-- Logs begin at Mon 2022-07-25 13:33:40 UTC, end at Mon 2022-07-25 16:12:07 UTC. -- Jul 25 14:14:45.531725 n-d-846435-14 systemd[1]: Starting Devstack devstack@n-api.service... Jul 25 14:14:45.541232 n-d-846435-14 devstack@n-api.service[103961]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 25 14:14:45.543202 n-d-846435-14 devstack@n-api.service[103961]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 14:14:45 2022] *** Jul 25 14:14:45.543202 n-d-846435-14 devstack@n-api.service[103961]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 14:14:45.543202 n-d-846435-14 devstack@n-api.service[103961]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 14:14:45.543202 n-d-846435-14 devstack@n-api.service[103961]: nodename: n-d-846435-14 Jul 25 14:14:45.543202 n-d-846435-14 devstack@n-api.service[103961]: machine: x86_64 Jul 25 14:14:45.543202 n-d-846435-14 devstack@n-api.service[103961]: clock source: unix Jul 25 14:14:45.543202 n-d-846435-14 devstack@n-api.service[103961]: pcre jit disabled Jul 25 14:14:45.543202 n-d-846435-14 devstack@n-api.service[103961]: detected number of CPU cores: 4 Jul 25 14:14:45.543202 n-d-846435-14 devstack@n-api.service[103961]: current working directory: / Jul 25 14:14:45.543202 n-d-846435-14 devstack@n-api.service[103961]: detected binary path: /usr/bin/uwsgi-core Jul 25 14:14:45.543787 n-d-846435-14 devstack@n-api.service[103961]: your processes number limit is 47680 Jul 25 14:14:45.543787 n-d-846435-14 devstack@n-api.service[103961]: your memory page size is 4096 bytes Jul 25 14:14:45.543787 n-d-846435-14 devstack@n-api.service[103961]: detected max file descriptor number: 2048 Jul 25 14:14:45.543787 n-d-846435-14 devstack@n-api.service[103961]: lock engine: pthread robust mutexes Jul 25 14:14:45.543787 n-d-846435-14 devstack@n-api.service[103961]: thunder lock: enabled Jul 25 14:14:45.543787 n-d-846435-14 devstack@n-api.service[103961]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 25 14:14:45.543787 n-d-846435-14 devstack@n-api.service[103961]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 14:14:45.582016 n-d-846435-14 devstack@n-api.service[103961]: Python main interpreter initialized at 0x55cb541c79c0 Jul 25 14:14:45.582016 n-d-846435-14 devstack@n-api.service[103961]: python threads support enabled Jul 25 14:14:45.582016 n-d-846435-14 devstack@n-api.service[103961]: your server socket listen backlog is limited to 100 connections Jul 25 14:14:45.582016 n-d-846435-14 devstack@n-api.service[103961]: your mercy for graceful operations on workers is 90 seconds Jul 25 14:14:45.582410 n-d-846435-14 devstack@n-api.service[103961]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 14:14:45.582410 n-d-846435-14 devstack@n-api.service[103961]: *** Operational MODE: preforking *** Jul 25 14:14:45.582692 n-d-846435-14 devstack@n-api.service[103961]: *** uWSGI is running in multiple interpreter mode *** Jul 25 14:14:45.582692 n-d-846435-14 devstack@n-api.service[103961]: spawned uWSGI master process (pid: 103961) Jul 25 14:14:45.582915 n-d-846435-14 systemd[1]: Started Devstack devstack@n-api.service. Jul 25 14:14:45.583757 n-d-846435-14 devstack@n-api.service[103961]: spawned uWSGI worker 1 (pid: 103962, cores: 1) Jul 25 14:14:45.583757 n-d-846435-14 devstack@n-api.service[103961]: spawned uWSGI worker 2 (pid: 103963, cores: 1) Jul 25 14:14:45.583921 n-d-846435-14 devstack@n-api.service[103961]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 14:14:46.235469 n-d-846435-14 devstack@n-api.service[103962]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 14:14:46.236132 n-d-846435-14 devstack@n-api.service[103963]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 14:14:47.311424 n-d-846435-14 devstack@n-api.service[103962]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 14:14:47.311424 n-d-846435-14 devstack@n-api.service[103962]: from cryptography.utils import int_from_bytes Jul 25 14:14:47.312082 n-d-846435-14 devstack@n-api.service[103962]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 14:14:47.312082 n-d-846435-14 devstack@n-api.service[103962]: from cryptography.utils import int_from_bytes Jul 25 14:14:47.313226 n-d-846435-14 devstack@n-api.service[103963]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 14:14:47.313226 n-d-846435-14 devstack@n-api.service[103963]: from cryptography.utils import int_from_bytes Jul 25 14:14:47.313684 n-d-846435-14 devstack@n-api.service[103963]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 14:14:47.313684 n-d-846435-14 devstack@n-api.service[103963]: from cryptography.utils import int_from_bytes Jul 25 14:14:49.770773 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 14:14:49.771315 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 14:14:49.771401 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 14:14:49.771789 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 14:14:49.772081 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 14:14:49.772644 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.772764 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.773097 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.773411 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.773734 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.774013 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.774167 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 14:14:49.774610 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.774708 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 14:14:49.774790 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.774942 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 14:14:49.775043 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.775202 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.775301 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 14:14:49.775513 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.775603 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 14:14:49.775835 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-846435-14 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.775924 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.776177 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.776269 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.776485 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.776590 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.776795 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.776891 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.777088 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.777196 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.777392 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.777496 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.777710 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.777820 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.778010 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.778102 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.778408 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.778589 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.778752 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.778985 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.779121 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.779250 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.779374 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-846435-14 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.779571 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.779712 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.779885 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.780053 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.780202 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.780324 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.780515 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.781125 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.781125 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.781358 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.781358 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.781624 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.781624 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.781833 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.781833 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.782041 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.782149 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-846435-14 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.782261 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.782436 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.782608 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.782742 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.782864 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.783009 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.783139 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.783401 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.783550 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.783706 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.783849 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.784023 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.784169 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.784305 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.784426 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.784679 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.784773 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.785008 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.785168 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.785308 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.785404 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-846435-14 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.785650 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.785782 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.785941 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.786051 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.786285 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.786432 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.786599 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.786731 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.786895 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.787039 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.787198 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.787341 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.787516 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.787649 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.787816 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.787962 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.788122 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.788222 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.788385 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.788527 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.788669 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.788846 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.788978 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.789168 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.789300 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.789471 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.789575 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.789775 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.789873 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.790053 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.790141 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.790363 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.790469 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.790680 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.790778 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.790982 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.791072 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.791288 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.791382 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.791537 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.791625 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.791844 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.791940 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.792190 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.792289 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.792494 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.792581 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.792794 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.792882 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.793025 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.793108 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.793287 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.793378 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.793608 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.793705 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.793928 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.794017 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.794219 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.794303 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.794529 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.794623 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.794835 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.794986 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.88 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.795140 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.795268 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.88 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.795443 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.795573 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.795748 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.795875 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.796078 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.796223 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.796386 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.796516 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.796701 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.796840 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.797014 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.797163 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.797612 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.797751 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.797915 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.798045 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.798216 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.798344 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.798531 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.798666 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.88 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.798856 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.88 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.798982 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.799155 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.799294 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.799435 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.799566 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.799698 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.799828 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.799966 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.800203 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.800348 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.800475 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.800650 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.800796 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.800951 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.801103 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.801252 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.801409 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.801548 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.801717 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.801848 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.802036 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.802132 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.802552 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.802654 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.802734 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.802811 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.802900 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.802990 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.803207 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.803295 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.803508 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.803602 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.803825 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.803910 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.804158 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.804244 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.804466 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.804566 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.804771 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.804855 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.805071 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.805163 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.805371 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.805467 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.805669 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.805754 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.805970 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.806055 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.806272 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.806362 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.806573 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.806663 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.806872 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.806961 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.807175 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.807315 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.807474 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.807557 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.807772 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.807855 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.808103 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.808204 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.808408 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.808499 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.808709 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.808835 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.809011 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.809097 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.809304 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.809387 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.809603 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.809689 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.809915 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.810019 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.810217 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.810310 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.810517 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.810599 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.810812 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.810907 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.811112 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.811196 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.811410 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.811501 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.811710 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.811806 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.812021 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.812108 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.812324 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.812418 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.812620 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.812705 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.812920 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.813002 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.813226 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.813317 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.813528 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.813612 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.813831 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.813914 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.814133 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.814214 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.814434 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.814519 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.814737 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.814827 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.815038 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.815132 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.815341 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.815425 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.815666 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.815759 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.816012 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.816122 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.816290 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.816376 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.816606 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.816758 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.816923 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.817067 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.817231 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.817380 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.817537 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.817667 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.817841 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.817973 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.818158 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:14:49.818287 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.818463 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.818601 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.818779 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.818872 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.819094 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.819221 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.819425 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.819553 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.819739 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.819872 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.820075 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.820206 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.820390 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.820551 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.820719 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.820866 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.821009 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.821166 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.821304 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.821432 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.821609 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.821746 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.821915 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.822044 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.822224 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.822350 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.822561 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.822713 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.822848 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.822979 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.823157 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.823298 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.823472 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.823602 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.823776 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.823904 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.824090 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.824228 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.824399 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.824549 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.824712 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.824839 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.825038 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.825174 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.825347 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.825478 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.825654 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.825793 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.825961 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.826113 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.826267 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.826402 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.826573 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.826701 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.826880 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.827016 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.827185 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.827321 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.827517 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.827649 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.827826 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.827963 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.828148 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.828234 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.828458 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.828597 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.828769 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.828897 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.829077 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.829208 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.829383 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.829471 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.829691 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.829826 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.829994 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.830137 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.830293 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.830429 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.830593 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.830719 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.830883 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.831011 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.831183 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.831349 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.831578 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.831706 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.831893 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.832069 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.832221 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.832357 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.832533 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.832685 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.832818 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.832951 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.833128 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.833267 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.833434 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.833577 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.833737 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.833864 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.834036 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.834174 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.834341 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.834490 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.834630 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.834762 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.834902 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.835034 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.835222 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.835351 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.835527 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.835658 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.835829 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.835959 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.836172 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.836307 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.836461 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.836592 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.836761 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.836891 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.837069 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.837203 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.837375 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.837507 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.837679 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.837812 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.837985 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.838114 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.838289 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.838430 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.838594 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.838680 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.838910 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.839000 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.839217 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.839315 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.839521 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.839604 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.839841 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.839924 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.840168 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.840267 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.840470 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.840554 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.840787 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.840872 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.841096 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.841189 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.841394 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.841484 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.841700 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.841791 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.842001 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.842095 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.842300 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.842384 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.842598 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.842681 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.842903 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.842996 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.843204 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.843295 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.843503 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.843586 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.843800 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.843911 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.844123 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.844288 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.844430 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.844633 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.844743 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.844989 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.845077 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.845316 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.845412 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.845616 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.845702 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.845913 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.846004 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.846251 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.846338 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.846552 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.846640 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.846915 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.847008 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.847247 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.847332 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.847593 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.847693 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.847909 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.848038 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.848243 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.848328 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.848559 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.848658 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.848866 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.848961 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.849177 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.849334 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.849465 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.849605 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.849772 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.849904 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.850080 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.850247 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.850439 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.850634 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.850817 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.851030 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.851223 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.851443 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.851578 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.851712 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.851843 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.852034 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.852166 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.852310 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.852451 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.852594 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.852727 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.852860 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.852999 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.853135 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.853270 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.853396 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.853526 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.853670 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.853818 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.853948 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.854076 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.854204 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.854347 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.854479 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.854618 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.854749 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.854880 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.855010 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.855181 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.855310 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.855493 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.855628 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.855809 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.855937 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.856141 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.856290 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.856455 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.856596 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.856761 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.856893 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.857078 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.857220 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.857384 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.857518 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.857697 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.857870 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.858000 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.858150 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.858282 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.858414 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.858605 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.858752 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.858928 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.859070 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.859236 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.859364 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.859545 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.859628 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.859861 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.859954 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.860192 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.860282 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.860501 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.860587 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.860808 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.860894 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.861109 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.861192 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.861410 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.861493 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.861716 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.861810 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.862017 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.862107 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.862320 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.862403 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.862655 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.862789 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.862955 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.863124 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.863262 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.863435 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.863566 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.863746 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.863864 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.864090 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.864179 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.864400 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.864486 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.864711 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.864804 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.865023 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.865107 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.865330 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.865424 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.865635 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.865719 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.865944 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.866050 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.866249 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.866347 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.866558 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.866672 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.866859 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.866946 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.867158 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.867246 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.867455 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.867552 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.867754 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.867864 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.868094 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.868191 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.868394 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.868482 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.868691 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.868803 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.869005 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.869103 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.869307 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.869416 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.869613 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.869717 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.869921 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.870008 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.870222 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.870308 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.870526 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.870621 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.870844 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.870931 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.871149 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.871234 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.871450 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.871623 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.871739 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.871823 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.872061 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.872165 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.872366 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.872461 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.872671 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.872764 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.872988 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.873074 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.873293 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.873395 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.873599 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.873703 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.873905 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.873999 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.874202 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.874298 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.874506 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.874600 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.874811 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.874913 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.875132 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.875395 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.875503 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.875729 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.875823 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.876062 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.876171 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.876373 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.876468 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.876685 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.876779 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.876995 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.877089 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.877325 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.877435 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.877620 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.877716 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.877929 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.878025 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.878301 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.878412 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.878604 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.878690 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.878910 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.879019 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.879212 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.879317 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.879517 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.879782 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.879876 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.880132 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.880222 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.880437 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.880519 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.880743 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.880853 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.881043 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.881130 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.881342 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.881436 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.881640 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.881735 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.881940 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.882025 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.882248 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.882335 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.882548 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.882644 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.882853 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.882941 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.883152 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.883237 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.883455 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.883545 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.883759 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.883854 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.884082 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.884178 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.884459 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.884591 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.884721 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.884918 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.885004 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.885082 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.885267 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.885395 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.885568 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.885730 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.885882 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.886057 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.886143 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.886403 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.886492 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.886809 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.886920 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.887001 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.887087 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.887314 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.887400 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.887613 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.887697 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.887912 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.888050 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.888238 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.888385 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.888545 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.888631 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.888852 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.888952 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.889153 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.889253 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.889463 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.889560 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.889767 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.889867 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.890073 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.890162 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.890377 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.890470 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.890675 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.890775 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.890983 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.891069 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.891281 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.891368 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.891589 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.891687 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.891893 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.892013 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.892215 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.892301 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.892514 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.892602 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.892819 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.892907 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.893124 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.893210 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.893426 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.893526 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.893752 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.893836 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.894054 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.894183 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.894366 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.894482 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.894660 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.894745 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.894960 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.895055 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.895258 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.895343 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.895562 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.895648 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.895864 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.895956 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.896192 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.896279 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.896490 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.896577 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.896800 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.896894 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.897099 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.897192 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.897399 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.897483 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.897702 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.897798 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.898000 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.898093 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.898296 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.898380 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.898600 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.898779 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.898900 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.898984 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.899202 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.899298 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.899504 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.899621 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.899808 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.899919 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.900131 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.900226 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.900432 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.900529 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.900732 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.900818 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.901036 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.901121 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.901334 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.901429 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.901630 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.901715 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.901925 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.902012 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.902224 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.902317 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.902522 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.902657 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.902840 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.903050 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.903184 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.903323 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.903456 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.903601 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.903734 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.903876 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.904030 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.904172 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.904335 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.904464 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.904633 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.904776 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.904939 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.905075 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.905241 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.905371 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.905540 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.905680 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.905838 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.905968 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.906138 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.906267 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.906439 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.906576 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.906759 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.906889 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.907056 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.907194 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.907342 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.907483 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.907645 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.907778 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.907944 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.908079 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.908267 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.908354 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.908569 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.908653 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.908885 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.908970 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.909192 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.909279 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.909596 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.909719 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.909910 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.910017 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.910223 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.910318 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.910551 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.910652 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.910832 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.910964 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.911137 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.911239 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.911444 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.911546 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.911750 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.911853 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.912080 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.912176 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.912384 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.912477 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.912685 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.912785 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.912990 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.913074 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.913300 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.913393 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.913607 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.913699 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.913914 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.914001 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.914219 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.914318 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.914526 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.914620 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.914832 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.914916 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.915134 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.915227 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.915443 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.915527 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.915752 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.915839 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.916075 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.916163 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.916381 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.916467 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.916680 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.916764 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.916988 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.917072 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.917288 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.917382 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.917598 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.917717 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.917908 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.918027 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.918216 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.918334 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.918529 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.918627 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.918844 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.918949 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.919145 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.919231 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.919470 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.919562 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.919782 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.919874 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.920120 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.920207 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.920431 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.920515 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.920745 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.920842 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.921059 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.921153 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.921363 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.921448 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.921704 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.921798 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.922005 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.922090 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.922636 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.922727 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.922960 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.923053 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.923263 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.923347 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.923568 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.923668 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.923870 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.923964 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.924213 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.924308 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.924516 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.924609 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.924831 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.924917 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.925348 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.925446 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.925572 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.925665 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.925877 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.925973 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.926176 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.926287 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.926477 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.926598 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.926789 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.926912 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.927114 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.927209 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.927420 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.927514 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.927723 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.927834 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.928052 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.928161 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.928376 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.928473 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.928680 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.928765 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.929003 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.929100 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.929374 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.929459 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.929682 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.929756 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.929993 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.930084 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.930295 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.930393 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.930615 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.930748 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.930934 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.931019 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.931240 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.931324 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.931556 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.931642 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.931936 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.932033 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.932265 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.932351 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.932578 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.932710 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.932888 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.932972 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.933206 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.933289 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.933509 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.933631 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.933807 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.933893 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.934111 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.934213 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.934411 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.934495 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.934709 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.934793 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.935025 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.935119 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.935331 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.935423 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.935636 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.935720 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.935940 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.936067 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.936265 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.936386 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.936564 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.936700 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.936863 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.937093 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.937190 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.937353 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.937465 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.937680 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.937784 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.938041 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.938144 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.938343 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.938437 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.938670 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.938765 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.938970 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.939053 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.939290 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.939385 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.939594 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.939690 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.939894 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.940099 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.940219 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.940307 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.940520 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.940621 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.940933 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.941041 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.941192 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.941280 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.941515 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.941605 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.941819 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.941905 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.942140 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.942227 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.942454 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.942543 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.942776 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.942870 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.943087 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.943172 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.943394 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.943482 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.943710 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.943806 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.944038 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.944127 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.944343 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.944450 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.944648 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.944743 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.944952 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.945045 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.945260 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.945354 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.945655 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.945756 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.945861 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.945962 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.946166 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.946252 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.946466 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.946553 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.946764 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.946860 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.947124 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.947225 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.947381 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.947470 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.947683 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.947780 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.948021 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.948217 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.948333 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.948419 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.948635 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.948724 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.948937 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.949031 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.949235 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.949329 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.949573 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.949670 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.949877 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.949962 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.950179 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.950335 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.950487 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.950624 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.950760 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.950909 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.951064 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.951194 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.951363 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.951497 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.951685 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.951820 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.952006 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.952152 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.952330 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.952472 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.952641 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.952770 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.952949 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.953094 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.953262 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.953404 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.953573 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.953702 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.953885 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.954030 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.954191 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.954321 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.954504 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.954633 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.954818 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.954965 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.955130 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.955258 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.955469 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.955659 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.955796 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.955999 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.956133 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.956338 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.956467 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.956651 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.956863 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.956999 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.957131 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.957258 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.957385 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.957548 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.957697 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.957856 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.957985 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.958161 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.958290 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.958467 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.958606 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.958775 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.958911 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.959097 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.959245 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.959416 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.959505 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.959734 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.959942 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.960093 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.960296 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.960396 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.960617 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.960702 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.960931 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.961016 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.961244 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.961342 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.961558 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.961642 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.961871 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.961956 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.962183 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.962270 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.962493 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.962579 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.962803 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.962888 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.963110 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.963195 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.963419 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.963504 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.963725 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.963819 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.964057 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.964149 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.964367 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.964451 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.964673 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.964772 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.964981 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.965071 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.965296 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.965391 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.965604 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.965700 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.965923 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.966008 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.966252 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.966341 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.966554 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.966652 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.966865 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.966956 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.967175 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.967259 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.967485 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.967572 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.967790 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.968016 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.968132 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.968331 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.968433 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.968661 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.968749 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.968982 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.969068 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.969301 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.969387 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.969615 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.969699 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.969927 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.970018 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.970247 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.970332 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.970548 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.970635 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.970848 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.970940 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.971153 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.971239 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.971458 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.971542 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.971756 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.971850 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.972148 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.972372 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.972457 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.972688 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.972775 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.973022 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.973109 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.973337 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.973429 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.973658 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.973870 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.973966 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.974223 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.974313 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.974541 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.974641 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.974866 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.975003 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.975166 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.975250 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.975474 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.975568 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.975783 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.975870 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.976128 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.976218 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.976435 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.976531 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.976739 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.976826 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.977050 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.977135 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.977359 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.977466 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.977661 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.977754 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.977964 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.978273 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.978357 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.978580 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.978673 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.978879 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.978964 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.979187 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.979297 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.979488 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.979648 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.979812 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.980017 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.980143 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.980356 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.980455 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.980711 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.980809 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.981025 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.981110 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.981325 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.981424 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.981624 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.981711 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.981925 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.982013 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.982221 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.982315 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.982527 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.982612 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.982826 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.982912 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.983129 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.983215 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.983428 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.983513 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.983735 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.983819 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.984062 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.984193 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.984369 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.984456 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.984714 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.984810 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.985016 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.985103 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.985316 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.985402 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.985612 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.985697 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.985914 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.986000 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.986217 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.986305 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.986518 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.986611 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.986819 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.986907 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.987123 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.987222 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.987422 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.987515 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.987755 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.987840 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.988081 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.988332 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.988421 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.988663 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.988749 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.988978 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.989064 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.989306 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.989392 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.989634 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.989729 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.989940 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.990052 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.990239 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.990338 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.990538 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.990661 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.990858 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.990953 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.991165 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.991259 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.991470 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.991590 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.991775 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.991925 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.992104 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.992295 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.992411 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.992640 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.992728 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.993007 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.993189 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.993311 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.993524 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.993616 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.993845 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.993930 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.994181 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.994312 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.994483 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.994567 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.994786 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.994870 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.995095 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.995225 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.995396 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.995488 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.995719 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.995812 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.996051 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.996141 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.996362 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.996445 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.996669 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.996763 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.996972 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.997055 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.997275 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.997360 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.997578 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.997671 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.997883 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.997968 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.998188 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.998271 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.998496 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.998589 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.998803 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.998889 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.999100 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.999184 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.999407 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.999512 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.999716 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:49.999821 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.000051 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.000169 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.000393 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.000480 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.000717 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.000808 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.001034 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.001122 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.001349 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.001435 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.001663 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.001748 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.001977 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.002070 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.002281 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.002367 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.002588 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.002672 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.002898 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.002995 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.003283 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.003398 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.003593 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.003692 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.003894 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.004023 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.004223 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.004315 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.004517 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.004634 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.004821 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.004949 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.005137 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.005269 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.005440 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.005589 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.005738 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.005896 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.006034 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.006219 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.006338 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.006542 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.006637 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.006851 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.006943 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.007167 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.007253 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.007476 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.007571 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.007783 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.007867 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.008108 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.008210 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.008406 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.008493 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.008707 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.008791 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.009003 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.009088 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.009302 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.009389 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.009598 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.009682 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.009903 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.009988 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.010200 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.010286 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.010500 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.010594 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.010795 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.010894 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.011092 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.011176 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.011390 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.011474 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.011691 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.011783 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.012014 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.012102 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.012320 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.012417 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.012622 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.012717 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.012929 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.013014 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.013231 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.013316 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.013533 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.013637 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.013832 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.013917 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.014132 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.014217 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.014434 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.014531 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.014736 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.014823 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.015042 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.015127 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.015343 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.015429 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.015646 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.015733 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.015946 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.016089 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.016277 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.016363 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.016585 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.016670 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.016892 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.016977 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.017216 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.017301 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.017540 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.017624 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.017844 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.017936 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.018168 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.018251 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.018480 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.018563 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.018814 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.018907 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.019126 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.019210 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.019436 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.019520 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.019748 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.019840 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.020081 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.020176 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.020384 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.020468 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.020693 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.020825 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.021005 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.021126 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.021307 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.021396 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.021616 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.021705 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.021924 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.022011 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.022227 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.022345 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.022539 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.022629 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.022850 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.022936 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.023151 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.023236 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.023476 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.023564 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.023782 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.023876 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.024128 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.024232 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.024447 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.024550 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.024759 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.024862 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.025087 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.025188 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.025413 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.025499 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.025710 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.025813 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.026020 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.026116 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.026326 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.026412 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.026625 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.026711 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.026865 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 14:14:50.026979 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.027233 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.027541 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.027873 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.028217 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.028548 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.028874 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.029185 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.029510 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.029834 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.030182 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.030492 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.030838 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.031168 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.031484 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.031796 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.032124 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:14:50.032369 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 14:14:50.181303 n-d-846435-14 devstack@n-api.service[103962]: INFO dbcounter [None req-71f288b0-05ab-46e8-a3e5-3fce646a3801 None None] Registered counter for database nova_api Jul 25 14:14:50.186776 n-d-846435-14 devstack@n-api.service[103963]: INFO dbcounter [None req-7de1754c-c573-479e-bcb6-e7c3ed84be88 None None] Registered counter for database nova_api Jul 25 14:14:50.203444 n-d-846435-14 devstack@n-api.service[103962]: DEBUG oslo_db.sqlalchemy.engines [None req-71f288b0-05ab-46e8-a3e5-3fce646a3801 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103962) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 14:14:50.209359 n-d-846435-14 devstack@n-api.service[103963]: DEBUG oslo_db.sqlalchemy.engines [None req-7de1754c-c573-479e-bcb6-e7c3ed84be88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103963) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 14:14:50.210723 n-d-846435-14 devstack@n-api.service[103962]: DEBUG dbcounter [-] [103962] Writer thread running {{(pid=103962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 14:14:50.216658 n-d-846435-14 devstack@n-api.service[103963]: DEBUG dbcounter [-] [103963] Writer thread running {{(pid=103963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 14:14:50.266656 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.context [None req-71f288b0-05ab-46e8-a3e5-3fce646a3801 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cadb07ed-5464-41eb-afb8-bf9dd92401b6(cell1) {{(pid=103962) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 14:14:50.270813 n-d-846435-14 devstack@n-api.service[103962]: DEBUG oslo_concurrency.lockutils [None req-71f288b0-05ab-46e8-a3e5-3fce646a3801 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:14:50.272517 n-d-846435-14 devstack@n-api.service[103962]: DEBUG oslo_concurrency.lockutils [None req-71f288b0-05ab-46e8-a3e5-3fce646a3801 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:14:50.273273 n-d-846435-14 devstack@n-api.service[103962]: DEBUG oslo_concurrency.lockutils [None req-71f288b0-05ab-46e8-a3e5-3fce646a3801 None None] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:14:50.274146 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.context [None req-7de1754c-c573-479e-bcb6-e7c3ed84be88 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cadb07ed-5464-41eb-afb8-bf9dd92401b6(cell1) {{(pid=103963) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 14:14:50.275275 n-d-846435-14 devstack@n-api.service[103962]: DEBUG oslo_concurrency.lockutils [None req-71f288b0-05ab-46e8-a3e5-3fce646a3801 None None] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:14:50.277316 n-d-846435-14 devstack@n-api.service[103962]: INFO dbcounter [None req-71f288b0-05ab-46e8-a3e5-3fce646a3801 None None] Registered counter for database nova_cell0 Jul 25 14:14:50.278301 n-d-846435-14 devstack@n-api.service[103963]: DEBUG oslo_concurrency.lockutils [None req-7de1754c-c573-479e-bcb6-e7c3ed84be88 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:14:50.280014 n-d-846435-14 devstack@n-api.service[103963]: DEBUG oslo_concurrency.lockutils [None req-7de1754c-c573-479e-bcb6-e7c3ed84be88 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:14:50.280830 n-d-846435-14 devstack@n-api.service[103963]: DEBUG oslo_concurrency.lockutils [None req-7de1754c-c573-479e-bcb6-e7c3ed84be88 None None] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:14:50.283016 n-d-846435-14 devstack@n-api.service[103963]: DEBUG oslo_concurrency.lockutils [None req-7de1754c-c573-479e-bcb6-e7c3ed84be88 None None] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:14:50.283160 n-d-846435-14 devstack@n-api.service[103962]: INFO dbcounter [None req-71f288b0-05ab-46e8-a3e5-3fce646a3801 None None] Registered counter for database nova_cell1 Jul 25 14:14:50.285244 n-d-846435-14 devstack@n-api.service[103963]: INFO dbcounter [None req-7de1754c-c573-479e-bcb6-e7c3ed84be88 None None] Registered counter for database nova_cell0 Jul 25 14:14:50.290276 n-d-846435-14 devstack@n-api.service[103962]: DEBUG oslo_db.sqlalchemy.engines [None req-71f288b0-05ab-46e8-a3e5-3fce646a3801 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103962) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 14:14:50.291221 n-d-846435-14 devstack@n-api.service[103963]: INFO dbcounter [None req-7de1754c-c573-479e-bcb6-e7c3ed84be88 None None] Registered counter for database nova_cell1 Jul 25 14:14:50.292468 n-d-846435-14 devstack@n-api.service[103962]: DEBUG oslo_db.sqlalchemy.engines [None req-71f288b0-05ab-46e8-a3e5-3fce646a3801 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103962) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 14:14:50.300048 n-d-846435-14 devstack@n-api.service[103962]: DEBUG dbcounter [-] [103962] Writer thread running {{(pid=103962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 14:14:50.300297 n-d-846435-14 devstack@n-api.service[103963]: DEBUG oslo_db.sqlalchemy.engines [None req-7de1754c-c573-479e-bcb6-e7c3ed84be88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103963) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 14:14:50.301406 n-d-846435-14 devstack@n-api.service[103963]: DEBUG oslo_db.sqlalchemy.engines [None req-7de1754c-c573-479e-bcb6-e7c3ed84be88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103963) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 14:14:50.302492 n-d-846435-14 devstack@n-api.service[103962]: DEBUG dbcounter [-] [103962] Writer thread running {{(pid=103962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 14:14:50.308883 n-d-846435-14 devstack@n-api.service[103963]: DEBUG dbcounter [-] [103963] Writer thread running {{(pid=103963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 14:14:50.313661 n-d-846435-14 devstack@n-api.service[103963]: DEBUG dbcounter [-] [103963] Writer thread running {{(pid=103963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 14:14:50.445972 n-d-846435-14 devstack@n-api.service[103962]: INFO dbcounter [None req-71f288b0-05ab-46e8-a3e5-3fce646a3801 None None] Registered counter for database nova_cell0 Jul 25 14:14:50.455252 n-d-846435-14 devstack@n-api.service[103962]: DEBUG oslo_db.sqlalchemy.engines [None req-71f288b0-05ab-46e8-a3e5-3fce646a3801 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103962) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 14:14:50.457708 n-d-846435-14 devstack@n-api.service[103963]: INFO dbcounter [None req-7de1754c-c573-479e-bcb6-e7c3ed84be88 None None] Registered counter for database nova_cell0 Jul 25 14:14:50.460039 n-d-846435-14 devstack@n-api.service[103962]: DEBUG dbcounter [-] [103962] Writer thread running {{(pid=103962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 14:14:50.467118 n-d-846435-14 devstack@n-api.service[103963]: DEBUG oslo_db.sqlalchemy.engines [None req-7de1754c-c573-479e-bcb6-e7c3ed84be88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103963) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 14:14:50.472302 n-d-846435-14 devstack@n-api.service[103963]: DEBUG dbcounter [-] [103963] Writer thread running {{(pid=103963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 14:14:50.794197 n-d-846435-14 devstack@n-api.service[103962]: WARNING keystonemiddleware.auth_token [None req-71f288b0-05ab-46e8-a3e5-3fce646a3801 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 14:14:50.800246 n-d-846435-14 devstack@n-api.service[103963]: WARNING keystonemiddleware.auth_token [None req-7de1754c-c573-479e-bcb6-e7c3ed84be88 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 14:14:50.801961 n-d-846435-14 devstack@n-api.service[103962]: WARNING keystonemiddleware.auth_token [None req-71f288b0-05ab-46e8-a3e5-3fce646a3801 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 14:14:50.807491 n-d-846435-14 devstack@n-api.service[103963]: WARNING keystonemiddleware.auth_token [None req-7de1754c-c573-479e-bcb6-e7c3ed84be88 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 14:14:51.139054 n-d-846435-14 devstack@n-api.service[103962]: WARNING keystonemiddleware.auth_token [None req-71f288b0-05ab-46e8-a3e5-3fce646a3801 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 14:14:51.145035 n-d-846435-14 devstack@n-api.service[103962]: WARNING keystonemiddleware.auth_token [None req-71f288b0-05ab-46e8-a3e5-3fce646a3801 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 14:14:51.145175 n-d-846435-14 devstack@n-api.service[103963]: WARNING keystonemiddleware.auth_token [None req-7de1754c-c573-479e-bcb6-e7c3ed84be88 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 14:14:51.150367 n-d-846435-14 devstack@n-api.service[103962]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cb541c79c0 pid: 103962 (default app) Jul 25 14:14:51.151140 n-d-846435-14 devstack@n-api.service[103963]: WARNING keystonemiddleware.auth_token [None req-7de1754c-c573-479e-bcb6-e7c3ed84be88 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 14:14:51.152499 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-71f288b0-05ab-46e8-a3e5-3fce646a3801 None None] Calling method '>' {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:14:51.153665 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-71f288b0-05ab-46e8-a3e5-3fce646a3801 None None] 10.222.0.88 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001758 Jul 25 14:14:51.154083 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 1/1] 10.222.0.88 () {50 vars in 788 bytes} [Mon Jul 25 14:14:51 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:14:51.156574 n-d-846435-14 devstack@n-api.service[103963]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cb541c79c0 pid: 103963 (default app) Jul 25 14:16:08.075349 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-71f288b0-05ab-46e8-a3e5-3fce646a3801 None None] Calling method '>' {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:16:08.076520 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-71f288b0-05ab-46e8-a3e5-3fce646a3801 None None] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001606 Jul 25 14:16:08.076880 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 2/2] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 25 14:16:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:16:08.090354 n-d-846435-14 devstack@n-api.service[103963]: DEBUG dbcounter [-] [103963] Writing DB stats nova_api:SELECT=3 {{(pid=103963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:16:08.091329 n-d-846435-14 devstack@n-api.service[103963]: DEBUG dbcounter [-] [103963] Writing DB stats nova_cell0:SELECT=3 {{(pid=103963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:16:08.092348 n-d-846435-14 devstack@n-api.service[103963]: DEBUG dbcounter [-] [103963] Writing DB stats nova_cell1:SELECT=3 {{(pid=103963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:16:08.093415 n-d-846435-14 devstack@n-api.service[103963]: DEBUG dbcounter [-] [103963] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:16:09.021450 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-4db91b47-0f57-443a-ae61-a21914135616 admin admin] Calling method '>' {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:16:09.053341 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-4db91b47-0f57-443a-ae61-a21914135616 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.968536 Jul 25 14:16:09.054242 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 1/3] 10.222.0.88 () {60 vars in 1291 bytes} [Mon Jul 25 14:16:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:16:11.289038 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-71f288b0-05ab-46e8-a3e5-3fce646a3801 None None] Calling method '>' {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:16:11.290074 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-71f288b0-05ab-46e8-a3e5-3fce646a3801 None None] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jul 25 14:16:11.290461 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 3/4] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 25 14:16:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:16:11.845324 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-65884bcf-3e7b-4aeb-b8a7-d5b80e809453 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "disk": 1, "os-flavor-access:is_public": true, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "name": "cirros256"}} {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:16:11.867990 n-d-846435-14 devstack@n-api.service[103963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:16:11.867990 n-d-846435-14 devstack@n-api.service[103963]: warnings.warn(msg) Jul 25 14:16:11.904713 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-65884bcf-3e7b-4aeb-b8a7-d5b80e809453 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.599666 Jul 25 14:16:11.904713 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 2/5] 10.222.0.88 () {64 vars in 1282 bytes} [Mon Jul 25 14:16:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:16:11.915906 n-d-846435-14 devstack@n-api.service[103962]: DEBUG dbcounter [-] [103962] Writing DB stats nova_api:SELECT=3 {{(pid=103962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:16:11.918037 n-d-846435-14 devstack@n-api.service[103962]: DEBUG dbcounter [-] [103962] Writing DB stats nova_cell0:SELECT=3 {{(pid=103962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:16:11.919233 n-d-846435-14 devstack@n-api.service[103962]: DEBUG dbcounter [-] [103962] Writing DB stats nova_cell1:SELECT=3 {{(pid=103962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:16:11.920049 n-d-846435-14 devstack@n-api.service[103962]: DEBUG dbcounter [-] [103962] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:16:12.135056 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-28a5fc53-8077-4f02-9cfc-a7a2745a13ae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:16:12.139479 n-d-846435-14 devstack@n-api.service[103962]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:16:12.139479 n-d-846435-14 devstack@n-api.service[103962]: warnings.warn(msg) Jul 25 14:16:12.205534 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-28a5fc53-8077-4f02-9cfc-a7a2745a13ae admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.295717 Jul 25 14:16:12.206720 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 4/6] 10.222.0.88 () {64 vars in 1335 bytes} [Mon Jul 25 14:16:11 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:16:14.472027 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-65884bcf-3e7b-4aeb-b8a7-d5b80e809453 admin admin] Calling method '>' {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:16:14.473082 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-65884bcf-3e7b-4aeb-b8a7-d5b80e809453 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001691 Jul 25 14:16:14.473803 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 3/7] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 25 14:16:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:16:15.280129 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-8a7cd5cc-8ebc-4b2c-8c03-e1601490acaf admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 512, "name": "ds512M", "vcpus": 1, "swap": 0, "disk": 5, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:16:15.303948 n-d-846435-14 devstack@n-api.service[103962]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:16:15.303948 n-d-846435-14 devstack@n-api.service[103962]: warnings.warn(msg) Jul 25 14:16:15.326077 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-8a7cd5cc-8ebc-4b2c-8c03-e1601490acaf admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.846214 Jul 25 14:16:15.326866 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 5/8] 10.222.0.88 () {64 vars in 1282 bytes} [Mon Jul 25 14:16:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:16:15.339288 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-35a9fdb5-26e9-4c67-82d2-c30f3f7ca41c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:16:15.342231 n-d-846435-14 devstack@n-api.service[103963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:16:15.342231 n-d-846435-14 devstack@n-api.service[103963]: warnings.warn(msg) Jul 25 14:16:15.376981 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-35a9fdb5-26e9-4c67-82d2-c30f3f7ca41c admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041542 Jul 25 14:16:15.377607 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 4/9] 10.222.0.88 () {64 vars in 1335 bytes} [Mon Jul 25 14:16:15 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:16:17.738874 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-8a7cd5cc-8ebc-4b2c-8c03-e1601490acaf admin admin] Calling method '>' {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:16:17.740961 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-8a7cd5cc-8ebc-4b2c-8c03-e1601490acaf admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001802 Jul 25 14:16:17.741212 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 6/10] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 25 14:16:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:16:18.387664 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-cb49de96-1f55-4801-911d-78e92f79aba7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "vcpus": 1, "rxtx_factor": 1.0, "ram": 1024, "swap": 0, "disk": 10, "os-flavor-access:is_public": true}} {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:16:18.410097 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-cb49de96-1f55-4801-911d-78e92f79aba7 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.662517 Jul 25 14:16:18.416785 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 5/11] 10.222.0.88 () {64 vars in 1282 bytes} [Mon Jul 25 14:16:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 14:16:18.424765 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-a5e5b4b7-d5c3-4237-be91-1ce48b796f21 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:16:18.469230 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-a5e5b4b7-d5c3-4237-be91-1ce48b796f21 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048152 Jul 25 14:16:18.480421 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 7/12] 10.222.0.88 () {64 vars in 1335 bytes} [Mon Jul 25 14:16:18 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:16:20.755300 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-cb49de96-1f55-4801-911d-78e92f79aba7 admin admin] Calling method '>' {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:16:20.757010 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-cb49de96-1f55-4801-911d-78e92f79aba7 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002137 Jul 25 14:16:20.757595 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 6/13] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 25 14:16:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:16:21.166905 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-2849f105-7094-481c-848d-eccff68432a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "d3", "ram": 2048, "name": "ds2G", "vcpus": 2, "disk": 10}} {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:16:21.189479 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-2849f105-7094-481c-848d-eccff68432a3 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.425565 Jul 25 14:16:21.190015 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 8/14] 10.222.0.88 () {64 vars in 1282 bytes} [Mon Jul 25 14:16:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:16:21.207537 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-3f7538dd-d763-4df6-a8ee-873161c250b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:16:21.235764 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-3f7538dd-d763-4df6-a8ee-873161c250b4 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037316 Jul 25 14:16:21.240058 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 7/15] 10.222.0.88 () {64 vars in 1335 bytes} [Mon Jul 25 14:16:21 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:16:23.486866 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-2849f105-7094-481c-848d-eccff68432a3 admin admin] Calling method '>' {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:16:23.487935 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-2849f105-7094-481c-848d-eccff68432a3 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jul 25 14:16:23.488302 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 9/16] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 25 14:16:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:16:24.004647 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-8ca969cb-985d-42a9-a190-1a3895979817 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 20, "id": "d4", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "ram": 4096}} {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:16:24.025818 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-8ca969cb-985d-42a9-a190-1a3895979817 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.531173 Jul 25 14:16:24.026646 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 8/17] 10.222.0.88 () {64 vars in 1282 bytes} [Mon Jul 25 14:16:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:16:24.038766 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-d1e21ec0-df63-4eef-8e71-2cbd418839e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:16:24.068085 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-d1e21ec0-df63-4eef-8e71-2cbd418839e9 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032714 Jul 25 14:16:24.068536 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 10/18] 10.222.0.88 () {64 vars in 1335 bytes} [Mon Jul 25 14:16:24 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:16:26.489061 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-8ca969cb-985d-42a9-a190-1a3895979817 admin admin] Calling method '>' {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:16:26.491321 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-8ca969cb-985d-42a9-a190-1a3895979817 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002670 Jul 25 14:16:26.493334 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 9/19] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 25 14:16:26 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:16:26.992517 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-93ec8e45-8abe-4eee-94b8-8775c1ccb531 admin admin] Calling method '>' {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:16:27.019483 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-93ec8e45-8abe-4eee-94b8-8775c1ccb531 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.519833 Jul 25 14:16:27.036010 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 11/20] 10.222.0.88 () {60 vars in 1291 bytes} [Mon Jul 25 14:16:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:16:29.297902 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-8ca969cb-985d-42a9-a190-1a3895979817 admin admin] Calling method '>' {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:16:29.298911 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-8ca969cb-985d-42a9-a190-1a3895979817 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001843 Jul 25 14:16:29.299312 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 10/21] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 25 14:16:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:16:29.721977 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-4b74aea0-44cf-47d6-b37c-cf04e7a5aeef admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "swap": 0, "name": "m1.tiny", "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "ram": 512}} {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:16:29.741903 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-4b74aea0-44cf-47d6-b37c-cf04e7a5aeef admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.436216 Jul 25 14:16:29.742443 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 12/22] 10.222.0.88 () {64 vars in 1282 bytes} [Mon Jul 25 14:16:29 2022] POST /compute/v2.1/flavors => generated 402 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:16:29.754375 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-0b7eff66-fdcd-4b38-9c28-5f93b54fa2cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:16:29.780420 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-0b7eff66-fdcd-4b38-9c28-5f93b54fa2cd admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029771 Jul 25 14:16:29.781053 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 11/23] 10.222.0.88 () {64 vars in 1332 bytes} [Mon Jul 25 14:16:29 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:16:32.292630 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-4b74aea0-44cf-47d6-b37c-cf04e7a5aeef admin admin] Calling method '>' {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:16:32.293588 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-4b74aea0-44cf-47d6-b37c-cf04e7a5aeef admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001571 Jul 25 14:16:32.293999 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 13/24] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 25 14:16:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:16:32.747221 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-d05f999b-1759-4274-b9da-8139dc2c922a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "swap": 0, "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "name": "m1.small", "vcpus": 1}} {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:16:32.767078 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-d05f999b-1759-4274-b9da-8139dc2c922a admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.466060 Jul 25 14:16:32.767594 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 12/25] 10.222.0.88 () {64 vars in 1282 bytes} [Mon Jul 25 14:16:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:16:32.779559 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-289b49f6-364c-42d6-8917-e9fba4f9c3e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:16:32.806549 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-289b49f6-364c-42d6-8917-e9fba4f9c3e7 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030559 Jul 25 14:16:32.807104 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 14/26] 10.222.0.88 () {64 vars in 1332 bytes} [Mon Jul 25 14:16:32 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:16:34.975676 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-d05f999b-1759-4274-b9da-8139dc2c922a admin admin] Calling method '>' {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:16:34.976760 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-d05f999b-1759-4274-b9da-8139dc2c922a admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Jul 25 14:16:34.977157 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 13/27] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 25 14:16:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:16:35.389773 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-ff4b014e-305d-4ac8-b666-02aefbd5b47d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "id": "3", "ram": 4096, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 40, "rxtx_factor": 1.0}} {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:16:35.410205 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-ff4b014e-305d-4ac8-b666-02aefbd5b47d admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.426906 Jul 25 14:16:35.410662 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 15/28] 10.222.0.88 () {64 vars in 1282 bytes} [Mon Jul 25 14:16:34 2022] POST /compute/v2.1/flavors => generated 406 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:16:35.423496 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-7f493ae4-85de-4a17-8654-17b8286d5848 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:16:35.451868 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-7f493ae4-85de-4a17-8654-17b8286d5848 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032459 Jul 25 14:16:35.452482 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 14/29] 10.222.0.88 () {64 vars in 1332 bytes} [Mon Jul 25 14:16:35 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:16:37.656312 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-ff4b014e-305d-4ac8-b666-02aefbd5b47d admin admin] Calling method '>' {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:16:37.657518 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-ff4b014e-305d-4ac8-b666-02aefbd5b47d admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001686 Jul 25 14:16:37.657918 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 16/30] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 25 14:16:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:16:38.089244 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-0283c88b-4564-4252-909d-2f7a013e2e9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 80, "os-flavor-access:is_public": true, "ram": 8192, "id": "4", "name": "m1.large", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:16:38.109530 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-0283c88b-4564-4252-909d-2f7a013e2e9a admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.444839 Jul 25 14:16:38.110448 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 15/31] 10.222.0.88 () {64 vars in 1282 bytes} [Mon Jul 25 14:16:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:16:38.122677 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-ef7a5ab3-8edf-40fc-bdf8-802e1f6758f0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:16:38.149179 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-ef7a5ab3-8edf-40fc-bdf8-802e1f6758f0 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030371 Jul 25 14:16:38.150050 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 17/32] 10.222.0.88 () {64 vars in 1332 bytes} [Mon Jul 25 14:16:38 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:16:40.390818 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-0283c88b-4564-4252-909d-2f7a013e2e9a admin admin] Calling method '>' {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:16:40.391816 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-0283c88b-4564-4252-909d-2f7a013e2e9a admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 25 14:16:40.392441 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 16/33] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 25 14:16:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:16:40.850525 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-ae8ce96a-588b-45ee-a8df-6bd276e49f12 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "disk": 160, "swap": 0, "rxtx_factor": 1.0, "id": "5", "os-flavor-access:is_public": true, "vcpus": 8, "ram": 16384}} {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:16:40.872560 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-ae8ce96a-588b-45ee-a8df-6bd276e49f12 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.473559 Jul 25 14:16:40.873306 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 18/34] 10.222.0.88 () {64 vars in 1282 bytes} [Mon Jul 25 14:16:40 2022] POST /compute/v2.1/flavors => generated 408 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:16:40.887368 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-8a6dcd00-f5e8-4c08-b41d-894227d0adfe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:16:40.894531 n-d-846435-14 devstack@n-api.service[103963]: DEBUG dbcounter [-] [103963] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:16:40.918738 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-8a6dcd00-f5e8-4c08-b41d-894227d0adfe admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036043 Jul 25 14:16:40.919630 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 17/35] 10.222.0.88 () {64 vars in 1332 bytes} [Mon Jul 25 14:16:40 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:17:05.119598 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-ae8ce96a-588b-45ee-a8df-6bd276e49f12 admin admin] Calling method '>' {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:17:05.120640 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-ae8ce96a-588b-45ee-a8df-6bd276e49f12 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jul 25 14:17:05.121047 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 19/36] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 25 14:17:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:17:05.132106 n-d-846435-14 devstack@n-api.service[103963]: DEBUG dbcounter [-] [103963] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:17:05.549992 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-9424b7bb-2a17-480d-b9d3-7c90c6769321 admin admin] Calling method '>' {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:17:05.569132 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-9424b7bb-2a17-480d-b9d3-7c90c6769321 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.441221 Jul 25 14:17:05.569729 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 18/37] 10.222.0.88 () {60 vars in 1291 bytes} [Mon Jul 25 14:17:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:17:06.643616 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-ae8ce96a-588b-45ee-a8df-6bd276e49f12 admin admin] Calling method '>' {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:17:06.644657 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-ae8ce96a-588b-45ee-a8df-6bd276e49f12 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jul 25 14:17:06.645056 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 20/38] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Jul 25 14:17:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:17:07.257125 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-4e9febbd-8172-4691-8bbd-f87d84670d44 admin admin] Calling method '>' {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:17:07.262908 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.wsgi [None req-4e9febbd-8172-4691-8bbd-f87d84670d44 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 25 14:17:07.266311 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-4e9febbd-8172-4691-8bbd-f87d84670d44 admin admin] Request method failure captured: Jul 25 14:17:07.266311 n-d-846435-14 devstack@n-api.service[103963]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 25 14:17:07.266311 n-d-846435-14 devstack@n-api.service[103963]: Accept: application/json Jul 25 14:17:07.266311 n-d-846435-14 devstack@n-api.service[103963]: Accept-Encoding: gzip, deflate Jul 25 14:17:07.266311 n-d-846435-14 devstack@n-api.service[103963]: Connection: keep-alive Jul 25 14:17:07.266311 n-d-846435-14 devstack@n-api.service[103963]: Content-Length: 0 Jul 25 14:17:07.266311 n-d-846435-14 devstack@n-api.service[103963]: Host: 10.222.0.88 Jul 25 14:17:07.266311 n-d-846435-14 devstack@n-api.service[103963]: Openstack-Api-Version: compute 2.90 Jul 25 14:17:07.266311 n-d-846435-14 devstack@n-api.service[103963]: Openstack-System-Scope: None Jul 25 14:17:07.266311 n-d-846435-14 devstack@n-api.service[103963]: User-Agent: python-novaclient Jul 25 14:17:07.266311 n-d-846435-14 devstack@n-api.service[103963]: X-Auth-Token: gAAAAABi3qXiP7GE5Kk2Lrvmp8sDc_VT01FRL0bg7y4AKE9nQyOp9-Qjt-KaghE8jsxFGp5fvBfckYlldFQC-TKIsw8vlEa6nRrYABUpD1yNDnzdA1DESJhfuxByQ5cWliQCgSDcDNUHBtfcWME0k69pNXKDZPbl1TpuzCrjklYfhahWkignhvo Jul 25 14:17:07.266311 n-d-846435-14 devstack@n-api.service[103963]: X-Domain-Id: None Jul 25 14:17:07.266311 n-d-846435-14 devstack@n-api.service[103963]: X-Domain-Name: None Jul 25 14:17:07.266311 n-d-846435-14 devstack@n-api.service[103963]: X-Identity-Status: Confirmed Jul 25 14:17:07.266311 n-d-846435-14 devstack@n-api.service[103963]: X-Is-Admin-Project: True Jul 25 14:17:07.266311 n-d-846435-14 devstack@n-api.service[103963]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 14:17:07.266311 n-d-846435-14 devstack@n-api.service[103963]: X-Project-Domain-Id: default Jul 25 14:17:07.266311 n-d-846435-14 devstack@n-api.service[103963]: X-Project-Domain-Name: Default Jul 25 14:17:07.266311 n-d-846435-14 devstack@n-api.service[103963]: X-Project-Id: f7865a5063284db3bc5cfedce7e79271 Jul 25 14:17:07.266311 n-d-846435-14 devstack@n-api.service[103963]: X-Project-Name: admin Jul 25 14:17:07.266311 n-d-846435-14 devstack@n-api.service[103963]: X-Role: admin,reader,member Jul 25 14:17:07.266311 n-d-846435-14 devstack@n-api.service[103963]: X-Roles: admin,reader,member Jul 25 14:17:07.267893 n-d-846435-14 devstack@n-api.service[103963]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f7865a5063284db3bc5cfedce7e79271"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f7865a5063284db3bc5cfedce7e79271"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f7865a5063284db3bc5cfedce7e79271", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f7865a5063284db3bc5cfedce7e79271"}]}] Jul 25 14:17:07.267893 n-d-846435-14 devstack@n-api.service[103963]: X-Tenant: admin Jul 25 14:17:07.267893 n-d-846435-14 devstack@n-api.service[103963]: X-Tenant-Id: f7865a5063284db3bc5cfedce7e79271 Jul 25 14:17:07.267893 n-d-846435-14 devstack@n-api.service[103963]: X-Tenant-Name: admin Jul 25 14:17:07.267893 n-d-846435-14 devstack@n-api.service[103963]: X-User: admin Jul 25 14:17:07.267893 n-d-846435-14 devstack@n-api.service[103963]: X-User-Domain-Id: default Jul 25 14:17:07.267893 n-d-846435-14 devstack@n-api.service[103963]: X-User-Domain-Name: Default Jul 25 14:17:07.267893 n-d-846435-14 devstack@n-api.service[103963]: X-User-Id: e6691d7972b040efb48e33a902fca45f Jul 25 14:17:07.267893 n-d-846435-14 devstack@n-api.service[103963]: X-User-Name: admin Jul 25 14:17:07.267893 n-d-846435-14 devstack@n-api.service[103963]: method: > Jul 25 14:17:07.267893 n-d-846435-14 devstack@n-api.service[103963]: exception: Flavor 42 could not be found. Jul 25 14:17:07.267893 n-d-846435-14 devstack@n-api.service[103963]: action_args: {'id': '42'} Jul 25 14:17:07.267893 n-d-846435-14 devstack@n-api.service[103963]: {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:17:07.267893 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:17:07.268853 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 14:17:07.268853 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 14:17:07.268853 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 14:17:07.268853 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 14:17:07.268853 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:17:07.268853 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:17:07.268853 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 14:17:07.268853 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 14:17:07.268853 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 14:17:07.268853 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:17:07.268853 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 14:17:07.268853 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 14:17:07.268853 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 25 14:17:07.268853 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi Jul 25 14:17:07.268853 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:17:07.268853 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi Jul 25 14:17:07.268853 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:17:07.268853 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:17:07.268853 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:17:07.270103 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:17:07.270103 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:17:07.270103 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:17:07.270103 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:17:07.270103 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 14:17:07.270103 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:17:07.270103 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 25 14:17:07.270103 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi Jul 25 14:17:07.270103 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:17:07.270103 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi Jul 25 14:17:07.270103 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:17:07.270103 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:17:07.270103 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:17:07.270103 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:17:07.270103 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:17:07.270103 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 25 14:17:07.270103 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi Jul 25 14:17:07.270103 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-4e9febbd-8172-4691-8bbd-f87d84670d44 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:17:07.271128 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-4e9febbd-8172-4691-8bbd-f87d84670d44 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.418425 Jul 25 14:17:07.271128 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 19/39] 10.222.0.88 () {60 vars in 1190 bytes} [Mon Jul 25 14:17:06 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 420 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 14:17:07.278856 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-ec7c4363-4fe0-4af5-9d0b-98f8fd9f07e1 admin admin] Calling method '>' {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:17:07.285219 n-d-846435-14 devstack@n-api.service[103962]: DEBUG dbcounter [-] [103962] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:17:07.314422 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-ec7c4363-4fe0-4af5-9d0b-98f8fd9f07e1 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.039521 Jul 25 14:17:07.314992 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 21/40] 10.222.0.88 () {60 vars in 1210 bytes} [Mon Jul 25 14:17:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:17:07.330386 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-f941096d-b04a-4c9c-b947-21468c462dcf admin admin] Calling method '>' {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:17:07.354595 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-f941096d-b04a-4c9c-b947-21468c462dcf admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027821 Jul 25 14:17:07.355186 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 20/41] 10.222.0.88 () {60 vars in 1210 bytes} [Mon Jul 25 14:17:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:17:07.365495 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-e23a4caa-3c86-4bee-9768-d4b02a74f077 admin admin] Calling method '>' {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:17:07.371654 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.wsgi [None req-e23a4caa-3c86-4bee-9768-d4b02a74f077 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 25 14:17:07.374939 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-e23a4caa-3c86-4bee-9768-d4b02a74f077 admin admin] Request method failure captured: Jul 25 14:17:07.374939 n-d-846435-14 devstack@n-api.service[103962]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 25 14:17:07.374939 n-d-846435-14 devstack@n-api.service[103962]: Accept: application/json Jul 25 14:17:07.374939 n-d-846435-14 devstack@n-api.service[103962]: Accept-Encoding: gzip, deflate Jul 25 14:17:07.374939 n-d-846435-14 devstack@n-api.service[103962]: Connection: keep-alive Jul 25 14:17:07.374939 n-d-846435-14 devstack@n-api.service[103962]: Content-Length: 0 Jul 25 14:17:07.374939 n-d-846435-14 devstack@n-api.service[103962]: Host: 10.222.0.88 Jul 25 14:17:07.374939 n-d-846435-14 devstack@n-api.service[103962]: Openstack-Api-Version: compute 2.90 Jul 25 14:17:07.374939 n-d-846435-14 devstack@n-api.service[103962]: Openstack-System-Scope: None Jul 25 14:17:07.374939 n-d-846435-14 devstack@n-api.service[103962]: User-Agent: python-novaclient Jul 25 14:17:07.374939 n-d-846435-14 devstack@n-api.service[103962]: X-Auth-Token: gAAAAABi3qXiP7GE5Kk2Lrvmp8sDc_VT01FRL0bg7y4AKE9nQyOp9-Qjt-KaghE8jsxFGp5fvBfckYlldFQC-TKIsw8vlEa6nRrYABUpD1yNDnzdA1DESJhfuxByQ5cWliQCgSDcDNUHBtfcWME0k69pNXKDZPbl1TpuzCrjklYfhahWkignhvo Jul 25 14:17:07.374939 n-d-846435-14 devstack@n-api.service[103962]: X-Domain-Id: None Jul 25 14:17:07.374939 n-d-846435-14 devstack@n-api.service[103962]: X-Domain-Name: None Jul 25 14:17:07.374939 n-d-846435-14 devstack@n-api.service[103962]: X-Identity-Status: Confirmed Jul 25 14:17:07.374939 n-d-846435-14 devstack@n-api.service[103962]: X-Is-Admin-Project: True Jul 25 14:17:07.374939 n-d-846435-14 devstack@n-api.service[103962]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 14:17:07.374939 n-d-846435-14 devstack@n-api.service[103962]: X-Project-Domain-Id: default Jul 25 14:17:07.374939 n-d-846435-14 devstack@n-api.service[103962]: X-Project-Domain-Name: Default Jul 25 14:17:07.374939 n-d-846435-14 devstack@n-api.service[103962]: X-Project-Id: f7865a5063284db3bc5cfedce7e79271 Jul 25 14:17:07.374939 n-d-846435-14 devstack@n-api.service[103962]: X-Project-Name: admin Jul 25 14:17:07.374939 n-d-846435-14 devstack@n-api.service[103962]: X-Role: admin,reader,member Jul 25 14:17:07.374939 n-d-846435-14 devstack@n-api.service[103962]: X-Roles: admin,reader,member Jul 25 14:17:07.376390 n-d-846435-14 devstack@n-api.service[103962]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f7865a5063284db3bc5cfedce7e79271"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f7865a5063284db3bc5cfedce7e79271"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f7865a5063284db3bc5cfedce7e79271", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f7865a5063284db3bc5cfedce7e79271"}]}] Jul 25 14:17:07.376390 n-d-846435-14 devstack@n-api.service[103962]: X-Tenant: admin Jul 25 14:17:07.376390 n-d-846435-14 devstack@n-api.service[103962]: X-Tenant-Id: f7865a5063284db3bc5cfedce7e79271 Jul 25 14:17:07.376390 n-d-846435-14 devstack@n-api.service[103962]: X-Tenant-Name: admin Jul 25 14:17:07.376390 n-d-846435-14 devstack@n-api.service[103962]: X-User: admin Jul 25 14:17:07.376390 n-d-846435-14 devstack@n-api.service[103962]: X-User-Domain-Id: default Jul 25 14:17:07.376390 n-d-846435-14 devstack@n-api.service[103962]: X-User-Domain-Name: Default Jul 25 14:17:07.376390 n-d-846435-14 devstack@n-api.service[103962]: X-User-Id: e6691d7972b040efb48e33a902fca45f Jul 25 14:17:07.376390 n-d-846435-14 devstack@n-api.service[103962]: X-User-Name: admin Jul 25 14:17:07.376390 n-d-846435-14 devstack@n-api.service[103962]: method: > Jul 25 14:17:07.376390 n-d-846435-14 devstack@n-api.service[103962]: exception: Flavor 42 could not be found. Jul 25 14:17:07.376390 n-d-846435-14 devstack@n-api.service[103962]: action_args: {'id': '42'} Jul 25 14:17:07.376390 n-d-846435-14 devstack@n-api.service[103962]: {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:17:07.376390 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:17:07.379443 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 14:17:07.379443 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 14:17:07.379443 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 14:17:07.379443 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 14:17:07.379443 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:17:07.379443 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:17:07.379443 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 14:17:07.379443 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 14:17:07.379443 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 14:17:07.379443 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:17:07.379443 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 14:17:07.379443 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 14:17:07.379443 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 25 14:17:07.379443 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi Jul 25 14:17:07.379443 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:17:07.379443 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi Jul 25 14:17:07.379443 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:17:07.379443 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:17:07.379443 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:17:07.380693 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:17:07.380693 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:17:07.380693 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:17:07.380693 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:17:07.380693 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 14:17:07.380693 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:17:07.380693 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 25 14:17:07.380693 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi Jul 25 14:17:07.380693 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:17:07.380693 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi Jul 25 14:17:07.380693 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:17:07.380693 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:17:07.380693 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:17:07.380693 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:17:07.380693 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:17:07.380693 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 25 14:17:07.380693 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi Jul 25 14:17:07.380693 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-e23a4caa-3c86-4bee-9768-d4b02a74f077 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:17:07.381673 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-e23a4caa-3c86-4bee-9768-d4b02a74f077 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014962 Jul 25 14:17:07.381673 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 22/42] 10.222.0.88 () {60 vars in 1190 bytes} [Mon Jul 25 14:17:07 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 14:17:08.345397 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-f941096d-b04a-4c9c-b947-21468c462dcf admin admin] Calling method '>' {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:17:08.346438 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-f941096d-b04a-4c9c-b947-21468c462dcf admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Jul 25 14:17:08.346863 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 21/43] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Jul 25 14:17:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:17:08.899299 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-ef9bc174-bb65-4fe1-841f-fa81d3c5b2b0 admin admin] Calling method '>' {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:17:08.905915 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.wsgi [None req-ef9bc174-bb65-4fe1-841f-fa81d3c5b2b0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 25 14:17:08.907550 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-ef9bc174-bb65-4fe1-841f-fa81d3c5b2b0 admin admin] Request method failure captured: Jul 25 14:17:08.907550 n-d-846435-14 devstack@n-api.service[103962]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 25 14:17:08.907550 n-d-846435-14 devstack@n-api.service[103962]: Accept: application/json Jul 25 14:17:08.907550 n-d-846435-14 devstack@n-api.service[103962]: Accept-Encoding: gzip, deflate Jul 25 14:17:08.907550 n-d-846435-14 devstack@n-api.service[103962]: Connection: keep-alive Jul 25 14:17:08.907550 n-d-846435-14 devstack@n-api.service[103962]: Content-Length: 0 Jul 25 14:17:08.907550 n-d-846435-14 devstack@n-api.service[103962]: Host: 10.222.0.88 Jul 25 14:17:08.907550 n-d-846435-14 devstack@n-api.service[103962]: Openstack-Api-Version: compute 2.90 Jul 25 14:17:08.907550 n-d-846435-14 devstack@n-api.service[103962]: Openstack-System-Scope: None Jul 25 14:17:08.907550 n-d-846435-14 devstack@n-api.service[103962]: User-Agent: python-novaclient Jul 25 14:17:08.907550 n-d-846435-14 devstack@n-api.service[103962]: X-Auth-Token: gAAAAABi3qXkKxPUFu_l0rpW0HRhJeIIUj_LZ52Tv0KAXCq3oxgZJfBLgxrsALl2qg8funo-daZDdrOyaKCrdW9CjBPRhoZuuC0XKrBtWCmu6L9K5zlZEtcdq3NpZKRqOCl0WOF2g6WuPRBnsepKlbJ0JKm-tEJOzD60_efaZUqG8gbskoe51Ck Jul 25 14:17:08.907550 n-d-846435-14 devstack@n-api.service[103962]: X-Domain-Id: None Jul 25 14:17:08.907550 n-d-846435-14 devstack@n-api.service[103962]: X-Domain-Name: None Jul 25 14:17:08.907550 n-d-846435-14 devstack@n-api.service[103962]: X-Identity-Status: Confirmed Jul 25 14:17:08.907550 n-d-846435-14 devstack@n-api.service[103962]: X-Is-Admin-Project: True Jul 25 14:17:08.907550 n-d-846435-14 devstack@n-api.service[103962]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 14:17:08.907550 n-d-846435-14 devstack@n-api.service[103962]: X-Project-Domain-Id: default Jul 25 14:17:08.907550 n-d-846435-14 devstack@n-api.service[103962]: X-Project-Domain-Name: Default Jul 25 14:17:08.907550 n-d-846435-14 devstack@n-api.service[103962]: X-Project-Id: f7865a5063284db3bc5cfedce7e79271 Jul 25 14:17:08.907550 n-d-846435-14 devstack@n-api.service[103962]: X-Project-Name: admin Jul 25 14:17:08.907550 n-d-846435-14 devstack@n-api.service[103962]: X-Role: admin,reader,member Jul 25 14:17:08.907550 n-d-846435-14 devstack@n-api.service[103962]: X-Roles: admin,reader,member Jul 25 14:17:08.909151 n-d-846435-14 devstack@n-api.service[103962]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f7865a5063284db3bc5cfedce7e79271"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f7865a5063284db3bc5cfedce7e79271"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f7865a5063284db3bc5cfedce7e79271", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f7865a5063284db3bc5cfedce7e79271"}]}] Jul 25 14:17:08.909151 n-d-846435-14 devstack@n-api.service[103962]: X-Tenant: admin Jul 25 14:17:08.909151 n-d-846435-14 devstack@n-api.service[103962]: X-Tenant-Id: f7865a5063284db3bc5cfedce7e79271 Jul 25 14:17:08.909151 n-d-846435-14 devstack@n-api.service[103962]: X-Tenant-Name: admin Jul 25 14:17:08.909151 n-d-846435-14 devstack@n-api.service[103962]: X-User: admin Jul 25 14:17:08.909151 n-d-846435-14 devstack@n-api.service[103962]: X-User-Domain-Id: default Jul 25 14:17:08.909151 n-d-846435-14 devstack@n-api.service[103962]: X-User-Domain-Name: Default Jul 25 14:17:08.909151 n-d-846435-14 devstack@n-api.service[103962]: X-User-Id: e6691d7972b040efb48e33a902fca45f Jul 25 14:17:08.909151 n-d-846435-14 devstack@n-api.service[103962]: X-User-Name: admin Jul 25 14:17:08.909151 n-d-846435-14 devstack@n-api.service[103962]: method: > Jul 25 14:17:08.909151 n-d-846435-14 devstack@n-api.service[103962]: exception: Flavor 84 could not be found. Jul 25 14:17:08.909151 n-d-846435-14 devstack@n-api.service[103962]: action_args: {'id': '84'} Jul 25 14:17:08.909151 n-d-846435-14 devstack@n-api.service[103962]: {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:17:08.909151 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:17:08.910253 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 14:17:08.910253 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 14:17:08.910253 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 14:17:08.910253 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 14:17:08.910253 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:17:08.910253 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:17:08.910253 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 14:17:08.910253 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 14:17:08.910253 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 14:17:08.910253 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:17:08.910253 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 14:17:08.910253 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 14:17:08.910253 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 25 14:17:08.910253 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi Jul 25 14:17:08.910253 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:17:08.910253 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi Jul 25 14:17:08.910253 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:17:08.910253 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:17:08.910253 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:17:08.911327 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:17:08.911327 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:17:08.911327 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:17:08.911327 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:17:08.911327 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 14:17:08.911327 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:17:08.911327 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 25 14:17:08.911327 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi Jul 25 14:17:08.911327 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:17:08.911327 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi Jul 25 14:17:08.911327 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:17:08.911327 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:17:08.911327 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:17:08.911327 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:17:08.911327 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:17:08.911327 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 25 14:17:08.911327 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi Jul 25 14:17:08.911327 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-ef9bc174-bb65-4fe1-841f-fa81d3c5b2b0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:17:08.912365 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-ef9bc174-bb65-4fe1-841f-fa81d3c5b2b0 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.424325 Jul 25 14:17:08.912365 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 23/44] 10.222.0.88 () {60 vars in 1190 bytes} [Mon Jul 25 14:17:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 426 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 14:17:08.919333 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-cff396ff-26a9-4eb6-9a07-4935cde7a560 admin admin] Calling method '>' {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:17:08.935295 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-cff396ff-26a9-4eb6-9a07-4935cde7a560 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019745 Jul 25 14:17:08.935852 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 22/45] 10.222.0.88 () {60 vars in 1210 bytes} [Mon Jul 25 14:17:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:17:08.945989 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-b91d4b2d-9793-4ca4-abf3-ef5a1a50f6aa admin admin] Calling method '>' {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:17:08.963519 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-b91d4b2d-9793-4ca4-abf3-ef5a1a50f6aa admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021113 Jul 25 14:17:08.964143 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 24/46] 10.222.0.88 () {60 vars in 1210 bytes} [Mon Jul 25 14:17:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:17:08.974038 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-8107a4f3-1738-4c16-93bb-c6132867c4bb admin admin] Calling method '>' {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:17:08.979944 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.wsgi [None req-8107a4f3-1738-4c16-93bb-c6132867c4bb admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 25 14:17:08.981498 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-8107a4f3-1738-4c16-93bb-c6132867c4bb admin admin] Request method failure captured: Jul 25 14:17:08.981498 n-d-846435-14 devstack@n-api.service[103963]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 25 14:17:08.981498 n-d-846435-14 devstack@n-api.service[103963]: Accept: application/json Jul 25 14:17:08.981498 n-d-846435-14 devstack@n-api.service[103963]: Accept-Encoding: gzip, deflate Jul 25 14:17:08.981498 n-d-846435-14 devstack@n-api.service[103963]: Connection: keep-alive Jul 25 14:17:08.981498 n-d-846435-14 devstack@n-api.service[103963]: Content-Length: 0 Jul 25 14:17:08.981498 n-d-846435-14 devstack@n-api.service[103963]: Host: 10.222.0.88 Jul 25 14:17:08.981498 n-d-846435-14 devstack@n-api.service[103963]: Openstack-Api-Version: compute 2.90 Jul 25 14:17:08.981498 n-d-846435-14 devstack@n-api.service[103963]: Openstack-System-Scope: None Jul 25 14:17:08.981498 n-d-846435-14 devstack@n-api.service[103963]: User-Agent: python-novaclient Jul 25 14:17:08.981498 n-d-846435-14 devstack@n-api.service[103963]: X-Auth-Token: gAAAAABi3qXkKxPUFu_l0rpW0HRhJeIIUj_LZ52Tv0KAXCq3oxgZJfBLgxrsALl2qg8funo-daZDdrOyaKCrdW9CjBPRhoZuuC0XKrBtWCmu6L9K5zlZEtcdq3NpZKRqOCl0WOF2g6WuPRBnsepKlbJ0JKm-tEJOzD60_efaZUqG8gbskoe51Ck Jul 25 14:17:08.981498 n-d-846435-14 devstack@n-api.service[103963]: X-Domain-Id: None Jul 25 14:17:08.981498 n-d-846435-14 devstack@n-api.service[103963]: X-Domain-Name: None Jul 25 14:17:08.981498 n-d-846435-14 devstack@n-api.service[103963]: X-Identity-Status: Confirmed Jul 25 14:17:08.981498 n-d-846435-14 devstack@n-api.service[103963]: X-Is-Admin-Project: True Jul 25 14:17:08.981498 n-d-846435-14 devstack@n-api.service[103963]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 14:17:08.981498 n-d-846435-14 devstack@n-api.service[103963]: X-Project-Domain-Id: default Jul 25 14:17:08.981498 n-d-846435-14 devstack@n-api.service[103963]: X-Project-Domain-Name: Default Jul 25 14:17:08.981498 n-d-846435-14 devstack@n-api.service[103963]: X-Project-Id: f7865a5063284db3bc5cfedce7e79271 Jul 25 14:17:08.981498 n-d-846435-14 devstack@n-api.service[103963]: X-Project-Name: admin Jul 25 14:17:08.981498 n-d-846435-14 devstack@n-api.service[103963]: X-Role: admin,reader,member Jul 25 14:17:08.981498 n-d-846435-14 devstack@n-api.service[103963]: X-Roles: admin,reader,member Jul 25 14:17:08.983741 n-d-846435-14 devstack@n-api.service[103963]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f7865a5063284db3bc5cfedce7e79271"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f7865a5063284db3bc5cfedce7e79271"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f7865a5063284db3bc5cfedce7e79271", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f7865a5063284db3bc5cfedce7e79271"}]}] Jul 25 14:17:08.983741 n-d-846435-14 devstack@n-api.service[103963]: X-Tenant: admin Jul 25 14:17:08.983741 n-d-846435-14 devstack@n-api.service[103963]: X-Tenant-Id: f7865a5063284db3bc5cfedce7e79271 Jul 25 14:17:08.983741 n-d-846435-14 devstack@n-api.service[103963]: X-Tenant-Name: admin Jul 25 14:17:08.983741 n-d-846435-14 devstack@n-api.service[103963]: X-User: admin Jul 25 14:17:08.983741 n-d-846435-14 devstack@n-api.service[103963]: X-User-Domain-Id: default Jul 25 14:17:08.983741 n-d-846435-14 devstack@n-api.service[103963]: X-User-Domain-Name: Default Jul 25 14:17:08.983741 n-d-846435-14 devstack@n-api.service[103963]: X-User-Id: e6691d7972b040efb48e33a902fca45f Jul 25 14:17:08.983741 n-d-846435-14 devstack@n-api.service[103963]: X-User-Name: admin Jul 25 14:17:08.983741 n-d-846435-14 devstack@n-api.service[103963]: method: > Jul 25 14:17:08.983741 n-d-846435-14 devstack@n-api.service[103963]: exception: Flavor 84 could not be found. Jul 25 14:17:08.983741 n-d-846435-14 devstack@n-api.service[103963]: action_args: {'id': '84'} Jul 25 14:17:08.983741 n-d-846435-14 devstack@n-api.service[103963]: {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:17:08.983741 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:17:08.984599 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 14:17:08.984599 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 14:17:08.984599 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 14:17:08.984599 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 14:17:08.984599 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:17:08.984599 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:17:08.984599 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 14:17:08.984599 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 14:17:08.984599 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 14:17:08.984599 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:17:08.984599 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 14:17:08.984599 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 14:17:08.984599 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 25 14:17:08.984599 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi Jul 25 14:17:08.984599 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:17:08.984599 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi Jul 25 14:17:08.984599 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:17:08.984599 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:17:08.984599 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:17:08.985737 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:17:08.985737 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:17:08.985737 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:17:08.985737 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:17:08.985737 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 14:17:08.985737 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:17:08.985737 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 25 14:17:08.985737 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi Jul 25 14:17:08.985737 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:17:08.985737 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi Jul 25 14:17:08.985737 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:17:08.985737 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:17:08.985737 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:17:08.985737 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:17:08.985737 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:17:08.985737 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 25 14:17:08.985737 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi Jul 25 14:17:08.985737 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-8107a4f3-1738-4c16-93bb-c6132867c4bb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:17:08.986719 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-8107a4f3-1738-4c16-93bb-c6132867c4bb admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012514 Jul 25 14:17:08.986719 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 23/47] 10.222.0.88 () {60 vars in 1190 bytes} [Mon Jul 25 14:17:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 14:17:09.979947 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-b91d4b2d-9793-4ca4-abf3-ef5a1a50f6aa admin admin] Calling method '>' {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:17:09.981412 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-b91d4b2d-9793-4ca4-abf3-ef5a1a50f6aa admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002015 Jul 25 14:17:09.981932 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 25/48] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Jul 25 14:17:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:17:10.543127 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-fee6df55-7bd6-49f1-993a-8f88be18923a admin admin] Calling method '>' {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:17:10.549403 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.wsgi [None req-fee6df55-7bd6-49f1-993a-8f88be18923a admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 25 14:17:10.550997 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-fee6df55-7bd6-49f1-993a-8f88be18923a admin admin] Request method failure captured: Jul 25 14:17:10.550997 n-d-846435-14 devstack@n-api.service[103963]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 25 14:17:10.550997 n-d-846435-14 devstack@n-api.service[103963]: Accept: application/json Jul 25 14:17:10.550997 n-d-846435-14 devstack@n-api.service[103963]: Accept-Encoding: gzip, deflate Jul 25 14:17:10.550997 n-d-846435-14 devstack@n-api.service[103963]: Connection: keep-alive Jul 25 14:17:10.550997 n-d-846435-14 devstack@n-api.service[103963]: Content-Length: 0 Jul 25 14:17:10.550997 n-d-846435-14 devstack@n-api.service[103963]: Host: 10.222.0.88 Jul 25 14:17:10.550997 n-d-846435-14 devstack@n-api.service[103963]: Openstack-Api-Version: compute 2.90 Jul 25 14:17:10.550997 n-d-846435-14 devstack@n-api.service[103963]: Openstack-System-Scope: None Jul 25 14:17:10.550997 n-d-846435-14 devstack@n-api.service[103963]: User-Agent: python-novaclient Jul 25 14:17:10.550997 n-d-846435-14 devstack@n-api.service[103963]: X-Auth-Token: gAAAAABi3qXlqxk40AG4o_3lXf2Cc21GMsHWPQFYNcd6oWX0RUIuMiZbltrC1Hm1OebCaSrTdAjEVGUNGZf5GRQpwmK8Mp-pcokk3EaSdifYpZ6TfUHsddJ69J7vpkWBVROhk661MGH67BtF5F78umV23M3rBrROgXf_6LWw3q7OGHhdncR5mxs Jul 25 14:17:10.550997 n-d-846435-14 devstack@n-api.service[103963]: X-Domain-Id: None Jul 25 14:17:10.550997 n-d-846435-14 devstack@n-api.service[103963]: X-Domain-Name: None Jul 25 14:17:10.550997 n-d-846435-14 devstack@n-api.service[103963]: X-Identity-Status: Confirmed Jul 25 14:17:10.550997 n-d-846435-14 devstack@n-api.service[103963]: X-Is-Admin-Project: True Jul 25 14:17:10.550997 n-d-846435-14 devstack@n-api.service[103963]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 14:17:10.550997 n-d-846435-14 devstack@n-api.service[103963]: X-Project-Domain-Id: default Jul 25 14:17:10.550997 n-d-846435-14 devstack@n-api.service[103963]: X-Project-Domain-Name: Default Jul 25 14:17:10.550997 n-d-846435-14 devstack@n-api.service[103963]: X-Project-Id: f7865a5063284db3bc5cfedce7e79271 Jul 25 14:17:10.550997 n-d-846435-14 devstack@n-api.service[103963]: X-Project-Name: admin Jul 25 14:17:10.550997 n-d-846435-14 devstack@n-api.service[103963]: X-Role: admin,reader,member Jul 25 14:17:10.550997 n-d-846435-14 devstack@n-api.service[103963]: X-Roles: admin,reader,member Jul 25 14:17:10.552667 n-d-846435-14 devstack@n-api.service[103963]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f7865a5063284db3bc5cfedce7e79271"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f7865a5063284db3bc5cfedce7e79271"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f7865a5063284db3bc5cfedce7e79271", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f7865a5063284db3bc5cfedce7e79271"}]}] Jul 25 14:17:10.552667 n-d-846435-14 devstack@n-api.service[103963]: X-Tenant: admin Jul 25 14:17:10.552667 n-d-846435-14 devstack@n-api.service[103963]: X-Tenant-Id: f7865a5063284db3bc5cfedce7e79271 Jul 25 14:17:10.552667 n-d-846435-14 devstack@n-api.service[103963]: X-Tenant-Name: admin Jul 25 14:17:10.552667 n-d-846435-14 devstack@n-api.service[103963]: X-User: admin Jul 25 14:17:10.552667 n-d-846435-14 devstack@n-api.service[103963]: X-User-Domain-Id: default Jul 25 14:17:10.552667 n-d-846435-14 devstack@n-api.service[103963]: X-User-Domain-Name: Default Jul 25 14:17:10.552667 n-d-846435-14 devstack@n-api.service[103963]: X-User-Id: e6691d7972b040efb48e33a902fca45f Jul 25 14:17:10.552667 n-d-846435-14 devstack@n-api.service[103963]: X-User-Name: admin Jul 25 14:17:10.552667 n-d-846435-14 devstack@n-api.service[103963]: method: > Jul 25 14:17:10.552667 n-d-846435-14 devstack@n-api.service[103963]: exception: Flavor 451 could not be found. Jul 25 14:17:10.552667 n-d-846435-14 devstack@n-api.service[103963]: action_args: {'id': '451'} Jul 25 14:17:10.552667 n-d-846435-14 devstack@n-api.service[103963]: {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:17:10.552667 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:17:10.553708 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 14:17:10.553708 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 14:17:10.553708 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 14:17:10.553708 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 14:17:10.553708 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:17:10.553708 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:17:10.553708 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 14:17:10.553708 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 14:17:10.553708 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 14:17:10.553708 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:17:10.553708 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 14:17:10.553708 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 14:17:10.553708 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 25 14:17:10.553708 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi Jul 25 14:17:10.553708 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:17:10.553708 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi Jul 25 14:17:10.553708 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:17:10.553708 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:17:10.553708 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:17:10.555120 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:17:10.555120 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:17:10.555120 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:17:10.555120 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:17:10.555120 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 14:17:10.555120 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:17:10.555120 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 25 14:17:10.555120 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi Jul 25 14:17:10.555120 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:17:10.555120 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi Jul 25 14:17:10.555120 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:17:10.555120 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:17:10.555120 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:17:10.555120 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:17:10.555120 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:17:10.555120 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 25 14:17:10.555120 n-d-846435-14 devstack@n-api.service[103963]: ERROR nova.api.openstack.wsgi Jul 25 14:17:10.555120 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-fee6df55-7bd6-49f1-993a-8f88be18923a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:17:10.556397 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-fee6df55-7bd6-49f1-993a-8f88be18923a admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.433818 Jul 25 14:17:10.556397 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 24/49] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Jul 25 14:17:10 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 435 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 14:17:10.562226 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-11e35c57-1678-43d7-a7c3-eb2a6e6a05b9 admin admin] Calling method '>' {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:17:10.578001 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-11e35c57-1678-43d7-a7c3-eb2a6e6a05b9 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019328 Jul 25 14:17:10.578558 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 26/50] 10.222.0.88 () {60 vars in 1210 bytes} [Mon Jul 25 14:17:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:17:10.588700 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-5ac8b615-c1de-420b-b435-24e0d3a46ea0 admin admin] Calling method '>' {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:17:10.604156 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-5ac8b615-c1de-420b-b435-24e0d3a46ea0 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019095 Jul 25 14:17:10.604711 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 25/51] 10.222.0.88 () {60 vars in 1210 bytes} [Mon Jul 25 14:17:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:17:10.614983 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-6bc995dd-2ea5-4f0c-9bcd-c140079593af admin admin] Calling method '>' {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:17:10.628366 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.wsgi [None req-6bc995dd-2ea5-4f0c-9bcd-c140079593af admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 25 14:17:10.630024 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-6bc995dd-2ea5-4f0c-9bcd-c140079593af admin admin] Request method failure captured: Jul 25 14:17:10.630024 n-d-846435-14 devstack@n-api.service[103962]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 25 14:17:10.630024 n-d-846435-14 devstack@n-api.service[103962]: Accept: application/json Jul 25 14:17:10.630024 n-d-846435-14 devstack@n-api.service[103962]: Accept-Encoding: gzip, deflate Jul 25 14:17:10.630024 n-d-846435-14 devstack@n-api.service[103962]: Connection: keep-alive Jul 25 14:17:10.630024 n-d-846435-14 devstack@n-api.service[103962]: Content-Length: 0 Jul 25 14:17:10.630024 n-d-846435-14 devstack@n-api.service[103962]: Host: 10.222.0.88 Jul 25 14:17:10.630024 n-d-846435-14 devstack@n-api.service[103962]: Openstack-Api-Version: compute 2.90 Jul 25 14:17:10.630024 n-d-846435-14 devstack@n-api.service[103962]: Openstack-System-Scope: None Jul 25 14:17:10.630024 n-d-846435-14 devstack@n-api.service[103962]: User-Agent: python-novaclient Jul 25 14:17:10.630024 n-d-846435-14 devstack@n-api.service[103962]: X-Auth-Token: gAAAAABi3qXlqxk40AG4o_3lXf2Cc21GMsHWPQFYNcd6oWX0RUIuMiZbltrC1Hm1OebCaSrTdAjEVGUNGZf5GRQpwmK8Mp-pcokk3EaSdifYpZ6TfUHsddJ69J7vpkWBVROhk661MGH67BtF5F78umV23M3rBrROgXf_6LWw3q7OGHhdncR5mxs Jul 25 14:17:10.630024 n-d-846435-14 devstack@n-api.service[103962]: X-Domain-Id: None Jul 25 14:17:10.630024 n-d-846435-14 devstack@n-api.service[103962]: X-Domain-Name: None Jul 25 14:17:10.630024 n-d-846435-14 devstack@n-api.service[103962]: X-Identity-Status: Confirmed Jul 25 14:17:10.630024 n-d-846435-14 devstack@n-api.service[103962]: X-Is-Admin-Project: True Jul 25 14:17:10.630024 n-d-846435-14 devstack@n-api.service[103962]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 14:17:10.630024 n-d-846435-14 devstack@n-api.service[103962]: X-Project-Domain-Id: default Jul 25 14:17:10.630024 n-d-846435-14 devstack@n-api.service[103962]: X-Project-Domain-Name: Default Jul 25 14:17:10.630024 n-d-846435-14 devstack@n-api.service[103962]: X-Project-Id: f7865a5063284db3bc5cfedce7e79271 Jul 25 14:17:10.630024 n-d-846435-14 devstack@n-api.service[103962]: X-Project-Name: admin Jul 25 14:17:10.630024 n-d-846435-14 devstack@n-api.service[103962]: X-Role: admin,reader,member Jul 25 14:17:10.630024 n-d-846435-14 devstack@n-api.service[103962]: X-Roles: admin,reader,member Jul 25 14:17:10.631566 n-d-846435-14 devstack@n-api.service[103962]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f7865a5063284db3bc5cfedce7e79271"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f7865a5063284db3bc5cfedce7e79271"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f7865a5063284db3bc5cfedce7e79271", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f7865a5063284db3bc5cfedce7e79271"}]}] Jul 25 14:17:10.631566 n-d-846435-14 devstack@n-api.service[103962]: X-Tenant: admin Jul 25 14:17:10.631566 n-d-846435-14 devstack@n-api.service[103962]: X-Tenant-Id: f7865a5063284db3bc5cfedce7e79271 Jul 25 14:17:10.631566 n-d-846435-14 devstack@n-api.service[103962]: X-Tenant-Name: admin Jul 25 14:17:10.631566 n-d-846435-14 devstack@n-api.service[103962]: X-User: admin Jul 25 14:17:10.631566 n-d-846435-14 devstack@n-api.service[103962]: X-User-Domain-Id: default Jul 25 14:17:10.631566 n-d-846435-14 devstack@n-api.service[103962]: X-User-Domain-Name: Default Jul 25 14:17:10.631566 n-d-846435-14 devstack@n-api.service[103962]: X-User-Id: e6691d7972b040efb48e33a902fca45f Jul 25 14:17:10.631566 n-d-846435-14 devstack@n-api.service[103962]: X-User-Name: admin Jul 25 14:17:10.631566 n-d-846435-14 devstack@n-api.service[103962]: method: > Jul 25 14:17:10.631566 n-d-846435-14 devstack@n-api.service[103962]: exception: Flavor 451 could not be found. Jul 25 14:17:10.631566 n-d-846435-14 devstack@n-api.service[103962]: action_args: {'id': '451'} Jul 25 14:17:10.631566 n-d-846435-14 devstack@n-api.service[103962]: {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:17:10.631566 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:17:10.632989 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 14:17:10.632989 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 14:17:10.632989 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 14:17:10.632989 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 14:17:10.632989 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:17:10.632989 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:17:10.632989 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 14:17:10.632989 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 14:17:10.632989 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 14:17:10.632989 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:17:10.632989 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 14:17:10.632989 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 14:17:10.632989 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 25 14:17:10.632989 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi Jul 25 14:17:10.632989 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:17:10.632989 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi Jul 25 14:17:10.632989 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:17:10.632989 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:17:10.632989 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:17:10.634269 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:17:10.634269 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:17:10.634269 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:17:10.634269 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:17:10.634269 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 14:17:10.634269 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:17:10.634269 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 25 14:17:10.634269 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi Jul 25 14:17:10.634269 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:17:10.634269 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi Jul 25 14:17:10.634269 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:17:10.634269 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:17:10.634269 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:17:10.634269 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:17:10.634269 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:17:10.634269 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 25 14:17:10.634269 n-d-846435-14 devstack@n-api.service[103962]: ERROR nova.api.openstack.wsgi Jul 25 14:17:10.634269 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-6bc995dd-2ea5-4f0c-9bcd-c140079593af admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:17:10.635488 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-6bc995dd-2ea5-4f0c-9bcd-c140079593af admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.020606 Jul 25 14:17:10.635488 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 27/52] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Jul 25 14:17:10 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 14:17:11.608244 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-5ac8b615-c1de-420b-b435-24e0d3a46ea0 admin admin] Calling method '>' {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:17:11.609255 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-5ac8b615-c1de-420b-b435-24e0d3a46ea0 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jul 25 14:17:11.609653 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 26/53] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Jul 25 14:17:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:17:12.163675 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-17d242af-e9e2-45a2-bfa2-aefc9b17f03e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:17:12.184375 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-17d242af-e9e2-45a2-bfa2-aefc9b17f03e admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.438788 Jul 25 14:17:12.184826 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 28/54] 10.222.0.88 () {64 vars in 1235 bytes} [Mon Jul 25 14:17:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:17:13.151123 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-5ac8b615-c1de-420b-b435-24e0d3a46ea0 admin admin] Calling method '>' {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:17:13.151852 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-5ac8b615-c1de-420b-b435-24e0d3a46ea0 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Jul 25 14:17:13.152234 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 27/55] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Jul 25 14:17:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:17:13.684961 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-838ee8be-07c1-4527-8834-8ef27f429426 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:17:13.709746 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-838ee8be-07c1-4527-8834-8ef27f429426 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.421764 Jul 25 14:17:13.710303 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 29/56] 10.222.0.88 () {64 vars in 1235 bytes} [Mon Jul 25 14:17:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:17:14.718002 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-5ac8b615-c1de-420b-b435-24e0d3a46ea0 admin admin] Calling method '>' {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:17:14.718992 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-5ac8b615-c1de-420b-b435-24e0d3a46ea0 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jul 25 14:17:14.719386 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 28/57] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Jul 25 14:17:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:17:15.288327 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-a72a431f-79a6-4c5d-a5bb-37dde6164f6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:17:15.309683 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-a72a431f-79a6-4c5d-a5bb-37dde6164f6d admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.452724 Jul 25 14:17:15.310228 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 30/58] 10.222.0.88 () {64 vars in 1235 bytes} [Mon Jul 25 14:17:14 2022] POST /compute/v2.1/flavors => generated 407 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:17:16.293643 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-5ac8b615-c1de-420b-b435-24e0d3a46ea0 admin admin] Calling method '>' {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:17:16.295197 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-5ac8b615-c1de-420b-b435-24e0d3a46ea0 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002034 Jul 25 14:17:16.295782 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 29/59] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Jul 25 14:17:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:17:16.873013 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-2a0a1c77-3eda-4aef-95a1-bf78ff3d975a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:17:16.896547 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-2a0a1c77-3eda-4aef-95a1-bf78ff3d975a admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.449972 Jul 25 14:17:16.897073 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 31/60] 10.222.0.88 () {64 vars in 1235 bytes} [Mon Jul 25 14:17:16 2022] POST /compute/v2.1/flavors => generated 409 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:17:17.904193 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-5ac8b615-c1de-420b-b435-24e0d3a46ea0 admin admin] Calling method '>' {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:17:17.905312 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-5ac8b615-c1de-420b-b435-24e0d3a46ea0 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001815 Jul 25 14:17:17.905711 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 30/61] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Jul 25 14:17:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:17:18.497506 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-9c2f928b-1b93-43ab-8fca-5a8fcefbe2da admin admin] Calling method '>' {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:17:18.518730 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-9c2f928b-1b93-43ab-8fca-5a8fcefbe2da admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.471832 Jul 25 14:17:18.519279 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 32/62] 10.222.0.88 () {60 vars in 1202 bytes} [Mon Jul 25 14:17:18 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:18:11.377672 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-5ac8b615-c1de-420b-b435-24e0d3a46ea0 admin admin] Calling method '>' {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:18:11.378641 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-5ac8b615-c1de-420b-b435-24e0d3a46ea0 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001935 Jul 25 14:18:11.379107 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 31/63] 10.222.0.88 () {54 vars in 930 bytes} [Mon Jul 25 14:18:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:18:11.389765 n-d-846435-14 devstack@n-api.service[103962]: DEBUG dbcounter [-] [103962] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:18:11.835502 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-50513c2a-ba09-4277-9f48-2d4085b3a969 admin admin] Calling method '>' {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:18:11.860782 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-50513c2a-ba09-4277-9f48-2d4085b3a969 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.475375 Jul 25 14:18:11.861348 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 33/64] 10.222.0.88 () {60 vars in 1291 bytes} [Mon Jul 25 14:18:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:18:11.889166 n-d-846435-14 devstack@n-api.service[103963]: DEBUG dbcounter [-] [103963] Writing DB stats nova_api:SELECT=14 {{(pid=103963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:18:11.893313 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-6b5af03a-8cdd-418e-a1a0-910d66360894 admin admin] Calling method '>' {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:18:11.901587 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-6b5af03a-8cdd-418e-a1a0-910d66360894 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013888 Jul 25 14:18:11.902116 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 32/65] 10.222.0.88 () {60 vars in 1282 bytes} [Mon Jul 25 14:18:11 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:18:11.914963 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-66e3f4c5-57f2-4cdc-8107-e46bb490accc admin admin] Calling method '>' {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:18:11.922766 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-66e3f4c5-57f2-4cdc-8107-e46bb490accc admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011924 Jul 25 14:18:11.923270 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 34/66] 10.222.0.88 () {60 vars in 1285 bytes} [Mon Jul 25 14:18:11 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:18:11.935454 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-d5c4623e-a747-49f6-85a1-9c170bdf65ac admin admin] Calling method '>' {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:18:11.943923 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-d5c4623e-a747-49f6-85a1-9c170bdf65ac admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012276 Jul 25 14:18:11.944556 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 33/67] 10.222.0.88 () {60 vars in 1285 bytes} [Mon Jul 25 14:18:11 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:18:11.960636 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-0a8c26d3-7a57-444b-bfce-ff3412ab8df9 admin admin] Calling method '>' {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:18:11.968824 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-0a8c26d3-7a57-444b-bfce-ff3412ab8df9 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012039 Jul 25 14:18:11.969381 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 35/68] 10.222.0.88 () {60 vars in 1282 bytes} [Mon Jul 25 14:18:11 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:23:49.374969 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-d5c4623e-a747-49f6-85a1-9c170bdf65ac admin admin] Calling method '>' {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:23:49.376050 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-d5c4623e-a747-49f6-85a1-9c170bdf65ac admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 25 14:23:49.376398 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 34/69] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Jul 25 14:23:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:23:49.520174 n-d-846435-14 devstack@n-api.service[103962]: DEBUG dbcounter [-] [103962] Writing DB stats nova_api:SELECT=6 {{(pid=103962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:23:49.687472 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-0e4ecf9b-fa5d-465a-8a57-2a3ce9fdf23a admin admin] Calling method '>' {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:23:49.689823 n-d-846435-14 devstack@n-api.service[103962]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:23:49.689823 n-d-846435-14 devstack@n-api.service[103962]: warnings.warn(msg) Jul 25 14:23:49.691062 n-d-846435-14 devstack@n-api.service[103962]: DEBUG oslo_concurrency.lockutils [None req-0e4ecf9b-fa5d-465a-8a57-2a3ce9fdf23a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:23:49.691496 n-d-846435-14 devstack@n-api.service[103962]: DEBUG oslo_concurrency.lockutils [None req-0e4ecf9b-fa5d-465a-8a57-2a3ce9fdf23a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:23:49.692302 n-d-846435-14 devstack@n-api.service[103962]: DEBUG oslo_concurrency.lockutils [None req-0e4ecf9b-fa5d-465a-8a57-2a3ce9fdf23a admin admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:23:49.692728 n-d-846435-14 devstack@n-api.service[103962]: DEBUG oslo_concurrency.lockutils [None req-0e4ecf9b-fa5d-465a-8a57-2a3ce9fdf23a admin admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:23:49.733852 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-0e4ecf9b-fa5d-465a-8a57-2a3ce9fdf23a admin admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.216462 Jul 25 14:23:49.734330 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 36/70] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Jul 25 14:23:49 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:23:50.582332 n-d-846435-14 devstack@n-api.service[103963]: DEBUG nova.api.openstack.wsgi [None req-d5c4623e-a747-49f6-85a1-9c170bdf65ac admin admin] Calling method '>' {{(pid=103963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:23:50.583335 n-d-846435-14 devstack@n-api.service[103963]: INFO nova.api.openstack.requestlog [None req-d5c4623e-a747-49f6-85a1-9c170bdf65ac admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jul 25 14:23:50.583726 n-d-846435-14 devstack@n-api.service[103963]: [pid: 103963|app: 0|req: 35/71] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Jul 25 14:23:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:23:50.782307 n-d-846435-14 devstack@n-api.service[103962]: DEBUG nova.api.openstack.wsgi [None req-989c91fd-9cd2-4e17-bb0b-4812408c9e19 admin admin] Calling method '>' {{(pid=103962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:23:50.786675 n-d-846435-14 devstack@n-api.service[103962]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:23:50.786675 n-d-846435-14 devstack@n-api.service[103962]: warnings.warn(msg) Jul 25 14:23:50.788610 n-d-846435-14 devstack@n-api.service[103962]: DEBUG oslo_concurrency.lockutils [None req-989c91fd-9cd2-4e17-bb0b-4812408c9e19 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:23:50.789048 n-d-846435-14 devstack@n-api.service[103962]: DEBUG oslo_concurrency.lockutils [None req-989c91fd-9cd2-4e17-bb0b-4812408c9e19 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:23:50.790333 n-d-846435-14 devstack@n-api.service[103962]: DEBUG oslo_concurrency.lockutils [None req-989c91fd-9cd2-4e17-bb0b-4812408c9e19 admin admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:23:50.790760 n-d-846435-14 devstack@n-api.service[103962]: DEBUG oslo_concurrency.lockutils [None req-989c91fd-9cd2-4e17-bb0b-4812408c9e19 admin admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:23:50.813157 n-d-846435-14 devstack@n-api.service[103962]: INFO nova.api.openstack.requestlog [None req-989c91fd-9cd2-4e17-bb0b-4812408c9e19 admin admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.093688 Jul 25 14:23:50.813708 n-d-846435-14 devstack@n-api.service[103962]: [pid: 103962|app: 0|req: 37/72] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Jul 25 14:23:50 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:24:35.908669 n-d-846435-14 systemd[1]: Stopping Devstack devstack@n-api.service... Jul 25 14:24:35.909267 n-d-846435-14 devstack@n-api.service[103961]: Mon Jul 25 14:24:35 2022 - graceful shutdown triggered... Jul 25 14:24:35.909758 n-d-846435-14 devstack@n-api.service[103962]: Gracefully killing worker 1 (pid: 103962)... Jul 25 14:24:35.910397 n-d-846435-14 devstack@n-api.service[103963]: Gracefully killing worker 2 (pid: 103963)... Jul 25 14:24:36.910230 n-d-846435-14 devstack@n-api.service[103961]: worker 1 buried after 1 seconds Jul 25 14:24:36.910230 n-d-846435-14 devstack@n-api.service[103961]: worker 2 buried after 1 seconds Jul 25 14:24:36.910230 n-d-846435-14 devstack@n-api.service[103961]: goodbye to uWSGI. Jul 25 14:24:36.912738 n-d-846435-14 systemd[1]: devstack@n-api.service: Succeeded. Jul 25 14:24:36.913640 n-d-846435-14 systemd[1]: Stopped Devstack devstack@n-api.service. Jul 25 14:24:36.917972 n-d-846435-14 systemd[1]: Starting Devstack devstack@n-api.service... Jul 25 14:24:36.941483 n-d-846435-14 devstack@n-api.service[119292]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 25 14:24:36.978486 n-d-846435-14 devstack@n-api.service[119292]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 14:24:36 2022] *** Jul 25 14:24:36.978486 n-d-846435-14 devstack@n-api.service[119292]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 14:24:36.978486 n-d-846435-14 devstack@n-api.service[119292]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 14:24:36.978486 n-d-846435-14 devstack@n-api.service[119292]: nodename: n-d-846435-14 Jul 25 14:24:36.978486 n-d-846435-14 devstack@n-api.service[119292]: machine: x86_64 Jul 25 14:24:36.978486 n-d-846435-14 devstack@n-api.service[119292]: clock source: unix Jul 25 14:24:36.978486 n-d-846435-14 devstack@n-api.service[119292]: pcre jit disabled Jul 25 14:24:36.978486 n-d-846435-14 devstack@n-api.service[119292]: detected number of CPU cores: 4 Jul 25 14:24:36.978486 n-d-846435-14 devstack@n-api.service[119292]: current working directory: / Jul 25 14:24:36.978486 n-d-846435-14 devstack@n-api.service[119292]: detected binary path: /usr/bin/uwsgi-core Jul 25 14:24:36.978486 n-d-846435-14 devstack@n-api.service[119292]: your processes number limit is 47680 Jul 25 14:24:36.978486 n-d-846435-14 devstack@n-api.service[119292]: your memory page size is 4096 bytes Jul 25 14:24:36.978486 n-d-846435-14 devstack@n-api.service[119292]: detected max file descriptor number: 2048 Jul 25 14:24:36.979378 n-d-846435-14 devstack@n-api.service[119292]: lock engine: pthread robust mutexes Jul 25 14:24:36.979378 n-d-846435-14 devstack@n-api.service[119292]: thunder lock: enabled Jul 25 14:24:36.979378 n-d-846435-14 devstack@n-api.service[119292]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 25 14:24:36.979378 n-d-846435-14 devstack@n-api.service[119292]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 14:24:37.018875 n-d-846435-14 devstack@n-api.service[119292]: Python main interpreter initialized at 0x55d334eaf9c0 Jul 25 14:24:37.018875 n-d-846435-14 devstack@n-api.service[119292]: python threads support enabled Jul 25 14:24:37.018875 n-d-846435-14 devstack@n-api.service[119292]: your server socket listen backlog is limited to 100 connections Jul 25 14:24:37.018875 n-d-846435-14 devstack@n-api.service[119292]: your mercy for graceful operations on workers is 90 seconds Jul 25 14:24:37.019328 n-d-846435-14 devstack@n-api.service[119292]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 14:24:37.019328 n-d-846435-14 devstack@n-api.service[119292]: *** Operational MODE: preforking *** Jul 25 14:24:37.019547 n-d-846435-14 devstack@n-api.service[119292]: *** uWSGI is running in multiple interpreter mode *** Jul 25 14:24:37.019547 n-d-846435-14 devstack@n-api.service[119292]: spawned uWSGI master process (pid: 119292) Jul 25 14:24:37.019772 n-d-846435-14 systemd[1]: Started Devstack devstack@n-api.service. Jul 25 14:24:37.020347 n-d-846435-14 devstack@n-api.service[119292]: spawned uWSGI worker 1 (pid: 119303, cores: 1) Jul 25 14:24:37.020873 n-d-846435-14 devstack@n-api.service[119292]: spawned uWSGI worker 2 (pid: 119304, cores: 1) Jul 25 14:24:37.021161 n-d-846435-14 devstack@n-api.service[119292]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 14:24:37.678817 n-d-846435-14 devstack@n-api.service[119303]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 14:24:37.679483 n-d-846435-14 devstack@n-api.service[119304]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 14:24:38.828716 n-d-846435-14 devstack@n-api.service[119304]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 14:24:38.828716 n-d-846435-14 devstack@n-api.service[119304]: from cryptography.utils import int_from_bytes Jul 25 14:24:38.829481 n-d-846435-14 devstack@n-api.service[119304]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 14:24:38.829481 n-d-846435-14 devstack@n-api.service[119304]: from cryptography.utils import int_from_bytes Jul 25 14:24:38.834265 n-d-846435-14 devstack@n-api.service[119303]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 14:24:38.834265 n-d-846435-14 devstack@n-api.service[119303]: from cryptography.utils import int_from_bytes Jul 25 14:24:38.834731 n-d-846435-14 devstack@n-api.service[119303]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 14:24:38.834731 n-d-846435-14 devstack@n-api.service[119303]: from cryptography.utils import int_from_bytes Jul 25 14:24:41.204178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 14:24:41.204880 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 14:24:41.204989 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 14:24:41.205307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 14:24:41.205534 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 14:24:41.205944 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.206268 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.206589 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.206905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.207215 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.207524 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.207845 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.208184 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.208506 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.208778 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.209098 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 14:24:41.209492 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.209587 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 14:24:41.209677 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-846435-14 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.209776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.209872 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 14:24:41.210150 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.210253 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 14:24:41.210461 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.210561 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 14:24:41.210777 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.210879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.211081 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.211175 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.211401 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.211499 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.211701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.211826 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.212100 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.212231 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.212565 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.212655 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.212744 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.212969 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.213067 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.213282 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.213374 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.213563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.213681 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.213898 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.214023 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.214219 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.214330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-846435-14 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.214521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.214629 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.214840 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.214984 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.215146 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.215262 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.215457 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.215565 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.215851 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.215960 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-846435-14 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.216201 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.216303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.216534 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.216727 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.217022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.217134 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.217355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.217623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.217933 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.218044 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.218138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.218260 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.218380 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.218574 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.218701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.218880 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.219026 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.219201 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.219336 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.219508 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.219663 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.219833 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.220001 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.220154 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.220326 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.220554 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-846435-14 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.220652 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.220870 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.220977 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.221180 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.221282 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.221497 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.221599 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.221822 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.221925 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.222126 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.222234 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.222425 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.222524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.222672 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.222781 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.222980 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.223111 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.223305 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.223415 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.223623 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.223739 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.223940 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.224064 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.224214 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.224331 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.224465 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.224670 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.224906 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.224993 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.225203 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.225327 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.225511 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.225608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.225817 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.225927 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.226118 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.226228 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.226422 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.226525 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.226704 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.226810 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.227010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.227121 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.227310 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.227409 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.227613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.227713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.227928 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.228083 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.228254 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.228415 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.228568 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.228717 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.228864 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.229013 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.229164 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.229308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.229456 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.229600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.88 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.229764 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.229911 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.88 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.230055 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.230192 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.230328 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.230472 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.230616 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.230769 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.230916 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.231050 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.231186 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.231328 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.231471 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.231614 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.231755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.231899 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.232071 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.232190 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.232323 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.232486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.232632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.232802 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.232948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.233139 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.233369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.88 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.233469 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.233623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.88 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.233728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.233930 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.234052 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.234252 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.234360 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.234563 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.234666 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.234868 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.234970 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.235172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.235268 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.235476 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.235584 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.235805 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.235959 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.236153 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.236297 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.236427 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.236738 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.236960 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.237056 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.237141 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.237235 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.237327 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.237412 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.237542 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.237651 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.237872 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.238020 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.238142 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.238282 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.238473 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.238608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.238738 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.238843 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.239075 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.239225 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.239379 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.239481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.239664 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.239823 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.239925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.240070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.240303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.240440 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.240638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.240774 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.240950 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.241099 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.241230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.241337 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.241553 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.241689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.241858 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.242004 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.242161 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.242260 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.242422 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.242538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.242721 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.242822 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.243023 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.243140 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.243335 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.243432 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.243629 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.243720 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.243933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.244066 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.244264 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.244359 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.244564 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.244662 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.244864 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.244979 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.245166 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.245265 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.245463 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.245564 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.245763 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.245861 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.246064 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.246166 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.246351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.246440 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.246648 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.246740 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.246943 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.247039 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.247256 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.247355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.247551 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.247644 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.247844 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.247952 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.248174 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.248291 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.248479 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.248582 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.248778 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.248913 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.249080 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.249180 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.249384 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.249486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.249686 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.249793 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.249992 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.250084 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.250294 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.250385 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.250595 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.250696 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.250894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.250993 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.251210 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.251308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.251528 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.251621 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.251836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.251929 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.252206 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.252475 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.252731 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.252879 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.253020 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 14:24:41.253167 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.253167 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.253470 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.253570 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.253665 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.253771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.253866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.254171 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.254274 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.254371 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.254480 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.254616 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.254721 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.254924 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.255034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.255258 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.255384 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.255563 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.255679 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.255903 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.256017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.256239 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.256342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.256556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.256645 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.256872 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.257017 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.257193 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.257287 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.257511 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.257612 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.257830 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.257929 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.258139 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.258231 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.258447 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.258562 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.258758 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.258861 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.259061 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.259152 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.259381 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.259537 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.259694 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.259794 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.260029 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.260146 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.260340 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.260433 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.260649 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.260754 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.260959 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.261051 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.261272 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.261362 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.261583 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.261684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.261915 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.262005 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.262229 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.262386 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.262522 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.262691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.262850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.262994 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.263147 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.263291 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.263448 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.263590 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.263734 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.263870 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.264051 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.264206 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.264361 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.264527 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.264728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.264878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.265023 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.265182 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.265344 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.265433 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.265525 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.265616 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.265828 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.265980 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.266123 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.266226 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.266427 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.266516 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.266754 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.266855 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.267058 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.267165 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.267369 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.267479 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.267676 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.267776 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.267993 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.268085 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.268307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.268409 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.268609 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.268712 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.268916 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.269005 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.269215 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.269309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.269590 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.269705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.269830 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.269918 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.270133 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.270230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.270449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.270551 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.270749 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.270836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.271050 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.271148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.271359 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.271449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.271744 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.271877 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.272056 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.272149 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.272364 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.272468 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.272671 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.272763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.272979 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.273068 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.273286 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.273384 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.273590 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.273685 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.273905 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.274008 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.274210 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.274308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.274521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.274783 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.274881 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.275033 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.275132 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.275223 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.275415 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.275549 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.275724 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.275869 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.276051 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.276196 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.276383 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.276559 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.276705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.276866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.277050 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.277237 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.277416 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.277589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.277782 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.277878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.278116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.278236 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.278377 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.278377 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.278554 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.278686 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.278773 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.278988 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.279123 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.279284 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.279393 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.279696 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.279860 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.279967 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.280090 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.280188 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.280285 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.280631 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.280808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.280957 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.281051 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.281146 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.281232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.281425 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.281565 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.281745 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.281886 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.282017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.282116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.282353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.282595 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.282746 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.282838 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.282956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.283083 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.283254 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.283405 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.283510 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.283625 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.283820 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.283922 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.284165 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.284305 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.284417 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.284518 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.284792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.284944 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.285067 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.285167 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.285377 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.285499 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.285715 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.285866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.286008 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.286119 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.286342 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.286504 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.286599 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.286685 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.286965 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.287117 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.287305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.287473 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.287577 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.287675 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.287892 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.288027 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.288246 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.288416 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.288519 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.288606 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.288856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.288996 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.289156 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.289263 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.289459 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.289599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.289765 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.289971 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.290085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.290173 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.290375 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.290528 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.290633 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.290720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.290980 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.291120 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.291293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.291431 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.291608 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.291760 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.291873 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.292000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.292228 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.292368 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.292542 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.292699 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.292865 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.292968 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.293169 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.293309 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.293455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.293570 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.293781 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.293931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.294067 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.294175 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.294380 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.294492 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.294687 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.294782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.294997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.295095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.295299 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.295426 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.295580 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.295670 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.295893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.296030 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.296226 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.296333 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.296533 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.296639 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.296837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.296931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.297577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.297720 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.297831 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.297933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.298049 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.298154 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.298358 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.298454 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.298658 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.298761 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.298965 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.299060 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.299401 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.299540 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.299642 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.299728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.299875 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.300081 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.300183 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.300278 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.300500 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.300596 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.300800 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.300974 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.301118 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.301220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.301420 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.301515 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.301723 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.301826 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.302019 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.302113 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.302320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.302415 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.302619 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.302768 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.302943 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.303041 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.303275 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.303381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.303594 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.303698 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.303902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.304030 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.304234 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.304345 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.304549 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.304645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.304859 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.304955 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.305158 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.305252 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.305477 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.305580 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.305782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.305885 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.306086 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.306181 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.306391 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.306487 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.306695 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.306789 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.306998 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.307091 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.307304 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.307400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.307602 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.307705 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.307909 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.308065 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.308240 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.308340 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.308543 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.308636 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.308844 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.308949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.309148 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.309240 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.309456 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.309544 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.309782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.310036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.310135 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.310367 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.310459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.310680 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.310779 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.310987 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.311078 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.311298 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.311388 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.311609 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.311712 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.311930 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.312043 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.312274 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.312377 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.312588 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.312701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.312894 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.313071 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.313197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.313297 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.313498 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.313598 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.313800 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.313899 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.314108 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.314377 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.314480 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.314697 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.314787 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.314998 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.315105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.315305 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.315397 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.315607 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.315708 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.315909 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.316049 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.316234 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.316329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.316554 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.316698 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.316841 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.316932 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.317127 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.317229 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.317432 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.317528 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.317733 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.317824 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.318051 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.318143 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.318374 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.318479 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.318679 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.318770 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.318979 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.319069 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.319278 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.319371 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.319612 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.319713 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.319910 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.320048 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.320241 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.320334 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.320547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.320642 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.320853 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.320960 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.321167 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.321258 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.321474 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.321574 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.321783 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.321883 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.322132 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.322275 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.322377 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.322464 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.322668 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.322811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.322979 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.323122 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.323280 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.323401 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.323577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.323675 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.323885 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.324035 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.324218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.324337 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.324525 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.324625 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.324833 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.324925 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.325135 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.325233 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.325442 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.325534 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.325743 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.325850 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.326056 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.326162 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.326368 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.326527 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.326663 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.326752 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.326956 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.327065 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.327264 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.327362 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.327568 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.327659 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.327869 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.327996 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.328200 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.328291 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.328501 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.328602 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.328808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.328906 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.329110 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.329200 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.329412 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.329505 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.329720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.329840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.330021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.330129 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.330326 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.330453 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.330663 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.330872 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.331119 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.331387 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.331758 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.331856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.332066 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.332168 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.332255 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.332339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.332422 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.332513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.332513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.332742 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.332742 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.332941 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.333062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.333343 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.333647 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.333749 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.333950 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.334122 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.334310 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.334419 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.334619 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.334721 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.334926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.335019 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.335249 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.335350 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.335559 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.335649 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.335866 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.335959 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.336203 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.336309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.336508 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.336600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.336811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.336903 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.337111 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.337282 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.337415 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.337507 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.337716 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.337808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.338036 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.338128 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.338342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.338433 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.338650 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.338749 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.338954 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.339045 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.339253 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.339351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.339554 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.339644 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.339866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.340005 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.340194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.340296 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.340501 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.340601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.340804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.340907 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.341109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.341203 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.341413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.341512 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.341734 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.341826 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.342042 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.342142 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.342346 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.342449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.342648 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.342737 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.342951 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.343051 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.343259 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.343415 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.343562 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.343676 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.343865 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.343968 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.344206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.344318 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.344519 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.344668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.344856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.345035 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.345185 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.345325 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.345476 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.345622 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.345768 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.345907 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.346051 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.346190 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.346363 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.346499 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.346678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.346812 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.346987 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.347088 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.347291 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.347390 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.347593 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.347692 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.347900 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.348011 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.348239 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.348344 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.348549 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.348654 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.348856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.348945 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.349164 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.349265 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.349469 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.349570 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.349866 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.349982 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.350112 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.350206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.350411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.350519 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.350723 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.350846 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.351029 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.351132 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.351332 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.351445 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.351638 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.351731 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.351940 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.352070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.352270 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.352371 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.352572 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.352663 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.352888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.352987 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.353201 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.353368 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.353518 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.353654 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.353797 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.353964 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.354115 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.354262 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.354400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.354535 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.354705 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.354842 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.355013 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.355149 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.355321 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.355465 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.355628 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.355772 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.355938 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.356097 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.356272 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.356400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.356661 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.356795 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.356980 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.357084 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.357262 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.357363 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.357572 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.357673 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.357893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.357986 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.358196 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.358287 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.358504 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.358610 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.358805 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.358898 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.359110 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.359208 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.359412 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.359529 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.359730 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.359832 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.360171 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.360278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.360480 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.360581 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.360780 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.360870 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.361082 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.361180 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.361393 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.361497 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.361716 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.361815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.362022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.362122 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.362328 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.362424 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.362632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.362732 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.362953 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.363071 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.363264 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.363396 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.363568 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.363684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.364019 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.364215 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.364386 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.364546 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.364694 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.364831 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.365005 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.365160 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.365361 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.365499 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.365659 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.365813 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.365983 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.366126 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.366307 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.366456 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.366630 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.366774 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.366926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.367576 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.367728 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.367880 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.368059 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.368171 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.368269 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.368362 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.368455 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.368549 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.368645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.368740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.368829 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.368936 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.369081 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.369247 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.369405 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.369556 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.369729 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.369861 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.370041 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.370262 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.370367 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.370598 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.370762 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.370858 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.371069 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.371172 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.371376 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.371469 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.371679 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.371778 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.372010 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.372120 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.372324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.372431 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.372625 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.372724 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.372932 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.373035 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.373241 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.373341 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.373546 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.373639 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.373855 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.373965 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.374159 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.374289 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.374468 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.374586 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.374773 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.374888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.375078 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.375185 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.375379 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.375486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.375679 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.375777 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.376026 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.376138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.376329 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.376419 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.376647 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.376740 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.376963 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.377154 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.377318 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.377464 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.377622 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.377771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.377911 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.378061 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.378209 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.378355 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.378503 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.378651 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.378789 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.378935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.379082 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.379234 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.379381 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.379537 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.379676 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.379823 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.379962 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.380149 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.380322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.380456 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.380589 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.380734 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.380894 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.381075 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.381213 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.381364 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.381511 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.381650 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.381789 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.381934 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.382073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.382213 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.382396 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.382538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.382699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.382844 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.382992 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.383134 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.383287 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.383428 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.383595 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.384206 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.384447 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.384604 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.384829 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.384978 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.385141 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.385286 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.385435 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.385585 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.385726 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.385879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.386029 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.386180 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.386328 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.386481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.386623 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.386873 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.387022 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.387173 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.387324 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.387468 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.387609 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.387797 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.387797 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.388141 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.388285 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.388430 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.388579 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.388734 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.388883 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.389032 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.389181 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.389322 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.389322 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.389545 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.389633 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.389717 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.389800 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.389916 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.390015 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.390090 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.390172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.390256 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.390256 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.390472 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.390625 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.390775 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.390876 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.391088 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.391220 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.391402 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.391516 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.391713 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.391808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.392047 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.392156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.392362 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.392466 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.392671 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.392770 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.392982 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.393075 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.393292 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.393388 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.393600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.393693 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.393927 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.394196 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.394388 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.394539 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.394640 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.394763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.394917 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.395079 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.395179 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.395394 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.395487 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.395751 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.395854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.396088 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.396182 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.396405 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.396537 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.396861 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.397002 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.397150 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.397241 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.397459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.397559 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.397771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.397876 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.398085 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.398186 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.398399 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.398668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.398782 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.398888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.399006 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.399100 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.399314 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.399416 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.399622 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.399724 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.399932 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.400096 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.400266 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.400359 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.400580 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.400722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.400902 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.401017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.401223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.401320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.401525 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.401625 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.401833 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.401924 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.402141 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.402231 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.402449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.402548 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.402761 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.402966 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.403056 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.403284 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.403376 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.403613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.403703 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.403935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.404063 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.404313 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.404415 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.404609 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.404775 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.404938 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.405085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.405232 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.405371 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.405520 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.405683 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.405816 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.405960 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.406099 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.406238 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.406384 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.406663 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.406823 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.406975 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.407123 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.407277 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.407417 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.407554 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.407699 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.407875 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.408030 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.408245 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.408380 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.408562 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.408821 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.408927 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.409170 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.409270 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.409472 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.409563 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.409781 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.409894 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.410089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.410190 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.410395 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.410487 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.410719 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.410834 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.411030 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.411139 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.411331 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.411425 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.411636 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.411735 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.411941 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.412045 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.412302 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.412542 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.412649 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.412897 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.412988 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.413207 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.413306 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.413515 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.413607 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.413815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.413914 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.414123 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.414221 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.414431 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.414539 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.414742 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.414841 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.415071 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.415185 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.415340 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.415432 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.415642 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.415748 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.415950 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.416061 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.416274 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.416372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.416575 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.416681 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.416875 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.416980 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.417207 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.417313 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.417479 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.417586 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.417774 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.417878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.418082 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.418172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.418382 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.418495 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.418692 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.418849 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.418990 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.419090 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.419292 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.419390 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.419604 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.419708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.419910 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.420047 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.420243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.420343 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.420546 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.420637 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.420848 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.420955 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.421157 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.421255 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.421460 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.421560 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.421767 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.421865 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.422072 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.422478 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.422691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.422782 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.422994 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.423087 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.423303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.423620 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.423720 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.423953 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.424302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.424302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.424494 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.424628 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.424720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.424885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.425021 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.425219 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.425331 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.425524 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.425668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.425827 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.425969 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.463804 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.464791 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.464889 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.464963 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.465165 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.465299 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.465414 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.465414 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.465649 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.465773 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.465890 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.465890 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.465890 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.465890 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.465890 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.465890 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.465890 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.465890 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.466976 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.467130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.467286 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.467430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.467576 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.467718 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.467939 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.468104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.468241 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.468388 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.468533 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.468692 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.468835 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.468982 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.469136 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.469291 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.469458 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.469610 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.469753 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.469929 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.470199 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.470458 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.470725 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.470969 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.471217 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.471444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.471669 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.471912 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.472226 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.472226 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.472562 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.472707 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.472847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.473012 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.473164 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.473311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.473510 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.473763 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.474041 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.474566 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.474823 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.475126 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.475477 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.475477 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.476048 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.476273 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.476457 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.476580 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.476704 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.476781 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.476901 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.477043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.477159 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.477275 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.477389 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.477516 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.477639 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.477760 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.477878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.477997 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.478119 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.478238 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.478356 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.478475 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.478604 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.478723 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.478850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.478970 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.479090 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.479209 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.479336 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.479455 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.479574 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.479694 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.479813 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.479939 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.480104 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.480104 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.480341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.480463 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.480579 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.480705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.480705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.480705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.480705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.481131 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.481247 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.481370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.481488 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.481612 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.481728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.481728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.481950 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.482077 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.482191 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.482306 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.482421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.482535 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.482677 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.482811 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.482936 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.483061 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.483178 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.483293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.483410 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.483533 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.483649 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.483764 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.483880 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.484016 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.484170 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.484333 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.484489 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.484602 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.484744 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.484910 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.484910 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.485101 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.485101 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.485242 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.485324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.485382 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.485496 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.485572 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.485630 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.485697 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.485764 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.485831 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.485971 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.486049 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.486203 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.486335 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.486459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.486536 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.486654 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.486732 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.486836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.486956 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.487097 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.487181 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.487318 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.487437 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.487555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.487673 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.487793 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.487922 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.488055 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.488192 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.488323 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.488438 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.488556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.488684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.488814 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.488935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.489055 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.489177 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.489292 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.489419 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.489541 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.489662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.489777 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.489897 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.490026 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.490149 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.490330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.490470 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.490594 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.490711 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.490711 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.491006 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.491006 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.491243 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.491358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.491476 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.491602 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.491721 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.491721 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.491951 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.491951 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.492221 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.492352 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.492469 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.492586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.492707 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.492826 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.492954 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.493071 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.493188 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.493306 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.493435 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.493556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.493684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.493804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.493923 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.494043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.494162 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.494281 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.494410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.494539 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.494658 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.494774 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.494895 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.495032 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.495032 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.495032 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.495032 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.495032 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.495032 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.495032 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.495032 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.495912 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.496052 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.496052 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.496275 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.496411 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.496542 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.496658 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.496775 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.496892 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.497010 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.497010 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.497237 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.497237 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.497237 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.497237 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.497237 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.497771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 14:24:41.497771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 14:24:41.498010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 14:24:41.534771 n-d-846435-14 devstack@n-api.service[119304]: INFO dbcounter [None req-39a5f6f7-d86a-4a04-96c1-d2c1ddd8acbe None None] Registered counter for database nova_api Jul 25 14:24:41.535022 n-d-846435-14 devstack@n-api.service[119303]: INFO dbcounter [None req-7c70614f-b1b1-45ea-83bd-753bd7ead9d5 None None] Registered counter for database nova_api Jul 25 14:24:41.555760 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_db.sqlalchemy.engines [None req-39a5f6f7-d86a-4a04-96c1-d2c1ddd8acbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 14:24:41.557370 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_db.sqlalchemy.engines [None req-7c70614f-b1b1-45ea-83bd-753bd7ead9d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 14:24:41.562777 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writer thread running {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 14:24:41.564557 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writer thread running {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 14:24:41.618469 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.context [None req-39a5f6f7-d86a-4a04-96c1-d2c1ddd8acbe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cadb07ed-5464-41eb-afb8-bf9dd92401b6(cell1) {{(pid=119304) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 14:24:41.621524 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.context [None req-7c70614f-b1b1-45ea-83bd-753bd7ead9d5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cadb07ed-5464-41eb-afb8-bf9dd92401b6(cell1) {{(pid=119303) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 14:24:41.622532 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-39a5f6f7-d86a-4a04-96c1-d2c1ddd8acbe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:24:41.624169 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-39a5f6f7-d86a-4a04-96c1-d2c1ddd8acbe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:24:41.624953 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-39a5f6f7-d86a-4a04-96c1-d2c1ddd8acbe None None] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:24:41.625768 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7c70614f-b1b1-45ea-83bd-753bd7ead9d5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:24:41.627031 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-39a5f6f7-d86a-4a04-96c1-d2c1ddd8acbe None None] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:24:41.627354 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7c70614f-b1b1-45ea-83bd-753bd7ead9d5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:24:41.628179 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7c70614f-b1b1-45ea-83bd-753bd7ead9d5 None None] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:24:41.629415 n-d-846435-14 devstack@n-api.service[119304]: INFO dbcounter [None req-39a5f6f7-d86a-4a04-96c1-d2c1ddd8acbe None None] Registered counter for database nova_cell0 Jul 25 14:24:41.630268 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7c70614f-b1b1-45ea-83bd-753bd7ead9d5 None None] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:24:41.632344 n-d-846435-14 devstack@n-api.service[119303]: INFO dbcounter [None req-7c70614f-b1b1-45ea-83bd-753bd7ead9d5 None None] Registered counter for database nova_cell0 Jul 25 14:24:41.633415 n-d-846435-14 devstack@n-api.service[119304]: INFO dbcounter [None req-39a5f6f7-d86a-4a04-96c1-d2c1ddd8acbe None None] Registered counter for database nova_cell1 Jul 25 14:24:41.636594 n-d-846435-14 devstack@n-api.service[119303]: INFO dbcounter [None req-7c70614f-b1b1-45ea-83bd-753bd7ead9d5 None None] Registered counter for database nova_cell1 Jul 25 14:24:41.641476 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_db.sqlalchemy.engines [None req-39a5f6f7-d86a-4a04-96c1-d2c1ddd8acbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 14:24:41.642743 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_db.sqlalchemy.engines [None req-39a5f6f7-d86a-4a04-96c1-d2c1ddd8acbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 14:24:41.644821 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_db.sqlalchemy.engines [None req-7c70614f-b1b1-45ea-83bd-753bd7ead9d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 14:24:41.649234 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_db.sqlalchemy.engines [None req-7c70614f-b1b1-45ea-83bd-753bd7ead9d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 14:24:41.649606 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writer thread running {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 14:24:41.650772 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writer thread running {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 14:24:41.650872 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writer thread running {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 14:24:41.790304 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writer thread running {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 14:24:41.795878 n-d-846435-14 devstack@n-api.service[119304]: INFO dbcounter [None req-39a5f6f7-d86a-4a04-96c1-d2c1ddd8acbe None None] Registered counter for database nova_cell0 Jul 25 14:24:41.800605 n-d-846435-14 devstack@n-api.service[119303]: INFO dbcounter [None req-7c70614f-b1b1-45ea-83bd-753bd7ead9d5 None None] Registered counter for database nova_cell0 Jul 25 14:24:41.803167 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_db.sqlalchemy.engines [None req-39a5f6f7-d86a-4a04-96c1-d2c1ddd8acbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 14:24:41.807900 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writer thread running {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 14:24:41.809463 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_db.sqlalchemy.engines [None req-7c70614f-b1b1-45ea-83bd-753bd7ead9d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 14:24:41.814130 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writer thread running {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 14:24:42.118920 n-d-846435-14 devstack@n-api.service[119304]: WARNING keystonemiddleware.auth_token [None req-39a5f6f7-d86a-4a04-96c1-d2c1ddd8acbe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 14:24:42.126225 n-d-846435-14 devstack@n-api.service[119304]: WARNING keystonemiddleware.auth_token [None req-39a5f6f7-d86a-4a04-96c1-d2c1ddd8acbe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 14:24:42.133557 n-d-846435-14 devstack@n-api.service[119303]: WARNING keystonemiddleware.auth_token [None req-7c70614f-b1b1-45ea-83bd-753bd7ead9d5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 14:24:42.140903 n-d-846435-14 devstack@n-api.service[119303]: WARNING keystonemiddleware.auth_token [None req-7c70614f-b1b1-45ea-83bd-753bd7ead9d5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 14:24:42.463701 n-d-846435-14 devstack@n-api.service[119304]: WARNING keystonemiddleware.auth_token [None req-39a5f6f7-d86a-4a04-96c1-d2c1ddd8acbe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 14:24:42.471321 n-d-846435-14 devstack@n-api.service[119304]: WARNING keystonemiddleware.auth_token [None req-39a5f6f7-d86a-4a04-96c1-d2c1ddd8acbe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 14:24:42.478671 n-d-846435-14 devstack@n-api.service[119304]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d334eaf9c0 pid: 119304 (default app) Jul 25 14:24:42.480541 n-d-846435-14 devstack@n-api.service[119303]: WARNING keystonemiddleware.auth_token [None req-7c70614f-b1b1-45ea-83bd-753bd7ead9d5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 14:24:42.493323 n-d-846435-14 devstack@n-api.service[119303]: WARNING keystonemiddleware.auth_token [None req-7c70614f-b1b1-45ea-83bd-753bd7ead9d5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 14:24:42.498672 n-d-846435-14 devstack@n-api.service[119303]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d334eaf9c0 pid: 119303 (default app) Jul 25 14:25:28.248866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:25:28.250011 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:25:28.250814 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:25:28.252905 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:25:28.710709 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:25:28.712337 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:25:28.713578 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:25:28.716798 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:25:29.797509 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ae1ac5fa-88fa-4469-9238-9118b2f6b30d tempest-AZAdminV2TestJSON-1595814687 tempest-AZAdminV2TestJSON-1595814687-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:29.799321 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ae1ac5fa-88fa-4469-9238-9118b2f6b30d tempest-AZAdminV2TestJSON-1595814687 tempest-AZAdminV2TestJSON-1595814687-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:29.799991 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ae1ac5fa-88fa-4469-9238-9118b2f6b30d tempest-AZAdminV2TestJSON-1595814687 tempest-AZAdminV2TestJSON-1595814687-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:29.800557 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ae1ac5fa-88fa-4469-9238-9118b2f6b30d tempest-AZAdminV2TestJSON-1595814687 tempest-AZAdminV2TestJSON-1595814687-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:29.800966 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ae1ac5fa-88fa-4469-9238-9118b2f6b30d tempest-AZAdminV2TestJSON-1595814687 tempest-AZAdminV2TestJSON-1595814687-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:29.863350 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ae1ac5fa-88fa-4469-9238-9118b2f6b30d tempest-AZAdminV2TestJSON-1595814687 tempest-AZAdminV2TestJSON-1595814687-project-admin] 10.222.0.88 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.620249 Jul 25 14:25:29.865587 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1/1] 10.222.0.88 () {58 vars in 1164 bytes} [Mon Jul 25 14:25:28 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:25:30.126554 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b8cd70b7-4915-49c0-9d67-7702a67a2b22 tempest-AggregatesAdminTestV241-81003580 tempest-AggregatesAdminTestV241-81003580-project-admin] Calling method '.version_select at 0x7f46960ffa60>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:30.135297 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:30.135297 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:30.148285 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b8cd70b7-4915-49c0-9d67-7702a67a2b22 tempest-AggregatesAdminTestV241-81003580 tempest-AggregatesAdminTestV241-81003580-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cadb07ed-5464-41eb-afb8-bf9dd92401b6(cell1) {{(pid=119304) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 25 14:25:30.149097 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8cd70b7-4915-49c0-9d67-7702a67a2b22 tempest-AggregatesAdminTestV241-81003580 tempest-AggregatesAdminTestV241-81003580-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:30.154977 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8cd70b7-4915-49c0-9d67-7702a67a2b22 tempest-AggregatesAdminTestV241-81003580 tempest-AggregatesAdminTestV241-81003580-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:30.218175 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8cd70b7-4915-49c0-9d67-7702a67a2b22 tempest-AggregatesAdminTestV241-81003580 tempest-AggregatesAdminTestV241-81003580-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:30.223442 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8cd70b7-4915-49c0-9d67-7702a67a2b22 tempest-AggregatesAdminTestV241-81003580 tempest-AggregatesAdminTestV241-81003580-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:30.250814 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8cd70b7-4915-49c0-9d67-7702a67a2b22 tempest-AggregatesAdminTestV241-81003580 tempest-AggregatesAdminTestV241-81003580-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:30.251245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-94f8dc4b-1317-4a94-a6d5-e61dc46c0032 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1301191300", "ram": 512, "vcpus": 1, "disk": 10, "id": 692371424, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:30.251700 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8cd70b7-4915-49c0-9d67-7702a67a2b22 tempest-AggregatesAdminTestV241-81003580 tempest-AggregatesAdminTestV241-81003580-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:30.264469 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b8cd70b7-4915-49c0-9d67-7702a67a2b22 tempest-AggregatesAdminTestV241-81003580 tempest-AggregatesAdminTestV241-81003580-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.396827 Jul 25 14:25:30.265071 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2/2] 10.222.0.88 () {60 vars in 1208 bytes} [Mon Jul 25 14:25:29 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:25:30.287293 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:30.287293 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:30.369681 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-94f8dc4b-1317-4a94-a6d5-e61dc46c0032 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 1.664779 Jul 25 14:25:30.381747 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1/3] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:25:28 2022] POST /compute/v2.1/flavors => generated 413 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:30.733773 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9a61a69d-7120-471f-9cae-1e677e6fdf94 tempest-FlavorMetadataValidation-1696092200 tempest-FlavorMetadataValidation-1696092200-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1669887657", "id": 1581497851, "os-flavor-access:is_public": "True"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:30.765601 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:30.765601 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:30.787748 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-28d0b355-f0bd-4fd9-b6e6-7b6a56f7d234 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Calling method '.version_select at 0x7f46960fcf70>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:30.789032 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:30.789032 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:30.800020 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-28d0b355-f0bd-4fd9-b6e6-7b6a56f7d234 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cadb07ed-5464-41eb-afb8-bf9dd92401b6(cell1) {{(pid=119303) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 25 14:25:30.800827 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-28d0b355-f0bd-4fd9-b6e6-7b6a56f7d234 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:30.801262 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-28d0b355-f0bd-4fd9-b6e6-7b6a56f7d234 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:30.817827 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9a61a69d-7120-471f-9cae-1e677e6fdf94 tempest-FlavorMetadataValidation-1696092200 tempest-FlavorMetadataValidation-1696092200-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.548220 Jul 25 14:25:30.830152 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3/4] 10.222.0.88 () {62 vars in 1188 bytes} [Mon Jul 25 14:25:30 2022] POST /compute/v2.1/flavors => generated 471 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:25:30.855046 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-28d0b355-f0bd-4fd9-b6e6-7b6a56f7d234 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:30.855721 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-28d0b355-f0bd-4fd9-b6e6-7b6a56f7d234 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:30.889861 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-28d0b355-f0bd-4fd9-b6e6-7b6a56f7d234 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:30.890329 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-28d0b355-f0bd-4fd9-b6e6-7b6a56f7d234 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:30.905964 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-28d0b355-f0bd-4fd9-b6e6-7b6a56f7d234 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.519148 Jul 25 14:25:30.906806 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2/5] 10.222.0.88 () {58 vars in 1167 bytes} [Mon Jul 25 14:25:30 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:30.914289 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3b36a047-3858-4c2c-ac2a-92b10082f501 tempest-AZAdminV2TestJSON-1595814687 tempest-AZAdminV2TestJSON-1595814687-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:30.915547 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:30.915547 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:30.916873 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b36a047-3858-4c2c-ac2a-92b10082f501 tempest-AZAdminV2TestJSON-1595814687 tempest-AZAdminV2TestJSON-1595814687-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:30.917384 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b36a047-3858-4c2c-ac2a-92b10082f501 tempest-AZAdminV2TestJSON-1595814687 tempest-AZAdminV2TestJSON-1595814687-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:30.918484 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b36a047-3858-4c2c-ac2a-92b10082f501 tempest-AZAdminV2TestJSON-1595814687 tempest-AZAdminV2TestJSON-1595814687-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:30.920699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b36a047-3858-4c2c-ac2a-92b10082f501 tempest-AZAdminV2TestJSON-1595814687 tempest-AZAdminV2TestJSON-1595814687-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:31.008907 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3b36a047-3858-4c2c-ac2a-92b10082f501 tempest-AZAdminV2TestJSON-1595814687 tempest-AZAdminV2TestJSON-1595814687-project-admin] 10.222.0.88 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.100199 Jul 25 14:25:31.010452 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3/6] 10.222.0.88 () {58 vars in 1185 bytes} [Mon Jul 25 14:25:30 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:31.034091 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a5756618-4675-4569-9fbc-77d1fa004fba tempest-AggregatesAdminTestV241-81003580 tempest-AggregatesAdminTestV241-81003580-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-297954185"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:31.038674 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:31.038674 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:31.042572 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.aggregate [None req-a5756618-4675-4569-9fbc-77d1fa004fba tempest-AggregatesAdminTestV241-81003580 tempest-AggregatesAdminTestV241-81003580-project-admin] Generated uuid 6427065e-734a-4860-8126-71f8fe9cbb85 for aggregate {{(pid=119303) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 14:25:31.130015 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-16b308ae-1c6f-47c1-8e5f-c11e69393eef tempest-HypervisorAdminNegativeTestJSON-1201469204 tempest-HypervisorAdminNegativeTestJSON-1201469204-project] Calling method '.version_select at 0x7f4695f11e50>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:31.131063 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:31.131063 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:31.132440 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-16b308ae-1c6f-47c1-8e5f-c11e69393eef tempest-HypervisorAdminNegativeTestJSON-1201469204 tempest-HypervisorAdminNegativeTestJSON-1201469204-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'c70258c1f3bd43bc8f1da781ad98ed55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2018ea1a9c94e02bcae7414e0a0d988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:25:31.139346 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-16b308ae-1c6f-47c1-8e5f-c11e69393eef tempest-HypervisorAdminNegativeTestJSON-1201469204 tempest-HypervisorAdminNegativeTestJSON-1201469204-project] Request method failure captured: Jul 25 14:25:31.139346 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jul 25 14:25:31.139346 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:25:31.139346 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:25:31.139346 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:25:31.139346 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:25:31.139346 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:25:31.139346 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:25:31.139346 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:25:31.139346 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:25:31.139346 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfXPk7XG7fyqylEnzqfDXBufxv8JQlSs3-BfKcSzH0owfhbJfMdYnlyDYnIGiI7m5RtSVReZWU2zllKNkP1q7OHfheiMxGq2NRT4hdWMOem25LLgGl3D6WcAuFPlC0NRI0xJvYMkAl_5bMG6G8yqa5U7zUq4lpugXa3CI_PEB60Odk Jul 25 14:25:31.139346 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:25:31.139346 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:25:31.139346 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:25:31.139346 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:25:31.139346 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:25:31.139346 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:25:31.139346 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: f2018ea1a9c94e02bcae7414e0a0d988 Jul 25 14:25:31.139346 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1201469204 Jul 25 14:25:31.139346 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:25:31.139346 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:25:31.140813 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f2018ea1a9c94e02bcae7414e0a0d988"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f2018ea1a9c94e02bcae7414e0a0d988"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f2018ea1a9c94e02bcae7414e0a0d988", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f2018ea1a9c94e02bcae7414e0a0d988"}]}] Jul 25 14:25:31.140813 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1201469204 Jul 25 14:25:31.140813 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: f2018ea1a9c94e02bcae7414e0a0d988 Jul 25 14:25:31.140813 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1201469204 Jul 25 14:25:31.140813 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-HypervisorAdminNegativeTestJSON-1201469204-project Jul 25 14:25:31.140813 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:25:31.140813 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:25:31.140813 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: c70258c1f3bd43bc8f1da781ad98ed55 Jul 25 14:25:31.140813 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1201469204-project Jul 25 14:25:31.140813 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:25:31.140813 n-d-846435-14 devstack@n-api.service[119304]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 25 14:25:31.140813 n-d-846435-14 devstack@n-api.service[119304]: action_args: {} Jul 25 14:25:31.140813 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:25:31.141503 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:31.141503 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:31.141503 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:31.141503 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:25:31.141503 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:25:31.141503 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:25:31.141503 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:25:31.141503 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:25:31.141503 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:25:31.141503 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jul 25 14:25:31.141503 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._detail(req) Jul 25 14:25:31.141503 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jul 25 14:25:31.141503 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jul 25 14:25:31.141503 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 14:25:31.141503 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 14:25:31.141503 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 14:25:31.141503 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 14:25:31.141503 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:25:31.141503 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:25:31.142493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:25:31.142493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:25:31.142493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 14:25:31.142493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 14:25:31.142493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 14:25:31.142493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 14:25:31.142493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 14:25:31.142493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 14:25:31.142493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 25 14:25:31.142493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:31.142493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:31.142493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:31.142493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:31.142493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:31.142493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:31.142493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 14:25:31.142493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 14:25:31.142493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 25 14:25:31.142493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:31.150896 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-16b308ae-1c6f-47c1-8e5f-c11e69393eef tempest-HypervisorAdminNegativeTestJSON-1201469204 tempest-HypervisorAdminNegativeTestJSON-1201469204-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:25:31.152305 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-16b308ae-1c6f-47c1-8e5f-c11e69393eef tempest-HypervisorAdminNegativeTestJSON-1201469204 tempest-HypervisorAdminNegativeTestJSON-1201469204-project] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.320546 Jul 25 14:25:31.153349 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4/7] 10.222.0.88 () {58 vars in 1167 bytes} [Mon Jul 25 14:25:30 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 322 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:25:31.169452 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a5756618-4675-4569-9fbc-77d1fa004fba tempest-AggregatesAdminTestV241-81003580 tempest-AggregatesAdminTestV241-81003580-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.154033 Jul 25 14:25:31.170305 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 4/8] 10.222.0.88 () {62 vars in 1205 bytes} [Mon Jul 25 14:25:31 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:25:31.185553 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-48feb525-8b68-44b4-bd28-9982376a530c tempest-FlavorMetadataValidation-1696092200 tempest-FlavorMetadataValidation-1696092200-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:31.191125 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:31.191125 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:31.330199 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e79f0205-58e9-47da-8879-93d198177dbc tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:31.371362 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-e79f0205-58e9-47da-8879-93d198177dbc tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916-project] HTTP exception thrown: Flavor 692371424 has no extra specs with key hw:cpu_thread_policy. Jul 25 14:25:31.375501 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e79f0205-58e9-47da-8879-93d198177dbc tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916-project] Request method failure captured: Jul 25 14:25:31.375501 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/flavors/692371424/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 25 14:25:31.375501 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:25:31.375501 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:25:31.375501 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:25:31.375501 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:25:31.375501 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:25:31.375501 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:25:31.375501 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:25:31.375501 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:25:31.375501 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfWurkPQ74ddJ4EKMqMbCoUvC4HZdXVfUCpzCKhE0vwPPRjxvkd2LU430zLC6JNB84R0wlOJs8Ce2K5TcAE1k4ibyWOZytcPvNHxjrF1VYO1I962U2hGBoKz-cJzrbJx2d1G7DmqFb6zW58JTn4zdSKrekLEiryU_bwwQ3INMUIvoU Jul 25 14:25:31.375501 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:25:31.375501 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:25:31.375501 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:25:31.375501 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:25:31.375501 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:25:31.375501 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:25:31.375501 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 90c418435b6f4541a7e994cca48fe6f3 Jul 25 14:25:31.375501 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916 Jul 25 14:25:31.375501 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:25:31.375501 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:25:31.376611 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90c418435b6f4541a7e994cca48fe6f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90c418435b6f4541a7e994cca48fe6f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_90c418435b6f4541a7e994cca48fe6f3", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/90c418435b6f4541a7e994cca48fe6f3"}]}] Jul 25 14:25:31.376611 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916 Jul 25 14:25:31.376611 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 90c418435b6f4541a7e994cca48fe6f3 Jul 25 14:25:31.376611 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916 Jul 25 14:25:31.376611 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916-project Jul 25 14:25:31.376611 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:25:31.376611 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:25:31.376611 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 2ba4c706ff8f42c4a4b2c636274fea7f Jul 25 14:25:31.376611 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916-project Jul 25 14:25:31.376611 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:25:31.376611 n-d-846435-14 devstack@n-api.service[119304]: exception: Flavor 692371424 has no extra specs with key hw:cpu_thread_policy. Jul 25 14:25:31.377159 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'flavor_id': '692371424', 'id': 'hw:cpu_thread_policy'} Jul 25 14:25:31.377159 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:25:31.377159 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:31.377159 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jul 25 14:25:31.377159 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jul 25 14:25:31.377159 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 25 14:25:31.377159 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:31.377159 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:31.377159 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:31.377159 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:31.377159 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:31.377159 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:31.377159 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:25:31.377159 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:25:31.377159 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:25:31.377159 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:25:31.377159 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jul 25 14:25:31.377159 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 14:25:31.377159 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 692371424 has no extra specs with key hw:cpu_thread_policy. Jul 25 14:25:31.377159 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:31.377159 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:31.377159 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:31.378174 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:31.378174 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:31.378174 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:31.378174 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:25:31.378174 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:25:31.378174 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 692371424 has no extra specs with key hw:cpu_thread_policy. Jul 25 14:25:31.378174 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:31.379198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e79f0205-58e9-47da-8879-93d198177dbc tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916-project] Returning 404 to user: Flavor 692371424 has no extra specs with key hw:cpu_thread_policy. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:25:31.381966 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e79f0205-58e9-47da-8879-93d198177dbc tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916-project] 10.222.0.88 "GET /compute/v2.1/flavors/692371424/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.227311 Jul 25 14:25:31.387310 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 5/9] 10.222.0.88 () {58 vars in 1263 bytes} [Mon Jul 25 14:25:31 2022] GET /compute/v2.1/flavors/692371424/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:25:31.465691 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-48feb525-8b68-44b4-bd28-9982376a530c tempest-FlavorMetadataValidation-1696092200 tempest-FlavorMetadataValidation-1696092200-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors/1581497851/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.282393 Jul 25 14:25:31.471847 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 5/10] 10.222.0.88 () {62 vars in 1265 bytes} [Mon Jul 25 14:25:31 2022] POST /compute/v2.1/flavors/1581497851/os-extra_specs => generated 62 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:31.485367 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-61f7b409-135f-4318-85d7-dc62f68ff2a3 tempest-HypervisorAdminNegativeTestJSON-1201469204 tempest-HypervisorAdminNegativeTestJSON-1201469204-project] Calling method '.version_select at 0x7f46956a5790>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:31.489603 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:31.489603 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:31.490804 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-61f7b409-135f-4318-85d7-dc62f68ff2a3 tempest-HypervisorAdminNegativeTestJSON-1201469204 tempest-HypervisorAdminNegativeTestJSON-1201469204-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'c70258c1f3bd43bc8f1da781ad98ed55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2018ea1a9c94e02bcae7414e0a0d988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:25:31.501428 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-61f7b409-135f-4318-85d7-dc62f68ff2a3 tempest-HypervisorAdminNegativeTestJSON-1201469204 tempest-HypervisorAdminNegativeTestJSON-1201469204-project] Request method failure captured: Jul 25 14:25:31.501428 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jul 25 14:25:31.501428 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:25:31.501428 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:25:31.501428 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:25:31.501428 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:25:31.501428 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:25:31.501428 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:25:31.501428 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:25:31.501428 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:25:31.501428 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qfXPk7XG7fyqylEnzqfDXBufxv8JQlSs3-BfKcSzH0owfhbJfMdYnlyDYnIGiI7m5RtSVReZWU2zllKNkP1q7OHfheiMxGq2NRT4hdWMOem25LLgGl3D6WcAuFPlC0NRI0xJvYMkAl_5bMG6G8yqa5U7zUq4lpugXa3CI_PEB60Odk Jul 25 14:25:31.501428 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:25:31.501428 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:25:31.501428 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:25:31.501428 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:25:31.501428 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:25:31.501428 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:25:31.501428 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: f2018ea1a9c94e02bcae7414e0a0d988 Jul 25 14:25:31.501428 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1201469204 Jul 25 14:25:31.501428 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:25:31.501428 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:25:31.502560 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f2018ea1a9c94e02bcae7414e0a0d988"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f2018ea1a9c94e02bcae7414e0a0d988"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f2018ea1a9c94e02bcae7414e0a0d988", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f2018ea1a9c94e02bcae7414e0a0d988"}]}] Jul 25 14:25:31.502560 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1201469204 Jul 25 14:25:31.502560 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: f2018ea1a9c94e02bcae7414e0a0d988 Jul 25 14:25:31.502560 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1201469204 Jul 25 14:25:31.502560 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-HypervisorAdminNegativeTestJSON-1201469204-project Jul 25 14:25:31.502560 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:25:31.502560 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:25:31.502560 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: c70258c1f3bd43bc8f1da781ad98ed55 Jul 25 14:25:31.502560 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1201469204-project Jul 25 14:25:31.502560 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:25:31.502560 n-d-846435-14 devstack@n-api.service[119303]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 25 14:25:31.502560 n-d-846435-14 devstack@n-api.service[119303]: action_args: {} Jul 25 14:25:31.502560 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:25:31.503191 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:31.503191 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:31.503191 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:31.503191 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:25:31.503191 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:25:31.503191 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:25:31.503191 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:25:31.503191 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:25:31.503191 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:25:31.503191 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jul 25 14:25:31.503191 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 25 14:25:31.503191 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jul 25 14:25:31.503191 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jul 25 14:25:31.503191 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 14:25:31.503191 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 14:25:31.503191 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 14:25:31.503191 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 14:25:31.503191 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:25:31.503191 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:25:31.504098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:25:31.504098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:25:31.504098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 14:25:31.504098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 14:25:31.504098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 14:25:31.504098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 14:25:31.504098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 14:25:31.504098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 14:25:31.504098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 25 14:25:31.504098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:31.504098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:31.504098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:31.504098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:31.504098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:31.504098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:31.504098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 14:25:31.504098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 14:25:31.504098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 25 14:25:31.504098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:31.505150 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-61f7b409-135f-4318-85d7-dc62f68ff2a3 tempest-HypervisorAdminNegativeTestJSON-1201469204 tempest-HypervisorAdminNegativeTestJSON-1201469204-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:25:31.505975 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-61f7b409-135f-4318-85d7-dc62f68ff2a3 tempest-HypervisorAdminNegativeTestJSON-1201469204 tempest-HypervisorAdminNegativeTestJSON-1201469204-project] 10.222.0.88 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.034535 Jul 25 14:25:31.507104 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 6/11] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:25:31 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:25:31.519613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-58f25cfa-9032-4069-ae3c-461733e8002a tempest-AggregatesAdminTestV241-81003580 tempest-AggregatesAdminTestV241-81003580-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1121200208"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:31.632620 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:31.632620 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:31.678821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-af9585ae-e1a9-4ed7-ac1d-726630a2de89 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-727312302", "id": 1501334179, "os-flavor-access:is_public": "True"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:31.686318 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-58f25cfa-9032-4069-ae3c-461733e8002a tempest-AggregatesAdminTestV241-81003580 tempest-AggregatesAdminTestV241-81003580-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.177770 Jul 25 14:25:31.687836 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 7/12] 10.222.0.88 () {62 vars in 1210 bytes} [Mon Jul 25 14:25:31 2022] PUT /compute/v2.1/os-aggregates/1 => generated 299 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:25:31.693242 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7dd655b1-a57c-4ce6-b3b8-87a3d8188fd4 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:31.696660 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:31.696660 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:31.698327 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7dd655b1-a57c-4ce6-b3b8-87a3d8188fd4 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '2ba4c706ff8f42c4a4b2c636274fea7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c418435b6f4541a7e994cca48fe6f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:25:31.701232 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7dd655b1-a57c-4ce6-b3b8-87a3d8188fd4 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916-project] Request method failure captured: Jul 25 14:25:31.701232 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/flavors/692371424/os-extra_specs HTTP/1.1 Jul 25 14:25:31.701232 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:25:31.701232 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:25:31.701232 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:25:31.701232 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 66 Jul 25 14:25:31.701232 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:25:31.701232 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:25:31.701232 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:25:31.701232 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:25:31.701232 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qfWurkPQ74ddJ4EKMqMbCoUvC4HZdXVfUCpzCKhE0vwPPRjxvkd2LU430zLC6JNB84R0wlOJs8Ce2K5TcAE1k4ibyWOZytcPvNHxjrF1VYO1I962U2hGBoKz-cJzrbJx2d1G7DmqFb6zW58JTn4zdSKrekLEiryU_bwwQ3INMUIvoU Jul 25 14:25:31.701232 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:25:31.701232 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:25:31.701232 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:25:31.701232 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:25:31.701232 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:25:31.701232 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:25:31.701232 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 90c418435b6f4541a7e994cca48fe6f3 Jul 25 14:25:31.701232 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916 Jul 25 14:25:31.701232 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:25:31.701232 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:25:31.702267 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90c418435b6f4541a7e994cca48fe6f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90c418435b6f4541a7e994cca48fe6f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_90c418435b6f4541a7e994cca48fe6f3", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/90c418435b6f4541a7e994cca48fe6f3"}]}] Jul 25 14:25:31.702267 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916 Jul 25 14:25:31.702267 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 90c418435b6f4541a7e994cca48fe6f3 Jul 25 14:25:31.702267 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916 Jul 25 14:25:31.702267 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916-project Jul 25 14:25:31.702267 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:25:31.702267 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:25:31.702267 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 2ba4c706ff8f42c4a4b2c636274fea7f Jul 25 14:25:31.702267 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916-project Jul 25 14:25:31.702267 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:25:31.702267 n-d-846435-14 devstack@n-api.service[119303]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jul 25 14:25:31.702267 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:25:31.702867 n-d-846435-14 devstack@n-api.service[119303]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 25 14:25:31.702867 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'flavor_id': '692371424', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jul 25 14:25:31.702867 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:25:31.702867 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:31.702867 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:31.702867 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:31.702867 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:25:31.702867 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:25:31.702867 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:25:31.702867 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:25:31.702867 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:25:31.702867 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:25:31.702867 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jul 25 14:25:31.702867 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jul 25 14:25:31.702867 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 14:25:31.702867 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 14:25:31.702867 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 14:25:31.702867 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 14:25:31.702867 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:25:31.703741 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:25:31.703741 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:25:31.703741 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:25:31.703741 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 14:25:31.703741 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 14:25:31.703741 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 14:25:31.703741 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 14:25:31.703741 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 14:25:31.703741 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 14:25:31.703741 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 25 14:25:31.703741 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:31.703741 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:31.703741 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:31.703741 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:31.703741 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:31.703741 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:31.703741 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 14:25:31.703741 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 14:25:31.703741 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 25 14:25:31.703741 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:31.710711 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-af9585ae-e1a9-4ed7-ac1d-726630a2de89 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.325627 Jul 25 14:25:31.716026 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 6/13] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:25:31 2022] POST /compute/v2.1/flavors => generated 429 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:31.716596 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0ba0a2f2-beb8-4afb-bc36-b93b92f067d8 tempest-FlavorMetadataValidation-1696092200 tempest-FlavorMetadataValidation-1696092200-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:31.717190 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:31.717190 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:31.718609 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7dd655b1-a57c-4ce6-b3b8-87a3d8188fd4 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:25:31.721104 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7dd655b1-a57c-4ce6-b3b8-87a3d8188fd4 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916-project] 10.222.0.88 "POST /compute/v2.1/flavors/692371424/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.031984 Jul 25 14:25:31.723187 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 8/14] 10.222.0.88 () {60 vars in 1221 bytes} [Mon Jul 25 14:25:31 2022] POST /compute/v2.1/flavors/692371424/os-extra_specs => generated 124 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:25:31.737454 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a7ad3619-c57e-466b-a1e0-6ca6c87d1d85 tempest-HypervisorAdminNegativeTestJSON-1201469204 tempest-HypervisorAdminNegativeTestJSON-1201469204-project] Calling method '.version_select at 0x7f46945e2af0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:31.739864 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:31.739864 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:31.741040 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a7ad3619-c57e-466b-a1e0-6ca6c87d1d85 tempest-HypervisorAdminNegativeTestJSON-1201469204 tempest-HypervisorAdminNegativeTestJSON-1201469204-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'c70258c1f3bd43bc8f1da781ad98ed55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2018ea1a9c94e02bcae7414e0a0d988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:25:31.742925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a7ad3619-c57e-466b-a1e0-6ca6c87d1d85 tempest-HypervisorAdminNegativeTestJSON-1201469204 tempest-HypervisorAdminNegativeTestJSON-1201469204-project] Request method failure captured: Jul 25 14:25:31.742925 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jul 25 14:25:31.742925 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:25:31.742925 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:25:31.742925 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:25:31.742925 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:25:31.742925 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:25:31.742925 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:25:31.742925 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:25:31.742925 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:25:31.742925 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qfXPk7XG7fyqylEnzqfDXBufxv8JQlSs3-BfKcSzH0owfhbJfMdYnlyDYnIGiI7m5RtSVReZWU2zllKNkP1q7OHfheiMxGq2NRT4hdWMOem25LLgGl3D6WcAuFPlC0NRI0xJvYMkAl_5bMG6G8yqa5U7zUq4lpugXa3CI_PEB60Odk Jul 25 14:25:31.742925 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:25:31.742925 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:25:31.742925 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:25:31.742925 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:25:31.742925 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:25:31.742925 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:25:31.742925 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: f2018ea1a9c94e02bcae7414e0a0d988 Jul 25 14:25:31.742925 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1201469204 Jul 25 14:25:31.742925 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:25:31.742925 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:25:31.744376 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f2018ea1a9c94e02bcae7414e0a0d988"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f2018ea1a9c94e02bcae7414e0a0d988"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f2018ea1a9c94e02bcae7414e0a0d988", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f2018ea1a9c94e02bcae7414e0a0d988"}]}] Jul 25 14:25:31.744376 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1201469204 Jul 25 14:25:31.744376 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: f2018ea1a9c94e02bcae7414e0a0d988 Jul 25 14:25:31.744376 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1201469204 Jul 25 14:25:31.744376 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-HypervisorAdminNegativeTestJSON-1201469204-project Jul 25 14:25:31.744376 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:25:31.744376 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:25:31.744376 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: c70258c1f3bd43bc8f1da781ad98ed55 Jul 25 14:25:31.744376 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1201469204-project Jul 25 14:25:31.744376 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:25:31.744376 n-d-846435-14 devstack@n-api.service[119303]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 25 14:25:31.744376 n-d-846435-14 devstack@n-api.service[119303]: action_args: {} Jul 25 14:25:31.744376 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:25:31.745134 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:31.745134 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:31.745134 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:31.745134 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:25:31.745134 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:25:31.745134 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:25:31.745134 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:25:31.745134 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:25:31.745134 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:25:31.745134 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jul 25 14:25:31.745134 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jul 25 14:25:31.745134 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 14:25:31.745134 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 14:25:31.745134 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 14:25:31.745134 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 14:25:31.745134 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:25:31.745134 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:25:31.745134 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:25:31.745134 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:25:31.746333 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 14:25:31.746333 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 14:25:31.746333 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 14:25:31.746333 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 14:25:31.746333 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 14:25:31.746333 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 14:25:31.746333 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 25 14:25:31.746333 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:31.746333 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:31.746333 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:31.746333 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:31.746333 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:31.746333 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:31.746333 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 14:25:31.746333 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 14:25:31.746333 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 25 14:25:31.746333 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:31.747462 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a7ad3619-c57e-466b-a1e0-6ca6c87d1d85 tempest-HypervisorAdminNegativeTestJSON-1201469204 tempest-HypervisorAdminNegativeTestJSON-1201469204-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:25:31.747462 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a7ad3619-c57e-466b-a1e0-6ca6c87d1d85 tempest-HypervisorAdminNegativeTestJSON-1201469204 tempest-HypervisorAdminNegativeTestJSON-1201469204-project] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.016722 Jul 25 14:25:31.747462 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 9/15] 10.222.0.88 () {58 vars in 1179 bytes} [Mon Jul 25 14:25:31 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:25:31.754979 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0ba0a2f2-beb8-4afb-bc36-b93b92f067d8 tempest-FlavorMetadataValidation-1696092200 tempest-FlavorMetadataValidation-1696092200-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/1581497851" status: 202 len: 0 microversion: 2.86 time: 0.041824 Jul 25 14:25:31.755698 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 7/16] 10.222.0.88 () {60 vars in 1202 bytes} [Mon Jul 25 14:25:31 2022] DELETE /compute/v2.1/flavors/1581497851 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:25:31.757881 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2050923f-1a54-43fd-bc7a-c021702a04be tempest-AggregatesAdminTestV241-81003580 tempest-AggregatesAdminTestV241-81003580-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:31.758734 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:31.758734 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:31.763018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-df297c07-7118-45ef-910b-efb8c3e8a9d7 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:31.768194 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2050923f-1a54-43fd-bc7a-c021702a04be tempest-AggregatesAdminTestV241-81003580 tempest-AggregatesAdminTestV241-81003580-project-admin] 10.222.0.88 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.018271 Jul 25 14:25:31.775181 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 10/17] 10.222.0.88 () {60 vars in 1190 bytes} [Mon Jul 25 14:25:31 2022] GET /compute/v2.1/os-aggregates/1 => generated 299 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:25:31.775181 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1d3dcaeb-d2b7-4e07-9fb2-6d9d52f041ae tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:31.777673 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:31.777673 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:31.791223 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-df297c07-7118-45ef-910b-efb8c3e8a9d7 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/1501334179" status: 202 len: 0 microversion: 2.1 time: 0.034304 Jul 25 14:25:31.792153 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 8/18] 10.222.0.88 () {58 vars in 1161 bytes} [Mon Jul 25 14:25:31 2022] DELETE /compute/v2.1/flavors/1501334179 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:25:31.815198 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1d3dcaeb-d2b7-4e07-9fb2-6d9d52f041ae tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors/692371424/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.044696 Jul 25 14:25:31.817029 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 11/19] 10.222.0.88 () {60 vars in 1221 bytes} [Mon Jul 25 14:25:31 2022] POST /compute/v2.1/flavors/692371424/os-extra_specs => generated 66 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:25:31.830853 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a670a269-9307-44c1-aa9d-c64d1a844fa3 tempest-FlavorMetadataValidation-1696092200 tempest-FlavorMetadataValidation-1696092200-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:31.890673 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a670a269-9307-44c1-aa9d-c64d1a844fa3 tempest-FlavorMetadataValidation-1696092200 tempest-FlavorMetadataValidation-1696092200-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 6267 microversion: 2.86 time: 0.072462 Jul 25 14:25:31.905503 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 12/20] 10.222.0.88 () {60 vars in 1187 bytes} [Mon Jul 25 14:25:31 2022] GET /compute/v2.1/flavors/detail => generated 6267 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:25:31.916648 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-090f329b-321a-4fe3-b1a5-09178d59a4cf tempest-AggregatesAdminTestV241-81003580 tempest-AggregatesAdminTestV241-81003580-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-846435-14"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:31.921007 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:31.921007 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:31.934123 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-090f329b-321a-4fe3-b1a5-09178d59a4cf tempest-AggregatesAdminTestV241-81003580 tempest-AggregatesAdminTestV241-81003580-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:31.934647 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-090f329b-321a-4fe3-b1a5-09178d59a4cf tempest-AggregatesAdminTestV241-81003580 tempest-AggregatesAdminTestV241-81003580-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:32.037106 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-60373b33-0889-4bfa-93b4-c183bce9d702 tempest-HypervisorAdminNegativeTestJSON-555155127 tempest-HypervisorAdminNegativeTestJSON-555155127-project-admin] Calling method '.version_select at 0x7f4695effee0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:32.038013 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:32.038013 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:32.039275 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60373b33-0889-4bfa-93b4-c183bce9d702 tempest-HypervisorAdminNegativeTestJSON-555155127 tempest-HypervisorAdminNegativeTestJSON-555155127-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:32.039793 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60373b33-0889-4bfa-93b4-c183bce9d702 tempest-HypervisorAdminNegativeTestJSON-555155127 tempest-HypervisorAdminNegativeTestJSON-555155127-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:32.103946 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60373b33-0889-4bfa-93b4-c183bce9d702 tempest-HypervisorAdminNegativeTestJSON-555155127 tempest-HypervisorAdminNegativeTestJSON-555155127-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:32.104759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60373b33-0889-4bfa-93b4-c183bce9d702 tempest-HypervisorAdminNegativeTestJSON-555155127 tempest-HypervisorAdminNegativeTestJSON-555155127-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:32.173813 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60373b33-0889-4bfa-93b4-c183bce9d702 tempest-HypervisorAdminNegativeTestJSON-555155127 tempest-HypervisorAdminNegativeTestJSON-555155127-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:32.177370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60373b33-0889-4bfa-93b4-c183bce9d702 tempest-HypervisorAdminNegativeTestJSON-555155127 tempest-HypervisorAdminNegativeTestJSON-555155127-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:32.208524 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-60373b33-0889-4bfa-93b4-c183bce9d702 tempest-HypervisorAdminNegativeTestJSON-555155127 tempest-HypervisorAdminNegativeTestJSON-555155127-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.409244 Jul 25 14:25:32.216913 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 9/21] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:25:31 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:32.230964 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bfe9f72d-f7c9-44d1-857b-06bd9c425585 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:32.325469 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bfe9f72d-f7c9-44d1-857b-06bd9c425585 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.105423 Jul 25 14:25:32.327209 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 10/22] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:25:32 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:32.348122 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0b8ff15a-aadb-47c8-986e-b9069171ec71 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:32.349528 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:32.349528 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:32.354388 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0b8ff15a-aadb-47c8-986e-b9069171ec71 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '2ba4c706ff8f42c4a4b2c636274fea7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c418435b6f4541a7e994cca48fe6f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:25:32.360289 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0b8ff15a-aadb-47c8-986e-b9069171ec71 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916-project] Request method failure captured: Jul 25 14:25:32.360289 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/flavors/692371424/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 25 14:25:32.360289 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:25:32.360289 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:25:32.360289 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:25:32.360289 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:25:32.360289 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:25:32.360289 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:25:32.360289 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:25:32.360289 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:25:32.360289 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfWurkPQ74ddJ4EKMqMbCoUvC4HZdXVfUCpzCKhE0vwPPRjxvkd2LU430zLC6JNB84R0wlOJs8Ce2K5TcAE1k4ibyWOZytcPvNHxjrF1VYO1I962U2hGBoKz-cJzrbJx2d1G7DmqFb6zW58JTn4zdSKrekLEiryU_bwwQ3INMUIvoU Jul 25 14:25:32.360289 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:25:32.360289 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:25:32.360289 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:25:32.360289 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:25:32.360289 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:25:32.360289 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:25:32.360289 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 90c418435b6f4541a7e994cca48fe6f3 Jul 25 14:25:32.360289 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916 Jul 25 14:25:32.360289 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:25:32.360289 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:25:32.361730 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90c418435b6f4541a7e994cca48fe6f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90c418435b6f4541a7e994cca48fe6f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_90c418435b6f4541a7e994cca48fe6f3", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/90c418435b6f4541a7e994cca48fe6f3"}]}] Jul 25 14:25:32.361730 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916 Jul 25 14:25:32.361730 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 90c418435b6f4541a7e994cca48fe6f3 Jul 25 14:25:32.361730 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916 Jul 25 14:25:32.361730 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916-project Jul 25 14:25:32.361730 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:25:32.361730 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:25:32.361730 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 2ba4c706ff8f42c4a4b2c636274fea7f Jul 25 14:25:32.361730 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916-project Jul 25 14:25:32.361730 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:25:32.361730 n-d-846435-14 devstack@n-api.service[119304]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 25 14:25:32.362587 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'flavor_id': '692371424', 'id': 'hw:numa_nodes'} Jul 25 14:25:32.362587 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:25:32.362587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:32.362587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:32.362587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:32.362587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:25:32.362587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:25:32.362587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:25:32.362587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:25:32.362587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jul 25 14:25:32.362587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jul 25 14:25:32.362587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 14:25:32.362587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 14:25:32.362587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 14:25:32.362587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 14:25:32.362587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:25:32.362587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:25:32.362587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:25:32.362587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:25:32.362587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 14:25:32.363516 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 14:25:32.363516 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 14:25:32.363516 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 14:25:32.363516 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 14:25:32.363516 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 14:25:32.363516 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 25 14:25:32.363516 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:32.363516 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:32.363516 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:32.363516 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:32.363516 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:32.363516 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:32.363516 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 14:25:32.363516 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 14:25:32.363516 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 25 14:25:32.363516 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:32.363516 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0b8ff15a-aadb-47c8-986e-b9069171ec71 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:25:32.364448 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0b8ff15a-aadb-47c8-986e-b9069171ec71 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916-project] 10.222.0.88 "DELETE /compute/v2.1/flavors/692371424/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.032170 Jul 25 14:25:32.367452 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 11/23] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Jul 25 14:25:32 2022] DELETE /compute/v2.1/flavors/692371424/os-extra_specs/hw:numa_nodes => generated 124 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:25:32.386268 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4922a7f9-eb8c-4d9e-b4ce-4e708c23bc13 tempest-HypervisorAdminNegativeTestJSON-1201469204 tempest-HypervisorAdminNegativeTestJSON-1201469204-project] Calling method '.version_select at 0x7f4695f4b8b0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:32.387610 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:32.387610 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:32.388882 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4922a7f9-eb8c-4d9e-b4ce-4e708c23bc13 tempest-HypervisorAdminNegativeTestJSON-1201469204 tempest-HypervisorAdminNegativeTestJSON-1201469204-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'c70258c1f3bd43bc8f1da781ad98ed55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2018ea1a9c94e02bcae7414e0a0d988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:25:32.397409 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4922a7f9-eb8c-4d9e-b4ce-4e708c23bc13 tempest-HypervisorAdminNegativeTestJSON-1201469204 tempest-HypervisorAdminNegativeTestJSON-1201469204-project] Request method failure captured: Jul 25 14:25:32.397409 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jul 25 14:25:32.397409 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:25:32.397409 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:25:32.397409 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:25:32.397409 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:25:32.397409 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:25:32.397409 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:25:32.397409 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:25:32.397409 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:25:32.397409 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfXPk7XG7fyqylEnzqfDXBufxv8JQlSs3-BfKcSzH0owfhbJfMdYnlyDYnIGiI7m5RtSVReZWU2zllKNkP1q7OHfheiMxGq2NRT4hdWMOem25LLgGl3D6WcAuFPlC0NRI0xJvYMkAl_5bMG6G8yqa5U7zUq4lpugXa3CI_PEB60Odk Jul 25 14:25:32.397409 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:25:32.397409 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:25:32.397409 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:25:32.397409 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:25:32.397409 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:25:32.397409 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:25:32.397409 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: f2018ea1a9c94e02bcae7414e0a0d988 Jul 25 14:25:32.397409 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1201469204 Jul 25 14:25:32.397409 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:25:32.397409 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:25:32.398471 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f2018ea1a9c94e02bcae7414e0a0d988"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f2018ea1a9c94e02bcae7414e0a0d988"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f2018ea1a9c94e02bcae7414e0a0d988", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f2018ea1a9c94e02bcae7414e0a0d988"}]}] Jul 25 14:25:32.398471 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1201469204 Jul 25 14:25:32.398471 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: f2018ea1a9c94e02bcae7414e0a0d988 Jul 25 14:25:32.398471 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1201469204 Jul 25 14:25:32.398471 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-HypervisorAdminNegativeTestJSON-1201469204-project Jul 25 14:25:32.398471 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:25:32.398471 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:25:32.398471 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: c70258c1f3bd43bc8f1da781ad98ed55 Jul 25 14:25:32.398471 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1201469204-project Jul 25 14:25:32.398471 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:25:32.398471 n-d-846435-14 devstack@n-api.service[119304]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 25 14:25:32.398471 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '1'} Jul 25 14:25:32.398471 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:25:32.399118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:32.399118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:32.399118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:32.399118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:25:32.399118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:25:32.399118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:25:32.399118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:25:32.399118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:25:32.399118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:25:32.399118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jul 25 14:25:32.399118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jul 25 14:25:32.399118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 14:25:32.399118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 14:25:32.399118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 14:25:32.399118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 14:25:32.399118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:25:32.399118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:25:32.399118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:25:32.399118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:25:32.400035 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 14:25:32.400035 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 14:25:32.400035 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 14:25:32.400035 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 14:25:32.400035 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 14:25:32.400035 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 14:25:32.400035 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 25 14:25:32.400035 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:32.400035 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:32.400035 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:32.400035 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:32.400035 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:32.400035 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:32.400035 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 14:25:32.400035 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 14:25:32.400035 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 25 14:25:32.400035 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:32.401640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4922a7f9-eb8c-4d9e-b4ce-4e708c23bc13 tempest-HypervisorAdminNegativeTestJSON-1201469204 tempest-HypervisorAdminNegativeTestJSON-1201469204-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:25:32.401640 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4922a7f9-eb8c-4d9e-b4ce-4e708c23bc13 tempest-HypervisorAdminNegativeTestJSON-1201469204 tempest-HypervisorAdminNegativeTestJSON-1201469204-project] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.026108 Jul 25 14:25:32.406953 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 12/24] 10.222.0.88 () {58 vars in 1173 bytes} [Mon Jul 25 14:25:32 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:25:32.414020 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-29daca2e-f7cc-4e61-bc58-8d28cfc3d2ac tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-297682280", "id": 423076400, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:32.429571 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:32.429571 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:32.461269 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-29daca2e-f7cc-4e61-bc58-8d28cfc3d2ac tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.053180 Jul 25 14:25:32.465278 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 13/25] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:25:32 2022] POST /compute/v2.1/flavors => generated 413 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:32.476698 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-420abc16-59f0-45ab-beb5-8474887292e6 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:32.487552 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:32.487552 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:32.562572 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-420abc16-59f0-45ab-beb5-8474887292e6 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors/692371424/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.095688 Jul 25 14:25:32.564102 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 14/26] 10.222.0.88 () {60 vars in 1221 bytes} [Mon Jul 25 14:25:32 2022] POST /compute/v2.1/flavors/692371424/os-extra_specs => generated 66 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:25:32.576969 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f4ea93da-d88c-4049-a08d-eef53fda2ef8 tempest-HypervisorAdminNegativeTestJSON-555155127 tempest-HypervisorAdminNegativeTestJSON-555155127-project-admin] Calling method '.version_select at 0x7f4695e5bc10>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:32.580553 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-f4ea93da-d88c-4049-a08d-eef53fda2ef8 tempest-HypervisorAdminNegativeTestJSON-555155127 tempest-HypervisorAdminNegativeTestJSON-555155127-project-admin] HTTP exception thrown: Hypervisor with ID '5a03f9dc-6cec-4d53-b9dc-c00933c88165' could not be found. Jul 25 14:25:32.584792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f4ea93da-d88c-4049-a08d-eef53fda2ef8 tempest-HypervisorAdminNegativeTestJSON-555155127 tempest-HypervisorAdminNegativeTestJSON-555155127-project-admin] Request method failure captured: Jul 25 14:25:32.584792 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/os-hypervisors/5a03f9dc-6cec-4d53-b9dc-c00933c88165/uptime HTTP/1.1 Jul 25 14:25:32.584792 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:25:32.584792 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:25:32.584792 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:25:32.584792 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:25:32.584792 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:25:32.584792 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:25:32.584792 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:25:32.584792 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:25:32.584792 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfZowRSRmhXzB35oXBtW0WDhVb9v1BmTfh7uEOoazxjKiib9qbgdCOhCTKNZVm5H79XY9-fs0k5YoDo-Q1uWe-Zlggvo2Kl-vgcdaH15XGBQT7JgvAjwKDND_6E6vnjxksP9U7BiZ_bd9X9WrtJqoqYdqfA95Q6GqPpV8p6y5drINs Jul 25 14:25:32.584792 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:25:32.584792 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:25:32.584792 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:25:32.584792 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:25:32.584792 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:25:32.584792 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:25:32.584792 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: edc5d5098e224b6ba57942e6f0b53e15 Jul 25 14:25:32.584792 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-555155127 Jul 25 14:25:32.584792 n-d-846435-14 devstack@n-api.service[119304]: X-Role: admin,reader,member Jul 25 14:25:32.584792 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: admin,reader,member Jul 25 14:25:32.585867 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/edc5d5098e224b6ba57942e6f0b53e15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/edc5d5098e224b6ba57942e6f0b53e15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_edc5d5098e224b6ba57942e6f0b53e15", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/edc5d5098e224b6ba57942e6f0b53e15"}]}] Jul 25 14:25:32.585867 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-555155127 Jul 25 14:25:32.585867 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: edc5d5098e224b6ba57942e6f0b53e15 Jul 25 14:25:32.585867 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-555155127 Jul 25 14:25:32.585867 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-HypervisorAdminNegativeTestJSON-555155127-project-admin Jul 25 14:25:32.585867 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:25:32.585867 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:25:32.585867 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 5b1728d3067d4aacba45edbce1624787 Jul 25 14:25:32.585867 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-555155127-project-admin Jul 25 14:25:32.585867 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:25:32.585867 n-d-846435-14 devstack@n-api.service[119304]: exception: Hypervisor with ID '5a03f9dc-6cec-4d53-b9dc-c00933c88165' could not be found. Jul 25 14:25:32.585867 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '5a03f9dc-6cec-4d53-b9dc-c00933c88165'} Jul 25 14:25:32.586474 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:25:32.586474 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:32.586474 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 25 14:25:32.586474 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 25 14:25:32.586474 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '5a03f9dc-6cec-4d53-b9dc-c00933c88165' Jul 25 14:25:32.586474 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:32.586474 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:32.586474 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:32.586474 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:32.586474 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 25 14:25:32.586474 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 25 14:25:32.586474 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 25 14:25:32.586474 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 25 14:25:32.586474 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 25 14:25:32.586474 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:32.586474 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:32.586474 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:32.586474 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:32.586474 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 25 14:25:32.586474 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 25 14:25:32.586474 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 25 14:25:32.586474 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 25 14:25:32.587492 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 25 14:25:32.587492 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:32.587492 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:32.587492 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:32.587492 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:32.587492 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:32.587492 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:32.587492 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:25:32.587492 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:25:32.587492 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:25:32.587492 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:25:32.587492 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:25:32.587492 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:25:32.587492 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jul 25 14:25:32.587492 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 25 14:25:32.587492 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 25 14:25:32.587492 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 14:25:32.587492 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '5a03f9dc-6cec-4d53-b9dc-c00933c88165' could not be found. Jul 25 14:25:32.587492 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:32.587492 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:32.587492 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:32.588497 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:32.588497 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:32.588497 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:32.588497 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:25:32.588497 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:25:32.588497 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '5a03f9dc-6cec-4d53-b9dc-c00933c88165' could not be found. Jul 25 14:25:32.588497 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:32.592573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f4ea93da-d88c-4049-a08d-eef53fda2ef8 tempest-HypervisorAdminNegativeTestJSON-555155127 tempest-HypervisorAdminNegativeTestJSON-555155127-project-admin] Returning 404 to user: Hypervisor with ID '5a03f9dc-6cec-4d53-b9dc-c00933c88165' could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:25:32.604479 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f4ea93da-d88c-4049-a08d-eef53fda2ef8 tempest-HypervisorAdminNegativeTestJSON-555155127 tempest-HypervisorAdminNegativeTestJSON-555155127-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/5a03f9dc-6cec-4d53-b9dc-c00933c88165/uptime" status: 404 len: 123 microversion: 2.1 time: 0.029316 Jul 25 14:25:32.608083 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 15/27] 10.222.0.88 () {58 vars in 1278 bytes} [Mon Jul 25 14:25:32 2022] GET /compute/v2.1/os-hypervisors/5a03f9dc-6cec-4d53-b9dc-c00933c88165/uptime => generated 123 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:25:32.616220 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b0e3a7ba-a653-4b9c-af67-24c7941e8922 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:32.676052 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b0e3a7ba-a653-4b9c-af67-24c7941e8922 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 5797 microversion: 2.1 time: 0.066645 Jul 25 14:25:32.685615 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 16/28] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:25:32 2022] GET /compute/v2.1/flavors/detail => generated 5797 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:32.698497 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-eebe1184-ba1e-4328-8f11-92acc7f89945 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:32.710265 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-090f329b-321a-4fe3-b1a5-09178d59a4cf tempest-AggregatesAdminTestV241-81003580 tempest-AggregatesAdminTestV241-81003580-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.41 time: 0.803345 Jul 25 14:25:32.718601 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 13/29] 10.222.0.88 () {62 vars in 1232 bytes} [Mon Jul 25 14:25:31 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:25:32.724370 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1ebe02b1-e5ed-4290-933f-3bd30d3319b6 tempest-HypervisorAdminNegativeTestJSON-555155127 tempest-HypervisorAdminNegativeTestJSON-555155127-project-admin] Calling method '.version_select at 0x7f46945e1dc0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:32.725238 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:32.725238 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:32.726418 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ebe02b1-e5ed-4290-933f-3bd30d3319b6 tempest-HypervisorAdminNegativeTestJSON-555155127 tempest-HypervisorAdminNegativeTestJSON-555155127-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:32.730268 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ebe02b1-e5ed-4290-933f-3bd30d3319b6 tempest-HypervisorAdminNegativeTestJSON-555155127 tempest-HypervisorAdminNegativeTestJSON-555155127-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:32.737203 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:32.737203 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:32.738251 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-eebe1184-ba1e-4328-8f11-92acc7f89945 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '2ba4c706ff8f42c4a4b2c636274fea7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c418435b6f4541a7e994cca48fe6f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:25:32.743240 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-eebe1184-ba1e-4328-8f11-92acc7f89945 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916-project] Request method failure captured: Jul 25 14:25:32.743240 n-d-846435-14 devstack@n-api.service[119304]: request: PUT /compute/v2.1/flavors/692371424/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 25 14:25:32.743240 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:25:32.743240 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:25:32.743240 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:25:32.743240 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 22 Jul 25 14:25:32.743240 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:25:32.743240 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:25:32.743240 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:25:32.743240 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:25:32.743240 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfWurkPQ74ddJ4EKMqMbCoUvC4HZdXVfUCpzCKhE0vwPPRjxvkd2LU430zLC6JNB84R0wlOJs8Ce2K5TcAE1k4ibyWOZytcPvNHxjrF1VYO1I962U2hGBoKz-cJzrbJx2d1G7DmqFb6zW58JTn4zdSKrekLEiryU_bwwQ3INMUIvoU Jul 25 14:25:32.743240 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:25:32.743240 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:25:32.743240 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:25:32.743240 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:25:32.743240 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:25:32.743240 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:25:32.743240 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 90c418435b6f4541a7e994cca48fe6f3 Jul 25 14:25:32.743240 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916 Jul 25 14:25:32.743240 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:25:32.743240 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:25:32.744984 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90c418435b6f4541a7e994cca48fe6f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90c418435b6f4541a7e994cca48fe6f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_90c418435b6f4541a7e994cca48fe6f3", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/90c418435b6f4541a7e994cca48fe6f3"}]}] Jul 25 14:25:32.744984 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916 Jul 25 14:25:32.744984 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 90c418435b6f4541a7e994cca48fe6f3 Jul 25 14:25:32.744984 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916 Jul 25 14:25:32.744984 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916-project Jul 25 14:25:32.744984 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:25:32.744984 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:25:32.744984 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 2ba4c706ff8f42c4a4b2c636274fea7f Jul 25 14:25:32.744984 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916-project Jul 25 14:25:32.744984 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:25:32.744984 n-d-846435-14 devstack@n-api.service[119304]: {"hw:numa_nodes": "1"} Jul 25 14:25:32.744984 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:25:32.744984 n-d-846435-14 devstack@n-api.service[119304]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 25 14:25:32.745779 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'flavor_id': '692371424', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jul 25 14:25:32.745779 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:25:32.745779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:32.745779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:32.745779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:32.745779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:25:32.745779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:25:32.745779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:25:32.745779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:25:32.745779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:25:32.745779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:25:32.745779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jul 25 14:25:32.745779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jul 25 14:25:32.745779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 14:25:32.745779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 14:25:32.745779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 14:25:32.745779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 14:25:32.745779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:25:32.745779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:25:32.746913 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:25:32.746913 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:25:32.746913 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 14:25:32.746913 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 14:25:32.746913 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 14:25:32.746913 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 14:25:32.746913 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 14:25:32.746913 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 14:25:32.746913 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 25 14:25:32.746913 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:32.746913 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:32.746913 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:32.746913 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:32.746913 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:32.746913 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:32.746913 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 14:25:32.746913 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 14:25:32.746913 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 25 14:25:32.746913 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:32.748071 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-eebe1184-ba1e-4328-8f11-92acc7f89945 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:25:32.751688 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-eebe1184-ba1e-4328-8f11-92acc7f89945 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916 tempest-FlavorsExtraSpecsNegativeTestJSON-2037047916-project] 10.222.0.88 "PUT /compute/v2.1/flavors/692371424/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.057203 Jul 25 14:25:32.755048 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 17/30] 10.222.0.88 () {60 vars in 1262 bytes} [Mon Jul 25 14:25:32 2022] PUT /compute/v2.1/flavors/692371424/os-extra_specs/hw:numa_nodes => generated 124 bytes in 68 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:25:32.767022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9f19bd71-6c08-45bf-9292-fb809af6981c tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:32.769584 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:32.769584 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:32.782761 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ebe02b1-e5ed-4290-933f-3bd30d3319b6 tempest-HypervisorAdminNegativeTestJSON-555155127 tempest-HypervisorAdminNegativeTestJSON-555155127-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:32.790908 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ebe02b1-e5ed-4290-933f-3bd30d3319b6 tempest-HypervisorAdminNegativeTestJSON-555155127 tempest-HypervisorAdminNegativeTestJSON-555155127-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:32.806870 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ebe02b1-e5ed-4290-933f-3bd30d3319b6 tempest-HypervisorAdminNegativeTestJSON-555155127 tempest-HypervisorAdminNegativeTestJSON-555155127-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:32.807831 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ebe02b1-e5ed-4290-933f-3bd30d3319b6 tempest-HypervisorAdminNegativeTestJSON-555155127 tempest-HypervisorAdminNegativeTestJSON-555155127-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:32.813685 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9f19bd71-6c08-45bf-9292-fb809af6981c tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/423076400" status: 202 len: 0 microversion: 2.1 time: 0.057447 Jul 25 14:25:32.817208 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 18/31] 10.222.0.88 () {58 vars in 1158 bytes} [Mon Jul 25 14:25:32 2022] DELETE /compute/v2.1/flavors/423076400 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:25:32.821103 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1ebe02b1-e5ed-4290-933f-3bd30d3319b6 tempest-HypervisorAdminNegativeTestJSON-555155127 tempest-HypervisorAdminNegativeTestJSON-555155127-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.100373 Jul 25 14:25:32.822578 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 14/32] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:25:32 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:32.825873 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e56c4160-894f-4af4-b009-f0f75aa2ca01 tempest-AggregatesAdminTestV241-81003580 tempest-AggregatesAdminTestV241-81003580-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-846435-14"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:32.828727 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:32.828727 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:32.833923 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1c449bce-1af2-4968-bbaa-46eb8a5cb1b8 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:32.835498 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:32.835498 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:32.845551 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-1c449bce-1af2-4968-bbaa-46eb8a5cb1b8 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768-project-admin] HTTP exception thrown: Flavor 692371424 has no extra specs with key hw:cpu_thread_policy. Jul 25 14:25:32.847579 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1c449bce-1af2-4968-bbaa-46eb8a5cb1b8 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768-project-admin] Request method failure captured: Jul 25 14:25:32.847579 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/flavors/692371424/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 25 14:25:32.847579 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:25:32.847579 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:25:32.847579 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:25:32.847579 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:25:32.847579 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:25:32.847579 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:25:32.847579 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:25:32.847579 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:25:32.847579 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qfY2c35g2YYAFA7HjaYRjlrHz0UVmF1GHcfDOMMpu7kmVOBJ8Pqww7YnCo30eVVnRao0XVHpl1LMtFYzaBf3OGLMqau6AXUffDH34kh0q9_PIwG9a2YtvBOhJ137TW-gdM__UGWHYdd8yyxHI4TOkjUn5M2BzSzd-twqyKuavkueTE Jul 25 14:25:32.847579 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:25:32.847579 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:25:32.847579 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:25:32.847579 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:25:32.847579 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:25:32.847579 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:25:32.847579 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 752b49be15c847c6874aefcc12562858 Jul 25 14:25:32.847579 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 Jul 25 14:25:32.847579 n-d-846435-14 devstack@n-api.service[119303]: X-Role: admin,reader,member Jul 25 14:25:32.847579 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: admin,reader,member Jul 25 14:25:32.848771 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/752b49be15c847c6874aefcc12562858"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/752b49be15c847c6874aefcc12562858"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_752b49be15c847c6874aefcc12562858", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/752b49be15c847c6874aefcc12562858"}]}] Jul 25 14:25:32.848771 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 Jul 25 14:25:32.848771 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 752b49be15c847c6874aefcc12562858 Jul 25 14:25:32.848771 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 Jul 25 14:25:32.848771 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-525520768-project-admin Jul 25 14:25:32.848771 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:25:32.848771 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:25:32.848771 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 5f4e9fff4bbf4662834eb669f79141ad Jul 25 14:25:32.848771 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-525520768-project-admin Jul 25 14:25:32.848771 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:25:32.848771 n-d-846435-14 devstack@n-api.service[119303]: exception: Flavor 692371424 has no extra specs with key hw:cpu_thread_policy. Jul 25 14:25:32.849354 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'flavor_id': '692371424', 'id': 'hw:cpu_thread_policy'} Jul 25 14:25:32.849354 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:25:32.849354 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:32.849354 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jul 25 14:25:32.849354 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jul 25 14:25:32.849354 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 25 14:25:32.849354 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:32.849354 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:32.849354 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:32.849354 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:32.849354 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:32.849354 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:32.849354 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:25:32.849354 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:25:32.849354 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:25:32.849354 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:25:32.849354 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jul 25 14:25:32.849354 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 14:25:32.849354 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 692371424 has no extra specs with key hw:cpu_thread_policy. Jul 25 14:25:32.849354 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:32.849354 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:32.849354 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:32.850496 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:32.850496 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:32.850496 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:32.850496 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:25:32.850496 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:25:32.850496 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 692371424 has no extra specs with key hw:cpu_thread_policy. Jul 25 14:25:32.850496 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:32.859279 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1c449bce-1af2-4968-bbaa-46eb8a5cb1b8 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768-project-admin] Returning 404 to user: Flavor 692371424 has no extra specs with key hw:cpu_thread_policy. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:25:32.861112 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1c449bce-1af2-4968-bbaa-46eb8a5cb1b8 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/692371424/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.037209 Jul 25 14:25:32.862987 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 15/33] 10.222.0.88 () {58 vars in 1266 bytes} [Mon Jul 25 14:25:32 2022] DELETE /compute/v2.1/flavors/692371424/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:25:32.870778 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a7f41add-d552-429a-9b5e-93e8e3abda34 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:32.899834 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e56c4160-894f-4af4-b009-f0f75aa2ca01 tempest-AggregatesAdminTestV241-81003580 tempest-AggregatesAdminTestV241-81003580-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:32.904015 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e56c4160-894f-4af4-b009-f0f75aa2ca01 tempest-AggregatesAdminTestV241-81003580 tempest-AggregatesAdminTestV241-81003580-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:32.922804 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a7f41add-d552-429a-9b5e-93e8e3abda34 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.058075 Jul 25 14:25:32.962513 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 16/34] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:25:32 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:32.973293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-835688b0-ec9b-4595-a33f-a2df681132b4 tempest-HypervisorAdminNegativeTestJSON-1201469204 tempest-HypervisorAdminNegativeTestJSON-1201469204-project] Calling method '.version_select at 0x7f46945e14c0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:32.974967 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:32.974967 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:32.977299 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-835688b0-ec9b-4595-a33f-a2df681132b4 tempest-HypervisorAdminNegativeTestJSON-1201469204 tempest-HypervisorAdminNegativeTestJSON-1201469204-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'c70258c1f3bd43bc8f1da781ad98ed55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2018ea1a9c94e02bcae7414e0a0d988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:25:32.979990 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-835688b0-ec9b-4595-a33f-a2df681132b4 tempest-HypervisorAdminNegativeTestJSON-1201469204 tempest-HypervisorAdminNegativeTestJSON-1201469204-project] Request method failure captured: Jul 25 14:25:32.979990 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jul 25 14:25:32.979990 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:25:32.979990 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:25:32.979990 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:25:32.979990 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:25:32.979990 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:25:32.979990 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:25:32.979990 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:25:32.979990 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:25:32.979990 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qfXPk7XG7fyqylEnzqfDXBufxv8JQlSs3-BfKcSzH0owfhbJfMdYnlyDYnIGiI7m5RtSVReZWU2zllKNkP1q7OHfheiMxGq2NRT4hdWMOem25LLgGl3D6WcAuFPlC0NRI0xJvYMkAl_5bMG6G8yqa5U7zUq4lpugXa3CI_PEB60Odk Jul 25 14:25:32.979990 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:25:32.979990 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:25:32.979990 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:25:32.979990 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:25:32.979990 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:25:32.979990 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:25:32.979990 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: f2018ea1a9c94e02bcae7414e0a0d988 Jul 25 14:25:32.979990 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1201469204 Jul 25 14:25:32.979990 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:25:32.979990 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:25:32.981088 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f2018ea1a9c94e02bcae7414e0a0d988"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f2018ea1a9c94e02bcae7414e0a0d988"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f2018ea1a9c94e02bcae7414e0a0d988", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f2018ea1a9c94e02bcae7414e0a0d988"}]}] Jul 25 14:25:32.981088 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1201469204 Jul 25 14:25:32.981088 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: f2018ea1a9c94e02bcae7414e0a0d988 Jul 25 14:25:32.981088 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1201469204 Jul 25 14:25:32.981088 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-HypervisorAdminNegativeTestJSON-1201469204-project Jul 25 14:25:32.981088 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:25:32.981088 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:25:32.981088 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: c70258c1f3bd43bc8f1da781ad98ed55 Jul 25 14:25:32.981088 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1201469204-project Jul 25 14:25:32.981088 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:25:32.981088 n-d-846435-14 devstack@n-api.service[119303]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 25 14:25:32.981088 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '1'} Jul 25 14:25:32.981088 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:25:32.981742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:32.981742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:32.981742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:32.981742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:25:32.981742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:25:32.981742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:25:32.981742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:25:32.981742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:25:32.981742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:25:32.981742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 25 14:25:32.981742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 25 14:25:32.981742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jul 25 14:25:32.981742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jul 25 14:25:32.981742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 14:25:32.981742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 14:25:32.981742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 14:25:32.981742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 14:25:32.981742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:25:32.981742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:25:32.982665 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:25:32.982665 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:25:32.982665 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 14:25:32.982665 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 14:25:32.982665 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 14:25:32.982665 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 14:25:32.982665 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 14:25:32.982665 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 14:25:32.982665 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 25 14:25:32.982665 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:32.982665 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:32.982665 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:32.982665 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:32.982665 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:32.982665 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:32.982665 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 14:25:32.982665 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 14:25:32.982665 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 25 14:25:32.982665 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:32.983587 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-835688b0-ec9b-4595-a33f-a2df681132b4 tempest-HypervisorAdminNegativeTestJSON-1201469204 tempest-HypervisorAdminNegativeTestJSON-1201469204-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:25:32.983587 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-835688b0-ec9b-4595-a33f-a2df681132b4 tempest-HypervisorAdminNegativeTestJSON-1201469204 tempest-HypervisorAdminNegativeTestJSON-1201469204-project] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.017812 Jul 25 14:25:32.983587 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 17/35] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jul 25 14:25:32 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:25:32.991617 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cb7132b4-be85-48bf-ab76-33248e651615 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:33.000224 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:33.000224 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:33.013832 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-cb7132b4-be85-48bf-ab76-33248e651615 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768-project-admin] HTTP exception thrown: Request body and URI mismatch Jul 25 14:25:33.019579 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cb7132b4-be85-48bf-ab76-33248e651615 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768-project-admin] Request method failure captured: Jul 25 14:25:33.019579 n-d-846435-14 devstack@n-api.service[119303]: request: PUT /compute/v2.1/flavors/692371424/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 25 14:25:33.019579 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:25:33.019579 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:25:33.019579 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:25:33.019579 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 27 Jul 25 14:25:33.019579 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:25:33.019579 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:25:33.019579 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:25:33.019579 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:25:33.019579 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qfY2c35g2YYAFA7HjaYRjlrHz0UVmF1GHcfDOMMpu7kmVOBJ8Pqww7YnCo30eVVnRao0XVHpl1LMtFYzaBf3OGLMqau6AXUffDH34kh0q9_PIwG9a2YtvBOhJ137TW-gdM__UGWHYdd8yyxHI4TOkjUn5M2BzSzd-twqyKuavkueTE Jul 25 14:25:33.019579 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:25:33.019579 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:25:33.019579 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:25:33.019579 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:25:33.019579 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:25:33.019579 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:25:33.019579 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 752b49be15c847c6874aefcc12562858 Jul 25 14:25:33.019579 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 Jul 25 14:25:33.019579 n-d-846435-14 devstack@n-api.service[119303]: X-Role: admin,reader,member Jul 25 14:25:33.019579 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: admin,reader,member Jul 25 14:25:33.020798 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/752b49be15c847c6874aefcc12562858"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/752b49be15c847c6874aefcc12562858"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_752b49be15c847c6874aefcc12562858", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/752b49be15c847c6874aefcc12562858"}]}] Jul 25 14:25:33.020798 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 Jul 25 14:25:33.020798 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 752b49be15c847c6874aefcc12562858 Jul 25 14:25:33.020798 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 Jul 25 14:25:33.020798 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-525520768-project-admin Jul 25 14:25:33.020798 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:25:33.020798 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:25:33.020798 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 5f4e9fff4bbf4662834eb669f79141ad Jul 25 14:25:33.020798 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-525520768-project-admin Jul 25 14:25:33.020798 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:25:33.020798 n-d-846435-14 devstack@n-api.service[119303]: {"hw:cpu_policy": "shared"} Jul 25 14:25:33.020798 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:25:33.020798 n-d-846435-14 devstack@n-api.service[119303]: exception: Request body and URI mismatch Jul 25 14:25:33.021452 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'flavor_id': '692371424', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jul 25 14:25:33.021452 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:25:33.021452 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:33.021452 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:33.021452 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:33.021452 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:25:33.021452 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:25:33.021452 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:25:33.021452 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:25:33.021452 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:25:33.021452 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:25:33.021452 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jul 25 14:25:33.021452 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jul 25 14:25:33.021452 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jul 25 14:25:33.021452 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:33.021452 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:33.021452 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:33.021452 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:33.021452 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:33.021452 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:33.022401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:25:33.022401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:25:33.022401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jul 25 14:25:33.022401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:33.022401 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cb7132b4-be85-48bf-ab76-33248e651615 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:25:33.022401 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cb7132b4-be85-48bf-ab76-33248e651615 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768-project-admin] 10.222.0.88 "PUT /compute/v2.1/flavors/692371424/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.038120 Jul 25 14:25:33.025108 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 18/36] 10.222.0.88 () {60 vars in 1262 bytes} [Mon Jul 25 14:25:32 2022] PUT /compute/v2.1/flavors/692371424/os-extra_specs/hw:numa_nodes => generated 73 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 14:25:33.033728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9e3ae54a-a5b2-4981-97bd-afcb9e6898c8 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-496358348", "id": 1360859193, "os-flavor-access:is_public": "True"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:33.057088 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:33.057088 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:33.090325 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9e3ae54a-a5b2-4981-97bd-afcb9e6898c8 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.063837 Jul 25 14:25:33.094033 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 19/37] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:25:33 2022] POST /compute/v2.1/flavors => generated 428 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:33.104260 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8f5c595f-718b-41e8-a8b3-8db1a8eee04c tempest-HypervisorAdminNegativeTestJSON-555155127 tempest-HypervisorAdminNegativeTestJSON-555155127-project-admin] Calling method '.version_select at 0x7f46945c9700>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:33.108262 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-8f5c595f-718b-41e8-a8b3-8db1a8eee04c tempest-HypervisorAdminNegativeTestJSON-555155127 tempest-HypervisorAdminNegativeTestJSON-555155127-project-admin] HTTP exception thrown: Hypervisor with ID 'e0698e71-251f-4a0f-b363-97158637c4f7' could not be found. Jul 25 14:25:33.115944 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8f5c595f-718b-41e8-a8b3-8db1a8eee04c tempest-HypervisorAdminNegativeTestJSON-555155127 tempest-HypervisorAdminNegativeTestJSON-555155127-project-admin] Request method failure captured: Jul 25 14:25:33.115944 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/os-hypervisors/e0698e71-251f-4a0f-b363-97158637c4f7 HTTP/1.1 Jul 25 14:25:33.115944 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:25:33.115944 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:25:33.115944 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:25:33.115944 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:25:33.115944 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:25:33.115944 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:25:33.115944 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:25:33.115944 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:25:33.115944 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qfZowRSRmhXzB35oXBtW0WDhVb9v1BmTfh7uEOoazxjKiib9qbgdCOhCTKNZVm5H79XY9-fs0k5YoDo-Q1uWe-Zlggvo2Kl-vgcdaH15XGBQT7JgvAjwKDND_6E6vnjxksP9U7BiZ_bd9X9WrtJqoqYdqfA95Q6GqPpV8p6y5drINs Jul 25 14:25:33.115944 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:25:33.115944 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:25:33.115944 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:25:33.115944 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:25:33.115944 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:25:33.115944 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:25:33.115944 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: edc5d5098e224b6ba57942e6f0b53e15 Jul 25 14:25:33.115944 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-555155127 Jul 25 14:25:33.115944 n-d-846435-14 devstack@n-api.service[119303]: X-Role: admin,reader,member Jul 25 14:25:33.115944 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: admin,reader,member Jul 25 14:25:33.117632 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/edc5d5098e224b6ba57942e6f0b53e15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/edc5d5098e224b6ba57942e6f0b53e15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_edc5d5098e224b6ba57942e6f0b53e15", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/edc5d5098e224b6ba57942e6f0b53e15"}]}] Jul 25 14:25:33.117632 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-555155127 Jul 25 14:25:33.117632 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: edc5d5098e224b6ba57942e6f0b53e15 Jul 25 14:25:33.117632 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-555155127 Jul 25 14:25:33.117632 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-HypervisorAdminNegativeTestJSON-555155127-project-admin Jul 25 14:25:33.117632 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:25:33.117632 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:25:33.117632 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 5b1728d3067d4aacba45edbce1624787 Jul 25 14:25:33.117632 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-555155127-project-admin Jul 25 14:25:33.117632 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:25:33.117632 n-d-846435-14 devstack@n-api.service[119303]: exception: Hypervisor with ID 'e0698e71-251f-4a0f-b363-97158637c4f7' could not be found. Jul 25 14:25:33.117632 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'e0698e71-251f-4a0f-b363-97158637c4f7'} Jul 25 14:25:33.118390 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:25:33.118390 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:33.118390 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 25 14:25:33.118390 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 25 14:25:33.118390 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'e0698e71-251f-4a0f-b363-97158637c4f7' Jul 25 14:25:33.118390 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:33.118390 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:33.118390 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:33.118390 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:33.118390 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 25 14:25:33.118390 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 25 14:25:33.118390 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 25 14:25:33.118390 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 25 14:25:33.118390 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 25 14:25:33.118390 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:33.118390 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:33.118390 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:33.118390 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:33.118390 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 25 14:25:33.118390 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 25 14:25:33.118390 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 25 14:25:33.118390 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 25 14:25:33.119745 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 25 14:25:33.119745 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:33.119745 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:33.119745 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:33.119745 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:33.119745 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:33.119745 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:33.119745 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:25:33.119745 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:25:33.119745 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:25:33.119745 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:25:33.119745 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:25:33.119745 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:25:33.119745 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 25 14:25:33.119745 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 25 14:25:33.119745 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jul 25 14:25:33.119745 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 25 14:25:33.119745 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 25 14:25:33.119745 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 14:25:33.119745 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'e0698e71-251f-4a0f-b363-97158637c4f7' could not be found. Jul 25 14:25:33.120949 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:33.120949 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:33.120949 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:33.120949 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:33.120949 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:33.120949 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:33.120949 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:25:33.120949 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:25:33.120949 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'e0698e71-251f-4a0f-b363-97158637c4f7' could not be found. Jul 25 14:25:33.120949 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:33.123402 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8f5c595f-718b-41e8-a8b3-8db1a8eee04c tempest-HypervisorAdminNegativeTestJSON-555155127 tempest-HypervisorAdminNegativeTestJSON-555155127-project-admin] Returning 404 to user: Hypervisor with ID 'e0698e71-251f-4a0f-b363-97158637c4f7' could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:25:33.126396 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8f5c595f-718b-41e8-a8b3-8db1a8eee04c tempest-HypervisorAdminNegativeTestJSON-555155127 tempest-HypervisorAdminNegativeTestJSON-555155127-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/e0698e71-251f-4a0f-b363-97158637c4f7" status: 404 len: 123 microversion: 2.1 time: 0.029940 Jul 25 14:25:33.132576 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 20/38] 10.222.0.88 () {58 vars in 1257 bytes} [Mon Jul 25 14:25:33 2022] GET /compute/v2.1/os-hypervisors/e0698e71-251f-4a0f-b363-97158637c4f7 => generated 123 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:25:33.148831 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3ec0bacf-e77c-4162-950e-5629ea3f4be8 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:33.168396 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3ec0bacf-e77c-4162-950e-5629ea3f4be8 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768-project-admin] Request method failure captured: Jul 25 14:25:33.168396 n-d-846435-14 devstack@n-api.service[119303]: request: PUT /compute/v2.1/flavors/692371424/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 25 14:25:33.168396 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:25:33.168396 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:25:33.168396 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:25:33.168396 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 49 Jul 25 14:25:33.168396 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:25:33.168396 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:25:33.168396 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:25:33.168396 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:25:33.168396 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qfY2c35g2YYAFA7HjaYRjlrHz0UVmF1GHcfDOMMpu7kmVOBJ8Pqww7YnCo30eVVnRao0XVHpl1LMtFYzaBf3OGLMqau6AXUffDH34kh0q9_PIwG9a2YtvBOhJ137TW-gdM__UGWHYdd8yyxHI4TOkjUn5M2BzSzd-twqyKuavkueTE Jul 25 14:25:33.168396 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:25:33.168396 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:25:33.168396 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:25:33.168396 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:25:33.168396 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:25:33.168396 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:25:33.168396 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 752b49be15c847c6874aefcc12562858 Jul 25 14:25:33.168396 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 Jul 25 14:25:33.168396 n-d-846435-14 devstack@n-api.service[119303]: X-Role: admin,reader,member Jul 25 14:25:33.168396 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: admin,reader,member Jul 25 14:25:33.169658 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/752b49be15c847c6874aefcc12562858"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/752b49be15c847c6874aefcc12562858"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_752b49be15c847c6874aefcc12562858", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/752b49be15c847c6874aefcc12562858"}]}] Jul 25 14:25:33.169658 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 Jul 25 14:25:33.169658 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 752b49be15c847c6874aefcc12562858 Jul 25 14:25:33.169658 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 Jul 25 14:25:33.169658 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-525520768-project-admin Jul 25 14:25:33.169658 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:25:33.169658 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:25:33.169658 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 5f4e9fff4bbf4662834eb669f79141ad Jul 25 14:25:33.169658 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-525520768-project-admin Jul 25 14:25:33.169658 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:25:33.169658 n-d-846435-14 devstack@n-api.service[119303]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jul 25 14:25:33.169658 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:25:33.170272 n-d-846435-14 devstack@n-api.service[119303]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 25 14:25:33.170272 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'flavor_id': '692371424', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jul 25 14:25:33.170272 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:25:33.170272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:33.170272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:25:33.170272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:25:33.170272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:25:33.170272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:25:33.170272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 25 14:25:33.170272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:33.170272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jul 25 14:25:33.170272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 25 14:25:33.170272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jul 25 14:25:33.170272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jul 25 14:25:33.170272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 25 14:25:33.170272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'type': ['string', Jul 25 14:25:33.170272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'number']}}, Jul 25 14:25:33.170272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 25 14:25:33.170272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:33.170272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi On instance: Jul 25 14:25:33.170272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jul 25 14:25:33.170272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:33.171672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:33.171672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:33.171672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:33.171672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:33.171672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:33.171672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:25:33.171672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:25:33.171672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:25:33.171672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:25:33.171672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:25:33.171672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:25:33.171672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:25:33.171672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:25:33.171672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:25:33.171672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:25:33.171672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 25 14:25:33.171672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:33.171672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:33.171672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:33.171672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:33.175132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:33.175132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:33.175132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:25:33.175132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:25:33.175132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 25 14:25:33.175132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:33.175132 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3ec0bacf-e77c-4162-950e-5629ea3f4be8 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:25:33.175132 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3ec0bacf-e77c-4162-950e-5629ea3f4be8 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768-project-admin] 10.222.0.88 "PUT /compute/v2.1/flavors/692371424/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.038298 Jul 25 14:25:33.176576 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 21/39] 10.222.0.88 () {60 vars in 1262 bytes} [Mon Jul 25 14:25:33 2022] PUT /compute/v2.1/flavors/692371424/os-extra_specs/hw:numa_nodes => generated 117 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:25:33.193809 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e857c65e-8fac-4fd8-8008-dde56a421a9c tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:33.197278 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:33.197278 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:33.272600 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e857c65e-8fac-4fd8-8008-dde56a421a9c tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/1360859193" status: 202 len: 0 microversion: 2.1 time: 0.094767 Jul 25 14:25:33.277827 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 22/40] 10.222.0.88 () {58 vars in 1161 bytes} [Mon Jul 25 14:25:33 2022] DELETE /compute/v2.1/flavors/1360859193 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:25:33.296838 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4cfcab42-3249-46af-a4be-ff60428a4515 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:33.357937 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4cfcab42-3249-46af-a4be-ff60428a4515 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/692371424" status: 202 len: 0 microversion: 2.1 time: 0.078468 Jul 25 14:25:33.359201 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 23/41] 10.222.0.88 () {58 vars in 1158 bytes} [Mon Jul 25 14:25:33 2022] DELETE /compute/v2.1/flavors/692371424 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:25:33.367327 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b8c7e109-af77-44f1-afc8-23a2c3b1a762 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:33.446080 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b8c7e109-af77-44f1-afc8-23a2c3b1a762 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.085459 Jul 25 14:25:33.449383 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 24/42] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:25:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:33.496345 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-81dc9e4c-1aa9-432c-870e-21ce03188e49 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:33.584189 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-81dc9e4c-1aa9-432c-870e-21ce03188e49 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768 tempest-FlavorsExtraSpecsNegativeTestJSON-525520768-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.114499 Jul 25 14:25:33.584883 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 25/43] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:25:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:33.608766 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f16f1517-2c13-4d5c-948e-dc6136fefdb5 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1493450812", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:33.649123 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f16f1517-2c13-4d5c-948e-dc6136fefdb5 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.063089 Jul 25 14:25:33.649722 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 26/44] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:25:33 2022] POST /compute/v2.1/flavors => generated 507 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:33.662478 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f87f78d8-b1fd-47c8-abfb-14a4b034690c tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:33.671487 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e56c4160-894f-4af4-b009-f0f75aa2ca01 tempest-AggregatesAdminTestV241-81003580 tempest-AggregatesAdminTestV241-81003580-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.41 time: 0.853723 Jul 25 14:25:33.695256 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 19/45] 10.222.0.88 () {62 vars in 1232 bytes} [Mon Jul 25 14:25:32 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:25:33.699636 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:UPDATE=1,nova_api:DELETE=8 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:25:33.713561 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f87f78d8-b1fd-47c8-abfb-14a4b034690c tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/bfe39c81-75bf-401f-bfe3-3dd3c548e64e" status: 202 len: 0 microversion: 2.1 time: 0.053495 Jul 25 14:25:33.716779 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f92f7ce7-3fc5-4745-ac98-28a70b701477 tempest-AggregatesAdminTestV241-81003580 tempest-AggregatesAdminTestV241-81003580-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:33.717570 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 27/46] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:25:33 2022] DELETE /compute/v2.1/flavors/bfe39c81-75bf-401f-bfe3-3dd3c548e64e => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 14:25:33.720898 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:33.720898 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:33.722369 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-708daff2-79bb-4cf1-b485-b1e94a83771e tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:33.744959 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-708daff2-79bb-4cf1-b485-b1e94a83771e tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026234 Jul 25 14:25:33.745835 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 28/47] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:25:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:33.765252 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d393d184-8995-4bdf-85cf-e22297510ca7 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1173522443", "id": "12adcadc-ec2a-4f03-9ad3-e9d46041f726", "os-flavor-access:is_public": "True"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:33.772006 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f92f7ce7-3fc5-4745-ac98-28a70b701477 tempest-AggregatesAdminTestV241-81003580 tempest-AggregatesAdminTestV241-81003580-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.073510 Jul 25 14:25:33.773807 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 20/48] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Jul 25 14:25:33 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:33.790928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a0df7e3a-6075-4925-a82c-dbb7cb76b702 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-138790999", "name": "tempest-test_aggregate-1534629812"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:33.805013 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d393d184-8995-4bdf-85cf-e22297510ca7 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.043725 Jul 25 14:25:33.813069 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 29/49] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:25:33 2022] POST /compute/v2.1/flavors => generated 507 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:25:33.825707 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-570ada5b-3a88-40ec-b6c8-046bb3b0cacd tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:33.853468 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:33.853468 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:33.856309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.aggregate [None req-a0df7e3a-6075-4925-a82c-dbb7cb76b702 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Generated uuid 0162520c-338a-44f9-aaff-f7be159c7085 for aggregate {{(pid=119304) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 14:25:33.879298 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-570ada5b-3a88-40ec-b6c8-046bb3b0cacd tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/12adcadc-ec2a-4f03-9ad3-e9d46041f726" status: 202 len: 0 microversion: 2.1 time: 0.064795 Jul 25 14:25:33.880985 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 30/50] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:25:33 2022] DELETE /compute/v2.1/flavors/12adcadc-ec2a-4f03-9ad3-e9d46041f726 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:25:33.893261 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e87d5792-5162-40b6-8518-2c7eb1a0e8c6 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:33.930190 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a0df7e3a-6075-4925-a82c-dbb7cb76b702 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.151004 Jul 25 14:25:33.935672 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 21/51] 10.222.0.88 () {60 vars in 1165 bytes} [Mon Jul 25 14:25:33 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:33.946373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a5c17e96-ab38-4d37-a19c-83e868b4dab8 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:33.947937 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:33.947937 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:33.951383 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e87d5792-5162-40b6-8518-2c7eb1a0e8c6 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057909 Jul 25 14:25:33.954833 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 31/52] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:25:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:33.965259 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a5c17e96-ab38-4d37-a19c-83e868b4dab8 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "GET /compute/v2.1/os-aggregates" status: 200 len: 301 microversion: 2.1 time: 0.022830 Jul 25 14:25:33.966040 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 22/53] 10.222.0.88 () {58 vars in 1143 bytes} [Mon Jul 25 14:25:33 2022] GET /compute/v2.1/os-aggregates => generated 301 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:25:33.977847 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-25a72b1a-6c75-4f04-8f08-fb9d10813598 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-830645678", "id": 2023942672, "os-flavor-access:is_public": "True"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:33.979765 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d1eb1480-dc27-420c-b4bc-9cbe1ef0aef0 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-846435-14"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:33.986078 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:33.986078 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:34.007007 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1eb1480-dc27-420c-b4bc-9cbe1ef0aef0 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:34.007251 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1eb1480-dc27-420c-b4bc-9cbe1ef0aef0 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:34.031401 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-25a72b1a-6c75-4f04-8f08-fb9d10813598 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.060055 Jul 25 14:25:34.034934 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 32/54] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:25:33 2022] POST /compute/v2.1/flavors => generated 413 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:25:34.053644 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b38bb3d0-0bfd-4273-be09-93eddd1fc5a4 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:34.067950 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b38bb3d0-0bfd-4273-be09-93eddd1fc5a4 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/2023942672" status: 200 len: 413 microversion: 2.1 time: 0.024250 Jul 25 14:25:34.083894 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 33/55] 10.222.0.88 () {58 vars in 1158 bytes} [Mon Jul 25 14:25:34 2022] GET /compute/v2.1/flavors/2023942672 => generated 413 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:34.249274 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d1eb1480-dc27-420c-b4bc-9cbe1ef0aef0 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 314 microversion: 2.1 time: 0.275465 Jul 25 14:25:34.251926 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 23/56] 10.222.0.88 () {60 vars in 1191 bytes} [Mon Jul 25 14:25:33 2022] POST /compute/v2.1/os-aggregates/2/action => generated 314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:25:34.823118 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9e925377-b463-46eb-9711-2c76d4101c60 tempest-FlavorsAdminTestJSON-106208806 tempest-FlavorsAdminTestJSON-106208806-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:34.897231 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9e925377-b463-46eb-9711-2c76d4101c60 tempest-FlavorsAdminTestJSON-106208806 tempest-FlavorsAdminTestJSON-106208806-project] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.811676 Jul 25 14:25:34.898919 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 34/57] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:25:34 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:34.916749 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b1af676e-adaa-4371-a541-73ca7f744753 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:34.917419 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:34.917419 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:34.933755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6,nova_api:DELETE=14,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:25:34.941392 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b1af676e-adaa-4371-a541-73ca7f744753 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/2023942672" status: 202 len: 0 microversion: 2.1 time: 0.028267 Jul 25 14:25:34.942236 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 24/58] 10.222.0.88 () {58 vars in 1161 bytes} [Mon Jul 25 14:25:34 2022] DELETE /compute/v2.1/flavors/2023942672 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:25:34.951667 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1ea911c9-a765-4d37-9f6d-dcbf40eb1e0b tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:34.987185 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1ea911c9-a765-4d37-9f6d-dcbf40eb1e0b tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039437 Jul 25 14:25:34.988472 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 35/59] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:25:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:35.008392 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-44b10dc2-8749-4c33-979a-49699a77e7c4 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-241827626", "id": 1482982635, "os-flavor-access:is_public": "False"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:35.009528 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:35.009528 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:35.041539 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-44b10dc2-8749-4c33-979a-49699a77e7c4 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.038409 Jul 25 14:25:35.051074 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 25/60] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:25:35 2022] POST /compute/v2.1/flavors => generated 429 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:35.062400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-db1d5ecc-379f-4e85-96d3-75b228e4b0fe tempest-FlavorsAdminTestJSON-106208806 tempest-FlavorsAdminTestJSON-106208806-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "1482982635"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:35.080204 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-db1d5ecc-379f-4e85-96d3-75b228e4b0fe tempest-FlavorsAdminTestJSON-106208806 tempest-FlavorsAdminTestJSON-106208806-project] HTTP exception thrown: Flavor 1482982635 could not be found. Jul 25 14:25:35.084533 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-db1d5ecc-379f-4e85-96d3-75b228e4b0fe tempest-FlavorsAdminTestJSON-106208806 tempest-FlavorsAdminTestJSON-106208806-project] Request method failure captured: Jul 25 14:25:35.084533 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 14:25:35.084533 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:25:35.084533 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:25:35.084533 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:25:35.084533 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 107 Jul 25 14:25:35.084533 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:25:35.084533 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:25:35.084533 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:25:35.084533 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:25:35.084533 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfZV3QKVRcMPQrYh8IvHiJVofCp-NgThkmtkYbJepLdkHWiiet8AGZH6IHhwO7T_dU26YMFIEypj5ey4CfAEPyxAo3_hoazczSz6QjLRrL322M2Hbxns4gI3cNkPXEtDV0f8mcJmjBRIGPBTVNTaqnd6F58v8EmGHl_dpCVSv-7A38 Jul 25 14:25:35.084533 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:25:35.084533 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:25:35.084533 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:25:35.084533 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:25:35.084533 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:25:35.084533 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:25:35.084533 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: b3081646c17c4188a1691aedcb6ca29d Jul 25 14:25:35.084533 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-FlavorsAdminTestJSON-106208806 Jul 25 14:25:35.084533 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:25:35.084533 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:25:35.085722 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b3081646c17c4188a1691aedcb6ca29d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b3081646c17c4188a1691aedcb6ca29d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b3081646c17c4188a1691aedcb6ca29d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b3081646c17c4188a1691aedcb6ca29d"}]}] Jul 25 14:25:35.085722 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-FlavorsAdminTestJSON-106208806 Jul 25 14:25:35.085722 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: b3081646c17c4188a1691aedcb6ca29d Jul 25 14:25:35.085722 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-106208806 Jul 25 14:25:35.085722 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-FlavorsAdminTestJSON-106208806-project Jul 25 14:25:35.085722 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:25:35.085722 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:25:35.085722 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 542628a63e5b4f7f89c8efefc14dd575 Jul 25 14:25:35.085722 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-FlavorsAdminTestJSON-106208806-project Jul 25 14:25:35.085722 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:25:35.085722 n-d-846435-14 devstack@n-api.service[119304]: {"server": {"name": "test", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "1482982635"}} Jul 25 14:25:35.085722 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:25:35.085722 n-d-846435-14 devstack@n-api.service[119304]: exception: Flavor 1482982635 could not be found. Jul 25 14:25:35.086398 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'a7b14aba-1848-4a00-a3e7-b66eb3e97925', 'flavorRef': '1482982635'}}} Jul 25 14:25:35.086398 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:25:35.086398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:35.086398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 25 14:25:35.086398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 25 14:25:35.086398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 14:25:35.086398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 14:25:35.086398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:25:35.086398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:25:35.086398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 14:25:35.086398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 14:25:35.086398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 14:25:35.086398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:25:35.086398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 14:25:35.086398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 14:25:35.086398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1482982635 could not be found. Jul 25 14:25:35.086398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:35.086398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:35.086398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:35.086398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:35.087374 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:35.087374 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:35.087374 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:25:35.087374 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:25:35.087374 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:25:35.087374 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:25:35.087374 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:25:35.087374 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:25:35.087374 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:25:35.087374 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:25:35.087374 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:25:35.087374 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:25:35.087374 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 14:25:35.087374 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 25 14:25:35.087374 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 25 14:25:35.087374 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1482982635 could not be found. Jul 25 14:25:35.087374 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:35.087374 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:35.087374 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:35.087374 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:35.087374 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:35.088446 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:35.088446 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:25:35.088446 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:25:35.088446 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1482982635 could not be found. Jul 25 14:25:35.088446 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:35.090699 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-db1d5ecc-379f-4e85-96d3-75b228e4b0fe tempest-FlavorsAdminTestJSON-106208806 tempest-FlavorsAdminTestJSON-106208806-project] Returning 400 to user: Flavor 1482982635 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:25:35.092823 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-db1d5ecc-379f-4e85-96d3-75b228e4b0fe tempest-FlavorsAdminTestJSON-106208806 tempest-FlavorsAdminTestJSON-106208806-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.040155 Jul 25 14:25:35.094571 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 26/61] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:25:35 2022] POST /compute/v2.1/servers => generated 81 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 14:25:35.103780 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-238beb35-f70d-4aef-a201-de0a16c69566 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:35.133947 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-238beb35-f70d-4aef-a201-de0a16c69566 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/1482982635" status: 202 len: 0 microversion: 2.1 time: 0.033978 Jul 25 14:25:35.137311 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 27/62] 10.222.0.88 () {58 vars in 1161 bytes} [Mon Jul 25 14:25:35 2022] DELETE /compute/v2.1/flavors/1482982635 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:25:35.146696 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9eae97b4-c339-45ae-b6ae-d89765eddf3b tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:35.180879 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9eae97b4-c339-45ae-b6ae-d89765eddf3b tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040440 Jul 25 14:25:35.181841 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 28/63] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:25:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:35.215543 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3456f6d0-6090-43f0-9837-ec1e7698c9e4 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1766338237", "id": 359492172, "os-flavor-access:is_public": "False"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:35.239044 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3456f6d0-6090-43f0-9837-ec1e7698c9e4 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.041605 Jul 25 14:25:35.239673 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 29/64] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:25:35 2022] POST /compute/v2.1/flavors => generated 412 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:35.253700 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-da914d55-dabf-498c-9382-a842905beb2e tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-955053291", "id": 1419741176, "os-flavor-access:is_public": "True"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:35.279925 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-da914d55-dabf-498c-9382-a842905beb2e tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.031248 Jul 25 14:25:35.282393 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 30/65] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:25:35 2022] POST /compute/v2.1/flavors => generated 413 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:35.294149 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2d96f81f-4b86-42d7-9cd1-f7af2b7f9df4 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:35.313063 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2d96f81f-4b86-42d7-9cd1-f7af2b7f9df4 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.022585 Jul 25 14:25:35.321727 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 31/66] 10.222.0.88 () {58 vars in 1169 bytes} [Mon Jul 25 14:25:35 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:35.326511 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-137ee75f-8fe6-41d7-afb6-947d9972334e tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:35.347255 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-137ee75f-8fe6-41d7-afb6-947d9972334e tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.024217 Jul 25 14:25:35.368923 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 32/67] 10.222.0.88 () {58 vars in 1177 bytes} [Mon Jul 25 14:25:35 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:35.374197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-859e1320-6cf9-4754-84a5-28dce061cc55 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:35.384922 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-859e1320-6cf9-4754-84a5-28dce061cc55 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.013893 Jul 25 14:25:35.385716 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 33/68] 10.222.0.88 () {58 vars in 1171 bytes} [Mon Jul 25 14:25:35 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:25:35.398768 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4c30dbf6-0b12-41d0-a7ea-f369b2c013a5 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:35.408853 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4c30dbf6-0b12-41d0-a7ea-f369b2c013a5 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.013844 Jul 25 14:25:35.409770 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 34/69] 10.222.0.88 () {58 vars in 1169 bytes} [Mon Jul 25 14:25:35 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:35.422479 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-99087321-e27c-47be-b1fc-0c2fcc383e98 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:35.456424 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-99087321-e27c-47be-b1fc-0c2fcc383e98 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.037637 Jul 25 14:25:35.457529 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 35/70] 10.222.0.88 () {58 vars in 1169 bytes} [Mon Jul 25 14:25:35 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:35.484411 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7c0c318b-1d3e-48fe-a9ba-200dc2cfef62 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:35.526716 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7c0c318b-1d3e-48fe-a9ba-200dc2cfef62 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.053291 Jul 25 14:25:35.527938 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 36/71] 10.222.0.88 () {58 vars in 1175 bytes} [Mon Jul 25 14:25:35 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:35.548324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-62abae98-d788-4677-a8aa-017dc3e0f1c1 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:35.581448 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-62abae98-d788-4677-a8aa-017dc3e0f1c1 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.039983 Jul 25 14:25:35.582200 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 37/72] 10.222.0.88 () {58 vars in 1173 bytes} [Mon Jul 25 14:25:35 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:25:35.600992 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dc35d973-b992-44a0-b6ea-b9c0fdb2e121 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:35.635480 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dc35d973-b992-44a0-b6ea-b9c0fdb2e121 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.039211 Jul 25 14:25:35.636682 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 38/73] 10.222.0.88 () {58 vars in 1169 bytes} [Mon Jul 25 14:25:35 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:25:35.657540 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-910a6836-21bf-40a5-8879-0b8373eea898 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:35.684749 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-910a6836-21bf-40a5-8879-0b8373eea898 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/1419741176" status: 202 len: 0 microversion: 2.1 time: 0.031570 Jul 25 14:25:35.686981 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 39/74] 10.222.0.88 () {58 vars in 1161 bytes} [Mon Jul 25 14:25:35 2022] DELETE /compute/v2.1/flavors/1419741176 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 14:25:35.700677 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b88ddc22-c703-4282-b8f8-3817b831983c tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:35.754594 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b88ddc22-c703-4282-b8f8-3817b831983c tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.063458 Jul 25 14:25:35.755307 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 40/75] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:25:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:35.780118 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-663b7837-25ac-47ea-9cf8-5e827bd1813c tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:35.826637 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-663b7837-25ac-47ea-9cf8-5e827bd1813c tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/359492172" status: 202 len: 0 microversion: 2.1 time: 0.055976 Jul 25 14:25:35.831774 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 41/76] 10.222.0.88 () {58 vars in 1158 bytes} [Mon Jul 25 14:25:35 2022] DELETE /compute/v2.1/flavors/359492172 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:25:35.837054 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d251f88b-eef2-43a5-a00a-c60e2e13b161 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:35.871351 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d251f88b-eef2-43a5-a00a-c60e2e13b161 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037472 Jul 25 14:25:35.886523 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 42/77] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:25:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:25:35.896552 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2c1850d6-14c1-436a-b64a-51295df75550 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1819132053", "id": 1098101408, "os-flavor-access:is_public": "False"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:35.934957 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2c1850d6-14c1-436a-b64a-51295df75550 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.044178 Jul 25 14:25:35.938483 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 43/78] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:25:35 2022] POST /compute/v2.1/flavors => generated 415 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:35.961467 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b3b5fa2f-3e57-4626-a285-18219988399e tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:36.044097 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b3b5fa2f-3e57-4626-a285-18219988399e tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.091672 Jul 25 14:25:36.045039 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 44/79] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:25:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:36.063167 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-637bde5b-4211-4d1c-aaf9-6f8d0ecdbce1 tempest-FlavorsAdminTestJSON-106208806 tempest-FlavorsAdminTestJSON-106208806-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:36.097416 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-637bde5b-4211-4d1c-aaf9-6f8d0ecdbce1 tempest-FlavorsAdminTestJSON-106208806 tempest-FlavorsAdminTestJSON-106208806-project] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038151 Jul 25 14:25:36.108556 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 45/80] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:25:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:36.119673 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3ffef608-1dcf-4841-8cc3-3d80248630ff tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:36.134743 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2d5f1a39-37da-47ec-9be5-a1b9598da98f tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-635481561", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "availability_zone": "tempest-test_az-138790999"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:36.177187 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3ffef608-1dcf-4841-8cc3-3d80248630ff tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/1098101408" status: 202 len: 0 microversion: 2.1 time: 0.063624 Jul 25 14:25:36.178440 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 46/81] 10.222.0.88 () {58 vars in 1161 bytes} [Mon Jul 25 14:25:36 2022] DELETE /compute/v2.1/flavors/1098101408 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:25:36.187858 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b12654a5-23e0-48dd-aa7e-2ca3c34cfe47 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:36.202014 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2d5f1a39-37da-47ec-9be5-a1b9598da98f tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:36.205150 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2d5f1a39-37da-47ec-9be5-a1b9598da98f tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:36.206256 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2d5f1a39-37da-47ec-9be5-a1b9598da98f tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:36.206839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2d5f1a39-37da-47ec-9be5-a1b9598da98f tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:36.227649 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b12654a5-23e0-48dd-aa7e-2ca3c34cfe47 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043819 Jul 25 14:25:36.231425 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 47/82] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:25:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:25:36.249571 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-15e64dd7-1a9d-48a5-a499-18186b9d4bd1 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1879470857", "id": 1775928586, "os-flavor-access:is_public": "True"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:36.283130 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-15e64dd7-1a9d-48a5-a499-18186b9d4bd1 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.037373 Jul 25 14:25:36.283759 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 48/83] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:25:36 2022] POST /compute/v2.1/flavors => generated 414 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:25:36.297079 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d26da631-360e-479f-8a90-9108202f6abe tempest-FlavorsAdminTestJSON-106208806 tempest-FlavorsAdminTestJSON-106208806-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:36.321584 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d26da631-360e-479f-8a90-9108202f6abe tempest-FlavorsAdminTestJSON-106208806 tempest-FlavorsAdminTestJSON-106208806-project] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.029911 Jul 25 14:25:36.322993 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 49/84] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:25:36 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:25:36.341426 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ae1757a1-eedc-4222-8514-e5f656175672 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:36.378252 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ae1757a1-eedc-4222-8514-e5f656175672 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/1775928586" status: 202 len: 0 microversion: 2.1 time: 0.039427 Jul 25 14:25:36.384820 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 50/85] 10.222.0.88 () {58 vars in 1161 bytes} [Mon Jul 25 14:25:36 2022] DELETE /compute/v2.1/flavors/1775928586 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:25:36.419540 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3171d71a-5b36-49da-822a-253c40fc6b81 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:36.477480 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3171d71a-5b36-49da-822a-253c40fc6b81 tempest-FlavorsAdminTestJSON-1658097929 tempest-FlavorsAdminTestJSON-1658097929-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.089211 Jul 25 14:25:36.480482 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 51/86] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:25:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:38.000214 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-2d5f1a39-37da-47ec-9be5-a1b9598da98f tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] validate_networks() for None {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:25:38.457275 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-2d5f1a39-37da-47ec-9be5-a1b9598da98f tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:25:38.458115 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-2d5f1a39-37da-47ec-9be5-a1b9598da98f tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:25:38.458832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-2d5f1a39-37da-47ec-9be5-a1b9598da98f tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:25:38.459441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-2d5f1a39-37da-47ec-9be5-a1b9598da98f tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:25:38.460102 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-2d5f1a39-37da-47ec-9be5-a1b9598da98f tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:25:38.477329 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2d5f1a39-37da-47ec-9be5-a1b9598da98f tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:38.478256 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2d5f1a39-37da-47ec-9be5-a1b9598da98f tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:38.479343 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2d5f1a39-37da-47ec-9be5-a1b9598da98f tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:38.479923 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2d5f1a39-37da-47ec-9be5-a1b9598da98f tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:38.562701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-2d5f1a39-37da-47ec-9be5-a1b9598da98f tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Getting quotas for project 78221408d9ae4bdfb29ded35235d5287. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:25:38.574734 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-2d5f1a39-37da-47ec-9be5-a1b9598da98f tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Getting quotas for user 71a2d52c9e2c48dd9e7502843844bf27 and project 78221408d9ae4bdfb29ded35235d5287. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:25:38.601937 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2d5f1a39-37da-47ec-9be5-a1b9598da98f tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:25:38.608104 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2d5f1a39-37da-47ec-9be5-a1b9598da98f tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:25:38.706363 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2d5f1a39-37da-47ec-9be5-a1b9598da98f tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.688637 Jul 25 14:25:38.710920 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 36/87] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:25:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 3697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:25:38.715673 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3ac35bef-49d5-4dbd-9868-019643d85f3b tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:38.716453 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3ac35bef-49d5-4dbd-9868-019643d85f3b tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:25:39.811936 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:25:40.497813 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3ac35bef-49d5-4dbd-9868-019643d85f3b tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2d52c9e2c48dd9e7502843844bf27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78221408d9ae4bdfb29ded35235d5287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:25:40.528377 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3ac35bef-49d5-4dbd-9868-019643d85f3b tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] 10.222.0.88 "GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f" status: 200 len: 1241 microversion: 2.1 time: 1.816544 Jul 25 14:25:40.529367 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 52/88] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:25:38 2022] GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f => generated 1241 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:25:41.549621 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-417f5261-723b-4b27-b819-c2b7ef5d486f tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:41.550905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-417f5261-723b-4b27-b819-c2b7ef5d486f tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:25:41.577308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-417f5261-723b-4b27-b819-c2b7ef5d486f tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:41.581338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-417f5261-723b-4b27-b819-c2b7ef5d486f tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:41.583936 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-417f5261-723b-4b27-b819-c2b7ef5d486f tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:41.585409 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-417f5261-723b-4b27-b819-c2b7ef5d486f tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:41.905138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-417f5261-723b-4b27-b819-c2b7ef5d486f tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2d52c9e2c48dd9e7502843844bf27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78221408d9ae4bdfb29ded35235d5287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:25:41.932319 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-417f5261-723b-4b27-b819-c2b7ef5d486f tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] 10.222.0.88 "GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f" status: 200 len: 1307 microversion: 2.1 time: 0.386957 Jul 25 14:25:41.933878 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 37/89] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:25:41 2022] GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f => generated 1307 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:42.955120 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-57ab04f4-789b-4b13-9749-8fb82954ae1a tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:42.958722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-57ab04f4-789b-4b13-9749-8fb82954ae1a tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:25:42.971786 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-57ab04f4-789b-4b13-9749-8fb82954ae1a tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:42.972258 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-57ab04f4-789b-4b13-9749-8fb82954ae1a tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:42.979317 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-57ab04f4-789b-4b13-9749-8fb82954ae1a tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:42.980005 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-57ab04f4-789b-4b13-9749-8fb82954ae1a tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:43.453423 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-57ab04f4-789b-4b13-9749-8fb82954ae1a tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2d52c9e2c48dd9e7502843844bf27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78221408d9ae4bdfb29ded35235d5287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:25:43.467657 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-57ab04f4-789b-4b13-9749-8fb82954ae1a tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] 10.222.0.88 "GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f" status: 200 len: 1295 microversion: 2.1 time: 0.516159 Jul 25 14:25:43.468594 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 53/90] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:25:42 2022] GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f => generated 1295 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:44.490019 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dbe02554-19e3-44c7-ac84-14a1f0ecc602 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:44.490629 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-dbe02554-19e3-44c7-ac84-14a1f0ecc602 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:25:44.508885 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dbe02554-19e3-44c7-ac84-14a1f0ecc602 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:44.510636 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dbe02554-19e3-44c7-ac84-14a1f0ecc602 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:44.513423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dbe02554-19e3-44c7-ac84-14a1f0ecc602 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:44.514226 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dbe02554-19e3-44c7-ac84-14a1f0ecc602 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:45.012681 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-dbe02554-19e3-44c7-ac84-14a1f0ecc602 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2d52c9e2c48dd9e7502843844bf27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78221408d9ae4bdfb29ded35235d5287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:25:45.038212 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dbe02554-19e3-44c7-ac84-14a1f0ecc602 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] 10.222.0.88 "GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f" status: 200 len: 1337 microversion: 2.1 time: 0.546038 Jul 25 14:25:45.060400 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 38/91] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:25:44 2022] GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f => generated 1337 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:45.568263 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f6d0478e-9dc0-477b-9e02-cb9c05c4b851 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-257046597", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:45.587049 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=16,nova_api:INSERT=5 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:25:45.720891 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-f6d0478e-9dc0-477b-9e02-cb9c05c4b851 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] validate_networks() for None {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:25:46.111449 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d63e6a41-7bfe-4ba6-a03e-46e35d719e6e tempest-FlavorsExtraSpecsTestJSON-1790899012 tempest-FlavorsExtraSpecsTestJSON-1790899012-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1991492344", "ram": 512, "vcpus": 1, "disk": 10, "id": 191667745, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:46.114917 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:46.114917 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:46.148497 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d63e6a41-7bfe-4ba6-a03e-46e35d719e6e tempest-FlavorsExtraSpecsTestJSON-1790899012 tempest-FlavorsExtraSpecsTestJSON-1790899012-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.833172 Jul 25 14:25:46.158021 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 39/92] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:25:45 2022] POST /compute/v2.1/flavors => generated 413 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:25:46.179695 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-773bb9b2-9c1e-4a3a-9ec7-acc343f33e91 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:46.181364 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-773bb9b2-9c1e-4a3a-9ec7-acc343f33e91 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:25:46.207536 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-773bb9b2-9c1e-4a3a-9ec7-acc343f33e91 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:46.208049 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-773bb9b2-9c1e-4a3a-9ec7-acc343f33e91 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:46.211565 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-773bb9b2-9c1e-4a3a-9ec7-acc343f33e91 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:46.212330 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-773bb9b2-9c1e-4a3a-9ec7-acc343f33e91 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:46.350406 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f6d0478e-9dc0-477b-9e02-cb9c05c4b851 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:25:46.351338 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f6d0478e-9dc0-477b-9e02-cb9c05c4b851 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:25:46.352029 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f6d0478e-9dc0-477b-9e02-cb9c05c4b851 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:25:46.352645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f6d0478e-9dc0-477b-9e02-cb9c05c4b851 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:25:46.353210 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f6d0478e-9dc0-477b-9e02-cb9c05c4b851 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:25:46.373736 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6d0478e-9dc0-477b-9e02-cb9c05c4b851 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:46.375064 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6d0478e-9dc0-477b-9e02-cb9c05c4b851 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:46.376205 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6d0478e-9dc0-477b-9e02-cb9c05c4b851 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:46.377015 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6d0478e-9dc0-477b-9e02-cb9c05c4b851 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:46.467177 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-f6d0478e-9dc0-477b-9e02-cb9c05c4b851 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Getting quotas for project 8236bf5c62e6434cbedf22a0e3fba1f4. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:25:46.498596 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-f6d0478e-9dc0-477b-9e02-cb9c05c4b851 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Getting quotas for user d99a49d2a5254f038c4c1e243f3bac22 and project 8236bf5c62e6434cbedf22a0e3fba1f4. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:25:46.514740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-773bb9b2-9c1e-4a3a-9ec7-acc343f33e91 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2d52c9e2c48dd9e7502843844bf27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78221408d9ae4bdfb29ded35235d5287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:25:46.520384 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f6d0478e-9dc0-477b-9e02-cb9c05c4b851 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:25:46.525369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f6d0478e-9dc0-477b-9e02-cb9c05c4b851 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 0a711946-8ed7-4475-a873-944011be17d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:25:46.536707 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-773bb9b2-9c1e-4a3a-9ec7-acc343f33e91 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] 10.222.0.88 "GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f" status: 200 len: 1337 microversion: 2.1 time: 0.364626 Jul 25 14:25:46.537732 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 40/93] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:25:46 2022] GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f => generated 1337 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:46.546964 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7e038cf9-afad-4649-9615-4668fb177d3f tempest-FlavorsExtraSpecsTestJSON-1790899012 tempest-FlavorsExtraSpecsTestJSON-1790899012-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:46.565097 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:46.565097 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:46.623488 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7e038cf9-afad-4649-9615-4668fb177d3f tempest-FlavorsExtraSpecsTestJSON-1790899012 tempest-FlavorsExtraSpecsTestJSON-1790899012-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors/191667745/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.082065 Jul 25 14:25:46.630303 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f6d0478e-9dc0-477b-9e02-cb9c05c4b851 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.078525 Jul 25 14:25:46.632756 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 54/94] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:25:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:25:46.647239 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 41/95] 10.222.0.88 () {60 vars in 1221 bytes} [Mon Jul 25 14:25:46 2022] POST /compute/v2.1/flavors/191667745/os-extra_specs => generated 66 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:25:46.666740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ae52768b-6261-48d7-8b74-7067c5c1396e tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:46.668455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ae52768b-6261-48d7-8b74-7067c5c1396e tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 0a711946-8ed7-4475-a873-944011be17d6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:25:46.834973 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ae52768b-6261-48d7-8b74-7067c5c1396e tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:25:46.854451 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ae52768b-6261-48d7-8b74-7067c5c1396e tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6" status: 200 len: 1219 microversion: 2.1 time: 0.200761 Jul 25 14:25:46.855411 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 42/96] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:25:46 2022] GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6 => generated 1219 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:47.337577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3b9c9cb6-135d-4481-b19d-642c43b79a15 tempest-FlavorsExtraSpecsTestJSON-632365448 tempest-FlavorsExtraSpecsTestJSON-632365448-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:47.366271 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3b9c9cb6-135d-4481-b19d-642c43b79a15 tempest-FlavorsExtraSpecsTestJSON-632365448 tempest-FlavorsExtraSpecsTestJSON-632365448-project] 10.222.0.88 "GET /compute/v2.1/flavors/191667745/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.508943 Jul 25 14:25:47.375795 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 43/97] 10.222.0.88 () {58 vars in 1200 bytes} [Mon Jul 25 14:25:46 2022] GET /compute/v2.1/flavors/191667745/os-extra_specs => generated 66 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:25:47.492029 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-59e41419-9ffb-4698-83f9-bd5db09cc250 tempest-HypervisorAdminNegativeUnderV252Test-345821337 tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin] Calling method '.version_select at 0x7f46943d6160>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:47.493195 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:47.493195 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:47.495523 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59e41419-9ffb-4698-83f9-bd5db09cc250 tempest-HypervisorAdminNegativeUnderV252Test-345821337 tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:47.496219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59e41419-9ffb-4698-83f9-bd5db09cc250 tempest-HypervisorAdminNegativeUnderV252Test-345821337 tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:47.528033 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59e41419-9ffb-4698-83f9-bd5db09cc250 tempest-HypervisorAdminNegativeUnderV252Test-345821337 tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:47.531464 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59e41419-9ffb-4698-83f9-bd5db09cc250 tempest-HypervisorAdminNegativeUnderV252Test-345821337 tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:47.560066 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59e41419-9ffb-4698-83f9-bd5db09cc250 tempest-HypervisorAdminNegativeUnderV252Test-345821337 tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:47.562344 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59e41419-9ffb-4698-83f9-bd5db09cc250 tempest-HypervisorAdminNegativeUnderV252Test-345821337 tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:47.578893 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-59e41419-9ffb-4698-83f9-bd5db09cc250 tempest-HypervisorAdminNegativeUnderV252Test-345821337 tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.942794 Jul 25 14:25:47.581442 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 55/98] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:25:46 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:47.946795 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0bc43698-a821-45fb-bd15-640ab92bb815 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:47.989295 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0bc43698-a821-45fb-bd15-640ab92bb815 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.604231 Jul 25 14:25:47.990611 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 44/99] 10.222.0.88 () {58 vars in 1137 bytes} [Mon Jul 25 14:25:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:47.998870 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-73be191f-ac56-4e11-a454-cd567811aec2 tempest-FlavorsExtraSpecsTestJSON-1790899012 tempest-FlavorsExtraSpecsTestJSON-1790899012-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:48.005561 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:48.005561 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:48.086585 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-73be191f-ac56-4e11-a454-cd567811aec2 tempest-FlavorsExtraSpecsTestJSON-1790899012 tempest-FlavorsExtraSpecsTestJSON-1790899012-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors/191667745/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.094526 Jul 25 14:25:48.089793 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 45/100] 10.222.0.88 () {60 vars in 1221 bytes} [Mon Jul 25 14:25:47 2022] POST /compute/v2.1/flavors/191667745/os-extra_specs => generated 66 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:25:48.102737 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-081fb215-df55-47d4-a904-f0fddecd0869 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:48.108418 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-081fb215-df55-47d4-a904-f0fddecd0869 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:25:48.128734 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-081fb215-df55-47d4-a904-f0fddecd0869 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:48.130068 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-081fb215-df55-47d4-a904-f0fddecd0869 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:48.132946 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-081fb215-df55-47d4-a904-f0fddecd0869 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:48.134924 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-081fb215-df55-47d4-a904-f0fddecd0869 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:48.143053 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3d3616ee-fe2a-4aaa-99b5-e46a5dadee3d tempest-HypervisorAdminUnderV252Test-437360991 tempest-HypervisorAdminUnderV252Test-437360991-project-admin] Calling method '.version_select at 0x7f46943489d0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:48.143920 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:48.143920 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:48.145035 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3d3616ee-fe2a-4aaa-99b5-e46a5dadee3d tempest-HypervisorAdminUnderV252Test-437360991 tempest-HypervisorAdminUnderV252Test-437360991-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:48.146081 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3d3616ee-fe2a-4aaa-99b5-e46a5dadee3d tempest-HypervisorAdminUnderV252Test-437360991 tempest-HypervisorAdminUnderV252Test-437360991-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:48.179856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3d3616ee-fe2a-4aaa-99b5-e46a5dadee3d tempest-HypervisorAdminUnderV252Test-437360991 tempest-HypervisorAdminUnderV252Test-437360991-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:48.180602 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3d3616ee-fe2a-4aaa-99b5-e46a5dadee3d tempest-HypervisorAdminUnderV252Test-437360991 tempest-HypervisorAdminUnderV252Test-437360991-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:48.231399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3d3616ee-fe2a-4aaa-99b5-e46a5dadee3d tempest-HypervisorAdminUnderV252Test-437360991 tempest-HypervisorAdminUnderV252Test-437360991-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:48.233323 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3d3616ee-fe2a-4aaa-99b5-e46a5dadee3d tempest-HypervisorAdminUnderV252Test-437360991 tempest-HypervisorAdminUnderV252Test-437360991-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:48.263452 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3d3616ee-fe2a-4aaa-99b5-e46a5dadee3d tempest-HypervisorAdminUnderV252Test-437360991 tempest-HypervisorAdminUnderV252Test-437360991-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.679049 Jul 25 14:25:48.272353 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 56/101] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:25:47 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:48.484339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-081fb215-df55-47d4-a904-f0fddecd0869 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2d52c9e2c48dd9e7502843844bf27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78221408d9ae4bdfb29ded35235d5287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:25:48.492936 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-081fb215-df55-47d4-a904-f0fddecd0869 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] 10.222.0.88 "GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f" status: 200 len: 1337 microversion: 2.1 time: 0.401476 Jul 25 14:25:48.499262 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 46/102] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:25:48 2022] GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f => generated 1337 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:48.533411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:25:48.582591 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0dc4794b-92b1-44da-ad2d-a978c7c35d63 tempest-HypervisorAdminNegativeUnderV252Test-1591169232 tempest-HypervisorAdminNegativeUnderV252Test-1591169232-project] Calling method '.version_select at 0x7f4694348700>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:48.583458 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:48.583458 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:48.584598 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0dc4794b-92b1-44da-ad2d-a978c7c35d63 tempest-HypervisorAdminNegativeUnderV252Test-1591169232 tempest-HypervisorAdminNegativeUnderV252Test-1591169232-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '75c45fa8a85642e6868d4efa0240aff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb38b4560941a09d2a08c12ebcd7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:25:48.586281 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0dc4794b-92b1-44da-ad2d-a978c7c35d63 tempest-HypervisorAdminNegativeUnderV252Test-1591169232 tempest-HypervisorAdminNegativeUnderV252Test-1591169232-project] Request method failure captured: Jul 25 14:25:48.586281 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/os-hypervisors/n-h1-846435-14/search HTTP/1.1 Jul 25 14:25:48.586281 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:25:48.586281 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:25:48.586281 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:25:48.586281 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:25:48.586281 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:25:48.586281 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:25:48.586281 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:25:48.586281 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:25:48.586281 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfmKLKeBxENgKgMZHtr4h4bzR7Qu7YZDUaXT9LBdzT_aCXTwJAAzxahBPu3bctdhOSsSk0p_CYw67oQil5s_P3VZKlvdqLOqvO3szZV7WLSoNxnmy-1rU920j5Y0qD28PUbhWhzFkVLCEVuSwjznhSWi7Jco844bWnoG8Gq-pF4sZQ Jul 25 14:25:48.586281 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:25:48.586281 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:25:48.586281 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:25:48.586281 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:25:48.586281 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:25:48.586281 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:25:48.586281 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 3ebb38b4560941a09d2a08c12ebcd7f2 Jul 25 14:25:48.586281 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1591169232 Jul 25 14:25:48.586281 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:25:48.586281 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:25:48.587760 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3ebb38b4560941a09d2a08c12ebcd7f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3ebb38b4560941a09d2a08c12ebcd7f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3ebb38b4560941a09d2a08c12ebcd7f2", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3ebb38b4560941a09d2a08c12ebcd7f2"}]}] Jul 25 14:25:48.587760 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1591169232 Jul 25 14:25:48.587760 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 3ebb38b4560941a09d2a08c12ebcd7f2 Jul 25 14:25:48.587760 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1591169232 Jul 25 14:25:48.587760 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1591169232-project Jul 25 14:25:48.587760 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:25:48.587760 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:25:48.587760 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 75c45fa8a85642e6868d4efa0240aff8 Jul 25 14:25:48.587760 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1591169232-project Jul 25 14:25:48.587760 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:25:48.587760 n-d-846435-14 devstack@n-api.service[119304]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 25 14:25:48.587760 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'n-h1-846435-14'} Jul 25 14:25:48.588708 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:25:48.588708 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:48.588708 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:48.588708 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:48.588708 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:25:48.588708 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:25:48.588708 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:25:48.588708 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:25:48.588708 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:25:48.588708 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:25:48.588708 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jul 25 14:25:48.588708 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jul 25 14:25:48.588708 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 14:25:48.588708 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 14:25:48.588708 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 14:25:48.588708 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 14:25:48.588708 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:25:48.588708 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:25:48.588708 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:25:48.590030 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:25:48.590030 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 14:25:48.590030 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 14:25:48.590030 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 14:25:48.590030 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 14:25:48.590030 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 14:25:48.590030 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 14:25:48.590030 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 25 14:25:48.590030 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:48.590030 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:48.590030 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:48.590030 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:48.590030 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:48.590030 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:48.590030 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 14:25:48.590030 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 14:25:48.590030 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 25 14:25:48.590030 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:48.591375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0dc4794b-92b1-44da-ad2d-a978c7c35d63 tempest-HypervisorAdminNegativeUnderV252Test-1591169232 tempest-HypervisorAdminNegativeUnderV252Test-1591169232-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:25:48.591375 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0dc4794b-92b1-44da-ad2d-a978c7c35d63 tempest-HypervisorAdminNegativeUnderV252Test-1591169232 tempest-HypervisorAdminNegativeUnderV252Test-1591169232-project] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/n-h1-846435-14/search" status: 403 len: 117 microversion: 2.1 time: 0.313729 Jul 25 14:25:48.596781 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 57/103] 10.222.0.88 () {58 vars in 1212 bytes} [Mon Jul 25 14:25:48 2022] GET /compute/v2.1/os-hypervisors/n-h1-846435-14/search => generated 117 bytes in 323 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:25:48.615243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-043f7fea-a3db-4299-afe3-cf13077f94a9 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:48.615867 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-043f7fea-a3db-4299-afe3-cf13077f94a9 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 0a711946-8ed7-4475-a873-944011be17d6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:25:48.655408 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-043f7fea-a3db-4299-afe3-cf13077f94a9 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:48.655864 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-043f7fea-a3db-4299-afe3-cf13077f94a9 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:48.662729 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-043f7fea-a3db-4299-afe3-cf13077f94a9 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:48.667276 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-043f7fea-a3db-4299-afe3-cf13077f94a9 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:48.822516 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4b5f794c-9cde-4c3a-ac16-3ddf2b90c917 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:48.825782 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:48.825782 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:48.829654 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4b5f794c-9cde-4c3a-ac16-3ddf2b90c917 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:48.832666 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4b5f794c-9cde-4c3a-ac16-3ddf2b90c917 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:48.837304 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4b5f794c-9cde-4c3a-ac16-3ddf2b90c917 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:48.840855 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4b5f794c-9cde-4c3a-ac16-3ddf2b90c917 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:48.957474 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4b5f794c-9cde-4c3a-ac16-3ddf2b90c917 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 403 microversion: 2.1 time: 0.438717 Jul 25 14:25:48.967158 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-043f7fea-a3db-4299-afe3-cf13077f94a9 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:25:48.971313 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 47/104] 10.222.0.88 () {58 vars in 1176 bytes} [Mon Jul 25 14:25:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 403 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:49.029280 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-043f7fea-a3db-4299-afe3-cf13077f94a9 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6" status: 200 len: 1215 microversion: 2.1 time: 0.428504 Jul 25 14:25:49.045462 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 58/105] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:25:48 2022] GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6 => generated 1215 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:49.061250 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f28a1df7-5893-481b-b615-59e840a16dca tempest-FlavorsExtraSpecsTestJSON-632365448 tempest-FlavorsExtraSpecsTestJSON-632365448-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:49.082543 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f28a1df7-5893-481b-b615-59e840a16dca tempest-FlavorsExtraSpecsTestJSON-632365448 tempest-FlavorsExtraSpecsTestJSON-632365448-project] 10.222.0.88 "GET /compute/v2.1/flavors/191667745/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.034291 Jul 25 14:25:49.083752 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 59/106] 10.222.0.88 () {58 vars in 1242 bytes} [Mon Jul 25 14:25:49 2022] GET /compute/v2.1/flavors/191667745/os-extra_specs/hw:numa_nodes => generated 22 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:25:49.094995 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-71498872-6427-4603-aba8-81613ef80d60 tempest-HypervisorAdminUnderV252Test-437360991 tempest-HypervisorAdminUnderV252Test-437360991-project-admin] Calling method '.version_select at 0x7f4694380d30>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:49.100780 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:49.100780 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:49.103217 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71498872-6427-4603-aba8-81613ef80d60 tempest-HypervisorAdminUnderV252Test-437360991 tempest-HypervisorAdminUnderV252Test-437360991-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:49.104079 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71498872-6427-4603-aba8-81613ef80d60 tempest-HypervisorAdminUnderV252Test-437360991 tempest-HypervisorAdminUnderV252Test-437360991-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:49.135811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71498872-6427-4603-aba8-81613ef80d60 tempest-HypervisorAdminUnderV252Test-437360991 tempest-HypervisorAdminUnderV252Test-437360991-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:49.136428 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71498872-6427-4603-aba8-81613ef80d60 tempest-HypervisorAdminUnderV252Test-437360991 tempest-HypervisorAdminUnderV252Test-437360991-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:49.218293 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71498872-6427-4603-aba8-81613ef80d60 tempest-HypervisorAdminUnderV252Test-437360991 tempest-HypervisorAdminUnderV252Test-437360991-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:49.221737 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71498872-6427-4603-aba8-81613ef80d60 tempest-HypervisorAdminUnderV252Test-437360991 tempest-HypervisorAdminUnderV252Test-437360991-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:49.234262 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-71498872-6427-4603-aba8-81613ef80d60 tempest-HypervisorAdminUnderV252Test-437360991 tempest-HypervisorAdminUnderV252Test-437360991-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/n-h1-846435-14/servers" status: 200 len: 197 microversion: 2.1 time: 0.149181 Jul 25 14:25:49.236771 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 60/107] 10.222.0.88 () {58 vars in 1215 bytes} [Mon Jul 25 14:25:49 2022] GET /compute/v2.1/os-hypervisors/n-h1-846435-14/servers => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:49.262023 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e5540384-860e-4f13-b623-c32266fcbb13 tempest-HypervisorAdminNegativeUnderV252Test-345821337 tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin] Calling method '.version_select at 0x7f46943800d0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:49.263292 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:49.263292 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:49.265399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e5540384-860e-4f13-b623-c32266fcbb13 tempest-HypervisorAdminNegativeUnderV252Test-345821337 tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:49.266828 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e5540384-860e-4f13-b623-c32266fcbb13 tempest-HypervisorAdminNegativeUnderV252Test-345821337 tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:49.278787 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-e5540384-860e-4f13-b623-c32266fcbb13 tempest-HypervisorAdminNegativeUnderV252Test-345821337 tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 25 14:25:49.284408 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e5540384-860e-4f13-b623-c32266fcbb13 tempest-HypervisorAdminNegativeUnderV252Test-345821337 tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin] Request method failure captured: Jul 25 14:25:49.284408 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jul 25 14:25:49.284408 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:25:49.284408 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:25:49.284408 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:25:49.284408 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:25:49.284408 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:25:49.284408 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:25:49.284408 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:25:49.284408 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:25:49.284408 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfqMEd8f3RRwPyZJ5FTyVW-DBlNoqCCk0CwxyPxMrrD-qOTi7AwwoLUKEoK410DICdciHgmIh5N2z1J3tczxsdTIQkPLXRnLLONGxnJWKsqL0zGxW1ewKSSdS7kc7DAEfptSRU-ZVKaIDgmdYC4XUIDS62GSm3E9s9Rz39vCYsugSs Jul 25 14:25:49.284408 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:25:49.284408 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:25:49.284408 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:25:49.284408 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:25:49.284408 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:25:49.284408 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:25:49.284408 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: ee77f7ba414a42fe8510938f46a573cb Jul 25 14:25:49.284408 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-345821337 Jul 25 14:25:49.284408 n-d-846435-14 devstack@n-api.service[119304]: X-Role: admin,reader,member Jul 25 14:25:49.284408 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: admin,reader,member Jul 25 14:25:49.285868 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ee77f7ba414a42fe8510938f46a573cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ee77f7ba414a42fe8510938f46a573cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ee77f7ba414a42fe8510938f46a573cb", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ee77f7ba414a42fe8510938f46a573cb"}]}] Jul 25 14:25:49.285868 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-345821337 Jul 25 14:25:49.285868 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: ee77f7ba414a42fe8510938f46a573cb Jul 25 14:25:49.285868 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-345821337 Jul 25 14:25:49.285868 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin Jul 25 14:25:49.285868 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:25:49.285868 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:25:49.285868 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 787bd005a9934a65a5772ce428b23308 Jul 25 14:25:49.285868 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin Jul 25 14:25:49.285868 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:25:49.285868 n-d-846435-14 devstack@n-api.service[119304]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 25 14:25:49.285868 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'nonexistent_hypervisor_name'} Jul 25 14:25:49.295024 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:25:49.295024 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:49.295024 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:49.295024 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:49.295024 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:25:49.295024 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:25:49.295024 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:25:49.295024 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:25:49.295024 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:25:49.295024 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:25:49.295024 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jul 25 14:25:49.295024 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 25 14:25:49.295024 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 25 14:25:49.295024 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 14:25:49.295024 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 25 14:25:49.295024 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:49.295024 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:49.295024 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:49.295024 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:49.295024 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:49.298755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:49.298755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:25:49.298755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:25:49.298755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 25 14:25:49.298755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:49.298755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e5540384-860e-4f13-b623-c32266fcbb13 tempest-HypervisorAdminNegativeUnderV252Test-345821337 tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:25:49.298755 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e5540384-860e-4f13-b623-c32266fcbb13 tempest-HypervisorAdminNegativeUnderV252Test-345821337 tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.051406 Jul 25 14:25:49.298755 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 61/108] 10.222.0.88 () {58 vars in 1251 bytes} [Mon Jul 25 14:25:49 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:25:49.302528 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4bad7647-d6c1-43dc-8975-5bf56eb07290 tempest-FlavorsExtraSpecsTestJSON-1790899012 tempest-FlavorsExtraSpecsTestJSON-1790899012-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:49.308659 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:49.308659 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:49.351881 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4bad7647-d6c1-43dc-8975-5bf56eb07290 tempest-FlavorsExtraSpecsTestJSON-1790899012 tempest-FlavorsExtraSpecsTestJSON-1790899012-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors/191667745/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.059490 Jul 25 14:25:49.360073 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 62/109] 10.222.0.88 () {60 vars in 1221 bytes} [Mon Jul 25 14:25:49 2022] POST /compute/v2.1/flavors/191667745/os-extra_specs => generated 66 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:25:49.554526 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ededb7ac-ea0f-4dcf-9033-ed3175b72ea1 tempest-ServersWithSpecificFlavorTestJSON-269819481 tempest-ServersWithSpecificFlavorTestJSON-269819481-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-316269259", "id": 897650779, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:49.557562 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:49.557562 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:49.600441 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ededb7ac-ea0f-4dcf-9033-ed3175b72ea1 tempest-ServersWithSpecificFlavorTestJSON-269819481 tempest-ServersWithSpecificFlavorTestJSON-269819481-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.627677 Jul 25 14:25:49.620895 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 48/110] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:25:48 2022] POST /compute/v2.1/flavors => generated 421 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:49.635680 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-73c05020-2ad4-4836-b8f0-e1ded6a02296 tempest-HypervisorAdminUnderV252Test-437360991 tempest-HypervisorAdminUnderV252Test-437360991-project-admin] Calling method '.version_select at 0x7f469448ae50>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:49.642460 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:49.642460 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:49.647906 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-73c05020-2ad4-4836-b8f0-e1ded6a02296 tempest-HypervisorAdminUnderV252Test-437360991 tempest-HypervisorAdminUnderV252Test-437360991-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:49.653542 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-73c05020-2ad4-4836-b8f0-e1ded6a02296 tempest-HypervisorAdminUnderV252Test-437360991 tempest-HypervisorAdminUnderV252Test-437360991-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:49.735760 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-73c05020-2ad4-4836-b8f0-e1ded6a02296 tempest-HypervisorAdminUnderV252Test-437360991 tempest-HypervisorAdminUnderV252Test-437360991-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:49.736244 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-73c05020-2ad4-4836-b8f0-e1ded6a02296 tempest-HypervisorAdminUnderV252Test-437360991 tempest-HypervisorAdminUnderV252Test-437360991-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:49.796673 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:DELETE=4,nova_api:SELECT=79,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:25:49.800663 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-73c05020-2ad4-4836-b8f0-e1ded6a02296 tempest-HypervisorAdminUnderV252Test-437360991 tempest-HypervisorAdminUnderV252Test-437360991-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:49.810988 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-e23a7979-e4a1-49ba-baf5-b934d8f8b87e req-eac05f17-54ab-4538-9e8e-877192a478d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9eb52d5-1abd-4050-ada7-60d23d4bb29f", "tag": "1a6656a9-cb42-4d44-908a-a8d1cfc3696d"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:49.811358 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-73c05020-2ad4-4836-b8f0-e1ded6a02296 tempest-HypervisorAdminUnderV252Test-437360991 tempest-HypervisorAdminUnderV252Test-437360991-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:49.829094 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-73c05020-2ad4-4836-b8f0-e1ded6a02296 tempest-HypervisorAdminUnderV252Test-437360991 tempest-HypervisorAdminUnderV252Test-437360991-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.197060 Jul 25 14:25:49.829713 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 49/111] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:25:49 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:49.839038 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-e23a7979-e4a1-49ba-baf5-b934d8f8b87e req-eac05f17-54ab-4538-9e8e-877192a478d1 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:49.839666 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-e23a7979-e4a1-49ba-baf5-b934d8f8b87e req-eac05f17-54ab-4538-9e8e-877192a478d1 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:49.849480 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4efe3651-b8ec-4c1a-807c-09570409dc3d tempest-HypervisorAdminNegativeUnderV252Test-345821337 tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin] Calling method '.version_select at 0x7f469443d9d0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:49.850726 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:49.850726 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:49.854252 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4efe3651-b8ec-4c1a-807c-09570409dc3d tempest-HypervisorAdminNegativeUnderV252Test-345821337 tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:49.855018 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4efe3651-b8ec-4c1a-807c-09570409dc3d tempest-HypervisorAdminNegativeUnderV252Test-345821337 tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:49.892312 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4efe3651-b8ec-4c1a-807c-09570409dc3d tempest-HypervisorAdminNegativeUnderV252Test-345821337 tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:49.892932 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4efe3651-b8ec-4c1a-807c-09570409dc3d tempest-HypervisorAdminNegativeUnderV252Test-345821337 tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:49.909841 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-e23a7979-e4a1-49ba-baf5-b934d8f8b87e req-eac05f17-54ab-4538-9e8e-877192a478d1 service nova] Creating event network-changed:1a6656a9-cb42-4d44-908a-a8d1cfc3696d for instance a9eb52d5-1abd-4050-ada7-60d23d4bb29f on n-h1-846435-14 Jul 25 14:25:49.913695 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-e23a7979-e4a1-49ba-baf5-b934d8f8b87e req-eac05f17-54ab-4538-9e8e-877192a478d1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119304) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 14:25:49.916254 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b7aa3155-4230-45bd-93ab-400e415cbc45 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:49.918449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b7aa3155-4230-45bd-93ab-400e415cbc45 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:49.919152 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4efe3651-b8ec-4c1a-807c-09570409dc3d tempest-HypervisorAdminNegativeUnderV252Test-345821337 tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:49.920146 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b7aa3155-4230-45bd-93ab-400e415cbc45 None None] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:49.921660 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4efe3651-b8ec-4c1a-807c-09570409dc3d tempest-HypervisorAdminNegativeUnderV252Test-345821337 tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:49.925107 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b7aa3155-4230-45bd-93ab-400e415cbc45 None None] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:49.946205 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.compute.rpcapi [None req-b7aa3155-4230-45bd-93ab-400e415cbc45 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 25 14:25:49.948955 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b7aa3155-4230-45bd-93ab-400e415cbc45 None None] Releasing lock "compute-rpcapi-router" {{(pid=119304) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 14:25:49.956274 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4efe3651-b8ec-4c1a-807c-09570409dc3d tempest-HypervisorAdminNegativeUnderV252Test-345821337 tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.115200 Jul 25 14:25:49.956931 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 50/112] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:25:49 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:49.978294 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-39567603-6dde-42ca-88cb-b6c63ddd6cdb tempest-FlavorsExtraSpecsTestJSON-1790899012 tempest-FlavorsExtraSpecsTestJSON-1790899012-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:49.988956 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b7aa3155-4230-45bd-93ab-400e415cbc45 None None] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.621386 Jul 25 14:25:49.990816 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 63/113] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:49.997273 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-eb9a3219-d0e0-4009-b206-c43278cdea6e tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:49.998348 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-eb9a3219-d0e0-4009-b206-c43278cdea6e tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:25:50.018253 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eb9a3219-d0e0-4009-b206-c43278cdea6e tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:50.018904 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eb9a3219-d0e0-4009-b206-c43278cdea6e tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:50.020673 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eb9a3219-d0e0-4009-b206-c43278cdea6e tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:50.022564 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eb9a3219-d0e0-4009-b206-c43278cdea6e tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:50.033616 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-39567603-6dde-42ca-88cb-b6c63ddd6cdb tempest-FlavorsExtraSpecsTestJSON-1790899012 tempest-FlavorsExtraSpecsTestJSON-1790899012-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/191667745/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.061950 Jul 25 14:25:50.040324 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 51/114] 10.222.0.88 () {58 vars in 1200 bytes} [Mon Jul 25 14:25:49 2022] GET /compute/v2.1/flavors/191667745/os-extra_specs => generated 66 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:25:50.048797 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-808fde73-dec7-464a-bf74-1476e0264688 tempest-ServersWithSpecificFlavorTestJSON-269819481 tempest-ServersWithSpecificFlavorTestJSON-269819481-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:50.069140 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-808fde73-dec7-464a-bf74-1476e0264688 tempest-ServersWithSpecificFlavorTestJSON-269819481 tempest-ServersWithSpecificFlavorTestJSON-269819481-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.032578 Jul 25 14:25:50.072145 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 52/115] 10.222.0.88 () {58 vars in 1182 bytes} [Mon Jul 25 14:25:50 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:25:50.091343 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d7047bc7-466b-4932-a9e2-5bd36f0a12a1 tempest-HypervisorAdminUnderV252Test-437360991 tempest-HypervisorAdminUnderV252Test-437360991-project-admin] Calling method '.version_select at 0x7f46943b81f0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:50.092659 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:50.092659 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:50.099262 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d7047bc7-466b-4932-a9e2-5bd36f0a12a1 tempest-HypervisorAdminUnderV252Test-437360991 tempest-HypervisorAdminUnderV252Test-437360991-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:50.100370 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d7047bc7-466b-4932-a9e2-5bd36f0a12a1 tempest-HypervisorAdminUnderV252Test-437360991 tempest-HypervisorAdminUnderV252Test-437360991-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:50.170505 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d7047bc7-466b-4932-a9e2-5bd36f0a12a1 tempest-HypervisorAdminUnderV252Test-437360991 tempest-HypervisorAdminUnderV252Test-437360991-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:50.172833 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d7047bc7-466b-4932-a9e2-5bd36f0a12a1 tempest-HypervisorAdminUnderV252Test-437360991 tempest-HypervisorAdminUnderV252Test-437360991-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:50.195089 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d7047bc7-466b-4932-a9e2-5bd36f0a12a1 tempest-HypervisorAdminUnderV252Test-437360991 tempest-HypervisorAdminUnderV252Test-437360991-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/n-h1-846435-14/search" status: 200 len: 105 microversion: 2.1 time: 0.121518 Jul 25 14:25:50.200423 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 53/116] 10.222.0.88 () {58 vars in 1212 bytes} [Mon Jul 25 14:25:50 2022] GET /compute/v2.1/os-hypervisors/n-h1-846435-14/search => generated 105 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:50.216326 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ab99be14-8402-4660-b265-bc5be9e9b13a tempest-HypervisorAdminNegativeUnderV252Test-1591169232 tempest-HypervisorAdminNegativeUnderV252Test-1591169232-project] Calling method '.version_select at 0x7f4694349940>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:50.220566 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:50.220566 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:50.224782 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ab99be14-8402-4660-b265-bc5be9e9b13a tempest-HypervisorAdminNegativeUnderV252Test-1591169232 tempest-HypervisorAdminNegativeUnderV252Test-1591169232-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '75c45fa8a85642e6868d4efa0240aff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebb38b4560941a09d2a08c12ebcd7f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:25:50.229935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ab99be14-8402-4660-b265-bc5be9e9b13a tempest-HypervisorAdminNegativeUnderV252Test-1591169232 tempest-HypervisorAdminNegativeUnderV252Test-1591169232-project] Request method failure captured: Jul 25 14:25:50.229935 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jul 25 14:25:50.229935 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:25:50.229935 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:25:50.229935 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:25:50.229935 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:25:50.229935 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:25:50.229935 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:25:50.229935 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:25:50.229935 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:25:50.229935 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qfmKLKeBxENgKgMZHtr4h4bzR7Qu7YZDUaXT9LBdzT_aCXTwJAAzxahBPu3bctdhOSsSk0p_CYw67oQil5s_P3VZKlvdqLOqvO3szZV7WLSoNxnmy-1rU920j5Y0qD28PUbhWhzFkVLCEVuSwjznhSWi7Jco844bWnoG8Gq-pF4sZQ Jul 25 14:25:50.229935 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:25:50.229935 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:25:50.229935 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:25:50.229935 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:25:50.229935 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:25:50.229935 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:25:50.229935 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 3ebb38b4560941a09d2a08c12ebcd7f2 Jul 25 14:25:50.229935 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1591169232 Jul 25 14:25:50.229935 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:25:50.229935 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:25:50.231749 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3ebb38b4560941a09d2a08c12ebcd7f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3ebb38b4560941a09d2a08c12ebcd7f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3ebb38b4560941a09d2a08c12ebcd7f2", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3ebb38b4560941a09d2a08c12ebcd7f2"}]}] Jul 25 14:25:50.231749 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1591169232 Jul 25 14:25:50.231749 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 3ebb38b4560941a09d2a08c12ebcd7f2 Jul 25 14:25:50.231749 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1591169232 Jul 25 14:25:50.231749 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1591169232-project Jul 25 14:25:50.231749 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:25:50.231749 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:25:50.231749 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 75c45fa8a85642e6868d4efa0240aff8 Jul 25 14:25:50.231749 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1591169232-project Jul 25 14:25:50.231749 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:25:50.231749 n-d-846435-14 devstack@n-api.service[119303]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 25 14:25:50.231749 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '1'} Jul 25 14:25:50.232662 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:25:50.232662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:50.232662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:50.232662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:50.232662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:25:50.232662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:25:50.232662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:25:50.232662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:25:50.232662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:25:50.232662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:25:50.232662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jul 25 14:25:50.232662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jul 25 14:25:50.232662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 14:25:50.232662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 14:25:50.232662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 14:25:50.232662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 14:25:50.232662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:25:50.232662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:25:50.232662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:25:50.233948 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:25:50.233948 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 14:25:50.233948 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 14:25:50.233948 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 14:25:50.233948 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 14:25:50.233948 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 14:25:50.233948 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 14:25:50.233948 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 25 14:25:50.233948 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:50.233948 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:50.233948 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:50.233948 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:50.233948 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:50.233948 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:50.233948 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 14:25:50.233948 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 14:25:50.233948 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 25 14:25:50.233948 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:50.238274 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ab99be14-8402-4660-b265-bc5be9e9b13a tempest-HypervisorAdminNegativeUnderV252Test-1591169232 tempest-HypervisorAdminNegativeUnderV252Test-1591169232-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:25:50.240744 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ab99be14-8402-4660-b265-bc5be9e9b13a tempest-HypervisorAdminNegativeUnderV252Test-1591169232 tempest-HypervisorAdminNegativeUnderV252Test-1591169232-project] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.038962 Jul 25 14:25:50.247195 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 54/117] 10.222.0.88 () {58 vars in 1176 bytes} [Mon Jul 25 14:25:50 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:25:50.255331 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bf5e1bb7-2bea-42b3-8991-7d45394b63cc tempest-FlavorsExtraSpecsTestJSON-1790899012 tempest-FlavorsExtraSpecsTestJSON-1790899012-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:50.260803 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:50.260803 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:50.300569 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bf5e1bb7-2bea-42b3-8991-7d45394b63cc tempest-FlavorsExtraSpecsTestJSON-1790899012 tempest-FlavorsExtraSpecsTestJSON-1790899012-project-admin] 10.222.0.88 "PUT /compute/v2.1/flavors/191667745/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.051191 Jul 25 14:25:50.302021 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 55/118] 10.222.0.88 () {60 vars in 1262 bytes} [Mon Jul 25 14:25:50 2022] PUT /compute/v2.1/flavors/191667745/os-extra_specs/hw:numa_nodes => generated 22 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:25:50.313524 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6a1c610a-f9a4-4d93-aee9-b1c470d5492d tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:50.314331 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6a1c610a-f9a4-4d93-aee9-b1c470d5492d tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 0a711946-8ed7-4475-a873-944011be17d6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:25:50.322294 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6a1c610a-f9a4-4d93-aee9-b1c470d5492d tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:50.322788 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6a1c610a-f9a4-4d93-aee9-b1c470d5492d tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:50.324027 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6a1c610a-f9a4-4d93-aee9-b1c470d5492d tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:50.324753 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6a1c610a-f9a4-4d93-aee9-b1c470d5492d tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:50.717257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-eb9a3219-d0e0-4009-b206-c43278cdea6e tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2d52c9e2c48dd9e7502843844bf27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78221408d9ae4bdfb29ded35235d5287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:25:50.729425 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-eb9a3219-d0e0-4009-b206-c43278cdea6e tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] 10.222.0.88 "GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f" status: 200 len: 1337 microversion: 2.1 time: 0.737184 Jul 25 14:25:50.730261 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 64/119] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:25:49 2022] GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f => generated 1337 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:50.734816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4304fab4-b4c6-427a-9f14-2e7647be90dd tempest-ServersWithSpecificFlavorTestJSON-269819481 tempest-ServersWithSpecificFlavorTestJSON-269819481-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-418807747", "id": 1368011728, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:50.744387 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:50.744387 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:50.780654 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4304fab4-b4c6-427a-9f14-2e7647be90dd tempest-ServersWithSpecificFlavorTestJSON-269819481 tempest-ServersWithSpecificFlavorTestJSON-269819481-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.049075 Jul 25 14:25:50.785223 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 65/120] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:25:50 2022] POST /compute/v2.1/flavors => generated 424 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:50.798613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-841c25be-30d1-48fc-aff4-1411c08a8ef8 tempest-HypervisorAdminNegativeUnderV252Test-345821337 tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin] Calling method '.version_select at 0x7f46942d3c10>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:50.799414 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:50.799414 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:50.815519 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-841c25be-30d1-48fc-aff4-1411c08a8ef8 tempest-HypervisorAdminNegativeUnderV252Test-345821337 tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:50.815519 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-841c25be-30d1-48fc-aff4-1411c08a8ef8 tempest-HypervisorAdminNegativeUnderV252Test-345821337 tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:50.832674 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-841c25be-30d1-48fc-aff4-1411c08a8ef8 tempest-HypervisorAdminNegativeUnderV252Test-345821337 tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin] HTTP exception thrown: No hypervisor matching 'ef39f617-dd5a-4904-82ca-cdeca97100a6' could be found. Jul 25 14:25:50.834184 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-841c25be-30d1-48fc-aff4-1411c08a8ef8 tempest-HypervisorAdminNegativeUnderV252Test-345821337 tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin] Request method failure captured: Jul 25 14:25:50.834184 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/os-hypervisors/ef39f617-dd5a-4904-82ca-cdeca97100a6/servers HTTP/1.1 Jul 25 14:25:50.834184 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:25:50.834184 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:25:50.834184 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:25:50.834184 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:25:50.834184 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:25:50.834184 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:25:50.834184 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:25:50.834184 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:25:50.834184 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfqMEd8f3RRwPyZJ5FTyVW-DBlNoqCCk0CwxyPxMrrD-qOTi7AwwoLUKEoK410DICdciHgmIh5N2z1J3tczxsdTIQkPLXRnLLONGxnJWKsqL0zGxW1ewKSSdS7kc7DAEfptSRU-ZVKaIDgmdYC4XUIDS62GSm3E9s9Rz39vCYsugSs Jul 25 14:25:50.834184 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:25:50.834184 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:25:50.834184 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:25:50.834184 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:25:50.834184 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:25:50.834184 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:25:50.834184 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: ee77f7ba414a42fe8510938f46a573cb Jul 25 14:25:50.834184 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-345821337 Jul 25 14:25:50.834184 n-d-846435-14 devstack@n-api.service[119304]: X-Role: admin,reader,member Jul 25 14:25:50.834184 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: admin,reader,member Jul 25 14:25:50.835268 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ee77f7ba414a42fe8510938f46a573cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ee77f7ba414a42fe8510938f46a573cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ee77f7ba414a42fe8510938f46a573cb", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ee77f7ba414a42fe8510938f46a573cb"}]}] Jul 25 14:25:50.835268 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-345821337 Jul 25 14:25:50.835268 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: ee77f7ba414a42fe8510938f46a573cb Jul 25 14:25:50.835268 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-345821337 Jul 25 14:25:50.835268 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin Jul 25 14:25:50.835268 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:25:50.835268 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:25:50.835268 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 787bd005a9934a65a5772ce428b23308 Jul 25 14:25:50.835268 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin Jul 25 14:25:50.835268 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:25:50.835268 n-d-846435-14 devstack@n-api.service[119304]: exception: No hypervisor matching 'ef39f617-dd5a-4904-82ca-cdeca97100a6' could be found. Jul 25 14:25:50.835268 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'ef39f617-dd5a-4904-82ca-cdeca97100a6'} Jul 25 14:25:50.836356 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:25:50.836356 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:50.836356 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:50.836356 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:50.836356 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:25:50.836356 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:25:50.836356 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:25:50.836356 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:25:50.836356 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:25:50.836356 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:25:50.836356 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jul 25 14:25:50.836356 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 25 14:25:50.836356 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 25 14:25:50.836356 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 14:25:50.836356 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'ef39f617-dd5a-4904-82ca-cdeca97100a6' could be found. Jul 25 14:25:50.836356 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:50.836356 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:50.836356 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:50.836356 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:50.837604 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:50.837604 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:50.837604 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:25:50.837604 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:25:50.837604 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'ef39f617-dd5a-4904-82ca-cdeca97100a6' could be found. Jul 25 14:25:50.837604 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:50.837977 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6a1c610a-f9a4-4d93-aee9-b1c470d5492d tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:25:50.847005 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-841c25be-30d1-48fc-aff4-1411c08a8ef8 tempest-HypervisorAdminNegativeUnderV252Test-345821337 tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin] Returning 404 to user: No hypervisor matching 'ef39f617-dd5a-4904-82ca-cdeca97100a6' could be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:25:50.853907 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-841c25be-30d1-48fc-aff4-1411c08a8ef8 tempest-HypervisorAdminNegativeUnderV252Test-345821337 tempest-HypervisorAdminNegativeUnderV252Test-345821337-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/ef39f617-dd5a-4904-82ca-cdeca97100a6/servers" status: 404 len: 123 microversion: 2.1 time: 0.066463 Jul 25 14:25:50.856072 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 66/121] 10.222.0.88 () {58 vars in 1281 bytes} [Mon Jul 25 14:25:50 2022] GET /compute/v2.1/os-hypervisors/ef39f617-dd5a-4904-82ca-cdeca97100a6/servers => generated 123 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:25:50.864463 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5d9938ce-85c7-48d6-b223-fb0a3ab67ae7 tempest-FlavorsExtraSpecsTestJSON-1790899012 tempest-FlavorsExtraSpecsTestJSON-1790899012-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:50.901478 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5d9938ce-85c7-48d6-b223-fb0a3ab67ae7 tempest-FlavorsExtraSpecsTestJSON-1790899012 tempest-FlavorsExtraSpecsTestJSON-1790899012-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/191667745/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.043960 Jul 25 14:25:50.909106 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 67/122] 10.222.0.88 () {58 vars in 1200 bytes} [Mon Jul 25 14:25:50 2022] GET /compute/v2.1/flavors/191667745/os-extra_specs => generated 66 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:25:50.914438 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-93a86ebe-c938-4d05-92fb-e8d7c73a5df3 tempest-ServersWithSpecificFlavorTestJSON-269819481 tempest-ServersWithSpecificFlavorTestJSON-269819481-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:50.915744 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6a1c610a-f9a4-4d93-aee9-b1c470d5492d tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6" status: 200 len: 1277 microversion: 2.1 time: 0.608835 Jul 25 14:25:50.923048 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 56/123] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:25:50 2022] GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6 => generated 1277 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:50.935023 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-93a86ebe-c938-4d05-92fb-e8d7c73a5df3 tempest-ServersWithSpecificFlavorTestJSON-269819481 tempest-ServersWithSpecificFlavorTestJSON-269819481-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.024535 Jul 25 14:25:50.939378 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 68/124] 10.222.0.88 () {58 vars in 1182 bytes} [Mon Jul 25 14:25:50 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:25:50.953634 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d88c6b04-8a75-4a09-8185-d27d7b59ee27 tempest-FlavorsExtraSpecsTestJSON-1790899012 tempest-FlavorsExtraSpecsTestJSON-1790899012-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:50.961137 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:50.961137 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:50.961942 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-90a34f58-ed81-4edd-8a11-dc5f08fe973a tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Action: 'create', calling method: .version_select at 0x7f46942d3e50>, body: {"keypair": {"name": "tempest-keypair-999429076", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIK71naTv/mS9b7f1h+FAj7RcGKP4VKGM8qN7U63DKtTzNZ5nSM23qzeQ/RCPrI2uWzQQz8PSBoW0cuKLwyc4lg6RCcEaL5+WfAhbOXr5gRV/KgUqvoo6rjYGeOtK2bPmg=="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:51.043484 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-90a34f58-ed81-4edd-8a11-dc5f08fe973a tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Getting quotas for project 508d55290b2744998f48e37d5af6dd04. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:25:51.058477 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-90a34f58-ed81-4edd-8a11-dc5f08fe973a tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Getting quotas for user aec61e9c63c043f49c26eb8220cb67bb and project 508d55290b2744998f48e37d5af6dd04. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:25:51.087278 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d88c6b04-8a75-4a09-8185-d27d7b59ee27 tempest-FlavorsExtraSpecsTestJSON-1790899012 tempest-FlavorsExtraSpecsTestJSON-1790899012-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/191667745/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.159534 Jul 25 14:25:51.094365 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 57/125] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Jul 25 14:25:50 2022] DELETE /compute/v2.1/flavors/191667745/os-extra_specs/hw:numa_nodes => generated 0 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 14:25:51.118144 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e53765e0-697a-451c-907e-15c81bbbddf3 tempest-FlavorsExtraSpecsTestJSON-1790899012 tempest-FlavorsExtraSpecsTestJSON-1790899012-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:51.132755 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-90a34f58-ed81-4edd-8a11-dc5f08fe973a tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.179966 Jul 25 14:25:51.141105 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 69/126] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:25:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:51.195821 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e53765e0-697a-451c-907e-15c81bbbddf3 tempest-FlavorsExtraSpecsTestJSON-1790899012 tempest-FlavorsExtraSpecsTestJSON-1790899012-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/191667745/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.090701 Jul 25 14:25:51.203888 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 58/127] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Jul 25 14:25:51 2022] DELETE /compute/v2.1/flavors/191667745/os-extra_specs/hw:cpu_policy => generated 0 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 14:25:51.206811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f241c2ba-d6a1-49db-b7e7-5e1fdcd4c5dd tempest-FlavorsExtraSpecsTestJSON-1790899012 tempest-FlavorsExtraSpecsTestJSON-1790899012-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:51.232218 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f241c2ba-d6a1-49db-b7e7-5e1fdcd4c5dd tempest-FlavorsExtraSpecsTestJSON-1790899012 tempest-FlavorsExtraSpecsTestJSON-1790899012-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/191667745/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.028692 Jul 25 14:25:51.235555 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 70/128] 10.222.0.88 () {58 vars in 1200 bytes} [Mon Jul 25 14:25:51 2022] GET /compute/v2.1/flavors/191667745/os-extra_specs => generated 19 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:25:51.253212 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d1ebc9bb-7677-404d-b6d9-b83268dcfa70 tempest-FlavorsExtraSpecsTestJSON-1790899012 tempest-FlavorsExtraSpecsTestJSON-1790899012-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:51.260268 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:51.260268 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:51.307303 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d1ebc9bb-7677-404d-b6d9-b83268dcfa70 tempest-FlavorsExtraSpecsTestJSON-1790899012 tempest-FlavorsExtraSpecsTestJSON-1790899012-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/191667745" status: 202 len: 0 microversion: 2.1 time: 0.063841 Jul 25 14:25:51.311289 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 71/129] 10.222.0.88 () {58 vars in 1158 bytes} [Mon Jul 25 14:25:51 2022] DELETE /compute/v2.1/flavors/191667745 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:25:51.325368 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dcb1210a-a9e9-4ca2-8b05-6a95c1cf1de0 tempest-FlavorsExtraSpecsTestJSON-1790899012 tempest-FlavorsExtraSpecsTestJSON-1790899012-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:51.403487 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dcb1210a-a9e9-4ca2-8b05-6a95c1cf1de0 tempest-FlavorsExtraSpecsTestJSON-1790899012 tempest-FlavorsExtraSpecsTestJSON-1790899012-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.083562 Jul 25 14:25:51.407062 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 72/130] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:25:51 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:51.729724 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d2776a74-f407-435c-a062-f23d9c042f6e tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1727369174", "id": 2095787394, "os-flavor-access:is_public": "False"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:51.733228 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:51.733228 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:51.764223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7e55782d-e8d2-45ef-9e6f-4c33a1f0af4d tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:51.765773 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7e55782d-e8d2-45ef-9e6f-4c33a1f0af4d tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:25:51.775247 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7e55782d-e8d2-45ef-9e6f-4c33a1f0af4d tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:51.775485 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d2776a74-f407-435c-a062-f23d9c042f6e tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.564922 Jul 25 14:25:51.776029 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 59/131] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:25:51 2022] POST /compute/v2.1/flavors => generated 439 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:25:51.777434 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7e55782d-e8d2-45ef-9e6f-4c33a1f0af4d tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:51.780039 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7e55782d-e8d2-45ef-9e6f-4c33a1f0af4d tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:51.780653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7e55782d-e8d2-45ef-9e6f-4c33a1f0af4d tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:51.796568 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-73f93b1f-f74d-47fa-bae8-58e9f887fdb5 tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5e9d697a4bc44f6fa37d1173c35b8eed"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:51.811273 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:51.811273 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:52.202180 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7e55782d-e8d2-45ef-9e6f-4c33a1f0af4d tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2d52c9e2c48dd9e7502843844bf27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78221408d9ae4bdfb29ded35235d5287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:25:52.211161 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7e55782d-e8d2-45ef-9e6f-4c33a1f0af4d tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] 10.222.0.88 "GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f" status: 200 len: 1337 microversion: 2.1 time: 0.461844 Jul 25 14:25:52.215690 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 73/132] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:25:51 2022] GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f => generated 1337 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:52.224479 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d8e784b3-94ac-4865-bc31-fb20cde7d383 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:52.225263 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d8e784b3-94ac-4865-bc31-fb20cde7d383 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 0a711946-8ed7-4475-a873-944011be17d6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:25:52.240911 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d8e784b3-94ac-4865-bc31-fb20cde7d383 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:52.242799 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d8e784b3-94ac-4865-bc31-fb20cde7d383 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:52.243902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d8e784b3-94ac-4865-bc31-fb20cde7d383 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:52.245866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d8e784b3-94ac-4865-bc31-fb20cde7d383 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:52.497884 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-73f93b1f-f74d-47fa-bae8-58e9f887fdb5 tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors/2095787394/action" status: 200 len: 97 microversion: 2.1 time: 0.712452 Jul 25 14:25:52.509320 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 60/133] 10.222.0.88 () {60 vars in 1200 bytes} [Mon Jul 25 14:25:51 2022] POST /compute/v2.1/flavors/2095787394/action => generated 97 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:25:52.532717 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8c8b8167-6178-4488-be4a-443da0392874 tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5e9d697a4bc44f6fa37d1173c35b8eed"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:52.715648 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-8c8b8167-6178-4488-be4a-443da0392874 tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] HTTP exception thrown: Flavor access already exists for flavor 31 and project 5e9d697a4bc44f6fa37d1173c35b8eed combination. Jul 25 14:25:52.766684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8c8b8167-6178-4488-be4a-443da0392874 tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] Request method failure captured: Jul 25 14:25:52.766684 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/flavors/2095787394/action HTTP/1.1 Jul 25 14:25:52.766684 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:25:52.766684 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:25:52.766684 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:25:52.766684 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 67 Jul 25 14:25:52.766684 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:25:52.766684 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:25:52.766684 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:25:52.766684 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:25:52.766684 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qftDf30_PrDMbxXWp0T6qLhEONen734MGwOeyAIe9ZlgekVMn1KWu0exlxwHpRPvbh-8urpnM0qDMLz2AeXDWEHjWibnRULqu93HupWYPsUFiI4W5-5gLYihzdkogLLgjGKKrQsQr5UOAPCr3TR-jFAKPdK2EhfxHdcizF-9V7Dqr8 Jul 25 14:25:52.766684 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:25:52.766684 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:25:52.766684 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:25:52.766684 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:25:52.766684 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:25:52.766684 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:25:52.766684 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 0ec5325decaf40558a78fc054d1b60cd Jul 25 14:25:52.766684 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1921339813 Jul 25 14:25:52.766684 n-d-846435-14 devstack@n-api.service[119303]: X-Role: admin,reader,member Jul 25 14:25:52.766684 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: admin,reader,member Jul 25 14:25:52.768085 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0ec5325decaf40558a78fc054d1b60cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0ec5325decaf40558a78fc054d1b60cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0ec5325decaf40558a78fc054d1b60cd", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0ec5325decaf40558a78fc054d1b60cd"}]}] Jul 25 14:25:52.768085 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1921339813 Jul 25 14:25:52.768085 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 0ec5325decaf40558a78fc054d1b60cd Jul 25 14:25:52.768085 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1921339813 Jul 25 14:25:52.768085 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin Jul 25 14:25:52.768085 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:25:52.768085 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:25:52.768085 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 2fcca4e8acc24242a292aab4fcbeb8c7 Jul 25 14:25:52.768085 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin Jul 25 14:25:52.768085 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:25:52.768085 n-d-846435-14 devstack@n-api.service[119303]: {"addTenantAccess": {"tenant": "5e9d697a4bc44f6fa37d1173c35b8eed"}} Jul 25 14:25:52.768085 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:25:52.769004 n-d-846435-14 devstack@n-api.service[119303]: exception: Flavor access already exists for flavor 31 and project 5e9d697a4bc44f6fa37d1173c35b8eed combination. Jul 25 14:25:52.769004 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '2095787394', 'body': {'addTenantAccess': {'tenant': '5e9d697a4bc44f6fa37d1173c35b8eed'}}} Jul 25 14:25:52.769004 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:25:52.769004 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:52.769004 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 14:25:52.769004 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 25 14:25:52.769004 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 14:25:52.769004 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 25 14:25:52.769004 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 14:25:52.769004 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 25 14:25:52.769004 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 14:25:52.769004 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 25 14:25:52.769004 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 14:25:52.769004 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 14:25:52.769004 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 14:25:52.769004 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result.read() Jul 25 14:25:52.769004 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 14:25:52.769004 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 25 14:25:52.770224 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 14:25:52.770224 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 25 14:25:52.770224 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 14:25:52.770224 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 25 14:25:52.770224 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 14:25:52.770224 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 25 14:25:52.770224 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '31-5e9d697a4bc44f6fa37d1173c35b8eed' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 25 14:25:52.770224 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:52.770224 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 25 14:25:52.770224 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:52.770224 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:52.770224 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jul 25 14:25:52.770224 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi project.save(context.session) Jul 25 14:25:52.770224 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 25 14:25:52.770224 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi session.flush() Jul 25 14:25:52.770224 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 14:25:52.770224 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 25 14:25:52.770224 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 14:25:52.770224 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 25 14:25:52.771496 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 14:25:52.771496 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 25 14:25:52.771496 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 14:25:52.771496 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception Jul 25 14:25:52.771496 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 14:25:52.771496 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 25 14:25:52.771496 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 14:25:52.771496 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 25 14:25:52.771496 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 14:25:52.771496 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 25 14:25:52.771496 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 14:25:52.771496 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 25 14:25:52.771496 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 14:25:52.771496 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 25 14:25:52.771496 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 14:25:52.771496 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 14:25:52.771496 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 14:25:52.771496 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 25 14:25:52.772663 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 14:25:52.772663 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 25 14:25:52.772663 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 14:25:52.772663 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 25 14:25:52.772663 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 14:25:52.772663 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 14:25:52.772663 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 14:25:52.772663 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception Jul 25 14:25:52.772663 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 14:25:52.772663 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 25 14:25:52.772663 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 14:25:52.772663 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 25 14:25:52.772663 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 14:25:52.772663 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 25 14:25:52.772663 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 14:25:52.772663 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 25 14:25:52.772663 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 14:25:52.772663 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 14:25:52.773742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 14:25:52.773742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result.read() Jul 25 14:25:52.773742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 14:25:52.773742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 25 14:25:52.773742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 14:25:52.773742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 25 14:25:52.773742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 14:25:52.773742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 25 14:25:52.773742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 14:25:52.773742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 25 14:25:52.773742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '31-5e9d697a4bc44f6fa37d1173c35b8eed' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 25 14:25:52.773742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jul 25 14:25:52.773742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 25, 14, 25, 52, 708520), 'updated_at': None, 'flavor_id': 31, 'project_id': '5e9d697a4bc44f6fa37d1173c35b8eed'}] Jul 25 14:25:52.773742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 14:25:52.773742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:52.773742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:52.773742 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:52.774943 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:52.774943 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jul 25 14:25:52.774943 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jul 25 14:25:52.774943 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 25 14:25:52.774943 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 25 14:25:52.774943 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jul 25 14:25:52.774943 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jul 25 14:25:52.774943 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jul 25 14:25:52.774943 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jul 25 14:25:52.774943 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jul 25 14:25:52.774943 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jul 25 14:25:52.774943 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 14:25:52.774943 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 14:25:52.774943 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jul 25 14:25:52.774943 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jul 25 14:25:52.774943 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 31 and project 5e9d697a4bc44f6fa37d1173c35b8eed combination. Jul 25 14:25:52.774943 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:52.774943 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:52.774943 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:52.776565 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:52.776565 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:52.776565 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:52.776565 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:25:52.776565 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:25:52.776565 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:25:52.776565 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:25:52.776565 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:25:52.776565 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:25:52.776565 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jul 25 14:25:52.776565 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jul 25 14:25:52.776565 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 31 and project 5e9d697a4bc44f6fa37d1173c35b8eed combination. Jul 25 14:25:52.776565 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:52.776565 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:52.776565 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:52.776565 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:52.776565 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:52.776565 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:52.776565 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:25:52.776565 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:25:52.777864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 31 and project 5e9d697a4bc44f6fa37d1173c35b8eed combination. Jul 25 14:25:52.777864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:52.779205 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8c8b8167-6178-4488-be4a-443da0392874 tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] Returning 409 to user: Flavor access already exists for flavor 31 and project 5e9d697a4bc44f6fa37d1173c35b8eed combination. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:25:52.780685 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8c8b8167-6178-4488-be4a-443da0392874 tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors/2095787394/action" status: 409 len: 152 microversion: 2.1 time: 0.270092 Jul 25 14:25:52.786377 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 61/134] 10.222.0.88 () {60 vars in 1200 bytes} [Mon Jul 25 14:25:52 2022] POST /compute/v2.1/flavors/2095787394/action => generated 152 bytes in 276 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:25:52.792283 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-933dc62e-50dc-46ea-8634-691189d70680 tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "5e9d697a4bc44f6fa37d1173c35b8eed"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:52.795422 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:52.795422 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:52.922995 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d8e784b3-94ac-4865-bc31-fb20cde7d383 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:25:52.945201 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d8e784b3-94ac-4865-bc31-fb20cde7d383 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6" status: 200 len: 1277 microversion: 2.1 time: 0.724977 Jul 25 14:25:52.961088 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-933dc62e-50dc-46ea-8634-691189d70680 tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors/2095787394/action" status: 200 len: 21 microversion: 2.1 time: 0.172528 Jul 25 14:25:52.962819 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 62/135] 10.222.0.88 () {60 vars in 1200 bytes} [Mon Jul 25 14:25:52 2022] POST /compute/v2.1/flavors/2095787394/action => generated 21 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:25:52.975341 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 74/136] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:25:52 2022] GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6 => generated 1277 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:52.982458 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c0c1242a-29d1-444f-9f66-b050a5b33686 tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:52.983356 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:52.983356 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:53.055031 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c0c1242a-29d1-444f-9f66-b050a5b33686 tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/2095787394" status: 202 len: 0 microversion: 2.1 time: 0.083793 Jul 25 14:25:53.058164 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 63/137] 10.222.0.88 () {58 vars in 1161 bytes} [Mon Jul 25 14:25:52 2022] DELETE /compute/v2.1/flavors/2095787394 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:25:53.066017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-581b52f3-e47e-49e0-a2e0-12300fc989f8 tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:53.112680 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-581b52f3-e47e-49e0-a2e0-12300fc989f8 tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.049264 Jul 25 14:25:53.116666 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 75/138] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:25:53 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:53.137019 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2c4565ed-1ba8-4def-8ff6-676c23b9355f tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1047620350", "id": 1469516501, "os-flavor-access:is_public": "True"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:53.185958 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2c4565ed-1ba8-4def-8ff6-676c23b9355f tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.053608 Jul 25 14:25:53.187927 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 64/139] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:25:53 2022] POST /compute/v2.1/flavors => generated 438 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:53.208273 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-976a6c56-383d-424e-bced-83af85eda0fc tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:53.209300 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:53.209300 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:53.233356 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-976a6c56-383d-424e-bced-83af85eda0fc tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] HTTP exception thrown: Access list not available for public flavors. Jul 25 14:25:53.243012 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-71e090ec-0bce-44d8-b678-6b175ff45505 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:53.244022 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-71e090ec-0bce-44d8-b678-6b175ff45505 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:25:53.254436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-976a6c56-383d-424e-bced-83af85eda0fc tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] Request method failure captured: Jul 25 14:25:53.254436 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/flavors/1469516501/os-flavor-access HTTP/1.1 Jul 25 14:25:53.254436 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:25:53.254436 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:25:53.254436 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:25:53.254436 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:25:53.254436 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:25:53.254436 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:25:53.254436 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:25:53.254436 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:25:53.254436 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qftDf30_PrDMbxXWp0T6qLhEONen734MGwOeyAIe9ZlgekVMn1KWu0exlxwHpRPvbh-8urpnM0qDMLz2AeXDWEHjWibnRULqu93HupWYPsUFiI4W5-5gLYihzdkogLLgjGKKrQsQr5UOAPCr3TR-jFAKPdK2EhfxHdcizF-9V7Dqr8 Jul 25 14:25:53.254436 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:25:53.254436 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:25:53.254436 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:25:53.254436 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:25:53.254436 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:25:53.254436 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:25:53.254436 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 0ec5325decaf40558a78fc054d1b60cd Jul 25 14:25:53.254436 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1921339813 Jul 25 14:25:53.254436 n-d-846435-14 devstack@n-api.service[119304]: X-Role: admin,reader,member Jul 25 14:25:53.254436 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: admin,reader,member Jul 25 14:25:53.255688 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0ec5325decaf40558a78fc054d1b60cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0ec5325decaf40558a78fc054d1b60cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0ec5325decaf40558a78fc054d1b60cd", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0ec5325decaf40558a78fc054d1b60cd"}]}] Jul 25 14:25:53.255688 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1921339813 Jul 25 14:25:53.255688 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 0ec5325decaf40558a78fc054d1b60cd Jul 25 14:25:53.255688 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1921339813 Jul 25 14:25:53.255688 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin Jul 25 14:25:53.255688 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:25:53.255688 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:25:53.255688 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 2fcca4e8acc24242a292aab4fcbeb8c7 Jul 25 14:25:53.255688 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin Jul 25 14:25:53.255688 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:25:53.255688 n-d-846435-14 devstack@n-api.service[119304]: exception: Access list not available for public flavors. Jul 25 14:25:53.255688 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'flavor_id': '1469516501'} Jul 25 14:25:53.256398 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:25:53.256398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:53.256398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:53.256398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:53.256398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:25:53.256398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:25:53.256398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:25:53.256398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:25:53.256398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jul 25 14:25:53.256398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 14:25:53.256398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jul 25 14:25:53.256398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:53.256398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:53.256398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:53.256398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:53.256398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:53.256398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:53.256398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:25:53.256398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:25:53.256398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jul 25 14:25:53.256398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:53.261730 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-976a6c56-383d-424e-bced-83af85eda0fc tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:25:53.265615 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-71e090ec-0bce-44d8-b678-6b175ff45505 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:53.266431 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-976a6c56-383d-424e-bced-83af85eda0fc tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/1469516501/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.070198 Jul 25 14:25:53.270482 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 76/140] 10.222.0.88 () {58 vars in 1209 bytes} [Mon Jul 25 14:25:53 2022] GET /compute/v2.1/flavors/1469516501/os-flavor-access => generated 91 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:25:53.271631 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-71e090ec-0bce-44d8-b678-6b175ff45505 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:53.278976 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-71e090ec-0bce-44d8-b678-6b175ff45505 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:53.279444 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-71e090ec-0bce-44d8-b678-6b175ff45505 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:53.282124 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e396d8ab-b2f5-4a21-83a2-ecece62a1df1 tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:53.283239 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:53.283239 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:53.344975 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e396d8ab-b2f5-4a21-83a2-ecece62a1df1 tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/1469516501" status: 202 len: 0 microversion: 2.1 time: 0.067029 Jul 25 14:25:53.345909 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 77/141] 10.222.0.88 () {58 vars in 1161 bytes} [Mon Jul 25 14:25:53 2022] DELETE /compute/v2.1/flavors/1469516501 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:25:53.360869 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d1ffd47c-0e14-436d-9de3-fcaec943682e tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:53.436406 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d1ffd47c-0e14-436d-9de3-fcaec943682e tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.075949 Jul 25 14:25:53.457854 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 78/142] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:25:53 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:53.470860 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-36223b64-afd7-49e1-9fd5-9237e8dde7c2 tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-327154297", "id": 795614916, "os-flavor-access:is_public": "False"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:53.475693 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:53.475693 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:53.508343 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-36223b64-afd7-49e1-9fd5-9237e8dde7c2 tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.041969 Jul 25 14:25:53.511104 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 79/143] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:25:53 2022] POST /compute/v2.1/flavors => generated 435 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:25:53.812039 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4ccfc60e-3514-45f8-9975-1004a2b2d2df tempest-FlavorsAccessNegativeTestJSON-584648480 tempest-FlavorsAccessNegativeTestJSON-584648480-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5e9d697a4bc44f6fa37d1173c35b8eed"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:53.815167 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:53.815167 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:53.816185 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4ccfc60e-3514-45f8-9975-1004a2b2d2df tempest-FlavorsAccessNegativeTestJSON-584648480 tempest-FlavorsAccessNegativeTestJSON-584648480-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '8911a8040bb34a4896767b6a965c5969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d697a4bc44f6fa37d1173c35b8eed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:25:53.817870 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4ccfc60e-3514-45f8-9975-1004a2b2d2df tempest-FlavorsAccessNegativeTestJSON-584648480 tempest-FlavorsAccessNegativeTestJSON-584648480-project] Request method failure captured: Jul 25 14:25:53.817870 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/flavors/795614916/action HTTP/1.1 Jul 25 14:25:53.817870 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:25:53.817870 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:25:53.817870 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:25:53.817870 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 67 Jul 25 14:25:53.817870 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:25:53.817870 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:25:53.817870 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:25:53.817870 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:25:53.817870 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfrwfQGR94XItAJ5M02zCPjw4TR0FJLTsXjfL0gKCS4gTK4e3RajGaylXD03yLgOrMqcRvDmYRpnu3liPAYrLKtq448LBqhRz8KmOKMBDw4LDaLM2PxE71wvhdtX0LQu5boT1lIBeOxvcT7N8Y8GJSOFfn6xVmzDIrKj4Xrw2cwapI Jul 25 14:25:53.817870 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:25:53.817870 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:25:53.817870 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:25:53.817870 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:25:53.817870 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:25:53.817870 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:25:53.817870 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 5e9d697a4bc44f6fa37d1173c35b8eed Jul 25 14:25:53.817870 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-584648480 Jul 25 14:25:53.817870 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:25:53.817870 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:25:53.819132 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5e9d697a4bc44f6fa37d1173c35b8eed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5e9d697a4bc44f6fa37d1173c35b8eed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_5e9d697a4bc44f6fa37d1173c35b8eed", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/5e9d697a4bc44f6fa37d1173c35b8eed"}]}] Jul 25 14:25:53.819132 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-584648480 Jul 25 14:25:53.819132 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 5e9d697a4bc44f6fa37d1173c35b8eed Jul 25 14:25:53.819132 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-584648480 Jul 25 14:25:53.819132 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-FlavorsAccessNegativeTestJSON-584648480-project Jul 25 14:25:53.819132 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:25:53.819132 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:25:53.819132 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 8911a8040bb34a4896767b6a965c5969 Jul 25 14:25:53.819132 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-584648480-project Jul 25 14:25:53.819132 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:25:53.819132 n-d-846435-14 devstack@n-api.service[119304]: {"addTenantAccess": {"tenant": "5e9d697a4bc44f6fa37d1173c35b8eed"}} Jul 25 14:25:53.819132 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:25:53.820830 n-d-846435-14 devstack@n-api.service[119304]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 25 14:25:53.820830 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '795614916', 'body': {'addTenantAccess': {'tenant': '5e9d697a4bc44f6fa37d1173c35b8eed'}}} Jul 25 14:25:53.820830 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:25:53.820830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:53.820830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:53.820830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:53.820830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:25:53.820830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:25:53.820830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:25:53.820830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:25:53.820830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:25:53.820830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:25:53.820830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jul 25 14:25:53.820830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jul 25 14:25:53.820830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 14:25:53.820830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 14:25:53.820830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 14:25:53.820830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 14:25:53.820830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:25:53.822355 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:25:53.822355 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:25:53.822355 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:25:53.822355 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 14:25:53.822355 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 14:25:53.822355 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 14:25:53.822355 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 14:25:53.822355 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 14:25:53.822355 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 14:25:53.822355 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 25 14:25:53.822355 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:53.822355 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:53.822355 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:53.822355 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:53.822355 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:53.822355 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:53.822355 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 14:25:53.822355 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 14:25:53.822355 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 25 14:25:53.822355 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:25:53.825281 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4ccfc60e-3514-45f8-9975-1004a2b2d2df tempest-FlavorsAccessNegativeTestJSON-584648480 tempest-FlavorsAccessNegativeTestJSON-584648480-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:25:53.825281 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4ccfc60e-3514-45f8-9975-1004a2b2d2df tempest-FlavorsAccessNegativeTestJSON-584648480 tempest-FlavorsAccessNegativeTestJSON-584648480-project] 10.222.0.88 "POST /compute/v2.1/flavors/795614916/action" status: 403 len: 130 microversion: 2.1 time: 0.298057 Jul 25 14:25:53.825281 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 80/144] 10.222.0.88 () {60 vars in 1197 bytes} [Mon Jul 25 14:25:53 2022] POST /compute/v2.1/flavors/795614916/action => generated 130 bytes in 299 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:25:53.838788 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-906018bf-6334-47e4-993d-1fe038192ebc tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:53.870425 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=8 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:25:53.881083 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-906018bf-6334-47e4-993d-1fe038192ebc tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/795614916" status: 202 len: 0 microversion: 2.1 time: 0.049050 Jul 25 14:25:53.895905 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 81/145] 10.222.0.88 () {58 vars in 1158 bytes} [Mon Jul 25 14:25:53 2022] DELETE /compute/v2.1/flavors/795614916 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:25:53.907856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a944b218-0e0d-4d64-82f8-dcccbfa50355 tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:53.944409 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a944b218-0e0d-4d64-82f8-dcccbfa50355 tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.043075 Jul 25 14:25:53.946548 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 82/146] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:25:53 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:25:53.979686 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ece14a62-8097-4954-9a25-95f258304928 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:53.981435 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ece14a62-8097-4954-9a25-95f258304928 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 0a711946-8ed7-4475-a873-944011be17d6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:25:54.002588 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ece14a62-8097-4954-9a25-95f258304928 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:54.006087 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ece14a62-8097-4954-9a25-95f258304928 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:54.020950 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ece14a62-8097-4954-9a25-95f258304928 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:54.024376 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ece14a62-8097-4954-9a25-95f258304928 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:54.026521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-71e090ec-0bce-44d8-b678-6b175ff45505 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2d52c9e2c48dd9e7502843844bf27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78221408d9ae4bdfb29ded35235d5287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:25:54.039821 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-71e090ec-0bce-44d8-b678-6b175ff45505 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] 10.222.0.88 "GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f" status: 200 len: 1337 microversion: 2.1 time: 0.800878 Jul 25 14:25:54.054267 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 65/147] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:25:53 2022] GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f => generated 1337 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:54.060594 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-27ec0c4d-61c3-452e-9cdd-43d47d244d76 tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-430004645", "id": 607548988, "os-flavor-access:is_public": "False"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:54.073567 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:54.073567 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:54.127235 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-27ec0c4d-61c3-452e-9cdd-43d47d244d76 tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.068967 Jul 25 14:25:54.129331 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 66/148] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:25:54 2022] POST /compute/v2.1/flavors => generated 435 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:54.142275 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-133076dc-98e2-469c-bcc8-7ef47ba63a7d tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5e9d697a4bc44f6fa37d1173c35b8eed"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:54.153025 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:54.153025 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:54.465961 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-133076dc-98e2-469c-bcc8-7ef47ba63a7d tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors/607548988/action" status: 200 len: 96 microversion: 2.1 time: 0.328129 Jul 25 14:25:54.471648 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 67/149] 10.222.0.88 () {60 vars in 1197 bytes} [Mon Jul 25 14:25:54 2022] POST /compute/v2.1/flavors/607548988/action => generated 96 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:25:54.494815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c0b065cd-b77d-4494-b397-40e8ee01e608 tempest-FlavorsAccessNegativeTestJSON-584648480 tempest-FlavorsAccessNegativeTestJSON-584648480-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "5e9d697a4bc44f6fa37d1173c35b8eed"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:54.515260 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:54.515260 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:54.520251 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c0b065cd-b77d-4494-b397-40e8ee01e608 tempest-FlavorsAccessNegativeTestJSON-584648480 tempest-FlavorsAccessNegativeTestJSON-584648480-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '8911a8040bb34a4896767b6a965c5969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d697a4bc44f6fa37d1173c35b8eed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:25:54.522471 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c0b065cd-b77d-4494-b397-40e8ee01e608 tempest-FlavorsAccessNegativeTestJSON-584648480 tempest-FlavorsAccessNegativeTestJSON-584648480-project] Request method failure captured: Jul 25 14:25:54.522471 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/flavors/607548988/action HTTP/1.1 Jul 25 14:25:54.522471 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:25:54.522471 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:25:54.522471 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:25:54.522471 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 70 Jul 25 14:25:54.522471 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:25:54.522471 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:25:54.522471 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:25:54.522471 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:25:54.522471 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qfrwfQGR94XItAJ5M02zCPjw4TR0FJLTsXjfL0gKCS4gTK4e3RajGaylXD03yLgOrMqcRvDmYRpnu3liPAYrLKtq448LBqhRz8KmOKMBDw4LDaLM2PxE71wvhdtX0LQu5boT1lIBeOxvcT7N8Y8GJSOFfn6xVmzDIrKj4Xrw2cwapI Jul 25 14:25:54.522471 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:25:54.522471 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:25:54.522471 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:25:54.522471 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:25:54.522471 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:25:54.522471 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:25:54.522471 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 5e9d697a4bc44f6fa37d1173c35b8eed Jul 25 14:25:54.522471 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-584648480 Jul 25 14:25:54.522471 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:25:54.522471 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:25:54.523628 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5e9d697a4bc44f6fa37d1173c35b8eed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5e9d697a4bc44f6fa37d1173c35b8eed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_5e9d697a4bc44f6fa37d1173c35b8eed", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/5e9d697a4bc44f6fa37d1173c35b8eed"}]}] Jul 25 14:25:54.523628 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-584648480 Jul 25 14:25:54.523628 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 5e9d697a4bc44f6fa37d1173c35b8eed Jul 25 14:25:54.523628 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-584648480 Jul 25 14:25:54.523628 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-FlavorsAccessNegativeTestJSON-584648480-project Jul 25 14:25:54.523628 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:25:54.523628 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:25:54.523628 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 8911a8040bb34a4896767b6a965c5969 Jul 25 14:25:54.523628 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-584648480-project Jul 25 14:25:54.523628 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:25:54.523628 n-d-846435-14 devstack@n-api.service[119303]: {"removeTenantAccess": {"tenant": "5e9d697a4bc44f6fa37d1173c35b8eed"}} Jul 25 14:25:54.523628 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:25:54.524269 n-d-846435-14 devstack@n-api.service[119303]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 25 14:25:54.524269 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '607548988', 'body': {'removeTenantAccess': {'tenant': '5e9d697a4bc44f6fa37d1173c35b8eed'}}} Jul 25 14:25:54.524269 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:25:54.524269 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:54.524269 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:54.524269 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:54.524269 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:25:54.524269 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:25:54.524269 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:25:54.524269 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:25:54.524269 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:25:54.524269 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:25:54.524269 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jul 25 14:25:54.524269 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi context.can( Jul 25 14:25:54.524269 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 14:25:54.524269 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 14:25:54.524269 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 14:25:54.524269 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 14:25:54.524269 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:25:54.524269 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:25:54.530053 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:25:54.530053 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:25:54.530053 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 14:25:54.530053 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 14:25:54.530053 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 14:25:54.530053 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 14:25:54.530053 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 14:25:54.530053 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 14:25:54.530053 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 25 14:25:54.530053 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:54.530053 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:54.530053 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:54.530053 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:54.530053 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:54.530053 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:54.530053 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 14:25:54.530053 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 14:25:54.530053 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 25 14:25:54.530053 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:54.531025 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c0b065cd-b77d-4494-b397-40e8ee01e608 tempest-FlavorsAccessNegativeTestJSON-584648480 tempest-FlavorsAccessNegativeTestJSON-584648480-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:25:54.531025 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c0b065cd-b77d-4494-b397-40e8ee01e608 tempest-FlavorsAccessNegativeTestJSON-584648480 tempest-FlavorsAccessNegativeTestJSON-584648480-project] 10.222.0.88 "POST /compute/v2.1/flavors/607548988/action" status: 403 len: 133 microversion: 2.1 time: 0.042483 Jul 25 14:25:54.531025 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 68/150] 10.222.0.88 () {60 vars in 1197 bytes} [Mon Jul 25 14:25:54 2022] POST /compute/v2.1/flavors/607548988/action => generated 133 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:25:54.571158 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bcc92827-c355-4bd3-be39-aef3fd135d6b tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "5e9d697a4bc44f6fa37d1173c35b8eed"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:54.658300 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ece14a62-8097-4954-9a25-95f258304928 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:25:54.666871 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ece14a62-8097-4954-9a25-95f258304928 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6" status: 200 len: 1319 microversion: 2.1 time: 0.698132 Jul 25 14:25:54.685019 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 83/151] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:25:53 2022] GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6 => generated 1319 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:54.731796 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bcc92827-c355-4bd3-be39-aef3fd135d6b tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors/607548988/action" status: 200 len: 21 microversion: 2.1 time: 0.188271 Jul 25 14:25:54.742922 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 69/152] 10.222.0.88 () {60 vars in 1197 bytes} [Mon Jul 25 14:25:54 2022] POST /compute/v2.1/flavors/607548988/action => generated 21 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:25:54.744836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-db8275c5-6dd3-413a-9f20-8076433c4746 tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:54.745583 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:54.745583 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:54.780452 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-db8275c5-6dd3-413a-9f20-8076433c4746 tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/607548988" status: 202 len: 0 microversion: 2.1 time: 0.039095 Jul 25 14:25:54.788679 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 84/153] 10.222.0.88 () {58 vars in 1158 bytes} [Mon Jul 25 14:25:54 2022] DELETE /compute/v2.1/flavors/607548988 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:25:54.798014 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7730c31e-144b-437a-8178-93808dda2143 tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:54.841606 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7730c31e-144b-437a-8178-93808dda2143 tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.048999 Jul 25 14:25:54.864637 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 70/154] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:25:54 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:54.867335 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d9ca716d-97c8-4079-9211-9106630bf35a tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1589262605", "id": 911549630, "os-flavor-access:is_public": "False"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:54.870266 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:54.870266 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:25:54.896647 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d9ca716d-97c8-4079-9211-9106630bf35a tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.034264 Jul 25 14:25:54.898647 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 85/155] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:25:54 2022] POST /compute/v2.1/flavors => generated 436 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:25:54.914142 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9b9d8156-fc05-4b00-8dc9-53e0ce6dec30 tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e6adf2b0700b4f548a9d87adcaa54937"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:55.070197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-754f93d5-a28b-4a3f-aece-b17add7da3cb tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:55.071637 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-754f93d5-a28b-4a3f-aece-b17add7da3cb tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:25:55.084204 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-754f93d5-a28b-4a3f-aece-b17add7da3cb tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:55.096851 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-754f93d5-a28b-4a3f-aece-b17add7da3cb tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:55.098029 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-754f93d5-a28b-4a3f-aece-b17add7da3cb tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:55.098673 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-754f93d5-a28b-4a3f-aece-b17add7da3cb tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:55.445546 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-754f93d5-a28b-4a3f-aece-b17add7da3cb tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2d52c9e2c48dd9e7502843844bf27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78221408d9ae4bdfb29ded35235d5287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:25:55.455520 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-754f93d5-a28b-4a3f-aece-b17add7da3cb tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] 10.222.0.88 "GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f" status: 200 len: 1337 microversion: 2.1 time: 0.390282 Jul 25 14:25:55.455713 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-9b9d8156-fc05-4b00-8dc9-53e0ce6dec30 tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] HTTP exception thrown: Flavor access not found for 35 / e6adf2b0700b4f548a9d87adcaa54937 combination. Jul 25 14:25:55.458454 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9b9d8156-fc05-4b00-8dc9-53e0ce6dec30 tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] Request method failure captured: Jul 25 14:25:55.458454 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/flavors/911549630/action HTTP/1.1 Jul 25 14:25:55.458454 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:25:55.458454 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:25:55.458454 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:25:55.458454 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 70 Jul 25 14:25:55.458454 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:25:55.458454 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:25:55.458454 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:25:55.458454 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:25:55.458454 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qftDf30_PrDMbxXWp0T6qLhEONen734MGwOeyAIe9ZlgekVMn1KWu0exlxwHpRPvbh-8urpnM0qDMLz2AeXDWEHjWibnRULqu93HupWYPsUFiI4W5-5gLYihzdkogLLgjGKKrQsQr5UOAPCr3TR-jFAKPdK2EhfxHdcizF-9V7Dqr8 Jul 25 14:25:55.458454 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:25:55.458454 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:25:55.458454 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:25:55.458454 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:25:55.458454 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:25:55.458454 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:25:55.458454 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 0ec5325decaf40558a78fc054d1b60cd Jul 25 14:25:55.458454 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1921339813 Jul 25 14:25:55.458454 n-d-846435-14 devstack@n-api.service[119303]: X-Role: admin,reader,member Jul 25 14:25:55.458454 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: admin,reader,member Jul 25 14:25:55.459968 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0ec5325decaf40558a78fc054d1b60cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0ec5325decaf40558a78fc054d1b60cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0ec5325decaf40558a78fc054d1b60cd", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0ec5325decaf40558a78fc054d1b60cd"}]}] Jul 25 14:25:55.459968 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1921339813 Jul 25 14:25:55.459968 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 0ec5325decaf40558a78fc054d1b60cd Jul 25 14:25:55.459968 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1921339813 Jul 25 14:25:55.459968 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin Jul 25 14:25:55.459968 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:25:55.459968 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:25:55.459968 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 2fcca4e8acc24242a292aab4fcbeb8c7 Jul 25 14:25:55.459968 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin Jul 25 14:25:55.459968 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:25:55.459968 n-d-846435-14 devstack@n-api.service[119303]: {"removeTenantAccess": {"tenant": "e6adf2b0700b4f548a9d87adcaa54937"}} Jul 25 14:25:55.459968 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:25:55.461035 n-d-846435-14 devstack@n-api.service[119303]: exception: Flavor access not found for 35 / e6adf2b0700b4f548a9d87adcaa54937 combination. Jul 25 14:25:55.461035 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '911549630', 'body': {'removeTenantAccess': {'tenant': 'e6adf2b0700b4f548a9d87adcaa54937'}}} Jul 25 14:25:55.461035 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:25:55.461035 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:55.461035 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jul 25 14:25:55.461035 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jul 25 14:25:55.461035 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 25 14:25:55.461035 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 25 14:25:55.461035 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jul 25 14:25:55.461035 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jul 25 14:25:55.461035 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jul 25 14:25:55.461035 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jul 25 14:25:55.461035 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jul 25 14:25:55.461035 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jul 25 14:25:55.461035 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 14:25:55.461035 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 14:25:55.461035 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jul 25 14:25:55.461035 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jul 25 14:25:55.462150 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 35 / e6adf2b0700b4f548a9d87adcaa54937 combination. Jul 25 14:25:55.462150 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:55.462150 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:55.462150 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:55.462150 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:55.462150 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:55.462150 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:55.462150 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:25:55.462150 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:25:55.462150 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:25:55.462150 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:25:55.462150 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:25:55.462150 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:25:55.462150 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jul 25 14:25:55.462150 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:25:55.462150 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 35 / e6adf2b0700b4f548a9d87adcaa54937 combination. Jul 25 14:25:55.462150 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:55.462150 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:25:55.462150 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:55.462150 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:25:55.463438 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:25:55.463438 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:25:55.463438 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:25:55.463438 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:25:55.463438 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 35 / e6adf2b0700b4f548a9d87adcaa54937 combination. Jul 25 14:25:55.463438 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:25:55.463438 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9b9d8156-fc05-4b00-8dc9-53e0ce6dec30 tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] Returning 404 to user: Flavor access not found for 35 / e6adf2b0700b4f548a9d87adcaa54937 combination. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:25:55.463438 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9b9d8156-fc05-4b00-8dc9-53e0ce6dec30 tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors/911549630/action" status: 404 len: 124 microversion: 2.1 time: 0.555349 Jul 25 14:25:55.465959 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 71/156] 10.222.0.88 () {60 vars in 1197 bytes} [Mon Jul 25 14:25:54 2022] POST /compute/v2.1/flavors/911549630/action => generated 124 bytes in 559 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:25:55.466817 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 86/157] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:25:55 2022] GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f => generated 1337 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:55.485845 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2fc15e81-1e3d-48a4-8d49-a89663c28ece tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:55.486618 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:25:55.486618 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:25:55.498635 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=77,nova_api:SAVEPOINT=3,nova_api:RELEASE=3,nova_api:UPDATE=1,nova_api:DELETE=10,nova_api:INSERT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:25:55.516128 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2fc15e81-1e3d-48a4-8d49-a89663c28ece tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/911549630" status: 202 len: 0 microversion: 2.1 time: 0.035757 Jul 25 14:25:55.517386 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 72/158] 10.222.0.88 () {58 vars in 1158 bytes} [Mon Jul 25 14:25:55 2022] DELETE /compute/v2.1/flavors/911549630 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:25:55.526666 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f25044bd-b5b2-44a7-985c-5309a7b2215e tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:55.585397 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f25044bd-b5b2-44a7-985c-5309a7b2215e tempest-FlavorsAccessNegativeTestJSON-1921339813 tempest-FlavorsAccessNegativeTestJSON-1921339813-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.062896 Jul 25 14:25:55.586590 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 87/159] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:25:55 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:55.698716 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b8d4fb33-1587-4bef-835e-049f7f1101aa tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:55.699583 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b8d4fb33-1587-4bef-835e-049f7f1101aa tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 0a711946-8ed7-4475-a873-944011be17d6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:25:55.716891 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8d4fb33-1587-4bef-835e-049f7f1101aa tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:55.718103 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8d4fb33-1587-4bef-835e-049f7f1101aa tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:55.722410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8d4fb33-1587-4bef-835e-049f7f1101aa tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:55.723339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8d4fb33-1587-4bef-835e-049f7f1101aa tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:56.495500 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5a23f332-e5b5-475c-be69-bd624912817c tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:56.501269 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5a23f332-e5b5-475c-be69-bd624912817c tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:25:56.515779 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5a23f332-e5b5-475c-be69-bd624912817c tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:56.519641 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5a23f332-e5b5-475c-be69-bd624912817c tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:56.523308 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5a23f332-e5b5-475c-be69-bd624912817c tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:56.527281 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5a23f332-e5b5-475c-be69-bd624912817c tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:56.849285 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=8 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:25:56.911999 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b8d4fb33-1587-4bef-835e-049f7f1101aa tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:25:56.946771 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b8d4fb33-1587-4bef-835e-049f7f1101aa tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6" status: 200 len: 1319 microversion: 2.1 time: 1.254059 Jul 25 14:25:56.972495 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 73/160] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:25:55 2022] GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6 => generated 1319 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:57.122183 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5a23f332-e5b5-475c-be69-bd624912817c tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2d52c9e2c48dd9e7502843844bf27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78221408d9ae4bdfb29ded35235d5287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:25:57.130432 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:25:57.133164 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5a23f332-e5b5-475c-be69-bd624912817c tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] 10.222.0.88 "GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f" status: 200 len: 1337 microversion: 2.1 time: 0.648358 Jul 25 14:25:57.134665 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 88/161] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:25:56 2022] GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f => generated 1337 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:57.979326 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ae5a884d-c124-4c86-89f3-b70b4c260424 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:57.980223 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ae5a884d-c124-4c86-89f3-b70b4c260424 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 0a711946-8ed7-4475-a873-944011be17d6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:25:57.991573 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae5a884d-c124-4c86-89f3-b70b4c260424 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:57.993909 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae5a884d-c124-4c86-89f3-b70b4c260424 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:57.997101 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae5a884d-c124-4c86-89f3-b70b4c260424 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:57.999599 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae5a884d-c124-4c86-89f3-b70b4c260424 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:58.161122 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8d4b55c8-9222-4822-8aaf-e63728581643 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:58.162286 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8d4b55c8-9222-4822-8aaf-e63728581643 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:25:58.182286 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d4b55c8-9222-4822-8aaf-e63728581643 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:58.183482 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d4b55c8-9222-4822-8aaf-e63728581643 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:58.186840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d4b55c8-9222-4822-8aaf-e63728581643 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:58.187644 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d4b55c8-9222-4822-8aaf-e63728581643 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:58.582664 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8d4b55c8-9222-4822-8aaf-e63728581643 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2d52c9e2c48dd9e7502843844bf27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78221408d9ae4bdfb29ded35235d5287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:25:58.592926 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8d4b55c8-9222-4822-8aaf-e63728581643 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] 10.222.0.88 "GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f" status: 200 len: 1337 microversion: 2.1 time: 0.436510 Jul 25 14:25:58.610222 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 89/162] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:25:58 2022] GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f => generated 1337 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:58.883006 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:25:59.307372 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ae5a884d-c124-4c86-89f3-b70b4c260424 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:25:59.315469 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=87 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:25:59.330842 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ae5a884d-c124-4c86-89f3-b70b4c260424 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6" status: 200 len: 1319 microversion: 2.1 time: 1.354243 Jul 25 14:25:59.333459 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 74/163] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:25:57 2022] GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6 => generated 1319 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:25:59.632046 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6ab61f49-addb-4beb-bfc9-6df0ff9cc248 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:25:59.637230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6ab61f49-addb-4beb-bfc9-6df0ff9cc248 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:25:59.659832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ab61f49-addb-4beb-bfc9-6df0ff9cc248 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:59.661240 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ab61f49-addb-4beb-bfc9-6df0ff9cc248 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:59.663088 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ab61f49-addb-4beb-bfc9-6df0ff9cc248 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:59.664394 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ab61f49-addb-4beb-bfc9-6df0ff9cc248 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:59.876599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-ad8d4282-83bc-46cd-af04-1825cc3cd9ea req-8f378116-85fd-4a3b-823e-eb88b50937d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a711946-8ed7-4475-a873-944011be17d6", "tag": "bf389314-6fd9-4ecd-97b3-f759aab3353b"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:25:59.897062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ad8d4282-83bc-46cd-af04-1825cc3cd9ea req-8f378116-85fd-4a3b-823e-eb88b50937d8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:25:59.897660 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ad8d4282-83bc-46cd-af04-1825cc3cd9ea req-8f378116-85fd-4a3b-823e-eb88b50937d8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:25:59.919671 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-ad8d4282-83bc-46cd-af04-1825cc3cd9ea req-8f378116-85fd-4a3b-823e-eb88b50937d8 service nova] Creating event network-changed:bf389314-6fd9-4ecd-97b3-f759aab3353b for instance 0a711946-8ed7-4475-a873-944011be17d6 on n-h2-846435-14 Jul 25 14:25:59.933761 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-ad8d4282-83bc-46cd-af04-1825cc3cd9ea req-8f378116-85fd-4a3b-823e-eb88b50937d8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.625363 Jul 25 14:25:59.936477 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 90/164] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:00.018405 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6ab61f49-addb-4beb-bfc9-6df0ff9cc248 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2d52c9e2c48dd9e7502843844bf27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78221408d9ae4bdfb29ded35235d5287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:00.027246 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6ab61f49-addb-4beb-bfc9-6df0ff9cc248 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] 10.222.0.88 "GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f" status: 200 len: 1337 microversion: 2.1 time: 0.413350 Jul 25 14:26:00.040635 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 75/165] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:25:59 2022] GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f => generated 1337 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:00.128129 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f23176ca-0bb3-4159-a89a-bb40b1245cea tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1113493066", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "1368011728", "adminPass": "***", "networks": [{"uuid": "47b59bfd-bdf0-453c-b442-6e1a450f2229"}], "security_groups": [{"name": "tempest-securitygroup--1215900045"}], "key_name": "tempest-keypair-999429076", "user_data": "}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:00.153967 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=4 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:00.358937 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0e40cae1-adfe-4411-a8b1-3f94fdd5d8f7 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:00.359927 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0e40cae1-adfe-4411-a8b1-3f94fdd5d8f7 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 0a711946-8ed7-4475-a873-944011be17d6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:00.373513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e40cae1-adfe-4411-a8b1-3f94fdd5d8f7 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:00.374178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e40cae1-adfe-4411-a8b1-3f94fdd5d8f7 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:00.374977 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e40cae1-adfe-4411-a8b1-3f94fdd5d8f7 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:00.375418 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e40cae1-adfe-4411-a8b1-3f94fdd5d8f7 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:00.665235 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0e40cae1-adfe-4411-a8b1-3f94fdd5d8f7 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:00.689167 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0e40cae1-adfe-4411-a8b1-3f94fdd5d8f7 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6" status: 200 len: 1319 microversion: 2.1 time: 0.329998 Jul 25 14:26:00.705005 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 76/166] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:00 2022] GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6 => generated 1319 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:26:01.053515 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6f1ad611-ff97-49f2-b358-b34d3bc92208 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:01.066965 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6f1ad611-ff97-49f2-b358-b34d3bc92208 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:01.087355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=12 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:01.099214 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6f1ad611-ff97-49f2-b358-b34d3bc92208 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:01.099628 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6f1ad611-ff97-49f2-b358-b34d3bc92208 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:01.100436 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6f1ad611-ff97-49f2-b358-b34d3bc92208 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:01.100879 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6f1ad611-ff97-49f2-b358-b34d3bc92208 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:01.379941 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6f1ad611-ff97-49f2-b358-b34d3bc92208 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2d52c9e2c48dd9e7502843844bf27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78221408d9ae4bdfb29ded35235d5287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:01.389985 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6f1ad611-ff97-49f2-b358-b34d3bc92208 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] 10.222.0.88 "GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f" status: 200 len: 1337 microversion: 2.1 time: 0.345109 Jul 25 14:26:01.404615 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 77/167] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:01 2022] GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f => generated 1337 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:01.900840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-f23176ca-0bb3-4159-a89a-bb40b1245cea tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] validate_networks() for [('47b59bfd-bdf0-453c-b442-6e1a450f2229', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:26:01.956279 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e7c2e2b4-43c6-46e6-84df-f02a34e32486 tempest-QuotaClassesAdminTestJSON-2036889656 tempest-QuotaClassesAdminTestJSON-2036889656-project-admin] Calling method '.version_select at 0x7f469411fdc0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:01.957333 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:01.957333 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:01.983872 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e7c2e2b4-43c6-46e6-84df-f02a34e32486 tempest-QuotaClassesAdminTestJSON-2036889656 tempest-QuotaClassesAdminTestJSON-2036889656-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.577810 Jul 25 14:26:01.984563 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 78/168] 10.222.0.88 () {58 vars in 1185 bytes} [Mon Jul 25 14:26:01 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:01.989579 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9586e8a3-bc5c-44b7-8f53-bb41383f0ca5 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:01.990194 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9586e8a3-bc5c-44b7-8f53-bb41383f0ca5 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 0a711946-8ed7-4475-a873-944011be17d6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:01.998358 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9586e8a3-bc5c-44b7-8f53-bb41383f0ca5 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:02.011550 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9586e8a3-bc5c-44b7-8f53-bb41383f0ca5 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:02.013123 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9586e8a3-bc5c-44b7-8f53-bb41383f0ca5 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:02.013880 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9586e8a3-bc5c-44b7-8f53-bb41383f0ca5 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:02.244935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9586e8a3-bc5c-44b7-8f53-bb41383f0ca5 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:02.254753 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9586e8a3-bc5c-44b7-8f53-bb41383f0ca5 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6" status: 200 len: 1319 microversion: 2.1 time: 0.268809 Jul 25 14:26:02.255339 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 79/169] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:01 2022] GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6 => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:02.275442 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2f3149d4-6d5d-4de0-acc9-742973ec92a4 tempest-QuotaClassesAdminTestJSON-2036889656 tempest-QuotaClassesAdminTestJSON-2036889656-project-admin] Action: 'update', calling method: .version_select at 0x7f46943fdb80>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:02.279019 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:02.279019 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:02.607381 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2f3149d4-6d5d-4de0-acc9-742973ec92a4 tempest-QuotaClassesAdminTestJSON-2036889656 tempest-QuotaClassesAdminTestJSON-2036889656-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.350666 Jul 25 14:26:02.608332 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 80/170] 10.222.0.88 () {60 vars in 1206 bytes} [Mon Jul 25 14:26:02 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:02.613386 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bfb9e247-d669-4239-823e-1f810ece720a tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:02.614092 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bfb9e247-d669-4239-823e-1f810ece720a tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:02.622439 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bfb9e247-d669-4239-823e-1f810ece720a tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:02.623408 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bfb9e247-d669-4239-823e-1f810ece720a tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:02.624219 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bfb9e247-d669-4239-823e-1f810ece720a tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:02.624723 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bfb9e247-d669-4239-823e-1f810ece720a tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:02.782293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bfb9e247-d669-4239-823e-1f810ece720a tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2d52c9e2c48dd9e7502843844bf27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78221408d9ae4bdfb29ded35235d5287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:02.790365 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bfb9e247-d669-4239-823e-1f810ece720a tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] 10.222.0.88 "GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f" status: 200 len: 1337 microversion: 2.1 time: 0.180979 Jul 25 14:26:02.804751 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 81/171] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:02 2022] GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f => generated 1337 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:02.810036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a86c11f9-b65e-43cd-b254-41618790a123 tempest-QuotaClassesAdminTestJSON-2036889656 tempest-QuotaClassesAdminTestJSON-2036889656-project-admin] Calling method '.version_select at 0x7f46940e59d0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:02.811019 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:02.811019 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:02.821303 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a86c11f9-b65e-43cd-b254-41618790a123 tempest-QuotaClassesAdminTestJSON-2036889656 tempest-QuotaClassesAdminTestJSON-2036889656-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.014842 Jul 25 14:26:02.822231 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 82/172] 10.222.0.88 () {58 vars in 1185 bytes} [Mon Jul 25 14:26:02 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:02.940149 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f23176ca-0bb3-4159-a89a-bb40b1245cea tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:26:02.941396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f23176ca-0bb3-4159-a89a-bb40b1245cea tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:26:02.942226 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f23176ca-0bb3-4159-a89a-bb40b1245cea tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:26:02.942822 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f23176ca-0bb3-4159-a89a-bb40b1245cea tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:26:02.943437 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f23176ca-0bb3-4159-a89a-bb40b1245cea tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:26:02.958257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f23176ca-0bb3-4159-a89a-bb40b1245cea tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:02.959842 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f23176ca-0bb3-4159-a89a-bb40b1245cea tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:02.960963 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f23176ca-0bb3-4159-a89a-bb40b1245cea tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:02.961421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f23176ca-0bb3-4159-a89a-bb40b1245cea tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:02.984167 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-f23176ca-0bb3-4159-a89a-bb40b1245cea tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Getting quotas for project 508d55290b2744998f48e37d5af6dd04. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:26:02.989222 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-f23176ca-0bb3-4159-a89a-bb40b1245cea tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Getting quotas for user aec61e9c63c043f49c26eb8220cb67bb and project 508d55290b2744998f48e37d5af6dd04. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:26:03.001543 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f23176ca-0bb3-4159-a89a-bb40b1245cea tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:26:03.003957 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f23176ca-0bb3-4159-a89a-bb40b1245cea tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:26:03.053846 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f23176ca-0bb3-4159-a89a-bb40b1245cea tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.931908 Jul 25 14:26:03.054983 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 91/173] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:26:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 2934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:26:03.060400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6ac79575-08fb-492b-8ae4-c89c68900cb4 tempest-QuotaClassesAdminTestJSON-2036889656 tempest-QuotaClassesAdminTestJSON-2036889656-project-admin] Action: 'update', calling method: .version_select at 0x7f46942b4e50>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:03.064183 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:03.064183 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:03.125419 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ad1578bf-bf10-4cc8-8daa-57dea2f99e88 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1939280643", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:03.193994 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-ad1578bf-bf10-4cc8-8daa-57dea2f99e88 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] validate_networks() for None {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:26:03.230158 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6ac79575-08fb-492b-8ae4-c89c68900cb4 tempest-QuotaClassesAdminTestJSON-2036889656 tempest-QuotaClassesAdminTestJSON-2036889656-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.173618 Jul 25 14:26:03.231078 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 92/174] 10.222.0.88 () {60 vars in 1206 bytes} [Mon Jul 25 14:26:03 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:03.237502 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c95c89d1-66fb-4d0e-a2b7-fc4c2fbaa46a tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:03.238368 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c95c89d1-66fb-4d0e-a2b7-fc4c2fbaa46a tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:03.298398 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c95c89d1-66fb-4d0e-a2b7-fc4c2fbaa46a tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:03.309616 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c95c89d1-66fb-4d0e-a2b7-fc4c2fbaa46a tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5" status: 200 len: 1264 microversion: 2.1 time: 0.077403 Jul 25 14:26:03.323902 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 93/175] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:03 2022] GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 => generated 1264 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:03.331522 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-59ea7c9d-db30-4ad9-8ed6-e7f3a13f5f3b tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:03.332503 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-59ea7c9d-db30-4ad9-8ed6-e7f3a13f5f3b tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 0a711946-8ed7-4475-a873-944011be17d6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:03.341013 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59ea7c9d-db30-4ad9-8ed6-e7f3a13f5f3b tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:03.341634 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59ea7c9d-db30-4ad9-8ed6-e7f3a13f5f3b tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:03.342837 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59ea7c9d-db30-4ad9-8ed6-e7f3a13f5f3b tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:03.343706 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59ea7c9d-db30-4ad9-8ed6-e7f3a13f5f3b tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:03.547831 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-59ea7c9d-db30-4ad9-8ed6-e7f3a13f5f3b tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:03.559238 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-59ea7c9d-db30-4ad9-8ed6-e7f3a13f5f3b tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6" status: 200 len: 1319 microversion: 2.1 time: 0.233442 Jul 25 14:26:03.572526 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 94/176] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:03 2022] GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:03.627192 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-ad1578bf-bf10-4cc8-8daa-57dea2f99e88 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:26:03.627741 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-ad1578bf-bf10-4cc8-8daa-57dea2f99e88 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:26:03.628144 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-ad1578bf-bf10-4cc8-8daa-57dea2f99e88 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:26:03.628790 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-ad1578bf-bf10-4cc8-8daa-57dea2f99e88 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:26:03.629372 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-ad1578bf-bf10-4cc8-8daa-57dea2f99e88 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:26:03.642787 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ad1578bf-bf10-4cc8-8daa-57dea2f99e88 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:03.643714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ad1578bf-bf10-4cc8-8daa-57dea2f99e88 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:03.644951 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ad1578bf-bf10-4cc8-8daa-57dea2f99e88 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:03.645684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ad1578bf-bf10-4cc8-8daa-57dea2f99e88 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:03.670178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-ad1578bf-bf10-4cc8-8daa-57dea2f99e88 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Getting quotas for project e693063176af4ae1ae0942ab1b10dc73. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:26:03.678865 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-ad1578bf-bf10-4cc8-8daa-57dea2f99e88 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Getting quotas for user f844b69077cc4ec087269cbb3db2f99e and project e693063176af4ae1ae0942ab1b10dc73. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:26:03.699887 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ad1578bf-bf10-4cc8-8daa-57dea2f99e88 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:26:03.704977 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ad1578bf-bf10-4cc8-8daa-57dea2f99e88 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:26:03.776623 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ad1578bf-bf10-4cc8-8daa-57dea2f99e88 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.951975 Jul 25 14:26:03.777780 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 83/177] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:26:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:26:03.812226 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-06056ad4-931a-46bf-9bf3-bdc6064bb0fa tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:03.813031 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-06056ad4-931a-46bf-9bf3-bdc6064bb0fa tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:03.820453 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-06056ad4-931a-46bf-9bf3-bdc6064bb0fa tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:03.821179 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-06056ad4-931a-46bf-9bf3-bdc6064bb0fa tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:03.822069 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-06056ad4-931a-46bf-9bf3-bdc6064bb0fa tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:03.822648 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-06056ad4-931a-46bf-9bf3-bdc6064bb0fa tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:03.926301 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e49657ce-5d99-4ff1-86d0-88bbae1bda24 tempest-KeyPairsV210TestJSON-143074179 tempest-KeyPairsV210TestJSON-143074179-project-admin] Action: 'create', calling method: .version_select at 0x7f4694249af0>, body: {"keypair": {"name": "tempest-keypair-1840883291", "type": "ssh", "user_id": "03cd70351bcd433da970d3b9cae9afd0", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCcFLjPE5hUWF8H+Rfp0mEcNmz92STQodkwmNOcl5lAfB/u/spl0t5jgq5Jon/db/xZDflBAB8s7sTF+nhPV28DlBOmvdWCA8DuNWABJk4poMeOv+rMhDuG8jhL8X8lLA=="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:03.959809 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-e49657ce-5d99-4ff1-86d0-88bbae1bda24 tempest-KeyPairsV210TestJSON-143074179 tempest-KeyPairsV210TestJSON-143074179-project-admin] Getting quotas for project 7ac88e469d3d47109fd38db99e574b3e. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:26:03.977888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-e49657ce-5d99-4ff1-86d0-88bbae1bda24 tempest-KeyPairsV210TestJSON-143074179 tempest-KeyPairsV210TestJSON-143074179-project-admin] Getting quotas for user 8728508205af48c78c3b590809c81f1d and project 7ac88e469d3d47109fd38db99e574b3e. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:26:04.034797 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e49657ce-5d99-4ff1-86d0-88bbae1bda24 tempest-KeyPairsV210TestJSON-143074179 tempest-KeyPairsV210TestJSON-143074179-project-admin] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.455781 Jul 25 14:26:04.036436 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 95/178] 10.222.0.88 () {62 vars in 1200 bytes} [Mon Jul 25 14:26:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 463 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 14:26:04.051334 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5ab3bcd2-16b5-4c28-a3e2-d6f1aee0cf6f tempest-KeyPairsV210TestJSON-143074179 tempest-KeyPairsV210TestJSON-143074179-project-admin] Action: 'create', calling method: .version_select at 0x7f46942498b0>, body: {"keypair": {"name": "tempest-keypair-1708204465", "type": "ssh", "user_id": "03cd70351bcd433da970d3b9cae9afd0", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6JMXL/5I3PktHhCK0ON+xgRzWSMHk+aE9gXxMowUJ3ccEoknbahsoblQ8A7ezwGasN/1rDYnoByaWhtmAU+V2P1vBj6+oc2mAHZOVU0fueFbPrdZbbumXj2M1mDdodUw=="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:04.110705 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-5ab3bcd2-16b5-4c28-a3e2-d6f1aee0cf6f tempest-KeyPairsV210TestJSON-143074179 tempest-KeyPairsV210TestJSON-143074179-project-admin] Getting quotas for project 7ac88e469d3d47109fd38db99e574b3e. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:26:04.120403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-5ab3bcd2-16b5-4c28-a3e2-d6f1aee0cf6f tempest-KeyPairsV210TestJSON-143074179 tempest-KeyPairsV210TestJSON-143074179-project-admin] Getting quotas for user 8728508205af48c78c3b590809c81f1d and project 7ac88e469d3d47109fd38db99e574b3e. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:26:04.132882 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-06056ad4-931a-46bf-9bf3-bdc6064bb0fa tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2d52c9e2c48dd9e7502843844bf27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78221408d9ae4bdfb29ded35235d5287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:04.146727 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-06056ad4-931a-46bf-9bf3-bdc6064bb0fa tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] 10.222.0.88 "GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f" status: 200 len: 1337 microversion: 2.1 time: 0.336340 Jul 25 14:26:04.158568 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 84/179] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:03 2022] GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f => generated 1337 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:26:04.162275 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=4,nova_api:INSERT=5,nova_api:UPDATE=12 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:04.176334 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f9be8f2b-ab11-4876-be4a-6e1ccf742617 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-554646054", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:04.185056 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5ab3bcd2-16b5-4c28-a3e2-d6f1aee0cf6f tempest-KeyPairsV210TestJSON-143074179 tempest-KeyPairsV210TestJSON-143074179-project-admin] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.138547 Jul 25 14:26:04.186209 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 96/180] 10.222.0.88 () {62 vars in 1200 bytes} [Mon Jul 25 14:26:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 141 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 14:26:04.195300 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=72,nova_api:UPDATE=12,nova_api:INSERT=15 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:04.202588 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-271cdda0-7dbd-4ebc-9914-41f1ca6b37eb tempest-KeyPairsV210TestJSON-143074179 tempest-KeyPairsV210TestJSON-143074179-project-admin] Calling method '.version_select at 0x7f4694311a60>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:04.224226 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-271cdda0-7dbd-4ebc-9914-41f1ca6b37eb tempest-KeyPairsV210TestJSON-143074179 tempest-KeyPairsV210TestJSON-143074179-project-admin] 10.222.0.88 "GET /compute/v2.1/os-keypairs/tempest-keypair-1840883291?user_id=03cd70351bcd433da970d3b9cae9afd0" status: 200 len: 512 microversion: 2.10 time: 0.030961 Jul 25 14:26:04.225500 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 97/181] 10.222.0.88 () {60 vars in 1340 bytes} [Mon Jul 25 14:26:04 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1840883291?user_id=03cd70351bcd433da970d3b9cae9afd0 => generated 512 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:26:04.240524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-60208eec-e512-4b71-9b90-5658e73643c7 tempest-KeyPairsV210TestJSON-143074179 tempest-KeyPairsV210TestJSON-143074179-project-admin] Action: 'create', calling method: .version_select at 0x7f46943111f0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1771010700", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsxm2nFEpizSu/5Pni9OeRO5DUO8ELQfpiywOBxf/MfbYiLxoJH0BWs+4NPbOp3BicSPBCP/ZesdGL2y6bv4svzdHc65wf4qV4AOtgRbldplfizDaKvMGtCRxQ+k9NqrA=="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:04.258839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-f9be8f2b-ab11-4876-be4a-6e1ccf742617 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] validate_networks() for None {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:26:04.273549 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-60208eec-e512-4b71-9b90-5658e73643c7 tempest-KeyPairsV210TestJSON-143074179 tempest-KeyPairsV210TestJSON-143074179-project-admin] Getting quotas for project 7ac88e469d3d47109fd38db99e574b3e. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:26:04.279229 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-60208eec-e512-4b71-9b90-5658e73643c7 tempest-KeyPairsV210TestJSON-143074179 tempest-KeyPairsV210TestJSON-143074179-project-admin] Getting quotas for user 8728508205af48c78c3b590809c81f1d and project 7ac88e469d3d47109fd38db99e574b3e. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:26:04.310133 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-60208eec-e512-4b71-9b90-5658e73643c7 tempest-KeyPairsV210TestJSON-143074179 tempest-KeyPairsV210TestJSON-143074179-project-admin] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.074905 Jul 25 14:26:04.311532 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 98/182] 10.222.0.88 () {62 vars in 1200 bytes} [Mon Jul 25 14:26:04 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 77 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 25 14:26:04.323160 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-15db1478-b818-47ae-aee0-d1785ef192d1 tempest-KeyPairsV210TestJSON-143074179 tempest-KeyPairsV210TestJSON-143074179-project-admin] Calling method '.version_select at 0x7f46942a73a0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:04.327372 n-d-846435-14 devstack@n-api.service[119304]: WARNING oslo_db.sqlalchemy.utils [None req-15db1478-b818-47ae-aee0-d1785ef192d1 tempest-KeyPairsV210TestJSON-143074179 tempest-KeyPairsV210TestJSON-143074179-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jul 25 14:26:04.335370 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-15db1478-b818-47ae-aee0-d1785ef192d1 tempest-KeyPairsV210TestJSON-143074179 tempest-KeyPairsV210TestJSON-143074179-project-admin] 10.222.0.88 "GET /compute/v2.1/os-keypairs?user_id=03cd70351bcd433da970d3b9cae9afd0" status: 200 len: 726 microversion: 2.10 time: 0.017294 Jul 25 14:26:04.336039 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 99/183] 10.222.0.88 () {60 vars in 1259 bytes} [Mon Jul 25 14:26:04 2022] GET /compute/v2.1/os-keypairs?user_id=03cd70351bcd433da970d3b9cae9afd0 => generated 726 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:26:04.345273 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1a755d43-c794-4a69-b29b-1b0618258ac1 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:04.346036 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1a755d43-c794-4a69-b29b-1b0618258ac1 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:04.354639 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1a755d43-c794-4a69-b29b-1b0618258ac1 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:04.355381 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1a755d43-c794-4a69-b29b-1b0618258ac1 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:04.356515 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1a755d43-c794-4a69-b29b-1b0618258ac1 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:04.357140 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1a755d43-c794-4a69-b29b-1b0618258ac1 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:04.428640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1a755d43-c794-4a69-b29b-1b0618258ac1 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:04.436336 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1a755d43-c794-4a69-b29b-1b0618258ac1 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5" status: 200 len: 1337 microversion: 2.1 time: 0.099120 Jul 25 14:26:04.437434 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 100/184] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:04 2022] GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 => generated 1337 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:04.438480 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1a755d43-c794-4a69-b29b-1b0618258ac1 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:04.439629 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1a755d43-c794-4a69-b29b-1b0618258ac1 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001302 Jul 25 14:26:04.447956 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 101/185] 10.222.0.88 () {56 vars in 886 bytes} [Mon Jul 25 14:26:04 2022] GET /compute/ => generated 377 bytes in 10 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 25 14:26:04.454864 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-687b84bc-9b18-4097-a374-b9af5fc9fceb tempest-KeyPairsV210TestJSON-143074179 tempest-KeyPairsV210TestJSON-143074179-project-admin] Calling method '.version_select at 0x7f46942a7670>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:04.494054 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-687b84bc-9b18-4097-a374-b9af5fc9fceb tempest-KeyPairsV210TestJSON-143074179 tempest-KeyPairsV210TestJSON-143074179-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1771010700" status: 204 len: 0 microversion: 2.10 time: 0.044948 Jul 25 14:26:04.494759 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 102/186] 10.222.0.88 () {60 vars in 1325 bytes} [Mon Jul 25 14:26:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1771010700 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 14:26:04.506226 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4f965470-317f-4d09-aa58-7b87c315158e tempest-KeyPairsV210TestJSON-143074179 tempest-KeyPairsV210TestJSON-143074179-project-admin] Calling method '.version_select at 0x7f46942499d0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:04.564216 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4f965470-317f-4d09-aa58-7b87c315158e tempest-KeyPairsV210TestJSON-143074179 tempest-KeyPairsV210TestJSON-143074179-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1708204465?user_id=03cd70351bcd433da970d3b9cae9afd0" status: 204 len: 0 microversion: 2.10 time: 0.064469 Jul 25 14:26:04.565772 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 103/187] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Jul 25 14:26:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1708204465?user_id=03cd70351bcd433da970d3b9cae9afd0 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 14:26:04.581527 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-67fa2db9-2058-4a6f-95f8-863a489ad9c9 tempest-KeyPairsV210TestJSON-143074179 tempest-KeyPairsV210TestJSON-143074179-project-admin] Calling method '.version_select at 0x7f46942b4d30>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:04.667940 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-67fa2db9-2058-4a6f-95f8-863a489ad9c9 tempest-KeyPairsV210TestJSON-143074179 tempest-KeyPairsV210TestJSON-143074179-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1840883291?user_id=03cd70351bcd433da970d3b9cae9afd0" status: 204 len: 0 microversion: 2.10 time: 0.097515 Jul 25 14:26:04.668581 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 104/188] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Jul 25 14:26:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1840883291?user_id=03cd70351bcd433da970d3b9cae9afd0 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 14:26:04.680121 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f4678d6d-5307-4fef-84ed-3cfa8bb58438 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:04.680745 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f4678d6d-5307-4fef-84ed-3cfa8bb58438 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 0a711946-8ed7-4475-a873-944011be17d6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:04.699615 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f4678d6d-5307-4fef-84ed-3cfa8bb58438 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:04.700524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f4678d6d-5307-4fef-84ed-3cfa8bb58438 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:04.701542 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f4678d6d-5307-4fef-84ed-3cfa8bb58438 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:04.702230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f4678d6d-5307-4fef-84ed-3cfa8bb58438 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:04.876833 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-f9be8f2b-ab11-4876-be4a-6e1ccf742617 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:26:04.877347 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-f9be8f2b-ab11-4876-be4a-6e1ccf742617 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:26:04.877915 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-f9be8f2b-ab11-4876-be4a-6e1ccf742617 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:26:04.878416 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-f9be8f2b-ab11-4876-be4a-6e1ccf742617 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:26:04.878997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-f9be8f2b-ab11-4876-be4a-6e1ccf742617 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:26:04.895382 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f9be8f2b-ab11-4876-be4a-6e1ccf742617 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:04.896546 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f9be8f2b-ab11-4876-be4a-6e1ccf742617 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:04.897399 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f9be8f2b-ab11-4876-be4a-6e1ccf742617 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:04.897845 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f9be8f2b-ab11-4876-be4a-6e1ccf742617 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:04.946017 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-f9be8f2b-ab11-4876-be4a-6e1ccf742617 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Getting quotas for project e693063176af4ae1ae0942ab1b10dc73. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:26:04.959339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-f9be8f2b-ab11-4876-be4a-6e1ccf742617 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Getting quotas for user f844b69077cc4ec087269cbb3db2f99e and project e693063176af4ae1ae0942ab1b10dc73. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:26:04.983442 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f9be8f2b-ab11-4876-be4a-6e1ccf742617 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:26:04.985618 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f9be8f2b-ab11-4876-be4a-6e1ccf742617 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: b7018cc7-3f35-47d3-a679-30b828faedab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:26:05.083221 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f9be8f2b-ab11-4876-be4a-6e1ccf742617 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.923437 Jul 25 14:26:05.083876 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 85/189] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:26:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:26:05.095058 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0abbe49f-da62-4444-95c2-532afc5c8ab9 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:05.095960 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0abbe49f-da62-4444-95c2-532afc5c8ab9 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: b7018cc7-3f35-47d3-a679-30b828faedab] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:05.185300 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0abbe49f-da62-4444-95c2-532afc5c8ab9 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:05.196163 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0abbe49f-da62-4444-95c2-532afc5c8ab9 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab" status: 200 len: 1213 microversion: 2.1 time: 0.103206 Jul 25 14:26:05.212132 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 86/190] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:05 2022] GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab => generated 1213 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:05.222102 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ff2dd910-e1b3-44dd-8fc5-c3a4b78ded4c tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:05.225179 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ff2dd910-e1b3-44dd-8fc5-c3a4b78ded4c tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:05.240590 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ff2dd910-e1b3-44dd-8fc5-c3a4b78ded4c tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:05.243384 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ff2dd910-e1b3-44dd-8fc5-c3a4b78ded4c tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:05.245983 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ff2dd910-e1b3-44dd-8fc5-c3a4b78ded4c tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:05.246608 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ff2dd910-e1b3-44dd-8fc5-c3a4b78ded4c tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:05.258163 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f4678d6d-5307-4fef-84ed-3cfa8bb58438 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:05.266969 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f4678d6d-5307-4fef-84ed-3cfa8bb58438 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6" status: 200 len: 1319 microversion: 2.1 time: 0.597370 Jul 25 14:26:05.271104 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 105/191] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:04 2022] GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6 => generated 1319 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:05.462247 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-724eb3c7-f6f6-413a-83c7-448226488ca0 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:05.462859 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-724eb3c7-f6f6-413a-83c7-448226488ca0 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:05.474962 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-724eb3c7-f6f6-413a-83c7-448226488ca0 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:05.475424 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-724eb3c7-f6f6-413a-83c7-448226488ca0 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:05.476318 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-724eb3c7-f6f6-413a-83c7-448226488ca0 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:05.476897 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-724eb3c7-f6f6-413a-83c7-448226488ca0 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:05.707723 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-724eb3c7-f6f6-413a-83c7-448226488ca0 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:05.726553 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-724eb3c7-f6f6-413a-83c7-448226488ca0 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5" status: 200 len: 1343 microversion: 2.1 time: 0.267774 Jul 25 14:26:05.728048 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 106/192] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:05 2022] GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 => generated 1343 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:26:05.917863 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ff2dd910-e1b3-44dd-8fc5-c3a4b78ded4c tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2d52c9e2c48dd9e7502843844bf27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78221408d9ae4bdfb29ded35235d5287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:05.937526 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ff2dd910-e1b3-44dd-8fc5-c3a4b78ded4c tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] 10.222.0.88 "GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f" status: 200 len: 1337 microversion: 2.1 time: 0.722257 Jul 25 14:26:05.939222 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 87/193] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:05 2022] GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f => generated 1337 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:06.219373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-712eb487-8d21-4a03-b3ab-f85f113fb69b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:06.220036 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-712eb487-8d21-4a03-b3ab-f85f113fb69b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: b7018cc7-3f35-47d3-a679-30b828faedab] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:06.228302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-712eb487-8d21-4a03-b3ab-f85f113fb69b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:06.229080 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-712eb487-8d21-4a03-b3ab-f85f113fb69b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:06.230025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-712eb487-8d21-4a03-b3ab-f85f113fb69b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:06.230634 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-712eb487-8d21-4a03-b3ab-f85f113fb69b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:06.301917 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e0b4f754-c9bb-48a2-990a-05d6e56c518e tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:06.303109 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e0b4f754-c9bb-48a2-990a-05d6e56c518e tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 0a711946-8ed7-4475-a873-944011be17d6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:06.314386 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e0b4f754-c9bb-48a2-990a-05d6e56c518e tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:06.314846 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e0b4f754-c9bb-48a2-990a-05d6e56c518e tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:06.315624 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e0b4f754-c9bb-48a2-990a-05d6e56c518e tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:06.316089 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e0b4f754-c9bb-48a2-990a-05d6e56c518e tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:06.374525 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-712eb487-8d21-4a03-b3ab-f85f113fb69b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:06.387065 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-712eb487-8d21-4a03-b3ab-f85f113fb69b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab" status: 200 len: 1217 microversion: 2.1 time: 0.172580 Jul 25 14:26:06.387691 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 107/194] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:06 2022] GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab => generated 1217 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:06.643638 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e0b4f754-c9bb-48a2-990a-05d6e56c518e tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:06.657040 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e0b4f754-c9bb-48a2-990a-05d6e56c518e tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6" status: 200 len: 1319 microversion: 2.1 time: 0.363449 Jul 25 14:26:06.672821 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 88/195] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:06 2022] GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6 => generated 1319 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:26:06.748730 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-735e7a0b-d900-4ef1-828e-3030df4e44db tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:06.749345 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-735e7a0b-d900-4ef1-828e-3030df4e44db tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:06.764447 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-735e7a0b-d900-4ef1-828e-3030df4e44db tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:06.765058 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-735e7a0b-d900-4ef1-828e-3030df4e44db tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:06.765985 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-735e7a0b-d900-4ef1-828e-3030df4e44db tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:06.772853 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-735e7a0b-d900-4ef1-828e-3030df4e44db tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:06.963540 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d5e0954c-77b9-4c5a-a0eb-7da4a2ac2b21 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:06.965634 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d5e0954c-77b9-4c5a-a0eb-7da4a2ac2b21 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:06.974744 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d5e0954c-77b9-4c5a-a0eb-7da4a2ac2b21 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:06.975602 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d5e0954c-77b9-4c5a-a0eb-7da4a2ac2b21 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:06.976785 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d5e0954c-77b9-4c5a-a0eb-7da4a2ac2b21 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:06.977517 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d5e0954c-77b9-4c5a-a0eb-7da4a2ac2b21 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:07.014666 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-735e7a0b-d900-4ef1-828e-3030df4e44db tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:07.026281 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-735e7a0b-d900-4ef1-828e-3030df4e44db tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5" status: 200 len: 1411 microversion: 2.1 time: 0.281184 Jul 25 14:26:07.028301 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 108/196] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:06 2022] GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 => generated 1411 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:07.292499 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d5e0954c-77b9-4c5a-a0eb-7da4a2ac2b21 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2d52c9e2c48dd9e7502843844bf27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78221408d9ae4bdfb29ded35235d5287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:07.304704 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d5e0954c-77b9-4c5a-a0eb-7da4a2ac2b21 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] 10.222.0.88 "GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f" status: 200 len: 1337 microversion: 2.1 time: 0.348039 Jul 25 14:26:07.320524 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 89/197] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:06 2022] GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f => generated 1337 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:07.411808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c5be6e6e-0d3f-4e3d-8b40-d684994a1a18 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:07.413202 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c5be6e6e-0d3f-4e3d-8b40-d684994a1a18 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: b7018cc7-3f35-47d3-a679-30b828faedab] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:07.422777 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c5be6e6e-0d3f-4e3d-8b40-d684994a1a18 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:07.423426 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c5be6e6e-0d3f-4e3d-8b40-d684994a1a18 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:07.425829 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c5be6e6e-0d3f-4e3d-8b40-d684994a1a18 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:07.426634 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c5be6e6e-0d3f-4e3d-8b40-d684994a1a18 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:07.570096 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-598bad67-bc88-4469-a98d-058677eaceee req-de76905a-5f8b-437e-9ed2-15416771a468 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5", "tag": "0dfe3f1f-597d-4865-90a9-c04d07e6faf2"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:07.575361 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c5be6e6e-0d3f-4e3d-8b40-d684994a1a18 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:07.589744 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c5be6e6e-0d3f-4e3d-8b40-d684994a1a18 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab" status: 200 len: 1217 microversion: 2.1 time: 0.183454 Jul 25 14:26:07.590341 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 109/198] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:07 2022] GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab => generated 1217 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:07.595203 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-598bad67-bc88-4469-a98d-058677eaceee req-de76905a-5f8b-437e-9ed2-15416771a468 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:07.595642 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-598bad67-bc88-4469-a98d-058677eaceee req-de76905a-5f8b-437e-9ed2-15416771a468 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:07.629540 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-598bad67-bc88-4469-a98d-058677eaceee req-de76905a-5f8b-437e-9ed2-15416771a468 service nova] Creating event network-changed:0dfe3f1f-597d-4865-90a9-c04d07e6faf2 for instance 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 on n-h1-846435-14 Jul 25 14:26:07.630498 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-598bad67-bc88-4469-a98d-058677eaceee req-de76905a-5f8b-437e-9ed2-15416771a468 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119303) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 14:26:07.631903 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-faa28d4a-c944-4226-8696-39027b0fca76 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:07.632582 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-faa28d4a-c944-4226-8696-39027b0fca76 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:07.633775 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-faa28d4a-c944-4226-8696-39027b0fca76 None None] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:07.634391 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-faa28d4a-c944-4226-8696-39027b0fca76 None None] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:07.647644 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.compute.rpcapi [None req-faa28d4a-c944-4226-8696-39027b0fca76 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 25 14:26:07.648737 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-faa28d4a-c944-4226-8696-39027b0fca76 None None] Releasing lock "compute-rpcapi-router" {{(pid=119303) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 14:26:07.665666 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-faa28d4a-c944-4226-8696-39027b0fca76 None None] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099109 Jul 25 14:26:07.671486 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 90/199] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:07.679891 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e7ac9bbd-6629-43e4-a0ee-1c0ae01341cb tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:07.680857 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e7ac9bbd-6629-43e4-a0ee-1c0ae01341cb tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 0a711946-8ed7-4475-a873-944011be17d6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:07.695137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e7ac9bbd-6629-43e4-a0ee-1c0ae01341cb tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:07.696456 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e7ac9bbd-6629-43e4-a0ee-1c0ae01341cb tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:07.697409 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e7ac9bbd-6629-43e4-a0ee-1c0ae01341cb tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:07.697994 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e7ac9bbd-6629-43e4-a0ee-1c0ae01341cb tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:08.060350 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3823fe12-1e54-4b24-89a9-908a4da3257b tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:08.063578 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3823fe12-1e54-4b24-89a9-908a4da3257b tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:08.084110 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3823fe12-1e54-4b24-89a9-908a4da3257b tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:08.085731 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3823fe12-1e54-4b24-89a9-908a4da3257b tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:08.087340 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3823fe12-1e54-4b24-89a9-908a4da3257b tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:08.088585 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3823fe12-1e54-4b24-89a9-908a4da3257b tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:08.243137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e7ac9bbd-6629-43e4-a0ee-1c0ae01341cb tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:08.255848 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e7ac9bbd-6629-43e4-a0ee-1c0ae01341cb tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6" status: 200 len: 1319 microversion: 2.1 time: 0.579267 Jul 25 14:26:08.257752 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 110/200] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:07 2022] GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6 => generated 1319 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:08.339552 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-01216810-6564-48f7-8a3e-adc28d3e58ab tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:08.340249 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-01216810-6564-48f7-8a3e-adc28d3e58ab tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:08.353837 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01216810-6564-48f7-8a3e-adc28d3e58ab tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:08.354288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01216810-6564-48f7-8a3e-adc28d3e58ab tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:08.357952 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01216810-6564-48f7-8a3e-adc28d3e58ab tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:08.359213 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01216810-6564-48f7-8a3e-adc28d3e58ab tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:08.743852 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-01216810-6564-48f7-8a3e-adc28d3e58ab tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2d52c9e2c48dd9e7502843844bf27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78221408d9ae4bdfb29ded35235d5287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:08.759303 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-01216810-6564-48f7-8a3e-adc28d3e58ab tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] 10.222.0.88 "GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f" status: 200 len: 1337 microversion: 2.1 time: 0.432065 Jul 25 14:26:08.759901 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 111/201] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:08 2022] GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f => generated 1337 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:09.058492 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-c4e45b0f-5d77-448e-a095-074b5f6a3f12 req-2a71782a-cdbd-4f33-94ba-52657e6d7eab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9eb52d5-1abd-4050-ada7-60d23d4bb29f", "name": "network-vif-plugged", "status": "completed", "tag": "1a6656a9-cb42-4d44-908a-a8d1cfc3696d"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:09.059235 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3823fe12-1e54-4b24-89a9-908a4da3257b tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:09.068720 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3823fe12-1e54-4b24-89a9-908a4da3257b tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5" status: 200 len: 1411 microversion: 2.1 time: 1.022909 Jul 25 14:26:09.080220 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 91/202] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:08 2022] GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 => generated 1411 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:09.080220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3e56e814-08b6-4bd9-9869-99404edec18a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:09.080220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3e56e814-08b6-4bd9-9869-99404edec18a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: b7018cc7-3f35-47d3-a679-30b828faedab] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:09.084574 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c4e45b0f-5d77-448e-a095-074b5f6a3f12 req-2a71782a-cdbd-4f33-94ba-52657e6d7eab service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:09.085322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c4e45b0f-5d77-448e-a095-074b5f6a3f12 req-2a71782a-cdbd-4f33-94ba-52657e6d7eab service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:09.096010 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3e56e814-08b6-4bd9-9869-99404edec18a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:09.096386 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3e56e814-08b6-4bd9-9869-99404edec18a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:09.097159 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3e56e814-08b6-4bd9-9869-99404edec18a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:09.097593 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3e56e814-08b6-4bd9-9869-99404edec18a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:09.098846 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-c4e45b0f-5d77-448e-a095-074b5f6a3f12 req-2a71782a-cdbd-4f33-94ba-52657e6d7eab service nova] Creating event network-vif-plugged:1a6656a9-cb42-4d44-908a-a8d1cfc3696d for instance a9eb52d5-1abd-4050-ada7-60d23d4bb29f on n-h1-846435-14 Jul 25 14:26:09.105194 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-c4e45b0f-5d77-448e-a095-074b5f6a3f12 req-2a71782a-cdbd-4f33-94ba-52657e6d7eab service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.343852 Jul 25 14:26:09.105980 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 112/203] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:09.234292 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3e56e814-08b6-4bd9-9869-99404edec18a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:09.243744 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3e56e814-08b6-4bd9-9869-99404edec18a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab" status: 200 len: 1271 microversion: 2.1 time: 0.172662 Jul 25 14:26:09.256283 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 92/204] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:09 2022] GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab => generated 1271 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:09.282504 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-945200ea-cad8-4f3e-b66c-6d3708def531 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:09.283986 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-945200ea-cad8-4f3e-b66c-6d3708def531 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 0a711946-8ed7-4475-a873-944011be17d6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:09.293669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-945200ea-cad8-4f3e-b66c-6d3708def531 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:09.294218 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-945200ea-cad8-4f3e-b66c-6d3708def531 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:09.295106 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-945200ea-cad8-4f3e-b66c-6d3708def531 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:09.296185 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-945200ea-cad8-4f3e-b66c-6d3708def531 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:09.472038 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-945200ea-cad8-4f3e-b66c-6d3708def531 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:09.481553 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-945200ea-cad8-4f3e-b66c-6d3708def531 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6" status: 200 len: 1319 microversion: 2.1 time: 0.206796 Jul 25 14:26:09.504604 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 113/205] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:09 2022] GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:09.786061 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c60224aa-e097-46ca-a454-6f5fc7aa5575 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:09.789749 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c60224aa-e097-46ca-a454-6f5fc7aa5575 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:09.809130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c60224aa-e097-46ca-a454-6f5fc7aa5575 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:09.809755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c60224aa-e097-46ca-a454-6f5fc7aa5575 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:09.811668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c60224aa-e097-46ca-a454-6f5fc7aa5575 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:09.813871 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c60224aa-e097-46ca-a454-6f5fc7aa5575 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:10.057522 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d0b4ddad-feb0-45b5-8a4c-07057f9932b7 tempest-QuotasAdminTestV257-989393170 tempest-QuotasAdminTestV257-989393170-project-admin] Action: 'update', calling method: .version_select at 0x7f469409e1f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:10.233418 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c60224aa-e097-46ca-a454-6f5fc7aa5575 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2d52c9e2c48dd9e7502843844bf27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78221408d9ae4bdfb29ded35235d5287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:10.248810 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c60224aa-e097-46ca-a454-6f5fc7aa5575 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] 10.222.0.88 "GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f" status: 200 len: 1337 microversion: 2.1 time: 0.467461 Jul 25 14:26:10.263734 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 114/206] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:09 2022] GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f => generated 1337 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:10.278705 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8da21309-bc19-4139-964a-8ddea9c42f2e tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:10.279375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8da21309-bc19-4139-964a-8ddea9c42f2e tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:10.297131 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8da21309-bc19-4139-964a-8ddea9c42f2e tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:10.298414 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8da21309-bc19-4139-964a-8ddea9c42f2e tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:10.299270 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8da21309-bc19-4139-964a-8ddea9c42f2e tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:10.299702 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8da21309-bc19-4139-964a-8ddea9c42f2e tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:10.380733 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d0b4ddad-feb0-45b5-8a4c-07057f9932b7 tempest-QuotasAdminTestV257-989393170 tempest-QuotasAdminTestV257-989393170-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:10.381406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d0b4ddad-feb0-45b5-8a4c-07057f9932b7 tempest-QuotasAdminTestV257-989393170 tempest-QuotasAdminTestV257-989393170-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:10.384455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d0b4ddad-feb0-45b5-8a4c-07057f9932b7 tempest-QuotasAdminTestV257-989393170 tempest-QuotasAdminTestV257-989393170-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:10.386506 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d0b4ddad-feb0-45b5-8a4c-07057f9932b7 tempest-QuotasAdminTestV257-989393170 tempest-QuotasAdminTestV257-989393170-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:10.565557 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d0b4ddad-feb0-45b5-8a4c-07057f9932b7 tempest-QuotasAdminTestV257-989393170 tempest-QuotasAdminTestV257-989393170-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-sets/8b26de11963648b397d990e0203f1a68" status: 200 len: 148 microversion: 2.57 time: 1.084586 Jul 25 14:26:10.566403 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 93/207] 10.222.0.88 () {62 vars in 1303 bytes} [Mon Jul 25 14:26:09 2022] PUT /compute/v2.1/os-quota-sets/8b26de11963648b397d990e0203f1a68 => generated 148 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:26:10.572339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-55878de9-3025-4d28-b63d-2dd6e72a96c4 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:10.573096 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-55878de9-3025-4d28-b63d-2dd6e72a96c4 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: b7018cc7-3f35-47d3-a679-30b828faedab] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:10.580979 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-55878de9-3025-4d28-b63d-2dd6e72a96c4 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:10.581691 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-55878de9-3025-4d28-b63d-2dd6e72a96c4 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:10.582949 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-55878de9-3025-4d28-b63d-2dd6e72a96c4 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:10.583480 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-55878de9-3025-4d28-b63d-2dd6e72a96c4 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:10.660886 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8da21309-bc19-4139-964a-8ddea9c42f2e tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:10.674100 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8da21309-bc19-4139-964a-8ddea9c42f2e tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5" status: 200 len: 1411 microversion: 2.1 time: 0.398650 Jul 25 14:26:10.674856 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 115/208] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:10 2022] GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 => generated 1411 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:10.681329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6286ec9d-8058-4d1f-9b5e-eb08d13a09ba tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:10.682049 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6286ec9d-8058-4d1f-9b5e-eb08d13a09ba tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 0a711946-8ed7-4475-a873-944011be17d6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:10.695067 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6286ec9d-8058-4d1f-9b5e-eb08d13a09ba tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:10.695790 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6286ec9d-8058-4d1f-9b5e-eb08d13a09ba tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:10.696716 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6286ec9d-8058-4d1f-9b5e-eb08d13a09ba tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:10.697282 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6286ec9d-8058-4d1f-9b5e-eb08d13a09ba tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:10.724171 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-55878de9-3025-4d28-b63d-2dd6e72a96c4 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:10.733240 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-55878de9-3025-4d28-b63d-2dd6e72a96c4 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab" status: 200 len: 1271 microversion: 2.1 time: 0.165704 Jul 25 14:26:10.734847 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 94/209] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:10 2022] GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab => generated 1271 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:10.740326 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1015a479-9004-4513-9124-ab11c5cb2c53 tempest-QuotasAdminTestV257-989393170 tempest-QuotasAdminTestV257-989393170-project-admin] Calling method '.version_select at 0x7f46944b9310>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:11.017120 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6286ec9d-8058-4d1f-9b5e-eb08d13a09ba tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:11.030843 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6286ec9d-8058-4d1f-9b5e-eb08d13a09ba tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6" status: 200 len: 1319 microversion: 2.1 time: 0.354672 Jul 25 14:26:11.035893 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 116/210] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:10 2022] GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6 => generated 1319 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:11.047657 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-40f3395e-903f-45d6-8603-370a5fa95ef4 req-011a6011-c094-4e14-a701-1cab380eb477 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c25476ab-b697-45f9-aa22-ead2d1b23fc7", "tag": "c69d5fca-fc3b-4290-b9b5-09a0bbddbbc9"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:11.071569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-40f3395e-903f-45d6-8603-370a5fa95ef4 req-011a6011-c094-4e14-a701-1cab380eb477 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:11.075528 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-40f3395e-903f-45d6-8603-370a5fa95ef4 req-011a6011-c094-4e14-a701-1cab380eb477 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:11.093438 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-40f3395e-903f-45d6-8603-370a5fa95ef4 req-011a6011-c094-4e14-a701-1cab380eb477 service nova] Creating event network-changed:c69d5fca-fc3b-4290-b9b5-09a0bbddbbc9 for instance c25476ab-b697-45f9-aa22-ead2d1b23fc7 on n-h1-846435-14 Jul 25 14:26:11.098841 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-40f3395e-903f-45d6-8603-370a5fa95ef4 req-011a6011-c094-4e14-a701-1cab380eb477 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061343 Jul 25 14:26:11.099669 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 117/211] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:11.105236 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1015a479-9004-4513-9124-ab11c5cb2c53 tempest-QuotasAdminTestV257-989393170 tempest-QuotasAdminTestV257-989393170-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:11.106201 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1015a479-9004-4513-9124-ab11c5cb2c53 tempest-QuotasAdminTestV257-989393170 tempest-QuotasAdminTestV257-989393170-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:11.107964 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1015a479-9004-4513-9124-ab11c5cb2c53 tempest-QuotasAdminTestV257-989393170 tempest-QuotasAdminTestV257-989393170-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:11.110640 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1015a479-9004-4513-9124-ab11c5cb2c53 tempest-QuotasAdminTestV257-989393170 tempest-QuotasAdminTestV257-989393170-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:11.134160 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1015a479-9004-4513-9124-ab11c5cb2c53 tempest-QuotasAdminTestV257-989393170 tempest-QuotasAdminTestV257-989393170-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/8b26de11963648b397d990e0203f1a68/detail" status: 200 len: 463 microversion: 2.57 time: 0.398072 Jul 25 14:26:11.135083 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 95/212] 10.222.0.88 () {60 vars in 1304 bytes} [Mon Jul 25 14:26:10 2022] GET /compute/v2.1/os-quota-sets/8b26de11963648b397d990e0203f1a68/detail => generated 463 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:26:11.279766 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c612d9ed-685e-414d-99cc-970a966298a6 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:11.280960 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c612d9ed-685e-414d-99cc-970a966298a6 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:11.296026 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c612d9ed-685e-414d-99cc-970a966298a6 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:11.296500 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c612d9ed-685e-414d-99cc-970a966298a6 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:11.298145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c612d9ed-685e-414d-99cc-970a966298a6 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:11.300513 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c612d9ed-685e-414d-99cc-970a966298a6 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:11.417265 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-42fbd2ee-1e32-4b18-a751-f245babf0bfa tempest-QuotasAdminTestV257-989393170 tempest-QuotasAdminTestV257-989393170-project-admin] Action: 'update', calling method: .version_select at 0x7f46940eb160>, body: {"quota_set": {"ram": "2048"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:11.529654 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c612d9ed-685e-414d-99cc-970a966298a6 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2d52c9e2c48dd9e7502843844bf27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78221408d9ae4bdfb29ded35235d5287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:11.542675 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c612d9ed-685e-414d-99cc-970a966298a6 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] 10.222.0.88 "GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f" status: 200 len: 1337 microversion: 2.1 time: 0.270711 Jul 25 14:26:11.554147 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 118/213] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:11 2022] GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f => generated 1337 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:11.677283 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42fbd2ee-1e32-4b18-a751-f245babf0bfa tempest-QuotasAdminTestV257-989393170 tempest-QuotasAdminTestV257-989393170-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:11.678057 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42fbd2ee-1e32-4b18-a751-f245babf0bfa tempest-QuotasAdminTestV257-989393170 tempest-QuotasAdminTestV257-989393170-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:11.679538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42fbd2ee-1e32-4b18-a751-f245babf0bfa tempest-QuotasAdminTestV257-989393170 tempest-QuotasAdminTestV257-989393170-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:11.679995 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42fbd2ee-1e32-4b18-a751-f245babf0bfa tempest-QuotasAdminTestV257-989393170 tempest-QuotasAdminTestV257-989393170-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:11.697456 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3997ab2c-31ac-42e9-a75b-26c8d0c86ac3 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:11.698274 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3997ab2c-31ac-42e9-a75b-26c8d0c86ac3 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:11.717496 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42fbd2ee-1e32-4b18-a751-f245babf0bfa tempest-QuotasAdminTestV257-989393170 tempest-QuotasAdminTestV257-989393170-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:11.718178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42fbd2ee-1e32-4b18-a751-f245babf0bfa tempest-QuotasAdminTestV257-989393170 tempest-QuotasAdminTestV257-989393170-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:11.719159 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42fbd2ee-1e32-4b18-a751-f245babf0bfa tempest-QuotasAdminTestV257-989393170 tempest-QuotasAdminTestV257-989393170-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:11.719776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42fbd2ee-1e32-4b18-a751-f245babf0bfa tempest-QuotasAdminTestV257-989393170 tempest-QuotasAdminTestV257-989393170-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:11.722401 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3997ab2c-31ac-42e9-a75b-26c8d0c86ac3 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:11.724600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3997ab2c-31ac-42e9-a75b-26c8d0c86ac3 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:11.725993 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3997ab2c-31ac-42e9-a75b-26c8d0c86ac3 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:11.727991 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3997ab2c-31ac-42e9-a75b-26c8d0c86ac3 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:11.738775 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:11.860656 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-42fbd2ee-1e32-4b18-a751-f245babf0bfa tempest-QuotasAdminTestV257-989393170 tempest-QuotasAdminTestV257-989393170-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-sets/8b26de11963648b397d990e0203f1a68?user_id=39f926d7b52d4d1d81ad13e12391d843" status: 200 len: 148 microversion: 2.57 time: 0.448498 Jul 25 14:26:11.870942 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 96/214] 10.222.0.88 () {62 vars in 1384 bytes} [Mon Jul 25 14:26:11 2022] PUT /compute/v2.1/os-quota-sets/8b26de11963648b397d990e0203f1a68?user_id=39f926d7b52d4d1d81ad13e12391d843 => generated 148 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 14:26:11.884805 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-881af94e-6318-4773-a972-b3f778e0eaf7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:11.887292 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-881af94e-6318-4773-a972-b3f778e0eaf7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: b7018cc7-3f35-47d3-a679-30b828faedab] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:11.901717 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-881af94e-6318-4773-a972-b3f778e0eaf7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:11.902605 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-881af94e-6318-4773-a972-b3f778e0eaf7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:11.905942 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-881af94e-6318-4773-a972-b3f778e0eaf7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:11.908328 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-881af94e-6318-4773-a972-b3f778e0eaf7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:12.001913 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3997ab2c-31ac-42e9-a75b-26c8d0c86ac3 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:12.009193 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3997ab2c-31ac-42e9-a75b-26c8d0c86ac3 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5" status: 200 len: 1411 microversion: 2.1 time: 0.316859 Jul 25 14:26:12.025030 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 119/215] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:11 2022] GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 => generated 1411 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:26:12.031940 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4d90d0bf-ea42-4cbf-91bb-a57335054364 tempest-QuotasAdminTestV257-989393170 tempest-QuotasAdminTestV257-989393170-project-admin] Calling method '.version_select at 0x7f46942a7160>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:12.339272 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4d90d0bf-ea42-4cbf-91bb-a57335054364 tempest-QuotasAdminTestV257-989393170 tempest-QuotasAdminTestV257-989393170-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/8b26de11963648b397d990e0203f1a68?user_id=39f926d7b52d4d1d81ad13e12391d843" status: 200 len: 190 microversion: 2.57 time: 0.313033 Jul 25 14:26:12.340447 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 120/216] 10.222.0.88 () {60 vars in 1364 bytes} [Mon Jul 25 14:26:12 2022] GET /compute/v2.1/os-quota-sets/8b26de11963648b397d990e0203f1a68?user_id=39f926d7b52d4d1d81ad13e12391d843 => generated 190 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:26:12.345267 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-287cbd3d-fe2f-4c88-b72b-482f36b3ff48 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:12.345752 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-287cbd3d-fe2f-4c88-b72b-482f36b3ff48 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 0a711946-8ed7-4475-a873-944011be17d6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:12.364763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-287cbd3d-fe2f-4c88-b72b-482f36b3ff48 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:12.365744 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-287cbd3d-fe2f-4c88-b72b-482f36b3ff48 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:12.366641 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-287cbd3d-fe2f-4c88-b72b-482f36b3ff48 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:12.367623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-287cbd3d-fe2f-4c88-b72b-482f36b3ff48 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:12.393079 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-881af94e-6318-4773-a972-b3f778e0eaf7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:12.400932 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-881af94e-6318-4773-a972-b3f778e0eaf7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab" status: 200 len: 1313 microversion: 2.1 time: 0.527853 Jul 25 14:26:12.406374 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 97/217] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:11 2022] GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab => generated 1313 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:12.416926 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-38b98495-7038-4198-8c49-b44641f49c1b req-c79274c7-3f8e-4176-a1eb-e2fdd59e8094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a711946-8ed7-4475-a873-944011be17d6", "name": "network-vif-plugged", "status": "completed", "tag": "bf389314-6fd9-4ecd-97b3-f759aab3353b"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:12.450382 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-38b98495-7038-4198-8c49-b44641f49c1b req-c79274c7-3f8e-4176-a1eb-e2fdd59e8094 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:12.454310 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-38b98495-7038-4198-8c49-b44641f49c1b req-c79274c7-3f8e-4176-a1eb-e2fdd59e8094 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:12.472395 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-38b98495-7038-4198-8c49-b44641f49c1b req-c79274c7-3f8e-4176-a1eb-e2fdd59e8094 service nova] Creating event network-vif-plugged:bf389314-6fd9-4ecd-97b3-f759aab3353b for instance 0a711946-8ed7-4475-a873-944011be17d6 on n-h2-846435-14 Jul 25 14:26:12.479346 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-38b98495-7038-4198-8c49-b44641f49c1b req-c79274c7-3f8e-4176-a1eb-e2fdd59e8094 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070708 Jul 25 14:26:12.480868 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 98/218] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:12.549413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-287cbd3d-fe2f-4c88-b72b-482f36b3ff48 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:12.557692 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-287cbd3d-fe2f-4c88-b72b-482f36b3ff48 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6" status: 200 len: 1319 microversion: 2.1 time: 0.216156 Jul 25 14:26:12.571471 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 121/219] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:12 2022] GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:12.576434 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1ca0ff85-a658-4119-a3bc-0b22c919f337 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:12.577046 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1ca0ff85-a658-4119-a3bc-0b22c919f337 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:12.583501 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1ca0ff85-a658-4119-a3bc-0b22c919f337 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:12.584201 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1ca0ff85-a658-4119-a3bc-0b22c919f337 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:12.585150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1ca0ff85-a658-4119-a3bc-0b22c919f337 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:12.585731 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1ca0ff85-a658-4119-a3bc-0b22c919f337 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:12.633589 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fb1b0e8a-6ce2-4485-9866-fa13dd7a2b7a tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] Calling method '.version_select at 0x7f46940560d0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:12.637028 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:12.637028 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:12.638401 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fb1b0e8a-6ce2-4485-9866-fa13dd7a2b7a tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:12.643760 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fb1b0e8a-6ce2-4485-9866-fa13dd7a2b7a tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:12.645145 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fb1b0e8a-6ce2-4485-9866-fa13dd7a2b7a tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:12.645940 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fb1b0e8a-6ce2-4485-9866-fa13dd7a2b7a tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:12.670179 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:12.725898 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fb1b0e8a-6ce2-4485-9866-fa13dd7a2b7a tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hosts" status: 200 len: 402 microversion: 2.1 time: 0.243514 Jul 25 14:26:12.726554 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 99/220] 10.222.0.88 () {58 vars in 1128 bytes} [Mon Jul 25 14:26:12 2022] GET /compute/v2.1/os-hosts => generated 402 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:12.814291 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1ca0ff85-a658-4119-a3bc-0b22c919f337 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2d52c9e2c48dd9e7502843844bf27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78221408d9ae4bdfb29ded35235d5287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:12.823762 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1ca0ff85-a658-4119-a3bc-0b22c919f337 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] 10.222.0.88 "GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f" status: 200 len: 1337 microversion: 2.1 time: 0.251058 Jul 25 14:26:12.825161 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 122/221] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:12 2022] GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f => generated 1337 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:13.015279 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2a34d716-25e1-4b3e-8087-65308aeb1593 tempest-HostsAdminNegativeTestJSON-1073874240 tempest-HostsAdminNegativeTestJSON-1073874240-project] Calling method '.version_select at 0x7f46940eb430>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:13.017967 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:13.017967 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:13.019280 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2a34d716-25e1-4b3e-8087-65308aeb1593 tempest-HostsAdminNegativeTestJSON-1073874240 tempest-HostsAdminNegativeTestJSON-1073874240-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '61ad6cbbe2cc48428dad47f553f2622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b834bddd2ca463686e24f8ceeae3b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:13.029821 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2a34d716-25e1-4b3e-8087-65308aeb1593 tempest-HostsAdminNegativeTestJSON-1073874240 tempest-HostsAdminNegativeTestJSON-1073874240-project] Request method failure captured: Jul 25 14:26:13.029821 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jul 25 14:26:13.029821 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:26:13.029821 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:26:13.029821 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:26:13.029821 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:26:13.029821 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:26:13.029821 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:26:13.029821 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:26:13.029821 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:13.029821 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qgD80IUd-yC8mr3_8c9CeE5F5Q06Gp5fvHXLwYyllyJgCOh0iDwU58ikkQ-pEBB9z2D10bghDVPkH6ndriKGro_3F2xp4v0d61Sy4oYj7dCYKYtiGk2FHaBPTmdrDyVNoZgGiNjDmqFah_aDPOQfKfyvx4ebsVbYjb-c3sfuwR_JLA Jul 25 14:26:13.029821 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:26:13.029821 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:26:13.029821 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:26:13.029821 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:26:13.029821 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:26:13.029821 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:26:13.029821 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 6b834bddd2ca463686e24f8ceeae3b62 Jul 25 14:26:13.029821 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1073874240 Jul 25 14:26:13.029821 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:26:13.029821 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:26:13.031071 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6b834bddd2ca463686e24f8ceeae3b62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6b834bddd2ca463686e24f8ceeae3b62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6b834bddd2ca463686e24f8ceeae3b62", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6b834bddd2ca463686e24f8ceeae3b62"}]}] Jul 25 14:26:13.031071 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1073874240 Jul 25 14:26:13.031071 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 6b834bddd2ca463686e24f8ceeae3b62 Jul 25 14:26:13.031071 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1073874240 Jul 25 14:26:13.031071 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-HostsAdminNegativeTestJSON-1073874240-project Jul 25 14:26:13.031071 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:26:13.031071 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:26:13.031071 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 61ad6cbbe2cc48428dad47f553f2622f Jul 25 14:26:13.031071 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1073874240-project Jul 25 14:26:13.031071 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:26:13.031071 n-d-846435-14 devstack@n-api.service[119303]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 25 14:26:13.031071 n-d-846435-14 devstack@n-api.service[119303]: action_args: {} Jul 25 14:26:13.031071 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:13.031787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.031787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:13.031787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:13.031787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:13.031787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:13.031787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:26:13.031787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:26:13.031787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 14:26:13.031787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:26:13.031787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:13.031787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:13.031787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jul 25 14:26:13.031787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jul 25 14:26:13.031787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 14:26:13.031787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 14:26:13.031787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 14:26:13.031787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 14:26:13.031787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:26:13.031787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:26:13.032888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:26:13.032888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:26:13.032888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 14:26:13.032888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 14:26:13.032888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 14:26:13.032888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 14:26:13.032888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 14:26:13.032888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 14:26:13.032888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 25 14:26:13.032888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.032888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:13.032888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.032888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.032888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:13.032888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:13.032888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 14:26:13.032888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 14:26:13.032888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 25 14:26:13.032888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.033893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2a34d716-25e1-4b3e-8087-65308aeb1593 tempest-HostsAdminNegativeTestJSON-1073874240 tempest-HostsAdminNegativeTestJSON-1073874240-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:13.033968 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-931aae37-1af9-4aba-b3eb-ad76e630f107 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:13.033968 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-931aae37-1af9-4aba-b3eb-ad76e630f107 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:13.034441 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2a34d716-25e1-4b3e-8087-65308aeb1593 tempest-HostsAdminNegativeTestJSON-1073874240 tempest-HostsAdminNegativeTestJSON-1073874240-project] 10.222.0.88 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.294521 Jul 25 14:26:13.034441 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 100/222] 10.222.0.88 () {58 vars in 1128 bytes} [Mon Jul 25 14:26:12 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 299 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:26:13.034580 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:13.041283 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-931aae37-1af9-4aba-b3eb-ad76e630f107 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:13.041821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-931aae37-1af9-4aba-b3eb-ad76e630f107 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:13.042770 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-931aae37-1af9-4aba-b3eb-ad76e630f107 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:13.043251 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-931aae37-1af9-4aba-b3eb-ad76e630f107 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:13.043798 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-78ac6684-4d0c-4b86-a5a7-94de7f26de5a tempest-HostsAdminNegativeTestJSON-1073874240 tempest-HostsAdminNegativeTestJSON-1073874240-project] Calling method '.version_select at 0x7f46944b9310>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:13.044821 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:13.044821 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:13.046883 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-78ac6684-4d0c-4b86-a5a7-94de7f26de5a tempest-HostsAdminNegativeTestJSON-1073874240 tempest-HostsAdminNegativeTestJSON-1073874240-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '61ad6cbbe2cc48428dad47f553f2622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b834bddd2ca463686e24f8ceeae3b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:13.049206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-78ac6684-4d0c-4b86-a5a7-94de7f26de5a tempest-HostsAdminNegativeTestJSON-1073874240 tempest-HostsAdminNegativeTestJSON-1073874240-project] Request method failure captured: Jul 25 14:26:13.049206 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/os-hosts/n-d-846435-14/reboot HTTP/1.1 Jul 25 14:26:13.049206 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:26:13.049206 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:26:13.049206 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:26:13.049206 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:26:13.049206 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:26:13.049206 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:26:13.049206 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:26:13.049206 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:13.049206 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qgD80IUd-yC8mr3_8c9CeE5F5Q06Gp5fvHXLwYyllyJgCOh0iDwU58ikkQ-pEBB9z2D10bghDVPkH6ndriKGro_3F2xp4v0d61Sy4oYj7dCYKYtiGk2FHaBPTmdrDyVNoZgGiNjDmqFah_aDPOQfKfyvx4ebsVbYjb-c3sfuwR_JLA Jul 25 14:26:13.049206 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:26:13.049206 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:26:13.049206 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:26:13.049206 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:26:13.049206 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:26:13.049206 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:26:13.049206 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 6b834bddd2ca463686e24f8ceeae3b62 Jul 25 14:26:13.049206 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1073874240 Jul 25 14:26:13.049206 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:26:13.049206 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:26:13.050359 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6b834bddd2ca463686e24f8ceeae3b62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6b834bddd2ca463686e24f8ceeae3b62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6b834bddd2ca463686e24f8ceeae3b62", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6b834bddd2ca463686e24f8ceeae3b62"}]}] Jul 25 14:26:13.050359 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1073874240 Jul 25 14:26:13.050359 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 6b834bddd2ca463686e24f8ceeae3b62 Jul 25 14:26:13.050359 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1073874240 Jul 25 14:26:13.050359 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-HostsAdminNegativeTestJSON-1073874240-project Jul 25 14:26:13.050359 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:26:13.050359 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:26:13.050359 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 61ad6cbbe2cc48428dad47f553f2622f Jul 25 14:26:13.050359 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1073874240-project Jul 25 14:26:13.050359 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:26:13.050359 n-d-846435-14 devstack@n-api.service[119303]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 25 14:26:13.050359 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'n-d-846435-14'} Jul 25 14:26:13.050359 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:13.051198 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.051198 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:13.051198 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:13.051198 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:13.051198 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:13.051198 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:26:13.051198 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:26:13.051198 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:13.051198 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:13.051198 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jul 25 14:26:13.051198 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jul 25 14:26:13.051198 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 14:26:13.051198 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 14:26:13.051198 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 14:26:13.051198 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 14:26:13.051198 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:26:13.051198 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:26:13.051198 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:26:13.051198 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:26:13.052221 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 14:26:13.052221 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 14:26:13.052221 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 14:26:13.052221 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 14:26:13.052221 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 14:26:13.052221 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 14:26:13.052221 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 25 14:26:13.052221 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.052221 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:13.052221 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.052221 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.052221 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:13.052221 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:13.052221 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 14:26:13.052221 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 14:26:13.052221 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 25 14:26:13.052221 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.055425 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-78ac6684-4d0c-4b86-a5a7-94de7f26de5a tempest-HostsAdminNegativeTestJSON-1073874240 tempest-HostsAdminNegativeTestJSON-1073874240-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:13.056800 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-78ac6684-4d0c-4b86-a5a7-94de7f26de5a tempest-HostsAdminNegativeTestJSON-1073874240 tempest-HostsAdminNegativeTestJSON-1073874240-project] 10.222.0.88 "GET /compute/v2.1/os-hosts/n-d-846435-14/reboot" status: 403 len: 111 microversion: 2.1 time: 0.019163 Jul 25 14:26:13.057816 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 101/223] 10.222.0.88 () {58 vars in 1191 bytes} [Mon Jul 25 14:26:13 2022] GET /compute/v2.1/os-hosts/n-d-846435-14/reboot => generated 111 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:26:13.067239 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3ef6490c-7bbc-4eba-adbd-b5739f1c5d1a tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] Calling method '.version_select at 0x7f46940cba60>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:13.081596 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-3ef6490c-7bbc-4eba-adbd-b5739f1c5d1a tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 14:26:13.087262 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3ef6490c-7bbc-4eba-adbd-b5739f1c5d1a tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] Request method failure captured: Jul 25 14:26:13.087262 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jul 25 14:26:13.087262 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:26:13.087262 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:26:13.087262 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:26:13.087262 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:26:13.087262 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:26:13.087262 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:26:13.087262 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:26:13.087262 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:13.087262 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qgEWGmpOjVjBJ86-F0oWwx5C3ue3T2JU_pZSiE1XsjZ0HgV-CntKu-RWCtODr4Y0D-1cjBsoLqD8mzfWCj_Nh0Hq1hSezcZA_IHrrb8j4nKS2qBFMB47vWl3-OMjZ_uhltvVyn6aOQzI5nvve0tL97qWp98HaRRnQ2oTKKzIqW_lbw Jul 25 14:26:13.087262 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:26:13.087262 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:26:13.087262 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:26:13.087262 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:26:13.087262 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:26:13.087262 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:26:13.087262 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 81c39817be0b4e429e90c6cda843b282 Jul 25 14:26:13.087262 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1170906488 Jul 25 14:26:13.087262 n-d-846435-14 devstack@n-api.service[119303]: X-Role: admin,reader,member Jul 25 14:26:13.087262 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: admin,reader,member Jul 25 14:26:13.088793 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/81c39817be0b4e429e90c6cda843b282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/81c39817be0b4e429e90c6cda843b282"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_81c39817be0b4e429e90c6cda843b282", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/81c39817be0b4e429e90c6cda843b282"}]}] Jul 25 14:26:13.088793 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1170906488 Jul 25 14:26:13.088793 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 81c39817be0b4e429e90c6cda843b282 Jul 25 14:26:13.088793 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1170906488 Jul 25 14:26:13.088793 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-HostsAdminNegativeTestJSON-1170906488-project-admin Jul 25 14:26:13.088793 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:26:13.088793 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:26:13.088793 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: d45c83a726b04697bfbf1fd156f0bd30 Jul 25 14:26:13.088793 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1170906488-project-admin Jul 25 14:26:13.088793 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:26:13.088793 n-d-846435-14 devstack@n-api.service[119303]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 14:26:13.088793 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'nonexistent_hostname'} Jul 25 14:26:13.088793 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:13.089501 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.089501 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 25 14:26:13.089501 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 25 14:26:13.089501 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 14:26:13.089501 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 14:26:13.089501 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:26:13.089501 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:26:13.089501 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:26:13.089501 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:26:13.089501 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 14:26:13.089501 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 14:26:13.089501 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 25 14:26:13.089501 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 25 14:26:13.089501 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:26:13.089501 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:26:13.089501 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 25 14:26:13.089501 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 25 14:26:13.089501 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 14:26:13.089501 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 14:26:13.090716 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 25 14:26:13.090716 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 25 14:26:13.090716 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 14:26:13.090716 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.090716 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:13.090716 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.090716 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.090716 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:13.090716 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:13.090716 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:13.090716 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:13.090716 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:26:13.090716 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:26:13.090716 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:13.090716 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:13.090716 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jul 25 14:26:13.090716 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jul 25 14:26:13.090716 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 25 14:26:13.090716 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:26:13.091943 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 14:26:13.091943 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.091943 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:13.091943 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.091943 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.091943 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:13.091943 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:13.091943 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:26:13.091943 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:26:13.091943 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 14:26:13.091943 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.091943 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3ef6490c-7bbc-4eba-adbd-b5739f1c5d1a tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:13.093139 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3ef6490c-7bbc-4eba-adbd-b5739f1c5d1a tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.029493 Jul 25 14:26:13.093947 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 102/224] 10.222.0.88 () {58 vars in 1212 bytes} [Mon Jul 25 14:26:13 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:26:13.105998 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d826055b-d3ec-4cec-b080-179096e4e4de tempest-HostsAdminNegativeTestJSON-1073874240 tempest-HostsAdminNegativeTestJSON-1073874240-project] Calling method '.version_select at 0x7f4687fa64c0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:13.106873 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:13.106873 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:13.108166 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d826055b-d3ec-4cec-b080-179096e4e4de tempest-HostsAdminNegativeTestJSON-1073874240 tempest-HostsAdminNegativeTestJSON-1073874240-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '61ad6cbbe2cc48428dad47f553f2622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b834bddd2ca463686e24f8ceeae3b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:13.109854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d826055b-d3ec-4cec-b080-179096e4e4de tempest-HostsAdminNegativeTestJSON-1073874240 tempest-HostsAdminNegativeTestJSON-1073874240-project] Request method failure captured: Jul 25 14:26:13.109854 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/os-hosts/n-d-846435-14 HTTP/1.1 Jul 25 14:26:13.109854 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:26:13.109854 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:26:13.109854 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:26:13.109854 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:26:13.109854 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:26:13.109854 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:26:13.109854 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:26:13.109854 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:13.109854 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qgD80IUd-yC8mr3_8c9CeE5F5Q06Gp5fvHXLwYyllyJgCOh0iDwU58ikkQ-pEBB9z2D10bghDVPkH6ndriKGro_3F2xp4v0d61Sy4oYj7dCYKYtiGk2FHaBPTmdrDyVNoZgGiNjDmqFah_aDPOQfKfyvx4ebsVbYjb-c3sfuwR_JLA Jul 25 14:26:13.109854 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:26:13.109854 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:26:13.109854 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:26:13.109854 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:26:13.109854 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:26:13.109854 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:26:13.109854 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 6b834bddd2ca463686e24f8ceeae3b62 Jul 25 14:26:13.109854 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1073874240 Jul 25 14:26:13.109854 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:26:13.109854 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:26:13.111191 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6b834bddd2ca463686e24f8ceeae3b62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6b834bddd2ca463686e24f8ceeae3b62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6b834bddd2ca463686e24f8ceeae3b62", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6b834bddd2ca463686e24f8ceeae3b62"}]}] Jul 25 14:26:13.111191 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1073874240 Jul 25 14:26:13.111191 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 6b834bddd2ca463686e24f8ceeae3b62 Jul 25 14:26:13.111191 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1073874240 Jul 25 14:26:13.111191 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-HostsAdminNegativeTestJSON-1073874240-project Jul 25 14:26:13.111191 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:26:13.111191 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:26:13.111191 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 61ad6cbbe2cc48428dad47f553f2622f Jul 25 14:26:13.111191 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1073874240-project Jul 25 14:26:13.111191 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:26:13.111191 n-d-846435-14 devstack@n-api.service[119303]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 25 14:26:13.111191 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'n-d-846435-14'} Jul 25 14:26:13.111191 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:13.111864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.111864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:13.111864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:13.111864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:13.111864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:13.111864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:26:13.111864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:26:13.111864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:13.111864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:13.111864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jul 25 14:26:13.111864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jul 25 14:26:13.111864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 14:26:13.111864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 14:26:13.111864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 14:26:13.111864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 14:26:13.111864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:26:13.111864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:26:13.111864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:26:13.111864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:26:13.113511 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 14:26:13.113511 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 14:26:13.113511 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 14:26:13.113511 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 14:26:13.113511 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 14:26:13.113511 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 14:26:13.113511 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 25 14:26:13.113511 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.113511 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:13.113511 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.113511 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.113511 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:13.113511 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:13.113511 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 14:26:13.113511 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 14:26:13.113511 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 25 14:26:13.113511 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.116976 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d826055b-d3ec-4cec-b080-179096e4e4de tempest-HostsAdminNegativeTestJSON-1073874240 tempest-HostsAdminNegativeTestJSON-1073874240-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:13.116976 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d826055b-d3ec-4cec-b080-179096e4e4de tempest-HostsAdminNegativeTestJSON-1073874240 tempest-HostsAdminNegativeTestJSON-1073874240-project] 10.222.0.88 "GET /compute/v2.1/os-hosts/n-d-846435-14" status: 403 len: 109 microversion: 2.1 time: 0.009990 Jul 25 14:26:13.116976 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 103/225] 10.222.0.88 () {58 vars in 1170 bytes} [Mon Jul 25 14:26:13 2022] GET /compute/v2.1/os-hosts/n-d-846435-14 => generated 109 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:26:13.122789 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-0a6ec27a-4db9-436b-bc85-cf5c3ad16207 req-4693c2df-3d22-490d-86e2-fee53e80a476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7018cc7-3f35-47d3-a679-30b828faedab", "tag": "3b2a879a-4843-4428-b75e-ce8d7edfab6d"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:13.135010 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-0a6ec27a-4db9-436b-bc85-cf5c3ad16207 req-4693c2df-3d22-490d-86e2-fee53e80a476 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:13.135460 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-0a6ec27a-4db9-436b-bc85-cf5c3ad16207 req-4693c2df-3d22-490d-86e2-fee53e80a476 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:13.149191 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-0a6ec27a-4db9-436b-bc85-cf5c3ad16207 req-4693c2df-3d22-490d-86e2-fee53e80a476 service nova] Creating event network-changed:3b2a879a-4843-4428-b75e-ce8d7edfab6d for instance b7018cc7-3f35-47d3-a679-30b828faedab on n-h2-846435-14 Jul 25 14:26:13.154457 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-0a6ec27a-4db9-436b-bc85-cf5c3ad16207 req-4693c2df-3d22-490d-86e2-fee53e80a476 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036450 Jul 25 14:26:13.156141 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 104/226] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:13.164507 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-73a401cd-0ca5-4bf3-8e5f-5f0135164305 tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] Calling method '.version_select at 0x7f46940cba60>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:13.165579 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:13.165579 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:13.172768 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-73a401cd-0ca5-4bf3-8e5f-5f0135164305 tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 14:26:13.174387 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-73a401cd-0ca5-4bf3-8e5f-5f0135164305 tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] Request method failure captured: Jul 25 14:26:13.174387 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 25 14:26:13.174387 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:26:13.174387 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:26:13.174387 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:26:13.174387 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:26:13.174387 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:26:13.174387 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:26:13.174387 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:26:13.174387 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:13.174387 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qgEWGmpOjVjBJ86-F0oWwx5C3ue3T2JU_pZSiE1XsjZ0HgV-CntKu-RWCtODr4Y0D-1cjBsoLqD8mzfWCj_Nh0Hq1hSezcZA_IHrrb8j4nKS2qBFMB47vWl3-OMjZ_uhltvVyn6aOQzI5nvve0tL97qWp98HaRRnQ2oTKKzIqW_lbw Jul 25 14:26:13.174387 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:26:13.174387 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:26:13.174387 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:26:13.174387 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:26:13.174387 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:26:13.174387 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:26:13.174387 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 81c39817be0b4e429e90c6cda843b282 Jul 25 14:26:13.174387 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1170906488 Jul 25 14:26:13.174387 n-d-846435-14 devstack@n-api.service[119303]: X-Role: admin,reader,member Jul 25 14:26:13.174387 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: admin,reader,member Jul 25 14:26:13.175523 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/81c39817be0b4e429e90c6cda843b282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/81c39817be0b4e429e90c6cda843b282"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_81c39817be0b4e429e90c6cda843b282", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/81c39817be0b4e429e90c6cda843b282"}]}] Jul 25 14:26:13.175523 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1170906488 Jul 25 14:26:13.175523 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 81c39817be0b4e429e90c6cda843b282 Jul 25 14:26:13.175523 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1170906488 Jul 25 14:26:13.175523 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-HostsAdminNegativeTestJSON-1170906488-project-admin Jul 25 14:26:13.175523 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:26:13.175523 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:26:13.175523 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: d45c83a726b04697bfbf1fd156f0bd30 Jul 25 14:26:13.175523 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1170906488-project-admin Jul 25 14:26:13.175523 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:26:13.175523 n-d-846435-14 devstack@n-api.service[119303]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 14:26:13.175523 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'nonexistent_hostname'} Jul 25 14:26:13.175523 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:13.176252 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.176252 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jul 25 14:26:13.176252 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 25 14:26:13.176252 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:26:13.176252 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:26:13.176252 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 25 14:26:13.176252 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 25 14:26:13.176252 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 14:26:13.176252 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 14:26:13.176252 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 25 14:26:13.176252 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 25 14:26:13.176252 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 14:26:13.176252 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.176252 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:13.176252 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.176252 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.176252 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:13.176252 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:13.176252 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:13.177302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:13.177302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:26:13.177302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:26:13.177302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:13.177302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:13.177302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jul 25 14:26:13.177302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:26:13.177302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 14:26:13.177302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.177302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:13.177302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.177302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.177302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:13.177302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:13.177302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:26:13.177302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:26:13.177302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 14:26:13.177302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.178243 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-73a401cd-0ca5-4bf3-8e5f-5f0135164305 tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:13.178243 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-73a401cd-0ca5-4bf3-8e5f-5f0135164305 tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.016617 Jul 25 14:26:13.178243 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 105/227] 10.222.0.88 () {58 vars in 1191 bytes} [Mon Jul 25 14:26:13 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:26:13.188521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b29057b3-048f-4a18-bb63-fe0215324e8e tempest-HostsAdminNegativeTestJSON-1073874240 tempest-HostsAdminNegativeTestJSON-1073874240-project] Calling method '.version_select at 0x7f4687fa6d30>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:13.189483 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:13.189483 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:13.190615 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b29057b3-048f-4a18-bb63-fe0215324e8e tempest-HostsAdminNegativeTestJSON-1073874240 tempest-HostsAdminNegativeTestJSON-1073874240-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '61ad6cbbe2cc48428dad47f553f2622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b834bddd2ca463686e24f8ceeae3b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:13.192792 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b29057b3-048f-4a18-bb63-fe0215324e8e tempest-HostsAdminNegativeTestJSON-1073874240 tempest-HostsAdminNegativeTestJSON-1073874240-project] Request method failure captured: Jul 25 14:26:13.192792 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/os-hosts/n-d-846435-14/shutdown HTTP/1.1 Jul 25 14:26:13.192792 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:26:13.192792 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:26:13.192792 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:26:13.192792 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:26:13.192792 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:26:13.192792 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:26:13.192792 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:26:13.192792 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:13.192792 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qgD80IUd-yC8mr3_8c9CeE5F5Q06Gp5fvHXLwYyllyJgCOh0iDwU58ikkQ-pEBB9z2D10bghDVPkH6ndriKGro_3F2xp4v0d61Sy4oYj7dCYKYtiGk2FHaBPTmdrDyVNoZgGiNjDmqFah_aDPOQfKfyvx4ebsVbYjb-c3sfuwR_JLA Jul 25 14:26:13.192792 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:26:13.192792 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:26:13.192792 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:26:13.192792 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:26:13.192792 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:26:13.192792 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:26:13.192792 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 6b834bddd2ca463686e24f8ceeae3b62 Jul 25 14:26:13.192792 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1073874240 Jul 25 14:26:13.192792 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:26:13.192792 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:26:13.194245 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6b834bddd2ca463686e24f8ceeae3b62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6b834bddd2ca463686e24f8ceeae3b62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6b834bddd2ca463686e24f8ceeae3b62", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6b834bddd2ca463686e24f8ceeae3b62"}]}] Jul 25 14:26:13.194245 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1073874240 Jul 25 14:26:13.194245 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 6b834bddd2ca463686e24f8ceeae3b62 Jul 25 14:26:13.194245 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1073874240 Jul 25 14:26:13.194245 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-HostsAdminNegativeTestJSON-1073874240-project Jul 25 14:26:13.194245 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:26:13.194245 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:26:13.194245 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 61ad6cbbe2cc48428dad47f553f2622f Jul 25 14:26:13.194245 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1073874240-project Jul 25 14:26:13.194245 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:26:13.194245 n-d-846435-14 devstack@n-api.service[119303]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 25 14:26:13.194245 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'n-d-846435-14'} Jul 25 14:26:13.194245 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:13.195049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.195049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:13.195049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:13.195049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:13.195049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:13.195049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:26:13.195049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:26:13.195049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:13.195049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:13.195049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jul 25 14:26:13.195049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jul 25 14:26:13.195049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 14:26:13.195049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 14:26:13.195049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 14:26:13.195049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 14:26:13.195049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:26:13.195049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:26:13.195049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:26:13.195049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:26:13.196056 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 14:26:13.196056 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 14:26:13.196056 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 14:26:13.196056 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 14:26:13.196056 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 14:26:13.196056 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 14:26:13.196056 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 25 14:26:13.196056 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.196056 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:13.196056 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.196056 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.196056 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:13.196056 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:13.196056 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 14:26:13.196056 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 14:26:13.196056 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 25 14:26:13.196056 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.196946 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b29057b3-048f-4a18-bb63-fe0215324e8e tempest-HostsAdminNegativeTestJSON-1073874240 tempest-HostsAdminNegativeTestJSON-1073874240-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:13.196946 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b29057b3-048f-4a18-bb63-fe0215324e8e tempest-HostsAdminNegativeTestJSON-1073874240 tempest-HostsAdminNegativeTestJSON-1073874240-project] 10.222.0.88 "GET /compute/v2.1/os-hosts/n-d-846435-14/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.010233 Jul 25 14:26:13.196946 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 106/228] 10.222.0.88 () {58 vars in 1197 bytes} [Mon Jul 25 14:26:13 2022] GET /compute/v2.1/os-hosts/n-d-846435-14/shutdown => generated 113 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:26:13.204860 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-50c1b9ce-8ec8-421e-a002-07e0156e3465 tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] Calling method '.version_select at 0x7f469409e280>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:13.211150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-931aae37-1af9-4aba-b3eb-ad76e630f107 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:13.220052 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-931aae37-1af9-4aba-b3eb-ad76e630f107 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5" status: 200 len: 1411 microversion: 2.1 time: 0.192320 Jul 25 14:26:13.220620 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 123/229] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:13 2022] GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 => generated 1411 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:26:13.224963 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-50c1b9ce-8ec8-421e-a002-07e0156e3465 tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 14:26:13.226425 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-50c1b9ce-8ec8-421e-a002-07e0156e3465 tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] Request method failure captured: Jul 25 14:26:13.226425 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jul 25 14:26:13.226425 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:26:13.226425 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:26:13.226425 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:26:13.226425 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:26:13.226425 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:26:13.226425 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:26:13.226425 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:26:13.226425 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:13.226425 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qgEWGmpOjVjBJ86-F0oWwx5C3ue3T2JU_pZSiE1XsjZ0HgV-CntKu-RWCtODr4Y0D-1cjBsoLqD8mzfWCj_Nh0Hq1hSezcZA_IHrrb8j4nKS2qBFMB47vWl3-OMjZ_uhltvVyn6aOQzI5nvve0tL97qWp98HaRRnQ2oTKKzIqW_lbw Jul 25 14:26:13.226425 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:26:13.226425 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:26:13.226425 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:26:13.226425 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:26:13.226425 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:26:13.226425 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:26:13.226425 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 81c39817be0b4e429e90c6cda843b282 Jul 25 14:26:13.226425 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1170906488 Jul 25 14:26:13.226425 n-d-846435-14 devstack@n-api.service[119303]: X-Role: admin,reader,member Jul 25 14:26:13.226425 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: admin,reader,member Jul 25 14:26:13.227545 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/81c39817be0b4e429e90c6cda843b282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/81c39817be0b4e429e90c6cda843b282"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_81c39817be0b4e429e90c6cda843b282", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/81c39817be0b4e429e90c6cda843b282"}]}] Jul 25 14:26:13.227545 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1170906488 Jul 25 14:26:13.227545 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 81c39817be0b4e429e90c6cda843b282 Jul 25 14:26:13.227545 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1170906488 Jul 25 14:26:13.227545 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-HostsAdminNegativeTestJSON-1170906488-project-admin Jul 25 14:26:13.227545 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:26:13.227545 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:26:13.227545 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: d45c83a726b04697bfbf1fd156f0bd30 Jul 25 14:26:13.227545 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1170906488-project-admin Jul 25 14:26:13.227545 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:26:13.227545 n-d-846435-14 devstack@n-api.service[119303]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 14:26:13.227545 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'nonexistent_hostname'} Jul 25 14:26:13.227545 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:13.228281 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.228281 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 25 14:26:13.228281 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 25 14:26:13.228281 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 14:26:13.228281 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 14:26:13.228281 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:26:13.228281 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:26:13.228281 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:26:13.228281 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:26:13.228281 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 14:26:13.228281 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 14:26:13.228281 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 25 14:26:13.228281 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 25 14:26:13.228281 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:26:13.228281 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:26:13.228281 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 25 14:26:13.228281 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 25 14:26:13.228281 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 14:26:13.228281 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 14:26:13.229327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 25 14:26:13.229327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 25 14:26:13.229327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 14:26:13.229327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.229327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:13.229327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.229327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.229327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:13.229327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:13.229327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:13.229327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:13.229327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:26:13.229327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:26:13.229327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:13.229327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:13.229327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jul 25 14:26:13.229327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jul 25 14:26:13.229327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 25 14:26:13.229327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:26:13.230297 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 14:26:13.230297 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.230297 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:13.230297 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.230297 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.230297 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:13.230297 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:13.230297 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:26:13.230297 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:26:13.230297 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 14:26:13.230297 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.230297 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-50c1b9ce-8ec8-421e-a002-07e0156e3465 tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:13.230297 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-50c1b9ce-8ec8-421e-a002-07e0156e3465 tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.027737 Jul 25 14:26:13.230297 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 107/230] 10.222.0.88 () {58 vars in 1218 bytes} [Mon Jul 25 14:26:13 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:26:13.240479 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e0ffc94c-01ea-4796-aa96-b07c748d095a tempest-HostsAdminNegativeTestJSON-1073874240 tempest-HostsAdminNegativeTestJSON-1073874240-project] Calling method '.version_select at 0x7f46942809d0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:13.241358 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:13.241358 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:13.242572 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e0ffc94c-01ea-4796-aa96-b07c748d095a tempest-HostsAdminNegativeTestJSON-1073874240 tempest-HostsAdminNegativeTestJSON-1073874240-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '61ad6cbbe2cc48428dad47f553f2622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b834bddd2ca463686e24f8ceeae3b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:13.244995 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e0ffc94c-01ea-4796-aa96-b07c748d095a tempest-HostsAdminNegativeTestJSON-1073874240 tempest-HostsAdminNegativeTestJSON-1073874240-project] Request method failure captured: Jul 25 14:26:13.244995 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/os-hosts/n-d-846435-14/startup HTTP/1.1 Jul 25 14:26:13.244995 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:26:13.244995 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:26:13.244995 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:26:13.244995 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:26:13.244995 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:26:13.244995 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:26:13.244995 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:26:13.244995 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:13.244995 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qgD80IUd-yC8mr3_8c9CeE5F5Q06Gp5fvHXLwYyllyJgCOh0iDwU58ikkQ-pEBB9z2D10bghDVPkH6ndriKGro_3F2xp4v0d61Sy4oYj7dCYKYtiGk2FHaBPTmdrDyVNoZgGiNjDmqFah_aDPOQfKfyvx4ebsVbYjb-c3sfuwR_JLA Jul 25 14:26:13.244995 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:26:13.244995 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:26:13.244995 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:26:13.244995 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:26:13.244995 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:26:13.244995 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:26:13.244995 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 6b834bddd2ca463686e24f8ceeae3b62 Jul 25 14:26:13.244995 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1073874240 Jul 25 14:26:13.244995 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:26:13.244995 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:26:13.246199 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6b834bddd2ca463686e24f8ceeae3b62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6b834bddd2ca463686e24f8ceeae3b62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6b834bddd2ca463686e24f8ceeae3b62", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6b834bddd2ca463686e24f8ceeae3b62"}]}] Jul 25 14:26:13.246199 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1073874240 Jul 25 14:26:13.246199 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 6b834bddd2ca463686e24f8ceeae3b62 Jul 25 14:26:13.246199 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1073874240 Jul 25 14:26:13.246199 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-HostsAdminNegativeTestJSON-1073874240-project Jul 25 14:26:13.246199 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:26:13.246199 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:26:13.246199 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 61ad6cbbe2cc48428dad47f553f2622f Jul 25 14:26:13.246199 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1073874240-project Jul 25 14:26:13.246199 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:26:13.246199 n-d-846435-14 devstack@n-api.service[119304]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 25 14:26:13.246199 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'n-d-846435-14'} Jul 25 14:26:13.246199 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:13.246919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.246919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:13.246919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:13.246919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:13.246919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:13.246919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:26:13.246919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:26:13.246919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:13.246919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:13.246919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jul 25 14:26:13.246919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jul 25 14:26:13.246919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 14:26:13.246919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 14:26:13.246919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 14:26:13.246919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 14:26:13.246919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:26:13.246919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:26:13.246919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:26:13.246919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:26:13.248203 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 14:26:13.248203 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 14:26:13.248203 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 14:26:13.248203 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 14:26:13.248203 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 14:26:13.248203 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 14:26:13.248203 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 25 14:26:13.248203 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.248203 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:13.248203 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.248203 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.248203 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:13.248203 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:13.248203 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 14:26:13.248203 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 14:26:13.248203 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 25 14:26:13.248203 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.249447 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e0ffc94c-01ea-4796-aa96-b07c748d095a tempest-HostsAdminNegativeTestJSON-1073874240 tempest-HostsAdminNegativeTestJSON-1073874240-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:13.249447 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e0ffc94c-01ea-4796-aa96-b07c748d095a tempest-HostsAdminNegativeTestJSON-1073874240 tempest-HostsAdminNegativeTestJSON-1073874240-project] 10.222.0.88 "GET /compute/v2.1/os-hosts/n-d-846435-14/startup" status: 403 len: 110 microversion: 2.1 time: 0.009947 Jul 25 14:26:13.249447 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 124/231] 10.222.0.88 () {58 vars in 1194 bytes} [Mon Jul 25 14:26:13 2022] GET /compute/v2.1/os-hosts/n-d-846435-14/startup => generated 110 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:26:13.257194 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8cb3c5a2-688e-41bb-aec1-09cfb65ca672 tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] Calling method '.version_select at 0x7f46940cba60>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:13.257979 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:13.257979 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:13.266059 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-8cb3c5a2-688e-41bb-aec1-09cfb65ca672 tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 14:26:13.268659 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8cb3c5a2-688e-41bb-aec1-09cfb65ca672 tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] Request method failure captured: Jul 25 14:26:13.268659 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jul 25 14:26:13.268659 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:26:13.268659 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:26:13.268659 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:26:13.268659 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:26:13.268659 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:26:13.268659 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:26:13.268659 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:26:13.268659 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:13.268659 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qgEWGmpOjVjBJ86-F0oWwx5C3ue3T2JU_pZSiE1XsjZ0HgV-CntKu-RWCtODr4Y0D-1cjBsoLqD8mzfWCj_Nh0Hq1hSezcZA_IHrrb8j4nKS2qBFMB47vWl3-OMjZ_uhltvVyn6aOQzI5nvve0tL97qWp98HaRRnQ2oTKKzIqW_lbw Jul 25 14:26:13.268659 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:26:13.268659 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:26:13.268659 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:26:13.268659 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:26:13.268659 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:26:13.268659 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:26:13.268659 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 81c39817be0b4e429e90c6cda843b282 Jul 25 14:26:13.268659 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1170906488 Jul 25 14:26:13.268659 n-d-846435-14 devstack@n-api.service[119303]: X-Role: admin,reader,member Jul 25 14:26:13.268659 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: admin,reader,member Jul 25 14:26:13.270551 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/81c39817be0b4e429e90c6cda843b282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/81c39817be0b4e429e90c6cda843b282"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_81c39817be0b4e429e90c6cda843b282", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/81c39817be0b4e429e90c6cda843b282"}]}] Jul 25 14:26:13.270551 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1170906488 Jul 25 14:26:13.270551 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 81c39817be0b4e429e90c6cda843b282 Jul 25 14:26:13.270551 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1170906488 Jul 25 14:26:13.270551 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-HostsAdminNegativeTestJSON-1170906488-project-admin Jul 25 14:26:13.270551 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:26:13.270551 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:26:13.270551 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: d45c83a726b04697bfbf1fd156f0bd30 Jul 25 14:26:13.270551 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1170906488-project-admin Jul 25 14:26:13.270551 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:26:13.270551 n-d-846435-14 devstack@n-api.service[119303]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 14:26:13.270551 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'nonexistent_hostname'} Jul 25 14:26:13.270551 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:13.271360 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.271360 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 25 14:26:13.271360 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 25 14:26:13.271360 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 14:26:13.271360 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 14:26:13.271360 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:26:13.271360 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:26:13.271360 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:26:13.271360 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:26:13.271360 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 14:26:13.271360 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 14:26:13.271360 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 25 14:26:13.271360 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 25 14:26:13.271360 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:26:13.271360 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:26:13.271360 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 25 14:26:13.271360 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 25 14:26:13.271360 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 14:26:13.271360 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 14:26:13.272446 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 25 14:26:13.272446 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 25 14:26:13.272446 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 14:26:13.272446 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.272446 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:13.272446 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.272446 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.272446 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:13.272446 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:13.272446 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:13.272446 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:13.272446 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:26:13.272446 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:26:13.272446 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:13.272446 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:13.272446 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jul 25 14:26:13.272446 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jul 25 14:26:13.272446 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 25 14:26:13.272446 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:26:13.273401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 14:26:13.273401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.273401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:13.273401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.273401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.273401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:13.273401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:13.273401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:26:13.273401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:26:13.273401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 14:26:13.273401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.273401 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8cb3c5a2-688e-41bb-aec1-09cfb65ca672 tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:13.274019 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8cb3c5a2-688e-41bb-aec1-09cfb65ca672 tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.020241 Jul 25 14:26:13.278245 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 108/232] 10.222.0.88 () {58 vars in 1215 bytes} [Mon Jul 25 14:26:13 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:26:13.283948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0952b9b7-d82b-4291-8a66-37691b59f63f tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] Action: 'update', calling method: .version_select at 0x7f46942a7550>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:13.295055 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0952b9b7-d82b-4291-8a66-37691b59f63f tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] Request method failure captured: Jul 25 14:26:13.295055 n-d-846435-14 devstack@n-api.service[119304]: request: PUT /compute/v2.1/os-hosts/n-d-846435-14 HTTP/1.1 Jul 25 14:26:13.295055 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:26:13.295055 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:26:13.295055 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:26:13.295055 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 51 Jul 25 14:26:13.295055 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:26:13.295055 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:26:13.295055 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:26:13.295055 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:13.295055 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qgEWGmpOjVjBJ86-F0oWwx5C3ue3T2JU_pZSiE1XsjZ0HgV-CntKu-RWCtODr4Y0D-1cjBsoLqD8mzfWCj_Nh0Hq1hSezcZA_IHrrb8j4nKS2qBFMB47vWl3-OMjZ_uhltvVyn6aOQzI5nvve0tL97qWp98HaRRnQ2oTKKzIqW_lbw Jul 25 14:26:13.295055 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:26:13.295055 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:26:13.295055 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:26:13.295055 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:26:13.295055 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:26:13.295055 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:26:13.295055 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 81c39817be0b4e429e90c6cda843b282 Jul 25 14:26:13.295055 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1170906488 Jul 25 14:26:13.295055 n-d-846435-14 devstack@n-api.service[119304]: X-Role: admin,reader,member Jul 25 14:26:13.295055 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: admin,reader,member Jul 25 14:26:13.296625 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/81c39817be0b4e429e90c6cda843b282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/81c39817be0b4e429e90c6cda843b282"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_81c39817be0b4e429e90c6cda843b282", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/81c39817be0b4e429e90c6cda843b282"}]}] Jul 25 14:26:13.296625 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1170906488 Jul 25 14:26:13.296625 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 81c39817be0b4e429e90c6cda843b282 Jul 25 14:26:13.296625 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1170906488 Jul 25 14:26:13.296625 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-HostsAdminNegativeTestJSON-1170906488-project-admin Jul 25 14:26:13.296625 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:26:13.296625 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:26:13.296625 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: d45c83a726b04697bfbf1fd156f0bd30 Jul 25 14:26:13.296625 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1170906488-project-admin Jul 25 14:26:13.296625 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:26:13.296625 n-d-846435-14 devstack@n-api.service[119304]: {"status": "enable", "maintenance_mode": "invalid"} Jul 25 14:26:13.296625 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:26:13.296625 n-d-846435-14 devstack@n-api.service[119304]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 25 14:26:13.297398 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'n-d-846435-14', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jul 25 14:26:13.297398 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:13.297398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.297398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:26:13.297398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:26:13.297398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:26:13.297398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:26:13.297398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 25 14:26:13.297398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.297398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jul 25 14:26:13.297398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 25 14:26:13.297398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'disable', Jul 25 14:26:13.297398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'Enable', Jul 25 14:26:13.297398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'Disable', Jul 25 14:26:13.297398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 25 14:26:13.297398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 25 14:26:13.297398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 25 14:26:13.297398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.297398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi On instance: Jul 25 14:26:13.297398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'invalid' Jul 25 14:26:13.297398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.297398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:13.297398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.297398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.297398 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:13.298683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:13.298683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:13.298683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:13.298683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:26:13.298683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:26:13.298683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:13.298683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:13.298683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:26:13.298683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:26:13.298683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:26:13.298683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:26:13.298683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:26:13.298683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:26:13.298683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 25 14:26:13.298683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.298683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:13.298683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.298683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.298683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:13.301879 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:13.301879 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:26:13.301879 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:26:13.301879 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 25 14:26:13.301879 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.301879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0952b9b7-d82b-4291-8a66-37691b59f63f tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:13.301879 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0952b9b7-d82b-4291-8a66-37691b59f63f tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-hosts/n-d-846435-14" status: 400 len: 199 microversion: 2.1 time: 0.017366 Jul 25 14:26:13.303696 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 125/233] 10.222.0.88 () {60 vars in 1190 bytes} [Mon Jul 25 14:26:13 2022] PUT /compute/v2.1/os-hosts/n-d-846435-14 => generated 199 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:26:13.309305 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e8b7c8e3-6814-4049-a252-75450f074607 tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] Action: 'update', calling method: .version_select at 0x7f4687fa6790>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:13.315635 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e8b7c8e3-6814-4049-a252-75450f074607 tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] Request method failure captured: Jul 25 14:26:13.315635 n-d-846435-14 devstack@n-api.service[119303]: request: PUT /compute/v2.1/os-hosts/n-d-846435-14 HTTP/1.1 Jul 25 14:26:13.315635 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:26:13.315635 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:26:13.315635 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:26:13.315635 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 51 Jul 25 14:26:13.315635 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:26:13.315635 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:26:13.315635 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:26:13.315635 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:13.315635 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qgEWGmpOjVjBJ86-F0oWwx5C3ue3T2JU_pZSiE1XsjZ0HgV-CntKu-RWCtODr4Y0D-1cjBsoLqD8mzfWCj_Nh0Hq1hSezcZA_IHrrb8j4nKS2qBFMB47vWl3-OMjZ_uhltvVyn6aOQzI5nvve0tL97qWp98HaRRnQ2oTKKzIqW_lbw Jul 25 14:26:13.315635 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:26:13.315635 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:26:13.315635 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:26:13.315635 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:26:13.315635 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:26:13.315635 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:26:13.315635 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 81c39817be0b4e429e90c6cda843b282 Jul 25 14:26:13.315635 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1170906488 Jul 25 14:26:13.315635 n-d-846435-14 devstack@n-api.service[119303]: X-Role: admin,reader,member Jul 25 14:26:13.315635 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: admin,reader,member Jul 25 14:26:13.316993 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/81c39817be0b4e429e90c6cda843b282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/81c39817be0b4e429e90c6cda843b282"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_81c39817be0b4e429e90c6cda843b282", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/81c39817be0b4e429e90c6cda843b282"}]}] Jul 25 14:26:13.316993 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1170906488 Jul 25 14:26:13.316993 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 81c39817be0b4e429e90c6cda843b282 Jul 25 14:26:13.316993 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1170906488 Jul 25 14:26:13.316993 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-HostsAdminNegativeTestJSON-1170906488-project-admin Jul 25 14:26:13.316993 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:26:13.316993 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:26:13.316993 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: d45c83a726b04697bfbf1fd156f0bd30 Jul 25 14:26:13.316993 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1170906488-project-admin Jul 25 14:26:13.316993 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:26:13.316993 n-d-846435-14 devstack@n-api.service[119303]: {"status": "invalid", "maintenance_mode": "enable"} Jul 25 14:26:13.316993 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:26:13.316993 n-d-846435-14 devstack@n-api.service[119303]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 25 14:26:13.317697 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'n-d-846435-14', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jul 25 14:26:13.317697 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:13.317697 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.317697 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:26:13.317697 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:26:13.317697 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:26:13.317697 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:26:13.317697 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 25 14:26:13.317697 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.317697 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jul 25 14:26:13.317697 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 25 14:26:13.317697 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'disable', Jul 25 14:26:13.317697 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'Enable', Jul 25 14:26:13.317697 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'Disable', Jul 25 14:26:13.317697 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 25 14:26:13.317697 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 25 14:26:13.317697 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 25 14:26:13.317697 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.317697 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi On instance: Jul 25 14:26:13.317697 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'invalid' Jul 25 14:26:13.317697 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.317697 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:13.317697 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.317697 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.317697 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:13.318950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:13.318950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:13.318950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:13.318950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:26:13.318950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:26:13.318950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:13.318950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:13.318950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:26:13.318950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:26:13.318950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:26:13.318950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:26:13.318950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:26:13.318950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:26:13.318950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 25 14:26:13.318950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.318950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:13.318950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.318950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.318950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:13.319932 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:13.319932 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:26:13.319932 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:26:13.319932 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 25 14:26:13.319932 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.319932 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e8b7c8e3-6814-4049-a252-75450f074607 tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:13.319932 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e8b7c8e3-6814-4049-a252-75450f074607 tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-hosts/n-d-846435-14" status: 400 len: 189 microversion: 2.1 time: 0.012883 Jul 25 14:26:13.319932 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 109/234] 10.222.0.88 () {60 vars in 1190 bytes} [Mon Jul 25 14:26:13 2022] PUT /compute/v2.1/os-hosts/n-d-846435-14 => generated 189 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 14:26:13.328189 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-eda86d10-f923-454c-8f59-d1870b87b074 tempest-HostsAdminNegativeTestJSON-1073874240 tempest-HostsAdminNegativeTestJSON-1073874240-project] Action: 'update', calling method: .version_select at 0x7f46942d30d0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:13.330669 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:13.330669 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:13.331768 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-eda86d10-f923-454c-8f59-d1870b87b074 tempest-HostsAdminNegativeTestJSON-1073874240 tempest-HostsAdminNegativeTestJSON-1073874240-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '61ad6cbbe2cc48428dad47f553f2622f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b834bddd2ca463686e24f8ceeae3b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:13.333413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-eda86d10-f923-454c-8f59-d1870b87b074 tempest-HostsAdminNegativeTestJSON-1073874240 tempest-HostsAdminNegativeTestJSON-1073874240-project] Request method failure captured: Jul 25 14:26:13.333413 n-d-846435-14 devstack@n-api.service[119304]: request: PUT /compute/v2.1/os-hosts/n-d-846435-14 HTTP/1.1 Jul 25 14:26:13.333413 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:26:13.333413 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:26:13.333413 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:26:13.333413 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 50 Jul 25 14:26:13.333413 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:26:13.333413 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:26:13.333413 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:26:13.333413 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:13.333413 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qgD80IUd-yC8mr3_8c9CeE5F5Q06Gp5fvHXLwYyllyJgCOh0iDwU58ikkQ-pEBB9z2D10bghDVPkH6ndriKGro_3F2xp4v0d61Sy4oYj7dCYKYtiGk2FHaBPTmdrDyVNoZgGiNjDmqFah_aDPOQfKfyvx4ebsVbYjb-c3sfuwR_JLA Jul 25 14:26:13.333413 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:26:13.333413 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:26:13.333413 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:26:13.333413 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:26:13.333413 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:26:13.333413 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:26:13.333413 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 6b834bddd2ca463686e24f8ceeae3b62 Jul 25 14:26:13.333413 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1073874240 Jul 25 14:26:13.333413 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:26:13.333413 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:26:13.334581 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6b834bddd2ca463686e24f8ceeae3b62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6b834bddd2ca463686e24f8ceeae3b62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6b834bddd2ca463686e24f8ceeae3b62", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6b834bddd2ca463686e24f8ceeae3b62"}]}] Jul 25 14:26:13.334581 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1073874240 Jul 25 14:26:13.334581 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 6b834bddd2ca463686e24f8ceeae3b62 Jul 25 14:26:13.334581 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1073874240 Jul 25 14:26:13.334581 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-HostsAdminNegativeTestJSON-1073874240-project Jul 25 14:26:13.334581 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:26:13.334581 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:26:13.334581 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 61ad6cbbe2cc48428dad47f553f2622f Jul 25 14:26:13.334581 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1073874240-project Jul 25 14:26:13.334581 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:26:13.334581 n-d-846435-14 devstack@n-api.service[119304]: {"status": "enable", "maintenance_mode": "enable"} Jul 25 14:26:13.334581 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:26:13.334581 n-d-846435-14 devstack@n-api.service[119304]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 25 14:26:13.334581 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'n-d-846435-14', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 25 14:26:13.335348 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:13.335348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.335348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:13.335348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:13.335348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:13.335348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:13.335348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:26:13.335348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:26:13.335348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:13.335348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:13.335348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:26:13.335348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:26:13.335348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jul 25 14:26:13.335348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jul 25 14:26:13.335348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 14:26:13.335348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 14:26:13.335348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 14:26:13.335348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 14:26:13.335348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:26:13.335348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:26:13.336727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:26:13.336727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:26:13.336727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 14:26:13.336727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 14:26:13.336727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 14:26:13.336727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 14:26:13.336727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 14:26:13.336727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 14:26:13.336727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 25 14:26:13.336727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.336727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:13.336727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.336727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.336727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:13.336727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:13.336727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 14:26:13.336727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 14:26:13.336727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 25 14:26:13.336727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.337782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-eda86d10-f923-454c-8f59-d1870b87b074 tempest-HostsAdminNegativeTestJSON-1073874240 tempest-HostsAdminNegativeTestJSON-1073874240-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:13.337782 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-eda86d10-f923-454c-8f59-d1870b87b074 tempest-HostsAdminNegativeTestJSON-1073874240 tempest-HostsAdminNegativeTestJSON-1073874240-project] 10.222.0.88 "PUT /compute/v2.1/os-hosts/n-d-846435-14" status: 403 len: 111 microversion: 2.1 time: 0.011585 Jul 25 14:26:13.339639 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 126/235] 10.222.0.88 () {60 vars in 1190 bytes} [Mon Jul 25 14:26:13 2022] PUT /compute/v2.1/os-hosts/n-d-846435-14 => generated 111 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:26:13.344460 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-29f6291f-34c3-468f-a4cb-ea68f284b397 tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] Action: 'update', calling method: .version_select at 0x7f46940765e0>, body: {"status": null, "maintenance_mode": null} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:13.353859 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-29f6291f-34c3-468f-a4cb-ea68f284b397 tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] Request method failure captured: Jul 25 14:26:13.353859 n-d-846435-14 devstack@n-api.service[119303]: request: PUT /compute/v2.1/os-hosts/n-d-846435-14 HTTP/1.1 Jul 25 14:26:13.353859 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:26:13.353859 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:26:13.353859 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:26:13.353859 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 42 Jul 25 14:26:13.353859 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:26:13.353859 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:26:13.353859 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:26:13.353859 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:13.353859 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qgEWGmpOjVjBJ86-F0oWwx5C3ue3T2JU_pZSiE1XsjZ0HgV-CntKu-RWCtODr4Y0D-1cjBsoLqD8mzfWCj_Nh0Hq1hSezcZA_IHrrb8j4nKS2qBFMB47vWl3-OMjZ_uhltvVyn6aOQzI5nvve0tL97qWp98HaRRnQ2oTKKzIqW_lbw Jul 25 14:26:13.353859 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:26:13.353859 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:26:13.353859 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:26:13.353859 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:26:13.353859 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:26:13.353859 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:26:13.353859 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 81c39817be0b4e429e90c6cda843b282 Jul 25 14:26:13.353859 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1170906488 Jul 25 14:26:13.353859 n-d-846435-14 devstack@n-api.service[119303]: X-Role: admin,reader,member Jul 25 14:26:13.353859 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: admin,reader,member Jul 25 14:26:13.355038 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/81c39817be0b4e429e90c6cda843b282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/81c39817be0b4e429e90c6cda843b282"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_81c39817be0b4e429e90c6cda843b282", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/81c39817be0b4e429e90c6cda843b282"}]}] Jul 25 14:26:13.355038 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1170906488 Jul 25 14:26:13.355038 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 81c39817be0b4e429e90c6cda843b282 Jul 25 14:26:13.355038 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1170906488 Jul 25 14:26:13.355038 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-HostsAdminNegativeTestJSON-1170906488-project-admin Jul 25 14:26:13.355038 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:26:13.355038 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:26:13.355038 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: d45c83a726b04697bfbf1fd156f0bd30 Jul 25 14:26:13.355038 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1170906488-project-admin Jul 25 14:26:13.355038 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:26:13.355038 n-d-846435-14 devstack@n-api.service[119303]: {"status": null, "maintenance_mode": null} Jul 25 14:26:13.355038 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:26:13.355038 n-d-846435-14 devstack@n-api.service[119303]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 25 14:26:13.355038 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'n-d-846435-14', 'body': {'status': None, 'maintenance_mode': None}} Jul 25 14:26:13.355793 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:13.355793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.355793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:26:13.355793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:26:13.355793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:26:13.355793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:26:13.355793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jul 25 14:26:13.355793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.355793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jul 25 14:26:13.355793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 25 14:26:13.355793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'disable', Jul 25 14:26:13.355793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'Enable', Jul 25 14:26:13.355793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'Disable', Jul 25 14:26:13.355793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 25 14:26:13.355793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 25 14:26:13.355793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 25 14:26:13.355793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.355793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi On instance: Jul 25 14:26:13.355793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi None Jul 25 14:26:13.355793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.355793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:13.355793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.355793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.355793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:13.355793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:13.357422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:13.357422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:13.357422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:26:13.357422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:26:13.357422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:13.357422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:13.357422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:26:13.357422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:26:13.357422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:26:13.357422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:26:13.357422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:26:13.357422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:26:13.357422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 25 14:26:13.357422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.357422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:13.357422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.357422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.357422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:13.357422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:13.358571 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:26:13.358571 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:26:13.358571 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 25 14:26:13.358571 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.358571 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-29f6291f-34c3-468f-a4cb-ea68f284b397 tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:13.358571 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-29f6291f-34c3-468f-a4cb-ea68f284b397 tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-hosts/n-d-846435-14" status: 400 len: 127 microversion: 2.1 time: 0.014862 Jul 25 14:26:13.358571 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 110/236] 10.222.0.88 () {60 vars in 1190 bytes} [Mon Jul 25 14:26:13 2022] PUT /compute/v2.1/os-hosts/n-d-846435-14 => generated 127 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 14:26:13.366034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-12b06783-d862-40ab-a528-949afc58ed49 tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] Action: 'update', calling method: .version_select at 0x7f46942a7af0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:13.370899 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.hosts [None req-12b06783-d862-40ab-a528-949afc58ed49 tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] Enabling host nonexistent_hostname. Jul 25 14:26:13.382517 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-12b06783-d862-40ab-a528-949afc58ed49 tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 14:26:13.387565 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-12b06783-d862-40ab-a528-949afc58ed49 tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] Request method failure captured: Jul 25 14:26:13.387565 n-d-846435-14 devstack@n-api.service[119304]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 25 14:26:13.387565 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:26:13.387565 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:26:13.387565 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:26:13.387565 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 50 Jul 25 14:26:13.387565 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:26:13.387565 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:26:13.387565 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:26:13.387565 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:13.387565 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qgEWGmpOjVjBJ86-F0oWwx5C3ue3T2JU_pZSiE1XsjZ0HgV-CntKu-RWCtODr4Y0D-1cjBsoLqD8mzfWCj_Nh0Hq1hSezcZA_IHrrb8j4nKS2qBFMB47vWl3-OMjZ_uhltvVyn6aOQzI5nvve0tL97qWp98HaRRnQ2oTKKzIqW_lbw Jul 25 14:26:13.387565 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:26:13.387565 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:26:13.387565 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:26:13.387565 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:26:13.387565 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:26:13.387565 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:26:13.387565 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 81c39817be0b4e429e90c6cda843b282 Jul 25 14:26:13.387565 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1170906488 Jul 25 14:26:13.387565 n-d-846435-14 devstack@n-api.service[119304]: X-Role: admin,reader,member Jul 25 14:26:13.387565 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: admin,reader,member Jul 25 14:26:13.388877 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/81c39817be0b4e429e90c6cda843b282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/81c39817be0b4e429e90c6cda843b282"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_81c39817be0b4e429e90c6cda843b282", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/81c39817be0b4e429e90c6cda843b282"}]}] Jul 25 14:26:13.388877 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1170906488 Jul 25 14:26:13.388877 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 81c39817be0b4e429e90c6cda843b282 Jul 25 14:26:13.388877 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1170906488 Jul 25 14:26:13.388877 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-HostsAdminNegativeTestJSON-1170906488-project-admin Jul 25 14:26:13.388877 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:26:13.388877 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:26:13.388877 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: d45c83a726b04697bfbf1fd156f0bd30 Jul 25 14:26:13.388877 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1170906488-project-admin Jul 25 14:26:13.388877 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:26:13.388877 n-d-846435-14 devstack@n-api.service[119304]: {"status": "enable", "maintenance_mode": "enable"} Jul 25 14:26:13.388877 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:26:13.388877 n-d-846435-14 devstack@n-api.service[119304]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 14:26:13.388877 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 25 14:26:13.389732 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:13.389732 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.389732 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jul 25 14:26:13.389732 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jul 25 14:26:13.389732 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 14:26:13.389732 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 14:26:13.389732 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:26:13.389732 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:26:13.389732 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:26:13.389732 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:26:13.389732 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 14:26:13.389732 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 14:26:13.389732 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 25 14:26:13.389732 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 25 14:26:13.389732 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:26:13.389732 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:26:13.389732 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 25 14:26:13.389732 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 25 14:26:13.390765 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 14:26:13.390765 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 14:26:13.390765 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 25 14:26:13.390765 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 25 14:26:13.390765 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 14:26:13.390765 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.390765 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:13.390765 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.390765 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.390765 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:13.390765 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:13.390765 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:13.390765 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:13.390765 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:26:13.390765 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:26:13.390765 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:13.390765 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:13.390765 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:26:13.390765 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:26:13.390765 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jul 25 14:26:13.391796 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jul 25 14:26:13.391796 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jul 25 14:26:13.391796 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:26:13.391796 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 14:26:13.391796 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.391796 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:13.391796 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.391796 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:13.391796 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:13.391796 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:13.391796 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:26:13.391796 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:26:13.391796 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 14:26:13.391796 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:13.391796 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-12b06783-d862-40ab-a528-949afc58ed49 tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:13.392638 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-12b06783-d862-40ab-a528-949afc58ed49 tempest-HostsAdminNegativeTestJSON-1170906488 tempest-HostsAdminNegativeTestJSON-1170906488-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.027401 Jul 25 14:26:13.392638 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 127/237] 10.222.0.88 () {60 vars in 1211 bytes} [Mon Jul 25 14:26:13 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:26:13.435573 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-97b4e302-866a-473f-8b60-ed2053c4a0a7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:13.436336 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-97b4e302-866a-473f-8b60-ed2053c4a0a7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: b7018cc7-3f35-47d3-a679-30b828faedab] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:13.450723 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-97b4e302-866a-473f-8b60-ed2053c4a0a7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:13.451297 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-97b4e302-866a-473f-8b60-ed2053c4a0a7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:13.452004 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-97b4e302-866a-473f-8b60-ed2053c4a0a7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:13.452641 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-97b4e302-866a-473f-8b60-ed2053c4a0a7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:13.579843 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cff140e9-93a0-4067-9ac1-e2afcbfbedd8 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:13.580493 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cff140e9-93a0-4067-9ac1-e2afcbfbedd8 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 0a711946-8ed7-4475-a873-944011be17d6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:13.594731 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cff140e9-93a0-4067-9ac1-e2afcbfbedd8 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:13.595444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cff140e9-93a0-4067-9ac1-e2afcbfbedd8 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:13.596435 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cff140e9-93a0-4067-9ac1-e2afcbfbedd8 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:13.596968 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cff140e9-93a0-4067-9ac1-e2afcbfbedd8 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:13.738756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-97b4e302-866a-473f-8b60-ed2053c4a0a7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:13.759825 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-97b4e302-866a-473f-8b60-ed2053c4a0a7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab" status: 200 len: 1313 microversion: 2.1 time: 0.333012 Jul 25 14:26:13.762530 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 111/238] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:13 2022] GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:13.778806 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cff140e9-93a0-4067-9ac1-e2afcbfbedd8 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:13.790049 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cff140e9-93a0-4067-9ac1-e2afcbfbedd8 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6" status: 200 len: 1319 microversion: 2.1 time: 0.213841 Jul 25 14:26:13.791370 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 128/239] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:13 2022] GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:26:13.846667 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4e8eab10-6d6d-4f89-b150-f53e14e344a8 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:13.847129 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4e8eab10-6d6d-4f89-b150-f53e14e344a8 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:13.867665 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e8eab10-6d6d-4f89-b150-f53e14e344a8 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:13.868523 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e8eab10-6d6d-4f89-b150-f53e14e344a8 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:13.869429 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e8eab10-6d6d-4f89-b150-f53e14e344a8 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:13.871225 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e8eab10-6d6d-4f89-b150-f53e14e344a8 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:14.029877 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3b743e26-b2e3-4307-b494-878e418956bf tempest-QuotasAdminTestV236-586051921 tempest-QuotasAdminTestV236-586051921-project-admin] Action: 'update', calling method: .version_select at 0x7f4687fa6ca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:14.110748 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4e8eab10-6d6d-4f89-b150-f53e14e344a8 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2d52c9e2c48dd9e7502843844bf27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78221408d9ae4bdfb29ded35235d5287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:14.119006 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b743e26-b2e3-4307-b494-878e418956bf tempest-QuotasAdminTestV236-586051921 tempest-QuotasAdminTestV236-586051921-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:14.119569 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b743e26-b2e3-4307-b494-878e418956bf tempest-QuotasAdminTestV236-586051921 tempest-QuotasAdminTestV236-586051921-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:14.120431 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b743e26-b2e3-4307-b494-878e418956bf tempest-QuotasAdminTestV236-586051921 tempest-QuotasAdminTestV236-586051921-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:14.120712 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4e8eab10-6d6d-4f89-b150-f53e14e344a8 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] 10.222.0.88 "GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f" status: 200 len: 1487 microversion: 2.1 time: 0.278104 Jul 25 14:26:14.120854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b743e26-b2e3-4307-b494-878e418956bf tempest-QuotasAdminTestV236-586051921 tempest-QuotasAdminTestV236-586051921-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:14.122007 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 129/240] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:13 2022] GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f => generated 1487 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:14.137674 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:14.147269 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a2c26caf-4e55-4dda-b7f2-72422a46d3b2 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:14.148031 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a2c26caf-4e55-4dda-b7f2-72422a46d3b2 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:14.158856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a2c26caf-4e55-4dda-b7f2-72422a46d3b2 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:14.159370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a2c26caf-4e55-4dda-b7f2-72422a46d3b2 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:14.165558 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a2c26caf-4e55-4dda-b7f2-72422a46d3b2 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:14.166243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a2c26caf-4e55-4dda-b7f2-72422a46d3b2 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:14.191620 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3b743e26-b2e3-4307-b494-878e418956bf tempest-QuotasAdminTestV236-586051921 tempest-QuotasAdminTestV236-586051921-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-sets/023fab8bc282444dafc4a4d920bd462a" status: 200 len: 240 microversion: 2.36 time: 0.427761 Jul 25 14:26:14.193301 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 112/241] 10.222.0.88 () {62 vars in 1303 bytes} [Mon Jul 25 14:26:13 2022] PUT /compute/v2.1/os-quota-sets/023fab8bc282444dafc4a4d920bd462a => generated 240 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:26:14.207472 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-35a7a76e-1965-4f4c-bb8f-0b6808d19d1d tempest-QuotasAdminTestV236-586051921 tempest-QuotasAdminTestV236-586051921-project-admin] Calling method '.version_select at 0x7f4687fae1f0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:14.281552 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=88,nova_cell0:UPDATE=12 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:14.285569 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-35a7a76e-1965-4f4c-bb8f-0b6808d19d1d tempest-QuotasAdminTestV236-586051921 tempest-QuotasAdminTestV236-586051921-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:14.286006 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-35a7a76e-1965-4f4c-bb8f-0b6808d19d1d tempest-QuotasAdminTestV236-586051921 tempest-QuotasAdminTestV236-586051921-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:14.286940 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-35a7a76e-1965-4f4c-bb8f-0b6808d19d1d tempest-QuotasAdminTestV236-586051921 tempest-QuotasAdminTestV236-586051921-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:14.287584 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-35a7a76e-1965-4f4c-bb8f-0b6808d19d1d tempest-QuotasAdminTestV236-586051921 tempest-QuotasAdminTestV236-586051921-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:14.314976 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-35a7a76e-1965-4f4c-bb8f-0b6808d19d1d tempest-QuotasAdminTestV236-586051921 tempest-QuotasAdminTestV236-586051921-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/023fab8bc282444dafc4a4d920bd462a/detail" status: 200 len: 672 microversion: 2.36 time: 0.113016 Jul 25 14:26:14.315896 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 113/242] 10.222.0.88 () {60 vars in 1304 bytes} [Mon Jul 25 14:26:14 2022] GET /compute/v2.1/os-quota-sets/023fab8bc282444dafc4a4d920bd462a/detail => generated 672 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:26:14.328132 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ac5db58e-8624-4f47-9822-79e2e6e3d2d8 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:14.329004 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ac5db58e-8624-4f47-9822-79e2e6e3d2d8 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:14.337775 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ac5db58e-8624-4f47-9822-79e2e6e3d2d8 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:14.338244 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ac5db58e-8624-4f47-9822-79e2e6e3d2d8 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:14.339474 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ac5db58e-8624-4f47-9822-79e2e6e3d2d8 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:14.339912 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ac5db58e-8624-4f47-9822-79e2e6e3d2d8 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:14.735386 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a2c26caf-4e55-4dda-b7f2-72422a46d3b2 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f" status: 200 len: 1640 microversion: 2.1 time: 0.592250 Jul 25 14:26:14.736382 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 130/243] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:14 2022] GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f => generated 1640 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:14.740466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ac5db58e-8624-4f47-9822-79e2e6e3d2d8 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:14.743541 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ff9a349c-00df-4766-9a8a-4471ae5c1d75 tempest-QuotasAdminTestV236-586051921 tempest-QuotasAdminTestV236-586051921-project-admin] Action: 'update', calling method: .version_select at 0x7f469427e0d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:14.760723 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ac5db58e-8624-4f47-9822-79e2e6e3d2d8 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5" status: 200 len: 1411 microversion: 2.1 time: 0.438623 Jul 25 14:26:14.769762 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 114/244] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:14 2022] GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 => generated 1411 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:14.775338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-1c1a00dd-53c3-4ded-9461-146de7cf6dab req-5188dffd-cf4a-489b-a7c2-ecccbd72023f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5", "name": "network-vif-plugged", "status": "completed", "tag": "0dfe3f1f-597d-4865-90a9-c04d07e6faf2"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:14.800494 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-1c1a00dd-53c3-4ded-9461-146de7cf6dab req-5188dffd-cf4a-489b-a7c2-ecccbd72023f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:14.801317 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-1c1a00dd-53c3-4ded-9461-146de7cf6dab req-5188dffd-cf4a-489b-a7c2-ecccbd72023f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:14.815304 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-1c1a00dd-53c3-4ded-9461-146de7cf6dab req-5188dffd-cf4a-489b-a7c2-ecccbd72023f service nova] Creating event network-vif-plugged:0dfe3f1f-597d-4865-90a9-c04d07e6faf2 for instance 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 on n-h1-846435-14 Jul 25 14:26:14.822134 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-1c1a00dd-53c3-4ded-9461-146de7cf6dab req-5188dffd-cf4a-489b-a7c2-ecccbd72023f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050672 Jul 25 14:26:14.823009 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 115/245] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:14.830366 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a8358e8b-657c-4a80-8a10-ccc99b452c51 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:14.831284 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a8358e8b-657c-4a80-8a10-ccc99b452c51 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:14.839991 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a8358e8b-657c-4a80-8a10-ccc99b452c51 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:14.840741 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a8358e8b-657c-4a80-8a10-ccc99b452c51 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:14.841699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a8358e8b-657c-4a80-8a10-ccc99b452c51 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:14.842386 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a8358e8b-657c-4a80-8a10-ccc99b452c51 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:14.877615 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a8358e8b-657c-4a80-8a10-ccc99b452c51 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:26:15.038161 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a8358e8b-657c-4a80-8a10-ccc99b452c51 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f" status: 204 len: 0 microversion: 2.1 time: 0.213496 Jul 25 14:26:15.038807 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 116/246] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:26:14 2022] DELETE /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:26:15.046996 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3de7dbab-d7d0-4646-8ee2-8b77526bca2a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:15.048000 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3de7dbab-d7d0-4646-8ee2-8b77526bca2a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: b7018cc7-3f35-47d3-a679-30b828faedab] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:15.055419 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3de7dbab-d7d0-4646-8ee2-8b77526bca2a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:15.056292 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3de7dbab-d7d0-4646-8ee2-8b77526bca2a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:15.056919 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3de7dbab-d7d0-4646-8ee2-8b77526bca2a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:15.057268 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3de7dbab-d7d0-4646-8ee2-8b77526bca2a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:15.076888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff9a349c-00df-4766-9a8a-4471ae5c1d75 tempest-QuotasAdminTestV236-586051921 tempest-QuotasAdminTestV236-586051921-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:15.077664 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff9a349c-00df-4766-9a8a-4471ae5c1d75 tempest-QuotasAdminTestV236-586051921 tempest-QuotasAdminTestV236-586051921-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:15.078449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff9a349c-00df-4766-9a8a-4471ae5c1d75 tempest-QuotasAdminTestV236-586051921 tempest-QuotasAdminTestV236-586051921-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:15.079060 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff9a349c-00df-4766-9a8a-4471ae5c1d75 tempest-QuotasAdminTestV236-586051921 tempest-QuotasAdminTestV236-586051921-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:15.123318 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff9a349c-00df-4766-9a8a-4471ae5c1d75 tempest-QuotasAdminTestV236-586051921 tempest-QuotasAdminTestV236-586051921-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:15.123967 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff9a349c-00df-4766-9a8a-4471ae5c1d75 tempest-QuotasAdminTestV236-586051921 tempest-QuotasAdminTestV236-586051921-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:15.124573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff9a349c-00df-4766-9a8a-4471ae5c1d75 tempest-QuotasAdminTestV236-586051921 tempest-QuotasAdminTestV236-586051921-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:15.124997 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff9a349c-00df-4766-9a8a-4471ae5c1d75 tempest-QuotasAdminTestV236-586051921 tempest-QuotasAdminTestV236-586051921-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:15.171188 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:15.196097 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ff9a349c-00df-4766-9a8a-4471ae5c1d75 tempest-QuotasAdminTestV236-586051921 tempest-QuotasAdminTestV236-586051921-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-sets/023fab8bc282444dafc4a4d920bd462a?user_id=f0a4f3d3e1f046949c093a34969e4b3a" status: 200 len: 240 microversion: 2.36 time: 0.458260 Jul 25 14:26:15.196741 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 131/247] 10.222.0.88 () {62 vars in 1384 bytes} [Mon Jul 25 14:26:14 2022] PUT /compute/v2.1/os-quota-sets/023fab8bc282444dafc4a4d920bd462a?user_id=f0a4f3d3e1f046949c093a34969e4b3a => generated 240 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:26:15.202412 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0e26c65f-2286-4143-8501-31a464d3fbb5 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:15.203490 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0e26c65f-2286-4143-8501-31a464d3fbb5 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 0a711946-8ed7-4475-a873-944011be17d6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:15.210427 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0e26c65f-2286-4143-8501-31a464d3fbb5 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:15.210865 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0e26c65f-2286-4143-8501-31a464d3fbb5 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:15.211638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0e26c65f-2286-4143-8501-31a464d3fbb5 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:15.212315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0e26c65f-2286-4143-8501-31a464d3fbb5 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:15.261455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3de7dbab-d7d0-4646-8ee2-8b77526bca2a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:15.269890 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3de7dbab-d7d0-4646-8ee2-8b77526bca2a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab" status: 200 len: 1313 microversion: 2.1 time: 0.229912 Jul 25 14:26:15.285422 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 117/248] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:15 2022] GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:15.292740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-38024fbf-8b52-4409-9526-fb93af8c7a79 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:15.293593 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-38024fbf-8b52-4409-9526-fb93af8c7a79 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:15.302386 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-38024fbf-8b52-4409-9526-fb93af8c7a79 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:15.303155 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-38024fbf-8b52-4409-9526-fb93af8c7a79 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:15.304361 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-38024fbf-8b52-4409-9526-fb93af8c7a79 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:15.305130 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-38024fbf-8b52-4409-9526-fb93af8c7a79 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:15.626578 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0e26c65f-2286-4143-8501-31a464d3fbb5 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:15.642184 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0e26c65f-2286-4143-8501-31a464d3fbb5 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6" status: 200 len: 1319 microversion: 2.1 time: 0.444058 Jul 25 14:26:15.643139 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 132/249] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:15 2022] GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6 => generated 1319 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:15.659204 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8202b646-7bf0-4187-8a3b-738fc4db2edf tempest-QuotasAdminTestV236-586051921 tempest-QuotasAdminTestV236-586051921-project-admin] Calling method '.version_select at 0x7f4695f79e50>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:15.669153 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-38024fbf-8b52-4409-9526-fb93af8c7a79 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2d52c9e2c48dd9e7502843844bf27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78221408d9ae4bdfb29ded35235d5287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:15.683569 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-38024fbf-8b52-4409-9526-fb93af8c7a79 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] 10.222.0.88 "GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f" status: 200 len: 1493 microversion: 2.1 time: 0.396448 Jul 25 14:26:15.686202 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 118/250] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:15 2022] GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f => generated 1493 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:15.786416 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4985659c-cdb0-43ac-80a7-de67b8e328dd tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:15.787145 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4985659c-cdb0-43ac-80a7-de67b8e328dd tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:15.796696 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4985659c-cdb0-43ac-80a7-de67b8e328dd tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:15.798415 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4985659c-cdb0-43ac-80a7-de67b8e328dd tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:15.799525 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4985659c-cdb0-43ac-80a7-de67b8e328dd tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:15.800097 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4985659c-cdb0-43ac-80a7-de67b8e328dd tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:16.002081 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4985659c-cdb0-43ac-80a7-de67b8e328dd tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:16.011664 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4985659c-cdb0-43ac-80a7-de67b8e328dd tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5" status: 200 len: 1411 microversion: 2.1 time: 0.232196 Jul 25 14:26:16.011910 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8202b646-7bf0-4187-8a3b-738fc4db2edf tempest-QuotasAdminTestV236-586051921 tempest-QuotasAdminTestV236-586051921-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/023fab8bc282444dafc4a4d920bd462a?user_id=f0a4f3d3e1f046949c093a34969e4b3a" status: 200 len: 282 microversion: 2.36 time: 0.360362 Jul 25 14:26:16.012846 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 133/251] 10.222.0.88 () {60 vars in 1364 bytes} [Mon Jul 25 14:26:15 2022] GET /compute/v2.1/os-quota-sets/023fab8bc282444dafc4a4d920bd462a?user_id=f0a4f3d3e1f046949c093a34969e4b3a => generated 282 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:26:16.031563 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 119/252] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:15 2022] GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 => generated 1411 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:26:16.291734 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6625f2b8-dac5-4a1c-b6bd-efa0145b3346 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:16.292599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6625f2b8-dac5-4a1c-b6bd-efa0145b3346 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: b7018cc7-3f35-47d3-a679-30b828faedab] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:16.301445 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6625f2b8-dac5-4a1c-b6bd-efa0145b3346 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:16.302058 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6625f2b8-dac5-4a1c-b6bd-efa0145b3346 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:16.303241 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6625f2b8-dac5-4a1c-b6bd-efa0145b3346 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:16.303867 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6625f2b8-dac5-4a1c-b6bd-efa0145b3346 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:16.461205 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6625f2b8-dac5-4a1c-b6bd-efa0145b3346 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:16.470250 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6625f2b8-dac5-4a1c-b6bd-efa0145b3346 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab" status: 200 len: 1313 microversion: 2.1 time: 0.183239 Jul 25 14:26:16.471433 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 134/253] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:16 2022] GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:16.666950 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d63513d5-d510-44dd-b696-b420a62f3f19 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:16.667759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d63513d5-d510-44dd-b696-b420a62f3f19 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 0a711946-8ed7-4475-a873-944011be17d6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:16.675091 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d63513d5-d510-44dd-b696-b420a62f3f19 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:16.675547 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d63513d5-d510-44dd-b696-b420a62f3f19 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:16.676414 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d63513d5-d510-44dd-b696-b420a62f3f19 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:16.676859 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d63513d5-d510-44dd-b696-b420a62f3f19 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:16.708243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a1b8e430-14b5-4710-8378-27492cf2719d tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:16.709337 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a1b8e430-14b5-4710-8378-27492cf2719d tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:16.717684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1b8e430-14b5-4710-8378-27492cf2719d tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:16.718464 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1b8e430-14b5-4710-8378-27492cf2719d tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:16.719507 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1b8e430-14b5-4710-8378-27492cf2719d tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:16.720601 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1b8e430-14b5-4710-8378-27492cf2719d tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:16.856925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d63513d5-d510-44dd-b696-b420a62f3f19 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:16.865360 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d63513d5-d510-44dd-b696-b420a62f3f19 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6" status: 200 len: 1319 microversion: 2.1 time: 0.202491 Jul 25 14:26:16.866275 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 120/254] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:16 2022] GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:16.915086 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a1b8e430-14b5-4710-8378-27492cf2719d tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2d52c9e2c48dd9e7502843844bf27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78221408d9ae4bdfb29ded35235d5287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:16.924801 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a1b8e430-14b5-4710-8378-27492cf2719d tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] 10.222.0.88 "GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f" status: 200 len: 1493 microversion: 2.1 time: 0.222257 Jul 25 14:26:16.925237 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 135/255] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:16 2022] GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f => generated 1493 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:17.033882 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e91d8bed-a261-414a-ada0-136adb639784 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:17.034583 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e91d8bed-a261-414a-ada0-136adb639784 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:17.041931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e91d8bed-a261-414a-ada0-136adb639784 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:17.042619 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e91d8bed-a261-414a-ada0-136adb639784 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:17.043717 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e91d8bed-a261-414a-ada0-136adb639784 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:17.044482 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e91d8bed-a261-414a-ada0-136adb639784 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:17.092294 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6725522f-dbe6-40fc-af55-5a7523c13ce5 tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:17.104949 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6725522f-dbe6-40fc-af55-5a7523c13ce5 tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] 10.222.0.88 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.175317 Jul 25 14:26:17.106350 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 121/256] 10.222.0.88 () {58 vars in 1137 bytes} [Mon Jul 25 14:26:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:26:17.122539 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b2fa6bcc-7919-4ec7-953a-a005d9066073 tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:17.168425 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b2fa6bcc-7919-4ec7-953a-a005d9066073 tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] 10.222.0.88 "GET /compute/v2.1/flavors" status: 200 len: 3077 microversion: 2.1 time: 0.050249 Jul 25 14:26:17.168425 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 122/257] 10.222.0.88 () {58 vars in 1125 bytes} [Mon Jul 25 14:26:17 2022] GET /compute/v2.1/flavors => generated 3077 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:26:17.190690 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f390b0ae-bfda-4ccc-a5b4-a65a3f4437e7 tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:17.213393 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f390b0ae-bfda-4ccc-a5b4-a65a3f4437e7 tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] 10.222.0.88 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028031 Jul 25 14:26:17.223711 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 123/258] 10.222.0.88 () {58 vars in 1137 bytes} [Mon Jul 25 14:26:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:17.229466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cca1f8be-0fc6-4bed-bfd6-43afc0e45892 tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:17.239365 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cca1f8be-0fc6-4bed-bfd6-43afc0e45892 tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] 10.222.0.88 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014158 Jul 25 14:26:17.247043 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 124/259] 10.222.0.88 () {58 vars in 1137 bytes} [Mon Jul 25 14:26:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:17.252088 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-51964dd6-4f24-4f76-8358-c0b341aec713 tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:17.253621 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e91d8bed-a261-414a-ada0-136adb639784 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:17.273434 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e91d8bed-a261-414a-ada0-136adb639784 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5" status: 200 len: 1411 microversion: 2.1 time: 0.233413 Jul 25 14:26:17.283596 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-51964dd6-4f24-4f76-8358-c0b341aec713 tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] 10.222.0.88 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.035151 Jul 25 14:26:17.287063 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 136/260] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:17 2022] GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 => generated 1411 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:26:17.292350 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 125/261] 10.222.0.88 () {58 vars in 1165 bytes} [Mon Jul 25 14:26:17 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:17.303107 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5d09322d-85a6-4046-adb3-8cf0b47106f0 tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:17.313654 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5d09322d-85a6-4046-adb3-8cf0b47106f0 tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] 10.222.0.88 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015560 Jul 25 14:26:17.314471 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 137/262] 10.222.0.88 () {58 vars in 1137 bytes} [Mon Jul 25 14:26:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:17.327831 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-28978812-ee26-4e3c-a1dd-332dd1d62622 tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:17.367081 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-28978812-ee26-4e3c-a1dd-332dd1d62622 tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] 10.222.0.88 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.044758 Jul 25 14:26:17.368156 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 126/263] 10.222.0.88 () {58 vars in 1169 bytes} [Mon Jul 25 14:26:17 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:26:17.385654 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a18b2ce3-2f75-456e-9ea4-dc5d44a1a26a tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:17.408259 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a18b2ce3-2f75-456e-9ea4-dc5d44a1a26a tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] 10.222.0.88 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.028594 Jul 25 14:26:17.417327 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 138/264] 10.222.0.88 () {58 vars in 1161 bytes} [Mon Jul 25 14:26:17 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:17.424334 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6e6c2c2b-90d2-49e3-98f5-02393d187e81 tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:17.433759 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6e6c2c2b-90d2-49e3-98f5-02393d187e81 tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] 10.222.0.88 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013790 Jul 25 14:26:17.434531 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 127/265] 10.222.0.88 () {58 vars in 1137 bytes} [Mon Jul 25 14:26:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:17.446847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f584dc9f-58ae-487b-a2c5-9f37dfce56e0 tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:17.494309 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-55887c60-5bd4-46c8-9924-2049d70e6679 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:17.495172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-55887c60-5bd4-46c8-9924-2049d70e6679 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: b7018cc7-3f35-47d3-a679-30b828faedab] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:17.502379 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f584dc9f-58ae-487b-a2c5-9f37dfce56e0 tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] 10.222.0.88 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2911 microversion: 2.1 time: 0.059848 Jul 25 14:26:17.505204 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-55887c60-5bd4-46c8-9924-2049d70e6679 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:17.505654 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 139/266] 10.222.0.88 () {58 vars in 1167 bytes} [Mon Jul 25 14:26:17 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2911 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:17.506719 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-55887c60-5bd4-46c8-9924-2049d70e6679 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:17.507528 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-55887c60-5bd4-46c8-9924-2049d70e6679 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:17.508253 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-55887c60-5bd4-46c8-9924-2049d70e6679 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:17.530327 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7221d831-c675-4e38-839a-fe53e8ca561b tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:17.549941 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7221d831-c675-4e38-839a-fe53e8ca561b tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] 10.222.0.88 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029280 Jul 25 14:26:17.552255 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 140/267] 10.222.0.88 () {58 vars in 1137 bytes} [Mon Jul 25 14:26:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:17.568327 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1b236743-e1a1-4407-86e4-76fdd3586c68 tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:17.639298 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1b236743-e1a1-4407-86e4-76fdd3586c68 tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] 10.222.0.88 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.079201 Jul 25 14:26:17.645825 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 141/268] 10.222.0.88 () {58 vars in 1144 bytes} [Mon Jul 25 14:26:17 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:17.664642 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-33db2ad1-23b2-4d48-a253-aca49234c960 tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:17.689593 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-33db2ad1-23b2-4d48-a253-aca49234c960 tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] 10.222.0.88 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028400 Jul 25 14:26:17.698313 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 142/269] 10.222.0.88 () {58 vars in 1137 bytes} [Mon Jul 25 14:26:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:17.707320 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-52e1d735-5ecd-490f-aabc-7958e4ab7112 tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:17.742957 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-52e1d735-5ecd-490f-aabc-7958e4ab7112 tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] 10.222.0.88 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.042600 Jul 25 14:26:17.748018 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 143/270] 10.222.0.88 () {58 vars in 1148 bytes} [Mon Jul 25 14:26:17 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:17.761010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-005c64de-d328-4c90-9fef-d5a1845d95b5 tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:17.780426 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-005c64de-d328-4c90-9fef-d5a1845d95b5 tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] 10.222.0.88 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.026576 Jul 25 14:26:17.781174 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 144/271] 10.222.0.88 () {58 vars in 1140 bytes} [Mon Jul 25 14:26:17 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:17.797990 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fb094ad8-5739-4bc5-94dc-e19bcd4a4910 tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:17.809233 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fb094ad8-5739-4bc5-94dc-e19bcd4a4910 tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] 10.222.0.88 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018224 Jul 25 14:26:17.810006 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 145/272] 10.222.0.88 () {58 vars in 1137 bytes} [Mon Jul 25 14:26:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:17.823809 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-86af4d30-d386-46c6-b715-b1cf28e76a04 tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:17.858697 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-86af4d30-d386-46c6-b715-b1cf28e76a04 tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] 10.222.0.88 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1540 microversion: 2.1 time: 0.040506 Jul 25 14:26:17.869957 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 146/273] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:26:17 2022] GET /compute/v2.1/flavors?marker=452 => generated 1540 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:26:17.875658 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f97fcc96-d86f-4708-9d00-e47bd533e67e tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:17.911821 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f97fcc96-d86f-4708-9d00-e47bd533e67e tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.040818 Jul 25 14:26:17.924000 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 147/274] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:26:17 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:17.924000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5f6443f2-7852-4661-9b36-562c0883ae89 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:17.924000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5f6443f2-7852-4661-9b36-562c0883ae89 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 0a711946-8ed7-4475-a873-944011be17d6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:17.925548 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5f6443f2-7852-4661-9b36-562c0883ae89 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:17.926289 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5f6443f2-7852-4661-9b36-562c0883ae89 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:17.927427 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5f6443f2-7852-4661-9b36-562c0883ae89 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:17.928079 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5f6443f2-7852-4661-9b36-562c0883ae89 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:18.112834 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5f6443f2-7852-4661-9b36-562c0883ae89 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:18.122402 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5f6443f2-7852-4661-9b36-562c0883ae89 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6" status: 200 len: 1468 microversion: 2.1 time: 0.208060 Jul 25 14:26:18.123102 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 148/275] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:17 2022] GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6 => generated 1468 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:18.127011 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-55887c60-5bd4-46c8-9924-2049d70e6679 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:18.127828 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ff2be7c5-e6a6-40cc-bcf0-c4fff53e1f2e tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:18.135125 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-55887c60-5bd4-46c8-9924-2049d70e6679 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab" status: 200 len: 1313 microversion: 2.1 time: 0.647678 Jul 25 14:26:18.135703 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 128/276] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:17 2022] GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab => generated 1313 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:18.152300 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0a94141b-d6b9-4b81-90de-dbc977b817c5 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:18.153065 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0a94141b-d6b9-4b81-90de-dbc977b817c5 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:18.155645 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ff2be7c5-e6a6-40cc-bcf0-c4fff53e1f2e tempest-FlavorsV2TestJSON-818575269 tempest-FlavorsV2TestJSON-818575269-project] 10.222.0.88 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031352 Jul 25 14:26:18.157129 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 149/277] 10.222.0.88 () {58 vars in 1137 bytes} [Mon Jul 25 14:26:18 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:18.168004 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0a94141b-d6b9-4b81-90de-dbc977b817c5 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:18.168671 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0a94141b-d6b9-4b81-90de-dbc977b817c5 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:18.169243 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0a94141b-d6b9-4b81-90de-dbc977b817c5 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:18.169663 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0a94141b-d6b9-4b81-90de-dbc977b817c5 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:18.345648 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0a94141b-d6b9-4b81-90de-dbc977b817c5 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2d52c9e2c48dd9e7502843844bf27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78221408d9ae4bdfb29ded35235d5287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:18.358863 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0a94141b-d6b9-4b81-90de-dbc977b817c5 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] 10.222.0.88 "GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f" status: 200 len: 1451 microversion: 2.1 time: 0.221995 Jul 25 14:26:18.359719 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 129/278] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:18 2022] GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f => generated 1451 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:18.368527 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-0edf46a6-59c4-42ba-b256-b17983976d2b req-4c0ae6c4-8239-434b-9462-646f157e2da1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c25476ab-b697-45f9-aa22-ead2d1b23fc7", "name": "network-vif-plugged", "status": "completed", "tag": "c69d5fca-fc3b-4290-b9b5-09a0bbddbbc9"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:18.393314 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-0edf46a6-59c4-42ba-b256-b17983976d2b req-4c0ae6c4-8239-434b-9462-646f157e2da1 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:18.393779 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-0edf46a6-59c4-42ba-b256-b17983976d2b req-4c0ae6c4-8239-434b-9462-646f157e2da1 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:18.406109 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-0edf46a6-59c4-42ba-b256-b17983976d2b req-4c0ae6c4-8239-434b-9462-646f157e2da1 service nova] Creating event network-vif-plugged:c69d5fca-fc3b-4290-b9b5-09a0bbddbbc9 for instance c25476ab-b697-45f9-aa22-ead2d1b23fc7 on n-h1-846435-14 Jul 25 14:26:18.412505 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-0edf46a6-59c4-42ba-b256-b17983976d2b req-4c0ae6c4-8239-434b-9462-646f157e2da1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051524 Jul 25 14:26:18.413651 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 130/279] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:18.422689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fcc76ebe-9cf1-461a-8d52-263bbccb56c5 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:18.423582 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fcc76ebe-9cf1-461a-8d52-263bbccb56c5 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:18.432409 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fcc76ebe-9cf1-461a-8d52-263bbccb56c5 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:18.433063 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fcc76ebe-9cf1-461a-8d52-263bbccb56c5 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:18.434332 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fcc76ebe-9cf1-461a-8d52-263bbccb56c5 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:18.434925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fcc76ebe-9cf1-461a-8d52-263bbccb56c5 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:18.523547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bb35b833-e076-4f9a-b8f8-a79497c2cd17 tempest-DeleteServersAdminTestJSON-1134357036 tempest-DeleteServersAdminTestJSON-1134357036-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:18.524213 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bb35b833-e076-4f9a-b8f8-a79497c2cd17 tempest-DeleteServersAdminTestJSON-1134357036 tempest-DeleteServersAdminTestJSON-1134357036-project-admin] [instance: 0a711946-8ed7-4475-a873-944011be17d6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:18.538766 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bb35b833-e076-4f9a-b8f8-a79497c2cd17 tempest-DeleteServersAdminTestJSON-1134357036 tempest-DeleteServersAdminTestJSON-1134357036-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:18.540396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bb35b833-e076-4f9a-b8f8-a79497c2cd17 tempest-DeleteServersAdminTestJSON-1134357036 tempest-DeleteServersAdminTestJSON-1134357036-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:18.542169 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bb35b833-e076-4f9a-b8f8-a79497c2cd17 tempest-DeleteServersAdminTestJSON-1134357036 tempest-DeleteServersAdminTestJSON-1134357036-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:18.543595 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bb35b833-e076-4f9a-b8f8-a79497c2cd17 tempest-DeleteServersAdminTestJSON-1134357036 tempest-DeleteServersAdminTestJSON-1134357036-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:18.592004 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bb35b833-e076-4f9a-b8f8-a79497c2cd17 tempest-DeleteServersAdminTestJSON-1134357036 tempest-DeleteServersAdminTestJSON-1134357036-project-admin] [instance: 0a711946-8ed7-4475-a873-944011be17d6] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:26:18.817125 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bb35b833-e076-4f9a-b8f8-a79497c2cd17 tempest-DeleteServersAdminTestJSON-1134357036 tempest-DeleteServersAdminTestJSON-1134357036-project-admin] 10.222.0.88 "DELETE /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6" status: 204 len: 0 microversion: 2.1 time: 0.658288 Jul 25 14:26:18.820312 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 150/280] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:26:18 2022] DELETE /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:26:18.835135 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-7dbacecf-02eb-4392-a83a-20795f9f2639 req-fd683097-d5c4-4ce0-96fe-12f47ece3155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9eb52d5-1abd-4050-ada7-60d23d4bb29f", "name": "network-vif-deleted", "tag": "1a6656a9-cb42-4d44-908a-a8d1cfc3696d"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:18.860765 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-7dbacecf-02eb-4392-a83a-20795f9f2639 req-fd683097-d5c4-4ce0-96fe-12f47ece3155 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:18.861120 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-7dbacecf-02eb-4392-a83a-20795f9f2639 req-fd683097-d5c4-4ce0-96fe-12f47ece3155 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:18.865820 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fcc76ebe-9cf1-461a-8d52-263bbccb56c5 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:18.879507 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fcc76ebe-9cf1-461a-8d52-263bbccb56c5 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5" status: 200 len: 1610 microversion: 2.1 time: 0.459373 Jul 25 14:26:18.880226 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 131/281] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:18 2022] GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 => generated 1610 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:18.885295 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bb2b7ef7-509b-400d-9a09-9d7a2e9707aa tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:18.886062 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bb2b7ef7-509b-400d-9a09-9d7a2e9707aa tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 0a711946-8ed7-4475-a873-944011be17d6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:18.892638 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bb2b7ef7-509b-400d-9a09-9d7a2e9707aa tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:18.893272 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bb2b7ef7-509b-400d-9a09-9d7a2e9707aa tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:18.894036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bb2b7ef7-509b-400d-9a09-9d7a2e9707aa tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:18.894671 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bb2b7ef7-509b-400d-9a09-9d7a2e9707aa tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:18.901778 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-7dbacecf-02eb-4392-a83a-20795f9f2639 req-fd683097-d5c4-4ce0-96fe-12f47ece3155 service nova] Creating event network-vif-deleted:1a6656a9-cb42-4d44-908a-a8d1cfc3696d for instance a9eb52d5-1abd-4050-ada7-60d23d4bb29f on n-h1-846435-14 Jul 25 14:26:18.907567 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-7dbacecf-02eb-4392-a83a-20795f9f2639 req-fd683097-d5c4-4ce0-96fe-12f47ece3155 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084655 Jul 25 14:26:18.908365 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 151/282] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:19.093293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bb2b7ef7-509b-400d-9a09-9d7a2e9707aa tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:19.104248 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bb2b7ef7-509b-400d-9a09-9d7a2e9707aa tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6" status: 200 len: 1474 microversion: 2.1 time: 0.222609 Jul 25 14:26:19.105231 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 132/283] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:18 2022] GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6 => generated 1474 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:19.110616 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-414b7f21-ac5e-4d86-b25e-5a27197b99f4 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:19.111486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-414b7f21-ac5e-4d86-b25e-5a27197b99f4 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:19.131537 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-414b7f21-ac5e-4d86-b25e-5a27197b99f4 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:19.132137 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-414b7f21-ac5e-4d86-b25e-5a27197b99f4 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:19.132863 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-414b7f21-ac5e-4d86-b25e-5a27197b99f4 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:19.134043 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-414b7f21-ac5e-4d86-b25e-5a27197b99f4 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:19.243968 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cce0674e-9a10-4992-a070-89664516a5fd tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Calling method '.version_select at 0x7f46940f6f70>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:19.246690 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:19.246690 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:19.246690 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cce0674e-9a10-4992-a070-89664516a5fd tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:19.246690 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cce0674e-9a10-4992-a070-89664516a5fd tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:19.261432 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cce0674e-9a10-4992-a070-89664516a5fd tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:19.261882 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cce0674e-9a10-4992-a070-89664516a5fd tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:19.272310 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cce0674e-9a10-4992-a070-89664516a5fd tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:19.272756 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cce0674e-9a10-4992-a070-89664516a5fd tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:19.278736 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cce0674e-9a10-4992-a070-89664516a5fd tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.369420 Jul 25 14:26:19.284061 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 152/284] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:26:18 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:19.290555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ef82bbc4-125c-4f81-ac2f-9408a23e6dcd tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:19.291603 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ef82bbc4-125c-4f81-ac2f-9408a23e6dcd tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: b7018cc7-3f35-47d3-a679-30b828faedab] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:19.299460 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ef82bbc4-125c-4f81-ac2f-9408a23e6dcd tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:19.300393 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ef82bbc4-125c-4f81-ac2f-9408a23e6dcd tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:19.300886 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ef82bbc4-125c-4f81-ac2f-9408a23e6dcd tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:19.301405 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ef82bbc4-125c-4f81-ac2f-9408a23e6dcd tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:19.306441 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:19.312851 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-414b7f21-ac5e-4d86-b25e-5a27197b99f4 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.205356 Jul 25 14:26:19.315416 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 133/285] 10.222.0.88 () {58 vars in 1275 bytes} [Mon Jul 25 14:26:19 2022] GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5/os-interface => generated 284 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:19.324193 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-42b989a7-0a67-4242-bc3b-47d01f229547 tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Calling method '.version_select at 0x7f4687fae0d0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:19.325489 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:19.325489 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:19.329287 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42b989a7-0a67-4242-bc3b-47d01f229547 tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:19.333102 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42b989a7-0a67-4242-bc3b-47d01f229547 tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:19.354142 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42b989a7-0a67-4242-bc3b-47d01f229547 tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:19.354589 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42b989a7-0a67-4242-bc3b-47d01f229547 tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:19.369115 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42b989a7-0a67-4242-bc3b-47d01f229547 tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:19.369763 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42b989a7-0a67-4242-bc3b-47d01f229547 tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:19.378434 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-42b989a7-0a67-4242-bc3b-47d01f229547 tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.061244 Jul 25 14:26:19.379666 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 134/286] 10.222.0.88 () {58 vars in 1167 bytes} [Mon Jul 25 14:26:19 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:19.384419 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1809bfb1-1be4-4160-ad79-87604fe1f908 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:19.385019 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1809bfb1-1be4-4160-ad79-87604fe1f908 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:19.391332 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1809bfb1-1be4-4160-ad79-87604fe1f908 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:19.391963 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1809bfb1-1be4-4160-ad79-87604fe1f908 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:19.392927 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1809bfb1-1be4-4160-ad79-87604fe1f908 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:19.393502 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1809bfb1-1be4-4160-ad79-87604fe1f908 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:19.412630 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:19.434553 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1809bfb1-1be4-4160-ad79-87604fe1f908 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:19.435200 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1809bfb1-1be4-4160-ad79-87604fe1f908 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:19.435831 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-1809bfb1-1be4-4160-ad79-87604fe1f908 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lazy-loading 'fault' on Instance uuid a9eb52d5-1abd-4050-ada7-60d23d4bb29f {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:26:19.487995 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1809bfb1-1be4-4160-ad79-87604fe1f908 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2d52c9e2c48dd9e7502843844bf27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78221408d9ae4bdfb29ded35235d5287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:19.496151 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1809bfb1-1be4-4160-ad79-87604fe1f908 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] 10.222.0.88 "GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f" status: 200 len: 1327 microversion: 2.1 time: 0.115101 Jul 25 14:26:19.496726 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 135/287] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:19 2022] GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f => generated 1327 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:19.510156 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-98153674-b119-4e8e-9ed3-d94a5eec1222 tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Calling method '.version_select at 0x7f46945c9280>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:19.511091 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:19.511091 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:19.512643 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-98153674-b119-4e8e-9ed3-d94a5eec1222 tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:19.513323 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-98153674-b119-4e8e-9ed3-d94a5eec1222 tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:19.528157 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-98153674-b119-4e8e-9ed3-d94a5eec1222 tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:19.528610 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-98153674-b119-4e8e-9ed3-d94a5eec1222 tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:19.538814 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-98153674-b119-4e8e-9ed3-d94a5eec1222 tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:19.540019 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-98153674-b119-4e8e-9ed3-d94a5eec1222 tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:19.546911 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-98153674-b119-4e8e-9ed3-d94a5eec1222 tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.048884 Jul 25 14:26:19.547521 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 136/288] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:26:19 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:19.557637 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-db063bb8-5360-414e-97c1-cb9e3158f7d4 tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Calling method '.version_select at 0x7f469462f700>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:19.558428 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:19.558428 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:19.559729 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-db063bb8-5360-414e-97c1-cb9e3158f7d4 tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:19.560196 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-db063bb8-5360-414e-97c1-cb9e3158f7d4 tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:19.578926 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-db063bb8-5360-414e-97c1-cb9e3158f7d4 tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:19.579386 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-db063bb8-5360-414e-97c1-cb9e3158f7d4 tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:19.586258 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-db063bb8-5360-414e-97c1-cb9e3158f7d4 tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.032090 Jul 25 14:26:19.587174 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 137/289] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jul 25 14:26:19 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:26:19.601133 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c32c6524-116b-45fb-ac35-008e5d56073f tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Calling method '.version_select at 0x7f46940ebf70>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:19.602162 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:19.602162 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:19.603558 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c32c6524-116b-45fb-ac35-008e5d56073f tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:19.604028 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c32c6524-116b-45fb-ac35-008e5d56073f tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:19.622764 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c32c6524-116b-45fb-ac35-008e5d56073f tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.025116 Jul 25 14:26:19.623642 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 138/290] 10.222.0.88 () {58 vars in 1179 bytes} [Mon Jul 25 14:26:19 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:26:19.635749 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9d3512f8-26a3-4c93-bd67-d3a69876ccef tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Calling method '.version_select at 0x7f469412f310>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:19.636574 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:19.636574 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:19.638023 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d3512f8-26a3-4c93-bd67-d3a69876ccef tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:19.638938 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d3512f8-26a3-4c93-bd67-d3a69876ccef tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:19.654307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d3512f8-26a3-4c93-bd67-d3a69876ccef tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:19.654878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d3512f8-26a3-4c93-bd67-d3a69876ccef tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:19.676034 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d3512f8-26a3-4c93-bd67-d3a69876ccef tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:19.676560 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d3512f8-26a3-4c93-bd67-d3a69876ccef tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:19.689715 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9d3512f8-26a3-4c93-bd67-d3a69876ccef tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.057840 Jul 25 14:26:19.695678 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 139/291] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:26:19 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:19.700833 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-96c9d294-565e-434e-a092-149db41cb5ea tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Calling method '.version_select at 0x7f469462f790>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:19.702004 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:19.702004 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:19.703248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-96c9d294-565e-434e-a092-149db41cb5ea tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:19.703705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-96c9d294-565e-434e-a092-149db41cb5ea tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:19.723799 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-96c9d294-565e-434e-a092-149db41cb5ea tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:19.724322 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-96c9d294-565e-434e-a092-149db41cb5ea tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:19.732351 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-96c9d294-565e-434e-a092-149db41cb5ea tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.035295 Jul 25 14:26:19.733074 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 140/292] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jul 25 14:26:19 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:19.751837 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ef82bbc4-125c-4f81-ac2f-9408a23e6dcd tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:19.756429 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e2d8b253-74a7-4f62-a714-4c9662b39cac tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Calling method '.version_select at 0x7f46945c91f0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:19.763174 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:19.763174 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:19.764620 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e2d8b253-74a7-4f62-a714-4c9662b39cac tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:19.765241 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e2d8b253-74a7-4f62-a714-4c9662b39cac tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:19.783283 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ef82bbc4-125c-4f81-ac2f-9408a23e6dcd tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab" status: 200 len: 1313 microversion: 2.1 time: 0.501207 Jul 25 14:26:19.784318 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 153/293] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:19 2022] GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab => generated 1313 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:19.806517 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e2d8b253-74a7-4f62-a714-4c9662b39cac tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:19.807456 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e2d8b253-74a7-4f62-a714-4c9662b39cac tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:19.815028 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e2d8b253-74a7-4f62-a714-4c9662b39cac tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.071272 Jul 25 14:26:19.825132 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 141/294] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jul 25 14:26:19 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:19.831424 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5b687c04-ea6b-4ec3-8ffb-124c7993230b tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Calling method '.version_select at 0x7f469405be50>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:19.832520 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:19.832520 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:19.834008 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b687c04-ea6b-4ec3-8ffb-124c7993230b tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:19.834454 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b687c04-ea6b-4ec3-8ffb-124c7993230b tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:19.873216 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b687c04-ea6b-4ec3-8ffb-124c7993230b tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:19.873404 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b687c04-ea6b-4ec3-8ffb-124c7993230b tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:19.897842 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b687c04-ea6b-4ec3-8ffb-124c7993230b tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:19.898630 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b687c04-ea6b-4ec3-8ffb-124c7993230b tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:20.063625 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5b687c04-ea6b-4ec3-8ffb-124c7993230b tempest-HypervisorAdminTestJSON-801264965 tempest-HypervisorAdminTestJSON-801264965-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.235795 Jul 25 14:26:20.065275 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 154/295] 10.222.0.88 () {58 vars in 1173 bytes} [Mon Jul 25 14:26:19 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:26:20.131006 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-79b7fdd6-2ca9-407f-8ca8-fe108d990955 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:20.132130 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-79b7fdd6-2ca9-407f-8ca8-fe108d990955 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 0a711946-8ed7-4475-a873-944011be17d6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:20.139441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-79b7fdd6-2ca9-407f-8ca8-fe108d990955 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:20.144785 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-79b7fdd6-2ca9-407f-8ca8-fe108d990955 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:20.145809 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-79b7fdd6-2ca9-407f-8ca8-fe108d990955 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:20.148389 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-79b7fdd6-2ca9-407f-8ca8-fe108d990955 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:20.519483 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6ce4ec52-ddaa-4dc4-8701-b752a14329ad tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:20.521316 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6ce4ec52-ddaa-4dc4-8701-b752a14329ad tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:20.538918 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6ce4ec52-ddaa-4dc4-8701-b752a14329ad tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:20.540698 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6ce4ec52-ddaa-4dc4-8701-b752a14329ad tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:20.541628 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6ce4ec52-ddaa-4dc4-8701-b752a14329ad tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:20.544569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6ce4ec52-ddaa-4dc4-8701-b752a14329ad tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:20.546653 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-79b7fdd6-2ca9-407f-8ca8-fe108d990955 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:20.555035 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-79b7fdd6-2ca9-407f-8ca8-fe108d990955 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6" status: 200 len: 1474 microversion: 2.1 time: 0.428521 Jul 25 14:26:20.555610 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 142/296] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:20 2022] GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6 => generated 1474 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:20.567362 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-6ce4ec52-ddaa-4dc4-8701-b752a14329ad tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] HTTP exception thrown: Instance a9eb52d5-1abd-4050-ada7-60d23d4bb29f could not be found. Jul 25 14:26:20.578286 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6ce4ec52-ddaa-4dc4-8701-b752a14329ad tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Request method failure captured: Jul 25 14:26:20.578286 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f HTTP/1.1 Jul 25 14:26:20.578286 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:26:20.578286 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:26:20.578286 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:26:20.578286 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:26:20.578286 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:26:20.578286 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:26:20.578286 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:26:20.578286 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:20.578286 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfWFzn3TRYgxiDs3R9clfLBm71tFJf6-E4Q2YKrzEMBahbQrxbWAea9Pf-LZ2eb4IFT4l09uJl4WQVd3ZE72tckkYvBk6lHJ-2dlyiOaf_XShyHHfgYs6Nuw6jJ616wHkxMMJJn_4YMor2ou3uPnUQo6AO4Qb5CNVJs_W5LGYg2sRk Jul 25 14:26:20.578286 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:26:20.578286 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:26:20.578286 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:26:20.578286 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:26:20.578286 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:26:20.578286 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:26:20.578286 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 78221408d9ae4bdfb29ded35235d5287 Jul 25 14:26:20.578286 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-AggregatesAdminTestJSON-1334684196 Jul 25 14:26:20.578286 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:26:20.578286 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:26:20.579739 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/78221408d9ae4bdfb29ded35235d5287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/78221408d9ae4bdfb29ded35235d5287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_78221408d9ae4bdfb29ded35235d5287", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/78221408d9ae4bdfb29ded35235d5287"}]}] Jul 25 14:26:20.579739 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-AggregatesAdminTestJSON-1334684196 Jul 25 14:26:20.579739 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 78221408d9ae4bdfb29ded35235d5287 Jul 25 14:26:20.579739 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1334684196 Jul 25 14:26:20.579739 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-AggregatesAdminTestJSON-1334684196-project Jul 25 14:26:20.579739 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:26:20.579739 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:26:20.579739 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 71a2d52c9e2c48dd9e7502843844bf27 Jul 25 14:26:20.579739 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-AggregatesAdminTestJSON-1334684196-project Jul 25 14:26:20.579739 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:26:20.579739 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance a9eb52d5-1abd-4050-ada7-60d23d4bb29f could not be found. Jul 25 14:26:20.579739 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'a9eb52d5-1abd-4050-ada7-60d23d4bb29f'} Jul 25 14:26:20.580585 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:20.580585 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:20.580585 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:26:20.580585 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:26:20.580585 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:26:20.580585 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:26:20.580585 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:26:20.580585 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:26:20.580585 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:26:20.580585 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:26:20.580585 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9eb52d5-1abd-4050-ada7-60d23d4bb29f could not be found. Jul 25 14:26:20.580585 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:20.580585 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:20.580585 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:20.580585 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:20.580585 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:20.580585 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:20.580585 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:20.580585 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:20.580585 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:20.581988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:20.581988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:26:20.581988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:26:20.581988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:26:20.581988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:26:20.581988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:26:20.581988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:26:20.581988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9eb52d5-1abd-4050-ada7-60d23d4bb29f could not be found. Jul 25 14:26:20.581988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:20.581988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:20.581988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:20.581988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:20.581988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:20.581988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:20.581988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:26:20.581988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:26:20.581988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9eb52d5-1abd-4050-ada7-60d23d4bb29f could not be found. Jul 25 14:26:20.581988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:20.584186 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6ce4ec52-ddaa-4dc4-8701-b752a14329ad tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Returning 404 to user: Instance a9eb52d5-1abd-4050-ada7-60d23d4bb29f could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:20.585185 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6ce4ec52-ddaa-4dc4-8701-b752a14329ad tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] 10.222.0.88 "GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f" status: 404 len: 111 microversion: 2.1 time: 0.070400 Jul 25 14:26:20.585748 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 155/297] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:20 2022] GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:26:20.594442 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d9226e29-10fe-453d-a4ad-6b07708285fd tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-846435-14"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:20.597299 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:20.597299 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:20.609621 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d9226e29-10fe-453d-a4ad-6b07708285fd tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:20.610324 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d9226e29-10fe-453d-a4ad-6b07708285fd tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:20.807109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-69ae602c-5efe-4abb-998f-4be981c02767 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:20.808953 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-69ae602c-5efe-4abb-998f-4be981c02767 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: b7018cc7-3f35-47d3-a679-30b828faedab] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:20.825875 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69ae602c-5efe-4abb-998f-4be981c02767 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:20.826692 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69ae602c-5efe-4abb-998f-4be981c02767 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:20.830655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69ae602c-5efe-4abb-998f-4be981c02767 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:20.831442 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69ae602c-5efe-4abb-998f-4be981c02767 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:20.846024 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d9226e29-10fe-453d-a4ad-6b07708285fd tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 298 microversion: 2.1 time: 0.254963 Jul 25 14:26:20.846667 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 143/298] 10.222.0.88 () {60 vars in 1191 bytes} [Mon Jul 25 14:26:20 2022] POST /compute/v2.1/os-aggregates/2/action => generated 298 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:20.870859 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6a765c0a-9b24-4645-877a-4b1c1d4a3bd3 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:20.874648 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:20.874648 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:20.937647 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:20.956734 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6a765c0a-9b24-4645-877a-4b1c1d4a3bd3 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.095769 Jul 25 14:26:20.958837 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 144/299] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jul 25 14:26:20 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 25 14:26:20.980155 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2d597206-06fa-4a2e-9952-e9b11fdb9533 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-82557713"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:20.985673 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:20.985673 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:20.987867 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.aggregate [None req-2d597206-06fa-4a2e-9952-e9b11fdb9533 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Generated uuid 98e560b2-7a46-49d9-b9a5-345f148213e4 for aggregate {{(pid=119303) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 14:26:21.031386 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2d597206-06fa-4a2e-9952-e9b11fdb9533 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.058149 Jul 25 14:26:21.033071 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 145/300] 10.222.0.88 () {60 vars in 1164 bytes} [Mon Jul 25 14:26:20 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:21.054064 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-43a87b8f-b9fc-4eb3-9211-e8495fe6b790 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-846435-14"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:21.070611 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:21.070611 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:21.093841 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43a87b8f-b9fc-4eb3-9211-e8495fe6b790 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:21.097545 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43a87b8f-b9fc-4eb3-9211-e8495fe6b790 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:21.164983 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-69ae602c-5efe-4abb-998f-4be981c02767 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:21.176981 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-69ae602c-5efe-4abb-998f-4be981c02767 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab" status: 200 len: 1313 microversion: 2.1 time: 0.375787 Jul 25 14:26:21.177780 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 156/301] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:20 2022] GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:21.332036 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-43a87b8f-b9fc-4eb3-9211-e8495fe6b790 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 0.289003 Jul 25 14:26:21.332912 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 146/302] 10.222.0.88 () {60 vars in 1191 bytes} [Mon Jul 25 14:26:21 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:21.350719 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b257a70e-8133-4a33-b6bc-5650908872ce tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:21.351580 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:21.351580 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:21.371231 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b257a70e-8133-4a33-b6bc-5650908872ce tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 241 microversion: 2.1 time: 0.026695 Jul 25 14:26:21.371825 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 157/303] 10.222.0.88 () {58 vars in 1149 bytes} [Mon Jul 25 14:26:21 2022] GET /compute/v2.1/os-aggregates/3 => generated 241 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:26:21.384364 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b9d2f436-e9d5-424e-8cba-e0e59c2a8d9a tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-846435-14"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:21.387043 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:21.387043 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:21.407360 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b9d2f436-e9d5-424e-8cba-e0e59c2a8d9a tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:21.407904 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b9d2f436-e9d5-424e-8cba-e0e59c2a8d9a tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:21.576816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3651ba8c-c54a-46f6-a423-c524caaddb6e tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:21.577549 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3651ba8c-c54a-46f6-a423-c524caaddb6e tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 0a711946-8ed7-4475-a873-944011be17d6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:21.586661 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3651ba8c-c54a-46f6-a423-c524caaddb6e tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:21.590121 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3651ba8c-c54a-46f6-a423-c524caaddb6e tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:21.590985 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3651ba8c-c54a-46f6-a423-c524caaddb6e tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:21.591548 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3651ba8c-c54a-46f6-a423-c524caaddb6e tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:21.640612 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b9d2f436-e9d5-424e-8cba-e0e59c2a8d9a tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 225 microversion: 2.1 time: 0.258549 Jul 25 14:26:21.654348 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 147/304] 10.222.0.88 () {60 vars in 1191 bytes} [Mon Jul 25 14:26:21 2022] POST /compute/v2.1/os-aggregates/3/action => generated 225 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:21.659767 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-08b1be55-aa98-4d4d-97cd-c43e06bcb004 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:21.661038 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:21.661038 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:21.699919 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-08b1be55-aa98-4d4d-97cd-c43e06bcb004 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.042909 Jul 25 14:26:21.710810 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 148/305] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jul 25 14:26:21 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 14:26:21.721269 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a0f6e92b-7594-47c7-a1ed-4263e6cf6810 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:21.722242 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a0f6e92b-7594-47c7-a1ed-4263e6cf6810 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:21.734762 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a0f6e92b-7594-47c7-a1ed-4263e6cf6810 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:21.737362 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a0f6e92b-7594-47c7-a1ed-4263e6cf6810 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:21.739394 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a0f6e92b-7594-47c7-a1ed-4263e6cf6810 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:21.740117 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a0f6e92b-7594-47c7-a1ed-4263e6cf6810 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:22.162471 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3651ba8c-c54a-46f6-a423-c524caaddb6e tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:22.177044 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3651ba8c-c54a-46f6-a423-c524caaddb6e tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6" status: 200 len: 1474 microversion: 2.1 time: 0.602099 Jul 25 14:26:22.181156 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 158/306] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:21 2022] GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6 => generated 1474 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:26:22.197440 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a0f6e92b-7594-47c7-a1ed-4263e6cf6810 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:22.199535 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-27e81851-9d3e-441c-9abc-3afcf250e7a6 req-32fc3e11-2130-42ab-9a6a-7ce581daee7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5", "tag": "0dfe3f1f-597d-4865-90a9-c04d07e6faf2"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:22.207535 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a0f6e92b-7594-47c7-a1ed-4263e6cf6810 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5" status: 200 len: 1589 microversion: 2.1 time: 0.494856 Jul 25 14:26:22.226648 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-27e81851-9d3e-441c-9abc-3afcf250e7a6 req-32fc3e11-2130-42ab-9a6a-7ce581daee7d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:22.227139 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 149/307] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:21 2022] GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 => generated 1589 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:22.227517 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-27e81851-9d3e-441c-9abc-3afcf250e7a6 req-32fc3e11-2130-42ab-9a6a-7ce581daee7d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:22.244294 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3f3b85d1-99a1-4ed0-88b9-fa7b525ffe07 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1396167981"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:22.247427 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:22.247427 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:22.248767 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.aggregate [None req-3f3b85d1-99a1-4ed0-88b9-fa7b525ffe07 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Generated uuid ff87d087-e69f-4dcc-89ac-110f83d2a345 for aggregate {{(pid=119303) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 14:26:22.251905 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-27e81851-9d3e-441c-9abc-3afcf250e7a6 req-32fc3e11-2130-42ab-9a6a-7ce581daee7d service nova] Creating event network-changed:0dfe3f1f-597d-4865-90a9-c04d07e6faf2 for instance 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 on n-h1-846435-14 Jul 25 14:26:22.272782 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-27e81851-9d3e-441c-9abc-3afcf250e7a6 req-32fc3e11-2130-42ab-9a6a-7ce581daee7d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085975 Jul 25 14:26:22.291414 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 159/308] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:22.312500 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3f3b85d1-99a1-4ed0-88b9-fa7b525ffe07 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.083628 Jul 25 14:26:22.319405 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 150/309] 10.222.0.88 () {60 vars in 1164 bytes} [Mon Jul 25 14:26:22 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:22.319821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-824f5dd3-679d-4568-b241-8685ba5cc192 req-133708a9-5373-4d21-bd5d-d541a6cb7db8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a711946-8ed7-4475-a873-944011be17d6", "name": "network-vif-deleted", "tag": "bf389314-6fd9-4ecd-97b3-f759aab3353b"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:22.324932 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-09a290ee-1bc1-49c1-ad4f-4e0e7cf36b58 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:22.327178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-09a290ee-1bc1-49c1-ad4f-4e0e7cf36b58 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: b7018cc7-3f35-47d3-a679-30b828faedab] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:22.341705 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-824f5dd3-679d-4568-b241-8685ba5cc192 req-133708a9-5373-4d21-bd5d-d541a6cb7db8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:22.342159 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-824f5dd3-679d-4568-b241-8685ba5cc192 req-133708a9-5373-4d21-bd5d-d541a6cb7db8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:22.346286 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-09a290ee-1bc1-49c1-ad4f-4e0e7cf36b58 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:22.347770 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-09a290ee-1bc1-49c1-ad4f-4e0e7cf36b58 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:22.348785 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-09a290ee-1bc1-49c1-ad4f-4e0e7cf36b58 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:22.349377 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-09a290ee-1bc1-49c1-ad4f-4e0e7cf36b58 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:22.366411 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-824f5dd3-679d-4568-b241-8685ba5cc192 req-133708a9-5373-4d21-bd5d-d541a6cb7db8 service nova] Creating event network-vif-deleted:bf389314-6fd9-4ecd-97b3-f759aab3353b for instance 0a711946-8ed7-4475-a873-944011be17d6 on n-h2-846435-14 Jul 25 14:26:22.382753 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-824f5dd3-679d-4568-b241-8685ba5cc192 req-133708a9-5373-4d21-bd5d-d541a6cb7db8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089484 Jul 25 14:26:22.388361 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 160/310] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:22.395566 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f34b425b-65f4-4ec2-b96c-0a0eb7798929 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-846435-14"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:22.399133 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:22.399133 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:22.409203 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f34b425b-65f4-4ec2-b96c-0a0eb7798929 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:22.409908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f34b425b-65f4-4ec2-b96c-0a0eb7798929 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:22.643785 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f34b425b-65f4-4ec2-b96c-0a0eb7798929 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 243 microversion: 2.1 time: 0.253990 Jul 25 14:26:22.644792 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 161/311] 10.222.0.88 () {60 vars in 1191 bytes} [Mon Jul 25 14:26:22 2022] POST /compute/v2.1/os-aggregates/4/action => generated 243 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:22.649956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-3c04c10f-9a9e-4a50-9c05-a94db0166a5f req-0758dc30-4306-4e97-951a-d3f1f811e10a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7018cc7-3f35-47d3-a679-30b828faedab", "name": "network-vif-plugged", "status": "completed", "tag": "3b2a879a-4843-4428-b75e-ce8d7edfab6d"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:22.662677 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-3c04c10f-9a9e-4a50-9c05-a94db0166a5f req-0758dc30-4306-4e97-951a-d3f1f811e10a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:22.663754 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-3c04c10f-9a9e-4a50-9c05-a94db0166a5f req-0758dc30-4306-4e97-951a-d3f1f811e10a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:22.705535 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-09a290ee-1bc1-49c1-ad4f-4e0e7cf36b58 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:22.707703 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-3c04c10f-9a9e-4a50-9c05-a94db0166a5f req-0758dc30-4306-4e97-951a-d3f1f811e10a service nova] Creating event network-vif-plugged:3b2a879a-4843-4428-b75e-ce8d7edfab6d for instance b7018cc7-3f35-47d3-a679-30b828faedab on n-h2-846435-14 Jul 25 14:26:22.720519 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-3c04c10f-9a9e-4a50-9c05-a94db0166a5f req-0758dc30-4306-4e97-951a-d3f1f811e10a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073850 Jul 25 14:26:22.721471 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-09a290ee-1bc1-49c1-ad4f-4e0e7cf36b58 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab" status: 200 len: 1313 microversion: 2.1 time: 0.397435 Jul 25 14:26:22.722164 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 162/312] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:22.728920 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b2a7bc74-3b85-42e2-8ebb-2e671af6db91 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:22.730903 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:22.730903 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:22.739874 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b2a7bc74-3b85-42e2-8ebb-2e671af6db91 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.015760 Jul 25 14:26:22.741213 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 163/313] 10.222.0.88 () {58 vars in 1143 bytes} [Mon Jul 25 14:26:22 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:22.742774 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 151/314] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:22 2022] GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab => generated 1313 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:22.755707 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2d1a0b16-4d3f-4e07-ac7a-f524de759cee tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-846435-14"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:22.758519 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:22.758519 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:22.778376 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d1a0b16-4d3f-4e07-ac7a-f524de759cee tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:22.785436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d1a0b16-4d3f-4e07-ac7a-f524de759cee tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:22.955424 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2d1a0b16-4d3f-4e07-ac7a-f524de759cee tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.204487 Jul 25 14:26:22.962805 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 164/315] 10.222.0.88 () {60 vars in 1191 bytes} [Mon Jul 25 14:26:22 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:26:22.973706 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fdfdba68-1360-4960-bef8-4307bf1aab71 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:22.974783 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:22.974783 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:23.000885 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fdfdba68-1360-4960-bef8-4307bf1aab71 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.030720 Jul 25 14:26:23.002040 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 152/316] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jul 25 14:26:22 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 14:26:23.014922 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0a77cc78-70c6-4044-a186-16e0814fe7ab tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2063450336"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:23.017892 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:23.017892 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:23.018877 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.aggregate [None req-0a77cc78-70c6-4044-a186-16e0814fe7ab tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Generated uuid 4240d10c-c689-4ca9-bba6-211b108d9ff0 for aggregate {{(pid=119304) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 14:26:23.030199 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:23.053292 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0a77cc78-70c6-4044-a186-16e0814fe7ab tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.044246 Jul 25 14:26:23.063171 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 165/317] 10.222.0.88 () {60 vars in 1164 bytes} [Mon Jul 25 14:26:23 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:23.068469 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-81f1493f-4861-4539-a66b-1d8ce7fcfbd1 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-846435-14"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:23.071402 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:23.071402 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:23.084414 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-81f1493f-4861-4539-a66b-1d8ce7fcfbd1 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:23.091755 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-81f1493f-4861-4539-a66b-1d8ce7fcfbd1 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:23.204631 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-632891bf-d0c4-4457-b721-513a0bf4c033 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:23.209908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-632891bf-d0c4-4457-b721-513a0bf4c033 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 0a711946-8ed7-4475-a873-944011be17d6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:23.226956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-632891bf-d0c4-4457-b721-513a0bf4c033 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:23.228083 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-632891bf-d0c4-4457-b721-513a0bf4c033 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:23.230620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-632891bf-d0c4-4457-b721-513a0bf4c033 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:23.232040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-632891bf-d0c4-4457-b721-513a0bf4c033 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:23.262183 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-632891bf-d0c4-4457-b721-513a0bf4c033 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] HTTP exception thrown: Instance 0a711946-8ed7-4475-a873-944011be17d6 could not be found. Jul 25 14:26:23.265120 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-632891bf-d0c4-4457-b721-513a0bf4c033 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Request method failure captured: Jul 25 14:26:23.265120 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6 HTTP/1.1 Jul 25 14:26:23.265120 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:26:23.265120 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:26:23.265120 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:26:23.265120 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:26:23.265120 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:26:23.265120 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:26:23.265120 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:26:23.265120 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:23.265120 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfkKVYF8tulhJYxobI4sMNY3mzpHgkPM2lXpcETovKivA9uFectz576sX3ZKXxXrAhs6PwLDD3YKX24eq6m5sccxa2kS8D_PLpt0mt7x8_jh2juqAPUA8rdyUNm7PZioLQXJKZtZS-vslZXRGC30P8bzTEt9vWEmXaF8ORSii-5bdU Jul 25 14:26:23.265120 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:26:23.265120 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:26:23.265120 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:26:23.265120 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:26:23.265120 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:26:23.265120 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:26:23.265120 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 8236bf5c62e6434cbedf22a0e3fba1f4 Jul 25 14:26:23.265120 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-DeleteServersAdminTestJSON-652135158 Jul 25 14:26:23.265120 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:26:23.265120 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:26:23.266440 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8236bf5c62e6434cbedf22a0e3fba1f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8236bf5c62e6434cbedf22a0e3fba1f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8236bf5c62e6434cbedf22a0e3fba1f4", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8236bf5c62e6434cbedf22a0e3fba1f4"}]}] Jul 25 14:26:23.266440 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-DeleteServersAdminTestJSON-652135158 Jul 25 14:26:23.266440 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 8236bf5c62e6434cbedf22a0e3fba1f4 Jul 25 14:26:23.266440 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-652135158 Jul 25 14:26:23.266440 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-DeleteServersAdminTestJSON-652135158-project Jul 25 14:26:23.266440 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:26:23.266440 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:26:23.266440 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: d99a49d2a5254f038c4c1e243f3bac22 Jul 25 14:26:23.266440 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-DeleteServersAdminTestJSON-652135158-project Jul 25 14:26:23.266440 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:26:23.266440 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 0a711946-8ed7-4475-a873-944011be17d6 could not be found. Jul 25 14:26:23.266440 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '0a711946-8ed7-4475-a873-944011be17d6'} Jul 25 14:26:23.267167 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:23.267167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:23.267167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:26:23.267167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:26:23.267167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:26:23.267167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:26:23.267167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:26:23.267167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:26:23.267167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:26:23.267167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:26:23.267167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a711946-8ed7-4475-a873-944011be17d6 could not be found. Jul 25 14:26:23.267167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:23.267167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:23.267167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:23.267167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:23.267167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:23.267167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:23.267167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:23.267167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:23.267167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:23.268326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:23.268326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:26:23.268326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:26:23.268326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:26:23.268326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:26:23.268326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:26:23.268326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:26:23.268326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a711946-8ed7-4475-a873-944011be17d6 could not be found. Jul 25 14:26:23.268326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:23.268326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:23.268326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:23.268326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:23.268326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:23.268326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:23.268326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:26:23.268326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:26:23.268326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a711946-8ed7-4475-a873-944011be17d6 could not be found. Jul 25 14:26:23.268326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:23.272846 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-632891bf-d0c4-4457-b721-513a0bf4c033 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Returning 404 to user: Instance 0a711946-8ed7-4475-a873-944011be17d6 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:23.274049 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-632891bf-d0c4-4457-b721-513a0bf4c033 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6" status: 404 len: 111 microversion: 2.1 time: 0.075161 Jul 25 14:26:23.274993 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 166/318] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:23 2022] GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:26:23.399093 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-81f1493f-4861-4539-a66b-1d8ce7fcfbd1 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 243 microversion: 2.1 time: 0.336196 Jul 25 14:26:23.401593 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 153/319] 10.222.0.88 () {60 vars in 1191 bytes} [Mon Jul 25 14:26:23 2022] POST /compute/v2.1/os-aggregates/5/action => generated 243 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:26:23.414210 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e26a1db3-aa74-4a5d-9dcd-687eec0f36fe tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-846435-14"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:23.416794 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:23.416794 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:23.433784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e26a1db3-aa74-4a5d-9dcd-687eec0f36fe tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:23.434229 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e26a1db3-aa74-4a5d-9dcd-687eec0f36fe tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:23.521314 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e3f161d9-55b3-45fd-a2fb-b7f13d97fda6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1149099328", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:23.642406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-e3f161d9-55b3-45fd-a2fb-b7f13d97fda6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] validate_networks() for None {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:26:23.652953 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e26a1db3-aa74-4a5d-9dcd-687eec0f36fe tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 227 microversion: 2.1 time: 0.243762 Jul 25 14:26:23.654405 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 167/320] 10.222.0.88 () {60 vars in 1191 bytes} [Mon Jul 25 14:26:23 2022] POST /compute/v2.1/os-aggregates/5/action => generated 227 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:23.666141 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-89415b0e-2f0c-4194-b9d9-3c856b89e89a tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:23.667095 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:23.667095 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:23.721738 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-89415b0e-2f0c-4194-b9d9-3c856b89e89a tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.059800 Jul 25 14:26:23.724671 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 168/321] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jul 25 14:26:23 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 14:26:23.738694 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c611f219-7da7-4458-8069-f2a462245b38 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1790420247"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:23.745402 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:23.745402 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:23.754389 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.aggregate [None req-c611f219-7da7-4458-8069-f2a462245b38 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Generated uuid 4cae0122-481e-4623-bab1-ef5dc6e1b7c2 for aggregate {{(pid=119304) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 14:26:23.799863 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c611f219-7da7-4458-8069-f2a462245b38 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.067660 Jul 25 14:26:23.802179 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 169/322] 10.222.0.88 () {60 vars in 1164 bytes} [Mon Jul 25 14:26:23 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:23.818545 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8c9bd727-aa07-4381-9ca0-663aa508d43a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:23.819278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8c9bd727-aa07-4381-9ca0-663aa508d43a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: b7018cc7-3f35-47d3-a679-30b828faedab] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:23.833299 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8c9bd727-aa07-4381-9ca0-663aa508d43a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:23.835917 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8c9bd727-aa07-4381-9ca0-663aa508d43a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:23.838829 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8c9bd727-aa07-4381-9ca0-663aa508d43a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:23.839355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8c9bd727-aa07-4381-9ca0-663aa508d43a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:24.103312 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-e3f161d9-55b3-45fd-a2fb-b7f13d97fda6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:26:24.104310 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-e3f161d9-55b3-45fd-a2fb-b7f13d97fda6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:26:24.105206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-e3f161d9-55b3-45fd-a2fb-b7f13d97fda6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:26:24.106043 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-e3f161d9-55b3-45fd-a2fb-b7f13d97fda6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:26:24.107057 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-e3f161d9-55b3-45fd-a2fb-b7f13d97fda6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:26:24.123520 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3f161d9-55b3-45fd-a2fb-b7f13d97fda6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:24.124512 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3f161d9-55b3-45fd-a2fb-b7f13d97fda6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:24.125760 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3f161d9-55b3-45fd-a2fb-b7f13d97fda6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:24.126994 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3f161d9-55b3-45fd-a2fb-b7f13d97fda6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:24.149977 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-e3f161d9-55b3-45fd-a2fb-b7f13d97fda6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Getting quotas for project 8236bf5c62e6434cbedf22a0e3fba1f4. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:26:24.157846 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-e3f161d9-55b3-45fd-a2fb-b7f13d97fda6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Getting quotas for user d99a49d2a5254f038c4c1e243f3bac22 and project 8236bf5c62e6434cbedf22a0e3fba1f4. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:26:24.177640 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e3f161d9-55b3-45fd-a2fb-b7f13d97fda6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:26:24.181205 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e3f161d9-55b3-45fd-a2fb-b7f13d97fda6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 9b76704f-db05-4df8-832a-2f9d30409637] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:26:24.321127 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e3f161d9-55b3-45fd-a2fb-b7f13d97fda6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.802082 Jul 25 14:26:24.324132 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 154/323] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:26:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 14:26:24.340103 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-95a8fec1-6c96-42d8-97f2-6d70388d16ba tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:24.341608 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:24.341608 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:24.397904 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-95a8fec1-6c96-42d8-97f2-6d70388d16ba tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.071178 Jul 25 14:26:24.399157 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 155/324] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jul 25 14:26:24 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 14:26:24.408841 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4204dbc5-caf4-4014-8f8d-4cdb5c50bb27 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-360683634"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:24.414554 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:24.414554 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:24.418536 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.aggregate [None req-4204dbc5-caf4-4014-8f8d-4cdb5c50bb27 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Generated uuid 61f6db63-6dd2-428a-8852-44cfc8d13a45 for aggregate {{(pid=119303) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 14:26:24.454802 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4204dbc5-caf4-4014-8f8d-4cdb5c50bb27 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.052776 Jul 25 14:26:24.455661 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 156/325] 10.222.0.88 () {60 vars in 1164 bytes} [Mon Jul 25 14:26:24 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:24.466123 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7ab87235-4a12-489a-a88e-66a5326e2ea9 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:24.472254 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7ab87235-4a12-489a-a88e-66a5326e2ea9 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 9b76704f-db05-4df8-832a-2f9d30409637] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:24.492641 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8c9bd727-aa07-4381-9ca0-663aa508d43a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:24.505873 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8c9bd727-aa07-4381-9ca0-663aa508d43a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab" status: 200 len: 1313 microversion: 2.1 time: 0.700988 Jul 25 14:26:24.524264 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 170/326] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:23 2022] GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab => generated 1313 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:24.536675 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-391e5611-96a5-4955-87d5-21082b51893c tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:24.539333 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:24.539333 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:24.561665 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-391e5611-96a5-4955-87d5-21082b51893c tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Jul 25 14:26:24.567702 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-391e5611-96a5-4955-87d5-21082b51893c tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Request method failure captured: Jul 25 14:26:24.567702 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Jul 25 14:26:24.567702 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:26:24.567702 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:26:24.567702 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:26:24.567702 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:26:24.567702 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:26:24.567702 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:26:24.567702 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:26:24.567702 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:24.567702 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfZVHpe8O6FCRXlEnKHyXsQlSX6hfFKHxozQpH2aXbg-onJl0B6XDehabms0Cefqb6mcQuJkl66m5qLXNBbA3L02N7zgXpcQ03ePd42XNiHIhJEnNey5rv3VNFY8-CvLu2PMX1r_UrSG6OjEkkRA7hxJTnH25zIdV1cf4U6xKu5gI0 Jul 25 14:26:24.567702 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:26:24.567702 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:26:24.567702 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:26:24.567702 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:26:24.567702 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:26:24.567702 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:26:24.567702 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 7719233bd6be441599474918c7a78fc8 Jul 25 14:26:24.567702 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-AggregatesAdminTestJSON-1830763140 Jul 25 14:26:24.567702 n-d-846435-14 devstack@n-api.service[119304]: X-Role: admin,reader,member Jul 25 14:26:24.567702 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: admin,reader,member Jul 25 14:26:24.569290 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7719233bd6be441599474918c7a78fc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7719233bd6be441599474918c7a78fc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_7719233bd6be441599474918c7a78fc8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/7719233bd6be441599474918c7a78fc8"}]}] Jul 25 14:26:24.569290 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-AggregatesAdminTestJSON-1830763140 Jul 25 14:26:24.569290 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 7719233bd6be441599474918c7a78fc8 Jul 25 14:26:24.569290 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1830763140 Jul 25 14:26:24.569290 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-AggregatesAdminTestJSON-1830763140-project-admin Jul 25 14:26:24.569290 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:26:24.569290 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:26:24.569290 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: c7a00815fb6840bab5efa3b87923d993 Jul 25 14:26:24.569290 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-AggregatesAdminTestJSON-1830763140-project-admin Jul 25 14:26:24.569290 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:26:24.569290 n-d-846435-14 devstack@n-api.service[119304]: exception: Aggregate 6 could not be found. Jul 25 14:26:24.569290 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '6'} Jul 25 14:26:24.569290 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:24.570326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:24.570326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 25 14:26:24.570326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 25 14:26:24.570326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 25 14:26:24.570326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 25 14:26:24.570326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:26:24.570326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:26:24.570326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 25 14:26:24.570326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 25 14:26:24.570326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 14:26:24.570326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 14:26:24.570326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 25 14:26:24.570326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 25 14:26:24.570326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Jul 25 14:26:24.570326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:24.570326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:24.570326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:24.570326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:24.570326 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:24.571656 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:24.571656 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:24.571656 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:24.571656 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:24.571656 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:24.571656 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 25 14:26:24.571656 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:26:24.571656 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Jul 25 14:26:24.571656 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:24.571656 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:24.571656 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:24.571656 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:24.571656 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:24.571656 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:24.571656 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:26:24.571656 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:26:24.571656 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Jul 25 14:26:24.571656 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:24.573659 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-391e5611-96a5-4955-87d5-21082b51893c tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:24.574672 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-391e5611-96a5-4955-87d5-21082b51893c tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.048841 Jul 25 14:26:24.585563 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 171/327] 10.222.0.88 () {58 vars in 1149 bytes} [Mon Jul 25 14:26:24 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:26:24.590400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-db647095-5717-4f79-a18b-88438b414820 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-846435-14"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:24.593880 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:24.593880 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:24.634333 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db647095-5717-4f79-a18b-88438b414820 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:24.635354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db647095-5717-4f79-a18b-88438b414820 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:24.689778 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7ab87235-4a12-489a-a88e-66a5326e2ea9 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:24.700607 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7ab87235-4a12-489a-a88e-66a5326e2ea9 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637" status: 200 len: 1220 microversion: 2.1 time: 0.242193 Jul 25 14:26:24.701192 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 157/328] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:24 2022] GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637 => generated 1220 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:24.734394 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-65a2e4d2-f5f8-4674-b318-51f0bfb23de3 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:24.738524 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:24.738524 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:24.763589 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-65a2e4d2-f5f8-4674-b318-51f0bfb23de3 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Jul 25 14:26:24.766175 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-65a2e4d2-f5f8-4674-b318-51f0bfb23de3 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Request method failure captured: Jul 25 14:26:24.766175 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Jul 25 14:26:24.766175 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:26:24.766175 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:26:24.766175 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:26:24.766175 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:26:24.766175 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:26:24.766175 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:26:24.766175 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:26:24.766175 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:24.766175 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qfZVHpe8O6FCRXlEnKHyXsQlSX6hfFKHxozQpH2aXbg-onJl0B6XDehabms0Cefqb6mcQuJkl66m5qLXNBbA3L02N7zgXpcQ03ePd42XNiHIhJEnNey5rv3VNFY8-CvLu2PMX1r_UrSG6OjEkkRA7hxJTnH25zIdV1cf4U6xKu5gI0 Jul 25 14:26:24.766175 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:26:24.766175 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:26:24.766175 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:26:24.766175 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:26:24.766175 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:26:24.766175 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:26:24.766175 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 7719233bd6be441599474918c7a78fc8 Jul 25 14:26:24.766175 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-AggregatesAdminTestJSON-1830763140 Jul 25 14:26:24.766175 n-d-846435-14 devstack@n-api.service[119303]: X-Role: admin,reader,member Jul 25 14:26:24.766175 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: admin,reader,member Jul 25 14:26:24.767408 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7719233bd6be441599474918c7a78fc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7719233bd6be441599474918c7a78fc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_7719233bd6be441599474918c7a78fc8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/7719233bd6be441599474918c7a78fc8"}]}] Jul 25 14:26:24.767408 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-AggregatesAdminTestJSON-1830763140 Jul 25 14:26:24.767408 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 7719233bd6be441599474918c7a78fc8 Jul 25 14:26:24.767408 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1830763140 Jul 25 14:26:24.767408 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-AggregatesAdminTestJSON-1830763140-project-admin Jul 25 14:26:24.767408 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:26:24.767408 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:26:24.767408 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: c7a00815fb6840bab5efa3b87923d993 Jul 25 14:26:24.767408 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-AggregatesAdminTestJSON-1830763140-project-admin Jul 25 14:26:24.767408 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:26:24.767408 n-d-846435-14 devstack@n-api.service[119303]: exception: Aggregate 6 could not be found. Jul 25 14:26:24.767408 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '6'} Jul 25 14:26:24.767408 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:24.768149 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:24.768149 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 25 14:26:24.768149 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 25 14:26:24.768149 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 14:26:24.768149 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 14:26:24.768149 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:26:24.768149 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:26:24.768149 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:26:24.768149 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:26:24.768149 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 14:26:24.768149 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 14:26:24.768149 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 25 14:26:24.768149 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 25 14:26:24.768149 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:26:24.768149 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:26:24.768149 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 25 14:26:24.768149 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 25 14:26:24.768149 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 14:26:24.768149 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 14:26:24.769195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 25 14:26:24.769195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 25 14:26:24.769195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Jul 25 14:26:24.769195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:24.769195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:24.769195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:24.769195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:24.769195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:24.769195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:24.769195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:24.769195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:24.769195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:24.769195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:24.769195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 25 14:26:24.769195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:26:24.769195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Jul 25 14:26:24.769195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:24.769195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:24.769195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:24.769195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:24.769195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:24.770399 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:24.770399 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:26:24.770399 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:26:24.770399 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Jul 25 14:26:24.770399 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:24.770399 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-65a2e4d2-f5f8-4674-b318-51f0bfb23de3 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:24.770748 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-65a2e4d2-f5f8-4674-b318-51f0bfb23de3 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.052226 Jul 25 14:26:24.773338 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 158/329] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jul 25 14:26:24 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:26:24.798897 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bb2dbb18-cf66-45ab-96bb-bc9aedd9bd26 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-427129245", "name": "tempest-test_aggregate-2008469190"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:24.838852 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:24.838852 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:24.839946 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.aggregate [None req-bb2dbb18-cf66-45ab-96bb-bc9aedd9bd26 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Generated uuid 7085e799-9634-4d3b-aaeb-c1fa5d0cc942 for aggregate {{(pid=119303) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 14:26:24.909099 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-db647095-5717-4f79-a18b-88438b414820 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 242 microversion: 2.1 time: 0.322264 Jul 25 14:26:24.911173 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 172/330] 10.222.0.88 () {60 vars in 1191 bytes} [Mon Jul 25 14:26:24 2022] POST /compute/v2.1/os-aggregates/7/action => generated 242 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:24.929351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4de0ce2f-ce1d-4ce4-b8ba-eeb6382909b9 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-846435-14"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:24.934985 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bb2dbb18-cf66-45ab-96bb-bc9aedd9bd26 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.154380 Jul 25 14:26:24.944214 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:24.944214 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:24.948807 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 159/331] 10.222.0.88 () {60 vars in 1165 bytes} [Mon Jul 25 14:26:24 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:26:24.956567 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-942b79c5-6d99-442a-a3b0-5fc4643a7828 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:24.957884 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:24.957884 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:24.975711 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4de0ce2f-ce1d-4ce4-b8ba-eeb6382909b9 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:24.977797 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4de0ce2f-ce1d-4ce4-b8ba-eeb6382909b9 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:25.010795 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-942b79c5-6d99-442a-a3b0-5fc4643a7828 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.060589 Jul 25 14:26:25.013862 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 160/332] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jul 25 14:26:24 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 14:26:25.025770 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9ea9c6e2-0a14-41d9-952c-d4727e604fb4 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:25.029210 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:25.029210 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:25.037586 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-4de0ce2f-ce1d-4ce4-b8ba-eeb6382909b9 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] HTTP exception thrown: Aggregate 7 already has host n-h1-846435-14. Jul 25 14:26:25.042299 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-9ea9c6e2-0a14-41d9-952c-d4727e604fb4 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Jul 25 14:26:25.043796 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9ea9c6e2-0a14-41d9-952c-d4727e604fb4 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Request method failure captured: Jul 25 14:26:25.043796 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Jul 25 14:26:25.043796 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:26:25.043796 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:26:25.043796 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:26:25.043796 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:26:25.043796 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:26:25.043796 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:26:25.043796 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:26:25.043796 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:25.043796 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qfZVHpe8O6FCRXlEnKHyXsQlSX6hfFKHxozQpH2aXbg-onJl0B6XDehabms0Cefqb6mcQuJkl66m5qLXNBbA3L02N7zgXpcQ03ePd42XNiHIhJEnNey5rv3VNFY8-CvLu2PMX1r_UrSG6OjEkkRA7hxJTnH25zIdV1cf4U6xKu5gI0 Jul 25 14:26:25.043796 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:26:25.043796 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:26:25.043796 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:26:25.043796 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:26:25.043796 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:26:25.043796 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:26:25.043796 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 7719233bd6be441599474918c7a78fc8 Jul 25 14:26:25.043796 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-AggregatesAdminTestJSON-1830763140 Jul 25 14:26:25.043796 n-d-846435-14 devstack@n-api.service[119303]: X-Role: admin,reader,member Jul 25 14:26:25.043796 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: admin,reader,member Jul 25 14:26:25.045467 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7719233bd6be441599474918c7a78fc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7719233bd6be441599474918c7a78fc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_7719233bd6be441599474918c7a78fc8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/7719233bd6be441599474918c7a78fc8"}]}] Jul 25 14:26:25.045467 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-AggregatesAdminTestJSON-1830763140 Jul 25 14:26:25.045467 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 7719233bd6be441599474918c7a78fc8 Jul 25 14:26:25.045467 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1830763140 Jul 25 14:26:25.045467 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-AggregatesAdminTestJSON-1830763140-project-admin Jul 25 14:26:25.045467 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:26:25.045467 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:26:25.045467 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: c7a00815fb6840bab5efa3b87923d993 Jul 25 14:26:25.045467 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-AggregatesAdminTestJSON-1830763140-project-admin Jul 25 14:26:25.045467 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:26:25.045467 n-d-846435-14 devstack@n-api.service[119303]: exception: Aggregate 8 could not be found. Jul 25 14:26:25.045467 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '8'} Jul 25 14:26:25.045467 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:25.046277 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:25.046277 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 25 14:26:25.046277 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 25 14:26:25.046277 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 25 14:26:25.046277 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 25 14:26:25.046277 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:26:25.046277 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:26:25.046277 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 25 14:26:25.046277 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 25 14:26:25.046277 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 14:26:25.046277 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 14:26:25.046277 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 25 14:26:25.046277 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 25 14:26:25.046277 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Jul 25 14:26:25.046277 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:25.046277 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:25.046277 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:25.046277 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:25.046277 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:25.047641 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:25.047641 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:25.047641 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:25.047641 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:25.047641 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:25.047641 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 25 14:26:25.047641 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:26:25.047641 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Jul 25 14:26:25.047641 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:25.047641 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:25.047641 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:25.047641 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:25.047641 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:25.047641 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:25.047641 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:26:25.047641 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:26:25.047641 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Jul 25 14:26:25.047641 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:25.049772 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9ea9c6e2-0a14-41d9-952c-d4727e604fb4 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:25.049772 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9ea9c6e2-0a14-41d9-952c-d4727e604fb4 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "GET /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.026081 Jul 25 14:26:25.054450 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 161/333] 10.222.0.88 () {58 vars in 1149 bytes} [Mon Jul 25 14:26:25 2022] GET /compute/v2.1/os-aggregates/8 => generated 77 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:26:25.063528 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cfc35d39-6edb-4976-b202-1e7ccdd62b64 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:25.067339 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:25.067339 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:25.073624 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4de0ce2f-ce1d-4ce4-b8ba-eeb6382909b9 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Request method failure captured: Jul 25 14:26:25.073624 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/os-aggregates/7/action HTTP/1.1 Jul 25 14:26:25.073624 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:26:25.073624 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:26:25.073624 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:26:25.073624 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 40 Jul 25 14:26:25.073624 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:26:25.073624 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:26:25.073624 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:26:25.073624 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:25.073624 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfrk8sVGXsDqmhpZWz7J0Bm3w7SJo2Zip8QxPneTId9qHuMkiM-5Q6QrnVOzmA8IlDYzwlgpnxzqv89mPFD81OF3fP4oMPBg2T7fknckotFmas4lLxiFkI8qKcC9FQPMFhV9kCKf0OTrjPUoufcyO4jX3a-T0NwKnKsdyq_aYYEKbs Jul 25 14:26:25.073624 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:26:25.073624 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:26:25.073624 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:26:25.073624 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:26:25.073624 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:26:25.073624 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:26:25.073624 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 210769c76f534885b40be67c84b4da2c Jul 25 14:26:25.073624 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-758784592 Jul 25 14:26:25.073624 n-d-846435-14 devstack@n-api.service[119304]: X-Role: admin,reader,member Jul 25 14:26:25.073624 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: admin,reader,member Jul 25 14:26:25.075030 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/210769c76f534885b40be67c84b4da2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/210769c76f534885b40be67c84b4da2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_210769c76f534885b40be67c84b4da2c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/210769c76f534885b40be67c84b4da2c"}]}] Jul 25 14:26:25.075030 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-758784592 Jul 25 14:26:25.075030 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 210769c76f534885b40be67c84b4da2c Jul 25 14:26:25.075030 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-758784592 Jul 25 14:26:25.075030 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin Jul 25 14:26:25.075030 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:26:25.075030 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:26:25.075030 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 437bdf0ef30d4aeb965581dae9c76a48 Jul 25 14:26:25.075030 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin Jul 25 14:26:25.075030 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:26:25.075030 n-d-846435-14 devstack@n-api.service[119304]: {"add_host": {"host": "n-h1-846435-14"}} Jul 25 14:26:25.075030 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:26:25.075030 n-d-846435-14 devstack@n-api.service[119304]: exception: Aggregate 7 already has host n-h1-846435-14. Jul 25 14:26:25.075943 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '7', 'body': {'add_host': {'host': 'n-h1-846435-14'}}} Jul 25 14:26:25.075943 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:25.075943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:25.075943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 14:26:25.075943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 25 14:26:25.075943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 14:26:25.075943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 25 14:26:25.075943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 14:26:25.075943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 25 14:26:25.075943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 14:26:25.075943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 25 14:26:25.075943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 14:26:25.075943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 14:26:25.075943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 14:26:25.075943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result.read() Jul 25 14:26:25.075943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 14:26:25.075943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 25 14:26:25.075943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 14:26:25.075943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 25 14:26:25.077244 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 14:26:25.077244 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 25 14:26:25.077244 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 14:26:25.077244 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 25 14:26:25.077244 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-846435-14-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 25 14:26:25.077244 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:25.077244 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 25 14:26:25.077244 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:25.077244 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:25.077244 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jul 25 14:26:25.077244 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jul 25 14:26:25.077244 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 25 14:26:25.077244 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi session.flush() Jul 25 14:26:25.077244 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 14:26:25.077244 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 25 14:26:25.077244 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 14:26:25.077244 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 25 14:26:25.077244 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 14:26:25.077244 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 25 14:26:25.078688 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 14:26:25.078688 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception Jul 25 14:26:25.078688 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 14:26:25.078688 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 25 14:26:25.078688 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 14:26:25.078688 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 25 14:26:25.078688 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 14:26:25.078688 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 25 14:26:25.078688 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 14:26:25.078688 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 25 14:26:25.078688 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 14:26:25.078688 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 25 14:26:25.078688 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 14:26:25.078688 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 14:26:25.078688 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 14:26:25.078688 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 25 14:26:25.078688 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 14:26:25.078688 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 25 14:26:25.079853 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 14:26:25.079853 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 25 14:26:25.079853 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 14:26:25.079853 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 14:26:25.079853 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 14:26:25.079853 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception Jul 25 14:26:25.079853 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 14:26:25.079853 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 25 14:26:25.079853 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 14:26:25.079853 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 25 14:26:25.079853 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 14:26:25.079853 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 25 14:26:25.079853 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 14:26:25.079853 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 25 14:26:25.079853 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 14:26:25.079853 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 14:26:25.079853 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 14:26:25.079853 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result.read() Jul 25 14:26:25.081252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 14:26:25.081252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 25 14:26:25.081252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 14:26:25.081252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 25 14:26:25.081252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 14:26:25.081252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 25 14:26:25.081252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 14:26:25.081252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 25 14:26:25.081252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-846435-14-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 25 14:26:25.081252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jul 25 14:26:25.081252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 25, 14, 26, 25, 22931), 'updated_at': None, 'host': 'n-h1-846435-14', 'aggregate_id': 7}] Jul 25 14:26:25.081252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 14:26:25.081252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:25.081252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:25.081252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:25.081252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:25.081252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 25 14:26:25.082435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 25 14:26:25.082435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 14:26:25.082435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 14:26:25.082435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:26:25.082435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:26:25.082435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:26:25.082435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:26:25.082435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 14:26:25.082435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 14:26:25.082435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jul 25 14:26:25.082435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jul 25 14:26:25.082435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 25 14:26:25.082435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 25 14:26:25.082435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jul 25 14:26:25.082435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jul 25 14:26:25.082435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jul 25 14:26:25.082435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jul 25 14:26:25.082435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 7 already has host n-h1-846435-14. Jul 25 14:26:25.082435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:25.082435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:25.083764 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:25.083764 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:25.083764 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:25.083764 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:25.083764 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:25.083764 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:25.083764 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:25.083764 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:25.083764 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:26:25.083764 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:26:25.083764 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jul 25 14:26:25.083764 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 25 14:26:25.083764 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 7 already has host n-h1-846435-14. Jul 25 14:26:25.083764 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:25.083764 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:25.083764 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:25.083764 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:25.083764 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:25.083764 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:25.083764 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:26:25.083764 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:26:25.087159 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 already has host n-h1-846435-14. Jul 25 14:26:25.087159 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:25.087159 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4de0ce2f-ce1d-4ce4-b8ba-eeb6382909b9 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Returning 409 to user: Aggregate 7 already has host n-h1-846435-14. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:25.087159 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4de0ce2f-ce1d-4ce4-b8ba-eeb6382909b9 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/7/action" status: 409 len: 96 microversion: 2.1 time: 0.162633 Jul 25 14:26:25.087159 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 173/334] 10.222.0.88 () {60 vars in 1191 bytes} [Mon Jul 25 14:26:24 2022] POST /compute/v2.1/os-aggregates/7/action => generated 96 bytes in 168 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jul 25 14:26:25.104982 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-099432ec-5f3b-42bb-b2f5-705217e8cebe tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-846435-14"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:25.116675 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:25.116675 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:25.136860 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-cfc35d39-6edb-4976-b202-1e7ccdd62b64 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Jul 25 14:26:25.137831 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-099432ec-5f3b-42bb-b2f5-705217e8cebe tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:25.144273 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cfc35d39-6edb-4976-b202-1e7ccdd62b64 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Request method failure captured: Jul 25 14:26:25.144273 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/os-aggregates/8 HTTP/1.1 Jul 25 14:26:25.144273 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:26:25.144273 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:26:25.144273 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:26:25.144273 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:26:25.144273 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:26:25.144273 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:26:25.144273 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:26:25.144273 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:25.144273 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qfZVHpe8O6FCRXlEnKHyXsQlSX6hfFKHxozQpH2aXbg-onJl0B6XDehabms0Cefqb6mcQuJkl66m5qLXNBbA3L02N7zgXpcQ03ePd42XNiHIhJEnNey5rv3VNFY8-CvLu2PMX1r_UrSG6OjEkkRA7hxJTnH25zIdV1cf4U6xKu5gI0 Jul 25 14:26:25.144273 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:26:25.144273 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:26:25.144273 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:26:25.144273 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:26:25.144273 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:26:25.144273 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:26:25.144273 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 7719233bd6be441599474918c7a78fc8 Jul 25 14:26:25.144273 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-AggregatesAdminTestJSON-1830763140 Jul 25 14:26:25.144273 n-d-846435-14 devstack@n-api.service[119303]: X-Role: admin,reader,member Jul 25 14:26:25.144273 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: admin,reader,member Jul 25 14:26:25.145681 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7719233bd6be441599474918c7a78fc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7719233bd6be441599474918c7a78fc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_7719233bd6be441599474918c7a78fc8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/7719233bd6be441599474918c7a78fc8"}]}] Jul 25 14:26:25.145681 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-AggregatesAdminTestJSON-1830763140 Jul 25 14:26:25.145681 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 7719233bd6be441599474918c7a78fc8 Jul 25 14:26:25.145681 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1830763140 Jul 25 14:26:25.145681 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-AggregatesAdminTestJSON-1830763140-project-admin Jul 25 14:26:25.145681 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:26:25.145681 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:26:25.145681 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: c7a00815fb6840bab5efa3b87923d993 Jul 25 14:26:25.145681 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-AggregatesAdminTestJSON-1830763140-project-admin Jul 25 14:26:25.145681 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:26:25.145681 n-d-846435-14 devstack@n-api.service[119303]: exception: Aggregate 8 could not be found. Jul 25 14:26:25.145681 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '8'} Jul 25 14:26:25.145681 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:25.146505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:25.146505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 25 14:26:25.146505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 25 14:26:25.146505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 14:26:25.146505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 14:26:25.146505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:26:25.146505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:26:25.146505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:26:25.146505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:26:25.146505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 14:26:25.146505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 14:26:25.146505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 25 14:26:25.146505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 25 14:26:25.146505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:26:25.146505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:26:25.146505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 25 14:26:25.146505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 25 14:26:25.146505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 14:26:25.146505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 14:26:25.147733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 25 14:26:25.147733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 25 14:26:25.147733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Jul 25 14:26:25.147733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:25.147733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:25.147733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:25.147733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:25.147733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:25.147733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:25.147733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:25.147733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:25.147733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:25.147733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:25.147733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 25 14:26:25.147733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:26:25.147733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Jul 25 14:26:25.147733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:25.147733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:25.147733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:25.147733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:25.147733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:25.149031 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:25.149031 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:26:25.149031 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:26:25.149031 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Jul 25 14:26:25.149031 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:25.149373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-099432ec-5f3b-42bb-b2f5-705217e8cebe tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:25.150770 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cfc35d39-6edb-4976-b202-1e7ccdd62b64 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:25.153723 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=5 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:25.157114 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cfc35d39-6edb-4976-b202-1e7ccdd62b64 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.098577 Jul 25 14:26:25.163553 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 162/335] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jul 25 14:26:25 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 77 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:26:25.189277 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c204a484-cb97-4d73-9c3f-5ca04f652463 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-238743492"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:25.206238 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:25.206238 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:25.207313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.aggregate [None req-c204a484-cb97-4d73-9c3f-5ca04f652463 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Generated uuid 543d3fcb-5bd9-492f-a4a8-4be1d222c810 for aggregate {{(pid=119303) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 14:26:25.241487 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=11,nova_api:DELETE=9 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:25.319357 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c204a484-cb97-4d73-9c3f-5ca04f652463 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.142932 Jul 25 14:26:25.326163 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 163/336] 10.222.0.88 () {60 vars in 1164 bytes} [Mon Jul 25 14:26:25 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:25.340259 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b27ab2ac-ca8c-46c3-b47c-ac9af8a87af9 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:25.341718 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:25.341718 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:25.357127 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b27ab2ac-ca8c-46c3-b47c-ac9af8a87af9 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 226 microversion: 2.1 time: 0.029633 Jul 25 14:26:25.365400 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 164/337] 10.222.0.88 () {58 vars in 1149 bytes} [Mon Jul 25 14:26:25 2022] GET /compute/v2.1/os-aggregates/9 => generated 226 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:25.382283 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9a67fe8f-d54c-4b2d-b83c-53ad280230b0 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:25.397714 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:25.397714 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:25.409413 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-099432ec-5f3b-42bb-b2f5-705217e8cebe tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 226 microversion: 2.1 time: 0.314081 Jul 25 14:26:25.415831 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 174/338] 10.222.0.88 () {60 vars in 1191 bytes} [Mon Jul 25 14:26:25 2022] POST /compute/v2.1/os-aggregates/7/action => generated 226 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:25.430642 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9a67fe8f-d54c-4b2d-b83c-53ad280230b0 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 264 microversion: 2.1 time: 0.052111 Jul 25 14:26:25.442771 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 165/339] 10.222.0.88 () {60 vars in 1191 bytes} [Mon Jul 25 14:26:25 2022] POST /compute/v2.1/os-aggregates/9/action => generated 264 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:25.447794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7c398a8e-01f2-4820-a47b-ad9ee7505e85 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:25.448574 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e70e620c-6bed-4099-a294-d34a7cdf0d78 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:25.451406 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:25.451406 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:25.455605 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:25.455605 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:25.468822 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7c398a8e-01f2-4820-a47b-ad9ee7505e85 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 240 microversion: 2.1 time: 0.023954 Jul 25 14:26:25.470180 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 166/340] 10.222.0.88 () {58 vars in 1149 bytes} [Mon Jul 25 14:26:25 2022] GET /compute/v2.1/os-aggregates/9 => generated 240 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:25.501129 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7652aaae-d8e3-484a-80c5-15cd19e05c0b tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:25.502682 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:25.502682 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:25.510430 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e70e620c-6bed-4099-a294-d34a7cdf0d78 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.092007 Jul 25 14:26:25.511026 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 175/341] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jul 25 14:26:25 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 14:26:25.531217 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-aaf38999-f616-40f4-8f7e-43ae7800879c tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1295198763"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:25.539470 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:25.539470 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:25.542278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.aggregate [None req-aaf38999-f616-40f4-8f7e-43ae7800879c tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Generated uuid 3bc6cddb-7f65-4534-9821-c06a97e0de47 for aggregate {{(pid=119304) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 14:26:25.550984 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7652aaae-d8e3-484a-80c5-15cd19e05c0b tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.068370 Jul 25 14:26:25.553524 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 167/342] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jul 25 14:26:25 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 14:26:25.569053 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7a31d4dd-7625-44a2-9de5-5ea9d0e535ab tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:25.573781 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7a31d4dd-7625-44a2-9de5-5ea9d0e535ab tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: b7018cc7-3f35-47d3-a679-30b828faedab] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:25.584733 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7a31d4dd-7625-44a2-9de5-5ea9d0e535ab tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:25.588400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7a31d4dd-7625-44a2-9de5-5ea9d0e535ab tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:25.591728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7a31d4dd-7625-44a2-9de5-5ea9d0e535ab tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:25.594097 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7a31d4dd-7625-44a2-9de5-5ea9d0e535ab tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:25.598729 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-aaf38999-f616-40f4-8f7e-43ae7800879c tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.081427 Jul 25 14:26:25.605437 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 176/343] 10.222.0.88 () {60 vars in 1164 bytes} [Mon Jul 25 14:26:25 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:25.606496 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8115096e-47dd-4104-a53a-d490d17b1e44 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-146917981", "availability_zone": "tempest-test_az-1973456431"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:25.615138 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:25.615138 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:25.618763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.aggregate [None req-8115096e-47dd-4104-a53a-d490d17b1e44 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Generated uuid a9d46ef8-e26c-4671-977b-667594d5fd0b for aggregate {{(pid=119304) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 14:26:25.666422 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8115096e-47dd-4104-a53a-d490d17b1e44 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.065393 Jul 25 14:26:25.667916 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 177/344] 10.222.0.88 () {60 vars in 1165 bytes} [Mon Jul 25 14:26:25 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:25.860462 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7a31d4dd-7625-44a2-9de5-5ea9d0e535ab tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:25.873810 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7a31d4dd-7625-44a2-9de5-5ea9d0e535ab tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab" status: 200 len: 1463 microversion: 2.1 time: 0.313562 Jul 25 14:26:25.875131 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 168/345] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:25 2022] GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab => generated 1463 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:25.881102 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-971138e6-1036-4f6e-bfb8-3d5b4874d8a8 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-146917981_new", "availability_zone": "tempest-test_az-1973456431_new"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:25.884634 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:25.884634 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:25.940692 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-971138e6-1036-4f6e-bfb8-3d5b4874d8a8 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:25.941701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-971138e6-1036-4f6e-bfb8-3d5b4874d8a8 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:26.005163 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=42 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:26.010412 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-971138e6-1036-4f6e-bfb8-3d5b4874d8a8 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-aggregates/11" status: 200 len: 336 microversion: 2.1 time: 0.133804 Jul 25 14:26:26.011059 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 169/346] 10.222.0.88 () {60 vars in 1173 bytes} [Mon Jul 25 14:26:25 2022] PUT /compute/v2.1/os-aggregates/11 => generated 336 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:26.024669 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1dc6a0fe-cfcf-4aaa-a1ea-ba7ae808856f tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:26.025292 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1dc6a0fe-cfcf-4aaa-a1ea-ba7ae808856f tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 9b76704f-db05-4df8-832a-2f9d30409637] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:26.036895 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1dc6a0fe-cfcf-4aaa-a1ea-ba7ae808856f tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:26.037703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1dc6a0fe-cfcf-4aaa-a1ea-ba7ae808856f tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:26.038754 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1dc6a0fe-cfcf-4aaa-a1ea-ba7ae808856f tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:26.039495 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1dc6a0fe-cfcf-4aaa-a1ea-ba7ae808856f tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:26.116488 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-87bd099f-a348-48bd-b2f9-f41c038be273 tempest-AggregatesAdminNegativeTestJSON-1433156439 tempest-AggregatesAdminNegativeTestJSON-1433156439-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-846435-14"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:26.119444 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:26.119444 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:26.120520 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-87bd099f-a348-48bd-b2f9-f41c038be273 tempest-AggregatesAdminNegativeTestJSON-1433156439 tempest-AggregatesAdminNegativeTestJSON-1433156439-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '01951376d7fd4d84a1b6fff78c7f5bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b2e3fdee054b1795deb765e23b3280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:26.125173 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-87bd099f-a348-48bd-b2f9-f41c038be273 tempest-AggregatesAdminNegativeTestJSON-1433156439 tempest-AggregatesAdminNegativeTestJSON-1433156439-project] Request method failure captured: Jul 25 14:26:26.125173 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Jul 25 14:26:26.125173 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:26:26.125173 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:26:26.125173 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:26:26.125173 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 40 Jul 25 14:26:26.125173 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:26:26.125173 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:26:26.125173 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:26:26.125173 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:26.125173 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfnaVij7CUadJ-LbEnNDdjLf89yFhW0YawEZXUY6izSnWZMm8Qt5xCOeAJj68875bkBQWGlWCN-eqpNz8T8FsyEOs2jPbLreE5_FCPqCGwZQvjweZ7IhjQ7r96K9UY4yG3840iPWZFDAboHo3DPFsAFA3lMPy57qeSr4gsNLdpW4Lg Jul 25 14:26:26.125173 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:26:26.125173 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:26:26.125173 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:26:26.125173 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:26:26.125173 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:26:26.125173 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:26:26.125173 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 23b2e3fdee054b1795deb765e23b3280 Jul 25 14:26:26.125173 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1433156439 Jul 25 14:26:26.125173 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:26:26.125173 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:26:26.126398 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/23b2e3fdee054b1795deb765e23b3280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/23b2e3fdee054b1795deb765e23b3280"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_23b2e3fdee054b1795deb765e23b3280", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/23b2e3fdee054b1795deb765e23b3280"}]}] Jul 25 14:26:26.126398 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1433156439 Jul 25 14:26:26.126398 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 23b2e3fdee054b1795deb765e23b3280 Jul 25 14:26:26.126398 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1433156439 Jul 25 14:26:26.126398 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-AggregatesAdminNegativeTestJSON-1433156439-project Jul 25 14:26:26.126398 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:26:26.126398 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:26:26.126398 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 01951376d7fd4d84a1b6fff78c7f5bae Jul 25 14:26:26.126398 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1433156439-project Jul 25 14:26:26.126398 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:26:26.126398 n-d-846435-14 devstack@n-api.service[119304]: {"add_host": {"host": "n-h1-846435-14"}} Jul 25 14:26:26.126398 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:26:26.126398 n-d-846435-14 devstack@n-api.service[119304]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 25 14:26:26.127136 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '10', 'body': {'add_host': {'host': 'n-h1-846435-14'}}} Jul 25 14:26:26.127136 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:26.127136 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:26.127136 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:26.127136 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:26.127136 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:26.127136 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:26.127136 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:26.127136 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:26.127136 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:26:26.127136 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:26:26.127136 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jul 25 14:26:26.127136 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jul 25 14:26:26.127136 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 14:26:26.127136 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 14:26:26.127136 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 14:26:26.127136 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 14:26:26.127136 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:26:26.127136 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:26:26.128236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:26:26.128236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:26:26.128236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 14:26:26.128236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 14:26:26.128236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 14:26:26.128236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 14:26:26.128236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 14:26:26.128236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 14:26:26.128236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 25 14:26:26.128236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.128236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:26.128236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.128236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:26.128236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:26.128236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:26.128236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 14:26:26.128236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 14:26:26.128236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 25 14:26:26.128236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.129331 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-87bd099f-a348-48bd-b2f9-f41c038be273 tempest-AggregatesAdminNegativeTestJSON-1433156439 tempest-AggregatesAdminNegativeTestJSON-1433156439-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:26.129331 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-87bd099f-a348-48bd-b2f9-f41c038be273 tempest-AggregatesAdminNegativeTestJSON-1433156439 tempest-AggregatesAdminNegativeTestJSON-1433156439-project] 10.222.0.88 "POST /compute/v2.1/os-aggregates/10/action" status: 403 len: 118 microversion: 2.1 time: 0.458592 Jul 25 14:26:26.130526 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 178/347] 10.222.0.88 () {60 vars in 1194 bytes} [Mon Jul 25 14:26:25 2022] POST /compute/v2.1/os-aggregates/10/action => generated 118 bytes in 461 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:26:26.144073 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8bfcc911-3cee-4714-a6d4-39e07517fc2e tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:26.146370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8bfcc911-3cee-4714-a6d4-39e07517fc2e tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:26.165067 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8bfcc911-3cee-4714-a6d4-39e07517fc2e tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:26.165573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8bfcc911-3cee-4714-a6d4-39e07517fc2e tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:26.168919 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8bfcc911-3cee-4714-a6d4-39e07517fc2e tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:26.169895 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8bfcc911-3cee-4714-a6d4-39e07517fc2e tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:26.189677 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1dc6a0fe-cfcf-4aaa-a1ea-ba7ae808856f tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:26.209766 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1dc6a0fe-cfcf-4aaa-a1ea-ba7ae808856f tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637" status: 200 len: 1280 microversion: 2.1 time: 0.194989 Jul 25 14:26:26.210915 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 170/348] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:26 2022] GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637 => generated 1280 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:26.221957 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-694c8ea3-b7bf-4fc8-a49c-69c56f563303 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:26.226560 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:26.226560 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:26.250813 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-694c8ea3-b7bf-4fc8-a49c-69c56f563303 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "GET /compute/v2.1/os-aggregates" status: 200 len: 554 microversion: 2.1 time: 0.036283 Jul 25 14:26:26.252519 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 171/349] 10.222.0.88 () {58 vars in 1143 bytes} [Mon Jul 25 14:26:26 2022] GET /compute/v2.1/os-aggregates => generated 554 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:26.263196 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-33603f73-977c-4905-85d6-08a79f686ab4 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:26.265751 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:26.265751 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:26.314545 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-33603f73-977c-4905-85d6-08a79f686ab4 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.058404 Jul 25 14:26:26.316569 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 172/350] 10.222.0.88 () {58 vars in 1155 bytes} [Mon Jul 25 14:26:26 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 14:26:26.329699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4fb344ad-c0b5-48c7-8a5a-74f8c5dc7f6d tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:26.331216 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:26.331216 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:26.369258 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4fb344ad-c0b5-48c7-8a5a-74f8c5dc7f6d tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.050172 Jul 25 14:26:26.370038 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 173/351] 10.222.0.88 () {58 vars in 1155 bytes} [Mon Jul 25 14:26:26 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 14:26:26.381317 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-981a80ae-20b9-4777-b9b0-18339a3f84eb tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1334623467"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:26.384205 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:26.384205 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:26.387058 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.aggregate [None req-981a80ae-20b9-4777-b9b0-18339a3f84eb tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Generated uuid 0d7b9173-ed11-42c4-bb16-4809ffc31b97 for aggregate {{(pid=119303) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 14:26:26.459925 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-981a80ae-20b9-4777-b9b0-18339a3f84eb tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.088591 Jul 25 14:26:26.461491 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 174/352] 10.222.0.88 () {60 vars in 1164 bytes} [Mon Jul 25 14:26:26 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:26.478791 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-88d30741-aa78-479f-b998-9f47df851681 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-812488487"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:26.488953 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:26.488953 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:26.490029 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.aggregate [None req-88d30741-aa78-479f-b998-9f47df851681 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Generated uuid 097fa6ec-c1e3-469a-ac44-a42d4c8fefa3 for aggregate {{(pid=119303) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 14:26:26.552695 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-88d30741-aa78-479f-b998-9f47df851681 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.089489 Jul 25 14:26:26.555807 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 175/353] 10.222.0.88 () {60 vars in 1164 bytes} [Mon Jul 25 14:26:26 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:26.568487 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b4758cff-348d-4d42-9cda-4a94ee173146 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-767342793"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:26.580212 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:26.580212 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:26.603648 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b4758cff-348d-4d42-9cda-4a94ee173146 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:26.605208 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b4758cff-348d-4d42-9cda-4a94ee173146 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:26.608685 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8bfcc911-3cee-4714-a6d4-39e07517fc2e tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:26.619679 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8bfcc911-3cee-4714-a6d4-39e07517fc2e tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1463 microversion: 2.1 time: 0.486907 Jul 25 14:26:26.620254 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 179/354] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:26 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1463 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:26.629951 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b4758cff-348d-4d42-9cda-4a94ee173146 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:26.630697 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b4758cff-348d-4d42-9cda-4a94ee173146 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:26.642355 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-b4758cff-348d-4d42-9cda-4a94ee173146 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-767342793 could not be found. Jul 25 14:26:26.660554 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b4758cff-348d-4d42-9cda-4a94ee173146 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Request method failure captured: Jul 25 14:26:26.660554 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Jul 25 14:26:26.660554 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:26:26.660554 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:26:26.660554 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:26:26.660554 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 57 Jul 25 14:26:26.660554 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:26:26.660554 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:26:26.660554 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:26:26.660554 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:26.660554 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qfrk8sVGXsDqmhpZWz7J0Bm3w7SJo2Zip8QxPneTId9qHuMkiM-5Q6QrnVOzmA8IlDYzwlgpnxzqv89mPFD81OF3fP4oMPBg2T7fknckotFmas4lLxiFkI8qKcC9FQPMFhV9kCKf0OTrjPUoufcyO4jX3a-T0NwKnKsdyq_aYYEKbs Jul 25 14:26:26.660554 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:26:26.660554 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:26:26.660554 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:26:26.660554 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:26:26.660554 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:26:26.660554 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:26:26.660554 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 210769c76f534885b40be67c84b4da2c Jul 25 14:26:26.660554 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-758784592 Jul 25 14:26:26.660554 n-d-846435-14 devstack@n-api.service[119303]: X-Role: admin,reader,member Jul 25 14:26:26.660554 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: admin,reader,member Jul 25 14:26:26.662138 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/210769c76f534885b40be67c84b4da2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/210769c76f534885b40be67c84b4da2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_210769c76f534885b40be67c84b4da2c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/210769c76f534885b40be67c84b4da2c"}]}] Jul 25 14:26:26.662138 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-758784592 Jul 25 14:26:26.662138 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 210769c76f534885b40be67c84b4da2c Jul 25 14:26:26.662138 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-758784592 Jul 25 14:26:26.662138 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin Jul 25 14:26:26.662138 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:26:26.662138 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:26:26.662138 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 437bdf0ef30d4aeb965581dae9c76a48 Jul 25 14:26:26.662138 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin Jul 25 14:26:26.662138 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:26:26.662138 n-d-846435-14 devstack@n-api.service[119303]: {"add_host": {"host": "tempest-nonexist_host-767342793"}} Jul 25 14:26:26.662138 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:26:26.662138 n-d-846435-14 devstack@n-api.service[119303]: exception: Compute host tempest-nonexist_host-767342793 could not be found. Jul 25 14:26:26.663425 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '12', 'body': {'add_host': {'host': 'tempest-nonexist_host-767342793'}}} Jul 25 14:26:26.663425 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:26.663425 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:26.663425 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 25 14:26:26.663425 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 25 14:26:26.663425 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:26:26.663425 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:26:26.663425 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 25 14:26:26.663425 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 25 14:26:26.663425 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 14:26:26.663425 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 14:26:26.663425 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 25 14:26:26.663425 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 25 14:26:26.663425 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-767342793' is not mapped to any cell Jul 25 14:26:26.663425 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.663425 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:26.663425 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.663425 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:26.663425 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 25 14:26:26.665614 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 25 14:26:26.665614 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 25 14:26:26.665614 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 25 14:26:26.665614 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 25 14:26:26.665614 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.665614 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:26.665614 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.665614 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:26.665614 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 25 14:26:26.665614 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 25 14:26:26.665614 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 14:26:26.665614 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 14:26:26.665614 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:26:26.665614 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:26:26.665614 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:26:26.665614 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:26:26.665614 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 14:26:26.665614 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 14:26:26.665614 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jul 25 14:26:26.665614 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jul 25 14:26:26.668662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 25 14:26:26.668662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 25 14:26:26.668662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-767342793 could not be found. Jul 25 14:26:26.668662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.668662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:26.668662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.668662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:26.668662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:26.668662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:26.668662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:26.668662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:26.668662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:26.668662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:26.668662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:26:26.668662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:26:26.668662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jul 25 14:26:26.668662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:26:26.668662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-767342793 could not be found. Jul 25 14:26:26.668662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.668662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:26.668662 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.675341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:26.675341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:26.675341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:26.675341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:26:26.675341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:26:26.675341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-767342793 could not be found. Jul 25 14:26:26.675341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.675341 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b4758cff-348d-4d42-9cda-4a94ee173146 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-767342793 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:26.675341 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b4758cff-348d-4d42-9cda-4a94ee173146 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/12/action" status: 404 len: 110 microversion: 2.1 time: 0.104414 Jul 25 14:26:26.676727 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6728ec68-6d4e-453f-9523-b2559c522c03 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:26.676727 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:26.676727 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:26.677076 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 176/355] 10.222.0.88 () {60 vars in 1194 bytes} [Mon Jul 25 14:26:26 2022] POST /compute/v2.1/os-aggregates/12/action => generated 110 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:26:26.683538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7cb33173-6594-45b5-b340-647ea69e90a9 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:26.684833 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:26.684833 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:26.688147 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6728ec68-6d4e-453f-9523-b2559c522c03 tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "GET /compute/v2.1/os-aggregates" status: 200 len: 445 microversion: 2.1 time: 0.052384 Jul 25 14:26:26.695218 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 180/356] 10.222.0.88 () {58 vars in 1143 bytes} [Mon Jul 25 14:26:26 2022] GET /compute/v2.1/os-aggregates => generated 445 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:26.705331 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2760e251-9cb5-4718-8959-c46636a1e3ba tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:26.712092 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:26.712092 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:26.744571 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7cb33173-6594-45b5-b340-647ea69e90a9 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.069558 Jul 25 14:26:26.750566 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 177/357] 10.222.0.88 () {58 vars in 1155 bytes} [Mon Jul 25 14:26:26 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 14:26:26.760562 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-82c6ef0f-3bf5-47f1-8a45-e57ce2a3e7ef tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:26.763947 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2760e251-9cb5-4718-8959-c46636a1e3ba tempest-AggregatesAdminTestJSON-1830763140 tempest-AggregatesAdminTestJSON-1830763140-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.064204 Jul 25 14:26:26.765631 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 181/358] 10.222.0.88 () {58 vars in 1155 bytes} [Mon Jul 25 14:26:26 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 14:26:26.769621 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-82c6ef0f-3bf5-47f1-8a45-e57ce2a3e7ef tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Request method failure captured: Jul 25 14:26:26.769621 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 25 14:26:26.769621 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:26:26.769621 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:26:26.769621 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:26:26.769621 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 283 Jul 25 14:26:26.769621 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:26:26.769621 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:26:26.769621 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:26:26.769621 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:26.769621 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qfrk8sVGXsDqmhpZWz7J0Bm3w7SJo2Zip8QxPneTId9qHuMkiM-5Q6QrnVOzmA8IlDYzwlgpnxzqv89mPFD81OF3fP4oMPBg2T7fknckotFmas4lLxiFkI8qKcC9FQPMFhV9kCKf0OTrjPUoufcyO4jX3a-T0NwKnKsdyq_aYYEKbs Jul 25 14:26:26.769621 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:26:26.769621 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:26:26.769621 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:26:26.769621 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:26:26.769621 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:26:26.769621 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:26:26.769621 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 210769c76f534885b40be67c84b4da2c Jul 25 14:26:26.769621 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-758784592 Jul 25 14:26:26.769621 n-d-846435-14 devstack@n-api.service[119303]: X-Role: admin,reader,member Jul 25 14:26:26.769621 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: admin,reader,member Jul 25 14:26:26.770804 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/210769c76f534885b40be67c84b4da2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/210769c76f534885b40be67c84b4da2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_210769c76f534885b40be67c84b4da2c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/210769c76f534885b40be67c84b4da2c"}]}] Jul 25 14:26:26.770804 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-758784592 Jul 25 14:26:26.770804 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 210769c76f534885b40be67c84b4da2c Jul 25 14:26:26.770804 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-758784592 Jul 25 14:26:26.770804 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin Jul 25 14:26:26.770804 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:26:26.770804 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:26:26.770804 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 437bdf0ef30d4aeb965581dae9c76a48 Jul 25 14:26:26.770804 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin Jul 25 14:26:26.770804 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:26:26.770804 n-d-846435-14 devstack@n-api.service[119303]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 25 14:26:26.771417 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:26:26.771417 n-d-846435-14 devstack@n-api.service[119303]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 14:26:26.771417 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 25 14:26:26.771417 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:26.771417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:26.771417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:26:26.771417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:26:26.771417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:26:26.771417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:26:26.771417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 14:26:26.771417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.772073 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jul 25 14:26:26.772073 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 14:26:26.772073 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.772073 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 25 14:26:26.772073 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 25 14:26:26.772073 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.772073 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:26.772073 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.772073 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:26.772073 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:26.772073 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:26.772073 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:26.772073 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:26.772073 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:26.772073 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:26.772073 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:26:26.772073 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:26:26.772073 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:26:26.772073 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:26:26.773082 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:26:26.773082 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:26:26.773082 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:26:26.773082 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:26:26.773082 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 14:26:26.773082 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.773082 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:26.773082 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.773082 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:26.773082 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:26.773082 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:26.773082 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:26:26.773082 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:26:26.773822 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 14:26:26.773822 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.775583 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-82c6ef0f-3bf5-47f1-8a45-e57ce2a3e7ef tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:26.776699 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-82c6ef0f-3bf5-47f1-8a45-e57ce2a3e7ef tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.024418 Jul 25 14:26:26.777458 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 178/359] 10.222.0.88 () {60 vars in 1165 bytes} [Mon Jul 25 14:26:26 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:26:26.784287 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-34d0b3e9-e6d2-45a7-8641-8e0c714cc206 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:26.785836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-34d0b3e9-e6d2-45a7-8641-8e0c714cc206 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:26.801098 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9b3890b5-2277-4551-b9ca-c37ea519b228 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:26.809813 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-34d0b3e9-e6d2-45a7-8641-8e0c714cc206 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:26.809813 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-34d0b3e9-e6d2-45a7-8641-8e0c714cc206 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:26.809813 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-34d0b3e9-e6d2-45a7-8641-8e0c714cc206 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:26.809813 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-34d0b3e9-e6d2-45a7-8641-8e0c714cc206 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:26.825044 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9b3890b5-2277-4551-b9ca-c37ea519b228 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Request method failure captured: Jul 25 14:26:26.825044 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 25 14:26:26.825044 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:26:26.825044 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:26:26.825044 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:26:26.825044 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 27 Jul 25 14:26:26.825044 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:26:26.825044 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:26:26.825044 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:26:26.825044 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:26.825044 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qfrk8sVGXsDqmhpZWz7J0Bm3w7SJo2Zip8QxPneTId9qHuMkiM-5Q6QrnVOzmA8IlDYzwlgpnxzqv89mPFD81OF3fP4oMPBg2T7fknckotFmas4lLxiFkI8qKcC9FQPMFhV9kCKf0OTrjPUoufcyO4jX3a-T0NwKnKsdyq_aYYEKbs Jul 25 14:26:26.825044 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:26:26.825044 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:26:26.825044 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:26:26.825044 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:26:26.825044 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:26:26.825044 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:26:26.825044 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 210769c76f534885b40be67c84b4da2c Jul 25 14:26:26.825044 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-758784592 Jul 25 14:26:26.825044 n-d-846435-14 devstack@n-api.service[119303]: X-Role: admin,reader,member Jul 25 14:26:26.825044 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: admin,reader,member Jul 25 14:26:26.826488 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/210769c76f534885b40be67c84b4da2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/210769c76f534885b40be67c84b4da2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_210769c76f534885b40be67c84b4da2c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/210769c76f534885b40be67c84b4da2c"}]}] Jul 25 14:26:26.826488 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-758784592 Jul 25 14:26:26.826488 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 210769c76f534885b40be67c84b4da2c Jul 25 14:26:26.826488 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-758784592 Jul 25 14:26:26.826488 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin Jul 25 14:26:26.826488 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:26:26.826488 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:26:26.826488 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 437bdf0ef30d4aeb965581dae9c76a48 Jul 25 14:26:26.826488 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin Jul 25 14:26:26.826488 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:26:26.826488 n-d-846435-14 devstack@n-api.service[119303]: {"aggregate": {"name": ""}} Jul 25 14:26:26.826488 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:26:26.826488 n-d-846435-14 devstack@n-api.service[119303]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 25 14:26:26.827288 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'body': {'aggregate': {'name': ''}}} Jul 25 14:26:26.827288 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:26.827288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:26.827288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:26:26.827288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:26:26.827288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:26:26.827288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:26:26.827288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 25 14:26:26.827288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.827288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jul 25 14:26:26.827288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 14:26:26.827288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.827288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 25 14:26:26.827288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi '' Jul 25 14:26:26.827288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.827288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:26.827288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.827288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:26.827288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:26.827288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:26.827288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:26.827288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:26.827288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:26.829265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:26.829265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:26:26.829265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:26:26.829265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:26:26.829265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:26:26.829265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:26:26.829265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:26:26.829265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:26:26.829265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:26:26.829265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 25 14:26:26.829265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.829265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:26.829265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.829265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:26.829265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:26.829265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:26.829265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:26:26.829265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:26:26.829265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 25 14:26:26.829265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.840033 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9b3890b5-2277-4551-b9ca-c37ea519b228 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:26.844388 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9b3890b5-2277-4551-b9ca-c37ea519b228 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.060019 Jul 25 14:26:26.849468 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 179/360] 10.222.0.88 () {60 vars in 1164 bytes} [Mon Jul 25 14:26:26 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:26:26.863059 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-34d0b3e9-e6d2-45a7-8641-8e0c714cc206 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] HTTP exception thrown: Instance a9eb52d5-1abd-4050-ada7-60d23d4bb29f could not be found. Jul 25 14:26:26.868393 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-34d0b3e9-e6d2-45a7-8641-8e0c714cc206 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Request method failure captured: Jul 25 14:26:26.868393 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f HTTP/1.1 Jul 25 14:26:26.868393 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:26:26.868393 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:26:26.868393 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:26:26.868393 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:26:26.868393 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:26:26.868393 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:26:26.868393 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:26:26.868393 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:26.868393 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfWFzn3TRYgxiDs3R9clfLBm71tFJf6-E4Q2YKrzEMBahbQrxbWAea9Pf-LZ2eb4IFT4l09uJl4WQVd3ZE72tckkYvBk6lHJ-2dlyiOaf_XShyHHfgYs6Nuw6jJ616wHkxMMJJn_4YMor2ou3uPnUQo6AO4Qb5CNVJs_W5LGYg2sRk Jul 25 14:26:26.868393 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:26:26.868393 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:26:26.868393 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:26:26.868393 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:26:26.868393 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:26:26.868393 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:26:26.868393 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 78221408d9ae4bdfb29ded35235d5287 Jul 25 14:26:26.868393 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-AggregatesAdminTestJSON-1334684196 Jul 25 14:26:26.868393 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:26:26.868393 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:26:26.869843 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/78221408d9ae4bdfb29ded35235d5287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/78221408d9ae4bdfb29ded35235d5287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_78221408d9ae4bdfb29ded35235d5287", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/78221408d9ae4bdfb29ded35235d5287"}]}] Jul 25 14:26:26.869843 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-AggregatesAdminTestJSON-1334684196 Jul 25 14:26:26.869843 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 78221408d9ae4bdfb29ded35235d5287 Jul 25 14:26:26.869843 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1334684196 Jul 25 14:26:26.869843 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-AggregatesAdminTestJSON-1334684196-project Jul 25 14:26:26.869843 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:26:26.869843 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:26:26.869843 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 71a2d52c9e2c48dd9e7502843844bf27 Jul 25 14:26:26.869843 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-AggregatesAdminTestJSON-1334684196-project Jul 25 14:26:26.869843 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:26:26.869843 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance a9eb52d5-1abd-4050-ada7-60d23d4bb29f could not be found. Jul 25 14:26:26.869843 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'a9eb52d5-1abd-4050-ada7-60d23d4bb29f'} Jul 25 14:26:26.870565 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:26.870565 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:26.870565 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:26:26.870565 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:26:26.870565 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:26:26.870565 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:26:26.870565 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:26:26.870565 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:26:26.870565 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:26:26.870565 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:26:26.870565 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9eb52d5-1abd-4050-ada7-60d23d4bb29f could not be found. Jul 25 14:26:26.870565 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.870565 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:26.870565 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.870565 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:26.870565 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:26.870565 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:26.870565 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:26.870565 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:26.870565 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:26.871626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:26.871626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:26:26.871626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:26:26.871626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:26:26.871626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:26:26.871626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:26:26.871626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:26:26.871626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:26:26.871626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:26:26.871626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9eb52d5-1abd-4050-ada7-60d23d4bb29f could not be found. Jul 25 14:26:26.871626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.871626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:26.871626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.871626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:26.871626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:26.871626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:26.871626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:26:26.871626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:26:26.871626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9eb52d5-1abd-4050-ada7-60d23d4bb29f could not be found. Jul 25 14:26:26.871626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.874595 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a77c8603-44d3-4871-b242-f3c908078a45 tempest-AggregatesAdminNegativeTestJSON-1433156439 tempest-AggregatesAdminNegativeTestJSON-1433156439-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1325843065"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:26.876223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-34d0b3e9-e6d2-45a7-8641-8e0c714cc206 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Returning 404 to user: Instance a9eb52d5-1abd-4050-ada7-60d23d4bb29f could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:26.877357 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-34d0b3e9-e6d2-45a7-8641-8e0c714cc206 tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f" status: 404 len: 111 microversion: 2.1 time: 0.106203 Jul 25 14:26:26.878270 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 182/361] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:26:26 2022] DELETE /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:26:26.886371 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:26.886371 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:26.888570 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a77c8603-44d3-4871-b242-f3c908078a45 tempest-AggregatesAdminNegativeTestJSON-1433156439 tempest-AggregatesAdminNegativeTestJSON-1433156439-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '01951376d7fd4d84a1b6fff78c7f5bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b2e3fdee054b1795deb765e23b3280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:26.890255 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a77c8603-44d3-4871-b242-f3c908078a45 tempest-AggregatesAdminNegativeTestJSON-1433156439 tempest-AggregatesAdminNegativeTestJSON-1433156439-project] Request method failure captured: Jul 25 14:26:26.890255 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 25 14:26:26.890255 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:26:26.890255 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:26:26.890255 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:26:26.890255 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 60 Jul 25 14:26:26.890255 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:26:26.890255 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:26:26.890255 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:26:26.890255 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:26.890255 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qfnaVij7CUadJ-LbEnNDdjLf89yFhW0YawEZXUY6izSnWZMm8Qt5xCOeAJj68875bkBQWGlWCN-eqpNz8T8FsyEOs2jPbLreE5_FCPqCGwZQvjweZ7IhjQ7r96K9UY4yG3840iPWZFDAboHo3DPFsAFA3lMPy57qeSr4gsNLdpW4Lg Jul 25 14:26:26.890255 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:26:26.890255 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:26:26.890255 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:26:26.890255 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:26:26.890255 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:26:26.890255 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:26:26.890255 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 23b2e3fdee054b1795deb765e23b3280 Jul 25 14:26:26.890255 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1433156439 Jul 25 14:26:26.890255 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:26:26.890255 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:26:26.891489 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/23b2e3fdee054b1795deb765e23b3280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/23b2e3fdee054b1795deb765e23b3280"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_23b2e3fdee054b1795deb765e23b3280", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/23b2e3fdee054b1795deb765e23b3280"}]}] Jul 25 14:26:26.891489 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1433156439 Jul 25 14:26:26.891489 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 23b2e3fdee054b1795deb765e23b3280 Jul 25 14:26:26.891489 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1433156439 Jul 25 14:26:26.891489 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-AggregatesAdminNegativeTestJSON-1433156439-project Jul 25 14:26:26.891489 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:26:26.891489 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:26:26.891489 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 01951376d7fd4d84a1b6fff78c7f5bae Jul 25 14:26:26.891489 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1433156439-project Jul 25 14:26:26.891489 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:26:26.891489 n-d-846435-14 devstack@n-api.service[119303]: {"aggregate": {"name": "tempest-test_aggregate-1325843065"}} Jul 25 14:26:26.891489 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:26:26.891489 n-d-846435-14 devstack@n-api.service[119303]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 25 14:26:26.892250 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1325843065'}}} Jul 25 14:26:26.892250 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:26.892250 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:26.892250 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:26.892250 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:26.892250 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:26.892250 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:26.892250 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:26.892250 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:26.892250 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:26:26.892250 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:26:26.892250 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:26:26.892250 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:26:26.892250 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jul 25 14:26:26.892250 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jul 25 14:26:26.892250 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 14:26:26.892250 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 14:26:26.892250 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 14:26:26.892250 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 14:26:26.893240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:26:26.893240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:26:26.893240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:26:26.893240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:26:26.893240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 14:26:26.893240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 14:26:26.893240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 14:26:26.893240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 14:26:26.893240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 14:26:26.893240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 14:26:26.893240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 25 14:26:26.893240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.893240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:26.893240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.893240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:26.893240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:26.893240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:26.893240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 14:26:26.893240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 14:26:26.893240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 25 14:26:26.894350 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.894350 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a77c8603-44d3-4871-b242-f3c908078a45 tempest-AggregatesAdminNegativeTestJSON-1433156439 tempest-AggregatesAdminNegativeTestJSON-1433156439-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:26.894350 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a77c8603-44d3-4871-b242-f3c908078a45 tempest-AggregatesAdminNegativeTestJSON-1433156439 tempest-AggregatesAdminNegativeTestJSON-1433156439-project] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.037152 Jul 25 14:26:26.894563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3a722fd4-55ca-4d86-aa92-da087d37670c tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:26.894733 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 180/362] 10.222.0.88 () {60 vars in 1164 bytes} [Mon Jul 25 14:26:26 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:26:26.897750 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3a722fd4-55ca-4d86-aa92-da087d37670c tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] [instance: a9eb52d5-1abd-4050-ada7-60d23d4bb29f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:26.909558 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a722fd4-55ca-4d86-aa92-da087d37670c tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:26.910157 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a722fd4-55ca-4d86-aa92-da087d37670c tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:26.910992 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a722fd4-55ca-4d86-aa92-da087d37670c tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:26.911446 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a722fd4-55ca-4d86-aa92-da087d37670c tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:26.915732 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8383108f-36f0-4b22-bcc7-cba88a6dc66e tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1703154566"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:26.926512 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.aggregate [None req-8383108f-36f0-4b22-bcc7-cba88a6dc66e tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Generated uuid 5e27497a-dcce-423d-ba15-2608f8f79265 for aggregate {{(pid=119303) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 14:26:26.937156 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-3a722fd4-55ca-4d86-aa92-da087d37670c tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] HTTP exception thrown: Instance a9eb52d5-1abd-4050-ada7-60d23d4bb29f could not be found. Jul 25 14:26:26.939470 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3a722fd4-55ca-4d86-aa92-da087d37670c tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Request method failure captured: Jul 25 14:26:26.939470 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f HTTP/1.1 Jul 25 14:26:26.939470 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:26:26.939470 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:26:26.939470 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:26:26.939470 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:26:26.939470 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:26:26.939470 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:26:26.939470 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:26:26.939470 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:26.939470 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfWFzn3TRYgxiDs3R9clfLBm71tFJf6-E4Q2YKrzEMBahbQrxbWAea9Pf-LZ2eb4IFT4l09uJl4WQVd3ZE72tckkYvBk6lHJ-2dlyiOaf_XShyHHfgYs6Nuw6jJ616wHkxMMJJn_4YMor2ou3uPnUQo6AO4Qb5CNVJs_W5LGYg2sRk Jul 25 14:26:26.939470 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:26:26.939470 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:26:26.939470 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:26:26.939470 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:26:26.939470 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:26:26.939470 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:26:26.939470 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 78221408d9ae4bdfb29ded35235d5287 Jul 25 14:26:26.939470 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-AggregatesAdminTestJSON-1334684196 Jul 25 14:26:26.939470 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:26:26.939470 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:26:26.940698 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/78221408d9ae4bdfb29ded35235d5287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/78221408d9ae4bdfb29ded35235d5287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_78221408d9ae4bdfb29ded35235d5287", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/78221408d9ae4bdfb29ded35235d5287"}]}] Jul 25 14:26:26.940698 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-AggregatesAdminTestJSON-1334684196 Jul 25 14:26:26.940698 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 78221408d9ae4bdfb29ded35235d5287 Jul 25 14:26:26.940698 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1334684196 Jul 25 14:26:26.940698 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-AggregatesAdminTestJSON-1334684196-project Jul 25 14:26:26.940698 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:26:26.940698 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:26:26.940698 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 71a2d52c9e2c48dd9e7502843844bf27 Jul 25 14:26:26.940698 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-AggregatesAdminTestJSON-1334684196-project Jul 25 14:26:26.940698 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:26:26.940698 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance a9eb52d5-1abd-4050-ada7-60d23d4bb29f could not be found. Jul 25 14:26:26.940698 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'a9eb52d5-1abd-4050-ada7-60d23d4bb29f'} Jul 25 14:26:26.941423 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:26.941423 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:26.941423 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:26:26.941423 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:26:26.941423 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:26:26.941423 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:26:26.941423 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:26:26.941423 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:26:26.941423 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:26:26.941423 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:26:26.941423 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9eb52d5-1abd-4050-ada7-60d23d4bb29f could not be found. Jul 25 14:26:26.941423 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.941423 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:26.941423 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.941423 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:26.941423 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:26.941423 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:26.941423 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:26.941423 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:26.941423 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:26.942444 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:26.942444 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:26:26.942444 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:26:26.942444 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:26:26.942444 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:26:26.942444 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:26:26.942444 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:26:26.942444 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9eb52d5-1abd-4050-ada7-60d23d4bb29f could not be found. Jul 25 14:26:26.942444 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.942444 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:26.942444 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.942444 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:26.942444 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:26.942444 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:26.942444 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:26:26.942444 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:26:26.942444 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9eb52d5-1abd-4050-ada7-60d23d4bb29f could not be found. Jul 25 14:26:26.942444 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:26.943371 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3a722fd4-55ca-4d86-aa92-da087d37670c tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] Returning 404 to user: Instance a9eb52d5-1abd-4050-ada7-60d23d4bb29f could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:26.943371 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3a722fd4-55ca-4d86-aa92-da087d37670c tempest-AggregatesAdminTestJSON-1334684196 tempest-AggregatesAdminTestJSON-1334684196-project] 10.222.0.88 "GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f" status: 404 len: 111 microversion: 2.1 time: 0.058708 Jul 25 14:26:26.943504 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 183/363] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:26 2022] GET /compute/v2.1/servers/a9eb52d5-1abd-4050-ada7-60d23d4bb29f => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:26:26.951535 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a3cf8e71-6b30-4c5b-a059-8d37b5323ebb tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1095941079", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "c25476ab-b697-45f9-aa22-ead2d1b23fc7"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:26.990972 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8383108f-36f0-4b22-bcc7-cba88a6dc66e tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.084431 Jul 25 14:26:26.997727 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 181/364] 10.222.0.88 () {60 vars in 1164 bytes} [Mon Jul 25 14:26:26 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:27.015313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1df12c7b-9672-4974-9111-6e561f30a5bc tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1703154566"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:27.025179 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-a3cf8e71-6b30-4c5b-a059-8d37b5323ebb tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] validate_networks() for None {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:26:27.027943 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:27.027943 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:27.030991 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.aggregate [None req-1df12c7b-9672-4974-9111-6e561f30a5bc tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Generated uuid 2f1856d8-6259-45ce-bf44-f7711cdd1ab7 for aggregate {{(pid=119303) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 14:26:27.053567 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-1df12c7b-9672-4974-9111-6e561f30a5bc tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1703154566 already exists. Jul 25 14:26:27.060860 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1df12c7b-9672-4974-9111-6e561f30a5bc tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Request method failure captured: Jul 25 14:26:27.060860 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 25 14:26:27.060860 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:26:27.060860 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:26:27.060860 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:26:27.060860 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 60 Jul 25 14:26:27.060860 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:26:27.060860 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:26:27.060860 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:26:27.060860 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:27.060860 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qfrk8sVGXsDqmhpZWz7J0Bm3w7SJo2Zip8QxPneTId9qHuMkiM-5Q6QrnVOzmA8IlDYzwlgpnxzqv89mPFD81OF3fP4oMPBg2T7fknckotFmas4lLxiFkI8qKcC9FQPMFhV9kCKf0OTrjPUoufcyO4jX3a-T0NwKnKsdyq_aYYEKbs Jul 25 14:26:27.060860 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:26:27.060860 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:26:27.060860 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:26:27.060860 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:26:27.060860 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:26:27.060860 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:26:27.060860 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 210769c76f534885b40be67c84b4da2c Jul 25 14:26:27.060860 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-758784592 Jul 25 14:26:27.060860 n-d-846435-14 devstack@n-api.service[119303]: X-Role: admin,reader,member Jul 25 14:26:27.060860 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: admin,reader,member Jul 25 14:26:27.062196 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/210769c76f534885b40be67c84b4da2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/210769c76f534885b40be67c84b4da2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_210769c76f534885b40be67c84b4da2c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/210769c76f534885b40be67c84b4da2c"}]}] Jul 25 14:26:27.062196 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-758784592 Jul 25 14:26:27.062196 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 210769c76f534885b40be67c84b4da2c Jul 25 14:26:27.062196 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-758784592 Jul 25 14:26:27.062196 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin Jul 25 14:26:27.062196 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:26:27.062196 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:26:27.062196 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 437bdf0ef30d4aeb965581dae9c76a48 Jul 25 14:26:27.062196 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin Jul 25 14:26:27.062196 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:26:27.062196 n-d-846435-14 devstack@n-api.service[119303]: {"aggregate": {"name": "tempest-test_aggregate-1703154566"}} Jul 25 14:26:27.062196 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:26:27.062196 n-d-846435-14 devstack@n-api.service[119303]: exception: Aggregate tempest-test_aggregate-1703154566 already exists. Jul 25 14:26:27.062906 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1703154566'}}} Jul 25 14:26:27.062906 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:27.062906 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:27.062906 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jul 25 14:26:27.062906 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jul 25 14:26:27.062906 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 14:26:27.062906 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 14:26:27.062906 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:26:27.062906 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:26:27.062906 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:26:27.062906 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:26:27.062906 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 14:26:27.062906 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 14:26:27.062906 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jul 25 14:26:27.062906 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi aggregate.create() Jul 25 14:26:27.062906 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 25 14:26:27.062906 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 25 14:26:27.062906 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jul 25 14:26:27.062906 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jul 25 14:26:27.064024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 14:26:27.064024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 14:26:27.064024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jul 25 14:26:27.064024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jul 25 14:26:27.064024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1703154566 already exists. Jul 25 14:26:27.064024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:27.064024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:27.064024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:27.064024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:27.064024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:27.064024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:27.064024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:27.064024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:27.064024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:27.064024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:27.064024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:26:27.064024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:26:27.064024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:26:27.064024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:26:27.064024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jul 25 14:26:27.065099 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 25 14:26:27.065099 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1703154566 already exists. Jul 25 14:26:27.065099 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:27.065099 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:27.065099 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:27.065099 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:27.065099 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:27.065099 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:27.065099 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:26:27.065099 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:26:27.065099 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1703154566 already exists. Jul 25 14:26:27.065099 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:27.065099 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1df12c7b-9672-4974-9111-6e561f30a5bc tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1703154566 already exists. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:27.065099 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1df12c7b-9672-4974-9111-6e561f30a5bc tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.053542 Jul 25 14:26:27.065878 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 182/365] 10.222.0.88 () {60 vars in 1164 bytes} [Mon Jul 25 14:26:27 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:26:27.086643 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2b95add7-b5f8-41a8-8bdd-56fc0073f7cb tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:27.090818 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:27.090818 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:27.156224 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2b95add7-b5f8-41a8-8bdd-56fc0073f7cb tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.085628 Jul 25 14:26:27.160696 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 183/366] 10.222.0.88 () {58 vars in 1155 bytes} [Mon Jul 25 14:26:27 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 14:26:27.768672 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-a3cf8e71-6b30-4c5b-a059-8d37b5323ebb tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:26:27.769477 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-a3cf8e71-6b30-4c5b-a059-8d37b5323ebb tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:26:27.769959 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-a3cf8e71-6b30-4c5b-a059-8d37b5323ebb tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:26:27.770379 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-a3cf8e71-6b30-4c5b-a059-8d37b5323ebb tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:26:27.770790 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-a3cf8e71-6b30-4c5b-a059-8d37b5323ebb tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:26:27.786531 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3cf8e71-6b30-4c5b-a059-8d37b5323ebb tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:27.786971 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3cf8e71-6b30-4c5b-a059-8d37b5323ebb tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:27.789058 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3cf8e71-6b30-4c5b-a059-8d37b5323ebb tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:27.789545 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3cf8e71-6b30-4c5b-a059-8d37b5323ebb tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:27.825274 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-57e5e830-4203-45c1-990c-ca89345e1df1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-104441690", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:27.839666 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-a3cf8e71-6b30-4c5b-a059-8d37b5323ebb tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Getting quotas for project e693063176af4ae1ae0942ab1b10dc73. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:26:27.852871 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-a3cf8e71-6b30-4c5b-a059-8d37b5323ebb tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Getting quotas for user f844b69077cc4ec087269cbb3db2f99e and project e693063176af4ae1ae0942ab1b10dc73. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:26:27.885414 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a3cf8e71-6b30-4c5b-a059-8d37b5323ebb tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:26:27.892677 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a3cf8e71-6b30-4c5b-a059-8d37b5323ebb tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: 2ba0512b-a92a-404a-9bc1-ffc024d92740] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:26:27.918910 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-57e5e830-4203-45c1-990c-ca89345e1df1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] validate_networks() for None {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:26:27.981671 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a3cf8e71-6b30-4c5b-a059-8d37b5323ebb tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.035494 Jul 25 14:26:27.982569 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 184/367] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:26:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:26:27.999855 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-92069691-83ff-4e50-9947-57644ce18753 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-585934695"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:28.002885 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:28.002885 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:28.004183 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.aggregate [None req-92069691-83ff-4e50-9947-57644ce18753 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Generated uuid 3f51bccb-93fc-4692-af52-6b4f3fd8c031 for aggregate {{(pid=119304) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 14:26:28.040322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=8,nova_api:INSERT=10 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:28.064180 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-92069691-83ff-4e50-9947-57644ce18753 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.074049 Jul 25 14:26:28.072667 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 185/368] 10.222.0.88 () {60 vars in 1164 bytes} [Mon Jul 25 14:26:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:28.082338 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-75f87ebe-ee90-4d88-adaa-48cedad772cb tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:28.085922 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-75f87ebe-ee90-4d88-adaa-48cedad772cb tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 9b76704f-db05-4df8-832a-2f9d30409637] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:28.101242 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75f87ebe-ee90-4d88-adaa-48cedad772cb tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:28.103061 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75f87ebe-ee90-4d88-adaa-48cedad772cb tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:28.104978 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75f87ebe-ee90-4d88-adaa-48cedad772cb tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:28.106881 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75f87ebe-ee90-4d88-adaa-48cedad772cb tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:28.624017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-75f87ebe-ee90-4d88-adaa-48cedad772cb tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:28.642863 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-75f87ebe-ee90-4d88-adaa-48cedad772cb tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637" status: 200 len: 1320 microversion: 2.1 time: 0.571897 Jul 25 14:26:28.652958 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 186/369] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:28 2022] GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637 => generated 1320 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:28.673973 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-58091dda-775c-4701-8f0a-452ecdbe22b7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:28.675038 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-58091dda-775c-4701-8f0a-452ecdbe22b7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: 2ba0512b-a92a-404a-9bc1-ffc024d92740] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:28.761783 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-58091dda-775c-4701-8f0a-452ecdbe22b7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:28.770629 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-58091dda-775c-4701-8f0a-452ecdbe22b7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740" status: 200 len: 1214 microversion: 2.1 time: 0.112979 Jul 25 14:26:28.771965 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 187/370] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:28 2022] GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740 => generated 1214 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:28.789793 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b3dfc643-f8df-4931-8c81-16e507f6934c tempest-AggregatesAdminNegativeTestJSON-1433156439 tempest-AggregatesAdminNegativeTestJSON-1433156439-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:28.791016 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:28.791016 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:28.792176 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b3dfc643-f8df-4931-8c81-16e507f6934c tempest-AggregatesAdminNegativeTestJSON-1433156439 tempest-AggregatesAdminNegativeTestJSON-1433156439-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '01951376d7fd4d84a1b6fff78c7f5bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b2e3fdee054b1795deb765e23b3280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:28.794017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b3dfc643-f8df-4931-8c81-16e507f6934c tempest-AggregatesAdminNegativeTestJSON-1433156439 tempest-AggregatesAdminNegativeTestJSON-1433156439-project] Request method failure captured: Jul 25 14:26:28.794017 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Jul 25 14:26:28.794017 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:26:28.794017 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:26:28.794017 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:26:28.794017 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:26:28.794017 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:26:28.794017 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:26:28.794017 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:26:28.794017 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:28.794017 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfnaVij7CUadJ-LbEnNDdjLf89yFhW0YawEZXUY6izSnWZMm8Qt5xCOeAJj68875bkBQWGlWCN-eqpNz8T8FsyEOs2jPbLreE5_FCPqCGwZQvjweZ7IhjQ7r96K9UY4yG3840iPWZFDAboHo3DPFsAFA3lMPy57qeSr4gsNLdpW4Lg Jul 25 14:26:28.794017 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:26:28.794017 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:26:28.794017 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:26:28.794017 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:26:28.794017 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:26:28.794017 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:26:28.794017 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 23b2e3fdee054b1795deb765e23b3280 Jul 25 14:26:28.794017 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1433156439 Jul 25 14:26:28.794017 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:26:28.794017 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:26:28.795619 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/23b2e3fdee054b1795deb765e23b3280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/23b2e3fdee054b1795deb765e23b3280"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_23b2e3fdee054b1795deb765e23b3280", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/23b2e3fdee054b1795deb765e23b3280"}]}] Jul 25 14:26:28.795619 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1433156439 Jul 25 14:26:28.795619 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 23b2e3fdee054b1795deb765e23b3280 Jul 25 14:26:28.795619 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1433156439 Jul 25 14:26:28.795619 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-AggregatesAdminNegativeTestJSON-1433156439-project Jul 25 14:26:28.795619 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:26:28.795619 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:26:28.795619 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 01951376d7fd4d84a1b6fff78c7f5bae Jul 25 14:26:28.795619 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1433156439-project Jul 25 14:26:28.795619 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:26:28.795619 n-d-846435-14 devstack@n-api.service[119304]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 25 14:26:28.795619 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '15'} Jul 25 14:26:28.796453 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:28.796453 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:28.796453 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:28.796453 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:28.796453 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:28.796453 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:28.796453 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:28.796453 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:28.796453 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jul 25 14:26:28.796453 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jul 25 14:26:28.796453 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 14:26:28.796453 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 14:26:28.796453 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 14:26:28.796453 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 14:26:28.796453 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:26:28.796453 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:26:28.796453 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:26:28.796453 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:26:28.796453 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 14:26:28.797540 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 14:26:28.797540 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 14:26:28.797540 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 14:26:28.797540 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 14:26:28.797540 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 14:26:28.797540 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 25 14:26:28.797540 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:28.797540 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:28.797540 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:28.797540 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:28.797540 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:28.797540 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:28.797540 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 14:26:28.797540 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 14:26:28.797540 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 25 14:26:28.797540 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:28.799430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b3dfc643-f8df-4931-8c81-16e507f6934c tempest-AggregatesAdminNegativeTestJSON-1433156439 tempest-AggregatesAdminNegativeTestJSON-1433156439-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:28.800580 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b3dfc643-f8df-4931-8c81-16e507f6934c tempest-AggregatesAdminNegativeTestJSON-1433156439 tempest-AggregatesAdminNegativeTestJSON-1433156439-project] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.015125 Jul 25 14:26:28.804821 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 188/371] 10.222.0.88 () {58 vars in 1155 bytes} [Mon Jul 25 14:26:28 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:26:28.812269 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3949fb09-ddd3-4ee2-8f63-6249cf691e8e tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:28.853654 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3949fb09-ddd3-4ee2-8f63-6249cf691e8e tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.046668 Jul 25 14:26:28.854229 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 189/372] 10.222.0.88 () {58 vars in 1155 bytes} [Mon Jul 25 14:26:28 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 14:26:28.863579 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1e49b8eb-25bb-40a2-be63-93a8f53dd09c tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:28.864368 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:28.864368 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:28.876355 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-1e49b8eb-25bb-40a2-be63-93a8f53dd09c tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 25 14:26:28.878634 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1e49b8eb-25bb-40a2-be63-93a8f53dd09c tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Request method failure captured: Jul 25 14:26:28.878634 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 25 14:26:28.878634 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:26:28.878634 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:26:28.878634 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:26:28.878634 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:26:28.878634 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:26:28.878634 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:26:28.878634 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:26:28.878634 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:28.878634 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfrk8sVGXsDqmhpZWz7J0Bm3w7SJo2Zip8QxPneTId9qHuMkiM-5Q6QrnVOzmA8IlDYzwlgpnxzqv89mPFD81OF3fP4oMPBg2T7fknckotFmas4lLxiFkI8qKcC9FQPMFhV9kCKf0OTrjPUoufcyO4jX3a-T0NwKnKsdyq_aYYEKbs Jul 25 14:26:28.878634 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:26:28.878634 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:26:28.878634 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:26:28.878634 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:26:28.878634 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:26:28.878634 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:26:28.878634 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 210769c76f534885b40be67c84b4da2c Jul 25 14:26:28.878634 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-758784592 Jul 25 14:26:28.878634 n-d-846435-14 devstack@n-api.service[119304]: X-Role: admin,reader,member Jul 25 14:26:28.878634 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: admin,reader,member Jul 25 14:26:28.880232 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/210769c76f534885b40be67c84b4da2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/210769c76f534885b40be67c84b4da2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_210769c76f534885b40be67c84b4da2c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/210769c76f534885b40be67c84b4da2c"}]}] Jul 25 14:26:28.880232 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-758784592 Jul 25 14:26:28.880232 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 210769c76f534885b40be67c84b4da2c Jul 25 14:26:28.880232 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-758784592 Jul 25 14:26:28.880232 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin Jul 25 14:26:28.880232 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:26:28.880232 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:26:28.880232 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 437bdf0ef30d4aeb965581dae9c76a48 Jul 25 14:26:28.880232 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin Jul 25 14:26:28.880232 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:26:28.880232 n-d-846435-14 devstack@n-api.service[119304]: exception: Aggregate -1 could not be found. Jul 25 14:26:28.880232 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '-1'} Jul 25 14:26:28.880957 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:28.880957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:28.880957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 25 14:26:28.880957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 25 14:26:28.880957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 14:26:28.880957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 14:26:28.880957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:26:28.880957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:26:28.880957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:26:28.880957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:26:28.880957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 14:26:28.880957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 14:26:28.880957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 25 14:26:28.880957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 25 14:26:28.880957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:26:28.880957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:26:28.880957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 25 14:26:28.880957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 25 14:26:28.880957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 14:26:28.882039 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 14:26:28.882039 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 25 14:26:28.882039 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 25 14:26:28.882039 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 25 14:26:28.882039 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:28.882039 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:28.882039 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:28.882039 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:28.882039 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:28.882039 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:28.882039 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:28.882039 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:28.882039 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:28.882039 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:28.882039 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 25 14:26:28.882039 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:26:28.882039 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 25 14:26:28.882039 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:28.882039 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:28.882039 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:28.882039 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:28.883849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:28.883849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:28.883849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:26:28.883849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:26:28.883849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 25 14:26:28.883849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:28.884270 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-57e5e830-4203-45c1-990c-ca89345e1df1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:26:28.884270 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-57e5e830-4203-45c1-990c-ca89345e1df1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:26:28.884270 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-57e5e830-4203-45c1-990c-ca89345e1df1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:26:28.884270 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-57e5e830-4203-45c1-990c-ca89345e1df1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:26:28.884270 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-57e5e830-4203-45c1-990c-ca89345e1df1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:26:28.886103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1e49b8eb-25bb-40a2-be63-93a8f53dd09c tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:28.887830 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1e49b8eb-25bb-40a2-be63-93a8f53dd09c tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.028292 Jul 25 14:26:28.893341 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 190/373] 10.222.0.88 () {58 vars in 1155 bytes} [Mon Jul 25 14:26:28 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:26:28.898972 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a52661d3-6509-4a35-9694-85cb15c568d6 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1512939586"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:28.902288 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:28.902288 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:28.903494 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.aggregate [None req-a52661d3-6509-4a35-9694-85cb15c568d6 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Generated uuid 3f41d411-30db-473a-89bd-ed390a7f3054 for aggregate {{(pid=119304) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 14:26:28.908274 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57e5e830-4203-45c1-990c-ca89345e1df1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:28.910403 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57e5e830-4203-45c1-990c-ca89345e1df1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:28.913789 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57e5e830-4203-45c1-990c-ca89345e1df1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:28.915012 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57e5e830-4203-45c1-990c-ca89345e1df1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:28.939925 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a52661d3-6509-4a35-9694-85cb15c568d6 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.042151 Jul 25 14:26:28.944527 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=26 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:28.948214 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 191/374] 10.222.0.88 () {60 vars in 1164 bytes} [Mon Jul 25 14:26:28 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:28.957206 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-33e427dd-bbf7-4d00-8c5d-727cedf26f4d tempest-AggregatesAdminNegativeTestJSON-1433156439 tempest-AggregatesAdminNegativeTestJSON-1433156439-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:28.958053 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:28.958053 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:28.959036 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-33e427dd-bbf7-4d00-8c5d-727cedf26f4d tempest-AggregatesAdminNegativeTestJSON-1433156439 tempest-AggregatesAdminNegativeTestJSON-1433156439-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '01951376d7fd4d84a1b6fff78c7f5bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b2e3fdee054b1795deb765e23b3280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:28.961004 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-57e5e830-4203-45c1-990c-ca89345e1df1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Getting quotas for project 887aa20d1838484eb895896f8f76ce41. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:26:28.961200 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-33e427dd-bbf7-4d00-8c5d-727cedf26f4d tempest-AggregatesAdminNegativeTestJSON-1433156439 tempest-AggregatesAdminNegativeTestJSON-1433156439-project] Request method failure captured: Jul 25 14:26:28.961200 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Jul 25 14:26:28.961200 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:26:28.961200 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:26:28.961200 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:26:28.961200 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:26:28.961200 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:26:28.961200 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:26:28.961200 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:26:28.961200 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:28.961200 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfnaVij7CUadJ-LbEnNDdjLf89yFhW0YawEZXUY6izSnWZMm8Qt5xCOeAJj68875bkBQWGlWCN-eqpNz8T8FsyEOs2jPbLreE5_FCPqCGwZQvjweZ7IhjQ7r96K9UY4yG3840iPWZFDAboHo3DPFsAFA3lMPy57qeSr4gsNLdpW4Lg Jul 25 14:26:28.961200 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:26:28.961200 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:26:28.961200 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:26:28.961200 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:26:28.961200 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:26:28.961200 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:26:28.961200 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 23b2e3fdee054b1795deb765e23b3280 Jul 25 14:26:28.961200 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1433156439 Jul 25 14:26:28.961200 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:26:28.961200 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:26:28.962607 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/23b2e3fdee054b1795deb765e23b3280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/23b2e3fdee054b1795deb765e23b3280"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_23b2e3fdee054b1795deb765e23b3280", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/23b2e3fdee054b1795deb765e23b3280"}]}] Jul 25 14:26:28.962607 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1433156439 Jul 25 14:26:28.962607 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 23b2e3fdee054b1795deb765e23b3280 Jul 25 14:26:28.962607 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1433156439 Jul 25 14:26:28.962607 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-AggregatesAdminNegativeTestJSON-1433156439-project Jul 25 14:26:28.962607 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:26:28.962607 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:26:28.962607 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 01951376d7fd4d84a1b6fff78c7f5bae Jul 25 14:26:28.962607 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1433156439-project Jul 25 14:26:28.962607 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:26:28.962607 n-d-846435-14 devstack@n-api.service[119304]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 25 14:26:28.962607 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '16'} Jul 25 14:26:28.963434 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:28.963434 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:28.963434 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:28.963434 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:28.963434 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:28.963434 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:28.963434 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:28.963434 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:28.963434 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jul 25 14:26:28.963434 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jul 25 14:26:28.963434 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 14:26:28.963434 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 14:26:28.963434 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 14:26:28.963434 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 14:26:28.963434 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:26:28.963434 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:26:28.963434 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:26:28.963434 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:26:28.963434 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 14:26:28.964807 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 14:26:28.964807 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 14:26:28.964807 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 14:26:28.964807 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 14:26:28.964807 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 14:26:28.964807 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 25 14:26:28.964807 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:28.964807 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:28.964807 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:28.964807 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:28.964807 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:28.964807 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:28.964807 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 14:26:28.964807 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 14:26:28.964807 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 25 14:26:28.964807 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:28.964807 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-33e427dd-bbf7-4d00-8c5d-727cedf26f4d tempest-AggregatesAdminNegativeTestJSON-1433156439 tempest-AggregatesAdminNegativeTestJSON-1433156439-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:28.965917 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-33e427dd-bbf7-4d00-8c5d-727cedf26f4d tempest-AggregatesAdminNegativeTestJSON-1433156439 tempest-AggregatesAdminNegativeTestJSON-1433156439-project] 10.222.0.88 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.013454 Jul 25 14:26:28.966506 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 192/375] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jul 25 14:26:28 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:26:28.972980 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-57e5e830-4203-45c1-990c-ca89345e1df1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Getting quotas for user 00aea97fb95c44cfa5dce25e9a06cd37 and project 887aa20d1838484eb895896f8f76ce41. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:26:28.974442 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-52a544a5-ab03-496d-b216-d1d459779474 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:28.976301 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:28.976301 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:28.996512 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-57e5e830-4203-45c1-990c-ca89345e1df1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:26:29.005451 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-57e5e830-4203-45c1-990c-ca89345e1df1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:26:29.025817 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-52a544a5-ab03-496d-b216-d1d459779474 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.057714 Jul 25 14:26:29.027296 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 193/376] 10.222.0.88 () {58 vars in 1155 bytes} [Mon Jul 25 14:26:28 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 14:26:29.038243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4f0197c4-7834-4d60-866c-41833af35d8e tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:29.039377 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:29.039377 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:29.060966 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-4f0197c4-7834-4d60-866c-41833af35d8e tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 25 14:26:29.062869 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4f0197c4-7834-4d60-866c-41833af35d8e tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Request method failure captured: Jul 25 14:26:29.062869 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 25 14:26:29.062869 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:26:29.062869 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:26:29.062869 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:26:29.062869 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:26:29.062869 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:26:29.062869 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:26:29.062869 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:26:29.062869 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:29.062869 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfrk8sVGXsDqmhpZWz7J0Bm3w7SJo2Zip8QxPneTId9qHuMkiM-5Q6QrnVOzmA8IlDYzwlgpnxzqv89mPFD81OF3fP4oMPBg2T7fknckotFmas4lLxiFkI8qKcC9FQPMFhV9kCKf0OTrjPUoufcyO4jX3a-T0NwKnKsdyq_aYYEKbs Jul 25 14:26:29.062869 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:26:29.062869 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:26:29.062869 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:26:29.062869 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:26:29.062869 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:26:29.062869 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:26:29.062869 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 210769c76f534885b40be67c84b4da2c Jul 25 14:26:29.062869 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-758784592 Jul 25 14:26:29.062869 n-d-846435-14 devstack@n-api.service[119304]: X-Role: admin,reader,member Jul 25 14:26:29.062869 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: admin,reader,member Jul 25 14:26:29.064593 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/210769c76f534885b40be67c84b4da2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/210769c76f534885b40be67c84b4da2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_210769c76f534885b40be67c84b4da2c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/210769c76f534885b40be67c84b4da2c"}]}] Jul 25 14:26:29.064593 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-758784592 Jul 25 14:26:29.064593 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 210769c76f534885b40be67c84b4da2c Jul 25 14:26:29.064593 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-758784592 Jul 25 14:26:29.064593 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin Jul 25 14:26:29.064593 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:26:29.064593 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:26:29.064593 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 437bdf0ef30d4aeb965581dae9c76a48 Jul 25 14:26:29.064593 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin Jul 25 14:26:29.064593 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:26:29.064593 n-d-846435-14 devstack@n-api.service[119304]: exception: Aggregate -1 could not be found. Jul 25 14:26:29.064593 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '-1'} Jul 25 14:26:29.065348 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:29.065348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:29.065348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 25 14:26:29.065348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 25 14:26:29.065348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 25 14:26:29.065348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 25 14:26:29.065348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:26:29.065348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:26:29.065348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 25 14:26:29.065348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 25 14:26:29.065348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 14:26:29.065348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 14:26:29.065348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 25 14:26:29.065348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 25 14:26:29.065348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 25 14:26:29.065348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:29.065348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:29.065348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:29.065348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:29.065348 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:29.067558 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:29.067558 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:29.067558 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:29.067558 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:29.067558 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:29.067558 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 25 14:26:29.067558 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:26:29.067558 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 25 14:26:29.067558 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:29.067558 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:29.067558 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:29.067558 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:29.067558 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:29.067558 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:29.067558 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:26:29.067558 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:26:29.067558 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 25 14:26:29.067558 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:29.073072 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4f0197c4-7834-4d60-866c-41833af35d8e tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:29.074947 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4f0197c4-7834-4d60-866c-41833af35d8e tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] 10.222.0.88 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.042627 Jul 25 14:26:29.079035 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 194/377] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jul 25 14:26:29 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:26:29.088854 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-092362dc-11ab-4f54-8f06-8c1f4c3bccf5 tempest-AggregatesAdminNegativeTestJSON-1433156439 tempest-AggregatesAdminNegativeTestJSON-1433156439-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:29.103388 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-57e5e830-4203-45c1-990c-ca89345e1df1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.941331 Jul 25 14:26:29.105988 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 184/378] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:26:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:26:29.107067 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:29.107067 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:29.108226 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-092362dc-11ab-4f54-8f06-8c1f4c3bccf5 tempest-AggregatesAdminNegativeTestJSON-1433156439 tempest-AggregatesAdminNegativeTestJSON-1433156439-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '01951376d7fd4d84a1b6fff78c7f5bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b2e3fdee054b1795deb765e23b3280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:29.116541 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f3a3f27e-5168-4692-8894-082826755b30 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:29.121100 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f3a3f27e-5168-4692-8894-082826755b30 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:29.122346 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-092362dc-11ab-4f54-8f06-8c1f4c3bccf5 tempest-AggregatesAdminNegativeTestJSON-1433156439 tempest-AggregatesAdminNegativeTestJSON-1433156439-project] Request method failure captured: Jul 25 14:26:29.122346 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jul 25 14:26:29.122346 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:26:29.122346 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:26:29.122346 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:26:29.122346 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:26:29.122346 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:26:29.122346 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:26:29.122346 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:26:29.122346 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:29.122346 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfnaVij7CUadJ-LbEnNDdjLf89yFhW0YawEZXUY6izSnWZMm8Qt5xCOeAJj68875bkBQWGlWCN-eqpNz8T8FsyEOs2jPbLreE5_FCPqCGwZQvjweZ7IhjQ7r96K9UY4yG3840iPWZFDAboHo3DPFsAFA3lMPy57qeSr4gsNLdpW4Lg Jul 25 14:26:29.122346 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:26:29.122346 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:26:29.122346 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:26:29.122346 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:26:29.122346 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:26:29.122346 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:26:29.122346 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 23b2e3fdee054b1795deb765e23b3280 Jul 25 14:26:29.122346 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1433156439 Jul 25 14:26:29.122346 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:26:29.122346 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:26:29.123551 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/23b2e3fdee054b1795deb765e23b3280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/23b2e3fdee054b1795deb765e23b3280"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_23b2e3fdee054b1795deb765e23b3280", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/23b2e3fdee054b1795deb765e23b3280"}]}] Jul 25 14:26:29.123551 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1433156439 Jul 25 14:26:29.123551 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 23b2e3fdee054b1795deb765e23b3280 Jul 25 14:26:29.123551 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1433156439 Jul 25 14:26:29.123551 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-AggregatesAdminNegativeTestJSON-1433156439-project Jul 25 14:26:29.123551 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:26:29.123551 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:26:29.123551 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 01951376d7fd4d84a1b6fff78c7f5bae Jul 25 14:26:29.123551 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1433156439-project Jul 25 14:26:29.123551 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:26:29.123551 n-d-846435-14 devstack@n-api.service[119304]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 25 14:26:29.123551 n-d-846435-14 devstack@n-api.service[119304]: action_args: {} Jul 25 14:26:29.124236 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:29.124236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:29.124236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:29.124236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:29.124236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:29.124236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:29.124236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:29.124236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:29.124236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jul 25 14:26:29.124236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jul 25 14:26:29.124236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 14:26:29.124236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 14:26:29.124236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 14:26:29.124236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 14:26:29.124236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:26:29.124236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:26:29.124236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:26:29.124236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:26:29.124236 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 14:26:29.125600 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 14:26:29.125600 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 14:26:29.125600 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 14:26:29.125600 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 14:26:29.125600 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 14:26:29.125600 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 25 14:26:29.125600 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:29.125600 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:29.125600 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:29.125600 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:29.125600 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:29.125600 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:29.125600 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 14:26:29.125600 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 14:26:29.125600 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 25 14:26:29.125600 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:29.125600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-092362dc-11ab-4f54-8f06-8c1f4c3bccf5 tempest-AggregatesAdminNegativeTestJSON-1433156439 tempest-AggregatesAdminNegativeTestJSON-1433156439-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:29.126498 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-092362dc-11ab-4f54-8f06-8c1f4c3bccf5 tempest-AggregatesAdminNegativeTestJSON-1433156439 tempest-AggregatesAdminNegativeTestJSON-1433156439-project] 10.222.0.88 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.038869 Jul 25 14:26:29.126498 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 195/379] 10.222.0.88 () {58 vars in 1143 bytes} [Mon Jul 25 14:26:29 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:26:29.137091 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1f2e175d-f08f-4e1b-b744-309d8f9608e0 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2101079141"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:29.145343 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:29.145343 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:29.156632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.aggregate [None req-1f2e175d-f08f-4e1b-b744-309d8f9608e0 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Generated uuid ca214c94-4e72-40c2-a42d-41e4aeff0878 for aggregate {{(pid=119304) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 14:26:29.228345 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1f2e175d-f08f-4e1b-b744-309d8f9608e0 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.095145 Jul 25 14:26:29.228874 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 196/380] 10.222.0.88 () {60 vars in 1164 bytes} [Mon Jul 25 14:26:29 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:29.241401 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c47f2e50-51e6-48bb-9f05-5fadf7215505 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-846435-14"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:29.245891 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:29.245891 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:29.271872 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c47f2e50-51e6-48bb-9f05-5fadf7215505 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:29.272346 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c47f2e50-51e6-48bb-9f05-5fadf7215505 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:29.478735 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f3a3f27e-5168-4692-8894-082826755b30 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:29.495781 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c47f2e50-51e6-48bb-9f05-5fadf7215505 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 244 microversion: 2.1 time: 0.258586 Jul 25 14:26:29.497356 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 197/381] 10.222.0.88 () {60 vars in 1194 bytes} [Mon Jul 25 14:26:29 2022] POST /compute/v2.1/os-aggregates/17/action => generated 244 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:29.498053 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f3a3f27e-5168-4692-8894-082826755b30 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1212 microversion: 2.1 time: 0.376395 Jul 25 14:26:29.508481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-07c8ee11-80e9-4145-a090-3e04e42aa813 tempest-AggregatesAdminNegativeTestJSON-1433156439 tempest-AggregatesAdminNegativeTestJSON-1433156439-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-846435-14"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:29.511662 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 185/382] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:29 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1212 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:29.514760 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:29.514760 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:29.516228 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-07c8ee11-80e9-4145-a090-3e04e42aa813 tempest-AggregatesAdminNegativeTestJSON-1433156439 tempest-AggregatesAdminNegativeTestJSON-1433156439-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '01951376d7fd4d84a1b6fff78c7f5bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b2e3fdee054b1795deb765e23b3280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:29.518281 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-07c8ee11-80e9-4145-a090-3e04e42aa813 tempest-AggregatesAdminNegativeTestJSON-1433156439 tempest-AggregatesAdminNegativeTestJSON-1433156439-project] Request method failure captured: Jul 25 14:26:29.518281 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Jul 25 14:26:29.518281 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:26:29.518281 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:26:29.518281 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:26:29.518281 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 43 Jul 25 14:26:29.518281 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:26:29.518281 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:26:29.518281 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:26:29.518281 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:29.518281 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfnaVij7CUadJ-LbEnNDdjLf89yFhW0YawEZXUY6izSnWZMm8Qt5xCOeAJj68875bkBQWGlWCN-eqpNz8T8FsyEOs2jPbLreE5_FCPqCGwZQvjweZ7IhjQ7r96K9UY4yG3840iPWZFDAboHo3DPFsAFA3lMPy57qeSr4gsNLdpW4Lg Jul 25 14:26:29.518281 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:26:29.518281 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:26:29.518281 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:26:29.518281 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:26:29.518281 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:26:29.518281 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:26:29.518281 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 23b2e3fdee054b1795deb765e23b3280 Jul 25 14:26:29.518281 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1433156439 Jul 25 14:26:29.518281 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:26:29.518281 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:26:29.519704 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/23b2e3fdee054b1795deb765e23b3280"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/23b2e3fdee054b1795deb765e23b3280"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_23b2e3fdee054b1795deb765e23b3280", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/23b2e3fdee054b1795deb765e23b3280"}]}] Jul 25 14:26:29.519704 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1433156439 Jul 25 14:26:29.519704 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 23b2e3fdee054b1795deb765e23b3280 Jul 25 14:26:29.519704 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1433156439 Jul 25 14:26:29.519704 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-AggregatesAdminNegativeTestJSON-1433156439-project Jul 25 14:26:29.519704 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:26:29.519704 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:26:29.519704 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 01951376d7fd4d84a1b6fff78c7f5bae Jul 25 14:26:29.519704 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1433156439-project Jul 25 14:26:29.519704 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:26:29.519704 n-d-846435-14 devstack@n-api.service[119304]: {"remove_host": {"host": "n-h1-846435-14"}} Jul 25 14:26:29.519704 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:26:29.519704 n-d-846435-14 devstack@n-api.service[119304]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 25 14:26:29.520601 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-846435-14'}}} Jul 25 14:26:29.520601 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:29.520601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:29.520601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:29.520601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:29.520601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:29.520601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:29.520601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:29.520601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:29.520601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:26:29.520601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:26:29.520601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jul 25 14:26:29.520601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jul 25 14:26:29.520601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 14:26:29.520601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 14:26:29.520601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 14:26:29.520601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 14:26:29.520601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:26:29.520601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:26:29.521828 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:26:29.521828 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:26:29.521828 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 14:26:29.521828 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 14:26:29.521828 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 14:26:29.521828 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 14:26:29.521828 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 14:26:29.521828 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 14:26:29.521828 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 25 14:26:29.521828 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:29.521828 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:29.521828 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:29.521828 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:29.521828 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:29.521828 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:29.521828 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 14:26:29.521828 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 14:26:29.521828 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 25 14:26:29.521828 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:29.524491 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-07c8ee11-80e9-4145-a090-3e04e42aa813 tempest-AggregatesAdminNegativeTestJSON-1433156439 tempest-AggregatesAdminNegativeTestJSON-1433156439-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:29.526050 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-07c8ee11-80e9-4145-a090-3e04e42aa813 tempest-AggregatesAdminNegativeTestJSON-1433156439 tempest-AggregatesAdminNegativeTestJSON-1433156439-project] 10.222.0.88 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.021331 Jul 25 14:26:29.530511 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 198/383] 10.222.0.88 () {60 vars in 1194 bytes} [Mon Jul 25 14:26:29 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:26:29.541029 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c03b8565-7791-4983-aad8-396f4d98f9a2 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-846435-14"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:29.545570 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:29.545570 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:29.562396 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c03b8565-7791-4983-aad8-396f4d98f9a2 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:29.563083 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c03b8565-7791-4983-aad8-396f4d98f9a2 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:29.675487 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d5cba6d8-fb68-4a51-b8d1-40aa967344e2 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:29.676296 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d5cba6d8-fb68-4a51-b8d1-40aa967344e2 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 9b76704f-db05-4df8-832a-2f9d30409637] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:29.687148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5cba6d8-fb68-4a51-b8d1-40aa967344e2 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:29.687586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5cba6d8-fb68-4a51-b8d1-40aa967344e2 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:29.695796 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5cba6d8-fb68-4a51-b8d1-40aa967344e2 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:29.698973 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5cba6d8-fb68-4a51-b8d1-40aa967344e2 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:29.824219 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c03b8565-7791-4983-aad8-396f4d98f9a2 tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.291646 Jul 25 14:26:29.826389 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 186/384] 10.222.0.88 () {60 vars in 1194 bytes} [Mon Jul 25 14:26:29 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:29.846648 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-37833893-ef77-47ab-a445-e5b683dff927 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:29.847331 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-37833893-ef77-47ab-a445-e5b683dff927 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: 2ba0512b-a92a-404a-9bc1-ffc024d92740] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:29.856869 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7,nova_api:DELETE=11,nova_api:UPDATE=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:29.881312 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37833893-ef77-47ab-a445-e5b683dff927 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:29.887052 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37833893-ef77-47ab-a445-e5b683dff927 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:29.888815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37833893-ef77-47ab-a445-e5b683dff927 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:29.889596 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37833893-ef77-47ab-a445-e5b683dff927 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:30.170021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d5cba6d8-fb68-4a51-b8d1-40aa967344e2 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:30.180196 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d5cba6d8-fb68-4a51-b8d1-40aa967344e2 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637" status: 200 len: 1320 microversion: 2.1 time: 0.510593 Jul 25 14:26:30.186945 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 199/385] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:29 2022] GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637 => generated 1320 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:26:30.196716 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-76993327-7dc9-4e96-a06d-15f97ba7012e tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:30.198925 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:30.198925 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:30.206045 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-37833893-ef77-47ab-a445-e5b683dff927 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:30.221341 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-37833893-ef77-47ab-a445-e5b683dff927 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740" status: 200 len: 1274 microversion: 2.1 time: 0.391981 Jul 25 14:26:30.236467 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 187/386] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:29 2022] GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740 => generated 1274 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:30.262568 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-76993327-7dc9-4e96-a06d-15f97ba7012e tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.074336 Jul 25 14:26:30.263644 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 200/387] 10.222.0.88 () {58 vars in 1155 bytes} [Mon Jul 25 14:26:30 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 14:26:30.276115 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8f933f7d-b6be-47a8-bbf0-3c1926b8656d tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-550743368"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:30.276761 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:30.276761 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:30.278319 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.aggregate [None req-8f933f7d-b6be-47a8-bbf0-3c1926b8656d tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Generated uuid 7206c3ea-eaa2-4e1e-a86b-00f34aabec1e for aggregate {{(pid=119303) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 14:26:30.318688 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8f933f7d-b6be-47a8-bbf0-3c1926b8656d tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.048894 Jul 25 14:26:30.319587 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 188/388] 10.222.0.88 () {60 vars in 1164 bytes} [Mon Jul 25 14:26:30 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:30.332393 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9fae7f20-63f3-4b5e-84b1-4eff48f7596a tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:30.335190 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:30.335190 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:30.362456 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9fae7f20-63f3-4b5e-84b1-4eff48f7596a tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:30.365373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9fae7f20-63f3-4b5e-84b1-4eff48f7596a tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:30.378696 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9fae7f20-63f3-4b5e-84b1-4eff48f7596a tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:30.379649 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9fae7f20-63f3-4b5e-84b1-4eff48f7596a tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:30.393800 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.compute.aggregates [None req-9fae7f20-63f3-4b5e-84b1-4eff48f7596a tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 25 14:26:30.397496 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-9fae7f20-63f3-4b5e-84b1-4eff48f7596a tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Jul 25 14:26:30.400964 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9fae7f20-63f3-4b5e-84b1-4eff48f7596a tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Request method failure captured: Jul 25 14:26:30.400964 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Jul 25 14:26:30.400964 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:26:30.400964 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:26:30.400964 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:26:30.400964 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 42 Jul 25 14:26:30.400964 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:26:30.400964 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:26:30.400964 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:26:30.400964 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:30.400964 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfrk8sVGXsDqmhpZWz7J0Bm3w7SJo2Zip8QxPneTId9qHuMkiM-5Q6QrnVOzmA8IlDYzwlgpnxzqv89mPFD81OF3fP4oMPBg2T7fknckotFmas4lLxiFkI8qKcC9FQPMFhV9kCKf0OTrjPUoufcyO4jX3a-T0NwKnKsdyq_aYYEKbs Jul 25 14:26:30.400964 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:26:30.400964 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:26:30.400964 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:26:30.400964 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:26:30.400964 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:26:30.400964 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:26:30.400964 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 210769c76f534885b40be67c84b4da2c Jul 25 14:26:30.400964 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-758784592 Jul 25 14:26:30.400964 n-d-846435-14 devstack@n-api.service[119304]: X-Role: admin,reader,member Jul 25 14:26:30.400964 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: admin,reader,member Jul 25 14:26:30.402238 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/210769c76f534885b40be67c84b4da2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/210769c76f534885b40be67c84b4da2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_210769c76f534885b40be67c84b4da2c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/210769c76f534885b40be67c84b4da2c"}]}] Jul 25 14:26:30.402238 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-758784592 Jul 25 14:26:30.402238 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 210769c76f534885b40be67c84b4da2c Jul 25 14:26:30.402238 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-758784592 Jul 25 14:26:30.402238 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin Jul 25 14:26:30.402238 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:26:30.402238 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:26:30.402238 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 437bdf0ef30d4aeb965581dae9c76a48 Jul 25 14:26:30.402238 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin Jul 25 14:26:30.402238 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:26:30.402238 n-d-846435-14 devstack@n-api.service[119304]: {"remove_host": {"host": "nonexist_host"}} Jul 25 14:26:30.402238 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:26:30.402238 n-d-846435-14 devstack@n-api.service[119304]: exception: Cannot remove host nonexist_host in aggregate 18 Jul 25 14:26:30.402958 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jul 25 14:26:30.402958 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:30.402958 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:30.402958 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 25 14:26:30.402958 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 25 14:26:30.402958 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:26:30.402958 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:26:30.402958 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 25 14:26:30.402958 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 25 14:26:30.402958 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 14:26:30.402958 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 14:26:30.402958 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 25 14:26:30.402958 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 25 14:26:30.402958 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jul 25 14:26:30.402958 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:30.402958 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:30.402958 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:30.402958 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:30.402958 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 25 14:26:30.402958 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 25 14:26:30.404475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 25 14:26:30.404475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 25 14:26:30.404475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 25 14:26:30.404475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:30.404475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:30.404475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:30.404475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:30.404475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jul 25 14:26:30.404475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jul 25 14:26:30.404475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 14:26:30.404475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 14:26:30.404475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:26:30.404475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:26:30.404475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:26:30.404475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:26:30.404475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 14:26:30.404475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 14:26:30.404475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jul 25 14:26:30.404475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jul 25 14:26:30.404475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 25 14:26:30.405544 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 25 14:26:30.405544 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 25 14:26:30.405544 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:30.405544 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:30.405544 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:30.405544 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:30.405544 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:30.405544 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:30.405544 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:30.405544 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:30.405544 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:30.405544 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:30.405544 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:26:30.405544 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:26:30.405544 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jul 25 14:26:30.405544 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 14:26:30.405544 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Jul 25 14:26:30.405544 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:30.405544 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:30.405544 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:30.405544 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:30.408965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:30.408965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:30.408965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:26:30.408965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:26:30.408965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Jul 25 14:26:30.408965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:30.412807 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9fae7f20-63f3-4b5e-84b1-4eff48f7596a tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:30.417131 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9fae7f20-63f3-4b5e-84b1-4eff48f7596a tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.089950 Jul 25 14:26:30.423023 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 201/389] 10.222.0.88 () {60 vars in 1194 bytes} [Mon Jul 25 14:26:30 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:26:30.433522 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a68e8d89-7cf6-419a-9c66-74e88b5f65fa tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:30.434900 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:30.434900 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:30.488461 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a68e8d89-7cf6-419a-9c66-74e88b5f65fa tempest-AggregatesAdminNegativeTestJSON-758784592 tempest-AggregatesAdminNegativeTestJSON-758784592-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.059886 Jul 25 14:26:30.489509 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 189/390] 10.222.0.88 () {58 vars in 1155 bytes} [Mon Jul 25 14:26:30 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 14:26:30.525992 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9a8a44b2-926f-4d3d-bc96-cdc33e9d305a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:30.527659 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9a8a44b2-926f-4d3d-bc96-cdc33e9d305a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:30.556543 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9a8a44b2-926f-4d3d-bc96-cdc33e9d305a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:30.558311 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9a8a44b2-926f-4d3d-bc96-cdc33e9d305a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:30.561631 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9a8a44b2-926f-4d3d-bc96-cdc33e9d305a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:30.562333 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9a8a44b2-926f-4d3d-bc96-cdc33e9d305a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:30.718250 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9a8a44b2-926f-4d3d-bc96-cdc33e9d305a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:30.735814 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9a8a44b2-926f-4d3d-bc96-cdc33e9d305a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1208 microversion: 2.1 time: 0.215885 Jul 25 14:26:30.740283 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 202/391] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:30 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1208 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:31.216494 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-53d94e29-0ae2-4ec5-aa2c-a55e5125201d tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:31.218762 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-53d94e29-0ae2-4ec5-aa2c-a55e5125201d tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 9b76704f-db05-4df8-832a-2f9d30409637] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:31.258076 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1d676e71-a981-4332-9d77-a7fb83aabc25 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:31.261328 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1d676e71-a981-4332-9d77-a7fb83aabc25 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: 2ba0512b-a92a-404a-9bc1-ffc024d92740] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:31.272454 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-53d94e29-0ae2-4ec5-aa2c-a55e5125201d tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:31.278259 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-53d94e29-0ae2-4ec5-aa2c-a55e5125201d tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:31.282527 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-53d94e29-0ae2-4ec5-aa2c-a55e5125201d tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:31.289838 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-53d94e29-0ae2-4ec5-aa2c-a55e5125201d tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:31.311035 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1d676e71-a981-4332-9d77-a7fb83aabc25 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:31.323890 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1d676e71-a981-4332-9d77-a7fb83aabc25 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:31.331844 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1d676e71-a981-4332-9d77-a7fb83aabc25 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:31.341618 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1d676e71-a981-4332-9d77-a7fb83aabc25 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:31.375346 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:32.323036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-53d94e29-0ae2-4ec5-aa2c-a55e5125201d tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:32.328810 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:32.335538 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-53d94e29-0ae2-4ec5-aa2c-a55e5125201d tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637" status: 200 len: 1320 microversion: 2.1 time: 1.131534 Jul 25 14:26:32.358569 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 190/392] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:31 2022] GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637 => generated 1320 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:32.368582 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-b899aa51-13d5-4b3d-8c34-2e20224a6cb0 req-a8768d59-ff52-4ac0-9003-1803157227f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b76704f-db05-4df8-832a-2f9d30409637", "tag": "0899a43b-d400-4d94-afe9-0a96d734b452"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:32.389648 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b899aa51-13d5-4b3d-8c34-2e20224a6cb0 req-a8768d59-ff52-4ac0-9003-1803157227f8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:32.390116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b899aa51-13d5-4b3d-8c34-2e20224a6cb0 req-a8768d59-ff52-4ac0-9003-1803157227f8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:32.413249 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-b899aa51-13d5-4b3d-8c34-2e20224a6cb0 req-a8768d59-ff52-4ac0-9003-1803157227f8 service nova] Creating event network-changed:0899a43b-d400-4d94-afe9-0a96d734b452 for instance 9b76704f-db05-4df8-832a-2f9d30409637 on n-h2-846435-14 Jul 25 14:26:32.419312 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-b899aa51-13d5-4b3d-8c34-2e20224a6cb0 req-a8768d59-ff52-4ac0-9003-1803157227f8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058804 Jul 25 14:26:32.421200 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 191/393] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:32.427107 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e653a5c3-9237-4946-904e-3b77a4ade1da tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:32.428366 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e653a5c3-9237-4946-904e-3b77a4ade1da tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:32.438248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e653a5c3-9237-4946-904e-3b77a4ade1da tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:32.439043 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e653a5c3-9237-4946-904e-3b77a4ade1da tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:32.440262 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e653a5c3-9237-4946-904e-3b77a4ade1da tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:32.441030 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e653a5c3-9237-4946-904e-3b77a4ade1da tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:32.499968 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1d676e71-a981-4332-9d77-a7fb83aabc25 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:32.509688 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1d676e71-a981-4332-9d77-a7fb83aabc25 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740" status: 200 len: 1314 microversion: 2.1 time: 1.268876 Jul 25 14:26:32.511218 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 203/394] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:31 2022] GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740 => generated 1314 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:32.677273 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e653a5c3-9237-4946-904e-3b77a4ade1da tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:32.689735 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e653a5c3-9237-4946-904e-3b77a4ade1da tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1270 microversion: 2.1 time: 0.267060 Jul 25 14:26:32.690343 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 192/395] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:32 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1270 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:33.366188 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1e689a5e-f685-499f-8c53-28c29aa8da26 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:33.366865 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1e689a5e-f685-499f-8c53-28c29aa8da26 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 9b76704f-db05-4df8-832a-2f9d30409637] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:33.375863 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e689a5e-f685-499f-8c53-28c29aa8da26 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:33.381944 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e689a5e-f685-499f-8c53-28c29aa8da26 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:33.383214 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e689a5e-f685-499f-8c53-28c29aa8da26 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:33.388103 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e689a5e-f685-499f-8c53-28c29aa8da26 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:33.729939 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e3045d1d-4001-49ac-91e1-b09d9cf40ba5 tempest-HypervisorAdminV253TestBase-2045631672 tempest-HypervisorAdminV253TestBase-2045631672-project-admin] Calling method '.version_select at 0x7f4687dbee50>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:33.733207 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:33.733207 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:33.735523 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3045d1d-4001-49ac-91e1-b09d9cf40ba5 tempest-HypervisorAdminV253TestBase-2045631672 tempest-HypervisorAdminV253TestBase-2045631672-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:33.737262 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3045d1d-4001-49ac-91e1-b09d9cf40ba5 tempest-HypervisorAdminV253TestBase-2045631672 tempest-HypervisorAdminV253TestBase-2045631672-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:33.756893 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3045d1d-4001-49ac-91e1-b09d9cf40ba5 tempest-HypervisorAdminV253TestBase-2045631672 tempest-HypervisorAdminV253TestBase-2045631672-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:33.758423 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3045d1d-4001-49ac-91e1-b09d9cf40ba5 tempest-HypervisorAdminV253TestBase-2045631672 tempest-HypervisorAdminV253TestBase-2045631672-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:33.799524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3045d1d-4001-49ac-91e1-b09d9cf40ba5 tempest-HypervisorAdminV253TestBase-2045631672 tempest-HypervisorAdminV253TestBase-2045631672-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:33.800247 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3045d1d-4001-49ac-91e1-b09d9cf40ba5 tempest-HypervisorAdminV253TestBase-2045631672 tempest-HypervisorAdminV253TestBase-2045631672-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:33.814898 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3045d1d-4001-49ac-91e1-b09d9cf40ba5 tempest-HypervisorAdminV253TestBase-2045631672 tempest-HypervisorAdminV253TestBase-2045631672-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:33.815664 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3045d1d-4001-49ac-91e1-b09d9cf40ba5 tempest-HypervisorAdminV253TestBase-2045631672 tempest-HypervisorAdminV253TestBase-2045631672-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:33.862299 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3045d1d-4001-49ac-91e1-b09d9cf40ba5 tempest-HypervisorAdminV253TestBase-2045631672 tempest-HypervisorAdminV253TestBase-2045631672-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:33.862758 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3045d1d-4001-49ac-91e1-b09d9cf40ba5 tempest-HypervisorAdminV253TestBase-2045631672 tempest-HypervisorAdminV253TestBase-2045631672-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:33.871021 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e3045d1d-4001-49ac-91e1-b09d9cf40ba5 tempest-HypervisorAdminV253TestBase-2045631672 tempest-HypervisorAdminV253TestBase-2045631672-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2077 microversion: 2.53 time: 0.730628 Jul 25 14:26:33.872330 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 204/396] 10.222.0.88 () {60 vars in 1243 bytes} [Mon Jul 25 14:26:33 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2077 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:26:33.878607 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2e042071-50c0-47c5-8724-da0f1809e408 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:33.879452 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2e042071-50c0-47c5-8724-da0f1809e408 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: 2ba0512b-a92a-404a-9bc1-ffc024d92740] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:33.893253 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2e042071-50c0-47c5-8724-da0f1809e408 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:33.894699 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2e042071-50c0-47c5-8724-da0f1809e408 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:33.895962 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2e042071-50c0-47c5-8724-da0f1809e408 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:33.896830 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2e042071-50c0-47c5-8724-da0f1809e408 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:34.355172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1e689a5e-f685-499f-8c53-28c29aa8da26 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:34.368628 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1e689a5e-f685-499f-8c53-28c29aa8da26 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637" status: 200 len: 1320 microversion: 2.1 time: 1.006887 Jul 25 14:26:34.371937 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 193/397] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:33 2022] GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637 => generated 1320 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:26:34.385662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-286cbf65-7b59-41e3-a217-c28cf1d788e1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:34.387562 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-286cbf65-7b59-41e3-a217-c28cf1d788e1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:34.399373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2e042071-50c0-47c5-8724-da0f1809e408 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:34.415074 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2e042071-50c0-47c5-8724-da0f1809e408 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740" status: 200 len: 1314 microversion: 2.1 time: 0.536007 Jul 25 14:26:34.436002 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 205/398] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:33 2022] GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740 => generated 1314 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:34.436002 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9f7a0e9e-e857-4974-a024-f2bab8dd5421 tempest-HypervisorAdminV253TestBase-2045631672 tempest-HypervisorAdminV253TestBase-2045631672-project-admin] Calling method '.version_select at 0x7f4687ff5280>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:34.436294 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-286cbf65-7b59-41e3-a217-c28cf1d788e1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:34.436294 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-286cbf65-7b59-41e3-a217-c28cf1d788e1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:34.436294 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-286cbf65-7b59-41e3-a217-c28cf1d788e1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:34.436294 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-286cbf65-7b59-41e3-a217-c28cf1d788e1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:34.444051 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:34.444051 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:34.452850 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f7a0e9e-e857-4974-a024-f2bab8dd5421 tempest-HypervisorAdminV253TestBase-2045631672 tempest-HypervisorAdminV253TestBase-2045631672-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:34.453418 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f7a0e9e-e857-4974-a024-f2bab8dd5421 tempest-HypervisorAdminV253TestBase-2045631672 tempest-HypervisorAdminV253TestBase-2045631672-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:34.489446 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f7a0e9e-e857-4974-a024-f2bab8dd5421 tempest-HypervisorAdminV253TestBase-2045631672 tempest-HypervisorAdminV253TestBase-2045631672-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:34.489446 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f7a0e9e-e857-4974-a024-f2bab8dd5421 tempest-HypervisorAdminV253TestBase-2045631672 tempest-HypervisorAdminV253TestBase-2045631672-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:34.533345 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f7a0e9e-e857-4974-a024-f2bab8dd5421 tempest-HypervisorAdminV253TestBase-2045631672 tempest-HypervisorAdminV253TestBase-2045631672-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:34.533924 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f7a0e9e-e857-4974-a024-f2bab8dd5421 tempest-HypervisorAdminV253TestBase-2045631672 tempest-HypervisorAdminV253TestBase-2045631672-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:34.546914 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f7a0e9e-e857-4974-a024-f2bab8dd5421 tempest-HypervisorAdminV253TestBase-2045631672 tempest-HypervisorAdminV253TestBase-2045631672-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:34.547730 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f7a0e9e-e857-4974-a024-f2bab8dd5421 tempest-HypervisorAdminV253TestBase-2045631672 tempest-HypervisorAdminV253TestBase-2045631672-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:34.587351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f7a0e9e-e857-4974-a024-f2bab8dd5421 tempest-HypervisorAdminV253TestBase-2045631672 tempest-HypervisorAdminV253TestBase-2045631672-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:34.588305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f7a0e9e-e857-4974-a024-f2bab8dd5421 tempest-HypervisorAdminV253TestBase-2045631672 tempest-HypervisorAdminV253TestBase-2045631672-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:34.595598 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9f7a0e9e-e857-4974-a024-f2bab8dd5421 tempest-HypervisorAdminV253TestBase-2045631672 tempest-HypervisorAdminV253TestBase-2045631672-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 767 microversion: 2.53 time: 0.168802 Jul 25 14:26:34.597607 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 206/399] 10.222.0.88 () {60 vars in 1222 bytes} [Mon Jul 25 14:26:34 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 767 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:26:34.604170 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-c1747d82-fa2e-4514-9076-4dfcc81ba7f4 req-8c503049-f6d0-484f-b80a-98ac42cd9cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ba0512b-a92a-404a-9bc1-ffc024d92740", "tag": "b5d4e3ed-ac59-4af0-ae86-32099aa20f97"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:34.614518 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c1747d82-fa2e-4514-9076-4dfcc81ba7f4 req-8c503049-f6d0-484f-b80a-98ac42cd9cb7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:34.615090 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c1747d82-fa2e-4514-9076-4dfcc81ba7f4 req-8c503049-f6d0-484f-b80a-98ac42cd9cb7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:34.627948 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-c1747d82-fa2e-4514-9076-4dfcc81ba7f4 req-8c503049-f6d0-484f-b80a-98ac42cd9cb7 service nova] Creating event network-changed:b5d4e3ed-ac59-4af0-ae86-32099aa20f97 for instance 2ba0512b-a92a-404a-9bc1-ffc024d92740 on n-h1-846435-14 Jul 25 14:26:34.635145 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-c1747d82-fa2e-4514-9076-4dfcc81ba7f4 req-8c503049-f6d0-484f-b80a-98ac42cd9cb7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035620 Jul 25 14:26:34.636177 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 207/400] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:34.639814 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-286cbf65-7b59-41e3-a217-c28cf1d788e1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:34.642656 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3d7f7008-4566-4155-a3e6-23518498bb55 tempest-HypervisorAdminV253TestBase-2045631672 tempest-HypervisorAdminV253TestBase-2045631672-project-admin] Calling method '.version_select at 0x7f4687f8e310>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:34.647300 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:34.647300 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:34.650631 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3d7f7008-4566-4155-a3e6-23518498bb55 tempest-HypervisorAdminV253TestBase-2045631672 tempest-HypervisorAdminV253TestBase-2045631672-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:34.651365 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3d7f7008-4566-4155-a3e6-23518498bb55 tempest-HypervisorAdminV253TestBase-2045631672 tempest-HypervisorAdminV253TestBase-2045631672-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:34.652256 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-286cbf65-7b59-41e3-a217-c28cf1d788e1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1270 microversion: 2.1 time: 0.277859 Jul 25 14:26:34.653677 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 194/401] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:34 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1270 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:34.672773 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3d7f7008-4566-4155-a3e6-23518498bb55 tempest-HypervisorAdminV253TestBase-2045631672 tempest-HypervisorAdminV253TestBase-2045631672-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:34.673216 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3d7f7008-4566-4155-a3e6-23518498bb55 tempest-HypervisorAdminV253TestBase-2045631672 tempest-HypervisorAdminV253TestBase-2045631672-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:34.695582 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3d7f7008-4566-4155-a3e6-23518498bb55 tempest-HypervisorAdminV253TestBase-2045631672 tempest-HypervisorAdminV253TestBase-2045631672-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/84c82453-037d-4941-bd55-b5b1d5f4cfcb" status: 200 len: 794 microversion: 2.53 time: 0.055865 Jul 25 14:26:34.699184 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 208/402] 10.222.0.88 () {60 vars in 1298 bytes} [Mon Jul 25 14:26:34 2022] GET /compute/v2.1/os-hypervisors/84c82453-037d-4941-bd55-b5b1d5f4cfcb => generated 794 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:26:35.391334 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3b77d5e8-15fb-4883-b780-ec9d0cb61d90 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:35.391944 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3b77d5e8-15fb-4883-b780-ec9d0cb61d90 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 9b76704f-db05-4df8-832a-2f9d30409637] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:35.401520 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b77d5e8-15fb-4883-b780-ec9d0cb61d90 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:35.401965 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b77d5e8-15fb-4883-b780-ec9d0cb61d90 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:35.406347 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b77d5e8-15fb-4883-b780-ec9d0cb61d90 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:35.408705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b77d5e8-15fb-4883-b780-ec9d0cb61d90 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:35.450829 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-23d3fd25-2154-4d61-8714-66836ddd9c90 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:35.451629 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-23d3fd25-2154-4d61-8714-66836ddd9c90 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: 2ba0512b-a92a-404a-9bc1-ffc024d92740] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:35.464252 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23d3fd25-2154-4d61-8714-66836ddd9c90 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:35.464893 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23d3fd25-2154-4d61-8714-66836ddd9c90 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:35.465830 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23d3fd25-2154-4d61-8714-66836ddd9c90 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:35.474171 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23d3fd25-2154-4d61-8714-66836ddd9c90 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:35.883552 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-23d3fd25-2154-4d61-8714-66836ddd9c90 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:35.895941 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-23d3fd25-2154-4d61-8714-66836ddd9c90 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740" status: 200 len: 1314 microversion: 2.1 time: 0.448085 Jul 25 14:26:35.896571 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 209/403] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:35 2022] GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740 => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:26:35.929076 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-69e850e1-fa9f-4892-b38b-9d53fb225905 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:35.932470 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-69e850e1-fa9f-4892-b38b-9d53fb225905 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:35.950693 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69e850e1-fa9f-4892-b38b-9d53fb225905 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:35.951415 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69e850e1-fa9f-4892-b38b-9d53fb225905 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:35.953495 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69e850e1-fa9f-4892-b38b-9d53fb225905 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:35.954140 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69e850e1-fa9f-4892-b38b-9d53fb225905 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:36.031991 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3b77d5e8-15fb-4883-b780-ec9d0cb61d90 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:36.042629 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3b77d5e8-15fb-4883-b780-ec9d0cb61d90 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637" status: 200 len: 1320 microversion: 2.1 time: 0.654646 Jul 25 14:26:36.044157 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 195/404] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:35 2022] GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637 => generated 1320 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:36.516038 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-69e850e1-fa9f-4892-b38b-9d53fb225905 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:36.528398 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-69e850e1-fa9f-4892-b38b-9d53fb225905 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1312 microversion: 2.1 time: 0.626217 Jul 25 14:26:36.530524 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 210/405] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:35 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1312 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:36.917974 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-28508885-b0c6-4379-8933-7bef95e8aa56 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:36.919456 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-28508885-b0c6-4379-8933-7bef95e8aa56 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: 2ba0512b-a92a-404a-9bc1-ffc024d92740] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:36.937379 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28508885-b0c6-4379-8933-7bef95e8aa56 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:36.938265 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28508885-b0c6-4379-8933-7bef95e8aa56 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:36.939313 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28508885-b0c6-4379-8933-7bef95e8aa56 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:36.939902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28508885-b0c6-4379-8933-7bef95e8aa56 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:37.314167 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0191134e-7fd8-4459-b74b-d57d3929c712 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2139747962", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "d3c7e613-177d-41cb-9892-a283b29284d3"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:37.392804 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-0191134e-7fd8-4459-b74b-d57d3929c712 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] validate_networks() for [('d3c7e613-177d-41cb-9892-a283b29284d3', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:26:37.414431 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-28508885-b0c6-4379-8933-7bef95e8aa56 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:37.423816 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-28508885-b0c6-4379-8933-7bef95e8aa56 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740" status: 200 len: 1314 microversion: 2.1 time: 0.509643 Jul 25 14:26:37.439175 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 211/406] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:36 2022] GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740 => generated 1314 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:37.444879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-466e6ea4-4ead-459f-a821-3c683bf0430c tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:37.445728 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-466e6ea4-4ead-459f-a821-3c683bf0430c tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 9b76704f-db05-4df8-832a-2f9d30409637] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:37.455261 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-466e6ea4-4ead-459f-a821-3c683bf0430c tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:37.455935 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-466e6ea4-4ead-459f-a821-3c683bf0430c tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:37.457148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-466e6ea4-4ead-459f-a821-3c683bf0430c tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:37.457723 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-466e6ea4-4ead-459f-a821-3c683bf0430c tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:37.695748 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-466e6ea4-4ead-459f-a821-3c683bf0430c tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:37.709785 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-466e6ea4-4ead-459f-a821-3c683bf0430c tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637" status: 200 len: 1320 microversion: 2.1 time: 0.268416 Jul 25 14:26:37.711148 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 212/407] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:37 2022] GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637 => generated 1320 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:37.935433 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-494efd97-96e9-4439-9633-c7490f65af07 tempest-AZAdminNegativeTestJSON-2079658290 tempest-AZAdminNegativeTestJSON-2079658290-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:37.936287 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:37.936287 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:37.937156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-494efd97-96e9-4439-9633-c7490f65af07 tempest-AZAdminNegativeTestJSON-2079658290 tempest-AZAdminNegativeTestJSON-2079658290-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '05c45c96564848628593e2ba5ab0aca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3daa2796e0140a18d9f06fda8154ed0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:37.948471 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-494efd97-96e9-4439-9633-c7490f65af07 tempest-AZAdminNegativeTestJSON-2079658290 tempest-AZAdminNegativeTestJSON-2079658290-project] Request method failure captured: Jul 25 14:26:37.948471 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jul 25 14:26:37.948471 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:26:37.948471 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:26:37.948471 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:26:37.948471 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:26:37.948471 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:26:37.948471 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:26:37.948471 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:26:37.948471 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:37.948471 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qgbG58pT9S_e6k7iw__l0-2Hs7QRouN01S_j3vvQu0TGITG6Gxt9sXg8wU5GVtKsl4wNg1IQPAmCF7Tbhq6OMFT0uRW0B-wAGbSfozksvKCqU0L1T3VA3XAwV3AFVnZvUqNS3hHOAe5ukvt-aG7mvVRIae-p0tEmOLljWOZWJm4T_Y Jul 25 14:26:37.948471 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:26:37.948471 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:26:37.948471 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:26:37.948471 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:26:37.948471 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:26:37.948471 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:26:37.948471 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: d3daa2796e0140a18d9f06fda8154ed0 Jul 25 14:26:37.948471 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-AZAdminNegativeTestJSON-2079658290 Jul 25 14:26:37.948471 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:26:37.948471 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:26:37.949803 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d3daa2796e0140a18d9f06fda8154ed0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d3daa2796e0140a18d9f06fda8154ed0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_d3daa2796e0140a18d9f06fda8154ed0", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/d3daa2796e0140a18d9f06fda8154ed0"}]}] Jul 25 14:26:37.949803 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-AZAdminNegativeTestJSON-2079658290 Jul 25 14:26:37.949803 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: d3daa2796e0140a18d9f06fda8154ed0 Jul 25 14:26:37.949803 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-2079658290 Jul 25 14:26:37.949803 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-AZAdminNegativeTestJSON-2079658290-project Jul 25 14:26:37.949803 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:26:37.949803 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:26:37.949803 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 05c45c96564848628593e2ba5ab0aca8 Jul 25 14:26:37.949803 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-AZAdminNegativeTestJSON-2079658290-project Jul 25 14:26:37.949803 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:26:37.949803 n-d-846435-14 devstack@n-api.service[119304]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 25 14:26:37.949803 n-d-846435-14 devstack@n-api.service[119304]: action_args: {} Jul 25 14:26:37.950601 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:37.950601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:37.950601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:37.950601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:37.950601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:37.950601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:37.950601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:37.950601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:37.950601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jul 25 14:26:37.950601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jul 25 14:26:37.950601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 14:26:37.950601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 14:26:37.950601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 14:26:37.950601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 14:26:37.950601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:26:37.950601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:26:37.950601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:26:37.950601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:26:37.950601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 14:26:37.951855 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 14:26:37.951855 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 14:26:37.951855 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 14:26:37.951855 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 14:26:37.951855 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 14:26:37.951855 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 25 14:26:37.951855 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:37.951855 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:37.951855 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:37.951855 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:37.951855 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:37.951855 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:37.951855 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 14:26:37.951855 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 14:26:37.951855 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 25 14:26:37.951855 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:37.957205 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-494efd97-96e9-4439-9633-c7490f65af07 tempest-AZAdminNegativeTestJSON-2079658290 tempest-AZAdminNegativeTestJSON-2079658290-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:37.958272 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-494efd97-96e9-4439-9633-c7490f65af07 tempest-AZAdminNegativeTestJSON-2079658290 tempest-AZAdminNegativeTestJSON-2079658290-project] 10.222.0.88 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.245759 Jul 25 14:26:37.959571 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 213/408] 10.222.0.88 () {58 vars in 1185 bytes} [Mon Jul 25 14:26:37 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 247 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:26:37.978842 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ca9a27c3-6049-4f96-a695-0c0bf3ce0427 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:37.980555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ca9a27c3-6049-4f96-a695-0c0bf3ce0427 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:37.995129 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ca9a27c3-6049-4f96-a695-0c0bf3ce0427 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:37.996359 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ca9a27c3-6049-4f96-a695-0c0bf3ce0427 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:37.997555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ca9a27c3-6049-4f96-a695-0c0bf3ce0427 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:37.998259 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ca9a27c3-6049-4f96-a695-0c0bf3ce0427 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:38.228293 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ca9a27c3-6049-4f96-a695-0c0bf3ce0427 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:38.236836 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ca9a27c3-6049-4f96-a695-0c0bf3ce0427 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1312 microversion: 2.1 time: 0.276454 Jul 25 14:26:38.238125 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 214/409] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:37 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1312 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:38.447121 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6808551c-b08c-4b15-969d-3341b1967ed0 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:38.447121 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6808551c-b08c-4b15-969d-3341b1967ed0 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: 2ba0512b-a92a-404a-9bc1-ffc024d92740] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:38.456243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6808551c-b08c-4b15-969d-3341b1967ed0 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:38.456908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6808551c-b08c-4b15-969d-3341b1967ed0 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:38.457592 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6808551c-b08c-4b15-969d-3341b1967ed0 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:38.458020 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6808551c-b08c-4b15-969d-3341b1967ed0 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:38.766141 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=8 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:38.900271 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6808551c-b08c-4b15-969d-3341b1967ed0 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:38.910942 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6808551c-b08c-4b15-969d-3341b1967ed0 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740" status: 200 len: 1314 microversion: 2.1 time: 0.467712 Jul 25 14:26:38.911816 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 215/410] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:38 2022] GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740 => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:26:38.919517 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-aca94d5a-fbfb-4355-bd13-4ecd3c090b6f tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:38.920914 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-aca94d5a-fbfb-4355-bd13-4ecd3c090b6f tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 9b76704f-db05-4df8-832a-2f9d30409637] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:38.937832 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aca94d5a-fbfb-4355-bd13-4ecd3c090b6f tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:38.940163 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aca94d5a-fbfb-4355-bd13-4ecd3c090b6f tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:38.943928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aca94d5a-fbfb-4355-bd13-4ecd3c090b6f tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:38.944626 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aca94d5a-fbfb-4355-bd13-4ecd3c090b6f tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:38.951431 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:39.236529 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-aca94d5a-fbfb-4355-bd13-4ecd3c090b6f tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:39.260427 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-aca94d5a-fbfb-4355-bd13-4ecd3c090b6f tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637" status: 200 len: 1320 microversion: 2.1 time: 0.345472 Jul 25 14:26:39.263024 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 216/411] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:38 2022] GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637 => generated 1320 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:39.278748 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-06f57581-a64a-4cbc-bb44-98cff215ead7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:39.279761 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-06f57581-a64a-4cbc-bb44-98cff215ead7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:39.298146 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-06f57581-a64a-4cbc-bb44-98cff215ead7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:39.300666 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-06f57581-a64a-4cbc-bb44-98cff215ead7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:39.302749 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-06f57581-a64a-4cbc-bb44-98cff215ead7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:39.304428 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-06f57581-a64a-4cbc-bb44-98cff215ead7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:39.487081 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=16 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:39.645469 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-06f57581-a64a-4cbc-bb44-98cff215ead7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:39.657298 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-06f57581-a64a-4cbc-bb44-98cff215ead7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1312 microversion: 2.1 time: 0.392931 Jul 25 14:26:39.674868 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 217/412] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:39 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1312 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:39.686922 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-24ef1797-7d9e-4875-905d-ce043367b3a7 req-fd0bc2af-dade-40ce-9558-28957fad9b5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a419853-5f31-4fae-8a4e-da15efb145fb", "tag": "7bf3ba29-6559-4754-8d9e-31166ec3ecb3"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:39.716771 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-24ef1797-7d9e-4875-905d-ce043367b3a7 req-fd0bc2af-dade-40ce-9558-28957fad9b5c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:39.717217 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-24ef1797-7d9e-4875-905d-ce043367b3a7 req-fd0bc2af-dade-40ce-9558-28957fad9b5c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:39.747576 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-24ef1797-7d9e-4875-905d-ce043367b3a7 req-fd0bc2af-dade-40ce-9558-28957fad9b5c service nova] Creating event network-changed:7bf3ba29-6559-4754-8d9e-31166ec3ecb3 for instance 1a419853-5f31-4fae-8a4e-da15efb145fb on n-h2-846435-14 Jul 25 14:26:39.756673 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-24ef1797-7d9e-4875-905d-ce043367b3a7 req-fd0bc2af-dade-40ce-9558-28957fad9b5c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079558 Jul 25 14:26:39.757940 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 218/413] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:39.933460 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3a58c0ea-989f-4c57-85fd-ddf0025eea2b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:39.934027 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3a58c0ea-989f-4c57-85fd-ddf0025eea2b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: 2ba0512b-a92a-404a-9bc1-ffc024d92740] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:39.945283 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a58c0ea-989f-4c57-85fd-ddf0025eea2b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:39.949194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a58c0ea-989f-4c57-85fd-ddf0025eea2b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:39.952173 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a58c0ea-989f-4c57-85fd-ddf0025eea2b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:39.952939 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a58c0ea-989f-4c57-85fd-ddf0025eea2b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:40.257870 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-0191134e-7fd8-4459-b74b-d57d3929c712 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:26:40.258300 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-0191134e-7fd8-4459-b74b-d57d3929c712 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:26:40.258679 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-0191134e-7fd8-4459-b74b-d57d3929c712 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:26:40.259240 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-0191134e-7fd8-4459-b74b-d57d3929c712 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:26:40.259654 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-0191134e-7fd8-4459-b74b-d57d3929c712 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:26:40.278159 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0191134e-7fd8-4459-b74b-d57d3929c712 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:40.279954 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0191134e-7fd8-4459-b74b-d57d3929c712 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:40.284362 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0191134e-7fd8-4459-b74b-d57d3929c712 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:40.285071 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0191134e-7fd8-4459-b74b-d57d3929c712 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:40.344371 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3a58c0ea-989f-4c57-85fd-ddf0025eea2b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:40.347929 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-0191134e-7fd8-4459-b74b-d57d3929c712 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Getting quotas for project c0116982ed03475097096c73b5f03035. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:26:40.359230 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3a58c0ea-989f-4c57-85fd-ddf0025eea2b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740" status: 200 len: 1314 microversion: 2.1 time: 0.430721 Jul 25 14:26:40.379156 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-0191134e-7fd8-4459-b74b-d57d3929c712 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Getting quotas for user f1b1656f2dcd4ffebac55bf18110ff63 and project c0116982ed03475097096c73b5f03035. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:26:40.379371 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 219/414] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:39 2022] GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740 => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:40.394840 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0191134e-7fd8-4459-b74b-d57d3929c712 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:26:40.395021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ea1b333e-e82e-40d4-80db-89b8a5449650 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:40.395589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ea1b333e-e82e-40d4-80db-89b8a5449650 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 9b76704f-db05-4df8-832a-2f9d30409637] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:40.400137 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0191134e-7fd8-4459-b74b-d57d3929c712 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 04c1923b-e18a-408f-99b1-62d86feb25a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:26:40.421179 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=4 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:40.430711 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea1b333e-e82e-40d4-80db-89b8a5449650 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:40.431540 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea1b333e-e82e-40d4-80db-89b8a5449650 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:40.436829 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea1b333e-e82e-40d4-80db-89b8a5449650 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:40.439625 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea1b333e-e82e-40d4-80db-89b8a5449650 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:40.461400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:40.520334 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0191134e-7fd8-4459-b74b-d57d3929c712 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.714570 Jul 25 14:26:40.532061 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 196/415] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:26:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 3727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:26:40.554245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-95309230-0123-422f-9bfa-dbdda3e06a81 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:40.555671 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-95309230-0123-422f-9bfa-dbdda3e06a81 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 04c1923b-e18a-408f-99b1-62d86feb25a1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:40.896952 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-95309230-0123-422f-9bfa-dbdda3e06a81 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:40.917189 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-95309230-0123-422f-9bfa-dbdda3e06a81 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1" status: 200 len: 1225 microversion: 2.1 time: 0.368516 Jul 25 14:26:40.919134 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ea1b333e-e82e-40d4-80db-89b8a5449650 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:40.923399 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 197/416] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:40 2022] GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1 => generated 1225 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:40.941684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d74e7b7c-2ba8-4b7a-90e3-aa1676d79190 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:40.942489 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d74e7b7c-2ba8-4b7a-90e3-aa1676d79190 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:40.945035 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ea1b333e-e82e-40d4-80db-89b8a5449650 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637" status: 200 len: 1320 microversion: 2.1 time: 0.570769 Jul 25 14:26:40.948138 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 220/417] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:40 2022] GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637 => generated 1320 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:40.979246 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d74e7b7c-2ba8-4b7a-90e3-aa1676d79190 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:40.980762 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d74e7b7c-2ba8-4b7a-90e3-aa1676d79190 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:40.982145 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d74e7b7c-2ba8-4b7a-90e3-aa1676d79190 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:40.982797 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d74e7b7c-2ba8-4b7a-90e3-aa1676d79190 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:41.532908 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d74e7b7c-2ba8-4b7a-90e3-aa1676d79190 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:41.551070 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d74e7b7c-2ba8-4b7a-90e3-aa1676d79190 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1312 microversion: 2.1 time: 0.619060 Jul 25 14:26:41.570809 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 198/418] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:40 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1312 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:41.583650 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1e51cf36-f20c-4b68-9f63-a2e6097bd273 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:41.587163 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1e51cf36-f20c-4b68-9f63-a2e6097bd273 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: 2ba0512b-a92a-404a-9bc1-ffc024d92740] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:41.599963 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e51cf36-f20c-4b68-9f63-a2e6097bd273 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:41.600435 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e51cf36-f20c-4b68-9f63-a2e6097bd273 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:41.601221 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e51cf36-f20c-4b68-9f63-a2e6097bd273 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:41.601654 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e51cf36-f20c-4b68-9f63-a2e6097bd273 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:41.670353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9313fce7-e1ec-420a-9fea-886c5d772ae7 tempest-InstanceUsageAuditLogNegativeTestJSON-795619524 tempest-InstanceUsageAuditLogNegativeTestJSON-795619524-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:41.671508 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:41.671508 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:41.674141 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-9313fce7-e1ec-420a-9fea-886c5d772ae7 tempest-InstanceUsageAuditLogNegativeTestJSON-795619524 tempest-InstanceUsageAuditLogNegativeTestJSON-795619524-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jul 25 14:26:41.723077 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9313fce7-e1ec-420a-9fea-886c5d772ae7 tempest-InstanceUsageAuditLogNegativeTestJSON-795619524 tempest-InstanceUsageAuditLogNegativeTestJSON-795619524-project-admin] Request method failure captured: Jul 25 14:26:41.723077 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jul 25 14:26:41.723077 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:26:41.723077 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:26:41.723077 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:26:41.723077 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:26:41.723077 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:26:41.723077 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:26:41.723077 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:26:41.723077 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:41.723077 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qghxjHga9ikPpUiFJnaaX82wL-PkZ2QXzapagw9_xkam_WpIDMCpL28H17dO-d7fTISs7Z6u0IDdFQFdB3q95HxxFL00gQZXmAvBHBihV_VTytCuCtbY1FSuBOcHK58QdSUSkRN3jTMJOlmikhUtezORMuPRmuixjT0aSP2E19hRF4 Jul 25 14:26:41.723077 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:26:41.723077 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:26:41.723077 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:26:41.723077 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:26:41.723077 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:26:41.723077 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:26:41.723077 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 67958152fb2f4e15b88143b5bdbc7736 Jul 25 14:26:41.723077 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-795619524 Jul 25 14:26:41.723077 n-d-846435-14 devstack@n-api.service[119304]: X-Role: admin,reader,member Jul 25 14:26:41.723077 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: admin,reader,member Jul 25 14:26:41.724607 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/67958152fb2f4e15b88143b5bdbc7736"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/67958152fb2f4e15b88143b5bdbc7736"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_67958152fb2f4e15b88143b5bdbc7736", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/67958152fb2f4e15b88143b5bdbc7736"}]}] Jul 25 14:26:41.724607 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-795619524 Jul 25 14:26:41.724607 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 67958152fb2f4e15b88143b5bdbc7736 Jul 25 14:26:41.724607 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-795619524 Jul 25 14:26:41.724607 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-795619524-project-admin Jul 25 14:26:41.724607 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:26:41.724607 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:26:41.724607 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 22a45bb5f0d140e89daabed3f1a7565a Jul 25 14:26:41.724607 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-795619524-project-admin Jul 25 14:26:41.724607 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:26:41.724607 n-d-846435-14 devstack@n-api.service[119304]: exception: Invalid timestamp for date invalid_time Jul 25 14:26:41.724607 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'invalid_time'} Jul 25 14:26:41.725339 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:41.725339 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:41.725339 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jul 25 14:26:41.725339 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jul 25 14:26:41.725339 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jul 25 14:26:41.725339 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jul 25 14:26:41.725339 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jul 25 14:26:41.725339 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jul 25 14:26:41.725339 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jul 25 14:26:41.725339 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:41.725339 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:41.725339 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:41.725339 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:41.725339 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:41.725339 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:41.725339 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:41.725339 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:41.725339 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:41.725339 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:41.725339 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jul 25 14:26:41.726626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jul 25 14:26:41.726626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jul 25 14:26:41.726626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:41.726626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:41.726626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:41.726626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:41.726626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:41.726626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:41.726626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:26:41.726626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:26:41.726626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jul 25 14:26:41.726626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:41.728380 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9313fce7-e1ec-420a-9fea-886c5d772ae7 tempest-InstanceUsageAuditLogNegativeTestJSON-795619524 tempest-InstanceUsageAuditLogNegativeTestJSON-795619524-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:41.729291 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9313fce7-e1ec-420a-9fea-886c5d772ae7 tempest-InstanceUsageAuditLogNegativeTestJSON-795619524 tempest-InstanceUsageAuditLogNegativeTestJSON-795619524-project-admin] 10.222.0.88 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.469402 Jul 25 14:26:41.730548 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 221/419] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Jul 25 14:26:41 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 471 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 25 14:26:41.957044 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1e51cf36-f20c-4b68-9f63-a2e6097bd273 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:41.976255 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1e51cf36-f20c-4b68-9f63-a2e6097bd273 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740" status: 200 len: 1314 microversion: 2.1 time: 0.400914 Jul 25 14:26:41.994151 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 199/420] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:41 2022] GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740 => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:42.005930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a552806b-a409-4571-a939-db51846229e4 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:42.009287 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a552806b-a409-4571-a939-db51846229e4 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 04c1923b-e18a-408f-99b1-62d86feb25a1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:42.022191 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a552806b-a409-4571-a939-db51846229e4 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:42.022590 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a552806b-a409-4571-a939-db51846229e4 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:42.026892 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a552806b-a409-4571-a939-db51846229e4 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:42.027340 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a552806b-a409-4571-a939-db51846229e4 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:42.236816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-124f7722-2fee-434d-bf60-5764cb4743b8 tempest-InstanceUsageAuditLogNegativeTestJSON-1783478502 tempest-InstanceUsageAuditLogNegativeTestJSON-1783478502-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:42.237645 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:42.237645 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:42.239004 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-124f7722-2fee-434d-bf60-5764cb4743b8 tempest-InstanceUsageAuditLogNegativeTestJSON-1783478502 tempest-InstanceUsageAuditLogNegativeTestJSON-1783478502-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '46945c244694404cb2762e3fcf9dc95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c476c9b0d154905b010536059c59bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:42.241898 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-124f7722-2fee-434d-bf60-5764cb4743b8 tempest-InstanceUsageAuditLogNegativeTestJSON-1783478502 tempest-InstanceUsageAuditLogNegativeTestJSON-1783478502-project] Request method failure captured: Jul 25 14:26:42.241898 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jul 25 14:26:42.241898 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:26:42.241898 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:26:42.241898 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:26:42.241898 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:26:42.241898 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:26:42.241898 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:26:42.241898 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:26:42.241898 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:42.241898 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qgfsiC1RGSYXtZte-XU8BBwWFSRshc2y694pQrir29fcXPP88EizMI9kPom32rLs5p_kJuw8lKgf6kWGk5-ExdHGMu4qeES8-xB2cDmMmmRibkStr9W_iB0gDqBz9n-BctuB1ZD95a10Fbey5uHMfTvP6B-5ZJi30mIvCHAtlQtIsU Jul 25 14:26:42.241898 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:26:42.241898 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:26:42.241898 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:26:42.241898 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:26:42.241898 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:26:42.241898 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:26:42.241898 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 1c476c9b0d154905b010536059c59bdf Jul 25 14:26:42.241898 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1783478502 Jul 25 14:26:42.241898 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:26:42.241898 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:26:42.243349 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1c476c9b0d154905b010536059c59bdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1c476c9b0d154905b010536059c59bdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1c476c9b0d154905b010536059c59bdf", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1c476c9b0d154905b010536059c59bdf"}]}] Jul 25 14:26:42.243349 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1783478502 Jul 25 14:26:42.243349 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 1c476c9b0d154905b010536059c59bdf Jul 25 14:26:42.243349 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1783478502 Jul 25 14:26:42.243349 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1783478502-project Jul 25 14:26:42.243349 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:26:42.243349 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:26:42.243349 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 46945c244694404cb2762e3fcf9dc95c Jul 25 14:26:42.243349 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1783478502-project Jul 25 14:26:42.243349 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:26:42.243349 n-d-846435-14 devstack@n-api.service[119304]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 25 14:26:42.244226 n-d-846435-14 devstack@n-api.service[119304]: action_args: {} Jul 25 14:26:42.244226 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:42.244226 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:42.244226 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:42.244226 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:42.244226 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:42.244226 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:42.244226 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:42.244226 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:42.244226 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jul 25 14:26:42.244226 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jul 25 14:26:42.244226 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 14:26:42.244226 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 14:26:42.244226 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 14:26:42.244226 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 14:26:42.244226 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:26:42.244226 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:26:42.244226 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:26:42.244226 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:26:42.244226 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 14:26:42.245436 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 14:26:42.245436 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 14:26:42.245436 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 14:26:42.245436 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 14:26:42.245436 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 14:26:42.245436 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 25 14:26:42.245436 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:42.245436 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:42.245436 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:42.245436 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:42.245436 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:42.245436 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:42.245436 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 14:26:42.245436 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 14:26:42.245436 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 25 14:26:42.245436 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:42.245436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-124f7722-2fee-434d-bf60-5764cb4743b8 tempest-InstanceUsageAuditLogNegativeTestJSON-1783478502 tempest-InstanceUsageAuditLogNegativeTestJSON-1783478502-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:42.247215 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-124f7722-2fee-434d-bf60-5764cb4743b8 tempest-InstanceUsageAuditLogNegativeTestJSON-1783478502 tempest-InstanceUsageAuditLogNegativeTestJSON-1783478502-project] 10.222.0.88 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.509146 Jul 25 14:26:42.248167 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 222/421] 10.222.0.88 () {58 vars in 1185 bytes} [Mon Jul 25 14:26:41 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 512 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:26:42.262578 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-036a2022-212a-4da5-aee1-3af74b2264ef tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:42.263521 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-036a2022-212a-4da5-aee1-3af74b2264ef tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 9b76704f-db05-4df8-832a-2f9d30409637] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:42.277918 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-036a2022-212a-4da5-aee1-3af74b2264ef tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:42.281060 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-036a2022-212a-4da5-aee1-3af74b2264ef tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:42.285294 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-036a2022-212a-4da5-aee1-3af74b2264ef tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:42.286028 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-036a2022-212a-4da5-aee1-3af74b2264ef tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:42.426219 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a552806b-a409-4571-a939-db51846229e4 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:42.436775 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a552806b-a409-4571-a939-db51846229e4 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1" status: 200 len: 1221 microversion: 2.1 time: 0.439726 Jul 25 14:26:42.437691 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 200/422] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:41 2022] GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1 => generated 1221 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:42.448047 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-adef3fbb-2763-4e19-af2f-d3ce5c7a22d4 tempest-InstanceUsageAuditLogNegativeTestJSON-1783478502 tempest-InstanceUsageAuditLogNegativeTestJSON-1783478502-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:42.453116 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:42.453116 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:42.454394 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-adef3fbb-2763-4e19-af2f-d3ce5c7a22d4 tempest-InstanceUsageAuditLogNegativeTestJSON-1783478502 tempest-InstanceUsageAuditLogNegativeTestJSON-1783478502-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '46945c244694404cb2762e3fcf9dc95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c476c9b0d154905b010536059c59bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:42.456633 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-adef3fbb-2763-4e19-af2f-d3ce5c7a22d4 tempest-InstanceUsageAuditLogNegativeTestJSON-1783478502 tempest-InstanceUsageAuditLogNegativeTestJSON-1783478502-project] Request method failure captured: Jul 25 14:26:42.456633 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-07-25%2014:26:42 HTTP/1.1 Jul 25 14:26:42.456633 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:26:42.456633 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:26:42.456633 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:26:42.456633 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:26:42.456633 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:26:42.456633 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:26:42.456633 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:26:42.456633 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:42.456633 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qgfsiC1RGSYXtZte-XU8BBwWFSRshc2y694pQrir29fcXPP88EizMI9kPom32rLs5p_kJuw8lKgf6kWGk5-ExdHGMu4qeES8-xB2cDmMmmRibkStr9W_iB0gDqBz9n-BctuB1ZD95a10Fbey5uHMfTvP6B-5ZJi30mIvCHAtlQtIsU Jul 25 14:26:42.456633 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:26:42.456633 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:26:42.456633 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:26:42.456633 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:26:42.456633 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:26:42.456633 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:26:42.456633 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 1c476c9b0d154905b010536059c59bdf Jul 25 14:26:42.456633 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1783478502 Jul 25 14:26:42.456633 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:26:42.456633 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:26:42.457804 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1c476c9b0d154905b010536059c59bdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1c476c9b0d154905b010536059c59bdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1c476c9b0d154905b010536059c59bdf", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1c476c9b0d154905b010536059c59bdf"}]}] Jul 25 14:26:42.457804 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1783478502 Jul 25 14:26:42.457804 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 1c476c9b0d154905b010536059c59bdf Jul 25 14:26:42.457804 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1783478502 Jul 25 14:26:42.457804 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1783478502-project Jul 25 14:26:42.457804 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:26:42.457804 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:26:42.457804 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 46945c244694404cb2762e3fcf9dc95c Jul 25 14:26:42.457804 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1783478502-project Jul 25 14:26:42.457804 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:26:42.457804 n-d-846435-14 devstack@n-api.service[119303]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 25 14:26:42.458415 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '2022-07-25 14:26:42'} Jul 25 14:26:42.458415 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:42.458415 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:42.458415 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:42.458415 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:42.458415 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:42.458415 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:42.458415 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:42.458415 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:42.458415 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jul 25 14:26:42.458415 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jul 25 14:26:42.458415 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 14:26:42.458415 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 14:26:42.458415 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 14:26:42.458415 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 14:26:42.458415 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:26:42.458415 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:26:42.458415 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:26:42.458415 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:26:42.458415 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 14:26:42.459604 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 14:26:42.459604 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 14:26:42.459604 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 14:26:42.459604 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 14:26:42.459604 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 14:26:42.459604 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 25 14:26:42.459604 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:42.459604 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:42.459604 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:42.459604 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:42.459604 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:42.459604 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:42.459604 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 14:26:42.459604 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 14:26:42.459604 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 25 14:26:42.459604 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:42.459604 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-adef3fbb-2763-4e19-af2f-d3ce5c7a22d4 tempest-InstanceUsageAuditLogNegativeTestJSON-1783478502 tempest-InstanceUsageAuditLogNegativeTestJSON-1783478502-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:42.461730 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-adef3fbb-2763-4e19-af2f-d3ce5c7a22d4 tempest-InstanceUsageAuditLogNegativeTestJSON-1783478502 tempest-InstanceUsageAuditLogNegativeTestJSON-1783478502-project] 10.222.0.88 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-25 14:26:42" status: 403 len: 128 microversion: 2.1 time: 0.016900 Jul 25 14:26:42.461730 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 201/423] 10.222.0.88 () {58 vars in 1251 bytes} [Mon Jul 25 14:26:42 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-25%2014%3A26%3A42 => generated 128 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:26:42.551285 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-036a2022-212a-4da5-aee1-3af74b2264ef tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:42.562975 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-036a2022-212a-4da5-aee1-3af74b2264ef tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637" status: 200 len: 1320 microversion: 2.1 time: 0.308945 Jul 25 14:26:42.564306 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 223/424] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:42 2022] GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637 => generated 1320 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:42.576992 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cdb8753a-ed49-43fd-8b1c-aff7efd8f815 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:42.577597 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cdb8753a-ed49-43fd-8b1c-aff7efd8f815 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:42.591458 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cdb8753a-ed49-43fd-8b1c-aff7efd8f815 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:42.591960 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cdb8753a-ed49-43fd-8b1c-aff7efd8f815 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:42.596812 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cdb8753a-ed49-43fd-8b1c-aff7efd8f815 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:42.597354 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cdb8753a-ed49-43fd-8b1c-aff7efd8f815 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:42.830335 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-a2a28544-10f6-412b-a111-879cd7ad0387 req-80a13661-b82c-4f1a-8bf3-32f9889ad43f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba0512b-a92a-404a-9bc1-ffc024d92740", "name": "network-vif-plugged", "status": "completed", "tag": "b5d4e3ed-ac59-4af0-ae86-32099aa20f97"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:42.845927 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a2a28544-10f6-412b-a111-879cd7ad0387 req-80a13661-b82c-4f1a-8bf3-32f9889ad43f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:42.850444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a2a28544-10f6-412b-a111-879cd7ad0387 req-80a13661-b82c-4f1a-8bf3-32f9889ad43f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:42.885710 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-a2a28544-10f6-412b-a111-879cd7ad0387 req-80a13661-b82c-4f1a-8bf3-32f9889ad43f service nova] Creating event network-vif-plugged:b5d4e3ed-ac59-4af0-ae86-32099aa20f97 for instance 2ba0512b-a92a-404a-9bc1-ffc024d92740 on n-h1-846435-14 Jul 25 14:26:42.900900 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-a2a28544-10f6-412b-a111-879cd7ad0387 req-80a13661-b82c-4f1a-8bf3-32f9889ad43f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074750 Jul 25 14:26:42.907032 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 224/425] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:26:43.002494 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6d3c6c80-20ca-4616-9ae9-818796b2470f tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:43.003267 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6d3c6c80-20ca-4616-9ae9-818796b2470f tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: 2ba0512b-a92a-404a-9bc1-ffc024d92740] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:43.006422 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=6,nova_api:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:43.019253 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d3c6c80-20ca-4616-9ae9-818796b2470f tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:43.019944 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d3c6c80-20ca-4616-9ae9-818796b2470f tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:43.021162 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d3c6c80-20ca-4616-9ae9-818796b2470f tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:43.025653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d3c6c80-20ca-4616-9ae9-818796b2470f tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:43.251809 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cdb8753a-ed49-43fd-8b1c-aff7efd8f815 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:43.260582 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cdb8753a-ed49-43fd-8b1c-aff7efd8f815 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1312 microversion: 2.1 time: 0.688300 Jul 25 14:26:43.262188 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 202/426] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:42 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1312 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:43.394194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6d3c6c80-20ca-4616-9ae9-818796b2470f tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:43.404470 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6d3c6c80-20ca-4616-9ae9-818796b2470f tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740" status: 200 len: 1314 microversion: 2.1 time: 0.406790 Jul 25 14:26:43.405378 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 225/427] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:42 2022] GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740 => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:43.460159 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-db22ef9e-0a9d-4855-86e9-c43bb400b6b5 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:43.461018 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-db22ef9e-0a9d-4855-86e9-c43bb400b6b5 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 04c1923b-e18a-408f-99b1-62d86feb25a1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:43.470764 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-db22ef9e-0a9d-4855-86e9-c43bb400b6b5 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:43.472431 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-db22ef9e-0a9d-4855-86e9-c43bb400b6b5 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:43.474238 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-db22ef9e-0a9d-4855-86e9-c43bb400b6b5 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:43.475510 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-db22ef9e-0a9d-4855-86e9-c43bb400b6b5 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:43.585331 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e07c15a4-bf5d-4e9d-ba57-3ca5695e8b7e tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:43.585949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e07c15a4-bf5d-4e9d-ba57-3ca5695e8b7e tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 9b76704f-db05-4df8-832a-2f9d30409637] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:43.593003 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e07c15a4-bf5d-4e9d-ba57-3ca5695e8b7e tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:43.593810 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e07c15a4-bf5d-4e9d-ba57-3ca5695e8b7e tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:43.594906 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-db22ef9e-0a9d-4855-86e9-c43bb400b6b5 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:43.595489 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e07c15a4-bf5d-4e9d-ba57-3ca5695e8b7e tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:43.596105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e07c15a4-bf5d-4e9d-ba57-3ca5695e8b7e tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:43.604816 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-db22ef9e-0a9d-4855-86e9-c43bb400b6b5 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1" status: 200 len: 1283 microversion: 2.1 time: 0.151007 Jul 25 14:26:43.606323 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 203/428] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:43 2022] GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1 => generated 1283 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:43.852847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e07c15a4-bf5d-4e9d-ba57-3ca5695e8b7e tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:43.866243 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e07c15a4-bf5d-4e9d-ba57-3ca5695e8b7e tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637" status: 200 len: 1320 microversion: 2.1 time: 0.285159 Jul 25 14:26:43.880018 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 226/429] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:43 2022] GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637 => generated 1320 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:26:44.120324 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c38765c0-f353-4502-963b-66b24c1ec1a9 tempest-FlavorsV255TestJSON-1980461367 tempest-FlavorsV255TestJSON-1980461367-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-409484249", "id": 1418299154, "os-flavor-access:is_public": "True"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:44.124129 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:44.124129 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:44.152555 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c38765c0-f353-4502-963b-66b24c1ec1a9 tempest-FlavorsV255TestJSON-1980461367 tempest-FlavorsV255TestJSON-1980461367-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.228430 Jul 25 14:26:44.162692 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 204/430] 10.222.0.88 () {62 vars in 1188 bytes} [Mon Jul 25 14:26:43 2022] POST /compute/v2.1/flavors => generated 448 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:26:44.282343 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ef4225d9-6faf-4571-b081-a341fcabc1fb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:44.283341 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ef4225d9-6faf-4571-b081-a341fcabc1fb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:44.297211 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ef4225d9-6faf-4571-b081-a341fcabc1fb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:44.300912 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ef4225d9-6faf-4571-b081-a341fcabc1fb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:44.301999 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ef4225d9-6faf-4571-b081-a341fcabc1fb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:44.304154 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ef4225d9-6faf-4571-b081-a341fcabc1fb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:44.345266 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4e01351c-00bc-48b0-8d06-c2d5995b1b0d tempest-FlavorsV255TestJSON-631130564 tempest-FlavorsV255TestJSON-631130564-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:44.354360 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4e01351c-00bc-48b0-8d06-c2d5995b1b0d tempest-FlavorsV255TestJSON-631130564 tempest-FlavorsV255TestJSON-631130564-project] 10.222.0.88 "GET /compute/v2.1/flavors/1418299154" status: 200 len: 448 microversion: 2.55 time: 0.191211 Jul 25 14:26:44.355477 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 227/431] 10.222.0.88 () {60 vars in 1199 bytes} [Mon Jul 25 14:26:44 2022] GET /compute/v2.1/flavors/1418299154 => generated 448 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 14:26:44.368698 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-db712923-d290-46cf-9d67-eac9814e5e58 tempest-FlavorsV255TestJSON-1980461367 tempest-FlavorsV255TestJSON-1980461367-project-admin] Action: 'update', calling method: .version_select at 0x7f46964beb80>, body: {"flavor": {"description": "new"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:44.380415 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:44.380415 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:44.411116 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-db712923-d290-46cf-9d67-eac9814e5e58 tempest-FlavorsV255TestJSON-1980461367 tempest-FlavorsV255TestJSON-1980461367-project-admin] 10.222.0.88 "PUT /compute/v2.1/flavors/1418299154" status: 200 len: 449 microversion: 2.55 time: 0.046463 Jul 25 14:26:44.412297 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 228/432] 10.222.0.88 () {62 vars in 1219 bytes} [Mon Jul 25 14:26:44 2022] PUT /compute/v2.1/flavors/1418299154 => generated 449 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:26:44.427427 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2eea1203-1936-481f-bc24-fec0bb874c37 tempest-FlavorsV255TestJSON-631130564 tempest-FlavorsV255TestJSON-631130564-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:44.459134 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2eea1203-1936-481f-bc24-fec0bb874c37 tempest-FlavorsV255TestJSON-631130564 tempest-FlavorsV255TestJSON-631130564-project] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 6591 microversion: 2.55 time: 0.036442 Jul 25 14:26:44.460086 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 229/433] 10.222.0.88 () {60 vars in 1187 bytes} [Mon Jul 25 14:26:44 2022] GET /compute/v2.1/flavors/detail => generated 6591 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:26:44.466613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-654f6fa8-0905-498d-9823-999f6c8876d2 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:44.467228 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-654f6fa8-0905-498d-9823-999f6c8876d2 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: 2ba0512b-a92a-404a-9bc1-ffc024d92740] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:44.476119 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-654f6fa8-0905-498d-9823-999f6c8876d2 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:44.476751 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-654f6fa8-0905-498d-9823-999f6c8876d2 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:44.477617 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-654f6fa8-0905-498d-9823-999f6c8876d2 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:44.478104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-654f6fa8-0905-498d-9823-999f6c8876d2 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:44.676551 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-654f6fa8-0905-498d-9823-999f6c8876d2 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:44.692530 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-654f6fa8-0905-498d-9823-999f6c8876d2 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740" status: 200 len: 1314 microversion: 2.1 time: 0.230044 Jul 25 14:26:44.695813 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 230/434] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:44 2022] GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:44.710842 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-43e2f6aa-9d1d-4298-93b3-3d72219cdbc1 tempest-FlavorsV255TestJSON-631130564 tempest-FlavorsV255TestJSON-631130564-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:44.744910 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ef4225d9-6faf-4571-b081-a341fcabc1fb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:44.761580 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-43e2f6aa-9d1d-4298-93b3-3d72219cdbc1 tempest-FlavorsV255TestJSON-631130564 tempest-FlavorsV255TestJSON-631130564-project] 10.222.0.88 "GET /compute/v2.1/flavors" status: 200 len: 3681 microversion: 2.55 time: 0.063895 Jul 25 14:26:44.771454 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ef4225d9-6faf-4571-b081-a341fcabc1fb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1312 microversion: 2.1 time: 0.481459 Jul 25 14:26:44.788325 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 205/435] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:44 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1312 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:44.789752 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 231/436] 10.222.0.88 () {60 vars in 1166 bytes} [Mon Jul 25 14:26:44 2022] GET /compute/v2.1/flavors => generated 3681 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:26:44.790037 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6b64b5b3-279a-48a0-8ea2-57338a48835f tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:44.790037 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6b64b5b3-279a-48a0-8ea2-57338a48835f tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 04c1923b-e18a-408f-99b1-62d86feb25a1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:44.804671 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f9d9817e-c3b5-41b3-b26e-1ac8c2d20d3d tempest-FlavorsV255TestJSON-1980461367 tempest-FlavorsV255TestJSON-1980461367-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:44.808004 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:44.808004 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:44.826258 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6b64b5b3-279a-48a0-8ea2-57338a48835f tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:44.827482 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6b64b5b3-279a-48a0-8ea2-57338a48835f tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:44.828502 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6b64b5b3-279a-48a0-8ea2-57338a48835f tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:44.829413 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6b64b5b3-279a-48a0-8ea2-57338a48835f tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:44.878266 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f9d9817e-c3b5-41b3-b26e-1ac8c2d20d3d tempest-FlavorsV255TestJSON-1980461367 tempest-FlavorsV255TestJSON-1980461367-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/1418299154" status: 202 len: 0 microversion: 2.55 time: 0.093927 Jul 25 14:26:44.880716 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 232/437] 10.222.0.88 () {60 vars in 1202 bytes} [Mon Jul 25 14:26:44 2022] DELETE /compute/v2.1/flavors/1418299154 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:26:44.914455 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2690a2a0-a153-4a83-8831-8c06a355164a tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:44.915212 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2690a2a0-a153-4a83-8831-8c06a355164a tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 9b76704f-db05-4df8-832a-2f9d30409637] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:44.925070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2690a2a0-a153-4a83-8831-8c06a355164a tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:44.925559 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2690a2a0-a153-4a83-8831-8c06a355164a tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:44.926345 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2690a2a0-a153-4a83-8831-8c06a355164a tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:44.926776 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2690a2a0-a153-4a83-8831-8c06a355164a tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:45.218061 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6b64b5b3-279a-48a0-8ea2-57338a48835f tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:45.226593 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6b64b5b3-279a-48a0-8ea2-57338a48835f tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1" status: 200 len: 1325 microversion: 2.1 time: 0.448439 Jul 25 14:26:45.241978 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 206/438] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:44 2022] GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1 => generated 1325 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:45.246969 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-af8772e6-b96f-4bdc-b87c-4a79bc6be261 tempest-FlavorsV255TestJSON-1980461367 tempest-FlavorsV255TestJSON-1980461367-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:45.270810 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2690a2a0-a153-4a83-8831-8c06a355164a tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:45.288705 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2690a2a0-a153-4a83-8831-8c06a355164a tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637" status: 200 len: 1320 microversion: 2.1 time: 0.404839 Jul 25 14:26:45.291533 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 233/439] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:44 2022] GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637 => generated 1320 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:45.297525 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-af8772e6-b96f-4bdc-b87c-4a79bc6be261 tempest-FlavorsV255TestJSON-1980461367 tempest-FlavorsV255TestJSON-1980461367-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 6152 microversion: 2.55 time: 0.054101 Jul 25 14:26:45.305161 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 207/440] 10.222.0.88 () {60 vars in 1187 bytes} [Mon Jul 25 14:26:45 2022] GET /compute/v2.1/flavors/detail => generated 6152 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:26:45.305630 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-23bbfb52-6015-4399-8718-9e710fc26aae req-513b3d65-2098-437b-9035-4a2886e231fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b76704f-db05-4df8-832a-2f9d30409637", "name": "network-vif-plugged", "status": "completed", "tag": "0899a43b-d400-4d94-afe9-0a96d734b452"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:45.343232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-23bbfb52-6015-4399-8718-9e710fc26aae req-513b3d65-2098-437b-9035-4a2886e231fd service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:45.349870 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-23bbfb52-6015-4399-8718-9e710fc26aae req-513b3d65-2098-437b-9035-4a2886e231fd service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:45.402872 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-23bbfb52-6015-4399-8718-9e710fc26aae req-513b3d65-2098-437b-9035-4a2886e231fd service nova] Creating event network-vif-plugged:0899a43b-d400-4d94-afe9-0a96d734b452 for instance 9b76704f-db05-4df8-832a-2f9d30409637 on n-h2-846435-14 Jul 25 14:26:45.438299 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-23bbfb52-6015-4399-8718-9e710fc26aae req-513b3d65-2098-437b-9035-4a2886e231fd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133485 Jul 25 14:26:45.444288 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 234/441] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:45.474429 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-087e4f4f-92e8-43d4-861d-faddda43156e req-3991d182-ee95-4729-9a94-590aedc17ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04c1923b-e18a-408f-99b1-62d86feb25a1", "tag": "b9576864-54c5-430a-9ce8-c920701819c0"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:45.496156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-087e4f4f-92e8-43d4-861d-faddda43156e req-3991d182-ee95-4729-9a94-590aedc17ff7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:45.497037 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-087e4f4f-92e8-43d4-861d-faddda43156e req-3991d182-ee95-4729-9a94-590aedc17ff7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:45.529619 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-087e4f4f-92e8-43d4-861d-faddda43156e req-3991d182-ee95-4729-9a94-590aedc17ff7 service nova] Creating event network-changed:b9576864-54c5-430a-9ce8-c920701819c0 for instance 04c1923b-e18a-408f-99b1-62d86feb25a1 on n-h1-846435-14 Jul 25 14:26:45.556844 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-087e4f4f-92e8-43d4-861d-faddda43156e req-3991d182-ee95-4729-9a94-590aedc17ff7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110739 Jul 25 14:26:45.565992 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 235/442] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:45.718885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-69d789ed-f8f8-4554-8f0f-dec0288a6077 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:45.719602 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-69d789ed-f8f8-4554-8f0f-dec0288a6077 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: 2ba0512b-a92a-404a-9bc1-ffc024d92740] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:45.733993 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5c329510-7aba-45b7-a9d7-8a7bffa0ef04 tempest-FloatingIPsTestJSON-2063215081 tempest-FloatingIPsTestJSON-2063215081-project] Action: 'create', calling method: .version_select at 0x7f4694133a60>, body: {"pool": null} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:45.740014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69d789ed-f8f8-4554-8f0f-dec0288a6077 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:45.742835 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69d789ed-f8f8-4554-8f0f-dec0288a6077 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:45.745546 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69d789ed-f8f8-4554-8f0f-dec0288a6077 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:45.746264 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69d789ed-f8f8-4554-8f0f-dec0288a6077 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:46.090067 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-69d789ed-f8f8-4554-8f0f-dec0288a6077 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:46.130505 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-69d789ed-f8f8-4554-8f0f-dec0288a6077 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740" status: 200 len: 1464 microversion: 2.1 time: 0.409722 Jul 25 14:26:46.134844 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 236/443] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:45 2022] GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740 => generated 1464 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:26:46.147072 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b9b5f607-da6b-46a7-b24e-38eab19c253d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:46.148598 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b9b5f607-da6b-46a7-b24e-38eab19c253d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:46.189674 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b9b5f607-da6b-46a7-b24e-38eab19c253d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:46.190743 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b9b5f607-da6b-46a7-b24e-38eab19c253d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:46.193609 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b9b5f607-da6b-46a7-b24e-38eab19c253d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:46.195597 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b9b5f607-da6b-46a7-b24e-38eab19c253d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:46.392286 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b9b5f607-da6b-46a7-b24e-38eab19c253d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:46.404685 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b9b5f607-da6b-46a7-b24e-38eab19c253d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1312 microversion: 2.1 time: 0.263483 Jul 25 14:26:46.405277 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 237/444] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:46 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1312 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:46.703287 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b7988652-562d-45c8-9617-fef0ddf0dfa9 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:46.712577 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b7988652-562d-45c8-9617-fef0ddf0dfa9 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Searching by: {'deleted': False, 'project_id': '0db4dde5e2714b3db1a7777ad37de214'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:26:46.726111 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b7988652-562d-45c8-9617-fef0ddf0dfa9 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:46.726560 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b7988652-562d-45c8-9617-fef0ddf0dfa9 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:46.727346 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b7988652-562d-45c8-9617-fef0ddf0dfa9 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:46.727777 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b7988652-562d-45c8-9617-fef0ddf0dfa9 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:46.921162 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b7988652-562d-45c8-9617-fef0ddf0dfa9 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.511709 Jul 25 14:26:46.922149 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 238/445] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:26:46 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:26:46.946312 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cd47307f-86c5-4058-b2fd-56473d454843 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:46.946948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cd47307f-86c5-4058-b2fd-56473d454843 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 04c1923b-e18a-408f-99b1-62d86feb25a1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:46.963435 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cd47307f-86c5-4058-b2fd-56473d454843 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:46.963888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cd47307f-86c5-4058-b2fd-56473d454843 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:46.968355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cd47307f-86c5-4058-b2fd-56473d454843 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:46.970515 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cd47307f-86c5-4058-b2fd-56473d454843 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:47.439655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cd47307f-86c5-4058-b2fd-56473d454843 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:47.463873 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cd47307f-86c5-4058-b2fd-56473d454843 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1" status: 200 len: 1325 microversion: 2.1 time: 0.540390 Jul 25 14:26:47.467180 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 239/446] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:46 2022] GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1 => generated 1325 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:47.479996 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cb5bad80-3ee4-46d7-a6a2-73f533cab243 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:47.481559 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cb5bad80-3ee4-46d7-a6a2-73f533cab243 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 9b76704f-db05-4df8-832a-2f9d30409637] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:47.499176 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb5bad80-3ee4-46d7-a6a2-73f533cab243 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:47.500236 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb5bad80-3ee4-46d7-a6a2-73f533cab243 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:47.501222 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb5bad80-3ee4-46d7-a6a2-73f533cab243 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:47.502195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb5bad80-3ee4-46d7-a6a2-73f533cab243 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:48.028581 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cb5bad80-3ee4-46d7-a6a2-73f533cab243 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:48.039233 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cb5bad80-3ee4-46d7-a6a2-73f533cab243 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637" status: 200 len: 1470 microversion: 2.1 time: 0.570300 Jul 25 14:26:48.040104 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 240/447] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:47 2022] GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637 => generated 1470 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:48.045045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-368030c1-3b83-47d3-bca7-de2ef4d67fc9 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:48.051465 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-368030c1-3b83-47d3-bca7-de2ef4d67fc9 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Searching by: {'deleted': False} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:26:48.057109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-368030c1-3b83-47d3-bca7-de2ef4d67fc9 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:48.057803 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-368030c1-3b83-47d3-bca7-de2ef4d67fc9 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:48.058751 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-368030c1-3b83-47d3-bca7-de2ef4d67fc9 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:48.059329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-368030c1-3b83-47d3-bca7-de2ef4d67fc9 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:48.200906 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.multi_cell_list [None req-368030c1-3b83-47d3-bca7-de2ef4d67fc9 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=119304) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:26:48.239572 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5c329510-7aba-45b7-a9d7-8a7bffa0ef04 tempest-FloatingIPsTestJSON-2063215081 tempest-FloatingIPsTestJSON-2063215081-project] 10.222.0.88 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.932788 Jul 25 14:26:48.240748 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 208/448] 10.222.0.88 () {60 vars in 1170 bytes} [Mon Jul 25 14:26:45 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2935 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:48.256543 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-31922e52-9b21-4569-9769-1f4d4dd987b0 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:48.258628 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-31922e52-9b21-4569-9769-1f4d4dd987b0 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:48.276111 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-31922e52-9b21-4569-9769-1f4d4dd987b0 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:48.276564 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-31922e52-9b21-4569-9769-1f4d4dd987b0 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:48.277527 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-31922e52-9b21-4569-9769-1f4d4dd987b0 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:48.278114 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-31922e52-9b21-4569-9769-1f4d4dd987b0 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:48.362448 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-368030c1-3b83-47d3-bca7-de2ef4d67fc9 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:48.363196 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-368030c1-3b83-47d3-bca7-de2ef4d67fc9 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:48.554245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-31922e52-9b21-4569-9769-1f4d4dd987b0 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:48.578237 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-31922e52-9b21-4569-9769-1f4d4dd987b0 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1312 microversion: 2.1 time: 0.329527 Jul 25 14:26:48.581872 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 209/449] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:48 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1312 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:48.593047 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f47afc8e-4b0c-4721-9715-515ad1e2b37c tempest-DeleteServersAdminTestJSON-1134357036 tempest-DeleteServersAdminTestJSON-1134357036-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:48.595724 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f47afc8e-4b0c-4721-9715-515ad1e2b37c tempest-DeleteServersAdminTestJSON-1134357036 tempest-DeleteServersAdminTestJSON-1134357036-project-admin] [instance: 9b76704f-db05-4df8-832a-2f9d30409637] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:48.605241 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f47afc8e-4b0c-4721-9715-515ad1e2b37c tempest-DeleteServersAdminTestJSON-1134357036 tempest-DeleteServersAdminTestJSON-1134357036-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:48.610845 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f47afc8e-4b0c-4721-9715-515ad1e2b37c tempest-DeleteServersAdminTestJSON-1134357036 tempest-DeleteServersAdminTestJSON-1134357036-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:48.614339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f47afc8e-4b0c-4721-9715-515ad1e2b37c tempest-DeleteServersAdminTestJSON-1134357036 tempest-DeleteServersAdminTestJSON-1134357036-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:48.616999 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f47afc8e-4b0c-4721-9715-515ad1e2b37c tempest-DeleteServersAdminTestJSON-1134357036 tempest-DeleteServersAdminTestJSON-1134357036-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:48.802265 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f47afc8e-4b0c-4721-9715-515ad1e2b37c tempest-DeleteServersAdminTestJSON-1134357036 tempest-DeleteServersAdminTestJSON-1134357036-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637/action" status: 202 len: 0 microversion: 2.1 time: 0.218316 Jul 25 14:26:48.802999 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 210/450] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:26:48 2022] POST /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:26:48.811503 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7da09d19-e5cc-471c-8609-40dc565b7803 tempest-FloatingIPsTestJSON-2063215081 tempest-FloatingIPsTestJSON-2063215081-project] Calling method '.version_select at 0x7f4687e284c0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:49.128091 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-368030c1-3b83-47d3-bca7-de2ef4d67fc9 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 11218 microversion: 2.1 time: 1.086687 Jul 25 14:26:49.130171 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 241/451] 10.222.0.88 () {58 vars in 1171 bytes} [Mon Jul 25 14:26:48 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 11218 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:26:49.140377 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a66f266b-9ec5-47ec-89d7-b7b4ac4c4f2d tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:49.141506 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a66f266b-9ec5-47ec-89d7-b7b4ac4c4f2d tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 04c1923b-e18a-408f-99b1-62d86feb25a1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:49.156530 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a66f266b-9ec5-47ec-89d7-b7b4ac4c4f2d tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:49.157411 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a66f266b-9ec5-47ec-89d7-b7b4ac4c4f2d tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:49.158882 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a66f266b-9ec5-47ec-89d7-b7b4ac4c4f2d tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:49.159590 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a66f266b-9ec5-47ec-89d7-b7b4ac4c4f2d tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:49.218229 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7da09d19-e5cc-471c-8609-40dc565b7803 tempest-FloatingIPsTestJSON-2063215081 tempest-FloatingIPsTestJSON-2063215081-project] 10.222.0.88 "GET /compute/v2.1/os-floating-ips/58ea42c0-6977-44eb-a982-16c5f9e539cd" status: 200 len: 141 microversion: 2.1 time: 0.413788 Jul 25 14:26:49.219039 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 211/452] 10.222.0.88 () {58 vars in 1260 bytes} [Mon Jul 25 14:26:48 2022] GET /compute/v2.1/os-floating-ips/58ea42c0-6977-44eb-a982-16c5f9e539cd => generated 141 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:49.231584 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-e97a8096-7132-4183-acdc-e0c676dc3c69 req-91bbacdd-3122-4c88-bdd1-4fce7575787c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a419853-5f31-4fae-8a4e-da15efb145fb", "name": "network-vif-plugged", "status": "completed", "tag": "7bf3ba29-6559-4754-8d9e-31166ec3ecb3"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:49.248936 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-e97a8096-7132-4183-acdc-e0c676dc3c69 req-91bbacdd-3122-4c88-bdd1-4fce7575787c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:49.249504 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-e97a8096-7132-4183-acdc-e0c676dc3c69 req-91bbacdd-3122-4c88-bdd1-4fce7575787c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:49.261978 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-e97a8096-7132-4183-acdc-e0c676dc3c69 req-91bbacdd-3122-4c88-bdd1-4fce7575787c service nova] Creating event network-vif-plugged:7bf3ba29-6559-4754-8d9e-31166ec3ecb3 for instance 1a419853-5f31-4fae-8a4e-da15efb145fb on n-h2-846435-14 Jul 25 14:26:49.273818 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-e97a8096-7132-4183-acdc-e0c676dc3c69 req-91bbacdd-3122-4c88-bdd1-4fce7575787c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045825 Jul 25 14:26:49.274451 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 212/453] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:49.284132 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-774451a3-dd45-4b26-b9c3-2817dc61e0ef tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:49.284918 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-774451a3-dd45-4b26-b9c3-2817dc61e0ef tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 9b76704f-db05-4df8-832a-2f9d30409637] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:49.292528 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-774451a3-dd45-4b26-b9c3-2817dc61e0ef tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:49.293239 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-774451a3-dd45-4b26-b9c3-2817dc61e0ef tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:49.294356 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-774451a3-dd45-4b26-b9c3-2817dc61e0ef tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:49.295682 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-774451a3-dd45-4b26-b9c3-2817dc61e0ef tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:49.339001 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-774451a3-dd45-4b26-b9c3-2817dc61e0ef tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:49.339753 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-774451a3-dd45-4b26-b9c3-2817dc61e0ef tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:49.340382 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-774451a3-dd45-4b26-b9c3-2817dc61e0ef tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lazy-loading 'fault' on Instance uuid 9b76704f-db05-4df8-832a-2f9d30409637 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:26:49.444560 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a66f266b-9ec5-47ec-89d7-b7b4ac4c4f2d tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:49.452282 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a66f266b-9ec5-47ec-89d7-b7b4ac4c4f2d tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1" status: 200 len: 1325 microversion: 2.1 time: 0.320505 Jul 25 14:26:49.452872 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 242/454] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:49 2022] GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1 => generated 1325 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:49.471141 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d34ba538-4cf3-4f16-bdad-792c61293f48 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:49.485883 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d34ba538-4cf3-4f16-bdad-792c61293f48 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Searching by: {'deleted': False, 'project_id': '0db4dde5e2714b3db1a7777ad37de214'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:26:49.495402 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d34ba538-4cf3-4f16-bdad-792c61293f48 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:49.496010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d34ba538-4cf3-4f16-bdad-792c61293f48 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:49.496902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d34ba538-4cf3-4f16-bdad-792c61293f48 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:49.497399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d34ba538-4cf3-4f16-bdad-792c61293f48 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:49.541915 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d34ba538-4cf3-4f16-bdad-792c61293f48 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/detail?tenant_id=e693063176af4ae1ae0942ab1b10dc73" status: 200 len: 15 microversion: 2.1 time: 0.076209 Jul 25 14:26:49.542976 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 243/455] 10.222.0.88 () {58 vars in 1231 bytes} [Mon Jul 25 14:26:49 2022] GET /compute/v2.1/servers/detail?tenant_id=e693063176af4ae1ae0942ab1b10dc73 => generated 15 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:26:49.548452 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3c611112-1e83-4774-9542-13bb5aa16991 tempest-FloatingIPsTestJSON-2063215081 tempest-FloatingIPsTestJSON-2063215081-project] Calling method '.version_select at 0x7f4687d06670>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:49.604181 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-774451a3-dd45-4b26-b9c3-2817dc61e0ef tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:49.610478 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:49.616055 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-774451a3-dd45-4b26-b9c3-2817dc61e0ef tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637" status: 200 len: 1453 microversion: 2.1 time: 0.340372 Jul 25 14:26:49.616650 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 213/456] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:49 2022] GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637 => generated 1453 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:49.624636 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2feae7f4-6b9f-48bb-9985-d1cf618ebcc0 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:49.631424 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2feae7f4-6b9f-48bb-9985-d1cf618ebcc0 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Searching by: {'tenant_id': 'e693063176af4ae1ae0942ab1b10dc73', 'deleted': False} {{(pid=119303) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:26:49.639688 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2feae7f4-6b9f-48bb-9985-d1cf618ebcc0 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:49.640434 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2feae7f4-6b9f-48bb-9985-d1cf618ebcc0 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:49.641548 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2feae7f4-6b9f-48bb-9985-d1cf618ebcc0 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:49.642125 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2feae7f4-6b9f-48bb-9985-d1cf618ebcc0 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:49.767649 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.multi_cell_list [None req-2feae7f4-6b9f-48bb-9985-d1cf618ebcc0 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119303) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:26:49.843574 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3c611112-1e83-4774-9542-13bb5aa16991 tempest-FloatingIPsTestJSON-2063215081 tempest-FloatingIPsTestJSON-2063215081-project] 10.222.0.88 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.299179 Jul 25 14:26:49.845333 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 244/457] 10.222.0.88 () {58 vars in 1149 bytes} [Mon Jul 25 14:26:49 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:49.850394 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4bdc5c3f-2083-4817-8bbb-6fd630b67071 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:49.851553 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4bdc5c3f-2083-4817-8bbb-6fd630b67071 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:49.858703 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4bdc5c3f-2083-4817-8bbb-6fd630b67071 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:49.859334 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4bdc5c3f-2083-4817-8bbb-6fd630b67071 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:49.860310 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4bdc5c3f-2083-4817-8bbb-6fd630b67071 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:49.861066 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4bdc5c3f-2083-4817-8bbb-6fd630b67071 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:49.902763 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2feae7f4-6b9f-48bb-9985-d1cf618ebcc0 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:49.903112 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2feae7f4-6b9f-48bb-9985-d1cf618ebcc0 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:50.013462 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4bdc5c3f-2083-4817-8bbb-6fd630b67071 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:50.024348 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4bdc5c3f-2083-4817-8bbb-6fd630b67071 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1312 microversion: 2.1 time: 0.177356 Jul 25 14:26:50.025574 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 245/458] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:49 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1312 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:50.030641 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9e3f2257-38a5-47ca-aeba-f9694316b637 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:50.031684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9e3f2257-38a5-47ca-aeba-f9694316b637 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 9b76704f-db05-4df8-832a-2f9d30409637] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:50.038992 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9e3f2257-38a5-47ca-aeba-f9694316b637 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:50.039611 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9e3f2257-38a5-47ca-aeba-f9694316b637 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:50.039876 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2feae7f4-6b9f-48bb-9985-d1cf618ebcc0 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e693063176af4ae1ae0942ab1b10dc73" status: 200 len: 4832 microversion: 2.1 time: 0.420809 Jul 25 14:26:50.040421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9e3f2257-38a5-47ca-aeba-f9694316b637 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:50.041581 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9e3f2257-38a5-47ca-aeba-f9694316b637 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:50.044132 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 214/459] 10.222.0.88 () {58 vars in 1257 bytes} [Mon Jul 25 14:26:49 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e693063176af4ae1ae0942ab1b10dc73 => generated 4832 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:50.051771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-83c92cf5-c14c-4885-8b66-b50b524808a4 tempest-FloatingIPsTestJSON-2063215081 tempest-FloatingIPsTestJSON-2063215081-project] Calling method '.version_select at 0x7f4687e28d30>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:50.073290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9e3f2257-38a5-47ca-aeba-f9694316b637 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 9b76704f-db05-4df8-832a-2f9d30409637] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:26:50.139174 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:50.216615 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9e3f2257-38a5-47ca-aeba-f9694316b637 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "DELETE /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637" status: 204 len: 0 microversion: 2.1 time: 0.188925 Jul 25 14:26:50.218238 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 246/460] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:26:50 2022] DELETE /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:26:50.526787 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8430b825-9554-4f2d-93ed-0a9364f43a26 tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Calling method '.version_select at 0x7f4687bae8b0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:50.751442 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8430b825-9554-4f2d-93ed-0a9364f43a26 tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/76d896f4a50140a4b1c52e6cb13f29e3" status: 200 len: 371 microversion: 2.1 time: 0.531739 Jul 25 14:26:50.752055 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 247/461] 10.222.0.88 () {58 vars in 1242 bytes} [Mon Jul 25 14:26:50 2022] GET /compute/v2.1/os-quota-sets/76d896f4a50140a4b1c52e6cb13f29e3 => generated 371 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:50.758657 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3cafacfa-694d-4430-ad63-94caed25e008 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:50.762523 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3cafacfa-694d-4430-ad63-94caed25e008 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Searching by: {'tenant_id': '0db4dde5e2714b3db1a7777ad37de214', 'deleted': False} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:26:50.767890 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3cafacfa-694d-4430-ad63-94caed25e008 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:50.768373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3cafacfa-694d-4430-ad63-94caed25e008 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:50.769319 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3cafacfa-694d-4430-ad63-94caed25e008 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:50.770025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3cafacfa-694d-4430-ad63-94caed25e008 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:50.798157 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3cafacfa-694d-4430-ad63-94caed25e008 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=0db4dde5e2714b3db1a7777ad37de214" status: 200 len: 15 microversion: 2.1 time: 0.045021 Jul 25 14:26:50.798693 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 248/462] 10.222.0.88 () {58 vars in 1257 bytes} [Mon Jul 25 14:26:50 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=0db4dde5e2714b3db1a7777ad37de214 => generated 15 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:26:50.803046 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0a031a6c-15e3-4491-9379-cca07ebd93c6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:50.803758 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0a031a6c-15e3-4491-9379-cca07ebd93c6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 9b76704f-db05-4df8-832a-2f9d30409637] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:50.809648 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0a031a6c-15e3-4491-9379-cca07ebd93c6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:50.810128 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0a031a6c-15e3-4491-9379-cca07ebd93c6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:50.810878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0a031a6c-15e3-4491-9379-cca07ebd93c6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:50.811341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0a031a6c-15e3-4491-9379-cca07ebd93c6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:50.844619 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0a031a6c-15e3-4491-9379-cca07ebd93c6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:50.844855 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0a031a6c-15e3-4491-9379-cca07ebd93c6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:50.845293 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-0a031a6c-15e3-4491-9379-cca07ebd93c6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lazy-loading 'fault' on Instance uuid 9b76704f-db05-4df8-832a-2f9d30409637 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:26:50.899841 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-83c92cf5-c14c-4885-8b66-b50b524808a4 tempest-FloatingIPsTestJSON-2063215081 tempest-FloatingIPsTestJSON-2063215081-project] 10.222.0.88 "DELETE /compute/v2.1/os-floating-ips/58ea42c0-6977-44eb-a982-16c5f9e539cd" status: 202 len: 0 microversion: 2.1 time: 0.853445 Jul 25 14:26:50.900567 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 215/463] 10.222.0.88 () {58 vars in 1263 bytes} [Mon Jul 25 14:26:50 2022] DELETE /compute/v2.1/os-floating-ips/58ea42c0-6977-44eb-a982-16c5f9e539cd => generated 0 bytes in 856 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:26:50.905426 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-13e32a4b-b05e-42c5-9f27-cdf188251553 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:50.906138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-13e32a4b-b05e-42c5-9f27-cdf188251553 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 04c1923b-e18a-408f-99b1-62d86feb25a1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:50.912891 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-13e32a4b-b05e-42c5-9f27-cdf188251553 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:50.913551 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-13e32a4b-b05e-42c5-9f27-cdf188251553 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:50.914438 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-13e32a4b-b05e-42c5-9f27-cdf188251553 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:50.915230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-13e32a4b-b05e-42c5-9f27-cdf188251553 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:50.966758 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0a031a6c-15e3-4491-9379-cca07ebd93c6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:50.974524 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0a031a6c-15e3-4491-9379-cca07ebd93c6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637" status: 200 len: 1459 microversion: 2.1 time: 0.174871 Jul 25 14:26:50.988211 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 249/464] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:50 2022] GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637 => generated 1459 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:51.028754 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b2ffbb3c-b08e-41b0-9e8e-cf60e6248af0 tempest-HypervisorAdminV228Test-1208201439 tempest-HypervisorAdminV228Test-1208201439-project-admin] Calling method '.version_select at 0x7f4687bc5c10>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:51.029642 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:51.029642 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:51.030853 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b2ffbb3c-b08e-41b0-9e8e-cf60e6248af0 tempest-HypervisorAdminV228Test-1208201439 tempest-HypervisorAdminV228Test-1208201439-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:51.031294 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b2ffbb3c-b08e-41b0-9e8e-cf60e6248af0 tempest-HypervisorAdminV228Test-1208201439 tempest-HypervisorAdminV228Test-1208201439-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:51.045804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b2ffbb3c-b08e-41b0-9e8e-cf60e6248af0 tempest-HypervisorAdminV228Test-1208201439 tempest-HypervisorAdminV228Test-1208201439-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:51.046280 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b2ffbb3c-b08e-41b0-9e8e-cf60e6248af0 tempest-HypervisorAdminV228Test-1208201439 tempest-HypervisorAdminV228Test-1208201439-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:51.054849 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-13e32a4b-b05e-42c5-9f27-cdf188251553 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:51.056700 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b2ffbb3c-b08e-41b0-9e8e-cf60e6248af0 tempest-HypervisorAdminV228Test-1208201439 tempest-HypervisorAdminV228Test-1208201439-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:51.057128 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b2ffbb3c-b08e-41b0-9e8e-cf60e6248af0 tempest-HypervisorAdminV228Test-1208201439 tempest-HypervisorAdminV228Test-1208201439-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:51.062643 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-13e32a4b-b05e-42c5-9f27-cdf188251553 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1" status: 200 len: 1325 microversion: 2.1 time: 0.160976 Jul 25 14:26:51.063043 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b2ffbb3c-b08e-41b0-9e8e-cf60e6248af0 tempest-HypervisorAdminV228Test-1208201439 tempest-HypervisorAdminV228Test-1208201439-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.086982 Jul 25 14:26:51.063557 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 216/465] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:50 2022] GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1 => generated 1325 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:51.063858 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 250/466] 10.222.0.88 () {60 vars in 1187 bytes} [Mon Jul 25 14:26:50 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:26:51.068117 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7a7c66aa-d02e-48af-9a53-df53d76596bc tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:51.073306 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7a7c66aa-d02e-48af-9a53-df53d76596bc tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.008618 Jul 25 14:26:51.073781 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b37494a2-f55e-423b-86e2-a792fd8de4e3 tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Action: 'update', calling method: .version_select at 0x7f4687d6af70>, body: {"quota_set": {"ram": "5120"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:51.073912 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 251/467] 10.222.0.88 () {58 vars in 1189 bytes} [Mon Jul 25 14:26:51 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:26:51.077982 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c82e1db7-4ec2-4018-875e-3012f557636f tempest-FloatingIPsTestJSON-2063215081 tempest-FloatingIPsTestJSON-2063215081-project] Action: 'create', calling method: .version_select at 0x7f4687ba1670>, body: {"pool": null} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:51.140418 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b37494a2-f55e-423b-86e2-a792fd8de4e3 tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:51.140864 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b37494a2-f55e-423b-86e2-a792fd8de4e3 tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:51.141661 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b37494a2-f55e-423b-86e2-a792fd8de4e3 tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:51.142092 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b37494a2-f55e-423b-86e2-a792fd8de4e3 tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:51.191298 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b37494a2-f55e-423b-86e2-a792fd8de4e3 tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-sets/76d896f4a50140a4b1c52e6cb13f29e3" status: 200 len: 328 microversion: 2.1 time: 0.120902 Jul 25 14:26:51.191934 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 217/468] 10.222.0.88 () {60 vars in 1262 bytes} [Mon Jul 25 14:26:51 2022] PUT /compute/v2.1/os-quota-sets/76d896f4a50140a4b1c52e6cb13f29e3 => generated 328 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:51.196933 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-196780cb-f8ff-49b6-9f60-55d0f5f7ef51 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:51.197102 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-196780cb-f8ff-49b6-9f60-55d0f5f7ef51 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:51.203502 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-196780cb-f8ff-49b6-9f60-55d0f5f7ef51 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:51.203502 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-196780cb-f8ff-49b6-9f60-55d0f5f7ef51 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:51.204261 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-196780cb-f8ff-49b6-9f60-55d0f5f7ef51 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:51.204701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-196780cb-f8ff-49b6-9f60-55d0f5f7ef51 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:51.338325 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-196780cb-f8ff-49b6-9f60-55d0f5f7ef51 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:51.346357 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-196780cb-f8ff-49b6-9f60-55d0f5f7ef51 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1312 microversion: 2.1 time: 0.153410 Jul 25 14:26:51.346935 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 218/469] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:51 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:51.351386 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4b0f8202-3abb-40ca-9513-d59d1b0ba257 tempest-HypervisorAdminV228Test-1208201439 tempest-HypervisorAdminV228Test-1208201439-project-admin] Calling method '.version_select at 0x7f4687d62f70>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:51.352469 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:51.352469 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:26:51.353470 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4b0f8202-3abb-40ca-9513-d59d1b0ba257 tempest-HypervisorAdminV228Test-1208201439 tempest-HypervisorAdminV228Test-1208201439-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:51.353916 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4b0f8202-3abb-40ca-9513-d59d1b0ba257 tempest-HypervisorAdminV228Test-1208201439 tempest-HypervisorAdminV228Test-1208201439-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:51.366672 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4b0f8202-3abb-40ca-9513-d59d1b0ba257 tempest-HypervisorAdminV228Test-1208201439 tempest-HypervisorAdminV228Test-1208201439-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:51.367124 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4b0f8202-3abb-40ca-9513-d59d1b0ba257 tempest-HypervisorAdminV228Test-1208201439 tempest-HypervisorAdminV228Test-1208201439-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:51.374087 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4b0f8202-3abb-40ca-9513-d59d1b0ba257 tempest-HypervisorAdminV228Test-1208201439 tempest-HypervisorAdminV228Test-1208201439-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.026183 Jul 25 14:26:51.374653 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 219/470] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Jul 25 14:26:51 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:26:51.379074 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e1f7aba8-3f24-4950-a82f-78ea89170c27 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:51.381382 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e1f7aba8-3f24-4950-a82f-78ea89170c27 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:51.384650 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:51.389143 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e1f7aba8-3f24-4950-a82f-78ea89170c27 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:51.389684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e1f7aba8-3f24-4950-a82f-78ea89170c27 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:51.390488 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e1f7aba8-3f24-4950-a82f-78ea89170c27 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:51.390927 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e1f7aba8-3f24-4950-a82f-78ea89170c27 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:51.487962 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e1f7aba8-3f24-4950-a82f-78ea89170c27 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7/action" status: 202 len: 0 microversion: 2.1 time: 0.111618 Jul 25 14:26:51.492037 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 220/471] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:26:51 2022] POST /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:26:51.496394 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8f15f540-8da2-41b6-8e32-a39a9793e9aa tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:51.511334 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8f15f540-8da2-41b6-8e32-a39a9793e9aa tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-quota-sets/76d896f4a50140a4b1c52e6cb13f29e3" status: 202 len: 0 microversion: 2.1 time: 0.018469 Jul 25 14:26:51.512067 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 221/472] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Jul 25 14:26:51 2022] DELETE /compute/v2.1/os-quota-sets/76d896f4a50140a4b1c52e6cb13f29e3 => generated 0 bytes in 20 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:26:51.520967 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-04dab047-70f3-48be-9cc2-9d8d72948ab6 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:51.526178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-04dab047-70f3-48be-9cc2-9d8d72948ab6 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:51.526976 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-04dab047-70f3-48be-9cc2-9d8d72948ab6 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73'} {{(pid=119303) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:26:51.535019 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-04dab047-70f3-48be-9cc2-9d8d72948ab6 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:51.535519 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-04dab047-70f3-48be-9cc2-9d8d72948ab6 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:51.536375 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-04dab047-70f3-48be-9cc2-9d8d72948ab6 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:51.536838 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-04dab047-70f3-48be-9cc2-9d8d72948ab6 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:51.622998 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.multi_cell_list [None req-04dab047-70f3-48be-9cc2-9d8d72948ab6 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119303) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:26:51.685138 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-04dab047-70f3-48be-9cc2-9d8d72948ab6 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.171774 Jul 25 14:26:51.685733 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 222/473] 10.222.0.88 () {58 vars in 1150 bytes} [Mon Jul 25 14:26:51 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:51.701423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-84a6f1bf-cb78-4efa-bbd5-06a75f270e5c tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Calling method '.version_select at 0x7f4687e8b280>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:51.963104 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-84a6f1bf-cb78-4efa-bbd5-06a75f270e5c tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/76d896f4a50140a4b1c52e6cb13f29e3" status: 200 len: 371 microversion: 2.1 time: 0.276233 Jul 25 14:26:51.963876 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 223/474] 10.222.0.88 () {58 vars in 1242 bytes} [Mon Jul 25 14:26:51 2022] GET /compute/v2.1/os-quota-sets/76d896f4a50140a4b1c52e6cb13f29e3 => generated 371 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:51.969078 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6ce37ad6-2520-4e9c-add5-7423ab01c42a tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:51.971807 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6ce37ad6-2520-4e9c-add5-7423ab01c42a tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:51.978634 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ce37ad6-2520-4e9c-add5-7423ab01c42a tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:51.979155 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ce37ad6-2520-4e9c-add5-7423ab01c42a tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:51.980180 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ce37ad6-2520-4e9c-add5-7423ab01c42a tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:51.980764 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ce37ad6-2520-4e9c-add5-7423ab01c42a tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:52.082604 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6ce37ad6-2520-4e9c-add5-7423ab01c42a tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7/action" status: 202 len: 0 microversion: 2.1 time: 0.116097 Jul 25 14:26:52.086413 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 224/475] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:26:51 2022] POST /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:26:52.093665 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cfef1501-705a-495d-aaa8-a2d590a30307 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:52.094294 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cfef1501-705a-495d-aaa8-a2d590a30307 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 9b76704f-db05-4df8-832a-2f9d30409637] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:52.109379 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cfef1501-705a-495d-aaa8-a2d590a30307 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:52.109835 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cfef1501-705a-495d-aaa8-a2d590a30307 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:52.110653 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cfef1501-705a-495d-aaa8-a2d590a30307 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:52.111135 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cfef1501-705a-495d-aaa8-a2d590a30307 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:52.147638 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cfef1501-705a-495d-aaa8-a2d590a30307 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:52.148590 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cfef1501-705a-495d-aaa8-a2d590a30307 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:52.149386 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-cfef1501-705a-495d-aaa8-a2d590a30307 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lazy-loading 'fault' on Instance uuid 9b76704f-db05-4df8-832a-2f9d30409637 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:26:52.394315 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cfef1501-705a-495d-aaa8-a2d590a30307 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd99a49d2a5254f038c4c1e243f3bac22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8236bf5c62e6434cbedf22a0e3fba1f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:52.403520 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cfef1501-705a-495d-aaa8-a2d590a30307 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637" status: 200 len: 1459 microversion: 2.1 time: 0.318120 Jul 25 14:26:52.404431 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 225/476] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:52 2022] GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637 => generated 1459 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:52.422951 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f0b98e45-57a9-4858-a68a-691024cace0a tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:52.423440 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f0b98e45-57a9-4858-a68a-691024cace0a tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 04c1923b-e18a-408f-99b1-62d86feb25a1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:52.430525 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f0b98e45-57a9-4858-a68a-691024cace0a tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:52.431059 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f0b98e45-57a9-4858-a68a-691024cace0a tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:52.432002 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f0b98e45-57a9-4858-a68a-691024cace0a tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:52.432504 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f0b98e45-57a9-4858-a68a-691024cace0a tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:52.452782 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c82e1db7-4ec2-4018-875e-3012f557636f tempest-FloatingIPsTestJSON-2063215081 tempest-FloatingIPsTestJSON-2063215081-project] 10.222.0.88 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.377964 Jul 25 14:26:52.453846 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 252/477] 10.222.0.88 () {60 vars in 1170 bytes} [Mon Jul 25 14:26:51 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:52.459752 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-de1142ef-3797-48b3-9cd9-f87b523b2b86 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:52.460561 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-de1142ef-3797-48b3-9cd9-f87b523b2b86 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:52.467920 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-de1142ef-3797-48b3-9cd9-f87b523b2b86 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:52.468647 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-de1142ef-3797-48b3-9cd9-f87b523b2b86 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:52.469597 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-de1142ef-3797-48b3-9cd9-f87b523b2b86 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:52.470206 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-de1142ef-3797-48b3-9cd9-f87b523b2b86 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:52.638403 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-de1142ef-3797-48b3-9cd9-f87b523b2b86 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1616 microversion: 2.1 time: 0.183300 Jul 25 14:26:52.639260 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 253/478] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:52 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1616 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:52.661033 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c2b1a6d5-ebfc-4945-8319-1d72cb4c0178 tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Calling method '.version_select at 0x7f4687bc5f70>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:52.665731 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f0b98e45-57a9-4858-a68a-691024cace0a tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:52.678039 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f0b98e45-57a9-4858-a68a-691024cace0a tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1" status: 200 len: 1325 microversion: 2.1 time: 0.260728 Jul 25 14:26:52.691707 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 226/479] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:52 2022] GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1 => generated 1325 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:52.698555 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-5efd0149-2ddc-4869-b068-19f8fe27b74a req-b21f01f0-ebfe-4bbc-9446-29d5f0f8976d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c1923b-e18a-408f-99b1-62d86feb25a1", "name": "network-vif-plugged", "status": "completed", "tag": "b9576864-54c5-430a-9ce8-c920701819c0"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:52.710139 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-5efd0149-2ddc-4869-b068-19f8fe27b74a req-b21f01f0-ebfe-4bbc-9446-29d5f0f8976d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:52.710665 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-5efd0149-2ddc-4869-b068-19f8fe27b74a req-b21f01f0-ebfe-4bbc-9446-29d5f0f8976d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:52.722174 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-5efd0149-2ddc-4869-b068-19f8fe27b74a req-b21f01f0-ebfe-4bbc-9446-29d5f0f8976d service nova] Creating event network-vif-plugged:b9576864-54c5-430a-9ce8-c920701819c0 for instance 04c1923b-e18a-408f-99b1-62d86feb25a1 on n-h1-846435-14 Jul 25 14:26:52.736552 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-5efd0149-2ddc-4869-b068-19f8fe27b74a req-b21f01f0-ebfe-4bbc-9446-29d5f0f8976d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042857 Jul 25 14:26:52.737497 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 227/480] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:52.742760 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-62aa08b0-311d-4af9-b5c8-f382debd268c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:52.743464 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-62aa08b0-311d-4af9-b5c8-f382debd268c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:52.751845 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-62aa08b0-311d-4af9-b5c8-f382debd268c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:52.752057 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-62aa08b0-311d-4af9-b5c8-f382debd268c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:52.753077 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-62aa08b0-311d-4af9-b5c8-f382debd268c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:52.754177 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-62aa08b0-311d-4af9-b5c8-f382debd268c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:53.014499 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c2b1a6d5-ebfc-4945-8319-1d72cb4c0178 tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/1c4cdc1479974f16950fdd78ba052296/defaults" status: 200 len: 371 microversion: 2.1 time: 0.360455 Jul 25 14:26:53.015560 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 254/481] 10.222.0.88 () {58 vars in 1269 bytes} [Mon Jul 25 14:26:52 2022] GET /compute/v2.1/os-quota-sets/1c4cdc1479974f16950fdd78ba052296/defaults => generated 371 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:53.025941 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-db5d0bc1-fc89-4697-8e7f-a516b02be38e tempest-FloatingIPsTestJSON-2063215081 tempest-FloatingIPsTestJSON-2063215081-project] Calling method '.version_select at 0x7f4687ba1af0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:53.065022 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-62aa08b0-311d-4af9-b5c8-f382debd268c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:53.073161 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-62aa08b0-311d-4af9-b5c8-f382debd268c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1460 microversion: 2.1 time: 0.334577 Jul 25 14:26:53.073738 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 228/482] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:52 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1460 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:53.088458 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-28a1457b-ee8d-443f-a1f4-5b841cae847e tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:53.099519 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-28a1457b-ee8d-443f-a1f4-5b841cae847e tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:53.112153 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-28a1457b-ee8d-443f-a1f4-5b841cae847e tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:53.114672 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-28a1457b-ee8d-443f-a1f4-5b841cae847e tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:53.115652 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-28a1457b-ee8d-443f-a1f4-5b841cae847e tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:53.116223 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-28a1457b-ee8d-443f-a1f4-5b841cae847e tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:53.390448 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-28a1457b-ee8d-443f-a1f4-5b841cae847e tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1616 microversion: 2.1 time: 0.315384 Jul 25 14:26:53.390788 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 229/483] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:53 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1616 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:53.404180 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-07eea709-fe12-4116-9ba9-1a7c57c545f3 req-1e2c52fe-a4bd-4369-ae52-5332cb44c265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b76704f-db05-4df8-832a-2f9d30409637", "name": "network-vif-deleted", "tag": "0899a43b-d400-4d94-afe9-0a96d734b452"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:53.407871 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-07eea709-fe12-4116-9ba9-1a7c57c545f3 req-1e2c52fe-a4bd-4369-ae52-5332cb44c265 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:53.408427 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-07eea709-fe12-4116-9ba9-1a7c57c545f3 req-1e2c52fe-a4bd-4369-ae52-5332cb44c265 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:53.427323 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-07eea709-fe12-4116-9ba9-1a7c57c545f3 req-1e2c52fe-a4bd-4369-ae52-5332cb44c265 service nova] Creating event network-vif-deleted:0899a43b-d400-4d94-afe9-0a96d734b452 for instance 9b76704f-db05-4df8-832a-2f9d30409637 on n-h2-846435-14 Jul 25 14:26:53.439418 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-07eea709-fe12-4116-9ba9-1a7c57c545f3 req-1e2c52fe-a4bd-4369-ae52-5332cb44c265 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046709 Jul 25 14:26:53.444095 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 230/484] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:53.717772 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fa9f9621-de1f-4cd9-aacc-439765625e9c tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:53.718503 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fa9f9621-de1f-4cd9-aacc-439765625e9c tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:53.725472 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa9f9621-de1f-4cd9-aacc-439765625e9c tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:53.726032 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa9f9621-de1f-4cd9-aacc-439765625e9c tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:53.726806 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa9f9621-de1f-4cd9-aacc-439765625e9c tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:53.727294 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa9f9621-de1f-4cd9-aacc-439765625e9c tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:53.749796 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:54.065210 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fa9f9621-de1f-4cd9-aacc-439765625e9c tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1613 microversion: 2.1 time: 0.617768 Jul 25 14:26:54.085138 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 231/485] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:53 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1613 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:54.104403 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-56e801ef-5075-4979-b706-d72015b1d9fa tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Action: 'update', calling method: .version_select at 0x7f4687cb7160>, body: {"quota_set": {"ram": "5120"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:54.244285 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-db5d0bc1-fc89-4697-8e7f-a516b02be38e tempest-FloatingIPsTestJSON-2063215081 tempest-FloatingIPsTestJSON-2063215081-project] 10.222.0.88 "DELETE /compute/v2.1/os-floating-ips/b725b08a-f3bf-4474-bad2-415c18cb3557" status: 202 len: 0 microversion: 2.1 time: 1.226959 Jul 25 14:26:54.244788 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 255/486] 10.222.0.88 () {58 vars in 1263 bytes} [Mon Jul 25 14:26:53 2022] DELETE /compute/v2.1/os-floating-ips/b725b08a-f3bf-4474-bad2-415c18cb3557 => generated 0 bytes in 1229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:26:54.253045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3f928c7f-11cf-4cab-a5c1-cbb17323341e tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:54.261459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3f928c7f-11cf-4cab-a5c1-cbb17323341e tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Searching by: {'host': 'n-h1-846435-14', 'deleted': False} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:26:54.266620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f928c7f-11cf-4cab-a5c1-cbb17323341e tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:54.267059 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f928c7f-11cf-4cab-a5c1-cbb17323341e tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:54.267834 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f928c7f-11cf-4cab-a5c1-cbb17323341e tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:54.268619 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f928c7f-11cf-4cab-a5c1-cbb17323341e tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:54.362025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.multi_cell_list [None req-3f928c7f-11cf-4cab-a5c1-cbb17323341e tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=119304) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:26:54.423189 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3f928c7f-11cf-4cab-a5c1-cbb17323341e tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] 10.222.0.88 "GET /compute/v2.1/servers?host=n-h1-846435-14&all_tenants=1" status: 200 len: 1341 microversion: 2.1 time: 0.173705 Jul 25 14:26:54.423877 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 256/487] 10.222.0.88 () {58 vars in 1192 bytes} [Mon Jul 25 14:26:54 2022] GET /compute/v2.1/servers?host=n-h1-846435-14&all_tenants=1 => generated 1341 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:54.432325 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fab129c3-de56-4d8c-ba83-ece418336a06 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:54.433066 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fab129c3-de56-4d8c-ba83-ece418336a06 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 9b76704f-db05-4df8-832a-2f9d30409637] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:54.439998 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fab129c3-de56-4d8c-ba83-ece418336a06 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:54.440530 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fab129c3-de56-4d8c-ba83-ece418336a06 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:54.441413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fab129c3-de56-4d8c-ba83-ece418336a06 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:54.441913 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fab129c3-de56-4d8c-ba83-ece418336a06 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:54.456432 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-fab129c3-de56-4d8c-ba83-ece418336a06 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] HTTP exception thrown: Instance 9b76704f-db05-4df8-832a-2f9d30409637 could not be found. Jul 25 14:26:54.458071 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fab129c3-de56-4d8c-ba83-ece418336a06 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Request method failure captured: Jul 25 14:26:54.458071 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637 HTTP/1.1 Jul 25 14:26:54.458071 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:26:54.458071 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:26:54.458071 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:26:54.458071 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:26:54.458071 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:26:54.458071 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:26:54.458071 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:26:54.458071 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:54.458071 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfkKVYF8tulhJYxobI4sMNY3mzpHgkPM2lXpcETovKivA9uFectz576sX3ZKXxXrAhs6PwLDD3YKX24eq6m5sccxa2kS8D_PLpt0mt7x8_jh2juqAPUA8rdyUNm7PZioLQXJKZtZS-vslZXRGC30P8bzTEt9vWEmXaF8ORSii-5bdU Jul 25 14:26:54.458071 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:26:54.458071 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:26:54.458071 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:26:54.458071 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:26:54.458071 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:26:54.458071 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:26:54.458071 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 8236bf5c62e6434cbedf22a0e3fba1f4 Jul 25 14:26:54.458071 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-DeleteServersAdminTestJSON-652135158 Jul 25 14:26:54.458071 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:26:54.458071 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:26:54.459482 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8236bf5c62e6434cbedf22a0e3fba1f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8236bf5c62e6434cbedf22a0e3fba1f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8236bf5c62e6434cbedf22a0e3fba1f4", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8236bf5c62e6434cbedf22a0e3fba1f4"}]}] Jul 25 14:26:54.459482 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-DeleteServersAdminTestJSON-652135158 Jul 25 14:26:54.459482 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 8236bf5c62e6434cbedf22a0e3fba1f4 Jul 25 14:26:54.459482 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-652135158 Jul 25 14:26:54.459482 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-DeleteServersAdminTestJSON-652135158-project Jul 25 14:26:54.459482 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:26:54.459482 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:26:54.459482 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: d99a49d2a5254f038c4c1e243f3bac22 Jul 25 14:26:54.459482 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-DeleteServersAdminTestJSON-652135158-project Jul 25 14:26:54.459482 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:26:54.459482 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 9b76704f-db05-4df8-832a-2f9d30409637 could not be found. Jul 25 14:26:54.459482 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '9b76704f-db05-4df8-832a-2f9d30409637'} Jul 25 14:26:54.460336 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:54.460336 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:54.460336 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:26:54.460336 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:26:54.460336 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:26:54.460336 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:26:54.460336 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:26:54.460336 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:26:54.460336 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:26:54.460336 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:26:54.460336 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b76704f-db05-4df8-832a-2f9d30409637 could not be found. Jul 25 14:26:54.460336 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:54.460336 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:54.460336 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:54.460336 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:54.460336 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:54.460336 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:54.460336 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:54.460336 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:54.460336 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:54.461721 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:54.461721 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:26:54.461721 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:26:54.461721 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:26:54.461721 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:26:54.461721 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:26:54.461721 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:26:54.461721 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b76704f-db05-4df8-832a-2f9d30409637 could not be found. Jul 25 14:26:54.461721 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:54.461721 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:54.461721 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:54.461721 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:54.461721 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:54.461721 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:54.461721 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:26:54.461721 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:26:54.461721 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b76704f-db05-4df8-832a-2f9d30409637 could not be found. Jul 25 14:26:54.461721 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:54.462955 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fab129c3-de56-4d8c-ba83-ece418336a06 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Returning 404 to user: Instance 9b76704f-db05-4df8-832a-2f9d30409637 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:54.462955 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fab129c3-de56-4d8c-ba83-ece418336a06 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637" status: 404 len: 111 microversion: 2.1 time: 0.034452 Jul 25 14:26:54.462955 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 257/488] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:54 2022] GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:26:54.467349 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ef4c2667-7326-4f53-91ac-d1d5a797431e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:54.467349 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ef4c2667-7326-4f53-91ac-d1d5a797431e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 04c1923b-e18a-408f-99b1-62d86feb25a1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:54.472265 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ef4c2667-7326-4f53-91ac-d1d5a797431e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:54.472706 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ef4c2667-7326-4f53-91ac-d1d5a797431e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:54.473496 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ef4c2667-7326-4f53-91ac-d1d5a797431e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:54.473981 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ef4c2667-7326-4f53-91ac-d1d5a797431e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:54.490042 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56e801ef-5075-4979-b706-d72015b1d9fa tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:54.490744 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56e801ef-5075-4979-b706-d72015b1d9fa tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:54.491620 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56e801ef-5075-4979-b706-d72015b1d9fa tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:54.492174 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56e801ef-5075-4979-b706-d72015b1d9fa tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:54.554612 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-56e801ef-5075-4979-b706-d72015b1d9fa tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-sets/de9185ab9f4c4a04a17b15407d8991e0" status: 200 len: 328 microversion: 2.1 time: 0.468061 Jul 25 14:26:54.555617 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 232/489] 10.222.0.88 () {60 vars in 1262 bytes} [Mon Jul 25 14:26:54 2022] PUT /compute/v2.1/os-quota-sets/de9185ab9f4c4a04a17b15407d8991e0 => generated 328 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:54.560496 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-539acdee-d4da-478c-a648-62d2a85d88a3 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:54.561258 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-539acdee-d4da-478c-a648-62d2a85d88a3 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:54.568113 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-539acdee-d4da-478c-a648-62d2a85d88a3 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:54.568564 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-539acdee-d4da-478c-a648-62d2a85d88a3 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:54.569392 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-539acdee-d4da-478c-a648-62d2a85d88a3 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:54.569821 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-539acdee-d4da-478c-a648-62d2a85d88a3 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:54.620572 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ef4c2667-7326-4f53-91ac-d1d5a797431e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:54.629710 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ef4c2667-7326-4f53-91ac-d1d5a797431e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1" status: 200 len: 1522 microversion: 2.1 time: 0.168234 Jul 25 14:26:54.630277 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 258/490] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:54 2022] GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:54.635968 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9703ed98-b190-4dbf-906b-4e56ea3679ab tempest-FloatingIPsTestJSON-2063215081 tempest-FloatingIPsTestJSON-2063215081-project] Calling method '.version_select at 0x7f4687ac4310>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:54.661580 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-539acdee-d4da-478c-a648-62d2a85d88a3 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd8f2a5957f224095933cfaaecc9a800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1dcb670bb2e4ec0b747b392ca4139eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:54.662198 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-539acdee-d4da-478c-a648-62d2a85d88a3 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] flavor_id is None. Assuming migration. {{(pid=119303) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 25 14:26:54.662634 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-539acdee-d4da-478c-a648-62d2a85d88a3 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119303) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 14:26:54.684218 n-d-846435-14 devstack@n-api.service[119304]: DEBUG neutronclient.v2_0.client [None req-9703ed98-b190-4dbf-906b-4e56ea3679ab tempest-FloatingIPsTestJSON-2063215081 tempest-FloatingIPsTestJSON-2063215081-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP b725b08a-f3bf-4474-bad2-415c18cb3557 could not be found", "detail": ""}} {{(pid=119304) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 14:26:54.684906 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-9703ed98-b190-4dbf-906b-4e56ea3679ab tempest-FloatingIPsTestJSON-2063215081 tempest-FloatingIPsTestJSON-2063215081-project] HTTP exception thrown: Floating IP not found for ID b725b08a-f3bf-4474-bad2-415c18cb3557 Jul 25 14:26:54.716587 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9703ed98-b190-4dbf-906b-4e56ea3679ab tempest-FloatingIPsTestJSON-2063215081 tempest-FloatingIPsTestJSON-2063215081-project] Request method failure captured: Jul 25 14:26:54.716587 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/os-floating-ips/b725b08a-f3bf-4474-bad2-415c18cb3557 HTTP/1.1 Jul 25 14:26:54.716587 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:26:54.716587 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:26:54.716587 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:26:54.716587 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:26:54.716587 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:26:54.716587 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:26:54.716587 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:26:54.716587 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:54.716587 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qgkKmYRsupIZhhAPmhMZr5p0SIngVtj9BkgLwPMAWpcepB5TA2X2H_1X0mtoACuI4xzLFa8HzNnO6jlmOLnZkUco8xwydSCoOviURbY_yyUL1UjRp91zpAQs5KzBOxYSm1NFF4lLFoz7KfF2uu2xNBJGrzv4V8ssIGi0ggWoREOAK4 Jul 25 14:26:54.716587 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:26:54.716587 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:26:54.716587 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:26:54.716587 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:26:54.716587 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:26:54.716587 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:26:54.716587 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: b60e26add4254da48e50833c33a1177c Jul 25 14:26:54.716587 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-FloatingIPsTestJSON-2063215081 Jul 25 14:26:54.716587 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:26:54.716587 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:26:54.718074 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b60e26add4254da48e50833c33a1177c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b60e26add4254da48e50833c33a1177c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b60e26add4254da48e50833c33a1177c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b60e26add4254da48e50833c33a1177c"}]}] Jul 25 14:26:54.718074 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-FloatingIPsTestJSON-2063215081 Jul 25 14:26:54.718074 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: b60e26add4254da48e50833c33a1177c Jul 25 14:26:54.718074 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-FloatingIPsTestJSON-2063215081 Jul 25 14:26:54.718074 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-FloatingIPsTestJSON-2063215081-project Jul 25 14:26:54.718074 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:26:54.718074 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:26:54.718074 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: b6a569557c5e419681a05ae86c28a963 Jul 25 14:26:54.718074 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-FloatingIPsTestJSON-2063215081-project Jul 25 14:26:54.718074 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:26:54.718074 n-d-846435-14 devstack@n-api.service[119304]: exception: Floating IP not found for ID b725b08a-f3bf-4474-bad2-415c18cb3557 Jul 25 14:26:54.718074 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'b725b08a-f3bf-4474-bad2-415c18cb3557'} Jul 25 14:26:54.718074 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:54.719091 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:54.719091 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 25 14:26:54.719091 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 25 14:26:54.719091 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:26:54.719091 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:26:54.719091 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 25 14:26:54.719091 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 25 14:26:54.719091 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:26:54.719091 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:26:54.719091 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 14:26:54.719091 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 14:26:54.719091 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:26:54.719091 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:26:54.719091 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 14:26:54.719091 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 14:26:54.719091 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:26:54.719091 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:26:54.719091 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 14:26:54.719091 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 14:26:54.720491 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:26:54.720491 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:26:54.720491 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 14:26:54.720491 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 14:26:54.720491 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 14:26:54.720491 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 14:26:54.720491 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP b725b08a-f3bf-4474-bad2-415c18cb3557 could not be found Jul 25 14:26:54.720491 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40628185-3e86-41b0-aadd-e7aed9308921'] Jul 25 14:26:54.720491 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:54.720491 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:54.720491 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:54.720491 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:54.720491 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 25 14:26:54.720491 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 25 14:26:54.720491 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 25 14:26:54.720491 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 25 14:26:54.720491 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID b725b08a-f3bf-4474-bad2-415c18cb3557. Jul 25 14:26:54.720491 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:54.720491 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:54.720491 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:54.721917 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:54.721917 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:54.721917 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:54.721917 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:54.721917 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:54.721917 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:26:54.721917 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:26:54.721917 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:54.721917 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:54.721917 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 25 14:26:54.721917 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 14:26:54.721917 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID b725b08a-f3bf-4474-bad2-415c18cb3557 Jul 25 14:26:54.721917 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:54.721917 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:54.721917 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:54.721917 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:54.721917 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:54.721917 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:54.721917 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:26:54.721917 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:26:54.724302 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID b725b08a-f3bf-4474-bad2-415c18cb3557 Jul 25 14:26:54.724302 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:54.725789 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9703ed98-b190-4dbf-906b-4e56ea3679ab tempest-FloatingIPsTestJSON-2063215081 tempest-FloatingIPsTestJSON-2063215081-project] Returning 404 to user: Floating IP not found for ID b725b08a-f3bf-4474-bad2-415c18cb3557 {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:54.726941 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9703ed98-b190-4dbf-906b-4e56ea3679ab tempest-FloatingIPsTestJSON-2063215081 tempest-FloatingIPsTestJSON-2063215081-project] 10.222.0.88 "GET /compute/v2.1/os-floating-ips/b725b08a-f3bf-4474-bad2-415c18cb3557" status: 404 len: 111 microversion: 2.1 time: 0.095613 Jul 25 14:26:54.728101 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 259/491] 10.222.0.88 () {58 vars in 1260 bytes} [Mon Jul 25 14:26:54 2022] GET /compute/v2.1/os-floating-ips/b725b08a-f3bf-4474-bad2-415c18cb3557 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:26:54.734304 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8255b754-baff-4587-bd49-2b5c99e749f6 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:54.741221 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8255b754-baff-4587-bd49-2b5c99e749f6 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:26:54.747650 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8255b754-baff-4587-bd49-2b5c99e749f6 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:54.748119 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8255b754-baff-4587-bd49-2b5c99e749f6 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:54.748901 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8255b754-baff-4587-bd49-2b5c99e749f6 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:54.749322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8255b754-baff-4587-bd49-2b5c99e749f6 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:54.770411 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8255b754-baff-4587-bd49-2b5c99e749f6 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] 10.222.0.88 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.040698 Jul 25 14:26:54.771114 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 260/492] 10.222.0.88 () {58 vars in 1196 bytes} [Mon Jul 25 14:26:54 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:26:54.776078 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-abe98d77-eafd-44e3-a4b7-4cb7ffa21eb2 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:54.776611 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-abe98d77-eafd-44e3-a4b7-4cb7ffa21eb2 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 9b76704f-db05-4df8-832a-2f9d30409637] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:54.783298 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-abe98d77-eafd-44e3-a4b7-4cb7ffa21eb2 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:54.783745 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-abe98d77-eafd-44e3-a4b7-4cb7ffa21eb2 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:54.784572 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-abe98d77-eafd-44e3-a4b7-4cb7ffa21eb2 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:54.785001 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-abe98d77-eafd-44e3-a4b7-4cb7ffa21eb2 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:54.799037 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-abe98d77-eafd-44e3-a4b7-4cb7ffa21eb2 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] HTTP exception thrown: Instance 9b76704f-db05-4df8-832a-2f9d30409637 could not be found. Jul 25 14:26:54.800812 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-abe98d77-eafd-44e3-a4b7-4cb7ffa21eb2 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Request method failure captured: Jul 25 14:26:54.800812 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637 HTTP/1.1 Jul 25 14:26:54.800812 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:26:54.800812 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:26:54.800812 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:26:54.800812 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:26:54.800812 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:26:54.800812 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:26:54.800812 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:26:54.800812 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:54.800812 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfkKVYF8tulhJYxobI4sMNY3mzpHgkPM2lXpcETovKivA9uFectz576sX3ZKXxXrAhs6PwLDD3YKX24eq6m5sccxa2kS8D_PLpt0mt7x8_jh2juqAPUA8rdyUNm7PZioLQXJKZtZS-vslZXRGC30P8bzTEt9vWEmXaF8ORSii-5bdU Jul 25 14:26:54.800812 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:26:54.800812 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:26:54.800812 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:26:54.800812 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:26:54.800812 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:26:54.800812 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:26:54.800812 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 8236bf5c62e6434cbedf22a0e3fba1f4 Jul 25 14:26:54.800812 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-DeleteServersAdminTestJSON-652135158 Jul 25 14:26:54.800812 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:26:54.800812 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:26:54.802017 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8236bf5c62e6434cbedf22a0e3fba1f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8236bf5c62e6434cbedf22a0e3fba1f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8236bf5c62e6434cbedf22a0e3fba1f4", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8236bf5c62e6434cbedf22a0e3fba1f4"}]}] Jul 25 14:26:54.802017 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-DeleteServersAdminTestJSON-652135158 Jul 25 14:26:54.802017 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 8236bf5c62e6434cbedf22a0e3fba1f4 Jul 25 14:26:54.802017 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-652135158 Jul 25 14:26:54.802017 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-DeleteServersAdminTestJSON-652135158-project Jul 25 14:26:54.802017 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:26:54.802017 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:26:54.802017 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: d99a49d2a5254f038c4c1e243f3bac22 Jul 25 14:26:54.802017 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-DeleteServersAdminTestJSON-652135158-project Jul 25 14:26:54.802017 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:26:54.802017 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 9b76704f-db05-4df8-832a-2f9d30409637 could not be found. Jul 25 14:26:54.802017 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '9b76704f-db05-4df8-832a-2f9d30409637'} Jul 25 14:26:54.802801 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:54.802801 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:54.802801 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:26:54.802801 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:26:54.802801 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:26:54.802801 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:26:54.802801 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:26:54.802801 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:26:54.802801 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:26:54.802801 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:26:54.802801 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b76704f-db05-4df8-832a-2f9d30409637 could not be found. Jul 25 14:26:54.802801 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:54.802801 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:54.802801 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:54.802801 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:54.802801 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:54.802801 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:54.802801 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:54.802801 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:54.802801 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:54.803869 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:54.803869 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:26:54.803869 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:26:54.803869 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:26:54.803869 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:26:54.803869 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:26:54.803869 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:26:54.803869 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:26:54.803869 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:26:54.803869 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b76704f-db05-4df8-832a-2f9d30409637 could not be found. Jul 25 14:26:54.803869 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:54.803869 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:54.803869 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:54.803869 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:54.803869 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:54.803869 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:54.803869 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:26:54.803869 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:26:54.803869 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b76704f-db05-4df8-832a-2f9d30409637 could not be found. Jul 25 14:26:54.803869 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:54.806040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-abe98d77-eafd-44e3-a4b7-4cb7ffa21eb2 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Returning 404 to user: Instance 9b76704f-db05-4df8-832a-2f9d30409637 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:54.806040 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-abe98d77-eafd-44e3-a4b7-4cb7ffa21eb2 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "DELETE /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637" status: 404 len: 111 microversion: 2.1 time: 0.030031 Jul 25 14:26:54.806040 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 261/493] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:26:54 2022] DELETE /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:26:54.809623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-44b7ce22-646c-4df3-b695-eadee89687cf tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Calling method '.version_select at 0x7f4687b4f550>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:55.057735 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:55.067265 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-44b7ce22-646c-4df3-b695-eadee89687cf tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:55.067572 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-44b7ce22-646c-4df3-b695-eadee89687cf tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:55.068393 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-44b7ce22-646c-4df3-b695-eadee89687cf tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:55.068821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-44b7ce22-646c-4df3-b695-eadee89687cf tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:55.097602 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-44b7ce22-646c-4df3-b695-eadee89687cf tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/de9185ab9f4c4a04a17b15407d8991e0/detail" status: 200 len: 916 microversion: 2.1 time: 0.293900 Jul 25 14:26:55.098365 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 262/494] 10.222.0.88 () {58 vars in 1263 bytes} [Mon Jul 25 14:26:54 2022] GET /compute/v2.1/os-quota-sets/de9185ab9f4c4a04a17b15407d8991e0/detail => generated 916 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:55.102952 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3bd30720-9c68-4d48-a620-3fdfbc33e721 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:55.103635 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3bd30720-9c68-4d48-a620-3fdfbc33e721 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 04c1923b-e18a-408f-99b1-62d86feb25a1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:55.119722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3bd30720-9c68-4d48-a620-3fdfbc33e721 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:55.119722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3bd30720-9c68-4d48-a620-3fdfbc33e721 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:55.119722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3bd30720-9c68-4d48-a620-3fdfbc33e721 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:55.119722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3bd30720-9c68-4d48-a620-3fdfbc33e721 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:55.147315 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-539acdee-d4da-478c-a648-62d2a85d88a3 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb/action" status: 202 len: 0 microversion: 2.1 time: 0.590088 Jul 25 14:26:55.151641 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 233/495] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:26:54 2022] POST /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb/action => generated 0 bytes in 595 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:26:55.157754 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-66121ba5-b591-4f88-a777-2958628b5e19 tempest-FloatingIPsTestJSON-2063215081 tempest-FloatingIPsTestJSON-2063215081-project] Calling method '.version_select at 0x7f4687c2f5e0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:55.214970 n-d-846435-14 devstack@n-api.service[119303]: DEBUG neutronclient.v2_0.client [None req-66121ba5-b591-4f88-a777-2958628b5e19 tempest-FloatingIPsTestJSON-2063215081 tempest-FloatingIPsTestJSON-2063215081-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP b725b08a-f3bf-4474-bad2-415c18cb3557 could not be found", "detail": ""}} {{(pid=119303) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 14:26:55.215907 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-66121ba5-b591-4f88-a777-2958628b5e19 tempest-FloatingIPsTestJSON-2063215081 tempest-FloatingIPsTestJSON-2063215081-project] HTTP exception thrown: Floating IP not found for ID b725b08a-f3bf-4474-bad2-415c18cb3557 Jul 25 14:26:55.220972 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-66121ba5-b591-4f88-a777-2958628b5e19 tempest-FloatingIPsTestJSON-2063215081 tempest-FloatingIPsTestJSON-2063215081-project] Request method failure captured: Jul 25 14:26:55.220972 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/os-floating-ips/b725b08a-f3bf-4474-bad2-415c18cb3557 HTTP/1.1 Jul 25 14:26:55.220972 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:26:55.220972 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:26:55.220972 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:26:55.220972 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:26:55.220972 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:26:55.220972 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:26:55.220972 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:26:55.220972 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:55.220972 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qgkKmYRsupIZhhAPmhMZr5p0SIngVtj9BkgLwPMAWpcepB5TA2X2H_1X0mtoACuI4xzLFa8HzNnO6jlmOLnZkUco8xwydSCoOviURbY_yyUL1UjRp91zpAQs5KzBOxYSm1NFF4lLFoz7KfF2uu2xNBJGrzv4V8ssIGi0ggWoREOAK4 Jul 25 14:26:55.220972 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:26:55.220972 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:26:55.220972 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:26:55.220972 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:26:55.220972 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:26:55.220972 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:26:55.220972 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: b60e26add4254da48e50833c33a1177c Jul 25 14:26:55.220972 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-FloatingIPsTestJSON-2063215081 Jul 25 14:26:55.220972 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:26:55.220972 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:26:55.222676 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b60e26add4254da48e50833c33a1177c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b60e26add4254da48e50833c33a1177c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b60e26add4254da48e50833c33a1177c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b60e26add4254da48e50833c33a1177c"}]}] Jul 25 14:26:55.222676 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-FloatingIPsTestJSON-2063215081 Jul 25 14:26:55.222676 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: b60e26add4254da48e50833c33a1177c Jul 25 14:26:55.222676 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-FloatingIPsTestJSON-2063215081 Jul 25 14:26:55.222676 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-FloatingIPsTestJSON-2063215081-project Jul 25 14:26:55.222676 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:26:55.222676 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:26:55.222676 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: b6a569557c5e419681a05ae86c28a963 Jul 25 14:26:55.222676 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-FloatingIPsTestJSON-2063215081-project Jul 25 14:26:55.222676 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:26:55.222676 n-d-846435-14 devstack@n-api.service[119303]: exception: Floating IP not found for ID b725b08a-f3bf-4474-bad2-415c18cb3557 Jul 25 14:26:55.222676 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'b725b08a-f3bf-4474-bad2-415c18cb3557'} Jul 25 14:26:55.222676 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:55.223743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:55.223743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 25 14:26:55.223743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 25 14:26:55.223743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:26:55.223743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:26:55.223743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 25 14:26:55.223743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 25 14:26:55.223743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:26:55.223743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:26:55.223743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 14:26:55.223743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 14:26:55.223743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:26:55.223743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:26:55.223743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 14:26:55.223743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 14:26:55.223743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:26:55.223743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:26:55.223743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 14:26:55.223743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 14:26:55.224886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:26:55.224886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:26:55.224886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 14:26:55.224886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 14:26:55.224886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 14:26:55.224886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 14:26:55.224886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP b725b08a-f3bf-4474-bad2-415c18cb3557 could not be found Jul 25 14:26:55.224886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-41e35859-865b-472f-8bba-89faaff53d31'] Jul 25 14:26:55.224886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:55.224886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:55.224886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:55.224886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:55.224886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 25 14:26:55.224886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 25 14:26:55.224886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 25 14:26:55.224886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 25 14:26:55.224886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID b725b08a-f3bf-4474-bad2-415c18cb3557. Jul 25 14:26:55.224886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:55.224886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:55.224886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:55.226310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:55.226310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:55.226310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:55.226310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:55.226310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:55.226310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:26:55.226310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:26:55.226310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:55.226310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:55.226310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 25 14:26:55.226310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 14:26:55.226310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID b725b08a-f3bf-4474-bad2-415c18cb3557 Jul 25 14:26:55.226310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:55.226310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:55.226310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:55.226310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:55.226310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:55.226310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:55.226310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:26:55.226310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:26:55.227700 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID b725b08a-f3bf-4474-bad2-415c18cb3557 Jul 25 14:26:55.227700 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:55.227700 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-66121ba5-b591-4f88-a777-2958628b5e19 tempest-FloatingIPsTestJSON-2063215081 tempest-FloatingIPsTestJSON-2063215081-project] Returning 404 to user: Floating IP not found for ID b725b08a-f3bf-4474-bad2-415c18cb3557 {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:55.227700 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-66121ba5-b591-4f88-a777-2958628b5e19 tempest-FloatingIPsTestJSON-2063215081 tempest-FloatingIPsTestJSON-2063215081-project] 10.222.0.88 "DELETE /compute/v2.1/os-floating-ips/b725b08a-f3bf-4474-bad2-415c18cb3557" status: 404 len: 111 microversion: 2.1 time: 0.069971 Jul 25 14:26:55.227700 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 234/496] 10.222.0.88 () {58 vars in 1263 bytes} [Mon Jul 25 14:26:55 2022] DELETE /compute/v2.1/os-floating-ips/b725b08a-f3bf-4474-bad2-415c18cb3557 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:26:55.235532 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a680e715-8b74-40b8-9538-62adfd91a906 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:55.239528 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a680e715-8b74-40b8-9538-62adfd91a906 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:55.249643 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a680e715-8b74-40b8-9538-62adfd91a906 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:55.250333 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a680e715-8b74-40b8-9538-62adfd91a906 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:55.262718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a680e715-8b74-40b8-9538-62adfd91a906 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:55.263180 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a680e715-8b74-40b8-9538-62adfd91a906 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:55.335870 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3bd30720-9c68-4d48-a620-3fdfbc33e721 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:55.348475 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3bd30720-9c68-4d48-a620-3fdfbc33e721 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1" status: 200 len: 1522 microversion: 2.1 time: 0.248886 Jul 25 14:26:55.349590 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 263/497] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:55 2022] GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:55.355127 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-09154777-be0c-48e6-a7f0-2f228a3d6746 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:55.356687 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-09154777-be0c-48e6-a7f0-2f228a3d6746 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 9b76704f-db05-4df8-832a-2f9d30409637] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:55.363807 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09154777-be0c-48e6-a7f0-2f228a3d6746 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:55.365062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09154777-be0c-48e6-a7f0-2f228a3d6746 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:55.366986 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09154777-be0c-48e6-a7f0-2f228a3d6746 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:55.368023 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09154777-be0c-48e6-a7f0-2f228a3d6746 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:55.399290 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-09154777-be0c-48e6-a7f0-2f228a3d6746 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] HTTP exception thrown: Instance 9b76704f-db05-4df8-832a-2f9d30409637 could not be found. Jul 25 14:26:55.401244 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-09154777-be0c-48e6-a7f0-2f228a3d6746 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Request method failure captured: Jul 25 14:26:55.401244 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637 HTTP/1.1 Jul 25 14:26:55.401244 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:26:55.401244 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:26:55.401244 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:26:55.401244 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:26:55.401244 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:26:55.401244 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:26:55.401244 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:26:55.401244 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:55.401244 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfkKVYF8tulhJYxobI4sMNY3mzpHgkPM2lXpcETovKivA9uFectz576sX3ZKXxXrAhs6PwLDD3YKX24eq6m5sccxa2kS8D_PLpt0mt7x8_jh2juqAPUA8rdyUNm7PZioLQXJKZtZS-vslZXRGC30P8bzTEt9vWEmXaF8ORSii-5bdU Jul 25 14:26:55.401244 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:26:55.401244 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:26:55.401244 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:26:55.401244 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:26:55.401244 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:26:55.401244 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:26:55.401244 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 8236bf5c62e6434cbedf22a0e3fba1f4 Jul 25 14:26:55.401244 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-DeleteServersAdminTestJSON-652135158 Jul 25 14:26:55.401244 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:26:55.401244 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:26:55.402499 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8236bf5c62e6434cbedf22a0e3fba1f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8236bf5c62e6434cbedf22a0e3fba1f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8236bf5c62e6434cbedf22a0e3fba1f4", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8236bf5c62e6434cbedf22a0e3fba1f4"}]}] Jul 25 14:26:55.402499 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-DeleteServersAdminTestJSON-652135158 Jul 25 14:26:55.402499 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 8236bf5c62e6434cbedf22a0e3fba1f4 Jul 25 14:26:55.402499 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-652135158 Jul 25 14:26:55.402499 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-DeleteServersAdminTestJSON-652135158-project Jul 25 14:26:55.402499 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:26:55.402499 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:26:55.402499 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: d99a49d2a5254f038c4c1e243f3bac22 Jul 25 14:26:55.402499 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-DeleteServersAdminTestJSON-652135158-project Jul 25 14:26:55.402499 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:26:55.402499 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 9b76704f-db05-4df8-832a-2f9d30409637 could not be found. Jul 25 14:26:55.402499 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '9b76704f-db05-4df8-832a-2f9d30409637'} Jul 25 14:26:55.403292 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:55.403292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:55.403292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:26:55.403292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:26:55.403292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:26:55.403292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:26:55.403292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:26:55.403292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:26:55.403292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:26:55.403292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:26:55.403292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b76704f-db05-4df8-832a-2f9d30409637 could not be found. Jul 25 14:26:55.403292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:55.403292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:55.403292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:55.403292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:55.403292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:55.403292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:55.403292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:55.403292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:55.403292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:55.404485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:55.404485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:26:55.404485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:26:55.404485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:26:55.404485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:26:55.404485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:26:55.404485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:26:55.404485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b76704f-db05-4df8-832a-2f9d30409637 could not be found. Jul 25 14:26:55.404485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:55.404485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:55.404485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:55.404485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:55.404485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:55.404485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:55.404485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:26:55.404485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:26:55.404485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b76704f-db05-4df8-832a-2f9d30409637 could not be found. Jul 25 14:26:55.404485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:55.406799 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a680e715-8b74-40b8-9538-62adfd91a906 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7/action" status: 202 len: 0 microversion: 2.1 time: 0.178890 Jul 25 14:26:55.406799 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 235/498] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:26:55 2022] POST /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:26:55.408146 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-09154777-be0c-48e6-a7f0-2f228a3d6746 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Returning 404 to user: Instance 9b76704f-db05-4df8-832a-2f9d30409637 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:55.409902 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-09154777-be0c-48e6-a7f0-2f228a3d6746 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637" status: 404 len: 111 microversion: 2.1 time: 0.058544 Jul 25 14:26:55.410612 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-520bb2d9-050a-48ae-b980-058bceadf9a9 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:55.411227 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-520bb2d9-050a-48ae-b980-058bceadf9a9 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:55.411597 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 264/499] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:55 2022] GET /compute/v2.1/servers/9b76704f-db05-4df8-832a-2f9d30409637 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:26:55.418117 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-520bb2d9-050a-48ae-b980-058bceadf9a9 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:55.418276 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-520bb2d9-050a-48ae-b980-058bceadf9a9 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:55.418998 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-520bb2d9-050a-48ae-b980-058bceadf9a9 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:55.419457 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-520bb2d9-050a-48ae-b980-058bceadf9a9 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:55.555875 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ee3b4e11-24b0-45da-9c55-a4fc3f34f3cf tempest-InstanceUsageAuditLogTestJSON-835142981 tempest-InstanceUsageAuditLogTestJSON-835142981-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:55.556720 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:55.556720 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:55.576124 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ee3b4e11-24b0-45da-9c55-a4fc3f34f3cf tempest-InstanceUsageAuditLogTestJSON-835142981 tempest-InstanceUsageAuditLogTestJSON-835142981-project-admin] 10.222.0.88 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-25 14:26:55" status: 200 len: 318 microversion: 2.1 time: 0.162010 Jul 25 14:26:55.577117 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 265/500] 10.222.0.88 () {58 vars in 1251 bytes} [Mon Jul 25 14:26:55 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-25%2014%3A26%3A55 => generated 318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:55.582942 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c45aa385-50ca-4487-8418-590036f4ef69 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1502561655", "metadata": {"": ""}}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:55.587831 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c45aa385-50ca-4487-8418-590036f4ef69 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Request method failure captured: Jul 25 14:26:55.587831 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1/action HTTP/1.1 Jul 25 14:26:55.587831 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:26:55.587831 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:26:55.587831 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:26:55.587831 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 107 Jul 25 14:26:55.587831 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:26:55.587831 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:26:55.587831 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:26:55.587831 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:55.587831 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qgcGc2RjkaZaGa63-PPdbCX4s7H2xWtuYRqlF0JWR61IUGzx74RHc-m8TJT-_RdlH0tQcWSd5UK3Q-O0K9ctQCv8954sZsqJWdlZOw1b7jo_qk8Zk2eLIrhbYh_u9wxQIss6t5T5Ti1Es5U9sr0YdlFFb4d-omgDGqaIN2Ib47NRJM Jul 25 14:26:55.587831 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:26:55.587831 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:26:55.587831 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:26:55.587831 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:26:55.587831 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:26:55.587831 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:26:55.587831 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: c0116982ed03475097096c73b5f03035 Jul 25 14:26:55.587831 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:26:55.587831 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:26:55.587831 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:26:55.589185 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0116982ed03475097096c73b5f03035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0116982ed03475097096c73b5f03035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0116982ed03475097096c73b5f03035", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0116982ed03475097096c73b5f03035"}]}] Jul 25 14:26:55.589185 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:26:55.589185 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: c0116982ed03475097096c73b5f03035 Jul 25 14:26:55.589185 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:26:55.589185 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ImagesOneServerNegativeTestJSON-745484288-project Jul 25 14:26:55.589185 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:26:55.589185 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:26:55.589185 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: f1b1656f2dcd4ffebac55bf18110ff63 Jul 25 14:26:55.589185 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-745484288-project Jul 25 14:26:55.589185 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:26:55.589185 n-d-846435-14 devstack@n-api.service[119304]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1502561655", "metadata": {"": ""}}} Jul 25 14:26:55.589185 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:26:55.594472 n-d-846435-14 devstack@n-api.service[119304]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 14:26:55.594472 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '04c1923b-e18a-408f-99b1-62d86feb25a1', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1502561655', 'metadata': {'': ''}}}} Jul 25 14:26:55.594472 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:55.594472 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:55.594472 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:26:55.594472 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:26:55.594472 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:26:55.594472 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:26:55.594472 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 14:26:55.594472 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:55.594472 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 25 14:26:55.594472 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 25 14:26:55.594472 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 25 14:26:55.594472 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 25 14:26:55.594472 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 25 14:26:55.594472 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:55.594472 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 25 14:26:55.594472 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi {'': ''} Jul 25 14:26:55.594472 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:55.594472 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:55.594472 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:55.595683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:55.595683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:55.595683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:55.595683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:55.595683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:55.595683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:55.595683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:55.595683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:26:55.595683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:26:55.595683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:26:55.595683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:26:55.595683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:26:55.595683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:26:55.595683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:26:55.595683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:26:55.595683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 14:26:55.595683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:55.595683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:55.595683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:55.595683 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:55.596841 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:55.596841 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:55.596841 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:26:55.596841 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:26:55.596841 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 14:26:55.596841 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:55.596841 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c45aa385-50ca-4487-8418-590036f4ef69 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:55.596841 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c45aa385-50ca-4487-8418-590036f4ef69 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "POST /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1/action" status: 400 len: 170 microversion: 2.1 time: 0.010976 Jul 25 14:26:55.596841 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 266/501] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 25 14:26:55 2022] POST /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1/action => generated 170 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:26:55.597387 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3b8f802e-8b73-45a1-8142-d95e66e3acc9 tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Action: 'update', calling method: .version_select at 0x7f46879bf700>, body: {"quota_set": {"ram": "2048"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:55.668619 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b8f802e-8b73-45a1-8142-d95e66e3acc9 tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:55.669151 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b8f802e-8b73-45a1-8142-d95e66e3acc9 tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:55.670309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b8f802e-8b73-45a1-8142-d95e66e3acc9 tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:55.670799 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b8f802e-8b73-45a1-8142-d95e66e3acc9 tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:55.706537 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b8f802e-8b73-45a1-8142-d95e66e3acc9 tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:55.707351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b8f802e-8b73-45a1-8142-d95e66e3acc9 tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:55.708394 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b8f802e-8b73-45a1-8142-d95e66e3acc9 tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:55.709073 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b8f802e-8b73-45a1-8142-d95e66e3acc9 tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:55.713201 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-520bb2d9-050a-48ae-b980-058bceadf9a9 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:55.724262 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-520bb2d9-050a-48ae-b980-058bceadf9a9 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1469 microversion: 2.1 time: 0.317710 Jul 25 14:26:55.725100 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 236/502] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:55 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1469 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:55.730060 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-502e93bf-4b84-4217-8e02-7034b49aa334 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:55.733028 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-502e93bf-4b84-4217-8e02-7034b49aa334 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:55.739455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-502e93bf-4b84-4217-8e02-7034b49aa334 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:55.740144 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-502e93bf-4b84-4217-8e02-7034b49aa334 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:55.741083 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-502e93bf-4b84-4217-8e02-7034b49aa334 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:55.741658 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-502e93bf-4b84-4217-8e02-7034b49aa334 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:55.781739 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3b8f802e-8b73-45a1-8142-d95e66e3acc9 tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-sets/de9185ab9f4c4a04a17b15407d8991e0?user_id=fbcb662a7c9c45d5839a0195e05ca931" status: 200 len: 328 microversion: 2.1 time: 0.189701 Jul 25 14:26:55.788648 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 267/503] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Jul 25 14:26:55 2022] PUT /compute/v2.1/os-quota-sets/de9185ab9f4c4a04a17b15407d8991e0?user_id=fbcb662a7c9c45d5839a0195e05ca931 => generated 328 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:55.788648 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bc561ddb-f0fa-4ccc-a5ca-54915b673976 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:55.788648 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bc561ddb-f0fa-4ccc-a5ca-54915b673976 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 0a711946-8ed7-4475-a873-944011be17d6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:55.795535 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bc561ddb-f0fa-4ccc-a5ca-54915b673976 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:55.796128 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bc561ddb-f0fa-4ccc-a5ca-54915b673976 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:55.796987 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bc561ddb-f0fa-4ccc-a5ca-54915b673976 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:55.797582 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bc561ddb-f0fa-4ccc-a5ca-54915b673976 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:55.813611 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-bc561ddb-f0fa-4ccc-a5ca-54915b673976 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] HTTP exception thrown: Instance 0a711946-8ed7-4475-a873-944011be17d6 could not be found. Jul 25 14:26:55.817411 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bc561ddb-f0fa-4ccc-a5ca-54915b673976 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Request method failure captured: Jul 25 14:26:55.817411 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6 HTTP/1.1 Jul 25 14:26:55.817411 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:26:55.817411 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:26:55.817411 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:26:55.817411 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:26:55.817411 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:26:55.817411 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:26:55.817411 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:26:55.817411 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:55.817411 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfkKVYF8tulhJYxobI4sMNY3mzpHgkPM2lXpcETovKivA9uFectz576sX3ZKXxXrAhs6PwLDD3YKX24eq6m5sccxa2kS8D_PLpt0mt7x8_jh2juqAPUA8rdyUNm7PZioLQXJKZtZS-vslZXRGC30P8bzTEt9vWEmXaF8ORSii-5bdU Jul 25 14:26:55.817411 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:26:55.817411 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:26:55.817411 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:26:55.817411 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:26:55.817411 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:26:55.817411 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:26:55.817411 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 8236bf5c62e6434cbedf22a0e3fba1f4 Jul 25 14:26:55.817411 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-DeleteServersAdminTestJSON-652135158 Jul 25 14:26:55.817411 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:26:55.817411 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:26:55.818653 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8236bf5c62e6434cbedf22a0e3fba1f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8236bf5c62e6434cbedf22a0e3fba1f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8236bf5c62e6434cbedf22a0e3fba1f4", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8236bf5c62e6434cbedf22a0e3fba1f4"}]}] Jul 25 14:26:55.818653 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-DeleteServersAdminTestJSON-652135158 Jul 25 14:26:55.818653 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 8236bf5c62e6434cbedf22a0e3fba1f4 Jul 25 14:26:55.818653 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-652135158 Jul 25 14:26:55.818653 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-DeleteServersAdminTestJSON-652135158-project Jul 25 14:26:55.818653 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:26:55.818653 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:26:55.818653 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: d99a49d2a5254f038c4c1e243f3bac22 Jul 25 14:26:55.818653 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-DeleteServersAdminTestJSON-652135158-project Jul 25 14:26:55.818653 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:26:55.818653 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 0a711946-8ed7-4475-a873-944011be17d6 could not be found. Jul 25 14:26:55.818653 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '0a711946-8ed7-4475-a873-944011be17d6'} Jul 25 14:26:55.819368 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:55.819368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:55.819368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:26:55.819368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:26:55.819368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:26:55.819368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:26:55.819368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:26:55.819368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:26:55.819368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:26:55.819368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:26:55.819368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a711946-8ed7-4475-a873-944011be17d6 could not be found. Jul 25 14:26:55.819368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:55.819368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:55.819368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:55.819368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:55.819368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:55.819368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:55.819368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:55.819368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:55.819368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:55.821134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:55.821134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:26:55.821134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:26:55.821134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:26:55.821134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:26:55.821134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:26:55.821134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:26:55.821134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:26:55.821134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:26:55.821134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a711946-8ed7-4475-a873-944011be17d6 could not be found. Jul 25 14:26:55.821134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:55.821134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:55.821134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:55.821134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:55.821134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:55.821134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:55.821134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:26:55.821134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:26:55.821134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a711946-8ed7-4475-a873-944011be17d6 could not be found. Jul 25 14:26:55.821134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:55.822777 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bc561ddb-f0fa-4ccc-a5ca-54915b673976 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Returning 404 to user: Instance 0a711946-8ed7-4475-a873-944011be17d6 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:55.822777 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bc561ddb-f0fa-4ccc-a5ca-54915b673976 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "DELETE /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6" status: 404 len: 111 microversion: 2.1 time: 0.034987 Jul 25 14:26:55.822777 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 268/504] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:26:55 2022] DELETE /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:26:55.828122 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c37ef885-13f2-4761-b704-ff60e9c98b9f tempest-InstanceUsageAuditLogTestJSON-835142981 tempest-InstanceUsageAuditLogTestJSON-835142981-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:55.829116 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:26:55.829116 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:26:55.837195 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-502e93bf-4b84-4217-8e02-7034b49aa334 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:26:55.837787 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-502e93bf-4b84-4217-8e02-7034b49aa334 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:26:55.838418 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-502e93bf-4b84-4217-8e02-7034b49aa334 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:26:55.838967 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-502e93bf-4b84-4217-8e02-7034b49aa334 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:26:55.839527 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-502e93bf-4b84-4217-8e02-7034b49aa334 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:26:55.844554 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c37ef885-13f2-4761-b704-ff60e9c98b9f tempest-InstanceUsageAuditLogTestJSON-835142981 tempest-InstanceUsageAuditLogTestJSON-835142981-project-admin] 10.222.0.88 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.021141 Jul 25 14:26:55.845459 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 269/505] 10.222.0.88 () {58 vars in 1185 bytes} [Mon Jul 25 14:26:55 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:55.857257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-64f277a7-9d3c-47ec-81e7-fb8d57922c9d tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:55.858054 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-64f277a7-9d3c-47ec-81e7-fb8d57922c9d tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 04c1923b-e18a-408f-99b1-62d86feb25a1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:55.867025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-64f277a7-9d3c-47ec-81e7-fb8d57922c9d tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:55.867800 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-64f277a7-9d3c-47ec-81e7-fb8d57922c9d tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:55.869210 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-64f277a7-9d3c-47ec-81e7-fb8d57922c9d tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:55.871049 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-64f277a7-9d3c-47ec-81e7-fb8d57922c9d tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:55.960332 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-502e93bf-4b84-4217-8e02-7034b49aa334 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:55.975718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-502e93bf-4b84-4217-8e02-7034b49aa334 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:55.977828 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-502e93bf-4b84-4217-8e02-7034b49aa334 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:55.979111 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-502e93bf-4b84-4217-8e02-7034b49aa334 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:55.980400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-502e93bf-4b84-4217-8e02-7034b49aa334 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:56.021015 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-502e93bf-4b84-4217-8e02-7034b49aa334 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "POST /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7/action" status: 202 len: 1067 microversion: 2.1 time: 0.294444 Jul 25 14:26:56.022678 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 237/506] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:26:55 2022] POST /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7/action => generated 1067 bytes in 297 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 14:26:56.042178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3c7f9b53-2d0a-44e6-8f90-c6413fce0aa3 tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Calling method '.version_select at 0x7f468794ed30>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:56.152544 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-64f277a7-9d3c-47ec-81e7-fb8d57922c9d tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:56.176877 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-64f277a7-9d3c-47ec-81e7-fb8d57922c9d tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1" status: 200 len: 1522 microversion: 2.1 time: 0.323250 Jul 25 14:26:56.192952 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 270/507] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:55 2022] GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1 => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:56.196717 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3c7f9b53-2d0a-44e6-8f90-c6413fce0aa3 tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/de9185ab9f4c4a04a17b15407d8991e0?user_id=fbcb662a7c9c45d5839a0195e05ca931" status: 200 len: 370 microversion: 2.1 time: 0.171937 Jul 25 14:26:56.198509 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 238/508] 10.222.0.88 () {58 vars in 1323 bytes} [Mon Jul 25 14:26:56 2022] GET /compute/v2.1/os-quota-sets/de9185ab9f4c4a04a17b15407d8991e0?user_id=fbcb662a7c9c45d5839a0195e05ca931 => generated 370 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:56.211015 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7c927964-b9a5-4dce-92ad-a430a53850e6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:56.212027 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7c927964-b9a5-4dce-92ad-a430a53850e6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] [instance: 0a711946-8ed7-4475-a873-944011be17d6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:56.226791 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a055030a-3b22-485a-9769-eef672f0f1c8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:56.227938 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a055030a-3b22-485a-9769-eef672f0f1c8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:56.230926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7c927964-b9a5-4dce-92ad-a430a53850e6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:56.231750 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7c927964-b9a5-4dce-92ad-a430a53850e6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:56.233029 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7c927964-b9a5-4dce-92ad-a430a53850e6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:56.236160 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7c927964-b9a5-4dce-92ad-a430a53850e6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:56.242349 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a055030a-3b22-485a-9769-eef672f0f1c8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:56.243003 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a055030a-3b22-485a-9769-eef672f0f1c8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:56.245530 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a055030a-3b22-485a-9769-eef672f0f1c8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:56.247494 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a055030a-3b22-485a-9769-eef672f0f1c8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:56.261687 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-7c927964-b9a5-4dce-92ad-a430a53850e6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] HTTP exception thrown: Instance 0a711946-8ed7-4475-a873-944011be17d6 could not be found. Jul 25 14:26:56.269175 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7c927964-b9a5-4dce-92ad-a430a53850e6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Request method failure captured: Jul 25 14:26:56.269175 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6 HTTP/1.1 Jul 25 14:26:56.269175 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:26:56.269175 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:26:56.269175 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:26:56.269175 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:26:56.269175 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:26:56.269175 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:26:56.269175 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:26:56.269175 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:56.269175 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfkKVYF8tulhJYxobI4sMNY3mzpHgkPM2lXpcETovKivA9uFectz576sX3ZKXxXrAhs6PwLDD3YKX24eq6m5sccxa2kS8D_PLpt0mt7x8_jh2juqAPUA8rdyUNm7PZioLQXJKZtZS-vslZXRGC30P8bzTEt9vWEmXaF8ORSii-5bdU Jul 25 14:26:56.269175 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:26:56.269175 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:26:56.269175 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:26:56.269175 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:26:56.269175 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:26:56.269175 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:26:56.269175 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 8236bf5c62e6434cbedf22a0e3fba1f4 Jul 25 14:26:56.269175 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-DeleteServersAdminTestJSON-652135158 Jul 25 14:26:56.269175 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:26:56.269175 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:26:56.270673 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8236bf5c62e6434cbedf22a0e3fba1f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8236bf5c62e6434cbedf22a0e3fba1f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8236bf5c62e6434cbedf22a0e3fba1f4", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8236bf5c62e6434cbedf22a0e3fba1f4"}]}] Jul 25 14:26:56.270673 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-DeleteServersAdminTestJSON-652135158 Jul 25 14:26:56.270673 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 8236bf5c62e6434cbedf22a0e3fba1f4 Jul 25 14:26:56.270673 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-652135158 Jul 25 14:26:56.270673 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-DeleteServersAdminTestJSON-652135158-project Jul 25 14:26:56.270673 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:26:56.270673 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:26:56.270673 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: d99a49d2a5254f038c4c1e243f3bac22 Jul 25 14:26:56.270673 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-DeleteServersAdminTestJSON-652135158-project Jul 25 14:26:56.270673 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:26:56.270673 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 0a711946-8ed7-4475-a873-944011be17d6 could not be found. Jul 25 14:26:56.270673 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '0a711946-8ed7-4475-a873-944011be17d6'} Jul 25 14:26:56.271475 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:56.271475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:56.271475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:26:56.271475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:26:56.271475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:26:56.271475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:26:56.271475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:26:56.271475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:26:56.271475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:26:56.271475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:26:56.271475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a711946-8ed7-4475-a873-944011be17d6 could not be found. Jul 25 14:26:56.271475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:56.271475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:56.271475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:56.271475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:56.271475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:56.271475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:56.271475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:56.271475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:56.271475 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:56.272795 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:56.272795 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:26:56.272795 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:26:56.272795 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:26:56.272795 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:26:56.272795 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:26:56.272795 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:26:56.272795 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a711946-8ed7-4475-a873-944011be17d6 could not be found. Jul 25 14:26:56.272795 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:56.272795 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:56.272795 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:56.272795 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:56.272795 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:56.272795 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:56.272795 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:26:56.272795 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:26:56.272795 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a711946-8ed7-4475-a873-944011be17d6 could not be found. Jul 25 14:26:56.272795 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:56.276673 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7c927964-b9a5-4dce-92ad-a430a53850e6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] Returning 404 to user: Instance 0a711946-8ed7-4475-a873-944011be17d6 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:56.277685 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7c927964-b9a5-4dce-92ad-a430a53850e6 tempest-DeleteServersAdminTestJSON-652135158 tempest-DeleteServersAdminTestJSON-652135158-project] 10.222.0.88 "GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6" status: 404 len: 111 microversion: 2.1 time: 0.084288 Jul 25 14:26:56.283244 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 271/509] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:56 2022] GET /compute/v2.1/servers/0a711946-8ed7-4475-a873-944011be17d6 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:26:56.290823 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4f8a9230-a00e-45d2-9531-6b33ee9a27e3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:56.295719 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4f8a9230-a00e-45d2-9531-6b33ee9a27e3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 04c1923b-e18a-408f-99b1-62d86feb25a1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:56.311222 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4f8a9230-a00e-45d2-9531-6b33ee9a27e3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:56.312197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4f8a9230-a00e-45d2-9531-6b33ee9a27e3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:56.313140 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4f8a9230-a00e-45d2-9531-6b33ee9a27e3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:56.313711 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4f8a9230-a00e-45d2-9531-6b33ee9a27e3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:56.547130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4f8a9230-a00e-45d2-9531-6b33ee9a27e3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:56.558200 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4f8a9230-a00e-45d2-9531-6b33ee9a27e3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1" status: 200 len: 1522 microversion: 2.1 time: 0.273619 Jul 25 14:26:56.569176 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 272/510] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:56 2022] GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:56.578988 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-62752370-f5db-496d-bc44-3ba1e2458752 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2110091687", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:56.583684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-62752370-f5db-496d-bc44-3ba1e2458752 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Request method failure captured: Jul 25 14:26:56.583684 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1/action HTTP/1.1 Jul 25 14:26:56.583684 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:26:56.583684 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:26:56.583684 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:26:56.583684 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 619 Jul 25 14:26:56.583684 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:26:56.583684 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:26:56.583684 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:26:56.583684 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:56.583684 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qgcGc2RjkaZaGa63-PPdbCX4s7H2xWtuYRqlF0JWR61IUGzx74RHc-m8TJT-_RdlH0tQcWSd5UK3Q-O0K9ctQCv8954sZsqJWdlZOw1b7jo_qk8Zk2eLIrhbYh_u9wxQIss6t5T5Ti1Es5U9sr0YdlFFb4d-omgDGqaIN2Ib47NRJM Jul 25 14:26:56.583684 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:26:56.583684 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:26:56.583684 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:26:56.583684 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:26:56.583684 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:26:56.583684 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:26:56.583684 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: c0116982ed03475097096c73b5f03035 Jul 25 14:26:56.583684 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:26:56.583684 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:26:56.583684 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:26:56.585160 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0116982ed03475097096c73b5f03035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0116982ed03475097096c73b5f03035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0116982ed03475097096c73b5f03035", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0116982ed03475097096c73b5f03035"}]}] Jul 25 14:26:56.585160 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:26:56.585160 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: c0116982ed03475097096c73b5f03035 Jul 25 14:26:56.585160 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:26:56.585160 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ImagesOneServerNegativeTestJSON-745484288-project Jul 25 14:26:56.585160 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:26:56.585160 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:26:56.585160 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: f1b1656f2dcd4ffebac55bf18110ff63 Jul 25 14:26:56.585160 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-745484288-project Jul 25 14:26:56.585160 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:26:56.585826 n-d-846435-14 devstack@n-api.service[119304]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2110091687", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jul 25 14:26:56.585826 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:26:56.585826 n-d-846435-14 devstack@n-api.service[119304]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 14:26:56.586049 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '04c1923b-e18a-408f-99b1-62d86feb25a1', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2110091687', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jul 25 14:26:56.586049 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:56.586049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:56.586049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:26:56.586049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:26:56.586049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:26:56.586049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:26:56.586049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 14:26:56.586049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:56.586049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 25 14:26:56.586049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 25 14:26:56.586676 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 25 14:26:56.586676 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 25 14:26:56.586676 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 25 14:26:56.586676 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:56.586676 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 25 14:26:56.586676 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jul 25 14:26:56.586676 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:56.586676 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:56.586676 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:56.586676 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:56.586676 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:56.586676 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:56.586676 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:56.586676 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:56.586676 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:56.586676 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:56.586676 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:26:56.587676 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:26:56.587676 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:26:56.587676 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:26:56.587676 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:26:56.587676 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:26:56.587676 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:26:56.587676 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:26:56.587676 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 14:26:56.587676 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:56.587676 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:56.587676 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:56.587676 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:56.588393 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:56.588393 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:56.588393 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:26:56.588393 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:26:56.588393 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 14:26:56.588393 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:26:56.589831 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-62752370-f5db-496d-bc44-3ba1e2458752 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:56.591008 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-62752370-f5db-496d-bc44-3ba1e2458752 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "POST /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1/action" status: 400 len: 938 microversion: 2.1 time: 0.016638 Jul 25 14:26:56.596360 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 273/511] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 25 14:26:56 2022] POST /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1/action => generated 938 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 14:26:56.601572 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b0826d26-4001-44ce-96fd-15a53cdbaf78 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:56.602654 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b0826d26-4001-44ce-96fd-15a53cdbaf78 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 04c1923b-e18a-408f-99b1-62d86feb25a1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:56.610539 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0826d26-4001-44ce-96fd-15a53cdbaf78 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:56.611256 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0826d26-4001-44ce-96fd-15a53cdbaf78 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:56.612589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0826d26-4001-44ce-96fd-15a53cdbaf78 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:56.613404 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0826d26-4001-44ce-96fd-15a53cdbaf78 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:56.625366 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a055030a-3b22-485a-9769-eef672f0f1c8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:56.637296 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a055030a-3b22-485a-9769-eef672f0f1c8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1471 microversion: 2.1 time: 0.435667 Jul 25 14:26:56.638858 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 239/512] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:56 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1471 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:56.747369 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4ce0952a-9311-4a43-8e10-33e3e24631a6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:56.748037 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4ce0952a-9311-4a43-8e10-33e3e24631a6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:56.763832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4ce0952a-9311-4a43-8e10-33e3e24631a6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:56.764488 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4ce0952a-9311-4a43-8e10-33e3e24631a6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:56.765432 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4ce0952a-9311-4a43-8e10-33e3e24631a6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:56.766019 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4ce0952a-9311-4a43-8e10-33e3e24631a6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:56.832089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b0826d26-4001-44ce-96fd-15a53cdbaf78 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:56.846921 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b0826d26-4001-44ce-96fd-15a53cdbaf78 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1" status: 200 len: 1522 microversion: 2.1 time: 0.248945 Jul 25 14:26:56.860065 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 274/513] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:56 2022] GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:56.869949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f7c55c5b-6456-45eb-9401-95a7e44ca8e9 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:56.870634 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f7c55c5b-6456-45eb-9401-95a7e44ca8e9 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 04c1923b-e18a-408f-99b1-62d86feb25a1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:56.882158 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f7c55c5b-6456-45eb-9401-95a7e44ca8e9 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:56.882626 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f7c55c5b-6456-45eb-9401-95a7e44ca8e9 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:56.883426 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f7c55c5b-6456-45eb-9401-95a7e44ca8e9 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:56.883894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f7c55c5b-6456-45eb-9401-95a7e44ca8e9 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:57.034617 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4ce0952a-9311-4a43-8e10-33e3e24631a6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:57.044249 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4ce0952a-9311-4a43-8e10-33e3e24631a6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1469 microversion: 2.1 time: 0.303458 Jul 25 14:26:57.045689 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 240/514] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:56 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1469 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:57.152807 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f7c55c5b-6456-45eb-9401-95a7e44ca8e9 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:57.163389 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f7c55c5b-6456-45eb-9401-95a7e44ca8e9 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1" status: 200 len: 1522 microversion: 2.1 time: 0.297545 Jul 25 14:26:57.164094 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 275/515] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:56 2022] GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:26:57.189685 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2fbc767c-a330-4998-a662-3b03511326ce tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:57.194219 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2fbc767c-a330-4998-a662-3b03511326ce tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Request method failure captured: Jul 25 14:26:57.194219 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1/action HTTP/1.1 Jul 25 14:26:57.194219 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:26:57.194219 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:26:57.194219 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:26:57.194219 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 285 Jul 25 14:26:57.194219 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:26:57.194219 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:26:57.194219 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:26:57.194219 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:26:57.194219 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qgcGc2RjkaZaGa63-PPdbCX4s7H2xWtuYRqlF0JWR61IUGzx74RHc-m8TJT-_RdlH0tQcWSd5UK3Q-O0K9ctQCv8954sZsqJWdlZOw1b7jo_qk8Zk2eLIrhbYh_u9wxQIss6t5T5Ti1Es5U9sr0YdlFFb4d-omgDGqaIN2Ib47NRJM Jul 25 14:26:57.194219 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:26:57.194219 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:26:57.194219 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:26:57.194219 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:26:57.194219 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:26:57.194219 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:26:57.194219 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: c0116982ed03475097096c73b5f03035 Jul 25 14:26:57.194219 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:26:57.194219 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:26:57.194219 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:26:57.195959 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0116982ed03475097096c73b5f03035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0116982ed03475097096c73b5f03035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0116982ed03475097096c73b5f03035", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0116982ed03475097096c73b5f03035"}]}] Jul 25 14:26:57.195959 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:26:57.195959 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: c0116982ed03475097096c73b5f03035 Jul 25 14:26:57.195959 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:26:57.195959 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ImagesOneServerNegativeTestJSON-745484288-project Jul 25 14:26:57.195959 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:26:57.195959 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:26:57.195959 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: f1b1656f2dcd4ffebac55bf18110ff63 Jul 25 14:26:57.195959 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-745484288-project Jul 25 14:26:57.195959 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:26:57.195959 n-d-846435-14 devstack@n-api.service[119303]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 25 14:26:57.196635 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:26:57.196635 n-d-846435-14 devstack@n-api.service[119303]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 14:26:57.196635 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '04c1923b-e18a-408f-99b1-62d86feb25a1', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 25 14:26:57.196635 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:26:57.196635 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:57.196635 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:26:57.196635 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:26:57.196635 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:26:57.196635 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:26:57.196635 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 14:26:57.197680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:57.197680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jul 25 14:26:57.197680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 14:26:57.197680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:57.197680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 25 14:26:57.197680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 25 14:26:57.197680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:57.197680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:57.197680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:57.197680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:57.197680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:57.197680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:57.197680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:26:57.197680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:26:57.197680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:26:57.197680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:26:57.197680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:26:57.197680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:26:57.197680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:26:57.197680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:26:57.199320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:26:57.199320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:26:57.199320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:26:57.199320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:26:57.199320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 14:26:57.199320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:57.199320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:26:57.199320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:57.199320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:26:57.199320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:26:57.199320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:26:57.199320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:26:57.199320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:26:57.201209 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 14:26:57.201209 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:26:57.202563 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2fbc767c-a330-4998-a662-3b03511326ce tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:26:57.204274 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2fbc767c-a330-4998-a662-3b03511326ce tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "POST /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1/action" status: 400 len: 619 microversion: 2.1 time: 0.020619 Jul 25 14:26:57.209109 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 241/516] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 25 14:26:57 2022] POST /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1/action => generated 619 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:26:57.220774 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-75a81838-8bc2-49d9-a3a2-faf8ff15a566 tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Calling method '.version_select at 0x7f46879b4b80>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:57.241283 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e3b6d438-0514-486b-8524-a0dbd8d73be6 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:57.242093 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e3b6d438-0514-486b-8524-a0dbd8d73be6 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 04c1923b-e18a-408f-99b1-62d86feb25a1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:57.263045 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3b6d438-0514-486b-8524-a0dbd8d73be6 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:57.274144 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3b6d438-0514-486b-8524-a0dbd8d73be6 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:57.281236 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3b6d438-0514-486b-8524-a0dbd8d73be6 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:57.283208 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3b6d438-0514-486b-8524-a0dbd8d73be6 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:57.615426 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-75a81838-8bc2-49d9-a3a2-faf8ff15a566 tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/1c4cdc1479974f16950fdd78ba052296/defaults" status: 200 len: 371 microversion: 2.1 time: 0.398637 Jul 25 14:26:57.616772 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 276/517] 10.222.0.88 () {58 vars in 1269 bytes} [Mon Jul 25 14:26:57 2022] GET /compute/v2.1/os-quota-sets/1c4cdc1479974f16950fdd78ba052296/defaults => generated 371 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:57.627878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-13a8534b-5b74-497e-affb-341ec3f66f38 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:57.628801 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-13a8534b-5b74-497e-affb-341ec3f66f38 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:57.643928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-13a8534b-5b74-497e-affb-341ec3f66f38 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:57.646832 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-13a8534b-5b74-497e-affb-341ec3f66f38 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:57.647811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-13a8534b-5b74-497e-affb-341ec3f66f38 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:57.650589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-13a8534b-5b74-497e-affb-341ec3f66f38 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:57.725363 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-13a8534b-5b74-497e-affb-341ec3f66f38 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:26:57.744414 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:57.760732 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e3b6d438-0514-486b-8524-a0dbd8d73be6 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:57.771259 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e3b6d438-0514-486b-8524-a0dbd8d73be6 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1" status: 200 len: 1522 microversion: 2.1 time: 0.546054 Jul 25 14:26:57.773930 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 242/518] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:57 2022] GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1 => generated 1522 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:57.779320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c0179763-33df-4598-9930-53084505985c tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Action: 'update', calling method: .version_select at 0x7f4687c2f8b0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:57.858182 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-13a8534b-5b74-497e-affb-341ec3f66f38 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "DELETE /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5" status: 204 len: 0 microversion: 2.1 time: 0.239426 Jul 25 14:26:57.859243 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 277/519] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:26:57 2022] DELETE /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:26:57.866278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b0158478-e3c7-40ee-95cb-db607e00c8b8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:57.867288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b0158478-e3c7-40ee-95cb-db607e00c8b8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:57.876082 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0158478-e3c7-40ee-95cb-db607e00c8b8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:57.877040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0158478-e3c7-40ee-95cb-db607e00c8b8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:57.883019 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0158478-e3c7-40ee-95cb-db607e00c8b8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:57.883918 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0158478-e3c7-40ee-95cb-db607e00c8b8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:58.048328 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c0179763-33df-4598-9930-53084505985c tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:58.049695 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c0179763-33df-4598-9930-53084505985c tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:58.051059 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c0179763-33df-4598-9930-53084505985c tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:58.051750 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c0179763-33df-4598-9930-53084505985c tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:58.122561 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b0158478-e3c7-40ee-95cb-db607e00c8b8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:58.131900 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b0158478-e3c7-40ee-95cb-db607e00c8b8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1471 microversion: 2.1 time: 0.270439 Jul 25 14:26:58.134685 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 278/520] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:57 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1471 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:58.164305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-449402a4-0183-4405-8ce0-898fa3160ae0 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:58.168758 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-449402a4-0183-4405-8ce0-898fa3160ae0 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 04c1923b-e18a-408f-99b1-62d86feb25a1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:58.181851 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-449402a4-0183-4405-8ce0-898fa3160ae0 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:58.192633 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-449402a4-0183-4405-8ce0-898fa3160ae0 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:58.193634 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-449402a4-0183-4405-8ce0-898fa3160ae0 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:58.194170 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-449402a4-0183-4405-8ce0-898fa3160ae0 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:58.329098 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=2,nova_api:INSERT=11 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:26:58.431592 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c0179763-33df-4598-9930-53084505985c tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-sets/1c4cdc1479974f16950fdd78ba052296" status: 200 len: 329 microversion: 2.1 time: 0.656102 Jul 25 14:26:58.432266 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 243/521] 10.222.0.88 () {60 vars in 1263 bytes} [Mon Jul 25 14:26:57 2022] PUT /compute/v2.1/os-quota-sets/1c4cdc1479974f16950fdd78ba052296 => generated 329 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:26:58.437008 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8240683f-ac7e-4cdf-a60a-01cf36b92043 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:26:58.437719 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8240683f-ac7e-4cdf-a60a-01cf36b92043 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:58.458929 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8240683f-ac7e-4cdf-a60a-01cf36b92043 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:58.459392 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8240683f-ac7e-4cdf-a60a-01cf36b92043 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:58.460226 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8240683f-ac7e-4cdf-a60a-01cf36b92043 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:58.463274 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8240683f-ac7e-4cdf-a60a-01cf36b92043 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:58.499724 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-449402a4-0183-4405-8ce0-898fa3160ae0 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:58.519145 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-449402a4-0183-4405-8ce0-898fa3160ae0 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1" status: 200 len: 1522 microversion: 2.1 time: 0.381769 Jul 25 14:26:58.522243 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 279/522] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:58 2022] GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1 => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:58.534893 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ab6290f3-1e5a-4a84-af1f-4b34537ecd52 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1188774497", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "897650779", "adminPass": "***", "networks": [{"uuid": "47b59bfd-bdf0-453c-b442-6e1a450f2229"}], "security_groups": [{"name": "tempest-securitygroup--1215900045"}], "key_name": "tempest-keypair-999429076", "user_data": "}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:58.721423 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-ab6290f3-1e5a-4a84-af1f-4b34537ecd52 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] validate_networks() for [('47b59bfd-bdf0-453c-b442-6e1a450f2229', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:26:58.789242 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8240683f-ac7e-4cdf-a60a-01cf36b92043 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:26:58.800266 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8240683f-ac7e-4cdf-a60a-01cf36b92043 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1469 microversion: 2.1 time: 0.365587 Jul 25 14:26:58.803132 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 244/523] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:26:58 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1469 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:26:58.814931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-da37e4a3-6899-4c11-acac-3985bb357388 tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Action: 'update', calling method: .version_select at 0x7f4687938f70>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:59.346515 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-ab6290f3-1e5a-4a84-af1f-4b34537ecd52 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:26:59.347482 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-ab6290f3-1e5a-4a84-af1f-4b34537ecd52 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:26:59.348202 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-ab6290f3-1e5a-4a84-af1f-4b34537ecd52 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:26:59.348757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-ab6290f3-1e5a-4a84-af1f-4b34537ecd52 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:26:59.349344 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-ab6290f3-1e5a-4a84-af1f-4b34537ecd52 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:26:59.360065 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da37e4a3-6899-4c11-acac-3985bb357388 tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:59.360899 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da37e4a3-6899-4c11-acac-3985bb357388 tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:59.361846 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ab6290f3-1e5a-4a84-af1f-4b34537ecd52 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:59.362727 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ab6290f3-1e5a-4a84-af1f-4b34537ecd52 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:59.363722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ab6290f3-1e5a-4a84-af1f-4b34537ecd52 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:59.364455 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ab6290f3-1e5a-4a84-af1f-4b34537ecd52 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:59.368686 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da37e4a3-6899-4c11-acac-3985bb357388 tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:59.369136 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da37e4a3-6899-4c11-acac-3985bb357388 tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:59.397262 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-ab6290f3-1e5a-4a84-af1f-4b34537ecd52 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Getting quotas for project 508d55290b2744998f48e37d5af6dd04. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:26:59.404022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-ab6290f3-1e5a-4a84-af1f-4b34537ecd52 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Getting quotas for user aec61e9c63c043f49c26eb8220cb67bb and project 508d55290b2744998f48e37d5af6dd04. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:26:59.432525 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ab6290f3-1e5a-4a84-af1f-4b34537ecd52 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:26:59.435593 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ab6290f3-1e5a-4a84-af1f-4b34537ecd52 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: fca96a8a-7721-4bbc-8ffa-b732ef5d753d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:26:59.570072 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ab6290f3-1e5a-4a84-af1f-4b34537ecd52 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.041832 Jul 25 14:26:59.595565 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 280/524] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:26:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:26:59.624426 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0b09e090-2e11-4613-8b0b-816579bc51c2 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-360966835"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:26:59.629147 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0b09e090-2e11-4613-8b0b-816579bc51c2 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 04c1923b-e18a-408f-99b1-62d86feb25a1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:26:59.659040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b09e090-2e11-4613-8b0b-816579bc51c2 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:59.660718 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b09e090-2e11-4613-8b0b-816579bc51c2 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:26:59.661811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b09e090-2e11-4613-8b0b-816579bc51c2 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:26:59.666839 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b09e090-2e11-4613-8b0b-816579bc51c2 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:00.029410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:00.048346 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-da37e4a3-6899-4c11-acac-3985bb357388 tempest-QuotasAdminTestJSON-323644728 tempest-QuotasAdminTestJSON-323644728-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-sets/1c4cdc1479974f16950fdd78ba052296" status: 200 len: 329 microversion: 2.1 time: 1.241517 Jul 25 14:27:00.048953 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 245/525] 10.222.0.88 () {60 vars in 1263 bytes} [Mon Jul 25 14:26:58 2022] PUT /compute/v2.1/os-quota-sets/1c4cdc1479974f16950fdd78ba052296 => generated 329 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:00.064156 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2af932d9-6edd-4549-8b55-bd7f2a24f9cd tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:00.064832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2af932d9-6edd-4549-8b55-bd7f2a24f9cd tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:00.090301 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2af932d9-6edd-4549-8b55-bd7f2a24f9cd tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:00.090774 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2af932d9-6edd-4549-8b55-bd7f2a24f9cd tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:00.091579 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2af932d9-6edd-4549-8b55-bd7f2a24f9cd tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:00.101630 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2af932d9-6edd-4549-8b55-bd7f2a24f9cd tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:00.231140 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0b09e090-2e11-4613-8b0b-816579bc51c2 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "POST /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1/action" status: 202 len: 0 microversion: 2.1 time: 0.633891 Jul 25 14:27:00.232209 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 281/526] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:26:59 2022] POST /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1/action => generated 0 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 14:27:00.239038 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7c918160-c0c8-4520-aaad-deb4efa2b081 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:00.240005 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7c918160-c0c8-4520-aaad-deb4efa2b081 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: fca96a8a-7721-4bbc-8ffa-b732ef5d753d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:00.660753 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7c918160-c0c8-4520-aaad-deb4efa2b081 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:00.670992 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7c918160-c0c8-4520-aaad-deb4efa2b081 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d" status: 200 len: 1262 microversion: 2.1 time: 0.436713 Jul 25 14:27:00.675404 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 282/527] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:00 2022] GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d => generated 1262 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:00.685010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-907aa7c7-b9a4-422c-b894-135f03d1ce89 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:00.685949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-907aa7c7-b9a4-422c-b894-135f03d1ce89 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:00.709087 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-907aa7c7-b9a4-422c-b894-135f03d1ce89 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:00.712144 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-907aa7c7-b9a4-422c-b894-135f03d1ce89 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:00.713119 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-907aa7c7-b9a4-422c-b894-135f03d1ce89 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:00.713760 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-907aa7c7-b9a4-422c-b894-135f03d1ce89 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:00.941632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-907aa7c7-b9a4-422c-b894-135f03d1ce89 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:00.953079 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-907aa7c7-b9a4-422c-b894-135f03d1ce89 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1469 microversion: 2.1 time: 0.274500 Jul 25 14:27:00.954602 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 283/528] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:00 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1469 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:00.961883 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-13b78f54-d912-44d3-b4bc-2ed39b62a97a tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1863591140"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:00.964626 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-13b78f54-d912-44d3-b4bc-2ed39b62a97a tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 04c1923b-e18a-408f-99b1-62d86feb25a1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:00.972346 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-13b78f54-d912-44d3-b4bc-2ed39b62a97a tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:00.972910 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-13b78f54-d912-44d3-b4bc-2ed39b62a97a tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:00.973749 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-13b78f54-d912-44d3-b4bc-2ed39b62a97a tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:00.974265 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-13b78f54-d912-44d3-b4bc-2ed39b62a97a tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:01.021168 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-13b78f54-d912-44d3-b4bc-2ed39b62a97a tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] HTTP exception thrown: Cannot 'createImage' instance 04c1923b-e18a-408f-99b1-62d86feb25a1 while it is in task_state image_snapshot Jul 25 14:27:01.023661 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-13b78f54-d912-44d3-b4bc-2ed39b62a97a tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Request method failure captured: Jul 25 14:27:01.023661 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1/action HTTP/1.1 Jul 25 14:27:01.023661 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:27:01.023661 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:27:01.023661 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:27:01.023661 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 85 Jul 25 14:27:01.023661 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:27:01.023661 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:27:01.023661 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:27:01.023661 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:27:01.023661 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qgcGc2RjkaZaGa63-PPdbCX4s7H2xWtuYRqlF0JWR61IUGzx74RHc-m8TJT-_RdlH0tQcWSd5UK3Q-O0K9ctQCv8954sZsqJWdlZOw1b7jo_qk8Zk2eLIrhbYh_u9wxQIss6t5T5Ti1Es5U9sr0YdlFFb4d-omgDGqaIN2Ib47NRJM Jul 25 14:27:01.023661 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:27:01.023661 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:27:01.023661 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:27:01.023661 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:27:01.023661 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:27:01.023661 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:27:01.023661 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: c0116982ed03475097096c73b5f03035 Jul 25 14:27:01.023661 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:27:01.023661 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:27:01.023661 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:27:01.025234 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0116982ed03475097096c73b5f03035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0116982ed03475097096c73b5f03035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0116982ed03475097096c73b5f03035", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0116982ed03475097096c73b5f03035"}]}] Jul 25 14:27:01.025234 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:27:01.025234 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: c0116982ed03475097096c73b5f03035 Jul 25 14:27:01.025234 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:27:01.025234 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ImagesOneServerNegativeTestJSON-745484288-project Jul 25 14:27:01.025234 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:27:01.025234 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:27:01.025234 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: f1b1656f2dcd4ffebac55bf18110ff63 Jul 25 14:27:01.025234 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-745484288-project Jul 25 14:27:01.025234 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:27:01.025234 n-d-846435-14 devstack@n-api.service[119304]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1863591140"}} Jul 25 14:27:01.025234 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:27:01.026041 n-d-846435-14 devstack@n-api.service[119304]: exception: Cannot 'createImage' instance 04c1923b-e18a-408f-99b1-62d86feb25a1 while it is in task_state image_snapshot Jul 25 14:27:01.026041 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '04c1923b-e18a-408f-99b1-62d86feb25a1', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1863591140'}}} Jul 25 14:27:01.026041 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:27:01.026041 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:01.026041 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jul 25 14:27:01.026041 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jul 25 14:27:01.026041 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jul 25 14:27:01.026041 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 14:27:01.026041 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 04c1923b-e18a-408f-99b1-62d86feb25a1 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Jul 25 14:27:01.026041 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:01.026041 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:01.026041 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:01.026041 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:01.026041 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:01.026041 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:01.026041 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:27:01.026041 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:27:01.026041 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:27:01.026041 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:27:01.027524 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:27:01.027524 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:27:01.027524 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:27:01.027524 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:27:01.027524 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jul 25 14:27:01.027524 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 14:27:01.027524 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 14:27:01.027524 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 14:27:01.027524 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 04c1923b-e18a-408f-99b1-62d86feb25a1 while it is in task_state image_snapshot Jul 25 14:27:01.027524 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:01.027524 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:01.027524 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:01.027524 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:01.027524 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:01.027524 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:01.027524 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:27:01.027524 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:27:01.027524 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 04c1923b-e18a-408f-99b1-62d86feb25a1 while it is in task_state image_snapshot Jul 25 14:27:01.027524 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:01.029897 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-13b78f54-d912-44d3-b4bc-2ed39b62a97a tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Returning 409 to user: Cannot 'createImage' instance 04c1923b-e18a-408f-99b1-62d86feb25a1 while it is in task_state image_snapshot {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:27:01.031366 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-13b78f54-d912-44d3-b4bc-2ed39b62a97a tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "POST /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1/action" status: 409 len: 159 microversion: 2.1 time: 0.075370 Jul 25 14:27:01.035360 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 284/529] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:27:00 2022] POST /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1/action => generated 159 bytes in 80 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:27:01.040812 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-030cf906-804e-4c26-8788-763efd0a0cdd tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '.version_select at 0x7f4687952ca0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:01.270068 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2af932d9-6edd-4549-8b55-bd7f2a24f9cd tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:01.284755 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2af932d9-6edd-4549-8b55-bd7f2a24f9cd tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1471 microversion: 2.1 time: 1.234626 Jul 25 14:27:01.289251 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 246/530] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:00 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1471 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:01.480064 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-030cf906-804e-4c26-8788-763efd0a0cdd tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "DELETE /compute/v2.1/images/a9d4f5f5-3ad2-4589-8cec-dd7f0e4374f5" status: 204 len: 0 microversion: 2.1 time: 0.443058 Jul 25 14:27:01.480774 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 285/531] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:01 2022] DELETE /compute/v2.1/images/a9d4f5f5-3ad2-4589-8cec-dd7f0e4374f5 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:27:01.491472 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-01be4e94-4101-4129-b19f-a0d7121dfea7 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:01.492419 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-01be4e94-4101-4129-b19f-a0d7121dfea7 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 04c1923b-e18a-408f-99b1-62d86feb25a1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:01.506357 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-01be4e94-4101-4129-b19f-a0d7121dfea7 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:01.506806 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-01be4e94-4101-4129-b19f-a0d7121dfea7 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:01.511340 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-01be4e94-4101-4129-b19f-a0d7121dfea7 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:01.517999 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-01be4e94-4101-4129-b19f-a0d7121dfea7 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:01.701663 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3227486a-b2b1-470d-a3cc-1eaf943e521b tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:01.702746 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3227486a-b2b1-470d-a3cc-1eaf943e521b tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: fca96a8a-7721-4bbc-8ffa-b732ef5d753d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:01.725511 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3227486a-b2b1-470d-a3cc-1eaf943e521b tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:01.726001 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3227486a-b2b1-470d-a3cc-1eaf943e521b tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:01.728136 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3227486a-b2b1-470d-a3cc-1eaf943e521b tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:01.731345 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3227486a-b2b1-470d-a3cc-1eaf943e521b tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:02.028517 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-01be4e94-4101-4129-b19f-a0d7121dfea7 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:02.032230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:02.038398 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-01be4e94-4101-4129-b19f-a0d7121dfea7 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1" status: 200 len: 1540 microversion: 2.1 time: 0.553328 Jul 25 14:27:02.048956 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 247/532] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:01 2022] GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1 => generated 1540 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:02.054200 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-56978e04-91c5-440c-9fdc-d1e07ab5c296 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:02.054822 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-56978e04-91c5-440c-9fdc-d1e07ab5c296 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:02.072586 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56978e04-91c5-440c-9fdc-d1e07ab5c296 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:02.073040 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56978e04-91c5-440c-9fdc-d1e07ab5c296 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:02.073822 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56978e04-91c5-440c-9fdc-d1e07ab5c296 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:02.074255 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56978e04-91c5-440c-9fdc-d1e07ab5c296 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:02.101350 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3227486a-b2b1-470d-a3cc-1eaf943e521b tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:02.116637 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3227486a-b2b1-470d-a3cc-1eaf943e521b tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d" status: 200 len: 1320 microversion: 2.1 time: 0.422519 Jul 25 14:27:02.119378 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 286/533] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:01 2022] GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d => generated 1320 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:02.197552 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-2003ca2d-d075-47ed-b1eb-dd34260d5b1a req-4034ea9f-6a9e-4685-a033-53c793f5b730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5", "name": "network-vif-deleted", "tag": "0dfe3f1f-597d-4865-90a9-c04d07e6faf2"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:02.237194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-2003ca2d-d075-47ed-b1eb-dd34260d5b1a req-4034ea9f-6a9e-4685-a033-53c793f5b730 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:02.239510 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-2003ca2d-d075-47ed-b1eb-dd34260d5b1a req-4034ea9f-6a9e-4685-a033-53c793f5b730 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:02.268138 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-2003ca2d-d075-47ed-b1eb-dd34260d5b1a req-4034ea9f-6a9e-4685-a033-53c793f5b730 service nova] Creating event network-vif-deleted:0dfe3f1f-597d-4865-90a9-c04d07e6faf2 for instance 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 on n-h1-846435-14 Jul 25 14:27:02.288086 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-2003ca2d-d075-47ed-b1eb-dd34260d5b1a req-4034ea9f-6a9e-4685-a033-53c793f5b730 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094523 Jul 25 14:27:02.290550 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 287/534] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:02.310786 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d587ddbc-00d1-45cd-ab55-ed4275c60e29 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:02.311470 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d587ddbc-00d1-45cd-ab55-ed4275c60e29 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:02.330021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d587ddbc-00d1-45cd-ab55-ed4275c60e29 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:02.330463 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d587ddbc-00d1-45cd-ab55-ed4275c60e29 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:02.331366 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d587ddbc-00d1-45cd-ab55-ed4275c60e29 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:02.331795 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d587ddbc-00d1-45cd-ab55-ed4275c60e29 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:02.583445 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d587ddbc-00d1-45cd-ab55-ed4275c60e29 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:02.596407 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d587ddbc-00d1-45cd-ab55-ed4275c60e29 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1471 microversion: 2.1 time: 0.290097 Jul 25 14:27:02.597354 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 288/535] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:02 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1471 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:03.225719 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-56978e04-91c5-440c-9fdc-d1e07ab5c296 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:03.246374 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-56978e04-91c5-440c-9fdc-d1e07ab5c296 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1469 microversion: 2.1 time: 1.194914 Jul 25 14:27:03.248609 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 248/536] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:02 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1469 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:03.267057 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4ce0475c-bdde-4f1a-90c2-0c34037a42b5 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:03.270046 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4ce0475c-bdde-4f1a-90c2-0c34037a42b5 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 04c1923b-e18a-408f-99b1-62d86feb25a1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:03.309555 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4ce0475c-bdde-4f1a-90c2-0c34037a42b5 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:03.311611 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4ce0475c-bdde-4f1a-90c2-0c34037a42b5 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:03.316180 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4ce0475c-bdde-4f1a-90c2-0c34037a42b5 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:03.317756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4ce0475c-bdde-4f1a-90c2-0c34037a42b5 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:03.540265 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ce563210-c3d5-477a-9668-84e5a9e460cc tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1132208260", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:03.623763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-ce563210-c3d5-477a-9668-84e5a9e460cc tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] validate_networks() for None {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:27:03.959613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-ce563210-c3d5-477a-9668-84e5a9e460cc tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:27:03.960387 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-ce563210-c3d5-477a-9668-84e5a9e460cc tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:27:03.961043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-ce563210-c3d5-477a-9668-84e5a9e460cc tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:27:03.961622 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-ce563210-c3d5-477a-9668-84e5a9e460cc tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:27:03.962204 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-ce563210-c3d5-477a-9668-84e5a9e460cc tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:27:03.979834 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce563210-c3d5-477a-9668-84e5a9e460cc tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:03.980572 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce563210-c3d5-477a-9668-84e5a9e460cc tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:03.981545 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce563210-c3d5-477a-9668-84e5a9e460cc tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:03.985006 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce563210-c3d5-477a-9668-84e5a9e460cc tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:04.022896 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-ce563210-c3d5-477a-9668-84e5a9e460cc tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Getting quotas for project f07a43cd116847b6816581adfeed8f9b. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:27:04.037383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-ce563210-c3d5-477a-9668-84e5a9e460cc tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Getting quotas for user 6976261712c44d37821f95e1f482de72 and project f07a43cd116847b6816581adfeed8f9b. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:27:04.046261 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:04.082430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ce563210-c3d5-477a-9668-84e5a9e460cc tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:27:04.084807 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ce563210-c3d5-477a-9668-84e5a9e460cc tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: b6ed0cc6-bfeb-4148-a017-69d0eedad83e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:27:04.166855 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ce563210-c3d5-477a-9668-84e5a9e460cc tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.414692 Jul 25 14:27:04.170974 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 289/537] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:27:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 14:27:04.186449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c9319def-dfb7-4b3c-ad51-1d0415cc89f5 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:04.187506 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c9319def-dfb7-4b3c-ad51-1d0415cc89f5 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: fca96a8a-7721-4bbc-8ffa-b732ef5d753d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:04.203622 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c9319def-dfb7-4b3c-ad51-1d0415cc89f5 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:04.204535 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c9319def-dfb7-4b3c-ad51-1d0415cc89f5 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:04.208170 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c9319def-dfb7-4b3c-ad51-1d0415cc89f5 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:04.211441 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c9319def-dfb7-4b3c-ad51-1d0415cc89f5 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:04.282441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4ce0475c-bdde-4f1a-90c2-0c34037a42b5 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:04.293233 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4ce0475c-bdde-4f1a-90c2-0c34037a42b5 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1" status: 200 len: 1522 microversion: 2.1 time: 1.040592 Jul 25 14:27:04.310091 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 249/538] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:03 2022] GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1 => generated 1522 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:04.326449 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6ee20cfe-43bf-412e-b9aa-da680f32d8da tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:04.328750 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6ee20cfe-43bf-412e-b9aa-da680f32d8da tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:04.353966 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ee20cfe-43bf-412e-b9aa-da680f32d8da tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:04.354561 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ee20cfe-43bf-412e-b9aa-da680f32d8da tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:04.358852 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ee20cfe-43bf-412e-b9aa-da680f32d8da tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:04.360126 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ee20cfe-43bf-412e-b9aa-da680f32d8da tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:04.404832 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c9319def-dfb7-4b3c-ad51-1d0415cc89f5 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:04.413781 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c9319def-dfb7-4b3c-ad51-1d0415cc89f5 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d" status: 200 len: 1320 microversion: 2.1 time: 0.241337 Jul 25 14:27:04.416749 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 290/539] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:04 2022] GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d => generated 1320 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:04.649657 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6ee20cfe-43bf-412e-b9aa-da680f32d8da tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:04.661149 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6ee20cfe-43bf-412e-b9aa-da680f32d8da tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1471 microversion: 2.1 time: 0.343608 Jul 25 14:27:04.662926 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 250/540] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:04 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1471 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:04.674058 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-41c6de9c-7abe-41cd-b016-ff1755aa78e6 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:04.678218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-41c6de9c-7abe-41cd-b016-ff1755aa78e6 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: b6ed0cc6-bfeb-4148-a017-69d0eedad83e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:04.873902 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-41c6de9c-7abe-41cd-b016-ff1755aa78e6 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:04.881346 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1efe1f79-7641-4794-9f22-aec62f3e6148 tempest-FlavorsAccessTestJSON-1302870921 tempest-FlavorsAccessTestJSON-1302870921-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1250111736", "id": 1177844050, "os-flavor-access:is_public": "False"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:04.898960 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:27:04.898960 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:27:04.904468 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-41c6de9c-7abe-41cd-b016-ff1755aa78e6 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e" status: 200 len: 1219 microversion: 2.1 time: 0.234874 Jul 25 14:27:04.905179 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 251/541] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:04 2022] GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e => generated 1219 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:04.940470 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c10ef256-cc6f-4f0a-a6f0-3b0122203c50 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:04.941737 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1efe1f79-7641-4794-9f22-aec62f3e6148 tempest-FlavorsAccessTestJSON-1302870921 tempest-FlavorsAccessTestJSON-1302870921-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.523678 Jul 25 14:27:04.946401 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c10ef256-cc6f-4f0a-a6f0-3b0122203c50 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:04.950992 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 291/542] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:27:04 2022] POST /compute/v2.1/flavors => generated 431 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:04.964128 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-962fac01-1ac6-4a1b-9d48-8ae57e381dfa tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:04.964630 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-962fac01-1ac6-4a1b-9d48-8ae57e381dfa tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 04c1923b-e18a-408f-99b1-62d86feb25a1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:04.964747 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c10ef256-cc6f-4f0a-a6f0-3b0122203c50 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:04.965160 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c10ef256-cc6f-4f0a-a6f0-3b0122203c50 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:04.967965 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c10ef256-cc6f-4f0a-a6f0-3b0122203c50 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:04.969593 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c10ef256-cc6f-4f0a-a6f0-3b0122203c50 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:04.988900 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-962fac01-1ac6-4a1b-9d48-8ae57e381dfa tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:04.990436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-962fac01-1ac6-4a1b-9d48-8ae57e381dfa tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:04.993674 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-962fac01-1ac6-4a1b-9d48-8ae57e381dfa tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:04.994469 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-962fac01-1ac6-4a1b-9d48-8ae57e381dfa tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:05.067889 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-962fac01-1ac6-4a1b-9d48-8ae57e381dfa tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 04c1923b-e18a-408f-99b1-62d86feb25a1] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:27:05.242815 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-962fac01-1ac6-4a1b-9d48-8ae57e381dfa tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "DELETE /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1" status: 204 len: 0 microversion: 2.1 time: 0.287022 Jul 25 14:27:05.246482 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 292/543] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:27:04 2022] DELETE /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:27:05.255210 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a0ef1efb-524c-431c-a087-fe760ffe19b0 tempest-FlavorsAccessTestJSON-1302870921 tempest-FlavorsAccessTestJSON-1302870921-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2c52df2183bf4cb89b8458ce1537e881"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:05.266619 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:27:05.266619 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:27:05.424048 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c10ef256-cc6f-4f0a-a6f0-3b0122203c50 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:05.438526 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c10ef256-cc6f-4f0a-a6f0-3b0122203c50 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1474 microversion: 2.1 time: 0.526107 Jul 25 14:27:05.444043 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 252/544] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:04 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1474 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:05.456472 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9bf1fd03-3c60-4c70-913c-bea2fc2892e8 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:05.458842 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9bf1fd03-3c60-4c70-913c-bea2fc2892e8 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 04c1923b-e18a-408f-99b1-62d86feb25a1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:05.469982 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9bf1fd03-3c60-4c70-913c-bea2fc2892e8 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:05.476150 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9bf1fd03-3c60-4c70-913c-bea2fc2892e8 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:05.477570 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9bf1fd03-3c60-4c70-913c-bea2fc2892e8 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:05.478919 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9bf1fd03-3c60-4c70-913c-bea2fc2892e8 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:05.715539 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a0ef1efb-524c-431c-a087-fe760ffe19b0 tempest-FlavorsAccessTestJSON-1302870921 tempest-FlavorsAccessTestJSON-1302870921-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors/1177844050/action" status: 200 len: 97 microversion: 2.1 time: 0.470144 Jul 25 14:27:05.717423 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 293/545] 10.222.0.88 () {60 vars in 1200 bytes} [Mon Jul 25 14:27:05 2022] POST /compute/v2.1/flavors/1177844050/action => generated 97 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:27:05.724536 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-50e3f419-7c8f-4bc0-8851-1e31a7bcc080 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:05.725961 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-50e3f419-7c8f-4bc0-8851-1e31a7bcc080 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: fca96a8a-7721-4bbc-8ffa-b732ef5d753d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:05.734061 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50e3f419-7c8f-4bc0-8851-1e31a7bcc080 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:05.734925 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50e3f419-7c8f-4bc0-8851-1e31a7bcc080 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:05.736075 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50e3f419-7c8f-4bc0-8851-1e31a7bcc080 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:05.736751 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50e3f419-7c8f-4bc0-8851-1e31a7bcc080 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:05.786778 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9bf1fd03-3c60-4c70-913c-bea2fc2892e8 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:05.795629 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9bf1fd03-3c60-4c70-913c-bea2fc2892e8 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1" status: 200 len: 1528 microversion: 2.1 time: 0.350126 Jul 25 14:27:05.796494 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 253/546] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:05 2022] GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1 => generated 1528 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:05.814030 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d2e35d19-7743-4624-b3be-6bc24e332040 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:05.814964 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d2e35d19-7743-4624-b3be-6bc24e332040 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:05.817251 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:INSERT=18,nova_api:SELECT=68,nova_api:UPDATE=14 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:05.823121 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d2e35d19-7743-4624-b3be-6bc24e332040 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:05.823781 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d2e35d19-7743-4624-b3be-6bc24e332040 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:05.824765 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d2e35d19-7743-4624-b3be-6bc24e332040 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:05.825336 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d2e35d19-7743-4624-b3be-6bc24e332040 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:05.968959 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-50e3f419-7c8f-4bc0-8851-1e31a7bcc080 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:05.981053 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-50e3f419-7c8f-4bc0-8851-1e31a7bcc080 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d" status: 200 len: 1388 microversion: 2.1 time: 0.262134 Jul 25 14:27:05.982382 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 294/547] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:05 2022] GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d => generated 1388 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:06.170219 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d2e35d19-7743-4624-b3be-6bc24e332040 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:06.187497 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d2e35d19-7743-4624-b3be-6bc24e332040 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1471 microversion: 2.1 time: 0.377381 Jul 25 14:27:06.199818 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 254/548] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:05 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1471 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:06.210743 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e197e77c-66b3-41eb-b274-e5830a31ca67 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:06.211568 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e197e77c-66b3-41eb-b274-e5830a31ca67 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: b6ed0cc6-bfeb-4148-a017-69d0eedad83e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:06.219349 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e197e77c-66b3-41eb-b274-e5830a31ca67 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:06.220578 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e197e77c-66b3-41eb-b274-e5830a31ca67 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:06.221848 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e197e77c-66b3-41eb-b274-e5830a31ca67 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:06.222495 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e197e77c-66b3-41eb-b274-e5830a31ca67 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:06.356143 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6810bf2a-c6ed-469f-be98-54a56d39be74 tempest-FlavorsAccessTestJSON-1862917876 tempest-FlavorsAccessTestJSON-1862917876-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:06.397648 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6810bf2a-c6ed-469f-be98-54a56d39be74 tempest-FlavorsAccessTestJSON-1862917876 tempest-FlavorsAccessTestJSON-1862917876-project] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 6237 microversion: 2.1 time: 0.413865 Jul 25 14:27:06.398456 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 295/549] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:27:05 2022] GET /compute/v2.1/flavors/detail => generated 6237 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:06.403459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-607b8787-f57f-4c50-9050-e1763b4a7204 req-eb443bbf-a28a-4d92-a8e0-94c1bf60ceca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c1923b-e18a-408f-99b1-62d86feb25a1", "name": "network-vif-plugged", "status": "completed", "tag": "b9576864-54c5-430a-9ce8-c920701819c0"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:06.413897 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e197e77c-66b3-41eb-b274-e5830a31ca67 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:06.426775 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e197e77c-66b3-41eb-b274-e5830a31ca67 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e" status: 200 len: 1277 microversion: 2.1 time: 0.225003 Jul 25 14:27:06.436139 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-607b8787-f57f-4c50-9050-e1763b4a7204 req-eb443bbf-a28a-4d92-a8e0-94c1bf60ceca service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:06.438523 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-607b8787-f57f-4c50-9050-e1763b4a7204 req-eb443bbf-a28a-4d92-a8e0-94c1bf60ceca service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:06.441651 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 255/550] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:06 2022] GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e => generated 1277 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:06.453332 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4649ebd2-78d6-47a2-85b2-ebcfbcc627ae tempest-FlavorsAccessTestJSON-1302870921 tempest-FlavorsAccessTestJSON-1302870921-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2c52df2183bf4cb89b8458ce1537e881"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:06.456083 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:27:06.456083 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:27:06.501784 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-607b8787-f57f-4c50-9050-e1763b4a7204 req-eb443bbf-a28a-4d92-a8e0-94c1bf60ceca service nova] Creating event network-vif-plugged:b9576864-54c5-430a-9ce8-c920701819c0 for instance 04c1923b-e18a-408f-99b1-62d86feb25a1 on n-h1-846435-14 Jul 25 14:27:06.517851 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-607b8787-f57f-4c50-9050-e1763b4a7204 req-eb443bbf-a28a-4d92-a8e0-94c1bf60ceca service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117390 Jul 25 14:27:06.522489 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 296/551] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:06.552709 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c4e53971-8c5b-4299-9412-d4822091d09d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:06.553866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c4e53971-8c5b-4299-9412-d4822091d09d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:06.581294 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c4e53971-8c5b-4299-9412-d4822091d09d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:06.582083 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c4e53971-8c5b-4299-9412-d4822091d09d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:06.584213 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c4e53971-8c5b-4299-9412-d4822091d09d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:06.584863 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c4e53971-8c5b-4299-9412-d4822091d09d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:06.791099 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4649ebd2-78d6-47a2-85b2-ebcfbcc627ae tempest-FlavorsAccessTestJSON-1302870921 tempest-FlavorsAccessTestJSON-1302870921-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors/1177844050/action" status: 200 len: 21 microversion: 2.1 time: 0.348061 Jul 25 14:27:06.793068 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 256/552] 10.222.0.88 () {60 vars in 1200 bytes} [Mon Jul 25 14:27:06 2022] POST /compute/v2.1/flavors/1177844050/action => generated 21 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:27:06.797787 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c4e53971-8c5b-4299-9412-d4822091d09d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:06.803237 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:06.804857 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b4b31add-d998-4a0d-9b47-1742328422db tempest-FlavorsAccessTestJSON-1862917876 tempest-FlavorsAccessTestJSON-1862917876-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:06.810377 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c4e53971-8c5b-4299-9412-d4822091d09d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1474 microversion: 2.1 time: 0.285759 Jul 25 14:27:06.820023 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 297/553] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:06 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1474 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:06.826115 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5b45dc38-1eaa-45a6-aa4e-e9ff93fa1726 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:06.826961 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5b45dc38-1eaa-45a6-aa4e-e9ff93fa1726 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 04c1923b-e18a-408f-99b1-62d86feb25a1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:06.848391 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b4b31add-d998-4a0d-9b47-1742328422db tempest-FlavorsAccessTestJSON-1862917876 tempest-FlavorsAccessTestJSON-1862917876-project] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.049752 Jul 25 14:27:06.850354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b45dc38-1eaa-45a6-aa4e-e9ff93fa1726 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:06.851047 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b45dc38-1eaa-45a6-aa4e-e9ff93fa1726 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:06.852044 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b45dc38-1eaa-45a6-aa4e-e9ff93fa1726 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:06.852666 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b45dc38-1eaa-45a6-aa4e-e9ff93fa1726 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:06.857300 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 257/554] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:27:06 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:06.875168 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b28a23d2-24a2-43e1-8140-dc9f7c46fd9b tempest-FlavorsAccessTestJSON-1302870921 tempest-FlavorsAccessTestJSON-1302870921-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:06.876442 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:27:06.876442 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:27:06.904484 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b28a23d2-24a2-43e1-8140-dc9f7c46fd9b tempest-FlavorsAccessTestJSON-1302870921 tempest-FlavorsAccessTestJSON-1302870921-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/1177844050" status: 202 len: 0 microversion: 2.1 time: 0.038101 Jul 25 14:27:06.905563 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 258/555] 10.222.0.88 () {58 vars in 1161 bytes} [Mon Jul 25 14:27:06 2022] DELETE /compute/v2.1/flavors/1177844050 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:27:06.914893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ce3e5ca6-0d04-49fc-80a0-85749ba3c9f0 tempest-FlavorsAccessTestJSON-1302870921 tempest-FlavorsAccessTestJSON-1302870921-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:06.959588 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ce3e5ca6-0d04-49fc-80a0-85749ba3c9f0 tempest-FlavorsAccessTestJSON-1302870921 tempest-FlavorsAccessTestJSON-1302870921-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.049400 Jul 25 14:27:06.975908 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 259/556] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:27:06 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:27:06.981189 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-59f154f1-6fbc-43f0-b996-f16900ab4d78 tempest-FlavorsAccessTestJSON-1302870921 tempest-FlavorsAccessTestJSON-1302870921-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1187000276", "id": 1162069564, "os-flavor-access:is_public": "False"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:06.985393 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:27:06.985393 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:27:07.004843 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-59f154f1-6fbc-43f0-b996-f16900ab4d78 tempest-FlavorsAccessTestJSON-1302870921 tempest-FlavorsAccessTestJSON-1302870921-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.027324 Jul 25 14:27:07.014068 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 260/557] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:27:06 2022] POST /compute/v2.1/flavors => generated 431 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:07.020470 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-450d4f91-1cbb-4630-af3b-dae4bf78fbf1 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:07.021482 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-450d4f91-1cbb-4630-af3b-dae4bf78fbf1 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: fca96a8a-7721-4bbc-8ffa-b732ef5d753d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:07.028920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-450d4f91-1cbb-4630-af3b-dae4bf78fbf1 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:07.029728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-450d4f91-1cbb-4630-af3b-dae4bf78fbf1 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:07.030986 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-450d4f91-1cbb-4630-af3b-dae4bf78fbf1 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:07.031728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-450d4f91-1cbb-4630-af3b-dae4bf78fbf1 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:07.106619 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5b45dc38-1eaa-45a6-aa4e-e9ff93fa1726 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:07.116560 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5b45dc38-1eaa-45a6-aa4e-e9ff93fa1726 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1" status: 200 len: 1528 microversion: 2.1 time: 0.303830 Jul 25 14:27:07.118201 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 298/558] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:06 2022] GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1 => generated 1528 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:27:07.131070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-50d40cad-c9b7-47d9-99a0-b735db574575 tempest-FlavorsAccessTestJSON-1302870921 tempest-FlavorsAccessTestJSON-1302870921-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:07.134149 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:27:07.134149 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:27:07.162745 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-50d40cad-c9b7-47d9-99a0-b735db574575 tempest-FlavorsAccessTestJSON-1302870921 tempest-FlavorsAccessTestJSON-1302870921-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/1162069564/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.043264 Jul 25 14:27:07.163252 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 299/559] 10.222.0.88 () {58 vars in 1209 bytes} [Mon Jul 25 14:27:07 2022] GET /compute/v2.1/flavors/1162069564/os-flavor-access => generated 21 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:27:07.168570 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-28e02b7d-3627-4055-890e-c9118995c86b req-6764feb5-150a-4f4e-9cc1-7a0c61c1002e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fca96a8a-7721-4bbc-8ffa-b732ef5d753d", "tag": "205878ed-21c4-4153-8a87-16c8234dec0f"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:07.184397 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-28e02b7d-3627-4055-890e-c9118995c86b req-6764feb5-150a-4f4e-9cc1-7a0c61c1002e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:07.185428 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-28e02b7d-3627-4055-890e-c9118995c86b req-6764feb5-150a-4f4e-9cc1-7a0c61c1002e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:07.201974 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-28e02b7d-3627-4055-890e-c9118995c86b req-6764feb5-150a-4f4e-9cc1-7a0c61c1002e service nova] Creating event network-changed:205878ed-21c4-4153-8a87-16c8234dec0f for instance fca96a8a-7721-4bbc-8ffa-b732ef5d753d on n-h2-846435-14 Jul 25 14:27:07.212998 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-28e02b7d-3627-4055-890e-c9118995c86b req-6764feb5-150a-4f4e-9cc1-7a0c61c1002e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047485 Jul 25 14:27:07.215418 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 300/560] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:07.458605 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-450d4f91-1cbb-4630-af3b-dae4bf78fbf1 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:07.466569 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-450d4f91-1cbb-4630-af3b-dae4bf78fbf1 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d" status: 200 len: 1388 microversion: 2.1 time: 0.450435 Jul 25 14:27:07.480701 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 261/561] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:07 2022] GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d => generated 1388 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:07.485964 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c787080e-7aeb-4b95-ae33-a83bf8bf670f tempest-FlavorsAccessTestJSON-1302870921 tempest-FlavorsAccessTestJSON-1302870921-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:07.486929 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:27:07.486929 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:27:07.505035 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c787080e-7aeb-4b95-ae33-a83bf8bf670f tempest-FlavorsAccessTestJSON-1302870921 tempest-FlavorsAccessTestJSON-1302870921-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/1162069564" status: 202 len: 0 microversion: 2.1 time: 0.022883 Jul 25 14:27:07.508758 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 262/562] 10.222.0.88 () {58 vars in 1161 bytes} [Mon Jul 25 14:27:07 2022] DELETE /compute/v2.1/flavors/1162069564 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:27:07.514519 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6e355d1f-449f-4379-b65a-007293b37a09 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:07.515153 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6e355d1f-449f-4379-b65a-007293b37a09 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:07.530574 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e355d1f-449f-4379-b65a-007293b37a09 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:07.531036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e355d1f-449f-4379-b65a-007293b37a09 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:07.531839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e355d1f-449f-4379-b65a-007293b37a09 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:07.532305 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e355d1f-449f-4379-b65a-007293b37a09 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:07.554254 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-59c05daf-ed15-4d36-aed4-08901c9cd466 tempest-ListImageFiltersNegativeTestJSON-756380291 tempest-ListImageFiltersNegativeTestJSON-756380291-project] Calling method '.version_select at 0x7f46878d93a0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:07.578350 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-59c05daf-ed15-4d36-aed4-08901c9cd466 tempest-ListImageFiltersNegativeTestJSON-756380291 tempest-ListImageFiltersNegativeTestJSON-756380291-project] HTTP exception thrown: Image not found. Jul 25 14:27:07.592219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-59c05daf-ed15-4d36-aed4-08901c9cd466 tempest-ListImageFiltersNegativeTestJSON-756380291 tempest-ListImageFiltersNegativeTestJSON-756380291-project] Request method failure captured: Jul 25 14:27:07.592219 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/images/9f939dc4-c3a0-40a4-b527-9b9f50d4116d HTTP/1.1 Jul 25 14:27:07.592219 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:27:07.592219 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:27:07.592219 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:27:07.592219 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:27:07.592219 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:27:07.592219 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:27:07.592219 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:27:07.592219 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:27:07.592219 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qg6Ll95lNi2e-eQKWvJ6gBsgDHDtHUng1S39ddV93AYfMv_jqS91ZixgOblI7cv2fJxXmbphXTnSNg5MBmzkYfK2V0OkigJECdbW4Iv6mNZAj_Zth4A90KkY0bAekUTgVn-_iKSmLgBWMBzdK1jxv1Uw8pICPtIaGOgUZ5IRAZYufM Jul 25 14:27:07.592219 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:27:07.592219 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:27:07.592219 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:27:07.592219 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:27:07.592219 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:27:07.592219 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:27:07.592219 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 4bd2bfe9baf2466daecff2e13b4379f4 Jul 25 14:27:07.592219 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-756380291 Jul 25 14:27:07.592219 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:27:07.592219 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:27:07.593587 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/4bd2bfe9baf2466daecff2e13b4379f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/4bd2bfe9baf2466daecff2e13b4379f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_4bd2bfe9baf2466daecff2e13b4379f4", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/4bd2bfe9baf2466daecff2e13b4379f4"}]}] Jul 25 14:27:07.593587 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-756380291 Jul 25 14:27:07.593587 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 4bd2bfe9baf2466daecff2e13b4379f4 Jul 25 14:27:07.593587 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-756380291 Jul 25 14:27:07.593587 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ListImageFiltersNegativeTestJSON-756380291-project Jul 25 14:27:07.593587 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:27:07.593587 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:27:07.593587 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 08718395ceb348ed8e81296605e9190c Jul 25 14:27:07.593587 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-756380291-project Jul 25 14:27:07.593587 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:27:07.593587 n-d-846435-14 devstack@n-api.service[119304]: exception: Image not found. Jul 25 14:27:07.593587 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '9f939dc4-c3a0-40a4-b527-9b9f50d4116d'} Jul 25 14:27:07.593587 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:27:07.594360 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:07.594360 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 14:27:07.594360 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 14:27:07.594360 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 14:27:07.594360 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 14:27:07.594360 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 14:27:07.594360 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 14:27:07.594360 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 14:27:07.594360 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 14:27:07.594360 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 14:27:07.594360 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 14:27:07.594360 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 14:27:07.594360 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 14:27:07.594360 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 14:27:07.594360 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 14:27:07.594360 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 14:27:07.594360 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 14:27:07.594360 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9f939dc4-c3a0-40a4-b527-9b9f50d4116d Jul 25 14:27:07.595367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:07.595367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:07.595367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:07.595367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:07.595367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 25 14:27:07.595367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 25 14:27:07.595367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 14:27:07.595367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 14:27:07.595367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 14:27:07.595367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 14:27:07.595367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 14:27:07.595367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 14:27:07.595367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 14:27:07.595367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 14:27:07.595367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 14:27:07.595367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 14:27:07.595367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 14:27:07.595367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 14:27:07.595367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 14:27:07.595367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 14:27:07.596568 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 14:27:07.596568 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 14:27:07.596568 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 14:27:07.596568 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 14:27:07.596568 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 14:27:07.596568 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 14:27:07.596568 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 14:27:07.596568 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 14:27:07.596568 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9f939dc4-c3a0-40a4-b527-9b9f50d4116d could not be found. Jul 25 14:27:07.596568 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:07.596568 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:07.596568 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:07.596568 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:07.596568 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:07.596568 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:07.596568 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:27:07.596568 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:27:07.596568 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:27:07.596568 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:27:07.597634 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:27:07.597634 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:27:07.597634 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 25 14:27:07.597634 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 14:27:07.597634 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 14:27:07.597634 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:07.597634 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:07.597634 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:07.597634 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:07.597634 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:07.597634 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:07.597634 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:27:07.597634 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:27:07.597634 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 14:27:07.597634 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:07.597634 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-59c05daf-ed15-4d36-aed4-08901c9cd466 tempest-ListImageFiltersNegativeTestJSON-756380291 tempest-ListImageFiltersNegativeTestJSON-756380291-project] Returning 404 to user: Image not found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:27:07.599624 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-59c05daf-ed15-4d36-aed4-08901c9cd466 tempest-ListImageFiltersNegativeTestJSON-756380291 tempest-ListImageFiltersNegativeTestJSON-756380291-project] 10.222.0.88 "GET /compute/v2.1/images/9f939dc4-c3a0-40a4-b527-9b9f50d4116d" status: 404 len: 62 microversion: 2.1 time: 0.376885 Jul 25 14:27:07.599624 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 301/563] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:27:07 2022] GET /compute/v2.1/images/9f939dc4-c3a0-40a4-b527-9b9f50d4116d => generated 62 bytes in 378 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:27:07.602535 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e19bfcc4-a351-41dd-82de-bcc8d58242d1 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:07.603298 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e19bfcc4-a351-41dd-82de-bcc8d58242d1 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: b6ed0cc6-bfeb-4148-a017-69d0eedad83e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:07.611264 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e19bfcc4-a351-41dd-82de-bcc8d58242d1 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:07.611704 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e19bfcc4-a351-41dd-82de-bcc8d58242d1 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:07.612787 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e19bfcc4-a351-41dd-82de-bcc8d58242d1 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:07.613230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e19bfcc4-a351-41dd-82de-bcc8d58242d1 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:07.681598 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e19bfcc4-a351-41dd-82de-bcc8d58242d1 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:07.689828 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e19bfcc4-a351-41dd-82de-bcc8d58242d1 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e" status: 200 len: 1277 microversion: 2.1 time: 0.094451 Jul 25 14:27:07.703465 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 302/564] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:07 2022] GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e => generated 1277 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:07.703465 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0f1b4cd3-128d-441f-bbeb-125045816c4a tempest-FlavorsAccessTestJSON-1302870921 tempest-FlavorsAccessTestJSON-1302870921-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:07.723310 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0f1b4cd3-128d-441f-bbeb-125045816c4a tempest-FlavorsAccessTestJSON-1302870921 tempest-FlavorsAccessTestJSON-1302870921-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.031237 Jul 25 14:27:07.723912 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 303/565] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:27:07 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:07.785068 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f871eb13-0d1f-4c91-bf3f-13a644742d5f tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-774080646", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:07.840817 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6e355d1f-449f-4379-b65a-007293b37a09 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:07.848548 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-f871eb13-0d1f-4c91-bf3f-13a644742d5f tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] validate_networks() for None {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:27:07.851234 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6e355d1f-449f-4379-b65a-007293b37a09 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1471 microversion: 2.1 time: 0.342946 Jul 25 14:27:07.865450 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 263/566] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:07 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1471 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:07.871066 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e98be77e-d8ad-4062-bf4e-42972c633be3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:07.871950 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e98be77e-d8ad-4062-bf4e-42972c633be3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:07.880737 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e98be77e-d8ad-4062-bf4e-42972c633be3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:07.882232 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e98be77e-d8ad-4062-bf4e-42972c633be3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:07.884146 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e98be77e-d8ad-4062-bf4e-42972c633be3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:07.886586 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e98be77e-d8ad-4062-bf4e-42972c633be3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:08.269630 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e98be77e-d8ad-4062-bf4e-42972c633be3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:08.282959 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e98be77e-d8ad-4062-bf4e-42972c633be3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1474 microversion: 2.1 time: 0.416359 Jul 25 14:27:08.283875 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 264/567] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:07 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1474 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:08.293313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4c8f7ac4-eac2-4768-aae3-224cb024fcac tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:08.295365 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4c8f7ac4-eac2-4768-aae3-224cb024fcac tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 04c1923b-e18a-408f-99b1-62d86feb25a1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:08.319040 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c8f7ac4-eac2-4768-aae3-224cb024fcac tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:08.322704 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c8f7ac4-eac2-4768-aae3-224cb024fcac tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:08.325284 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c8f7ac4-eac2-4768-aae3-224cb024fcac tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:08.326180 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c8f7ac4-eac2-4768-aae3-224cb024fcac tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:08.511517 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f871eb13-0d1f-4c91-bf3f-13a644742d5f tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:27:08.512314 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f871eb13-0d1f-4c91-bf3f-13a644742d5f tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:27:08.512977 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f871eb13-0d1f-4c91-bf3f-13a644742d5f tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:27:08.513459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f871eb13-0d1f-4c91-bf3f-13a644742d5f tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:27:08.513875 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f871eb13-0d1f-4c91-bf3f-13a644742d5f tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:27:08.525745 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f871eb13-0d1f-4c91-bf3f-13a644742d5f tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:08.526460 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f871eb13-0d1f-4c91-bf3f-13a644742d5f tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:08.527418 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f871eb13-0d1f-4c91-bf3f-13a644742d5f tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:08.527854 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f871eb13-0d1f-4c91-bf3f-13a644742d5f tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:08.545887 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-f871eb13-0d1f-4c91-bf3f-13a644742d5f tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Getting quotas for project 327a5b80b3404191ae269afa882d3753. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:27:08.551495 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-f871eb13-0d1f-4c91-bf3f-13a644742d5f tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Getting quotas for user 0334859a0fd544b3b4064ca188a22d32 and project 327a5b80b3404191ae269afa882d3753. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:27:08.566517 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f871eb13-0d1f-4c91-bf3f-13a644742d5f tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:27:08.568976 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f871eb13-0d1f-4c91-bf3f-13a644742d5f tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: c2ea60b9-dff6-4ee9-8004-680327fa2f96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:27:08.622682 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f871eb13-0d1f-4c91-bf3f-13a644742d5f tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.897682 Jul 25 14:27:08.624871 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 304/568] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:27:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:27:08.631725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-61e4eec3-15d2-4ca3-9ed4-60c21b1470c2 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:08.632816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-61e4eec3-15d2-4ca3-9ed4-60c21b1470c2 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: fca96a8a-7721-4bbc-8ffa-b732ef5d753d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:08.640978 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-61e4eec3-15d2-4ca3-9ed4-60c21b1470c2 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:08.642257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-61e4eec3-15d2-4ca3-9ed4-60c21b1470c2 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:08.643714 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-61e4eec3-15d2-4ca3-9ed4-60c21b1470c2 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:08.644372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-61e4eec3-15d2-4ca3-9ed4-60c21b1470c2 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:08.720535 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4c8f7ac4-eac2-4768-aae3-224cb024fcac tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:08.734683 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4c8f7ac4-eac2-4768-aae3-224cb024fcac tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1" status: 200 len: 1528 microversion: 2.1 time: 0.449080 Jul 25 14:27:08.749526 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 265/569] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:08 2022] GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1 => generated 1528 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:08.757121 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-76831df9-bee4-484e-ba86-4a6d0f01fcd4 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:08.757781 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-76831df9-bee4-484e-ba86-4a6d0f01fcd4 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: c2ea60b9-dff6-4ee9-8004-680327fa2f96] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:08.845986 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-76831df9-bee4-484e-ba86-4a6d0f01fcd4 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:08.859711 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-76831df9-bee4-484e-ba86-4a6d0f01fcd4 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96" status: 200 len: 1221 microversion: 2.1 time: 0.106722 Jul 25 14:27:08.861527 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 266/570] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:08 2022] GET /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96 => generated 1221 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:08.873748 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-28e39c74-d36e-43b2-99a4-9c545fa99742 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:08.877011 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-28e39c74-d36e-43b2-99a4-9c545fa99742 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: b6ed0cc6-bfeb-4148-a017-69d0eedad83e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:08.881450 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-61e4eec3-15d2-4ca3-9ed4-60c21b1470c2 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:08.889347 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-61e4eec3-15d2-4ca3-9ed4-60c21b1470c2 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d" status: 200 len: 1388 microversion: 2.1 time: 0.263123 Jul 25 14:27:08.889622 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-28e39c74-d36e-43b2-99a4-9c545fa99742 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:08.889930 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 305/571] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:08 2022] GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d => generated 1388 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:08.890709 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-28e39c74-d36e-43b2-99a4-9c545fa99742 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:08.892088 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-28e39c74-d36e-43b2-99a4-9c545fa99742 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:08.892734 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-28e39c74-d36e-43b2-99a4-9c545fa99742 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:08.920112 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-83011986-2250-43f1-ad76-f027cb147e99 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:08.920709 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-83011986-2250-43f1-ad76-f027cb147e99 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:08.951532 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83011986-2250-43f1-ad76-f027cb147e99 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:08.952541 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83011986-2250-43f1-ad76-f027cb147e99 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:08.953017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83011986-2250-43f1-ad76-f027cb147e99 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:08.953868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83011986-2250-43f1-ad76-f027cb147e99 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:09.137722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-28e39c74-d36e-43b2-99a4-9c545fa99742 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:09.149459 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-28e39c74-d36e-43b2-99a4-9c545fa99742 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e" status: 200 len: 1319 microversion: 2.1 time: 0.286382 Jul 25 14:27:09.152146 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 267/572] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:08 2022] GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:09.176120 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-7fad74db-aba5-48ef-a255-817b5b5af69b req-24a2234b-e176-4541-be2f-5ab41d212704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c1923b-e18a-408f-99b1-62d86feb25a1", "name": "network-vif-deleted", "tag": "b9576864-54c5-430a-9ce8-c920701819c0"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:09.193760 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-7fad74db-aba5-48ef-a255-817b5b5af69b req-24a2234b-e176-4541-be2f-5ab41d212704 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:09.193760 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-7fad74db-aba5-48ef-a255-817b5b5af69b req-24a2234b-e176-4541-be2f-5ab41d212704 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:09.207360 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-7fad74db-aba5-48ef-a255-817b5b5af69b req-24a2234b-e176-4541-be2f-5ab41d212704 service nova] Creating event network-vif-deleted:b9576864-54c5-430a-9ce8-c920701819c0 for instance 04c1923b-e18a-408f-99b1-62d86feb25a1 on n-h1-846435-14 Jul 25 14:27:09.213314 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-7fad74db-aba5-48ef-a255-817b5b5af69b req-24a2234b-e176-4541-be2f-5ab41d212704 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043574 Jul 25 14:27:09.214583 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 268/573] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:09.262886 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-83011986-2250-43f1-ad76-f027cb147e99 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:09.271944 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-83011986-2250-43f1-ad76-f027cb147e99 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1477 microversion: 2.1 time: 0.368310 Jul 25 14:27:09.272511 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 306/574] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:08 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1477 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:09.306188 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-70a645ba-1385-438a-979a-1f92e20abf66 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:09.306931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-70a645ba-1385-438a-979a-1f92e20abf66 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:09.318705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70a645ba-1385-438a-979a-1f92e20abf66 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:09.319259 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70a645ba-1385-438a-979a-1f92e20abf66 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:09.320015 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70a645ba-1385-438a-979a-1f92e20abf66 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:09.320704 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70a645ba-1385-438a-979a-1f92e20abf66 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:09.404366 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=14 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:09.531590 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-70a645ba-1385-438a-979a-1f92e20abf66 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:09.542268 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-70a645ba-1385-438a-979a-1f92e20abf66 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1474 microversion: 2.1 time: 0.240796 Jul 25 14:27:09.543211 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 269/575] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:09 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1474 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:09.758425 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f2566a2d-1ffd-410e-9af2-e4f9780a65ed tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:09.759042 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f2566a2d-1ffd-410e-9af2-e4f9780a65ed tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 04c1923b-e18a-408f-99b1-62d86feb25a1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:09.766775 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f2566a2d-1ffd-410e-9af2-e4f9780a65ed tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:09.767227 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f2566a2d-1ffd-410e-9af2-e4f9780a65ed tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:09.768017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f2566a2d-1ffd-410e-9af2-e4f9780a65ed tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:09.768781 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f2566a2d-1ffd-410e-9af2-e4f9780a65ed tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:09.810666 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f2566a2d-1ffd-410e-9af2-e4f9780a65ed tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:09.811386 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f2566a2d-1ffd-410e-9af2-e4f9780a65ed tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:09.812045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-f2566a2d-1ffd-410e-9af2-e4f9780a65ed tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lazy-loading 'fault' on Instance uuid 04c1923b-e18a-408f-99b1-62d86feb25a1 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:27:09.872409 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f2566a2d-1ffd-410e-9af2-e4f9780a65ed tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:09.883870 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-584ff6f9-30ef-491b-9d06-d24c07ad667b tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:09.889744 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f2566a2d-1ffd-410e-9af2-e4f9780a65ed tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1" status: 200 len: 1315 microversion: 2.1 time: 0.136147 Jul 25 14:27:09.892767 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-584ff6f9-30ef-491b-9d06-d24c07ad667b tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: c2ea60b9-dff6-4ee9-8004-680327fa2f96] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:09.893009 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 307/576] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:09 2022] GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1 => generated 1315 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:09.910128 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4d9996f0-c442-4433-873c-74fdbf4752a6 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:09.910788 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4d9996f0-c442-4433-873c-74fdbf4752a6 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: fca96a8a-7721-4bbc-8ffa-b732ef5d753d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:09.917867 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-584ff6f9-30ef-491b-9d06-d24c07ad667b tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:09.918224 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4d9996f0-c442-4433-873c-74fdbf4752a6 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:09.918351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-584ff6f9-30ef-491b-9d06-d24c07ad667b tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:09.918687 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4d9996f0-c442-4433-873c-74fdbf4752a6 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:09.919092 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-584ff6f9-30ef-491b-9d06-d24c07ad667b tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:09.919776 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4d9996f0-c442-4433-873c-74fdbf4752a6 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:09.919893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-584ff6f9-30ef-491b-9d06-d24c07ad667b tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:09.920232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4d9996f0-c442-4433-873c-74fdbf4752a6 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:10.044015 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-584ff6f9-30ef-491b-9d06-d24c07ad667b tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:10.052908 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-584ff6f9-30ef-491b-9d06-d24c07ad667b tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96" status: 200 len: 1217 microversion: 2.1 time: 0.173228 Jul 25 14:27:10.054280 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 270/577] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:09 2022] GET /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96 => generated 1217 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:10.144040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4d9996f0-c442-4433-873c-74fdbf4752a6 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:10.153338 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4d9996f0-c442-4433-873c-74fdbf4752a6 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d" status: 200 len: 1388 microversion: 2.1 time: 0.247190 Jul 25 14:27:10.154246 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 308/578] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:09 2022] GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d => generated 1388 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:27:10.178888 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-25753548-cdc8-40a1-8c17-92e628605a2e tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:10.179583 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-25753548-cdc8-40a1-8c17-92e628605a2e tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: b6ed0cc6-bfeb-4148-a017-69d0eedad83e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:10.186246 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-25753548-cdc8-40a1-8c17-92e628605a2e tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:10.187302 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-25753548-cdc8-40a1-8c17-92e628605a2e tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:10.188136 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-25753548-cdc8-40a1-8c17-92e628605a2e tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:10.188789 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-25753548-cdc8-40a1-8c17-92e628605a2e tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:10.348603 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-25753548-cdc8-40a1-8c17-92e628605a2e tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:10.364675 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-25753548-cdc8-40a1-8c17-92e628605a2e tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e" status: 200 len: 1319 microversion: 2.1 time: 0.196217 Jul 25 14:27:10.365265 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 271/579] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:10 2022] GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:10.376737 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a4c8108a-6287-491e-b06e-5909d4117fed tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:10.377565 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a4c8108a-6287-491e-b06e-5909d4117fed tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:10.384533 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a4c8108a-6287-491e-b06e-5909d4117fed tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:10.384982 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a4c8108a-6287-491e-b06e-5909d4117fed tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:10.385963 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a4c8108a-6287-491e-b06e-5909d4117fed tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:10.386677 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a4c8108a-6287-491e-b06e-5909d4117fed tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:10.492513 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cd698032-e0c0-4786-94f2-e9a4b7f5fb79 tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] Action: 'create', calling method: .version_select at 0x7f46879524c0>, body: {"keypair": {"name": "tempest-keypair-296588575", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIayENqK4qKIfkrcxq+0VdhEjunnZmRZB56xLstbwBtfKqZRobD/D66agZfxQNoUJ4zoH5p6e9FUw1eMLRoL2Su8jt59yLEXCJfGUh6B4F2uiH3e3wLvRjs/RFvAMRVcWw=="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:10.515537 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=47 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:10.524678 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-cd698032-e0c0-4786-94f2-e9a4b7f5fb79 tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] Getting quotas for project 780f954ec6f541e2b2eaf334a30c8085. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:27:10.531854 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-cd698032-e0c0-4786-94f2-e9a4b7f5fb79 tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] Getting quotas for user a6457c30507d4cad8e4a779a2952f4c3 and project 780f954ec6f541e2b2eaf334a30c8085. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:27:10.562896 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cd698032-e0c0-4786-94f2-e9a4b7f5fb79 tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.387824 Jul 25 14:27:10.570507 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 309/580] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:27:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:27:10.573465 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a4c8108a-6287-491e-b06e-5909d4117fed tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:10.576788 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-777c4494-8e69-4859-a0f5-ea2de0c8ee46 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:10.577646 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-777c4494-8e69-4859-a0f5-ea2de0c8ee46 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:10.586190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-777c4494-8e69-4859-a0f5-ea2de0c8ee46 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:10.587163 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-777c4494-8e69-4859-a0f5-ea2de0c8ee46 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:10.587297 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a4c8108a-6287-491e-b06e-5909d4117fed tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1477 microversion: 2.1 time: 0.219883 Jul 25 14:27:10.588346 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 272/581] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:10 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1477 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:10.600728 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-777c4494-8e69-4859-a0f5-ea2de0c8ee46 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:10.601344 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-777c4494-8e69-4859-a0f5-ea2de0c8ee46 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:10.606376 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a789dda9-be8a-4a05-ba5c-c95b4867ac5c tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] Calling method '.version_select at 0x7f46879110d0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:10.625475 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a789dda9-be8a-4a05-ba5c-c95b4867ac5c tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] 10.222.0.88 "GET /compute/v2.1/os-keypairs/tempest-keypair-296588575" status: 200 len: 496 microversion: 2.1 time: 0.036047 Jul 25 14:27:10.626602 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 273/582] 10.222.0.88 () {58 vars in 1215 bytes} [Mon Jul 25 14:27:10 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-296588575 => generated 496 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:10.639792 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0876e5e6-4c1f-4938-8eb7-496cc9c1069d tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] Calling method '.version_select at 0x7f46878f6ee0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:10.668504 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0876e5e6-4c1f-4938-8eb7-496cc9c1069d tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-296588575" status: 202 len: 0 microversion: 2.1 time: 0.034143 Jul 25 14:27:10.669905 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 274/583] 10.222.0.88 () {58 vars in 1218 bytes} [Mon Jul 25 14:27:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-296588575 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:27:10.681715 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-98d5df81-a130-4009-ad7c-bc09b18a23d2 tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] Action: 'create', calling method: .version_select at 0x7f46878d3160>, body: {"keypair": {"name": "tempest-keypair-1245730643", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCHBWq4Li7DTchipayY6OOt57GYZB4cVzEldEkHgvSaKli6Fkt+a06WMnTTOjX16GLRagNmE/KDESlIHxz2wmGxvMIJYVK3wxSM8dY4LfZfF7wW3EfEEsGMEwAU9+Prnw=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:10.700708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-98d5df81-a130-4009-ad7c-bc09b18a23d2 tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] Getting quotas for project 780f954ec6f541e2b2eaf334a30c8085. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:27:10.706304 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-98d5df81-a130-4009-ad7c-bc09b18a23d2 tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] Getting quotas for user a6457c30507d4cad8e4a779a2952f4c3 and project 780f954ec6f541e2b2eaf334a30c8085. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:27:10.734130 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-98d5df81-a130-4009-ad7c-bc09b18a23d2 tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056274 Jul 25 14:27:10.735399 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 275/584] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:27:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:27:10.748392 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5e6166cc-195a-48d3-90d0-f29ecc604028 tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] Calling method '.version_select at 0x7f4687938940>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:10.767243 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5e6166cc-195a-48d3-90d0-f29ecc604028 tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1245730643" status: 202 len: 0 microversion: 2.1 time: 0.025451 Jul 25 14:27:10.772045 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 276/585] 10.222.0.88 () {58 vars in 1221 bytes} [Mon Jul 25 14:27:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1245730643 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 14:27:10.777577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9b09dd4c-8e98-4e16-94e7-5e60e79dd884 tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] Action: 'create', calling method: .version_select at 0x7f4687911820>, body: {"keypair": {"name": "tempest-keypair-627910968", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:10.795868 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-9b09dd4c-8e98-4e16-94e7-5e60e79dd884 tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] Getting quotas for project 780f954ec6f541e2b2eaf334a30c8085. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:27:10.802968 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-9b09dd4c-8e98-4e16-94e7-5e60e79dd884 tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] Getting quotas for user a6457c30507d4cad8e4a779a2952f4c3 and project 780f954ec6f541e2b2eaf334a30c8085. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:27:10.832075 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9b09dd4c-8e98-4e16-94e7-5e60e79dd884 tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.058739 Jul 25 14:27:10.832952 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 277/586] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:27:10 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:10.842622 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bd764824-4ed0-4a94-a292-86648d16c93a tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] Calling method '.version_select at 0x7f46879ed8b0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:10.857893 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-777c4494-8e69-4859-a0f5-ea2de0c8ee46 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:10.863628 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bd764824-4ed0-4a94-a292-86648d16c93a tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-627910968" status: 202 len: 0 microversion: 2.1 time: 0.024606 Jul 25 14:27:10.864801 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 278/587] 10.222.0.88 () {58 vars in 1218 bytes} [Mon Jul 25 14:27:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-627910968 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 14:27:10.871444 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-777c4494-8e69-4859-a0f5-ea2de0c8ee46 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1474 microversion: 2.1 time: 0.295707 Jul 25 14:27:10.877688 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a6cf2cfe-6be5-46f5-b9fc-c36ca68490c9 tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] Action: 'create', calling method: .version_select at 0x7f4687938790>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1336415195", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6u1rsLU0aGWsGH3rq2EJRGaTve+wBRPqTWLiPYcUedfJ+6rf2rZEd4n9fLYlmcNn/6mLSQx4EM7IMtzUNF7VlPNlxmjx9Er3SdK4E65aP3YZBJzQYlNBpVgv+G99uOeA=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:10.881442 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 310/588] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:10 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1474 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:10.894920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-a6cf2cfe-6be5-46f5-b9fc-c36ca68490c9 tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] Getting quotas for project 780f954ec6f541e2b2eaf334a30c8085. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:27:10.900376 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-a6cf2cfe-6be5-46f5-b9fc-c36ca68490c9 tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] Getting quotas for user a6457c30507d4cad8e4a779a2952f4c3 and project 780f954ec6f541e2b2eaf334a30c8085. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:27:10.903262 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=10,nova_api:INSERT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:10.913292 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3954101c-83b7-4b67-bf28-88d42aec5832 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:10.914324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3954101c-83b7-4b67-bf28-88d42aec5832 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 04c1923b-e18a-408f-99b1-62d86feb25a1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:10.926196 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3954101c-83b7-4b67-bf28-88d42aec5832 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:10.926768 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3954101c-83b7-4b67-bf28-88d42aec5832 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:10.928427 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3954101c-83b7-4b67-bf28-88d42aec5832 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:10.928895 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3954101c-83b7-4b67-bf28-88d42aec5832 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:10.934498 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a6cf2cfe-6be5-46f5-b9fc-c36ca68490c9 tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.061424 Jul 25 14:27:10.935280 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 279/589] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:27:10 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:10.946813 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-3954101c-83b7-4b67-bf28-88d42aec5832 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] HTTP exception thrown: Instance 04c1923b-e18a-408f-99b1-62d86feb25a1 could not be found. Jul 25 14:27:10.948728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7d61aaaf-b282-43d3-bb7c-79331737aa0c tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] Action: 'create', calling method: .version_select at 0x7f4687938af0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1852811147", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGVAdVdUU4NEXewRwGBjx/fahecc8GJyVYsnVr6LRiZ/x7ecZgE5/PsA+/Xnp9ThiBZzcdsjLS8Nc2huqj2lE3mfpy/2TFsIQ4WdcmaS/Hh+unK3IzGTAJb/L8b7suEJ6Q=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:10.949262 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3954101c-83b7-4b67-bf28-88d42aec5832 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Request method failure captured: Jul 25 14:27:10.949262 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1 HTTP/1.1 Jul 25 14:27:10.949262 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:27:10.949262 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:27:10.949262 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:27:10.949262 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:27:10.949262 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:27:10.949262 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:27:10.949262 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:27:10.949262 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:27:10.949262 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qgcGc2RjkaZaGa63-PPdbCX4s7H2xWtuYRqlF0JWR61IUGzx74RHc-m8TJT-_RdlH0tQcWSd5UK3Q-O0K9ctQCv8954sZsqJWdlZOw1b7jo_qk8Zk2eLIrhbYh_u9wxQIss6t5T5Ti1Es5U9sr0YdlFFb4d-omgDGqaIN2Ib47NRJM Jul 25 14:27:10.949262 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:27:10.949262 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:27:10.949262 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:27:10.949262 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:27:10.949262 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:27:10.949262 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:27:10.949262 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: c0116982ed03475097096c73b5f03035 Jul 25 14:27:10.949262 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:27:10.949262 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:27:10.949262 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:27:10.950689 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0116982ed03475097096c73b5f03035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0116982ed03475097096c73b5f03035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0116982ed03475097096c73b5f03035", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0116982ed03475097096c73b5f03035"}]}] Jul 25 14:27:10.950689 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:27:10.950689 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: c0116982ed03475097096c73b5f03035 Jul 25 14:27:10.950689 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:27:10.950689 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ImagesOneServerNegativeTestJSON-745484288-project Jul 25 14:27:10.950689 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:27:10.950689 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:27:10.950689 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: f1b1656f2dcd4ffebac55bf18110ff63 Jul 25 14:27:10.950689 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-745484288-project Jul 25 14:27:10.950689 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:27:10.950689 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 04c1923b-e18a-408f-99b1-62d86feb25a1 could not be found. Jul 25 14:27:10.950689 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '04c1923b-e18a-408f-99b1-62d86feb25a1'} Jul 25 14:27:10.951476 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:27:10.951476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:10.951476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:27:10.951476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:27:10.951476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:27:10.951476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:27:10.951476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:27:10.951476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:27:10.951476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:27:10.951476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:27:10.951476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04c1923b-e18a-408f-99b1-62d86feb25a1 could not be found. Jul 25 14:27:10.951476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:10.951476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:10.951476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:10.951476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:10.951476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:10.951476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:10.951476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:27:10.951476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:27:10.951476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:27:10.953239 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:27:10.953239 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:27:10.953239 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:27:10.953239 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:27:10.953239 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:27:10.953239 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:27:10.953239 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:27:10.953239 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04c1923b-e18a-408f-99b1-62d86feb25a1 could not be found. Jul 25 14:27:10.953239 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:10.953239 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:10.953239 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:10.953239 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:10.953239 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:10.953239 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:10.953239 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:27:10.953239 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:27:10.953239 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04c1923b-e18a-408f-99b1-62d86feb25a1 could not be found. Jul 25 14:27:10.953239 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:10.954735 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3954101c-83b7-4b67-bf28-88d42aec5832 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Returning 404 to user: Instance 04c1923b-e18a-408f-99b1-62d86feb25a1 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:27:10.954735 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3954101c-83b7-4b67-bf28-88d42aec5832 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1" status: 404 len: 111 microversion: 2.1 time: 0.044247 Jul 25 14:27:10.954735 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 311/590] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:10 2022] GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:27:10.966173 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b2f72c00-208d-4e39-8347-de2d2649b0c8 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Action: 'create', calling method: .version_select at 0x7f4687976310>, body: {"keypair": {"name": "tempest-keypair-1262065392", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTlnI3aq5evIoOhkrcQHVxbHVlLRLdlo1CBn5+cE+VNSgOn3/QbU1gaXk4D9fyllfWHYzB1lcjRz8YHYtWChTWpmv5EGKXTPhfQ1CaBKNXIxk/kcvpPXotPwMCt4NN4Vg=="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:10.971964 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-7d61aaaf-b282-43d3-bb7c-79331737aa0c tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] Getting quotas for project 780f954ec6f541e2b2eaf334a30c8085. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:27:10.979220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-7d61aaaf-b282-43d3-bb7c-79331737aa0c tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] Getting quotas for user a6457c30507d4cad8e4a779a2952f4c3 and project 780f954ec6f541e2b2eaf334a30c8085. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:27:10.986838 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-b2f72c00-208d-4e39-8347-de2d2649b0c8 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Getting quotas for project c0116982ed03475097096c73b5f03035. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:27:10.994732 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-b2f72c00-208d-4e39-8347-de2d2649b0c8 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Getting quotas for user f1b1656f2dcd4ffebac55bf18110ff63 and project c0116982ed03475097096c73b5f03035. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:27:11.010488 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7d61aaaf-b282-43d3-bb7c-79331737aa0c tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.065681 Jul 25 14:27:11.018228 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:11.020147 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 280/591] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:27:10 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:11.027877 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-df90bb2d-c28c-45ea-9b54-de1ebe535429 tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] Action: 'create', calling method: .version_select at 0x7f46879ed820>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-109023505", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuvNPMYadDUPnMQmBz3AXx9heoXWGUiHY8cRXeYNd/9JBI/EPzrUh7XkkL2hmy8xOnNX3A7kirKIh/9SG2Jl/X3ecoG2u2f6QE+uxgygjs7OYWs5o496HhtnbPsPKGZvw=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:11.042457 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b2f72c00-208d-4e39-8347-de2d2649b0c8 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.081215 Jul 25 14:27:11.043668 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 312/592] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:27:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:27:11.045182 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-df90bb2d-c28c-45ea-9b54-de1ebe535429 tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] Getting quotas for project 780f954ec6f541e2b2eaf334a30c8085. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:27:11.054524 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-df90bb2d-c28c-45ea-9b54-de1ebe535429 tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] Getting quotas for user a6457c30507d4cad8e4a779a2952f4c3 and project 780f954ec6f541e2b2eaf334a30c8085. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:27:11.075661 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-697984ff-d4ad-4b4a-8fa4-4f1831edc3fc tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:11.076569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-697984ff-d4ad-4b4a-8fa4-4f1831edc3fc tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: c2ea60b9-dff6-4ee9-8004-680327fa2f96] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:11.083701 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-697984ff-d4ad-4b4a-8fa4-4f1831edc3fc tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:11.084611 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-697984ff-d4ad-4b4a-8fa4-4f1831edc3fc tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:11.085555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-697984ff-d4ad-4b4a-8fa4-4f1831edc3fc tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:11.086213 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-697984ff-d4ad-4b4a-8fa4-4f1831edc3fc tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:11.090566 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-df90bb2d-c28c-45ea-9b54-de1ebe535429 tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.066985 Jul 25 14:27:11.091555 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 281/593] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:27:11 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:11.103154 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1c5aba92-1730-43a3-b657-e51b173be696 tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] Calling method '.version_select at 0x7f46878f3f70>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:11.116513 n-d-846435-14 devstack@n-api.service[119303]: WARNING oslo_db.sqlalchemy.utils [None req-1c5aba92-1730-43a3-b657-e51b173be696 tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 25 14:27:11.133648 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1c5aba92-1730-43a3-b657-e51b173be696 tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] 10.222.0.88 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.035689 Jul 25 14:27:11.134970 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 282/594] 10.222.0.88 () {58 vars in 1137 bytes} [Mon Jul 25 14:27:11 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:11.145334 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9aa34b7c-08f1-4135-a8f2-30c7c2b49636 tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] Calling method '.version_select at 0x7f46878f3550>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:11.182536 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9aa34b7c-08f1-4135-a8f2-30c7c2b49636 tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-109023505" status: 202 len: 0 microversion: 2.1 time: 0.041252 Jul 25 14:27:11.183321 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 283/595] 10.222.0.88 () {58 vars in 1275 bytes} [Mon Jul 25 14:27:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-109023505 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 14:27:11.190962 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-697984ff-d4ad-4b4a-8fa4-4f1831edc3fc tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:11.191641 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d4903a6c-0188-4de7-9052-874bad069067 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:11.193202 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d4903a6c-0188-4de7-9052-874bad069067 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: fca96a8a-7721-4bbc-8ffa-b732ef5d753d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:11.203651 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d4903a6c-0188-4de7-9052-874bad069067 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:11.205098 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d4903a6c-0188-4de7-9052-874bad069067 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:11.206190 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d4903a6c-0188-4de7-9052-874bad069067 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:11.206823 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d4903a6c-0188-4de7-9052-874bad069067 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:11.209473 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-697984ff-d4ad-4b4a-8fa4-4f1831edc3fc tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96" status: 200 len: 1279 microversion: 2.1 time: 0.135842 Jul 25 14:27:11.220704 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 313/596] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:11 2022] GET /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96 => generated 1279 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:27:11.220704 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-21f38321-b7f2-4af7-8bcb-494692c7b399 tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] Calling method '.version_select at 0x7f46878d9700>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:11.236799 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:11.243372 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-21f38321-b7f2-4af7-8bcb-494692c7b399 tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1852811147" status: 202 len: 0 microversion: 2.1 time: 0.031281 Jul 25 14:27:11.245676 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 314/597] 10.222.0.88 () {58 vars in 1278 bytes} [Mon Jul 25 14:27:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1852811147 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:27:11.253268 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f8990006-3a3c-4800-9c17-872c888cb7c4 tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] Calling method '.version_select at 0x7f468790f3a0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:11.276423 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f8990006-3a3c-4800-9c17-872c888cb7c4 tempest-KeyPairsV2TestJSON-507530687 tempest-KeyPairsV2TestJSON-507530687-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1336415195" status: 202 len: 0 microversion: 2.1 time: 0.027520 Jul 25 14:27:11.277434 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 315/598] 10.222.0.88 () {58 vars in 1278 bytes} [Mon Jul 25 14:27:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1336415195 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:27:11.387762 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-792c3d29-65bd-4657-9b08-f0377beb3ab9 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:11.388400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-792c3d29-65bd-4657-9b08-f0377beb3ab9 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: b6ed0cc6-bfeb-4148-a017-69d0eedad83e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:11.399930 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-792c3d29-65bd-4657-9b08-f0377beb3ab9 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:11.401229 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-792c3d29-65bd-4657-9b08-f0377beb3ab9 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:11.403377 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-792c3d29-65bd-4657-9b08-f0377beb3ab9 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:11.404158 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-792c3d29-65bd-4657-9b08-f0377beb3ab9 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:11.466686 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d4903a6c-0188-4de7-9052-874bad069067 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:11.479059 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d4903a6c-0188-4de7-9052-874bad069067 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d" status: 200 len: 1388 microversion: 2.1 time: 0.293957 Jul 25 14:27:11.480240 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 284/599] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:11 2022] GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d => generated 1388 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:11.611294 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1ccd40d2-9c7b-4067-a57f-a8ee302646cf tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:11.612040 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1ccd40d2-9c7b-4067-a57f-a8ee302646cf tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:11.619700 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ccd40d2-9c7b-4067-a57f-a8ee302646cf tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:11.620459 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ccd40d2-9c7b-4067-a57f-a8ee302646cf tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:11.621792 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ccd40d2-9c7b-4067-a57f-a8ee302646cf tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:11.622240 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ccd40d2-9c7b-4067-a57f-a8ee302646cf tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:11.710932 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-792c3d29-65bd-4657-9b08-f0377beb3ab9 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:11.724620 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-792c3d29-65bd-4657-9b08-f0377beb3ab9 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e" status: 200 len: 1319 microversion: 2.1 time: 0.342347 Jul 25 14:27:11.725824 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 316/600] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:11 2022] GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e => generated 1319 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:11.910774 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-45fb759b-9a31-49a8-8428-2fd3519dfd16 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:11.916893 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-45fb759b-9a31-49a8-8428-2fd3519dfd16 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:11.931654 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45fb759b-9a31-49a8-8428-2fd3519dfd16 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:11.933781 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45fb759b-9a31-49a8-8428-2fd3519dfd16 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:11.937680 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45fb759b-9a31-49a8-8428-2fd3519dfd16 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:11.939349 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45fb759b-9a31-49a8-8428-2fd3519dfd16 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:12.243708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1ccd40d2-9c7b-4067-a57f-a8ee302646cf tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:12.259210 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1ccd40d2-9c7b-4067-a57f-a8ee302646cf tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1477 microversion: 2.1 time: 0.651581 Jul 25 14:27:12.259809 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 285/601] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:11 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1477 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:27:12.264400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9271d496-a1f1-4464-b91f-53c33fa72f6d tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:12.274364 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9271d496-a1f1-4464-b91f-53c33fa72f6d tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: c2ea60b9-dff6-4ee9-8004-680327fa2f96] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:12.286194 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9271d496-a1f1-4464-b91f-53c33fa72f6d tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:12.286877 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9271d496-a1f1-4464-b91f-53c33fa72f6d tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:12.287926 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9271d496-a1f1-4464-b91f-53c33fa72f6d tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:12.288641 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9271d496-a1f1-4464-b91f-53c33fa72f6d tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:12.449384 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-45fb759b-9a31-49a8-8428-2fd3519dfd16 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:12.459280 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-45fb759b-9a31-49a8-8428-2fd3519dfd16 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1474 microversion: 2.1 time: 0.567186 Jul 25 14:27:12.460949 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 317/602] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:11 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1474 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:12.480928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-3f750f05-fff3-4854-ab83-5d39475fd371 req-a6478d53-7fa0-45c3-bf8e-c5da85ea96f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c25476ab-b697-45f9-aa22-ead2d1b23fc7", "name": "network-vif-unplugged", "status": "completed", "tag": "c69d5fca-fc3b-4290-b9b5-09a0bbddbbc9"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:12.494739 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-3f750f05-fff3-4854-ab83-5d39475fd371 req-a6478d53-7fa0-45c3-bf8e-c5da85ea96f5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:12.495464 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-3f750f05-fff3-4854-ab83-5d39475fd371 req-a6478d53-7fa0-45c3-bf8e-c5da85ea96f5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:12.516200 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-3f750f05-fff3-4854-ab83-5d39475fd371 req-a6478d53-7fa0-45c3-bf8e-c5da85ea96f5 service nova] Creating event network-vif-unplugged:c69d5fca-fc3b-4290-b9b5-09a0bbddbbc9 for instance c25476ab-b697-45f9-aa22-ead2d1b23fc7 on n-h1-846435-14 Jul 25 14:27:12.524186 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-3f750f05-fff3-4854-ab83-5d39475fd371 req-a6478d53-7fa0-45c3-bf8e-c5da85ea96f5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057936 Jul 25 14:27:12.524186 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 318/603] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:12.526796 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-14caffe2-2345-41ab-82bc-9b62e6becf9c tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:12.527545 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-14caffe2-2345-41ab-82bc-9b62e6becf9c tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: fca96a8a-7721-4bbc-8ffa-b732ef5d753d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:12.535942 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-14caffe2-2345-41ab-82bc-9b62e6becf9c tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:12.536510 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-14caffe2-2345-41ab-82bc-9b62e6becf9c tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:12.537422 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-14caffe2-2345-41ab-82bc-9b62e6becf9c tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:12.537895 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-14caffe2-2345-41ab-82bc-9b62e6becf9c tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:12.899874 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-14caffe2-2345-41ab-82bc-9b62e6becf9c tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:12.915321 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-14caffe2-2345-41ab-82bc-9b62e6becf9c tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d" status: 200 len: 1388 microversion: 2.1 time: 0.392609 Jul 25 14:27:12.929574 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 319/604] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:12 2022] GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d => generated 1388 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:12.934739 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-69a43ed2-0091-4885-a920-40732751b145 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:12.943342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-69a43ed2-0091-4885-a920-40732751b145 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: b6ed0cc6-bfeb-4148-a017-69d0eedad83e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:12.949892 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69a43ed2-0091-4885-a920-40732751b145 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:12.950546 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69a43ed2-0091-4885-a920-40732751b145 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:12.951604 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69a43ed2-0091-4885-a920-40732751b145 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:12.959821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69a43ed2-0091-4885-a920-40732751b145 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:13.010478 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9271d496-a1f1-4464-b91f-53c33fa72f6d tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:13.019384 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9271d496-a1f1-4464-b91f-53c33fa72f6d tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96" status: 200 len: 1321 microversion: 2.1 time: 0.758193 Jul 25 14:27:13.020824 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 286/605] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:12 2022] GET /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96 => generated 1321 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:13.278772 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-69a43ed2-0091-4885-a920-40732751b145 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:13.284983 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cbef81c2-9072-4ea6-993a-11a0f50cbf05 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:13.289357 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cbef81c2-9072-4ea6-993a-11a0f50cbf05 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:13.299240 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-69a43ed2-0091-4885-a920-40732751b145 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e" status: 200 len: 1319 microversion: 2.1 time: 0.368226 Jul 25 14:27:13.318156 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cbef81c2-9072-4ea6-993a-11a0f50cbf05 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:13.319075 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 320/606] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:12 2022] GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e => generated 1319 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:13.320412 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cbef81c2-9072-4ea6-993a-11a0f50cbf05 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:13.321513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cbef81c2-9072-4ea6-993a-11a0f50cbf05 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:13.322196 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cbef81c2-9072-4ea6-993a-11a0f50cbf05 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:13.481652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-89584171-d8e6-4520-a882-3bd07da327b5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:13.482262 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-89584171-d8e6-4520-a882-3bd07da327b5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:13.488575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-89584171-d8e6-4520-a882-3bd07da327b5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:13.489319 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-89584171-d8e6-4520-a882-3bd07da327b5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:13.490095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-89584171-d8e6-4520-a882-3bd07da327b5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:13.490509 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-89584171-d8e6-4520-a882-3bd07da327b5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:13.873157 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cbef81c2-9072-4ea6-993a-11a0f50cbf05 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:13.882913 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cbef81c2-9072-4ea6-993a-11a0f50cbf05 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1477 microversion: 2.1 time: 0.601686 Jul 25 14:27:13.888800 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 287/607] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:13 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1477 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:13.890354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-89584171-d8e6-4520-a882-3bd07da327b5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:13.899357 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-89584171-d8e6-4520-a882-3bd07da327b5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1474 microversion: 2.1 time: 0.421436 Jul 25 14:27:13.901968 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 321/608] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:13 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1474 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:27:13.905427 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-bcb07835-7c12-45d5-bb39-a92f344f13b9 req-569f5900-aeaf-4a3d-9795-a2cd2ccf286d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2ea60b9-dff6-4ee9-8004-680327fa2f96", "tag": "83f3c285-c7d1-4407-9b2d-044ccf989207"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:13.939173 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cc972736-d847-46d4-b43a-0d8ac15af4e5 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:13.939717 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-bcb07835-7c12-45d5-bb39-a92f344f13b9 req-569f5900-aeaf-4a3d-9795-a2cd2ccf286d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:13.939836 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-bcb07835-7c12-45d5-bb39-a92f344f13b9 req-569f5900-aeaf-4a3d-9795-a2cd2ccf286d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:13.940315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cc972736-d847-46d4-b43a-0d8ac15af4e5 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: fca96a8a-7721-4bbc-8ffa-b732ef5d753d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:13.953641 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cc972736-d847-46d4-b43a-0d8ac15af4e5 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:13.954886 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cc972736-d847-46d4-b43a-0d8ac15af4e5 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:13.957698 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-bcb07835-7c12-45d5-bb39-a92f344f13b9 req-569f5900-aeaf-4a3d-9795-a2cd2ccf286d service nova] Creating event network-changed:83f3c285-c7d1-4407-9b2d-044ccf989207 for instance c2ea60b9-dff6-4ee9-8004-680327fa2f96 on n-h1-846435-14 Jul 25 14:27:13.959135 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cc972736-d847-46d4-b43a-0d8ac15af4e5 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:13.960030 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cc972736-d847-46d4-b43a-0d8ac15af4e5 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:13.964685 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-bcb07835-7c12-45d5-bb39-a92f344f13b9 req-569f5900-aeaf-4a3d-9795-a2cd2ccf286d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074272 Jul 25 14:27:13.965942 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 288/609] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:14.042879 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f319bda1-7366-42c1-b7b7-0e0ce0a00698 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:14.044485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f319bda1-7366-42c1-b7b7-0e0ce0a00698 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: c2ea60b9-dff6-4ee9-8004-680327fa2f96] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:14.052367 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f319bda1-7366-42c1-b7b7-0e0ce0a00698 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:14.053032 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f319bda1-7366-42c1-b7b7-0e0ce0a00698 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:14.054136 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f319bda1-7366-42c1-b7b7-0e0ce0a00698 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:14.054807 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f319bda1-7366-42c1-b7b7-0e0ce0a00698 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:14.697903 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f319bda1-7366-42c1-b7b7-0e0ce0a00698 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:14.718154 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f319bda1-7366-42c1-b7b7-0e0ce0a00698 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96" status: 200 len: 1321 microversion: 2.1 time: 0.680145 Jul 25 14:27:14.721121 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 289/610] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:14 2022] GET /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96 => generated 1321 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:14.730653 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-16f43250-cbc1-4572-9f72-f05827292a21 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:14.731578 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-16f43250-cbc1-4572-9f72-f05827292a21 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: b6ed0cc6-bfeb-4148-a017-69d0eedad83e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:14.760237 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cc972736-d847-46d4-b43a-0d8ac15af4e5 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:14.777287 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cc972736-d847-46d4-b43a-0d8ac15af4e5 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d" status: 200 len: 1388 microversion: 2.1 time: 0.844364 Jul 25 14:27:14.778268 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-16f43250-cbc1-4572-9f72-f05827292a21 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:14.778457 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 322/611] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:13 2022] GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d => generated 1388 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:14.779205 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-16f43250-cbc1-4572-9f72-f05827292a21 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:14.782759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-16f43250-cbc1-4572-9f72-f05827292a21 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:14.784738 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-16f43250-cbc1-4572-9f72-f05827292a21 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:14.792230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-8c025c64-0e26-4fa8-941b-34ae756a1a78 req-6bb73c96-ea87-4568-a176-4bdec46cf2b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c25476ab-b697-45f9-aa22-ead2d1b23fc7", "name": "network-vif-plugged", "status": "completed", "tag": "c69d5fca-fc3b-4290-b9b5-09a0bbddbbc9"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:14.848487 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-8c025c64-0e26-4fa8-941b-34ae756a1a78 req-6bb73c96-ea87-4568-a176-4bdec46cf2b9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:14.850809 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-8c025c64-0e26-4fa8-941b-34ae756a1a78 req-6bb73c96-ea87-4568-a176-4bdec46cf2b9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:14.890418 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-8c025c64-0e26-4fa8-941b-34ae756a1a78 req-6bb73c96-ea87-4568-a176-4bdec46cf2b9 service nova] Creating event network-vif-plugged:c69d5fca-fc3b-4290-b9b5-09a0bbddbbc9 for instance c25476ab-b697-45f9-aa22-ead2d1b23fc7 on n-h1-846435-14 Jul 25 14:27:14.904284 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-8c025c64-0e26-4fa8-941b-34ae756a1a78 req-6bb73c96-ea87-4568-a176-4bdec46cf2b9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123565 Jul 25 14:27:14.904883 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 323/612] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:14.920759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-417f2a77-05a8-4529-931c-d1e25c1d1f1b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:14.921811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-417f2a77-05a8-4529-931c-d1e25c1d1f1b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:14.945764 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-417f2a77-05a8-4529-931c-d1e25c1d1f1b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:14.946367 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-417f2a77-05a8-4529-931c-d1e25c1d1f1b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:14.947397 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-417f2a77-05a8-4529-931c-d1e25c1d1f1b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:14.948206 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-417f2a77-05a8-4529-931c-d1e25c1d1f1b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:15.042978 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:15.400997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-16f43250-cbc1-4572-9f72-f05827292a21 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:15.409531 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-16f43250-cbc1-4572-9f72-f05827292a21 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e" status: 200 len: 1319 microversion: 2.1 time: 0.685920 Jul 25 14:27:15.412969 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 290/613] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:14 2022] GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e => generated 1319 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:15.428035 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-60e32dcc-9821-43ff-bb5e-e339257267f7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:15.428979 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-60e32dcc-9821-43ff-bb5e-e339257267f7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:15.447732 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-60e32dcc-9821-43ff-bb5e-e339257267f7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:15.448428 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-60e32dcc-9821-43ff-bb5e-e339257267f7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:15.449169 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-60e32dcc-9821-43ff-bb5e-e339257267f7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:15.449608 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-60e32dcc-9821-43ff-bb5e-e339257267f7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:15.451825 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-417f2a77-05a8-4529-931c-d1e25c1d1f1b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:15.465224 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-417f2a77-05a8-4529-931c-d1e25c1d1f1b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1477 microversion: 2.1 time: 0.553401 Jul 25 14:27:15.468815 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 324/614] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:14 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1477 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:15.633363 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4a6a93ad-4872-4674-87db-8ec57c9d5429 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Action: 'create', calling method: .version_select at 0x7f46878d95e0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMS7eZGfzYNGeucD3VofcIRTd3B0eIuTaRPlPI0OwLfYYdsRTR89a0SUY2/BDSfY6/Qy9p2hqyj2Duf3L+uF5qnMlbWSyAg5qC4hvAsPr8x2JR/wCmM7Ff/HvIG1JR8ZQ=="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:15.640447 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-4a6a93ad-4872-4674-87db-8ec57c9d5429 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jul 25 14:27:15.643649 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4a6a93ad-4872-4674-87db-8ec57c9d5429 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Request method failure captured: Jul 25 14:27:15.643649 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 25 14:27:15.643649 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:27:15.643649 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:27:15.643649 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:27:15.643649 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 257 Jul 25 14:27:15.643649 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:27:15.643649 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:27:15.643649 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:27:15.643649 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:27:15.643649 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qhDcNcPzi3aavbZvan7KCQfQ979IXtlqtq1C3UqanqSqAtiZY1LnI2z0RIUHqhWhB9MVCU-s_SObCGvRn4aG5Nztcq0pfwy6sajMdU6-cDMu1eb5vRkrdypkGroCF601T29exOb-WmWrEpn8WXj-0HsGJytaHeRjrdia4cFCvDPkJQ Jul 25 14:27:15.643649 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:27:15.643649 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:27:15.643649 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:27:15.643649 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:27:15.643649 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:27:15.643649 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:27:15.643649 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: c0c2b3eaa0f54a32970cfd0976f5c0ac Jul 25 14:27:15.643649 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1965683114 Jul 25 14:27:15.643649 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:27:15.643649 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:27:15.645216 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0c2b3eaa0f54a32970cfd0976f5c0ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0c2b3eaa0f54a32970cfd0976f5c0ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0c2b3eaa0f54a32970cfd0976f5c0ac", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0c2b3eaa0f54a32970cfd0976f5c0ac"}]}] Jul 25 14:27:15.645216 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1965683114 Jul 25 14:27:15.645216 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: c0c2b3eaa0f54a32970cfd0976f5c0ac Jul 25 14:27:15.645216 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1965683114 Jul 25 14:27:15.645216 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-KeyPairsNegativeTestJSON-1965683114-project Jul 25 14:27:15.645216 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:27:15.645216 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:27:15.645216 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: d96225f9d6fe4598a7014ed533aa4c3a Jul 25 14:27:15.645216 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1965683114-project Jul 25 14:27:15.645216 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:27:15.645216 n-d-846435-14 devstack@n-api.service[119304]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMS7eZGfzYNGeucD3VofcIRTd3B0eIuTaRPlPI0OwLfYYdsRTR89a0SUY2/BDSfY6/Qy9p2hqyj2Duf3L+uF5qnMlbWSyAg5qC4hvAsPr8x2JR/wCmM7Ff/HvIG1JR8ZQ=="}} Jul 25 14:27:15.645216 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:27:15.646647 n-d-846435-14 devstack@n-api.service[119304]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jul 25 14:27:15.646647 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMS7eZGfzYNGeucD3VofcIRTd3B0eIuTaRPlPI0OwLfYYdsRTR89a0SUY2/BDSfY6/Qy9p2hqyj2Duf3L+uF5qnMlbWSyAg5qC4hvAsPr8x2JR/wCmM7Ff/HvIG1JR8ZQ=='}}} Jul 25 14:27:15.646647 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:27:15.646647 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:15.646647 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 25 14:27:15.646647 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 25 14:27:15.646647 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 14:27:15.646647 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 14:27:15.646647 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:27:15.646647 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:27:15.646647 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:27:15.646647 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:27:15.646647 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 14:27:15.646647 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 14:27:15.646647 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jul 25 14:27:15.646647 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jul 25 14:27:15.646647 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jul 25 14:27:15.646647 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 25 14:27:15.647930 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jul 25 14:27:15.647930 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:15.647930 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:15.647930 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:15.647930 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:15.647930 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:15.647930 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:15.647930 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:27:15.647930 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:27:15.647930 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:27:15.647930 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:27:15.647930 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:27:15.647930 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:27:15.647930 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:27:15.647930 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:27:15.647930 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:27:15.647930 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:27:15.647930 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 25 14:27:15.647930 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 25 14:27:15.647930 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 25 14:27:15.649310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 25 14:27:15.649310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jul 25 14:27:15.649310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:15.649310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:15.649310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:15.649310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:15.649310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:15.649310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:15.649310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:27:15.649310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:27:15.649310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jul 25 14:27:15.649310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:15.653087 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4a6a93ad-4872-4674-87db-8ec57c9d5429 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:27:15.654461 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4a6a93ad-4872-4674-87db-8ec57c9d5429 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.184246 Jul 25 14:27:15.655786 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 325/615] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:27:15 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 186 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:27:15.660808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-13b09311-2126-4441-8374-4950a087e4ec req-125d3c89-0367-4580-a384-b56612e2cff5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6ed0cc6-bfeb-4148-a017-69d0eedad83e", "tag": "9ed86ee9-b2e4-4fa1-86f9-082e0978d084"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:15.675816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-13b09311-2126-4441-8374-4950a087e4ec req-125d3c89-0367-4580-a384-b56612e2cff5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:15.676224 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-13b09311-2126-4441-8374-4950a087e4ec req-125d3c89-0367-4580-a384-b56612e2cff5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:15.687435 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-13b09311-2126-4441-8374-4950a087e4ec req-125d3c89-0367-4580-a384-b56612e2cff5 service nova] Creating event network-changed:9ed86ee9-b2e4-4fa1-86f9-082e0978d084 for instance b6ed0cc6-bfeb-4148-a017-69d0eedad83e on n-h2-846435-14 Jul 25 14:27:15.692730 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-13b09311-2126-4441-8374-4950a087e4ec req-125d3c89-0367-4580-a384-b56612e2cff5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035219 Jul 25 14:27:15.693888 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 326/616] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:15.698803 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5605d409-4614-46e7-a1e5-7ab41f526a19 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-501024659", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:15.768739 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-5605d409-4614-46e7-a1e5-7ab41f526a19 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] validate_networks() for [('d3c7e613-177d-41cb-9892-a283b29284d3', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:27:15.957722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-60e32dcc-9821-43ff-bb5e-e339257267f7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:15.973236 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-60e32dcc-9821-43ff-bb5e-e339257267f7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1474 microversion: 2.1 time: 0.558975 Jul 25 14:27:15.973838 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 291/617] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:15 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1474 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:15.999674 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bca9ad7e-0f2d-4ec9-846f-1c9582ffd79c tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Action: 'create', calling method: .version_select at 0x7f4687911c10>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2122500907", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:16.023811 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-bca9ad7e-0f2d-4ec9-846f-1c9582ffd79c tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Getting quotas for project c0c2b3eaa0f54a32970cfd0976f5c0ac. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:27:16.029948 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-bca9ad7e-0f2d-4ec9-846f-1c9582ffd79c tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Getting quotas for user d96225f9d6fe4598a7014ed533aa4c3a and project c0c2b3eaa0f54a32970cfd0976f5c0ac. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:27:16.054244 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-bca9ad7e-0f2d-4ec9-846f-1c9582ffd79c tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bca9ad7e-0f2d-4ec9-846f-1c9582ffd79c tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Request method failure captured: Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 2167 Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qhDcNcPzi3aavbZvan7KCQfQ979IXtlqtq1C3UqanqSqAtiZY1LnI2z0RIUHqhWhB9MVCU-s_SObCGvRn4aG5Nztcq0pfwy6sajMdU6-cDMu1eb5vRkrdypkGroCF601T29exOb-WmWrEpn8WXj-0HsGJytaHeRjrdia4cFCvDPkJQ Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: c0c2b3eaa0f54a32970cfd0976f5c0ac Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1965683114 Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0c2b3eaa0f54a32970cfd0976f5c0ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0c2b3eaa0f54a32970cfd0976f5c0ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0c2b3eaa0f54a32970cfd0976f5c0ac", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0c2b3eaa0f54a32970cfd0976f5c0ac"}]}] Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1965683114 Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: c0c2b3eaa0f54a32970cfd0976f5c0ac Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1965683114 Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-KeyPairsNegativeTestJSON-1965683114-project Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: d96225f9d6fe4598a7014ed533aa4c3a Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1965683114-project Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2122500907", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:27:16.070551 n-d-846435-14 devstack@n-api.service[119303]: exception: Keypair data is invalid: failed to generate fingerprint Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-2122500907', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:27:16.072942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:27:16.075261 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:27:16.075261 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:27:16.075261 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:27:16.075261 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:27:16.075261 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 25 14:27:16.075261 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 25 14:27:16.075261 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 25 14:27:16.075261 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 25 14:27:16.075261 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 25 14:27:16.075261 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:16.075261 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:16.075261 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:16.075261 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:16.075261 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:16.075261 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:16.075261 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:27:16.075261 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:27:16.075261 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 25 14:27:16.075261 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:16.075261 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bca9ad7e-0f2d-4ec9-846f-1c9582ffd79c tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:27:16.075261 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bca9ad7e-0f2d-4ec9-846f-1c9582ffd79c tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.092514 Jul 25 14:27:16.075261 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 292/618] 10.222.0.88 () {60 vars in 1160 bytes} [Mon Jul 25 14:27:15 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 14:27:16.077931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7202d9b1-9878-4afd-b02b-282224186702 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:16.078341 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7202d9b1-9878-4afd-b02b-282224186702 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: c2ea60b9-dff6-4ee9-8004-680327fa2f96] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:16.090220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7202d9b1-9878-4afd-b02b-282224186702 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:16.090670 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7202d9b1-9878-4afd-b02b-282224186702 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:16.092398 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7202d9b1-9878-4afd-b02b-282224186702 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:16.093540 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7202d9b1-9878-4afd-b02b-282224186702 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:16.271080 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-5605d409-4614-46e7-a1e5-7ab41f526a19 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:27:16.271578 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-5605d409-4614-46e7-a1e5-7ab41f526a19 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:27:16.272002 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-5605d409-4614-46e7-a1e5-7ab41f526a19 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:27:16.272460 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-5605d409-4614-46e7-a1e5-7ab41f526a19 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:27:16.272866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-5605d409-4614-46e7-a1e5-7ab41f526a19 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:27:16.282251 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5605d409-4614-46e7-a1e5-7ab41f526a19 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:16.282879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5605d409-4614-46e7-a1e5-7ab41f526a19 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:16.283674 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5605d409-4614-46e7-a1e5-7ab41f526a19 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:16.284164 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5605d409-4614-46e7-a1e5-7ab41f526a19 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:16.291059 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=26 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:16.302775 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-5605d409-4614-46e7-a1e5-7ab41f526a19 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Getting quotas for project c0116982ed03475097096c73b5f03035. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:27:16.308816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-5605d409-4614-46e7-a1e5-7ab41f526a19 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Getting quotas for user f1b1656f2dcd4ffebac55bf18110ff63 and project c0116982ed03475097096c73b5f03035. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:27:16.322561 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5605d409-4614-46e7-a1e5-7ab41f526a19 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:27:16.325750 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5605d409-4614-46e7-a1e5-7ab41f526a19 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:27:16.370326 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5605d409-4614-46e7-a1e5-7ab41f526a19 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.675660 Jul 25 14:27:16.370992 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 327/619] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:27:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:27:16.379435 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-100e275b-e60d-40a3-9f40-39bc36b9be4a tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:16.380270 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-100e275b-e60d-40a3-9f40-39bc36b9be4a tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: fca96a8a-7721-4bbc-8ffa-b732ef5d753d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:16.389323 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-100e275b-e60d-40a3-9f40-39bc36b9be4a tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:16.389804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-100e275b-e60d-40a3-9f40-39bc36b9be4a tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:16.391254 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-100e275b-e60d-40a3-9f40-39bc36b9be4a tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:16.391254 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-100e275b-e60d-40a3-9f40-39bc36b9be4a tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:16.540825 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7202d9b1-9878-4afd-b02b-282224186702 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:16.554418 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7202d9b1-9878-4afd-b02b-282224186702 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96" status: 200 len: 1321 microversion: 2.1 time: 0.480141 Jul 25 14:27:16.572176 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 293/620] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:16 2022] GET /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96 => generated 1321 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:16.572176 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f492baac-77c5-4ed5-ab5f-eb95192df6c4 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Action: 'create', calling method: .version_select at 0x7f4687911e50>, body: {"keypair": {"name": "tempest-keypair-1799527055", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAQ4lii9pK9isELqmAthb/e4Hynh2p5NwlKtA4UnROWMTLFbQczf66sjrKY4eTzeQj66dAblAYI3EWpG0zFGVXj2bBKPxEauJG0tKGuInxdF48GdBovYl3UIJLmz6BSNw=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:16.604646 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-f492baac-77c5-4ed5-ab5f-eb95192df6c4 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Getting quotas for project c0c2b3eaa0f54a32970cfd0976f5c0ac. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:27:16.610884 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-f492baac-77c5-4ed5-ab5f-eb95192df6c4 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Getting quotas for user d96225f9d6fe4598a7014ed533aa4c3a and project c0c2b3eaa0f54a32970cfd0976f5c0ac. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:27:16.648681 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f492baac-77c5-4ed5-ab5f-eb95192df6c4 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.082464 Jul 25 14:27:16.652674 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 294/621] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:27:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:16.660521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-16d5e2f9-5c7b-4448-ab91-5b698b854782 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:16.661375 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-16d5e2f9-5c7b-4448-ab91-5b698b854782 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:16.726847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-100e275b-e60d-40a3-9f40-39bc36b9be4a tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:16.736265 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-100e275b-e60d-40a3-9f40-39bc36b9be4a tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d" status: 200 len: 1388 microversion: 2.1 time: 0.363860 Jul 25 14:27:16.737909 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 328/622] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:16 2022] GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d => generated 1388 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:16.753402 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7ad92576-5cc9-4d6f-8b6b-e411b03eb0dc tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:16.756081 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7ad92576-5cc9-4d6f-8b6b-e411b03eb0dc tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: b6ed0cc6-bfeb-4148-a017-69d0eedad83e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:16.772449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7ad92576-5cc9-4d6f-8b6b-e411b03eb0dc tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:16.773496 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7ad92576-5cc9-4d6f-8b6b-e411b03eb0dc tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:16.774506 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7ad92576-5cc9-4d6f-8b6b-e411b03eb0dc tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:16.775084 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7ad92576-5cc9-4d6f-8b6b-e411b03eb0dc tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:16.780051 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-16d5e2f9-5c7b-4448-ab91-5b698b854782 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:16.798385 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-16d5e2f9-5c7b-4448-ab91-5b698b854782 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9" status: 200 len: 1224 microversion: 2.1 time: 0.143819 Jul 25 14:27:16.799318 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 295/623] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:16 2022] GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 => generated 1224 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:16.805570 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-25fc39f5-8bb1-4b84-87a7-afdbe44f0684 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:16.809208 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-25fc39f5-8bb1-4b84-87a7-afdbe44f0684 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:16.828500 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-25fc39f5-8bb1-4b84-87a7-afdbe44f0684 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:16.829507 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-25fc39f5-8bb1-4b84-87a7-afdbe44f0684 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:16.841830 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-25fc39f5-8bb1-4b84-87a7-afdbe44f0684 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:16.842657 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-25fc39f5-8bb1-4b84-87a7-afdbe44f0684 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:17.105782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7ad92576-5cc9-4d6f-8b6b-e411b03eb0dc tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:17.113970 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7ad92576-5cc9-4d6f-8b6b-e411b03eb0dc tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e" status: 200 len: 1319 microversion: 2.1 time: 0.374747 Jul 25 14:27:17.114551 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 329/624] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:16 2022] GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e => generated 1319 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:17.119260 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-375876fc-5497-414f-91f9-cdc340178e04 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Action: 'create', calling method: .version_select at 0x7f468791c550>, body: {"keypair": {"name": "tempest-keypair-1799527055", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7ElQHB2E8oi6bFwKPev9+/f+8f5Vys3VF++KztnP5ZDvfN4jPM1F4QcgxuR65CTBijjfzDcP37YuwGHCNUh7uazgjw5S0cZjGu1uX4FGTgjnS4L0tC0/uvt3GobE1FSg=="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:17.136851 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-375876fc-5497-414f-91f9-cdc340178e04 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Getting quotas for project c0c2b3eaa0f54a32970cfd0976f5c0ac. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:27:17.142672 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-375876fc-5497-414f-91f9-cdc340178e04 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Getting quotas for user d96225f9d6fe4598a7014ed533aa4c3a and project c0c2b3eaa0f54a32970cfd0976f5c0ac. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:27:17.167813 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-375876fc-5497-414f-91f9-cdc340178e04 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] HTTP exception thrown: Key pair 'tempest-keypair-1799527055' already exists. Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-375876fc-5497-414f-91f9-cdc340178e04 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Request method failure captured: Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 273 Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qhDcNcPzi3aavbZvan7KCQfQ979IXtlqtq1C3UqanqSqAtiZY1LnI2z0RIUHqhWhB9MVCU-s_SObCGvRn4aG5Nztcq0pfwy6sajMdU6-cDMu1eb5vRkrdypkGroCF601T29exOb-WmWrEpn8WXj-0HsGJytaHeRjrdia4cFCvDPkJQ Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: c0c2b3eaa0f54a32970cfd0976f5c0ac Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1965683114 Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0c2b3eaa0f54a32970cfd0976f5c0ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0c2b3eaa0f54a32970cfd0976f5c0ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0c2b3eaa0f54a32970cfd0976f5c0ac", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0c2b3eaa0f54a32970cfd0976f5c0ac"}]}] Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1965683114 Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: c0c2b3eaa0f54a32970cfd0976f5c0ac Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1965683114 Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-KeyPairsNegativeTestJSON-1965683114-project Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: d96225f9d6fe4598a7014ed533aa4c3a Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1965683114-project Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: {"keypair": {"name": "tempest-keypair-1799527055", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7ElQHB2E8oi6bFwKPev9+/f+8f5Vys3VF++KztnP5ZDvfN4jPM1F4QcgxuR65CTBijjfzDcP37YuwGHCNUh7uazgjw5S0cZjGu1uX4FGTgjnS4L0tC0/uvt3GobE1FSg=="}} Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: exception: Key pair 'tempest-keypair-1799527055' already exists. Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1799527055', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7ElQHB2E8oi6bFwKPev9+/f+8f5Vys3VF++KztnP5ZDvfN4jPM1F4QcgxuR65CTBijjfzDcP37YuwGHCNUh7uazgjw5S0cZjGu1uX4FGTgjnS4L0tC0/uvt3GobE1FSg=='}}} Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result.read() Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'd96225f9d6fe4598a7014ed533aa4c3a-tempest-keypair-1799527055' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 25 14:27:17.172601 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi session.flush() Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result.read() Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 25 14:27:17.176287 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'd96225f9d6fe4598a7014ed533aa4c3a-tempest-keypair-1799527055' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 25, 14, 27, 17, 160272), 'updated_at': None, 'name': 'tempest-keypair-1799527055', 'user_id': 'd96225f9d6fe4598a7014ed533aa4c3a', 'fingerprint': '54:cd:33:bc:5e:35:a2:98:ba:58:7e:d8:d7:09:87:99', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7ElQHB2E8oi6bFwKPev9+/f+8f5Vys3VF++KztnP5ZDvfN4jPM1F4QcgxuR65CTBijjfzDcP37YuwGHCNUh7uazgjw5S0cZjGu1uX4FGTgjnS4L0tC0/uvt3GobE1FSg==', 'type': 'ssh'}] Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi keypair.create() Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._create() Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1799527055' already exists. Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jul 25 14:27:17.179397 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1799527055' already exists. Jul 25 14:27:17.185401 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.185401 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:17.185401 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.185401 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:17.185401 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:17.185401 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:17.185401 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:27:17.185401 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:27:17.185401 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1799527055' already exists. Jul 25 14:27:17.185401 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.185401 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-375876fc-5497-414f-91f9-cdc340178e04 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Returning 409 to user: Key pair 'tempest-keypair-1799527055' already exists. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:27:17.185401 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-375876fc-5497-414f-91f9-cdc340178e04 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.069441 Jul 25 14:27:17.189469 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 330/625] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:27:17 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:27:17.196238 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-b67fd028-c5c8-4c82-a5c6-59ee1598cd0a req-dc589da9-e256-433c-b9f2-09bf92324f01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fca96a8a-7721-4bbc-8ffa-b732ef5d753d", "name": "network-vif-plugged", "status": "completed", "tag": "205878ed-21c4-4153-8a87-16c8234dec0f"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:17.206722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-b67fd028-c5c8-4c82-a5c6-59ee1598cd0a req-dc589da9-e256-433c-b9f2-09bf92324f01 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:17.207161 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-b67fd028-c5c8-4c82-a5c6-59ee1598cd0a req-dc589da9-e256-433c-b9f2-09bf92324f01 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:17.220822 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-b67fd028-c5c8-4c82-a5c6-59ee1598cd0a req-dc589da9-e256-433c-b9f2-09bf92324f01 service nova] Creating event network-vif-plugged:205878ed-21c4-4153-8a87-16c8234dec0f for instance fca96a8a-7721-4bbc-8ffa-b732ef5d753d on n-h2-846435-14 Jul 25 14:27:17.226370 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-b67fd028-c5c8-4c82-a5c6-59ee1598cd0a req-dc589da9-e256-433c-b9f2-09bf92324f01 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035506 Jul 25 14:27:17.227289 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 331/626] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:17.232685 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-95ff5d3a-20c2-4585-8ea9-97bbc09e2fd4 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:17.233394 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-95ff5d3a-20c2-4585-8ea9-97bbc09e2fd4 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:17.240619 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-95ff5d3a-20c2-4585-8ea9-97bbc09e2fd4 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:17.240979 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-95ff5d3a-20c2-4585-8ea9-97bbc09e2fd4 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:17.241771 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-95ff5d3a-20c2-4585-8ea9-97bbc09e2fd4 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:17.242203 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-95ff5d3a-20c2-4585-8ea9-97bbc09e2fd4 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:17.284232 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-25fc39f5-8bb1-4b84-87a7-afdbe44f0684 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:17.299085 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-25fc39f5-8bb1-4b84-87a7-afdbe44f0684 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1477 microversion: 2.1 time: 0.497157 Jul 25 14:27:17.302119 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 296/627] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:16 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1477 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:17.310870 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-961e9027-3707-48e9-b766-44e5c32f67d0 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Calling method '.version_select at 0x7f4687911af0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:17.367934 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-961e9027-3707-48e9-b766-44e5c32f67d0 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1799527055" status: 202 len: 0 microversion: 2.1 time: 0.063802 Jul 25 14:27:17.370456 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 297/628] 10.222.0.88 () {58 vars in 1221 bytes} [Mon Jul 25 14:27:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1799527055 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:27:17.385589 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-063d7f80-8054-40de-95ae-1a6476e3db4a tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Action: 'create', calling method: .version_select at 0x7f46878f30d0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsFJcqxGpytbMokkabmnlD6GRTBUObSFGRYQDt3M9IcYBt+ipvD73Xhzovs5m3cCDLb6NiucZ0FUUnmlj+mvpfiSmMDyxDVuZsUe8uDPtlG3XswyHoKmzJtjWGv6/MmhQ=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-063d7f80-8054-40de-95ae-1a6476e3db4a tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Request method failure captured: Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 247 Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qhDcNcPzi3aavbZvan7KCQfQ979IXtlqtq1C3UqanqSqAtiZY1LnI2z0RIUHqhWhB9MVCU-s_SObCGvRn4aG5Nztcq0pfwy6sajMdU6-cDMu1eb5vRkrdypkGroCF601T29exOb-WmWrEpn8WXj-0HsGJytaHeRjrdia4cFCvDPkJQ Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: c0c2b3eaa0f54a32970cfd0976f5c0ac Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1965683114 Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0c2b3eaa0f54a32970cfd0976f5c0ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0c2b3eaa0f54a32970cfd0976f5c0ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0c2b3eaa0f54a32970cfd0976f5c0ac", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0c2b3eaa0f54a32970cfd0976f5c0ac"}]}] Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1965683114 Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: c0c2b3eaa0f54a32970cfd0976f5c0ac Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1965683114 Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-KeyPairsNegativeTestJSON-1965683114-project Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: d96225f9d6fe4598a7014ed533aa4c3a Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1965683114-project Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsFJcqxGpytbMokkabmnlD6GRTBUObSFGRYQDt3M9IcYBt+ipvD73Xhzovs5m3cCDLb6NiucZ0FUUnmlj+mvpfiSmMDyxDVuZsUe8uDPtlG3XswyHoKmzJtjWGv6/MmhQ=="}} Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsFJcqxGpytbMokkabmnlD6GRTBUObSFGRYQDt3M9IcYBt+ipvD73Xhzovs5m3cCDLb6NiucZ0FUUnmlj+mvpfiSmMDyxDVuZsUe8uDPtlG3XswyHoKmzJtjWGv6/MmhQ=='}}} Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi '' Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:27:17.403836 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:27:17.408417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:27:17.408417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:27:17.408417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:27:17.408417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:27:17.408417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 25 14:27:17.408417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.408417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:17.408417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.408417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:17.408417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:17.408417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:17.408417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:27:17.408417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:27:17.408417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 25 14:27:17.408417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.408417 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-063d7f80-8054-40de-95ae-1a6476e3db4a tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:27:17.409489 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-063d7f80-8054-40de-95ae-1a6476e3db4a tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.030467 Jul 25 14:27:17.411652 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 298/629] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:27:17 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:27:17.427059 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a9504050-6ed6-4341-9fbb-b071a6751145 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Action: 'create', calling method: .version_select at 0x7f46878b53a0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-459907719", "public_key": " "}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:17.468225 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-a9504050-6ed6-4341-9fbb-b071a6751145 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Getting quotas for project c0c2b3eaa0f54a32970cfd0976f5c0ac. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:27:17.481307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-a9504050-6ed6-4341-9fbb-b071a6751145 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Getting quotas for user d96225f9d6fe4598a7014ed533aa4c3a and project c0c2b3eaa0f54a32970cfd0976f5c0ac. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:27:17.524893 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-a9504050-6ed6-4341-9fbb-b071a6751145 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a9504050-6ed6-4341-9fbb-b071a6751145 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Request method failure captured: Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 94 Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qhDcNcPzi3aavbZvan7KCQfQ979IXtlqtq1C3UqanqSqAtiZY1LnI2z0RIUHqhWhB9MVCU-s_SObCGvRn4aG5Nztcq0pfwy6sajMdU6-cDMu1eb5vRkrdypkGroCF601T29exOb-WmWrEpn8WXj-0HsGJytaHeRjrdia4cFCvDPkJQ Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: c0c2b3eaa0f54a32970cfd0976f5c0ac Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1965683114 Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0c2b3eaa0f54a32970cfd0976f5c0ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0c2b3eaa0f54a32970cfd0976f5c0ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0c2b3eaa0f54a32970cfd0976f5c0ac", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0c2b3eaa0f54a32970cfd0976f5c0ac"}]}] Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1965683114 Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: c0c2b3eaa0f54a32970cfd0976f5c0ac Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1965683114 Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-KeyPairsNegativeTestJSON-1965683114-project Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: d96225f9d6fe4598a7014ed533aa4c3a Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1965683114-project Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-459907719", "public_key": " "}} Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: exception: Keypair data is invalid: failed to generate fingerprint Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-459907719', 'public_key': ' '}}} Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:17.529410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.534401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:17.534401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:17.534401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:17.534401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:27:17.534401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:27:17.534401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:27:17.534401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:27:17.534401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:27:17.534401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:27:17.534401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:27:17.534401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:27:17.534401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:27:17.534401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:27:17.534401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 25 14:27:17.534401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 25 14:27:17.534401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 25 14:27:17.534401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 25 14:27:17.534401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 25 14:27:17.534401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.534401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:17.534401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.534401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:17.534401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:17.534401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:17.534401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:27:17.534401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:27:17.534401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 25 14:27:17.534401 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.536588 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a9504050-6ed6-4341-9fbb-b071a6751145 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:27:17.538730 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a9504050-6ed6-4341-9fbb-b071a6751145 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.122432 Jul 25 14:27:17.541586 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 299/630] 10.222.0.88 () {60 vars in 1158 bytes} [Mon Jul 25 14:27:17 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 25 14:27:17.561457 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-45649b52-4b5b-4612-80b6-af2933d0afc3 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Action: 'create', calling method: .version_select at 0x7f4687b0ec10>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3HYP9fQEIxJ2kN9vaE7MUeJg5ElGoyPocD2x/N4EG95MMjo0ScR7/iKV991uC501nzjKSnyEzrytgiN8yyr3uUDEHORnUl8qCh49EPRNi9UQOrq1G1ZEZLbcfBRBPPXA=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-45649b52-4b5b-4612-80b6-af2933d0afc3 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Request method failure captured: Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 507 Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qhDcNcPzi3aavbZvan7KCQfQ979IXtlqtq1C3UqanqSqAtiZY1LnI2z0RIUHqhWhB9MVCU-s_SObCGvRn4aG5Nztcq0pfwy6sajMdU6-cDMu1eb5vRkrdypkGroCF601T29exOb-WmWrEpn8WXj-0HsGJytaHeRjrdia4cFCvDPkJQ Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: c0c2b3eaa0f54a32970cfd0976f5c0ac Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1965683114 Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0c2b3eaa0f54a32970cfd0976f5c0ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0c2b3eaa0f54a32970cfd0976f5c0ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0c2b3eaa0f54a32970cfd0976f5c0ac", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0c2b3eaa0f54a32970cfd0976f5c0ac"}]}] Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1965683114 Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: c0c2b3eaa0f54a32970cfd0976f5c0ac Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1965683114 Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-KeyPairsNegativeTestJSON-1965683114-project Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: d96225f9d6fe4598a7014ed533aa4c3a Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1965683114-project Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3HYP9fQEIxJ2kN9vaE7MUeJg5ElGoyPocD2x/N4EG95MMjo0ScR7/iKV991uC501nzjKSnyEzrytgiN8yyr3uUDEHORnUl8qCh49EPRNi9UQOrq1G1ZEZLbcfBRBPPXA=="}} Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3HYP9fQEIxJ2kN9vaE7MUeJg5ElGoyPocD2x/N4EG95MMjo0ScR7/iKV991uC501nzjKSnyEzrytgiN8yyr3uUDEHORnUl8qCh49EPRNi9UQOrq1G1ZEZLbcfBRBPPXA=='}}} Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jul 25 14:27:17.566837 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.570551 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:17.570551 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.570551 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:17.570551 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:17.570551 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:17.570551 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:27:17.570551 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:27:17.570551 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:27:17.570551 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:27:17.570551 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:27:17.570551 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:27:17.570551 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:27:17.570551 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:27:17.570551 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:27:17.570551 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:27:17.570551 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:27:17.570551 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:27:17.570551 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:27:17.570551 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:27:17.570551 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 25 14:27:17.570551 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.570551 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:17.570551 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.570551 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:17.570551 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:17.570551 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:17.570551 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:27:17.570551 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:27:17.570551 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 25 14:27:17.570551 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.570551 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-45649b52-4b5b-4612-80b6-af2933d0afc3 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:27:17.580746 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-45649b52-4b5b-4612-80b6-af2933d0afc3 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.020163 Jul 25 14:27:17.580746 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 300/631] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:27:17 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 14:27:17.587525 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5b93e727-c4df-4f9c-ad34-a8a9e51ea509 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:17.588461 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5b93e727-c4df-4f9c-ad34-a8a9e51ea509 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: c2ea60b9-dff6-4ee9-8004-680327fa2f96] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:17.595267 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5b93e727-c4df-4f9c-ad34-a8a9e51ea509 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:17.595878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5b93e727-c4df-4f9c-ad34-a8a9e51ea509 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:17.596961 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5b93e727-c4df-4f9c-ad34-a8a9e51ea509 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:17.597509 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5b93e727-c4df-4f9c-ad34-a8a9e51ea509 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:17.685265 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-95ff5d3a-20c2-4585-8ea9-97bbc09e2fd4 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:17.705347 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-95ff5d3a-20c2-4585-8ea9-97bbc09e2fd4 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1474 microversion: 2.1 time: 0.476806 Jul 25 14:27:17.711160 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 332/632] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:17 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1474 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:17.719161 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c7160788-a888-4831-b4ed-c4455bad2ca1 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Action: 'create', calling method: .version_select at 0x7f46878f1f70>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-773082255", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:17.741282 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-c7160788-a888-4831-b4ed-c4455bad2ca1 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Getting quotas for project c0c2b3eaa0f54a32970cfd0976f5c0ac. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:27:17.749369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-c7160788-a888-4831-b4ed-c4455bad2ca1 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Getting quotas for user d96225f9d6fe4598a7014ed533aa4c3a and project c0c2b3eaa0f54a32970cfd0976f5c0ac. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:27:17.790706 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-c7160788-a888-4831-b4ed-c4455bad2ca1 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c7160788-a888-4831-b4ed-c4455bad2ca1 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Request method failure captured: Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 117 Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qhDcNcPzi3aavbZvan7KCQfQ979IXtlqtq1C3UqanqSqAtiZY1LnI2z0RIUHqhWhB9MVCU-s_SObCGvRn4aG5Nztcq0pfwy6sajMdU6-cDMu1eb5vRkrdypkGroCF601T29exOb-WmWrEpn8WXj-0HsGJytaHeRjrdia4cFCvDPkJQ Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: c0c2b3eaa0f54a32970cfd0976f5c0ac Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1965683114 Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0c2b3eaa0f54a32970cfd0976f5c0ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0c2b3eaa0f54a32970cfd0976f5c0ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0c2b3eaa0f54a32970cfd0976f5c0ac", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0c2b3eaa0f54a32970cfd0976f5c0ac"}]}] Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1965683114 Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: c0c2b3eaa0f54a32970cfd0976f5c0ac Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1965683114 Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-KeyPairsNegativeTestJSON-1965683114-project Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: d96225f9d6fe4598a7014ed533aa4c3a Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1965683114-project Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-773082255", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: exception: Keypair data is invalid: failed to generate fingerprint Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-773082255', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 25 14:27:17.802411 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 25 14:27:17.807564 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:17.814426 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c7160788-a888-4831-b4ed-c4455bad2ca1 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:27:17.815591 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c7160788-a888-4831-b4ed-c4455bad2ca1 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.103019 Jul 25 14:27:17.816393 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 333/633] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:27:17 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 14:27:17.831816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b8887e81-55ce-4d3c-be84-a74f81e5ff0c tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:17.832819 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b8887e81-55ce-4d3c-be84-a74f81e5ff0c tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: fca96a8a-7721-4bbc-8ffa-b732ef5d753d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:17.841583 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8887e81-55ce-4d3c-be84-a74f81e5ff0c tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:17.842232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8887e81-55ce-4d3c-be84-a74f81e5ff0c tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:17.843213 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8887e81-55ce-4d3c-be84-a74f81e5ff0c tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:17.843798 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8887e81-55ce-4d3c-be84-a74f81e5ff0c tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:18.006609 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b8887e81-55ce-4d3c-be84-a74f81e5ff0c tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:18.015359 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b8887e81-55ce-4d3c-be84-a74f81e5ff0c tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d" status: 200 len: 1388 microversion: 2.1 time: 0.189634 Jul 25 14:27:18.016120 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 334/634] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:17 2022] GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d => generated 1388 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:18.020724 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-568cc219-4be2-40e2-a33a-b1f045f4c225 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:18.021321 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-568cc219-4be2-40e2-a33a-b1f045f4c225 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:18.027791 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-568cc219-4be2-40e2-a33a-b1f045f4c225 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:18.028338 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-568cc219-4be2-40e2-a33a-b1f045f4c225 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:18.029150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-568cc219-4be2-40e2-a33a-b1f045f4c225 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:18.029648 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-568cc219-4be2-40e2-a33a-b1f045f4c225 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:18.070667 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5b93e727-c4df-4f9c-ad34-a8a9e51ea509 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:18.078588 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5b93e727-c4df-4f9c-ad34-a8a9e51ea509 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96" status: 200 len: 1321 microversion: 2.1 time: 0.496504 Jul 25 14:27:18.079497 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 301/635] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:17 2022] GET /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96 => generated 1321 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:18.083925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3e18c836-4fd1-45fe-adca-82f9bc5c9b09 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Calling method '.version_select at 0x7f46879edaf0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:18.099694 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-3e18c836-4fd1-45fe-adca-82f9bc5c9b09 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1272887214 not found for user d96225f9d6fe4598a7014ed533aa4c3a Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3e18c836-4fd1-45fe-adca-82f9bc5c9b09 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Request method failure captured: Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1272887214 HTTP/1.1 Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qhDcNcPzi3aavbZvan7KCQfQ979IXtlqtq1C3UqanqSqAtiZY1LnI2z0RIUHqhWhB9MVCU-s_SObCGvRn4aG5Nztcq0pfwy6sajMdU6-cDMu1eb5vRkrdypkGroCF601T29exOb-WmWrEpn8WXj-0HsGJytaHeRjrdia4cFCvDPkJQ Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: c0c2b3eaa0f54a32970cfd0976f5c0ac Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1965683114 Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0c2b3eaa0f54a32970cfd0976f5c0ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0c2b3eaa0f54a32970cfd0976f5c0ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0c2b3eaa0f54a32970cfd0976f5c0ac", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0c2b3eaa0f54a32970cfd0976f5c0ac"}]}] Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1965683114 Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: c0c2b3eaa0f54a32970cfd0976f5c0ac Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1965683114 Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-KeyPairsNegativeTestJSON-1965683114-project Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: d96225f9d6fe4598a7014ed533aa4c3a Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1965683114-project Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: exception: Keypair tempest-keypair-non-existent-1272887214 not found for user d96225f9d6fe4598a7014ed533aa4c3a Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'tempest-keypair-non-existent-1272887214'} Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1272887214 not found for user d96225f9d6fe4598a7014ed533aa4c3a Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:18.101956 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:18.105735 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:18.105735 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:18.105735 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:18.105735 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:18.105735 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:27:18.105735 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:27:18.105735 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:27:18.105735 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:27:18.105735 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 14:27:18.105735 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:27:18.105735 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:27:18.105735 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:27:18.105735 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 25 14:27:18.105735 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 25 14:27:18.105735 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 25 14:27:18.105735 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 25 14:27:18.105735 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1272887214 not found for user d96225f9d6fe4598a7014ed533aa4c3a Jul 25 14:27:18.105735 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:18.105735 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:18.105735 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:18.105735 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:18.105735 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:18.105735 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:18.105735 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:27:18.105735 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:27:18.105735 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1272887214 not found for user d96225f9d6fe4598a7014ed533aa4c3a Jul 25 14:27:18.105735 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:18.107644 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-568cc219-4be2-40e2-a33a-b1f045f4c225 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:18.108557 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3e18c836-4fd1-45fe-adca-82f9bc5c9b09 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1272887214 not found for user d96225f9d6fe4598a7014ed533aa4c3a {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:27:18.109547 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3e18c836-4fd1-45fe-adca-82f9bc5c9b09 tempest-KeyPairsNegativeTestJSON-1965683114 tempest-KeyPairsNegativeTestJSON-1965683114-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1272887214" status: 404 len: 145 microversion: 2.1 time: 0.029351 Jul 25 14:27:18.110257 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 302/636] 10.222.0.88 () {58 vars in 1260 bytes} [Mon Jul 25 14:27:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1272887214 => generated 145 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:27:18.119112 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-568cc219-4be2-40e2-a33a-b1f045f4c225 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9" status: 200 len: 1276 microversion: 2.1 time: 0.101762 Jul 25 14:27:18.119715 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 335/637] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:18 2022] GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 => generated 1276 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:18.140898 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b9677eaf-eba1-43c5-92fd-6a28885f9032 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:18.141600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b9677eaf-eba1-43c5-92fd-6a28885f9032 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: b6ed0cc6-bfeb-4148-a017-69d0eedad83e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:18.144748 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:18.150962 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b9677eaf-eba1-43c5-92fd-6a28885f9032 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:18.151475 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b9677eaf-eba1-43c5-92fd-6a28885f9032 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:18.152273 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b9677eaf-eba1-43c5-92fd-6a28885f9032 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:18.152710 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b9677eaf-eba1-43c5-92fd-6a28885f9032 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:18.323377 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d1832909-6118-443a-ab70-6878d229ffa7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:18.324054 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d1832909-6118-443a-ab70-6878d229ffa7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:18.336230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1832909-6118-443a-ab70-6878d229ffa7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:18.336589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1832909-6118-443a-ab70-6878d229ffa7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:18.337390 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1832909-6118-443a-ab70-6878d229ffa7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:18.340968 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1832909-6118-443a-ab70-6878d229ffa7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:18.482935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b9677eaf-eba1-43c5-92fd-6a28885f9032 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:18.491919 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b9677eaf-eba1-43c5-92fd-6a28885f9032 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e" status: 200 len: 1319 microversion: 2.1 time: 0.354543 Jul 25 14:27:18.493217 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 303/638] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:18 2022] GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e => generated 1319 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:18.675480 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d1832909-6118-443a-ab70-6878d229ffa7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:18.686544 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d1832909-6118-443a-ab70-6878d229ffa7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1463 microversion: 2.1 time: 0.367367 Jul 25 14:27:18.701449 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 336/639] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:18 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1463 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:27:18.711517 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ddb9e8ef-e17c-4d49-ab0d-de3ffc5713b6 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:18.712741 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ddb9e8ef-e17c-4d49-ab0d-de3ffc5713b6 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:18.721253 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ddb9e8ef-e17c-4d49-ab0d-de3ffc5713b6 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:18.722887 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ddb9e8ef-e17c-4d49-ab0d-de3ffc5713b6 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:18.728286 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ddb9e8ef-e17c-4d49-ab0d-de3ffc5713b6 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:18.729124 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ddb9e8ef-e17c-4d49-ab0d-de3ffc5713b6 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:18.732422 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-932925dc-3d3b-4472-bab4-081d92922538 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:18.733031 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-932925dc-3d3b-4472-bab4-081d92922538 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:18.740705 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-932925dc-3d3b-4472-bab4-081d92922538 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:18.748601 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-932925dc-3d3b-4472-bab4-081d92922538 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:18.749593 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-932925dc-3d3b-4472-bab4-081d92922538 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:18.750200 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-932925dc-3d3b-4472-bab4-081d92922538 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:18.955937 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-932925dc-3d3b-4472-bab4-081d92922538 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:18.965283 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-932925dc-3d3b-4472-bab4-081d92922538 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1474 microversion: 2.1 time: 0.236934 Jul 25 14:27:18.968986 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 337/640] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:18 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1474 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:27:19.037030 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b0ccb749-533a-4cd3-8246-2ffcc8ff0afa tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:19.037764 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b0ccb749-533a-4cd3-8246-2ffcc8ff0afa tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: fca96a8a-7721-4bbc-8ffa-b732ef5d753d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:19.049774 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0ccb749-533a-4cd3-8246-2ffcc8ff0afa tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:19.049937 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ddb9e8ef-e17c-4d49-ab0d-de3ffc5713b6 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:19.050939 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0ccb749-533a-4cd3-8246-2ffcc8ff0afa tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:19.051925 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0ccb749-533a-4cd3-8246-2ffcc8ff0afa tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:19.060697 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0ccb749-533a-4cd3-8246-2ffcc8ff0afa tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:19.073153 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ddb9e8ef-e17c-4d49-ab0d-de3ffc5713b6 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1463 microversion: 2.1 time: 0.366338 Jul 25 14:27:19.094681 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 304/641] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:18 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1463 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:19.122621 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cd40062f-4ebc-4a24-a8cb-9c5881e9b390 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:19.125087 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cd40062f-4ebc-4a24-a8cb-9c5881e9b390 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: c2ea60b9-dff6-4ee9-8004-680327fa2f96] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:19.139413 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cd40062f-4ebc-4a24-a8cb-9c5881e9b390 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:19.139871 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cd40062f-4ebc-4a24-a8cb-9c5881e9b390 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:19.140701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cd40062f-4ebc-4a24-a8cb-9c5881e9b390 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:19.145419 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cd40062f-4ebc-4a24-a8cb-9c5881e9b390 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:19.305975 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b0ccb749-533a-4cd3-8246-2ffcc8ff0afa tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:19.329186 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b0ccb749-533a-4cd3-8246-2ffcc8ff0afa tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d" status: 200 len: 1388 microversion: 2.1 time: 0.295651 Jul 25 14:27:19.356599 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 338/642] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:19 2022] GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d => generated 1388 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:27:19.376358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f993ee6c-e71b-4fe9-a409-8776108b80d8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:19.384724 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f993ee6c-e71b-4fe9-a409-8776108b80d8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:19.403181 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f993ee6c-e71b-4fe9-a409-8776108b80d8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:19.408814 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f993ee6c-e71b-4fe9-a409-8776108b80d8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:19.410982 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f993ee6c-e71b-4fe9-a409-8776108b80d8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:19.411744 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f993ee6c-e71b-4fe9-a409-8776108b80d8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:19.541420 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f993ee6c-e71b-4fe9-a409-8776108b80d8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:27:19.541834 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f993ee6c-e71b-4fe9-a409-8776108b80d8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:27:19.542298 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f993ee6c-e71b-4fe9-a409-8776108b80d8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:27:19.542698 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f993ee6c-e71b-4fe9-a409-8776108b80d8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:27:19.543094 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f993ee6c-e71b-4fe9-a409-8776108b80d8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:27:19.649195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f993ee6c-e71b-4fe9-a409-8776108b80d8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:19.656523 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cd40062f-4ebc-4a24-a8cb-9c5881e9b390 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:19.673315 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cd40062f-4ebc-4a24-a8cb-9c5881e9b390 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96" status: 200 len: 1321 microversion: 2.1 time: 0.574782 Jul 25 14:27:19.677141 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 305/643] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:19 2022] GET /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96 => generated 1321 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:19.685163 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f993ee6c-e71b-4fe9-a409-8776108b80d8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:19.686437 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f993ee6c-e71b-4fe9-a409-8776108b80d8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:19.687924 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c522401e-5c3a-43fb-9c07-466fc6c38e5e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:19.688913 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f993ee6c-e71b-4fe9-a409-8776108b80d8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:19.689457 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f993ee6c-e71b-4fe9-a409-8776108b80d8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:19.691102 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c522401e-5c3a-43fb-9c07-466fc6c38e5e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:19.704621 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c522401e-5c3a-43fb-9c07-466fc6c38e5e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:19.711058 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c522401e-5c3a-43fb-9c07-466fc6c38e5e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:19.712790 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c522401e-5c3a-43fb-9c07-466fc6c38e5e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:19.713363 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c522401e-5c3a-43fb-9c07-466fc6c38e5e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:19.753153 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f993ee6c-e71b-4fe9-a409-8776108b80d8 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "POST /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7/action" status: 202 len: 1067 microversion: 2.1 time: 0.379900 Jul 25 14:27:19.756292 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 339/644] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:27:19 2022] POST /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7/action => generated 1067 bytes in 398 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 14:27:19.769739 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-09c7ebde-48c7-4a03-9661-b8383a16af7d tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:19.770354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-09c7ebde-48c7-4a03-9661-b8383a16af7d tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: b6ed0cc6-bfeb-4148-a017-69d0eedad83e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:19.781945 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09c7ebde-48c7-4a03-9661-b8383a16af7d tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:19.787345 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09c7ebde-48c7-4a03-9661-b8383a16af7d tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:19.791268 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09c7ebde-48c7-4a03-9661-b8383a16af7d tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:19.791902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09c7ebde-48c7-4a03-9661-b8383a16af7d tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:20.120991 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-09c7ebde-48c7-4a03-9661-b8383a16af7d tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:20.133967 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-09c7ebde-48c7-4a03-9661-b8383a16af7d tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e" status: 200 len: 1319 microversion: 2.1 time: 0.374520 Jul 25 14:27:20.151455 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 340/645] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:19 2022] GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e => generated 1319 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:20.164259 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8591f730-8aee-45a1-8246-8dd46bf32312 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:20.165099 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8591f730-8aee-45a1-8246-8dd46bf32312 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:20.182103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8591f730-8aee-45a1-8246-8dd46bf32312 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:20.183501 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8591f730-8aee-45a1-8246-8dd46bf32312 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:20.184948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8591f730-8aee-45a1-8246-8dd46bf32312 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:20.187989 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8591f730-8aee-45a1-8246-8dd46bf32312 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:20.429321 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c522401e-5c3a-43fb-9c07-466fc6c38e5e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:20.442141 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c522401e-5c3a-43fb-9c07-466fc6c38e5e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9" status: 200 len: 1324 microversion: 2.1 time: 0.763043 Jul 25 14:27:20.443109 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 306/646] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:19 2022] GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 => generated 1324 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:20.463859 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bd56856e-3963-4e3b-8029-e9bb5ea72220 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:20.464907 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bd56856e-3963-4e3b-8029-e9bb5ea72220 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:20.481474 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd56856e-3963-4e3b-8029-e9bb5ea72220 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:20.482865 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd56856e-3963-4e3b-8029-e9bb5ea72220 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:20.485532 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd56856e-3963-4e3b-8029-e9bb5ea72220 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:20.486322 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd56856e-3963-4e3b-8029-e9bb5ea72220 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:20.595229 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8591f730-8aee-45a1-8246-8dd46bf32312 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:20.608109 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8591f730-8aee-45a1-8246-8dd46bf32312 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1472 microversion: 2.1 time: 0.455199 Jul 25 14:27:20.609177 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 341/647] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:20 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1472 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:20.615936 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-36bb9165-fd51-47df-a6fd-cdd35f30fe8b tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:20.616922 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-36bb9165-fd51-47df-a6fd-cdd35f30fe8b tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: fca96a8a-7721-4bbc-8ffa-b732ef5d753d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:20.626144 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-36bb9165-fd51-47df-a6fd-cdd35f30fe8b tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:20.626709 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-36bb9165-fd51-47df-a6fd-cdd35f30fe8b tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:20.627657 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-36bb9165-fd51-47df-a6fd-cdd35f30fe8b tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:20.628365 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-36bb9165-fd51-47df-a6fd-cdd35f30fe8b tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:21.034396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-36bb9165-fd51-47df-a6fd-cdd35f30fe8b tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:21.042668 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-36bb9165-fd51-47df-a6fd-cdd35f30fe8b tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d" status: 200 len: 1388 microversion: 2.1 time: 0.432357 Jul 25 14:27:21.047592 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 342/648] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:20 2022] GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d => generated 1388 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:21.056672 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b98d8035-5596-4e83-b6e2-d6c0d209f58d tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:21.057582 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b98d8035-5596-4e83-b6e2-d6c0d209f58d tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: c2ea60b9-dff6-4ee9-8004-680327fa2f96] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:21.065865 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=93,nova_api:DELETE=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:21.068017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b98d8035-5596-4e83-b6e2-d6c0d209f58d tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:21.068631 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b98d8035-5596-4e83-b6e2-d6c0d209f58d tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:21.069567 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b98d8035-5596-4e83-b6e2-d6c0d209f58d tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:21.070157 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b98d8035-5596-4e83-b6e2-d6c0d209f58d tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:21.186980 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bd56856e-3963-4e3b-8029-e9bb5ea72220 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:21.196201 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bd56856e-3963-4e3b-8029-e9bb5ea72220 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1474 microversion: 2.1 time: 0.749561 Jul 25 14:27:21.214947 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 307/649] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:20 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1474 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:21.222391 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-596fbc00-6c9b-4e8a-9c4b-72bd5e0b5824 req-9436c1ec-9492-4332-b491-757beafdb85f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5312b2e2-2ff9-457f-8d89-1cfa1b508ef9", "tag": "9ba908cc-d166-4dbe-8bf6-5618be7e27a2"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:21.233460 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-596fbc00-6c9b-4e8a-9c4b-72bd5e0b5824 req-9436c1ec-9492-4332-b491-757beafdb85f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:21.234144 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-596fbc00-6c9b-4e8a-9c4b-72bd5e0b5824 req-9436c1ec-9492-4332-b491-757beafdb85f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:21.247542 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-596fbc00-6c9b-4e8a-9c4b-72bd5e0b5824 req-9436c1ec-9492-4332-b491-757beafdb85f service nova] Creating event network-changed:9ba908cc-d166-4dbe-8bf6-5618be7e27a2 for instance 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 on n-h1-846435-14 Jul 25 14:27:21.253747 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-596fbc00-6c9b-4e8a-9c4b-72bd5e0b5824 req-9436c1ec-9492-4332-b491-757beafdb85f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037167 Jul 25 14:27:21.255144 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 308/650] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:21.262860 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-851cd101-4ecc-4b4c-b2c7-d3eec3b16163 req-c5ab9999-80b7-4f11-a5d7-50ec7555633c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2ea60b9-dff6-4ee9-8004-680327fa2f96", "name": "network-vif-plugged", "status": "completed", "tag": "83f3c285-c7d1-4407-9b2d-044ccf989207"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:21.273791 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-851cd101-4ecc-4b4c-b2c7-d3eec3b16163 req-c5ab9999-80b7-4f11-a5d7-50ec7555633c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:21.274239 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-851cd101-4ecc-4b4c-b2c7-d3eec3b16163 req-c5ab9999-80b7-4f11-a5d7-50ec7555633c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:21.285777 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-851cd101-4ecc-4b4c-b2c7-d3eec3b16163 req-c5ab9999-80b7-4f11-a5d7-50ec7555633c service nova] Creating event network-vif-plugged:83f3c285-c7d1-4407-9b2d-044ccf989207 for instance c2ea60b9-dff6-4ee9-8004-680327fa2f96 on n-h1-846435-14 Jul 25 14:27:21.290838 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-851cd101-4ecc-4b4c-b2c7-d3eec3b16163 req-c5ab9999-80b7-4f11-a5d7-50ec7555633c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034131 Jul 25 14:27:21.291730 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 309/651] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:21.350678 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b98d8035-5596-4e83-b6e2-d6c0d209f58d tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:21.361133 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b98d8035-5596-4e83-b6e2-d6c0d209f58d tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96" status: 200 len: 1321 microversion: 2.1 time: 0.311832 Jul 25 14:27:21.363500 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 343/652] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:21 2022] GET /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96 => generated 1321 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:21.370602 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3c4ab0e4-8a78-4d11-b6ff-55cbd5a12b2f tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:21.371595 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3c4ab0e4-8a78-4d11-b6ff-55cbd5a12b2f tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: b6ed0cc6-bfeb-4148-a017-69d0eedad83e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:21.379730 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c4ab0e4-8a78-4d11-b6ff-55cbd5a12b2f tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:21.380789 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c4ab0e4-8a78-4d11-b6ff-55cbd5a12b2f tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:21.381697 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c4ab0e4-8a78-4d11-b6ff-55cbd5a12b2f tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:21.382230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c4ab0e4-8a78-4d11-b6ff-55cbd5a12b2f tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:21.386952 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:21.497937 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-31c954de-d59c-405b-98fd-6a550841539e tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Action: 'create', calling method: .version_select at 0x7f468794eee0>, body: {"keypair": {"name": "tempest-keypair-2132209486", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/1czYcD9SwWqQo765znUwPlV8+1eqN1FfT0XWG/edSzZiSybW2+WyVFr3qHAf5QTo82qb9qdkTd6ScjfVWV51nTOFjFzOPSWbMi66B3dJTKSgpN9jzQopx8P0xc3R8iQ=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:21.525238 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-31c954de-d59c-405b-98fd-6a550841539e tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Getting quotas for project 9a34823815374efcbc24441bbd218736. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:27:21.530610 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-31c954de-d59c-405b-98fd-6a550841539e tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Getting quotas for user 7c491c6251384c18909de56b9dec598d and project 9a34823815374efcbc24441bbd218736. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:27:21.578113 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-31c954de-d59c-405b-98fd-6a550841539e tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.284613 Jul 25 14:27:21.579153 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 310/653] 10.222.0.88 () {62 vars in 1199 bytes} [Mon Jul 25 14:27:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 287 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 25 14:27:21.584649 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-93e3d902-f74e-44f8-b422-d2442adaf03c tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:21.585646 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-93e3d902-f74e-44f8-b422-d2442adaf03c tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:21.593990 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93e3d902-f74e-44f8-b422-d2442adaf03c tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:21.594927 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93e3d902-f74e-44f8-b422-d2442adaf03c tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:21.596355 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93e3d902-f74e-44f8-b422-d2442adaf03c tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:21.596989 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93e3d902-f74e-44f8-b422-d2442adaf03c tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:21.745656 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3c4ab0e4-8a78-4d11-b6ff-55cbd5a12b2f tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:21.754783 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3c4ab0e4-8a78-4d11-b6ff-55cbd5a12b2f tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e" status: 200 len: 1319 microversion: 2.1 time: 0.388738 Jul 25 14:27:21.755364 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 344/654] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:21 2022] GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e => generated 1319 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:21.760429 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f0c184d7-adc7-4562-9e55-a2dae724265d tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Calling method '.version_select at 0x7f46878d9790>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:21.769618 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f0c184d7-adc7-4562-9e55-a2dae724265d tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] 10.222.0.88 "GET /compute/v2.1/os-keypairs/tempest-keypair-2132209486" status: 200 len: 513 microversion: 2.2 time: 0.013045 Jul 25 14:27:21.770466 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 345/655] 10.222.0.88 () {60 vars in 1258 bytes} [Mon Jul 25 14:27:21 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2132209486 => generated 513 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:21.775205 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c3ee4709-85d1-4c29-8cd0-1b69e0ff966c tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:21.776046 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c3ee4709-85d1-4c29-8cd0-1b69e0ff966c tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:21.782398 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c3ee4709-85d1-4c29-8cd0-1b69e0ff966c tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:21.783073 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c3ee4709-85d1-4c29-8cd0-1b69e0ff966c tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:21.783914 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c3ee4709-85d1-4c29-8cd0-1b69e0ff966c tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:21.784410 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c3ee4709-85d1-4c29-8cd0-1b69e0ff966c tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:21.978674 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c3ee4709-85d1-4c29-8cd0-1b69e0ff966c tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:21.986954 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c3ee4709-85d1-4c29-8cd0-1b69e0ff966c tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1472 microversion: 2.1 time: 0.215216 Jul 25 14:27:21.988025 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 346/656] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:21 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1472 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:21.993410 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ee5ea198-df7d-4c6d-b89f-f0bc001cb1d0 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Calling method '.version_select at 0x7f46878d9b80>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:22.022602 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ee5ea198-df7d-4c6d-b89f-f0bc001cb1d0 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2132209486" status: 204 len: 0 microversion: 2.2 time: 0.032453 Jul 25 14:27:22.024154 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 347/657] 10.222.0.88 () {60 vars in 1261 bytes} [Mon Jul 25 14:27:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2132209486 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:27:22.036047 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-93e3d902-f74e-44f8-b422-d2442adaf03c tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:22.040908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-593954a6-d80d-4f27-bb32-9aaf9b07c427 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Action: 'create', calling method: .version_select at 0x7f4687850670>, body: {"keypair": {"name": "tempest-keypair-72419738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOYY1OMC66qiaNpxOZiIJyhE6E2XXLxbB1MsOExOiau1FjnOFiKbHB2tDD26+O5y01FGYEH/iT5XjHZE7vDxGaSqfv91qxrFXK91Wo6XcUsKOZVwgGNLwhD6qibsyAW7A=="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:22.042378 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:22.045475 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-93e3d902-f74e-44f8-b422-d2442adaf03c tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9" status: 200 len: 1324 microversion: 2.1 time: 0.465132 Jul 25 14:27:22.050885 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 311/658] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:21 2022] GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 => generated 1324 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:22.061443 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-593954a6-d80d-4f27-bb32-9aaf9b07c427 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Getting quotas for project 9a34823815374efcbc24441bbd218736. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:27:22.068948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-593954a6-d80d-4f27-bb32-9aaf9b07c427 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Getting quotas for user 7c491c6251384c18909de56b9dec598d and project 9a34823815374efcbc24441bbd218736. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:27:22.071406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3b5e54fc-ff51-43e1-8549-642bc5d7d469 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:22.072064 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3b5e54fc-ff51-43e1-8549-642bc5d7d469 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: fca96a8a-7721-4bbc-8ffa-b732ef5d753d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:22.078729 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b5e54fc-ff51-43e1-8549-642bc5d7d469 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:22.079181 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b5e54fc-ff51-43e1-8549-642bc5d7d469 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:22.080155 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b5e54fc-ff51-43e1-8549-642bc5d7d469 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:22.080812 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b5e54fc-ff51-43e1-8549-642bc5d7d469 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:22.102232 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-593954a6-d80d-4f27-bb32-9aaf9b07c427 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.2 time: 0.068636 Jul 25 14:27:22.102850 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 348/659] 10.222.0.88 () {62 vars in 1199 bytes} [Mon Jul 25 14:27:22 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 70 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 25 14:27:22.113409 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-421f43ef-072a-4f99-88d8-d027a62dd7f8 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Calling method '.version_select at 0x7f46878193a0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:22.139764 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-421f43ef-072a-4f99-88d8-d027a62dd7f8 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-72419738" status: 204 len: 0 microversion: 2.2 time: 0.030143 Jul 25 14:27:22.140715 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 349/660] 10.222.0.88 () {60 vars in 1255 bytes} [Mon Jul 25 14:27:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-72419738 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:27:22.149607 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-55cb3042-90c5-4139-a344-6f94244741a3 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Action: 'create', calling method: .version_select at 0x7f46878d9670>, body: {"keypair": {"name": "tempest-keypair-334246923", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:22.167549 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-55cb3042-90c5-4139-a344-6f94244741a3 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Getting quotas for project 9a34823815374efcbc24441bbd218736. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:27:22.173366 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-55cb3042-90c5-4139-a344-6f94244741a3 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Getting quotas for user 7c491c6251384c18909de56b9dec598d and project 9a34823815374efcbc24441bbd218736. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:27:22.202475 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-55cb3042-90c5-4139-a344-6f94244741a3 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.056468 Jul 25 14:27:22.204099 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 350/661] 10.222.0.88 () {62 vars in 1199 bytes} [Mon Jul 25 14:27:22 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 59 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Jul 25 14:27:22.216966 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0f8f175b-815d-4056-9d8a-14dca000d3e6 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Calling method '.version_select at 0x7f4687819790>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:22.240692 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0f8f175b-815d-4056-9d8a-14dca000d3e6 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-334246923" status: 204 len: 0 microversion: 2.2 time: 0.028481 Jul 25 14:27:22.241606 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 351/662] 10.222.0.88 () {60 vars in 1258 bytes} [Mon Jul 25 14:27:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-334246923 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:27:22.254345 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9471e029-9273-44df-83eb-ab82e0af8b62 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:22.255087 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9471e029-9273-44df-83eb-ab82e0af8b62 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:22.262538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9471e029-9273-44df-83eb-ab82e0af8b62 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:22.262984 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9471e029-9273-44df-83eb-ab82e0af8b62 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:22.263775 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9471e029-9273-44df-83eb-ab82e0af8b62 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:22.264547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9471e029-9273-44df-83eb-ab82e0af8b62 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:22.307851 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3b5e54fc-ff51-43e1-8549-642bc5d7d469 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:22.322429 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3b5e54fc-ff51-43e1-8549-642bc5d7d469 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d" status: 200 len: 1388 microversion: 2.1 time: 0.253637 Jul 25 14:27:22.337922 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 312/663] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:22 2022] GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d => generated 1388 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:22.343844 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bece53e3-a4a9-4288-af68-c27d00d07509 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Action: 'create', calling method: .version_select at 0x7f46879ed700>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1594892322", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYtZ5mQEjc9tu7FNUYkW2x6wilwdHkczsh+JyBprjZKKFTqAmjK7Nwer9iKxoRX2yXZow1vYD8P3ZWAMmdympg9Eq3o1p9/3q2IziOyaLkqsNvmn6uhZfKbaAMp0jM3mg=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:22.363355 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-bece53e3-a4a9-4288-af68-c27d00d07509 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Getting quotas for project 9a34823815374efcbc24441bbd218736. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:27:22.369117 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-bece53e3-a4a9-4288-af68-c27d00d07509 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Getting quotas for user 7c491c6251384c18909de56b9dec598d and project 9a34823815374efcbc24441bbd218736. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:27:22.398460 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bece53e3-a4a9-4288-af68-c27d00d07509 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.058306 Jul 25 14:27:22.400862 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 313/664] 10.222.0.88 () {62 vars in 1199 bytes} [Mon Jul 25 14:27:22 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 62 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 25 14:27:22.409269 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-44ac4cd8-e7bc-4e6e-a987-da4c025ea476 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:22.410292 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-44ac4cd8-e7bc-4e6e-a987-da4c025ea476 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: c2ea60b9-dff6-4ee9-8004-680327fa2f96] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:22.417633 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-44ac4cd8-e7bc-4e6e-a987-da4c025ea476 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:22.418439 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-44ac4cd8-e7bc-4e6e-a987-da4c025ea476 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:22.420901 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-44ac4cd8-e7bc-4e6e-a987-da4c025ea476 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:22.421433 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-44ac4cd8-e7bc-4e6e-a987-da4c025ea476 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:22.730865 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9471e029-9273-44df-83eb-ab82e0af8b62 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:22.739679 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9471e029-9273-44df-83eb-ab82e0af8b62 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1473 microversion: 2.1 time: 0.496909 Jul 25 14:27:22.740334 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 352/665] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:22 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1473 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:22.755601 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9fbb324c-3f3a-4db9-8a75-22bc126f9562 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Action: 'create', calling method: .version_select at 0x7f46879521f0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1856492782", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsrSpx4vuGXsZbKgFbnX7dGs72St8ZXVod5IIiUMbUbZXKF9NkJYD0tp4dgAzDncZqEjKDnXDm9k5E32tJvV89Gk/W3e9lKijX6nSMETFnAC3wFWSKw2YbKs6I1MVzclg=="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:22.778701 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-9fbb324c-3f3a-4db9-8a75-22bc126f9562 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Getting quotas for project 9a34823815374efcbc24441bbd218736. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:27:22.786150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-9fbb324c-3f3a-4db9-8a75-22bc126f9562 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Getting quotas for user 7c491c6251384c18909de56b9dec598d and project 9a34823815374efcbc24441bbd218736. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:27:22.799652 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-44ac4cd8-e7bc-4e6e-a987-da4c025ea476 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:22.809204 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-44ac4cd8-e7bc-4e6e-a987-da4c025ea476 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96" status: 200 len: 1321 microversion: 2.1 time: 0.406558 Jul 25 14:27:22.810783 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 314/666] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:22 2022] GET /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96 => generated 1321 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:22.825162 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0523df0c-8352-4402-af5a-b6538c7ed388 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:22.826907 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0523df0c-8352-4402-af5a-b6538c7ed388 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: b6ed0cc6-bfeb-4148-a017-69d0eedad83e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:22.830796 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9fbb324c-3f3a-4db9-8a75-22bc126f9562 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.089396 Jul 25 14:27:22.831449 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 353/667] 10.222.0.88 () {62 vars in 1199 bytes} [Mon Jul 25 14:27:22 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 91 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 25 14:27:22.838650 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0523df0c-8352-4402-af5a-b6538c7ed388 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:22.839096 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0523df0c-8352-4402-af5a-b6538c7ed388 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:22.839867 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0523df0c-8352-4402-af5a-b6538c7ed388 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:22.840353 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0523df0c-8352-4402-af5a-b6538c7ed388 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:22.850405 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3de6547e-83dc-462a-95a5-c9867b4e6c3c tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Action: 'create', calling method: .version_select at 0x7f46878d9d30>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1202618475", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHvUA8jsDcSfa17yymzCdD0dp4WN7rOYQ4FYYJfc23RyQco6u8Subb6XzF6c1Dgh4mNXfzdRm3oGI6wLmpnI25ZyN6qVhT/fTQgrVkdBGhqsna0h/6esBnWRp7NGdY6cA=="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:22.876979 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-3de6547e-83dc-462a-95a5-c9867b4e6c3c tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Getting quotas for project 9a34823815374efcbc24441bbd218736. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:27:22.886997 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-3de6547e-83dc-462a-95a5-c9867b4e6c3c tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Getting quotas for user 7c491c6251384c18909de56b9dec598d and project 9a34823815374efcbc24441bbd218736. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:27:22.922507 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3de6547e-83dc-462a-95a5-c9867b4e6c3c tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.076399 Jul 25 14:27:22.928691 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 354/668] 10.222.0.88 () {62 vars in 1199 bytes} [Mon Jul 25 14:27:22 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 87 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 25 14:27:22.933653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-69162eb4-8953-46ba-aec0-4ef9a9e15bc5 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Calling method '.version_select at 0x7f468791c5e0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:22.937738 n-d-846435-14 devstack@n-api.service[119304]: WARNING oslo_db.sqlalchemy.utils [None req-69162eb4-8953-46ba-aec0-4ef9a9e15bc5 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 25 14:27:22.944537 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-69162eb4-8953-46ba-aec0-4ef9a9e15bc5 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] 10.222.0.88 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.014276 Jul 25 14:27:22.952439 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 355/669] 10.222.0.88 () {60 vars in 1177 bytes} [Mon Jul 25 14:27:22 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:22.960820 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0adec892-32e7-4aef-89fe-e700ad97095a tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Calling method '.version_select at 0x7f46878f18b0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:22.983563 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0adec892-32e7-4aef-89fe-e700ad97095a tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1202618475" status: 204 len: 0 microversion: 2.2 time: 0.029410 Jul 25 14:27:22.989958 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 356/670] 10.222.0.88 () {60 vars in 1321 bytes} [Mon Jul 25 14:27:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1202618475 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:27:22.996412 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8d55327d-baa4-4d01-bc21-192af7c31ddb tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Calling method '.version_select at 0x7f4687831c10>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:23.050164 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8d55327d-baa4-4d01-bc21-192af7c31ddb tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1856492782" status: 204 len: 0 microversion: 2.2 time: 0.058576 Jul 25 14:27:23.051151 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 357/671] 10.222.0.88 () {60 vars in 1321 bytes} [Mon Jul 25 14:27:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1856492782 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:27:23.059522 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a1fdd26c-54ae-4a70-958a-2fb0119d267a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:23.060746 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a1fdd26c-54ae-4a70-958a-2fb0119d267a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:23.072479 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1fdd26c-54ae-4a70-958a-2fb0119d267a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:23.072938 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1fdd26c-54ae-4a70-958a-2fb0119d267a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:23.073737 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1fdd26c-54ae-4a70-958a-2fb0119d267a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:23.074176 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1fdd26c-54ae-4a70-958a-2fb0119d267a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:23.144149 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0523df0c-8352-4402-af5a-b6538c7ed388 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:23.152351 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0523df0c-8352-4402-af5a-b6538c7ed388 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e" status: 200 len: 1319 microversion: 2.1 time: 0.330931 Jul 25 14:27:23.157993 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 315/672] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:22 2022] GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e => generated 1319 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:23.167009 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-31e5e880-15ad-4a01-b1fb-2ef9cd1b80c5 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Calling method '.version_select at 0x7f46879383a0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:23.208089 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-31e5e880-15ad-4a01-b1fb-2ef9cd1b80c5 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1594892322" status: 204 len: 0 microversion: 2.2 time: 0.048924 Jul 25 14:27:23.209809 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 316/673] 10.222.0.88 () {60 vars in 1321 bytes} [Mon Jul 25 14:27:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1594892322 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:27:23.214646 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-08f56d52-1a97-4dd3-9e55-0996fd8559d3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:23.215444 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-08f56d52-1a97-4dd3-9e55-0996fd8559d3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:23.224857 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08f56d52-1a97-4dd3-9e55-0996fd8559d3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:23.225319 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08f56d52-1a97-4dd3-9e55-0996fd8559d3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:23.226114 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08f56d52-1a97-4dd3-9e55-0996fd8559d3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:23.226610 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08f56d52-1a97-4dd3-9e55-0996fd8559d3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:23.308896 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a1fdd26c-54ae-4a70-958a-2fb0119d267a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:23.317595 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a1fdd26c-54ae-4a70-958a-2fb0119d267a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1472 microversion: 2.1 time: 0.265094 Jul 25 14:27:23.318125 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 358/674] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:23 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1472 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:23.349028 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ff14e9e2-c0f4-4bac-a167-d7fdcae96eaa tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Action: 'create', calling method: .version_select at 0x7f4687865d30>, body: {"keypair": {"name": "tempest-keypair-851782934", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHF/T5HR5O5nNPwhj6tuBBzZIg71T034VSo2EymdEs+qG+jJhKuGgmIjbdYxLRiwWnhjtd7BrZIaAll0/vJWPUg3xyFHagPVbmzTNrvjCFJiNIBSqZyFCPcUBXhSRor6DA=="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:23.375272 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-ff14e9e2-c0f4-4bac-a167-d7fdcae96eaa tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Getting quotas for project 9a34823815374efcbc24441bbd218736. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:27:23.382602 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-ff14e9e2-c0f4-4bac-a167-d7fdcae96eaa tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Getting quotas for user 7c491c6251384c18909de56b9dec598d and project 9a34823815374efcbc24441bbd218736. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:27:23.422956 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ff14e9e2-c0f4-4bac-a167-d7fdcae96eaa tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.084534 Jul 25 14:27:23.429598 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 359/675] 10.222.0.88 () {62 vars in 1199 bytes} [Mon Jul 25 14:27:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 105 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 25 14:27:23.430152 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3488fe7a-e37f-4fce-bb22-121f5fc20b4b tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:23.431033 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3488fe7a-e37f-4fce-bb22-121f5fc20b4b tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: fca96a8a-7721-4bbc-8ffa-b732ef5d753d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:23.443792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3488fe7a-e37f-4fce-bb22-121f5fc20b4b tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:23.444340 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3488fe7a-e37f-4fce-bb22-121f5fc20b4b tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:23.445238 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3488fe7a-e37f-4fce-bb22-121f5fc20b4b tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:23.445733 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3488fe7a-e37f-4fce-bb22-121f5fc20b4b tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:23.609506 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-08f56d52-1a97-4dd3-9e55-0996fd8559d3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:23.621030 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-08f56d52-1a97-4dd3-9e55-0996fd8559d3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9" status: 200 len: 1324 microversion: 2.1 time: 0.409364 Jul 25 14:27:23.624799 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 317/676] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:23 2022] GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 => generated 1324 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:23.633457 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3f267086-2254-4975-ada8-6be6a120a578 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Calling method '.version_select at 0x7f46878d3550>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:23.675058 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3f267086-2254-4975-ada8-6be6a120a578 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] 10.222.0.88 "GET /compute/v2.1/os-keypairs/tempest-keypair-851782934" status: 200 len: 512 microversion: 2.2 time: 0.048197 Jul 25 14:27:23.675662 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 318/677] 10.222.0.88 () {60 vars in 1255 bytes} [Mon Jul 25 14:27:23 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-851782934 => generated 512 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:23.692955 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-72c371e5-3d64-427a-983f-9c757667b374 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Calling method '.version_select at 0x7f46879384c0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:23.701067 n-d-846435-14 devstack@n-api.service[119303]: WARNING oslo_db.sqlalchemy.utils [None req-72c371e5-3d64-427a-983f-9c757667b374 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 25 14:27:23.709471 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-72c371e5-3d64-427a-983f-9c757667b374 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] 10.222.0.88 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.025301 Jul 25 14:27:23.713385 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 319/678] 10.222.0.88 () {60 vars in 1177 bytes} [Mon Jul 25 14:27:23 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:23.722700 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dc3f7d5d-d8bd-4509-9c65-a430e6e48521 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Calling method '.version_select at 0x7f4687854310>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:23.748217 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dc3f7d5d-d8bd-4509-9c65-a430e6e48521 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-851782934" status: 204 len: 0 microversion: 2.2 time: 0.031138 Jul 25 14:27:23.749778 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 320/679] 10.222.0.88 () {60 vars in 1258 bytes} [Mon Jul 25 14:27:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-851782934 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:27:23.762102 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cb324266-c6f2-4871-9e98-4f34745056d7 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Action: 'create', calling method: .version_select at 0x7f4687854a60>, body: {"keypair": {"name": "tempest-keypair-276099636", "type": "x509"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:23.777697 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3488fe7a-e37f-4fce-bb22-121f5fc20b4b tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:23.783991 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-cb324266-c6f2-4871-9e98-4f34745056d7 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Getting quotas for project 9a34823815374efcbc24441bbd218736. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:27:23.786005 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3488fe7a-e37f-4fce-bb22-121f5fc20b4b tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d" status: 200 len: 1587 microversion: 2.1 time: 0.360740 Jul 25 14:27:23.798935 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 360/680] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:23 2022] GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d => generated 1587 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:23.798935 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e8b09112-4fbe-407c-a9dc-ab759d793b64 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:23.798935 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e8b09112-4fbe-407c-a9dc-ab759d793b64 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:23.807188 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-cb324266-c6f2-4871-9e98-4f34745056d7 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Getting quotas for user 7c491c6251384c18909de56b9dec598d and project 9a34823815374efcbc24441bbd218736. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:27:23.812979 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e8b09112-4fbe-407c-a9dc-ab759d793b64 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:23.813689 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e8b09112-4fbe-407c-a9dc-ab759d793b64 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:23.814647 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e8b09112-4fbe-407c-a9dc-ab759d793b64 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:23.815517 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e8b09112-4fbe-407c-a9dc-ab759d793b64 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:23.858693 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.processutils [None req-cb324266-c6f2-4871-9e98-4f34745056d7 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpj7xaxcf2/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpj7xaxcf2/temp.key -subj /CN=7c491c6251384c18909de56b9dec598d -extensions v3_req_client {{(pid=119303) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 25 14:27:24.014713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e8b09112-4fbe-407c-a9dc-ab759d793b64 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:24.023967 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e8b09112-4fbe-407c-a9dc-ab759d793b64 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1473 microversion: 2.1 time: 0.232654 Jul 25 14:27:24.037331 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 361/681] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:23 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1473 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:24.044855 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-256fcd9b-990b-4290-8b09-63a88638449a tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:24.052510 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-256fcd9b-990b-4290-8b09-63a88638449a tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: fca96a8a-7721-4bbc-8ffa-b732ef5d753d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:24.071434 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-256fcd9b-990b-4290-8b09-63a88638449a tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:24.073946 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-256fcd9b-990b-4290-8b09-63a88638449a tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:24.075998 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-256fcd9b-990b-4290-8b09-63a88638449a tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:24.076757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-256fcd9b-990b-4290-8b09-63a88638449a tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:24.291027 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-256fcd9b-990b-4290-8b09-63a88638449a tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.252396 Jul 25 14:27:24.293243 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 362/682] 10.222.0.88 () {58 vars in 1275 bytes} [Mon Jul 25 14:27:24 2022] GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d/os-interface => generated 284 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:24.300321 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c297a065-cb15-45d1-a4fb-e87ebeb9e3de tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:24.301230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c297a065-cb15-45d1-a4fb-e87ebeb9e3de tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: c2ea60b9-dff6-4ee9-8004-680327fa2f96] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:24.316391 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=5,nova_api:INSERT=5 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:24.321188 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c297a065-cb15-45d1-a4fb-e87ebeb9e3de tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:24.323625 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c297a065-cb15-45d1-a4fb-e87ebeb9e3de tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:24.327290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c297a065-cb15-45d1-a4fb-e87ebeb9e3de tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:24.329051 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c297a065-cb15-45d1-a4fb-e87ebeb9e3de tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:24.689834 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.processutils [None req-cb324266-c6f2-4871-9e98-4f34745056d7 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpj7xaxcf2/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpj7xaxcf2/temp.key -subj /CN=7c491c6251384c18909de56b9dec598d -extensions v3_req_client" returned: 0 in 0.831s {{(pid=119303) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 25 14:27:24.692239 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.processutils [None req-cb324266-c6f2-4871-9e98-4f34745056d7 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpj7xaxcf2/temp.key -password pass: {{(pid=119303) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 25 14:27:24.751322 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.processutils [None req-cb324266-c6f2-4871-9e98-4f34745056d7 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpj7xaxcf2/temp.key -password pass:" returned: 0 in 0.058s {{(pid=119303) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 25 14:27:24.848362 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c297a065-cb15-45d1-a4fb-e87ebeb9e3de tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:24.849622 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-cb324266-c6f2-4871-9e98-4f34745056d7 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Getting quotas for project 9a34823815374efcbc24441bbd218736. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:27:24.864522 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c297a065-cb15-45d1-a4fb-e87ebeb9e3de tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96" status: 200 len: 1470 microversion: 2.1 time: 0.562887 Jul 25 14:27:24.865957 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 363/683] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:24 2022] GET /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96 => generated 1470 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:24.870600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-eb0db150-a16c-4ae1-a7cc-372eb781f737 req-debea8c7-95b7-4a5c-8ca4-0d8b07858292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a419853-5f31-4fae-8a4e-da15efb145fb", "name": "network-vif-unplugged", "status": "completed", "tag": "7bf3ba29-6559-4754-8d9e-31166ec3ecb3"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:24.883236 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-cb324266-c6f2-4871-9e98-4f34745056d7 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Getting quotas for user 7c491c6251384c18909de56b9dec598d and project 9a34823815374efcbc24441bbd218736. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:27:24.894149 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-eb0db150-a16c-4ae1-a7cc-372eb781f737 req-debea8c7-95b7-4a5c-8ca4-0d8b07858292 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:24.896428 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-eb0db150-a16c-4ae1-a7cc-372eb781f737 req-debea8c7-95b7-4a5c-8ca4-0d8b07858292 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:24.921713 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-eb0db150-a16c-4ae1-a7cc-372eb781f737 req-debea8c7-95b7-4a5c-8ca4-0d8b07858292 service nova] Creating event network-vif-unplugged:7bf3ba29-6559-4754-8d9e-31166ec3ecb3 for instance 1a419853-5f31-4fae-8a4e-da15efb145fb on n-h1-846435-14 Jul 25 14:27:24.937325 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cb324266-c6f2-4871-9e98-4f34745056d7 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 1.178932 Jul 25 14:27:24.947787 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 321/684] 10.222.0.88 () {62 vars in 1198 bytes} [Mon Jul 25 14:27:23 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 1193 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:27:24.951574 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [req-eb0db150-a16c-4ae1-a7cc-372eb781f737 req-debea8c7-95b7-4a5c-8ca4-0d8b07858292 service nova] Instance 1a419853-5f31-4fae-8a4e-da15efb145fb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119304) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 14:27:24.963534 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ba634bea-82e2-4cb4-a23b-2105503ec47f tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:24.964244 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ba634bea-82e2-4cb4-a23b-2105503ec47f tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: b6ed0cc6-bfeb-4148-a017-69d0eedad83e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:24.981232 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ba634bea-82e2-4cb4-a23b-2105503ec47f tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:24.982207 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-eb0db150-a16c-4ae1-a7cc-372eb781f737 req-debea8c7-95b7-4a5c-8ca4-0d8b07858292 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114618 Jul 25 14:27:24.982460 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 364/685] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:24.987950 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ba634bea-82e2-4cb4-a23b-2105503ec47f tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:24.988145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f8653ed5-1437-4c24-859f-38e1f1fdf496 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:24.991160 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ba634bea-82e2-4cb4-a23b-2105503ec47f tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:24.991829 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ba634bea-82e2-4cb4-a23b-2105503ec47f tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:24.992334 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f8653ed5-1437-4c24-859f-38e1f1fdf496 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:25.012952 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8653ed5-1437-4c24-859f-38e1f1fdf496 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:25.019319 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8653ed5-1437-4c24-859f-38e1f1fdf496 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:25.020644 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8653ed5-1437-4c24-859f-38e1f1fdf496 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:25.025064 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8653ed5-1437-4c24-859f-38e1f1fdf496 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:25.381465 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ba634bea-82e2-4cb4-a23b-2105503ec47f tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:25.391542 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ba634bea-82e2-4cb4-a23b-2105503ec47f tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e" status: 200 len: 1319 microversion: 2.1 time: 0.441001 Jul 25 14:27:25.398071 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 322/686] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:24 2022] GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e => generated 1319 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:25.407786 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e1bb12a5-7bdd-4b9e-861d-553b119304ef tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:25.408518 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e1bb12a5-7bdd-4b9e-861d-553b119304ef tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:25.436215 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e1bb12a5-7bdd-4b9e-861d-553b119304ef tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:25.436950 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e1bb12a5-7bdd-4b9e-861d-553b119304ef tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:25.448040 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e1bb12a5-7bdd-4b9e-861d-553b119304ef tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:25.452273 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e1bb12a5-7bdd-4b9e-861d-553b119304ef tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:25.610773 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f8653ed5-1437-4c24-859f-38e1f1fdf496 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:25.624823 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f8653ed5-1437-4c24-859f-38e1f1fdf496 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1472 microversion: 2.1 time: 0.640629 Jul 25 14:27:25.638141 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 365/687] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:24 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1472 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:25.953898 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e1bb12a5-7bdd-4b9e-861d-553b119304ef tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:25.967203 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e1bb12a5-7bdd-4b9e-861d-553b119304ef tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9" status: 200 len: 1324 microversion: 2.1 time: 0.567673 Jul 25 14:27:25.968550 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 323/688] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:25 2022] GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 => generated 1324 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:25.974144 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b27c238d-ee6e-4a36-b25d-cc075967982b tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Calling method '.version_select at 0x7f4687854ee0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:25.984879 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b27c238d-ee6e-4a36-b25d-cc075967982b tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] 10.222.0.88 "GET /compute/v2.1/os-keypairs/tempest-keypair-276099636" status: 200 len: 1533 microversion: 2.2 time: 0.014871 Jul 25 14:27:25.986042 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 324/689] 10.222.0.88 () {60 vars in 1255 bytes} [Mon Jul 25 14:27:25 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-276099636 => generated 1533 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:25.992824 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d6c57741-f048-423b-a6e6-c5ee97ad0490 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:25.994042 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d6c57741-f048-423b-a6e6-c5ee97ad0490 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:26.012233 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d6c57741-f048-423b-a6e6-c5ee97ad0490 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:26.013486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d6c57741-f048-423b-a6e6-c5ee97ad0490 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:26.015005 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d6c57741-f048-423b-a6e6-c5ee97ad0490 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:26.015732 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d6c57741-f048-423b-a6e6-c5ee97ad0490 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:26.272629 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1b8c6b65-3ffa-48c9-a5da-d594d8a5b38c tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:26.273564 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1b8c6b65-3ffa-48c9-a5da-d594d8a5b38c tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] [instance: 74958543-1dc6-4121-8b65-7ab7ea818078] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:26.297366 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:26.299502 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-1b8c6b65-3ffa-48c9-a5da-d594d8a5b38c tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] HTTP exception thrown: Instance 74958543-1dc6-4121-8b65-7ab7ea818078 could not be found. Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1b8c6b65-3ffa-48c9-a5da-d594d8a5b38c tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Request method failure captured: Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers/74958543-1dc6-4121-8b65-7ab7ea818078/action HTTP/1.1 Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 15 Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qg7nZuy2E6W7V9cxrAuYDhTCzsd7mjQ2y9DytdP9VVoXrSJM7_baJbkZuHRqvejpj4kBIOobxOgruz3wO03rM_Z7SyWqFZ6hZJjK2_wltx19l26XUBq7uxn60d7hP2osCVOkzyPnKGIgKJgfQRHEPmlTqdp7mJc3QCgTQdDosp28uQ Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: b521f1290f19442c82b5fde0c45e87ed Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1616729302 Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: X-Role: admin,reader,member Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: admin,reader,member Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b521f1290f19442c82b5fde0c45e87ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b521f1290f19442c82b5fde0c45e87ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b521f1290f19442c82b5fde0c45e87ed", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b521f1290f19442c82b5fde0c45e87ed"}]}] Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1616729302 Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: b521f1290f19442c82b5fde0c45e87ed Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1616729302 Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersAdminNegativeTestJSON-1616729302-project-admin Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 6774836e5024420985da7cc07ec74915 Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1616729302-project-admin Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: {"migrate": {}} Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 74958543-1dc6-4121-8b65-7ab7ea818078 could not be found. Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '74958543-1dc6-4121-8b65-7ab7ea818078', 'body': {'migrate': {}}} Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74958543-1dc6-4121-8b65-7ab7ea818078 could not be found. Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74958543-1dc6-4121-8b65-7ab7ea818078 could not be found. Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:26.301970 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:26.306992 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:26.306992 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:26.306992 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:27:26.306992 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:27:26.306992 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74958543-1dc6-4121-8b65-7ab7ea818078 could not be found. Jul 25 14:27:26.306992 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:26.306992 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1b8c6b65-3ffa-48c9-a5da-d594d8a5b38c tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Returning 404 to user: Instance 74958543-1dc6-4121-8b65-7ab7ea818078 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:27:26.306992 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1b8c6b65-3ffa-48c9-a5da-d594d8a5b38c tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/74958543-1dc6-4121-8b65-7ab7ea818078/action" status: 404 len: 111 microversion: 2.1 time: 0.679471 Jul 25 14:27:26.311389 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 366/690] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:27:25 2022] POST /compute/v2.1/servers/74958543-1dc6-4121-8b65-7ab7ea818078/action => generated 111 bytes in 681 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:27:26.334779 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-f1976299-2ac6-4944-b7f8-16f973957925 req-b45c463d-06ac-4056-a755-f1bad999b90e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6ed0cc6-bfeb-4148-a017-69d0eedad83e", "name": "network-vif-plugged", "status": "completed", "tag": "9ed86ee9-b2e4-4fa1-86f9-082e0978d084"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:26.359241 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-f1976299-2ac6-4944-b7f8-16f973957925 req-b45c463d-06ac-4056-a755-f1bad999b90e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:26.364116 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-f1976299-2ac6-4944-b7f8-16f973957925 req-b45c463d-06ac-4056-a755-f1bad999b90e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:26.398924 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-f1976299-2ac6-4944-b7f8-16f973957925 req-b45c463d-06ac-4056-a755-f1bad999b90e service nova] Creating event network-vif-plugged:9ed86ee9-b2e4-4fa1-86f9-082e0978d084 for instance b6ed0cc6-bfeb-4148-a017-69d0eedad83e on n-h2-846435-14 Jul 25 14:27:26.417014 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-f1976299-2ac6-4944-b7f8-16f973957925 req-b45c463d-06ac-4056-a755-f1bad999b90e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098767 Jul 25 14:27:26.419316 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 367/691] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:26.433909 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-333cc91b-0c97-4970-9a71-4983c213b417 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Calling method '.version_select at 0x7f46878d93a0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:26.444063 n-d-846435-14 devstack@n-api.service[119304]: WARNING oslo_db.sqlalchemy.utils [None req-333cc91b-0c97-4970-9a71-4983c213b417 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 25 14:27:26.464148 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-333cc91b-0c97-4970-9a71-4983c213b417 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] 10.222.0.88 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.041931 Jul 25 14:27:26.468169 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 368/692] 10.222.0.88 () {60 vars in 1177 bytes} [Mon Jul 25 14:27:26 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:26.481037 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b62a731b-f4aa-4747-a7c7-a163632d18fa tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:26.482200 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b62a731b-f4aa-4747-a7c7-a163632d18fa tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: b6ed0cc6-bfeb-4148-a017-69d0eedad83e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:26.491120 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b62a731b-f4aa-4747-a7c7-a163632d18fa tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:26.496911 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b62a731b-f4aa-4747-a7c7-a163632d18fa tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:26.497828 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b62a731b-f4aa-4747-a7c7-a163632d18fa tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:26.498436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b62a731b-f4aa-4747-a7c7-a163632d18fa tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:26.606604 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d6c57741-f048-423b-a6e6-c5ee97ad0490 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:26.615440 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d6c57741-f048-423b-a6e6-c5ee97ad0490 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1473 microversion: 2.1 time: 0.627646 Jul 25 14:27:26.628160 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 325/693] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:25 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1473 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:26.633208 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e10650ab-faff-4294-bddd-e333a30a68a3 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] Calling method '.version_select at 0x7f4687854670>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:26.683067 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e10650ab-faff-4294-bddd-e333a30a68a3 tempest-KeyPairsV22TestJSON-1281607088 tempest-KeyPairsV22TestJSON-1281607088-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-276099636" status: 204 len: 0 microversion: 2.2 time: 0.053624 Jul 25 14:27:26.684217 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 326/694] 10.222.0.88 () {60 vars in 1258 bytes} [Mon Jul 25 14:27:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-276099636 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:27:26.705032 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d3012a45-68a8-4748-a89d-e84bc84fe74f tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-191623387", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:26.804387 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-d3012a45-68a8-4748-a89d-e84bc84fe74f tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] validate_networks() for None {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:27:27.005541 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b62a731b-f4aa-4747-a7c7-a163632d18fa tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:27.019377 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b62a731b-f4aa-4747-a7c7-a163632d18fa tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e" status: 200 len: 1319 microversion: 2.1 time: 0.549759 Jul 25 14:27:27.020099 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 369/695] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:26 2022] GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e => generated 1319 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:27.029330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d5e7b3ad-ee83-4c92-ada1-0cd3eee12822 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:27.035888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d5e7b3ad-ee83-4c92-ada1-0cd3eee12822 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:27.058649 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5e7b3ad-ee83-4c92-ada1-0cd3eee12822 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:27.061824 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5e7b3ad-ee83-4c92-ada1-0cd3eee12822 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:27.063003 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5e7b3ad-ee83-4c92-ada1-0cd3eee12822 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:27.065749 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5e7b3ad-ee83-4c92-ada1-0cd3eee12822 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:27.214030 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-d3012a45-68a8-4748-a89d-e84bc84fe74f tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:27:27.214581 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-d3012a45-68a8-4748-a89d-e84bc84fe74f tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:27:27.215437 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-d3012a45-68a8-4748-a89d-e84bc84fe74f tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:27:27.215437 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-d3012a45-68a8-4748-a89d-e84bc84fe74f tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:27:27.215818 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-d3012a45-68a8-4748-a89d-e84bc84fe74f tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:27:27.233807 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d3012a45-68a8-4748-a89d-e84bc84fe74f tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:27.234257 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d3012a45-68a8-4748-a89d-e84bc84fe74f tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:27.235048 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d3012a45-68a8-4748-a89d-e84bc84fe74f tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:27.235487 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d3012a45-68a8-4748-a89d-e84bc84fe74f tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:27.258184 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-d3012a45-68a8-4748-a89d-e84bc84fe74f tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Getting quotas for project 327a5b80b3404191ae269afa882d3753. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:27:27.260490 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:27.266750 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-d3012a45-68a8-4748-a89d-e84bc84fe74f tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Getting quotas for user 0334859a0fd544b3b4064ca188a22d32 and project 327a5b80b3404191ae269afa882d3753. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:27:27.283823 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d3012a45-68a8-4748-a89d-e84bc84fe74f tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:27:27.287447 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d3012a45-68a8-4748-a89d-e84bc84fe74f tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: 10a339c9-ca8c-403d-bb81-4aef27960efd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:27:27.371248 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d3012a45-68a8-4748-a89d-e84bc84fe74f tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.677367 Jul 25 14:27:27.372670 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 327/696] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:27:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:27:27.384347 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f16e88c7-dd5b-449e-9af0-a93f7708b270 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:27.385176 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f16e88c7-dd5b-449e-9af0-a93f7708b270 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:27.399216 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f16e88c7-dd5b-449e-9af0-a93f7708b270 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:27.399916 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f16e88c7-dd5b-449e-9af0-a93f7708b270 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:27.401596 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f16e88c7-dd5b-449e-9af0-a93f7708b270 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:27.402637 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f16e88c7-dd5b-449e-9af0-a93f7708b270 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:27.531345 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d5e7b3ad-ee83-4c92-ada1-0cd3eee12822 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:27.539665 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d5e7b3ad-ee83-4c92-ada1-0cd3eee12822 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1472 microversion: 2.1 time: 0.518447 Jul 25 14:27:27.552416 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 370/697] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:27 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1472 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:27.554661 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-c9be7a08-d649-4820-ab6c-3746f4937b5c req-25dfd4b8-410d-46b5-b7bb-b9d38ba508f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a419853-5f31-4fae-8a4e-da15efb145fb", "tag": "7bf3ba29-6559-4754-8d9e-31166ec3ecb3"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:27.578304 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c9be7a08-d649-4820-ab6c-3746f4937b5c req-25dfd4b8-410d-46b5-b7bb-b9d38ba508f0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:27.579060 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c9be7a08-d649-4820-ab6c-3746f4937b5c req-25dfd4b8-410d-46b5-b7bb-b9d38ba508f0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:27.606998 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-c9be7a08-d649-4820-ab6c-3746f4937b5c req-25dfd4b8-410d-46b5-b7bb-b9d38ba508f0 service nova] Creating event network-changed:7bf3ba29-6559-4754-8d9e-31166ec3ecb3 for instance 1a419853-5f31-4fae-8a4e-da15efb145fb on n-h1-846435-14 Jul 25 14:27:27.631280 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [req-c9be7a08-d649-4820-ab6c-3746f4937b5c req-25dfd4b8-410d-46b5-b7bb-b9d38ba508f0 service nova] Instance 1a419853-5f31-4fae-8a4e-da15efb145fb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119304) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 14:27:27.657484 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-c9be7a08-d649-4820-ab6c-3746f4937b5c req-25dfd4b8-410d-46b5-b7bb-b9d38ba508f0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113567 Jul 25 14:27:27.658705 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 371/698] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:27.665886 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2a890518-93d9-4270-b74a-580736145d08 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:27.666787 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2a890518-93d9-4270-b74a-580736145d08 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: 10a339c9-ca8c-403d-bb81-4aef27960efd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:27.759538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2a890518-93d9-4270-b74a-580736145d08 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:27.768288 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2a890518-93d9-4270-b74a-580736145d08 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd" status: 200 len: 1221 microversion: 2.1 time: 0.107759 Jul 25 14:27:27.776139 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 372/699] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:27 2022] GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd => generated 1221 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:27.787232 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f16e88c7-dd5b-449e-9af0-a93f7708b270 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:27.792922 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8ee61bc8-10f5-4091-a922-5b8b187d6ff4 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:27.796495 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8ee61bc8-10f5-4091-a922-5b8b187d6ff4 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: fca96a8a-7721-4bbc-8ffa-b732ef5d753d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:27.796706 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f16e88c7-dd5b-449e-9af0-a93f7708b270 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9" status: 200 len: 1324 microversion: 2.1 time: 0.416206 Jul 25 14:27:27.801099 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 328/700] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:27 2022] GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 => generated 1324 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:27.821237 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-13c5fb85-000c-4161-b6cd-da122b6a4dd9 req-8d7d5f14-957c-4ac5-9663-919948462ece service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fca96a8a-7721-4bbc-8ffa-b732ef5d753d", "tag": "205878ed-21c4-4153-8a87-16c8234dec0f"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:27.822673 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8ee61bc8-10f5-4091-a922-5b8b187d6ff4 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:27.828774 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8ee61bc8-10f5-4091-a922-5b8b187d6ff4 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:27.833648 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8ee61bc8-10f5-4091-a922-5b8b187d6ff4 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:27.835443 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8ee61bc8-10f5-4091-a922-5b8b187d6ff4 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:27.843733 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-13c5fb85-000c-4161-b6cd-da122b6a4dd9 req-8d7d5f14-957c-4ac5-9663-919948462ece service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:27.844452 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-13c5fb85-000c-4161-b6cd-da122b6a4dd9 req-8d7d5f14-957c-4ac5-9663-919948462ece service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:27.881285 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-13c5fb85-000c-4161-b6cd-da122b6a4dd9 req-8d7d5f14-957c-4ac5-9663-919948462ece service nova] Creating event network-changed:205878ed-21c4-4153-8a87-16c8234dec0f for instance fca96a8a-7721-4bbc-8ffa-b732ef5d753d on n-h2-846435-14 Jul 25 14:27:27.895476 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-13c5fb85-000c-4161-b6cd-da122b6a4dd9 req-8d7d5f14-957c-4ac5-9663-919948462ece service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092903 Jul 25 14:27:27.896680 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 329/701] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:27.910139 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4efdbd75-7939-49bf-9fc9-1f2fcf920794 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:27.914844 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4efdbd75-7939-49bf-9fc9-1f2fcf920794 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:27.935183 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4efdbd75-7939-49bf-9fc9-1f2fcf920794 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:27.935837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4efdbd75-7939-49bf-9fc9-1f2fcf920794 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:27.936813 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4efdbd75-7939-49bf-9fc9-1f2fcf920794 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:27.944260 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4efdbd75-7939-49bf-9fc9-1f2fcf920794 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:28.341645 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4efdbd75-7939-49bf-9fc9-1f2fcf920794 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:28.358665 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4efdbd75-7939-49bf-9fc9-1f2fcf920794 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1471 microversion: 2.1 time: 0.458695 Jul 25 14:27:28.359347 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 330/702] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:27 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1471 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:28.366630 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0b48228c-ad96-4b17-97ac-679ae7f2e1dd tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:28.367245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0b48228c-ad96-4b17-97ac-679ae7f2e1dd tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: b6ed0cc6-bfeb-4148-a017-69d0eedad83e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:28.383594 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b48228c-ad96-4b17-97ac-679ae7f2e1dd tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:28.384481 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b48228c-ad96-4b17-97ac-679ae7f2e1dd tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:28.385433 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b48228c-ad96-4b17-97ac-679ae7f2e1dd tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:28.386016 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b48228c-ad96-4b17-97ac-679ae7f2e1dd tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:28.635835 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8ee61bc8-10f5-4091-a922-5b8b187d6ff4 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:28.667036 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8ee61bc8-10f5-4091-a922-5b8b187d6ff4 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d" status: 200 len: 1587 microversion: 2.1 time: 0.888098 Jul 25 14:27:28.671287 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 373/703] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:27 2022] GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d => generated 1587 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:28.678813 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-89b10a0d-a19e-473f-af03-d59cade5b2f6 req-866b8c5f-a8ef-4807-992f-43cd08f2f2c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5312b2e2-2ff9-457f-8d89-1cfa1b508ef9", "name": "network-vif-plugged", "status": "completed", "tag": "9ba908cc-d166-4dbe-8bf6-5618be7e27a2"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:28.695180 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-89b10a0d-a19e-473f-af03-d59cade5b2f6 req-866b8c5f-a8ef-4807-992f-43cd08f2f2c5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:28.697467 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-89b10a0d-a19e-473f-af03-d59cade5b2f6 req-866b8c5f-a8ef-4807-992f-43cd08f2f2c5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:28.715463 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-89b10a0d-a19e-473f-af03-d59cade5b2f6 req-866b8c5f-a8ef-4807-992f-43cd08f2f2c5 service nova] Creating event network-vif-plugged:9ba908cc-d166-4dbe-8bf6-5618be7e27a2 for instance 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 on n-h1-846435-14 Jul 25 14:27:28.722615 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-89b10a0d-a19e-473f-af03-d59cade5b2f6 req-866b8c5f-a8ef-4807-992f-43cd08f2f2c5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048786 Jul 25 14:27:28.724609 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 374/704] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:28.732268 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-883caf0e-f2cc-41f7-9d22-21199d2fc0ba tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:28.733445 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-883caf0e-f2cc-41f7-9d22-21199d2fc0ba tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:28.742666 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-883caf0e-f2cc-41f7-9d22-21199d2fc0ba tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:28.744482 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-883caf0e-f2cc-41f7-9d22-21199d2fc0ba tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:28.745580 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-883caf0e-f2cc-41f7-9d22-21199d2fc0ba tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:28.746232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-883caf0e-f2cc-41f7-9d22-21199d2fc0ba tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:28.749598 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0b48228c-ad96-4b17-97ac-679ae7f2e1dd tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:28.759467 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0b48228c-ad96-4b17-97ac-679ae7f2e1dd tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e" status: 200 len: 1469 microversion: 2.1 time: 0.396526 Jul 25 14:27:28.764903 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 331/705] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:28 2022] GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e => generated 1469 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:29.377424 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-883caf0e-f2cc-41f7-9d22-21199d2fc0ba tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:29.397105 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-883caf0e-f2cc-41f7-9d22-21199d2fc0ba tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1472 microversion: 2.1 time: 0.670676 Jul 25 14:27:29.398326 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 375/706] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:28 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1472 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:29.403415 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-db8bf187-886e-4bbd-b23f-7ec35008ba46 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:29.404055 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-db8bf187-886e-4bbd-b23f-7ec35008ba46 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: 10a339c9-ca8c-403d-bb81-4aef27960efd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:29.415171 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db8bf187-886e-4bbd-b23f-7ec35008ba46 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:29.415626 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db8bf187-886e-4bbd-b23f-7ec35008ba46 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:29.416436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db8bf187-886e-4bbd-b23f-7ec35008ba46 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:29.417037 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db8bf187-886e-4bbd-b23f-7ec35008ba46 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:29.436876 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-551eb7c3-c945-4453-a4d9-528cdc4aa74d tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-856840538", "block_migration": true, "disk_over_commit": false}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:29.453659 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-551eb7c3-c945-4453-a4d9-528cdc4aa74d tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] [instance: b6ed0cc6-bfeb-4148-a017-69d0eedad83e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:29.465343 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-551eb7c3-c945-4453-a4d9-528cdc4aa74d tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:29.465948 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-551eb7c3-c945-4453-a4d9-528cdc4aa74d tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:29.468542 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-551eb7c3-c945-4453-a4d9-528cdc4aa74d tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:29.469571 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-551eb7c3-c945-4453-a4d9-528cdc4aa74d tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:29.594231 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-551eb7c3-c945-4453-a4d9-528cdc4aa74d tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] Lazy-loading 'flavor' on Instance uuid b6ed0cc6-bfeb-4148-a017-69d0eedad83e {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:27:29.594456 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-db8bf187-886e-4bbd-b23f-7ec35008ba46 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:29.602222 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-db8bf187-886e-4bbd-b23f-7ec35008ba46 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd" status: 200 len: 1273 microversion: 2.1 time: 0.202611 Jul 25 14:27:29.602807 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 376/707] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:29 2022] GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd => generated 1273 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:29.607296 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bd181fcc-eae5-467b-9446-1c3089e38026 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:29.607907 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bd181fcc-eae5-467b-9446-1c3089e38026 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:29.630545 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bd181fcc-eae5-467b-9446-1c3089e38026 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:29.630993 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bd181fcc-eae5-467b-9446-1c3089e38026 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:29.631781 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bd181fcc-eae5-467b-9446-1c3089e38026 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:29.632239 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bd181fcc-eae5-467b-9446-1c3089e38026 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:29.660469 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-551eb7c3-c945-4453-a4d9-528cdc4aa74d tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] [instance: b6ed0cc6-bfeb-4148-a017-69d0eedad83e] Going to try to live migrate instance to tempest-host-856840538 {{(pid=119303) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 14:27:29.669812 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-551eb7c3-c945-4453-a4d9-528cdc4aa74d tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] HTTP exception thrown: Compute host tempest-host-856840538 could not be found. Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-551eb7c3-c945-4453-a4d9-528cdc4aa74d tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] Request method failure captured: Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e/action HTTP/1.1 Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 106 Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qg2xpaVGnqN0r1xtRySup6MBYYFczh93AFGUAhaS63wG3ouXL0RrqW10SatAJG7Qk5uDQdrzGIz8ZHqX6qJWw4Q0u_rGadmDsPvce6pzpHuSbxubE17pt76fE-VZ6lJajfomVd4yVbeKeRYJoWPdKw19mLtgPlW1m2uugKCf58tLGM Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 8faf52828921463bb72adad4e12c60e1 Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-LiveMigrationNegativeTest-1375152235 Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: X-Role: admin,reader,member Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: admin,reader,member Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8faf52828921463bb72adad4e12c60e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8faf52828921463bb72adad4e12c60e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8faf52828921463bb72adad4e12c60e1", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8faf52828921463bb72adad4e12c60e1"}]}] Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-LiveMigrationNegativeTest-1375152235 Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 8faf52828921463bb72adad4e12c60e1 Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1375152235 Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-LiveMigrationNegativeTest-1375152235-project-admin Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: f1b075ab565b4b1695f83cc4b4127a91 Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-LiveMigrationNegativeTest-1375152235-project-admin Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: {"os-migrateLive": {"host": "tempest-host-856840538", "block_migration": true, "disk_over_commit": false}} Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: exception: Compute host tempest-host-856840538 could not be found. Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'b6ed0cc6-bfeb-4148-a017-69d0eedad83e', 'body': {'os-migrateLive': {'host': 'tempest-host-856840538', 'block_migration': True, 'disk_over_commit': False}}} Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jul 25 14:27:29.675036 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-856840538 could not be found. Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-856840538 could not be found. Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-856840538 could not be found. Jul 25 14:27:29.678714 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:29.683877 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-551eb7c3-c945-4453-a4d9-528cdc4aa74d tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] Returning 400 to user: Compute host tempest-host-856840538 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:27:29.685384 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-551eb7c3-c945-4453-a4d9-528cdc4aa74d tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e/action" status: 400 len: 99 microversion: 2.1 time: 0.900933 Jul 25 14:27:29.687670 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 332/708] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 25 14:27:28 2022] POST /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e/action => generated 99 bytes in 904 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 25 14:27:29.697753 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cc8c89f2-393c-43eb-9540-9e5e7bcb754b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:29.698587 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cc8c89f2-393c-43eb-9540-9e5e7bcb754b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:29.707952 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cc8c89f2-393c-43eb-9540-9e5e7bcb754b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:29.708680 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cc8c89f2-393c-43eb-9540-9e5e7bcb754b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:29.709637 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cc8c89f2-393c-43eb-9540-9e5e7bcb754b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:29.710230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cc8c89f2-393c-43eb-9540-9e5e7bcb754b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:30.087333 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cc8c89f2-393c-43eb-9540-9e5e7bcb754b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:30.097307 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cc8c89f2-393c-43eb-9540-9e5e7bcb754b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1468 microversion: 2.1 time: 0.408195 Jul 25 14:27:30.097985 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 333/709] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:29 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1468 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:30.103057 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bd181fcc-eae5-467b-9446-1c3089e38026 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:30.108735 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8587c7d4-f747-4b87-bbdc-af0aaa8ea8d9 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:30.109442 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8587c7d4-f747-4b87-bbdc-af0aaa8ea8d9 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: b6ed0cc6-bfeb-4148-a017-69d0eedad83e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:30.118235 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bd181fcc-eae5-467b-9446-1c3089e38026 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9" status: 200 len: 1324 microversion: 2.1 time: 0.514374 Jul 25 14:27:30.131718 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 377/710] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:29 2022] GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 => generated 1324 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:30.139445 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8587c7d4-f747-4b87-bbdc-af0aaa8ea8d9 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:30.141315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-df08628b-6743-4e28-8eec-d56e0e39fba3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:30.142057 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-df08628b-6743-4e28-8eec-d56e0e39fba3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:30.144875 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8587c7d4-f747-4b87-bbdc-af0aaa8ea8d9 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:30.146031 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8587c7d4-f747-4b87-bbdc-af0aaa8ea8d9 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:30.147820 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8587c7d4-f747-4b87-bbdc-af0aaa8ea8d9 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:30.165791 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-df08628b-6743-4e28-8eec-d56e0e39fba3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:30.166617 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-df08628b-6743-4e28-8eec-d56e0e39fba3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:30.167696 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-df08628b-6743-4e28-8eec-d56e0e39fba3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:30.168404 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-df08628b-6743-4e28-8eec-d56e0e39fba3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:30.173543 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:30.269778 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-df08628b-6743-4e28-8eec-d56e0e39fba3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "POST /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb/action" status: 204 len: 0 microversion: 2.1 time: 0.136087 Jul 25 14:27:30.271134 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 378/711] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:27:30 2022] POST /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb/action => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:27:30.282635 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ef1933e5-685f-4e25-bfb9-ce1ae354de2b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:30.283950 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ef1933e5-685f-4e25-bfb9-ce1ae354de2b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:30.293306 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ef1933e5-685f-4e25-bfb9-ce1ae354de2b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:30.295270 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ef1933e5-685f-4e25-bfb9-ce1ae354de2b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:30.296742 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ef1933e5-685f-4e25-bfb9-ce1ae354de2b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:30.305526 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ef1933e5-685f-4e25-bfb9-ce1ae354de2b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:30.450809 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8587c7d4-f747-4b87-bbdc-af0aaa8ea8d9 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:30.459375 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8587c7d4-f747-4b87-bbdc-af0aaa8ea8d9 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e" status: 200 len: 1469 microversion: 2.1 time: 0.360127 Jul 25 14:27:30.460596 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 334/712] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:30 2022] GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e => generated 1469 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:30.465853 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3b227748-0355-45b8-8448-c6522dda1c9a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:30.466721 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3b227748-0355-45b8-8448-c6522dda1c9a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:30.473946 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b227748-0355-45b8-8448-c6522dda1c9a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:30.474815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b227748-0355-45b8-8448-c6522dda1c9a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:30.476230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b227748-0355-45b8-8448-c6522dda1c9a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:30.476856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b227748-0355-45b8-8448-c6522dda1c9a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:30.775987 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3b227748-0355-45b8-8448-c6522dda1c9a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:30.818172 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3b227748-0355-45b8-8448-c6522dda1c9a tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1472 microversion: 2.1 time: 0.353657 Jul 25 14:27:30.828658 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 335/713] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:30 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1472 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:30.843761 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a19dc467-28e3-4e98-a5da-11eb560dc5e5 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:30.854123 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a19dc467-28e3-4e98-a5da-11eb560dc5e5 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: 10a339c9-ca8c-403d-bb81-4aef27960efd] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:30.873372 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a19dc467-28e3-4e98-a5da-11eb560dc5e5 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:30.874183 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a19dc467-28e3-4e98-a5da-11eb560dc5e5 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:30.877040 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a19dc467-28e3-4e98-a5da-11eb560dc5e5 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:30.878763 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a19dc467-28e3-4e98-a5da-11eb560dc5e5 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:31.067758 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a19dc467-28e3-4e98-a5da-11eb560dc5e5 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:31.080681 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a19dc467-28e3-4e98-a5da-11eb560dc5e5 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd" status: 200 len: 1279 microversion: 2.1 time: 0.249520 Jul 25 14:27:31.097071 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 336/714] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:30 2022] GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd => generated 1279 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:31.102436 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a8d675c4-2ca4-41d7-b866-c43c488819cd tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-344306116", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:31.171084 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-a8d675c4-2ca4-41d7-b866-c43c488819cd tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] validate_networks() for None {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:27:31.264849 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ef1933e5-685f-4e25-bfb9-ce1ae354de2b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:31.280400 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ef1933e5-685f-4e25-bfb9-ce1ae354de2b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1468 microversion: 2.1 time: 1.003730 Jul 25 14:27:31.299028 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 379/715] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:30 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1468 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:31.307609 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2099a84c-ce1d-4c5d-985e-c00e4ab19ccb tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:31.308692 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2099a84c-ce1d-4c5d-985e-c00e4ab19ccb tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:31.329534 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2099a84c-ce1d-4c5d-985e-c00e4ab19ccb tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:31.329992 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2099a84c-ce1d-4c5d-985e-c00e4ab19ccb tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:31.338748 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2099a84c-ce1d-4c5d-985e-c00e4ab19ccb tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:31.339200 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2099a84c-ce1d-4c5d-985e-c00e4ab19ccb tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:31.709670 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-a8d675c4-2ca4-41d7-b866-c43c488819cd tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:27:31.710856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-a8d675c4-2ca4-41d7-b866-c43c488819cd tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:27:31.711387 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-a8d675c4-2ca4-41d7-b866-c43c488819cd tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:27:31.712150 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-a8d675c4-2ca4-41d7-b866-c43c488819cd tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:27:31.712904 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-a8d675c4-2ca4-41d7-b866-c43c488819cd tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:27:31.720172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=61 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:31.724356 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a8d675c4-2ca4-41d7-b866-c43c488819cd tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:31.724816 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a8d675c4-2ca4-41d7-b866-c43c488819cd tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:31.725618 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a8d675c4-2ca4-41d7-b866-c43c488819cd tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:31.726052 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a8d675c4-2ca4-41d7-b866-c43c488819cd tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:31.752403 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-a8d675c4-2ca4-41d7-b866-c43c488819cd tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Getting quotas for project f07a43cd116847b6816581adfeed8f9b. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:27:31.758991 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-a8d675c4-2ca4-41d7-b866-c43c488819cd tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Getting quotas for user 6976261712c44d37821f95e1f482de72 and project f07a43cd116847b6816581adfeed8f9b. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:27:31.781887 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a8d675c4-2ca4-41d7-b866-c43c488819cd tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:27:31.784468 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a8d675c4-2ca4-41d7-b866-c43c488819cd tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: 6805171d-8f8d-4694-ab4a-2875d20b0d2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:27:31.856247 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a8d675c4-2ca4-41d7-b866-c43c488819cd tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.757496 Jul 25 14:27:31.856997 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 337/716] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:27:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:27:31.879879 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1243a1fa-632c-406a-85f1-6fbaa09388ac tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:31.883163 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1243a1fa-632c-406a-85f1-6fbaa09388ac tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:31.901262 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1243a1fa-632c-406a-85f1-6fbaa09388ac tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:31.902635 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1243a1fa-632c-406a-85f1-6fbaa09388ac tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:31.903602 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1243a1fa-632c-406a-85f1-6fbaa09388ac tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:31.904312 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1243a1fa-632c-406a-85f1-6fbaa09388ac tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:31.910351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:32.108581 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1243a1fa-632c-406a-85f1-6fbaa09388ac tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:32.135465 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1243a1fa-632c-406a-85f1-6fbaa09388ac tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1472 microversion: 2.1 time: 0.266782 Jul 25 14:27:32.136927 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 338/717] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:31 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1472 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:32.148605 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e9952064-213e-41c8-a55e-c37542199899 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:32.149523 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e9952064-213e-41c8-a55e-c37542199899 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: 6805171d-8f8d-4694-ab4a-2875d20b0d2a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:32.266024 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e9952064-213e-41c8-a55e-c37542199899 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:32.274556 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e9952064-213e-41c8-a55e-c37542199899 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a" status: 200 len: 1218 microversion: 2.1 time: 0.136213 Jul 25 14:27:32.275083 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 339/718] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:32 2022] GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a => generated 1218 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:32.294601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ce445ede-30f0-4a24-af1f-444c73908050 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:32.295248 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2099a84c-ce1d-4c5d-985e-c00e4ab19ccb tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:32.305373 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ce445ede-30f0-4a24-af1f-444c73908050 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: 10a339c9-ca8c-403d-bb81-4aef27960efd] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:32.315665 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2099a84c-ce1d-4c5d-985e-c00e4ab19ccb tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9" status: 200 len: 1520 microversion: 2.1 time: 1.013062 Jul 25 14:27:32.316673 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 380/719] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:31 2022] GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 => generated 1520 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:32.330147 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ce445ede-30f0-4a24-af1f-444c73908050 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:32.330765 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ce445ede-30f0-4a24-af1f-444c73908050 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:32.333716 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ce445ede-30f0-4a24-af1f-444c73908050 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:32.334554 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ce445ede-30f0-4a24-af1f-444c73908050 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:32.334812 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d8d5f4a1-50a5-431a-b32a-c3eb5fcafad7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:32.338095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d8d5f4a1-50a5-431a-b32a-c3eb5fcafad7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:32.350441 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d8d5f4a1-50a5-431a-b32a-c3eb5fcafad7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:32.353208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d8d5f4a1-50a5-431a-b32a-c3eb5fcafad7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:32.354178 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d8d5f4a1-50a5-431a-b32a-c3eb5fcafad7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:32.354599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d8d5f4a1-50a5-431a-b32a-c3eb5fcafad7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:32.470133 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ce445ede-30f0-4a24-af1f-444c73908050 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:32.479386 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ce445ede-30f0-4a24-af1f-444c73908050 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd" status: 200 len: 1279 microversion: 2.1 time: 0.201623 Jul 25 14:27:32.480656 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 340/720] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:32 2022] GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd => generated 1279 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:32.488218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5dbc43db-3f85-403a-bbf4-c4c56a1bb4f3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:32.489000 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5dbc43db-3f85-403a-bbf4-c4c56a1bb4f3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:32.501968 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5dbc43db-3f85-403a-bbf4-c4c56a1bb4f3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:32.504274 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5dbc43db-3f85-403a-bbf4-c4c56a1bb4f3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:32.506322 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5dbc43db-3f85-403a-bbf4-c4c56a1bb4f3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:32.506836 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5dbc43db-3f85-403a-bbf4-c4c56a1bb4f3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:32.680791 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5dbc43db-3f85-403a-bbf4-c4c56a1bb4f3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:32.689527 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5dbc43db-3f85-403a-bbf4-c4c56a1bb4f3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9" status: 200 len: 1520 microversion: 2.1 time: 0.207472 Jul 25 14:27:32.700180 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 341/721] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:32 2022] GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:32.711913 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-43abca63-29e0-41b9-8b55-8b759e88c4dc tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-178040929"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:32.717655 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-43abca63-29e0-41b9-8b55-8b759e88c4dc tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:32.724435 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43abca63-29e0-41b9-8b55-8b759e88c4dc tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:32.724951 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43abca63-29e0-41b9-8b55-8b759e88c4dc tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:32.726027 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43abca63-29e0-41b9-8b55-8b759e88c4dc tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:32.726649 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43abca63-29e0-41b9-8b55-8b759e88c4dc tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:32.986368 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d8d5f4a1-50a5-431a-b32a-c3eb5fcafad7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:32.993896 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-43abca63-29e0-41b9-8b55-8b759e88c4dc tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "POST /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9/action" status: 202 len: 0 microversion: 2.1 time: 0.286243 Jul 25 14:27:32.999643 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 342/722] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:27:32 2022] POST /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 25 14:27:33.009249 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-977a8a6a-f611-412e-b5bf-7ae39a0956f5 req-c419d4f4-d85a-466f-91fb-761e0ff3abcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a419853-5f31-4fae-8a4e-da15efb145fb", "name": "network-vif-plugged", "status": "completed", "tag": "7bf3ba29-6559-4754-8d9e-31166ec3ecb3"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:33.028660 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d8d5f4a1-50a5-431a-b32a-c3eb5fcafad7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1468 microversion: 2.1 time: 0.708525 Jul 25 14:27:33.035174 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-977a8a6a-f611-412e-b5bf-7ae39a0956f5 req-c419d4f4-d85a-466f-91fb-761e0ff3abcd service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:33.035764 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-977a8a6a-f611-412e-b5bf-7ae39a0956f5 req-c419d4f4-d85a-466f-91fb-761e0ff3abcd service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:33.049524 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 381/723] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:32 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1468 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:33.059952 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-977a8a6a-f611-412e-b5bf-7ae39a0956f5 req-c419d4f4-d85a-466f-91fb-761e0ff3abcd service nova] Creating event network-vif-plugged:7bf3ba29-6559-4754-8d9e-31166ec3ecb3 for instance 1a419853-5f31-4fae-8a4e-da15efb145fb on n-h1-846435-14 Jul 25 14:27:33.063917 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cab2f7d9-2966-4132-b3a0-d823093ac440 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '.version_select at 0x7f46878f14c0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:33.089674 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [req-977a8a6a-f611-412e-b5bf-7ae39a0956f5 req-c419d4f4-d85a-466f-91fb-761e0ff3abcd service nova] Instance 1a419853-5f31-4fae-8a4e-da15efb145fb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119303) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 14:27:33.134089 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-977a8a6a-f611-412e-b5bf-7ae39a0956f5 req-c419d4f4-d85a-466f-91fb-761e0ff3abcd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132987 Jul 25 14:27:33.142016 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 343/724] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:33.161921 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-78e2866c-bdfa-44c9-b57d-d172743e1816 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:33.162616 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-78e2866c-bdfa-44c9-b57d-d172743e1816 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:33.174681 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-78e2866c-bdfa-44c9-b57d-d172743e1816 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:33.178308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-78e2866c-bdfa-44c9-b57d-d172743e1816 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:33.181488 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-78e2866c-bdfa-44c9-b57d-d172743e1816 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:33.182146 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-78e2866c-bdfa-44c9-b57d-d172743e1816 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:33.325611 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cab2f7d9-2966-4132-b3a0-d823093ac440 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "DELETE /compute/v2.1/images/0dcfe739-f97a-4424-9c8e-0277e691cc7c" status: 204 len: 0 microversion: 2.1 time: 0.271822 Jul 25 14:27:33.329127 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 382/725] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:33 2022] DELETE /compute/v2.1/images/0dcfe739-f97a-4424-9c8e-0277e691cc7c => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:27:33.347989 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f69f3d4d-cfb9-4371-bd29-33f2fdbaf2ec tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:33.352205 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f69f3d4d-cfb9-4371-bd29-33f2fdbaf2ec tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: 6805171d-8f8d-4694-ab4a-2875d20b0d2a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:33.381263 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f69f3d4d-cfb9-4371-bd29-33f2fdbaf2ec tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:33.381712 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f69f3d4d-cfb9-4371-bd29-33f2fdbaf2ec tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:33.382491 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f69f3d4d-cfb9-4371-bd29-33f2fdbaf2ec tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:33.382921 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f69f3d4d-cfb9-4371-bd29-33f2fdbaf2ec tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:33.478161 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-78e2866c-bdfa-44c9-b57d-d172743e1816 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:33.487387 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-78e2866c-bdfa-44c9-b57d-d172743e1816 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1472 microversion: 2.1 time: 0.329644 Jul 25 14:27:33.489992 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 344/726] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:33 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1472 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:27:33.495748 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2a1aff7e-c7b6-4f2c-ad24-ee793f70dc5b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '.version_select at 0x7f46878f3430>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:33.533525 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-2a1aff7e-c7b6-4f2c-ad24-ee793f70dc5b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] HTTP exception thrown: Image not found. Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2a1aff7e-c7b6-4f2c-ad24-ee793f70dc5b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Request method failure captured: Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/images/0dcfe739-f97a-4424-9c8e-0277e691cc7c HTTP/1.1 Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qgcGc2RjkaZaGa63-PPdbCX4s7H2xWtuYRqlF0JWR61IUGzx74RHc-m8TJT-_RdlH0tQcWSd5UK3Q-O0K9ctQCv8954sZsqJWdlZOw1b7jo_qk8Zk2eLIrhbYh_u9wxQIss6t5T5Ti1Es5U9sr0YdlFFb4d-omgDGqaIN2Ib47NRJM Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: c0116982ed03475097096c73b5f03035 Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0116982ed03475097096c73b5f03035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0116982ed03475097096c73b5f03035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0116982ed03475097096c73b5f03035", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0116982ed03475097096c73b5f03035"}]}] Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: c0116982ed03475097096c73b5f03035 Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ImagesOneServerNegativeTestJSON-745484288-project Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: f1b1656f2dcd4ffebac55bf18110ff63 Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-745484288-project Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: exception: Image not found. Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '0dcfe739-f97a-4424-9c8e-0277e691cc7c'} Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0dcfe739-f97a-4424-9c8e-0277e691cc7c Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 14:27:33.538544 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0dcfe739-f97a-4424-9c8e-0277e691cc7c could not be found. Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2a1aff7e-c7b6-4f2c-ad24-ee793f70dc5b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Returning 404 to user: Image not found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2a1aff7e-c7b6-4f2c-ad24-ee793f70dc5b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/images/0dcfe739-f97a-4424-9c8e-0277e691cc7c" status: 404 len: 62 microversion: 2.1 time: 0.048295 Jul 25 14:27:33.542367 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 345/727] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:27:33 2022] GET /compute/v2.1/images/0dcfe739-f97a-4424-9c8e-0277e691cc7c => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:27:33.550923 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5de1be9b-fc27-479d-8e00-6c5299ab14d8 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:33.551542 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5de1be9b-fc27-479d-8e00-6c5299ab14d8 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: 10a339c9-ca8c-403d-bb81-4aef27960efd] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:33.576436 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5de1be9b-fc27-479d-8e00-6c5299ab14d8 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:33.576902 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5de1be9b-fc27-479d-8e00-6c5299ab14d8 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:33.580035 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5de1be9b-fc27-479d-8e00-6c5299ab14d8 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:33.580625 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5de1be9b-fc27-479d-8e00-6c5299ab14d8 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:33.813669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f69f3d4d-cfb9-4371-bd29-33f2fdbaf2ec tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:33.824291 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f69f3d4d-cfb9-4371-bd29-33f2fdbaf2ec tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a" status: 200 len: 1270 microversion: 2.1 time: 0.491471 Jul 25 14:27:33.828311 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 383/728] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:33 2022] GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a => generated 1270 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:33.833779 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1c9c4c4a-c58e-478e-92a9-b9bf0967450f tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:33.834655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1c9c4c4a-c58e-478e-92a9-b9bf0967450f tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:33.849759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1c9c4c4a-c58e-478e-92a9-b9bf0967450f tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:33.853093 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1c9c4c4a-c58e-478e-92a9-b9bf0967450f tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:33.853989 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1c9c4c4a-c58e-478e-92a9-b9bf0967450f tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:33.854643 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1c9c4c4a-c58e-478e-92a9-b9bf0967450f tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:33.908232 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5de1be9b-fc27-479d-8e00-6c5299ab14d8 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:33.922672 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5de1be9b-fc27-479d-8e00-6c5299ab14d8 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd" status: 200 len: 1321 microversion: 2.1 time: 0.377400 Jul 25 14:27:33.923591 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 346/729] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:33 2022] GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd => generated 1321 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:34.055028 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ff60f492-088c-4515-88f7-950e4dcc2c1c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:34.055776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ff60f492-088c-4515-88f7-950e4dcc2c1c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:34.062908 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ff60f492-088c-4515-88f7-950e4dcc2c1c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:34.063607 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ff60f492-088c-4515-88f7-950e4dcc2c1c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:34.064482 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ff60f492-088c-4515-88f7-950e4dcc2c1c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:34.065359 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ff60f492-088c-4515-88f7-950e4dcc2c1c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:34.297966 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ff60f492-088c-4515-88f7-950e4dcc2c1c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:34.306944 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ff60f492-088c-4515-88f7-950e4dcc2c1c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1468 microversion: 2.1 time: 0.256347 Jul 25 14:27:34.310850 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 347/730] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:34 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1468 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:34.464770 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1c9c4c4a-c58e-478e-92a9-b9bf0967450f tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:34.476125 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1c9c4c4a-c58e-478e-92a9-b9bf0967450f tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9" status: 200 len: 1532 microversion: 2.1 time: 0.646248 Jul 25 14:27:34.490071 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 384/731] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:33 2022] GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 => generated 1532 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:34.510791 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8d1e9202-523e-4711-84a5-7cfa249472ce tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:34.511532 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8d1e9202-523e-4711-84a5-7cfa249472ce tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:34.520276 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8d1e9202-523e-4711-84a5-7cfa249472ce tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:34.521873 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8d1e9202-523e-4711-84a5-7cfa249472ce tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:34.525613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8d1e9202-523e-4711-84a5-7cfa249472ce tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:34.526173 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8d1e9202-523e-4711-84a5-7cfa249472ce tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:34.827923 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8d1e9202-523e-4711-84a5-7cfa249472ce tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:34.839333 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8d1e9202-523e-4711-84a5-7cfa249472ce tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1472 microversion: 2.1 time: 0.332314 Jul 25 14:27:34.840748 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 348/732] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:34 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1472 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:34.860412 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7f2f5999-9c80-4556-a85d-cb47cac4f8e3 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:34.861344 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7f2f5999-9c80-4556-a85d-cb47cac4f8e3 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: 6805171d-8f8d-4694-ab4a-2875d20b0d2a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:34.871549 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7f2f5999-9c80-4556-a85d-cb47cac4f8e3 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:34.872348 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7f2f5999-9c80-4556-a85d-cb47cac4f8e3 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:34.873302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7f2f5999-9c80-4556-a85d-cb47cac4f8e3 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:34.874023 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7f2f5999-9c80-4556-a85d-cb47cac4f8e3 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:34.947337 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7bd26dbd-adc0-455b-8566-7f22326a1a08 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:34.948563 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7bd26dbd-adc0-455b-8566-7f22326a1a08 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: 10a339c9-ca8c-403d-bb81-4aef27960efd] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:34.966143 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7bd26dbd-adc0-455b-8566-7f22326a1a08 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:34.969210 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7bd26dbd-adc0-455b-8566-7f22326a1a08 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:34.972307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7bd26dbd-adc0-455b-8566-7f22326a1a08 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:34.973659 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7bd26dbd-adc0-455b-8566-7f22326a1a08 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:35.201196 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7bd26dbd-adc0-455b-8566-7f22326a1a08 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:35.220614 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7bd26dbd-adc0-455b-8566-7f22326a1a08 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd" status: 200 len: 1321 microversion: 2.1 time: 0.278501 Jul 25 14:27:35.223387 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 349/733] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:34 2022] GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd => generated 1321 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:27:35.335014 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7b5feed1-144a-4fd4-9fe4-525bc15bc7bb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:35.336491 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7b5feed1-144a-4fd4-9fe4-525bc15bc7bb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:35.346556 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b5feed1-144a-4fd4-9fe4-525bc15bc7bb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:35.348208 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b5feed1-144a-4fd4-9fe4-525bc15bc7bb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:35.349231 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b5feed1-144a-4fd4-9fe4-525bc15bc7bb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:35.350158 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b5feed1-144a-4fd4-9fe4-525bc15bc7bb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:35.475875 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7f2f5999-9c80-4556-a85d-cb47cac4f8e3 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:35.495172 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7f2f5999-9c80-4556-a85d-cb47cac4f8e3 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a" status: 200 len: 1318 microversion: 2.1 time: 0.639721 Jul 25 14:27:35.496190 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 385/734] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:34 2022] GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a => generated 1318 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:35.503109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a4c972bf-aceb-4c3b-adad-ac6cc5d47411 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:35.504505 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a4c972bf-aceb-4c3b-adad-ac6cc5d47411 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:35.514575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4c972bf-aceb-4c3b-adad-ac6cc5d47411 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:35.515134 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4c972bf-aceb-4c3b-adad-ac6cc5d47411 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:35.522234 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4c972bf-aceb-4c3b-adad-ac6cc5d47411 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:35.523155 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4c972bf-aceb-4c3b-adad-ac6cc5d47411 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:35.612644 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7b5feed1-144a-4fd4-9fe4-525bc15bc7bb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:35.626216 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7b5feed1-144a-4fd4-9fe4-525bc15bc7bb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1460 microversion: 2.1 time: 0.298432 Jul 25 14:27:35.630307 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 350/735] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:35 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1460 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:35.650084 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-088ff632-e574-48b9-8989-7b5e9c0f51a1 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:35.650911 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-088ff632-e574-48b9-8989-7b5e9c0f51a1 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:35.660467 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-088ff632-e574-48b9-8989-7b5e9c0f51a1 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:35.661203 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-088ff632-e574-48b9-8989-7b5e9c0f51a1 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:35.662936 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-088ff632-e574-48b9-8989-7b5e9c0f51a1 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:35.663522 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-088ff632-e574-48b9-8989-7b5e9c0f51a1 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:36.309260 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a4c972bf-aceb-4c3b-adad-ac6cc5d47411 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:36.325054 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a4c972bf-aceb-4c3b-adad-ac6cc5d47411 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9" status: 200 len: 1538 microversion: 2.1 time: 0.827693 Jul 25 14:27:36.326578 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 386/736] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:35 2022] GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 => generated 1538 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:36.344829 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-fc1cb4e1-6e6d-4943-ae3b-c735bb10c578 req-e0fc559f-16d9-4bc7-92a4-963243e4c2bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6805171d-8f8d-4694-ab4a-2875d20b0d2a", "tag": "c0ef8191-2d08-4d3f-90f7-ebf1eb92fcad"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:36.361989 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-fc1cb4e1-6e6d-4943-ae3b-c735bb10c578 req-e0fc559f-16d9-4bc7-92a4-963243e4c2bd service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:36.362788 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-fc1cb4e1-6e6d-4943-ae3b-c735bb10c578 req-e0fc559f-16d9-4bc7-92a4-963243e4c2bd service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:36.375519 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-fc1cb4e1-6e6d-4943-ae3b-c735bb10c578 req-e0fc559f-16d9-4bc7-92a4-963243e4c2bd service nova] Creating event network-changed:c0ef8191-2d08-4d3f-90f7-ebf1eb92fcad for instance 6805171d-8f8d-4694-ab4a-2875d20b0d2a on n-h2-846435-14 Jul 25 14:27:36.381394 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-fc1cb4e1-6e6d-4943-ae3b-c735bb10c578 req-e0fc559f-16d9-4bc7-92a4-963243e4c2bd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053048 Jul 25 14:27:36.382944 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 387/737] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:36.390652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3b9253e5-62bb-476d-8a64-5cb247ab36d7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:36.392170 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3b9253e5-62bb-476d-8a64-5cb247ab36d7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:36.396733 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-088ff632-e574-48b9-8989-7b5e9c0f51a1 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1613 microversion: 2.1 time: 0.750834 Jul 25 14:27:36.399831 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b9253e5-62bb-476d-8a64-5cb247ab36d7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:36.400615 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b9253e5-62bb-476d-8a64-5cb247ab36d7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:36.401802 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b9253e5-62bb-476d-8a64-5cb247ab36d7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:36.402676 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b9253e5-62bb-476d-8a64-5cb247ab36d7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:36.424575 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 351/738] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:35 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1613 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:27:36.431877 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c4cfd2f9-94b0-4375-9531-0b45a9ee497b tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:36.434424 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c4cfd2f9-94b0-4375-9531-0b45a9ee497b tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: 10a339c9-ca8c-403d-bb81-4aef27960efd] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:36.452077 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c4cfd2f9-94b0-4375-9531-0b45a9ee497b tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:36.452222 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c4cfd2f9-94b0-4375-9531-0b45a9ee497b tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:36.452905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c4cfd2f9-94b0-4375-9531-0b45a9ee497b tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:36.453343 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c4cfd2f9-94b0-4375-9531-0b45a9ee497b tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:36.848026 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c4cfd2f9-94b0-4375-9531-0b45a9ee497b tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:36.862367 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c4cfd2f9-94b0-4375-9531-0b45a9ee497b tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd" status: 200 len: 1321 microversion: 2.1 time: 0.439850 Jul 25 14:27:36.870387 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 352/739] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:36 2022] GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd => generated 1321 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:36.877064 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-78143ea1-5abc-48d6-8b03-b9a1f9f9fc51 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Calling method '.version_select at 0x7f468777eca0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:36.881874 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-78143ea1-5abc-48d6-8b03-b9a1f9f9fc51 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:36.882581 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-78143ea1-5abc-48d6-8b03-b9a1f9f9fc51 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:36.918607 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-78143ea1-5abc-48d6-8b03-b9a1f9f9fc51 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] 10.222.0.88 "GET /compute/v2.1/os-migrations" status: 200 len: 413 microversion: 2.1 time: 0.046615 Jul 25 14:27:36.922954 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 353/740] 10.222.0.88 () {58 vars in 1143 bytes} [Mon Jul 25 14:27:36 2022] GET /compute/v2.1/os-migrations => generated 413 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:36.942881 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-da99a988-d389-4ae8-91ab-eaa1e1fa7119 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:36.943627 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-da99a988-d389-4ae8-91ab-eaa1e1fa7119 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: 6805171d-8f8d-4694-ab4a-2875d20b0d2a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:36.951523 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da99a988-d389-4ae8-91ab-eaa1e1fa7119 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:36.952153 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da99a988-d389-4ae8-91ab-eaa1e1fa7119 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:36.953046 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da99a988-d389-4ae8-91ab-eaa1e1fa7119 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:36.953586 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da99a988-d389-4ae8-91ab-eaa1e1fa7119 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:36.973830 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3b9253e5-62bb-476d-8a64-5cb247ab36d7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:36.990024 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3b9253e5-62bb-476d-8a64-5cb247ab36d7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1472 microversion: 2.1 time: 0.604893 Jul 25 14:27:36.991779 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 388/741] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:36 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1472 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:37.142518 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0e6e79dd-4409-420e-aa30-7db1832830c5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1422616714", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:37.232390 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-0e6e79dd-4409-420e-aa30-7db1832830c5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] validate_networks() for None {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:27:37.322037 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-da99a988-d389-4ae8-91ab-eaa1e1fa7119 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:37.330959 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-da99a988-d389-4ae8-91ab-eaa1e1fa7119 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a" status: 200 len: 1318 microversion: 2.1 time: 0.406296 Jul 25 14:27:37.332365 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 354/742] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:36 2022] GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a => generated 1318 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:37.350163 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-864fd6d0-d4f7-4ff2-8d28-64fd5eff7cfa tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:37.351235 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-864fd6d0-d4f7-4ff2-8d28-64fd5eff7cfa tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:37.360477 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-864fd6d0-d4f7-4ff2-8d28-64fd5eff7cfa tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:37.361222 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-864fd6d0-d4f7-4ff2-8d28-64fd5eff7cfa tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:37.362314 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-864fd6d0-d4f7-4ff2-8d28-64fd5eff7cfa tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:37.363304 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-864fd6d0-d4f7-4ff2-8d28-64fd5eff7cfa tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:37.561187 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-864fd6d0-d4f7-4ff2-8d28-64fd5eff7cfa tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:37.585721 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-864fd6d0-d4f7-4ff2-8d28-64fd5eff7cfa tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9" status: 200 len: 1520 microversion: 2.1 time: 0.239371 Jul 25 14:27:37.587026 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 355/743] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:37 2022] GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:37.613018 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7cdb8d33-385d-4445-82e4-80f720cad5c4 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:37.615229 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7cdb8d33-385d-4445-82e4-80f720cad5c4 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:37.623203 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7cdb8d33-385d-4445-82e4-80f720cad5c4 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:37.623955 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7cdb8d33-385d-4445-82e4-80f720cad5c4 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:37.624957 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7cdb8d33-385d-4445-82e4-80f720cad5c4 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:37.626081 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7cdb8d33-385d-4445-82e4-80f720cad5c4 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:37.652456 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:37.664248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7cdb8d33-385d-4445-82e4-80f720cad5c4 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:27:37.764733 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=43 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:37.831491 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7cdb8d33-385d-4445-82e4-80f720cad5c4 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "DELETE /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9" status: 204 len: 0 microversion: 2.1 time: 0.223938 Jul 25 14:27:37.837155 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 356/744] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:27:37 2022] DELETE /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 14:27:37.839835 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-1b9774ef-6dc8-4d43-a243-24de4e976610 req-a12d903e-7b91-4ee0-807b-55c7219baf2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10a339c9-ca8c-403d-bb81-4aef27960efd", "tag": "f37b672e-6ac4-490d-a461-bc2d062ec5c4"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:37.852492 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-1b9774ef-6dc8-4d43-a243-24de4e976610 req-a12d903e-7b91-4ee0-807b-55c7219baf2b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:37.852947 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-1b9774ef-6dc8-4d43-a243-24de4e976610 req-a12d903e-7b91-4ee0-807b-55c7219baf2b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:37.891965 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-1b9774ef-6dc8-4d43-a243-24de4e976610 req-a12d903e-7b91-4ee0-807b-55c7219baf2b service nova] Creating event network-changed:f37b672e-6ac4-490d-a461-bc2d062ec5c4 for instance 10a339c9-ca8c-403d-bb81-4aef27960efd on n-h1-846435-14 Jul 25 14:27:37.899888 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-1b9774ef-6dc8-4d43-a243-24de4e976610 req-a12d903e-7b91-4ee0-807b-55c7219baf2b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065675 Jul 25 14:27:37.900917 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 357/745] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:37.906783 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-92fedfcd-59a1-4add-a9a0-9fd67fee07a1 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:37.907495 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-92fedfcd-59a1-4add-a9a0-9fd67fee07a1 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:37.922566 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-92fedfcd-59a1-4add-a9a0-9fd67fee07a1 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:37.922840 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-92fedfcd-59a1-4add-a9a0-9fd67fee07a1 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:37.923511 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-92fedfcd-59a1-4add-a9a0-9fd67fee07a1 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:37.923947 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-92fedfcd-59a1-4add-a9a0-9fd67fee07a1 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:38.167884 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-92fedfcd-59a1-4add-a9a0-9fd67fee07a1 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:38.177260 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-92fedfcd-59a1-4add-a9a0-9fd67fee07a1 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9" status: 200 len: 1526 microversion: 2.1 time: 0.275073 Jul 25 14:27:38.178742 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 358/746] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:37 2022] GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 => generated 1526 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:38.184099 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-808443eb-f7fe-411d-89c0-13cd8b17b86c tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:38.184880 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-808443eb-f7fe-411d-89c0-13cd8b17b86c tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: 10a339c9-ca8c-403d-bb81-4aef27960efd] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:38.191907 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-808443eb-f7fe-411d-89c0-13cd8b17b86c tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:38.192636 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-808443eb-f7fe-411d-89c0-13cd8b17b86c tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:38.193607 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-808443eb-f7fe-411d-89c0-13cd8b17b86c tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:38.194203 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-808443eb-f7fe-411d-89c0-13cd8b17b86c tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:38.396152 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-808443eb-f7fe-411d-89c0-13cd8b17b86c tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:38.403967 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-808443eb-f7fe-411d-89c0-13cd8b17b86c tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd" status: 200 len: 1321 microversion: 2.1 time: 0.224067 Jul 25 14:27:38.404778 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 359/747] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:38 2022] GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:38.409512 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6cb580d1-bf0e-4114-9291-0f0309fb462b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:38.410116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6cb580d1-bf0e-4114-9291-0f0309fb462b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:38.417992 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6cb580d1-bf0e-4114-9291-0f0309fb462b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:38.418464 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6cb580d1-bf0e-4114-9291-0f0309fb462b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:38.419559 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6cb580d1-bf0e-4114-9291-0f0309fb462b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:38.420013 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6cb580d1-bf0e-4114-9291-0f0309fb462b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:38.504564 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-0e6e79dd-4409-420e-aa30-7db1832830c5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:27:38.505206 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-0e6e79dd-4409-420e-aa30-7db1832830c5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:27:38.505889 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-0e6e79dd-4409-420e-aa30-7db1832830c5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:27:38.506361 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-0e6e79dd-4409-420e-aa30-7db1832830c5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:27:38.506840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-0e6e79dd-4409-420e-aa30-7db1832830c5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:27:38.517848 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0e6e79dd-4409-420e-aa30-7db1832830c5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:38.518728 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0e6e79dd-4409-420e-aa30-7db1832830c5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:38.519671 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0e6e79dd-4409-420e-aa30-7db1832830c5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:38.520455 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0e6e79dd-4409-420e-aa30-7db1832830c5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:38.542190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-0e6e79dd-4409-420e-aa30-7db1832830c5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Getting quotas for project 887aa20d1838484eb895896f8f76ce41. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:27:38.552150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-0e6e79dd-4409-420e-aa30-7db1832830c5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Getting quotas for user 00aea97fb95c44cfa5dce25e9a06cd37 and project 887aa20d1838484eb895896f8f76ce41. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:27:38.557961 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6cb580d1-bf0e-4114-9291-0f0309fb462b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:38.567931 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6cb580d1-bf0e-4114-9291-0f0309fb462b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1472 microversion: 2.1 time: 0.161900 Jul 25 14:27:38.570114 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 360/748] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:38 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1472 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:38.575195 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3b270c6c-97db-4524-9266-76f34f042bb1 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:38.576016 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3b270c6c-97db-4524-9266-76f34f042bb1 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: 6805171d-8f8d-4694-ab4a-2875d20b0d2a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:38.578388 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0e6e79dd-4409-420e-aa30-7db1832830c5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:27:38.581889 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0e6e79dd-4409-420e-aa30-7db1832830c5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:27:38.582685 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b270c6c-97db-4524-9266-76f34f042bb1 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:38.583318 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b270c6c-97db-4524-9266-76f34f042bb1 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:38.584421 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b270c6c-97db-4524-9266-76f34f042bb1 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:38.585010 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b270c6c-97db-4524-9266-76f34f042bb1 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:38.636887 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0e6e79dd-4409-420e-aa30-7db1832830c5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.498830 Jul 25 14:27:38.638209 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 389/749] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:27:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:27:38.652174 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-75d161a8-ef0a-4a37-8288-e73abf8928e6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:38.653071 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-75d161a8-ef0a-4a37-8288-e73abf8928e6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:38.761561 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-75d161a8-ef0a-4a37-8288-e73abf8928e6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:38.772997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3b270c6c-97db-4524-9266-76f34f042bb1 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:38.780324 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-75d161a8-ef0a-4a37-8288-e73abf8928e6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1213 microversion: 2.1 time: 0.135047 Jul 25 14:27:38.792358 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 390/750] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:38 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1213 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:38.796116 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3b270c6c-97db-4524-9266-76f34f042bb1 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a" status: 200 len: 1318 microversion: 2.1 time: 0.224326 Jul 25 14:27:38.811082 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 361/751] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:38 2022] GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:38.869670 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-58579ad9-a3ef-4ca2-803e-99a21ec2cb71 req-b6de6518-210c-4a77-842b-fb10a83323fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5312b2e2-2ff9-457f-8d89-1cfa1b508ef9", "name": "network-vif-plugged", "status": "completed", "tag": "9ba908cc-d166-4dbe-8bf6-5618be7e27a2"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:38.904935 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-58579ad9-a3ef-4ca2-803e-99a21ec2cb71 req-b6de6518-210c-4a77-842b-fb10a83323fc service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:38.905527 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-58579ad9-a3ef-4ca2-803e-99a21ec2cb71 req-b6de6518-210c-4a77-842b-fb10a83323fc service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:38.920445 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-58579ad9-a3ef-4ca2-803e-99a21ec2cb71 req-b6de6518-210c-4a77-842b-fb10a83323fc service nova] Creating event network-vif-plugged:9ba908cc-d166-4dbe-8bf6-5618be7e27a2 for instance 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 on n-h1-846435-14 Jul 25 14:27:38.929698 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-58579ad9-a3ef-4ca2-803e-99a21ec2cb71 req-b6de6518-210c-4a77-842b-fb10a83323fc service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060596 Jul 25 14:27:38.931531 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 391/752] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:39.199158 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e9f4e85b-1b4b-41cb-a6ef-6a32dba9b91b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:39.199775 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e9f4e85b-1b4b-41cb-a6ef-6a32dba9b91b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:39.206896 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e9f4e85b-1b4b-41cb-a6ef-6a32dba9b91b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:39.207328 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e9f4e85b-1b4b-41cb-a6ef-6a32dba9b91b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:39.208139 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e9f4e85b-1b4b-41cb-a6ef-6a32dba9b91b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:39.208577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e9f4e85b-1b4b-41cb-a6ef-6a32dba9b91b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:39.425936 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f8aa8825-5c2a-4435-989d-3c5c74d26486 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:39.426703 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f8aa8825-5c2a-4435-989d-3c5c74d26486 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: 10a339c9-ca8c-403d-bb81-4aef27960efd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:39.441481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8aa8825-5c2a-4435-989d-3c5c74d26486 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:39.443103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8aa8825-5c2a-4435-989d-3c5c74d26486 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:39.445119 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8aa8825-5c2a-4435-989d-3c5c74d26486 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:39.447703 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8aa8825-5c2a-4435-989d-3c5c74d26486 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:39.682490 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e9f4e85b-1b4b-41cb-a6ef-6a32dba9b91b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:39.693909 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e9f4e85b-1b4b-41cb-a6ef-6a32dba9b91b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9" status: 200 len: 1526 microversion: 2.1 time: 0.496121 Jul 25 14:27:39.695247 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 362/753] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:39 2022] GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 => generated 1526 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:39.714330 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-646d7dec-0261-4d35-889a-abcf7682657d tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:39.715281 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-646d7dec-0261-4d35-889a-abcf7682657d tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:39.735772 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-646d7dec-0261-4d35-889a-abcf7682657d tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:39.739200 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-646d7dec-0261-4d35-889a-abcf7682657d tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:39.740501 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-646d7dec-0261-4d35-889a-abcf7682657d tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:39.741196 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-646d7dec-0261-4d35-889a-abcf7682657d tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:40.007163 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-646d7dec-0261-4d35-889a-abcf7682657d tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:40.018330 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-646d7dec-0261-4d35-889a-abcf7682657d tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1472 microversion: 2.1 time: 0.318012 Jul 25 14:27:40.019252 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 363/754] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:39 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1472 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:40.041730 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0cba0bc5-ad73-4975-934f-ccfc4d78a208 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:40.044276 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0cba0bc5-ad73-4975-934f-ccfc4d78a208 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:40.049800 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:40.058713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f8aa8825-5c2a-4435-989d-3c5c74d26486 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:40.063235 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0cba0bc5-ad73-4975-934f-ccfc4d78a208 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:40.063600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0cba0bc5-ad73-4975-934f-ccfc4d78a208 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:40.067457 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0cba0bc5-ad73-4975-934f-ccfc4d78a208 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:40.070815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0cba0bc5-ad73-4975-934f-ccfc4d78a208 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:40.078609 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f8aa8825-5c2a-4435-989d-3c5c74d26486 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd" status: 200 len: 1321 microversion: 2.1 time: 0.657620 Jul 25 14:27:40.080477 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 392/755] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:39 2022] GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd => generated 1321 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:40.085721 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ad6ec1e4-cd77-40a6-94a8-5b5faef865ae tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:40.086581 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ad6ec1e4-cd77-40a6-94a8-5b5faef865ae tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: 6805171d-8f8d-4694-ab4a-2875d20b0d2a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:40.110859 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad6ec1e4-cd77-40a6-94a8-5b5faef865ae tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:40.111689 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad6ec1e4-cd77-40a6-94a8-5b5faef865ae tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:40.113774 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad6ec1e4-cd77-40a6-94a8-5b5faef865ae tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:40.116111 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad6ec1e4-cd77-40a6-94a8-5b5faef865ae tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:40.435026 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ad6ec1e4-cd77-40a6-94a8-5b5faef865ae tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:40.450145 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ad6ec1e4-cd77-40a6-94a8-5b5faef865ae tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a" status: 200 len: 1318 microversion: 2.1 time: 0.367326 Jul 25 14:27:40.452284 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 393/756] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:40 2022] GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:40.482128 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0cba0bc5-ad73-4975-934f-ccfc4d78a208 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:40.494409 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0cba0bc5-ad73-4975-934f-ccfc4d78a208 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1265 microversion: 2.1 time: 0.470745 Jul 25 14:27:40.495764 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 364/757] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:40 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1265 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:40.716000 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-36d4094e-bbd8-4010-9911-163d9541a619 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:40.717517 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-36d4094e-bbd8-4010-9911-163d9541a619 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:40.730611 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-36d4094e-bbd8-4010-9911-163d9541a619 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:40.731513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-36d4094e-bbd8-4010-9911-163d9541a619 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:40.732458 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-36d4094e-bbd8-4010-9911-163d9541a619 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:40.732916 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-36d4094e-bbd8-4010-9911-163d9541a619 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:40.814748 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7fc36fec-9e48-43da-83cc-3ec4642801a8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-756862607", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "89585d8f-fb83-418b-9add-e96b30bdd24c"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:41.210428 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-7fc36fec-9e48-43da-83cc-3ec4642801a8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] validate_networks() for [('89585d8f-fb83-418b-9add-e96b30bdd24c', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:27:41.580733 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-36d4094e-bbd8-4010-9911-163d9541a619 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:41.608864 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-36d4094e-bbd8-4010-9911-163d9541a619 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9" status: 200 len: 1526 microversion: 2.1 time: 0.891394 Jul 25 14:27:41.624090 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 365/758] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:40 2022] GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 => generated 1526 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:27:41.644446 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b8680147-a176-4b48-a191-9bb81c096325 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:41.645217 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b8680147-a176-4b48-a191-9bb81c096325 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:41.652237 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8680147-a176-4b48-a191-9bb81c096325 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:41.652691 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8680147-a176-4b48-a191-9bb81c096325 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:41.662413 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8680147-a176-4b48-a191-9bb81c096325 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:41.662862 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8680147-a176-4b48-a191-9bb81c096325 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:41.738932 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:42.064628 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b8680147-a176-4b48-a191-9bb81c096325 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:42.079240 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b8680147-a176-4b48-a191-9bb81c096325 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1472 microversion: 2.1 time: 0.449543 Jul 25 14:27:42.080427 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 366/759] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:41 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1472 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:42.086471 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-7fc36fec-9e48-43da-83cc-3ec4642801a8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:27:42.086899 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-7fc36fec-9e48-43da-83cc-3ec4642801a8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:27:42.087382 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-7fc36fec-9e48-43da-83cc-3ec4642801a8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:27:42.087779 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-7fc36fec-9e48-43da-83cc-3ec4642801a8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:27:42.088223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-7fc36fec-9e48-43da-83cc-3ec4642801a8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:27:42.105111 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-86654d29-0423-4439-ab44-704778428599 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:42.105734 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-86654d29-0423-4439-ab44-704778428599 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: 10a339c9-ca8c-403d-bb81-4aef27960efd] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:42.114306 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7fc36fec-9e48-43da-83cc-3ec4642801a8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:42.114676 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7fc36fec-9e48-43da-83cc-3ec4642801a8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:42.115478 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7fc36fec-9e48-43da-83cc-3ec4642801a8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:42.116488 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7fc36fec-9e48-43da-83cc-3ec4642801a8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:42.118366 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-86654d29-0423-4439-ab44-704778428599 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:42.118819 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-86654d29-0423-4439-ab44-704778428599 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:42.119594 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-86654d29-0423-4439-ab44-704778428599 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:42.125020 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-86654d29-0423-4439-ab44-704778428599 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:42.172748 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-7fc36fec-9e48-43da-83cc-3ec4642801a8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Getting quotas for project fb2b9ba0bede403bafb665d5e0818dfb. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:27:42.183961 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-7fc36fec-9e48-43da-83cc-3ec4642801a8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Getting quotas for user 94b57069a56c4fedb1d4546c1d0415c7 and project fb2b9ba0bede403bafb665d5e0818dfb. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:27:42.210784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7fc36fec-9e48-43da-83cc-3ec4642801a8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:27:42.215122 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7fc36fec-9e48-43da-83cc-3ec4642801a8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:27:42.273015 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=7 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:42.318481 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7fc36fec-9e48-43da-83cc-3ec4642801a8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.786421 Jul 25 14:27:42.319928 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 394/760] 10.222.0.88 () {62 vars in 1188 bytes} [Mon Jul 25 14:27:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1789 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 14:27:42.325221 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c7611d5f-ceef-4586-b59a-93a26c43093f tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:42.326126 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c7611d5f-ceef-4586-b59a-93a26c43093f tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: 6805171d-8f8d-4694-ab4a-2875d20b0d2a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:42.337879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c7611d5f-ceef-4586-b59a-93a26c43093f tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:42.338571 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c7611d5f-ceef-4586-b59a-93a26c43093f tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:42.339709 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c7611d5f-ceef-4586-b59a-93a26c43093f tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:42.340338 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c7611d5f-ceef-4586-b59a-93a26c43093f tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:42.796468 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-86654d29-0423-4439-ab44-704778428599 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:42.815692 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-86654d29-0423-4439-ab44-704778428599 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd" status: 200 len: 1321 microversion: 2.1 time: 0.713677 Jul 25 14:27:42.816419 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 367/761] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:42 2022] GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd => generated 1321 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:42.851450 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d66b3456-6b85-48e3-b00c-2e087f643bf6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:42.860656 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d66b3456-6b85-48e3-b00c-2e087f643bf6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:42.878741 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d66b3456-6b85-48e3-b00c-2e087f643bf6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:42.880834 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d66b3456-6b85-48e3-b00c-2e087f643bf6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:42.882954 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d66b3456-6b85-48e3-b00c-2e087f643bf6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:42.886554 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d66b3456-6b85-48e3-b00c-2e087f643bf6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:43.047868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c7611d5f-ceef-4586-b59a-93a26c43093f tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:43.059424 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c7611d5f-ceef-4586-b59a-93a26c43093f tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a" status: 200 len: 1318 microversion: 2.1 time: 0.738001 Jul 25 14:27:43.060448 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 395/762] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:42 2022] GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a => generated 1318 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:43.068580 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2afa8a98-89fc-4ffc-aa5e-d3343f743143 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:43.070715 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2afa8a98-89fc-4ffc-aa5e-d3343f743143 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:43.229113 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2afa8a98-89fc-4ffc-aa5e-d3343f743143 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:43.244151 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2afa8a98-89fc-4ffc-aa5e-d3343f743143 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:43.245685 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2afa8a98-89fc-4ffc-aa5e-d3343f743143 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:43.255615 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2afa8a98-89fc-4ffc-aa5e-d3343f743143 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 200 len: 1261 microversion: 2.25 time: 0.193451 Jul 25 14:27:43.257011 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 396/763] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:27:43 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 1261 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:27:43.277939 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c03a0fea-5b5b-48a0-a9d3-6806ea22e12b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:43.278623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c03a0fea-5b5b-48a0-a9d3-6806ea22e12b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:43.281011 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:43.289368 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c03a0fea-5b5b-48a0-a9d3-6806ea22e12b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:43.289916 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c03a0fea-5b5b-48a0-a9d3-6806ea22e12b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:43.290920 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c03a0fea-5b5b-48a0-a9d3-6806ea22e12b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:43.291423 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c03a0fea-5b5b-48a0-a9d3-6806ea22e12b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:43.371380 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c03a0fea-5b5b-48a0-a9d3-6806ea22e12b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:43.371955 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c03a0fea-5b5b-48a0-a9d3-6806ea22e12b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:43.383913 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-c03a0fea-5b5b-48a0-a9d3-6806ea22e12b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lazy-loading 'fault' on Instance uuid 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:27:43.534589 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d66b3456-6b85-48e3-b00c-2e087f643bf6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:43.556556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c03a0fea-5b5b-48a0-a9d3-6806ea22e12b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:43.561991 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d66b3456-6b85-48e3-b00c-2e087f643bf6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1313 microversion: 2.1 time: 0.742893 Jul 25 14:27:43.567414 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c03a0fea-5b5b-48a0-a9d3-6806ea22e12b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9" status: 200 len: 1314 microversion: 2.1 time: 0.309007 Jul 25 14:27:43.568719 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 368/764] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:42 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1313 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:43.581787 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-97518f21-6ace-4217-bd8e-1975ca0c5adc req-30c0ffde-a8d0-4b93-8a0f-3741493afa86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5312b2e2-2ff9-457f-8d89-1cfa1b508ef9", "name": "network-vif-deleted", "tag": "9ba908cc-d166-4dbe-8bf6-5618be7e27a2"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:43.592218 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 397/765] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:43 2022] GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:43.604252 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-97518f21-6ace-4217-bd8e-1975ca0c5adc req-30c0ffde-a8d0-4b93-8a0f-3741493afa86 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:43.605122 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-97518f21-6ace-4217-bd8e-1975ca0c5adc req-30c0ffde-a8d0-4b93-8a0f-3741493afa86 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:43.608546 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cb9916b2-50be-4838-8b69-52df22c41f34 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:43.609332 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cb9916b2-50be-4838-8b69-52df22c41f34 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:43.625707 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-97518f21-6ace-4217-bd8e-1975ca0c5adc req-30c0ffde-a8d0-4b93-8a0f-3741493afa86 service nova] Creating event network-vif-deleted:9ba908cc-d166-4dbe-8bf6-5618be7e27a2 for instance 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 on n-h1-846435-14 Jul 25 14:27:43.627868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb9916b2-50be-4838-8b69-52df22c41f34 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:43.628457 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb9916b2-50be-4838-8b69-52df22c41f34 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:43.632644 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-97518f21-6ace-4217-bd8e-1975ca0c5adc req-30c0ffde-a8d0-4b93-8a0f-3741493afa86 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062203 Jul 25 14:27:43.635088 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 369/766] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:43.636085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb9916b2-50be-4838-8b69-52df22c41f34 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:43.636657 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb9916b2-50be-4838-8b69-52df22c41f34 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:43.838879 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-83d1ed2a-1651-4f47-b488-5363d31a8e58 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:43.840448 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-83d1ed2a-1651-4f47-b488-5363d31a8e58 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: 10a339c9-ca8c-403d-bb81-4aef27960efd] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:43.849044 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-83d1ed2a-1651-4f47-b488-5363d31a8e58 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:43.849762 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-83d1ed2a-1651-4f47-b488-5363d31a8e58 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:43.850793 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-83d1ed2a-1651-4f47-b488-5363d31a8e58 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:43.851555 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-83d1ed2a-1651-4f47-b488-5363d31a8e58 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:44.101519 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cb9916b2-50be-4838-8b69-52df22c41f34 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:44.111776 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cb9916b2-50be-4838-8b69-52df22c41f34 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1472 microversion: 2.1 time: 0.518107 Jul 25 14:27:44.115493 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 398/767] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:43 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1472 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:44.130363 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f5bddab5-73fd-4c44-979a-f09914c7e61d tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:44.131099 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f5bddab5-73fd-4c44-979a-f09914c7e61d tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: 6805171d-8f8d-4694-ab4a-2875d20b0d2a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:44.141399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5bddab5-73fd-4c44-979a-f09914c7e61d tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:44.147244 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5bddab5-73fd-4c44-979a-f09914c7e61d tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:44.148347 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5bddab5-73fd-4c44-979a-f09914c7e61d tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:44.149527 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5bddab5-73fd-4c44-979a-f09914c7e61d tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:44.155137 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-83d1ed2a-1651-4f47-b488-5363d31a8e58 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:44.157961 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:44.174346 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-83d1ed2a-1651-4f47-b488-5363d31a8e58 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd" status: 200 len: 1321 microversion: 2.1 time: 0.340770 Jul 25 14:27:44.180941 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 370/768] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:43 2022] GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd => generated 1321 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:27:44.289504 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c9d6ed15-a659-4b6e-822e-54df33f7ffe6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:44.290123 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c9d6ed15-a659-4b6e-822e-54df33f7ffe6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:44.308218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c9d6ed15-a659-4b6e-822e-54df33f7ffe6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:44.315103 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c9d6ed15-a659-4b6e-822e-54df33f7ffe6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:44.316213 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c9d6ed15-a659-4b6e-822e-54df33f7ffe6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:44.316913 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c9d6ed15-a659-4b6e-822e-54df33f7ffe6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:44.514410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c9d6ed15-a659-4b6e-822e-54df33f7ffe6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:44.545641 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c9d6ed15-a659-4b6e-822e-54df33f7ffe6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:44.546981 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c9d6ed15-a659-4b6e-822e-54df33f7ffe6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:44.552401 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c9d6ed15-a659-4b6e-822e-54df33f7ffe6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 200 len: 1313 microversion: 2.25 time: 0.276341 Jul 25 14:27:44.553896 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 371/769] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:27:44 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:27:44.586751 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-07fe288f-8400-4bf2-bf1a-8d6f4eea59b5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:44.587375 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-07fe288f-8400-4bf2-bf1a-8d6f4eea59b5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:44.600650 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-07fe288f-8400-4bf2-bf1a-8d6f4eea59b5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:44.601108 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-07fe288f-8400-4bf2-bf1a-8d6f4eea59b5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:44.601906 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-07fe288f-8400-4bf2-bf1a-8d6f4eea59b5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:44.602341 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-07fe288f-8400-4bf2-bf1a-8d6f4eea59b5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:44.665391 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f5bddab5-73fd-4c44-979a-f09914c7e61d tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:44.677707 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f5bddab5-73fd-4c44-979a-f09914c7e61d tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a" status: 200 len: 1318 microversion: 2.1 time: 0.557717 Jul 25 14:27:44.690822 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 399/770] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:44 2022] GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a => generated 1318 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:44.703394 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7cc6d133-adc5-4a01-8fd9-c5e8d2497adb tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:44.706432 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7cc6d133-adc5-4a01-8fd9-c5e8d2497adb tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:44.734856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7cc6d133-adc5-4a01-8fd9-c5e8d2497adb tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:44.735354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7cc6d133-adc5-4a01-8fd9-c5e8d2497adb tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:44.739956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7cc6d133-adc5-4a01-8fd9-c5e8d2497adb tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:44.740431 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7cc6d133-adc5-4a01-8fd9-c5e8d2497adb tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:44.778770 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-7cc6d133-adc5-4a01-8fd9-c5e8d2497adb tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] HTTP exception thrown: Instance 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 could not be found. Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7cc6d133-adc5-4a01-8fd9-c5e8d2497adb tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Request method failure captured: Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 HTTP/1.1 Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qgcGc2RjkaZaGa63-PPdbCX4s7H2xWtuYRqlF0JWR61IUGzx74RHc-m8TJT-_RdlH0tQcWSd5UK3Q-O0K9ctQCv8954sZsqJWdlZOw1b7jo_qk8Zk2eLIrhbYh_u9wxQIss6t5T5Ti1Es5U9sr0YdlFFb4d-omgDGqaIN2Ib47NRJM Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: c0116982ed03475097096c73b5f03035 Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0116982ed03475097096c73b5f03035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0116982ed03475097096c73b5f03035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0116982ed03475097096c73b5f03035", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0116982ed03475097096c73b5f03035"}]}] Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: c0116982ed03475097096c73b5f03035 Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ImagesOneServerNegativeTestJSON-745484288-project Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: f1b1656f2dcd4ffebac55bf18110ff63 Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-745484288-project Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 could not be found. Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '5312b2e2-2ff9-457f-8d89-1cfa1b508ef9'} Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 could not be found. Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 could not be found. Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:44.781924 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:44.786399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:44.786399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:44.786399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:44.786399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:44.786399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:27:44.786399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:27:44.786399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 could not be found. Jul 25 14:27:44.786399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:44.786399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7cc6d133-adc5-4a01-8fd9-c5e8d2497adb tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Returning 404 to user: Instance 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:27:44.787886 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7cc6d133-adc5-4a01-8fd9-c5e8d2497adb tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9" status: 404 len: 111 microversion: 2.1 time: 0.090052 Jul 25 14:27:44.790972 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 400/771] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:44 2022] GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:27:45.007559 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fdb4af2a-81df-4ea3-95fc-9868ccb2bbe9 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-861562643", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:45.115009 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-fdb4af2a-81df-4ea3-95fc-9868ccb2bbe9 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] validate_networks() for [('d3c7e613-177d-41cb-9892-a283b29284d3', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:27:45.278353 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-07fe288f-8400-4bf2-bf1a-8d6f4eea59b5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:45.284783 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:45.302143 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-07fe288f-8400-4bf2-bf1a-8d6f4eea59b5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1313 microversion: 2.1 time: 0.719294 Jul 25 14:27:45.312550 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 372/772] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:44 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1313 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:27:45.331546 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7d6bd4ee-2dda-454b-b8c7-2fc4bdf6c3e7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:45.337183 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7d6bd4ee-2dda-454b-b8c7-2fc4bdf6c3e7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:45.352508 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7d6bd4ee-2dda-454b-b8c7-2fc4bdf6c3e7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:45.353377 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7d6bd4ee-2dda-454b-b8c7-2fc4bdf6c3e7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:45.355722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7d6bd4ee-2dda-454b-b8c7-2fc4bdf6c3e7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:45.357116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7d6bd4ee-2dda-454b-b8c7-2fc4bdf6c3e7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:45.961880 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-fdb4af2a-81df-4ea3-95fc-9868ccb2bbe9 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:27:45.964555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-fdb4af2a-81df-4ea3-95fc-9868ccb2bbe9 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:27:45.965239 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-fdb4af2a-81df-4ea3-95fc-9868ccb2bbe9 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:27:45.966171 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-fdb4af2a-81df-4ea3-95fc-9868ccb2bbe9 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:27:45.966956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-fdb4af2a-81df-4ea3-95fc-9868ccb2bbe9 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:27:45.999778 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fdb4af2a-81df-4ea3-95fc-9868ccb2bbe9 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:46.001144 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fdb4af2a-81df-4ea3-95fc-9868ccb2bbe9 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:46.006077 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fdb4af2a-81df-4ea3-95fc-9868ccb2bbe9 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:46.006724 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fdb4af2a-81df-4ea3-95fc-9868ccb2bbe9 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:46.071353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-fdb4af2a-81df-4ea3-95fc-9868ccb2bbe9 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Getting quotas for project c0116982ed03475097096c73b5f03035. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:27:46.085920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7d6bd4ee-2dda-454b-b8c7-2fc4bdf6c3e7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:46.091707 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-fdb4af2a-81df-4ea3-95fc-9868ccb2bbe9 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Getting quotas for user f1b1656f2dcd4ffebac55bf18110ff63 and project c0116982ed03475097096c73b5f03035. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:27:46.096492 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7d6bd4ee-2dda-454b-b8c7-2fc4bdf6c3e7 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1472 microversion: 2.1 time: 0.775427 Jul 25 14:27:46.098921 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 373/773] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:45 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1472 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:46.115906 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c31b913c-bd90-49f2-a1b7-2b21b37efff5 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:46.116569 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c31b913c-bd90-49f2-a1b7-2b21b37efff5 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: 10a339c9-ca8c-403d-bb81-4aef27960efd] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:46.132350 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fdb4af2a-81df-4ea3-95fc-9868ccb2bbe9 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:27:46.136765 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c31b913c-bd90-49f2-a1b7-2b21b37efff5 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:46.137225 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c31b913c-bd90-49f2-a1b7-2b21b37efff5 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:46.138025 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c31b913c-bd90-49f2-a1b7-2b21b37efff5 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:46.138521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c31b913c-bd90-49f2-a1b7-2b21b37efff5 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:46.140018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fdb4af2a-81df-4ea3-95fc-9868ccb2bbe9 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 3b44e25a-9b18-4ee6-b084-32f9e4f7e881] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:27:46.223261 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fdb4af2a-81df-4ea3-95fc-9868ccb2bbe9 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.220973 Jul 25 14:27:46.224392 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 401/774] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:27:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 1223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:27:46.237334 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f9c79b8f-1e2b-4da3-8862-40b23ef70339 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:46.238848 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f9c79b8f-1e2b-4da3-8862-40b23ef70339 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:46.250707 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f9c79b8f-1e2b-4da3-8862-40b23ef70339 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:46.251540 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f9c79b8f-1e2b-4da3-8862-40b23ef70339 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:46.254085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f9c79b8f-1e2b-4da3-8862-40b23ef70339 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:46.255065 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f9c79b8f-1e2b-4da3-8862-40b23ef70339 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:46.371934 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f9c79b8f-1e2b-4da3-8862-40b23ef70339 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:46.384465 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f9c79b8f-1e2b-4da3-8862-40b23ef70339 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:46.386387 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f9c79b8f-1e2b-4da3-8862-40b23ef70339 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:46.387842 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f9c79b8f-1e2b-4da3-8862-40b23ef70339 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 200 len: 1319 microversion: 2.25 time: 0.162440 Jul 25 14:27:46.389389 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 402/775] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:27:46 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:27:46.405479 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-dbd9ca4a-083c-4f0b-8aeb-90c6ce9e804c req-8361217b-972b-44ab-95ad-c3338a3b1e90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6805171d-8f8d-4694-ab4a-2875d20b0d2a", "name": "network-vif-plugged", "status": "completed", "tag": "c0ef8191-2d08-4d3f-90f7-ebf1eb92fcad"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:46.430585 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-dbd9ca4a-083c-4f0b-8aeb-90c6ce9e804c req-8361217b-972b-44ab-95ad-c3338a3b1e90 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:46.431189 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-dbd9ca4a-083c-4f0b-8aeb-90c6ce9e804c req-8361217b-972b-44ab-95ad-c3338a3b1e90 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:46.461416 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-dbd9ca4a-083c-4f0b-8aeb-90c6ce9e804c req-8361217b-972b-44ab-95ad-c3338a3b1e90 service nova] Creating event network-vif-plugged:c0ef8191-2d08-4d3f-90f7-ebf1eb92fcad for instance 6805171d-8f8d-4694-ab4a-2875d20b0d2a on n-h2-846435-14 Jul 25 14:27:46.472521 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-dbd9ca4a-083c-4f0b-8aeb-90c6ce9e804c req-8361217b-972b-44ab-95ad-c3338a3b1e90 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081305 Jul 25 14:27:46.473889 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 403/776] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:46.479302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b1809cb7-52e5-4d56-9fc6-b399f897b166 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:46.485028 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b1809cb7-52e5-4d56-9fc6-b399f897b166 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: 6805171d-8f8d-4694-ab4a-2875d20b0d2a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:46.499170 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b1809cb7-52e5-4d56-9fc6-b399f897b166 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:46.504818 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b1809cb7-52e5-4d56-9fc6-b399f897b166 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:46.505784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b1809cb7-52e5-4d56-9fc6-b399f897b166 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:46.506328 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b1809cb7-52e5-4d56-9fc6-b399f897b166 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:46.656898 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c31b913c-bd90-49f2-a1b7-2b21b37efff5 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:46.668441 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c31b913c-bd90-49f2-a1b7-2b21b37efff5 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd" status: 200 len: 1321 microversion: 2.1 time: 0.568388 Jul 25 14:27:46.670438 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 374/777] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:46 2022] GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd => generated 1321 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:46.679447 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-61be3b3b-94b0-4241-85c1-169a60b30bb3 req-6f9a83ae-a2f1-4a3c-85e5-53d664a8f8f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5db8a05-a27e-4426-9166-44727d5cc4ff", "tag": "f34d13c0-b812-4793-bcd0-55fe6e34bc46"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:46.701029 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-61be3b3b-94b0-4241-85c1-169a60b30bb3 req-6f9a83ae-a2f1-4a3c-85e5-53d664a8f8f5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:46.702313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-61be3b3b-94b0-4241-85c1-169a60b30bb3 req-6f9a83ae-a2f1-4a3c-85e5-53d664a8f8f5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:46.727519 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-61be3b3b-94b0-4241-85c1-169a60b30bb3 req-6f9a83ae-a2f1-4a3c-85e5-53d664a8f8f5 service nova] Creating event network-changed:f34d13c0-b812-4793-bcd0-55fe6e34bc46 for instance d5db8a05-a27e-4426-9166-44727d5cc4ff on n-h1-846435-14 Jul 25 14:27:46.743346 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-61be3b3b-94b0-4241-85c1-169a60b30bb3 req-6f9a83ae-a2f1-4a3c-85e5-53d664a8f8f5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068516 Jul 25 14:27:46.745240 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 375/778] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:46.755416 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6cfdccb4-9cb1-4d6d-bd60-42d68c597372 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:46.758954 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6cfdccb4-9cb1-4d6d-bd60-42d68c597372 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 3b44e25a-9b18-4ee6-b084-32f9e4f7e881] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:46.878073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6cfdccb4-9cb1-4d6d-bd60-42d68c597372 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:46.888689 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6cfdccb4-9cb1-4d6d-bd60-42d68c597372 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881" status: 200 len: 1224 microversion: 2.1 time: 0.141907 Jul 25 14:27:46.889930 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 376/779] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:46 2022] GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881 => generated 1224 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:46.895426 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e3477f7e-84d8-47a6-8a48-80c8be3a3951 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:46.896365 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e3477f7e-84d8-47a6-8a48-80c8be3a3951 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:46.903169 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3477f7e-84d8-47a6-8a48-80c8be3a3951 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:46.903931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3477f7e-84d8-47a6-8a48-80c8be3a3951 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:46.904989 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3477f7e-84d8-47a6-8a48-80c8be3a3951 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:46.905552 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3477f7e-84d8-47a6-8a48-80c8be3a3951 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:46.910489 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b1809cb7-52e5-4d56-9fc6-b399f897b166 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:46.918456 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b1809cb7-52e5-4d56-9fc6-b399f897b166 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a" status: 200 len: 1318 microversion: 2.1 time: 0.443089 Jul 25 14:27:46.919307 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 404/780] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:46 2022] GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a => generated 1318 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:47.121923 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ec1924e7-f71b-4c8b-8c35-55cbbad2c158 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:47.123366 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ec1924e7-f71b-4c8b-8c35-55cbbad2c158 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:47.130894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ec1924e7-f71b-4c8b-8c35-55cbbad2c158 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:47.131344 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ec1924e7-f71b-4c8b-8c35-55cbbad2c158 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:47.137106 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ec1924e7-f71b-4c8b-8c35-55cbbad2c158 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:47.137563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ec1924e7-f71b-4c8b-8c35-55cbbad2c158 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:47.393416 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e3477f7e-84d8-47a6-8a48-80c8be3a3951 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:47.419485 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e3477f7e-84d8-47a6-8a48-80c8be3a3951 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1313 microversion: 2.1 time: 0.527751 Jul 25 14:27:47.440088 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 377/781] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:46 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1313 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:47.447365 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0b8373eb-4020-4e00-ac81-ae3b3b353ca0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:47.449191 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0b8373eb-4020-4e00-ac81-ae3b3b353ca0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:47.459740 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ec1924e7-f71b-4c8b-8c35-55cbbad2c158 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:47.469020 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b8373eb-4020-4e00-ac81-ae3b3b353ca0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:47.469625 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b8373eb-4020-4e00-ac81-ae3b3b353ca0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:47.470599 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b8373eb-4020-4e00-ac81-ae3b3b353ca0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:47.471179 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b8373eb-4020-4e00-ac81-ae3b3b353ca0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:47.478553 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ec1924e7-f71b-4c8b-8c35-55cbbad2c158 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1472 microversion: 2.1 time: 0.358829 Jul 25 14:27:47.482180 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 405/782] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:47 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1472 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:27:47.666998 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0b8373eb-4020-4e00-ac81-ae3b3b353ca0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:47.678913 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0b8373eb-4020-4e00-ac81-ae3b3b353ca0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:47.680486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0b8373eb-4020-4e00-ac81-ae3b3b353ca0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:47.681649 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0b8373eb-4020-4e00-ac81-ae3b3b353ca0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 200 len: 1361 microversion: 2.25 time: 0.250412 Jul 25 14:27:47.682215 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 378/783] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:27:47 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 1361 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:27:47.697080 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7ffca8b2-776e-402e-b823-630dbfebd92a tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:47.697981 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7ffca8b2-776e-402e-b823-630dbfebd92a tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: 10a339c9-ca8c-403d-bb81-4aef27960efd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:47.719491 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7ffca8b2-776e-402e-b823-630dbfebd92a tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:47.720631 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7ffca8b2-776e-402e-b823-630dbfebd92a tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:47.722137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7ffca8b2-776e-402e-b823-630dbfebd92a tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:47.722778 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7ffca8b2-776e-402e-b823-630dbfebd92a tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:47.910722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3b8eeed8-da4e-48ce-88df-308261879a0e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:47.911564 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3b8eeed8-da4e-48ce-88df-308261879a0e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 3b44e25a-9b18-4ee6-b084-32f9e4f7e881] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:47.920418 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b8eeed8-da4e-48ce-88df-308261879a0e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:47.921352 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b8eeed8-da4e-48ce-88df-308261879a0e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:47.922368 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b8eeed8-da4e-48ce-88df-308261879a0e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:47.923057 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b8eeed8-da4e-48ce-88df-308261879a0e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:48.224296 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3b8eeed8-da4e-48ce-88df-308261879a0e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:48.242260 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3b8eeed8-da4e-48ce-88df-308261879a0e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881" status: 200 len: 1228 microversion: 2.1 time: 0.336038 Jul 25 14:27:48.243420 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 379/784] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:47 2022] GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881 => generated 1228 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:48.259552 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-52fc0198-b56e-4360-9423-cc415b906846 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:48.260212 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-52fc0198-b56e-4360-9423-cc415b906846 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: 6805171d-8f8d-4694-ab4a-2875d20b0d2a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:48.273028 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-52fc0198-b56e-4360-9423-cc415b906846 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:48.273491 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-52fc0198-b56e-4360-9423-cc415b906846 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:48.274295 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-52fc0198-b56e-4360-9423-cc415b906846 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:48.275495 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-52fc0198-b56e-4360-9423-cc415b906846 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:48.499519 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7ffca8b2-776e-402e-b823-630dbfebd92a tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:48.520968 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7ffca8b2-776e-402e-b823-630dbfebd92a tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd" status: 200 len: 1321 microversion: 2.1 time: 0.832688 Jul 25 14:27:48.538725 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 406/785] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:47 2022] GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd => generated 1321 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:48.547345 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-03ea1e8c-fdba-4cb7-bc2d-1faa43b3da3d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:48.548420 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-03ea1e8c-fdba-4cb7-bc2d-1faa43b3da3d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:48.562845 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-03ea1e8c-fdba-4cb7-bc2d-1faa43b3da3d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:48.564495 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-03ea1e8c-fdba-4cb7-bc2d-1faa43b3da3d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:48.568448 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-03ea1e8c-fdba-4cb7-bc2d-1faa43b3da3d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:48.580408 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-03ea1e8c-fdba-4cb7-bc2d-1faa43b3da3d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:49.122341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-03ea1e8c-fdba-4cb7-bc2d-1faa43b3da3d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:49.134479 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-03ea1e8c-fdba-4cb7-bc2d-1faa43b3da3d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1313 microversion: 2.1 time: 0.591084 Jul 25 14:27:49.149532 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 407/786] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:48 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1313 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:49.155163 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c7d19cee-8f9c-4b05-8e79-5ab039312a5e tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:49.156026 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c7d19cee-8f9c-4b05-8e79-5ab039312a5e tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:49.163008 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c7d19cee-8f9c-4b05-8e79-5ab039312a5e tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:49.164030 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c7d19cee-8f9c-4b05-8e79-5ab039312a5e tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:49.164999 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c7d19cee-8f9c-4b05-8e79-5ab039312a5e tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:49.165585 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c7d19cee-8f9c-4b05-8e79-5ab039312a5e tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:49.427457 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-52fc0198-b56e-4360-9423-cc415b906846 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:49.450406 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-52fc0198-b56e-4360-9423-cc415b906846 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a" status: 200 len: 1318 microversion: 2.1 time: 1.205636 Jul 25 14:27:49.452326 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 380/787] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:48 2022] GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a => generated 1318 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:49.458582 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-310afa82-4cea-46fc-8157-d007d2cb5d8b req-9036646b-8531-44de-bbdf-4249ccca37b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10a339c9-ca8c-403d-bb81-4aef27960efd", "name": "network-vif-plugged", "status": "completed", "tag": "f37b672e-6ac4-490d-a461-bc2d062ec5c4"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:49.485860 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-310afa82-4cea-46fc-8157-d007d2cb5d8b req-9036646b-8531-44de-bbdf-4249ccca37b7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:49.486551 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-310afa82-4cea-46fc-8157-d007d2cb5d8b req-9036646b-8531-44de-bbdf-4249ccca37b7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:49.510414 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-310afa82-4cea-46fc-8157-d007d2cb5d8b req-9036646b-8531-44de-bbdf-4249ccca37b7 service nova] Creating event network-vif-plugged:f37b672e-6ac4-490d-a461-bc2d062ec5c4 for instance 10a339c9-ca8c-403d-bb81-4aef27960efd on n-h1-846435-14 Jul 25 14:27:49.524360 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-310afa82-4cea-46fc-8157-d007d2cb5d8b req-9036646b-8531-44de-bbdf-4249ccca37b7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060853 Jul 25 14:27:49.527113 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 381/788] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:49.538244 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a85b1450-19c3-4263-96d9-0ab2cc726c04 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:49.541154 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a85b1450-19c3-4263-96d9-0ab2cc726c04 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:49.562057 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a85b1450-19c3-4263-96d9-0ab2cc726c04 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:49.562384 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a85b1450-19c3-4263-96d9-0ab2cc726c04 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:49.563894 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a85b1450-19c3-4263-96d9-0ab2cc726c04 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:49.564622 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a85b1450-19c3-4263-96d9-0ab2cc726c04 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:49.769329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c7d19cee-8f9c-4b05-8e79-5ab039312a5e tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:49.784682 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c7d19cee-8f9c-4b05-8e79-5ab039312a5e tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1472 microversion: 2.1 time: 0.632092 Jul 25 14:27:49.786169 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 408/789] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:49 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1472 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:49.803173 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-214445d5-075b-48ea-b37e-9b4d11ae1585 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:49.804815 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-214445d5-075b-48ea-b37e-9b4d11ae1585 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 3b44e25a-9b18-4ee6-b084-32f9e4f7e881] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:49.819683 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-214445d5-075b-48ea-b37e-9b4d11ae1585 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:49.820501 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-214445d5-075b-48ea-b37e-9b4d11ae1585 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:49.821472 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-214445d5-075b-48ea-b37e-9b4d11ae1585 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:49.822099 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-214445d5-075b-48ea-b37e-9b4d11ae1585 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:49.991083 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a85b1450-19c3-4263-96d9-0ab2cc726c04 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:50.000819 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-214445d5-075b-48ea-b37e-9b4d11ae1585 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:50.005555 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a85b1450-19c3-4263-96d9-0ab2cc726c04 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:50.011567 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a85b1450-19c3-4263-96d9-0ab2cc726c04 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:50.012863 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a85b1450-19c3-4263-96d9-0ab2cc726c04 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 200 len: 1361 microversion: 2.25 time: 0.484173 Jul 25 14:27:50.036993 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 382/790] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:27:49 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 1361 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:27:50.039251 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-214445d5-075b-48ea-b37e-9b4d11ae1585 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881" status: 200 len: 1282 microversion: 2.1 time: 0.251486 Jul 25 14:27:50.041083 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 409/791] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:49 2022] GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881 => generated 1282 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:50.045165 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8d922acd-4bcd-4616-8c9e-f6a7abed59fe tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:50.046065 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8d922acd-4bcd-4616-8c9e-f6a7abed59fe tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: 10a339c9-ca8c-403d-bb81-4aef27960efd] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:50.053390 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8d922acd-4bcd-4616-8c9e-f6a7abed59fe tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:50.054080 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8d922acd-4bcd-4616-8c9e-f6a7abed59fe tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:50.055033 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8d922acd-4bcd-4616-8c9e-f6a7abed59fe tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:50.056391 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8d922acd-4bcd-4616-8c9e-f6a7abed59fe tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:50.157401 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-96ef1cac-3e81-4fa2-82b3-2f3b3e8eaf2c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:50.158290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-96ef1cac-3e81-4fa2-82b3-2f3b3e8eaf2c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:50.171084 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-96ef1cac-3e81-4fa2-82b3-2f3b3e8eaf2c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:50.173470 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-96ef1cac-3e81-4fa2-82b3-2f3b3e8eaf2c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:50.174658 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-96ef1cac-3e81-4fa2-82b3-2f3b3e8eaf2c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:50.176932 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-96ef1cac-3e81-4fa2-82b3-2f3b3e8eaf2c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:50.369567 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8d922acd-4bcd-4616-8c9e-f6a7abed59fe tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:50.378872 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8d922acd-4bcd-4616-8c9e-f6a7abed59fe tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd" status: 200 len: 1321 microversion: 2.1 time: 0.340553 Jul 25 14:27:50.393985 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 383/792] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:50 2022] GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd => generated 1321 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:50.472849 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e418e5d0-67b3-4d5c-9154-d8b29c17da44 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:50.474195 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e418e5d0-67b3-4d5c-9154-d8b29c17da44 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: 6805171d-8f8d-4694-ab4a-2875d20b0d2a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:50.488064 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e418e5d0-67b3-4d5c-9154-d8b29c17da44 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:50.490214 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e418e5d0-67b3-4d5c-9154-d8b29c17da44 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:50.491275 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e418e5d0-67b3-4d5c-9154-d8b29c17da44 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:50.493815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e418e5d0-67b3-4d5c-9154-d8b29c17da44 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:50.559371 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-96ef1cac-3e81-4fa2-82b3-2f3b3e8eaf2c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:50.581335 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-96ef1cac-3e81-4fa2-82b3-2f3b3e8eaf2c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1313 microversion: 2.1 time: 0.430052 Jul 25 14:27:50.583457 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 410/793] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:50 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1313 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:50.602387 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-1b877d59-21ae-4ca1-ad7a-671b64faed1a req-59da6bde-8502-4598-8d72-d8e04e33207e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3d2010c-4e0c-412e-9b66-8fbac6510097", "tag": "520cf9de-1166-4382-a12f-5e27acc8c55e"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:50.617967 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-1b877d59-21ae-4ca1-ad7a-671b64faed1a req-59da6bde-8502-4598-8d72-d8e04e33207e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:50.618759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-1b877d59-21ae-4ca1-ad7a-671b64faed1a req-59da6bde-8502-4598-8d72-d8e04e33207e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:50.652358 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-1b877d59-21ae-4ca1-ad7a-671b64faed1a req-59da6bde-8502-4598-8d72-d8e04e33207e service nova] Creating event network-changed:520cf9de-1166-4382-a12f-5e27acc8c55e for instance b3d2010c-4e0c-412e-9b66-8fbac6510097 on n-h2-846435-14 Jul 25 14:27:50.660254 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-1b877d59-21ae-4ca1-ad7a-671b64faed1a req-59da6bde-8502-4598-8d72-d8e04e33207e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070943 Jul 25 14:27:50.661694 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 411/794] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:50.810470 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e418e5d0-67b3-4d5c-9154-d8b29c17da44 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:50.817168 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7d5eca1d-c308-4042-99ff-ebd310aa824b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:50.818125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7d5eca1d-c308-4042-99ff-ebd310aa824b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:50.831899 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d5eca1d-c308-4042-99ff-ebd310aa824b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:50.832699 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e418e5d0-67b3-4d5c-9154-d8b29c17da44 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a" status: 200 len: 1468 microversion: 2.1 time: 0.360078 Jul 25 14:27:50.848315 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 384/795] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:50 2022] GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a => generated 1468 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:50.852921 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d5eca1d-c308-4042-99ff-ebd310aa824b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:50.854045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d5eca1d-c308-4042-99ff-ebd310aa824b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:50.854692 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d5eca1d-c308-4042-99ff-ebd310aa824b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:50.859825 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8c58196c-c6df-4ee3-9cb7-2369090e1ba8 tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:50.863493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8c58196c-c6df-4ee3-9cb7-2369090e1ba8 tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] [instance: 6805171d-8f8d-4694-ab4a-2875d20b0d2a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:50.883065 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8c58196c-c6df-4ee3-9cb7-2369090e1ba8 tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:50.883531 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8c58196c-c6df-4ee3-9cb7-2369090e1ba8 tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:50.884365 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8c58196c-c6df-4ee3-9cb7-2369090e1ba8 tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:50.884800 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8c58196c-c6df-4ee3-9cb7-2369090e1ba8 tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:50.932404 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-8c58196c-c6df-4ee3-9cb7-2369090e1ba8 tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] Lazy-loading 'flavor' on Instance uuid 6805171d-8f8d-4694-ab4a-2875d20b0d2a {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:27:51.049628 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8c58196c-c6df-4ee3-9cb7-2369090e1ba8 tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a/action" status: 202 len: 0 microversion: 2.1 time: 0.197167 Jul 25 14:27:51.056321 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 385/796] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:27:50 2022] POST /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:27:51.064113 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3a23cdc1-dc58-4a5b-9c60-2e589af732cc tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:51.069944 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3a23cdc1-dc58-4a5b-9c60-2e589af732cc tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:51.084004 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3a23cdc1-dc58-4a5b-9c60-2e589af732cc tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:51.085494 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3a23cdc1-dc58-4a5b-9c60-2e589af732cc tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:51.087672 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3a23cdc1-dc58-4a5b-9c60-2e589af732cc tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:51.088388 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3a23cdc1-dc58-4a5b-9c60-2e589af732cc tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:51.280858 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7d5eca1d-c308-4042-99ff-ebd310aa824b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:51.295645 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7d5eca1d-c308-4042-99ff-ebd310aa824b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1472 microversion: 2.1 time: 0.488500 Jul 25 14:27:51.296677 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 412/797] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:50 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1472 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:27:51.309479 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-360d6c7d-19c7-42e9-a980-080390af1c9d tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:51.310409 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-360d6c7d-19c7-42e9-a980-080390af1c9d tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: 6805171d-8f8d-4694-ab4a-2875d20b0d2a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:51.320307 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-360d6c7d-19c7-42e9-a980-080390af1c9d tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:51.322905 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-360d6c7d-19c7-42e9-a980-080390af1c9d tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:51.326980 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-360d6c7d-19c7-42e9-a980-080390af1c9d tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:51.328372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-360d6c7d-19c7-42e9-a980-080390af1c9d tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:51.397271 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3a23cdc1-dc58-4a5b-9c60-2e589af732cc tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:51.418944 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3a23cdc1-dc58-4a5b-9c60-2e589af732cc tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:51.420678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3a23cdc1-dc58-4a5b-9c60-2e589af732cc tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:51.422890 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3a23cdc1-dc58-4a5b-9c60-2e589af732cc tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 200 len: 1361 microversion: 2.25 time: 0.364933 Jul 25 14:27:51.442316 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 386/798] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:27:51 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 1361 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:27:51.447740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ae2d4eaa-f014-463d-a6c4-962ac5d604c5 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:51.448775 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ae2d4eaa-f014-463d-a6c4-962ac5d604c5 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 3b44e25a-9b18-4ee6-b084-32f9e4f7e881] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:51.455316 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae2d4eaa-f014-463d-a6c4-962ac5d604c5 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:51.456155 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae2d4eaa-f014-463d-a6c4-962ac5d604c5 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:51.457096 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae2d4eaa-f014-463d-a6c4-962ac5d604c5 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:51.457691 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae2d4eaa-f014-463d-a6c4-962ac5d604c5 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:51.602856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-360d6c7d-19c7-42e9-a980-080390af1c9d tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:51.613569 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-360d6c7d-19c7-42e9-a980-080390af1c9d tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a" status: 200 len: 1476 microversion: 2.1 time: 0.315030 Jul 25 14:27:51.615203 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 413/799] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:51 2022] GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a => generated 1476 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:51.621902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-edddf67d-567e-49d7-9d99-10e6e81329a9 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:51.622698 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-edddf67d-567e-49d7-9d99-10e6e81329a9 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: 10a339c9-ca8c-403d-bb81-4aef27960efd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:51.633371 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-edddf67d-567e-49d7-9d99-10e6e81329a9 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:51.636248 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-edddf67d-567e-49d7-9d99-10e6e81329a9 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:51.637293 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-edddf67d-567e-49d7-9d99-10e6e81329a9 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:51.637881 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-edddf67d-567e-49d7-9d99-10e6e81329a9 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:51.668307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ae2d4eaa-f014-463d-a6c4-962ac5d604c5 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:51.678274 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ae2d4eaa-f014-463d-a6c4-962ac5d604c5 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881" status: 200 len: 1324 microversion: 2.1 time: 0.234699 Jul 25 14:27:51.678859 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 387/800] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:51 2022] GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881 => generated 1324 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:51.695051 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-000fee92-f853-4263-b203-bd8e65926af6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:51.696490 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-000fee92-f853-4263-b203-bd8e65926af6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:51.704224 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-000fee92-f853-4263-b203-bd8e65926af6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:51.704835 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-000fee92-f853-4263-b203-bd8e65926af6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:51.705788 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-000fee92-f853-4263-b203-bd8e65926af6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:51.706330 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-000fee92-f853-4263-b203-bd8e65926af6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:51.860314 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-000fee92-f853-4263-b203-bd8e65926af6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:51.868889 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-000fee92-f853-4263-b203-bd8e65926af6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1313 microversion: 2.1 time: 0.178659 Jul 25 14:27:51.871151 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-edddf67d-567e-49d7-9d99-10e6e81329a9 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:51.882919 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 388/801] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:51 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:51.885904 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-edddf67d-567e-49d7-9d99-10e6e81329a9 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd" status: 200 len: 1321 microversion: 2.1 time: 0.268853 Jul 25 14:27:51.886715 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 414/802] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:51 2022] GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd => generated 1321 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:51.894434 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-76c0b8ee-7297-40e2-b240-aa5063de8073 req-463e7615-50a4-42b3-a03f-346cfe8a3a49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5db8a05-a27e-4426-9166-44727d5cc4ff", "name": "network-vif-plugged", "status": "completed", "tag": "f34d13c0-b812-4793-bcd0-55fe6e34bc46"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:51.906612 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-76c0b8ee-7297-40e2-b240-aa5063de8073 req-463e7615-50a4-42b3-a03f-346cfe8a3a49 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:51.907208 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-76c0b8ee-7297-40e2-b240-aa5063de8073 req-463e7615-50a4-42b3-a03f-346cfe8a3a49 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:51.919755 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-76c0b8ee-7297-40e2-b240-aa5063de8073 req-463e7615-50a4-42b3-a03f-346cfe8a3a49 service nova] Creating event network-vif-plugged:f34d13c0-b812-4793-bcd0-55fe6e34bc46 for instance d5db8a05-a27e-4426-9166-44727d5cc4ff on n-h1-846435-14 Jul 25 14:27:51.924813 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-76c0b8ee-7297-40e2-b240-aa5063de8073 req-463e7615-50a4-42b3-a03f-346cfe8a3a49 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040626 Jul 25 14:27:51.925560 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 389/803] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:52.317145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-87cf9195-b9c7-463c-9fb8-f9782ef02a99 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:52.318003 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-87cf9195-b9c7-463c-9fb8-f9782ef02a99 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:52.330615 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-87cf9195-b9c7-463c-9fb8-f9782ef02a99 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:52.331357 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-87cf9195-b9c7-463c-9fb8-f9782ef02a99 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:52.332712 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-87cf9195-b9c7-463c-9fb8-f9782ef02a99 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:52.333322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-87cf9195-b9c7-463c-9fb8-f9782ef02a99 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:52.450422 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6345c2ae-ca56-47e6-a79a-9003643740d1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:52.451276 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6345c2ae-ca56-47e6-a79a-9003643740d1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:52.458163 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6345c2ae-ca56-47e6-a79a-9003643740d1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:52.458938 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6345c2ae-ca56-47e6-a79a-9003643740d1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:52.459920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6345c2ae-ca56-47e6-a79a-9003643740d1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:52.460377 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6345c2ae-ca56-47e6-a79a-9003643740d1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:52.606823 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6345c2ae-ca56-47e6-a79a-9003643740d1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:52.611676 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:52.620463 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6345c2ae-ca56-47e6-a79a-9003643740d1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:52.622182 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6345c2ae-ca56-47e6-a79a-9003643740d1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:52.623537 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6345c2ae-ca56-47e6-a79a-9003643740d1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 200 len: 1361 microversion: 2.25 time: 0.180312 Jul 25 14:27:52.624124 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 390/804] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:27:52 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:27:52.637574 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cd7d4400-11e4-4fff-bfa3-697a08554c3d tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:52.639051 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cd7d4400-11e4-4fff-bfa3-697a08554c3d tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: 6805171d-8f8d-4694-ab4a-2875d20b0d2a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:52.647492 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cd7d4400-11e4-4fff-bfa3-697a08554c3d tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:52.648086 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cd7d4400-11e4-4fff-bfa3-697a08554c3d tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:52.648975 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cd7d4400-11e4-4fff-bfa3-697a08554c3d tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:52.649629 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cd7d4400-11e4-4fff-bfa3-697a08554c3d tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:52.812045 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cd7d4400-11e4-4fff-bfa3-697a08554c3d tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:52.821512 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cd7d4400-11e4-4fff-bfa3-697a08554c3d tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a" status: 200 len: 1476 microversion: 2.1 time: 0.190200 Jul 25 14:27:52.823426 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 391/805] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:52 2022] GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a => generated 1476 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:52.828943 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-07341690-056e-46fc-b31b-b5056181c8c8 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:52.829832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-07341690-056e-46fc-b31b-b5056181c8c8 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 3b44e25a-9b18-4ee6-b084-32f9e4f7e881] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:52.838240 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-07341690-056e-46fc-b31b-b5056181c8c8 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:52.839110 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-07341690-056e-46fc-b31b-b5056181c8c8 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:52.839965 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-07341690-056e-46fc-b31b-b5056181c8c8 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:52.840504 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-07341690-056e-46fc-b31b-b5056181c8c8 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:52.862886 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-87cf9195-b9c7-463c-9fb8-f9782ef02a99 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:52.871355 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-87cf9195-b9c7-463c-9fb8-f9782ef02a99 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1490 microversion: 2.1 time: 0.558162 Jul 25 14:27:52.884580 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 415/806] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:52 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1490 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:52.891878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c0b9c6d6-4fad-4703-9212-b6f44d2064c8 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:52.892905 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c0b9c6d6-4fad-4703-9212-b6f44d2064c8 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:52.901822 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c0b9c6d6-4fad-4703-9212-b6f44d2064c8 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:52.902630 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c0b9c6d6-4fad-4703-9212-b6f44d2064c8 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:52.903610 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c0b9c6d6-4fad-4703-9212-b6f44d2064c8 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:52.904244 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c0b9c6d6-4fad-4703-9212-b6f44d2064c8 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:52.987063 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-07341690-056e-46fc-b31b-b5056181c8c8 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:52.995226 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-07341690-056e-46fc-b31b-b5056181c8c8 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881" status: 200 len: 1324 microversion: 2.1 time: 0.170313 Jul 25 14:27:52.995796 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 392/807] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:52 2022] GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881 => generated 1324 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:53.006293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ddf2281f-23df-453c-83ec-3d9273283897 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:53.007303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ddf2281f-23df-453c-83ec-3d9273283897 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: 10a339c9-ca8c-403d-bb81-4aef27960efd] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:53.014080 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ddf2281f-23df-453c-83ec-3d9273283897 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:53.014532 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ddf2281f-23df-453c-83ec-3d9273283897 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:53.016021 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ddf2281f-23df-453c-83ec-3d9273283897 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:53.016466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ddf2281f-23df-453c-83ec-3d9273283897 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:53.157395 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ddf2281f-23df-453c-83ec-3d9273283897 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:53.166996 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ddf2281f-23df-453c-83ec-3d9273283897 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd" status: 200 len: 1470 microversion: 2.1 time: 0.169863 Jul 25 14:27:53.175028 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 393/808] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:52 2022] GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd => generated 1470 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:53.185310 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c0b9c6d6-4fad-4703-9212-b6f44d2064c8 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:53.188879 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-59891b34-f34e-41d1-910d-9f559f0cc274 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:53.190252 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-59891b34-f34e-41d1-910d-9f559f0cc274 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] [instance: 10a339c9-ca8c-403d-bb81-4aef27960efd] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:53.196173 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c0b9c6d6-4fad-4703-9212-b6f44d2064c8 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1313 microversion: 2.1 time: 0.309976 Jul 25 14:27:53.196767 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 416/809] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:52 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1313 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:53.207662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59891b34-f34e-41d1-910d-9f559f0cc274 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:53.207662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59891b34-f34e-41d1-910d-9f559f0cc274 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:53.207662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59891b34-f34e-41d1-910d-9f559f0cc274 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:53.207662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59891b34-f34e-41d1-910d-9f559f0cc274 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:53.227240 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-59891b34-f34e-41d1-910d-9f559f0cc274 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Lazy-loading 'flavor' on Instance uuid 10a339c9-ca8c-403d-bb81-4aef27960efd {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:27:53.316907 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-59891b34-f34e-41d1-910d-9f559f0cc274 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd/action" status: 202 len: 0 microversion: 2.1 time: 0.130613 Jul 25 14:27:53.320004 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 394/810] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:27:53 2022] POST /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:27:53.346360 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-79101e30-4cfc-49eb-9cef-c59ca39a56ab tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:53.351601 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-79101e30-4cfc-49eb-9cef-c59ca39a56ab tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] [instance: 10a339c9-ca8c-403d-bb81-4aef27960efd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:53.368655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-79101e30-4cfc-49eb-9cef-c59ca39a56ab tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:53.369107 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-79101e30-4cfc-49eb-9cef-c59ca39a56ab tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:53.369896 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-79101e30-4cfc-49eb-9cef-c59ca39a56ab tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:53.370329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-79101e30-4cfc-49eb-9cef-c59ca39a56ab tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:53.646639 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-58888745-028d-40c6-b7ba-d575d29401e9 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:53.647595 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-58888745-028d-40c6-b7ba-d575d29401e9 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:53.655001 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-58888745-028d-40c6-b7ba-d575d29401e9 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:53.655690 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-58888745-028d-40c6-b7ba-d575d29401e9 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:53.656483 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-58888745-028d-40c6-b7ba-d575d29401e9 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:53.656879 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-58888745-028d-40c6-b7ba-d575d29401e9 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:53.834945 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-58888745-028d-40c6-b7ba-d575d29401e9 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:53.847065 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-58888745-028d-40c6-b7ba-d575d29401e9 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:53.848619 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-58888745-028d-40c6-b7ba-d575d29401e9 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:53.849773 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-58888745-028d-40c6-b7ba-d575d29401e9 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 200 len: 1361 microversion: 2.25 time: 0.207710 Jul 25 14:27:53.850667 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 395/811] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:27:53 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 1361 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:27:53.855278 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-43fac7b5-86cc-42c7-a2fe-a84e313c2140 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:53.855886 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-43fac7b5-86cc-42c7-a2fe-a84e313c2140 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: 6805171d-8f8d-4694-ab4a-2875d20b0d2a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:53.866802 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43fac7b5-86cc-42c7-a2fe-a84e313c2140 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:53.867264 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43fac7b5-86cc-42c7-a2fe-a84e313c2140 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:53.868092 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43fac7b5-86cc-42c7-a2fe-a84e313c2140 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:53.868529 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43fac7b5-86cc-42c7-a2fe-a84e313c2140 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:54.061393 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-79101e30-4cfc-49eb-9cef-c59ca39a56ab tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd" status: 200 len: 1631 microversion: 2.1 time: 0.737326 Jul 25 14:27:54.065375 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 417/812] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:53 2022] GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd => generated 1631 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:54.070563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e668f983-0d44-4fc7-9e13-08b3ca8fb905 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:54.071493 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e668f983-0d44-4fc7-9e13-08b3ca8fb905 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:54.090715 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e668f983-0d44-4fc7-9e13-08b3ca8fb905 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:54.091763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e668f983-0d44-4fc7-9e13-08b3ca8fb905 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:54.093895 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e668f983-0d44-4fc7-9e13-08b3ca8fb905 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:54.095101 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e668f983-0d44-4fc7-9e13-08b3ca8fb905 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:54.151935 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:54.212314 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-43fac7b5-86cc-42c7-a2fe-a84e313c2140 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:54.231311 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-43fac7b5-86cc-42c7-a2fe-a84e313c2140 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a" status: 200 len: 1476 microversion: 2.1 time: 0.379504 Jul 25 14:27:54.252238 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 396/813] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:53 2022] GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a => generated 1476 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:54.262129 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-79ed981f-7e87-4a8c-acae-0bb4dc7c90ef req-c2adde58-9429-4256-801b-3bde6b57f4a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b44e25a-9b18-4ee6-b084-32f9e4f7e881", "tag": "35ff58a9-4c79-467b-9c47-4078f588668b"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:54.286976 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-79ed981f-7e87-4a8c-acae-0bb4dc7c90ef req-c2adde58-9429-4256-801b-3bde6b57f4a5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:54.287685 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-79ed981f-7e87-4a8c-acae-0bb4dc7c90ef req-c2adde58-9429-4256-801b-3bde6b57f4a5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:54.304283 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-79ed981f-7e87-4a8c-acae-0bb4dc7c90ef req-c2adde58-9429-4256-801b-3bde6b57f4a5 service nova] Creating event network-changed:35ff58a9-4c79-467b-9c47-4078f588668b for instance 3b44e25a-9b18-4ee6-b084-32f9e4f7e881 on n-h1-846435-14 Jul 25 14:27:54.320673 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-79ed981f-7e87-4a8c-acae-0bb4dc7c90ef req-c2adde58-9429-4256-801b-3bde6b57f4a5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066549 Jul 25 14:27:54.322080 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 397/814] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:54.332592 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9c64bde6-e802-4253-ac0e-0a622ce21c14 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:54.333565 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9c64bde6-e802-4253-ac0e-0a622ce21c14 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 3b44e25a-9b18-4ee6-b084-32f9e4f7e881] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:54.342585 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9c64bde6-e802-4253-ac0e-0a622ce21c14 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:54.343310 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9c64bde6-e802-4253-ac0e-0a622ce21c14 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:54.344370 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9c64bde6-e802-4253-ac0e-0a622ce21c14 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:54.345024 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9c64bde6-e802-4253-ac0e-0a622ce21c14 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:54.534171 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e668f983-0d44-4fc7-9e13-08b3ca8fb905 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:54.542357 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e668f983-0d44-4fc7-9e13-08b3ca8fb905 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1478 microversion: 2.1 time: 0.475503 Jul 25 14:27:54.543826 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 418/815] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:54 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1478 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:54.550837 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e6e31971-2238-4165-96c0-a1a509156d06 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:54.551637 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e6e31971-2238-4165-96c0-a1a509156d06 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:54.558675 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6e31971-2238-4165-96c0-a1a509156d06 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:54.559122 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6e31971-2238-4165-96c0-a1a509156d06 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:54.560084 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6e31971-2238-4165-96c0-a1a509156d06 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:54.560655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6e31971-2238-4165-96c0-a1a509156d06 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:54.719397 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9c64bde6-e802-4253-ac0e-0a622ce21c14 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:54.729351 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9c64bde6-e802-4253-ac0e-0a622ce21c14 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881" status: 200 len: 1324 microversion: 2.1 time: 0.405665 Jul 25 14:27:54.730709 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 398/816] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:54 2022] GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881 => generated 1324 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:54.871025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e6e31971-2238-4165-96c0-a1a509156d06 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:54.874795 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d0542d8a-10e2-45c4-af52-e3d8e903de11 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:54.881411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d0542d8a-10e2-45c4-af52-e3d8e903de11 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:54.891879 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e6e31971-2238-4165-96c0-a1a509156d06 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1313 microversion: 2.1 time: 0.346482 Jul 25 14:27:54.897218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d0542d8a-10e2-45c4-af52-e3d8e903de11 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:54.897668 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d0542d8a-10e2-45c4-af52-e3d8e903de11 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:54.898480 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 419/817] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:54 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:54.899224 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d0542d8a-10e2-45c4-af52-e3d8e903de11 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:54.899668 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d0542d8a-10e2-45c4-af52-e3d8e903de11 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:55.062843 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d0542d8a-10e2-45c4-af52-e3d8e903de11 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:55.075054 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d0542d8a-10e2-45c4-af52-e3d8e903de11 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:55.079037 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d0542d8a-10e2-45c4-af52-e3d8e903de11 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:55.081783 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d0542d8a-10e2-45c4-af52-e3d8e903de11 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 200 len: 1361 microversion: 2.25 time: 0.213041 Jul 25 14:27:55.082577 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 399/818] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:27:54 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:27:55.102044 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6a2ef6ad-19a0-43b5-afd3-78661a061d42 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:55.103355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6a2ef6ad-19a0-43b5-afd3-78661a061d42 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] [instance: 10a339c9-ca8c-403d-bb81-4aef27960efd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:55.109980 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6a2ef6ad-19a0-43b5-afd3-78661a061d42 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:55.110652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6a2ef6ad-19a0-43b5-afd3-78661a061d42 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:55.111563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6a2ef6ad-19a0-43b5-afd3-78661a061d42 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:55.112265 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6a2ef6ad-19a0-43b5-afd3-78661a061d42 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:55.264355 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-eab77435-275f-4e02-8c28-c96bb1a1a4e5 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:55.265874 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-eab77435-275f-4e02-8c28-c96bb1a1a4e5 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: 6805171d-8f8d-4694-ab4a-2875d20b0d2a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:55.278279 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eab77435-275f-4e02-8c28-c96bb1a1a4e5 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:55.278742 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eab77435-275f-4e02-8c28-c96bb1a1a4e5 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:55.279751 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eab77435-275f-4e02-8c28-c96bb1a1a4e5 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:55.280224 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eab77435-275f-4e02-8c28-c96bb1a1a4e5 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:55.339554 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6a2ef6ad-19a0-43b5-afd3-78661a061d42 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd" status: 200 len: 1614 microversion: 2.1 time: 0.242314 Jul 25 14:27:55.361143 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 420/819] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:55 2022] GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd => generated 1614 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:55.367787 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e4262b0d-a928-42f5-b044-5f874da3fa28 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:55.369062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e4262b0d-a928-42f5-b044-5f874da3fa28 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] [instance: 10a339c9-ca8c-403d-bb81-4aef27960efd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:55.376674 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e4262b0d-a928-42f5-b044-5f874da3fa28 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:55.377514 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e4262b0d-a928-42f5-b044-5f874da3fa28 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:55.378574 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e4262b0d-a928-42f5-b044-5f874da3fa28 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:55.379221 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e4262b0d-a928-42f5-b044-5f874da3fa28 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:55.440713 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-eab77435-275f-4e02-8c28-c96bb1a1a4e5 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:55.451715 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-eab77435-275f-4e02-8c28-c96bb1a1a4e5 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a" status: 200 len: 1459 microversion: 2.1 time: 0.191088 Jul 25 14:27:55.452641 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 400/820] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:55 2022] GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a => generated 1459 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:27:55.472641 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8df44aff-2961-445d-9f8e-3e786d0fe6e5 tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:55.473605 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8df44aff-2961-445d-9f8e-3e786d0fe6e5 tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] [instance: 6805171d-8f8d-4694-ab4a-2875d20b0d2a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:55.483404 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8df44aff-2961-445d-9f8e-3e786d0fe6e5 tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:55.484036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8df44aff-2961-445d-9f8e-3e786d0fe6e5 tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:55.484940 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8df44aff-2961-445d-9f8e-3e786d0fe6e5 tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:55.485462 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8df44aff-2961-445d-9f8e-3e786d0fe6e5 tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:55.510718 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-e4262b0d-a928-42f5-b044-5f874da3fa28 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] HTTP exception thrown: Cannot 'migrate' instance 10a339c9-ca8c-403d-bb81-4aef27960efd while it is in vm_state suspended Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e4262b0d-a928-42f5-b044-5f874da3fa28 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Request method failure captured: Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd/action HTTP/1.1 Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 15 Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qg7nZuy2E6W7V9cxrAuYDhTCzsd7mjQ2y9DytdP9VVoXrSJM7_baJbkZuHRqvejpj4kBIOobxOgruz3wO03rM_Z7SyWqFZ6hZJjK2_wltx19l26XUBq7uxn60d7hP2osCVOkzyPnKGIgKJgfQRHEPmlTqdp7mJc3QCgTQdDosp28uQ Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: b521f1290f19442c82b5fde0c45e87ed Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1616729302 Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: X-Role: admin,reader,member Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: admin,reader,member Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b521f1290f19442c82b5fde0c45e87ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b521f1290f19442c82b5fde0c45e87ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b521f1290f19442c82b5fde0c45e87ed", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b521f1290f19442c82b5fde0c45e87ed"}]}] Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1616729302 Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: b521f1290f19442c82b5fde0c45e87ed Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1616729302 Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersAdminNegativeTestJSON-1616729302-project-admin Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 6774836e5024420985da7cc07ec74915 Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1616729302-project-admin Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: {"migrate": {}} Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: exception: Cannot 'migrate' instance 10a339c9-ca8c-403d-bb81-4aef27960efd while it is in vm_state suspended Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '10a339c9-ca8c-403d-bb81-4aef27960efd', 'body': {'migrate': {}}} Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 10a339c9-ca8c-403d-bb81-4aef27960efd in vm_state suspended. Cannot resize while the instance is in this state. Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:27:55.512380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:27:55.517192 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:27:55.517192 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jul 25 14:27:55.517192 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 14:27:55.517192 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 14:27:55.517192 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 14:27:55.517192 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 10a339c9-ca8c-403d-bb81-4aef27960efd while it is in vm_state suspended Jul 25 14:27:55.517192 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:55.517192 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:55.517192 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:55.517192 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:55.517192 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:55.517192 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:55.517192 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:27:55.517192 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:27:55.517192 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 10a339c9-ca8c-403d-bb81-4aef27960efd while it is in vm_state suspended Jul 25 14:27:55.517192 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:55.517192 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e4262b0d-a928-42f5-b044-5f874da3fa28 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Returning 409 to user: Cannot 'migrate' instance 10a339c9-ca8c-403d-bb81-4aef27960efd while it is in vm_state suspended {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:27:55.517192 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e4262b0d-a928-42f5-b044-5f874da3fa28 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd/action" status: 409 len: 148 microversion: 2.1 time: 0.151211 Jul 25 14:27:55.517192 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 421/821] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:27:55 2022] POST /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd/action => generated 148 bytes in 152 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:27:55.530482 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c2add73f-ef08-494b-8295-d99fd59be431 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c2add73f-ef08-494b-8295-d99fd59be431 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Request method failure captured: Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96/action HTTP/1.1 Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 39 Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qg7nZuy2E6W7V9cxrAuYDhTCzsd7mjQ2y9DytdP9VVoXrSJM7_baJbkZuHRqvejpj4kBIOobxOgruz3wO03rM_Z7SyWqFZ6hZJjK2_wltx19l26XUBq7uxn60d7hP2osCVOkzyPnKGIgKJgfQRHEPmlTqdp7mJc3QCgTQdDosp28uQ Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: b521f1290f19442c82b5fde0c45e87ed Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1616729302 Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: X-Role: admin,reader,member Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: admin,reader,member Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b521f1290f19442c82b5fde0c45e87ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b521f1290f19442c82b5fde0c45e87ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b521f1290f19442c82b5fde0c45e87ed", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b521f1290f19442c82b5fde0c45e87ed"}]}] Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1616729302 Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: b521f1290f19442c82b5fde0c45e87ed Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1616729302 Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersAdminNegativeTestJSON-1616729302-project-admin Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 6774836e5024420985da7cc07ec74915 Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1616729302-project-admin Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: {"os-resetState": {"state": "invalid"}} Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'c2ea60b9-dff6-4ee9-8004-680327fa2f96', 'body': {'os-resetState': {'state': 'invalid'}}} Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'invalid' Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:27:55.534594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:27:55.539004 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 25 14:27:55.539004 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:55.539004 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:55.539004 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:55.539004 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:55.539004 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:55.539004 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:55.539004 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:27:55.539004 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:27:55.539004 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 25 14:27:55.539004 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:55.540600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c2add73f-ef08-494b-8295-d99fd59be431 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:27:55.541431 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c2add73f-ef08-494b-8295-d99fd59be431 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96/action" status: 400 len: 144 microversion: 2.1 time: 0.014969 Jul 25 14:27:55.545197 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 422/822] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:27:55 2022] POST /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96/action => generated 144 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:27:55.553381 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1efd0405-457e-4249-bfd8-5e8ee037e052 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1efd0405-457e-4249-bfd8-5e8ee037e052 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Request method failure captured: Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96/action HTTP/1.1 Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 31 Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qg7nZuy2E6W7V9cxrAuYDhTCzsd7mjQ2y9DytdP9VVoXrSJM7_baJbkZuHRqvejpj4kBIOobxOgruz3wO03rM_Z7SyWqFZ6hZJjK2_wltx19l26XUBq7uxn60d7hP2osCVOkzyPnKGIgKJgfQRHEPmlTqdp7mJc3QCgTQdDosp28uQ Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: b521f1290f19442c82b5fde0c45e87ed Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1616729302 Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: X-Role: admin,reader,member Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: admin,reader,member Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b521f1290f19442c82b5fde0c45e87ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b521f1290f19442c82b5fde0c45e87ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b521f1290f19442c82b5fde0c45e87ed", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b521f1290f19442c82b5fde0c45e87ed"}]}] Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1616729302 Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: b521f1290f19442c82b5fde0c45e87ed Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1616729302 Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersAdminNegativeTestJSON-1616729302-project-admin Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 6774836e5024420985da7cc07ec74915 Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1616729302-project-admin Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: {"os-resetState": {"state": 1}} Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'c2ea60b9-dff6-4ee9-8004-680327fa2f96', 'body': {'os-resetState': {'state': 1}}} Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 1 Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 25 14:27:55.557784 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:55.568324 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:55.568324 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:55.568324 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:55.568324 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:55.568324 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:55.568324 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:27:55.568324 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:27:55.568324 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 25 14:27:55.568324 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:27:55.568324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1efd0405-457e-4249-bfd8-5e8ee037e052 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:27:55.568324 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1efd0405-457e-4249-bfd8-5e8ee037e052 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96/action" status: 400 len: 120 microversion: 2.1 time: 0.010409 Jul 25 14:27:55.568324 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 423/823] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:27:55 2022] POST /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96/action => generated 120 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 14:27:55.568324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cc01046e-e77b-4015-ba24-53d2b3189562 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:55.568324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cc01046e-e77b-4015-ba24-53d2b3189562 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:55.573306 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cc01046e-e77b-4015-ba24-53d2b3189562 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:55.573788 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cc01046e-e77b-4015-ba24-53d2b3189562 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:55.574606 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cc01046e-e77b-4015-ba24-53d2b3189562 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:55.575033 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cc01046e-e77b-4015-ba24-53d2b3189562 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:55.751617 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8df44aff-2961-445d-9f8e-3e786d0fe6e5 tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a" status: 200 len: 1612 microversion: 2.1 time: 0.283244 Jul 25 14:27:55.752515 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 401/824] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:55 2022] GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a => generated 1612 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:27:55.771964 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-09962bde-034d-423f-827d-9f91f37a3846 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:55.774486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-09962bde-034d-423f-827d-9f91f37a3846 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Failed to fetch instance by id 999 {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 25 14:27:55.775361 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-09962bde-034d-423f-827d-9f91f37a3846 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] HTTP exception thrown: Instance 999 could not be found. Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-09962bde-034d-423f-827d-9f91f37a3846 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Request method failure captured: Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 37 Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qg7nZuy2E6W7V9cxrAuYDhTCzsd7mjQ2y9DytdP9VVoXrSJM7_baJbkZuHRqvejpj4kBIOobxOgruz3wO03rM_Z7SyWqFZ6hZJjK2_wltx19l26XUBq7uxn60d7hP2osCVOkzyPnKGIgKJgfQRHEPmlTqdp7mJc3QCgTQdDosp28uQ Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: b521f1290f19442c82b5fde0c45e87ed Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1616729302 Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: X-Role: admin,reader,member Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: admin,reader,member Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b521f1290f19442c82b5fde0c45e87ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b521f1290f19442c82b5fde0c45e87ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b521f1290f19442c82b5fde0c45e87ed", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b521f1290f19442c82b5fde0c45e87ed"}]}] Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1616729302 Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: b521f1290f19442c82b5fde0c45e87ed Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1616729302 Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersAdminNegativeTestJSON-1616729302-project-admin Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 6774836e5024420985da7cc07ec74915 Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1616729302-project-admin Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: {"os-resetState": {"state": "error"}} Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 999 could not be found. Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:55.786110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:27:55.790778 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:27:55.790778 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 25 14:27:55.790778 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:55.791136 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-09962bde-034d-423f-827d-9f91f37a3846 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:27:55.792120 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-09962bde-034d-423f-827d-9f91f37a3846 tempest-ServersAdminNegativeTestJSON-1616729302 tempest-ServersAdminNegativeTestJSON-1616729302-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.036213 Jul 25 14:27:55.797750 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 402/825] 10.222.0.88 () {60 vars in 1179 bytes} [Mon Jul 25 14:27:55 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:27:55.799426 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-90038d63-b9e3-4c83-8454-69484d19ba63 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:55.800580 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-90038d63-b9e3-4c83-8454-69484d19ba63 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 3b44e25a-9b18-4ee6-b084-32f9e4f7e881] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:55.808628 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-90038d63-b9e3-4c83-8454-69484d19ba63 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:55.809408 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-90038d63-b9e3-4c83-8454-69484d19ba63 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:55.810274 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-90038d63-b9e3-4c83-8454-69484d19ba63 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:55.811690 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-90038d63-b9e3-4c83-8454-69484d19ba63 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:55.812646 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cc01046e-e77b-4015-ba24-53d2b3189562 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:55.820627 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cc01046e-e77b-4015-ba24-53d2b3189562 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1478 microversion: 2.1 time: 0.258806 Jul 25 14:27:55.823794 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 424/826] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:55 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1478 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:55.828525 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-05d3f231-5fb1-417a-a579-35b0a32246fe tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:55.832342 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:27:55.832342 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:27:55.833862 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-05d3f231-5fb1-417a-a579-35b0a32246fe tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:55.834481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-05d3f231-5fb1-417a-a579-35b0a32246fe tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:55.835644 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-05d3f231-5fb1-417a-a579-35b0a32246fe tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:55.836332 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-05d3f231-5fb1-417a-a579-35b0a32246fe tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:55.867675 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-05d3f231-5fb1-417a-a579-35b0a32246fe tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.042545 Jul 25 14:27:55.869055 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 425/827] 10.222.0.88 () {58 vars in 1176 bytes} [Mon Jul 25 14:27:55 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:27:55.873661 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-74e2176a-d92e-458c-989a-7f903db0e3a2 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:55.874219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-74e2176a-d92e-458c-989a-7f903db0e3a2 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: 10a339c9-ca8c-403d-bb81-4aef27960efd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:55.882399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-74e2176a-d92e-458c-989a-7f903db0e3a2 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:55.882925 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-74e2176a-d92e-458c-989a-7f903db0e3a2 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:55.883763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-74e2176a-d92e-458c-989a-7f903db0e3a2 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:55.884973 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-74e2176a-d92e-458c-989a-7f903db0e3a2 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:55.912778 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-74e2176a-d92e-458c-989a-7f903db0e3a2 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: 10a339c9-ca8c-403d-bb81-4aef27960efd] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:27:55.983873 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-90038d63-b9e3-4c83-8454-69484d19ba63 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:55.996188 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-90038d63-b9e3-4c83-8454-69484d19ba63 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881" status: 200 len: 1324 microversion: 2.1 time: 0.201365 Jul 25 14:27:56.009659 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 403/828] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:55 2022] GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881 => generated 1324 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:56.021969 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-74e2176a-d92e-458c-989a-7f903db0e3a2 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "DELETE /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd" status: 204 len: 0 microversion: 2.1 time: 0.150622 Jul 25 14:27:56.021969 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 426/829] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:27:55 2022] DELETE /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:27:56.025318 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-50736605-0f59-4026-9476-2cd34c8b02fa tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-846435-14", "block_migration": true, "disk_over_commit": false}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:56.034401 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-50736605-0f59-4026-9476-2cd34c8b02fa tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] [instance: 6805171d-8f8d-4694-ab4a-2875d20b0d2a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:56.036810 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b3c5c181-4489-4a10-b9fa-ed0a808386d4 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:56.037520 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b3c5c181-4489-4a10-b9fa-ed0a808386d4 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:56.044323 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b3c5c181-4489-4a10-b9fa-ed0a808386d4 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:56.044487 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-50736605-0f59-4026-9476-2cd34c8b02fa tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:56.044891 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-50736605-0f59-4026-9476-2cd34c8b02fa tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:56.045296 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b3c5c181-4489-4a10-b9fa-ed0a808386d4 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:56.045703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-50736605-0f59-4026-9476-2cd34c8b02fa tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:56.046172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-50736605-0f59-4026-9476-2cd34c8b02fa tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:56.046559 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b3c5c181-4489-4a10-b9fa-ed0a808386d4 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:56.047136 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b3c5c181-4489-4a10-b9fa-ed0a808386d4 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:56.083195 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-50736605-0f59-4026-9476-2cd34c8b02fa tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] Lazy-loading 'flavor' on Instance uuid 6805171d-8f8d-4694-ab4a-2875d20b0d2a {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:27:56.100552 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-50736605-0f59-4026-9476-2cd34c8b02fa tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 6805171d-8f8d-4694-ab4a-2875d20b0d2a while it is in vm_state suspended Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-50736605-0f59-4026-9476-2cd34c8b02fa tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] Request method failure captured: Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a/action HTTP/1.1 Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 98 Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qg2xpaVGnqN0r1xtRySup6MBYYFczh93AFGUAhaS63wG3ouXL0RrqW10SatAJG7Qk5uDQdrzGIz8ZHqX6qJWw4Q0u_rGadmDsPvce6pzpHuSbxubE17pt76fE-VZ6lJajfomVd4yVbeKeRYJoWPdKw19mLtgPlW1m2uugKCf58tLGM Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 8faf52828921463bb72adad4e12c60e1 Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-LiveMigrationNegativeTest-1375152235 Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: X-Role: admin,reader,member Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: admin,reader,member Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8faf52828921463bb72adad4e12c60e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8faf52828921463bb72adad4e12c60e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8faf52828921463bb72adad4e12c60e1", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8faf52828921463bb72adad4e12c60e1"}]}] Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-LiveMigrationNegativeTest-1375152235 Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 8faf52828921463bb72adad4e12c60e1 Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1375152235 Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-LiveMigrationNegativeTest-1375152235-project-admin Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: f1b075ab565b4b1695f83cc4b4127a91 Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-LiveMigrationNegativeTest-1375152235-project-admin Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: {"os-migrateLive": {"host": "n-h1-846435-14", "block_migration": true, "disk_over_commit": false}} Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: exception: Cannot 'os-migrateLive' instance 6805171d-8f8d-4694-ab4a-2875d20b0d2a while it is in vm_state suspended Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '6805171d-8f8d-4694-ab4a-2875d20b0d2a', 'body': {'os-migrateLive': {'host': 'n-h1-846435-14', 'block_migration': True, 'disk_over_commit': False}}} Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6805171d-8f8d-4694-ab4a-2875d20b0d2a in vm_state suspended. Cannot live_migrate while the instance is in this state. Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:56.102375 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:56.106524 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:56.106524 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:27:56.106524 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:27:56.106524 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:27:56.106524 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:27:56.106524 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:27:56.106524 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:27:56.106524 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:27:56.106524 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:27:56.106524 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:27:56.106524 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:27:56.106524 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 25 14:27:56.106524 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jul 25 14:27:56.106524 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 14:27:56.106524 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 14:27:56.106524 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 14:27:56.106524 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 6805171d-8f8d-4694-ab4a-2875d20b0d2a while it is in vm_state suspended Jul 25 14:27:56.106524 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:56.106524 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:27:56.106524 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:56.106524 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:27:56.106524 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:27:56.106524 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:27:56.106524 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:27:56.106524 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:27:56.106524 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 6805171d-8f8d-4694-ab4a-2875d20b0d2a while it is in vm_state suspended Jul 25 14:27:56.106524 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:27:56.106524 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-50736605-0f59-4026-9476-2cd34c8b02fa tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 6805171d-8f8d-4694-ab4a-2875d20b0d2a while it is in vm_state suspended {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:27:56.106524 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-50736605-0f59-4026-9476-2cd34c8b02fa tempest-LiveMigrationNegativeTest-1375152235 tempest-LiveMigrationNegativeTest-1375152235-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a/action" status: 409 len: 155 microversion: 2.1 time: 0.093039 Jul 25 14:27:56.106524 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 404/830] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:27:56 2022] POST /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a/action => generated 155 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:27:56.112940 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-32c43a2f-1217-4336-a4ab-26ad99d35e30 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:56.113637 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-32c43a2f-1217-4336-a4ab-26ad99d35e30 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: 10a339c9-ca8c-403d-bb81-4aef27960efd] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:56.115137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=22 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:56.121207 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-32c43a2f-1217-4336-a4ab-26ad99d35e30 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:56.121689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-32c43a2f-1217-4336-a4ab-26ad99d35e30 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:56.122752 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-32c43a2f-1217-4336-a4ab-26ad99d35e30 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:56.123198 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-32c43a2f-1217-4336-a4ab-26ad99d35e30 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:56.260616 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b3c5c181-4489-4a10-b9fa-ed0a808386d4 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:56.270691 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b3c5c181-4489-4a10-b9fa-ed0a808386d4 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1463 microversion: 2.1 time: 0.238538 Jul 25 14:27:56.286508 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 427/831] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:56 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1463 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:56.286508 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-542525c6-7041-4c28-87d1-9cd692735b61 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:56.289032 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-32c43a2f-1217-4336-a4ab-26ad99d35e30 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:56.292192 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-542525c6-7041-4c28-87d1-9cd692735b61 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:56.307165 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-542525c6-7041-4c28-87d1-9cd692735b61 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:56.307165 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-542525c6-7041-4c28-87d1-9cd692735b61 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:56.308443 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-542525c6-7041-4c28-87d1-9cd692735b61 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:56.309781 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-542525c6-7041-4c28-87d1-9cd692735b61 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:56.310234 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-32c43a2f-1217-4336-a4ab-26ad99d35e30 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd" status: 200 len: 1467 microversion: 2.1 time: 0.203856 Jul 25 14:27:56.320098 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 405/832] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:56 2022] GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd => generated 1467 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:56.321181 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ad35dd4b-920b-4673-9bbf-98497a2b1233 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:56.328569 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ad35dd4b-920b-4673-9bbf-98497a2b1233 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: 6805171d-8f8d-4694-ab4a-2875d20b0d2a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:56.345328 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ad35dd4b-920b-4673-9bbf-98497a2b1233 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:56.346585 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ad35dd4b-920b-4673-9bbf-98497a2b1233 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:56.347684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ad35dd4b-920b-4673-9bbf-98497a2b1233 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:56.349019 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ad35dd4b-920b-4673-9bbf-98497a2b1233 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:56.391515 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ad35dd4b-920b-4673-9bbf-98497a2b1233 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: 6805171d-8f8d-4694-ab4a-2875d20b0d2a] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:27:56.426430 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:56.483130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-542525c6-7041-4c28-87d1-9cd692735b61 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:56.503214 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ad35dd4b-920b-4673-9bbf-98497a2b1233 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "DELETE /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a" status: 204 len: 0 microversion: 2.1 time: 0.185423 Jul 25 14:27:56.503484 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-542525c6-7041-4c28-87d1-9cd692735b61 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:56.504414 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 406/833] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:27:56 2022] DELETE /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:27:56.506032 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-542525c6-7041-4c28-87d1-9cd692735b61 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:56.508856 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-542525c6-7041-4c28-87d1-9cd692735b61 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 200 len: 1361 microversion: 2.25 time: 0.229177 Jul 25 14:27:56.509522 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 428/834] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:27:56 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 1361 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:27:56.524103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-df48e8fd-6af5-43fc-900a-ba918f80cd5e tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:56.524103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-df48e8fd-6af5-43fc-900a-ba918f80cd5e tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: 6805171d-8f8d-4694-ab4a-2875d20b0d2a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:56.524103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-df48e8fd-6af5-43fc-900a-ba918f80cd5e tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:56.524103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-df48e8fd-6af5-43fc-900a-ba918f80cd5e tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:56.524103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-df48e8fd-6af5-43fc-900a-ba918f80cd5e tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:56.524736 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-df48e8fd-6af5-43fc-900a-ba918f80cd5e tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:56.530587 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-44ce3bfc-a95b-4a10-9877-b164a408810f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:56.533335 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-44ce3bfc-a95b-4a10-9877-b164a408810f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:56.540188 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-44ce3bfc-a95b-4a10-9877-b164a408810f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:56.540686 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-44ce3bfc-a95b-4a10-9877-b164a408810f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:56.541973 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-44ce3bfc-a95b-4a10-9877-b164a408810f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:56.542115 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-44ce3bfc-a95b-4a10-9877-b164a408810f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:56.664187 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-44ce3bfc-a95b-4a10-9877-b164a408810f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:56.672417 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-44ce3bfc-a95b-4a10-9877-b164a408810f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Old instance type m1.heat2, new instance type m1.heat {{(pid=119303) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 14:27:56.680132 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-44ce3bfc-a95b-4a10-9877-b164a408810f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:27:56.680551 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-44ce3bfc-a95b-4a10-9877-b164a408810f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:27:56.681015 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-44ce3bfc-a95b-4a10-9877-b164a408810f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:27:56.681417 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-44ce3bfc-a95b-4a10-9877-b164a408810f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:27:56.681970 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-44ce3bfc-a95b-4a10-9877-b164a408810f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:27:56.709885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-df48e8fd-6af5-43fc-900a-ba918f80cd5e tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:56.719998 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-df48e8fd-6af5-43fc-900a-ba918f80cd5e tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a" status: 200 len: 1465 microversion: 2.1 time: 0.208970 Jul 25 14:27:56.721194 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 429/835] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:56 2022] GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a => generated 1465 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:56.843888 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-44ce3bfc-a95b-4a10-9877-b164a408810f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "POST /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff/action" status: 202 len: 0 microversion: 2.1 time: 0.332118 Jul 25 14:27:56.846007 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-98a188bb-4b3b-4e89-8cbf-07a8dd746e17 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:56.846846 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-98a188bb-4b3b-4e89-8cbf-07a8dd746e17 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:56.851667 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 407/836] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:27:56 2022] POST /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:27:56.856126 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-576e29da-04da-44e0-8ed2-460857d79c5f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:56.856728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-576e29da-04da-44e0-8ed2-460857d79c5f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:56.858864 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98a188bb-4b3b-4e89-8cbf-07a8dd746e17 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:56.859404 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98a188bb-4b3b-4e89-8cbf-07a8dd746e17 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:56.860218 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98a188bb-4b3b-4e89-8cbf-07a8dd746e17 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:56.867390 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98a188bb-4b3b-4e89-8cbf-07a8dd746e17 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:56.876088 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-576e29da-04da-44e0-8ed2-460857d79c5f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:56.877084 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-576e29da-04da-44e0-8ed2-460857d79c5f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:56.878650 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-576e29da-04da-44e0-8ed2-460857d79c5f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:56.879313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-576e29da-04da-44e0-8ed2-460857d79c5f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:56.901304 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:57.183875 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-576e29da-04da-44e0-8ed2-460857d79c5f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:57.211869 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-576e29da-04da-44e0-8ed2-460857d79c5f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1472 microversion: 2.1 time: 0.359472 Jul 25 14:27:57.212542 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 408/837] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:56 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1472 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:57.220741 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-98a188bb-4b3b-4e89-8cbf-07a8dd746e17 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:57.229203 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-98a188bb-4b3b-4e89-8cbf-07a8dd746e17 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1463 microversion: 2.1 time: 0.387851 Jul 25 14:27:57.229806 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 430/838] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:56 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1463 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:57.264143 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cfa9d86f-67b1-4f80-861c-dc9742f696df tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:57.264458 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a827f1a1-7926-464f-85d6-4a872809103d tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:57.265101 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a827f1a1-7926-464f-85d6-4a872809103d tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 3b44e25a-9b18-4ee6-b084-32f9e4f7e881] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:57.268368 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cfa9d86f-67b1-4f80-861c-dc9742f696df tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:57.273064 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:57.294567 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cfa9d86f-67b1-4f80-861c-dc9742f696df tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:57.295401 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cfa9d86f-67b1-4f80-861c-dc9742f696df tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:57.295800 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a827f1a1-7926-464f-85d6-4a872809103d tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:57.296450 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a827f1a1-7926-464f-85d6-4a872809103d tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:57.297311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a827f1a1-7926-464f-85d6-4a872809103d tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:57.297451 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cfa9d86f-67b1-4f80-861c-dc9742f696df tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:57.297682 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a827f1a1-7926-464f-85d6-4a872809103d tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:57.299142 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cfa9d86f-67b1-4f80-861c-dc9742f696df tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:57.457423 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cfa9d86f-67b1-4f80-861c-dc9742f696df tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7/action" status: 202 len: 0 microversion: 2.1 time: 0.197138 Jul 25 14:27:57.460069 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 431/839] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:27:57 2022] POST /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:27:57.468420 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4b1703ad-d6d9-4496-a6a7-1945cbd954be tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:57.469779 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4b1703ad-d6d9-4496-a6a7-1945cbd954be tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: 10a339c9-ca8c-403d-bb81-4aef27960efd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:57.477754 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4b1703ad-d6d9-4496-a6a7-1945cbd954be tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:57.478696 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4b1703ad-d6d9-4496-a6a7-1945cbd954be tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:57.480574 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4b1703ad-d6d9-4496-a6a7-1945cbd954be tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:57.481477 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4b1703ad-d6d9-4496-a6a7-1945cbd954be tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:57.628552 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a827f1a1-7926-464f-85d6-4a872809103d tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:57.643621 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a827f1a1-7926-464f-85d6-4a872809103d tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881" status: 200 len: 1324 microversion: 2.1 time: 0.399732 Jul 25 14:27:57.657409 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 409/840] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:57 2022] GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881 => generated 1324 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:57.663451 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f596c546-096c-4e8f-ad45-70ee6907615a tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:57.664193 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f596c546-096c-4e8f-ad45-70ee6907615a tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:57.682035 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f596c546-096c-4e8f-ad45-70ee6907615a tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:57.682578 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f596c546-096c-4e8f-ad45-70ee6907615a tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:57.683456 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f596c546-096c-4e8f-ad45-70ee6907615a tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:57.684022 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f596c546-096c-4e8f-ad45-70ee6907615a tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:57.750003 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4b1703ad-d6d9-4496-a6a7-1945cbd954be tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:57.761104 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4b1703ad-d6d9-4496-a6a7-1945cbd954be tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd" status: 200 len: 1467 microversion: 2.1 time: 0.299342 Jul 25 14:27:57.762027 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 432/841] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:57 2022] GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd => generated 1467 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:57.775406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f596c546-096c-4e8f-ad45-70ee6907615a tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:57.775406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f596c546-096c-4e8f-ad45-70ee6907615a tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:57.775406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-f596c546-096c-4e8f-ad45-70ee6907615a tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lazy-loading 'fault' on Instance uuid c25476ab-b697-45f9-aa22-ead2d1b23fc7 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:27:57.803489 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6436a1d9-b7e6-475b-b636-b834ede0afac tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:57.804949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6436a1d9-b7e6-475b-b636-b834ede0afac tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:57.813840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6436a1d9-b7e6-475b-b636-b834ede0afac tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:57.814567 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6436a1d9-b7e6-475b-b636-b834ede0afac tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:57.815544 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6436a1d9-b7e6-475b-b636-b834ede0afac tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:57.816169 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6436a1d9-b7e6-475b-b636-b834ede0afac tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:58.096719 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6436a1d9-b7e6-475b-b636-b834ede0afac tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:58.099544 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f596c546-096c-4e8f-ad45-70ee6907615a tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1599 microversion: 2.1 time: 0.440823 Jul 25 14:27:58.101367 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 410/842] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:57 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1599 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:58.108624 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-da2370de-64f7-40d8-8d45-fb4376d5b901 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:58.110141 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-da2370de-64f7-40d8-8d45-fb4376d5b901 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: 6805171d-8f8d-4694-ab4a-2875d20b0d2a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:58.117135 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da2370de-64f7-40d8-8d45-fb4376d5b901 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:58.117793 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da2370de-64f7-40d8-8d45-fb4376d5b901 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:58.118727 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da2370de-64f7-40d8-8d45-fb4376d5b901 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:58.119313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da2370de-64f7-40d8-8d45-fb4376d5b901 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:58.122958 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6436a1d9-b7e6-475b-b636-b834ede0afac tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:58.124811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6436a1d9-b7e6-475b-b636-b834ede0afac tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:58.126673 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6436a1d9-b7e6-475b-b636-b834ede0afac tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 200 len: 1361 microversion: 2.25 time: 0.328306 Jul 25 14:27:58.127855 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 433/843] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:27:57 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 1361 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:27:58.133902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5fc9f553-ad58-499e-b8b7-1e1ca2b0514b tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:27:58.137790 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5fc9f553-ad58-499e-b8b7-1e1ca2b0514b tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:58.152512 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5fc9f553-ad58-499e-b8b7-1e1ca2b0514b tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:58.152964 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5fc9f553-ad58-499e-b8b7-1e1ca2b0514b tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:58.153746 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5fc9f553-ad58-499e-b8b7-1e1ca2b0514b tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:58.154178 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5fc9f553-ad58-499e-b8b7-1e1ca2b0514b tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:58.249729 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:58.342213 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5fc9f553-ad58-499e-b8b7-1e1ca2b0514b tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7/action" status: 202 len: 0 microversion: 2.1 time: 0.212395 Jul 25 14:27:58.342892 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 434/844] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:27:58 2022] POST /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:27:58.349487 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bf6f9062-b49d-450e-8de9-5881fab96c30 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:58.351135 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bf6f9062-b49d-450e-8de9-5881fab96c30 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:58.361633 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bf6f9062-b49d-450e-8de9-5881fab96c30 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:58.362425 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bf6f9062-b49d-450e-8de9-5881fab96c30 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:58.363547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bf6f9062-b49d-450e-8de9-5881fab96c30 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:58.364197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bf6f9062-b49d-450e-8de9-5881fab96c30 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:58.813092 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bf6f9062-b49d-450e-8de9-5881fab96c30 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:58.836252 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bf6f9062-b49d-450e-8de9-5881fab96c30 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1472 microversion: 2.1 time: 0.487254 Jul 25 14:27:58.846956 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 435/845] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:58 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1472 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:58.861233 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e2f145d3-dd62-4c4d-b8a2-674b93bfe904 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:58.862311 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e2f145d3-dd62-4c4d-b8a2-674b93bfe904 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:58.882286 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2f145d3-dd62-4c4d-b8a2-674b93bfe904 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:58.883841 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2f145d3-dd62-4c4d-b8a2-674b93bfe904 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:58.885372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2f145d3-dd62-4c4d-b8a2-674b93bfe904 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:58.885970 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2f145d3-dd62-4c4d-b8a2-674b93bfe904 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:59.181747 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e2f145d3-dd62-4c4d-b8a2-674b93bfe904 tempest-ServersAdminTestJSON-1833323898 tempest-ServersAdminTestJSON-1833323898-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1616 microversion: 2.1 time: 0.333046 Jul 25 14:27:59.182349 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 436/846] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:58 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1616 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:59.192297 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5bbcf1ea-1e6e-4b57-ba82-3850146a5a96 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:59.192297 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5bbcf1ea-1e6e-4b57-ba82-3850146a5a96 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 3b44e25a-9b18-4ee6-b084-32f9e4f7e881] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:59.192645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:27:59.212598 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5bbcf1ea-1e6e-4b57-ba82-3850146a5a96 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:59.213258 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5bbcf1ea-1e6e-4b57-ba82-3850146a5a96 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:59.214040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5bbcf1ea-1e6e-4b57-ba82-3850146a5a96 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:59.214598 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5bbcf1ea-1e6e-4b57-ba82-3850146a5a96 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:59.303899 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-da2370de-64f7-40d8-8d45-fb4376d5b901 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:59.314693 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-da2370de-64f7-40d8-8d45-fb4376d5b901 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a" status: 200 len: 1465 microversion: 2.1 time: 1.212029 Jul 25 14:27:59.326007 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 411/847] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:58 2022] GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a => generated 1465 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:59.349470 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-47173ab1-c833-4834-845e-1e8fb9379e27 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:59.359198 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-47173ab1-c833-4834-845e-1e8fb9379e27 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: 10a339c9-ca8c-403d-bb81-4aef27960efd] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:59.377207 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-47173ab1-c833-4834-845e-1e8fb9379e27 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:59.377207 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-47173ab1-c833-4834-845e-1e8fb9379e27 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:59.377207 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-47173ab1-c833-4834-845e-1e8fb9379e27 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:59.377836 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-47173ab1-c833-4834-845e-1e8fb9379e27 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:59.772002 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5bbcf1ea-1e6e-4b57-ba82-3850146a5a96 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:27:59.799962 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5bbcf1ea-1e6e-4b57-ba82-3850146a5a96 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881" status: 200 len: 1324 microversion: 2.1 time: 0.614940 Jul 25 14:27:59.805627 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 437/848] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:59 2022] GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881 => generated 1324 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:27:59.827959 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-50a28297-bbba-4205-9501-88574adc3c22 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:27:59.830933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-50a28297-bbba-4205-9501-88574adc3c22 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:27:59.849163 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50a28297-bbba-4205-9501-88574adc3c22 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:59.851076 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50a28297-bbba-4205-9501-88574adc3c22 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:27:59.854154 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50a28297-bbba-4205-9501-88574adc3c22 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:27:59.854632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50a28297-bbba-4205-9501-88574adc3c22 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:00.060259 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-47173ab1-c833-4834-845e-1e8fb9379e27 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:00.069753 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-47173ab1-c833-4834-845e-1e8fb9379e27 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd" status: 200 len: 1467 microversion: 2.1 time: 0.740341 Jul 25 14:28:00.076314 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-50a28297-bbba-4205-9501-88574adc3c22 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:00.078121 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 412/849] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:27:59 2022] GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd => generated 1467 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:00.092945 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-50a28297-bbba-4205-9501-88574adc3c22 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:00.094870 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-50a28297-bbba-4205-9501-88574adc3c22 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:00.096246 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-50a28297-bbba-4205-9501-88574adc3c22 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 200 len: 1361 microversion: 2.25 time: 0.289493 Jul 25 14:28:00.097616 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 438/850] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:27:59 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 1361 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:00.100452 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-43e4b01f-ee81-4e74-803b-5c2c595b11b3 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:00.105247 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-43e4b01f-ee81-4e74-803b-5c2c595b11b3 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: 2ba0512b-a92a-404a-9bc1-ffc024d92740] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:00.112917 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4c536ce8-8d04-439b-933a-47a26a39a7cc tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:00.115750 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4c536ce8-8d04-439b-933a-47a26a39a7cc tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:00.120179 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43e4b01f-ee81-4e74-803b-5c2c595b11b3 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:00.124492 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43e4b01f-ee81-4e74-803b-5c2c595b11b3 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:00.125656 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43e4b01f-ee81-4e74-803b-5c2c595b11b3 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:00.127279 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43e4b01f-ee81-4e74-803b-5c2c595b11b3 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:00.135866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4c536ce8-8d04-439b-933a-47a26a39a7cc tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:00.136678 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4c536ce8-8d04-439b-933a-47a26a39a7cc tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:00.137689 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4c536ce8-8d04-439b-933a-47a26a39a7cc tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:00.138309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4c536ce8-8d04-439b-933a-47a26a39a7cc tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:00.179163 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-43e4b01f-ee81-4e74-803b-5c2c595b11b3 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: 2ba0512b-a92a-404a-9bc1-ffc024d92740] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:28:00.336669 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-43e4b01f-ee81-4e74-803b-5c2c595b11b3 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "DELETE /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740" status: 204 len: 0 microversion: 2.1 time: 0.257077 Jul 25 14:28:00.338314 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 413/851] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:28:00 2022] DELETE /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:28:00.349504 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6378c12a-efab-41d0-9583-cdb0d5597100 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:00.351598 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6378c12a-efab-41d0-9583-cdb0d5597100 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: 6805171d-8f8d-4694-ab4a-2875d20b0d2a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:00.363644 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6378c12a-efab-41d0-9583-cdb0d5597100 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:00.365124 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6378c12a-efab-41d0-9583-cdb0d5597100 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:00.368667 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6378c12a-efab-41d0-9583-cdb0d5597100 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:00.369161 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6378c12a-efab-41d0-9583-cdb0d5597100 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:00.381498 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4c536ce8-8d04-439b-933a-47a26a39a7cc tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:00.391343 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4c536ce8-8d04-439b-933a-47a26a39a7cc tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1472 microversion: 2.1 time: 0.292239 Jul 25 14:28:00.391932 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 439/852] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:00 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1472 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:00.398211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-85a76882-415b-4679-a3c3-860e83000c14 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:00.402635 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-85a76882-415b-4679-a3c3-860e83000c14 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: 2ba0512b-a92a-404a-9bc1-ffc024d92740] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:00.417223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-85a76882-415b-4679-a3c3-860e83000c14 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:00.417679 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-85a76882-415b-4679-a3c3-860e83000c14 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:00.418846 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-85a76882-415b-4679-a3c3-860e83000c14 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:00.419305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-85a76882-415b-4679-a3c3-860e83000c14 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:00.627306 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-85a76882-415b-4679-a3c3-860e83000c14 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:00.639592 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-85a76882-415b-4679-a3c3-860e83000c14 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740" status: 200 len: 1470 microversion: 2.1 time: 0.245185 Jul 25 14:28:00.652951 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 440/853] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:00 2022] GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740 => generated 1470 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:00.724726 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-fdea7a7a-a04f-40fe-8ddc-7ac1c624d00d req-71f2092a-5124-4c2e-a79d-b22167877996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c25476ab-b697-45f9-aa22-ead2d1b23fc7", "name": "network-vif-plugged", "status": "completed", "tag": "c69d5fca-fc3b-4290-b9b5-09a0bbddbbc9"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:00.735156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-fdea7a7a-a04f-40fe-8ddc-7ac1c624d00d req-71f2092a-5124-4c2e-a79d-b22167877996 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:00.735600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-fdea7a7a-a04f-40fe-8ddc-7ac1c624d00d req-71f2092a-5124-4c2e-a79d-b22167877996 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:00.764158 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-fdea7a7a-a04f-40fe-8ddc-7ac1c624d00d req-71f2092a-5124-4c2e-a79d-b22167877996 service nova] Creating event network-vif-plugged:c69d5fca-fc3b-4290-b9b5-09a0bbddbbc9 for instance c25476ab-b697-45f9-aa22-ead2d1b23fc7 on n-h1-846435-14 Jul 25 14:28:00.771955 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-fdea7a7a-a04f-40fe-8ddc-7ac1c624d00d req-71f2092a-5124-4c2e-a79d-b22167877996 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051086 Jul 25 14:28:00.772904 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 441/854] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:28:00.816548 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6378c12a-efab-41d0-9583-cdb0d5597100 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:00.827703 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6378c12a-efab-41d0-9583-cdb0d5597100 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a" status: 200 len: 1465 microversion: 2.1 time: 0.484948 Jul 25 14:28:00.828502 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 414/855] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:00 2022] GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a => generated 1465 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:00.829684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ee80c607-0bac-4ae4-b53c-17918c7af4fc tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:00.830571 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ee80c607-0bac-4ae4-b53c-17918c7af4fc tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 3b44e25a-9b18-4ee6-b084-32f9e4f7e881] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:00.838704 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee80c607-0bac-4ae4-b53c-17918c7af4fc tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:00.844825 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee80c607-0bac-4ae4-b53c-17918c7af4fc tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:00.845941 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee80c607-0bac-4ae4-b53c-17918c7af4fc tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:00.846382 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee80c607-0bac-4ae4-b53c-17918c7af4fc tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:01.098982 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d7a9df9b-07b5-4006-a9b2-7db808eb9673 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:01.099604 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d7a9df9b-07b5-4006-a9b2-7db808eb9673 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: 10a339c9-ca8c-403d-bb81-4aef27960efd] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:01.123456 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d7a9df9b-07b5-4006-a9b2-7db808eb9673 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:01.123916 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d7a9df9b-07b5-4006-a9b2-7db808eb9673 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:01.124788 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d7a9df9b-07b5-4006-a9b2-7db808eb9673 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:01.141938 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d7a9df9b-07b5-4006-a9b2-7db808eb9673 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:01.145169 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ee80c607-0bac-4ae4-b53c-17918c7af4fc tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:01.159003 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ee80c607-0bac-4ae4-b53c-17918c7af4fc tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881" status: 200 len: 1324 microversion: 2.1 time: 0.331268 Jul 25 14:28:01.161132 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 442/856] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:00 2022] GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881 => generated 1324 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:28:01.173553 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-66e8ed62-b20a-4cd4-b7bb-d1a8b0d99868 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:01.174398 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-66e8ed62-b20a-4cd4-b7bb-d1a8b0d99868 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:01.202014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-66e8ed62-b20a-4cd4-b7bb-d1a8b0d99868 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:01.204240 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-66e8ed62-b20a-4cd4-b7bb-d1a8b0d99868 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:01.205382 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-66e8ed62-b20a-4cd4-b7bb-d1a8b0d99868 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:01.208588 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-66e8ed62-b20a-4cd4-b7bb-d1a8b0d99868 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:01.305509 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d7a9df9b-07b5-4006-a9b2-7db808eb9673 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:01.315238 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d7a9df9b-07b5-4006-a9b2-7db808eb9673 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd" status: 200 len: 1425 microversion: 2.1 time: 0.220287 Jul 25 14:28:01.332783 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 415/857] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:01 2022] GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd => generated 1425 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:28:01.343370 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-aded876a-7db5-47bb-bbfa-eae3557c3274 req-39b4db08-3bbc-41c6-961a-8d52ca43cd1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10a339c9-ca8c-403d-bb81-4aef27960efd", "name": "network-vif-deleted", "tag": "f37b672e-6ac4-490d-a461-bc2d062ec5c4"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:01.356802 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-aded876a-7db5-47bb-bbfa-eae3557c3274 req-39b4db08-3bbc-41c6-961a-8d52ca43cd1f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:01.358100 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-aded876a-7db5-47bb-bbfa-eae3557c3274 req-39b4db08-3bbc-41c6-961a-8d52ca43cd1f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:01.378019 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-aded876a-7db5-47bb-bbfa-eae3557c3274 req-39b4db08-3bbc-41c6-961a-8d52ca43cd1f service nova] Creating event network-vif-deleted:f37b672e-6ac4-490d-a461-bc2d062ec5c4 for instance 10a339c9-ca8c-403d-bb81-4aef27960efd on n-h1-846435-14 Jul 25 14:28:01.389573 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-aded876a-7db5-47bb-bbfa-eae3557c3274 req-39b4db08-3bbc-41c6-961a-8d52ca43cd1f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054945 Jul 25 14:28:01.390944 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 416/858] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:01.413374 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5c46d5a4-4cf7-436b-94ab-bd88d1bb1113 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:01.414230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5c46d5a4-4cf7-436b-94ab-bd88d1bb1113 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:01.426689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5c46d5a4-4cf7-436b-94ab-bd88d1bb1113 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:01.427817 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5c46d5a4-4cf7-436b-94ab-bd88d1bb1113 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:01.429420 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5c46d5a4-4cf7-436b-94ab-bd88d1bb1113 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:01.430034 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5c46d5a4-4cf7-436b-94ab-bd88d1bb1113 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:01.697438 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5c46d5a4-4cf7-436b-94ab-bd88d1bb1113 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:01.705960 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5c46d5a4-4cf7-436b-94ab-bd88d1bb1113 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1472 microversion: 2.1 time: 0.296853 Jul 25 14:28:01.726004 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 417/859] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:01 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1472 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:28:01.731423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0f6bbeb4-463b-4bf1-b2b7-26294b32dde5 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:01.744081 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0f6bbeb4-463b-4bf1-b2b7-26294b32dde5 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: 2ba0512b-a92a-404a-9bc1-ffc024d92740] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:01.757133 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f6bbeb4-463b-4bf1-b2b7-26294b32dde5 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:01.761793 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f6bbeb4-463b-4bf1-b2b7-26294b32dde5 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:01.762619 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f6bbeb4-463b-4bf1-b2b7-26294b32dde5 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:01.763850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f6bbeb4-463b-4bf1-b2b7-26294b32dde5 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:01.767381 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-66e8ed62-b20a-4cd4-b7bb-d1a8b0d99868 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:01.777151 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-66e8ed62-b20a-4cd4-b7bb-d1a8b0d99868 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:01.779767 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-66e8ed62-b20a-4cd4-b7bb-d1a8b0d99868 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:01.781265 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-66e8ed62-b20a-4cd4-b7bb-d1a8b0d99868 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 200 len: 1361 microversion: 2.25 time: 0.617589 Jul 25 14:28:01.797686 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 443/860] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:01 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 1361 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:01.857296 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8d178ad5-8807-4b6a-8444-d2fd06a7c8ab tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:01.859078 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8d178ad5-8807-4b6a-8444-d2fd06a7c8ab tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: 6805171d-8f8d-4694-ab4a-2875d20b0d2a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:01.868684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d178ad5-8807-4b6a-8444-d2fd06a7c8ab tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:01.870406 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d178ad5-8807-4b6a-8444-d2fd06a7c8ab tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:01.871959 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d178ad5-8807-4b6a-8444-d2fd06a7c8ab tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:01.872796 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d178ad5-8807-4b6a-8444-d2fd06a7c8ab tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:01.923921 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d178ad5-8807-4b6a-8444-d2fd06a7c8ab tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:01.924645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d178ad5-8807-4b6a-8444-d2fd06a7c8ab tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:01.925243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-8d178ad5-8807-4b6a-8444-d2fd06a7c8ab tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lazy-loading 'fault' on Instance uuid 6805171d-8f8d-4694-ab4a-2875d20b0d2a {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:28:02.029469 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8d178ad5-8807-4b6a-8444-d2fd06a7c8ab tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:02.043650 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8d178ad5-8807-4b6a-8444-d2fd06a7c8ab tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a" status: 200 len: 1308 microversion: 2.1 time: 0.192090 Jul 25 14:28:02.045685 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 444/861] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:01 2022] GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a => generated 1308 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:02.137951 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0f6bbeb4-463b-4bf1-b2b7-26294b32dde5 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:02.147563 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0f6bbeb4-463b-4bf1-b2b7-26294b32dde5 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740" status: 200 len: 1470 microversion: 2.1 time: 0.420063 Jul 25 14:28:02.148713 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 418/862] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:01 2022] GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740 => generated 1470 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:02.183052 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-220528fa-5675-4f99-8f5a-b26fbe84a2b8 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:02.184065 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-220528fa-5675-4f99-8f5a-b26fbe84a2b8 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 3b44e25a-9b18-4ee6-b084-32f9e4f7e881] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:02.191164 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-220528fa-5675-4f99-8f5a-b26fbe84a2b8 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:02.192116 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-220528fa-5675-4f99-8f5a-b26fbe84a2b8 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:02.193365 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-220528fa-5675-4f99-8f5a-b26fbe84a2b8 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:02.193898 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-220528fa-5675-4f99-8f5a-b26fbe84a2b8 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:02.339514 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d99c0992-fa54-48bd-a751-e48a47652e45 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:02.340394 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d99c0992-fa54-48bd-a751-e48a47652e45 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: 10a339c9-ca8c-403d-bb81-4aef27960efd] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:02.352007 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-220528fa-5675-4f99-8f5a-b26fbe84a2b8 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:02.352269 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d99c0992-fa54-48bd-a751-e48a47652e45 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:02.358158 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d99c0992-fa54-48bd-a751-e48a47652e45 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:02.359184 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d99c0992-fa54-48bd-a751-e48a47652e45 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:02.359936 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d99c0992-fa54-48bd-a751-e48a47652e45 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:02.360630 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-220528fa-5675-4f99-8f5a-b26fbe84a2b8 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881" status: 200 len: 1324 microversion: 2.1 time: 0.182085 Jul 25 14:28:02.364032 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 445/863] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:02 2022] GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881 => generated 1324 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:02.416779 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d99c0992-fa54-48bd-a751-e48a47652e45 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:02.417706 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d99c0992-fa54-48bd-a751-e48a47652e45 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:02.419135 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-d99c0992-fa54-48bd-a751-e48a47652e45 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lazy-loading 'fault' on Instance uuid 10a339c9-ca8c-403d-bb81-4aef27960efd {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:28:02.425349 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:28:02.517211 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d99c0992-fa54-48bd-a751-e48a47652e45 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:02.525587 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d99c0992-fa54-48bd-a751-e48a47652e45 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd" status: 200 len: 1311 microversion: 2.1 time: 0.190730 Jul 25 14:28:02.526652 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 419/864] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:02 2022] GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd => generated 1311 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:28:02.727462 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f1a76a9c-1a77-490e-86db-bb551cc6d7cd tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:02.729212 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f1a76a9c-1a77-490e-86db-bb551cc6d7cd tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:02.738213 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f1a76a9c-1a77-490e-86db-bb551cc6d7cd tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:02.739258 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f1a76a9c-1a77-490e-86db-bb551cc6d7cd tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:02.740557 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f1a76a9c-1a77-490e-86db-bb551cc6d7cd tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:02.742322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f1a76a9c-1a77-490e-86db-bb551cc6d7cd tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:02.788221 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-5997bf94-4e4a-449a-8750-80673db2a481 req-f30b61ca-e56a-4586-b4c7-36bcc28b12c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3d2010c-4e0c-412e-9b66-8fbac6510097", "name": "network-vif-plugged", "status": "completed", "tag": "520cf9de-1166-4382-a12f-5e27acc8c55e"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:02.805004 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-5997bf94-4e4a-449a-8750-80673db2a481 req-f30b61ca-e56a-4586-b4c7-36bcc28b12c5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:02.805826 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-5997bf94-4e4a-449a-8750-80673db2a481 req-f30b61ca-e56a-4586-b4c7-36bcc28b12c5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:02.823806 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-5997bf94-4e4a-449a-8750-80673db2a481 req-f30b61ca-e56a-4586-b4c7-36bcc28b12c5 service nova] Creating event network-vif-plugged:520cf9de-1166-4382-a12f-5e27acc8c55e for instance b3d2010c-4e0c-412e-9b66-8fbac6510097 on n-h2-846435-14 Jul 25 14:28:02.829244 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-5997bf94-4e4a-449a-8750-80673db2a481 req-f30b61ca-e56a-4586-b4c7-36bcc28b12c5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045244 Jul 25 14:28:02.830494 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 420/865] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:28:02.836196 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d827c45c-3bab-47ae-beb2-f50f8e94ea1c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:02.836979 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d827c45c-3bab-47ae-beb2-f50f8e94ea1c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:02.873470 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d827c45c-3bab-47ae-beb2-f50f8e94ea1c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:02.880297 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d827c45c-3bab-47ae-beb2-f50f8e94ea1c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:02.881667 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d827c45c-3bab-47ae-beb2-f50f8e94ea1c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:02.882150 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d827c45c-3bab-47ae-beb2-f50f8e94ea1c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:02.917207 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f1a76a9c-1a77-490e-86db-bb551cc6d7cd tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:02.928488 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f1a76a9c-1a77-490e-86db-bb551cc6d7cd tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1477 microversion: 2.1 time: 0.204823 Jul 25 14:28:02.929624 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 446/866] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:02 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1477 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:03.066215 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-06ba5fd0-d893-4988-a614-2c63915d6989 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:03.067060 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-06ba5fd0-d893-4988-a614-2c63915d6989 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: 6805171d-8f8d-4694-ab4a-2875d20b0d2a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:03.083704 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-06ba5fd0-d893-4988-a614-2c63915d6989 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:03.084197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-06ba5fd0-d893-4988-a614-2c63915d6989 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:03.084983 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-06ba5fd0-d893-4988-a614-2c63915d6989 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:03.085427 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-06ba5fd0-d893-4988-a614-2c63915d6989 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:03.101295 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-06ba5fd0-d893-4988-a614-2c63915d6989 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] HTTP exception thrown: Instance 6805171d-8f8d-4694-ab4a-2875d20b0d2a could not be found. Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-06ba5fd0-d893-4988-a614-2c63915d6989 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Request method failure captured: Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a HTTP/1.1 Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qg0JytHg_5gL4yn4EPj2Ia85Dizg_c4Mlw86p7T4Dptzsr__TUjT_b0CdRUxSabFQzFuVtuqNrYOiT6b5iysTUe91fBb_vqDoCI08DS5TyI57g-0GPmBFeXbO9WEQ5ir9TloZzE10OWgVtKsCZHbzovCV15woejgpqh1DyvpnHuAF4 Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: f07a43cd116847b6816581adfeed8f9b Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-LiveMigrationNegativeTest-1958345919 Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f07a43cd116847b6816581adfeed8f9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f07a43cd116847b6816581adfeed8f9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f07a43cd116847b6816581adfeed8f9b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f07a43cd116847b6816581adfeed8f9b"}]}] Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-LiveMigrationNegativeTest-1958345919 Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: f07a43cd116847b6816581adfeed8f9b Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1958345919 Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-LiveMigrationNegativeTest-1958345919-project Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 6976261712c44d37821f95e1f482de72 Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-LiveMigrationNegativeTest-1958345919-project Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 6805171d-8f8d-4694-ab4a-2875d20b0d2a could not be found. Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '6805171d-8f8d-4694-ab4a-2875d20b0d2a'} Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6805171d-8f8d-4694-ab4a-2875d20b0d2a could not be found. Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6805171d-8f8d-4694-ab4a-2875d20b0d2a could not be found. Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:03.103310 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:03.107495 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:03.107495 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:03.107495 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:03.107495 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:28:03.107495 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:28:03.107495 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6805171d-8f8d-4694-ab4a-2875d20b0d2a could not be found. Jul 25 14:28:03.107495 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:03.109455 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-06ba5fd0-d893-4988-a614-2c63915d6989 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Returning 404 to user: Instance 6805171d-8f8d-4694-ab4a-2875d20b0d2a could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:28:03.110550 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-06ba5fd0-d893-4988-a614-2c63915d6989 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a" status: 404 len: 111 microversion: 2.1 time: 0.048661 Jul 25 14:28:03.111447 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 447/867] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:03 2022] GET /compute/v2.1/servers/6805171d-8f8d-4694-ab4a-2875d20b0d2a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:28:03.123428 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-600e3372-99c6-47d5-a41d-d2cb6005dab3 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:03.124305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-600e3372-99c6-47d5-a41d-d2cb6005dab3 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: b6ed0cc6-bfeb-4148-a017-69d0eedad83e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:03.130967 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-600e3372-99c6-47d5-a41d-d2cb6005dab3 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:03.131775 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-600e3372-99c6-47d5-a41d-d2cb6005dab3 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:03.132797 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-600e3372-99c6-47d5-a41d-d2cb6005dab3 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:03.133535 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-600e3372-99c6-47d5-a41d-d2cb6005dab3 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:03.172293 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-600e3372-99c6-47d5-a41d-d2cb6005dab3 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: b6ed0cc6-bfeb-4148-a017-69d0eedad83e] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:28:03.241584 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d827c45c-3bab-47ae-beb2-f50f8e94ea1c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:03.251145 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d827c45c-3bab-47ae-beb2-f50f8e94ea1c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:03.252791 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d827c45c-3bab-47ae-beb2-f50f8e94ea1c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:03.254002 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d827c45c-3bab-47ae-beb2-f50f8e94ea1c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 200 len: 1361 microversion: 2.25 time: 0.422291 Jul 25 14:28:03.268805 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 421/868] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:02 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 1361 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:03.274916 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6e533e7a-4a22-4bf8-96e8-e925985f585b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:03.275576 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6e533e7a-4a22-4bf8-96e8-e925985f585b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: 2ba0512b-a92a-404a-9bc1-ffc024d92740] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:03.283110 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e533e7a-4a22-4bf8-96e8-e925985f585b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:03.283110 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e533e7a-4a22-4bf8-96e8-e925985f585b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:03.283849 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e533e7a-4a22-4bf8-96e8-e925985f585b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:03.284376 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e533e7a-4a22-4bf8-96e8-e925985f585b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:03.288415 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-600e3372-99c6-47d5-a41d-d2cb6005dab3 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e" status: 204 len: 0 microversion: 2.1 time: 0.168485 Jul 25 14:28:03.296918 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 448/869] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:28:03 2022] DELETE /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:28:03.304974 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a1979438-795a-4e67-86db-bb233894b5b3 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:03.305924 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a1979438-795a-4e67-86db-bb233894b5b3 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: b6ed0cc6-bfeb-4148-a017-69d0eedad83e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:03.316053 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1979438-795a-4e67-86db-bb233894b5b3 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:03.316504 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1979438-795a-4e67-86db-bb233894b5b3 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:03.317292 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1979438-795a-4e67-86db-bb233894b5b3 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:03.317726 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1979438-795a-4e67-86db-bb233894b5b3 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:03.335478 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e533e7a-4a22-4bf8-96e8-e925985f585b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:03.335930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e533e7a-4a22-4bf8-96e8-e925985f585b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:03.336423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-6e533e7a-4a22-4bf8-96e8-e925985f585b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lazy-loading 'fault' on Instance uuid 2ba0512b-a92a-404a-9bc1-ffc024d92740 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:28:03.350155 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:28:03.386013 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6e533e7a-4a22-4bf8-96e8-e925985f585b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:03.395483 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6e533e7a-4a22-4bf8-96e8-e925985f585b tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740" status: 200 len: 1304 microversion: 2.1 time: 0.125394 Jul 25 14:28:03.408002 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 422/870] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:03 2022] GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740 => generated 1304 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:03.414164 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-559da475-5132-4a1b-915e-cd55e38a9df0 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:03.414793 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-559da475-5132-4a1b-915e-cd55e38a9df0 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 3b44e25a-9b18-4ee6-b084-32f9e4f7e881] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:03.432865 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-559da475-5132-4a1b-915e-cd55e38a9df0 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:03.433793 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-559da475-5132-4a1b-915e-cd55e38a9df0 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:03.438085 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-559da475-5132-4a1b-915e-cd55e38a9df0 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:03.438728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-559da475-5132-4a1b-915e-cd55e38a9df0 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:03.509817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a1979438-795a-4e67-86db-bb233894b5b3 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:03.519761 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a1979438-795a-4e67-86db-bb233894b5b3 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e" status: 200 len: 1475 microversion: 2.1 time: 0.221296 Jul 25 14:28:03.525298 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 449/871] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:03 2022] GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e => generated 1475 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:03.530533 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-ebc50576-6336-4ded-bdb3-b9c3bae8b8b1 req-44b1095c-ee3d-49ea-bcd6-e12d5890c2ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6805171d-8f8d-4694-ab4a-2875d20b0d2a", "name": "network-vif-deleted", "tag": "c0ef8191-2d08-4d3f-90f7-ebf1eb92fcad"}, {"server_uuid": "2ba0512b-a92a-404a-9bc1-ffc024d92740", "name": "network-vif-deleted", "tag": "b5d4e3ed-ac59-4af0-ae86-32099aa20f97"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:03.560933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ebc50576-6336-4ded-bdb3-b9c3bae8b8b1 req-44b1095c-ee3d-49ea-bcd6-e12d5890c2ff service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:03.562673 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ebc50576-6336-4ded-bdb3-b9c3bae8b8b1 req-44b1095c-ee3d-49ea-bcd6-e12d5890c2ff service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:03.579280 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-ebc50576-6336-4ded-bdb3-b9c3bae8b8b1 req-44b1095c-ee3d-49ea-bcd6-e12d5890c2ff service nova] Creating event network-vif-deleted:c0ef8191-2d08-4d3f-90f7-ebf1eb92fcad for instance 6805171d-8f8d-4694-ab4a-2875d20b0d2a on n-h2-846435-14 Jul 25 14:28:03.579826 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-ebc50576-6336-4ded-bdb3-b9c3bae8b8b1 req-44b1095c-ee3d-49ea-bcd6-e12d5890c2ff service nova] Creating event network-vif-deleted:b5d4e3ed-ac59-4af0-ae86-32099aa20f97 for instance 2ba0512b-a92a-404a-9bc1-ffc024d92740 on n-h1-846435-14 Jul 25 14:28:03.590134 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-ebc50576-6336-4ded-bdb3-b9c3bae8b8b1 req-44b1095c-ee3d-49ea-bcd6-e12d5890c2ff service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.063296 Jul 25 14:28:03.594090 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 450/872] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:03.600132 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5e083f58-d64c-4947-8cfa-74db552fd461 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:03.600840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5e083f58-d64c-4947-8cfa-74db552fd461 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: 10a339c9-ca8c-403d-bb81-4aef27960efd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:03.611290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5e083f58-d64c-4947-8cfa-74db552fd461 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:03.612218 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5e083f58-d64c-4947-8cfa-74db552fd461 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:03.613163 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5e083f58-d64c-4947-8cfa-74db552fd461 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:03.613593 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5e083f58-d64c-4947-8cfa-74db552fd461 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:03.639782 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-5e083f58-d64c-4947-8cfa-74db552fd461 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] HTTP exception thrown: Instance 10a339c9-ca8c-403d-bb81-4aef27960efd could not be found. Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5e083f58-d64c-4947-8cfa-74db552fd461 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Request method failure captured: Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd HTTP/1.1 Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qg6DiqyC33XPnlixA23ZuJy02RDFh3vKg6O09Q6vuvTzgxr4OiNxn9S0rtZ1OYnrgCuKmKnpSZjYw7inFVSIwiUKVKJ0mq1S51i4dB7mYB6VWnz1-HE4NBQO9jKp3TVWEi5VnCA8gKl1TBHdeCsZVcaKL8d3jT42SaLSdceHh8PTCw Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 327a5b80b3404191ae269afa882d3753 Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-708891928 Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/327a5b80b3404191ae269afa882d3753"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/327a5b80b3404191ae269afa882d3753"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_327a5b80b3404191ae269afa882d3753", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/327a5b80b3404191ae269afa882d3753"}]}] Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersAdminNegativeTestJSON-708891928 Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 327a5b80b3404191ae269afa882d3753 Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-708891928 Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersAdminNegativeTestJSON-708891928-project Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 0334859a0fd544b3b4064ca188a22d32 Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersAdminNegativeTestJSON-708891928-project Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 10a339c9-ca8c-403d-bb81-4aef27960efd could not be found. Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '10a339c9-ca8c-403d-bb81-4aef27960efd'} Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10a339c9-ca8c-403d-bb81-4aef27960efd could not be found. Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10a339c9-ca8c-403d-bb81-4aef27960efd could not be found. Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:03.641722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:03.645621 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:03.645621 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:03.645621 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:03.645621 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:28:03.645621 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:28:03.645621 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10a339c9-ca8c-403d-bb81-4aef27960efd could not be found. Jul 25 14:28:03.645621 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:03.645621 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5e083f58-d64c-4947-8cfa-74db552fd461 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Returning 404 to user: Instance 10a339c9-ca8c-403d-bb81-4aef27960efd could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:28:03.645621 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5e083f58-d64c-4947-8cfa-74db552fd461 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd" status: 404 len: 111 microversion: 2.1 time: 0.047869 Jul 25 14:28:03.645621 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 451/873] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:03 2022] GET /compute/v2.1/servers/10a339c9-ca8c-403d-bb81-4aef27960efd => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:28:03.651863 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a683cab2-2119-47c4-ad46-06927c0a1349 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:03.652379 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a683cab2-2119-47c4-ad46-06927c0a1349 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: c2ea60b9-dff6-4ee9-8004-680327fa2f96] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:03.658609 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a683cab2-2119-47c4-ad46-06927c0a1349 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:03.658914 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-559da475-5132-4a1b-915e-cd55e38a9df0 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:03.659056 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a683cab2-2119-47c4-ad46-06927c0a1349 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:03.659804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a683cab2-2119-47c4-ad46-06927c0a1349 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:03.661447 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a683cab2-2119-47c4-ad46-06927c0a1349 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:03.668033 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-559da475-5132-4a1b-915e-cd55e38a9df0 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881" status: 200 len: 1324 microversion: 2.1 time: 0.265885 Jul 25 14:28:03.669008 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 423/874] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:03 2022] GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881 => generated 1324 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:03.699208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a683cab2-2119-47c4-ad46-06927c0a1349 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: c2ea60b9-dff6-4ee9-8004-680327fa2f96] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:28:03.785981 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a683cab2-2119-47c4-ad46-06927c0a1349 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96" status: 204 len: 0 microversion: 2.1 time: 0.137083 Jul 25 14:28:03.786989 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 452/875] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:28:03 2022] DELETE /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:28:03.796246 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d3789f8b-6342-42f6-802c-93b8b025ce8d tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:03.797056 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d3789f8b-6342-42f6-802c-93b8b025ce8d tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: c2ea60b9-dff6-4ee9-8004-680327fa2f96] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:03.803319 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d3789f8b-6342-42f6-802c-93b8b025ce8d tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:03.803860 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d3789f8b-6342-42f6-802c-93b8b025ce8d tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:03.804728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d3789f8b-6342-42f6-802c-93b8b025ce8d tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:03.805228 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d3789f8b-6342-42f6-802c-93b8b025ce8d tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:03.938143 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d3789f8b-6342-42f6-802c-93b8b025ce8d tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:03.946636 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d3789f8b-6342-42f6-802c-93b8b025ce8d tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96" status: 200 len: 1476 microversion: 2.1 time: 0.154301 Jul 25 14:28:03.947371 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 424/876] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:03 2022] GET /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96 => generated 1476 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:03.951865 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-adbf5092-415b-4a87-9c5b-c49080f037e7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:03.952685 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-adbf5092-415b-4a87-9c5b-c49080f037e7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:03.959828 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-adbf5092-415b-4a87-9c5b-c49080f037e7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:03.960426 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-adbf5092-415b-4a87-9c5b-c49080f037e7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:03.961302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-adbf5092-415b-4a87-9c5b-c49080f037e7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:03.961795 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-adbf5092-415b-4a87-9c5b-c49080f037e7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:04.103438 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-adbf5092-415b-4a87-9c5b-c49080f037e7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:04.111421 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-adbf5092-415b-4a87-9c5b-c49080f037e7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1477 microversion: 2.1 time: 0.165200 Jul 25 14:28:04.112265 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 453/877] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:03 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1477 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:28:04.280292 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-89506ac7-ea03-43f3-acde-3f9f3e609e1e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:04.281055 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-89506ac7-ea03-43f3-acde-3f9f3e609e1e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:04.287505 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89506ac7-ea03-43f3-acde-3f9f3e609e1e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:04.287967 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89506ac7-ea03-43f3-acde-3f9f3e609e1e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:04.289037 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89506ac7-ea03-43f3-acde-3f9f3e609e1e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:04.289589 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89506ac7-ea03-43f3-acde-3f9f3e609e1e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:04.419694 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-45c42149-b62b-4ad5-a50d-4b850c98c8d2 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:04.420616 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-45c42149-b62b-4ad5-a50d-4b850c98c8d2 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: 2ba0512b-a92a-404a-9bc1-ffc024d92740] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:04.427352 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45c42149-b62b-4ad5-a50d-4b850c98c8d2 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:04.427820 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45c42149-b62b-4ad5-a50d-4b850c98c8d2 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:04.432402 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45c42149-b62b-4ad5-a50d-4b850c98c8d2 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:04.432402 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45c42149-b62b-4ad5-a50d-4b850c98c8d2 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:04.432732 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-89506ac7-ea03-43f3-acde-3f9f3e609e1e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:04.443351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-89506ac7-ea03-43f3-acde-3f9f3e609e1e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:04.444881 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-89506ac7-ea03-43f3-acde-3f9f3e609e1e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:04.445787 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-45c42149-b62b-4ad5-a50d-4b850c98c8d2 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] HTTP exception thrown: Instance 2ba0512b-a92a-404a-9bc1-ffc024d92740 could not be found. Jul 25 14:28:04.445989 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-89506ac7-ea03-43f3-acde-3f9f3e609e1e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 200 len: 1361 microversion: 2.25 time: 0.169811 Jul 25 14:28:04.446757 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 425/878] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:04 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-45c42149-b62b-4ad5-a50d-4b850c98c8d2 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Request method failure captured: Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740 HTTP/1.1 Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qf4yYofYzxTEXQNBTIEp-KcIRH20fLV2cxto8L1IFG0djUXS1dfY4Ty-tmC57NrV7MKbzocwYOVJgoUXS2GRjoaKQJtNb6dRkF78OYZfD0mNoZCJx4JiITR7kS73zJTrQ4OH0jhjJsipi4F0VJMbeIif4GqTOE6U0QTz8Mam2Wwx8M Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: e693063176af4ae1ae0942ab1b10dc73 Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersAdminTestJSON-1892283915 Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e693063176af4ae1ae0942ab1b10dc73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e693063176af4ae1ae0942ab1b10dc73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e693063176af4ae1ae0942ab1b10dc73", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e693063176af4ae1ae0942ab1b10dc73"}]}] Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersAdminTestJSON-1892283915 Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: e693063176af4ae1ae0942ab1b10dc73 Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersAdminTestJSON-1892283915 Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersAdminTestJSON-1892283915-project Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: f844b69077cc4ec087269cbb3db2f99e Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersAdminTestJSON-1892283915-project Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 2ba0512b-a92a-404a-9bc1-ffc024d92740 could not be found. Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '2ba0512b-a92a-404a-9bc1-ffc024d92740'} Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ba0512b-a92a-404a-9bc1-ffc024d92740 could not be found. Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ba0512b-a92a-404a-9bc1-ffc024d92740 could not be found. Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:04.447897 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:04.452420 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:04.452420 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:04.452420 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:04.452420 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:28:04.452420 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:28:04.452420 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ba0512b-a92a-404a-9bc1-ffc024d92740 could not be found. Jul 25 14:28:04.452420 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:04.452420 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-45c42149-b62b-4ad5-a50d-4b850c98c8d2 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Returning 404 to user: Instance 2ba0512b-a92a-404a-9bc1-ffc024d92740 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:28:04.452420 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-45c42149-b62b-4ad5-a50d-4b850c98c8d2 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740" status: 404 len: 111 microversion: 2.1 time: 0.034156 Jul 25 14:28:04.453048 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 454/879] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:04 2022] GET /compute/v2.1/servers/2ba0512b-a92a-404a-9bc1-ffc024d92740 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:28:04.461697 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ba14b694-aa02-49b0-99c5-2f09bda950e0 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:04.462449 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ba14b694-aa02-49b0-99c5-2f09bda950e0 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: b7018cc7-3f35-47d3-a679-30b828faedab] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:04.471906 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ba14b694-aa02-49b0-99c5-2f09bda950e0 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:04.472384 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ba14b694-aa02-49b0-99c5-2f09bda950e0 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:04.473158 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ba14b694-aa02-49b0-99c5-2f09bda950e0 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:04.473625 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ba14b694-aa02-49b0-99c5-2f09bda950e0 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:04.500472 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ba14b694-aa02-49b0-99c5-2f09bda950e0 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: b7018cc7-3f35-47d3-a679-30b828faedab] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:28:04.541591 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3f5a2f5a-e9a5-4bf3-a7b7-2230f22d15e4 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:04.542253 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3f5a2f5a-e9a5-4bf3-a7b7-2230f22d15e4 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: b6ed0cc6-bfeb-4148-a017-69d0eedad83e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:04.548739 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f5a2f5a-e9a5-4bf3-a7b7-2230f22d15e4 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:04.549187 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f5a2f5a-e9a5-4bf3-a7b7-2230f22d15e4 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:04.549974 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f5a2f5a-e9a5-4bf3-a7b7-2230f22d15e4 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:04.550393 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f5a2f5a-e9a5-4bf3-a7b7-2230f22d15e4 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:04.591122 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ba14b694-aa02-49b0-99c5-2f09bda950e0 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab" status: 204 len: 0 microversion: 2.1 time: 0.132299 Jul 25 14:28:04.592032 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 426/880] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:28:04 2022] DELETE /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:28:04.600694 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3ed7d379-b9ad-4961-8074-ba771b617b85 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:04.601502 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3ed7d379-b9ad-4961-8074-ba771b617b85 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: b7018cc7-3f35-47d3-a679-30b828faedab] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:04.610731 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3ed7d379-b9ad-4961-8074-ba771b617b85 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:04.611237 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3ed7d379-b9ad-4961-8074-ba771b617b85 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:04.612055 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3ed7d379-b9ad-4961-8074-ba771b617b85 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:04.612492 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3ed7d379-b9ad-4961-8074-ba771b617b85 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:04.703480 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3f5a2f5a-e9a5-4bf3-a7b7-2230f22d15e4 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:04.713031 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3f5a2f5a-e9a5-4bf3-a7b7-2230f22d15e4 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e" status: 200 len: 1475 microversion: 2.1 time: 0.175280 Jul 25 14:28:04.713883 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 455/881] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:04 2022] GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e => generated 1475 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:28:04.719529 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7c322024-bd9b-4e6b-80d0-5dbcc2d3582a tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:04.720376 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7c322024-bd9b-4e6b-80d0-5dbcc2d3582a tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 3b44e25a-9b18-4ee6-b084-32f9e4f7e881] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:04.727500 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7c322024-bd9b-4e6b-80d0-5dbcc2d3582a tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:04.728002 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7c322024-bd9b-4e6b-80d0-5dbcc2d3582a tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:04.728940 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7c322024-bd9b-4e6b-80d0-5dbcc2d3582a tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:04.729375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7c322024-bd9b-4e6b-80d0-5dbcc2d3582a tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:04.770209 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3ed7d379-b9ad-4961-8074-ba771b617b85 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:04.780629 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3ed7d379-b9ad-4961-8074-ba771b617b85 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab" status: 200 len: 1469 microversion: 2.1 time: 0.184302 Jul 25 14:28:04.781414 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 427/882] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:04 2022] GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab => generated 1469 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:04.857316 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-f28da695-eae2-4c23-af1b-f1e4a197c7eb req-5804d6f8-5fec-4d9d-91cc-1c436c17b879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b44e25a-9b18-4ee6-b084-32f9e4f7e881", "name": "network-vif-plugged", "status": "completed", "tag": "35ff58a9-4c79-467b-9c47-4078f588668b"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:04.866964 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f28da695-eae2-4c23-af1b-f1e4a197c7eb req-5804d6f8-5fec-4d9d-91cc-1c436c17b879 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:04.867412 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f28da695-eae2-4c23-af1b-f1e4a197c7eb req-5804d6f8-5fec-4d9d-91cc-1c436c17b879 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:04.882620 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-f28da695-eae2-4c23-af1b-f1e4a197c7eb req-5804d6f8-5fec-4d9d-91cc-1c436c17b879 service nova] Creating event network-vif-plugged:35ff58a9-4c79-467b-9c47-4078f588668b for instance 3b44e25a-9b18-4ee6-b084-32f9e4f7e881 on n-h1-846435-14 Jul 25 14:28:04.883400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7c322024-bd9b-4e6b-80d0-5dbcc2d3582a tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:04.887774 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-f28da695-eae2-4c23-af1b-f1e4a197c7eb req-5804d6f8-5fec-4d9d-91cc-1c436c17b879 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034183 Jul 25 14:28:04.888695 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 428/883] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:28:04.891665 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7c322024-bd9b-4e6b-80d0-5dbcc2d3582a tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881" status: 200 len: 1324 microversion: 2.1 time: 0.176780 Jul 25 14:28:04.892323 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 456/884] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:04 2022] GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881 => generated 1324 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:04.972595 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a428332c-d4fe-4fa7-a7fd-672ed133a106 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:04.973291 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a428332c-d4fe-4fa7-a7fd-672ed133a106 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: c2ea60b9-dff6-4ee9-8004-680327fa2f96] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:04.979715 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a428332c-d4fe-4fa7-a7fd-672ed133a106 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:04.980247 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a428332c-d4fe-4fa7-a7fd-672ed133a106 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:04.981023 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a428332c-d4fe-4fa7-a7fd-672ed133a106 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:04.981444 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a428332c-d4fe-4fa7-a7fd-672ed133a106 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:05.133625 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-edb7826e-01f2-45c6-9db5-c691e23914d6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:05.134229 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-edb7826e-01f2-45c6-9db5-c691e23914d6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:05.141056 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-edb7826e-01f2-45c6-9db5-c691e23914d6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:05.141729 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-edb7826e-01f2-45c6-9db5-c691e23914d6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:05.142697 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-edb7826e-01f2-45c6-9db5-c691e23914d6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:05.143286 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-edb7826e-01f2-45c6-9db5-c691e23914d6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:05.161125 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a428332c-d4fe-4fa7-a7fd-672ed133a106 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:05.173557 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a428332c-d4fe-4fa7-a7fd-672ed133a106 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96" status: 200 len: 1476 microversion: 2.1 time: 0.206513 Jul 25 14:28:05.174301 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 429/885] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:04 2022] GET /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96 => generated 1476 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:05.295246 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-edb7826e-01f2-45c6-9db5-c691e23914d6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:05.302959 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-edb7826e-01f2-45c6-9db5-c691e23914d6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1477 microversion: 2.1 time: 0.173223 Jul 25 14:28:05.303531 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 457/886] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:05 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1477 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:28:05.477765 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9f769639-3e52-4e39-af89-bc4aa7bff7fc tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:05.478571 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9f769639-3e52-4e39-af89-bc4aa7bff7fc tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:05.487214 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f769639-3e52-4e39-af89-bc4aa7bff7fc tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:05.488017 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f769639-3e52-4e39-af89-bc4aa7bff7fc tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:05.489128 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f769639-3e52-4e39-af89-bc4aa7bff7fc tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:05.490348 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f769639-3e52-4e39-af89-bc4aa7bff7fc tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:05.734807 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-04daf516-8205-4acd-846b-3c96ca862cb0 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:05.734951 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9f769639-3e52-4e39-af89-bc4aa7bff7fc tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:05.735413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-04daf516-8205-4acd-846b-3c96ca862cb0 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: b6ed0cc6-bfeb-4148-a017-69d0eedad83e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:05.742372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-04daf516-8205-4acd-846b-3c96ca862cb0 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:05.742818 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-04daf516-8205-4acd-846b-3c96ca862cb0 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:05.743589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-04daf516-8205-4acd-846b-3c96ca862cb0 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:05.744043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-04daf516-8205-4acd-846b-3c96ca862cb0 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:05.745613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9f769639-3e52-4e39-af89-bc4aa7bff7fc tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:05.748516 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9f769639-3e52-4e39-af89-bc4aa7bff7fc tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:05.748516 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9f769639-3e52-4e39-af89-bc4aa7bff7fc tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 200 len: 1361 microversion: 2.25 time: 0.276758 Jul 25 14:28:05.763130 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 430/887] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:05 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 1361 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:05.802012 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-28034e9a-c00f-4cab-8083-a9ab350c46b4 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:05.802626 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-28034e9a-c00f-4cab-8083-a9ab350c46b4 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: b7018cc7-3f35-47d3-a679-30b828faedab] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:05.816691 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-28034e9a-c00f-4cab-8083-a9ab350c46b4 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:05.817181 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-28034e9a-c00f-4cab-8083-a9ab350c46b4 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:05.817959 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-28034e9a-c00f-4cab-8083-a9ab350c46b4 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:05.818402 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-28034e9a-c00f-4cab-8083-a9ab350c46b4 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:05.842968 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=8 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:28:05.927039 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-04daf516-8205-4acd-846b-3c96ca862cb0 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:05.934929 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-04daf516-8205-4acd-846b-3c96ca862cb0 tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e" status: 200 len: 1475 microversion: 2.1 time: 0.203966 Jul 25 14:28:05.949464 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 458/888] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:05 2022] GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e => generated 1475 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:05.956148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5ed76a77-674e-4db1-aa5a-2a34b8ba1d57 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:05.957470 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5ed76a77-674e-4db1-aa5a-2a34b8ba1d57 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 3b44e25a-9b18-4ee6-b084-32f9e4f7e881] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:05.965520 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ed76a77-674e-4db1-aa5a-2a34b8ba1d57 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:05.965970 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ed76a77-674e-4db1-aa5a-2a34b8ba1d57 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:05.966746 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ed76a77-674e-4db1-aa5a-2a34b8ba1d57 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:05.967177 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ed76a77-674e-4db1-aa5a-2a34b8ba1d57 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:06.070919 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-28034e9a-c00f-4cab-8083-a9ab350c46b4 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:06.083128 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-28034e9a-c00f-4cab-8083-a9ab350c46b4 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab" status: 200 len: 1469 microversion: 2.1 time: 0.285051 Jul 25 14:28:06.099863 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 431/889] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:05 2022] GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab => generated 1469 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:06.119014 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-b05c9221-4d2f-45f3-bc0d-065d01d0f4a1 req-e136481c-d656-42cb-83d0-7ddd81b171ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2ea60b9-dff6-4ee9-8004-680327fa2f96", "name": "network-vif-deleted", "tag": "83f3c285-c7d1-4407-9b2d-044ccf989207"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:06.132969 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b05c9221-4d2f-45f3-bc0d-065d01d0f4a1 req-e136481c-d656-42cb-83d0-7ddd81b171ab service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:06.133411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b05c9221-4d2f-45f3-bc0d-065d01d0f4a1 req-e136481c-d656-42cb-83d0-7ddd81b171ab service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:06.147507 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-b05c9221-4d2f-45f3-bc0d-065d01d0f4a1 req-e136481c-d656-42cb-83d0-7ddd81b171ab service nova] Creating event network-vif-deleted:83f3c285-c7d1-4407-9b2d-044ccf989207 for instance c2ea60b9-dff6-4ee9-8004-680327fa2f96 on n-h1-846435-14 Jul 25 14:28:06.152974 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-b05c9221-4d2f-45f3-bc0d-065d01d0f4a1 req-e136481c-d656-42cb-83d0-7ddd81b171ab service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051339 Jul 25 14:28:06.153133 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 432/890] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:06.188835 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5ed76a77-674e-4db1-aa5a-2a34b8ba1d57 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:06.196741 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-aedb767b-1917-4114-9034-cc9e1a0778b6 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:06.197481 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-aedb767b-1917-4114-9034-cc9e1a0778b6 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: c2ea60b9-dff6-4ee9-8004-680327fa2f96] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:06.198723 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5ed76a77-674e-4db1-aa5a-2a34b8ba1d57 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881" status: 200 len: 1324 microversion: 2.1 time: 0.247799 Jul 25 14:28:06.199558 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 459/891] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:05 2022] GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881 => generated 1324 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:06.204590 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aedb767b-1917-4114-9034-cc9e1a0778b6 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:06.205077 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aedb767b-1917-4114-9034-cc9e1a0778b6 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:06.205847 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aedb767b-1917-4114-9034-cc9e1a0778b6 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:06.206281 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aedb767b-1917-4114-9034-cc9e1a0778b6 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:06.241495 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aedb767b-1917-4114-9034-cc9e1a0778b6 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:06.242180 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aedb767b-1917-4114-9034-cc9e1a0778b6 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:06.242785 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-aedb767b-1917-4114-9034-cc9e1a0778b6 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lazy-loading 'fault' on Instance uuid c2ea60b9-dff6-4ee9-8004-680327fa2f96 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:28:06.289280 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-aedb767b-1917-4114-9034-cc9e1a0778b6 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0334859a0fd544b3b4064ca188a22d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327a5b80b3404191ae269afa882d3753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:06.297706 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-aedb767b-1917-4114-9034-cc9e1a0778b6 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96" status: 200 len: 1311 microversion: 2.1 time: 0.106472 Jul 25 14:28:06.298925 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 433/892] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:06 2022] GET /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96 => generated 1311 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:06.324279 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7b29b146-ad06-418d-bdea-9d87cad78519 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:06.324911 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7b29b146-ad06-418d-bdea-9d87cad78519 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:06.331865 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7b29b146-ad06-418d-bdea-9d87cad78519 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:06.332335 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7b29b146-ad06-418d-bdea-9d87cad78519 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:06.333096 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7b29b146-ad06-418d-bdea-9d87cad78519 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:06.333521 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7b29b146-ad06-418d-bdea-9d87cad78519 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:06.525697 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7b29b146-ad06-418d-bdea-9d87cad78519 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:06.535256 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7b29b146-ad06-418d-bdea-9d87cad78519 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1477 microversion: 2.1 time: 0.215005 Jul 25 14:28:06.540011 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 460/893] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:06 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1477 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:06.780479 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-420144b8-dc99-4487-9874-eb70c83db809 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:06.781098 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-420144b8-dc99-4487-9874-eb70c83db809 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:06.794043 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-420144b8-dc99-4487-9874-eb70c83db809 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:06.795007 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-420144b8-dc99-4487-9874-eb70c83db809 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:06.796076 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-420144b8-dc99-4487-9874-eb70c83db809 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:06.796715 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-420144b8-dc99-4487-9874-eb70c83db809 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:06.956359 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b5917f78-85c2-45bb-84df-2454240d6b8f tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:06.957272 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b5917f78-85c2-45bb-84df-2454240d6b8f tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: b6ed0cc6-bfeb-4148-a017-69d0eedad83e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:06.964272 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b5917f78-85c2-45bb-84df-2454240d6b8f tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:06.964987 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b5917f78-85c2-45bb-84df-2454240d6b8f tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:06.965921 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b5917f78-85c2-45bb-84df-2454240d6b8f tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:06.966502 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b5917f78-85c2-45bb-84df-2454240d6b8f tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:07.153208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b5917f78-85c2-45bb-84df-2454240d6b8f tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:07.160817 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b5917f78-85c2-45bb-84df-2454240d6b8f tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e" status: 200 len: 1475 microversion: 2.1 time: 0.208440 Jul 25 14:28:07.161394 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 461/894] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:06 2022] GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e => generated 1475 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:28:07.187161 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-86cf8ec8-fb1b-4382-9137-914b9dd91979 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:07.187784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-86cf8ec8-fb1b-4382-9137-914b9dd91979 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: b7018cc7-3f35-47d3-a679-30b828faedab] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:07.201258 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-86cf8ec8-fb1b-4382-9137-914b9dd91979 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:07.202547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-86cf8ec8-fb1b-4382-9137-914b9dd91979 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:07.207154 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-86cf8ec8-fb1b-4382-9137-914b9dd91979 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:07.207879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-86cf8ec8-fb1b-4382-9137-914b9dd91979 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:07.208026 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-420144b8-dc99-4487-9874-eb70c83db809 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:07.216112 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-420144b8-dc99-4487-9874-eb70c83db809 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:07.221092 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-420144b8-dc99-4487-9874-eb70c83db809 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:07.222249 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-420144b8-dc99-4487-9874-eb70c83db809 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 200 len: 1557 microversion: 2.25 time: 0.447293 Jul 25 14:28:07.222805 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 434/895] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:06 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 1557 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:07.233152 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a7de332f-18bf-441e-9a7b-f6c408a2245f tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:07.234081 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a7de332f-18bf-441e-9a7b-f6c408a2245f tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 3b44e25a-9b18-4ee6-b084-32f9e4f7e881] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:07.241095 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a7de332f-18bf-441e-9a7b-f6c408a2245f tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:07.241822 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a7de332f-18bf-441e-9a7b-f6c408a2245f tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:07.242798 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a7de332f-18bf-441e-9a7b-f6c408a2245f tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:07.243433 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a7de332f-18bf-441e-9a7b-f6c408a2245f tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:07.467923 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-86cf8ec8-fb1b-4382-9137-914b9dd91979 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:07.472233 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a7de332f-18bf-441e-9a7b-f6c408a2245f tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:07.478919 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:28:07.492851 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a7de332f-18bf-441e-9a7b-f6c408a2245f tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881" status: 200 len: 1520 microversion: 2.1 time: 0.268937 Jul 25 14:28:07.501569 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 435/896] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:07 2022] GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881 => generated 1520 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:07.522907 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-86cf8ec8-fb1b-4382-9137-914b9dd91979 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab" status: 200 len: 1469 microversion: 2.1 time: 0.311160 Jul 25 14:28:07.525171 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 462/897] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:07 2022] GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab => generated 1469 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:07.535643 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d4143752-c811-49bd-87fd-ab96af131e72 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:07.539940 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d4143752-c811-49bd-87fd-ab96af131e72 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] [instance: c2ea60b9-dff6-4ee9-8004-680327fa2f96] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:07.552505 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d4143752-c811-49bd-87fd-ab96af131e72 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:07.556517 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d4143752-c811-49bd-87fd-ab96af131e72 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:07.557519 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d4143752-c811-49bd-87fd-ab96af131e72 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:07.560691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d4143752-c811-49bd-87fd-ab96af131e72 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:07.601440 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-d4143752-c811-49bd-87fd-ab96af131e72 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] HTTP exception thrown: Instance c2ea60b9-dff6-4ee9-8004-680327fa2f96 could not be found. Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d4143752-c811-49bd-87fd-ab96af131e72 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Request method failure captured: Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96 HTTP/1.1 Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qg6DiqyC33XPnlixA23ZuJy02RDFh3vKg6O09Q6vuvTzgxr4OiNxn9S0rtZ1OYnrgCuKmKnpSZjYw7inFVSIwiUKVKJ0mq1S51i4dB7mYB6VWnz1-HE4NBQO9jKp3TVWEi5VnCA8gKl1TBHdeCsZVcaKL8d3jT42SaLSdceHh8PTCw Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 327a5b80b3404191ae269afa882d3753 Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-708891928 Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/327a5b80b3404191ae269afa882d3753"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/327a5b80b3404191ae269afa882d3753"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_327a5b80b3404191ae269afa882d3753", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/327a5b80b3404191ae269afa882d3753"}]}] Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersAdminNegativeTestJSON-708891928 Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 327a5b80b3404191ae269afa882d3753 Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-708891928 Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersAdminNegativeTestJSON-708891928-project Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 0334859a0fd544b3b4064ca188a22d32 Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersAdminNegativeTestJSON-708891928-project Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance c2ea60b9-dff6-4ee9-8004-680327fa2f96 could not be found. Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'c2ea60b9-dff6-4ee9-8004-680327fa2f96'} Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2ea60b9-dff6-4ee9-8004-680327fa2f96 could not be found. Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2ea60b9-dff6-4ee9-8004-680327fa2f96 could not be found. Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:07.605415 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:07.609957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:07.609957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:07.609957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:07.609957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:28:07.609957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:28:07.609957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2ea60b9-dff6-4ee9-8004-680327fa2f96 could not be found. Jul 25 14:28:07.609957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:07.609957 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d4143752-c811-49bd-87fd-ab96af131e72 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] Returning 404 to user: Instance c2ea60b9-dff6-4ee9-8004-680327fa2f96 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:28:07.610628 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d4143752-c811-49bd-87fd-ab96af131e72 tempest-ServersAdminNegativeTestJSON-708891928 tempest-ServersAdminNegativeTestJSON-708891928-project] 10.222.0.88 "GET /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96" status: 404 len: 111 microversion: 2.1 time: 0.082031 Jul 25 14:28:07.616308 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 463/898] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:07 2022] GET /compute/v2.1/servers/c2ea60b9-dff6-4ee9-8004-680327fa2f96 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:28:07.635771 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-63d1e967-adcd-440f-ac50-58da1d6ba74b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:07.638879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-63d1e967-adcd-440f-ac50-58da1d6ba74b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 3b44e25a-9b18-4ee6-b084-32f9e4f7e881] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:07.650719 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63d1e967-adcd-440f-ac50-58da1d6ba74b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:07.655459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63d1e967-adcd-440f-ac50-58da1d6ba74b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:07.656376 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63d1e967-adcd-440f-ac50-58da1d6ba74b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:07.658941 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63d1e967-adcd-440f-ac50-58da1d6ba74b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:07.724778 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-63d1e967-adcd-440f-ac50-58da1d6ba74b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 3b44e25a-9b18-4ee6-b084-32f9e4f7e881] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:28:07.894157 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-63d1e967-adcd-440f-ac50-58da1d6ba74b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "DELETE /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881" status: 204 len: 0 microversion: 2.1 time: 0.274893 Jul 25 14:28:07.898011 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 464/899] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:28:07 2022] DELETE /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:28:07.908017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8effd268-2a3c-477c-a99f-40a2c63f927b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:07.908780 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8effd268-2a3c-477c-a99f-40a2c63f927b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:07.925393 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8effd268-2a3c-477c-a99f-40a2c63f927b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:07.925895 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8effd268-2a3c-477c-a99f-40a2c63f927b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:07.926832 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8effd268-2a3c-477c-a99f-40a2c63f927b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:07.927304 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8effd268-2a3c-477c-a99f-40a2c63f927b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:07.937178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d15911a4-b2a8-4f94-81fd-b3ddc4e5059d tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:07.937812 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d15911a4-b2a8-4f94-81fd-b3ddc4e5059d tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:07.945096 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d15911a4-b2a8-4f94-81fd-b3ddc4e5059d tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:07.945549 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d15911a4-b2a8-4f94-81fd-b3ddc4e5059d tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:07.946364 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d15911a4-b2a8-4f94-81fd-b3ddc4e5059d tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:07.946804 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d15911a4-b2a8-4f94-81fd-b3ddc4e5059d tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:07.948424 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:28:08.115364 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8effd268-2a3c-477c-a99f-40a2c63f927b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:08.125270 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8effd268-2a3c-477c-a99f-40a2c63f927b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1477 microversion: 2.1 time: 0.227142 Jul 25 14:28:08.148793 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 465/900] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:07 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1477 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:08.155755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-137ce0c6-c548-4169-806b-8eb6544c867b req-eef7c723-be6b-4ddb-9404-f9382d80f705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7018cc7-3f35-47d3-a679-30b828faedab", "name": "network-vif-deleted", "tag": "3b2a879a-4843-4428-b75e-ce8d7edfab6d"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:08.161674 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-d15911a4-b2a8-4f94-81fd-b3ddc4e5059d tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lazy-loading 'services' on Instance uuid b3d2010c-4e0c-412e-9b66-8fbac6510097 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:28:08.170389 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-137ce0c6-c548-4169-806b-8eb6544c867b req-eef7c723-be6b-4ddb-9404-f9382d80f705 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:08.170832 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-137ce0c6-c548-4169-806b-8eb6544c867b req-eef7c723-be6b-4ddb-9404-f9382d80f705 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:08.197954 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-137ce0c6-c548-4169-806b-8eb6544c867b req-eef7c723-be6b-4ddb-9404-f9382d80f705 service nova] Creating event network-vif-deleted:3b2a879a-4843-4428-b75e-ce8d7edfab6d for instance b7018cc7-3f35-47d3-a679-30b828faedab on n-h2-846435-14 Jul 25 14:28:08.203418 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-137ce0c6-c548-4169-806b-8eb6544c867b req-eef7c723-be6b-4ddb-9404-f9382d80f705 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052511 Jul 25 14:28:08.204521 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 466/901] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:08.210028 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-52682448-c9c8-4fbb-90cf-2dd621355d8f tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:08.210741 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-52682448-c9c8-4fbb-90cf-2dd621355d8f tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 3b44e25a-9b18-4ee6-b084-32f9e4f7e881] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:08.218133 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52682448-c9c8-4fbb-90cf-2dd621355d8f tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:08.223934 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52682448-c9c8-4fbb-90cf-2dd621355d8f tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:08.224702 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52682448-c9c8-4fbb-90cf-2dd621355d8f tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:08.228037 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52682448-c9c8-4fbb-90cf-2dd621355d8f tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:08.245701 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d15911a4-b2a8-4f94-81fd-b3ddc4e5059d tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 200 len: 2051 microversion: 2.25 time: 0.742973 Jul 25 14:28:08.246300 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 436/902] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:07 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 2051 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:08.259769 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-c827bbd3-f5f9-4f2d-9c59-5ffc1dc8fde7 req-24d3dfdb-e91f-4739-a053-79950fa925a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6ed0cc6-bfeb-4148-a017-69d0eedad83e", "name": "network-vif-deleted", "tag": "9ed86ee9-b2e4-4fa1-86f9-082e0978d084"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:08.275804 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c827bbd3-f5f9-4f2d-9c59-5ffc1dc8fde7 req-24d3dfdb-e91f-4739-a053-79950fa925a0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:08.277474 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c827bbd3-f5f9-4f2d-9c59-5ffc1dc8fde7 req-24d3dfdb-e91f-4739-a053-79950fa925a0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:08.318573 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-c827bbd3-f5f9-4f2d-9c59-5ffc1dc8fde7 req-24d3dfdb-e91f-4739-a053-79950fa925a0 service nova] Creating event network-vif-deleted:9ed86ee9-b2e4-4fa1-86f9-082e0978d084 for instance b6ed0cc6-bfeb-4148-a017-69d0eedad83e on n-h2-846435-14 Jul 25 14:28:08.329862 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-c827bbd3-f5f9-4f2d-9c59-5ffc1dc8fde7 req-24d3dfdb-e91f-4739-a053-79950fa925a0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076819 Jul 25 14:28:08.330574 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 437/903] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:08.351122 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8ba49fe9-5d21-42fd-96be-39d5ccc7773b tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:08.351771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8ba49fe9-5d21-42fd-96be-39d5ccc7773b tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: b6ed0cc6-bfeb-4148-a017-69d0eedad83e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:08.362544 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ba49fe9-5d21-42fd-96be-39d5ccc7773b tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:08.363030 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ba49fe9-5d21-42fd-96be-39d5ccc7773b tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:08.363787 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ba49fe9-5d21-42fd-96be-39d5ccc7773b tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:08.364336 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ba49fe9-5d21-42fd-96be-39d5ccc7773b tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:08.434659 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ba49fe9-5d21-42fd-96be-39d5ccc7773b tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:08.435175 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ba49fe9-5d21-42fd-96be-39d5ccc7773b tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:08.435926 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-8ba49fe9-5d21-42fd-96be-39d5ccc7773b tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lazy-loading 'fault' on Instance uuid b6ed0cc6-bfeb-4148-a017-69d0eedad83e {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:28:08.493859 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8ba49fe9-5d21-42fd-96be-39d5ccc7773b tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6976261712c44d37821f95e1f482de72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07a43cd116847b6816581adfeed8f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:08.504091 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8ba49fe9-5d21-42fd-96be-39d5ccc7773b tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e" status: 200 len: 1309 microversion: 2.1 time: 0.166446 Jul 25 14:28:08.504091 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 438/904] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:08 2022] GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e => generated 1309 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:08.506051 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-52682448-c9c8-4fbb-90cf-2dd621355d8f tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:08.515275 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-52682448-c9c8-4fbb-90cf-2dd621355d8f tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881" status: 200 len: 1526 microversion: 2.1 time: 0.309209 Jul 25 14:28:08.528001 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 467/905] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:08 2022] GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881 => generated 1526 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:08.528224 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4dc1d8c0-2ad2-43d6-b81e-4fcc0fdc420c tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:08.528224 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4dc1d8c0-2ad2-43d6-b81e-4fcc0fdc420c tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:08.539184 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4dc1d8c0-2ad2-43d6-b81e-4fcc0fdc420c tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:08.540229 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4dc1d8c0-2ad2-43d6-b81e-4fcc0fdc420c tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:08.541218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4dc1d8c0-2ad2-43d6-b81e-4fcc0fdc420c tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:08.542151 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4dc1d8c0-2ad2-43d6-b81e-4fcc0fdc420c tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:08.553036 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e9c1de1e-391e-42fb-835c-17f881f69abe tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:08.553321 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e9c1de1e-391e-42fb-835c-17f881f69abe tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: b7018cc7-3f35-47d3-a679-30b828faedab] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:08.561270 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e9c1de1e-391e-42fb-835c-17f881f69abe tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:08.561413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e9c1de1e-391e-42fb-835c-17f881f69abe tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:08.562749 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e9c1de1e-391e-42fb-835c-17f881f69abe tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:08.563460 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e9c1de1e-391e-42fb-835c-17f881f69abe tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:08.613574 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e9c1de1e-391e-42fb-835c-17f881f69abe tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:08.614162 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e9c1de1e-391e-42fb-835c-17f881f69abe tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:08.614722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-e9c1de1e-391e-42fb-835c-17f881f69abe tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lazy-loading 'fault' on Instance uuid b7018cc7-3f35-47d3-a679-30b828faedab {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:28:08.678882 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e9c1de1e-391e-42fb-835c-17f881f69abe tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:08.686676 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e9c1de1e-391e-42fb-835c-17f881f69abe tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab" status: 200 len: 1303 microversion: 2.1 time: 0.143613 Jul 25 14:28:08.687436 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 468/906] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:08 2022] GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab => generated 1303 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:08.781410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-4dc1d8c0-2ad2-43d6-b81e-4fcc0fdc420c tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lazy-loading 'services' on Instance uuid b3d2010c-4e0c-412e-9b66-8fbac6510097 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:28:08.800829 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4dc1d8c0-2ad2-43d6-b81e-4fcc0fdc420c tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 200 len: 2051 microversion: 2.25 time: 0.295217 Jul 25 14:28:08.812058 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 439/907] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:08 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 2051 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:08.823619 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c8f26822-e333-410c-952d-d549de4f0050 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:08.826621 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:28:08.826621 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:28:08.827867 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c8f26822-e333-410c-952d-d549de4f0050 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:08.828662 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c8f26822-e333-410c-952d-d549de4f0050 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:08.829492 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c8f26822-e333-410c-952d-d549de4f0050 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:08.830059 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c8f26822-e333-410c-952d-d549de4f0050 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:08.858733 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c8f26822-e333-410c-952d-d549de4f0050 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.038750 Jul 25 14:28:08.864086 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 469/908] 10.222.0.88 () {60 vars in 1217 bytes} [Mon Jul 25 14:28:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:28:08.873800 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d661a89d-2bfe-455e-a565-bb82d945eac9 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-846435-14", "block_migration": "auto"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:08.877232 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d661a89d-2bfe-455e-a565-bb82d945eac9 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:08.886397 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d661a89d-2bfe-455e-a565-bb82d945eac9 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:08.886890 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d661a89d-2bfe-455e-a565-bb82d945eac9 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:08.887667 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d661a89d-2bfe-455e-a565-bb82d945eac9 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:08.888128 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d661a89d-2bfe-455e-a565-bb82d945eac9 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:08.914050 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-d661a89d-2bfe-455e-a565-bb82d945eac9 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lazy-loading 'flavor' on Instance uuid b3d2010c-4e0c-412e-9b66-8fbac6510097 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:28:08.927074 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d661a89d-2bfe-455e-a565-bb82d945eac9 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Going to try to live migrate instance to n-h1-846435-14 {{(pid=119303) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 14:28:09.155093 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fcbe8e0e-ba65-402e-a6ff-557297c4020c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:09.156177 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fcbe8e0e-ba65-402e-a6ff-557297c4020c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:09.165518 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fcbe8e0e-ba65-402e-a6ff-557297c4020c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:09.165966 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fcbe8e0e-ba65-402e-a6ff-557297c4020c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:09.166772 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fcbe8e0e-ba65-402e-a6ff-557297c4020c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:09.167385 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fcbe8e0e-ba65-402e-a6ff-557297c4020c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:09.334621 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fcbe8e0e-ba65-402e-a6ff-557297c4020c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:09.344524 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fcbe8e0e-ba65-402e-a6ff-557297c4020c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1477 microversion: 2.1 time: 0.193442 Jul 25 14:28:09.356062 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 470/909] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:09 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1477 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:09.527040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cff7e36a-4a92-44f0-9c32-e37befa2919e tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:09.531598 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cff7e36a-4a92-44f0-9c32-e37befa2919e tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] [instance: b6ed0cc6-bfeb-4148-a017-69d0eedad83e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:09.546112 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cff7e36a-4a92-44f0-9c32-e37befa2919e tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:09.548086 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cff7e36a-4a92-44f0-9c32-e37befa2919e tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:09.550400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cff7e36a-4a92-44f0-9c32-e37befa2919e tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:09.552352 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cff7e36a-4a92-44f0-9c32-e37befa2919e tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:09.579489 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-cff7e36a-4a92-44f0-9c32-e37befa2919e tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] HTTP exception thrown: Instance b6ed0cc6-bfeb-4148-a017-69d0eedad83e could not be found. Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cff7e36a-4a92-44f0-9c32-e37befa2919e tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Request method failure captured: Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e HTTP/1.1 Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qg0JytHg_5gL4yn4EPj2Ia85Dizg_c4Mlw86p7T4Dptzsr__TUjT_b0CdRUxSabFQzFuVtuqNrYOiT6b5iysTUe91fBb_vqDoCI08DS5TyI57g-0GPmBFeXbO9WEQ5ir9TloZzE10OWgVtKsCZHbzovCV15woejgpqh1DyvpnHuAF4 Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: f07a43cd116847b6816581adfeed8f9b Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-LiveMigrationNegativeTest-1958345919 Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f07a43cd116847b6816581adfeed8f9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f07a43cd116847b6816581adfeed8f9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f07a43cd116847b6816581adfeed8f9b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f07a43cd116847b6816581adfeed8f9b"}]}] Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-LiveMigrationNegativeTest-1958345919 Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: f07a43cd116847b6816581adfeed8f9b Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1958345919 Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-LiveMigrationNegativeTest-1958345919-project Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 6976261712c44d37821f95e1f482de72 Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-LiveMigrationNegativeTest-1958345919-project Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance b6ed0cc6-bfeb-4148-a017-69d0eedad83e could not be found. Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'b6ed0cc6-bfeb-4148-a017-69d0eedad83e'} Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6ed0cc6-bfeb-4148-a017-69d0eedad83e could not be found. Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6ed0cc6-bfeb-4148-a017-69d0eedad83e could not be found. Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:09.581559 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:09.589691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:09.589691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:09.589691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:09.589691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:28:09.589691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:28:09.589691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6ed0cc6-bfeb-4148-a017-69d0eedad83e could not be found. Jul 25 14:28:09.589691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:09.589691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cff7e36a-4a92-44f0-9c32-e37befa2919e tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] Returning 404 to user: Instance b6ed0cc6-bfeb-4148-a017-69d0eedad83e could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:28:09.589691 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cff7e36a-4a92-44f0-9c32-e37befa2919e tempest-LiveMigrationNegativeTest-1958345919 tempest-LiveMigrationNegativeTest-1958345919-project] 10.222.0.88 "GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e" status: 404 len: 111 microversion: 2.1 time: 0.062325 Jul 25 14:28:09.589691 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 471/910] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:09 2022] GET /compute/v2.1/servers/b6ed0cc6-bfeb-4148-a017-69d0eedad83e => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:28:09.594033 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6b0dfeb6-0897-4cde-962b-4f48caf11be6 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:09.594653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6b0dfeb6-0897-4cde-962b-4f48caf11be6 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 3b44e25a-9b18-4ee6-b084-32f9e4f7e881] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:09.603190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6b0dfeb6-0897-4cde-962b-4f48caf11be6 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:09.603642 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6b0dfeb6-0897-4cde-962b-4f48caf11be6 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:09.606437 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6b0dfeb6-0897-4cde-962b-4f48caf11be6 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:09.606437 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6b0dfeb6-0897-4cde-962b-4f48caf11be6 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:09.896876 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6b0dfeb6-0897-4cde-962b-4f48caf11be6 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:09.909165 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6b0dfeb6-0897-4cde-962b-4f48caf11be6 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881" status: 200 len: 1526 microversion: 2.1 time: 0.319293 Jul 25 14:28:09.912637 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 472/911] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:09 2022] GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881 => generated 1526 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:09.918982 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e29aeae5-4591-4a1f-a940-fefb477bc344 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:09.920624 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e29aeae5-4591-4a1f-a940-fefb477bc344 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: b7018cc7-3f35-47d3-a679-30b828faedab] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:09.928556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e29aeae5-4591-4a1f-a940-fefb477bc344 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:09.929473 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e29aeae5-4591-4a1f-a940-fefb477bc344 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:09.930705 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e29aeae5-4591-4a1f-a940-fefb477bc344 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:09.931355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e29aeae5-4591-4a1f-a940-fefb477bc344 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:09.949123 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-e29aeae5-4591-4a1f-a940-fefb477bc344 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] HTTP exception thrown: Instance b7018cc7-3f35-47d3-a679-30b828faedab could not be found. Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e29aeae5-4591-4a1f-a940-fefb477bc344 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Request method failure captured: Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab HTTP/1.1 Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qf4yYofYzxTEXQNBTIEp-KcIRH20fLV2cxto8L1IFG0djUXS1dfY4Ty-tmC57NrV7MKbzocwYOVJgoUXS2GRjoaKQJtNb6dRkF78OYZfD0mNoZCJx4JiITR7kS73zJTrQ4OH0jhjJsipi4F0VJMbeIif4GqTOE6U0QTz8Mam2Wwx8M Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: e693063176af4ae1ae0942ab1b10dc73 Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersAdminTestJSON-1892283915 Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e693063176af4ae1ae0942ab1b10dc73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e693063176af4ae1ae0942ab1b10dc73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e693063176af4ae1ae0942ab1b10dc73", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e693063176af4ae1ae0942ab1b10dc73"}]}] Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersAdminTestJSON-1892283915 Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: e693063176af4ae1ae0942ab1b10dc73 Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersAdminTestJSON-1892283915 Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersAdminTestJSON-1892283915-project Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: f844b69077cc4ec087269cbb3db2f99e Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersAdminTestJSON-1892283915-project Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance b7018cc7-3f35-47d3-a679-30b828faedab could not be found. Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'b7018cc7-3f35-47d3-a679-30b828faedab'} Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7018cc7-3f35-47d3-a679-30b828faedab could not be found. Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7018cc7-3f35-47d3-a679-30b828faedab could not be found. Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:09.951096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:09.955148 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:09.955148 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:09.955148 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:09.955148 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:28:09.955148 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:28:09.955148 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7018cc7-3f35-47d3-a679-30b828faedab could not be found. Jul 25 14:28:09.955148 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:09.955148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e29aeae5-4591-4a1f-a940-fefb477bc344 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Returning 404 to user: Instance b7018cc7-3f35-47d3-a679-30b828faedab could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:28:09.955148 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e29aeae5-4591-4a1f-a940-fefb477bc344 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab" status: 404 len: 111 microversion: 2.1 time: 0.038645 Jul 25 14:28:09.955148 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 473/912] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:09 2022] GET /compute/v2.1/servers/b7018cc7-3f35-47d3-a679-30b828faedab => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:28:09.962583 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f0bce9e0-e612-4ea9-82f1-f0c8d4b76e21 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:09.963180 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f0bce9e0-e612-4ea9-82f1-f0c8d4b76e21 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:09.970982 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0bce9e0-e612-4ea9-82f1-f0c8d4b76e21 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:09.972171 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0bce9e0-e612-4ea9-82f1-f0c8d4b76e21 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:09.973784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0bce9e0-e612-4ea9-82f1-f0c8d4b76e21 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:09.974317 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0bce9e0-e612-4ea9-82f1-f0c8d4b76e21 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:10.042202 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f0bce9e0-e612-4ea9-82f1-f0c8d4b76e21 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:28:10.154687 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:28:10.204939 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f0bce9e0-e612-4ea9-82f1-f0c8d4b76e21 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 204 len: 0 microversion: 2.1 time: 0.245498 Jul 25 14:28:10.207529 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 474/913] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:28:09 2022] DELETE /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:28:10.229507 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-628644f5-5df2-40a0-8aee-1bb3a83569dd tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:10.230271 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-628644f5-5df2-40a0-8aee-1bb3a83569dd tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:10.245560 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-628644f5-5df2-40a0-8aee-1bb3a83569dd tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:10.246032 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-628644f5-5df2-40a0-8aee-1bb3a83569dd tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:10.247658 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-628644f5-5df2-40a0-8aee-1bb3a83569dd tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:10.248318 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-628644f5-5df2-40a0-8aee-1bb3a83569dd tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:10.536463 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-628644f5-5df2-40a0-8aee-1bb3a83569dd tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:10.545477 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-628644f5-5df2-40a0-8aee-1bb3a83569dd tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1469 microversion: 2.1 time: 0.331898 Jul 25 14:28:10.553100 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 475/914] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:10 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1469 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:10.568490 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-367d675e-5026-4159-8839-c928889e1ae9 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:10.569113 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-367d675e-5026-4159-8839-c928889e1ae9 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:10.576851 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-367d675e-5026-4159-8839-c928889e1ae9 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:10.577531 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-367d675e-5026-4159-8839-c928889e1ae9 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:10.578374 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-367d675e-5026-4159-8839-c928889e1ae9 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:10.578807 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-367d675e-5026-4159-8839-c928889e1ae9 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:10.780435 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-367d675e-5026-4159-8839-c928889e1ae9 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:10.790402 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-367d675e-5026-4159-8839-c928889e1ae9 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1477 microversion: 2.1 time: 0.236174 Jul 25 14:28:10.790988 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 476/915] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:10 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1477 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:10.804889 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-124fc703-381d-49e7-b2a9-ff97aabe9bcf req-c20adc7b-d32b-4058-b6d0-284cf7f75604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b44e25a-9b18-4ee6-b084-32f9e4f7e881", "name": "network-vif-deleted", "tag": "35ff58a9-4c79-467b-9c47-4078f588668b"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:10.815683 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-124fc703-381d-49e7-b2a9-ff97aabe9bcf req-c20adc7b-d32b-4058-b6d0-284cf7f75604 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:10.816350 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-124fc703-381d-49e7-b2a9-ff97aabe9bcf req-c20adc7b-d32b-4058-b6d0-284cf7f75604 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:10.829539 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-124fc703-381d-49e7-b2a9-ff97aabe9bcf req-c20adc7b-d32b-4058-b6d0-284cf7f75604 service nova] Creating event network-vif-deleted:35ff58a9-4c79-467b-9c47-4078f588668b for instance 3b44e25a-9b18-4ee6-b084-32f9e4f7e881 on n-h1-846435-14 Jul 25 14:28:10.837477 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-124fc703-381d-49e7-b2a9-ff97aabe9bcf req-c20adc7b-d32b-4058-b6d0-284cf7f75604 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044504 Jul 25 14:28:10.838475 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 477/916] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:10.937178 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dd48b55a-6958-4785-acba-4e32cbb4ca46 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:10.938280 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dd48b55a-6958-4785-acba-4e32cbb4ca46 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 3b44e25a-9b18-4ee6-b084-32f9e4f7e881] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:10.948573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd48b55a-6958-4785-acba-4e32cbb4ca46 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:10.949042 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd48b55a-6958-4785-acba-4e32cbb4ca46 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:10.950009 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd48b55a-6958-4785-acba-4e32cbb4ca46 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:10.950439 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd48b55a-6958-4785-acba-4e32cbb4ca46 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:11.030684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dd48b55a-6958-4785-acba-4e32cbb4ca46 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:11.057044 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dd48b55a-6958-4785-acba-4e32cbb4ca46 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881" status: 200 len: 1484 microversion: 2.1 time: 0.123966 Jul 25 14:28:11.060860 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 478/917] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:10 2022] GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881 => generated 1484 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:28:11.567450 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-48b728c2-0f9b-4501-9932-b0b1819d455f tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:11.570844 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-48b728c2-0f9b-4501-9932-b0b1819d455f tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:11.591862 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48b728c2-0f9b-4501-9932-b0b1819d455f tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:11.593254 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48b728c2-0f9b-4501-9932-b0b1819d455f tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:11.594279 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48b728c2-0f9b-4501-9932-b0b1819d455f tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:11.595023 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48b728c2-0f9b-4501-9932-b0b1819d455f tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:11.860399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-48b728c2-0f9b-4501-9932-b0b1819d455f tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:11.869157 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-48b728c2-0f9b-4501-9932-b0b1819d455f tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1469 microversion: 2.1 time: 0.306268 Jul 25 14:28:11.887923 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 479/918] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:11 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1469 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:11.893161 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ad104c8f-a3b7-4986-824c-dcbe84683957 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:11.894000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ad104c8f-a3b7-4986-824c-dcbe84683957 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:11.901425 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad104c8f-a3b7-4986-824c-dcbe84683957 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:11.901869 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad104c8f-a3b7-4986-824c-dcbe84683957 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:11.902637 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad104c8f-a3b7-4986-824c-dcbe84683957 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:11.903070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad104c8f-a3b7-4986-824c-dcbe84683957 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:12.085281 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ad104c8f-a3b7-4986-824c-dcbe84683957 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:12.097185 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ad104c8f-a3b7-4986-824c-dcbe84683957 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1477 microversion: 2.1 time: 0.205581 Jul 25 14:28:12.098245 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 480/919] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:11 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1477 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:12.110221 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-25c4f2f0-5c30-483d-8792-27ad2177832b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:12.113640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-25c4f2f0-5c30-483d-8792-27ad2177832b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 3b44e25a-9b18-4ee6-b084-32f9e4f7e881] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:12.121244 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25c4f2f0-5c30-483d-8792-27ad2177832b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:12.122018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25c4f2f0-5c30-483d-8792-27ad2177832b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:12.123276 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25c4f2f0-5c30-483d-8792-27ad2177832b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:12.124041 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25c4f2f0-5c30-483d-8792-27ad2177832b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:12.163881 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25c4f2f0-5c30-483d-8792-27ad2177832b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:12.165005 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25c4f2f0-5c30-483d-8792-27ad2177832b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:12.165968 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-25c4f2f0-5c30-483d-8792-27ad2177832b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lazy-loading 'fault' on Instance uuid 3b44e25a-9b18-4ee6-b084-32f9e4f7e881 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:28:12.249473 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-25c4f2f0-5c30-483d-8792-27ad2177832b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b1656f2dcd4ffebac55bf18110ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0116982ed03475097096c73b5f03035', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:12.277360 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-25c4f2f0-5c30-483d-8792-27ad2177832b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881" status: 200 len: 1314 microversion: 2.1 time: 0.176710 Jul 25 14:28:12.278795 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 481/920] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:12 2022] GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:12.675326 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-882fe3d0-71d3-4fcf-b07f-ab56b553833d tempest-ServicesAdminTestJSON-210497171 tempest-ServicesAdminTestJSON-210497171-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:12.679400 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:28:12.679400 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:28:12.681898 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-882fe3d0-71d3-4fcf-b07f-ab56b553833d tempest-ServicesAdminTestJSON-210497171 tempest-ServicesAdminTestJSON-210497171-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:12.682377 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-882fe3d0-71d3-4fcf-b07f-ab56b553833d tempest-ServicesAdminTestJSON-210497171 tempest-ServicesAdminTestJSON-210497171-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:12.685396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-882fe3d0-71d3-4fcf-b07f-ab56b553833d tempest-ServicesAdminTestJSON-210497171 tempest-ServicesAdminTestJSON-210497171-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:12.686791 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-882fe3d0-71d3-4fcf-b07f-ab56b553833d tempest-ServicesAdminTestJSON-210497171 tempest-ServicesAdminTestJSON-210497171-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:12.747227 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-882fe3d0-71d3-4fcf-b07f-ab56b553833d tempest-ServicesAdminTestJSON-210497171 tempest-ServicesAdminTestJSON-210497171-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.210171 Jul 25 14:28:12.758307 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 482/921] 10.222.0.88 () {58 vars in 1137 bytes} [Mon Jul 25 14:28:12 2022] GET /compute/v2.1/os-services => generated 949 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:12.768926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-85788cb9-85a6-4f3e-bf8c-e3cd10acb8fb tempest-ServicesAdminTestJSON-210497171 tempest-ServicesAdminTestJSON-210497171-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:12.772497 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:28:12.772497 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:28:12.774323 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-85788cb9-85a6-4f3e-bf8c-e3cd10acb8fb tempest-ServicesAdminTestJSON-210497171 tempest-ServicesAdminTestJSON-210497171-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:12.774963 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-85788cb9-85a6-4f3e-bf8c-e3cd10acb8fb tempest-ServicesAdminTestJSON-210497171 tempest-ServicesAdminTestJSON-210497171-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:12.776231 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-85788cb9-85a6-4f3e-bf8c-e3cd10acb8fb tempest-ServicesAdminTestJSON-210497171 tempest-ServicesAdminTestJSON-210497171-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:12.776824 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-85788cb9-85a6-4f3e-bf8c-e3cd10acb8fb tempest-ServicesAdminTestJSON-210497171 tempest-ServicesAdminTestJSON-210497171-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:12.809592 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-85788cb9-85a6-4f3e-bf8c-e3cd10acb8fb tempest-ServicesAdminTestJSON-210497171 tempest-ServicesAdminTestJSON-210497171-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?host=n-d-846435-14" status: 200 len: 581 microversion: 2.1 time: 0.049899 Jul 25 14:28:12.810738 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 483/922] 10.222.0.88 () {58 vars in 1174 bytes} [Mon Jul 25 14:28:12 2022] GET /compute/v2.1/os-services?host=n-d-846435-14 => generated 581 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:12.824307 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4204f0d4-5323-4092-84a0-20625866ff8c tempest-ServicesAdminTestJSON-210497171 tempest-ServicesAdminTestJSON-210497171-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:12.827451 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:28:12.827451 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:28:12.829118 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4204f0d4-5323-4092-84a0-20625866ff8c tempest-ServicesAdminTestJSON-210497171 tempest-ServicesAdminTestJSON-210497171-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:12.829859 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4204f0d4-5323-4092-84a0-20625866ff8c tempest-ServicesAdminTestJSON-210497171 tempest-ServicesAdminTestJSON-210497171-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:12.830840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4204f0d4-5323-4092-84a0-20625866ff8c tempest-ServicesAdminTestJSON-210497171 tempest-ServicesAdminTestJSON-210497171-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:12.831467 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4204f0d4-5323-4092-84a0-20625866ff8c tempest-ServicesAdminTestJSON-210497171 tempest-ServicesAdminTestJSON-210497171-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:12.864387 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4204f0d4-5323-4092-84a0-20625866ff8c tempest-ServicesAdminTestJSON-210497171 tempest-ServicesAdminTestJSON-210497171-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.043643 Jul 25 14:28:12.865656 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 484/923] 10.222.0.88 () {58 vars in 1176 bytes} [Mon Jul 25 14:28:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:12.878782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-5edb3d14-b0b1-4297-83df-4f3476f69940 req-d772bd23-6b41-4b16-a4ba-be4a48ae403e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c25476ab-b697-45f9-aa22-ead2d1b23fc7", "name": "network-vif-deleted", "tag": "c69d5fca-fc3b-4290-b9b5-09a0bbddbbc9"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:12.896462 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-5edb3d14-b0b1-4297-83df-4f3476f69940 req-d772bd23-6b41-4b16-a4ba-be4a48ae403e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:12.897115 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-5edb3d14-b0b1-4297-83df-4f3476f69940 req-d772bd23-6b41-4b16-a4ba-be4a48ae403e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:12.902113 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:28:12.910929 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-5edb3d14-b0b1-4297-83df-4f3476f69940 req-d772bd23-6b41-4b16-a4ba-be4a48ae403e service nova] Creating event network-vif-deleted:c69d5fca-fc3b-4290-b9b5-09a0bbddbbc9 for instance c25476ab-b697-45f9-aa22-ead2d1b23fc7 on n-h1-846435-14 Jul 25 14:28:12.916281 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-5edb3d14-b0b1-4297-83df-4f3476f69940 req-d772bd23-6b41-4b16-a4ba-be4a48ae403e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041272 Jul 25 14:28:12.917114 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 485/924] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:12.923410 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-518d2f77-ca70-48cc-a884-36bf3587f2ba tempest-ServicesAdminTestJSON-210497171 tempest-ServicesAdminTestJSON-210497171-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:12.926440 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:28:12.926440 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:28:12.927743 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-518d2f77-ca70-48cc-a884-36bf3587f2ba tempest-ServicesAdminTestJSON-210497171 tempest-ServicesAdminTestJSON-210497171-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:12.928534 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-518d2f77-ca70-48cc-a884-36bf3587f2ba tempest-ServicesAdminTestJSON-210497171 tempest-ServicesAdminTestJSON-210497171-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:12.929467 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-518d2f77-ca70-48cc-a884-36bf3587f2ba tempest-ServicesAdminTestJSON-210497171 tempest-ServicesAdminTestJSON-210497171-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:12.930044 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-518d2f77-ca70-48cc-a884-36bf3587f2ba tempest-ServicesAdminTestJSON-210497171 tempest-ServicesAdminTestJSON-210497171-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:12.958274 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-518d2f77-ca70-48cc-a884-36bf3587f2ba tempest-ServicesAdminTestJSON-210497171 tempest-ServicesAdminTestJSON-210497171-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.039349 Jul 25 14:28:12.968219 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 486/925] 10.222.0.88 () {58 vars in 1137 bytes} [Mon Jul 25 14:28:12 2022] GET /compute/v2.1/os-services => generated 949 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:12.968219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-55e9d6f1-1faf-4eec-9944-f258c86b4159 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:12.968219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-55e9d6f1-1faf-4eec-9944-f258c86b4159 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:12.972297 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55e9d6f1-1faf-4eec-9944-f258c86b4159 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:12.972615 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55e9d6f1-1faf-4eec-9944-f258c86b4159 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:12.973399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55e9d6f1-1faf-4eec-9944-f258c86b4159 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:12.973827 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55e9d6f1-1faf-4eec-9944-f258c86b4159 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:13.010247 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55e9d6f1-1faf-4eec-9944-f258c86b4159 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:13.011079 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55e9d6f1-1faf-4eec-9944-f258c86b4159 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:13.011711 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-55e9d6f1-1faf-4eec-9944-f258c86b4159 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lazy-loading 'fault' on Instance uuid c25476ab-b697-45f9-aa22-ead2d1b23fc7 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:28:13.068223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-55e9d6f1-1faf-4eec-9944-f258c86b4159 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f844b69077cc4ec087269cbb3db2f99e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693063176af4ae1ae0942ab1b10dc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:13.077588 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-55e9d6f1-1faf-4eec-9944-f258c86b4159 tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 200 len: 1304 microversion: 2.1 time: 0.117100 Jul 25 14:28:13.091557 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 487/926] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:12 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 1304 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:13.120105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a303841e-06df-4042-892b-59789f852704 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:13.120975 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a303841e-06df-4042-892b-59789f852704 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:13.131604 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a303841e-06df-4042-892b-59789f852704 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:13.132092 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a303841e-06df-4042-892b-59789f852704 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:13.134705 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a303841e-06df-4042-892b-59789f852704 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:13.135167 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a303841e-06df-4042-892b-59789f852704 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:13.356030 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a303841e-06df-4042-892b-59789f852704 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:13.377973 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a303841e-06df-4042-892b-59789f852704 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1477 microversion: 2.1 time: 0.261013 Jul 25 14:28:13.379631 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 488/927] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:13 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1477 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:28:13.388193 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b941787b-f366-44c5-b8cd-1c3c1672392e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:13.389069 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b941787b-f366-44c5-b8cd-1c3c1672392e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 3b44e25a-9b18-4ee6-b084-32f9e4f7e881] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:13.408641 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b941787b-f366-44c5-b8cd-1c3c1672392e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:13.411218 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b941787b-f366-44c5-b8cd-1c3c1672392e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:13.413141 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b941787b-f366-44c5-b8cd-1c3c1672392e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:13.413795 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b941787b-f366-44c5-b8cd-1c3c1672392e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:13.436490 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-b941787b-f366-44c5-b8cd-1c3c1672392e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] HTTP exception thrown: Instance 3b44e25a-9b18-4ee6-b084-32f9e4f7e881 could not be found. Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b941787b-f366-44c5-b8cd-1c3c1672392e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Request method failure captured: Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881 HTTP/1.1 Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qgcGc2RjkaZaGa63-PPdbCX4s7H2xWtuYRqlF0JWR61IUGzx74RHc-m8TJT-_RdlH0tQcWSd5UK3Q-O0K9ctQCv8954sZsqJWdlZOw1b7jo_qk8Zk2eLIrhbYh_u9wxQIss6t5T5Ti1Es5U9sr0YdlFFb4d-omgDGqaIN2Ib47NRJM Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: c0116982ed03475097096c73b5f03035 Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0116982ed03475097096c73b5f03035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0116982ed03475097096c73b5f03035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0116982ed03475097096c73b5f03035", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0116982ed03475097096c73b5f03035"}]}] Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: c0116982ed03475097096c73b5f03035 Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ImagesOneServerNegativeTestJSON-745484288-project Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: f1b1656f2dcd4ffebac55bf18110ff63 Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-745484288-project Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 3b44e25a-9b18-4ee6-b084-32f9e4f7e881 could not be found. Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '3b44e25a-9b18-4ee6-b084-32f9e4f7e881'} Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b44e25a-9b18-4ee6-b084-32f9e4f7e881 could not be found. Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b44e25a-9b18-4ee6-b084-32f9e4f7e881 could not be found. Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:13.442595 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:13.447443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:13.447443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:13.447443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:13.447443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:13.447443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:28:13.447443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:28:13.447443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b44e25a-9b18-4ee6-b084-32f9e4f7e881 could not be found. Jul 25 14:28:13.447443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:13.450309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b941787b-f366-44c5-b8cd-1c3c1672392e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Returning 404 to user: Instance 3b44e25a-9b18-4ee6-b084-32f9e4f7e881 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:28:13.452492 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b941787b-f366-44c5-b8cd-1c3c1672392e tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881" status: 404 len: 111 microversion: 2.1 time: 0.071326 Jul 25 14:28:13.454354 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 489/928] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:13 2022] GET /compute/v2.1/servers/3b44e25a-9b18-4ee6-b084-32f9e4f7e881 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:28:13.463051 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f4b63164-889b-44d8-bfad-4499c8dcce9b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '.version_select at 0x7f4687dbeee0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:13.520957 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-f4b63164-889b-44d8-bfad-4499c8dcce9b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] HTTP exception thrown: Image not found. Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f4b63164-889b-44d8-bfad-4499c8dcce9b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Request method failure captured: Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/images/0dcfe739-f97a-4424-9c8e-0277e691cc7c HTTP/1.1 Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qgcGc2RjkaZaGa63-PPdbCX4s7H2xWtuYRqlF0JWR61IUGzx74RHc-m8TJT-_RdlH0tQcWSd5UK3Q-O0K9ctQCv8954sZsqJWdlZOw1b7jo_qk8Zk2eLIrhbYh_u9wxQIss6t5T5Ti1Es5U9sr0YdlFFb4d-omgDGqaIN2Ib47NRJM Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: c0116982ed03475097096c73b5f03035 Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0116982ed03475097096c73b5f03035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0116982ed03475097096c73b5f03035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0116982ed03475097096c73b5f03035", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0116982ed03475097096c73b5f03035"}]}] Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: c0116982ed03475097096c73b5f03035 Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ImagesOneServerNegativeTestJSON-745484288-project Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: f1b1656f2dcd4ffebac55bf18110ff63 Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-745484288-project Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: exception: Image not found. Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '0dcfe739-f97a-4424-9c8e-0277e691cc7c'} Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0dcfe739-f97a-4424-9c8e-0277e691cc7c to delete Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0dcfe739-f97a-4424-9c8e-0277e691cc7c could not be found. Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:13.529824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:13.534780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:13.534780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:13.534780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:13.534780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:28:13.534780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:28:13.534780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:28:13.534780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:28:13.534780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:28:13.534780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:28:13.534780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 14:28:13.534780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 14:28:13.534780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 14:28:13.534780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:13.534780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:13.534780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:13.534780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:13.534780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:13.534780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:13.534780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:28:13.534780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:28:13.534780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 14:28:13.534780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:13.539364 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d661a89d-2bfe-455e-a565-bb82d945eac9 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097/action" status: 202 len: 0 microversion: 2.25 time: 4.660151 Jul 25 14:28:13.539865 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f4b63164-889b-44d8-bfad-4499c8dcce9b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Returning 404 to user: Image not found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:28:13.539865 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f4b63164-889b-44d8-bfad-4499c8dcce9b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "DELETE /compute/v2.1/images/0dcfe739-f97a-4424-9c8e-0277e691cc7c" status: 404 len: 62 microversion: 2.1 time: 0.072325 Jul 25 14:28:13.540047 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 440/929] 10.222.0.88 () {62 vars in 1319 bytes} [Mon Jul 25 14:28:08 2022] POST /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097/action => generated 0 bytes in 4666 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 25 14:28:13.540153 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 490/930] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:13 2022] DELETE /compute/v2.1/images/0dcfe739-f97a-4424-9c8e-0277e691cc7c => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:28:13.541923 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4089ec6f-0fd7-4f12-b6db-78f8b0fb52a3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:13.542520 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4089ec6f-0fd7-4f12-b6db-78f8b0fb52a3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:13.544016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f0748be1-c986-49c3-a609-87fcf324b37e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:13.544696 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f0748be1-c986-49c3-a609-87fcf324b37e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:13.552881 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4089ec6f-0fd7-4f12-b6db-78f8b0fb52a3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:13.553342 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4089ec6f-0fd7-4f12-b6db-78f8b0fb52a3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:13.554161 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4089ec6f-0fd7-4f12-b6db-78f8b0fb52a3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:13.554601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4089ec6f-0fd7-4f12-b6db-78f8b0fb52a3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:13.563110 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0748be1-c986-49c3-a609-87fcf324b37e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:13.563535 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0748be1-c986-49c3-a609-87fcf324b37e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:13.564418 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0748be1-c986-49c3-a609-87fcf324b37e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:13.564852 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0748be1-c986-49c3-a609-87fcf324b37e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:13.569692 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-4089ec6f-0fd7-4f12-b6db-78f8b0fb52a3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] HTTP exception thrown: Instance 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 could not be found. Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4089ec6f-0fd7-4f12-b6db-78f8b0fb52a3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Request method failure captured: Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 HTTP/1.1 Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qgcGc2RjkaZaGa63-PPdbCX4s7H2xWtuYRqlF0JWR61IUGzx74RHc-m8TJT-_RdlH0tQcWSd5UK3Q-O0K9ctQCv8954sZsqJWdlZOw1b7jo_qk8Zk2eLIrhbYh_u9wxQIss6t5T5Ti1Es5U9sr0YdlFFb4d-omgDGqaIN2Ib47NRJM Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: c0116982ed03475097096c73b5f03035 Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0116982ed03475097096c73b5f03035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0116982ed03475097096c73b5f03035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0116982ed03475097096c73b5f03035", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0116982ed03475097096c73b5f03035"}]}] Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: c0116982ed03475097096c73b5f03035 Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ImagesOneServerNegativeTestJSON-745484288-project Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: f1b1656f2dcd4ffebac55bf18110ff63 Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-745484288-project Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 could not be found. Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '5312b2e2-2ff9-457f-8d89-1cfa1b508ef9'} Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 could not be found. Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:28:13.572294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:28:13.576312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 could not be found. Jul 25 14:28:13.576312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:13.576312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:13.576312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:13.576312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:13.576312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:13.576312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:13.576312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:28:13.576312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:28:13.576312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 could not be found. Jul 25 14:28:13.576312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:13.578268 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4089ec6f-0fd7-4f12-b6db-78f8b0fb52a3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Returning 404 to user: Instance 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:28:13.579347 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4089ec6f-0fd7-4f12-b6db-78f8b0fb52a3 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "DELETE /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9" status: 404 len: 111 microversion: 2.1 time: 0.042552 Jul 25 14:28:13.580317 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 441/931] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:28:13 2022] DELETE /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:28:13.590033 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e43f8098-c2ac-4a9f-8fd4-468e1020536b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:13.591073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e43f8098-c2ac-4a9f-8fd4-468e1020536b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:13.612591 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e43f8098-c2ac-4a9f-8fd4-468e1020536b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:13.614933 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e43f8098-c2ac-4a9f-8fd4-468e1020536b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:13.615939 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e43f8098-c2ac-4a9f-8fd4-468e1020536b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:13.617028 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e43f8098-c2ac-4a9f-8fd4-468e1020536b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:13.649983 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-e43f8098-c2ac-4a9f-8fd4-468e1020536b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] HTTP exception thrown: Instance 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 could not be found. Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e43f8098-c2ac-4a9f-8fd4-468e1020536b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Request method failure captured: Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 HTTP/1.1 Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qgcGc2RjkaZaGa63-PPdbCX4s7H2xWtuYRqlF0JWR61IUGzx74RHc-m8TJT-_RdlH0tQcWSd5UK3Q-O0K9ctQCv8954sZsqJWdlZOw1b7jo_qk8Zk2eLIrhbYh_u9wxQIss6t5T5Ti1Es5U9sr0YdlFFb4d-omgDGqaIN2Ib47NRJM Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: c0116982ed03475097096c73b5f03035 Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0116982ed03475097096c73b5f03035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0116982ed03475097096c73b5f03035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0116982ed03475097096c73b5f03035", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0116982ed03475097096c73b5f03035"}]}] Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: c0116982ed03475097096c73b5f03035 Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ImagesOneServerNegativeTestJSON-745484288-project Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: f1b1656f2dcd4ffebac55bf18110ff63 Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-745484288-project Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 could not be found. Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '5312b2e2-2ff9-457f-8d89-1cfa1b508ef9'} Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 could not be found. Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 could not be found. Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:13.653309 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:13.658691 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:13.658691 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:13.658691 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:13.658691 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:13.658691 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:28:13.658691 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:28:13.658691 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 could not be found. Jul 25 14:28:13.658691 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:13.663197 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e43f8098-c2ac-4a9f-8fd4-468e1020536b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Returning 404 to user: Instance 5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:28:13.669029 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e43f8098-c2ac-4a9f-8fd4-468e1020536b tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9" status: 404 len: 111 microversion: 2.1 time: 0.084245 Jul 25 14:28:13.685064 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 442/932] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:13 2022] GET /compute/v2.1/servers/5312b2e2-2ff9-457f-8d89-1cfa1b508ef9 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:28:13.691374 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cba77b82-61f7-45c8-be3f-4a78278164cb tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '.version_select at 0x7f46878d3ee0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:13.765145 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cba77b82-61f7-45c8-be3f-4a78278164cb tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1262065392" status: 202 len: 0 microversion: 2.1 time: 0.077493 Jul 25 14:28:13.771770 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 443/933] 10.222.0.88 () {58 vars in 1221 bytes} [Mon Jul 25 14:28:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1262065392 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:28:13.892946 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f0748be1-c986-49c3-a609-87fcf324b37e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:13.904115 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f0748be1-c986-49c3-a609-87fcf324b37e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:13.905684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f0748be1-c986-49c3-a609-87fcf324b37e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:13.906916 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f0748be1-c986-49c3-a609-87fcf324b37e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 200 len: 1567 microversion: 2.25 time: 0.367261 Jul 25 14:28:13.910083 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 491/934] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:13 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 1567 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:28:14.111344 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d564bcab-6a16-4e7e-8646-9b1cfacf098c tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:14.113293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d564bcab-6a16-4e7e-8646-9b1cfacf098c tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] [instance: c25476ab-b697-45f9-aa22-ead2d1b23fc7] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:14.138255 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d564bcab-6a16-4e7e-8646-9b1cfacf098c tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:14.138720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d564bcab-6a16-4e7e-8646-9b1cfacf098c tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:14.139520 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d564bcab-6a16-4e7e-8646-9b1cfacf098c tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:14.142887 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d564bcab-6a16-4e7e-8646-9b1cfacf098c tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:14.176657 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-d564bcab-6a16-4e7e-8646-9b1cfacf098c tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] HTTP exception thrown: Instance c25476ab-b697-45f9-aa22-ead2d1b23fc7 could not be found. Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d564bcab-6a16-4e7e-8646-9b1cfacf098c tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Request method failure captured: Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 HTTP/1.1 Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qf4yYofYzxTEXQNBTIEp-KcIRH20fLV2cxto8L1IFG0djUXS1dfY4Ty-tmC57NrV7MKbzocwYOVJgoUXS2GRjoaKQJtNb6dRkF78OYZfD0mNoZCJx4JiITR7kS73zJTrQ4OH0jhjJsipi4F0VJMbeIif4GqTOE6U0QTz8Mam2Wwx8M Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: e693063176af4ae1ae0942ab1b10dc73 Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersAdminTestJSON-1892283915 Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e693063176af4ae1ae0942ab1b10dc73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e693063176af4ae1ae0942ab1b10dc73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e693063176af4ae1ae0942ab1b10dc73", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e693063176af4ae1ae0942ab1b10dc73"}]}] Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersAdminTestJSON-1892283915 Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: e693063176af4ae1ae0942ab1b10dc73 Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersAdminTestJSON-1892283915 Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersAdminTestJSON-1892283915-project Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: f844b69077cc4ec087269cbb3db2f99e Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersAdminTestJSON-1892283915-project Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance c25476ab-b697-45f9-aa22-ead2d1b23fc7 could not be found. Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'c25476ab-b697-45f9-aa22-ead2d1b23fc7'} Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c25476ab-b697-45f9-aa22-ead2d1b23fc7 could not be found. Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c25476ab-b697-45f9-aa22-ead2d1b23fc7 could not be found. Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:14.179395 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:14.185065 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:14.185065 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:14.185065 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:14.185065 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:28:14.185065 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:28:14.185065 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c25476ab-b697-45f9-aa22-ead2d1b23fc7 could not be found. Jul 25 14:28:14.185065 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:14.187392 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d564bcab-6a16-4e7e-8646-9b1cfacf098c tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] Returning 404 to user: Instance c25476ab-b697-45f9-aa22-ead2d1b23fc7 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:28:14.188699 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d564bcab-6a16-4e7e-8646-9b1cfacf098c tempest-ServersAdminTestJSON-1892283915 tempest-ServersAdminTestJSON-1892283915-project] 10.222.0.88 "GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7" status: 404 len: 111 microversion: 2.1 time: 0.092697 Jul 25 14:28:14.193344 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 444/935] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:14 2022] GET /compute/v2.1/servers/c25476ab-b697-45f9-aa22-ead2d1b23fc7 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:28:14.400353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-44bc07a3-cda1-4586-842a-b820b8d03822 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:14.401000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-44bc07a3-cda1-4586-842a-b820b8d03822 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:14.419848 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-44bc07a3-cda1-4586-842a-b820b8d03822 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:14.422643 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-44bc07a3-cda1-4586-842a-b820b8d03822 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:14.425556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-44bc07a3-cda1-4586-842a-b820b8d03822 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:14.428016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-44bc07a3-cda1-4586-842a-b820b8d03822 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:14.905210 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-44bc07a3-cda1-4586-842a-b820b8d03822 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:14.919548 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-44bc07a3-cda1-4586-842a-b820b8d03822 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1477 microversion: 2.1 time: 0.521376 Jul 25 14:28:14.939196 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 492/936] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:14 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1477 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:14.947952 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1997e91d-d9e5-4f1a-ae30-11520f3f80aa tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:14.949914 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1997e91d-d9e5-4f1a-ae30-11520f3f80aa tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:14.956504 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1997e91d-d9e5-4f1a-ae30-11520f3f80aa tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:14.957077 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1997e91d-d9e5-4f1a-ae30-11520f3f80aa tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:14.958166 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1997e91d-d9e5-4f1a-ae30-11520f3f80aa tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:14.958864 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1997e91d-d9e5-4f1a-ae30-11520f3f80aa tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:15.050718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fefe6b23-d1ab-4bf7-96c9-3b8739c032cc tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-2067701536", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": "none"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:15.153114 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-fefe6b23-d1ab-4bf7-96c9-3b8739c032cc tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:28:15.153928 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-fefe6b23-d1ab-4bf7-96c9-3b8739c032cc tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:28:15.154807 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-fefe6b23-d1ab-4bf7-96c9-3b8739c032cc tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:28:15.155624 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-fefe6b23-d1ab-4bf7-96c9-3b8739c032cc tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:28:15.156428 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-fefe6b23-d1ab-4bf7-96c9-3b8739c032cc tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:28:15.162844 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:28:15.177088 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fefe6b23-d1ab-4bf7-96c9-3b8739c032cc tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:15.177772 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fefe6b23-d1ab-4bf7-96c9-3b8739c032cc tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:15.178869 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fefe6b23-d1ab-4bf7-96c9-3b8739c032cc tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:15.179593 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fefe6b23-d1ab-4bf7-96c9-3b8739c032cc tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:15.204895 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-fefe6b23-d1ab-4bf7-96c9-3b8739c032cc tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Getting quotas for project 99fb59846a68422698e4fc5576dfd95f. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:28:15.211100 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-fefe6b23-d1ab-4bf7-96c9-3b8739c032cc tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Getting quotas for user 6c2cd515ab9e4b40a33035e13ed6092e and project 99fb59846a68422698e4fc5576dfd95f. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:28:15.228245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fefe6b23-d1ab-4bf7-96c9-3b8739c032cc tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:28:15.231109 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fefe6b23-d1ab-4bf7-96c9-3b8739c032cc tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:28:15.303232 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fefe6b23-d1ab-4bf7-96c9-3b8739c032cc tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.718329 Jul 25 14:28:15.309686 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 445/937] 10.222.0.88 () {62 vars in 1188 bytes} [Mon Jul 25 14:28:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 14:28:15.319709 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-33d4df52-465a-4e7f-9525-abfa76a1e7cf tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:15.328123 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-33d4df52-465a-4e7f-9525-abfa76a1e7cf tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:15.439727 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1997e91d-d9e5-4f1a-ae30-11520f3f80aa tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:15.453231 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1997e91d-d9e5-4f1a-ae30-11520f3f80aa tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:15.454789 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1997e91d-d9e5-4f1a-ae30-11520f3f80aa tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:15.470135 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1997e91d-d9e5-4f1a-ae30-11520f3f80aa tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 200 len: 1567 microversion: 2.25 time: 0.517053 Jul 25 14:28:15.470787 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 493/938] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:14 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 1567 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:15.489042 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-33d4df52-465a-4e7f-9525-abfa76a1e7cf tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:15.497945 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-33d4df52-465a-4e7f-9525-abfa76a1e7cf tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:15.499872 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-33d4df52-465a-4e7f-9525-abfa76a1e7cf tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:15.510182 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-33d4df52-465a-4e7f-9525-abfa76a1e7cf tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "PUT /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1359 microversion: 2.75 time: 0.198052 Jul 25 14:28:15.512288 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 446/939] 10.222.0.88 () {62 vars in 1297 bytes} [Mon Jul 25 14:28:15 2022] PUT /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:15.535685 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-07b64cab-efdc-4bcd-888c-41bbfc3a4f83 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:15.536319 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-07b64cab-efdc-4bcd-888c-41bbfc3a4f83 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:15.626875 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d2751a16-1781-4ae3-bc2d-a05fe7795537 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '.version_select at 0x7f468763ed30>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:15.670434 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-d2751a16-1781-4ae3-bc2d-a05fe7795537 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] HTTP exception thrown: Image not found. Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d2751a16-1781-4ae3-bc2d-a05fe7795537 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Request method failure captured: Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/images/a9d4f5f5-3ad2-4589-8cec-dd7f0e4374f5 HTTP/1.1 Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qgcGc2RjkaZaGa63-PPdbCX4s7H2xWtuYRqlF0JWR61IUGzx74RHc-m8TJT-_RdlH0tQcWSd5UK3Q-O0K9ctQCv8954sZsqJWdlZOw1b7jo_qk8Zk2eLIrhbYh_u9wxQIss6t5T5Ti1Es5U9sr0YdlFFb4d-omgDGqaIN2Ib47NRJM Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: c0116982ed03475097096c73b5f03035 Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0116982ed03475097096c73b5f03035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0116982ed03475097096c73b5f03035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0116982ed03475097096c73b5f03035", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0116982ed03475097096c73b5f03035"}]}] Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: c0116982ed03475097096c73b5f03035 Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ImagesOneServerNegativeTestJSON-745484288-project Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: f1b1656f2dcd4ffebac55bf18110ff63 Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-745484288-project Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: exception: Image not found. Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'a9d4f5f5-3ad2-4589-8cec-dd7f0e4374f5'} Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a9d4f5f5-3ad2-4589-8cec-dd7f0e4374f5 to delete Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a9d4f5f5-3ad2-4589-8cec-dd7f0e4374f5 could not be found. Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:15.672358 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:15.676294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:15.676294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:15.676294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:15.676294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:28:15.676294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:28:15.676294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:28:15.676294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:28:15.676294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:28:15.676294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:28:15.676294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 14:28:15.676294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 14:28:15.676294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 14:28:15.676294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:15.676294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:15.676294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:15.676294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:15.676294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:15.676294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:15.676294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:28:15.676294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:28:15.676294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 14:28:15.676294 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:15.676294 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d2751a16-1781-4ae3-bc2d-a05fe7795537 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Returning 404 to user: Image not found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:28:15.676294 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d2751a16-1781-4ae3-bc2d-a05fe7795537 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "DELETE /compute/v2.1/images/a9d4f5f5-3ad2-4589-8cec-dd7f0e4374f5" status: 404 len: 62 microversion: 2.1 time: 0.051060 Jul 25 14:28:15.677752 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 447/940] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:15 2022] DELETE /compute/v2.1/images/a9d4f5f5-3ad2-4589-8cec-dd7f0e4374f5 => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 25 14:28:15.683708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7191da9e-f928-4ef1-a056-66f95a1b4f38 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:15.686533 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7191da9e-f928-4ef1-a056-66f95a1b4f38 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 04c1923b-e18a-408f-99b1-62d86feb25a1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:15.694724 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7191da9e-f928-4ef1-a056-66f95a1b4f38 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:15.695424 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7191da9e-f928-4ef1-a056-66f95a1b4f38 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:15.696487 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7191da9e-f928-4ef1-a056-66f95a1b4f38 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:15.696717 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-07b64cab-efdc-4bcd-888c-41bbfc3a4f83 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:15.697305 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7191da9e-f928-4ef1-a056-66f95a1b4f38 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:15.705654 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-07b64cab-efdc-4bcd-888c-41bbfc3a4f83 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:15.714087 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-7191da9e-f928-4ef1-a056-66f95a1b4f38 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] HTTP exception thrown: Instance 04c1923b-e18a-408f-99b1-62d86feb25a1 could not be found. Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7191da9e-f928-4ef1-a056-66f95a1b4f38 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Request method failure captured: Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1 HTTP/1.1 Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qgcGc2RjkaZaGa63-PPdbCX4s7H2xWtuYRqlF0JWR61IUGzx74RHc-m8TJT-_RdlH0tQcWSd5UK3Q-O0K9ctQCv8954sZsqJWdlZOw1b7jo_qk8Zk2eLIrhbYh_u9wxQIss6t5T5Ti1Es5U9sr0YdlFFb4d-omgDGqaIN2Ib47NRJM Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: c0116982ed03475097096c73b5f03035 Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0116982ed03475097096c73b5f03035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0116982ed03475097096c73b5f03035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0116982ed03475097096c73b5f03035", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0116982ed03475097096c73b5f03035"}]}] Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: c0116982ed03475097096c73b5f03035 Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ImagesOneServerNegativeTestJSON-745484288-project Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: f1b1656f2dcd4ffebac55bf18110ff63 Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-745484288-project Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 04c1923b-e18a-408f-99b1-62d86feb25a1 could not be found. Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '04c1923b-e18a-408f-99b1-62d86feb25a1'} Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04c1923b-e18a-408f-99b1-62d86feb25a1 could not be found. Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:28:15.715851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:28:15.720521 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04c1923b-e18a-408f-99b1-62d86feb25a1 could not be found. Jul 25 14:28:15.720521 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:15.720521 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:15.720521 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:15.720521 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:15.720521 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:15.720521 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:15.720521 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:28:15.720521 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:28:15.720521 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04c1923b-e18a-408f-99b1-62d86feb25a1 could not be found. Jul 25 14:28:15.720521 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:15.722703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7191da9e-f928-4ef1-a056-66f95a1b4f38 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Returning 404 to user: Instance 04c1923b-e18a-408f-99b1-62d86feb25a1 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:28:15.723580 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7191da9e-f928-4ef1-a056-66f95a1b4f38 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "DELETE /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1" status: 404 len: 111 microversion: 2.1 time: 0.043807 Jul 25 14:28:15.726718 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-07b64cab-efdc-4bcd-888c-41bbfc3a4f83 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:15.729369 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 448/941] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:28:15 2022] DELETE /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:28:15.735506 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-06112a0c-fe28-4fa6-8e43-9a8bbbe474b0 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:15.736484 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-06112a0c-fe28-4fa6-8e43-9a8bbbe474b0 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] [instance: 04c1923b-e18a-408f-99b1-62d86feb25a1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:15.747909 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-07b64cab-efdc-4bcd-888c-41bbfc3a4f83 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1359 microversion: 2.75 time: 0.216340 Jul 25 14:28:15.748979 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 494/942] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:15 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:15.766489 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-06112a0c-fe28-4fa6-8e43-9a8bbbe474b0 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:15.767194 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-06112a0c-fe28-4fa6-8e43-9a8bbbe474b0 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:15.768214 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-06112a0c-fe28-4fa6-8e43-9a8bbbe474b0 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:15.768804 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-06112a0c-fe28-4fa6-8e43-9a8bbbe474b0 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:15.788419 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-06112a0c-fe28-4fa6-8e43-9a8bbbe474b0 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] HTTP exception thrown: Instance 04c1923b-e18a-408f-99b1-62d86feb25a1 could not be found. Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-06112a0c-fe28-4fa6-8e43-9a8bbbe474b0 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Request method failure captured: Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1 HTTP/1.1 Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qgcGc2RjkaZaGa63-PPdbCX4s7H2xWtuYRqlF0JWR61IUGzx74RHc-m8TJT-_RdlH0tQcWSd5UK3Q-O0K9ctQCv8954sZsqJWdlZOw1b7jo_qk8Zk2eLIrhbYh_u9wxQIss6t5T5Ti1Es5U9sr0YdlFFb4d-omgDGqaIN2Ib47NRJM Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: c0116982ed03475097096c73b5f03035 Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0116982ed03475097096c73b5f03035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c0116982ed03475097096c73b5f03035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c0116982ed03475097096c73b5f03035", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c0116982ed03475097096c73b5f03035"}]}] Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: c0116982ed03475097096c73b5f03035 Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-745484288 Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ImagesOneServerNegativeTestJSON-745484288-project Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: f1b1656f2dcd4ffebac55bf18110ff63 Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-745484288-project Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 04c1923b-e18a-408f-99b1-62d86feb25a1 could not be found. Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '04c1923b-e18a-408f-99b1-62d86feb25a1'} Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04c1923b-e18a-408f-99b1-62d86feb25a1 could not be found. Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04c1923b-e18a-408f-99b1-62d86feb25a1 could not be found. Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:15.790355 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:15.795434 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:15.795434 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:15.795434 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:15.795434 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:15.795434 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:28:15.795434 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:28:15.795434 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04c1923b-e18a-408f-99b1-62d86feb25a1 could not be found. Jul 25 14:28:15.795434 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:15.798317 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-06112a0c-fe28-4fa6-8e43-9a8bbbe474b0 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] Returning 404 to user: Instance 04c1923b-e18a-408f-99b1-62d86feb25a1 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:28:15.800008 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-06112a0c-fe28-4fa6-8e43-9a8bbbe474b0 tempest-ImagesOneServerNegativeTestJSON-745484288 tempest-ImagesOneServerNegativeTestJSON-745484288-project] 10.222.0.88 "GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1" status: 404 len: 111 microversion: 2.1 time: 0.069216 Jul 25 14:28:15.800836 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 449/943] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:15 2022] GET /compute/v2.1/servers/04c1923b-e18a-408f-99b1-62d86feb25a1 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:28:15.952651 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-36d9eb2a-bf17-40b6-83c5-4ca743260b88 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:15.953273 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-36d9eb2a-bf17-40b6-83c5-4ca743260b88 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:15.963593 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-36d9eb2a-bf17-40b6-83c5-4ca743260b88 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:15.964344 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-36d9eb2a-bf17-40b6-83c5-4ca743260b88 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:15.965290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-36d9eb2a-bf17-40b6-83c5-4ca743260b88 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:15.966018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-36d9eb2a-bf17-40b6-83c5-4ca743260b88 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:16.014907 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-57ee37f4-1311-4649-aa02-1d903e5b7168 req-bb9bc359-c366-4406-a1a2-6f3d700c3315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3d2010c-4e0c-412e-9b66-8fbac6510097", "name": "network-vif-unplugged", "status": "completed", "tag": "520cf9de-1166-4382-a12f-5e27acc8c55e"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:16.036703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-57ee37f4-1311-4649-aa02-1d903e5b7168 req-bb9bc359-c366-4406-a1a2-6f3d700c3315 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:16.037784 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-57ee37f4-1311-4649-aa02-1d903e5b7168 req-bb9bc359-c366-4406-a1a2-6f3d700c3315 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:16.092255 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-57ee37f4-1311-4649-aa02-1d903e5b7168 req-bb9bc359-c366-4406-a1a2-6f3d700c3315 service nova] Creating event network-vif-unplugged:520cf9de-1166-4382-a12f-5e27acc8c55e for instance b3d2010c-4e0c-412e-9b66-8fbac6510097 on n-h2-846435-14 Jul 25 14:28:16.104057 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-57ee37f4-1311-4649-aa02-1d903e5b7168 req-bb9bc359-c366-4406-a1a2-6f3d700c3315 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095792 Jul 25 14:28:16.106853 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 450/944] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:16.496984 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d05a2906-5762-4b89-bb59-790335113f9a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:16.498072 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d05a2906-5762-4b89-bb59-790335113f9a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:16.514787 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d05a2906-5762-4b89-bb59-790335113f9a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:16.515643 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d05a2906-5762-4b89-bb59-790335113f9a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:16.516711 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d05a2906-5762-4b89-bb59-790335113f9a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:16.517720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d05a2906-5762-4b89-bb59-790335113f9a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:16.615933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-36d9eb2a-bf17-40b6-83c5-4ca743260b88 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:16.624654 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-36d9eb2a-bf17-40b6-83c5-4ca743260b88 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1477 microversion: 2.1 time: 0.677109 Jul 25 14:28:16.638435 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 495/945] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:15 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1477 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:16.782670 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-61c0304c-a128-47db-a850-7716bb43463d tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:16.784155 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-61c0304c-a128-47db-a850-7716bb43463d tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:16.803776 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-61c0304c-a128-47db-a850-7716bb43463d tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:16.804290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-61c0304c-a128-47db-a850-7716bb43463d tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:16.817481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-61c0304c-a128-47db-a850-7716bb43463d tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:16.820329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-61c0304c-a128-47db-a850-7716bb43463d tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:17.041103 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d05a2906-5762-4b89-bb59-790335113f9a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:17.055335 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d05a2906-5762-4b89-bb59-790335113f9a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:17.057128 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d05a2906-5762-4b89-bb59-790335113f9a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:17.061044 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d05a2906-5762-4b89-bb59-790335113f9a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 200 len: 1567 microversion: 2.25 time: 0.569979 Jul 25 14:28:17.077154 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 451/946] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:16 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 1567 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:17.203822 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-61c0304c-a128-47db-a850-7716bb43463d tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:17.216710 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-61c0304c-a128-47db-a850-7716bb43463d tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:17.218785 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-61c0304c-a128-47db-a850-7716bb43463d tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:17.227348 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-61c0304c-a128-47db-a850-7716bb43463d tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1355 microversion: 2.75 time: 0.450210 Jul 25 14:28:17.228276 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 496/947] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:16 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1355 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:17.664218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6f2dae7e-657f-41f0-bf81-99403d5b100a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:17.665477 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6f2dae7e-657f-41f0-bf81-99403d5b100a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:17.688547 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6f2dae7e-657f-41f0-bf81-99403d5b100a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:17.697470 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6f2dae7e-657f-41f0-bf81-99403d5b100a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:17.698592 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6f2dae7e-657f-41f0-bf81-99403d5b100a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:17.700800 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6f2dae7e-657f-41f0-bf81-99403d5b100a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:17.926767 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6f2dae7e-657f-41f0-bf81-99403d5b100a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:17.938204 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6f2dae7e-657f-41f0-bf81-99403d5b100a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1477 microversion: 2.1 time: 0.277889 Jul 25 14:28:17.940705 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 452/948] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:17 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1477 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:18.093727 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-818c5982-bc2e-41b0-bd48-d2a35e7a39a5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:18.095134 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-818c5982-bc2e-41b0-bd48-d2a35e7a39a5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:18.131071 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-a343335f-48fa-49dd-b696-0af0883474fc req-21cf326d-6276-42c4-9f56-7a16bafc8347 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3d2010c-4e0c-412e-9b66-8fbac6510097", "tag": "520cf9de-1166-4382-a12f-5e27acc8c55e"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:18.134846 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-818c5982-bc2e-41b0-bd48-d2a35e7a39a5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:18.135301 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-818c5982-bc2e-41b0-bd48-d2a35e7a39a5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:18.136141 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-818c5982-bc2e-41b0-bd48-d2a35e7a39a5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:18.136552 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-818c5982-bc2e-41b0-bd48-d2a35e7a39a5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:18.166226 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-a343335f-48fa-49dd-b696-0af0883474fc req-21cf326d-6276-42c4-9f56-7a16bafc8347 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:18.166694 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-a343335f-48fa-49dd-b696-0af0883474fc req-21cf326d-6276-42c4-9f56-7a16bafc8347 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:18.218734 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-a343335f-48fa-49dd-b696-0af0883474fc req-21cf326d-6276-42c4-9f56-7a16bafc8347 service nova] Creating event network-changed:520cf9de-1166-4382-a12f-5e27acc8c55e for instance b3d2010c-4e0c-412e-9b66-8fbac6510097 on n-h2-846435-14 Jul 25 14:28:18.237402 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-a343335f-48fa-49dd-b696-0af0883474fc req-21cf326d-6276-42c4-9f56-7a16bafc8347 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109564 Jul 25 14:28:18.240388 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 453/949] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:18.255054 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-40444abf-d271-453d-9e53-ddd2acc9c512 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:18.261078 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-40444abf-d271-453d-9e53-ddd2acc9c512 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:18.277289 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-40444abf-d271-453d-9e53-ddd2acc9c512 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:18.281684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-40444abf-d271-453d-9e53-ddd2acc9c512 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:18.286429 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-40444abf-d271-453d-9e53-ddd2acc9c512 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:18.290869 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-40444abf-d271-453d-9e53-ddd2acc9c512 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:18.471071 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-818c5982-bc2e-41b0-bd48-d2a35e7a39a5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:18.483928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-818c5982-bc2e-41b0-bd48-d2a35e7a39a5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:18.488285 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-818c5982-bc2e-41b0-bd48-d2a35e7a39a5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:18.490616 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-818c5982-bc2e-41b0-bd48-d2a35e7a39a5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 200 len: 1567 microversion: 2.25 time: 0.403509 Jul 25 14:28:18.493127 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 497/950] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:18 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 1567 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:18.665678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-40444abf-d271-453d-9e53-ddd2acc9c512 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:18.679461 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-40444abf-d271-453d-9e53-ddd2acc9c512 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:18.682310 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-40444abf-d271-453d-9e53-ddd2acc9c512 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:18.691299 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-40444abf-d271-453d-9e53-ddd2acc9c512 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1417 microversion: 2.75 time: 0.441910 Jul 25 14:28:18.693223 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 454/951] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:18 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1417 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:18.963018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-aa46ff63-4238-4d8b-a017-ec3c9a94352e tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:18.964031 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-aa46ff63-4238-4d8b-a017-ec3c9a94352e tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:18.971633 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aa46ff63-4238-4d8b-a017-ec3c9a94352e tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:18.972438 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aa46ff63-4238-4d8b-a017-ec3c9a94352e tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:18.973418 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aa46ff63-4238-4d8b-a017-ec3c9a94352e tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:18.973922 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aa46ff63-4238-4d8b-a017-ec3c9a94352e tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:19.326559 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-aa46ff63-4238-4d8b-a017-ec3c9a94352e tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:19.341314 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-aa46ff63-4238-4d8b-a017-ec3c9a94352e tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1477 microversion: 2.1 time: 0.384014 Jul 25 14:28:19.343169 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 498/952] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:18 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1477 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:19.514912 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e3aa8cd0-6fe3-452a-924b-6f09899180d7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:19.515436 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e3aa8cd0-6fe3-452a-924b-6f09899180d7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:19.526713 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3aa8cd0-6fe3-452a-924b-6f09899180d7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:19.527451 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3aa8cd0-6fe3-452a-924b-6f09899180d7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:19.528735 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3aa8cd0-6fe3-452a-924b-6f09899180d7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:19.531030 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3aa8cd0-6fe3-452a-924b-6f09899180d7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:19.720717 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-93e9bd56-9ab2-47e8-80ff-1bda982f6987 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:19.722032 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-93e9bd56-9ab2-47e8-80ff-1bda982f6987 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:19.729773 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-93e9bd56-9ab2-47e8-80ff-1bda982f6987 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:19.730453 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-93e9bd56-9ab2-47e8-80ff-1bda982f6987 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:19.731425 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-93e9bd56-9ab2-47e8-80ff-1bda982f6987 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:19.732074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-93e9bd56-9ab2-47e8-80ff-1bda982f6987 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:19.753211 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e3aa8cd0-6fe3-452a-924b-6f09899180d7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:19.767199 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e3aa8cd0-6fe3-452a-924b-6f09899180d7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:19.777158 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e3aa8cd0-6fe3-452a-924b-6f09899180d7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:19.778772 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e3aa8cd0-6fe3-452a-924b-6f09899180d7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 200 len: 1567 microversion: 2.25 time: 0.268044 Jul 25 14:28:19.779836 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 455/953] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:19 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 1567 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:19.856614 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-93e9bd56-9ab2-47e8-80ff-1bda982f6987 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:19.866458 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-93e9bd56-9ab2-47e8-80ff-1bda982f6987 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:19.871592 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-93e9bd56-9ab2-47e8-80ff-1bda982f6987 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:19.882206 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-93e9bd56-9ab2-47e8-80ff-1bda982f6987 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1417 microversion: 2.75 time: 0.166131 Jul 25 14:28:19.882810 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 499/954] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:19 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1417 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:28:20.197657 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-99f398b4-ab40-4008-8f99-b52ccb097d4b tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-2146326521", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:20.255375 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-99f398b4-ab40-4008-8f99-b52ccb097d4b tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] validate_networks() for None {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:28:20.368275 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a4ecd086-881e-4589-bb49-f736425bfb36 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:20.368898 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a4ecd086-881e-4589-bb49-f736425bfb36 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:20.379402 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4ecd086-881e-4589-bb49-f736425bfb36 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:20.380393 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4ecd086-881e-4589-bb49-f736425bfb36 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:20.381503 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4ecd086-881e-4589-bb49-f736425bfb36 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:20.382666 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4ecd086-881e-4589-bb49-f736425bfb36 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:20.721156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a4ecd086-881e-4589-bb49-f736425bfb36 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:20.734356 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a4ecd086-881e-4589-bb49-f736425bfb36 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1477 microversion: 2.1 time: 0.374931 Jul 25 14:28:20.749505 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 500/955] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:20 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1477 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:20.807663 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-aa095a92-b61f-4a7a-affc-4b88f77f570c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:20.808398 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-aa095a92-b61f-4a7a-affc-4b88f77f570c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:20.824070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aa095a92-b61f-4a7a-affc-4b88f77f570c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:20.824630 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aa095a92-b61f-4a7a-affc-4b88f77f570c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:20.827808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aa095a92-b61f-4a7a-affc-4b88f77f570c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:20.828530 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aa095a92-b61f-4a7a-affc-4b88f77f570c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:21.118698 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-99f398b4-ab40-4008-8f99-b52ccb097d4b tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:28:21.119793 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-99f398b4-ab40-4008-8f99-b52ccb097d4b tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:28:21.120734 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-99f398b4-ab40-4008-8f99-b52ccb097d4b tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:28:21.121332 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-99f398b4-ab40-4008-8f99-b52ccb097d4b tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:28:21.121915 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-99f398b4-ab40-4008-8f99-b52ccb097d4b tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:28:21.141146 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99f398b4-ab40-4008-8f99-b52ccb097d4b tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:21.142261 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99f398b4-ab40-4008-8f99-b52ccb097d4b tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:21.143352 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99f398b4-ab40-4008-8f99-b52ccb097d4b tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:21.144035 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99f398b4-ab40-4008-8f99-b52ccb097d4b tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:21.195532 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-99f398b4-ab40-4008-8f99-b52ccb097d4b tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Getting quotas for project 1b38ea3df00a4a6c84834a04fadc2901. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:28:21.204773 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-99f398b4-ab40-4008-8f99-b52ccb097d4b tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Getting quotas for user e734f14df14d4621be6343f462b81a27 and project 1b38ea3df00a4a6c84834a04fadc2901. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:28:21.223601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-99f398b4-ab40-4008-8f99-b52ccb097d4b tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:28:21.228585 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-99f398b4-ab40-4008-8f99-b52ccb097d4b tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] [instance: 66394997-4341-4d25-a34a-a479e299fe03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:28:21.352325 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-99f398b4-ab40-4008-8f99-b52ccb097d4b tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.382535 Jul 25 14:28:21.360082 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 456/956] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:28:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:28:21.376795 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-619c9019-6d09-400f-93ca-5faf9d1a70b5 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:21.377423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-619c9019-6d09-400f-93ca-5faf9d1a70b5 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:21.401161 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-619c9019-6d09-400f-93ca-5faf9d1a70b5 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:21.402569 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-619c9019-6d09-400f-93ca-5faf9d1a70b5 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:21.403648 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-619c9019-6d09-400f-93ca-5faf9d1a70b5 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:21.412533 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-619c9019-6d09-400f-93ca-5faf9d1a70b5 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:21.580322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-aa095a92-b61f-4a7a-affc-4b88f77f570c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:21.628650 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-aa095a92-b61f-4a7a-affc-4b88f77f570c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:21.633885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-aa095a92-b61f-4a7a-affc-4b88f77f570c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:21.646862 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-aa095a92-b61f-4a7a-affc-4b88f77f570c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 200 len: 1567 microversion: 2.25 time: 0.841511 Jul 25 14:28:21.647720 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 501/957] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:20 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 1567 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:21.681513 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5ce9cf1d-8428-40b3-a15e-a507aba56c90 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:21.682500 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5ce9cf1d-8428-40b3-a15e-a507aba56c90 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] [instance: 66394997-4341-4d25-a34a-a479e299fe03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:21.837691 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-619c9019-6d09-400f-93ca-5faf9d1a70b5 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:21.867472 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-619c9019-6d09-400f-93ca-5faf9d1a70b5 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:21.868357 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5ce9cf1d-8428-40b3-a15e-a507aba56c90 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e734f14df14d4621be6343f462b81a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38ea3df00a4a6c84834a04fadc2901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:21.872631 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-619c9019-6d09-400f-93ca-5faf9d1a70b5 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:21.881041 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5ce9cf1d-8428-40b3-a15e-a507aba56c90 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] 10.222.0.88 "GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03" status: 200 len: 1214 microversion: 2.1 time: 0.218815 Jul 25 14:28:21.884509 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 502/958] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:21 2022] GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03 => generated 1214 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:21.900770 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fced1387-5802-4fed-a727-194e832fa998 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:21.900967 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-619c9019-6d09-400f-93ca-5faf9d1a70b5 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1417 microversion: 2.75 time: 0.539190 Jul 25 14:28:21.901727 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fced1387-5802-4fed-a727-194e832fa998 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:21.904343 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 457/959] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:21 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1417 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:21.912884 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fced1387-5802-4fed-a727-194e832fa998 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:21.913646 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fced1387-5802-4fed-a727-194e832fa998 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:21.914694 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fced1387-5802-4fed-a727-194e832fa998 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:21.915279 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fced1387-5802-4fed-a727-194e832fa998 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:22.300371 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fced1387-5802-4fed-a727-194e832fa998 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:22.313535 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fced1387-5802-4fed-a727-194e832fa998 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1477 microversion: 2.1 time: 0.427774 Jul 25 14:28:22.324417 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 503/960] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:21 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1477 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:22.674877 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-60844f75-62ce-4cb3-ad87-d6ca7a389ccd tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:22.676256 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-60844f75-62ce-4cb3-ad87-d6ca7a389ccd tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:22.690386 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-60844f75-62ce-4cb3-ad87-d6ca7a389ccd tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:22.690950 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-60844f75-62ce-4cb3-ad87-d6ca7a389ccd tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:22.691874 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-60844f75-62ce-4cb3-ad87-d6ca7a389ccd tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:22.692530 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-60844f75-62ce-4cb3-ad87-d6ca7a389ccd tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:22.905226 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d520a469-8b86-486e-8880-3eed90d71e86 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:22.906437 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d520a469-8b86-486e-8880-3eed90d71e86 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] [instance: 66394997-4341-4d25-a34a-a479e299fe03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:22.918966 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d520a469-8b86-486e-8880-3eed90d71e86 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:22.919418 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d520a469-8b86-486e-8880-3eed90d71e86 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:22.921198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d520a469-8b86-486e-8880-3eed90d71e86 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:22.923382 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d520a469-8b86-486e-8880-3eed90d71e86 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:22.972336 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=10 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:28:23.050140 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d520a469-8b86-486e-8880-3eed90d71e86 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e734f14df14d4621be6343f462b81a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38ea3df00a4a6c84834a04fadc2901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:23.060198 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d520a469-8b86-486e-8880-3eed90d71e86 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] 10.222.0.88 "GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03" status: 200 len: 1266 microversion: 2.1 time: 0.158968 Jul 25 14:28:23.061708 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 504/961] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:22 2022] GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:28:23.068636 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c8538408-cc72-4ba7-af9e-e662bd91d856 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:23.069632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c8538408-cc72-4ba7-af9e-e662bd91d856 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:23.078064 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c8538408-cc72-4ba7-af9e-e662bd91d856 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:23.079512 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c8538408-cc72-4ba7-af9e-e662bd91d856 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:23.081394 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c8538408-cc72-4ba7-af9e-e662bd91d856 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:23.082077 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c8538408-cc72-4ba7-af9e-e662bd91d856 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:23.174581 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c8538408-cc72-4ba7-af9e-e662bd91d856 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:23.187273 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c8538408-cc72-4ba7-af9e-e662bd91d856 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:23.189602 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c8538408-cc72-4ba7-af9e-e662bd91d856 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:23.196012 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c8538408-cc72-4ba7-af9e-e662bd91d856 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1438 microversion: 2.75 time: 0.132927 Jul 25 14:28:23.196951 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 505/962] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:23 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1438 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:23.201928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-91ed5923-d12d-4f4c-82b3-31d4b8128480 req-47e06768-aca7-493b-8d2d-245482399f49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3d2010c-4e0c-412e-9b66-8fbac6510097", "name": "network-vif-unplugged", "status": "completed", "tag": "520cf9de-1166-4382-a12f-5e27acc8c55e"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:23.212264 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-91ed5923-d12d-4f4c-82b3-31d4b8128480 req-47e06768-aca7-493b-8d2d-245482399f49 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:23.212942 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-91ed5923-d12d-4f4c-82b3-31d4b8128480 req-47e06768-aca7-493b-8d2d-245482399f49 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:23.236065 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-91ed5923-d12d-4f4c-82b3-31d4b8128480 req-47e06768-aca7-493b-8d2d-245482399f49 service nova] Creating event network-vif-unplugged:520cf9de-1166-4382-a12f-5e27acc8c55e for instance b3d2010c-4e0c-412e-9b66-8fbac6510097 on n-h2-846435-14 Jul 25 14:28:23.241899 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-91ed5923-d12d-4f4c-82b3-31d4b8128480 req-47e06768-aca7-493b-8d2d-245482399f49 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043612 Jul 25 14:28:23.242868 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 506/963] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:23.248646 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dbb97141-cc87-46f6-92c3-22a685168ce6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:23.252826 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dbb97141-cc87-46f6-92c3-22a685168ce6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:23.260314 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dbb97141-cc87-46f6-92c3-22a685168ce6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:23.261562 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dbb97141-cc87-46f6-92c3-22a685168ce6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:23.262676 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dbb97141-cc87-46f6-92c3-22a685168ce6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:23.263415 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dbb97141-cc87-46f6-92c3-22a685168ce6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:23.273056 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:28:23.368392 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-dbb97141-cc87-46f6-92c3-22a685168ce6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:28:23.369316 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-dbb97141-cc87-46f6-92c3-22a685168ce6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:28:23.370048 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-dbb97141-cc87-46f6-92c3-22a685168ce6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:28:23.370792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-dbb97141-cc87-46f6-92c3-22a685168ce6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:28:23.371439 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-dbb97141-cc87-46f6-92c3-22a685168ce6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:28:23.402915 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-60844f75-62ce-4cb3-ad87-d6ca7a389ccd tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:23.427068 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-60844f75-62ce-4cb3-ad87-d6ca7a389ccd tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:23.432430 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-60844f75-62ce-4cb3-ad87-d6ca7a389ccd tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:23.434277 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-60844f75-62ce-4cb3-ad87-d6ca7a389ccd tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 200 len: 1567 microversion: 2.25 time: 0.763981 Jul 25 14:28:23.437803 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 458/964] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:22 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 1567 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:23.446653 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9ef673cf-2540-43db-8099-e2aa3211eb96 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:23.448827 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9ef673cf-2540-43db-8099-e2aa3211eb96 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:23.460898 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9ef673cf-2540-43db-8099-e2aa3211eb96 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:23.461941 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9ef673cf-2540-43db-8099-e2aa3211eb96 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:23.463149 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9ef673cf-2540-43db-8099-e2aa3211eb96 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:23.464094 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9ef673cf-2540-43db-8099-e2aa3211eb96 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:23.518902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dbb97141-cc87-46f6-92c3-22a685168ce6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:23.535225 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:28:23.542010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dbb97141-cc87-46f6-92c3-22a685168ce6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:23.542472 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dbb97141-cc87-46f6-92c3-22a685168ce6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:23.543575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dbb97141-cc87-46f6-92c3-22a685168ce6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:23.544034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dbb97141-cc87-46f6-92c3-22a685168ce6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:23.970485 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dbb97141-cc87-46f6-92c3-22a685168ce6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:23.982841 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dbb97141-cc87-46f6-92c3-22a685168ce6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:23.990249 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dbb97141-cc87-46f6-92c3-22a685168ce6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:24.001297 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dbb97141-cc87-46f6-92c3-22a685168ce6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "POST /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1/action" status: 202 len: 1495 microversion: 2.75 time: 0.756931 Jul 25 14:28:24.008554 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 507/965] 10.222.0.88 () {62 vars in 1319 bytes} [Mon Jul 25 14:28:23 2022] POST /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1/action => generated 1495 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 25 14:28:24.032345 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a652cd08-a8f5-4974-b8f6-2d2c619fdb22 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:24.033234 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a652cd08-a8f5-4974-b8f6-2d2c619fdb22 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:24.035538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:28:24.044548 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a652cd08-a8f5-4974-b8f6-2d2c619fdb22 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:24.049991 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a652cd08-a8f5-4974-b8f6-2d2c619fdb22 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:24.051135 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a652cd08-a8f5-4974-b8f6-2d2c619fdb22 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:24.051730 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a652cd08-a8f5-4974-b8f6-2d2c619fdb22 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:24.196386 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a652cd08-a8f5-4974-b8f6-2d2c619fdb22 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:24.220339 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a652cd08-a8f5-4974-b8f6-2d2c619fdb22 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:24.226362 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a652cd08-a8f5-4974-b8f6-2d2c619fdb22 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:24.237649 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a652cd08-a8f5-4974-b8f6-2d2c619fdb22 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1447 microversion: 2.75 time: 0.209385 Jul 25 14:28:24.240362 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 508/966] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:24 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1447 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:24.258494 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-33fa9d1b-ab65-4e73-913f-8500576c4bde tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:24.259373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-33fa9d1b-ab65-4e73-913f-8500576c4bde tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] [instance: 66394997-4341-4d25-a34a-a479e299fe03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:24.266960 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-33fa9d1b-ab65-4e73-913f-8500576c4bde tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:24.267416 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-33fa9d1b-ab65-4e73-913f-8500576c4bde tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:24.268224 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-33fa9d1b-ab65-4e73-913f-8500576c4bde tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:24.271562 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-33fa9d1b-ab65-4e73-913f-8500576c4bde tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:24.358734 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-33fa9d1b-ab65-4e73-913f-8500576c4bde tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e734f14df14d4621be6343f462b81a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38ea3df00a4a6c84834a04fadc2901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:24.366817 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-33fa9d1b-ab65-4e73-913f-8500576c4bde tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] 10.222.0.88 "GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03" status: 200 len: 1272 microversion: 2.1 time: 0.125032 Jul 25 14:28:24.367943 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 509/967] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:24 2022] GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03 => generated 1272 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:24.439873 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9ef673cf-2540-43db-8099-e2aa3211eb96 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:24.449831 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9ef673cf-2540-43db-8099-e2aa3211eb96 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1477 microversion: 2.1 time: 1.008988 Jul 25 14:28:24.451830 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 459/968] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:23 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1477 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:24.471702 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6324af4b-ff82-4327-a3c4-5b74e92ad01e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:24.473170 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6324af4b-ff82-4327-a3c4-5b74e92ad01e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:24.488022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6324af4b-ff82-4327-a3c4-5b74e92ad01e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:24.488504 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6324af4b-ff82-4327-a3c4-5b74e92ad01e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:24.489315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6324af4b-ff82-4327-a3c4-5b74e92ad01e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:24.489770 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6324af4b-ff82-4327-a3c4-5b74e92ad01e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:24.714276 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6324af4b-ff82-4327-a3c4-5b74e92ad01e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:24.725055 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6324af4b-ff82-4327-a3c4-5b74e92ad01e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:24.726986 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6324af4b-ff82-4327-a3c4-5b74e92ad01e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:24.728164 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6324af4b-ff82-4327-a3c4-5b74e92ad01e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 200 len: 1567 microversion: 2.25 time: 0.260395 Jul 25 14:28:24.743923 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 510/969] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:24 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 1567 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:25.266867 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-335df368-c10a-4133-a6a4-55215afd79da tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:25.267475 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-335df368-c10a-4133-a6a4-55215afd79da tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:25.285552 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-335df368-c10a-4133-a6a4-55215afd79da tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:25.286036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-335df368-c10a-4133-a6a4-55215afd79da tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:25.286818 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-335df368-c10a-4133-a6a4-55215afd79da tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:25.287247 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-335df368-c10a-4133-a6a4-55215afd79da tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:25.389804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-edd196ef-8225-4c58-a0ec-9d7b3078397f tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:25.391294 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-edd196ef-8225-4c58-a0ec-9d7b3078397f tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] [instance: 66394997-4341-4d25-a34a-a479e299fe03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:25.398181 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-edd196ef-8225-4c58-a0ec-9d7b3078397f tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:25.398879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-edd196ef-8225-4c58-a0ec-9d7b3078397f tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:25.399849 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-edd196ef-8225-4c58-a0ec-9d7b3078397f tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:25.400867 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-edd196ef-8225-4c58-a0ec-9d7b3078397f tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:25.441213 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-335df368-c10a-4133-a6a4-55215afd79da tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:25.451642 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-335df368-c10a-4133-a6a4-55215afd79da tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:25.453803 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-335df368-c10a-4133-a6a4-55215afd79da tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:25.461727 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-335df368-c10a-4133-a6a4-55215afd79da tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1447 microversion: 2.75 time: 0.198849 Jul 25 14:28:25.463205 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 460/970] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:25 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1447 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:25.475122 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8700021a-9c6e-4ef8-bd0a-b4640acb8158 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:25.478949 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8700021a-9c6e-4ef8-bd0a-b4640acb8158 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:25.486792 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8700021a-9c6e-4ef8-bd0a-b4640acb8158 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:25.487734 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8700021a-9c6e-4ef8-bd0a-b4640acb8158 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:25.488997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8700021a-9c6e-4ef8-bd0a-b4640acb8158 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:25.489672 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8700021a-9c6e-4ef8-bd0a-b4640acb8158 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:25.543011 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-edd196ef-8225-4c58-a0ec-9d7b3078397f tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e734f14df14d4621be6343f462b81a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38ea3df00a4a6c84834a04fadc2901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:25.552289 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-edd196ef-8225-4c58-a0ec-9d7b3078397f tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] 10.222.0.88 "GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03" status: 200 len: 1272 microversion: 2.1 time: 0.166193 Jul 25 14:28:25.566247 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 511/971] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:25 2022] GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03 => generated 1272 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:25.754346 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-782c0bff-8db5-4d54-bb06-de68ed315168 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:25.755513 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-782c0bff-8db5-4d54-bb06-de68ed315168 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:25.761805 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-782c0bff-8db5-4d54-bb06-de68ed315168 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:25.762497 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-782c0bff-8db5-4d54-bb06-de68ed315168 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:25.763323 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-782c0bff-8db5-4d54-bb06-de68ed315168 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:25.763837 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-782c0bff-8db5-4d54-bb06-de68ed315168 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:25.914279 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-782c0bff-8db5-4d54-bb06-de68ed315168 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:25.924100 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-782c0bff-8db5-4d54-bb06-de68ed315168 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:25.926215 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-782c0bff-8db5-4d54-bb06-de68ed315168 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:25.927764 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-782c0bff-8db5-4d54-bb06-de68ed315168 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 200 len: 1567 microversion: 2.25 time: 0.177358 Jul 25 14:28:25.945571 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 512/972] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:25 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 1567 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:25.993466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8700021a-9c6e-4ef8-bd0a-b4640acb8158 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:26.006153 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8700021a-9c6e-4ef8-bd0a-b4640acb8158 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1477 microversion: 2.1 time: 0.536232 Jul 25 14:28:26.008044 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 461/973] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:25 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1477 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:26.249841 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c425a190-1be8-4d2e-bf73-7f8d6007de0f tempest-ListImagesTestJSON-633996030 tempest-ListImagesTestJSON-633996030-project] Calling method '.version_select at 0x7f4687705160>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:26.317197 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c425a190-1be8-4d2e-bf73-7f8d6007de0f tempest-ListImagesTestJSON-633996030 tempest-ListImagesTestJSON-633996030-project] 10.222.0.88 "GET /compute/v2.1/images/a7b14aba-1848-4a00-a3e7-b66eb3e97925" status: 200 len: 784 microversion: 2.1 time: 0.370418 Jul 25 14:28:26.317801 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 513/974] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:28:25 2022] GET /compute/v2.1/images/a7b14aba-1848-4a00-a3e7-b66eb3e97925 => generated 784 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:26.335626 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-85b26642-d935-450b-b08e-f872dacbc532 tempest-ListImagesTestJSON-633996030 tempest-ListImagesTestJSON-633996030-project] Calling method '.version_select at 0x7f46875a0dc0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:26.463728 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-85b26642-d935-450b-b08e-f872dacbc532 tempest-ListImagesTestJSON-633996030 tempest-ListImagesTestJSON-633996030-project] 10.222.0.88 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.134412 Jul 25 14:28:26.473996 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 462/975] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Jul 25 14:28:26 2022] GET /compute/v2.1/images => generated 445 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:26.477246 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-012a96df-540c-47ad-99ab-caa8d89799da tempest-ListImagesTestJSON-633996030 tempest-ListImagesTestJSON-633996030-project] Calling method '.version_select at 0x7f46878d95e0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:26.491140 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-61a3e9dc-c5eb-42f9-bfd5-8e62fb3f1537 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:26.492209 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-61a3e9dc-c5eb-42f9-bfd5-8e62fb3f1537 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:26.512404 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-61a3e9dc-c5eb-42f9-bfd5-8e62fb3f1537 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:26.516330 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-61a3e9dc-c5eb-42f9-bfd5-8e62fb3f1537 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:26.517461 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-61a3e9dc-c5eb-42f9-bfd5-8e62fb3f1537 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:26.519850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-61a3e9dc-c5eb-42f9-bfd5-8e62fb3f1537 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:26.565054 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-012a96df-540c-47ad-99ab-caa8d89799da tempest-ListImagesTestJSON-633996030 tempest-ListImagesTestJSON-633996030-project] 10.222.0.88 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.087133 Jul 25 14:28:26.565720 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 514/976] 10.222.0.88 () {58 vars in 1143 bytes} [Mon Jul 25 14:28:26 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:26.581852 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3f6697fb-3682-40ed-9170-d366a429b14d tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:26.590186 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3f6697fb-3682-40ed-9170-d366a429b14d tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] [instance: 66394997-4341-4d25-a34a-a479e299fe03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:26.611390 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f6697fb-3682-40ed-9170-d366a429b14d tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:26.612116 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f6697fb-3682-40ed-9170-d366a429b14d tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:26.614452 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f6697fb-3682-40ed-9170-d366a429b14d tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:26.618167 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f6697fb-3682-40ed-9170-d366a429b14d tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:26.821631 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-61a3e9dc-c5eb-42f9-bfd5-8e62fb3f1537 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:26.835868 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-61a3e9dc-c5eb-42f9-bfd5-8e62fb3f1537 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:26.838102 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-61a3e9dc-c5eb-42f9-bfd5-8e62fb3f1537 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:26.857443 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-61a3e9dc-c5eb-42f9-bfd5-8e62fb3f1537 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1447 microversion: 2.75 time: 0.369589 Jul 25 14:28:26.873495 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 463/977] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:26 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1447 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:26.953856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-013b29ba-e277-438c-aaa4-20563c3c3a11 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:26.954844 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-013b29ba-e277-438c-aaa4-20563c3c3a11 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:26.970913 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-013b29ba-e277-438c-aaa4-20563c3c3a11 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:26.976465 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-013b29ba-e277-438c-aaa4-20563c3c3a11 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:26.979030 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-013b29ba-e277-438c-aaa4-20563c3c3a11 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:26.980601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-013b29ba-e277-438c-aaa4-20563c3c3a11 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:27.159934 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3f6697fb-3682-40ed-9170-d366a429b14d tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e734f14df14d4621be6343f462b81a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38ea3df00a4a6c84834a04fadc2901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:27.171943 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3f6697fb-3682-40ed-9170-d366a429b14d tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] 10.222.0.88 "GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03" status: 200 len: 1314 microversion: 2.1 time: 0.593769 Jul 25 14:28:27.172895 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 515/978] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:26 2022] GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03 => generated 1314 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:27.177496 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-30793ccf-aed5-4686-a32e-ae553b7ef057 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:27.178098 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-30793ccf-aed5-4686-a32e-ae553b7ef057 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:27.195863 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-30793ccf-aed5-4686-a32e-ae553b7ef057 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:27.196212 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-30793ccf-aed5-4686-a32e-ae553b7ef057 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:27.196997 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-30793ccf-aed5-4686-a32e-ae553b7ef057 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:27.200712 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-30793ccf-aed5-4686-a32e-ae553b7ef057 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:27.508582 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-013b29ba-e277-438c-aaa4-20563c3c3a11 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:27.518053 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-013b29ba-e277-438c-aaa4-20563c3c3a11 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:27.523206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-013b29ba-e277-438c-aaa4-20563c3c3a11 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:27.524973 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-013b29ba-e277-438c-aaa4-20563c3c3a11 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 200 len: 1557 microversion: 2.25 time: 0.576997 Jul 25 14:28:27.525994 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 464/979] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:26 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 1557 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:27.549138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b8e1929b-99b5-4072-82b3-6368820186cc tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Calling method '.version_select at 0x7f4687576ee0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:27.553794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8e1929b-99b5-4072-82b3-6368820186cc tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:27.554671 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8e1929b-99b5-4072-82b3-6368820186cc tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:27.561225 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-30793ccf-aed5-4686-a32e-ae553b7ef057 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:27.564718 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b8e1929b-99b5-4072-82b3-6368820186cc tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] 10.222.0.88 "GET /compute/v2.1/os-migrations" status: 200 len: 1537 microversion: 2.25 time: 0.019630 Jul 25 14:28:27.573524 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-30793ccf-aed5-4686-a32e-ae553b7ef057 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1477 microversion: 2.1 time: 0.399545 Jul 25 14:28:27.574635 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 516/980] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:27 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1477 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:27.576798 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 465/981] 10.222.0.88 () {60 vars in 1184 bytes} [Mon Jul 25 14:28:27 2022] GET /compute/v2.1/os-migrations => generated 1537 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:27.592522 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-62f6f31a-8094-4747-a7cf-8431d27b6573 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:27.595751 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-62f6f31a-8094-4747-a7cf-8431d27b6573 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:27.612064 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-62f6f31a-8094-4747-a7cf-8431d27b6573 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:27.612604 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-62f6f31a-8094-4747-a7cf-8431d27b6573 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:27.613455 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-62f6f31a-8094-4747-a7cf-8431d27b6573 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:27.613896 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-62f6f31a-8094-4747-a7cf-8431d27b6573 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:27.884319 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-60506df4-fb3f-4b30-9ec4-d6663fb2b134 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:27.885258 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-60506df4-fb3f-4b30-9ec4-d6663fb2b134 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:27.897096 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-60506df4-fb3f-4b30-9ec4-d6663fb2b134 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:27.897868 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-60506df4-fb3f-4b30-9ec4-d6663fb2b134 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:27.898784 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-60506df4-fb3f-4b30-9ec4-d6663fb2b134 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:27.899320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-60506df4-fb3f-4b30-9ec4-d6663fb2b134 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:27.991811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-62f6f31a-8094-4747-a7cf-8431d27b6573 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lazy-loading 'services' on Instance uuid b3d2010c-4e0c-412e-9b66-8fbac6510097 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:28:28.078135 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-62f6f31a-8094-4747-a7cf-8431d27b6573 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 200 len: 2051 microversion: 2.25 time: 0.496610 Jul 25 14:28:28.079656 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 517/982] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:27 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 2051 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:28.094511 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-60506df4-fb3f-4b30-9ec4-d6663fb2b134 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:28.104328 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-60506df4-fb3f-4b30-9ec4-d6663fb2b134 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:28.106751 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-60506df4-fb3f-4b30-9ec4-d6663fb2b134 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:28.114837 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-60506df4-fb3f-4b30-9ec4-d6663fb2b134 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1447 microversion: 2.75 time: 0.234747 Jul 25 14:28:28.116028 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 466/983] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:27 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1447 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:28:28.193131 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bdd91644-35a3-4646-92e2-066d55628b09 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:28.193752 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bdd91644-35a3-4646-92e2-066d55628b09 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] [instance: 66394997-4341-4d25-a34a-a479e299fe03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:28.206161 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bdd91644-35a3-4646-92e2-066d55628b09 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:28.209994 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bdd91644-35a3-4646-92e2-066d55628b09 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:28.215535 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bdd91644-35a3-4646-92e2-066d55628b09 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:28.216014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bdd91644-35a3-4646-92e2-066d55628b09 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:28.312286 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fb86c20d-d57d-4b79-b9b0-7544cef60cc2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1524052891", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "89585d8f-fb83-418b-9add-e96b30bdd24c"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:28.457323 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-fb86c20d-d57d-4b79-b9b0-7544cef60cc2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] validate_networks() for [('89585d8f-fb83-418b-9add-e96b30bdd24c', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:28:28.550400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bdd91644-35a3-4646-92e2-066d55628b09 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e734f14df14d4621be6343f462b81a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38ea3df00a4a6c84834a04fadc2901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:28.563342 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bdd91644-35a3-4646-92e2-066d55628b09 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] 10.222.0.88 "GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03" status: 200 len: 1314 microversion: 2.1 time: 0.374573 Jul 25 14:28:28.566205 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 518/984] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:28 2022] GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:28.599636 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-528bb598-c8eb-49d3-aec6-9934c1585d63 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:28.600579 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-528bb598-c8eb-49d3-aec6-9934c1585d63 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:28.607304 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-528bb598-c8eb-49d3-aec6-9934c1585d63 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:28.607866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-528bb598-c8eb-49d3-aec6-9934c1585d63 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:28.609522 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-528bb598-c8eb-49d3-aec6-9934c1585d63 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:28.610187 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-528bb598-c8eb-49d3-aec6-9934c1585d63 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:28.896782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-528bb598-c8eb-49d3-aec6-9934c1585d63 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:28.907234 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-528bb598-c8eb-49d3-aec6-9934c1585d63 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1477 microversion: 2.1 time: 0.315003 Jul 25 14:28:28.908432 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 519/985] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:28 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1477 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:29.144303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-920e4bc9-4bd7-434f-9285-41562df889c0 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:29.145338 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-920e4bc9-4bd7-434f-9285-41562df889c0 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:29.153662 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-920e4bc9-4bd7-434f-9285-41562df889c0 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:29.154435 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-920e4bc9-4bd7-434f-9285-41562df889c0 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:29.155930 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-920e4bc9-4bd7-434f-9285-41562df889c0 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:29.156671 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-920e4bc9-4bd7-434f-9285-41562df889c0 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:29.299177 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-920e4bc9-4bd7-434f-9285-41562df889c0 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:29.314558 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-920e4bc9-4bd7-434f-9285-41562df889c0 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:29.319240 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-920e4bc9-4bd7-434f-9285-41562df889c0 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:29.335876 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-920e4bc9-4bd7-434f-9285-41562df889c0 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1447 microversion: 2.75 time: 0.195900 Jul 25 14:28:29.336600 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 520/986] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:29 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1447 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:29.589176 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cedc600a-ff5b-40fd-8721-879685bc7798 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:29.589918 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cedc600a-ff5b-40fd-8721-879685bc7798 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] [instance: 66394997-4341-4d25-a34a-a479e299fe03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:29.599092 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cedc600a-ff5b-40fd-8721-879685bc7798 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:29.599778 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cedc600a-ff5b-40fd-8721-879685bc7798 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:29.600738 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cedc600a-ff5b-40fd-8721-879685bc7798 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:29.601355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cedc600a-ff5b-40fd-8721-879685bc7798 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:29.869503 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cedc600a-ff5b-40fd-8721-879685bc7798 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e734f14df14d4621be6343f462b81a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38ea3df00a4a6c84834a04fadc2901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:29.885171 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cedc600a-ff5b-40fd-8721-879685bc7798 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] 10.222.0.88 "GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03" status: 200 len: 1314 microversion: 2.1 time: 0.298491 Jul 25 14:28:29.900008 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 521/987] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:29 2022] GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:28:30.074538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-fb86c20d-d57d-4b79-b9b0-7544cef60cc2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:28:30.075240 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-fb86c20d-d57d-4b79-b9b0-7544cef60cc2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:28:30.075843 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-fb86c20d-d57d-4b79-b9b0-7544cef60cc2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:28:30.076277 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-fb86c20d-d57d-4b79-b9b0-7544cef60cc2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:28:30.076690 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-fb86c20d-d57d-4b79-b9b0-7544cef60cc2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:28:30.098401 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fb86c20d-d57d-4b79-b9b0-7544cef60cc2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:30.099491 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fb86c20d-d57d-4b79-b9b0-7544cef60cc2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:30.101875 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fb86c20d-d57d-4b79-b9b0-7544cef60cc2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:30.102317 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fb86c20d-d57d-4b79-b9b0-7544cef60cc2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:30.116319 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2cdebede-6304-417d-b03c-84b75db4dd31 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-49571412", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "8b75699c-1ef5-4c51-95ba-7d4e798771fe"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:30.128970 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-fb86c20d-d57d-4b79-b9b0-7544cef60cc2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Getting quotas for project fb2b9ba0bede403bafb665d5e0818dfb. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:28:30.134555 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-fb86c20d-d57d-4b79-b9b0-7544cef60cc2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Getting quotas for user 94b57069a56c4fedb1d4546c1d0415c7 and project fb2b9ba0bede403bafb665d5e0818dfb. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:28:30.152883 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fb86c20d-d57d-4b79-b9b0-7544cef60cc2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:28:30.155400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fb86c20d-d57d-4b79-b9b0-7544cef60cc2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: c9982c70-c715-4959-b9a9-fee30117751b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:28:30.184353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-2cdebede-6304-417d-b03c-84b75db4dd31 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] validate_networks() for [('8b75699c-1ef5-4c51-95ba-7d4e798771fe', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:28:30.221452 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fb86c20d-d57d-4b79-b9b0-7544cef60cc2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.913724 Jul 25 14:28:30.222573 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 467/988] 10.222.0.88 () {62 vars in 1188 bytes} [Mon Jul 25 14:28:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1916 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 14:28:30.233224 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-f93c3b90-3838-4412-9a90-a6bb9333fe0c req-e7a17d7c-ffca-4fd2-b6ad-2823a526a0f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66394997-4341-4d25-a34a-a479e299fe03", "tag": "12c7cc1c-4824-47a5-9693-38cf4730df08"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:30.256904 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f93c3b90-3838-4412-9a90-a6bb9333fe0c req-e7a17d7c-ffca-4fd2-b6ad-2823a526a0f0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:30.257796 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f93c3b90-3838-4412-9a90-a6bb9333fe0c req-e7a17d7c-ffca-4fd2-b6ad-2823a526a0f0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:30.278079 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-f93c3b90-3838-4412-9a90-a6bb9333fe0c req-e7a17d7c-ffca-4fd2-b6ad-2823a526a0f0 service nova] Creating event network-changed:12c7cc1c-4824-47a5-9693-38cf4730df08 for instance 66394997-4341-4d25-a34a-a479e299fe03 on n-h2-846435-14 Jul 25 14:28:30.289746 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-f93c3b90-3838-4412-9a90-a6bb9333fe0c req-e7a17d7c-ffca-4fd2-b6ad-2823a526a0f0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065202 Jul 25 14:28:30.290745 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 468/989] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:30.298325 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b44be861-2b39-4663-a530-be8bccc9089d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:30.299461 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b44be861-2b39-4663-a530-be8bccc9089d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:30.307296 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:28:30.312128 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b44be861-2b39-4663-a530-be8bccc9089d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:30.312880 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b44be861-2b39-4663-a530-be8bccc9089d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:30.315047 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b44be861-2b39-4663-a530-be8bccc9089d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:30.318198 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b44be861-2b39-4663-a530-be8bccc9089d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:30.766851 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b44be861-2b39-4663-a530-be8bccc9089d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:30.775144 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b44be861-2b39-4663-a530-be8bccc9089d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1477 microversion: 2.1 time: 0.482851 Jul 25 14:28:30.779138 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 469/990] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:30 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1477 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:30.798483 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8920fddf-e085-48c8-87d9-bdbf3dc5d29d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:30.799504 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8920fddf-e085-48c8-87d9-bdbf3dc5d29d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:30.888298 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8920fddf-e085-48c8-87d9-bdbf3dc5d29d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:30.899034 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8920fddf-e085-48c8-87d9-bdbf3dc5d29d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:30.901440 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8920fddf-e085-48c8-87d9-bdbf3dc5d29d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:30.903178 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8920fddf-e085-48c8-87d9-bdbf3dc5d29d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 200 len: 1262 microversion: 2.25 time: 0.122988 Jul 25 14:28:30.904538 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 470/991] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:30 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 1262 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:30.911151 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-938da1f9-3be2-4231-acf9-de2bf3174417 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:30.911962 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-938da1f9-3be2-4231-acf9-de2bf3174417 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:30.922014 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-938da1f9-3be2-4231-acf9-de2bf3174417 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:30.922948 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-938da1f9-3be2-4231-acf9-de2bf3174417 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:30.923901 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-938da1f9-3be2-4231-acf9-de2bf3174417 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:30.924362 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-938da1f9-3be2-4231-acf9-de2bf3174417 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:31.053528 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-938da1f9-3be2-4231-acf9-de2bf3174417 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:31.066250 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-938da1f9-3be2-4231-acf9-de2bf3174417 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:31.068151 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-938da1f9-3be2-4231-acf9-de2bf3174417 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:31.082725 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-938da1f9-3be2-4231-acf9-de2bf3174417 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1447 microversion: 2.75 time: 0.176415 Jul 25 14:28:31.084922 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 471/992] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:30 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1447 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:31.091931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a99800ca-6006-4f10-bece-adb216e82ee5 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:31.093815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a99800ca-6006-4f10-bece-adb216e82ee5 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] [instance: 66394997-4341-4d25-a34a-a479e299fe03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:31.107599 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a99800ca-6006-4f10-bece-adb216e82ee5 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:31.108373 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a99800ca-6006-4f10-bece-adb216e82ee5 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:31.109469 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a99800ca-6006-4f10-bece-adb216e82ee5 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:31.110110 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a99800ca-6006-4f10-bece-adb216e82ee5 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:31.256483 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-2cdebede-6304-417d-b03c-84b75db4dd31 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:28:31.256974 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-2cdebede-6304-417d-b03c-84b75db4dd31 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:28:31.258479 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-2cdebede-6304-417d-b03c-84b75db4dd31 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:28:31.259652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-2cdebede-6304-417d-b03c-84b75db4dd31 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:28:31.260371 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-2cdebede-6304-417d-b03c-84b75db4dd31 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:28:31.275191 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2cdebede-6304-417d-b03c-84b75db4dd31 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:31.276465 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2cdebede-6304-417d-b03c-84b75db4dd31 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:31.277886 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2cdebede-6304-417d-b03c-84b75db4dd31 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:31.279105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2cdebede-6304-417d-b03c-84b75db4dd31 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:31.307111 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-2cdebede-6304-417d-b03c-84b75db4dd31 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Getting quotas for project f1ca1e9beedc4892861051504a5dff08. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:28:31.318165 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-2cdebede-6304-417d-b03c-84b75db4dd31 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Getting quotas for user 774744dcf62f4ef78b4a2c8dfc96f9cd and project f1ca1e9beedc4892861051504a5dff08. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:28:31.350707 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2cdebede-6304-417d-b03c-84b75db4dd31 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:28:31.353693 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2cdebede-6304-417d-b03c-84b75db4dd31 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 1c6f6d12-3660-40ec-bf99-d735fa9d0358] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:28:31.432212 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2cdebede-6304-417d-b03c-84b75db4dd31 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.530675 Jul 25 14:28:31.432865 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 522/993] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:28:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:28:31.449242 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fe1bc204-0dfe-4e8d-aa7c-8afbc5c9eb23 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:31.452783 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fe1bc204-0dfe-4e8d-aa7c-8afbc5c9eb23 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 1c6f6d12-3660-40ec-bf99-d735fa9d0358] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:31.495382 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a99800ca-6006-4f10-bece-adb216e82ee5 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e734f14df14d4621be6343f462b81a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38ea3df00a4a6c84834a04fadc2901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:31.506582 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a99800ca-6006-4f10-bece-adb216e82ee5 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] 10.222.0.88 "GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03" status: 200 len: 1314 microversion: 2.1 time: 0.419405 Jul 25 14:28:31.508283 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 472/994] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:31 2022] GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:31.801219 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3d3c6106-5ce1-4798-a90e-d43010b72291 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:31.801965 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3d3c6106-5ce1-4798-a90e-d43010b72291 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:31.811381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3d3c6106-5ce1-4798-a90e-d43010b72291 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:31.814542 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3d3c6106-5ce1-4798-a90e-d43010b72291 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:31.815461 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3d3c6106-5ce1-4798-a90e-d43010b72291 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:31.816026 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3d3c6106-5ce1-4798-a90e-d43010b72291 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:32.022042 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fe1bc204-0dfe-4e8d-aa7c-8afbc5c9eb23 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774744dcf62f4ef78b4a2c8dfc96f9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ca1e9beedc4892861051504a5dff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:32.031848 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fe1bc204-0dfe-4e8d-aa7c-8afbc5c9eb23 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358" status: 200 len: 1222 microversion: 2.1 time: 0.591894 Jul 25 14:28:32.032812 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 523/995] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:31 2022] GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358 => generated 1222 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:32.049836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ed4ece6d-66e0-4c86-8fea-82d4cfad6d95 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:32.050694 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ed4ece6d-66e0-4c86-8fea-82d4cfad6d95 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:32.057910 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed4ece6d-66e0-4c86-8fea-82d4cfad6d95 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:32.065211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed4ece6d-66e0-4c86-8fea-82d4cfad6d95 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:32.066208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed4ece6d-66e0-4c86-8fea-82d4cfad6d95 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:32.066800 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed4ece6d-66e0-4c86-8fea-82d4cfad6d95 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:32.192140 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ed4ece6d-66e0-4c86-8fea-82d4cfad6d95 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:32.194344 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:28:32.209844 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ed4ece6d-66e0-4c86-8fea-82d4cfad6d95 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:32.211327 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ed4ece6d-66e0-4c86-8fea-82d4cfad6d95 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:32.212477 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ed4ece6d-66e0-4c86-8fea-82d4cfad6d95 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 200 len: 1320 microversion: 2.25 time: 0.178497 Jul 25 14:28:32.213345 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 524/996] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:32 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 1320 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:32.228140 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-67759438-1ca5-405f-9804-83f718310a22 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:32.228978 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-67759438-1ca5-405f-9804-83f718310a22 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:32.240017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-67759438-1ca5-405f-9804-83f718310a22 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:32.246999 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-67759438-1ca5-405f-9804-83f718310a22 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:32.248408 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-67759438-1ca5-405f-9804-83f718310a22 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:32.248998 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-67759438-1ca5-405f-9804-83f718310a22 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:32.355579 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-67759438-1ca5-405f-9804-83f718310a22 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:32.366822 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-67759438-1ca5-405f-9804-83f718310a22 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:32.371204 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-67759438-1ca5-405f-9804-83f718310a22 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:32.376786 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-67759438-1ca5-405f-9804-83f718310a22 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1447 microversion: 2.75 time: 0.162343 Jul 25 14:28:32.383132 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 525/997] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:32 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1447 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:32.527575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-09904547-1f11-4b10-90da-aedbc86eb67c tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:32.528484 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-09904547-1f11-4b10-90da-aedbc86eb67c tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] [instance: 66394997-4341-4d25-a34a-a479e299fe03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:32.540049 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09904547-1f11-4b10-90da-aedbc86eb67c tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:32.540731 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09904547-1f11-4b10-90da-aedbc86eb67c tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:32.541667 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09904547-1f11-4b10-90da-aedbc86eb67c tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:32.542245 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09904547-1f11-4b10-90da-aedbc86eb67c tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:32.792997 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-09904547-1f11-4b10-90da-aedbc86eb67c tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e734f14df14d4621be6343f462b81a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38ea3df00a4a6c84834a04fadc2901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:32.807478 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-09904547-1f11-4b10-90da-aedbc86eb67c tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] 10.222.0.88 "GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03" status: 200 len: 1314 microversion: 2.1 time: 0.283914 Jul 25 14:28:32.808739 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 526/998] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:32 2022] GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:28:33.004703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3d3c6106-5ce1-4798-a90e-d43010b72291 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:33.021002 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3d3c6106-5ce1-4798-a90e-d43010b72291 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1477 microversion: 2.1 time: 1.223073 Jul 25 14:28:33.024962 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 473/999] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:31 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1477 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:33.063160 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-11a7a99f-542f-4bc5-8dcb-148056c26932 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:33.065174 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-11a7a99f-542f-4bc5-8dcb-148056c26932 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 1c6f6d12-3660-40ec-bf99-d735fa9d0358] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:33.090822 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11a7a99f-542f-4bc5-8dcb-148056c26932 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:33.091574 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11a7a99f-542f-4bc5-8dcb-148056c26932 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:33.093034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11a7a99f-542f-4bc5-8dcb-148056c26932 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:33.097978 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11a7a99f-542f-4bc5-8dcb-148056c26932 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:33.243613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8f689f08-42af-4211-998a-e5890b934e67 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:33.244633 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8f689f08-42af-4211-998a-e5890b934e67 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:33.285270 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f689f08-42af-4211-998a-e5890b934e67 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:33.290273 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f689f08-42af-4211-998a-e5890b934e67 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:33.291657 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f689f08-42af-4211-998a-e5890b934e67 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:33.294512 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f689f08-42af-4211-998a-e5890b934e67 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:33.425438 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-11a7a99f-542f-4bc5-8dcb-148056c26932 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774744dcf62f4ef78b4a2c8dfc96f9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ca1e9beedc4892861051504a5dff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:33.457042 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-11a7a99f-542f-4bc5-8dcb-148056c26932 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358" status: 200 len: 1218 microversion: 2.1 time: 0.400038 Jul 25 14:28:33.458641 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 527/1000] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:33 2022] GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358 => generated 1218 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:33.463623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-18eaabd9-332d-446a-839f-c685c82c8bfa tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:33.464444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-18eaabd9-332d-446a-839f-c685c82c8bfa tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:33.482949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-18eaabd9-332d-446a-839f-c685c82c8bfa tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:33.483943 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-18eaabd9-332d-446a-839f-c685c82c8bfa tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:33.487823 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-18eaabd9-332d-446a-839f-c685c82c8bfa tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:33.489468 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-18eaabd9-332d-446a-839f-c685c82c8bfa tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:33.999247 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-18eaabd9-332d-446a-839f-c685c82c8bfa tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:34.019317 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-18eaabd9-332d-446a-839f-c685c82c8bfa tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:34.022276 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-18eaabd9-332d-446a-839f-c685c82c8bfa tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:34.035479 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-18eaabd9-332d-446a-839f-c685c82c8bfa tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1447 microversion: 2.75 time: 0.573490 Jul 25 14:28:34.048004 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 528/1001] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:33 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1447 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:34.049623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5cfdb3ac-d9f0-45d3-956a-cb1a95e57afd tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:34.050345 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5cfdb3ac-d9f0-45d3-956a-cb1a95e57afd tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] [instance: 66394997-4341-4d25-a34a-a479e299fe03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:34.064951 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8f689f08-42af-4211-998a-e5890b934e67 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:34.083799 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8f689f08-42af-4211-998a-e5890b934e67 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:34.085516 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8f689f08-42af-4211-998a-e5890b934e67 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:34.088389 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5cfdb3ac-d9f0-45d3-956a-cb1a95e57afd tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:34.088552 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5cfdb3ac-d9f0-45d3-956a-cb1a95e57afd tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:34.089280 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5cfdb3ac-d9f0-45d3-956a-cb1a95e57afd tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:34.108454 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5cfdb3ac-d9f0-45d3-956a-cb1a95e57afd tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:34.110391 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8f689f08-42af-4211-998a-e5890b934e67 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 200 len: 1362 microversion: 2.25 time: 0.870572 Jul 25 14:28:34.111190 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 474/1002] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:33 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 1362 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:28:34.140878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-99cb346d-ebf5-49e4-b059-65b37810dc2b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:34.141554 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-99cb346d-ebf5-49e4-b059-65b37810dc2b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:34.160464 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99cb346d-ebf5-49e4-b059-65b37810dc2b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:34.160922 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99cb346d-ebf5-49e4-b059-65b37810dc2b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:34.161718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99cb346d-ebf5-49e4-b059-65b37810dc2b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:34.162160 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99cb346d-ebf5-49e4-b059-65b37810dc2b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:34.582095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5cfdb3ac-d9f0-45d3-956a-cb1a95e57afd tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e734f14df14d4621be6343f462b81a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38ea3df00a4a6c84834a04fadc2901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:34.592475 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5cfdb3ac-d9f0-45d3-956a-cb1a95e57afd tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] 10.222.0.88 "GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03" status: 200 len: 1314 microversion: 2.1 time: 0.552371 Jul 25 14:28:34.602541 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 529/1003] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:34 2022] GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03 => generated 1314 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:34.617367 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d2759349-00b7-46e1-9804-86ce1cc8a4dc tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:34.618382 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d2759349-00b7-46e1-9804-86ce1cc8a4dc tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 1c6f6d12-3660-40ec-bf99-d735fa9d0358] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:34.628784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d2759349-00b7-46e1-9804-86ce1cc8a4dc tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:34.630053 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d2759349-00b7-46e1-9804-86ce1cc8a4dc tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:34.631211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d2759349-00b7-46e1-9804-86ce1cc8a4dc tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:34.631858 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d2759349-00b7-46e1-9804-86ce1cc8a4dc tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:34.769692 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d2759349-00b7-46e1-9804-86ce1cc8a4dc tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774744dcf62f4ef78b4a2c8dfc96f9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ca1e9beedc4892861051504a5dff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:34.784599 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d2759349-00b7-46e1-9804-86ce1cc8a4dc tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358" status: 200 len: 1280 microversion: 2.1 time: 0.177550 Jul 25 14:28:34.786016 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 530/1004] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:34 2022] GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358 => generated 1280 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:35.067161 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-16ab19d5-a0df-4159-8a7e-e79ead4bb258 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:35.067925 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-16ab19d5-a0df-4159-8a7e-e79ead4bb258 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:35.084796 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-16ab19d5-a0df-4159-8a7e-e79ead4bb258 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:35.085338 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-16ab19d5-a0df-4159-8a7e-e79ead4bb258 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:35.087043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-16ab19d5-a0df-4159-8a7e-e79ead4bb258 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:35.087990 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-16ab19d5-a0df-4159-8a7e-e79ead4bb258 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:35.381211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-16ab19d5-a0df-4159-8a7e-e79ead4bb258 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:35.394009 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-16ab19d5-a0df-4159-8a7e-e79ead4bb258 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:35.398793 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-16ab19d5-a0df-4159-8a7e-e79ead4bb258 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:35.414043 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-16ab19d5-a0df-4159-8a7e-e79ead4bb258 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1447 microversion: 2.75 time: 0.351232 Jul 25 14:28:35.415855 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 531/1005] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:35 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1447 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:35.441963 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-137b837e-0dc2-445f-a47b-b23d6d4fba48 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:35.445074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-137b837e-0dc2-445f-a47b-b23d6d4fba48 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:35.467619 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-137b837e-0dc2-445f-a47b-b23d6d4fba48 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:35.471121 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-137b837e-0dc2-445f-a47b-b23d6d4fba48 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:35.472669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-137b837e-0dc2-445f-a47b-b23d6d4fba48 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:35.474596 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-137b837e-0dc2-445f-a47b-b23d6d4fba48 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:35.907496 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-99cb346d-ebf5-49e4-b059-65b37810dc2b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:35.922333 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-99cb346d-ebf5-49e4-b059-65b37810dc2b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1477 microversion: 2.1 time: 1.782186 Jul 25 14:28:35.923650 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 475/1006] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:34 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1477 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:35.943353 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-89aeb54f-062b-45ad-a2d4-05fc9aeff804 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:35.944330 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-89aeb54f-062b-45ad-a2d4-05fc9aeff804 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] [instance: 66394997-4341-4d25-a34a-a479e299fe03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:35.953576 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89aeb54f-062b-45ad-a2d4-05fc9aeff804 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:35.954289 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89aeb54f-062b-45ad-a2d4-05fc9aeff804 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:35.955287 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89aeb54f-062b-45ad-a2d4-05fc9aeff804 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:35.955883 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89aeb54f-062b-45ad-a2d4-05fc9aeff804 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:36.147350 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-137b837e-0dc2-445f-a47b-b23d6d4fba48 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:36.155739 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-137b837e-0dc2-445f-a47b-b23d6d4fba48 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:36.157320 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-137b837e-0dc2-445f-a47b-b23d6d4fba48 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:36.158448 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-137b837e-0dc2-445f-a47b-b23d6d4fba48 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 200 len: 1362 microversion: 2.25 time: 0.741287 Jul 25 14:28:36.163693 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 532/1007] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:35 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 1362 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:36.181348 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8ad2175e-1bb3-434d-8263-c7eaa12ddfda tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:36.182427 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8ad2175e-1bb3-434d-8263-c7eaa12ddfda tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 1c6f6d12-3660-40ec-bf99-d735fa9d0358] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:36.199660 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8ad2175e-1bb3-434d-8263-c7eaa12ddfda tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:36.200145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8ad2175e-1bb3-434d-8263-c7eaa12ddfda tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:36.200943 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8ad2175e-1bb3-434d-8263-c7eaa12ddfda tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:36.201380 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8ad2175e-1bb3-434d-8263-c7eaa12ddfda tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:36.695932 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8ad2175e-1bb3-434d-8263-c7eaa12ddfda tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774744dcf62f4ef78b4a2c8dfc96f9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ca1e9beedc4892861051504a5dff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:36.705612 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8ad2175e-1bb3-434d-8263-c7eaa12ddfda tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358" status: 200 len: 1280 microversion: 2.1 time: 0.540465 Jul 25 14:28:36.706201 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 533/1008] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:36 2022] GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358 => generated 1280 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:36.727908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a3450c45-1444-450d-9a41-d3732623950d tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:36.735027 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a3450c45-1444-450d-9a41-d3732623950d tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:36.761970 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3450c45-1444-450d-9a41-d3732623950d tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:36.762419 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3450c45-1444-450d-9a41-d3732623950d tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:36.763207 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3450c45-1444-450d-9a41-d3732623950d tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:36.763643 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3450c45-1444-450d-9a41-d3732623950d tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:36.793727 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-89aeb54f-062b-45ad-a2d4-05fc9aeff804 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e734f14df14d4621be6343f462b81a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38ea3df00a4a6c84834a04fadc2901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:36.803331 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-89aeb54f-062b-45ad-a2d4-05fc9aeff804 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] 10.222.0.88 "GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03" status: 200 len: 1314 microversion: 2.1 time: 0.864915 Jul 25 14:28:36.823956 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 476/1009] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:35 2022] GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03 => generated 1314 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:36.952396 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-37de57f6-e745-4742-95e9-9f5c01faa930 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:36.959844 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-37de57f6-e745-4742-95e9-9f5c01faa930 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:36.972477 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37de57f6-e745-4742-95e9-9f5c01faa930 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:36.973115 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37de57f6-e745-4742-95e9-9f5c01faa930 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:36.974618 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37de57f6-e745-4742-95e9-9f5c01faa930 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:36.975458 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37de57f6-e745-4742-95e9-9f5c01faa930 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:37.064459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a3450c45-1444-450d-9a41-d3732623950d tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:37.075073 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a3450c45-1444-450d-9a41-d3732623950d tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:37.076696 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a3450c45-1444-450d-9a41-d3732623950d tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:37.090710 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a3450c45-1444-450d-9a41-d3732623950d tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1447 microversion: 2.75 time: 0.368222 Jul 25 14:28:37.091301 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 534/1010] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:36 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1447 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:37.181946 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0adbdaa0-6f6d-439e-84aa-fc402c2157c4 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:37.182599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0adbdaa0-6f6d-439e-84aa-fc402c2157c4 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:37.193599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0adbdaa0-6f6d-439e-84aa-fc402c2157c4 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:37.193957 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0adbdaa0-6f6d-439e-84aa-fc402c2157c4 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:37.194759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0adbdaa0-6f6d-439e-84aa-fc402c2157c4 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:37.197106 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0adbdaa0-6f6d-439e-84aa-fc402c2157c4 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:37.502676 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-37de57f6-e745-4742-95e9-9f5c01faa930 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:37.531754 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-37de57f6-e745-4742-95e9-9f5c01faa930 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1476 microversion: 2.1 time: 0.586078 Jul 25 14:28:37.558340 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 477/1011] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:36 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1476 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:37.727698 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cfb1e36e-c4f5-4c35-b71f-b1d70ae7ee00 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:37.729679 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cfb1e36e-c4f5-4c35-b71f-b1d70ae7ee00 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 1c6f6d12-3660-40ec-bf99-d735fa9d0358] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:37.748944 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cfb1e36e-c4f5-4c35-b71f-b1d70ae7ee00 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:37.750072 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cfb1e36e-c4f5-4c35-b71f-b1d70ae7ee00 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:37.751510 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cfb1e36e-c4f5-4c35-b71f-b1d70ae7ee00 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:37.752243 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cfb1e36e-c4f5-4c35-b71f-b1d70ae7ee00 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:38.015256 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0adbdaa0-6f6d-439e-84aa-fc402c2157c4 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:38.037817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0adbdaa0-6f6d-439e-84aa-fc402c2157c4 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:38.046073 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0adbdaa0-6f6d-439e-84aa-fc402c2157c4 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:38.052380 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0adbdaa0-6f6d-439e-84aa-fc402c2157c4 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 200 len: 1362 microversion: 2.25 time: 0.874261 Jul 25 14:28:38.056901 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 535/1012] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:37 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 1362 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:28:38.061908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-87aa8b19-b07d-4815-aa85-c193cdc73637 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:38.068191 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-87aa8b19-b07d-4815-aa85-c193cdc73637 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] [instance: 66394997-4341-4d25-a34a-a479e299fe03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:38.083457 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-87aa8b19-b07d-4815-aa85-c193cdc73637 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:38.084308 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-87aa8b19-b07d-4815-aa85-c193cdc73637 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:38.085363 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-87aa8b19-b07d-4815-aa85-c193cdc73637 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:38.092697 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-87aa8b19-b07d-4815-aa85-c193cdc73637 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:38.212247 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cfb1e36e-c4f5-4c35-b71f-b1d70ae7ee00 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774744dcf62f4ef78b4a2c8dfc96f9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ca1e9beedc4892861051504a5dff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:38.250498 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cfb1e36e-c4f5-4c35-b71f-b1d70ae7ee00 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358" status: 200 len: 1322 microversion: 2.1 time: 0.526607 Jul 25 14:28:38.255443 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 478/1013] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:37 2022] GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358 => generated 1322 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:38.290197 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-032b4e83-9257-4ae2-b5e5-24f1503c6a52 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:38.325765 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-032b4e83-9257-4ae2-b5e5-24f1503c6a52 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:38.372116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-032b4e83-9257-4ae2-b5e5-24f1503c6a52 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:38.373118 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-032b4e83-9257-4ae2-b5e5-24f1503c6a52 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:38.375003 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-032b4e83-9257-4ae2-b5e5-24f1503c6a52 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:38.375689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-032b4e83-9257-4ae2-b5e5-24f1503c6a52 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:38.573421 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-032b4e83-9257-4ae2-b5e5-24f1503c6a52 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:38.578626 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:28:38.597903 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-032b4e83-9257-4ae2-b5e5-24f1503c6a52 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:38.599747 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-032b4e83-9257-4ae2-b5e5-24f1503c6a52 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:38.616033 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-032b4e83-9257-4ae2-b5e5-24f1503c6a52 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1447 microversion: 2.75 time: 0.350101 Jul 25 14:28:38.619169 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 479/1014] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:38 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1447 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:38.629958 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ef8d8715-1b29-4ad0-a3d9-60b9d1d5db78 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:38.630930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ef8d8715-1b29-4ad0-a3d9-60b9d1d5db78 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:38.678675 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ef8d8715-1b29-4ad0-a3d9-60b9d1d5db78 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:38.680566 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ef8d8715-1b29-4ad0-a3d9-60b9d1d5db78 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:38.683156 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ef8d8715-1b29-4ad0-a3d9-60b9d1d5db78 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:38.683625 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ef8d8715-1b29-4ad0-a3d9-60b9d1d5db78 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:39.186060 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-87aa8b19-b07d-4815-aa85-c193cdc73637 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e734f14df14d4621be6343f462b81a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38ea3df00a4a6c84834a04fadc2901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:39.214883 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-87aa8b19-b07d-4815-aa85-c193cdc73637 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] 10.222.0.88 "GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03" status: 200 len: 1314 microversion: 2.1 time: 1.148169 Jul 25 14:28:39.215582 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 536/1015] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:38 2022] GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03 => generated 1314 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:39.267916 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-74dde8b9-43c0-463f-972b-6f7076d77ba5 req-05c546ad-5eec-4588-98a8-9896027b0dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9982c70-c715-4959-b9a9-fee30117751b", "tag": "7a86088b-678c-4fae-8f85-06963cf768fa"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:39.290645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-74dde8b9-43c0-463f-972b-6f7076d77ba5 req-05c546ad-5eec-4588-98a8-9896027b0dc9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:39.290815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ef8d8715-1b29-4ad0-a3d9-60b9d1d5db78 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:39.291870 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-74dde8b9-43c0-463f-972b-6f7076d77ba5 req-05c546ad-5eec-4588-98a8-9896027b0dc9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:39.315404 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-74dde8b9-43c0-463f-972b-6f7076d77ba5 req-05c546ad-5eec-4588-98a8-9896027b0dc9 service nova] Creating event network-changed:7a86088b-678c-4fae-8f85-06963cf768fa for instance c9982c70-c715-4959-b9a9-fee30117751b on n-h1-846435-14 Jul 25 14:28:39.316646 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ef8d8715-1b29-4ad0-a3d9-60b9d1d5db78 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1476 microversion: 2.1 time: 0.694044 Jul 25 14:28:39.317293 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 480/1016] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:38 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1476 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:39.323596 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-74dde8b9-43c0-463f-972b-6f7076d77ba5 req-05c546ad-5eec-4588-98a8-9896027b0dc9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072889 Jul 25 14:28:39.330780 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 537/1017] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:39.338047 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6686a4aa-7522-47d9-a73f-e7c42a46d4a0 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:39.340161 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6686a4aa-7522-47d9-a73f-e7c42a46d4a0 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 1c6f6d12-3660-40ec-bf99-d735fa9d0358] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:39.348882 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6686a4aa-7522-47d9-a73f-e7c42a46d4a0 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:39.349573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6686a4aa-7522-47d9-a73f-e7c42a46d4a0 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:39.351374 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6686a4aa-7522-47d9-a73f-e7c42a46d4a0 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:39.352045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6686a4aa-7522-47d9-a73f-e7c42a46d4a0 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:39.359357 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6b345b39-4a77-49c3-bc8e-7caef351388c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:39.360112 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6b345b39-4a77-49c3-bc8e-7caef351388c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:39.389402 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6b345b39-4a77-49c3-bc8e-7caef351388c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:39.389859 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6b345b39-4a77-49c3-bc8e-7caef351388c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:39.390643 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6b345b39-4a77-49c3-bc8e-7caef351388c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:39.402202 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6b345b39-4a77-49c3-bc8e-7caef351388c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:39.655864 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6b345b39-4a77-49c3-bc8e-7caef351388c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:39.666021 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6b345b39-4a77-49c3-bc8e-7caef351388c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:39.668247 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6b345b39-4a77-49c3-bc8e-7caef351388c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:39.669719 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6b345b39-4a77-49c3-bc8e-7caef351388c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 200 len: 1362 microversion: 2.25 time: 0.341222 Jul 25 14:28:39.685244 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 481/1018] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:39 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 1362 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:39.690443 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7ae5dfd7-df1c-45a6-be7b-3cf880d2b2e1 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:39.690885 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7ae5dfd7-df1c-45a6-be7b-3cf880d2b2e1 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:39.698396 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ae5dfd7-df1c-45a6-be7b-3cf880d2b2e1 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:39.699081 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ae5dfd7-df1c-45a6-be7b-3cf880d2b2e1 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:39.700099 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ae5dfd7-df1c-45a6-be7b-3cf880d2b2e1 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:39.700756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ae5dfd7-df1c-45a6-be7b-3cf880d2b2e1 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:39.785142 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7ae5dfd7-df1c-45a6-be7b-3cf880d2b2e1 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:39.799033 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7ae5dfd7-df1c-45a6-be7b-3cf880d2b2e1 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:39.800931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7ae5dfd7-df1c-45a6-be7b-3cf880d2b2e1 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:39.810327 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7ae5dfd7-df1c-45a6-be7b-3cf880d2b2e1 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1447 microversion: 2.75 time: 0.123795 Jul 25 14:28:39.811579 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 482/1019] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:39 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1447 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:40.000991 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6686a4aa-7522-47d9-a73f-e7c42a46d4a0 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774744dcf62f4ef78b4a2c8dfc96f9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ca1e9beedc4892861051504a5dff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:40.012721 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6686a4aa-7522-47d9-a73f-e7c42a46d4a0 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358" status: 200 len: 1322 microversion: 2.1 time: 0.680189 Jul 25 14:28:40.019298 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 538/1020] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:39 2022] GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358 => generated 1322 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:40.134645 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-f2283b13-29bd-42a4-a719-d868e1223efc req-b0098436-6275-41cf-b147-d118db971b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5db8a05-a27e-4426-9166-44727d5cc4ff", "name": "network-vif-unplugged", "status": "completed", "tag": "f34d13c0-b812-4793-bcd0-55fe6e34bc46"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:40.152704 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:28:40.157545 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f2283b13-29bd-42a4-a719-d868e1223efc req-b0098436-6275-41cf-b147-d118db971b67 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:40.158379 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f2283b13-29bd-42a4-a719-d868e1223efc req-b0098436-6275-41cf-b147-d118db971b67 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:40.177252 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-b021e871-4c17-4416-ab0d-ba2774d70db4 req-c814f176-48e3-4fe0-8d01-df1413c54179 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c6f6d12-3660-40ec-bf99-d735fa9d0358", "tag": "fb6f83eb-2e87-4f51-aa28-9bf153938de2"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:40.197767 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-b021e871-4c17-4416-ab0d-ba2774d70db4 req-c814f176-48e3-4fe0-8d01-df1413c54179 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:40.199085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-b021e871-4c17-4416-ab0d-ba2774d70db4 req-c814f176-48e3-4fe0-8d01-df1413c54179 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:40.200729 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-f2283b13-29bd-42a4-a719-d868e1223efc req-b0098436-6275-41cf-b147-d118db971b67 service nova] Creating event network-vif-unplugged:f34d13c0-b812-4793-bcd0-55fe6e34bc46 for instance d5db8a05-a27e-4426-9166-44727d5cc4ff on n-h1-846435-14 Jul 25 14:28:40.213438 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [req-f2283b13-29bd-42a4-a719-d868e1223efc req-b0098436-6275-41cf-b147-d118db971b67 service nova] Instance d5db8a05-a27e-4426-9166-44727d5cc4ff is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846435-14'} {{(pid=119303) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 14:28:40.226494 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-f2283b13-29bd-42a4-a719-d868e1223efc req-b0098436-6275-41cf-b147-d118db971b67 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100888 Jul 25 14:28:40.227716 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 483/1021] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:40.239589 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-841f729b-eb7a-4e51-ad9d-9173e87c1fd2 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:40.246902 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-841f729b-eb7a-4e51-ad9d-9173e87c1fd2 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] [instance: 66394997-4341-4d25-a34a-a479e299fe03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:40.264808 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-841f729b-eb7a-4e51-ad9d-9173e87c1fd2 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:40.267511 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-841f729b-eb7a-4e51-ad9d-9173e87c1fd2 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:40.271275 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-841f729b-eb7a-4e51-ad9d-9173e87c1fd2 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:40.272038 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-841f729b-eb7a-4e51-ad9d-9173e87c1fd2 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:40.277650 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-b021e871-4c17-4416-ab0d-ba2774d70db4 req-c814f176-48e3-4fe0-8d01-df1413c54179 service nova] Creating event network-changed:fb6f83eb-2e87-4f51-aa28-9bf153938de2 for instance 1c6f6d12-3660-40ec-bf99-d735fa9d0358 on n-h2-846435-14 Jul 25 14:28:40.299575 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-b021e871-4c17-4416-ab0d-ba2774d70db4 req-c814f176-48e3-4fe0-8d01-df1413c54179 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126676 Jul 25 14:28:40.300892 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 539/1022] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:40.343485 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1ccc74a5-9f53-4dec-9d03-4008635e2430 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:40.347799 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1ccc74a5-9f53-4dec-9d03-4008635e2430 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:40.361919 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1ccc74a5-9f53-4dec-9d03-4008635e2430 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:40.362434 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1ccc74a5-9f53-4dec-9d03-4008635e2430 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:40.363279 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1ccc74a5-9f53-4dec-9d03-4008635e2430 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:40.363757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1ccc74a5-9f53-4dec-9d03-4008635e2430 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:40.749305 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-841f729b-eb7a-4e51-ad9d-9173e87c1fd2 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e734f14df14d4621be6343f462b81a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38ea3df00a4a6c84834a04fadc2901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:40.762670 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-841f729b-eb7a-4e51-ad9d-9173e87c1fd2 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] 10.222.0.88 "GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03" status: 200 len: 1314 microversion: 2.1 time: 0.530896 Jul 25 14:28:40.764070 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 484/1023] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:40 2022] GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03 => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:40.776711 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-433e744c-08d0-44bd-8ed9-20c52975aece tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:40.786430 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-433e744c-08d0-44bd-8ed9-20c52975aece tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:40.794217 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-433e744c-08d0-44bd-8ed9-20c52975aece tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:40.794954 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-433e744c-08d0-44bd-8ed9-20c52975aece tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:40.795904 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-433e744c-08d0-44bd-8ed9-20c52975aece tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:40.801217 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-433e744c-08d0-44bd-8ed9-20c52975aece tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:40.849144 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1ccc74a5-9f53-4dec-9d03-4008635e2430 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:40.861513 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1ccc74a5-9f53-4dec-9d03-4008635e2430 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1474 microversion: 2.1 time: 0.526499 Jul 25 14:28:40.862315 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 540/1024] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:40 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1474 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:40.875394 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-753181bc-328a-440a-ad9e-2af19e0e0a4d tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:40.876069 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-753181bc-328a-440a-ad9e-2af19e0e0a4d tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:40.884643 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-753181bc-328a-440a-ad9e-2af19e0e0a4d tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:40.885380 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-753181bc-328a-440a-ad9e-2af19e0e0a4d tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:40.886329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-753181bc-328a-440a-ad9e-2af19e0e0a4d tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:40.886933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-753181bc-328a-440a-ad9e-2af19e0e0a4d tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:40.894085 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=22 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:28:40.994760 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-753181bc-328a-440a-ad9e-2af19e0e0a4d tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:41.021535 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-753181bc-328a-440a-ad9e-2af19e0e0a4d tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:41.026236 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-753181bc-328a-440a-ad9e-2af19e0e0a4d tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:41.035447 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-753181bc-328a-440a-ad9e-2af19e0e0a4d tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1447 microversion: 2.75 time: 0.170294 Jul 25 14:28:41.037470 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 541/1025] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:40 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1447 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:41.060934 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0388569d-d6dc-450f-b542-2028ac76e49d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:41.062639 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0388569d-d6dc-450f-b542-2028ac76e49d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 1c6f6d12-3660-40ec-bf99-d735fa9d0358] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:41.074948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0388569d-d6dc-450f-b542-2028ac76e49d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:41.075497 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0388569d-d6dc-450f-b542-2028ac76e49d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:41.076573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0388569d-d6dc-450f-b542-2028ac76e49d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:41.077242 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0388569d-d6dc-450f-b542-2028ac76e49d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:41.113447 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-433e744c-08d0-44bd-8ed9-20c52975aece tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:41.124993 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-433e744c-08d0-44bd-8ed9-20c52975aece tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:41.126600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-433e744c-08d0-44bd-8ed9-20c52975aece tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:41.129525 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-433e744c-08d0-44bd-8ed9-20c52975aece tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 200 len: 1362 microversion: 2.25 time: 0.364243 Jul 25 14:28:41.135595 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 485/1026] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:40 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 1362 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:41.295545 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:28:41.414328 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d29f8c0e-5dc8-46f5-8ce1-ccb09cb607bc tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Action: 'create', calling method: .version_select at 0x7f46874ec670>, body: {"keypair": {"name": "tempest-keypair-395562048", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP98grmpMpCYXesSWdGULbmo70NuVK+4Zx85hSnLENryui0hudBsREyEJv6dFsaC0gbIOY9eSCSZyL13yaKFi6mHSeRNoMdzp0MR6488MaVN8gHsIPCEVsyYiISdnLWMmw=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:41.449439 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-d29f8c0e-5dc8-46f5-8ce1-ccb09cb607bc tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Getting quotas for project 884d6897a35e49699a1ce44c2905dc23. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:28:41.457707 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-d29f8c0e-5dc8-46f5-8ce1-ccb09cb607bc tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Getting quotas for user da715e4c9f0f4d9ba4c964417088fa9d and project 884d6897a35e49699a1ce44c2905dc23. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:28:41.488187 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d29f8c0e-5dc8-46f5-8ce1-ccb09cb607bc tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.077742 Jul 25 14:28:41.488815 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 486/1027] 10.222.0.88 () {62 vars in 1200 bytes} [Mon Jul 25 14:28:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 79 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 14:28:41.785682 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f3ad78aa-f43f-4db7-93bf-78a94ef56f7b tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:41.787062 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f3ad78aa-f43f-4db7-93bf-78a94ef56f7b tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] [instance: 66394997-4341-4d25-a34a-a479e299fe03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:41.797226 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3ad78aa-f43f-4db7-93bf-78a94ef56f7b tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:41.798063 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3ad78aa-f43f-4db7-93bf-78a94ef56f7b tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:41.799099 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3ad78aa-f43f-4db7-93bf-78a94ef56f7b tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:41.799758 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3ad78aa-f43f-4db7-93bf-78a94ef56f7b tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:41.873584 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0388569d-d6dc-450f-b542-2028ac76e49d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774744dcf62f4ef78b4a2c8dfc96f9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ca1e9beedc4892861051504a5dff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:41.877325 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:28:41.899684 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0388569d-d6dc-450f-b542-2028ac76e49d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358" status: 200 len: 1322 microversion: 2.1 time: 0.860638 Jul 25 14:28:41.900593 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 542/1028] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:41 2022] GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358 => generated 1322 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:41.908207 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b05f89a6-33e5-4f65-86e1-ddf50d46788c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:41.909105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b05f89a6-33e5-4f65-86e1-ddf50d46788c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:41.924695 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b05f89a6-33e5-4f65-86e1-ddf50d46788c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:41.926152 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b05f89a6-33e5-4f65-86e1-ddf50d46788c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:41.927135 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b05f89a6-33e5-4f65-86e1-ddf50d46788c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:41.927725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b05f89a6-33e5-4f65-86e1-ddf50d46788c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:42.026457 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=12 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:28:42.246119 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b05f89a6-33e5-4f65-86e1-ddf50d46788c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:42.254994 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b05f89a6-33e5-4f65-86e1-ddf50d46788c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1471 microversion: 2.1 time: 0.353024 Jul 25 14:28:42.270706 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 543/1029] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:41 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1471 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:42.277513 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fe6771c9-0e77-4037-bd48-c3e9cb55a6ca tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:42.278632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fe6771c9-0e77-4037-bd48-c3e9cb55a6ca tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:42.286771 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fe6771c9-0e77-4037-bd48-c3e9cb55a6ca tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:42.287457 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fe6771c9-0e77-4037-bd48-c3e9cb55a6ca tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:42.288473 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fe6771c9-0e77-4037-bd48-c3e9cb55a6ca tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:42.289339 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fe6771c9-0e77-4037-bd48-c3e9cb55a6ca tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:42.404227 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fe6771c9-0e77-4037-bd48-c3e9cb55a6ca tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:42.419750 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fe6771c9-0e77-4037-bd48-c3e9cb55a6ca tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:42.421927 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fe6771c9-0e77-4037-bd48-c3e9cb55a6ca tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:42.425875 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:28:42.438815 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fe6771c9-0e77-4037-bd48-c3e9cb55a6ca tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1447 microversion: 2.75 time: 0.164570 Jul 25 14:28:42.439439 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 544/1030] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:42 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1447 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:42.452871 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6875aedb-9ce1-469e-b8ab-33e283557d33 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:42.453493 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6875aedb-9ce1-469e-b8ab-33e283557d33 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:42.471480 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f3ad78aa-f43f-4db7-93bf-78a94ef56f7b tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e734f14df14d4621be6343f462b81a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38ea3df00a4a6c84834a04fadc2901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:42.482049 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f3ad78aa-f43f-4db7-93bf-78a94ef56f7b tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] 10.222.0.88 "GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03" status: 200 len: 1314 microversion: 2.1 time: 0.700315 Jul 25 14:28:42.483825 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6875aedb-9ce1-469e-b8ab-33e283557d33 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:42.483825 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6875aedb-9ce1-469e-b8ab-33e283557d33 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:42.489656 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6875aedb-9ce1-469e-b8ab-33e283557d33 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:42.490022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6875aedb-9ce1-469e-b8ab-33e283557d33 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:42.495629 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 487/1031] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:41 2022] GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03 => generated 1314 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:42.504457 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ceca9a16-ba69-4f8d-a38b-84089b79968b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:42.505003 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ceca9a16-ba69-4f8d-a38b-84089b79968b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:42.529303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ceca9a16-ba69-4f8d-a38b-84089b79968b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:42.529807 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ceca9a16-ba69-4f8d-a38b-84089b79968b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:42.530605 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ceca9a16-ba69-4f8d-a38b-84089b79968b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:42.531162 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ceca9a16-ba69-4f8d-a38b-84089b79968b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:42.670223 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ceca9a16-ba69-4f8d-a38b-84089b79968b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "POST /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff/action" status: 204 len: 0 microversion: 2.1 time: 0.173278 Jul 25 14:28:42.671446 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 488/1032] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:28:42 2022] POST /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff/action => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:28:42.687406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-822d61d3-4fbe-4a0f-acd6-80e4ea7007fe req-41529061-7170-4258-ae6b-dd5f6a27642d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66394997-4341-4d25-a34a-a479e299fe03", "name": "network-vif-plugged", "status": "completed", "tag": "12c7cc1c-4824-47a5-9693-38cf4730df08"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:42.698735 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-822d61d3-4fbe-4a0f-acd6-80e4ea7007fe req-41529061-7170-4258-ae6b-dd5f6a27642d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:42.699516 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-822d61d3-4fbe-4a0f-acd6-80e4ea7007fe req-41529061-7170-4258-ae6b-dd5f6a27642d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:42.729811 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-822d61d3-4fbe-4a0f-acd6-80e4ea7007fe req-41529061-7170-4258-ae6b-dd5f6a27642d service nova] Creating event network-vif-plugged:12c7cc1c-4824-47a5-9693-38cf4730df08 for instance 66394997-4341-4d25-a34a-a479e299fe03 on n-h2-846435-14 Jul 25 14:28:42.743474 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-822d61d3-4fbe-4a0f-acd6-80e4ea7007fe req-41529061-7170-4258-ae6b-dd5f6a27642d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070401 Jul 25 14:28:42.744703 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 489/1033] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:42.820283 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6875aedb-9ce1-469e-b8ab-33e283557d33 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:42.828626 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6875aedb-9ce1-469e-b8ab-33e283557d33 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:42.830192 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6875aedb-9ce1-469e-b8ab-33e283557d33 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:42.834200 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6875aedb-9ce1-469e-b8ab-33e283557d33 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 200 len: 1362 microversion: 2.25 time: 0.393759 Jul 25 14:28:42.835314 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-90fb15df-38a5-47df-8763-13f93b7dbd79 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] Action: 'create', calling method: .version_select at 0x7f46875fc700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1030172769", "description": "tempest-description-1853973068"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:42.848329 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 545/1034] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:42 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 1362 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:42.848329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ae5e577c-8e28-47ee-bbdd-727fa3dccff1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:42.848329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ae5e577c-8e28-47ee-bbdd-727fa3dccff1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:42.852050 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ae5e577c-8e28-47ee-bbdd-727fa3dccff1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:42.852703 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ae5e577c-8e28-47ee-bbdd-727fa3dccff1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:42.853626 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ae5e577c-8e28-47ee-bbdd-727fa3dccff1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:42.854212 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ae5e577c-8e28-47ee-bbdd-727fa3dccff1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:43.085747 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ae5e577c-8e28-47ee-bbdd-727fa3dccff1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:43.095240 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ae5e577c-8e28-47ee-bbdd-727fa3dccff1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1471 microversion: 2.1 time: 0.253922 Jul 25 14:28:43.095832 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 546/1035] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:42 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1471 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:43.101203 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2ab6111f-5c04-4e29-998b-805834fadccb tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:43.106750 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2ab6111f-5c04-4e29-998b-805834fadccb tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 1c6f6d12-3660-40ec-bf99-d735fa9d0358] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:43.122395 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2ab6111f-5c04-4e29-998b-805834fadccb tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:43.123042 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2ab6111f-5c04-4e29-998b-805834fadccb tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:43.124026 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2ab6111f-5c04-4e29-998b-805834fadccb tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:43.124620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2ab6111f-5c04-4e29-998b-805834fadccb tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:43.266390 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-90fb15df-38a5-47df-8763-13f93b7dbd79 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.519949 Jul 25 14:28:43.267052 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 490/1036] 10.222.0.88 () {60 vars in 1180 bytes} [Mon Jul 25 14:28:42 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:43.279767 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-52730191-b7e1-4bef-ad28-47ea87c397f7 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] Action: 'create', calling method: .version_select at 0x7f468763edc0>, body: {"security_group_rule": {"parent_group_id": "a93ec440-1c7b-4f29-868b-f22a1c5989d5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:43.505228 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2ab6111f-5c04-4e29-998b-805834fadccb tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774744dcf62f4ef78b4a2c8dfc96f9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ca1e9beedc4892861051504a5dff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:43.515306 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2ab6111f-5c04-4e29-998b-805834fadccb tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358" status: 200 len: 1322 microversion: 2.1 time: 0.417542 Jul 25 14:28:43.517231 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 547/1037] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:43 2022] GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358 => generated 1322 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:43.533835 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-42e2a8c6-ead3-42ed-980f-7c3af53671da tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:43.534426 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-42e2a8c6-ead3-42ed-980f-7c3af53671da tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: fca96a8a-7721-4bbc-8ffa-b732ef5d753d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:43.551029 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-42e2a8c6-ead3-42ed-980f-7c3af53671da tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:43.551541 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-42e2a8c6-ead3-42ed-980f-7c3af53671da tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:43.552322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-42e2a8c6-ead3-42ed-980f-7c3af53671da tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:43.559531 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-42e2a8c6-ead3-42ed-980f-7c3af53671da tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:43.593135 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-42e2a8c6-ead3-42ed-980f-7c3af53671da tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: fca96a8a-7721-4bbc-8ffa-b732ef5d753d] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:28:43.777345 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-42e2a8c6-ead3-42ed-980f-7c3af53671da tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "DELETE /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d" status: 204 len: 0 microversion: 2.1 time: 0.257737 Jul 25 14:28:43.778271 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 548/1038] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:28:43 2022] DELETE /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:28:43.784988 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ae1beb08-bf8d-4608-b01f-6e38b7fcecf7 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:43.786288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ae1beb08-bf8d-4608-b01f-6e38b7fcecf7 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:43.795035 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ae1beb08-bf8d-4608-b01f-6e38b7fcecf7 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:43.795728 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ae1beb08-bf8d-4608-b01f-6e38b7fcecf7 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:43.796782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ae1beb08-bf8d-4608-b01f-6e38b7fcecf7 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:43.797559 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ae1beb08-bf8d-4608-b01f-6e38b7fcecf7 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:43.877844 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-52730191-b7e1-4bef-ad28-47ea87c397f7 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] 10.222.0.88 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.600750 Jul 25 14:28:43.879535 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 491/1039] 10.222.0.88 () {60 vars in 1195 bytes} [Mon Jul 25 14:28:43 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:43.892358 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8b0c9c51-0abb-4d6c-957d-1746591585c3 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:43.893508 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8b0c9c51-0abb-4d6c-957d-1746591585c3 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] [instance: 66394997-4341-4d25-a34a-a479e299fe03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:43.922032 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ae1beb08-bf8d-4608-b01f-6e38b7fcecf7 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:43.931937 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b0c9c51-0abb-4d6c-957d-1746591585c3 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:43.934110 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b0c9c51-0abb-4d6c-957d-1746591585c3 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:43.935012 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b0c9c51-0abb-4d6c-957d-1746591585c3 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:43.935459 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b0c9c51-0abb-4d6c-957d-1746591585c3 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:43.946445 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ae1beb08-bf8d-4608-b01f-6e38b7fcecf7 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:43.948939 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ae1beb08-bf8d-4608-b01f-6e38b7fcecf7 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:43.958349 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ae1beb08-bf8d-4608-b01f-6e38b7fcecf7 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1447 microversion: 2.75 time: 0.178365 Jul 25 14:28:43.959505 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 549/1040] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:43 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1447 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:43.965368 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-52633a1e-d236-44dd-9adb-cf2936228d8a tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:43.966462 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-52633a1e-d236-44dd-9adb-cf2936228d8a tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: fca96a8a-7721-4bbc-8ffa-b732ef5d753d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:43.975239 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52633a1e-d236-44dd-9adb-cf2936228d8a tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:43.976135 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52633a1e-d236-44dd-9adb-cf2936228d8a tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:43.977197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52633a1e-d236-44dd-9adb-cf2936228d8a tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:43.978688 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52633a1e-d236-44dd-9adb-cf2936228d8a tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:44.223596 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-52633a1e-d236-44dd-9adb-cf2936228d8a tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:44.235680 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-52633a1e-d236-44dd-9adb-cf2936228d8a tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d" status: 200 len: 1711 microversion: 2.1 time: 0.274647 Jul 25 14:28:44.236874 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 550/1041] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:43 2022] GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d => generated 1711 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:44.244235 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8b0c9c51-0abb-4d6c-957d-1746591585c3 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e734f14df14d4621be6343f462b81a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38ea3df00a4a6c84834a04fadc2901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:44.252950 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8b0c9c51-0abb-4d6c-957d-1746591585c3 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] 10.222.0.88 "GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03" status: 200 len: 1314 microversion: 2.1 time: 0.372100 Jul 25 14:28:44.256745 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 492/1042] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:43 2022] GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:44.268940 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0a2f16ba-c69e-49df-85fb-4f3a4d6b7d90 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:44.268940 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0a2f16ba-c69e-49df-85fb-4f3a4d6b7d90 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:44.269187 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f0f9113c-71c3-42c2-9568-7cf34763ea27 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] Action: 'create', calling method: .version_select at 0x7f468763e1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1676756884", "description": "tempest-description-792486941"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:44.273754 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0a2f16ba-c69e-49df-85fb-4f3a4d6b7d90 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:44.274210 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0a2f16ba-c69e-49df-85fb-4f3a4d6b7d90 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:44.274984 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0a2f16ba-c69e-49df-85fb-4f3a4d6b7d90 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:44.275423 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0a2f16ba-c69e-49df-85fb-4f3a4d6b7d90 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:44.441013 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f0f9113c-71c3-42c2-9568-7cf34763ea27 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.182650 Jul 25 14:28:44.442548 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 493/1043] 10.222.0.88 () {60 vars in 1180 bytes} [Mon Jul 25 14:28:44 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:44.449194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0a2f16ba-c69e-49df-85fb-4f3a4d6b7d90 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:44.454413 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9f025559-f033-4994-9eca-4718150a6036 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:44.455211 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9f025559-f033-4994-9eca-4718150a6036 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:44.460020 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0a2f16ba-c69e-49df-85fb-4f3a4d6b7d90 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:44.461488 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0a2f16ba-c69e-49df-85fb-4f3a4d6b7d90 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:44.462618 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0a2f16ba-c69e-49df-85fb-4f3a4d6b7d90 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 200 len: 1362 microversion: 2.25 time: 0.224520 Jul 25 14:28:44.464050 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 551/1044] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:44 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:44.469766 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6e2ba599-cd12-468e-9f48-221820ae4fd0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1928916092", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "7a2f48d6-0132-4d17-b322-ac3a7723438a"}, {"port": "2119900d-6644-4bf4-bbbb-a819dec5f58d", "tag": "port-1"}, {"port": "1b64c898-66f1-4e5b-be51-5b73f032a6f6", "tag": "port-2"}, {"uuid": "027d60df-0ae0-4f52-8b1a-c87b9ae3ce21", "tag": "net-1"}, {"uuid": "027d60df-0ae0-4f52-8b1a-c87b9ae3ce21"}, {"uuid": "c444ffcf-98e7-44ff-a27b-e7feb1d0ac6f", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "c444ffcf-98e7-44ff-a27b-e7feb1d0ac6f", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "d49ac5ad-4993-4ffc-ae11-34338442f93a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "359b3233-d00a-45c6-b2c4-0c318cfc5674", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "0212954d-e1ae-45bc-8c45-00d8b4afb35c", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--834639996"}], "key_name": "tempest-keypair-395562048", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:44.480432 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f025559-f033-4994-9eca-4718150a6036 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:44.481018 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f025559-f033-4994-9eca-4718150a6036 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:44.481979 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f025559-f033-4994-9eca-4718150a6036 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:44.482930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f025559-f033-4994-9eca-4718150a6036 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:44.609714 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-6e2ba599-cd12-468e-9f48-221820ae4fd0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] validate_networks() for [('7a2f48d6-0132-4d17-b322-ac3a7723438a', None, None, None, None, None), (None, None, '2119900d-6644-4bf4-bbbb-a819dec5f58d', None, None, None), (None, None, '1b64c898-66f1-4e5b-be51-5b73f032a6f6', None, None, None), ('027d60df-0ae0-4f52-8b1a-c87b9ae3ce21', None, None, None, None, None), ('027d60df-0ae0-4f52-8b1a-c87b9ae3ce21', None, None, None, None, None), ('c444ffcf-98e7-44ff-a27b-e7feb1d0ac6f', '10.2.2.100', None, None, None, None), ('c444ffcf-98e7-44ff-a27b-e7feb1d0ac6f', '10.2.2.200', None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:28:44.650402 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9f025559-f033-4994-9eca-4718150a6036 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:44.661508 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9f025559-f033-4994-9eca-4718150a6036 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1471 microversion: 2.1 time: 0.216867 Jul 25 14:28:44.662398 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 494/1045] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:44 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1471 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:44.682601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6692ca06-9a67-476c-a4d6-196eb11c1fa4 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] Action: 'create', calling method: .version_select at 0x7f468763ec10>, body: {"security_group_rule": {"parent_group_id": "d5a5b947-bf6c-48ef-9532-764a4a5f49da", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:44.923625 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6692ca06-9a67-476c-a4d6-196eb11c1fa4 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] 10.222.0.88 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.259023 Jul 25 14:28:44.926813 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 495/1046] 10.222.0.88 () {60 vars in 1195 bytes} [Mon Jul 25 14:28:44 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:44.938602 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6a910da3-3427-4341-9543-373e7ef4c5c3 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:44.939567 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6a910da3-3427-4341-9543-373e7ef4c5c3 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 1c6f6d12-3660-40ec-bf99-d735fa9d0358] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:44.963228 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6a910da3-3427-4341-9543-373e7ef4c5c3 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:44.963681 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6a910da3-3427-4341-9543-373e7ef4c5c3 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:44.964521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6a910da3-3427-4341-9543-373e7ef4c5c3 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:44.964958 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6a910da3-3427-4341-9543-373e7ef4c5c3 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:45.125815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6a910da3-3427-4341-9543-373e7ef4c5c3 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774744dcf62f4ef78b4a2c8dfc96f9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ca1e9beedc4892861051504a5dff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:45.133718 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6a910da3-3427-4341-9543-373e7ef4c5c3 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358" status: 200 len: 1322 microversion: 2.1 time: 0.205645 Jul 25 14:28:45.134392 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 496/1047] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:44 2022] GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:45.139705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-58357e4e-6013-4770-85ea-367667195d4b tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] Action: 'create', calling method: .version_select at 0x7f46875fc700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1233594085", "description": "tempest-description-699360939"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:45.298842 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-58357e4e-6013-4770-85ea-367667195d4b tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.162968 Jul 25 14:28:45.299439 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 497/1048] 10.222.0.88 () {60 vars in 1180 bytes} [Mon Jul 25 14:28:45 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:45.310600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e23a4f09-a20f-45bb-8da2-80bb7884f7e6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:45.311528 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e23a4f09-a20f-45bb-8da2-80bb7884f7e6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:45.318214 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e23a4f09-a20f-45bb-8da2-80bb7884f7e6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:45.318659 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e23a4f09-a20f-45bb-8da2-80bb7884f7e6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:45.319620 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e23a4f09-a20f-45bb-8da2-80bb7884f7e6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:45.320318 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e23a4f09-a20f-45bb-8da2-80bb7884f7e6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:45.395392 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e23a4f09-a20f-45bb-8da2-80bb7884f7e6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:45.405669 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e23a4f09-a20f-45bb-8da2-80bb7884f7e6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:45.406916 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e23a4f09-a20f-45bb-8da2-80bb7884f7e6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:45.414000 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e23a4f09-a20f-45bb-8da2-80bb7884f7e6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1447 microversion: 2.75 time: 0.113532 Jul 25 14:28:45.414921 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 498/1049] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:45 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1447 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:45.420081 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8b9bfe82-7202-4299-9d8a-6a8e3e8df9a2 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:45.420547 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8b9bfe82-7202-4299-9d8a-6a8e3e8df9a2 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: fca96a8a-7721-4bbc-8ffa-b732ef5d753d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:45.427079 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b9bfe82-7202-4299-9d8a-6a8e3e8df9a2 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:45.427538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b9bfe82-7202-4299-9d8a-6a8e3e8df9a2 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:45.428407 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b9bfe82-7202-4299-9d8a-6a8e3e8df9a2 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:45.428855 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b9bfe82-7202-4299-9d8a-6a8e3e8df9a2 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:45.683261 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8b9bfe82-7202-4299-9d8a-6a8e3e8df9a2 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:45.691730 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8b9bfe82-7202-4299-9d8a-6a8e3e8df9a2 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d" status: 200 len: 1711 microversion: 2.1 time: 0.275736 Jul 25 14:28:45.692343 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 499/1050] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:45 2022] GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d => generated 1711 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:45.708744 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fba736b0-a805-46b6-a6b4-4f0068449d26 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:45.709511 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fba736b0-a805-46b6-a6b4-4f0068449d26 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] [instance: 66394997-4341-4d25-a34a-a479e299fe03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:45.717189 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fba736b0-a805-46b6-a6b4-4f0068449d26 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:45.718288 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fba736b0-a805-46b6-a6b4-4f0068449d26 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:45.719359 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fba736b0-a805-46b6-a6b4-4f0068449d26 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:45.720073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fba736b0-a805-46b6-a6b4-4f0068449d26 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:45.893521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fba736b0-a805-46b6-a6b4-4f0068449d26 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e734f14df14d4621be6343f462b81a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38ea3df00a4a6c84834a04fadc2901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:45.902094 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fba736b0-a805-46b6-a6b4-4f0068449d26 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] 10.222.0.88 "GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03" status: 200 len: 1314 microversion: 2.1 time: 0.208668 Jul 25 14:28:45.916629 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 500/1051] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:45 2022] GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:45.921964 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-07cfa704-cc2c-4d68-850c-e7d9e7ff3f14 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] Action: 'create', calling method: .version_select at 0x7f46875fc280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1002402289", "description": "tempest-description-1320581586"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:46.098086 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-07cfa704-cc2c-4d68-850c-e7d9e7ff3f14 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.179952 Jul 25 14:28:46.098976 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 501/1052] 10.222.0.88 () {60 vars in 1180 bytes} [Mon Jul 25 14:28:45 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:46.103843 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3e36a34b-62a0-45b0-b6e9-016b7d5ebd7c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:46.104904 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3e36a34b-62a0-45b0-b6e9-016b7d5ebd7c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:46.120556 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3e36a34b-62a0-45b0-b6e9-016b7d5ebd7c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:46.121307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3e36a34b-62a0-45b0-b6e9-016b7d5ebd7c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:46.123280 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3e36a34b-62a0-45b0-b6e9-016b7d5ebd7c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:46.124498 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3e36a34b-62a0-45b0-b6e9-016b7d5ebd7c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:46.322522 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3e36a34b-62a0-45b0-b6e9-016b7d5ebd7c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:46.330830 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3e36a34b-62a0-45b0-b6e9-016b7d5ebd7c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:46.332419 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3e36a34b-62a0-45b0-b6e9-016b7d5ebd7c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:46.333793 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3e36a34b-62a0-45b0-b6e9-016b7d5ebd7c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 200 len: 1362 microversion: 2.25 time: 0.233390 Jul 25 14:28:46.334689 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 502/1053] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:46 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:46.339411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6e626b6c-df3e-4bd3-810a-903ba3802ed4 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:46.340240 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6e626b6c-df3e-4bd3-810a-903ba3802ed4 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:46.353236 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e626b6c-df3e-4bd3-810a-903ba3802ed4 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:46.353930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e626b6c-df3e-4bd3-810a-903ba3802ed4 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:46.354869 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e626b6c-df3e-4bd3-810a-903ba3802ed4 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:46.355474 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e626b6c-df3e-4bd3-810a-903ba3802ed4 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:46.385592 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:28:46.522691 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6e626b6c-df3e-4bd3-810a-903ba3802ed4 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:46.531346 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6e626b6c-df3e-4bd3-810a-903ba3802ed4 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1463 microversion: 2.1 time: 0.195451 Jul 25 14:28:46.532006 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 503/1054] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:46 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1463 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:46.536722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-c5c58064-f829-4ca6-a150-3cd9f37fd810 req-f31a5ab4-00ae-4c35-8e01-0a4eb015ff1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5db8a05-a27e-4426-9166-44727d5cc4ff", "name": "network-vif-plugged", "status": "completed", "tag": "f34d13c0-b812-4793-bcd0-55fe6e34bc46"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:46.546506 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c5c58064-f829-4ca6-a150-3cd9f37fd810 req-f31a5ab4-00ae-4c35-8e01-0a4eb015ff1f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:46.546959 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c5c58064-f829-4ca6-a150-3cd9f37fd810 req-f31a5ab4-00ae-4c35-8e01-0a4eb015ff1f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:46.558299 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-c5c58064-f829-4ca6-a150-3cd9f37fd810 req-f31a5ab4-00ae-4c35-8e01-0a4eb015ff1f service nova] Creating event network-vif-plugged:f34d13c0-b812-4793-bcd0-55fe6e34bc46 for instance d5db8a05-a27e-4426-9166-44727d5cc4ff on n-h1-846435-14 Jul 25 14:28:46.563546 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-c5c58064-f829-4ca6-a150-3cd9f37fd810 req-f31a5ab4-00ae-4c35-8e01-0a4eb015ff1f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030096 Jul 25 14:28:46.564276 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 504/1055] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:46.572303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-12086dc4-d0d3-4299-84c9-fea5c550621c tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] Action: 'create', calling method: .version_select at 0x7f468753f790>, body: {"security_group_rule": {"parent_group_id": "6300240d-5974-4a50-91f2-6dcdbbbbceb2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "e5489e44-ae73-4fd9-a356-2dc451f997a8"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:46.820300 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-12086dc4-d0d3-4299-84c9-fea5c550621c tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] 10.222.0.88 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.251814 Jul 25 14:28:46.820964 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 505/1056] 10.222.0.88 () {60 vars in 1195 bytes} [Mon Jul 25 14:28:46 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:46.825445 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b8bb0825-7903-4fdc-bed9-b3ec80aa008f tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:46.826166 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b8bb0825-7903-4fdc-bed9-b3ec80aa008f tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 1c6f6d12-3660-40ec-bf99-d735fa9d0358] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:46.834139 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8bb0825-7903-4fdc-bed9-b3ec80aa008f tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:46.834565 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8bb0825-7903-4fdc-bed9-b3ec80aa008f tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:46.835339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8bb0825-7903-4fdc-bed9-b3ec80aa008f tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:46.835775 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8bb0825-7903-4fdc-bed9-b3ec80aa008f tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:46.968942 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b8bb0825-7903-4fdc-bed9-b3ec80aa008f tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774744dcf62f4ef78b4a2c8dfc96f9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ca1e9beedc4892861051504a5dff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:46.976975 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b8bb0825-7903-4fdc-bed9-b3ec80aa008f tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358" status: 200 len: 1322 microversion: 2.1 time: 0.154988 Jul 25 14:28:46.977524 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 506/1057] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:46 2022] GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:46.982190 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b4ade4e6-ff14-4f29-a736-afbb860f5994 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:46.982798 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b4ade4e6-ff14-4f29-a736-afbb860f5994 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:46.988579 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b4ade4e6-ff14-4f29-a736-afbb860f5994 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:46.989268 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b4ade4e6-ff14-4f29-a736-afbb860f5994 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:46.990046 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b4ade4e6-ff14-4f29-a736-afbb860f5994 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:46.990481 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b4ade4e6-ff14-4f29-a736-afbb860f5994 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:47.054582 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b4ade4e6-ff14-4f29-a736-afbb860f5994 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:47.062717 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b4ade4e6-ff14-4f29-a736-afbb860f5994 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:47.064426 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b4ade4e6-ff14-4f29-a736-afbb860f5994 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:47.069535 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b4ade4e6-ff14-4f29-a736-afbb860f5994 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1447 microversion: 2.75 time: 0.090898 Jul 25 14:28:47.070112 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 507/1058] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:46 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1447 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:47.074564 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-aba36a4a-cd44-47c5-9b36-186f21300d6d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:47.075176 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-aba36a4a-cd44-47c5-9b36-186f21300d6d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:47.081053 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aba36a4a-cd44-47c5-9b36-186f21300d6d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:47.081718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aba36a4a-cd44-47c5-9b36-186f21300d6d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:47.082657 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aba36a4a-cd44-47c5-9b36-186f21300d6d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:47.083265 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aba36a4a-cd44-47c5-9b36-186f21300d6d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:47.184000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-6e2ba599-cd12-468e-9f48-221820ae4fd0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:28:47.184509 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-6e2ba599-cd12-468e-9f48-221820ae4fd0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:28:47.185003 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-6e2ba599-cd12-468e-9f48-221820ae4fd0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:28:47.185405 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-6e2ba599-cd12-468e-9f48-221820ae4fd0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:28:47.185924 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-6e2ba599-cd12-468e-9f48-221820ae4fd0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:28:47.195483 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e2ba599-cd12-468e-9f48-221820ae4fd0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:47.196171 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e2ba599-cd12-468e-9f48-221820ae4fd0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:47.197251 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e2ba599-cd12-468e-9f48-221820ae4fd0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:47.197880 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e2ba599-cd12-468e-9f48-221820ae4fd0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:47.217565 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-6e2ba599-cd12-468e-9f48-221820ae4fd0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Getting quotas for project 884d6897a35e49699a1ce44c2905dc23. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:28:47.217713 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-aba36a4a-cd44-47c5-9b36-186f21300d6d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:47.222852 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-6e2ba599-cd12-468e-9f48-221820ae4fd0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Getting quotas for user da715e4c9f0f4d9ba4c964417088fa9d and project 884d6897a35e49699a1ce44c2905dc23. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:28:47.225400 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-aba36a4a-cd44-47c5-9b36-186f21300d6d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1463 microversion: 2.1 time: 0.154317 Jul 25 14:28:47.226002 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 508/1059] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:47 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1463 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:47.230947 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3a850491-c07e-4c89-a754-51b85f035512 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:47.231888 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3a850491-c07e-4c89-a754-51b85f035512 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: fca96a8a-7721-4bbc-8ffa-b732ef5d753d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:47.238419 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3a850491-c07e-4c89-a754-51b85f035512 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:47.238891 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3a850491-c07e-4c89-a754-51b85f035512 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:47.239653 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3a850491-c07e-4c89-a754-51b85f035512 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:47.240521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3a850491-c07e-4c89-a754-51b85f035512 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:47.402790 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6e2ba599-cd12-468e-9f48-221820ae4fd0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:28:47.405770 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6e2ba599-cd12-468e-9f48-221820ae4fd0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='d49ac5ad-4993-4ffc-ae11-34338442f93a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='359b3233-d00a-45c6-b2c4-0c318cfc5674',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0212954d-e1ae-45bc-8c45-00d8b4afb35c',volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:28:47.475961 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3a850491-c07e-4c89-a754-51b85f035512 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:47.489757 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3a850491-c07e-4c89-a754-51b85f035512 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d" status: 200 len: 1711 microversion: 2.1 time: 0.262467 Jul 25 14:28:47.494124 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 509/1060] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:47 2022] GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d => generated 1711 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:47.504705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-464534f6-f5ad-44d7-a1b9-b6619b8b153d tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] Action: 'create', calling method: .version_select at 0x7f46875a0790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2001111442", "description": "tempest-description-1250678904"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:47.922040 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6e2ba599-cd12-468e-9f48-221820ae4fd0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 3.456703 Jul 25 14:28:47.922837 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 552/1061] 10.222.0.88 () {62 vars in 1189 bytes} [Mon Jul 25 14:28:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 3458 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 14:28:47.930697 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c5ea40ca-a540-4c69-8bc5-9bee8c6f31aa tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:47.931956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c5ea40ca-a540-4c69-8bc5-9bee8c6f31aa tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] [instance: 66394997-4341-4d25-a34a-a479e299fe03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:47.942955 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c5ea40ca-a540-4c69-8bc5-9bee8c6f31aa tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:47.943234 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c5ea40ca-a540-4c69-8bc5-9bee8c6f31aa tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:47.947132 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c5ea40ca-a540-4c69-8bc5-9bee8c6f31aa tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:47.947645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c5ea40ca-a540-4c69-8bc5-9bee8c6f31aa tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:47.959564 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-464534f6-f5ad-44d7-a1b9-b6619b8b153d tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.464103 Jul 25 14:28:47.968411 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 510/1062] 10.222.0.88 () {60 vars in 1180 bytes} [Mon Jul 25 14:28:47 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:47.968411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-12a2fbea-539d-4120-a0ea-f60e13f0b0c2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Action: 'create', calling method: .version_select at 0x7f46874ec8b0>, body: {"keypair": {"name": "tempest-keypair-1801699491", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErDJ5btiPx1zE1qBOnkCRmMayldq3jDm/QurgCMs7T6/9uqaT2OiWSJcBicuK2hj5IXVoIG5kBqq7ssLrhr2YP3M53cF4Os49OoDoXoy6BVYUcPLlRLQfjaGWQKFrPsTw=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:48.005989 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-12a2fbea-539d-4120-a0ea-f60e13f0b0c2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Getting quotas for project 887aa20d1838484eb895896f8f76ce41. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:28:48.011785 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-12a2fbea-539d-4120-a0ea-f60e13f0b0c2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Getting quotas for user 00aea97fb95c44cfa5dce25e9a06cd37 and project 887aa20d1838484eb895896f8f76ce41. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:28:48.041143 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:28:48.057643 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-12a2fbea-539d-4120-a0ea-f60e13f0b0c2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.096092 Jul 25 14:28:48.058635 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 511/1063] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:28:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:48.069287 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ac10d072-f6f9-4cb7-a00f-7f8b8489e02f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:48.071917 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ac10d072-f6f9-4cb7-a00f-7f8b8489e02f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:48.080926 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ac10d072-f6f9-4cb7-a00f-7f8b8489e02f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:48.081392 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ac10d072-f6f9-4cb7-a00f-7f8b8489e02f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:48.082224 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ac10d072-f6f9-4cb7-a00f-7f8b8489e02f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:48.082612 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ac10d072-f6f9-4cb7-a00f-7f8b8489e02f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:48.246456 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c5ea40ca-a540-4c69-8bc5-9bee8c6f31aa tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e734f14df14d4621be6343f462b81a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38ea3df00a4a6c84834a04fadc2901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:48.256442 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c5ea40ca-a540-4c69-8bc5-9bee8c6f31aa tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] 10.222.0.88 "GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03" status: 200 len: 1464 microversion: 2.1 time: 0.331351 Jul 25 14:28:48.270404 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 553/1064] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:47 2022] GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03 => generated 1464 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:48.286405 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3709558f-28c8-4a8e-8a30-59fa8c0bcdfd tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:48.287225 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3709558f-28c8-4a8e-8a30-59fa8c0bcdfd tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:48.325760 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ac10d072-f6f9-4cb7-a00f-7f8b8489e02f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:48.340054 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ac10d072-f6f9-4cb7-a00f-7f8b8489e02f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:48.343355 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ac10d072-f6f9-4cb7-a00f-7f8b8489e02f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:48.344806 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ac10d072-f6f9-4cb7-a00f-7f8b8489e02f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 200 len: 1362 microversion: 2.25 time: 0.285014 Jul 25 14:28:48.345767 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 512/1065] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:48 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 1362 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:48.350620 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-20ac363c-f216-49e7-84a6-6a5f35ccdf47 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] Action: 'create', calling method: .version_select at 0x7f46874f1280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1891501403", "description": "tempest-description-872567009"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:48.388323 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3709558f-28c8-4a8e-8a30-59fa8c0bcdfd tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:48.396331 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3709558f-28c8-4a8e-8a30-59fa8c0bcdfd tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:48.398556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3709558f-28c8-4a8e-8a30-59fa8c0bcdfd tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:48.399872 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3709558f-28c8-4a8e-8a30-59fa8c0bcdfd tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1285 microversion: 2.42 time: 0.128161 Jul 25 14:28:48.400642 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 554/1066] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:48 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:48.427017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a08c59ae-97ed-41d4-a1f0-37e289af879c tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:48.430301 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a08c59ae-97ed-41d4-a1f0-37e289af879c tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 1c6f6d12-3660-40ec-bf99-d735fa9d0358] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:48.446000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a08c59ae-97ed-41d4-a1f0-37e289af879c tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:48.446876 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a08c59ae-97ed-41d4-a1f0-37e289af879c tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:48.447876 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a08c59ae-97ed-41d4-a1f0-37e289af879c tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:48.448587 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a08c59ae-97ed-41d4-a1f0-37e289af879c tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:48.676414 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a08c59ae-97ed-41d4-a1f0-37e289af879c tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774744dcf62f4ef78b4a2c8dfc96f9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ca1e9beedc4892861051504a5dff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:48.684851 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a08c59ae-97ed-41d4-a1f0-37e289af879c tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358" status: 200 len: 1322 microversion: 2.1 time: 0.263278 Jul 25 14:28:48.685928 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 555/1067] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:48 2022] GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358 => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:48.706057 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-476c96b5-5a41-4367-8522-b11014ae7f31 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:48.706939 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-476c96b5-5a41-4367-8522-b11014ae7f31 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:48.713675 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-476c96b5-5a41-4367-8522-b11014ae7f31 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:48.714608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-476c96b5-5a41-4367-8522-b11014ae7f31 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:48.715689 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-476c96b5-5a41-4367-8522-b11014ae7f31 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:48.716447 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-476c96b5-5a41-4367-8522-b11014ae7f31 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:48.752231 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-20ac363c-f216-49e7-84a6-6a5f35ccdf47 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.405195 Jul 25 14:28:48.753046 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 513/1068] 10.222.0.88 () {60 vars in 1180 bytes} [Mon Jul 25 14:28:48 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:48.791688 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-476c96b5-5a41-4367-8522-b11014ae7f31 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:48.803029 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-476c96b5-5a41-4367-8522-b11014ae7f31 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:48.805049 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-476c96b5-5a41-4367-8522-b11014ae7f31 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:48.810552 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-476c96b5-5a41-4367-8522-b11014ae7f31 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1447 microversion: 2.75 time: 0.123419 Jul 25 14:28:48.811345 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 556/1069] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:48 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1447 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:48.816145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6e66ed76-c56e-4034-9e0f-ee77685a5ef5 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:48.816882 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6e66ed76-c56e-4034-9e0f-ee77685a5ef5 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: fca96a8a-7721-4bbc-8ffa-b732ef5d753d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:48.824673 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e66ed76-c56e-4034-9e0f-ee77685a5ef5 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:48.825309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e66ed76-c56e-4034-9e0f-ee77685a5ef5 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:48.826184 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e66ed76-c56e-4034-9e0f-ee77685a5ef5 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:48.826705 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e66ed76-c56e-4034-9e0f-ee77685a5ef5 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:48.905463 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6e66ed76-c56e-4034-9e0f-ee77685a5ef5 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:48.914693 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6e66ed76-c56e-4034-9e0f-ee77685a5ef5 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d" status: 200 len: 1643 microversion: 2.1 time: 0.102063 Jul 25 14:28:48.915361 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 557/1070] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:48 2022] GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d => generated 1643 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:48.920324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-cda4e741-6f5a-4033-b2d2-0c4cf372e28c req-98994838-7afc-472d-ab51-01ee910f6d79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9982c70-c715-4959-b9a9-fee30117751b", "name": "network-vif-plugged", "status": "completed", "tag": "7a86088b-678c-4fae-8f85-06963cf768fa"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:48.940058 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-cda4e741-6f5a-4033-b2d2-0c4cf372e28c req-98994838-7afc-472d-ab51-01ee910f6d79 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:48.941764 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-cda4e741-6f5a-4033-b2d2-0c4cf372e28c req-98994838-7afc-472d-ab51-01ee910f6d79 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:48.965560 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-cda4e741-6f5a-4033-b2d2-0c4cf372e28c req-98994838-7afc-472d-ab51-01ee910f6d79 service nova] Creating event network-vif-plugged:7a86088b-678c-4fae-8f85-06963cf768fa for instance c9982c70-c715-4959-b9a9-fee30117751b on n-h1-846435-14 Jul 25 14:28:48.972379 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-cda4e741-6f5a-4033-b2d2-0c4cf372e28c req-98994838-7afc-472d-ab51-01ee910f6d79 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055517 Jul 25 14:28:48.973918 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 558/1071] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:48.986602 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0be36ed4-40e7-4208-b754-7781396a8ac7 tempest-TenantUsagesTestJSON-1487849254 tempest-TenantUsagesTestJSON-1487849254-project-admin] Calling method '.version_select at 0x7f4687cb79d0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:48.991422 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4532a964-2d64-4ba4-8d95-dccc1de5b891 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] Action: 'create', calling method: .version_select at 0x7f4687648ca0>, body: {"security_group_rule": {"parent_group_id": "e6cc663c-6163-40ff-8794-b3b21af3f7a2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "5dcd68bc-85fa-4f2d-b69a-1dcaff6d54e5"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:49.024260 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0be36ed4-40e7-4208-b754-7781396a8ac7 tempest-TenantUsagesTestJSON-1487849254 tempest-TenantUsagesTestJSON-1487849254-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:49.024720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0be36ed4-40e7-4208-b754-7781396a8ac7 tempest-TenantUsagesTestJSON-1487849254 tempest-TenantUsagesTestJSON-1487849254-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:49.048467 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0be36ed4-40e7-4208-b754-7781396a8ac7 tempest-TenantUsagesTestJSON-1487849254 tempest-TenantUsagesTestJSON-1487849254-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:49.049019 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0be36ed4-40e7-4208-b754-7781396a8ac7 tempest-TenantUsagesTestJSON-1487849254 tempest-TenantUsagesTestJSON-1487849254-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:49.079614 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0be36ed4-40e7-4208-b754-7781396a8ac7 tempest-TenantUsagesTestJSON-1487849254 tempest-TenantUsagesTestJSON-1487849254-project-admin] 10.222.0.88 "GET /compute/v2.1/os-simple-tenant-usage/1b38ea3df00a4a6c84834a04fadc2901?start=2022-07-24T14%3A28%3A48.274450&end=2022-07-26T14%3A28%3A48.274450" status: 200 len: 695 microversion: 2.1 time: 0.318340 Jul 25 14:28:49.084770 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 514/1072] 10.222.0.88 () {58 vars in 1412 bytes} [Mon Jul 25 14:28:48 2022] GET /compute/v2.1/os-simple-tenant-usage/1b38ea3df00a4a6c84834a04fadc2901?start=2022-07-24T14%3A28%3A48.274450&end=2022-07-26T14%3A28%3A48.274450 => generated 695 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:49.102417 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-27599b01-caad-40d3-8137-30944bbf9ecd tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Calling method '.version_select at 0x7f468763e1f0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:49.121711 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27599b01-caad-40d3-8137-30944bbf9ecd tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:49.122190 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27599b01-caad-40d3-8137-30944bbf9ecd tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:49.141018 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27599b01-caad-40d3-8137-30944bbf9ecd tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:49.141782 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27599b01-caad-40d3-8137-30944bbf9ecd tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:49.162275 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-27599b01-caad-40d3-8137-30944bbf9ecd tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] 10.222.0.88 "GET /compute/v2.1/os-simple-tenant-usage/1b38ea3df00a4a6c84834a04fadc2901?start=2022-07-24T14%3A28%3A48.274450&end=2022-07-26T14%3A28%3A48.274450" status: 200 len: 695 microversion: 2.1 time: 0.064672 Jul 25 14:28:49.163439 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 515/1073] 10.222.0.88 () {58 vars in 1412 bytes} [Mon Jul 25 14:28:49 2022] GET /compute/v2.1/os-simple-tenant-usage/1b38ea3df00a4a6c84834a04fadc2901?start=2022-07-24T14%3A28%3A48.274450&end=2022-07-26T14%3A28%3A48.274450 => generated 695 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:49.168863 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-c6043916-5391-4b96-aa9f-9b719e65bd9b req-b083a769-7fe3-4cdf-b9f8-013f5e4712a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fca96a8a-7721-4bbc-8ffa-b732ef5d753d", "name": "network-vif-deleted", "tag": "205878ed-21c4-4153-8a87-16c8234dec0f"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:49.182112 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c6043916-5391-4b96-aa9f-9b719e65bd9b req-b083a769-7fe3-4cdf-b9f8-013f5e4712a1 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:49.182948 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c6043916-5391-4b96-aa9f-9b719e65bd9b req-b083a769-7fe3-4cdf-b9f8-013f5e4712a1 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:49.196553 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-c6043916-5391-4b96-aa9f-9b719e65bd9b req-b083a769-7fe3-4cdf-b9f8-013f5e4712a1 service nova] Creating event network-vif-deleted:205878ed-21c4-4153-8a87-16c8234dec0f for instance fca96a8a-7721-4bbc-8ffa-b732ef5d753d on n-h2-846435-14 Jul 25 14:28:49.202459 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-c6043916-5391-4b96-aa9f-9b719e65bd9b req-b083a769-7fe3-4cdf-b9f8-013f5e4712a1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037594 Jul 25 14:28:49.203713 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 516/1074] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:49.220050 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fecc3a70-c48c-46c9-ab42-1024c59f6305 tempest-TenantUsagesTestJSON-1487849254 tempest-TenantUsagesTestJSON-1487849254-project-admin] Calling method '.version_select at 0x7f46878d3ee0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:49.233361 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fecc3a70-c48c-46c9-ab42-1024c59f6305 tempest-TenantUsagesTestJSON-1487849254 tempest-TenantUsagesTestJSON-1487849254-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:49.234167 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fecc3a70-c48c-46c9-ab42-1024c59f6305 tempest-TenantUsagesTestJSON-1487849254 tempest-TenantUsagesTestJSON-1487849254-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:49.252824 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fecc3a70-c48c-46c9-ab42-1024c59f6305 tempest-TenantUsagesTestJSON-1487849254 tempest-TenantUsagesTestJSON-1487849254-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:49.253888 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fecc3a70-c48c-46c9-ab42-1024c59f6305 tempest-TenantUsagesTestJSON-1487849254 tempest-TenantUsagesTestJSON-1487849254-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:49.319682 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fecc3a70-c48c-46c9-ab42-1024c59f6305 tempest-TenantUsagesTestJSON-1487849254 tempest-TenantUsagesTestJSON-1487849254-project-admin] 10.222.0.88 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-24T14%3A28%3A48.274450&end=2022-07-26T14%3A28%3A48.274450&detailed=1" status: 200 len: 11190 microversion: 2.1 time: 0.110562 Jul 25 14:28:49.320600 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 517/1075] 10.222.0.88 () {58 vars in 1335 bytes} [Mon Jul 25 14:28:49 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-24T14%3A28%3A48.274450&end=2022-07-26T14%3A28%3A48.274450&detailed=1 => generated 11190 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:28:49.349131 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a57da1c4-45be-4baa-af9d-715a3d639500 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:49.350731 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a57da1c4-45be-4baa-af9d-715a3d639500 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] [instance: 66394997-4341-4d25-a34a-a479e299fe03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:49.368540 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a57da1c4-45be-4baa-af9d-715a3d639500 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:49.369719 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a57da1c4-45be-4baa-af9d-715a3d639500 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:49.370902 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a57da1c4-45be-4baa-af9d-715a3d639500 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:49.372700 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a57da1c4-45be-4baa-af9d-715a3d639500 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:49.410479 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a57da1c4-45be-4baa-af9d-715a3d639500 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] [instance: 66394997-4341-4d25-a34a-a479e299fe03] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:28:49.477311 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4532a964-2d64-4ba4-8d95-dccc1de5b891 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] 10.222.0.88 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.501847 Jul 25 14:28:49.479403 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 559/1076] 10.222.0.88 () {60 vars in 1195 bytes} [Mon Jul 25 14:28:48 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:49.486207 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-de74f6be-0331-4ba9-b47c-01d3d07cfbc3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:49.493620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-de74f6be-0331-4ba9-b47c-01d3d07cfbc3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:49.503834 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-de74f6be-0331-4ba9-b47c-01d3d07cfbc3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:49.504523 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-de74f6be-0331-4ba9-b47c-01d3d07cfbc3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:49.505544 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-de74f6be-0331-4ba9-b47c-01d3d07cfbc3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:49.506192 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-de74f6be-0331-4ba9-b47c-01d3d07cfbc3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:49.552991 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a57da1c4-45be-4baa-af9d-715a3d639500 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] 10.222.0.88 "DELETE /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03" status: 204 len: 0 microversion: 2.1 time: 0.208090 Jul 25 14:28:49.562075 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 518/1077] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:28:49 2022] DELETE /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 14:28:49.575885 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5904c1ef-17b3-4d2b-b193-8528958e53a4 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:49.576802 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5904c1ef-17b3-4d2b-b193-8528958e53a4 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:49.583751 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5904c1ef-17b3-4d2b-b193-8528958e53a4 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:49.584537 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5904c1ef-17b3-4d2b-b193-8528958e53a4 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:49.585628 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5904c1ef-17b3-4d2b-b193-8528958e53a4 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:49.586222 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5904c1ef-17b3-4d2b-b193-8528958e53a4 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:49.736907 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-de74f6be-0331-4ba9-b47c-01d3d07cfbc3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:49.746830 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-de74f6be-0331-4ba9-b47c-01d3d07cfbc3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:49.748635 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-de74f6be-0331-4ba9-b47c-01d3d07cfbc3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:49.749844 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-de74f6be-0331-4ba9-b47c-01d3d07cfbc3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 200 len: 1362 microversion: 2.25 time: 0.269200 Jul 25 14:28:49.750830 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 560/1078] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:49 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:49.755820 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cf98228a-f612-4930-ac27-5fb9cdc8c963 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] Calling method '.version_select at 0x7f4687648430>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:49.997572 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cf98228a-f612-4930-ac27-5fb9cdc8c963 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/5dcd68bc-85fa-4f2d-b69a-1dcaff6d54e5" status: 202 len: 0 microversion: 2.1 time: 0.245199 Jul 25 14:28:49.998648 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 561/1079] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:28:49 2022] DELETE /compute/v2.1/os-security-groups/5dcd68bc-85fa-4f2d-b69a-1dcaff6d54e5 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:28:50.003940 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5cff70f1-7949-46e9-8029-965818b0bf52 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:50.004686 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5cff70f1-7949-46e9-8029-965818b0bf52 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] [instance: 66394997-4341-4d25-a34a-a479e299fe03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:50.011569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5cff70f1-7949-46e9-8029-965818b0bf52 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:50.011994 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5cff70f1-7949-46e9-8029-965818b0bf52 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:50.012874 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5cff70f1-7949-46e9-8029-965818b0bf52 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:50.013376 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5cff70f1-7949-46e9-8029-965818b0bf52 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:50.036878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:28:50.038573 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5904c1ef-17b3-4d2b-b193-8528958e53a4 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:50.049764 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5904c1ef-17b3-4d2b-b193-8528958e53a4 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:50.051788 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5904c1ef-17b3-4d2b-b193-8528958e53a4 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:50.053719 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5904c1ef-17b3-4d2b-b193-8528958e53a4 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1575 microversion: 2.42 time: 0.488488 Jul 25 14:28:50.067044 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 519/1080] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:49 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1575 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:50.078752 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-05249438-fcd2-46d8-8401-7272ae68477d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:50.079371 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-05249438-fcd2-46d8-8401-7272ae68477d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 1c6f6d12-3660-40ec-bf99-d735fa9d0358] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:50.085980 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-05249438-fcd2-46d8-8401-7272ae68477d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:50.086790 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-05249438-fcd2-46d8-8401-7272ae68477d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:50.087875 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-05249438-fcd2-46d8-8401-7272ae68477d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:50.088477 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-05249438-fcd2-46d8-8401-7272ae68477d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:50.488342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5cff70f1-7949-46e9-8029-965818b0bf52 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e734f14df14d4621be6343f462b81a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38ea3df00a4a6c84834a04fadc2901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:50.489476 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-05249438-fcd2-46d8-8401-7272ae68477d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774744dcf62f4ef78b4a2c8dfc96f9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ca1e9beedc4892861051504a5dff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:50.500262 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-05249438-fcd2-46d8-8401-7272ae68477d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358" status: 200 len: 1322 microversion: 2.1 time: 0.425421 Jul 25 14:28:50.501518 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 520/1081] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:50 2022] GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358 => generated 1322 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:50.507032 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f49c42cf-aa69-45e4-bc9f-e4f21aadbef6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:50.507745 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f49c42cf-aa69-45e4-bc9f-e4f21aadbef6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:50.514771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f49c42cf-aa69-45e4-bc9f-e4f21aadbef6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:50.515384 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f49c42cf-aa69-45e4-bc9f-e4f21aadbef6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:50.516431 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f49c42cf-aa69-45e4-bc9f-e4f21aadbef6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:50.517891 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f49c42cf-aa69-45e4-bc9f-e4f21aadbef6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:50.518651 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5cff70f1-7949-46e9-8029-965818b0bf52 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] 10.222.0.88 "GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03" status: 200 len: 1470 microversion: 2.1 time: 0.499635 Jul 25 14:28:50.520067 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 562/1082] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:49 2022] GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03 => generated 1470 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:50.532279 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-009b5ef8-7fd1-4ca7-8111-3ff115f6a0ff tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:50.532279 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-009b5ef8-7fd1-4ca7-8111-3ff115f6a0ff tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: fca96a8a-7721-4bbc-8ffa-b732ef5d753d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:50.533994 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-009b5ef8-7fd1-4ca7-8111-3ff115f6a0ff tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:50.534637 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-009b5ef8-7fd1-4ca7-8111-3ff115f6a0ff tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:50.536527 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-009b5ef8-7fd1-4ca7-8111-3ff115f6a0ff tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:50.536527 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-009b5ef8-7fd1-4ca7-8111-3ff115f6a0ff tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:50.587765 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-009b5ef8-7fd1-4ca7-8111-3ff115f6a0ff tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:50.588353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-009b5ef8-7fd1-4ca7-8111-3ff115f6a0ff tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:50.588892 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-009b5ef8-7fd1-4ca7-8111-3ff115f6a0ff tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lazy-loading 'fault' on Instance uuid fca96a8a-7721-4bbc-8ffa-b732ef5d753d {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:28:50.627141 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f49c42cf-aa69-45e4-bc9f-e4f21aadbef6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:50.638145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-009b5ef8-7fd1-4ca7-8111-3ff115f6a0ff tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec61e9c63c043f49c26eb8220cb67bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d55290b2744998f48e37d5af6dd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:50.639328 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f49c42cf-aa69-45e4-bc9f-e4f21aadbef6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:50.643724 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f49c42cf-aa69-45e4-bc9f-e4f21aadbef6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:50.648684 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-009b5ef8-7fd1-4ca7-8111-3ff115f6a0ff tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d" status: 200 len: 1352 microversion: 2.1 time: 0.126934 Jul 25 14:28:50.649389 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 563/1083] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:50 2022] GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d => generated 1352 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:50.654284 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bb4c4396-83b4-42ba-8cc3-2f8ca04ae3a5 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] Calling method '.version_select at 0x7f46876a3af0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:50.658545 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f49c42cf-aa69-45e4-bc9f-e4f21aadbef6 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1447 microversion: 2.75 time: 0.155635 Jul 25 14:28:50.665897 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 521/1084] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:50 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1447 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:50.704427 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bb4c4396-83b4-42ba-8cc3-2f8ca04ae3a5 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] 10.222.0.88 "GET /compute/v2.1/os-security-groups/e6cc663c-6163-40ff-8794-b3b21af3f7a2" status: 200 len: 248 microversion: 2.1 time: 0.053715 Jul 25 14:28:50.705019 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 564/1085] 10.222.0.88 () {58 vars in 1269 bytes} [Mon Jul 25 14:28:50 2022] GET /compute/v2.1/os-security-groups/e6cc663c-6163-40ff-8794-b3b21af3f7a2 => generated 248 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:50.718693 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c5744eeb-ce80-4d70-a921-489bc3955a73 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] Action: 'create', calling method: .version_select at 0x7f4687408430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1183914820", "description": "tempest-description-1328826028"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:50.773612 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3cf196b9-ccc1-4e0a-879b-68ec5d194d37 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:50.774215 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3cf196b9-ccc1-4e0a-879b-68ec5d194d37 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:50.786066 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3cf196b9-ccc1-4e0a-879b-68ec5d194d37 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:50.786871 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3cf196b9-ccc1-4e0a-879b-68ec5d194d37 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:50.787801 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3cf196b9-ccc1-4e0a-879b-68ec5d194d37 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:50.788286 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3cf196b9-ccc1-4e0a-879b-68ec5d194d37 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:50.975010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3cf196b9-ccc1-4e0a-879b-68ec5d194d37 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:50.990288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3cf196b9-ccc1-4e0a-879b-68ec5d194d37 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:50.995919 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3cf196b9-ccc1-4e0a-879b-68ec5d194d37 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:50.999115 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3cf196b9-ccc1-4e0a-879b-68ec5d194d37 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 200 len: 1558 microversion: 2.25 time: 0.229564 Jul 25 14:28:51.003615 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 565/1086] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:50 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 1558 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:28:51.008500 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-5d040c50-dfc7-4d8a-9c37-82ac3c658200 req-5f4e24b1-4211-4f62-b3f6-9b3d8f119180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c6f6d12-3660-40ec-bf99-d735fa9d0358", "name": "network-vif-plugged", "status": "completed", "tag": "fb6f83eb-2e87-4f51-aa28-9bf153938de2"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:51.022718 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-5d040c50-dfc7-4d8a-9c37-82ac3c658200 req-5f4e24b1-4211-4f62-b3f6-9b3d8f119180 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:51.023198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-5d040c50-dfc7-4d8a-9c37-82ac3c658200 req-5f4e24b1-4211-4f62-b3f6-9b3d8f119180 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:51.036627 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-5d040c50-dfc7-4d8a-9c37-82ac3c658200 req-5f4e24b1-4211-4f62-b3f6-9b3d8f119180 service nova] Creating event network-vif-plugged:fb6f83eb-2e87-4f51-aa28-9bf153938de2 for instance 1c6f6d12-3660-40ec-bf99-d735fa9d0358 on n-h2-846435-14 Jul 25 14:28:51.042860 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-5d040c50-dfc7-4d8a-9c37-82ac3c658200 req-5f4e24b1-4211-4f62-b3f6-9b3d8f119180 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038206 Jul 25 14:28:51.044468 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 566/1087] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:51.050395 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7430ee23-07d5-401e-98be-ec072397d9a9 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:51.051088 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7430ee23-07d5-401e-98be-ec072397d9a9 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:51.065314 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7430ee23-07d5-401e-98be-ec072397d9a9 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:51.065857 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7430ee23-07d5-401e-98be-ec072397d9a9 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:51.066723 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7430ee23-07d5-401e-98be-ec072397d9a9 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:51.067257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7430ee23-07d5-401e-98be-ec072397d9a9 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:51.209303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-7430ee23-07d5-401e-98be-ec072397d9a9 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lazy-loading 'services' on Instance uuid c9982c70-c715-4959-b9a9-fee30117751b {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:28:51.225052 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7430ee23-07d5-401e-98be-ec072397d9a9 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 200 len: 2053 microversion: 2.25 time: 0.179308 Jul 25 14:28:51.225786 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 567/1088] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:51 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 2053 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:51.237386 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c5744eeb-ce80-4d70-a921-489bc3955a73 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.521637 Jul 25 14:28:51.239034 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 522/1089] 10.222.0.88 () {60 vars in 1180 bytes} [Mon Jul 25 14:28:50 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:51.261069 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-551b2ac9-3b8a-4361-8d79-dd98b73721ba tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] Action: 'create', calling method: .version_select at 0x7f4687408a60>, body: {"security_group_rule": {"parent_group_id": "75f714e1-ba33-45d4-b0ed-5e533a268ad7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:51.267145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1d30c988-19cc-441c-bdaa-ea79a462bd2b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:51.280234 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1d30c988-19cc-441c-bdaa-ea79a462bd2b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:51.290483 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1d30c988-19cc-441c-bdaa-ea79a462bd2b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:51.291107 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1d30c988-19cc-441c-bdaa-ea79a462bd2b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:51.293722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1d30c988-19cc-441c-bdaa-ea79a462bd2b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:51.294269 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1d30c988-19cc-441c-bdaa-ea79a462bd2b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:51.425337 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1d30c988-19cc-441c-bdaa-ea79a462bd2b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:51.449186 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1d30c988-19cc-441c-bdaa-ea79a462bd2b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:51.453858 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1d30c988-19cc-441c-bdaa-ea79a462bd2b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:51.453858 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1d30c988-19cc-441c-bdaa-ea79a462bd2b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1593 microversion: 2.42 time: 0.222981 Jul 25 14:28:51.453858 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 568/1090] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:51 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1593 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:51.457529 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e14c72ff-c433-4535-970b-e0570e05a71c tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:51.459963 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e14c72ff-c433-4535-970b-e0570e05a71c tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:51.467583 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e14c72ff-c433-4535-970b-e0570e05a71c tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:51.467583 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e14c72ff-c433-4535-970b-e0570e05a71c tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:51.467583 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e14c72ff-c433-4535-970b-e0570e05a71c tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:51.467583 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e14c72ff-c433-4535-970b-e0570e05a71c tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:51.635643 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-e14c72ff-c433-4535-970b-e0570e05a71c tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lazy-loading 'services' on Instance uuid c9982c70-c715-4959-b9a9-fee30117751b {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:28:51.650029 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e14c72ff-c433-4535-970b-e0570e05a71c tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 200 len: 2053 microversion: 2.25 time: 0.195837 Jul 25 14:28:51.660258 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 569/1091] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:51 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 2053 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:51.660258 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b9a9d5d2-28c3-478e-a4a5-4e17ddbfabd2 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:51.660258 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b9a9d5d2-28c3-478e-a4a5-4e17ddbfabd2 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 1c6f6d12-3660-40ec-bf99-d735fa9d0358] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:51.665760 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b9a9d5d2-28c3-478e-a4a5-4e17ddbfabd2 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:51.666622 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b9a9d5d2-28c3-478e-a4a5-4e17ddbfabd2 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:51.667792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b9a9d5d2-28c3-478e-a4a5-4e17ddbfabd2 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:51.668343 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b9a9d5d2-28c3-478e-a4a5-4e17ddbfabd2 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:51.820991 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b9a9d5d2-28c3-478e-a4a5-4e17ddbfabd2 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774744dcf62f4ef78b4a2c8dfc96f9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ca1e9beedc4892861051504a5dff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:51.829346 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b9a9d5d2-28c3-478e-a4a5-4e17ddbfabd2 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358" status: 200 len: 1322 microversion: 2.1 time: 0.177501 Jul 25 14:28:51.842279 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 570/1092] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:51 2022] GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:51.842279 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e0608078-7ea0-4d17-9c02-0adb67279348 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Calling method '.version_select at 0x7f46876adca0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:51.842279 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e0608078-7ea0-4d17-9c02-0adb67279348 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:51.842279 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e0608078-7ea0-4d17-9c02-0adb67279348 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:51.852259 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e0608078-7ea0-4d17-9c02-0adb67279348 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] 10.222.0.88 "GET /compute/v2.1/os-migrations" status: 200 len: 1198 microversion: 2.1 time: 0.020835 Jul 25 14:28:51.853231 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 571/1093] 10.222.0.88 () {58 vars in 1143 bytes} [Mon Jul 25 14:28:51 2022] GET /compute/v2.1/os-migrations => generated 1198 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:51.858481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e8b88656-f11e-437e-b7e7-1e3b37883f1a tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:51.859276 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e8b88656-f11e-437e-b7e7-1e3b37883f1a tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] [instance: 66394997-4341-4d25-a34a-a479e299fe03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:51.868380 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e8b88656-f11e-437e-b7e7-1e3b37883f1a tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:51.868683 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e8b88656-f11e-437e-b7e7-1e3b37883f1a tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:51.869670 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e8b88656-f11e-437e-b7e7-1e3b37883f1a tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:51.869850 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e8b88656-f11e-437e-b7e7-1e3b37883f1a tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:51.923534 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-551b2ac9-3b8a-4361-8d79-dd98b73721ba tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] 10.222.0.88 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.672615 Jul 25 14:28:51.924168 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 523/1094] 10.222.0.88 () {60 vars in 1195 bytes} [Mon Jul 25 14:28:51 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:51.928935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8d795256-524f-41e0-9f50-e3a7d34b5977 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:51.929705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8d795256-524f-41e0-9f50-e3a7d34b5977 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: fca96a8a-7721-4bbc-8ffa-b732ef5d753d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:51.946610 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8d795256-524f-41e0-9f50-e3a7d34b5977 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:51.947062 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8d795256-524f-41e0-9f50-e3a7d34b5977 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:51.947854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8d795256-524f-41e0-9f50-e3a7d34b5977 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:51.948320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8d795256-524f-41e0-9f50-e3a7d34b5977 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:51.977235 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-8d795256-524f-41e0-9f50-e3a7d34b5977 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] HTTP exception thrown: Instance fca96a8a-7721-4bbc-8ffa-b732ef5d753d could not be found. Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8d795256-524f-41e0-9f50-e3a7d34b5977 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Request method failure captured: Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d HTTP/1.1 Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qfepuHN12RSjndHzKsxcvRUnwBd7gUW5USRKf91qDve39QaBVEjKhMdFzop5D0hXXHQ4vxb293-w-WGBfgB-T628gvhrMspbrIW1Vj5UaJgSh6TYZ8NwMP0uyL2kvBxpDAoi44sMFrP6hkwSPxP060bWVpno8LxFv_lSOJlt0uXzFg Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 508d55290b2744998f48e37d5af6dd04 Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1250417465 Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/508d55290b2744998f48e37d5af6dd04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/508d55290b2744998f48e37d5af6dd04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_508d55290b2744998f48e37d5af6dd04", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/508d55290b2744998f48e37d5af6dd04"}]}] Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1250417465 Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 508d55290b2744998f48e37d5af6dd04 Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1250417465 Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1250417465-project Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: aec61e9c63c043f49c26eb8220cb67bb Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1250417465-project Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance fca96a8a-7721-4bbc-8ffa-b732ef5d753d could not be found. Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'fca96a8a-7721-4bbc-8ffa-b732ef5d753d'} Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fca96a8a-7721-4bbc-8ffa-b732ef5d753d could not be found. Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fca96a8a-7721-4bbc-8ffa-b732ef5d753d could not be found. Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:51.979086 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:51.986699 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:51.986699 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:51.986699 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:51.986699 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:51.986699 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:28:51.986699 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:28:51.986699 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fca96a8a-7721-4bbc-8ffa-b732ef5d753d could not be found. Jul 25 14:28:51.986699 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:51.986699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8d795256-524f-41e0-9f50-e3a7d34b5977 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Returning 404 to user: Instance fca96a8a-7721-4bbc-8ffa-b732ef5d753d could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:28:51.986699 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8d795256-524f-41e0-9f50-e3a7d34b5977 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d" status: 404 len: 111 microversion: 2.1 time: 0.057710 Jul 25 14:28:51.986699 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 524/1095] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:51 2022] GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:28:51.993281 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-aafdc404-4d59-4840-b152-303c51145d7c tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:51.996272 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:28:51.996272 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:28:51.997938 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aafdc404-4d59-4840-b152-303c51145d7c tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:51.998566 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aafdc404-4d59-4840-b152-303c51145d7c tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:51.999549 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aafdc404-4d59-4840-b152-303c51145d7c tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:52.000177 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aafdc404-4d59-4840-b152-303c51145d7c tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:52.029908 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-aafdc404-4d59-4840-b152-303c51145d7c tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.042582 Jul 25 14:28:52.030764 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 525/1096] 10.222.0.88 () {60 vars in 1217 bytes} [Mon Jul 25 14:28:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:28:52.041886 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6424c5ab-00dd-4174-8f5e-4629badff3f1 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:52.043137 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6424c5ab-00dd-4174-8f5e-4629badff3f1 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:52.049762 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6424c5ab-00dd-4174-8f5e-4629badff3f1 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:52.050414 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6424c5ab-00dd-4174-8f5e-4629badff3f1 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:52.051431 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6424c5ab-00dd-4174-8f5e-4629badff3f1 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:52.052090 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6424c5ab-00dd-4174-8f5e-4629badff3f1 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:52.095696 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e8b88656-f11e-437e-b7e7-1e3b37883f1a tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e734f14df14d4621be6343f462b81a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38ea3df00a4a6c84834a04fadc2901', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:52.108440 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e8b88656-f11e-437e-b7e7-1e3b37883f1a tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] 10.222.0.88 "GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03" status: 200 len: 1470 microversion: 2.1 time: 0.253792 Jul 25 14:28:52.110483 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 572/1097] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:51 2022] GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03 => generated 1470 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:52.114605 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-14c2d5b8-8720-4c07-8deb-72f9bdc808d5 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:52.124695 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-14c2d5b8-8720-4c07-8deb-72f9bdc808d5 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014526 Jul 25 14:28:52.125651 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 573/1098] 10.222.0.88 () {58 vars in 1137 bytes} [Mon Jul 25 14:28:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:52.130379 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-24b06ff1-42a6-4cad-b020-8211e340ba92 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] Action: 'create', calling method: .version_select at 0x7f4687648af0>, body: {"security_group_rule": {"parent_group_id": "75f714e1-ba33-45d4-b0ed-5e533a268ad7", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:52.165875 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6424c5ab-00dd-4174-8f5e-4629badff3f1 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:52.178075 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6424c5ab-00dd-4174-8f5e-4629badff3f1 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:52.180550 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6424c5ab-00dd-4174-8f5e-4629badff3f1 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:52.193367 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6424c5ab-00dd-4174-8f5e-4629badff3f1 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1447 microversion: 2.75 time: 0.161210 Jul 25 14:28:52.197291 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 526/1099] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:52 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1447 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:52.201803 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6be3fce3-3e29-48a3-a785-429dc2b474b6 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:52.202305 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6be3fce3-3e29-48a3-a785-429dc2b474b6 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:52.221126 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6be3fce3-3e29-48a3-a785-429dc2b474b6 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:52.221586 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6be3fce3-3e29-48a3-a785-429dc2b474b6 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:52.222378 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6be3fce3-3e29-48a3-a785-429dc2b474b6 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:52.222815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6be3fce3-3e29-48a3-a785-429dc2b474b6 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:52.253745 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-6be3fce3-3e29-48a3-a785-429dc2b474b6 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] HTTP exception thrown: Instance 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 could not be found. Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6be3fce3-3e29-48a3-a785-429dc2b474b6 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Request method failure captured: Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 HTTP/1.1 Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qfepuHN12RSjndHzKsxcvRUnwBd7gUW5USRKf91qDve39QaBVEjKhMdFzop5D0hXXHQ4vxb293-w-WGBfgB-T628gvhrMspbrIW1Vj5UaJgSh6TYZ8NwMP0uyL2kvBxpDAoi44sMFrP6hkwSPxP060bWVpno8LxFv_lSOJlt0uXzFg Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 508d55290b2744998f48e37d5af6dd04 Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1250417465 Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/508d55290b2744998f48e37d5af6dd04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/508d55290b2744998f48e37d5af6dd04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_508d55290b2744998f48e37d5af6dd04", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/508d55290b2744998f48e37d5af6dd04"}]}] Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1250417465 Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 508d55290b2744998f48e37d5af6dd04 Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1250417465 Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1250417465-project Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: aec61e9c63c043f49c26eb8220cb67bb Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1250417465-project Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 could not be found. Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5'} Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 could not be found. Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:28:52.256078 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:28:52.260808 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 could not be found. Jul 25 14:28:52.260808 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:52.260808 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:52.260808 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:52.260808 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:52.260808 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:52.260808 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:52.260808 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:28:52.260808 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:28:52.260808 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 could not be found. Jul 25 14:28:52.260808 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:52.263494 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6be3fce3-3e29-48a3-a785-429dc2b474b6 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Returning 404 to user: Instance 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:28:52.264657 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6be3fce3-3e29-48a3-a785-429dc2b474b6 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "DELETE /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5" status: 404 len: 111 microversion: 2.1 time: 0.066554 Jul 25 14:28:52.265829 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 527/1100] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:28:52 2022] DELETE /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:28:52.289803 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-77e96e58-f2b5-4768-a3be-2dc8b8072366 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:52.290796 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-77e96e58-f2b5-4768-a3be-2dc8b8072366 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:52.301032 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77e96e58-f2b5-4768-a3be-2dc8b8072366 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:52.302560 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77e96e58-f2b5-4768-a3be-2dc8b8072366 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:52.303544 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77e96e58-f2b5-4768-a3be-2dc8b8072366 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:52.304499 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77e96e58-f2b5-4768-a3be-2dc8b8072366 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:52.369122 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-24b06ff1-42a6-4cad-b020-8211e340ba92 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] 10.222.0.88 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.238477 Jul 25 14:28:52.372697 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 574/1101] 10.222.0.88 () {60 vars in 1195 bytes} [Mon Jul 25 14:28:52 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:52.387211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-059dd5fe-5cd3-4b3a-a19b-ffe696fff445 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1430368077", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:52.397453 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:28:52.397453 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:28:52.404692 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:28:52.416575 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-77e96e58-f2b5-4768-a3be-2dc8b8072366 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b/action" status: 202 len: 0 microversion: 2.25 time: 0.149124 Jul 25 14:28:52.418435 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 528/1102] 10.222.0.88 () {62 vars in 1319 bytes} [Mon Jul 25 14:28:52 2022] POST /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:28:52.424851 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7090a4a4-35e9-43e1-bdaf-bbaa878f7bb1 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:52.425816 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7090a4a4-35e9-43e1-bdaf-bbaa878f7bb1 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:52.436084 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7090a4a4-35e9-43e1-bdaf-bbaa878f7bb1 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:52.436895 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7090a4a4-35e9-43e1-bdaf-bbaa878f7bb1 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:52.438065 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7090a4a4-35e9-43e1-bdaf-bbaa878f7bb1 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:52.438852 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7090a4a4-35e9-43e1-bdaf-bbaa878f7bb1 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:52.456495 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-059dd5fe-5cd3-4b3a-a19b-ffe696fff445 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.081225 Jul 25 14:28:52.457627 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-7090a4a4-35e9-43e1-bdaf-bbaa878f7bb1 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] HTTP exception thrown: Instance 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 could not be found. Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7090a4a4-35e9-43e1-bdaf-bbaa878f7bb1 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Request method failure captured: Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 HTTP/1.1 Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qfepuHN12RSjndHzKsxcvRUnwBd7gUW5USRKf91qDve39QaBVEjKhMdFzop5D0hXXHQ4vxb293-w-WGBfgB-T628gvhrMspbrIW1Vj5UaJgSh6TYZ8NwMP0uyL2kvBxpDAoi44sMFrP6hkwSPxP060bWVpno8LxFv_lSOJlt0uXzFg Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 508d55290b2744998f48e37d5af6dd04 Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1250417465 Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/508d55290b2744998f48e37d5af6dd04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/508d55290b2744998f48e37d5af6dd04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_508d55290b2744998f48e37d5af6dd04", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/508d55290b2744998f48e37d5af6dd04"}]}] Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1250417465 Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 508d55290b2744998f48e37d5af6dd04 Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1250417465 Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1250417465-project Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: aec61e9c63c043f49c26eb8220cb67bb Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1250417465-project Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 could not be found. Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5'} Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 could not be found. Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 could not be found. Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:52.459607 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:52.465126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:52.465126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:52.465126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:52.465126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:52.465126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:28:52.465126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:28:52.465126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 could not be found. Jul 25 14:28:52.465126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:28:52.466970 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7090a4a4-35e9-43e1-bdaf-bbaa878f7bb1 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Returning 404 to user: Instance 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:28:52.469247 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7090a4a4-35e9-43e1-bdaf-bbaa878f7bb1 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5" status: 404 len: 111 microversion: 2.1 time: 0.049320 Jul 25 14:28:52.470156 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 529/1103] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:52 2022] GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:28:52.474999 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-b50b62bf-49b9-45e2-b877-d9293f20b333 req-e2479443-da84-4c03-92ab-23a7af98f5eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66394997-4341-4d25-a34a-a479e299fe03", "name": "network-vif-deleted", "tag": "12c7cc1c-4824-47a5-9693-38cf4730df08"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:52.477796 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 575/1104] 10.222.0.88 () {60 vars in 1146 bytes} [Mon Jul 25 14:28:52 2022] POST /compute/v2.1/flavors => generated 499 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:52.488458 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b50b62bf-49b9-45e2-b877-d9293f20b333 req-e2479443-da84-4c03-92ab-23a7af98f5eb service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:52.489162 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b50b62bf-49b9-45e2-b877-d9293f20b333 req-e2479443-da84-4c03-92ab-23a7af98f5eb service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:52.504552 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-b50b62bf-49b9-45e2-b877-d9293f20b333 req-e2479443-da84-4c03-92ab-23a7af98f5eb service nova] Creating event network-vif-deleted:12c7cc1c-4824-47a5-9693-38cf4730df08 for instance 66394997-4341-4d25-a34a-a479e299fe03 on n-h2-846435-14 Jul 25 14:28:52.506789 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2d3bc1bb-5e18-48e4-88f0-98d6f2228ba2 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] Calling method '.version_select at 0x7f46876adca0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:52.514055 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-b50b62bf-49b9-45e2-b877-d9293f20b333 req-e2479443-da84-4c03-92ab-23a7af98f5eb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042466 Jul 25 14:28:52.518029 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 530/1105] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:52.523584 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6a09c0b6-f96b-4fea-b06d-e9ff77410893 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:52.530317 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6a09c0b6-f96b-4fea-b06d-e9ff77410893 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:52.562657 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6a09c0b6-f96b-4fea-b06d-e9ff77410893 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:52.567450 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6a09c0b6-f96b-4fea-b06d-e9ff77410893 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:52.569041 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6a09c0b6-f96b-4fea-b06d-e9ff77410893 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:52.569716 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6a09c0b6-f96b-4fea-b06d-e9ff77410893 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:52.643427 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2d3bc1bb-5e18-48e4-88f0-98d6f2228ba2 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] 10.222.0.88 "GET /compute/v2.1/os-security-groups/75f714e1-ba33-45d4-b0ed-5e533a268ad7" status: 200 len: 665 microversion: 2.1 time: 0.162790 Jul 25 14:28:52.644198 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 576/1106] 10.222.0.88 () {58 vars in 1269 bytes} [Mon Jul 25 14:28:52 2022] GET /compute/v2.1/os-security-groups/75f714e1-ba33-45d4-b0ed-5e533a268ad7 => generated 665 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:52.649735 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c2400167-954d-4aef-a072-863173f17a8d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:52.650622 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c2400167-954d-4aef-a072-863173f17a8d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:52.664691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c2400167-954d-4aef-a072-863173f17a8d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:52.667927 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c2400167-954d-4aef-a072-863173f17a8d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:52.669075 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c2400167-954d-4aef-a072-863173f17a8d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:52.670164 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c2400167-954d-4aef-a072-863173f17a8d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:52.881574 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-6a09c0b6-f96b-4fea-b06d-e9ff77410893 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lazy-loading 'services' on Instance uuid c9982c70-c715-4959-b9a9-fee30117751b {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:28:52.919956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c2400167-954d-4aef-a072-863173f17a8d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:52.920880 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6a09c0b6-f96b-4fea-b06d-e9ff77410893 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 200 len: 2058 microversion: 2.25 time: 0.396829 Jul 25 14:28:52.921918 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 531/1107] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:52 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 2058 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:52.927220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-67405691-c2b1-4e00-a955-18381845ee24 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:52.931843 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c2400167-954d-4aef-a072-863173f17a8d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:52.933623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c2400167-954d-4aef-a072-863173f17a8d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:52.935022 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c2400167-954d-4aef-a072-863173f17a8d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1660 microversion: 2.42 time: 0.289586 Jul 25 14:28:52.935584 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 577/1108] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:52 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1660 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:52.940531 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9b850148-cbb4-4725-8201-855a197fc496 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '.version_select at 0x7f4687648550>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:52.957474 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-67405691-c2b1-4e00-a955-18381845ee24 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.033677 Jul 25 14:28:52.958433 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 532/1109] 10.222.0.88 () {58 vars in 1182 bytes} [Mon Jul 25 14:28:52 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:28:52.963423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-355a534c-5cba-4978-910d-0295d373e809 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] Calling method '.version_select at 0x7f46874f1d30>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:52.978461 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9b850148-cbb4-4725-8201-855a197fc496 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-999429076" status: 202 len: 0 microversion: 2.1 time: 0.041689 Jul 25 14:28:52.987074 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 578/1110] 10.222.0.88 () {58 vars in 1218 bytes} [Mon Jul 25 14:28:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-999429076 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:28:52.992126 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a44ba18d-a975-477d-a782-110578d180fc tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:52.993024 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a44ba18d-a975-477d-a782-110578d180fc tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 1c6f6d12-3660-40ec-bf99-d735fa9d0358] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:53.000620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a44ba18d-a975-477d-a782-110578d180fc tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:53.001289 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a44ba18d-a975-477d-a782-110578d180fc tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:53.002059 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a44ba18d-a975-477d-a782-110578d180fc tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:53.002494 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a44ba18d-a975-477d-a782-110578d180fc tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:53.256355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a44ba18d-a975-477d-a782-110578d180fc tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774744dcf62f4ef78b4a2c8dfc96f9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ca1e9beedc4892861051504a5dff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:53.268423 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a44ba18d-a975-477d-a782-110578d180fc tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358" status: 200 len: 1519 microversion: 2.1 time: 0.277313 Jul 25 14:28:53.269245 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 579/1111] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:52 2022] GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358 => generated 1519 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:53.292542 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-571e5fa2-5975-48d5-a64a-2e3987a83d88 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:53.293761 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-571e5fa2-5975-48d5-a64a-2e3987a83d88 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] [instance: 66394997-4341-4d25-a34a-a479e299fe03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:53.301220 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-571e5fa2-5975-48d5-a64a-2e3987a83d88 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:53.301955 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-571e5fa2-5975-48d5-a64a-2e3987a83d88 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:53.302889 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-571e5fa2-5975-48d5-a64a-2e3987a83d88 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:53.303473 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-571e5fa2-5975-48d5-a64a-2e3987a83d88 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:53.317906 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-571e5fa2-5975-48d5-a64a-2e3987a83d88 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] HTTP exception thrown: Instance 66394997-4341-4d25-a34a-a479e299fe03 could not be found. Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-571e5fa2-5975-48d5-a64a-2e3987a83d88 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Request method failure captured: Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03 HTTP/1.1 Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qiCbtsZ-Kxr0xR3g-9jiODiIamMVW7JQhW_kNIF4d1farG9twjJyz2W1aDrjlD68oxaEWZzx0_yV7-SwMr2fH-NxyaC6RinhoFFFdpg83j7rksNvmAkkOhpDV4MQF4uZ8vr2gFDajDzfa8cvt-rOwD-qU2lIaxepcp1tawIy0OWSaI Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 1b38ea3df00a4a6c84834a04fadc2901 Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-TenantUsagesTestJSON-954454435 Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1b38ea3df00a4a6c84834a04fadc2901"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1b38ea3df00a4a6c84834a04fadc2901"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1b38ea3df00a4a6c84834a04fadc2901", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1b38ea3df00a4a6c84834a04fadc2901"}]}] Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-TenantUsagesTestJSON-954454435 Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 1b38ea3df00a4a6c84834a04fadc2901 Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-TenantUsagesTestJSON-954454435 Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-TenantUsagesTestJSON-954454435-project Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: e734f14df14d4621be6343f462b81a27 Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-TenantUsagesTestJSON-954454435-project Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 66394997-4341-4d25-a34a-a479e299fe03 could not be found. Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '66394997-4341-4d25-a34a-a479e299fe03'} Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66394997-4341-4d25-a34a-a479e299fe03 could not be found. Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66394997-4341-4d25-a34a-a479e299fe03 could not be found. Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:53.319991 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:53.324594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:53.324594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:53.324594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:53.324594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:28:53.324594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:28:53.324594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66394997-4341-4d25-a34a-a479e299fe03 could not be found. Jul 25 14:28:53.324594 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:53.325890 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-571e5fa2-5975-48d5-a64a-2e3987a83d88 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] Returning 404 to user: Instance 66394997-4341-4d25-a34a-a479e299fe03 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:28:53.326886 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-571e5fa2-5975-48d5-a64a-2e3987a83d88 tempest-TenantUsagesTestJSON-954454435 tempest-TenantUsagesTestJSON-954454435-project] 10.222.0.88 "GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03" status: 404 len: 111 microversion: 2.1 time: 0.040851 Jul 25 14:28:53.327882 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 580/1112] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:53 2022] GET /compute/v2.1/servers/66394997-4341-4d25-a34a-a479e299fe03 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:28:53.334410 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5b238986-6594-4792-94ea-fb28ec7f24a2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-379374223", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "86f65049-f3d8-4372-9978-5846778c91ed"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:53.394135 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-355a534c-5cba-4978-910d-0295d373e809 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-group-rules/b2d242ca-aa59-464c-91e9-d124bf27f5ed" status: 202 len: 0 microversion: 2.1 time: 0.434486 Jul 25 14:28:53.398301 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 533/1113] 10.222.0.88 () {58 vars in 1287 bytes} [Mon Jul 25 14:28:52 2022] DELETE /compute/v2.1/os-security-group-rules/b2d242ca-aa59-464c-91e9-d124bf27f5ed => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:28:53.418091 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-5b238986-6594-4792-94ea-fb28ec7f24a2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] validate_networks() for None {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:28:53.421776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a3afbaf6-0ce1-45da-95fe-ec55f6a5c07e tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:53.422499 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a3afbaf6-0ce1-45da-95fe-ec55f6a5c07e tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:53.442230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a3afbaf6-0ce1-45da-95fe-ec55f6a5c07e tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:53.442593 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a3afbaf6-0ce1-45da-95fe-ec55f6a5c07e tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:53.443395 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a3afbaf6-0ce1-45da-95fe-ec55f6a5c07e tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:53.443841 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a3afbaf6-0ce1-45da-95fe-ec55f6a5c07e tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:53.562737 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a3afbaf6-0ce1-45da-95fe-ec55f6a5c07e tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:53.577389 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a3afbaf6-0ce1-45da-95fe-ec55f6a5c07e tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:53.579455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a3afbaf6-0ce1-45da-95fe-ec55f6a5c07e tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:53.593823 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a3afbaf6-0ce1-45da-95fe-ec55f6a5c07e tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1447 microversion: 2.75 time: 0.196328 Jul 25 14:28:53.604008 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 534/1114] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:53 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1447 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:53.604008 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-53bdcc77-3168-429a-b0e9-67a2086b249b tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Action: 'create', calling method: .version_select at 0x7f46874ec310>, body: {"pool": null} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:54.003094 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-5b238986-6594-4792-94ea-fb28ec7f24a2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:28:54.004244 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-5b238986-6594-4792-94ea-fb28ec7f24a2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:28:54.005035 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-5b238986-6594-4792-94ea-fb28ec7f24a2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:28:54.007400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-5b238986-6594-4792-94ea-fb28ec7f24a2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:28:54.009189 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-5b238986-6594-4792-94ea-fb28ec7f24a2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:28:54.022294 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b238986-6594-4792-94ea-fb28ec7f24a2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:54.026233 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b238986-6594-4792-94ea-fb28ec7f24a2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:54.028973 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b238986-6594-4792-94ea-fb28ec7f24a2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:54.030189 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b238986-6594-4792-94ea-fb28ec7f24a2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:54.045881 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:28:54.055174 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-5b238986-6594-4792-94ea-fb28ec7f24a2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Getting quotas for project 887aa20d1838484eb895896f8f76ce41. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:28:54.064443 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-5b238986-6594-4792-94ea-fb28ec7f24a2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Getting quotas for user 00aea97fb95c44cfa5dce25e9a06cd37 and project 887aa20d1838484eb895896f8f76ce41. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:28:54.102652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5b238986-6594-4792-94ea-fb28ec7f24a2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:28:54.111642 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5b238986-6594-4792-94ea-fb28ec7f24a2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:28:54.195502 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5b238986-6594-4792-94ea-fb28ec7f24a2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.866060 Jul 25 14:28:54.196361 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 581/1115] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:28:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:28:54.201069 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2297dcf9-c56c-43ba-8913-93c6972eaa1d tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] Calling method '.version_select at 0x7f4687648ee0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:54.609359 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2297dcf9-c56c-43ba-8913-93c6972eaa1d tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/75f714e1-ba33-45d4-b0ed-5e533a268ad7" status: 202 len: 0 microversion: 2.1 time: 0.411974 Jul 25 14:28:54.610458 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 582/1116] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:28:54 2022] DELETE /compute/v2.1/os-security-groups/75f714e1-ba33-45d4-b0ed-5e533a268ad7 => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:28:54.616536 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-75bd55e7-fd87-4503-a1f0-88f52e9569ce tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:54.617521 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-75bd55e7-fd87-4503-a1f0-88f52e9569ce tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:54.638769 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75bd55e7-fd87-4503-a1f0-88f52e9569ce tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:54.642158 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75bd55e7-fd87-4503-a1f0-88f52e9569ce tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:54.643544 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75bd55e7-fd87-4503-a1f0-88f52e9569ce tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:54.646912 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75bd55e7-fd87-4503-a1f0-88f52e9569ce tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:54.963302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-75bd55e7-fd87-4503-a1f0-88f52e9569ce tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lazy-loading 'services' on Instance uuid c9982c70-c715-4959-b9a9-fee30117751b {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:28:55.008008 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-75bd55e7-fd87-4503-a1f0-88f52e9569ce tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 200 len: 2038 microversion: 2.25 time: 0.392251 Jul 25 14:28:55.009653 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 583/1117] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:54 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 2038 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:55.029046 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-90abba64-4d2d-4d6e-92ec-61c4a50b70d0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:55.030537 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-90abba64-4d2d-4d6e-92ec-61c4a50b70d0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:55.040769 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-90abba64-4d2d-4d6e-92ec-61c4a50b70d0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:55.041221 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-90abba64-4d2d-4d6e-92ec-61c4a50b70d0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:55.042319 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-90abba64-4d2d-4d6e-92ec-61c4a50b70d0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:55.043212 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-90abba64-4d2d-4d6e-92ec-61c4a50b70d0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:55.215085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-90abba64-4d2d-4d6e-92ec-61c4a50b70d0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:55.225316 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-90abba64-4d2d-4d6e-92ec-61c4a50b70d0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:55.226818 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-90abba64-4d2d-4d6e-92ec-61c4a50b70d0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:55.228063 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-90abba64-4d2d-4d6e-92ec-61c4a50b70d0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1706 microversion: 2.42 time: 0.217212 Jul 25 14:28:55.228643 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 584/1118] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:55 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1706 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:55.233780 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d1bb1331-0266-41ed-99ea-e49638040251 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:55.234724 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d1bb1331-0266-41ed-99ea-e49638040251 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:55.241361 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1bb1331-0266-41ed-99ea-e49638040251 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:55.242088 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1bb1331-0266-41ed-99ea-e49638040251 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:55.243068 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1bb1331-0266-41ed-99ea-e49638040251 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:55.243711 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1bb1331-0266-41ed-99ea-e49638040251 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:55.311179 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d1bb1331-0266-41ed-99ea-e49638040251 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:55.319823 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d1bb1331-0266-41ed-99ea-e49638040251 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1282 microversion: 2.1 time: 0.089828 Jul 25 14:28:55.320681 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 585/1119] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:55 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1282 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:55.325070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7b5cd43e-09fa-44f5-84b6-14ac5ca0ac87 tempest-ServersWithSpecificFlavorTestJSON-269819481 tempest-ServersWithSpecificFlavorTestJSON-269819481-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:55.325820 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:28:55.325820 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:28:55.347108 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7b5cd43e-09fa-44f5-84b6-14ac5ca0ac87 tempest-ServersWithSpecificFlavorTestJSON-269819481 tempest-ServersWithSpecificFlavorTestJSON-269819481-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/1368011728" status: 202 len: 0 microversion: 2.1 time: 0.025367 Jul 25 14:28:55.347898 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 586/1120] 10.222.0.88 () {58 vars in 1161 bytes} [Mon Jul 25 14:28:55 2022] DELETE /compute/v2.1/flavors/1368011728 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:28:55.354585 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3686157e-e6df-4da9-8140-f8df6429a834 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] Calling method '.version_select at 0x7f46876bc670>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:55.386334 n-d-846435-14 devstack@n-api.service[119304]: DEBUG neutronclient.v2_0.client [None req-3686157e-e6df-4da9-8140-f8df6429a834 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5dcd68bc-85fa-4f2d-b69a-1dcaff6d54e5 does not exist", "detail": ""}} {{(pid=119304) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 14:28:55.387048 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.security_group_api [None req-3686157e-e6df-4da9-8140-f8df6429a834 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] Neutron security group 5dcd68bc-85fa-4f2d-b69a-1dcaff6d54e5 not found {{(pid=119304) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 14:28:55.387591 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-3686157e-e6df-4da9-8140-f8df6429a834 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] HTTP exception thrown: Security group 5dcd68bc-85fa-4f2d-b69a-1dcaff6d54e5 does not exist Jul 25 14:28:55.387591 n-d-846435-14 devstack@n-api.service[119304]: Neutron server returns request_ids: ['req-b0360e45-0120-4c9a-b46e-e4c3c16098e2'] Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3686157e-e6df-4da9-8140-f8df6429a834 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] Request method failure captured: Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/os-security-groups/5dcd68bc-85fa-4f2d-b69a-1dcaff6d54e5 HTTP/1.1 Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qia8Yj3RozBlp_0-imH6jUSLZA1G5y8Ot6XOGBzLKzVnyRX6YJ2l6zczapawi3OCsOIF0MTRo_DL8Z4cGbJn4nLXznVPN3F3Ov5B4sRSOcCOLuHwi7PejqB1XLu7S4y0Kp6234MZevIGKls6UquPm4EIFZ24XVGgb8cYAHbOIpfS0Q Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: e49fe8f629df412cafe95b3d5a4ee753 Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1026209653 Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e49fe8f629df412cafe95b3d5a4ee753"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e49fe8f629df412cafe95b3d5a4ee753"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e49fe8f629df412cafe95b3d5a4ee753", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e49fe8f629df412cafe95b3d5a4ee753"}]}] Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1026209653 Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: e49fe8f629df412cafe95b3d5a4ee753 Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1026209653 Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-SecurityGroupRulesTestJSON-1026209653-project Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: f4b599708c18448b99663104612f3a6e Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1026209653-project Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: exception: Security group 5dcd68bc-85fa-4f2d-b69a-1dcaff6d54e5 does not exist Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: Neutron server returns request_ids: ['req-b0360e45-0120-4c9a-b46e-e4c3c16098e2'] Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '5dcd68bc-85fa-4f2d-b69a-1dcaff6d54e5'} Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 14:28:55.391755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5dcd68bc-85fa-4f2d-b69a-1dcaff6d54e5 does not exist Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b0360e45-0120-4c9a-b46e-e4c3c16098e2'] Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5dcd68bc-85fa-4f2d-b69a-1dcaff6d54e5 does not exist Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b0360e45-0120-4c9a-b46e-e4c3c16098e2'] Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5dcd68bc-85fa-4f2d-b69a-1dcaff6d54e5 does not exist Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b0360e45-0120-4c9a-b46e-e4c3c16098e2'] Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5dcd68bc-85fa-4f2d-b69a-1dcaff6d54e5 does not exist Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b0360e45-0120-4c9a-b46e-e4c3c16098e2'] Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3686157e-e6df-4da9-8140-f8df6429a834 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] Returning 404 to user: Security group 5dcd68bc-85fa-4f2d-b69a-1dcaff6d54e5 does not exist Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: Neutron server returns request_ids: ['req-b0360e45-0120-4c9a-b46e-e4c3c16098e2'] {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3686157e-e6df-4da9-8140-f8df6429a834 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/5dcd68bc-85fa-4f2d-b69a-1dcaff6d54e5" status: 404 len: 194 microversion: 2.1 time: 0.044346 Jul 25 14:28:55.395714 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 587/1121] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:28:55 2022] DELETE /compute/v2.1/os-security-groups/5dcd68bc-85fa-4f2d-b69a-1dcaff6d54e5 => generated 194 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:28:55.403015 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3f7b2704-67b2-4e64-91fa-ec9843eed4ca tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:55.403015 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3f7b2704-67b2-4e64-91fa-ec9843eed4ca tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:55.411428 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f7b2704-67b2-4e64-91fa-ec9843eed4ca tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:55.412339 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f7b2704-67b2-4e64-91fa-ec9843eed4ca tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:55.412659 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f7b2704-67b2-4e64-91fa-ec9843eed4ca tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:55.413086 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f7b2704-67b2-4e64-91fa-ec9843eed4ca tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:55.509685 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3f7b2704-67b2-4e64-91fa-ec9843eed4ca tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:55.520944 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3f7b2704-67b2-4e64-91fa-ec9843eed4ca tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:55.522758 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3f7b2704-67b2-4e64-91fa-ec9843eed4ca tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:55.529500 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3f7b2704-67b2-4e64-91fa-ec9843eed4ca tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1447 microversion: 2.75 time: 0.133969 Jul 25 14:28:55.531517 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 588/1122] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:55 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1447 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:55.537535 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-da22d045-56ba-4330-b3da-c3d8c7cc6044 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846435-14", "block_migration": "auto"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:55.541952 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-da22d045-56ba-4330-b3da-c3d8c7cc6044 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:55.554078 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-da22d045-56ba-4330-b3da-c3d8c7cc6044 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:55.554798 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-da22d045-56ba-4330-b3da-c3d8c7cc6044 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:55.555759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-da22d045-56ba-4330-b3da-c3d8c7cc6044 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:55.556399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-da22d045-56ba-4330-b3da-c3d8c7cc6044 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:55.634716 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:28:55.641379 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-da22d045-56ba-4330-b3da-c3d8c7cc6044 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lazy-loading 'flavor' on Instance uuid c9982c70-c715-4959-b9a9-fee30117751b {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:28:55.714808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-da22d045-56ba-4330-b3da-c3d8c7cc6044 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Going to try to live migrate instance to n-h2-846435-14 {{(pid=119304) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 14:28:57.289427 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-53bdcc77-3168-429a-b0e9-67a2086b249b tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.692291 Jul 25 14:28:57.290027 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 535/1123] 10.222.0.88 () {60 vars in 1170 bytes} [Mon Jul 25 14:28:53 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:57.295886 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5289ab89-e49e-4081-b0ef-6ca1b4bcbf38 tempest-ServersWithSpecificFlavorTestJSON-269819481 tempest-ServersWithSpecificFlavorTestJSON-269819481-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:57.326845 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5289ab89-e49e-4081-b0ef-6ca1b4bcbf38 tempest-ServersWithSpecificFlavorTestJSON-269819481 tempest-ServersWithSpecificFlavorTestJSON-269819481-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 5891 microversion: 2.1 time: 0.035571 Jul 25 14:28:57.328042 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 536/1124] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:28:57 2022] GET /compute/v2.1/flavors/detail => generated 5891 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:57.333425 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-84348c54-e523-446b-aa17-709d0afdf611 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] Calling method '.version_select at 0x7f46873dfa60>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:57.688613 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-84348c54-e523-446b-aa17-709d0afdf611 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/e6cc663c-6163-40ff-8794-b3b21af3f7a2" status: 202 len: 0 microversion: 2.1 time: 0.359071 Jul 25 14:28:57.689553 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 537/1125] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:28:57 2022] DELETE /compute/v2.1/os-security-groups/e6cc663c-6163-40ff-8794-b3b21af3f7a2 => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:28:57.697953 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e5e55acb-1636-41c3-abc8-efd6f00cc9ce tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:57.698738 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e5e55acb-1636-41c3-abc8-efd6f00cc9ce tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:57.706638 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e5e55acb-1636-41c3-abc8-efd6f00cc9ce tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:57.707366 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e5e55acb-1636-41c3-abc8-efd6f00cc9ce tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:57.708570 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e5e55acb-1636-41c3-abc8-efd6f00cc9ce tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:57.709177 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e5e55acb-1636-41c3-abc8-efd6f00cc9ce tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:57.972847 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e5e55acb-1636-41c3-abc8-efd6f00cc9ce tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:57.984083 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e5e55acb-1636-41c3-abc8-efd6f00cc9ce tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:57.985661 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e5e55acb-1636-41c3-abc8-efd6f00cc9ce tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:57.986956 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e5e55acb-1636-41c3-abc8-efd6f00cc9ce tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1798 microversion: 2.42 time: 0.296012 Jul 25 14:28:57.987507 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 538/1126] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:57 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1798 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:58.018874 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-89aeaa78-8fbf-4e97-b7e5-268dcd0798c7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:58.019495 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-89aeaa78-8fbf-4e97-b7e5-268dcd0798c7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:58.021548 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=8 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:28:58.026850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89aeaa78-8fbf-4e97-b7e5-268dcd0798c7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:58.027298 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89aeaa78-8fbf-4e97-b7e5-268dcd0798c7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:58.028088 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89aeaa78-8fbf-4e97-b7e5-268dcd0798c7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:58.028520 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89aeaa78-8fbf-4e97-b7e5-268dcd0798c7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:58.129653 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-89aeaa78-8fbf-4e97-b7e5-268dcd0798c7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:58.139871 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-89aeaa78-8fbf-4e97-b7e5-268dcd0798c7 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1336 microversion: 2.1 time: 0.141521 Jul 25 14:28:58.154995 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 539/1127] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:28:57 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1336 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:28:58.160532 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-31238f1e-de1d-44ab-b363-cd63b5f5d270 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:58.161872 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-31238f1e-de1d-44ab-b363-cd63b5f5d270 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:28:58.169679 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-31238f1e-de1d-44ab-b363-cd63b5f5d270 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:58.170124 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-31238f1e-de1d-44ab-b363-cd63b5f5d270 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:58.170912 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-31238f1e-de1d-44ab-b363-cd63b5f5d270 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:58.171351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-31238f1e-de1d-44ab-b363-cd63b5f5d270 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:58.248962 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-31238f1e-de1d-44ab-b363-cd63b5f5d270 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:58.258854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-31238f1e-de1d-44ab-b363-cd63b5f5d270 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:58.260570 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-31238f1e-de1d-44ab-b363-cd63b5f5d270 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:28:58.268864 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-31238f1e-de1d-44ab-b363-cd63b5f5d270 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1453 microversion: 2.75 time: 0.112375 Jul 25 14:28:58.269997 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 540/1128] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:28:58 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1453 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:28:58.418910 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-39109661-26cc-4571-8b99-ab11e16786e4 tempest-FlavorsV2NegativeTest-1870789515 tempest-FlavorsV2NegativeTest-1870789515-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:58.427418 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-39109661-26cc-4571-8b99-ab11e16786e4 tempest-FlavorsV2NegativeTest-1870789515 tempest-FlavorsV2NegativeTest-1870789515-project] 10.222.0.88 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.156104 Jul 25 14:28:58.427995 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 541/1129] 10.222.0.88 () {58 vars in 1137 bytes} [Mon Jul 25 14:28:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:28:58.445469 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e0de3ebf-cec7-488a-847a-743b2321a905 tempest-ServersWithSpecificFlavorTestJSON-269819481 tempest-ServersWithSpecificFlavorTestJSON-269819481-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:28:58.446490 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:28:58.446490 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:28:58.485570 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e0de3ebf-cec7-488a-847a-743b2321a905 tempest-ServersWithSpecificFlavorTestJSON-269819481 tempest-ServersWithSpecificFlavorTestJSON-269819481-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/897650779" status: 202 len: 0 microversion: 2.1 time: 0.044715 Jul 25 14:28:58.489974 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 542/1130] 10.222.0.88 () {58 vars in 1158 bytes} [Mon Jul 25 14:28:58 2022] DELETE /compute/v2.1/flavors/897650779 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:28:58.496785 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-57af9e9a-457c-48d2-b257-a860998ee5b8 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-35381020", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "8b75699c-1ef5-4c51-95ba-7d4e798771fe"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:28:58.558814 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-57af9e9a-457c-48d2-b257-a860998ee5b8 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] validate_networks() for [('8b75699c-1ef5-4c51-95ba-7d4e798771fe', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:28:59.873675 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-57af9e9a-457c-48d2-b257-a860998ee5b8 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:28:59.875076 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-57af9e9a-457c-48d2-b257-a860998ee5b8 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:28:59.876009 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-57af9e9a-457c-48d2-b257-a860998ee5b8 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:28:59.876624 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-57af9e9a-457c-48d2-b257-a860998ee5b8 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:28:59.877203 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-57af9e9a-457c-48d2-b257-a860998ee5b8 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:28:59.891064 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57af9e9a-457c-48d2-b257-a860998ee5b8 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:59.891638 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57af9e9a-457c-48d2-b257-a860998ee5b8 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:59.892680 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57af9e9a-457c-48d2-b257-a860998ee5b8 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:28:59.894911 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57af9e9a-457c-48d2-b257-a860998ee5b8 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:28:59.930848 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-57af9e9a-457c-48d2-b257-a860998ee5b8 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Getting quotas for project f1ca1e9beedc4892861051504a5dff08. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:28:59.939164 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-57af9e9a-457c-48d2-b257-a860998ee5b8 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Getting quotas for user 774744dcf62f4ef78b4a2c8dfc96f9cd and project f1ca1e9beedc4892861051504a5dff08. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:28:59.957327 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-57af9e9a-457c-48d2-b257-a860998ee5b8 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:28:59.960492 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-57af9e9a-457c-48d2-b257-a860998ee5b8 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 58fa156b-43cc-4633-b7bd-6ed9cc2bd220] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:29:00.018041 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-57af9e9a-457c-48d2-b257-a860998ee5b8 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.526457 Jul 25 14:29:00.019538 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 543/1131] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:28:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:29:00.034759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-39f4bd1b-c00f-4526-860b-2ac9739abf38 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] Calling method '.version_select at 0x7f4687431160>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:00.746387 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-da22d045-56ba-4330-b3da-c3d8c7cc6044 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b/action" status: 202 len: 0 microversion: 2.25 time: 5.213414 Jul 25 14:29:00.746990 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 589/1132] 10.222.0.88 () {62 vars in 1319 bytes} [Mon Jul 25 14:28:55 2022] POST /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b/action => generated 0 bytes in 5215 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:29:00.752344 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-19975344-f1d6-4129-8fbb-85593d5070d2 tempest-ServersWithSpecificFlavorTestJSON-269819481 tempest-ServersWithSpecificFlavorTestJSON-269819481-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:00.805145 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-19975344-f1d6-4129-8fbb-85593d5070d2 tempest-ServersWithSpecificFlavorTestJSON-269819481 tempest-ServersWithSpecificFlavorTestJSON-269819481-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 5480 microversion: 2.1 time: 0.056640 Jul 25 14:29:00.808797 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 590/1133] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:29:00 2022] GET /compute/v2.1/flavors/detail => generated 5480 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:00.836451 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-226a9f7c-c43e-41b9-9c4f-d4a6faab7433 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:00.837486 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-226a9f7c-c43e-41b9-9c4f-d4a6faab7433 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:00.844216 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-226a9f7c-c43e-41b9-9c4f-d4a6faab7433 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:00.844877 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-226a9f7c-c43e-41b9-9c4f-d4a6faab7433 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:00.845867 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-226a9f7c-c43e-41b9-9c4f-d4a6faab7433 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:00.846623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-226a9f7c-c43e-41b9-9c4f-d4a6faab7433 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:00.992994 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-39f4bd1b-c00f-4526-860b-2ac9739abf38 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/e5489e44-ae73-4fd9-a356-2dc451f997a8" status: 202 len: 0 microversion: 2.1 time: 0.970598 Jul 25 14:29:00.993635 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 544/1134] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:29:00 2022] DELETE /compute/v2.1/os-security-groups/e5489e44-ae73-4fd9-a356-2dc451f997a8 => generated 0 bytes in 973 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:29:01.000956 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1361b930-3dfb-4966-b0bd-f0ef3d21817f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:01.003110 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1361b930-3dfb-4966-b0bd-f0ef3d21817f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:01.019852 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1361b930-3dfb-4966-b0bd-f0ef3d21817f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:01.020328 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1361b930-3dfb-4966-b0bd-f0ef3d21817f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:01.027937 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1361b930-3dfb-4966-b0bd-f0ef3d21817f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:01.028681 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1361b930-3dfb-4966-b0bd-f0ef3d21817f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:01.037894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-226a9f7c-c43e-41b9-9c4f-d4a6faab7433 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:01.049324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-226a9f7c-c43e-41b9-9c4f-d4a6faab7433 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:01.053105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-226a9f7c-c43e-41b9-9c4f-d4a6faab7433 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:01.054520 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-226a9f7c-c43e-41b9-9c4f-d4a6faab7433 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1844 microversion: 2.42 time: 0.244709 Jul 25 14:29:01.065537 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 591/1135] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:00 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1844 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:01.075130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8052289c-d2e2-4f96-ab5b-6a8f574f747f tempest-FlavorsV2NegativeTest-1870789515 tempest-FlavorsV2NegativeTest-1870789515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-693526815", "imageRef": "445148a7-7cca-4343-b6ed-542ca04a6411", "flavorRef": "452"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:01.154787 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-8052289c-d2e2-4f96-ab5b-6a8f574f747f tempest-FlavorsV2NegativeTest-1870789515 tempest-FlavorsV2NegativeTest-1870789515-project] validate_networks() for None {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:29:01.718577 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-8052289c-d2e2-4f96-ab5b-6a8f574f747f tempest-FlavorsV2NegativeTest-1870789515 tempest-FlavorsV2NegativeTest-1870789515-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8052289c-d2e2-4f96-ab5b-6a8f574f747f tempest-FlavorsV2NegativeTest-1870789515 tempest-FlavorsV2NegativeTest-1870789515-project] Request method failure captured: Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 142 Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qio3MqFSIxBD2-eRFbn0MmRncWwsUACgIutKvFYIMtvcwYz29vDI7DgIA_X4F-43fCzKQoJ3q0028qirovxVuNFUutRouZQd1xSsvRqQ-nZ81BEh94gHect_U2vK0RpW9TtLKjbgVdDMqY_uYJoPiDS4e3rEF6NapYctwJ3IlmF_oQ Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 5afbb9401a094b119cc13fe5eb60643e Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-FlavorsV2NegativeTest-1870789515 Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5afbb9401a094b119cc13fe5eb60643e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5afbb9401a094b119cc13fe5eb60643e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_5afbb9401a094b119cc13fe5eb60643e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/5afbb9401a094b119cc13fe5eb60643e"}]}] Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-FlavorsV2NegativeTest-1870789515 Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 5afbb9401a094b119cc13fe5eb60643e Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1870789515 Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-FlavorsV2NegativeTest-1870789515-project Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 3c865b7f1f174d5e9e200696a9abf31b Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-FlavorsV2NegativeTest-1870789515-project Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-693526815", "imageRef": "445148a7-7cca-4343-b6ed-542ca04a6411", "flavorRef": "452"}} Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: exception: Flavor's memory is too small for requested image. Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-693526815', 'imageRef': '445148a7-7cca-4343-b6ed-542ca04a6411', 'flavorRef': '452'}}} Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:29:01.720961 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:29:01.725715 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:29:01.725715 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:29:01.725715 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 14:29:01.725715 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 25 14:29:01.725715 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 25 14:29:01.725715 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jul 25 14:29:01.725715 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:01.725715 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:29:01.725715 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:01.725715 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:29:01.725715 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:29:01.725715 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:29:01.725715 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:29:01.725715 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:29:01.725715 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jul 25 14:29:01.725715 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:01.725715 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8052289c-d2e2-4f96-ab5b-6a8f574f747f tempest-FlavorsV2NegativeTest-1870789515 tempest-FlavorsV2NegativeTest-1870789515-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:29:01.725715 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8052289c-d2e2-4f96-ab5b-6a8f574f747f tempest-FlavorsV2NegativeTest-1870789515 tempest-FlavorsV2NegativeTest-1870789515-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.655788 Jul 25 14:29:01.737128 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 592/1136] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:29:01 2022] POST /compute/v2.1/servers => generated 93 bytes in 670 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 14:29:01.748270 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7a6337de-7157-40c8-8452-27a318633337 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:01.751475 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7a6337de-7157-40c8-8452-27a318633337 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:01.767077 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a6337de-7157-40c8-8452-27a318633337 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:01.767077 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a6337de-7157-40c8-8452-27a318633337 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:01.767077 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a6337de-7157-40c8-8452-27a318633337 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:01.767077 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a6337de-7157-40c8-8452-27a318633337 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:01.873742 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7a6337de-7157-40c8-8452-27a318633337 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:01.886948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7a6337de-7157-40c8-8452-27a318633337 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:01.889882 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7a6337de-7157-40c8-8452-27a318633337 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:01.897328 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7a6337de-7157-40c8-8452-27a318633337 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1438 microversion: 2.75 time: 0.158353 Jul 25 14:29:01.918031 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 593/1137] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:01 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1438 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:01.918031 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-f4000bc4-9d08-4fa5-9c0f-500395c481b2 req-5e9fa9f4-e3ec-468a-a328-c949d6850d59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33a6128a-580f-4184-ba11-6511d5021242", "tag": "117e3c70-2257-4ddb-af6d-4e75db8fcb77"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:01.930536 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-f4000bc4-9d08-4fa5-9c0f-500395c481b2 req-5e9fa9f4-e3ec-468a-a328-c949d6850d59 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:01.930980 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-f4000bc4-9d08-4fa5-9c0f-500395c481b2 req-5e9fa9f4-e3ec-468a-a328-c949d6850d59 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:01.945638 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-f4000bc4-9d08-4fa5-9c0f-500395c481b2 req-5e9fa9f4-e3ec-468a-a328-c949d6850d59 service nova] Creating event network-changed:117e3c70-2257-4ddb-af6d-4e75db8fcb77 for instance 33a6128a-580f-4184-ba11-6511d5021242 on n-h1-846435-14 Jul 25 14:29:01.962939 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-f4000bc4-9d08-4fa5-9c0f-500395c481b2 req-5e9fa9f4-e3ec-468a-a328-c949d6850d59 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053195 Jul 25 14:29:01.965023 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 594/1138] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:01.980972 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-12170d8a-39af-4e4e-ba08-d21faa11fa32 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:01.981673 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-12170d8a-39af-4e4e-ba08-d21faa11fa32 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 58fa156b-43cc-4633-b7bd-6ed9cc2bd220] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:01.996805 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-12170d8a-39af-4e4e-ba08-d21faa11fa32 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:02.004682 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-12170d8a-39af-4e4e-ba08-d21faa11fa32 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:02.006223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-12170d8a-39af-4e4e-ba08-d21faa11fa32 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:02.006713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-12170d8a-39af-4e4e-ba08-d21faa11fa32 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:02.021429 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1361b930-3dfb-4966-b0bd-f0ef3d21817f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:02.033607 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1361b930-3dfb-4966-b0bd-f0ef3d21817f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1378 microversion: 2.1 time: 1.037690 Jul 25 14:29:02.051246 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 545/1139] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:00 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1378 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:02.061590 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-305cf059-4b84-47c9-8b68-02f89aa3f925 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:02.062261 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-305cf059-4b84-47c9-8b68-02f89aa3f925 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:02.078161 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-305cf059-4b84-47c9-8b68-02f89aa3f925 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:02.081698 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-305cf059-4b84-47c9-8b68-02f89aa3f925 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:02.082729 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-305cf059-4b84-47c9-8b68-02f89aa3f925 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:02.085344 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-305cf059-4b84-47c9-8b68-02f89aa3f925 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:02.153730 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-12170d8a-39af-4e4e-ba08-d21faa11fa32 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774744dcf62f4ef78b4a2c8dfc96f9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ca1e9beedc4892861051504a5dff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:02.170076 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-12170d8a-39af-4e4e-ba08-d21faa11fa32 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "GET /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220" status: 200 len: 1280 microversion: 2.1 time: 0.202963 Jul 25 14:29:02.177238 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 595/1140] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:01 2022] GET /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220 => generated 1280 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:02.182504 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-082690de-42ab-4518-9e12-2c1bcd93bab8 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:02.185563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-082690de-42ab-4518-9e12-2c1bcd93bab8 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: fca96a8a-7721-4bbc-8ffa-b732ef5d753d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:02.201764 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-082690de-42ab-4518-9e12-2c1bcd93bab8 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:02.203592 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-082690de-42ab-4518-9e12-2c1bcd93bab8 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:02.203849 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-082690de-42ab-4518-9e12-2c1bcd93bab8 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:02.204449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-082690de-42ab-4518-9e12-2c1bcd93bab8 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:02.226211 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-082690de-42ab-4518-9e12-2c1bcd93bab8 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] HTTP exception thrown: Instance fca96a8a-7721-4bbc-8ffa-b732ef5d753d could not be found. Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-082690de-42ab-4518-9e12-2c1bcd93bab8 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Request method failure captured: Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d HTTP/1.1 Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfepuHN12RSjndHzKsxcvRUnwBd7gUW5USRKf91qDve39QaBVEjKhMdFzop5D0hXXHQ4vxb293-w-WGBfgB-T628gvhrMspbrIW1Vj5UaJgSh6TYZ8NwMP0uyL2kvBxpDAoi44sMFrP6hkwSPxP060bWVpno8LxFv_lSOJlt0uXzFg Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 508d55290b2744998f48e37d5af6dd04 Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1250417465 Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/508d55290b2744998f48e37d5af6dd04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/508d55290b2744998f48e37d5af6dd04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_508d55290b2744998f48e37d5af6dd04", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/508d55290b2744998f48e37d5af6dd04"}]}] Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1250417465 Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 508d55290b2744998f48e37d5af6dd04 Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1250417465 Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1250417465-project Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: aec61e9c63c043f49c26eb8220cb67bb Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1250417465-project Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance fca96a8a-7721-4bbc-8ffa-b732ef5d753d could not be found. Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'fca96a8a-7721-4bbc-8ffa-b732ef5d753d'} Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fca96a8a-7721-4bbc-8ffa-b732ef5d753d could not be found. Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:29:02.229756 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:29:02.234228 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fca96a8a-7721-4bbc-8ffa-b732ef5d753d could not be found. Jul 25 14:29:02.234228 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:02.234228 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:29:02.234228 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:02.234228 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:29:02.234228 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:29:02.234228 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:29:02.234228 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:29:02.234228 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:29:02.234228 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fca96a8a-7721-4bbc-8ffa-b732ef5d753d could not be found. Jul 25 14:29:02.234228 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:02.236157 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-082690de-42ab-4518-9e12-2c1bcd93bab8 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Returning 404 to user: Instance fca96a8a-7721-4bbc-8ffa-b732ef5d753d could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:29:02.237181 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-082690de-42ab-4518-9e12-2c1bcd93bab8 tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "DELETE /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d" status: 404 len: 111 microversion: 2.1 time: 0.058762 Jul 25 14:29:02.241199 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 596/1141] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:29:02 2022] DELETE /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:29:02.246537 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-067eec8e-2c8f-42e2-a6a0-fe9783bb7ca5 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] Calling method '.version_select at 0x7f46876bc1f0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:02.768990 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-067eec8e-2c8f-42e2-a6a0-fe9783bb7ca5 tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/6300240d-5974-4a50-91f2-6dcdbbbbceb2" status: 202 len: 0 microversion: 2.1 time: 0.526488 Jul 25 14:29:02.769610 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 597/1142] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:29:02 2022] DELETE /compute/v2.1/os-security-groups/6300240d-5974-4a50-91f2-6dcdbbbbceb2 => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:29:03.003010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fa1143c9-4144-4da8-8029-ab6c009250b8 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:03.007049 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fa1143c9-4144-4da8-8029-ab6c009250b8 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:03.015073 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fa1143c9-4144-4da8-8029-ab6c009250b8 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:03.015961 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fa1143c9-4144-4da8-8029-ab6c009250b8 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:03.017956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fa1143c9-4144-4da8-8029-ab6c009250b8 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:03.018632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fa1143c9-4144-4da8-8029-ab6c009250b8 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:03.117606 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-fa1143c9-4144-4da8-8029-ab6c009250b8 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:29:03.118372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-fa1143c9-4144-4da8-8029-ab6c009250b8 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:29:03.119087 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-fa1143c9-4144-4da8-8029-ab6c009250b8 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:29:03.119866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-fa1143c9-4144-4da8-8029-ab6c009250b8 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:29:03.120508 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-fa1143c9-4144-4da8-8029-ab6c009250b8 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:29:03.195936 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fa1143c9-4144-4da8-8029-ab6c009250b8 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:03.203628 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fa1143c9-4144-4da8-8029-ab6c009250b8 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:03.204442 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fa1143c9-4144-4da8-8029-ab6c009250b8 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:03.205525 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fa1143c9-4144-4da8-8029-ab6c009250b8 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:03.206167 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fa1143c9-4144-4da8-8029-ab6c009250b8 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:03.252523 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-305cf059-4b84-47c9-8b68-02f89aa3f925 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:03.265351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-305cf059-4b84-47c9-8b68-02f89aa3f925 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:03.266967 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-305cf059-4b84-47c9-8b68-02f89aa3f925 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:03.270277 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-305cf059-4b84-47c9-8b68-02f89aa3f925 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 200 len: 1568 microversion: 2.25 time: 1.215833 Jul 25 14:29:03.273416 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 546/1143] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:02 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 1568 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:03.287176 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3b358bef-0904-4df7-8e73-dfe69c02f478 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:03.288245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3b358bef-0904-4df7-8e73-dfe69c02f478 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:03.300879 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b358bef-0904-4df7-8e73-dfe69c02f478 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:03.301501 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b358bef-0904-4df7-8e73-dfe69c02f478 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:03.302394 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b358bef-0904-4df7-8e73-dfe69c02f478 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:03.302925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b358bef-0904-4df7-8e73-dfe69c02f478 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:03.642389 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-fa1143c9-4144-4da8-8029-ab6c009250b8 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lazy-loading 'services' on Instance uuid 95594c88-b538-470e-be2b-c38b7c2c88c1 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:29:03.681873 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fa1143c9-4144-4da8-8029-ab6c009250b8 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1/action" status: 202 len: 1944 microversion: 2.75 time: 0.910655 Jul 25 14:29:03.683551 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 598/1144] 10.222.0.88 () {62 vars in 1319 bytes} [Mon Jul 25 14:29:02 2022] POST /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1/action => generated 1944 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 25 14:29:03.690833 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9b8f684b-52d1-4557-b3b2-f54701030aaa tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:03.691707 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9b8f684b-52d1-4557-b3b2-f54701030aaa tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: fca96a8a-7721-4bbc-8ffa-b732ef5d753d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:03.723885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9b8f684b-52d1-4557-b3b2-f54701030aaa tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:03.725221 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9b8f684b-52d1-4557-b3b2-f54701030aaa tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:03.727232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9b8f684b-52d1-4557-b3b2-f54701030aaa tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:03.728016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9b8f684b-52d1-4557-b3b2-f54701030aaa tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:03.746277 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-9b8f684b-52d1-4557-b3b2-f54701030aaa tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] HTTP exception thrown: Instance fca96a8a-7721-4bbc-8ffa-b732ef5d753d could not be found. Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9b8f684b-52d1-4557-b3b2-f54701030aaa tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Request method failure captured: Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d HTTP/1.1 Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfepuHN12RSjndHzKsxcvRUnwBd7gUW5USRKf91qDve39QaBVEjKhMdFzop5D0hXXHQ4vxb293-w-WGBfgB-T628gvhrMspbrIW1Vj5UaJgSh6TYZ8NwMP0uyL2kvBxpDAoi44sMFrP6hkwSPxP060bWVpno8LxFv_lSOJlt0uXzFg Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 508d55290b2744998f48e37d5af6dd04 Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1250417465 Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/508d55290b2744998f48e37d5af6dd04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/508d55290b2744998f48e37d5af6dd04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_508d55290b2744998f48e37d5af6dd04", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/508d55290b2744998f48e37d5af6dd04"}]}] Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1250417465 Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 508d55290b2744998f48e37d5af6dd04 Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1250417465 Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1250417465-project Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: aec61e9c63c043f49c26eb8220cb67bb Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1250417465-project Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance fca96a8a-7721-4bbc-8ffa-b732ef5d753d could not be found. Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'fca96a8a-7721-4bbc-8ffa-b732ef5d753d'} Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fca96a8a-7721-4bbc-8ffa-b732ef5d753d could not be found. Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fca96a8a-7721-4bbc-8ffa-b732ef5d753d could not be found. Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:03.748371 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:29:03.752222 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:03.752222 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:29:03.752222 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:29:03.752222 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:29:03.752222 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:29:03.752222 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:29:03.752222 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fca96a8a-7721-4bbc-8ffa-b732ef5d753d could not be found. Jul 25 14:29:03.752222 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:03.754430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9b8f684b-52d1-4557-b3b2-f54701030aaa tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Returning 404 to user: Instance fca96a8a-7721-4bbc-8ffa-b732ef5d753d could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:29:03.756241 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9b8f684b-52d1-4557-b3b2-f54701030aaa tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d" status: 404 len: 111 microversion: 2.1 time: 0.070690 Jul 25 14:29:03.760823 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 599/1145] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:03 2022] GET /compute/v2.1/servers/fca96a8a-7721-4bbc-8ffa-b732ef5d753d => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:29:03.768379 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-17baac74-dcf7-4bde-9ead-65591307ef9c tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] Calling method '.version_select at 0x7f468753a310>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:04.041621 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=4 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:29:04.077154 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=14 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:29:04.177018 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3b358bef-0904-4df7-8e73-dfe69c02f478 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:04.194751 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3b358bef-0904-4df7-8e73-dfe69c02f478 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:04.197037 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3b358bef-0904-4df7-8e73-dfe69c02f478 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:04.199240 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3b358bef-0904-4df7-8e73-dfe69c02f478 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1865 microversion: 2.42 time: 0.924344 Jul 25 14:29:04.201546 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 547/1146] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:03 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1865 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:04.214282 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-17baac74-dcf7-4bde-9ead-65591307ef9c tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/d5a5b947-bf6c-48ef-9532-764a4a5f49da" status: 202 len: 0 microversion: 2.1 time: 0.439445 Jul 25 14:29:04.220809 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 600/1147] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:29:03 2022] DELETE /compute/v2.1/os-security-groups/d5a5b947-bf6c-48ef-9532-764a4a5f49da => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:29:04.226494 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-a5c775ca-9ebd-43e9-9692-553ff65345b6 req-2ec46751-5e47-4182-8efd-c20d8c98d154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9982c70-c715-4959-b9a9-fee30117751b", "name": "network-vif-unplugged", "status": "completed", "tag": "7a86088b-678c-4fae-8f85-06963cf768fa"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:04.226752 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4a557260-d5b1-4dd8-8bbb-59a05e858f56 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:04.227456 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4a557260-d5b1-4dd8-8bbb-59a05e858f56 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:04.243620 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4a557260-d5b1-4dd8-8bbb-59a05e858f56 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:04.244102 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4a557260-d5b1-4dd8-8bbb-59a05e858f56 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:04.244885 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4a557260-d5b1-4dd8-8bbb-59a05e858f56 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:04.245318 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4a557260-d5b1-4dd8-8bbb-59a05e858f56 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:04.250603 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a5c775ca-9ebd-43e9-9692-553ff65345b6 req-2ec46751-5e47-4182-8efd-c20d8c98d154 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:04.251764 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a5c775ca-9ebd-43e9-9692-553ff65345b6 req-2ec46751-5e47-4182-8efd-c20d8c98d154 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:04.270740 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-a5c775ca-9ebd-43e9-9692-553ff65345b6 req-2ec46751-5e47-4182-8efd-c20d8c98d154 service nova] Creating event network-vif-unplugged:7a86088b-678c-4fae-8f85-06963cf768fa for instance c9982c70-c715-4959-b9a9-fee30117751b on n-h1-846435-14 Jul 25 14:29:04.277594 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-a5c775ca-9ebd-43e9-9692-553ff65345b6 req-2ec46751-5e47-4182-8efd-c20d8c98d154 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055421 Jul 25 14:29:04.281819 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 601/1148] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:04.288283 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-22232e2d-df9e-4746-9f43-a4717f80b4fa tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:04.289482 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-22232e2d-df9e-4746-9f43-a4717f80b4fa tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 58fa156b-43cc-4633-b7bd-6ed9cc2bd220] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:04.297738 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-22232e2d-df9e-4746-9f43-a4717f80b4fa tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:04.298568 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-22232e2d-df9e-4746-9f43-a4717f80b4fa tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:04.299611 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-22232e2d-df9e-4746-9f43-a4717f80b4fa tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:04.300326 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-22232e2d-df9e-4746-9f43-a4717f80b4fa tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:04.417670 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-22232e2d-df9e-4746-9f43-a4717f80b4fa tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774744dcf62f4ef78b4a2c8dfc96f9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ca1e9beedc4892861051504a5dff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:04.436475 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-22232e2d-df9e-4746-9f43-a4717f80b4fa tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "GET /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220" status: 200 len: 1280 microversion: 2.1 time: 0.152827 Jul 25 14:29:04.437326 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 602/1149] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:04 2022] GET /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220 => generated 1280 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:04.443364 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e6f9bdda-3b3b-4b1e-b28d-7f911ac710c2 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:04.444425 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e6f9bdda-3b3b-4b1e-b28d-7f911ac710c2 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:04.451755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6f9bdda-3b3b-4b1e-b28d-7f911ac710c2 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:04.452692 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6f9bdda-3b3b-4b1e-b28d-7f911ac710c2 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:04.453778 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6f9bdda-3b3b-4b1e-b28d-7f911ac710c2 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:04.454513 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6f9bdda-3b3b-4b1e-b28d-7f911ac710c2 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:04.551537 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-e6f9bdda-3b3b-4b1e-b28d-7f911ac710c2 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lazy-loading 'services' on Instance uuid 95594c88-b538-470e-be2b-c38b7c2c88c1 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:29:04.572286 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e6f9bdda-3b3b-4b1e-b28d-7f911ac710c2 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1931 microversion: 2.75 time: 0.133512 Jul 25 14:29:04.573113 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 603/1150] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:04 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1931 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:04.577566 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4cf3eca9-46b2-4acb-8c27-6d38ab989b8f tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:04.578195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4cf3eca9-46b2-4acb-8c27-6d38ab989b8f tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:04.585410 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4cf3eca9-46b2-4acb-8c27-6d38ab989b8f tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:04.585962 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4cf3eca9-46b2-4acb-8c27-6d38ab989b8f tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:04.586886 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4cf3eca9-46b2-4acb-8c27-6d38ab989b8f tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:04.587475 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4cf3eca9-46b2-4acb-8c27-6d38ab989b8f tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:04.606239 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-4cf3eca9-46b2-4acb-8c27-6d38ab989b8f tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] HTTP exception thrown: Instance 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 could not be found. Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4cf3eca9-46b2-4acb-8c27-6d38ab989b8f tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Request method failure captured: Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 HTTP/1.1 Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qfepuHN12RSjndHzKsxcvRUnwBd7gUW5USRKf91qDve39QaBVEjKhMdFzop5D0hXXHQ4vxb293-w-WGBfgB-T628gvhrMspbrIW1Vj5UaJgSh6TYZ8NwMP0uyL2kvBxpDAoi44sMFrP6hkwSPxP060bWVpno8LxFv_lSOJlt0uXzFg Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 508d55290b2744998f48e37d5af6dd04 Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1250417465 Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/508d55290b2744998f48e37d5af6dd04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/508d55290b2744998f48e37d5af6dd04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_508d55290b2744998f48e37d5af6dd04", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/508d55290b2744998f48e37d5af6dd04"}]}] Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1250417465 Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 508d55290b2744998f48e37d5af6dd04 Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1250417465 Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1250417465-project Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: aec61e9c63c043f49c26eb8220cb67bb Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1250417465-project Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 could not be found. Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5'} Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 could not be found. Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:29:04.608093 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:29:04.612939 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 could not be found. Jul 25 14:29:04.612939 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:04.612939 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:29:04.612939 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:04.612939 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:29:04.612939 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:29:04.612939 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:29:04.612939 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:29:04.612939 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:29:04.612939 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 could not be found. Jul 25 14:29:04.612939 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:04.612939 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4cf3eca9-46b2-4acb-8c27-6d38ab989b8f tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Returning 404 to user: Instance 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:29:04.612939 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4cf3eca9-46b2-4acb-8c27-6d38ab989b8f tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "DELETE /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5" status: 404 len: 111 microversion: 2.1 time: 0.036270 Jul 25 14:29:04.612939 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 604/1151] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:29:04 2022] DELETE /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:29:04.616068 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-ffeeffe9-ac06-4d44-9bf3-6b3be26c0391 req-3ed7ca52-c13a-409e-a305-5bf50b3d9115 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33a6128a-580f-4184-ba11-6511d5021242", "tag": "2119900d-6644-4bf4-bbbb-a819dec5f58d"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:04.626686 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ffeeffe9-ac06-4d44-9bf3-6b3be26c0391 req-3ed7ca52-c13a-409e-a305-5bf50b3d9115 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:04.627168 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ffeeffe9-ac06-4d44-9bf3-6b3be26c0391 req-3ed7ca52-c13a-409e-a305-5bf50b3d9115 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:04.657796 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-ffeeffe9-ac06-4d44-9bf3-6b3be26c0391 req-3ed7ca52-c13a-409e-a305-5bf50b3d9115 service nova] Creating event network-changed:2119900d-6644-4bf4-bbbb-a819dec5f58d for instance 33a6128a-580f-4184-ba11-6511d5021242 on n-h1-846435-14 Jul 25 14:29:04.683240 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-ffeeffe9-ac06-4d44-9bf3-6b3be26c0391 req-3ed7ca52-c13a-409e-a305-5bf50b3d9115 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068946 Jul 25 14:29:04.686462 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 605/1152] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:04.693975 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-210d3a3b-0bb4-4dba-bd57-13bfb48b277a tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] Calling method '.version_select at 0x7f46877f91f0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:04.914325 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-210d3a3b-0bb4-4dba-bd57-13bfb48b277a tempest-SecurityGroupRulesTestJSON-1026209653 tempest-SecurityGroupRulesTestJSON-1026209653-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/a93ec440-1c7b-4f29-868b-f22a1c5989d5" status: 202 len: 0 microversion: 2.1 time: 0.225209 Jul 25 14:29:04.915356 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 606/1153] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:29:04 2022] DELETE /compute/v2.1/os-security-groups/a93ec440-1c7b-4f29-868b-f22a1c5989d5 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:29:04.926547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ca7b57dc-a083-4da9-8eb8-9860780c4aa9 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:04.927325 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ca7b57dc-a083-4da9-8eb8-9860780c4aa9 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:04.936801 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ca7b57dc-a083-4da9-8eb8-9860780c4aa9 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:04.937378 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ca7b57dc-a083-4da9-8eb8-9860780c4aa9 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:04.938268 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ca7b57dc-a083-4da9-8eb8-9860780c4aa9 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:04.938699 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ca7b57dc-a083-4da9-8eb8-9860780c4aa9 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:05.088835 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4a557260-d5b1-4dd8-8bbb-59a05e858f56 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:05.100662 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4a557260-d5b1-4dd8-8bbb-59a05e858f56 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1378 microversion: 2.1 time: 0.897732 Jul 25 14:29:05.114282 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 548/1154] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:04 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1378 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:05.122668 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-868745ac-c849-48fb-bea8-5928327cf89d tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:05.123363 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-868745ac-c849-48fb-bea8-5928327cf89d tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] [instance: 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:05.140191 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-868745ac-c849-48fb-bea8-5928327cf89d tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:05.140979 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-868745ac-c849-48fb-bea8-5928327cf89d tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:05.145008 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-868745ac-c849-48fb-bea8-5928327cf89d tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:05.145646 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-868745ac-c849-48fb-bea8-5928327cf89d tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:05.184634 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-868745ac-c849-48fb-bea8-5928327cf89d tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] HTTP exception thrown: Instance 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 could not be found. Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-868745ac-c849-48fb-bea8-5928327cf89d tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Request method failure captured: Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 HTTP/1.1 Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qfepuHN12RSjndHzKsxcvRUnwBd7gUW5USRKf91qDve39QaBVEjKhMdFzop5D0hXXHQ4vxb293-w-WGBfgB-T628gvhrMspbrIW1Vj5UaJgSh6TYZ8NwMP0uyL2kvBxpDAoi44sMFrP6hkwSPxP060bWVpno8LxFv_lSOJlt0uXzFg Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 508d55290b2744998f48e37d5af6dd04 Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1250417465 Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/508d55290b2744998f48e37d5af6dd04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/508d55290b2744998f48e37d5af6dd04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_508d55290b2744998f48e37d5af6dd04", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/508d55290b2744998f48e37d5af6dd04"}]}] Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1250417465 Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 508d55290b2744998f48e37d5af6dd04 Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1250417465 Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1250417465-project Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: aec61e9c63c043f49c26eb8220cb67bb Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1250417465-project Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 could not be found. Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5'} Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 could not be found. Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 could not be found. Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:29:05.190000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:29:05.193972 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:29:05.193972 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:29:05.193972 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:29:05.193972 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:29:05.193972 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:29:05.193972 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:29:05.193972 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 could not be found. Jul 25 14:29:05.193972 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:29:05.193972 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-868745ac-c849-48fb-bea8-5928327cf89d tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] Returning 404 to user: Instance 4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:29:05.193972 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-868745ac-c849-48fb-bea8-5928327cf89d tempest-ServersWithSpecificFlavorTestJSON-1250417465 tempest-ServersWithSpecificFlavorTestJSON-1250417465-project] 10.222.0.88 "GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5" status: 404 len: 111 microversion: 2.1 time: 0.076079 Jul 25 14:29:05.196465 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 549/1155] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:05 2022] GET /compute/v2.1/servers/4cb8e540-6a4a-4694-bd41-4b1b11b8a7e5 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:29:05.227246 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c878c0b1-feb5-4bbb-9614-b05ccb17a454 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:05.227857 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c878c0b1-feb5-4bbb-9614-b05ccb17a454 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:05.230938 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:29:05.245710 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c878c0b1-feb5-4bbb-9614-b05ccb17a454 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:05.246155 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c878c0b1-feb5-4bbb-9614-b05ccb17a454 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:05.249210 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c878c0b1-feb5-4bbb-9614-b05ccb17a454 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:05.249878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c878c0b1-feb5-4bbb-9614-b05ccb17a454 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:05.521896 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ca7b57dc-a083-4da9-8eb8-9860780c4aa9 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:05.534822 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ca7b57dc-a083-4da9-8eb8-9860780c4aa9 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:05.543551 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ca7b57dc-a083-4da9-8eb8-9860780c4aa9 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:05.545460 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ca7b57dc-a083-4da9-8eb8-9860780c4aa9 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 200 len: 1568 microversion: 2.25 time: 0.628802 Jul 25 14:29:05.556557 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 607/1156] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:04 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 1568 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:05.556557 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-92a80a09-d49f-45f9-9155-754e90f2af29 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:05.557423 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-92a80a09-d49f-45f9-9155-754e90f2af29 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 58fa156b-43cc-4633-b7bd-6ed9cc2bd220] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:05.573482 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-92a80a09-d49f-45f9-9155-754e90f2af29 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:05.574042 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-92a80a09-d49f-45f9-9155-754e90f2af29 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:05.575074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-92a80a09-d49f-45f9-9155-754e90f2af29 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:05.576091 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-92a80a09-d49f-45f9-9155-754e90f2af29 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:06.013918 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c878c0b1-feb5-4bbb-9614-b05ccb17a454 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:06.061162 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c878c0b1-feb5-4bbb-9614-b05ccb17a454 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:06.064369 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c878c0b1-feb5-4bbb-9614-b05ccb17a454 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:06.067097 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c878c0b1-feb5-4bbb-9614-b05ccb17a454 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1865 microversion: 2.42 time: 0.843760 Jul 25 14:29:06.068605 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 550/1157] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:05 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1865 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:29:06.084426 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d4e27e1f-2ce2-4d5a-bae5-d145e8e150a8 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:06.085480 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d4e27e1f-2ce2-4d5a-bae5-d145e8e150a8 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:06.097414 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d4e27e1f-2ce2-4d5a-bae5-d145e8e150a8 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:06.119629 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d4e27e1f-2ce2-4d5a-bae5-d145e8e150a8 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:06.121080 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d4e27e1f-2ce2-4d5a-bae5-d145e8e150a8 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:06.122614 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d4e27e1f-2ce2-4d5a-bae5-d145e8e150a8 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:06.255765 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-92a80a09-d49f-45f9-9155-754e90f2af29 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774744dcf62f4ef78b4a2c8dfc96f9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ca1e9beedc4892861051504a5dff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:06.263950 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-92a80a09-d49f-45f9-9155-754e90f2af29 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "GET /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220" status: 200 len: 1322 microversion: 2.1 time: 0.716007 Jul 25 14:29:06.277859 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 608/1158] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:05 2022] GET /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220 => generated 1322 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:06.283249 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2109d167-7577-4479-95c6-c938ee764515 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:06.284434 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2109d167-7577-4479-95c6-c938ee764515 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:06.292659 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2109d167-7577-4479-95c6-c938ee764515 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:06.293391 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2109d167-7577-4479-95c6-c938ee764515 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:06.294357 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2109d167-7577-4479-95c6-c938ee764515 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:06.294973 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2109d167-7577-4479-95c6-c938ee764515 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:06.731728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-d4e27e1f-2ce2-4d5a-bae5-d145e8e150a8 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lazy-loading 'services' on Instance uuid 95594c88-b538-470e-be2b-c38b7c2c88c1 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:29:06.774162 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d4e27e1f-2ce2-4d5a-bae5-d145e8e150a8 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1931 microversion: 2.75 time: 0.704058 Jul 25 14:29:06.775493 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 551/1159] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:06 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1931 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:06.781118 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-537922c2-dd0c-43fc-b5eb-fe9a099d3090 req-3901c8a0-d925-4187-814e-d5a11cbbe642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9982c70-c715-4959-b9a9-fee30117751b", "tag": "7a86088b-678c-4fae-8f85-06963cf768fa"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:06.798614 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-537922c2-dd0c-43fc-b5eb-fe9a099d3090 req-3901c8a0-d925-4187-814e-d5a11cbbe642 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:06.799270 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-537922c2-dd0c-43fc-b5eb-fe9a099d3090 req-3901c8a0-d925-4187-814e-d5a11cbbe642 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:06.815710 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-537922c2-dd0c-43fc-b5eb-fe9a099d3090 req-3901c8a0-d925-4187-814e-d5a11cbbe642 service nova] Creating event network-changed:7a86088b-678c-4fae-8f85-06963cf768fa for instance c9982c70-c715-4959-b9a9-fee30117751b on n-h1-846435-14 Jul 25 14:29:06.824545 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-537922c2-dd0c-43fc-b5eb-fe9a099d3090 req-3901c8a0-d925-4187-814e-d5a11cbbe642 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047324 Jul 25 14:29:06.825966 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 552/1160] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:06.845763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2109d167-7577-4479-95c6-c938ee764515 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:06.847367 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-efa0b087-fdff-43c5-9a98-f1fee8aefdb5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:06.848138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-efa0b087-fdff-43c5-9a98-f1fee8aefdb5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:06.848572 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:29:06.856964 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-efa0b087-fdff-43c5-9a98-f1fee8aefdb5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:06.857422 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-efa0b087-fdff-43c5-9a98-f1fee8aefdb5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:06.859173 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2109d167-7577-4479-95c6-c938ee764515 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1378 microversion: 2.1 time: 0.579772 Jul 25 14:29:06.859735 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-efa0b087-fdff-43c5-9a98-f1fee8aefdb5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:06.860210 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-efa0b087-fdff-43c5-9a98-f1fee8aefdb5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:06.864477 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 609/1161] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:06 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1378 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:06.954447 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-ae90944f-d195-43bc-9bf8-e12a996adec9 req-f358e7c3-8530-453b-9978-d1b25371c1e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "698a551a-c019-4ae5-ba50-0d190e41ff03", "tag": "a454c550-e298-46f0-8c6c-7d7c39505dca"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:06.973088 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ae90944f-d195-43bc-9bf8-e12a996adec9 req-f358e7c3-8530-453b-9978-d1b25371c1e5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:06.975271 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ae90944f-d195-43bc-9bf8-e12a996adec9 req-f358e7c3-8530-453b-9978-d1b25371c1e5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:06.998618 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-ae90944f-d195-43bc-9bf8-e12a996adec9 req-f358e7c3-8530-453b-9978-d1b25371c1e5 service nova] Creating event network-changed:a454c550-e298-46f0-8c6c-7d7c39505dca for instance 698a551a-c019-4ae5-ba50-0d190e41ff03 on n-h2-846435-14 Jul 25 14:29:07.016513 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-ae90944f-d195-43bc-9bf8-e12a996adec9 req-f358e7c3-8530-453b-9978-d1b25371c1e5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069240 Jul 25 14:29:07.018989 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 610/1162] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:29:07.096255 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dd8e85f0-f2fc-4ce6-8acc-0bae0db3f439 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:07.102339 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dd8e85f0-f2fc-4ce6-8acc-0bae0db3f439 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:07.114674 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd8e85f0-f2fc-4ce6-8acc-0bae0db3f439 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:07.116549 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd8e85f0-f2fc-4ce6-8acc-0bae0db3f439 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:07.117866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd8e85f0-f2fc-4ce6-8acc-0bae0db3f439 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:07.118625 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd8e85f0-f2fc-4ce6-8acc-0bae0db3f439 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:07.185218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-efa0b087-fdff-43c5-9a98-f1fee8aefdb5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:07.194549 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-efa0b087-fdff-43c5-9a98-f1fee8aefdb5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:07.202359 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-efa0b087-fdff-43c5-9a98-f1fee8aefdb5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:07.206583 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-efa0b087-fdff-43c5-9a98-f1fee8aefdb5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 200 len: 1568 microversion: 2.25 time: 0.376732 Jul 25 14:29:07.220635 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 553/1163] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:06 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 1568 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:07.284882 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8c275d57-45cf-4ca5-b4bb-2db9af2019f9 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:07.285487 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8c275d57-45cf-4ca5-b4bb-2db9af2019f9 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 58fa156b-43cc-4633-b7bd-6ed9cc2bd220] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:07.292272 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8c275d57-45cf-4ca5-b4bb-2db9af2019f9 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:07.292717 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8c275d57-45cf-4ca5-b4bb-2db9af2019f9 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:07.293492 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8c275d57-45cf-4ca5-b4bb-2db9af2019f9 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:07.293926 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8c275d57-45cf-4ca5-b4bb-2db9af2019f9 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:07.730583 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dd8e85f0-f2fc-4ce6-8acc-0bae0db3f439 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:07.742178 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dd8e85f0-f2fc-4ce6-8acc-0bae0db3f439 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:07.743842 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dd8e85f0-f2fc-4ce6-8acc-0bae0db3f439 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:07.745149 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dd8e85f0-f2fc-4ce6-8acc-0bae0db3f439 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1886 microversion: 2.42 time: 0.657577 Jul 25 14:29:07.747564 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 611/1164] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:07 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1886 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:29:07.799198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dbd702d7-3c2a-4e31-a9fb-4bdd9781428f tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:07.800433 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dbd702d7-3c2a-4e31-a9fb-4bdd9781428f tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:07.810148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dbd702d7-3c2a-4e31-a9fb-4bdd9781428f tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:07.812134 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dbd702d7-3c2a-4e31-a9fb-4bdd9781428f tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:07.815544 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dbd702d7-3c2a-4e31-a9fb-4bdd9781428f tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:07.816014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dbd702d7-3c2a-4e31-a9fb-4bdd9781428f tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:08.057972 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8c275d57-45cf-4ca5-b4bb-2db9af2019f9 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774744dcf62f4ef78b4a2c8dfc96f9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ca1e9beedc4892861051504a5dff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:08.070423 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8c275d57-45cf-4ca5-b4bb-2db9af2019f9 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "GET /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220" status: 200 len: 1322 microversion: 2.1 time: 0.789061 Jul 25 14:29:08.071806 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 554/1165] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:07 2022] GET /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220 => generated 1322 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:29:08.079071 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-dbd702d7-3c2a-4e31-a9fb-4bdd9781428f tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lazy-loading 'services' on Instance uuid 95594c88-b538-470e-be2b-c38b7c2c88c1 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:29:08.085453 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-26d6267a-1da5-458f-98a0-55af8304034a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:08.087639 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-26d6267a-1da5-458f-98a0-55af8304034a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:08.099536 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-26d6267a-1da5-458f-98a0-55af8304034a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:08.104540 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-26d6267a-1da5-458f-98a0-55af8304034a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:08.106410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-26d6267a-1da5-458f-98a0-55af8304034a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:08.111124 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-26d6267a-1da5-458f-98a0-55af8304034a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:08.134354 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dbd702d7-3c2a-4e31-a9fb-4bdd9781428f tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1931 microversion: 2.75 time: 0.338912 Jul 25 14:29:08.157019 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 612/1166] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:07 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1931 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:29:08.234454 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6ed8655c-db75-4be3-b5dd-f2110892ec5e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:08.235643 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6ed8655c-db75-4be3-b5dd-f2110892ec5e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:08.247404 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6ed8655c-db75-4be3-b5dd-f2110892ec5e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:08.247939 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6ed8655c-db75-4be3-b5dd-f2110892ec5e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:08.248929 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6ed8655c-db75-4be3-b5dd-f2110892ec5e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:08.249425 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6ed8655c-db75-4be3-b5dd-f2110892ec5e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:08.654220 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6ed8655c-db75-4be3-b5dd-f2110892ec5e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:08.669589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6ed8655c-db75-4be3-b5dd-f2110892ec5e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:08.671086 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6ed8655c-db75-4be3-b5dd-f2110892ec5e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:08.672473 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6ed8655c-db75-4be3-b5dd-f2110892ec5e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 200 len: 1568 microversion: 2.25 time: 0.442183 Jul 25 14:29:08.673045 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 613/1167] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:08 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 1568 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:29:08.775129 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e2a180e5-4aa3-431a-bbab-5f73e1a4d15e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:08.776074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e2a180e5-4aa3-431a-bbab-5f73e1a4d15e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:08.796147 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2a180e5-4aa3-431a-bbab-5f73e1a4d15e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:08.796592 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2a180e5-4aa3-431a-bbab-5f73e1a4d15e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:08.797444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2a180e5-4aa3-431a-bbab-5f73e1a4d15e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:08.797840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2a180e5-4aa3-431a-bbab-5f73e1a4d15e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:09.308378 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-26d6267a-1da5-458f-98a0-55af8304034a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:09.325573 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-26d6267a-1da5-458f-98a0-55af8304034a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1378 microversion: 2.1 time: 1.245888 Jul 25 14:29:09.328923 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 555/1168] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:08 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1378 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:09.337215 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e2a180e5-4aa3-431a-bbab-5f73e1a4d15e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:09.344363 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d0e20d10-a8b7-41b0-bd24-11929fc81af5 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:09.345202 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d0e20d10-a8b7-41b0-bd24-11929fc81af5 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 58fa156b-43cc-4633-b7bd-6ed9cc2bd220] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:09.359879 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d0e20d10-a8b7-41b0-bd24-11929fc81af5 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:09.360759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d0e20d10-a8b7-41b0-bd24-11929fc81af5 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:09.361795 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d0e20d10-a8b7-41b0-bd24-11929fc81af5 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:09.362448 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d0e20d10-a8b7-41b0-bd24-11929fc81af5 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:09.368215 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:29:09.390453 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e2a180e5-4aa3-431a-bbab-5f73e1a4d15e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:09.397934 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e2a180e5-4aa3-431a-bbab-5f73e1a4d15e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:09.405104 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e2a180e5-4aa3-431a-bbab-5f73e1a4d15e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1886 microversion: 2.42 time: 0.629989 Jul 25 14:29:09.408182 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 614/1169] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:08 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1886 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:09.414445 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-d179cbd2-ada3-4e18-b59e-cf7fe30817b9 req-b35bad3a-3d53-4837-acc6-5866b2698e72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33a6128a-580f-4184-ba11-6511d5021242", "tag": "1b64c898-66f1-4e5b-be51-5b73f032a6f6"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:09.478803 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-d179cbd2-ada3-4e18-b59e-cf7fe30817b9 req-b35bad3a-3d53-4837-acc6-5866b2698e72 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:09.479425 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-d179cbd2-ada3-4e18-b59e-cf7fe30817b9 req-b35bad3a-3d53-4837-acc6-5866b2698e72 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:09.493785 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-d179cbd2-ada3-4e18-b59e-cf7fe30817b9 req-b35bad3a-3d53-4837-acc6-5866b2698e72 service nova] Creating event network-changed:1b64c898-66f1-4e5b-be51-5b73f032a6f6 for instance 33a6128a-580f-4184-ba11-6511d5021242 on n-h1-846435-14 Jul 25 14:29:09.499686 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-d179cbd2-ada3-4e18-b59e-cf7fe30817b9 req-b35bad3a-3d53-4837-acc6-5866b2698e72 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089395 Jul 25 14:29:09.500857 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 615/1170] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:09.507061 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b469d129-7636-44a8-9afb-f6f822fdf9d1 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:09.508494 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b469d129-7636-44a8-9afb-f6f822fdf9d1 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:09.517887 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b469d129-7636-44a8-9afb-f6f822fdf9d1 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:09.518627 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b469d129-7636-44a8-9afb-f6f822fdf9d1 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:09.520091 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b469d129-7636-44a8-9afb-f6f822fdf9d1 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:09.521325 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b469d129-7636-44a8-9afb-f6f822fdf9d1 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:09.905446 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=10 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:29:09.949305 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:29:09.996948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-b469d129-7636-44a8-9afb-f6f822fdf9d1 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lazy-loading 'services' on Instance uuid 95594c88-b538-470e-be2b-c38b7c2c88c1 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:29:10.030191 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b469d129-7636-44a8-9afb-f6f822fdf9d1 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1931 microversion: 2.75 time: 0.527896 Jul 25 14:29:10.056973 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 616/1171] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:09 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1931 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:10.064258 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-24098f2a-e659-4dcb-a958-1259affe6d49 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:10.065129 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-24098f2a-e659-4dcb-a958-1259affe6d49 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:10.075819 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-24098f2a-e659-4dcb-a958-1259affe6d49 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:10.077323 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-24098f2a-e659-4dcb-a958-1259affe6d49 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:10.078518 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-24098f2a-e659-4dcb-a958-1259affe6d49 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:10.079240 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-24098f2a-e659-4dcb-a958-1259affe6d49 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:10.557894 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d0e20d10-a8b7-41b0-bd24-11929fc81af5 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774744dcf62f4ef78b4a2c8dfc96f9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ca1e9beedc4892861051504a5dff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:10.610916 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d0e20d10-a8b7-41b0-bd24-11929fc81af5 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "GET /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220" status: 200 len: 1322 microversion: 2.1 time: 1.257224 Jul 25 14:29:10.612917 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 556/1172] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:09 2022] GET /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220 => generated 1322 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:10.625167 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a4183b27-4d16-4d37-bca4-5aed89eb4641 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:10.627811 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a4183b27-4d16-4d37-bca4-5aed89eb4641 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:10.644522 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a4183b27-4d16-4d37-bca4-5aed89eb4641 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:10.645766 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a4183b27-4d16-4d37-bca4-5aed89eb4641 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:10.646836 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a4183b27-4d16-4d37-bca4-5aed89eb4641 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:10.648088 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a4183b27-4d16-4d37-bca4-5aed89eb4641 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:10.661784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-24098f2a-e659-4dcb-a958-1259affe6d49 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:10.694352 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-24098f2a-e659-4dcb-a958-1259affe6d49 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:10.698938 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-24098f2a-e659-4dcb-a958-1259affe6d49 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:10.704583 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-24098f2a-e659-4dcb-a958-1259affe6d49 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 200 len: 1568 microversion: 2.25 time: 0.645051 Jul 25 14:29:10.706971 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 617/1173] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:10 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 1568 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:10.730814 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e4cbeda2-8263-436d-9564-8674a56c9c16 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:10.731501 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e4cbeda2-8263-436d-9564-8674a56c9c16 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:10.757016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e4cbeda2-8263-436d-9564-8674a56c9c16 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:10.758151 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e4cbeda2-8263-436d-9564-8674a56c9c16 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:10.761418 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e4cbeda2-8263-436d-9564-8674a56c9c16 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:10.762064 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e4cbeda2-8263-436d-9564-8674a56c9c16 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:11.549334 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a4183b27-4d16-4d37-bca4-5aed89eb4641 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:11.563587 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a4183b27-4d16-4d37-bca4-5aed89eb4641 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1378 microversion: 2.1 time: 0.947828 Jul 25 14:29:11.571746 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 557/1174] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:10 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1378 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:11.589922 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fa875cde-e3f0-41c3-9c8d-86bf60f2df2a tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:11.596132 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fa875cde-e3f0-41c3-9c8d-86bf60f2df2a tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:11.621499 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa875cde-e3f0-41c3-9c8d-86bf60f2df2a tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:11.622340 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa875cde-e3f0-41c3-9c8d-86bf60f2df2a tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:11.624119 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa875cde-e3f0-41c3-9c8d-86bf60f2df2a tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:11.628982 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa875cde-e3f0-41c3-9c8d-86bf60f2df2a tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:11.782538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e4cbeda2-8263-436d-9564-8674a56c9c16 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:11.800326 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e4cbeda2-8263-436d-9564-8674a56c9c16 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:11.802456 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e4cbeda2-8263-436d-9564-8674a56c9c16 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:11.804343 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e4cbeda2-8263-436d-9564-8674a56c9c16 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1886 microversion: 2.42 time: 1.094668 Jul 25 14:29:11.807372 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 618/1175] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:10 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1886 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:11.826644 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-1c58abdb-3b2d-4853-814f-1125d8102282 req-e7563c4c-2d62-4747-82de-c5ef1f1e9924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9982c70-c715-4959-b9a9-fee30117751b", "name": "network-vif-unplugged", "status": "completed", "tag": "7a86088b-678c-4fae-8f85-06963cf768fa"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:11.849170 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:29:11.861223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-1c58abdb-3b2d-4853-814f-1125d8102282 req-e7563c4c-2d62-4747-82de-c5ef1f1e9924 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:11.861900 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-1c58abdb-3b2d-4853-814f-1125d8102282 req-e7563c4c-2d62-4747-82de-c5ef1f1e9924 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:11.877857 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-1c58abdb-3b2d-4853-814f-1125d8102282 req-e7563c4c-2d62-4747-82de-c5ef1f1e9924 service nova] Creating event network-vif-unplugged:7a86088b-678c-4fae-8f85-06963cf768fa for instance c9982c70-c715-4959-b9a9-fee30117751b on n-h1-846435-14 Jul 25 14:29:11.885070 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-1c58abdb-3b2d-4853-814f-1125d8102282 req-e7563c4c-2d62-4747-82de-c5ef1f1e9924 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075227 Jul 25 14:29:11.887683 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 619/1176] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:11.895526 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-41f65afb-ee83-4cac-8147-eb8c9ce2007a tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:11.896290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-41f65afb-ee83-4cac-8147-eb8c9ce2007a tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 58fa156b-43cc-4633-b7bd-6ed9cc2bd220] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:11.915154 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-41f65afb-ee83-4cac-8147-eb8c9ce2007a tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:11.915916 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-41f65afb-ee83-4cac-8147-eb8c9ce2007a tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:11.930420 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-41f65afb-ee83-4cac-8147-eb8c9ce2007a tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:11.930927 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-41f65afb-ee83-4cac-8147-eb8c9ce2007a tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:11.936342 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-fa875cde-e3f0-41c3-9c8d-86bf60f2df2a tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lazy-loading 'services' on Instance uuid 95594c88-b538-470e-be2b-c38b7c2c88c1 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:29:11.995189 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fa875cde-e3f0-41c3-9c8d-86bf60f2df2a tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1931 microversion: 2.75 time: 0.421171 Jul 25 14:29:11.998532 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 558/1177] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:11 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1931 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:12.010583 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a28800ff-295d-4d4f-964f-5414bce8d435 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:12.011288 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a28800ff-295d-4d4f-964f-5414bce8d435 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:12.030925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a28800ff-295d-4d4f-964f-5414bce8d435 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:12.031525 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a28800ff-295d-4d4f-964f-5414bce8d435 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:12.032346 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a28800ff-295d-4d4f-964f-5414bce8d435 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:12.041115 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a28800ff-295d-4d4f-964f-5414bce8d435 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:12.603769 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-41f65afb-ee83-4cac-8147-eb8c9ce2007a tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774744dcf62f4ef78b4a2c8dfc96f9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ca1e9beedc4892861051504a5dff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:12.620771 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-41f65afb-ee83-4cac-8147-eb8c9ce2007a tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "GET /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220" status: 200 len: 1322 microversion: 2.1 time: 0.731469 Jul 25 14:29:12.621662 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 620/1178] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:11 2022] GET /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220 => generated 1322 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:12.629773 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-5ebbc84a-1129-4cad-8d3c-401618b1f2e7 req-51616f65-ed75-40f1-b694-5d28a7d8db80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58fa156b-43cc-4633-b7bd-6ed9cc2bd220", "tag": "84f2f14b-3637-41cb-ad13-2d25a69e7b91"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:12.654853 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-5ebbc84a-1129-4cad-8d3c-401618b1f2e7 req-51616f65-ed75-40f1-b694-5d28a7d8db80 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:12.656260 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-5ebbc84a-1129-4cad-8d3c-401618b1f2e7 req-51616f65-ed75-40f1-b694-5d28a7d8db80 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:12.670443 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-5ebbc84a-1129-4cad-8d3c-401618b1f2e7 req-51616f65-ed75-40f1-b694-5d28a7d8db80 service nova] Creating event network-changed:84f2f14b-3637-41cb-ad13-2d25a69e7b91 for instance 58fa156b-43cc-4633-b7bd-6ed9cc2bd220 on n-h2-846435-14 Jul 25 14:29:12.678891 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-5ebbc84a-1129-4cad-8d3c-401618b1f2e7 req-51616f65-ed75-40f1-b694-5d28a7d8db80 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051483 Jul 25 14:29:12.681179 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 621/1179] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:12.684274 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a28800ff-295d-4d4f-964f-5414bce8d435 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:12.689361 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a30308c9-575f-4b3d-b96d-7a1cda7f4a94 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:12.689868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a30308c9-575f-4b3d-b96d-7a1cda7f4a94 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:12.694971 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a28800ff-295d-4d4f-964f-5414bce8d435 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:12.697666 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a28800ff-295d-4d4f-964f-5414bce8d435 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:12.699461 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a28800ff-295d-4d4f-964f-5414bce8d435 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 200 len: 1568 microversion: 2.25 time: 0.698033 Jul 25 14:29:12.703742 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 559/1180] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:11 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 1568 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:12.714514 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a30308c9-575f-4b3d-b96d-7a1cda7f4a94 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:12.714966 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a30308c9-575f-4b3d-b96d-7a1cda7f4a94 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:12.715760 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a30308c9-575f-4b3d-b96d-7a1cda7f4a94 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:12.716234 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a30308c9-575f-4b3d-b96d-7a1cda7f4a94 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:12.839097 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b3f01ba6-44fb-4a13-b021-27b5cd7b87bc tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:12.840274 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b3f01ba6-44fb-4a13-b021-27b5cd7b87bc tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:12.856828 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3f01ba6-44fb-4a13-b021-27b5cd7b87bc tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:12.857646 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3f01ba6-44fb-4a13-b021-27b5cd7b87bc tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:12.861650 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3f01ba6-44fb-4a13-b021-27b5cd7b87bc tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:12.870204 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3f01ba6-44fb-4a13-b021-27b5cd7b87bc tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:13.490828 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a30308c9-575f-4b3d-b96d-7a1cda7f4a94 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:13.500612 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a30308c9-575f-4b3d-b96d-7a1cda7f4a94 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1378 microversion: 2.1 time: 0.817729 Jul 25 14:29:13.501621 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 622/1181] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:12 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1378 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:13.511929 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ab90eca9-02cf-4a75-b5cb-e18b7397472b tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:13.512973 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ab90eca9-02cf-4a75-b5cb-e18b7397472b tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:13.520742 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ab90eca9-02cf-4a75-b5cb-e18b7397472b tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:13.521282 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ab90eca9-02cf-4a75-b5cb-e18b7397472b tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:13.522142 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ab90eca9-02cf-4a75-b5cb-e18b7397472b tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:13.522633 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ab90eca9-02cf-4a75-b5cb-e18b7397472b tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:13.705477 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-ab90eca9-02cf-4a75-b5cb-e18b7397472b tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lazy-loading 'services' on Instance uuid 95594c88-b538-470e-be2b-c38b7c2c88c1 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:29:13.749738 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ab90eca9-02cf-4a75-b5cb-e18b7397472b tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1931 microversion: 2.75 time: 0.246603 Jul 25 14:29:13.751228 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 623/1182] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:13 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1931 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:13.758761 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3173c585-e8e9-4631-984a-569d47d2762a tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:13.760660 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3173c585-e8e9-4631-984a-569d47d2762a tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 58fa156b-43cc-4633-b7bd-6ed9cc2bd220] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:13.776839 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3173c585-e8e9-4631-984a-569d47d2762a tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:13.777920 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3173c585-e8e9-4631-984a-569d47d2762a tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:13.779589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3173c585-e8e9-4631-984a-569d47d2762a tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:13.780303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3173c585-e8e9-4631-984a-569d47d2762a tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:13.974670 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b3f01ba6-44fb-4a13-b021-27b5cd7b87bc tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:13.990154 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b3f01ba6-44fb-4a13-b021-27b5cd7b87bc tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:13.992951 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b3f01ba6-44fb-4a13-b021-27b5cd7b87bc tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:13.995205 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b3f01ba6-44fb-4a13-b021-27b5cd7b87bc tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1874 microversion: 2.42 time: 1.160196 Jul 25 14:29:14.008621 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 560/1183] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:12 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1874 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:29:14.029704 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a7e66b4d-02b7-4671-b10a-97c8b13f3ee0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:14.030687 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a7e66b4d-02b7-4671-b10a-97c8b13f3ee0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:14.040855 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a7e66b4d-02b7-4671-b10a-97c8b13f3ee0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:14.043570 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a7e66b4d-02b7-4671-b10a-97c8b13f3ee0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:14.045247 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a7e66b4d-02b7-4671-b10a-97c8b13f3ee0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:14.046099 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a7e66b4d-02b7-4671-b10a-97c8b13f3ee0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:14.172428 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3173c585-e8e9-4631-984a-569d47d2762a tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774744dcf62f4ef78b4a2c8dfc96f9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ca1e9beedc4892861051504a5dff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:14.188513 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3173c585-e8e9-4631-984a-569d47d2762a tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "GET /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220" status: 200 len: 1322 microversion: 2.1 time: 0.435744 Jul 25 14:29:14.193150 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 624/1184] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:13 2022] GET /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220 => generated 1322 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:14.410903 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a7e66b4d-02b7-4671-b10a-97c8b13f3ee0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:14.421961 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a7e66b4d-02b7-4671-b10a-97c8b13f3ee0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:14.426283 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a7e66b4d-02b7-4671-b10a-97c8b13f3ee0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:14.434644 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a7e66b4d-02b7-4671-b10a-97c8b13f3ee0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 200 len: 1568 microversion: 2.25 time: 0.417817 Jul 25 14:29:14.436440 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 561/1185] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:14 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 1568 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:14.531527 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-27dd169f-66af-44ad-8151-8540d389f34b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:14.532972 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-27dd169f-66af-44ad-8151-8540d389f34b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:14.564396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-27dd169f-66af-44ad-8151-8540d389f34b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:14.565251 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-27dd169f-66af-44ad-8151-8540d389f34b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:14.568327 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-27dd169f-66af-44ad-8151-8540d389f34b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:14.569581 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-27dd169f-66af-44ad-8151-8540d389f34b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:14.716417 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-18f7e6d7-16cf-4804-9d99-beef6ed5bba8 req-546a7fc1-ec16-471a-a21f-2b3f9e7ddc9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33a6128a-580f-4184-ba11-6511d5021242", "tag": "87364f5a-d3ef-46c2-92c5-1fafec0f79e8"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:14.726285 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-18f7e6d7-16cf-4804-9d99-beef6ed5bba8 req-546a7fc1-ec16-471a-a21f-2b3f9e7ddc9e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:14.727001 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-18f7e6d7-16cf-4804-9d99-beef6ed5bba8 req-546a7fc1-ec16-471a-a21f-2b3f9e7ddc9e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:14.741376 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-18f7e6d7-16cf-4804-9d99-beef6ed5bba8 req-546a7fc1-ec16-471a-a21f-2b3f9e7ddc9e service nova] Creating event network-changed:87364f5a-d3ef-46c2-92c5-1fafec0f79e8 for instance 33a6128a-580f-4184-ba11-6511d5021242 on n-h1-846435-14 Jul 25 14:29:14.750135 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-18f7e6d7-16cf-4804-9d99-beef6ed5bba8 req-546a7fc1-ec16-471a-a21f-2b3f9e7ddc9e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037127 Jul 25 14:29:14.751292 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 562/1186] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:29:14.781221 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b0aeb3ef-51d0-4178-9c7c-910ea5a4a904 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:14.782233 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b0aeb3ef-51d0-4178-9c7c-910ea5a4a904 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:14.790025 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b0aeb3ef-51d0-4178-9c7c-910ea5a4a904 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:14.790791 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b0aeb3ef-51d0-4178-9c7c-910ea5a4a904 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:14.792218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b0aeb3ef-51d0-4178-9c7c-910ea5a4a904 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:14.792827 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b0aeb3ef-51d0-4178-9c7c-910ea5a4a904 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:14.950429 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-b0aeb3ef-51d0-4178-9c7c-910ea5a4a904 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lazy-loading 'services' on Instance uuid 95594c88-b538-470e-be2b-c38b7c2c88c1 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:29:14.984668 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b0aeb3ef-51d0-4178-9c7c-910ea5a4a904 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1931 microversion: 2.75 time: 0.209235 Jul 25 14:29:14.992766 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 563/1187] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:14 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1931 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:15.034437 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-587edea5-32c3-4e31-aaa8-754a86250b97 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:15.035055 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-587edea5-32c3-4e31-aaa8-754a86250b97 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:15.041413 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-587edea5-32c3-4e31-aaa8-754a86250b97 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:15.042484 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-587edea5-32c3-4e31-aaa8-754a86250b97 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:15.043248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-587edea5-32c3-4e31-aaa8-754a86250b97 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:15.043703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-587edea5-32c3-4e31-aaa8-754a86250b97 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:15.198723 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-27dd169f-66af-44ad-8151-8540d389f34b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:15.214341 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-27dd169f-66af-44ad-8151-8540d389f34b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1378 microversion: 2.1 time: 0.695133 Jul 25 14:29:15.215120 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 625/1188] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:14 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1378 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:15.222399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-52bc068b-befd-4535-9a92-3c410dd18884 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:15.224050 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-52bc068b-befd-4535-9a92-3c410dd18884 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 58fa156b-43cc-4633-b7bd-6ed9cc2bd220] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:15.231653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52bc068b-befd-4535-9a92-3c410dd18884 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:15.232367 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52bc068b-befd-4535-9a92-3c410dd18884 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:15.233395 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52bc068b-befd-4535-9a92-3c410dd18884 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:15.234186 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52bc068b-befd-4535-9a92-3c410dd18884 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:15.595837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-587edea5-32c3-4e31-aaa8-754a86250b97 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:15.621717 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-587edea5-32c3-4e31-aaa8-754a86250b97 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:15.631375 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-587edea5-32c3-4e31-aaa8-754a86250b97 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:15.633361 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-587edea5-32c3-4e31-aaa8-754a86250b97 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1874 microversion: 2.42 time: 0.604762 Jul 25 14:29:15.634719 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 564/1189] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:15 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1874 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:15.641681 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-80e23f8e-a1bf-478c-9400-6f14522c0c6c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:15.643019 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-80e23f8e-a1bf-478c-9400-6f14522c0c6c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:15.652812 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-80e23f8e-a1bf-478c-9400-6f14522c0c6c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:15.654680 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-80e23f8e-a1bf-478c-9400-6f14522c0c6c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:15.656226 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-80e23f8e-a1bf-478c-9400-6f14522c0c6c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:15.657200 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-80e23f8e-a1bf-478c-9400-6f14522c0c6c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:15.788777 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-52bc068b-befd-4535-9a92-3c410dd18884 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774744dcf62f4ef78b4a2c8dfc96f9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ca1e9beedc4892861051504a5dff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:15.810794 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-52bc068b-befd-4535-9a92-3c410dd18884 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "GET /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220" status: 200 len: 1322 microversion: 2.1 time: 0.594240 Jul 25 14:29:15.812120 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 626/1190] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:15 2022] GET /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220 => generated 1322 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:16.012149 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-45b66f92-c5b8-4aff-bc56-8b89c8b8e6bc tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:16.013054 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-45b66f92-c5b8-4aff-bc56-8b89c8b8e6bc tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:16.027831 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-80e23f8e-a1bf-478c-9400-6f14522c0c6c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:16.031776 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45b66f92-c5b8-4aff-bc56-8b89c8b8e6bc tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:16.032311 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45b66f92-c5b8-4aff-bc56-8b89c8b8e6bc tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:16.033085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45b66f92-c5b8-4aff-bc56-8b89c8b8e6bc tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:16.033504 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45b66f92-c5b8-4aff-bc56-8b89c8b8e6bc tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:16.038965 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-80e23f8e-a1bf-478c-9400-6f14522c0c6c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:16.045315 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-80e23f8e-a1bf-478c-9400-6f14522c0c6c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:16.046984 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-80e23f8e-a1bf-478c-9400-6f14522c0c6c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 200 len: 1568 microversion: 2.25 time: 0.410892 Jul 25 14:29:16.063370 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 565/1191] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:15 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 1568 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:16.215028 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-45b66f92-c5b8-4aff-bc56-8b89c8b8e6bc tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lazy-loading 'services' on Instance uuid 95594c88-b538-470e-be2b-c38b7c2c88c1 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:29:16.236102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:29:16.247641 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b79e539e-7204-4101-9a7b-2a963799fcdb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:16.254265 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b79e539e-7204-4101-9a7b-2a963799fcdb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:16.263954 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-45b66f92-c5b8-4aff-bc56-8b89c8b8e6bc tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1931 microversion: 2.75 time: 0.249012 Jul 25 14:29:16.265136 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 627/1192] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:16 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1931 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:29:16.287608 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b79e539e-7204-4101-9a7b-2a963799fcdb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:16.293148 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b79e539e-7204-4101-9a7b-2a963799fcdb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:16.296393 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b79e539e-7204-4101-9a7b-2a963799fcdb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:16.297693 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b79e539e-7204-4101-9a7b-2a963799fcdb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:16.523404 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-e8852b72-8401-447a-8343-adf9358e3070 req-711ca3bc-90ff-4b17-8513-7c9ab337d5ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698a551a-c019-4ae5-ba50-0d190e41ff03", "name": "network-vif-plugged", "status": "completed", "tag": "a454c550-e298-46f0-8c6c-7d7c39505dca"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:16.546846 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-e8852b72-8401-447a-8343-adf9358e3070 req-711ca3bc-90ff-4b17-8513-7c9ab337d5ff service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:16.547289 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-e8852b72-8401-447a-8343-adf9358e3070 req-711ca3bc-90ff-4b17-8513-7c9ab337d5ff service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:16.569320 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-e8852b72-8401-447a-8343-adf9358e3070 req-711ca3bc-90ff-4b17-8513-7c9ab337d5ff service nova] Creating event network-vif-plugged:a454c550-e298-46f0-8c6c-7d7c39505dca for instance 698a551a-c019-4ae5-ba50-0d190e41ff03 on n-h2-846435-14 Jul 25 14:29:16.586578 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-e8852b72-8401-447a-8343-adf9358e3070 req-711ca3bc-90ff-4b17-8513-7c9ab337d5ff service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071310 Jul 25 14:29:16.587432 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 628/1193] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:29:16.659474 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d9bd1979-922f-4cee-b67e-8c6fcce72c81 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:16.660500 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d9bd1979-922f-4cee-b67e-8c6fcce72c81 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:16.671119 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d9bd1979-922f-4cee-b67e-8c6fcce72c81 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:16.672484 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d9bd1979-922f-4cee-b67e-8c6fcce72c81 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:16.675885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d9bd1979-922f-4cee-b67e-8c6fcce72c81 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:16.676533 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d9bd1979-922f-4cee-b67e-8c6fcce72c81 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:17.405349 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b79e539e-7204-4101-9a7b-2a963799fcdb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:17.413149 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b79e539e-7204-4101-9a7b-2a963799fcdb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1378 microversion: 2.1 time: 1.175675 Jul 25 14:29:17.436067 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 566/1194] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:16 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1378 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:17.441165 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1f171c0c-8601-40ef-b992-3ec380369278 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:17.441780 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1f171c0c-8601-40ef-b992-3ec380369278 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 58fa156b-43cc-4633-b7bd-6ed9cc2bd220] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:17.451523 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1f171c0c-8601-40ef-b992-3ec380369278 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:17.451969 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1f171c0c-8601-40ef-b992-3ec380369278 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:17.452768 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1f171c0c-8601-40ef-b992-3ec380369278 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:17.453337 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1f171c0c-8601-40ef-b992-3ec380369278 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:17.895787 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1f171c0c-8601-40ef-b992-3ec380369278 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774744dcf62f4ef78b4a2c8dfc96f9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ca1e9beedc4892861051504a5dff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:17.904244 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1f171c0c-8601-40ef-b992-3ec380369278 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "GET /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220" status: 200 len: 1322 microversion: 2.1 time: 0.466846 Jul 25 14:29:17.908023 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 567/1195] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:17 2022] GET /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220 => generated 1322 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:17.917841 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cc3236cf-bbc7-4d2c-baeb-4afdd5b6ab17 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:17.924225 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cc3236cf-bbc7-4d2c-baeb-4afdd5b6ab17 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:17.950074 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cc3236cf-bbc7-4d2c-baeb-4afdd5b6ab17 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:17.950520 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cc3236cf-bbc7-4d2c-baeb-4afdd5b6ab17 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:17.951600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cc3236cf-bbc7-4d2c-baeb-4afdd5b6ab17 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:17.952135 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cc3236cf-bbc7-4d2c-baeb-4afdd5b6ab17 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:18.204390 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d9bd1979-922f-4cee-b67e-8c6fcce72c81 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:18.221250 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d9bd1979-922f-4cee-b67e-8c6fcce72c81 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:18.224341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d9bd1979-922f-4cee-b67e-8c6fcce72c81 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:18.227349 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d9bd1979-922f-4cee-b67e-8c6fcce72c81 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1874 microversion: 2.42 time: 1.570444 Jul 25 14:29:18.227953 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 629/1196] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:16 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1874 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:29:18.240215 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-aae6846c-09c5-43ca-b61f-facdd52b7ee5 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:18.240990 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-aae6846c-09c5-43ca-b61f-facdd52b7ee5 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:18.256292 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aae6846c-09c5-43ca-b61f-facdd52b7ee5 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:18.256738 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aae6846c-09c5-43ca-b61f-facdd52b7ee5 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:18.264897 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aae6846c-09c5-43ca-b61f-facdd52b7ee5 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:18.266571 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aae6846c-09c5-43ca-b61f-facdd52b7ee5 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:18.386397 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cc3236cf-bbc7-4d2c-baeb-4afdd5b6ab17 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:18.398509 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cc3236cf-bbc7-4d2c-baeb-4afdd5b6ab17 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:18.401441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cc3236cf-bbc7-4d2c-baeb-4afdd5b6ab17 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:18.403013 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cc3236cf-bbc7-4d2c-baeb-4afdd5b6ab17 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 200 len: 1568 microversion: 2.25 time: 0.494149 Jul 25 14:29:18.405426 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 568/1197] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:17 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 1568 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:18.412767 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-14ab76e3-fd02-4318-9a3b-7d3a7ec3ebb2 req-6a4ba18c-8fa2-4dbc-a00a-dfa1f9cfd0c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33a6128a-580f-4184-ba11-6511d5021242", "tag": "47a20d0d-9969-4add-9f4c-b4a79d222111"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:18.436807 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-14ab76e3-fd02-4318-9a3b-7d3a7ec3ebb2 req-6a4ba18c-8fa2-4dbc-a00a-dfa1f9cfd0c3 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:18.437526 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-14ab76e3-fd02-4318-9a3b-7d3a7ec3ebb2 req-6a4ba18c-8fa2-4dbc-a00a-dfa1f9cfd0c3 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:18.454433 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-14ab76e3-fd02-4318-9a3b-7d3a7ec3ebb2 req-6a4ba18c-8fa2-4dbc-a00a-dfa1f9cfd0c3 service nova] Creating event network-changed:47a20d0d-9969-4add-9f4c-b4a79d222111 for instance 33a6128a-580f-4184-ba11-6511d5021242 on n-h1-846435-14 Jul 25 14:29:18.458632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-aae6846c-09c5-43ca-b61f-facdd52b7ee5 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lazy-loading 'services' on Instance uuid 95594c88-b538-470e-be2b-c38b7c2c88c1 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:29:18.463830 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-14ab76e3-fd02-4318-9a3b-7d3a7ec3ebb2 req-6a4ba18c-8fa2-4dbc-a00a-dfa1f9cfd0c3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052765 Jul 25 14:29:18.465188 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 569/1198] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:18.477675 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-22772688-da3e-486b-a84d-468cad8e8484 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:18.478759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-22772688-da3e-486b-a84d-468cad8e8484 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:18.487918 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-22772688-da3e-486b-a84d-468cad8e8484 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:18.488702 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-22772688-da3e-486b-a84d-468cad8e8484 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:18.489751 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-22772688-da3e-486b-a84d-468cad8e8484 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:18.490340 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-22772688-da3e-486b-a84d-468cad8e8484 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:18.505055 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-aae6846c-09c5-43ca-b61f-facdd52b7ee5 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1931 microversion: 2.75 time: 0.275838 Jul 25 14:29:18.506075 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 630/1199] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:18 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1931 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:18.930501 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-10e88177-a115-4f02-80c7-920c822dac37 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:18.931426 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-10e88177-a115-4f02-80c7-920c822dac37 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 58fa156b-43cc-4633-b7bd-6ed9cc2bd220] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:18.943078 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-10e88177-a115-4f02-80c7-920c822dac37 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:18.944457 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-10e88177-a115-4f02-80c7-920c822dac37 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:18.952310 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-10e88177-a115-4f02-80c7-920c822dac37 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:18.953102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-10e88177-a115-4f02-80c7-920c822dac37 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:18.991011 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-22772688-da3e-486b-a84d-468cad8e8484 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:19.003035 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-22772688-da3e-486b-a84d-468cad8e8484 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1378 microversion: 2.1 time: 0.533310 Jul 25 14:29:19.004291 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 570/1200] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:18 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1378 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:19.251056 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ecf2746c-84a8-4bc8-b8fb-8e476fc0d045 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:19.251673 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ecf2746c-84a8-4bc8-b8fb-8e476fc0d045 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:19.265872 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ecf2746c-84a8-4bc8-b8fb-8e476fc0d045 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:19.266317 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ecf2746c-84a8-4bc8-b8fb-8e476fc0d045 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:19.267090 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ecf2746c-84a8-4bc8-b8fb-8e476fc0d045 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:19.267526 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ecf2746c-84a8-4bc8-b8fb-8e476fc0d045 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:19.438131 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-10e88177-a115-4f02-80c7-920c822dac37 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774744dcf62f4ef78b4a2c8dfc96f9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ca1e9beedc4892861051504a5dff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:19.452447 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-10e88177-a115-4f02-80c7-920c822dac37 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "GET /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220" status: 200 len: 1322 microversion: 2.1 time: 0.525746 Jul 25 14:29:19.453991 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 631/1201] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:18 2022] GET /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220 => generated 1322 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:19.460962 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2fca2a56-80a2-414a-8fd0-72792457f469 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:19.461638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2fca2a56-80a2-414a-8fd0-72792457f469 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:19.468726 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2fca2a56-80a2-414a-8fd0-72792457f469 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:19.469701 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2fca2a56-80a2-414a-8fd0-72792457f469 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:19.470844 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2fca2a56-80a2-414a-8fd0-72792457f469 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:19.471503 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2fca2a56-80a2-414a-8fd0-72792457f469 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:19.718038 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2fca2a56-80a2-414a-8fd0-72792457f469 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:19.729315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2fca2a56-80a2-414a-8fd0-72792457f469 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:19.730982 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2fca2a56-80a2-414a-8fd0-72792457f469 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:19.732635 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2fca2a56-80a2-414a-8fd0-72792457f469 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 200 len: 1568 microversion: 2.25 time: 0.276166 Jul 25 14:29:19.733708 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 632/1202] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:19 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 1568 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:19.738846 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-383a2953-dea1-45b9-b415-5b690d66a3e6 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:19.739457 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-383a2953-dea1-45b9-b415-5b690d66a3e6 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:19.746027 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-383a2953-dea1-45b9-b415-5b690d66a3e6 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:19.746704 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-383a2953-dea1-45b9-b415-5b690d66a3e6 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:19.751505 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-383a2953-dea1-45b9-b415-5b690d66a3e6 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:19.752190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-383a2953-dea1-45b9-b415-5b690d66a3e6 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:19.919327 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-383a2953-dea1-45b9-b415-5b690d66a3e6 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lazy-loading 'services' on Instance uuid 95594c88-b538-470e-be2b-c38b7c2c88c1 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:29:19.942868 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ecf2746c-84a8-4bc8-b8fb-8e476fc0d045 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:19.955643 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ecf2746c-84a8-4bc8-b8fb-8e476fc0d045 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:19.960727 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ecf2746c-84a8-4bc8-b8fb-8e476fc0d045 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:19.964341 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ecf2746c-84a8-4bc8-b8fb-8e476fc0d045 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1874 microversion: 2.42 time: 0.717220 Jul 25 14:29:19.965640 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 571/1203] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:19 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1874 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:29:19.969447 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-383a2953-dea1-45b9-b415-5b690d66a3e6 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1931 microversion: 2.75 time: 0.234115 Jul 25 14:29:19.972051 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 633/1204] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:19 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1931 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:20.028978 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-70b59cff-3fd8-4740-866f-be786f2e571b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:20.030960 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-70b59cff-3fd8-4740-866f-be786f2e571b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:20.044324 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70b59cff-3fd8-4740-866f-be786f2e571b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:20.044820 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70b59cff-3fd8-4740-866f-be786f2e571b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:20.046143 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70b59cff-3fd8-4740-866f-be786f2e571b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:20.046143 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70b59cff-3fd8-4740-866f-be786f2e571b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:20.236527 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-5c81c5b0-4ec0-429f-b8b0-a70c3c97a81b req-35621402-629f-4637-91be-addd5cdf2f21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58fa156b-43cc-4633-b7bd-6ed9cc2bd220", "name": "network-vif-plugged", "status": "completed", "tag": "84f2f14b-3637-41cb-ad13-2d25a69e7b91"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:20.253371 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-5c81c5b0-4ec0-429f-b8b0-a70c3c97a81b req-35621402-629f-4637-91be-addd5cdf2f21 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:20.257244 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-5c81c5b0-4ec0-429f-b8b0-a70c3c97a81b req-35621402-629f-4637-91be-addd5cdf2f21 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:20.296313 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-5c81c5b0-4ec0-429f-b8b0-a70c3c97a81b req-35621402-629f-4637-91be-addd5cdf2f21 service nova] Creating event network-vif-plugged:84f2f14b-3637-41cb-ad13-2d25a69e7b91 for instance 58fa156b-43cc-4633-b7bd-6ed9cc2bd220 on n-h2-846435-14 Jul 25 14:29:20.313925 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-5c81c5b0-4ec0-429f-b8b0-a70c3c97a81b req-35621402-629f-4637-91be-addd5cdf2f21 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082933 Jul 25 14:29:20.316933 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 634/1205] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:29:20.476773 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-70b59cff-3fd8-4740-866f-be786f2e571b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:20.476954 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-55b1761a-eeb4-433d-a9f0-4bfb4883dad7 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:20.479206 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-55b1761a-eeb4-433d-a9f0-4bfb4883dad7 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 58fa156b-43cc-4633-b7bd-6ed9cc2bd220] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:20.491558 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-70b59cff-3fd8-4740-866f-be786f2e571b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1528 microversion: 2.1 time: 0.469434 Jul 25 14:29:20.493177 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 572/1206] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:20 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1528 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:20.501470 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55b1761a-eeb4-433d-a9f0-4bfb4883dad7 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:20.501917 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55b1761a-eeb4-433d-a9f0-4bfb4883dad7 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:20.502691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55b1761a-eeb4-433d-a9f0-4bfb4883dad7 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:20.503120 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55b1761a-eeb4-433d-a9f0-4bfb4883dad7 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:20.519433 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-ebec1e9c-f721-4828-9007-ce37171946e7 req-66615fdf-b89a-4527-9b53-6c5fccc3e51a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33a6128a-580f-4184-ba11-6511d5021242", "tag": "66751fc0-fec5-4bc6-859a-9a0368452b30"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:20.541874 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ebec1e9c-f721-4828-9007-ce37171946e7 req-66615fdf-b89a-4527-9b53-6c5fccc3e51a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:20.543370 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ebec1e9c-f721-4828-9007-ce37171946e7 req-66615fdf-b89a-4527-9b53-6c5fccc3e51a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:20.560206 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-ebec1e9c-f721-4828-9007-ce37171946e7 req-66615fdf-b89a-4527-9b53-6c5fccc3e51a service nova] Creating event network-changed:66751fc0-fec5-4bc6-859a-9a0368452b30 for instance 33a6128a-580f-4184-ba11-6511d5021242 on n-h1-846435-14 Jul 25 14:29:20.565711 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-ebec1e9c-f721-4828-9007-ce37171946e7 req-66615fdf-b89a-4527-9b53-6c5fccc3e51a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070902 Jul 25 14:29:20.566769 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 573/1207] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:20.573270 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-76d8e27a-ea46-456a-b9ee-28a01a96b13f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:20.573986 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-76d8e27a-ea46-456a-b9ee-28a01a96b13f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:20.582663 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-76d8e27a-ea46-456a-b9ee-28a01a96b13f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:20.583367 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-76d8e27a-ea46-456a-b9ee-28a01a96b13f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:20.584367 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-76d8e27a-ea46-456a-b9ee-28a01a96b13f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:20.585642 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-76d8e27a-ea46-456a-b9ee-28a01a96b13f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:20.589439 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:29:20.911037 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-76d8e27a-ea46-456a-b9ee-28a01a96b13f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:20.923801 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-76d8e27a-ea46-456a-b9ee-28a01a96b13f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1528 microversion: 2.1 time: 0.355032 Jul 25 14:29:20.926838 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 574/1208] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:20 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1528 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:20.933472 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-faba0807-512f-4a0e-ada5-234bb601ad4d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:20.934997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-faba0807-512f-4a0e-ada5-234bb601ad4d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:20.951690 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-faba0807-512f-4a0e-ada5-234bb601ad4d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:20.953801 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-faba0807-512f-4a0e-ada5-234bb601ad4d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:20.954819 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-faba0807-512f-4a0e-ada5-234bb601ad4d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:20.955420 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-faba0807-512f-4a0e-ada5-234bb601ad4d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:21.308438 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-55b1761a-eeb4-433d-a9f0-4bfb4883dad7 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774744dcf62f4ef78b4a2c8dfc96f9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ca1e9beedc4892861051504a5dff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:21.316251 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-55b1761a-eeb4-433d-a9f0-4bfb4883dad7 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "GET /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220" status: 200 len: 1322 microversion: 2.1 time: 0.845474 Jul 25 14:29:21.316842 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 635/1209] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:20 2022] GET /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220 => generated 1322 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:21.331769 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f6da58b5-95bd-4ffb-899e-484146c04312 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:21.332962 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:29:21.332962 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:29:21.365753 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f6da58b5-95bd-4ffb-899e-484146c04312 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/86f65049-f3d8-4372-9978-5846778c91ed" status: 202 len: 0 microversion: 2.1 time: 0.041717 Jul 25 14:29:21.367392 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 636/1210] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:29:21 2022] DELETE /compute/v2.1/flavors/86f65049-f3d8-4372-9978-5846778c91ed => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:29:21.372914 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c03188c3-75f2-4890-8ce8-073ed0b99466 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:21.373824 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c03188c3-75f2-4890-8ce8-073ed0b99466 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:21.393366 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c03188c3-75f2-4890-8ce8-073ed0b99466 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:21.394451 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c03188c3-75f2-4890-8ce8-073ed0b99466 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:21.396495 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c03188c3-75f2-4890-8ce8-073ed0b99466 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:21.397112 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c03188c3-75f2-4890-8ce8-073ed0b99466 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:21.608194 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-faba0807-512f-4a0e-ada5-234bb601ad4d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:21.665832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-faba0807-512f-4a0e-ada5-234bb601ad4d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:21.675530 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-faba0807-512f-4a0e-ada5-234bb601ad4d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:21.680804 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-faba0807-512f-4a0e-ada5-234bb601ad4d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 200 len: 1543 microversion: 2.25 time: 0.748769 Jul 25 14:29:21.685690 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 575/1211] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:20 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 1543 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:21.702085 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e0daf83b-d891-461b-8781-5e455223ec4e tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:21.704220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e0daf83b-d891-461b-8781-5e455223ec4e tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:21.712670 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e0daf83b-d891-461b-8781-5e455223ec4e tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:21.713920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e0daf83b-d891-461b-8781-5e455223ec4e tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:21.714921 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e0daf83b-d891-461b-8781-5e455223ec4e tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:21.715518 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e0daf83b-d891-461b-8781-5e455223ec4e tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:21.803049 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c03188c3-75f2-4890-8ce8-073ed0b99466 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:21.820427 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c03188c3-75f2-4890-8ce8-073ed0b99466 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:21.822395 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c03188c3-75f2-4890-8ce8-073ed0b99466 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:21.824264 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c03188c3-75f2-4890-8ce8-073ed0b99466 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1874 microversion: 2.42 time: 0.455316 Jul 25 14:29:21.825450 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 637/1212] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:21 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1874 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:21.840373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f3fdc501-6c53-4e41-836c-040ebe9b52cd tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:21.882038 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-e0daf83b-d891-461b-8781-5e455223ec4e tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lazy-loading 'services' on Instance uuid 95594c88-b538-470e-be2b-c38b7c2c88c1 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:29:21.883821 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f3fdc501-6c53-4e41-836c-040ebe9b52cd tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053002 Jul 25 14:29:21.884684 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 638/1213] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:29:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:21.905249 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-52408397-e12b-4b09-912e-a1d1741427f9 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Calling method '.version_select at 0x7f468740a820>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:21.917566 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52408397-e12b-4b09-912e-a1d1741427f9 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:21.920923 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52408397-e12b-4b09-912e-a1d1741427f9 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:21.941477 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e0daf83b-d891-461b-8781-5e455223ec4e tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1931 microversion: 2.75 time: 0.254378 Jul 25 14:29:21.943493 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 576/1214] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:21 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1931 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:21.957647 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-52408397-e12b-4b09-912e-a1d1741427f9 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] 10.222.0.88 "GET /compute/v2.1/os-migrations" status: 200 len: 1717 microversion: 2.25 time: 0.068372 Jul 25 14:29:21.965823 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 639/1215] 10.222.0.88 () {60 vars in 1184 bytes} [Mon Jul 25 14:29:21 2022] GET /compute/v2.1/os-migrations => generated 1717 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:21.968498 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-89c70e1e-f32b-4e67-9355-f47b95cac58a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:21.972868 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-89c70e1e-f32b-4e67-9355-f47b95cac58a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:21.975262 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e3dd92d6-a0c5-43b1-b72f-f7617d95c304 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:21.976241 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e3dd92d6-a0c5-43b1-b72f-f7617d95c304 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:21.982118 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89c70e1e-f32b-4e67-9355-f47b95cac58a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:21.982851 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89c70e1e-f32b-4e67-9355-f47b95cac58a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:21.984521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89c70e1e-f32b-4e67-9355-f47b95cac58a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:21.985123 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3dd92d6-a0c5-43b1-b72f-f7617d95c304 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:21.985660 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89c70e1e-f32b-4e67-9355-f47b95cac58a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:21.985780 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3dd92d6-a0c5-43b1-b72f-f7617d95c304 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:21.986748 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3dd92d6-a0c5-43b1-b72f-f7617d95c304 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:21.987406 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3dd92d6-a0c5-43b1-b72f-f7617d95c304 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:22.024695 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-89c70e1e-f32b-4e67-9355-f47b95cac58a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:22.034076 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-89c70e1e-f32b-4e67-9355-f47b95cac58a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Old instance type tempest-test_resize_flavor_-1430368077, new instance type m1.heat {{(pid=119303) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 14:29:22.046164 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-89c70e1e-f32b-4e67-9355-f47b95cac58a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:29:22.046908 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-89c70e1e-f32b-4e67-9355-f47b95cac58a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:29:22.047726 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-89c70e1e-f32b-4e67-9355-f47b95cac58a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:29:22.048396 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-89c70e1e-f32b-4e67-9355-f47b95cac58a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:29:22.049116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-89c70e1e-f32b-4e67-9355-f47b95cac58a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:29:22.163277 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-89c70e1e-f32b-4e67-9355-f47b95cac58a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "POST /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03/action" status: 202 len: 0 microversion: 2.1 time: 0.209065 Jul 25 14:29:22.172134 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 577/1216] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:29:21 2022] POST /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:29:22.187020 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-087b037c-8541-47e2-9adc-269f95ab1ecc tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:22.192943 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-087b037c-8541-47e2-9adc-269f95ab1ecc tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:22.204885 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-087b037c-8541-47e2-9adc-269f95ab1ecc tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:22.205617 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-087b037c-8541-47e2-9adc-269f95ab1ecc tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:22.206622 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-087b037c-8541-47e2-9adc-269f95ab1ecc tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:22.218407 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-087b037c-8541-47e2-9adc-269f95ab1ecc tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:22.542931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-087b037c-8541-47e2-9adc-269f95ab1ecc tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:22.565496 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-087b037c-8541-47e2-9adc-269f95ab1ecc tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1537 microversion: 2.1 time: 0.390970 Jul 25 14:29:22.566239 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 578/1217] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:22 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1537 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:22.571262 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-80e1e3f0-5f34-4777-a146-993af3195a15 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:22.576972 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-80e1e3f0-5f34-4777-a146-993af3195a15 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 58fa156b-43cc-4633-b7bd-6ed9cc2bd220] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:22.587474 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-80e1e3f0-5f34-4777-a146-993af3195a15 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:22.587929 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-80e1e3f0-5f34-4777-a146-993af3195a15 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:22.590514 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-80e1e3f0-5f34-4777-a146-993af3195a15 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:22.591147 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-80e1e3f0-5f34-4777-a146-993af3195a15 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:22.789779 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-80e1e3f0-5f34-4777-a146-993af3195a15 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774744dcf62f4ef78b4a2c8dfc96f9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ca1e9beedc4892861051504a5dff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:22.798694 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-e3dd92d6-a0c5-43b1-b72f-f7617d95c304 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lazy-loading 'services' on Instance uuid c9982c70-c715-4959-b9a9-fee30117751b {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:29:22.804194 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-80e1e3f0-5f34-4777-a146-993af3195a15 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "GET /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220" status: 200 len: 1518 microversion: 2.1 time: 0.236620 Jul 25 14:29:22.805711 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 579/1218] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:22 2022] GET /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220 => generated 1518 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:22.815723 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e3dd92d6-a0c5-43b1-b72f-f7617d95c304 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 200 len: 2038 microversion: 2.25 time: 0.844980 Jul 25 14:29:22.833117 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 640/1219] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:21 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 2038 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:29:22.844839 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-ac1deece-4c71-41a0-8bf8-966c480368d0 req-bd6d159b-431c-459f-9f16-d35dbce319d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33a6128a-580f-4184-ba11-6511d5021242", "tag": "a5ecb61b-38f2-4d26-8fa4-777375045f83"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:22.871397 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ac1deece-4c71-41a0-8bf8-966c480368d0 req-bd6d159b-431c-459f-9f16-d35dbce319d3 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:22.873871 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ac1deece-4c71-41a0-8bf8-966c480368d0 req-bd6d159b-431c-459f-9f16-d35dbce319d3 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:22.891810 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-ac1deece-4c71-41a0-8bf8-966c480368d0 req-bd6d159b-431c-459f-9f16-d35dbce319d3 service nova] Creating event network-changed:a5ecb61b-38f2-4d26-8fa4-777375045f83 for instance 33a6128a-580f-4184-ba11-6511d5021242 on n-h1-846435-14 Jul 25 14:29:22.896998 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-ac1deece-4c71-41a0-8bf8-966c480368d0 req-bd6d159b-431c-459f-9f16-d35dbce319d3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062385 Jul 25 14:29:22.898488 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 641/1220] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:22.905505 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1ac61309-4c06-452a-82cc-cde8abbbbbaa tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Action: 'action', calling method: .version_select at 0x7f4696cb3940>, body: {"addFloatingIp": {"address": "172.25.5.249"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:22.909240 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1ac61309-4c06-452a-82cc-cde8abbbbbaa tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 1c6f6d12-3660-40ec-bf99-d735fa9d0358] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:22.916310 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1ac61309-4c06-452a-82cc-cde8abbbbbaa tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:22.917293 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1ac61309-4c06-452a-82cc-cde8abbbbbaa tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:22.918297 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1ac61309-4c06-452a-82cc-cde8abbbbbaa tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:22.918882 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1ac61309-4c06-452a-82cc-cde8abbbbbaa tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:22.997136 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1ac61309-4c06-452a-82cc-cde8abbbbbaa tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Acquired lock "refresh_cache-1c6f6d12-3660-40ec-bf99-d735fa9d0358" {{(pid=119304) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 14:29:23.001506 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0e2d05de-f172-42d8-8dfc-f7c53a24dfd6 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-303588375", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "2e368455-5d90-4a10-bf11-77a659392581"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:23.068010 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-0e2d05de-f172-42d8-8dfc-f7c53a24dfd6 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] validate_networks() for [('2e368455-5d90-4a10-bf11-77a659392581', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:29:23.600445 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-0e2d05de-f172-42d8-8dfc-f7c53a24dfd6 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:29:23.600870 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-0e2d05de-f172-42d8-8dfc-f7c53a24dfd6 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:29:23.601347 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-0e2d05de-f172-42d8-8dfc-f7c53a24dfd6 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:29:23.601756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-0e2d05de-f172-42d8-8dfc-f7c53a24dfd6 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:29:23.602215 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-0e2d05de-f172-42d8-8dfc-f7c53a24dfd6 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:29:23.625875 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e2d05de-f172-42d8-8dfc-f7c53a24dfd6 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:23.627091 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e2d05de-f172-42d8-8dfc-f7c53a24dfd6 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:23.628685 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e2d05de-f172-42d8-8dfc-f7c53a24dfd6 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:23.630441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e2d05de-f172-42d8-8dfc-f7c53a24dfd6 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:23.687865 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-0e2d05de-f172-42d8-8dfc-f7c53a24dfd6 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Getting quotas for project ad625845a6ea4b87b22bee984224c130. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:29:23.705250 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-0e2d05de-f172-42d8-8dfc-f7c53a24dfd6 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Getting quotas for user 88d2a80eed224b4a807463f558bfa37b and project ad625845a6ea4b87b22bee984224c130. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:29:23.747026 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0e2d05de-f172-42d8-8dfc-f7c53a24dfd6 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:29:23.751370 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0e2d05de-f172-42d8-8dfc-f7c53a24dfd6 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] [instance: 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:29:23.815312 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0e2d05de-f172-42d8-8dfc-f7c53a24dfd6 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.008271 Jul 25 14:29:23.816689 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 580/1221] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:29:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:29:23.821611 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0fee93ec-fe20-4d4b-ac26-862465bd1f07 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:23.822689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0fee93ec-fe20-4d4b-ac26-862465bd1f07 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:23.831365 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0fee93ec-fe20-4d4b-ac26-862465bd1f07 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:23.832350 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0fee93ec-fe20-4d4b-ac26-862465bd1f07 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:23.833478 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0fee93ec-fe20-4d4b-ac26-862465bd1f07 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:23.834577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0fee93ec-fe20-4d4b-ac26-862465bd1f07 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:24.169593 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0fee93ec-fe20-4d4b-ac26-862465bd1f07 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:24.180344 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0fee93ec-fe20-4d4b-ac26-862465bd1f07 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:24.183034 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0fee93ec-fe20-4d4b-ac26-862465bd1f07 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:24.184320 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0fee93ec-fe20-4d4b-ac26-862465bd1f07 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1874 microversion: 2.42 time: 0.366457 Jul 25 14:29:24.185448 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 581/1222] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:23 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1874 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:24.190568 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a9c54eab-8e04-4fea-9876-0eef5353847a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Action: 'create', calling method: .version_select at 0x7f46873b73a0>, body: {"keypair": {"name": "tempest-keypair-1860089630", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzqQnEt5CHdPUpQZi7fJVskxgL483VSHznaJ0U6phUVUHAwxHIKVv/U8Y1TZ+sskF7O2t0yprubJ+mC1YmwWX7/yMbfahClEikcKf6+jl6FThKKcc0TYHXyUQ2F9smW5Q=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:24.208156 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-a9c54eab-8e04-4fea-9876-0eef5353847a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Getting quotas for project fb2b9ba0bede403bafb665d5e0818dfb. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:29:24.214327 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-a9c54eab-8e04-4fea-9876-0eef5353847a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Getting quotas for user 94b57069a56c4fedb1d4546c1d0415c7 and project fb2b9ba0bede403bafb665d5e0818dfb. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:29:24.236850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:29:24.257915 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a9c54eab-8e04-4fea-9876-0eef5353847a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.064600 Jul 25 14:29:24.266574 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 582/1223] 10.222.0.88 () {62 vars in 1200 bytes} [Mon Jul 25 14:29:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 74 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 14:29:24.290391 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d3ea02ec-59c5-451f-bb12-2597895b5d8b tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:24.291108 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d3ea02ec-59c5-451f-bb12-2597895b5d8b tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:24.316249 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d3ea02ec-59c5-451f-bb12-2597895b5d8b tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:24.321271 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d3ea02ec-59c5-451f-bb12-2597895b5d8b tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:24.325364 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d3ea02ec-59c5-451f-bb12-2597895b5d8b tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:24.327176 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d3ea02ec-59c5-451f-bb12-2597895b5d8b tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:24.654493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-d3ea02ec-59c5-451f-bb12-2597895b5d8b tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lazy-loading 'services' on Instance uuid 95594c88-b538-470e-be2b-c38b7c2c88c1 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:29:24.679351 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d3ea02ec-59c5-451f-bb12-2597895b5d8b tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1931 microversion: 2.75 time: 0.415976 Jul 25 14:29:24.679951 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 583/1224] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:24 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1931 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:24.687481 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d69ea97a-b653-494b-b7ed-3931f1c9b867 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:24.688178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d69ea97a-b653-494b-b7ed-3931f1c9b867 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:24.695441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d69ea97a-b653-494b-b7ed-3931f1c9b867 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:24.696219 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d69ea97a-b653-494b-b7ed-3931f1c9b867 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:24.697163 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d69ea97a-b653-494b-b7ed-3931f1c9b867 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:24.697609 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d69ea97a-b653-494b-b7ed-3931f1c9b867 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:25.141280 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d69ea97a-b653-494b-b7ed-3931f1c9b867 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:25.156940 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d69ea97a-b653-494b-b7ed-3931f1c9b867 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1537 microversion: 2.1 time: 0.475817 Jul 25 14:29:25.157546 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 584/1225] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:24 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1537 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:25.162364 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-86e87ac8-1a10-4cd6-9c2f-59a73b6803a5 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:25.165151 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-86e87ac8-1a10-4cd6-9c2f-59a73b6803a5 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] [instance: 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:25.179703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-86e87ac8-1a10-4cd6-9c2f-59a73b6803a5 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:25.180318 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-86e87ac8-1a10-4cd6-9c2f-59a73b6803a5 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:25.184453 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-86e87ac8-1a10-4cd6-9c2f-59a73b6803a5 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:25.185129 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-86e87ac8-1a10-4cd6-9c2f-59a73b6803a5 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:25.354550 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-86e87ac8-1a10-4cd6-9c2f-59a73b6803a5 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2a80eed224b4a807463f558bfa37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad625845a6ea4b87b22bee984224c130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:25.367673 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-86e87ac8-1a10-4cd6-9c2f-59a73b6803a5 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] 10.222.0.88 "GET /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff" status: 200 len: 1283 microversion: 2.1 time: 0.208732 Jul 25 14:29:25.373820 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 585/1226] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:25 2022] GET /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff => generated 1283 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:25.384147 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c504efe1-9d62-4d84-8e37-dc19dca0c2f3 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:25.406205 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c504efe1-9d62-4d84-8e37-dc19dca0c2f3 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:25.420059 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c504efe1-9d62-4d84-8e37-dc19dca0c2f3 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:25.422305 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c504efe1-9d62-4d84-8e37-dc19dca0c2f3 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:25.426363 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c504efe1-9d62-4d84-8e37-dc19dca0c2f3 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:25.427016 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c504efe1-9d62-4d84-8e37-dc19dca0c2f3 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:26.575303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c504efe1-9d62-4d84-8e37-dc19dca0c2f3 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:26.588086 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c504efe1-9d62-4d84-8e37-dc19dca0c2f3 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:26.590008 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c504efe1-9d62-4d84-8e37-dc19dca0c2f3 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:26.591701 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c504efe1-9d62-4d84-8e37-dc19dca0c2f3 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1874 microversion: 2.42 time: 1.216415 Jul 25 14:29:26.609530 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 586/1227] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:25 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1874 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:26.617858 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-35874fbc-6511-49d7-a887-7f1eea2d0f3b tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:26.619037 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-35874fbc-6511-49d7-a887-7f1eea2d0f3b tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:26.627175 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-35874fbc-6511-49d7-a887-7f1eea2d0f3b tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:26.628177 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-35874fbc-6511-49d7-a887-7f1eea2d0f3b tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:26.629190 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-35874fbc-6511-49d7-a887-7f1eea2d0f3b tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:26.629892 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-35874fbc-6511-49d7-a887-7f1eea2d0f3b tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:26.787489 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-35874fbc-6511-49d7-a887-7f1eea2d0f3b tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lazy-loading 'services' on Instance uuid 95594c88-b538-470e-be2b-c38b7c2c88c1 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:29:26.815623 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-35874fbc-6511-49d7-a887-7f1eea2d0f3b tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1931 microversion: 2.75 time: 0.204754 Jul 25 14:29:26.816466 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 587/1228] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:26 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1931 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:26.823018 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bea60e54-a3d0-4433-9c35-74a910e1cd73 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:26.824328 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bea60e54-a3d0-4433-9c35-74a910e1cd73 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:26.831915 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bea60e54-a3d0-4433-9c35-74a910e1cd73 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:26.832718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bea60e54-a3d0-4433-9c35-74a910e1cd73 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:26.833923 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bea60e54-a3d0-4433-9c35-74a910e1cd73 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:26.835186 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bea60e54-a3d0-4433-9c35-74a910e1cd73 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:27.130565 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bea60e54-a3d0-4433-9c35-74a910e1cd73 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:27.141371 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bea60e54-a3d0-4433-9c35-74a910e1cd73 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1542 microversion: 2.1 time: 0.323248 Jul 25 14:29:27.142468 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 588/1229] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:26 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1542 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:27.148150 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ead98571-2bf6-46b5-85d5-e6b6650380fd tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:27.148772 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ead98571-2bf6-46b5-85d5-e6b6650380fd tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] [instance: 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:27.155312 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ead98571-2bf6-46b5-85d5-e6b6650380fd tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:27.155778 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ead98571-2bf6-46b5-85d5-e6b6650380fd tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:27.157081 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ead98571-2bf6-46b5-85d5-e6b6650380fd tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:27.157461 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ead98571-2bf6-46b5-85d5-e6b6650380fd tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:27.281951 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ead98571-2bf6-46b5-85d5-e6b6650380fd tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2a80eed224b4a807463f558bfa37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad625845a6ea4b87b22bee984224c130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:27.291084 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ead98571-2bf6-46b5-85d5-e6b6650380fd tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] 10.222.0.88 "GET /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff" status: 200 len: 1289 microversion: 2.1 time: 0.147492 Jul 25 14:29:27.292814 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 589/1230] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:27 2022] GET /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff => generated 1289 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:27.618410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-909ce5e8-3585-403b-9290-6ae674b0fc9f tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:27.619047 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-909ce5e8-3585-403b-9290-6ae674b0fc9f tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:27.635692 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-909ce5e8-3585-403b-9290-6ae674b0fc9f tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:27.636176 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-909ce5e8-3585-403b-9290-6ae674b0fc9f tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:27.636964 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-909ce5e8-3585-403b-9290-6ae674b0fc9f tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:27.637406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-909ce5e8-3585-403b-9290-6ae674b0fc9f tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:27.641956 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:29:28.046643 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-909ce5e8-3585-403b-9290-6ae674b0fc9f tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:28.069925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-909ce5e8-3585-403b-9290-6ae674b0fc9f tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:28.071473 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-909ce5e8-3585-403b-9290-6ae674b0fc9f tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:28.077184 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-909ce5e8-3585-403b-9290-6ae674b0fc9f tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1874 microversion: 2.42 time: 0.462702 Jul 25 14:29:28.082882 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 590/1231] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:27 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1874 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:29:28.100485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fcd8390c-7c4f-4738-832e-8f93d59b08d3 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:28.101384 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fcd8390c-7c4f-4738-832e-8f93d59b08d3 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:28.117579 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fcd8390c-7c4f-4738-832e-8f93d59b08d3 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:28.118278 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fcd8390c-7c4f-4738-832e-8f93d59b08d3 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:28.120887 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fcd8390c-7c4f-4738-832e-8f93d59b08d3 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:28.121490 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fcd8390c-7c4f-4738-832e-8f93d59b08d3 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:28.301903 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-fcd8390c-7c4f-4738-832e-8f93d59b08d3 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lazy-loading 'services' on Instance uuid 95594c88-b538-470e-be2b-c38b7c2c88c1 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:29:28.342035 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fcd8390c-7c4f-4738-832e-8f93d59b08d3 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1931 microversion: 2.75 time: 0.256802 Jul 25 14:29:28.343174 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 591/1232] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:28 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1931 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:28.371729 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6980d5c1-407b-43b1-be71-01f9a5ca79c6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:28.376815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6980d5c1-407b-43b1-be71-01f9a5ca79c6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:28.387607 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6980d5c1-407b-43b1-be71-01f9a5ca79c6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:28.389513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6980d5c1-407b-43b1-be71-01f9a5ca79c6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:28.390741 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6980d5c1-407b-43b1-be71-01f9a5ca79c6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:28.391614 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6980d5c1-407b-43b1-be71-01f9a5ca79c6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:28.497087 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-1ac61309-4c06-452a-82cc-cde8abbbbbaa tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 1c6f6d12-3660-40ec-bf99-d735fa9d0358] Building network info cache for instance {{(pid=119304) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 14:29:28.992962 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6980d5c1-407b-43b1-be71-01f9a5ca79c6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:29.017948 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6980d5c1-407b-43b1-be71-01f9a5ca79c6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1542 microversion: 2.1 time: 0.663316 Jul 25 14:29:29.018961 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 592/1233] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:28 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1542 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:29.025566 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b410ab4c-262f-455e-8573-8243eef7540d tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:29.027186 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b410ab4c-262f-455e-8573-8243eef7540d tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] [instance: 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:29.037790 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b410ab4c-262f-455e-8573-8243eef7540d tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:29.038553 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b410ab4c-262f-455e-8573-8243eef7540d tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:29.040402 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b410ab4c-262f-455e-8573-8243eef7540d tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:29.042509 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b410ab4c-262f-455e-8573-8243eef7540d tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:29.467165 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b410ab4c-262f-455e-8573-8243eef7540d tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2a80eed224b4a807463f558bfa37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad625845a6ea4b87b22bee984224c130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:29.480272 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b410ab4c-262f-455e-8573-8243eef7540d tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] 10.222.0.88 "GET /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff" status: 200 len: 1331 microversion: 2.1 time: 0.457889 Jul 25 14:29:29.482862 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 593/1234] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:29 2022] GET /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff => generated 1331 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:29.496528 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-348896d8-fbf9-4ede-b9a5-712e6de73e38 req-43447844-fd13-479f-9609-1128ec3c49f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c6f6d12-3660-40ec-bf99-d735fa9d0358", "tag": "fb6f83eb-2e87-4f51-aa28-9bf153938de2"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:29.538993 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-348896d8-fbf9-4ede-b9a5-712e6de73e38 req-43447844-fd13-479f-9609-1128ec3c49f2 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:29.540109 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-348896d8-fbf9-4ede-b9a5-712e6de73e38 req-43447844-fd13-479f-9609-1128ec3c49f2 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:29.588590 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-348896d8-fbf9-4ede-b9a5-712e6de73e38 req-43447844-fd13-479f-9609-1128ec3c49f2 service nova] Creating event network-changed:fb6f83eb-2e87-4f51-aa28-9bf153938de2 for instance 1c6f6d12-3660-40ec-bf99-d735fa9d0358 on n-h2-846435-14 Jul 25 14:29:29.619986 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-348896d8-fbf9-4ede-b9a5-712e6de73e38 req-43447844-fd13-479f-9609-1128ec3c49f2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122462 Jul 25 14:29:29.626515 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 594/1235] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:29.654173 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-295316c8-2f0f-4fe7-828d-455385f5a7de tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:29.655881 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-295316c8-2f0f-4fe7-828d-455385f5a7de tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:29.686870 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-295316c8-2f0f-4fe7-828d-455385f5a7de tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:29.692912 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-295316c8-2f0f-4fe7-828d-455385f5a7de tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:29.699026 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-295316c8-2f0f-4fe7-828d-455385f5a7de tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:29.700459 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-295316c8-2f0f-4fe7-828d-455385f5a7de tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:30.359695 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-295316c8-2f0f-4fe7-828d-455385f5a7de tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:30.380478 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-295316c8-2f0f-4fe7-828d-455385f5a7de tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:30.386992 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-295316c8-2f0f-4fe7-828d-455385f5a7de tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:30.390425 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-295316c8-2f0f-4fe7-828d-455385f5a7de tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1874 microversion: 2.42 time: 0.754190 Jul 25 14:29:30.393030 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 595/1236] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:29 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1874 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:30.400695 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-14a907f5-0e41-4401-9b12-35624843bfca tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:30.401705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-14a907f5-0e41-4401-9b12-35624843bfca tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:30.411165 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14a907f5-0e41-4401-9b12-35624843bfca tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:30.411939 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14a907f5-0e41-4401-9b12-35624843bfca tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:30.413601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14a907f5-0e41-4401-9b12-35624843bfca tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:30.414250 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14a907f5-0e41-4401-9b12-35624843bfca tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:30.574823 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-14a907f5-0e41-4401-9b12-35624843bfca tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lazy-loading 'services' on Instance uuid 95594c88-b538-470e-be2b-c38b7c2c88c1 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:29:30.594484 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-14a907f5-0e41-4401-9b12-35624843bfca tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1931 microversion: 2.75 time: 0.200078 Jul 25 14:29:30.595776 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 596/1237] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:30 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1931 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:30.600779 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-f92f1535-d7dd-4e59-bb86-57ff64a7a1c9 req-cef719be-3712-40dd-a669-1b7de466203e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff", "tag": "c9d23981-0c41-4d35-a06a-5e586993cfe1"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:30.611075 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f92f1535-d7dd-4e59-bb86-57ff64a7a1c9 req-cef719be-3712-40dd-a669-1b7de466203e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:30.611851 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f92f1535-d7dd-4e59-bb86-57ff64a7a1c9 req-cef719be-3712-40dd-a669-1b7de466203e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:30.624274 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-f92f1535-d7dd-4e59-bb86-57ff64a7a1c9 req-cef719be-3712-40dd-a669-1b7de466203e service nova] Creating event network-changed:c9d23981-0c41-4d35-a06a-5e586993cfe1 for instance 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff on n-h1-846435-14 Jul 25 14:29:30.630801 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-f92f1535-d7dd-4e59-bb86-57ff64a7a1c9 req-cef719be-3712-40dd-a669-1b7de466203e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033396 Jul 25 14:29:30.631914 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 597/1238] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:30.638709 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3e331138-c0c9-4fda-a948-b388897d8303 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-203608194", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "89585d8f-fb83-418b-9add-e96b30bdd24c"}], "security_groups": [{"name": "tempest-securitygroup--1541609818"}], "key_name": "tempest-keypair-1860089630", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:30.889851 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-3e331138-c0c9-4fda-a948-b388897d8303 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] validate_networks() for [('89585d8f-fb83-418b-9add-e96b30bdd24c', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:29:31.140077 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-1ac61309-4c06-452a-82cc-cde8abbbbbaa tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 1c6f6d12-3660-40ec-bf99-d735fa9d0358] Updating instance_info_cache with network_info: [{"id": "fb6f83eb-2e87-4f51-aa28-9bf153938de2", "address": "fa:16:3e:e5:ec:22", "network": {"id": "8b75699c-1ef5-4c51-95ba-7d4e798771fe", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1225325178-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f1ca1e9beedc4892861051504a5dff08", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapfb6f83eb-2e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119304) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 14:29:31.149407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1ac61309-4c06-452a-82cc-cde8abbbbbaa tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Releasing lock "refresh_cache-1c6f6d12-3660-40ec-bf99-d735fa9d0358" {{(pid=119304) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 14:29:31.150352 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1ac61309-4c06-452a-82cc-cde8abbbbbaa tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "POST /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358/action" status: 202 len: 0 microversion: 2.1 time: 8.250629 Jul 25 14:29:31.151375 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 642/1239] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:29:22 2022] POST /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358/action => generated 0 bytes in 8252 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 14:29:31.157186 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5b1f33e6-e7b2-4e81-b6b9-252c99cd1225 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:31.157982 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5b1f33e6-e7b2-4e81-b6b9-252c99cd1225 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:31.164697 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b1f33e6-e7b2-4e81-b6b9-252c99cd1225 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:31.165360 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b1f33e6-e7b2-4e81-b6b9-252c99cd1225 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:31.167766 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b1f33e6-e7b2-4e81-b6b9-252c99cd1225 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:31.168728 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b1f33e6-e7b2-4e81-b6b9-252c99cd1225 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:31.350809 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-3e331138-c0c9-4fda-a948-b388897d8303 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:29:31.351753 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-3e331138-c0c9-4fda-a948-b388897d8303 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:29:31.352260 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-3e331138-c0c9-4fda-a948-b388897d8303 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:29:31.352677 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-3e331138-c0c9-4fda-a948-b388897d8303 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:29:31.353097 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-3e331138-c0c9-4fda-a948-b388897d8303 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:29:31.363223 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3e331138-c0c9-4fda-a948-b388897d8303 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:31.363872 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3e331138-c0c9-4fda-a948-b388897d8303 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:31.364624 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3e331138-c0c9-4fda-a948-b388897d8303 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:31.365137 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3e331138-c0c9-4fda-a948-b388897d8303 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:31.384698 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-3e331138-c0c9-4fda-a948-b388897d8303 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Getting quotas for project fb2b9ba0bede403bafb665d5e0818dfb. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:29:31.390669 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-3e331138-c0c9-4fda-a948-b388897d8303 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Getting quotas for user 94b57069a56c4fedb1d4546c1d0415c7 and project fb2b9ba0bede403bafb665d5e0818dfb. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:29:31.403935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3e331138-c0c9-4fda-a948-b388897d8303 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:29:31.406539 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3e331138-c0c9-4fda-a948-b388897d8303 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:29:31.456174 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3e331138-c0c9-4fda-a948-b388897d8303 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 0.822690 Jul 25 14:29:31.457266 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 598/1240] 10.222.0.88 () {62 vars in 1188 bytes} [Mon Jul 25 14:29:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 14:29:31.462045 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e172ff9d-3276-433f-9934-c71a5298d5b3 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:31.462888 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e172ff9d-3276-433f-9934-c71a5298d5b3 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] [instance: 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:31.470208 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e172ff9d-3276-433f-9934-c71a5298d5b3 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:31.470838 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e172ff9d-3276-433f-9934-c71a5298d5b3 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:31.471612 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e172ff9d-3276-433f-9934-c71a5298d5b3 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:31.472069 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e172ff9d-3276-433f-9934-c71a5298d5b3 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:31.570505 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5b1f33e6-e7b2-4e81-b6b9-252c99cd1225 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:31.582819 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5b1f33e6-e7b2-4e81-b6b9-252c99cd1225 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1542 microversion: 2.1 time: 0.430101 Jul 25 14:29:31.590829 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 643/1241] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:31 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1542 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:31.602439 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-65121faf-27f1-405a-b01e-5c148c4cc73b tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.249"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:31.610311 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-65121faf-27f1-405a-b01e-5c148c4cc73b tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 58fa156b-43cc-4633-b7bd-6ed9cc2bd220] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:31.628748 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-65121faf-27f1-405a-b01e-5c148c4cc73b tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:31.633106 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-65121faf-27f1-405a-b01e-5c148c4cc73b tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:31.636308 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-65121faf-27f1-405a-b01e-5c148c4cc73b tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:31.636720 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-65121faf-27f1-405a-b01e-5c148c4cc73b tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:31.646261 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e172ff9d-3276-433f-9934-c71a5298d5b3 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2a80eed224b4a807463f558bfa37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad625845a6ea4b87b22bee984224c130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:31.658483 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e172ff9d-3276-433f-9934-c71a5298d5b3 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] 10.222.0.88 "GET /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff" status: 200 len: 1331 microversion: 2.1 time: 0.199955 Jul 25 14:29:31.659685 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 599/1242] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:31 2022] GET /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff => generated 1331 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:31.664572 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f2352518-4c15-445a-94ed-5aa4bd6e71a0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:31.665336 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f2352518-4c15-445a-94ed-5aa4bd6e71a0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:31.681161 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f2352518-4c15-445a-94ed-5aa4bd6e71a0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:31.681964 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f2352518-4c15-445a-94ed-5aa4bd6e71a0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:31.683380 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f2352518-4c15-445a-94ed-5aa4bd6e71a0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:31.684171 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f2352518-4c15-445a-94ed-5aa4bd6e71a0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:31.714535 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-65121faf-27f1-405a-b01e-5c148c4cc73b tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Acquired lock "refresh_cache-58fa156b-43cc-4633-b7bd-6ed9cc2bd220" {{(pid=119304) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 14:29:31.947947 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f2352518-4c15-445a-94ed-5aa4bd6e71a0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:31.963621 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f2352518-4c15-445a-94ed-5aa4bd6e71a0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:31.967015 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f2352518-4c15-445a-94ed-5aa4bd6e71a0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:31.968859 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f2352518-4c15-445a-94ed-5aa4bd6e71a0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1874 microversion: 2.42 time: 0.307992 Jul 25 14:29:31.987704 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 600/1243] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:31 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1874 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:31.994854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8a04a397-8303-46ab-a1c8-adca27676e49 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:31.995664 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8a04a397-8303-46ab-a1c8-adca27676e49 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:32.093745 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8a04a397-8303-46ab-a1c8-adca27676e49 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:32.105475 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8a04a397-8303-46ab-a1c8-adca27676e49 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:32.107930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8a04a397-8303-46ab-a1c8-adca27676e49 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:32.109606 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8a04a397-8303-46ab-a1c8-adca27676e49 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1285 microversion: 2.25 time: 0.120553 Jul 25 14:29:32.111508 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 601/1244] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:31 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:32.118585 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-30a8bd1e-1426-4826-a0db-30a69ab0ab6f tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:32.119762 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-30a8bd1e-1426-4826-a0db-30a69ab0ab6f tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:32.150108 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-30a8bd1e-1426-4826-a0db-30a69ab0ab6f tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:32.153339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-30a8bd1e-1426-4826-a0db-30a69ab0ab6f tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:32.160123 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-30a8bd1e-1426-4826-a0db-30a69ab0ab6f tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:32.162960 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-30a8bd1e-1426-4826-a0db-30a69ab0ab6f tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:32.562900 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-30a8bd1e-1426-4826-a0db-30a69ab0ab6f tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lazy-loading 'services' on Instance uuid 95594c88-b538-470e-be2b-c38b7c2c88c1 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:29:32.600596 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-30a8bd1e-1426-4826-a0db-30a69ab0ab6f tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1931 microversion: 2.75 time: 0.487359 Jul 25 14:29:32.601196 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 602/1245] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:32 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1931 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:32.610638 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7c7aa8b4-8b49-4474-a1bf-480b40e7b226 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:32.611469 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7c7aa8b4-8b49-4474-a1bf-480b40e7b226 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:32.622500 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7c7aa8b4-8b49-4474-a1bf-480b40e7b226 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:32.626370 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7c7aa8b4-8b49-4474-a1bf-480b40e7b226 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:32.627233 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7c7aa8b4-8b49-4474-a1bf-480b40e7b226 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:32.627683 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7c7aa8b4-8b49-4474-a1bf-480b40e7b226 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:33.037783 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7c7aa8b4-8b49-4474-a1bf-480b40e7b226 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:33.055111 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7c7aa8b4-8b49-4474-a1bf-480b40e7b226 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1542 microversion: 2.1 time: 0.448132 Jul 25 14:29:33.068525 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 603/1246] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:32 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1542 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:33.074718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-57bf7fd1-0e82-4750-9cc5-a2a8e53c825b tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:33.075203 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-57bf7fd1-0e82-4750-9cc5-a2a8e53c825b tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] [instance: 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:33.092620 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57bf7fd1-0e82-4750-9cc5-a2a8e53c825b tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:33.092998 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57bf7fd1-0e82-4750-9cc5-a2a8e53c825b tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:33.093822 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57bf7fd1-0e82-4750-9cc5-a2a8e53c825b tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:33.094261 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57bf7fd1-0e82-4750-9cc5-a2a8e53c825b tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:33.491569 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-57bf7fd1-0e82-4750-9cc5-a2a8e53c825b tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2a80eed224b4a807463f558bfa37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad625845a6ea4b87b22bee984224c130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:33.503187 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-57bf7fd1-0e82-4750-9cc5-a2a8e53c825b tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] 10.222.0.88 "GET /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff" status: 200 len: 1331 microversion: 2.1 time: 0.432839 Jul 25 14:29:33.504493 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 604/1247] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:33 2022] GET /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff => generated 1331 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:33.509025 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7b0c7852-cad5-46a9-9f0b-c043ca203b46 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:33.509644 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7b0c7852-cad5-46a9-9f0b-c043ca203b46 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:33.542123 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b0c7852-cad5-46a9-9f0b-c043ca203b46 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:33.542618 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b0c7852-cad5-46a9-9f0b-c043ca203b46 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:33.546533 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b0c7852-cad5-46a9-9f0b-c043ca203b46 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:33.548454 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b0c7852-cad5-46a9-9f0b-c043ca203b46 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:34.038935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7b0c7852-cad5-46a9-9f0b-c043ca203b46 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:34.056798 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7b0c7852-cad5-46a9-9f0b-c043ca203b46 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:34.064621 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7b0c7852-cad5-46a9-9f0b-c043ca203b46 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:34.067124 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7b0c7852-cad5-46a9-9f0b-c043ca203b46 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1874 microversion: 2.42 time: 0.560774 Jul 25 14:29:34.068282 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 605/1248] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:33 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1874 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:34.083224 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dce1a60d-6d8c-44b3-a703-41f5a3929079 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:34.097121 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-dce1a60d-6d8c-44b3-a703-41f5a3929079 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:34.107213 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dce1a60d-6d8c-44b3-a703-41f5a3929079 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:34.108043 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dce1a60d-6d8c-44b3-a703-41f5a3929079 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:34.110349 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dce1a60d-6d8c-44b3-a703-41f5a3929079 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:34.110975 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dce1a60d-6d8c-44b3-a703-41f5a3929079 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:34.210759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-dce1a60d-6d8c-44b3-a703-41f5a3929079 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:34.221951 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-dce1a60d-6d8c-44b3-a703-41f5a3929079 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:34.227503 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-dce1a60d-6d8c-44b3-a703-41f5a3929079 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:34.229716 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dce1a60d-6d8c-44b3-a703-41f5a3929079 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1343 microversion: 2.25 time: 0.159637 Jul 25 14:29:34.231293 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 606/1249] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:34 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1343 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:34.249012 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3ad10235-cb66-4efd-9c4d-6281e7c0c3b7 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:34.250920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3ad10235-cb66-4efd-9c4d-6281e7c0c3b7 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:34.263040 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3ad10235-cb66-4efd-9c4d-6281e7c0c3b7 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:34.263040 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3ad10235-cb66-4efd-9c4d-6281e7c0c3b7 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:34.264231 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3ad10235-cb66-4efd-9c4d-6281e7c0c3b7 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:34.264231 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3ad10235-cb66-4efd-9c4d-6281e7c0c3b7 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:34.384941 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-3ad10235-cb66-4efd-9c4d-6281e7c0c3b7 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lazy-loading 'services' on Instance uuid 95594c88-b538-470e-be2b-c38b7c2c88c1 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:29:34.412530 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3ad10235-cb66-4efd-9c4d-6281e7c0c3b7 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1931 microversion: 2.75 time: 0.179336 Jul 25 14:29:34.413241 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 607/1250] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:34 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1931 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:34.419056 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-480b33ec-838e-4be8-a1ca-748de3b67714 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:34.419821 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-480b33ec-838e-4be8-a1ca-748de3b67714 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:34.426248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-480b33ec-838e-4be8-a1ca-748de3b67714 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:34.426725 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-480b33ec-838e-4be8-a1ca-748de3b67714 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:34.427495 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-480b33ec-838e-4be8-a1ca-748de3b67714 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:34.427926 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-480b33ec-838e-4be8-a1ca-748de3b67714 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:34.465067 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:29:34.714502 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-480b33ec-838e-4be8-a1ca-748de3b67714 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:34.727692 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-480b33ec-838e-4be8-a1ca-748de3b67714 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1542 microversion: 2.1 time: 0.312829 Jul 25 14:29:34.728508 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 608/1251] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:34 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1542 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:34.738568 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f968e039-3e5d-4d12-9259-ab35c5453497 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:34.739235 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f968e039-3e5d-4d12-9259-ab35c5453497 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] [instance: 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:34.755038 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f968e039-3e5d-4d12-9259-ab35c5453497 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:34.755499 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f968e039-3e5d-4d12-9259-ab35c5453497 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:34.759893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f968e039-3e5d-4d12-9259-ab35c5453497 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:34.763048 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f968e039-3e5d-4d12-9259-ab35c5453497 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:35.108370 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f968e039-3e5d-4d12-9259-ab35c5453497 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2a80eed224b4a807463f558bfa37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad625845a6ea4b87b22bee984224c130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:35.120025 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f968e039-3e5d-4d12-9259-ab35c5453497 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] 10.222.0.88 "GET /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff" status: 200 len: 1331 microversion: 2.1 time: 0.390332 Jul 25 14:29:35.121274 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 609/1252] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:34 2022] GET /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff => generated 1331 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:35.146809 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9180ce9c-a8bd-45d3-bc14-e6780ac1eee4 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:35.147438 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9180ce9c-a8bd-45d3-bc14-e6780ac1eee4 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:35.160088 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9180ce9c-a8bd-45d3-bc14-e6780ac1eee4 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:35.162754 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9180ce9c-a8bd-45d3-bc14-e6780ac1eee4 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:35.163936 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9180ce9c-a8bd-45d3-bc14-e6780ac1eee4 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:35.180802 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9180ce9c-a8bd-45d3-bc14-e6780ac1eee4 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:35.768665 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9180ce9c-a8bd-45d3-bc14-e6780ac1eee4 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:35.784201 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9180ce9c-a8bd-45d3-bc14-e6780ac1eee4 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:35.789932 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9180ce9c-a8bd-45d3-bc14-e6780ac1eee4 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:35.792658 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9180ce9c-a8bd-45d3-bc14-e6780ac1eee4 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1874 microversion: 2.42 time: 0.667594 Jul 25 14:29:35.794238 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 610/1253] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:35 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1874 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:35.805651 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f36b3e2e-1ce2-4482-abe4-2ecc357d3336 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:35.806551 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f36b3e2e-1ce2-4482-abe4-2ecc357d3336 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:35.817077 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f36b3e2e-1ce2-4482-abe4-2ecc357d3336 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:35.817435 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f36b3e2e-1ce2-4482-abe4-2ecc357d3336 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:35.818202 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f36b3e2e-1ce2-4482-abe4-2ecc357d3336 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:35.818631 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f36b3e2e-1ce2-4482-abe4-2ecc357d3336 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:36.389481 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f36b3e2e-1ce2-4482-abe4-2ecc357d3336 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:36.405884 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f36b3e2e-1ce2-4482-abe4-2ecc357d3336 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:36.411228 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f36b3e2e-1ce2-4482-abe4-2ecc357d3336 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:36.412680 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f36b3e2e-1ce2-4482-abe4-2ecc357d3336 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1411 microversion: 2.25 time: 0.616715 Jul 25 14:29:36.413419 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 611/1254] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:35 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1411 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:36.446553 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1c0d4d32-3cbf-4677-9783-f9efdc46761d tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:36.451052 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1c0d4d32-3cbf-4677-9783-f9efdc46761d tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:36.464423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1c0d4d32-3cbf-4677-9783-f9efdc46761d tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:36.466200 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1c0d4d32-3cbf-4677-9783-f9efdc46761d tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:36.466910 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1c0d4d32-3cbf-4677-9783-f9efdc46761d tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:36.467354 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1c0d4d32-3cbf-4677-9783-f9efdc46761d tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:36.654352 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-1c0d4d32-3cbf-4677-9783-f9efdc46761d tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lazy-loading 'services' on Instance uuid 95594c88-b538-470e-be2b-c38b7c2c88c1 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:29:36.733724 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1c0d4d32-3cbf-4677-9783-f9efdc46761d tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1937 microversion: 2.75 time: 0.297284 Jul 25 14:29:36.736915 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 612/1255] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:36 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1937 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:36.744146 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3be4920e-3412-4026-99b5-22c4982c7fd3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:36.745726 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3be4920e-3412-4026-99b5-22c4982c7fd3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:36.764393 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3be4920e-3412-4026-99b5-22c4982c7fd3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:36.765259 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3be4920e-3412-4026-99b5-22c4982c7fd3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:36.766811 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3be4920e-3412-4026-99b5-22c4982c7fd3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:36.767863 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3be4920e-3412-4026-99b5-22c4982c7fd3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:37.059552 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3be4920e-3412-4026-99b5-22c4982c7fd3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:37.071288 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3be4920e-3412-4026-99b5-22c4982c7fd3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1542 microversion: 2.1 time: 0.331179 Jul 25 14:29:37.080053 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 613/1256] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:36 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1542 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:37.088016 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-20f38824-c22c-40d7-969b-1826d586f953 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:37.088713 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-20f38824-c22c-40d7-969b-1826d586f953 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] [instance: 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:37.100201 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-20f38824-c22c-40d7-969b-1826d586f953 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:37.104427 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-20f38824-c22c-40d7-969b-1826d586f953 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:37.105441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-20f38824-c22c-40d7-969b-1826d586f953 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:37.110023 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-20f38824-c22c-40d7-969b-1826d586f953 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:37.329321 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-20f38824-c22c-40d7-969b-1826d586f953 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2a80eed224b4a807463f558bfa37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad625845a6ea4b87b22bee984224c130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:37.340351 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-20f38824-c22c-40d7-969b-1826d586f953 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] 10.222.0.88 "GET /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff" status: 200 len: 1331 microversion: 2.1 time: 0.266535 Jul 25 14:29:37.355868 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 614/1257] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:37 2022] GET /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff => generated 1331 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:37.363864 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-270c1e94-cac3-4b99-8cb0-741d9bbd80c9 req-2821820b-0313-4c35-adc4-88a692c656af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff", "name": "network-vif-plugged", "status": "completed", "tag": "c9d23981-0c41-4d35-a06a-5e586993cfe1"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:37.390172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-270c1e94-cac3-4b99-8cb0-741d9bbd80c9 req-2821820b-0313-4c35-adc4-88a692c656af service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:37.391159 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-270c1e94-cac3-4b99-8cb0-741d9bbd80c9 req-2821820b-0313-4c35-adc4-88a692c656af service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:37.405877 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-270c1e94-cac3-4b99-8cb0-741d9bbd80c9 req-2821820b-0313-4c35-adc4-88a692c656af service nova] Creating event network-vif-plugged:c9d23981-0c41-4d35-a06a-5e586993cfe1 for instance 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff on n-h1-846435-14 Jul 25 14:29:37.411735 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-270c1e94-cac3-4b99-8cb0-741d9bbd80c9 req-2821820b-0313-4c35-adc4-88a692c656af service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054293 Jul 25 14:29:37.414998 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 615/1258] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:37.442922 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-8e644c77-9291-4276-8d75-6e730fcfdcf8 req-1c5ef91d-982c-4b6e-ae1c-eff932120fa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c", "tag": "eedb59eb-f3ec-476b-a198-201c579f3456"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:37.485412 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:29:37.488687 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-8e644c77-9291-4276-8d75-6e730fcfdcf8 req-1c5ef91d-982c-4b6e-ae1c-eff932120fa6 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:37.489269 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-8e644c77-9291-4276-8d75-6e730fcfdcf8 req-1c5ef91d-982c-4b6e-ae1c-eff932120fa6 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:37.506690 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-8e644c77-9291-4276-8d75-6e730fcfdcf8 req-1c5ef91d-982c-4b6e-ae1c-eff932120fa6 service nova] Creating event network-changed:eedb59eb-f3ec-476b-a198-201c579f3456 for instance 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c on n-h1-846435-14 Jul 25 14:29:37.514570 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-8e644c77-9291-4276-8d75-6e730fcfdcf8 req-1c5ef91d-982c-4b6e-ae1c-eff932120fa6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098075 Jul 25 14:29:37.515812 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 616/1259] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:37.522918 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5a908984-7472-432e-b40b-2ddbdf25722c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:37.523617 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5a908984-7472-432e-b40b-2ddbdf25722c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:37.531351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5a908984-7472-432e-b40b-2ddbdf25722c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:37.531803 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5a908984-7472-432e-b40b-2ddbdf25722c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:37.532949 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5a908984-7472-432e-b40b-2ddbdf25722c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:37.533163 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5a908984-7472-432e-b40b-2ddbdf25722c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:37.746760 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5a908984-7472-432e-b40b-2ddbdf25722c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:37.756438 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5a908984-7472-432e-b40b-2ddbdf25722c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:37.757968 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5a908984-7472-432e-b40b-2ddbdf25722c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:37.759179 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5a908984-7472-432e-b40b-2ddbdf25722c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1874 microversion: 2.42 time: 0.242128 Jul 25 14:29:37.759754 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 617/1260] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:37 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1874 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:37.768013 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-52c2baaf-8e4e-4c27-9e67-8167baa85aa0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:37.768904 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-52c2baaf-8e4e-4c27-9e67-8167baa85aa0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:37.776230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-52c2baaf-8e4e-4c27-9e67-8167baa85aa0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:37.776677 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-52c2baaf-8e4e-4c27-9e67-8167baa85aa0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:37.777464 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-52c2baaf-8e4e-4c27-9e67-8167baa85aa0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:37.778087 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-52c2baaf-8e4e-4c27-9e67-8167baa85aa0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:37.935406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-52c2baaf-8e4e-4c27-9e67-8167baa85aa0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:37.947479 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-52c2baaf-8e4e-4c27-9e67-8167baa85aa0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:37.949663 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-52c2baaf-8e4e-4c27-9e67-8167baa85aa0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:37.950817 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-52c2baaf-8e4e-4c27-9e67-8167baa85aa0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1411 microversion: 2.25 time: 0.187751 Jul 25 14:29:37.951598 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 618/1261] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:37 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1411 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:37.993979 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.network.neutron [None req-65121faf-27f1-405a-b01e-5c148c4cc73b tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 58fa156b-43cc-4633-b7bd-6ed9cc2bd220] re-assign floating IP 172.25.5.249 from instance 1c6f6d12-3660-40ec-bf99-d735fa9d0358 Jul 25 14:29:38.045474 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-65121faf-27f1-405a-b01e-5c148c4cc73b tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 1c6f6d12-3660-40ec-bf99-d735fa9d0358] Building network info cache for instance {{(pid=119304) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 14:29:38.149072 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d56ef240-e08b-4d3d-8aa2-96e0e5657226 tempest-FlavorsV261TestJSON-534500576 tempest-FlavorsV261TestJSON-534500576-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-667393839", "id": 1643976427, "os-flavor-access:is_public": "True"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:38.153387 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:29:38.153387 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:29:38.178096 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d56ef240-e08b-4d3d-8aa2-96e0e5657226 tempest-FlavorsV261TestJSON-534500576 tempest-FlavorsV261TestJSON-534500576-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 0.225242 Jul 25 14:29:38.178680 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 619/1262] 10.222.0.88 () {62 vars in 1188 bytes} [Mon Jul 25 14:29:37 2022] POST /compute/v2.1/flavors => generated 467 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:29:38.183389 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-425e39e2-613e-49c5-9f56-de5630e8e3a9 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:38.184182 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-425e39e2-613e-49c5-9f56-de5630e8e3a9 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:38.193198 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-425e39e2-613e-49c5-9f56-de5630e8e3a9 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:38.193676 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-425e39e2-613e-49c5-9f56-de5630e8e3a9 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:38.194943 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-425e39e2-613e-49c5-9f56-de5630e8e3a9 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:38.195389 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-425e39e2-613e-49c5-9f56-de5630e8e3a9 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:38.281516 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-425e39e2-613e-49c5-9f56-de5630e8e3a9 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lazy-loading 'services' on Instance uuid 95594c88-b538-470e-be2b-c38b7c2c88c1 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:29:38.330344 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-425e39e2-613e-49c5-9f56-de5630e8e3a9 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1937 microversion: 2.75 time: 0.149260 Jul 25 14:29:38.333876 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 620/1263] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:38 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1937 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:38.346694 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-62cd62b8-b3ad-40cc-850c-7bf85f73c932 req-d555971e-f63f-4609-bde1-4a656c8a5ace service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c6f6d12-3660-40ec-bf99-d735fa9d0358", "tag": "fb6f83eb-2e87-4f51-aa28-9bf153938de2"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:38.361045 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-62cd62b8-b3ad-40cc-850c-7bf85f73c932 req-d555971e-f63f-4609-bde1-4a656c8a5ace service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:38.361670 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-62cd62b8-b3ad-40cc-850c-7bf85f73c932 req-d555971e-f63f-4609-bde1-4a656c8a5ace service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:38.380280 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-62cd62b8-b3ad-40cc-850c-7bf85f73c932 req-d555971e-f63f-4609-bde1-4a656c8a5ace service nova] Creating event network-changed:fb6f83eb-2e87-4f51-aa28-9bf153938de2 for instance 1c6f6d12-3660-40ec-bf99-d735fa9d0358 on n-h2-846435-14 Jul 25 14:29:38.385929 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-62cd62b8-b3ad-40cc-850c-7bf85f73c932 req-d555971e-f63f-4609-bde1-4a656c8a5ace service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050461 Jul 25 14:29:38.386661 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 621/1264] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:38.391923 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7a9d6c1e-4e2f-4cd8-89e3-c7f3c28c00e3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:38.392664 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7a9d6c1e-4e2f-4cd8-89e3-c7f3c28c00e3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:38.412734 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7a9d6c1e-4e2f-4cd8-89e3-c7f3c28c00e3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:38.413539 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7a9d6c1e-4e2f-4cd8-89e3-c7f3c28c00e3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:38.414388 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7a9d6c1e-4e2f-4cd8-89e3-c7f3c28c00e3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:38.414995 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7a9d6c1e-4e2f-4cd8-89e3-c7f3c28c00e3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:38.657792 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7a9d6c1e-4e2f-4cd8-89e3-c7f3c28c00e3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:38.667561 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7a9d6c1e-4e2f-4cd8-89e3-c7f3c28c00e3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1542 microversion: 2.1 time: 0.279499 Jul 25 14:29:38.668651 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 622/1265] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:38 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1542 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:38.845880 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-722b2cb8-bfb7-4048-926e-4369ccc90be7 tempest-FlavorsV261TestJSON-1237286792 tempest-FlavorsV261TestJSON-1237286792-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:38.861560 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-722b2cb8-bfb7-4048-926e-4369ccc90be7 tempest-FlavorsV261TestJSON-1237286792 tempest-FlavorsV261TestJSON-1237286792-project] 10.222.0.88 "GET /compute/v2.1/flavors/1643976427" status: 200 len: 467 microversion: 2.61 time: 0.192112 Jul 25 14:29:38.871509 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 623/1266] 10.222.0.88 () {60 vars in 1199 bytes} [Mon Jul 25 14:29:38 2022] GET /compute/v2.1/flavors/1643976427 => generated 467 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:29:38.881350 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0962f1a1-dfcb-4dd9-abb9-a447db02c25e tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:38.882296 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0962f1a1-dfcb-4dd9-abb9-a447db02c25e tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] [instance: 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:38.895562 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0962f1a1-dfcb-4dd9-abb9-a447db02c25e tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:38.897021 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0962f1a1-dfcb-4dd9-abb9-a447db02c25e tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:38.904490 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0962f1a1-dfcb-4dd9-abb9-a447db02c25e tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:38.905181 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0962f1a1-dfcb-4dd9-abb9-a447db02c25e tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:39.056141 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-65121faf-27f1-405a-b01e-5c148c4cc73b tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 1c6f6d12-3660-40ec-bf99-d735fa9d0358] Updating instance_info_cache with network_info: [{"id": "fb6f83eb-2e87-4f51-aa28-9bf153938de2", "address": "fa:16:3e:e5:ec:22", "network": {"id": "8b75699c-1ef5-4c51-95ba-7d4e798771fe", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1225325178-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f1ca1e9beedc4892861051504a5dff08", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapfb6f83eb-2e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119304) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 14:29:39.074127 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-65121faf-27f1-405a-b01e-5c148c4cc73b tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 58fa156b-43cc-4633-b7bd-6ed9cc2bd220] Building network info cache for instance {{(pid=119304) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 14:29:39.088292 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0962f1a1-dfcb-4dd9-abb9-a447db02c25e tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2a80eed224b4a807463f558bfa37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad625845a6ea4b87b22bee984224c130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:39.098794 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0962f1a1-dfcb-4dd9-abb9-a447db02c25e tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] 10.222.0.88 "GET /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff" status: 200 len: 1331 microversion: 2.1 time: 0.225733 Jul 25 14:29:39.099617 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 624/1267] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:38 2022] GET /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff => generated 1331 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:39.104275 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fa49d6d7-6c0d-4f4a-9064-9719cd30a0de tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:39.104889 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fa49d6d7-6c0d-4f4a-9064-9719cd30a0de tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:39.111349 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa49d6d7-6c0d-4f4a-9064-9719cd30a0de tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:39.111792 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa49d6d7-6c0d-4f4a-9064-9719cd30a0de tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:39.112597 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa49d6d7-6c0d-4f4a-9064-9719cd30a0de tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:39.113055 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa49d6d7-6c0d-4f4a-9064-9719cd30a0de tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:39.324518 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fa49d6d7-6c0d-4f4a-9064-9719cd30a0de tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:39.334431 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fa49d6d7-6c0d-4f4a-9064-9719cd30a0de tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:39.336071 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fa49d6d7-6c0d-4f4a-9064-9719cd30a0de tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:39.337346 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fa49d6d7-6c0d-4f4a-9064-9719cd30a0de tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1874 microversion: 2.42 time: 0.236929 Jul 25 14:29:39.338299 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 625/1268] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:39 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1874 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:39.342871 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-58b336b1-10fe-4a03-a9c8-58d89252badf tempest-FlavorsV261TestJSON-534500576 tempest-FlavorsV261TestJSON-534500576-project-admin] Action: 'update', calling method: .version_select at 0x7f46964beb80>, body: {"flavor": {"description": "new"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:39.357427 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:29:39.357427 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:29:39.388480 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-58b336b1-10fe-4a03-a9c8-58d89252badf tempest-FlavorsV261TestJSON-534500576 tempest-FlavorsV261TestJSON-534500576-project-admin] 10.222.0.88 "PUT /compute/v2.1/flavors/1643976427" status: 200 len: 468 microversion: 2.61 time: 0.048995 Jul 25 14:29:39.389051 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 626/1269] 10.222.0.88 () {62 vars in 1219 bytes} [Mon Jul 25 14:29:39 2022] PUT /compute/v2.1/flavors/1643976427 => generated 468 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:29:39.469922 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f3ab8265-936a-4e3f-96cb-cfe50f3f5b1f tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Action: 'create', calling method: .version_select at 0x7f46873b7f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1761813343", "description": "tempest-description-1102361272"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:39.854890 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-65121faf-27f1-405a-b01e-5c148c4cc73b tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 58fa156b-43cc-4633-b7bd-6ed9cc2bd220] Updating instance_info_cache with network_info: [{"id": "84f2f14b-3637-41cb-ad13-2d25a69e7b91", "address": "fa:16:3e:c4:b1:c6", "network": {"id": "8b75699c-1ef5-4c51-95ba-7d4e798771fe", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1225325178-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f1ca1e9beedc4892861051504a5dff08", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap84f2f14b-36", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119304) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 14:29:39.870512 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-65121faf-27f1-405a-b01e-5c148c4cc73b tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Releasing lock "refresh_cache-58fa156b-43cc-4633-b7bd-6ed9cc2bd220" {{(pid=119304) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 14:29:39.871802 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-65121faf-27f1-405a-b01e-5c148c4cc73b tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "POST /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220/action" status: 202 len: 0 microversion: 2.1 time: 8.278847 Jul 25 14:29:39.872972 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 644/1270] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:29:31 2022] POST /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220/action => generated 0 bytes in 8281 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 14:29:39.885836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-69ee0513-9e14-40c3-b625-b3a3b81c5471 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:39.890555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-69ee0513-9e14-40c3-b625-b3a3b81c5471 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:39.908110 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69ee0513-9e14-40c3-b625-b3a3b81c5471 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:39.908404 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69ee0513-9e14-40c3-b625-b3a3b81c5471 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:39.909398 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69ee0513-9e14-40c3-b625-b3a3b81c5471 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:39.909979 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69ee0513-9e14-40c3-b625-b3a3b81c5471 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:39.929918 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f3ab8265-936a-4e3f-96cb-cfe50f3f5b1f tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.539778 Jul 25 14:29:39.930753 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 627/1271] 10.222.0.88 () {60 vars in 1180 bytes} [Mon Jul 25 14:29:39 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:39.947074 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-298c5f95-80bd-475c-b8e6-4edc86982422 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:39.947699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-298c5f95-80bd-475c-b8e6-4edc86982422 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:39.968429 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=3,nova_cell1:RELEASE=3,nova_cell1:UPDATE=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:29:39.969607 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-298c5f95-80bd-475c-b8e6-4edc86982422 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:39.973895 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-298c5f95-80bd-475c-b8e6-4edc86982422 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:39.978052 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-298c5f95-80bd-475c-b8e6-4edc86982422 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:39.982431 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-298c5f95-80bd-475c-b8e6-4edc86982422 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:40.166424 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-298c5f95-80bd-475c-b8e6-4edc86982422 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lazy-loading 'services' on Instance uuid 95594c88-b538-470e-be2b-c38b7c2c88c1 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:29:40.204940 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-298c5f95-80bd-475c-b8e6-4edc86982422 tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1937 microversion: 2.75 time: 0.263457 Jul 25 14:29:40.205531 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 628/1272] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:39 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1937 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:40.220794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0e3c4eeb-4dab-48f9-97d8-c8dcf2af7f52 tempest-FlavorsV261TestJSON-1237286792 tempest-FlavorsV261TestJSON-1237286792-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:40.288845 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0e3c4eeb-4dab-48f9-97d8-c8dcf2af7f52 tempest-FlavorsV261TestJSON-1237286792 tempest-FlavorsV261TestJSON-1237286792-project] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 6249 microversion: 2.61 time: 0.074830 Jul 25 14:29:40.302311 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 629/1273] 10.222.0.88 () {60 vars in 1187 bytes} [Mon Jul 25 14:29:40 2022] GET /compute/v2.1/flavors/detail => generated 6249 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:40.313178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f0b92c1b-e6b3-4e6a-adc1-66ae9e3b3798 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:40.313906 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f0b92c1b-e6b3-4e6a-adc1-66ae9e3b3798 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:40.318804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-69ee0513-9e14-40c3-b625-b3a3b81c5471 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:40.331794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f0b92c1b-e6b3-4e6a-adc1-66ae9e3b3798 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:40.332317 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f0b92c1b-e6b3-4e6a-adc1-66ae9e3b3798 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:40.333207 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f0b92c1b-e6b3-4e6a-adc1-66ae9e3b3798 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:40.333530 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-69ee0513-9e14-40c3-b625-b3a3b81c5471 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:40.334254 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f0b92c1b-e6b3-4e6a-adc1-66ae9e3b3798 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:40.336071 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-69ee0513-9e14-40c3-b625-b3a3b81c5471 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:40.337645 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-69ee0513-9e14-40c3-b625-b3a3b81c5471 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1411 microversion: 2.25 time: 0.463419 Jul 25 14:29:40.338669 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 645/1274] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:39 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1411 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:40.343930 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3c225562-525c-4148-bfc9-ea5eb1ba4e76 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Action: 'action', calling method: .version_select at 0x7f4696cb3a60>, body: {"removeFloatingIp": {"address": "172.25.5.249"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:40.490703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f0b92c1b-e6b3-4e6a-adc1-66ae9e3b3798 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:40.491496 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3c225562-525c-4148-bfc9-ea5eb1ba4e76 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 58fa156b-43cc-4633-b7bd-6ed9cc2bd220] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:40.498179 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c225562-525c-4148-bfc9-ea5eb1ba4e76 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:40.498625 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c225562-525c-4148-bfc9-ea5eb1ba4e76 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:40.499692 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c225562-525c-4148-bfc9-ea5eb1ba4e76 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:40.500171 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c225562-525c-4148-bfc9-ea5eb1ba4e76 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:40.501080 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f0b92c1b-e6b3-4e6a-adc1-66ae9e3b3798 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1542 microversion: 2.1 time: 0.197393 Jul 25 14:29:40.512007 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 630/1275] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:40 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1542 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:40.512007 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-04a3d80d-4187-4453-9bfd-c7c2c26c5738 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Action: 'create', calling method: .version_select at 0x7f4687332b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-879769153", "description": "tempest-description-1028674718"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:40.680813 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-04a3d80d-4187-4453-9bfd-c7c2c26c5738 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.177037 Jul 25 14:29:40.693429 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 631/1276] 10.222.0.88 () {60 vars in 1180 bytes} [Mon Jul 25 14:29:40 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:40.702353 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-961975c3-5760-4f28-b9b8-40cc1f824250 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:40.702353 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-961975c3-5760-4f28-b9b8-40cc1f824250 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] [instance: 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:40.708978 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-961975c3-5760-4f28-b9b8-40cc1f824250 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:40.710210 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-961975c3-5760-4f28-b9b8-40cc1f824250 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:40.710210 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-961975c3-5760-4f28-b9b8-40cc1f824250 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:40.710644 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-961975c3-5760-4f28-b9b8-40cc1f824250 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:40.738965 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:29:40.773288 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-3c225562-525c-4148-bfc9-ea5eb1ba4e76 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] HTTP exception thrown: Floating IP 172.25.5.249 is not associated with instance 1c6f6d12-3660-40ec-bf99-d735fa9d0358. Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3c225562-525c-4148-bfc9-ea5eb1ba4e76 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Request method failure captured: Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358/action HTTP/1.1 Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 49 Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qiNaioZXMvHAxPupfZxzmqs4h9Cwus7RVJAYa6TyjvQb83_RlbMQ9YT1JRYD70WuHhpCPl9f99GXdEwZlhPtNst6oi1voAGgfmapw4V4s_Zur6Hv8mZaqp9S4CxN0ZG4imfeRS1VG-itDkKnnYKqxtpkI78bE45UFx_i7Pn_qhVNTg Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: f1ca1e9beedc4892861051504a5dff08 Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1691880843 Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f1ca1e9beedc4892861051504a5dff08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f1ca1e9beedc4892861051504a5dff08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f1ca1e9beedc4892861051504a5dff08", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f1ca1e9beedc4892861051504a5dff08"}]}] Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1691880843 Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: f1ca1e9beedc4892861051504a5dff08 Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1691880843 Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-FloatingIPsAssociationTestJSON-1691880843-project Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 774744dcf62f4ef78b4a2c8dfc96f9cd Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1691880843-project Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: {"removeFloatingIp": {"address": "172.25.5.249"}} Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: exception: Floating IP 172.25.5.249 is not associated with instance 1c6f6d12-3660-40ec-bf99-d735fa9d0358. Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '1c6f6d12-3660-40ec-bf99-d735fa9d0358', 'body': {'removeFloatingIp': {'address': '172.25.5.249'}}} Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.5.249 is not associated with instance 1c6f6d12-3660-40ec-bf99-d735fa9d0358. Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.5.249 is not associated with instance 1c6f6d12-3660-40ec-bf99-d735fa9d0358. Jul 25 14:29:40.775214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:40.779950 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3c225562-525c-4148-bfc9-ea5eb1ba4e76 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Returning 409 to user: Floating IP 172.25.5.249 is not associated with instance 1c6f6d12-3660-40ec-bf99-d735fa9d0358. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:29:40.779950 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3c225562-525c-4148-bfc9-ea5eb1ba4e76 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "POST /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358/action" status: 409 len: 146 microversion: 2.1 time: 0.437134 Jul 25 14:29:40.779950 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 646/1277] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:29:40 2022] POST /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358/action => generated 146 bytes in 438 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:29:40.787801 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-623be634-d395-4381-be9c-093f42b55519 tempest-FlavorsV261TestJSON-1237286792 tempest-FlavorsV261TestJSON-1237286792-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:40.816606 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-623be634-d395-4381-be9c-093f42b55519 tempest-FlavorsV261TestJSON-1237286792 tempest-FlavorsV261TestJSON-1237286792-project] 10.222.0.88 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.61 time: 0.035736 Jul 25 14:29:40.817199 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 647/1278] 10.222.0.88 () {60 vars in 1166 bytes} [Mon Jul 25 14:29:40 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:40.832592 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dbf9d5a0-628d-40b6-afd5-6876ceede419 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:40.834335 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dbf9d5a0-628d-40b6-afd5-6876ceede419 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:40.841989 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dbf9d5a0-628d-40b6-afd5-6876ceede419 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:40.842430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dbf9d5a0-628d-40b6-afd5-6876ceede419 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:40.843723 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dbf9d5a0-628d-40b6-afd5-6876ceede419 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:40.844195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dbf9d5a0-628d-40b6-afd5-6876ceede419 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:40.858033 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-961975c3-5760-4f28-b9b8-40cc1f824250 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2a80eed224b4a807463f558bfa37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad625845a6ea4b87b22bee984224c130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:40.866786 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-961975c3-5760-4f28-b9b8-40cc1f824250 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] 10.222.0.88 "GET /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff" status: 200 len: 1535 microversion: 2.1 time: 0.169017 Jul 25 14:29:40.868032 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 632/1279] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:40 2022] GET /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff => generated 1535 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:40.873267 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-af9b54bd-5693-458d-b8bb-5d75943786a6 req-55c25cd2-ff61-440a-9d76-82db5a17c561 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58fa156b-43cc-4633-b7bd-6ed9cc2bd220", "tag": "84f2f14b-3637-41cb-ad13-2d25a69e7b91"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:40.885897 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-af9b54bd-5693-458d-b8bb-5d75943786a6 req-55c25cd2-ff61-440a-9d76-82db5a17c561 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:40.886450 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-af9b54bd-5693-458d-b8bb-5d75943786a6 req-55c25cd2-ff61-440a-9d76-82db5a17c561 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:40.901268 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-af9b54bd-5693-458d-b8bb-5d75943786a6 req-55c25cd2-ff61-440a-9d76-82db5a17c561 service nova] Creating event network-changed:84f2f14b-3637-41cb-ad13-2d25a69e7b91 for instance 58fa156b-43cc-4633-b7bd-6ed9cc2bd220 on n-h2-846435-14 Jul 25 14:29:40.906381 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-af9b54bd-5693-458d-b8bb-5d75943786a6 req-55c25cd2-ff61-440a-9d76-82db5a17c561 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036753 Jul 25 14:29:40.907049 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 633/1280] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:40.920221 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6cd1cb8a-c21f-402a-91cc-9acb3c7e69c3 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1843492657", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "9c10ea26-e276-4e9b-9f29-592bd546ef76"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:40.992271 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-6cd1cb8a-c21f-402a-91cc-9acb3c7e69c3 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] validate_networks() for [('9c10ea26-e276-4e9b-9f29-592bd546ef76', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:29:41.098505 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dbf9d5a0-628d-40b6-afd5-6876ceede419 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:41.112162 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dbf9d5a0-628d-40b6-afd5-6876ceede419 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:41.113515 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dbf9d5a0-628d-40b6-afd5-6876ceede419 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:41.114719 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dbf9d5a0-628d-40b6-afd5-6876ceede419 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1874 microversion: 2.42 time: 0.296420 Jul 25 14:29:41.126137 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 648/1281] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:40 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1874 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:41.132056 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f57bbb67-b3ea-402a-a292-0179bfdf731b tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.249"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:41.269706 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f57bbb67-b3ea-402a-a292-0179bfdf731b tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 58fa156b-43cc-4633-b7bd-6ed9cc2bd220] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:41.276295 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f57bbb67-b3ea-402a-a292-0179bfdf731b tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:41.277223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f57bbb67-b3ea-402a-a292-0179bfdf731b tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:41.277997 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f57bbb67-b3ea-402a-a292-0179bfdf731b tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:41.278583 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f57bbb67-b3ea-402a-a292-0179bfdf731b tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:41.372705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:29:41.505242 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f57bbb67-b3ea-402a-a292-0179bfdf731b tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Acquired lock "refresh_cache-58fa156b-43cc-4633-b7bd-6ed9cc2bd220" {{(pid=119304) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 14:29:42.035250 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-6cd1cb8a-c21f-402a-91cc-9acb3c7e69c3 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:29:42.040919 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-6cd1cb8a-c21f-402a-91cc-9acb3c7e69c3 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:29:42.042769 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-6cd1cb8a-c21f-402a-91cc-9acb3c7e69c3 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:29:42.048523 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-6cd1cb8a-c21f-402a-91cc-9acb3c7e69c3 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:29:42.050593 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-6cd1cb8a-c21f-402a-91cc-9acb3c7e69c3 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:29:42.084150 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6cd1cb8a-c21f-402a-91cc-9acb3c7e69c3 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:42.084892 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6cd1cb8a-c21f-402a-91cc-9acb3c7e69c3 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:42.085892 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6cd1cb8a-c21f-402a-91cc-9acb3c7e69c3 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:42.086542 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6cd1cb8a-c21f-402a-91cc-9acb3c7e69c3 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:42.135922 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-6cd1cb8a-c21f-402a-91cc-9acb3c7e69c3 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Getting quotas for project 3d71324b22554a3bb44d6aceb7bc3cbd. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:29:42.142259 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-6cd1cb8a-c21f-402a-91cc-9acb3c7e69c3 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Getting quotas for user b3f53d74a29243759065e68964f638dc and project 3d71324b22554a3bb44d6aceb7bc3cbd. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:29:42.163167 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6cd1cb8a-c21f-402a-91cc-9acb3c7e69c3 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:29:42.165825 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6cd1cb8a-c21f-402a-91cc-9acb3c7e69c3 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 74d6eac5-76ed-47bb-8e15-d6dea0e5618e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:29:42.234041 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6cd1cb8a-c21f-402a-91cc-9acb3c7e69c3 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.325751 Jul 25 14:29:42.243687 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 634/1282] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:29:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1336 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:29:42.248968 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-798d68ac-19da-4391-a0b4-e8c9e06ed60e tempest-FlavorsV261TestJSON-534500576 tempest-FlavorsV261TestJSON-534500576-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:42.252894 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:29:42.252894 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:29:42.279371 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-798d68ac-19da-4391-a0b4-e8c9e06ed60e tempest-FlavorsV261TestJSON-534500576 tempest-FlavorsV261TestJSON-534500576-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/1643976427" status: 202 len: 0 microversion: 2.61 time: 0.033713 Jul 25 14:29:42.279964 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 635/1283] 10.222.0.88 () {60 vars in 1202 bytes} [Mon Jul 25 14:29:42 2022] DELETE /compute/v2.1/flavors/1643976427 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:29:42.286864 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cea24f91-68d9-4e19-ab2f-011dc8f001e2 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Action: 'create', calling method: .version_select at 0x7f46872c04c0>, body: {"pool": "0e482852-0013-452e-b205-cea1a4f78a15"} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:42.361620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-f57bbb67-b3ea-402a-a292-0179bfdf731b tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 58fa156b-43cc-4633-b7bd-6ed9cc2bd220] Building network info cache for instance {{(pid=119304) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 14:29:43.043925 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-f57bbb67-b3ea-402a-a292-0179bfdf731b tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 58fa156b-43cc-4633-b7bd-6ed9cc2bd220] Updating instance_info_cache with network_info: [{"id": "84f2f14b-3637-41cb-ad13-2d25a69e7b91", "address": "fa:16:3e:c4:b1:c6", "network": {"id": "8b75699c-1ef5-4c51-95ba-7d4e798771fe", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1225325178-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f1ca1e9beedc4892861051504a5dff08", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap84f2f14b-36", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119304) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 14:29:43.056563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f57bbb67-b3ea-402a-a292-0179bfdf731b tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Releasing lock "refresh_cache-58fa156b-43cc-4633-b7bd-6ed9cc2bd220" {{(pid=119304) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 14:29:43.057683 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f57bbb67-b3ea-402a-a292-0179bfdf731b tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "POST /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220/action" status: 202 len: 0 microversion: 2.1 time: 1.931989 Jul 25 14:29:43.058778 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 649/1284] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:29:41 2022] POST /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220/action => generated 0 bytes in 1933 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 14:29:43.065472 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dd864ef1-d302-4e64-861b-e9a1f924949b tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:43.066316 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dd864ef1-d302-4e64-861b-e9a1f924949b tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:43.068425 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:29:43.075331 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd864ef1-d302-4e64-861b-e9a1f924949b tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:43.076045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd864ef1-d302-4e64-861b-e9a1f924949b tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:43.076985 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd864ef1-d302-4e64-861b-e9a1f924949b tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:43.077654 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd864ef1-d302-4e64-861b-e9a1f924949b tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:43.195670 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-dd864ef1-d302-4e64-861b-e9a1f924949b tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] Lazy-loading 'services' on Instance uuid 95594c88-b538-470e-be2b-c38b7c2c88c1 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:29:43.216945 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dd864ef1-d302-4e64-861b-e9a1f924949b tempest-ServersAdmin275Test-262390894 tempest-ServersAdmin275Test-262390894-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1922 microversion: 2.75 time: 0.156849 Jul 25 14:29:43.218086 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 650/1285] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:43 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1922 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:43.223579 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-078d7032-3787-4e2c-a895-dc1be7bbf83f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:43.223778 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-078d7032-3787-4e2c-a895-dc1be7bbf83f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:43.230357 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-078d7032-3787-4e2c-a895-dc1be7bbf83f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:43.231086 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-078d7032-3787-4e2c-a895-dc1be7bbf83f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:43.232054 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-078d7032-3787-4e2c-a895-dc1be7bbf83f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:43.232482 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-078d7032-3787-4e2c-a895-dc1be7bbf83f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:43.389210 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-078d7032-3787-4e2c-a895-dc1be7bbf83f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:43.397446 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-078d7032-3787-4e2c-a895-dc1be7bbf83f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:43.398933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-078d7032-3787-4e2c-a895-dc1be7bbf83f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:43.400058 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-078d7032-3787-4e2c-a895-dc1be7bbf83f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1411 microversion: 2.25 time: 0.180668 Jul 25 14:29:43.400622 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 651/1286] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:43 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1411 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:43.404946 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d944151b-d4a2-4b2f-925a-a63285124b86 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:43.405917 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d944151b-d4a2-4b2f-925a-a63285124b86 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:43.412933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d944151b-d4a2-4b2f-925a-a63285124b86 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:43.413506 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d944151b-d4a2-4b2f-925a-a63285124b86 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:43.414503 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d944151b-d4a2-4b2f-925a-a63285124b86 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:43.415023 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d944151b-d4a2-4b2f-925a-a63285124b86 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:43.809523 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cea24f91-68d9-4e19-ab2f-011dc8f001e2 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] 10.222.0.88 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.528198 Jul 25 14:29:43.810518 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 636/1287] 10.222.0.88 () {60 vars in 1170 bytes} [Mon Jul 25 14:29:42 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:43.822086 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8ffc7ccf-67bb-40f4-ac00-b546b2b5f707 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:43.823869 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8ffc7ccf-67bb-40f4-ac00-b546b2b5f707 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:43.833968 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ffc7ccf-67bb-40f4-ac00-b546b2b5f707 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:43.834431 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ffc7ccf-67bb-40f4-ac00-b546b2b5f707 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:43.835213 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ffc7ccf-67bb-40f4-ac00-b546b2b5f707 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:43.835651 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ffc7ccf-67bb-40f4-ac00-b546b2b5f707 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:43.835817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d944151b-d4a2-4b2f-925a-a63285124b86 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:43.844100 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d944151b-d4a2-4b2f-925a-a63285124b86 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1542 microversion: 2.1 time: 0.442417 Jul 25 14:29:43.844638 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 652/1288] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:43 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1542 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:43.864603 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bef45be5-b898-4ac0-8cf3-6b26fec26b5a tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:43.866120 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bef45be5-b898-4ac0-8cf3-6b26fec26b5a tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 74d6eac5-76ed-47bb-8e15-d6dea0e5618e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:43.874569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bef45be5-b898-4ac0-8cf3-6b26fec26b5a tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:43.875241 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bef45be5-b898-4ac0-8cf3-6b26fec26b5a tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:43.876251 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bef45be5-b898-4ac0-8cf3-6b26fec26b5a tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:43.878927 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bef45be5-b898-4ac0-8cf3-6b26fec26b5a tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:43.953492 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bef45be5-b898-4ac0-8cf3-6b26fec26b5a tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f53d74a29243759065e68964f638dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d71324b22554a3bb44d6aceb7bc3cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:43.961097 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bef45be5-b898-4ac0-8cf3-6b26fec26b5a tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e" status: 200 len: 1274 microversion: 2.1 time: 0.115253 Jul 25 14:29:43.962372 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 653/1289] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:43 2022] GET /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e => generated 1274 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:43.968694 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2f855e07-2bc2-4a98-8448-e50ea60a7c23 tempest-FlavorsV261TestJSON-534500576 tempest-FlavorsV261TestJSON-534500576-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:43.990392 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2f855e07-2bc2-4a98-8448-e50ea60a7c23 tempest-FlavorsV261TestJSON-534500576 tempest-FlavorsV261TestJSON-534500576-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.026678 Jul 25 14:29:43.991296 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 654/1290] 10.222.0.88 () {60 vars in 1187 bytes} [Mon Jul 25 14:29:43 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:44.007253 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-7133afca-a1ad-4c38-95e1-b12151615405 req-c529f071-a7c6-462e-8c03-a158733eb46e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58fa156b-43cc-4633-b7bd-6ed9cc2bd220", "tag": "84f2f14b-3637-41cb-ad13-2d25a69e7b91"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:44.018115 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-7133afca-a1ad-4c38-95e1-b12151615405 req-c529f071-a7c6-462e-8c03-a158733eb46e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:44.018734 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-7133afca-a1ad-4c38-95e1-b12151615405 req-c529f071-a7c6-462e-8c03-a158733eb46e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:44.033085 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-7133afca-a1ad-4c38-95e1-b12151615405 req-c529f071-a7c6-462e-8c03-a158733eb46e service nova] Creating event network-changed:84f2f14b-3637-41cb-ad13-2d25a69e7b91 for instance 58fa156b-43cc-4633-b7bd-6ed9cc2bd220 on n-h2-846435-14 Jul 25 14:29:44.038411 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-7133afca-a1ad-4c38-95e1-b12151615405 req-c529f071-a7c6-462e-8c03-a158733eb46e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045911 Jul 25 14:29:44.039487 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 655/1291] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:44.046174 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dd6ea98e-ad29-4b1f-9c74-f853b2c5a2e8 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:44.047099 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dd6ea98e-ad29-4b1f-9c74-f853b2c5a2e8 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 58fa156b-43cc-4633-b7bd-6ed9cc2bd220] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:44.054152 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd6ea98e-ad29-4b1f-9c74-f853b2c5a2e8 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:44.054487 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd6ea98e-ad29-4b1f-9c74-f853b2c5a2e8 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:44.055768 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd6ea98e-ad29-4b1f-9c74-f853b2c5a2e8 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:44.056238 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd6ea98e-ad29-4b1f-9c74-f853b2c5a2e8 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:44.094342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dd6ea98e-ad29-4b1f-9c74-f853b2c5a2e8 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 58fa156b-43cc-4633-b7bd-6ed9cc2bd220] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:29:44.202659 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8ffc7ccf-67bb-40f4-ac00-b546b2b5f707 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:44.214045 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8ffc7ccf-67bb-40f4-ac00-b546b2b5f707 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:44.216402 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8ffc7ccf-67bb-40f4-ac00-b546b2b5f707 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:44.218146 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8ffc7ccf-67bb-40f4-ac00-b546b2b5f707 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1874 microversion: 2.42 time: 0.406258 Jul 25 14:29:44.234994 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 637/1292] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:43 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1874 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:44.240518 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2a7e51a8-b493-4bf7-b70c-f65402f5a326 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:44.241291 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2a7e51a8-b493-4bf7-b70c-f65402f5a326 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:44.247134 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dd6ea98e-ad29-4b1f-9c74-f853b2c5a2e8 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "DELETE /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220" status: 204 len: 0 microversion: 2.1 time: 0.205474 Jul 25 14:29:44.248369 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 656/1293] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:29:44 2022] DELETE /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:29:44.249485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a7e51a8-b493-4bf7-b70c-f65402f5a326 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:44.250230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a7e51a8-b493-4bf7-b70c-f65402f5a326 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:44.251280 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a7e51a8-b493-4bf7-b70c-f65402f5a326 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:44.251902 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a7e51a8-b493-4bf7-b70c-f65402f5a326 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:44.264338 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9d96b0b3-4d5e-49c7-89f8-6bdac6f4d151 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.92"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:44.267882 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9d96b0b3-4d5e-49c7-89f8-6bdac6f4d151 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] [instance: 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:44.278460 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d96b0b3-4d5e-49c7-89f8-6bdac6f4d151 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:44.279809 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d96b0b3-4d5e-49c7-89f8-6bdac6f4d151 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:44.280831 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d96b0b3-4d5e-49c7-89f8-6bdac6f4d151 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:44.281614 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d96b0b3-4d5e-49c7-89f8-6bdac6f4d151 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:44.284469 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2a7e51a8-b493-4bf7-b70c-f65402f5a326 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:29:44.325591 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d96b0b3-4d5e-49c7-89f8-6bdac6f4d151 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Acquired lock "refresh_cache-520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff" {{(pid=119304) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 14:29:44.395142 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2a7e51a8-b493-4bf7-b70c-f65402f5a326 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "DELETE /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 204 len: 0 microversion: 2.75 time: 0.158372 Jul 25 14:29:44.397401 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 638/1294] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Jul 25 14:29:44 2022] DELETE /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 14:29:44.404703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-5e3c71a1-8bb0-424d-9c78-bbf588bb5d70 req-23899c29-8c6b-4135-b144-fa20acceb7c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c", "name": "network-vif-plugged", "status": "completed", "tag": "eedb59eb-f3ec-476b-a198-201c579f3456"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:44.422784 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-5e3c71a1-8bb0-424d-9c78-bbf588bb5d70 req-23899c29-8c6b-4135-b144-fa20acceb7c9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:44.423529 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-5e3c71a1-8bb0-424d-9c78-bbf588bb5d70 req-23899c29-8c6b-4135-b144-fa20acceb7c9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:44.460848 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-5e3c71a1-8bb0-424d-9c78-bbf588bb5d70 req-23899c29-8c6b-4135-b144-fa20acceb7c9 service nova] Creating event network-vif-plugged:eedb59eb-f3ec-476b-a198-201c579f3456 for instance 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c on n-h1-846435-14 Jul 25 14:29:44.466196 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-5e3c71a1-8bb0-424d-9c78-bbf588bb5d70 req-23899c29-8c6b-4135-b144-fa20acceb7c9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066770 Jul 25 14:29:44.467419 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 639/1295] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:44.473065 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9d0b2429-aec9-4e9a-894d-2a57fc4ab26d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Action: 'action', calling method: .version_select at 0x7f4696cb3940>, body: {"addFloatingIp": {"address": "172.25.5.249"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:44.476259 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9d0b2429-aec9-4e9a-894d-2a57fc4ab26d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 1c6f6d12-3660-40ec-bf99-d735fa9d0358] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:44.484998 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d0b2429-aec9-4e9a-894d-2a57fc4ab26d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:44.486151 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d0b2429-aec9-4e9a-894d-2a57fc4ab26d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:44.486286 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d0b2429-aec9-4e9a-894d-2a57fc4ab26d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:44.486891 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d0b2429-aec9-4e9a-894d-2a57fc4ab26d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:44.578998 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d0b2429-aec9-4e9a-894d-2a57fc4ab26d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Acquired lock "refresh_cache-1c6f6d12-3660-40ec-bf99-d735fa9d0358" {{(pid=119303) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 14:29:46.032559 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-9d96b0b3-4d5e-49c7-89f8-6bdac6f4d151 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] [instance: 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff] Building network info cache for instance {{(pid=119304) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 14:29:47.028795 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-9d96b0b3-4d5e-49c7-89f8-6bdac6f4d151 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] [instance: 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff] Updating instance_info_cache with network_info: [{"id": "c9d23981-0c41-4d35-a06a-5e586993cfe1", "address": "fa:16:3e:b9:b4:64", "network": {"id": "2e368455-5d90-4a10-bf11-77a659392581", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-221161537-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ad625845a6ea4b87b22bee984224c130", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc9d23981-0c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119304) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 14:29:47.049667 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d96b0b3-4d5e-49c7-89f8-6bdac6f4d151 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Releasing lock "refresh_cache-520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff" {{(pid=119304) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 14:29:47.054080 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9d96b0b3-4d5e-49c7-89f8-6bdac6f4d151 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] 10.222.0.88 "POST /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff/action" status: 202 len: 0 microversion: 2.1 time: 2.801731 Jul 25 14:29:47.055375 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 657/1296] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:29:44 2022] POST /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff/action => generated 0 bytes in 2807 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 14:29:47.069238 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a47c8bf7-82b7-416c-b0db-ddcc8431fd21 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:47.069524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a47c8bf7-82b7-416c-b0db-ddcc8431fd21 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:47.082612 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a47c8bf7-82b7-416c-b0db-ddcc8431fd21 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:47.084799 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a47c8bf7-82b7-416c-b0db-ddcc8431fd21 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:47.086245 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a47c8bf7-82b7-416c-b0db-ddcc8431fd21 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:47.087110 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a47c8bf7-82b7-416c-b0db-ddcc8431fd21 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:47.231475 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a47c8bf7-82b7-416c-b0db-ddcc8431fd21 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:47.232810 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-9d0b2429-aec9-4e9a-894d-2a57fc4ab26d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 1c6f6d12-3660-40ec-bf99-d735fa9d0358] Building network info cache for instance {{(pid=119303) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 14:29:47.245482 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a47c8bf7-82b7-416c-b0db-ddcc8431fd21 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:47.248110 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a47c8bf7-82b7-416c-b0db-ddcc8431fd21 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c2cd515ab9e4b40a33035e13ed6092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99fb59846a68422698e4fc5576dfd95f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:47.258445 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a47c8bf7-82b7-416c-b0db-ddcc8431fd21 tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 200 len: 1444 microversion: 2.75 time: 0.195675 Jul 25 14:29:47.282173 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 658/1297] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:47 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 1444 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:47.302549 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-276c5c4d-eeba-4b26-baa8-1af3fc74f94e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:47.302549 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-276c5c4d-eeba-4b26-baa8-1af3fc74f94e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:47.311580 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-276c5c4d-eeba-4b26-baa8-1af3fc74f94e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:47.312069 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-276c5c4d-eeba-4b26-baa8-1af3fc74f94e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:47.313054 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-276c5c4d-eeba-4b26-baa8-1af3fc74f94e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:47.313547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-276c5c4d-eeba-4b26-baa8-1af3fc74f94e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:47.635842 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-276c5c4d-eeba-4b26-baa8-1af3fc74f94e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:47.650400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-276c5c4d-eeba-4b26-baa8-1af3fc74f94e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:47.652870 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-276c5c4d-eeba-4b26-baa8-1af3fc74f94e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:47.655093 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-276c5c4d-eeba-4b26-baa8-1af3fc74f94e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1607 microversion: 2.25 time: 0.370758 Jul 25 14:29:47.657784 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 659/1298] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:47 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1607 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:47.675156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9978567f-73ee-4da8-b035-453085570210 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:47.676582 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9978567f-73ee-4da8-b035-453085570210 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:47.687531 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9978567f-73ee-4da8-b035-453085570210 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:47.688361 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9978567f-73ee-4da8-b035-453085570210 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:47.689955 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9978567f-73ee-4da8-b035-453085570210 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:47.690653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9978567f-73ee-4da8-b035-453085570210 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:47.963162 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9978567f-73ee-4da8-b035-453085570210 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:47.992669 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9978567f-73ee-4da8-b035-453085570210 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1542 microversion: 2.1 time: 0.330160 Jul 25 14:29:48.012093 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 660/1299] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:47 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1542 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:48.026182 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a5a440fa-95f2-4551-a157-1579453b7a94 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:48.028158 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a5a440fa-95f2-4551-a157-1579453b7a94 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 74d6eac5-76ed-47bb-8e15-d6dea0e5618e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:48.049817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5a440fa-95f2-4551-a157-1579453b7a94 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:48.054967 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5a440fa-95f2-4551-a157-1579453b7a94 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:48.059953 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5a440fa-95f2-4551-a157-1579453b7a94 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:48.064961 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5a440fa-95f2-4551-a157-1579453b7a94 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:48.081952 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:29:48.293794 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a5a440fa-95f2-4551-a157-1579453b7a94 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f53d74a29243759065e68964f638dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d71324b22554a3bb44d6aceb7bc3cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:48.306080 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a5a440fa-95f2-4551-a157-1579453b7a94 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e" status: 200 len: 1316 microversion: 2.1 time: 0.290146 Jul 25 14:29:48.306668 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 661/1300] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:48 2022] GET /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e => generated 1316 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:48.330441 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b8206ba5-9a98-48bf-abc8-4978a253127c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:48.334338 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b8206ba5-9a98-48bf-abc8-4978a253127c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:48.341632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8206ba5-9a98-48bf-abc8-4978a253127c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:48.342553 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8206ba5-9a98-48bf-abc8-4978a253127c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:48.343104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8206ba5-9a98-48bf-abc8-4978a253127c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:48.343597 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8206ba5-9a98-48bf-abc8-4978a253127c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:48.730861 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-9d0b2429-aec9-4e9a-894d-2a57fc4ab26d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 1c6f6d12-3660-40ec-bf99-d735fa9d0358] Updating instance_info_cache with network_info: [{"id": "fb6f83eb-2e87-4f51-aa28-9bf153938de2", "address": "fa:16:3e:e5:ec:22", "network": {"id": "8b75699c-1ef5-4c51-95ba-7d4e798771fe", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1225325178-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f1ca1e9beedc4892861051504a5dff08", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapfb6f83eb-2e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119303) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 14:29:48.749571 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d0b2429-aec9-4e9a-894d-2a57fc4ab26d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Releasing lock "refresh_cache-1c6f6d12-3660-40ec-bf99-d735fa9d0358" {{(pid=119303) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 14:29:48.750948 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9d0b2429-aec9-4e9a-894d-2a57fc4ab26d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "POST /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358/action" status: 202 len: 0 microversion: 2.1 time: 4.282506 Jul 25 14:29:48.751741 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 640/1301] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:29:44 2022] POST /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358/action => generated 0 bytes in 4284 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 14:29:48.756739 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-24d6bc51-c436-4b35-9380-69235d0ede8a req-530a0eee-5f43-46f3-8e99-e4ff7490f428 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff", "tag": "c9d23981-0c41-4d35-a06a-5e586993cfe1"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:48.767701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-24d6bc51-c436-4b35-9380-69235d0ede8a req-530a0eee-5f43-46f3-8e99-e4ff7490f428 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:48.768494 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-24d6bc51-c436-4b35-9380-69235d0ede8a req-530a0eee-5f43-46f3-8e99-e4ff7490f428 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:48.785088 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b8206ba5-9a98-48bf-abc8-4978a253127c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:48.785256 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-24d6bc51-c436-4b35-9380-69235d0ede8a req-530a0eee-5f43-46f3-8e99-e4ff7490f428 service nova] Creating event network-changed:c9d23981-0c41-4d35-a06a-5e586993cfe1 for instance 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff on n-h1-846435-14 Jul 25 14:29:48.802921 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b8206ba5-9a98-48bf-abc8-4978a253127c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:48.803502 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-24d6bc51-c436-4b35-9380-69235d0ede8a req-530a0eee-5f43-46f3-8e99-e4ff7490f428 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049859 Jul 25 14:29:48.804901 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 641/1302] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:48.809751 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b8206ba5-9a98-48bf-abc8-4978a253127c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:48.811899 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b8206ba5-9a98-48bf-abc8-4978a253127c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1874 microversion: 2.42 time: 0.503928 Jul 25 14:29:48.812084 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d8d311c9-0efb-4a8c-9fbe-84a391d15df9 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Action: 'create', calling method: .version_select at 0x7f46873dfaf0>, body: {"pool": "0e482852-0013-452e-b205-cea1a4f78a15"} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:48.816642 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 662/1303] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:48 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1874 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:48.838743 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-a5eeecef-086b-4aa2-aa0a-6a68758b9ab2 req-488cf5c1-0a78-4242-bf7b-4571935cf944 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c6f6d12-3660-40ec-bf99-d735fa9d0358", "tag": "fb6f83eb-2e87-4f51-aa28-9bf153938de2"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:48.853550 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a5eeecef-086b-4aa2-aa0a-6a68758b9ab2 req-488cf5c1-0a78-4242-bf7b-4571935cf944 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:48.854082 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a5eeecef-086b-4aa2-aa0a-6a68758b9ab2 req-488cf5c1-0a78-4242-bf7b-4571935cf944 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:48.866615 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-a5eeecef-086b-4aa2-aa0a-6a68758b9ab2 req-488cf5c1-0a78-4242-bf7b-4571935cf944 service nova] Creating event network-changed:fb6f83eb-2e87-4f51-aa28-9bf153938de2 for instance 1c6f6d12-3660-40ec-bf99-d735fa9d0358 on n-h2-846435-14 Jul 25 14:29:48.871952 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-a5eeecef-086b-4aa2-aa0a-6a68758b9ab2 req-488cf5c1-0a78-4242-bf7b-4571935cf944 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053882 Jul 25 14:29:48.872962 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 663/1304] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:48.879608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-53e90ce7-1ec9-4ec2-84a2-9f5be3c7a4a9 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:48.879911 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-53e90ce7-1ec9-4ec2-84a2-9f5be3c7a4a9 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:48.890970 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-53e90ce7-1ec9-4ec2-84a2-9f5be3c7a4a9 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:48.891324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-53e90ce7-1ec9-4ec2-84a2-9f5be3c7a4a9 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:48.892846 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-53e90ce7-1ec9-4ec2-84a2-9f5be3c7a4a9 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:48.893612 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-53e90ce7-1ec9-4ec2-84a2-9f5be3c7a4a9 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:49.034041 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-53e90ce7-1ec9-4ec2-84a2-9f5be3c7a4a9 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.159678 Jul 25 14:29:49.035593 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 664/1305] 10.222.0.88 () {60 vars in 1316 bytes} [Mon Jul 25 14:29:48 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:29:49.047957 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6d6d5ab4-5f61-4bfb-b494-6439dc07a11e tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:49.048916 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6d6d5ab4-5f61-4bfb-b494-6439dc07a11e tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] [instance: 95594c88-b538-470e-be2b-c38b7c2c88c1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:49.069243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d6d5ab4-5f61-4bfb-b494-6439dc07a11e tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:49.069791 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d6d5ab4-5f61-4bfb-b494-6439dc07a11e tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:49.070464 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d6d5ab4-5f61-4bfb-b494-6439dc07a11e tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:49.070887 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d6d5ab4-5f61-4bfb-b494-6439dc07a11e tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:49.108124 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-6d6d5ab4-5f61-4bfb-b494-6439dc07a11e tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] HTTP exception thrown: Instance 95594c88-b538-470e-be2b-c38b7c2c88c1 could not be found. Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6d6d5ab4-5f61-4bfb-b494-6439dc07a11e tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Request method failure captured: Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 HTTP/1.1 Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qh8f23_mcmcC4E7LwyAqCM-77zb4lJGaRibY-ztMidDawjNEzkRK2QiAV8ILmS-El0ZOUVpQWEFxcv9ixR_n1epxeopPcedNtqklGKrDrrXzZZdmy7MwlJMAwXsoYVUH71IXKwOM1FwBk0OoZXCEyzY_d8jUuY97z2gMJTBsGsYwus Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: X-Openstack-Nova-Api-Version: 2.75 Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 99fb59846a68422698e4fc5576dfd95f Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersAdmin275Test-1863208466 Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/99fb59846a68422698e4fc5576dfd95f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/99fb59846a68422698e4fc5576dfd95f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_99fb59846a68422698e4fc5576dfd95f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/99fb59846a68422698e4fc5576dfd95f"}]}] Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersAdmin275Test-1863208466 Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 99fb59846a68422698e4fc5576dfd95f Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersAdmin275Test-1863208466 Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersAdmin275Test-1863208466-project Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 6c2cd515ab9e4b40a33035e13ed6092e Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersAdmin275Test-1863208466-project Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 95594c88-b538-470e-be2b-c38b7c2c88c1 could not be found. Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '95594c88-b538-470e-be2b-c38b7c2c88c1'} Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95594c88-b538-470e-be2b-c38b7c2c88c1 could not be found. Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95594c88-b538-470e-be2b-c38b7c2c88c1 could not be found. Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:29:49.111117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:49.115515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:29:49.115515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:29:49.115515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:29:49.115515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:29:49.115515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:29:49.115515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95594c88-b538-470e-be2b-c38b7c2c88c1 could not be found. Jul 25 14:29:49.115515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:49.118105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6d6d5ab4-5f61-4bfb-b494-6439dc07a11e tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] Returning 404 to user: Instance 95594c88-b538-470e-be2b-c38b7c2c88c1 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:29:49.120192 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6d6d5ab4-5f61-4bfb-b494-6439dc07a11e tempest-ServersAdmin275Test-1863208466 tempest-ServersAdmin275Test-1863208466-project] 10.222.0.88 "GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1" status: 404 len: 111 microversion: 2.75 time: 0.082653 Jul 25 14:29:49.121341 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 665/1306] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:49 2022] GET /compute/v2.1/servers/95594c88-b538-470e-be2b-c38b7c2c88c1 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:29:49.134703 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-66dcfb13-db4e-4ddb-b5ae-8cc34fef8d0f tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '.version_select at 0x7f46873fea60>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:50.087623 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-66dcfb13-db4e-4ddb-b5ae-8cc34fef8d0f tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "GET /compute/v2.1/os-floating-ips/b2455b2d-5961-4b4a-8272-ed726aaade1a" status: 200 len: 185 microversion: 2.1 time: 0.964749 Jul 25 14:29:50.089480 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 666/1307] 10.222.0.88 () {58 vars in 1260 bytes} [Mon Jul 25 14:29:49 2022] GET /compute/v2.1/os-floating-ips/b2455b2d-5961-4b4a-8272-ed726aaade1a => generated 185 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:50.106110 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d8cd4916-ebb9-478a-86a7-7e342c4ec9f0 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:50.106464 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d8cd4916-ebb9-478a-86a7-7e342c4ec9f0 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:50.114285 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d8cd4916-ebb9-478a-86a7-7e342c4ec9f0 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:50.114791 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d8cd4916-ebb9-478a-86a7-7e342c4ec9f0 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:50.115510 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d8cd4916-ebb9-478a-86a7-7e342c4ec9f0 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:50.115951 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d8cd4916-ebb9-478a-86a7-7e342c4ec9f0 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:50.632747 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d8cd4916-ebb9-478a-86a7-7e342c4ec9f0 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:50.648245 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d8cd4916-ebb9-478a-86a7-7e342c4ec9f0 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1542 microversion: 2.1 time: 0.557108 Jul 25 14:29:50.666201 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 667/1308] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:50 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1542 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:50.778442 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d8d311c9-0efb-4a8c-9fbe-84a391d15df9 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] 10.222.0.88 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.972100 Jul 25 14:29:50.781606 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 642/1309] 10.222.0.88 () {60 vars in 1170 bytes} [Mon Jul 25 14:29:48 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1976 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:50.787918 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-61a14b90-933d-4216-b5a3-186b584f546a tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:50.791520 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-61a14b90-933d-4216-b5a3-186b584f546a tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 74d6eac5-76ed-47bb-8e15-d6dea0e5618e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:50.803772 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-61a14b90-933d-4216-b5a3-186b584f546a tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:50.804282 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-61a14b90-933d-4216-b5a3-186b584f546a tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:50.805456 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-61a14b90-933d-4216-b5a3-186b584f546a tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:50.806762 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-61a14b90-933d-4216-b5a3-186b584f546a tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:50.966413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-56d7ab1d-ac16-4d90-b23a-0b22f114e0e7 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Calling method '.version_select at 0x7f46873fe430>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:50.969666 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:29:50.969666 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:29:50.973078 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-56d7ab1d-ac16-4d90-b23a-0b22f114e0e7 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:50.973833 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-56d7ab1d-ac16-4d90-b23a-0b22f114e0e7 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:50.974893 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-56d7ab1d-ac16-4d90-b23a-0b22f114e0e7 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:50.975324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-56d7ab1d-ac16-4d90-b23a-0b22f114e0e7 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:51.004964 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-56d7ab1d-ac16-4d90-b23a-0b22f114e0e7 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.337269 Jul 25 14:29:51.005753 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 668/1310] 10.222.0.88 () {58 vars in 1128 bytes} [Mon Jul 25 14:29:50 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:51.010528 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-61a14b90-933d-4216-b5a3-186b584f546a tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f53d74a29243759065e68964f638dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d71324b22554a3bb44d6aceb7bc3cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:51.010942 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f855a5eb-9c3e-4418-9e68-1a4d6a768a1e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:51.011819 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f855a5eb-9c3e-4418-9e68-1a4d6a768a1e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:51.018447 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f855a5eb-9c3e-4418-9e68-1a4d6a768a1e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:51.019096 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f855a5eb-9c3e-4418-9e68-1a4d6a768a1e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:51.019360 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-61a14b90-933d-4216-b5a3-186b584f546a tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e" status: 200 len: 1316 microversion: 2.1 time: 0.236287 Jul 25 14:29:51.020047 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f855a5eb-9c3e-4418-9e68-1a4d6a768a1e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:51.020476 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f855a5eb-9c3e-4418-9e68-1a4d6a768a1e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:51.020711 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 643/1311] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:50 2022] GET /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e => generated 1316 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:51.035514 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8109d649-ccc2-4e3b-89da-428cfacb8e30 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Action: 'action', calling method: .version_select at 0x7f4696cb3a60>, body: {"removeFloatingIp": {"address": "172.25.5.249"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:51.187949 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8109d649-ccc2-4e3b-89da-428cfacb8e30 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 1c6f6d12-3660-40ec-bf99-d735fa9d0358] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:51.194472 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8109d649-ccc2-4e3b-89da-428cfacb8e30 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:51.194786 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8109d649-ccc2-4e3b-89da-428cfacb8e30 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:51.195593 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8109d649-ccc2-4e3b-89da-428cfacb8e30 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:51.196019 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8109d649-ccc2-4e3b-89da-428cfacb8e30 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:51.434988 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8109d649-ccc2-4e3b-89da-428cfacb8e30 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Acquired lock "refresh_cache-1c6f6d12-3660-40ec-bf99-d735fa9d0358" {{(pid=119303) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 14:29:51.467028 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f855a5eb-9c3e-4418-9e68-1a4d6a768a1e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:51.485436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f855a5eb-9c3e-4418-9e68-1a4d6a768a1e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:51.489438 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f855a5eb-9c3e-4418-9e68-1a4d6a768a1e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:51.491590 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f855a5eb-9c3e-4418-9e68-1a4d6a768a1e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1874 microversion: 2.42 time: 0.484533 Jul 25 14:29:51.494173 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 669/1312] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:51 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1874 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:51.501140 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b7f9c852-cde2-4dba-b107-e379134550f8 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.115"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:51.504367 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b7f9c852-cde2-4dba-b107-e379134550f8 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] [instance: 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:51.511813 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b7f9c852-cde2-4dba-b107-e379134550f8 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:51.512631 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b7f9c852-cde2-4dba-b107-e379134550f8 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:51.513896 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b7f9c852-cde2-4dba-b107-e379134550f8 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:51.515360 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b7f9c852-cde2-4dba-b107-e379134550f8 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:51.553181 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b7f9c852-cde2-4dba-b107-e379134550f8 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Acquired lock "refresh_cache-520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff" {{(pid=119304) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 14:29:52.123165 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:29:52.154706 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=24 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:29:52.232063 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-8109d649-ccc2-4e3b-89da-428cfacb8e30 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 1c6f6d12-3660-40ec-bf99-d735fa9d0358] Building network info cache for instance {{(pid=119303) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 14:29:52.325452 n-d-846435-14 devstack@n-api.service[119304]: DEBUG neutronclient.v2_0.client [None req-b7f9c852-cde2-4dba-b107-e379134550f8 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.5.115 (af7eedf8-0b13-4e68-bd9a-f8c7e101087c) with port c9d23981-0c41-4d35-a06a-5e586993cfe1 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 0e482852-0013-452e-b205-cea1a4f78a15.", "detail": ""}} {{(pid=119304) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 14:29:52.326041 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b7f9c852-cde2-4dba-b107-e379134550f8 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Releasing lock "refresh_cache-520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff" {{(pid=119304) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 14:29:52.326587 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-b7f9c852-cde2-4dba-b107-e379134550f8 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] HTTP exception thrown: Cannot associate floating IP 172.25.5.115 (af7eedf8-0b13-4e68-bd9a-f8c7e101087c) with port c9d23981-0c41-4d35-a06a-5e586993cfe1 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 0e482852-0013-452e-b205-cea1a4f78a15. Jul 25 14:29:52.326587 n-d-846435-14 devstack@n-api.service[119304]: Neutron server returns request_ids: ['req-5ef5ab16-eef4-4169-b0eb-0794e8591f49'] Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b7f9c852-cde2-4dba-b107-e379134550f8 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Request method failure captured: Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff/action HTTP/1.1 Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 46 Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qjCfxmZ_zoz5tZWTUa6ftqwLmr82iUZ_14Ovsmd3NdwrBu_a9sVwju_No84u4K9igULZtUJKu9bcoi_ZPmmr3dJFLiR7_vVQJY61rKTl0ctv-PndraeXHk1Y036T9HUysdMjo6ZhuG3ruxiL6bBhR5JOiI4s-6UClYCiowkw8s0Btk Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: ad625845a6ea4b87b22bee984224c130 Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-553112801 Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ad625845a6ea4b87b22bee984224c130"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ad625845a6ea4b87b22bee984224c130"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ad625845a6ea4b87b22bee984224c130", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ad625845a6ea4b87b22bee984224c130"}]}] Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-553112801 Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: ad625845a6ea4b87b22bee984224c130 Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-553112801 Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 88d2a80eed224b4a807463f558bfa37b Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: {"addFloatingIp": {"address": "172.25.5.115"}} Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: exception: Cannot associate floating IP 172.25.5.115 (af7eedf8-0b13-4e68-bd9a-f8c7e101087c) with port c9d23981-0c41-4d35-a06a-5e586993cfe1 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 0e482852-0013-452e-b205-cea1a4f78a15. Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: Neutron server returns request_ids: ['req-5ef5ab16-eef4-4169-b0eb-0794e8591f49'] Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff', 'body': {'addFloatingIp': {'address': '172.25.5.115'}}} Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 14:29:52.328660 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.5.115 (af7eedf8-0b13-4e68-bd9a-f8c7e101087c) with port c9d23981-0c41-4d35-a06a-5e586993cfe1 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 0e482852-0013-452e-b205-cea1a4f78a15. Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ef5ab16-eef4-4169-b0eb-0794e8591f49'] Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.5.115 (af7eedf8-0b13-4e68-bd9a-f8c7e101087c) with port c9d23981-0c41-4d35-a06a-5e586993cfe1 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 0e482852-0013-452e-b205-cea1a4f78a15. Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ef5ab16-eef4-4169-b0eb-0794e8591f49'] Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.5.115 (af7eedf8-0b13-4e68-bd9a-f8c7e101087c) with port c9d23981-0c41-4d35-a06a-5e586993cfe1 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 0e482852-0013-452e-b205-cea1a4f78a15. Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ef5ab16-eef4-4169-b0eb-0794e8591f49'] Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.5.115 (af7eedf8-0b13-4e68-bd9a-f8c7e101087c) with port c9d23981-0c41-4d35-a06a-5e586993cfe1 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 0e482852-0013-452e-b205-cea1a4f78a15. Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ef5ab16-eef4-4169-b0eb-0794e8591f49'] Jul 25 14:29:52.332639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:52.335632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b7f9c852-cde2-4dba-b107-e379134550f8 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Returning 400 to user: Cannot associate floating IP 172.25.5.115 (af7eedf8-0b13-4e68-bd9a-f8c7e101087c) with port c9d23981-0c41-4d35-a06a-5e586993cfe1 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 0e482852-0013-452e-b205-cea1a4f78a15. Jul 25 14:29:52.335632 n-d-846435-14 devstack@n-api.service[119304]: Neutron server returns request_ids: ['req-5ef5ab16-eef4-4169-b0eb-0794e8591f49'] {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:29:52.335632 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b7f9c852-cde2-4dba-b107-e379134550f8 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] 10.222.0.88 "POST /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff/action" status: 400 len: 382 microversion: 2.1 time: 0.834692 Jul 25 14:29:52.335632 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 670/1313] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:29:51 2022] POST /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff/action => generated 382 bytes in 839 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:29:52.338840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-2cc2ee40-85c8-4e25-9c13-7b5b1b4fd7e5 req-d69f36e0-6f7a-4dad-b119-f1db126f06e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74d6eac5-76ed-47bb-8e15-d6dea0e5618e", "tag": "e3504237-5bd2-4a4c-a8ef-533354ad94bb"}, {"server_uuid": "58fa156b-43cc-4633-b7bd-6ed9cc2bd220", "name": "network-vif-deleted", "tag": "84f2f14b-3637-41cb-ad13-2d25a69e7b91"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:52.373238 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-2cc2ee40-85c8-4e25-9c13-7b5b1b4fd7e5 req-d69f36e0-6f7a-4dad-b119-f1db126f06e4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:52.374126 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-2cc2ee40-85c8-4e25-9c13-7b5b1b4fd7e5 req-d69f36e0-6f7a-4dad-b119-f1db126f06e4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:52.401413 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-2cc2ee40-85c8-4e25-9c13-7b5b1b4fd7e5 req-d69f36e0-6f7a-4dad-b119-f1db126f06e4 service nova] Creating event network-changed:e3504237-5bd2-4a4c-a8ef-533354ad94bb for instance 74d6eac5-76ed-47bb-8e15-d6dea0e5618e on n-h2-846435-14 Jul 25 14:29:52.402644 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-2cc2ee40-85c8-4e25-9c13-7b5b1b4fd7e5 req-d69f36e0-6f7a-4dad-b119-f1db126f06e4 service nova] Creating event network-vif-deleted:84f2f14b-3637-41cb-ad13-2d25a69e7b91 for instance 58fa156b-43cc-4633-b7bd-6ed9cc2bd220 on n-h2-846435-14 Jul 25 14:29:52.412071 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-2cc2ee40-85c8-4e25-9c13-7b5b1b4fd7e5 req-d69f36e0-6f7a-4dad-b119-f1db126f06e4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.076323 Jul 25 14:29:52.416306 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 671/1314] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:52.433274 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c9b9dfce-c40d-402d-ac8d-f1448b3dc06c tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Calling method '.version_select at 0x7f468742aa60>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:52.444315 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:29:52.444315 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:29:52.447210 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c9b9dfce-c40d-402d-ac8d-f1448b3dc06c tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:52.448454 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c9b9dfce-c40d-402d-ac8d-f1448b3dc06c tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:52.450224 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c9b9dfce-c40d-402d-ac8d-f1448b3dc06c tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:52.453678 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c9b9dfce-c40d-402d-ac8d-f1448b3dc06c tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:52.527463 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c9b9dfce-c40d-402d-ac8d-f1448b3dc06c tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.108974 Jul 25 14:29:52.531794 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 672/1315] 10.222.0.88 () {58 vars in 1139 bytes} [Mon Jul 25 14:29:52 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:52.543313 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2cf12476-8200-41f8-92d5-5e1e2368724b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:52.544592 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2cf12476-8200-41f8-92d5-5e1e2368724b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:52.558879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2cf12476-8200-41f8-92d5-5e1e2368724b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:52.559536 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2cf12476-8200-41f8-92d5-5e1e2368724b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:52.560519 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2cf12476-8200-41f8-92d5-5e1e2368724b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:52.562799 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2cf12476-8200-41f8-92d5-5e1e2368724b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:52.843087 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2cf12476-8200-41f8-92d5-5e1e2368724b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:52.854388 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2cf12476-8200-41f8-92d5-5e1e2368724b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1541 microversion: 2.1 time: 0.320963 Jul 25 14:29:52.855042 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 673/1316] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:52 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1541 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:52.870250 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-81500ec1-1211-4203-b73b-3e5da91d2232 req-a6ef0941-79d5-425b-a215-7757a07c3a39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c", "tag": "eedb59eb-f3ec-476b-a198-201c579f3456"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:52.917296 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-81500ec1-1211-4203-b73b-3e5da91d2232 req-a6ef0941-79d5-425b-a215-7757a07c3a39 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:52.917868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-81500ec1-1211-4203-b73b-3e5da91d2232 req-a6ef0941-79d5-425b-a215-7757a07c3a39 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:52.952353 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-81500ec1-1211-4203-b73b-3e5da91d2232 req-a6ef0941-79d5-425b-a215-7757a07c3a39 service nova] Creating event network-changed:eedb59eb-f3ec-476b-a198-201c579f3456 for instance 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c on n-h1-846435-14 Jul 25 14:29:52.964852 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-81500ec1-1211-4203-b73b-3e5da91d2232 req-a6ef0941-79d5-425b-a215-7757a07c3a39 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106257 Jul 25 14:29:52.967561 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 674/1317] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:52.980554 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-23550419-e0c6-45d6-b696-7bab17e875a3 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:52.987177 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-23550419-e0c6-45d6-b696-7bab17e875a3 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 74d6eac5-76ed-47bb-8e15-d6dea0e5618e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:53.002583 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23550419-e0c6-45d6-b696-7bab17e875a3 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:53.003033 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23550419-e0c6-45d6-b696-7bab17e875a3 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:53.003826 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23550419-e0c6-45d6-b696-7bab17e875a3 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:53.004335 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23550419-e0c6-45d6-b696-7bab17e875a3 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:53.006388 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-8109d649-ccc2-4e3b-89da-428cfacb8e30 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 1c6f6d12-3660-40ec-bf99-d735fa9d0358] Updating instance_info_cache with network_info: [{"id": "fb6f83eb-2e87-4f51-aa28-9bf153938de2", "address": "fa:16:3e:e5:ec:22", "network": {"id": "8b75699c-1ef5-4c51-95ba-7d4e798771fe", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1225325178-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f1ca1e9beedc4892861051504a5dff08", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapfb6f83eb-2e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119303) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 14:29:53.023449 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8109d649-ccc2-4e3b-89da-428cfacb8e30 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Releasing lock "refresh_cache-1c6f6d12-3660-40ec-bf99-d735fa9d0358" {{(pid=119303) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 14:29:53.024401 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8109d649-ccc2-4e3b-89da-428cfacb8e30 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "POST /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358/action" status: 202 len: 0 microversion: 2.1 time: 2.002402 Jul 25 14:29:53.027531 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 644/1318] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:29:51 2022] POST /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358/action => generated 0 bytes in 2006 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 14:29:53.036373 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0f7c1a67-b89a-48c5-8f60-9b68633cc46e tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Calling method '.version_select at 0x7f468729e8b0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:53.273804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-23550419-e0c6-45d6-b696-7bab17e875a3 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f53d74a29243759065e68964f638dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d71324b22554a3bb44d6aceb7bc3cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:53.284486 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-23550419-e0c6-45d6-b696-7bab17e875a3 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e" status: 200 len: 1316 microversion: 2.1 time: 0.315342 Jul 25 14:29:53.285437 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 675/1319] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:52 2022] GET /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e => generated 1316 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:53.303498 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0c422725-abd5-4e75-a456-a1ad9589457a tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:53.304328 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0c422725-abd5-4e75-a456-a1ad9589457a tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:53.314812 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c422725-abd5-4e75-a456-a1ad9589457a tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:53.315958 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c422725-abd5-4e75-a456-a1ad9589457a tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:53.316815 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c422725-abd5-4e75-a456-a1ad9589457a tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:53.317255 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c422725-abd5-4e75-a456-a1ad9589457a tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:53.664573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0c422725-abd5-4e75-a456-a1ad9589457a tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:53.685352 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0c422725-abd5-4e75-a456-a1ad9589457a tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:53.689307 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0c422725-abd5-4e75-a456-a1ad9589457a tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:53.693923 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0c422725-abd5-4e75-a456-a1ad9589457a tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1874 microversion: 2.42 time: 0.397203 Jul 25 14:29:53.696910 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 676/1320] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:53 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1874 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:53.709215 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a48e2a7a-bc91-467b-b1d1-4a2dfacf8a30 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Calling method '.version_select at 0x7f46874e1790>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:53.722228 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:29:53.722228 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:29:53.723785 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a48e2a7a-bc91-467b-b1d1-4a2dfacf8a30 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:53.725492 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a48e2a7a-bc91-467b-b1d1-4a2dfacf8a30 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:53.732431 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a48e2a7a-bc91-467b-b1d1-4a2dfacf8a30 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:53.732431 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a48e2a7a-bc91-467b-b1d1-4a2dfacf8a30 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:53.799488 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a48e2a7a-bc91-467b-b1d1-4a2dfacf8a30 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.101114 Jul 25 14:29:53.804168 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 677/1321] 10.222.0.88 () {58 vars in 1145 bytes} [Mon Jul 25 14:29:53 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:29:53.820364 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-613a7123-79fc-4a33-bd71-12004399c691 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:53.821292 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-613a7123-79fc-4a33-bd71-12004399c691 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 58fa156b-43cc-4633-b7bd-6ed9cc2bd220] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:53.836919 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-613a7123-79fc-4a33-bd71-12004399c691 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:53.839340 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-613a7123-79fc-4a33-bd71-12004399c691 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:53.842209 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-613a7123-79fc-4a33-bd71-12004399c691 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:53.843122 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-613a7123-79fc-4a33-bd71-12004399c691 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:53.868450 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-613a7123-79fc-4a33-bd71-12004399c691 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] HTTP exception thrown: Instance 58fa156b-43cc-4633-b7bd-6ed9cc2bd220 could not be found. Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-613a7123-79fc-4a33-bd71-12004399c691 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Request method failure captured: Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220 HTTP/1.1 Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qiNaioZXMvHAxPupfZxzmqs4h9Cwus7RVJAYa6TyjvQb83_RlbMQ9YT1JRYD70WuHhpCPl9f99GXdEwZlhPtNst6oi1voAGgfmapw4V4s_Zur6Hv8mZaqp9S4CxN0ZG4imfeRS1VG-itDkKnnYKqxtpkI78bE45UFx_i7Pn_qhVNTg Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: f1ca1e9beedc4892861051504a5dff08 Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1691880843 Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f1ca1e9beedc4892861051504a5dff08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f1ca1e9beedc4892861051504a5dff08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f1ca1e9beedc4892861051504a5dff08", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f1ca1e9beedc4892861051504a5dff08"}]}] Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1691880843 Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: f1ca1e9beedc4892861051504a5dff08 Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1691880843 Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-FloatingIPsAssociationTestJSON-1691880843-project Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 774744dcf62f4ef78b4a2c8dfc96f9cd Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1691880843-project Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 58fa156b-43cc-4633-b7bd-6ed9cc2bd220 could not be found. Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '58fa156b-43cc-4633-b7bd-6ed9cc2bd220'} Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58fa156b-43cc-4633-b7bd-6ed9cc2bd220 could not be found. Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:29:53.870519 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:29:53.875581 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58fa156b-43cc-4633-b7bd-6ed9cc2bd220 could not be found. Jul 25 14:29:53.875581 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:53.875581 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:29:53.875581 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:53.875581 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:29:53.875581 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:29:53.875581 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:29:53.875581 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:29:53.875581 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:29:53.875581 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58fa156b-43cc-4633-b7bd-6ed9cc2bd220 could not be found. Jul 25 14:29:53.875581 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:53.875581 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-613a7123-79fc-4a33-bd71-12004399c691 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Returning 404 to user: Instance 58fa156b-43cc-4633-b7bd-6ed9cc2bd220 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:29:53.875581 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-613a7123-79fc-4a33-bd71-12004399c691 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "DELETE /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220" status: 404 len: 111 microversion: 2.1 time: 0.069029 Jul 25 14:29:53.876605 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 678/1322] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:29:53 2022] DELETE /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:29:53.884439 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-128f180e-6617-4ba3-b1e0-cd515d7c3565 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Calling method '.version_select at 0x7f46874e1700>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:53.887169 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:29:53.887169 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:29:53.888599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-128f180e-6617-4ba3-b1e0-cd515d7c3565 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:53.889159 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-128f180e-6617-4ba3-b1e0-cd515d7c3565 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:53.890221 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-128f180e-6617-4ba3-b1e0-cd515d7c3565 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:53.890750 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-128f180e-6617-4ba3-b1e0-cd515d7c3565 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:53.960196 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-128f180e-6617-4ba3-b1e0-cd515d7c3565 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.082638 Jul 25 14:29:53.961265 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 679/1323] 10.222.0.88 () {58 vars in 1128 bytes} [Mon Jul 25 14:29:53 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:53.966255 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b061ce52-720e-4f89-a991-61c383f9ee7e tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:53.967167 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b061ce52-720e-4f89-a991-61c383f9ee7e tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:53.975058 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b061ce52-720e-4f89-a991-61c383f9ee7e tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:53.976099 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b061ce52-720e-4f89-a991-61c383f9ee7e tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:53.979243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b061ce52-720e-4f89-a991-61c383f9ee7e tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:53.980038 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b061ce52-720e-4f89-a991-61c383f9ee7e tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:54.611234 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b061ce52-720e-4f89-a991-61c383f9ee7e tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:54.625102 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b061ce52-720e-4f89-a991-61c383f9ee7e tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1541 microversion: 2.1 time: 0.662381 Jul 25 14:29:54.626397 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 680/1324] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:53 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1541 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:54.646428 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e3d6723e-8627-46d2-9f4b-8589fce671b7 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:54.647211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e3d6723e-8627-46d2-9f4b-8589fce671b7 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 58fa156b-43cc-4633-b7bd-6ed9cc2bd220] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:54.654243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3d6723e-8627-46d2-9f4b-8589fce671b7 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:54.654804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3d6723e-8627-46d2-9f4b-8589fce671b7 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:54.656176 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3d6723e-8627-46d2-9f4b-8589fce671b7 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:54.656717 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3d6723e-8627-46d2-9f4b-8589fce671b7 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:54.676241 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-e3d6723e-8627-46d2-9f4b-8589fce671b7 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] HTTP exception thrown: Instance 58fa156b-43cc-4633-b7bd-6ed9cc2bd220 could not be found. Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e3d6723e-8627-46d2-9f4b-8589fce671b7 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Request method failure captured: Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220 HTTP/1.1 Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qiNaioZXMvHAxPupfZxzmqs4h9Cwus7RVJAYa6TyjvQb83_RlbMQ9YT1JRYD70WuHhpCPl9f99GXdEwZlhPtNst6oi1voAGgfmapw4V4s_Zur6Hv8mZaqp9S4CxN0ZG4imfeRS1VG-itDkKnnYKqxtpkI78bE45UFx_i7Pn_qhVNTg Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: f1ca1e9beedc4892861051504a5dff08 Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1691880843 Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f1ca1e9beedc4892861051504a5dff08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f1ca1e9beedc4892861051504a5dff08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f1ca1e9beedc4892861051504a5dff08", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f1ca1e9beedc4892861051504a5dff08"}]}] Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1691880843 Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: f1ca1e9beedc4892861051504a5dff08 Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1691880843 Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-FloatingIPsAssociationTestJSON-1691880843-project Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 774744dcf62f4ef78b4a2c8dfc96f9cd Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1691880843-project Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 58fa156b-43cc-4633-b7bd-6ed9cc2bd220 could not be found. Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '58fa156b-43cc-4633-b7bd-6ed9cc2bd220'} Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58fa156b-43cc-4633-b7bd-6ed9cc2bd220 could not be found. Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58fa156b-43cc-4633-b7bd-6ed9cc2bd220 could not be found. Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:54.679940 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:29:54.685171 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:54.685171 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:29:54.685171 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:29:54.685171 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:29:54.685171 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:29:54.685171 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:29:54.685171 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58fa156b-43cc-4633-b7bd-6ed9cc2bd220 could not be found. Jul 25 14:29:54.685171 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:29:54.685171 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e3d6723e-8627-46d2-9f4b-8589fce671b7 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Returning 404 to user: Instance 58fa156b-43cc-4633-b7bd-6ed9cc2bd220 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:29:54.687562 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e3d6723e-8627-46d2-9f4b-8589fce671b7 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "GET /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220" status: 404 len: 111 microversion: 2.1 time: 0.059877 Jul 25 14:29:54.688715 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 681/1325] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:54 2022] GET /compute/v2.1/servers/58fa156b-43cc-4633-b7bd-6ed9cc2bd220 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:29:54.693607 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3042ad2f-1ed7-4b04-a4b8-125c3317b684 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Calling method '.version_select at 0x7f46875214c0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:54.696995 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:29:54.696995 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:29:54.698478 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3042ad2f-1ed7-4b04-a4b8-125c3317b684 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:54.699091 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3042ad2f-1ed7-4b04-a4b8-125c3317b684 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:54.699889 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3042ad2f-1ed7-4b04-a4b8-125c3317b684 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:54.700482 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3042ad2f-1ed7-4b04-a4b8-125c3317b684 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:54.727095 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3042ad2f-1ed7-4b04-a4b8-125c3317b684 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.036753 Jul 25 14:29:54.727896 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 682/1326] 10.222.0.88 () {58 vars in 1155 bytes} [Mon Jul 25 14:29:54 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:54.733343 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5b8e9a71-4f1c-47db-8867-c348deca9884 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:54.733343 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5b8e9a71-4f1c-47db-8867-c348deca9884 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 74d6eac5-76ed-47bb-8e15-d6dea0e5618e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:54.739360 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b8e9a71-4f1c-47db-8867-c348deca9884 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:54.740045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b8e9a71-4f1c-47db-8867-c348deca9884 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:54.741137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b8e9a71-4f1c-47db-8867-c348deca9884 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:54.741757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b8e9a71-4f1c-47db-8867-c348deca9884 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:54.965532 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5b8e9a71-4f1c-47db-8867-c348deca9884 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f53d74a29243759065e68964f638dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d71324b22554a3bb44d6aceb7bc3cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:54.973927 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5b8e9a71-4f1c-47db-8867-c348deca9884 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e" status: 200 len: 1316 microversion: 2.1 time: 0.244924 Jul 25 14:29:54.975228 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 683/1327] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:54 2022] GET /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e => generated 1316 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:54.980141 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-8cf162b4-a6f7-462b-b1fb-cfcc334a717a req-388c10f2-49af-475e-95ad-5877a1c2a88f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c6f6d12-3660-40ec-bf99-d735fa9d0358", "tag": "fb6f83eb-2e87-4f51-aa28-9bf153938de2"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:54.991363 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-8cf162b4-a6f7-462b-b1fb-cfcc334a717a req-388c10f2-49af-475e-95ad-5877a1c2a88f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:54.992050 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-8cf162b4-a6f7-462b-b1fb-cfcc334a717a req-388c10f2-49af-475e-95ad-5877a1c2a88f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:55.006824 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-8cf162b4-a6f7-462b-b1fb-cfcc334a717a req-388c10f2-49af-475e-95ad-5877a1c2a88f service nova] Creating event network-changed:fb6f83eb-2e87-4f51-aa28-9bf153938de2 for instance 1c6f6d12-3660-40ec-bf99-d735fa9d0358 on n-h2-846435-14 Jul 25 14:29:55.012107 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-8cf162b4-a6f7-462b-b1fb-cfcc334a717a req-388c10f2-49af-475e-95ad-5877a1c2a88f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035465 Jul 25 14:29:55.012862 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 684/1328] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:55.018411 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b2d2822e-a4fb-4ebd-b324-b77d1f218acf tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '.version_select at 0x7f46873c3a60>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:55.432672 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0f7c1a67-b89a-48c5-8f60-9b68633cc46e tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] 10.222.0.88 "DELETE /compute/v2.1/os-floating-ips/af7eedf8-0b13-4e68-bd9a-f8c7e101087c" status: 202 len: 0 microversion: 2.1 time: 2.402241 Jul 25 14:29:55.432672 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 645/1329] 10.222.0.88 () {58 vars in 1263 bytes} [Mon Jul 25 14:29:53 2022] DELETE /compute/v2.1/os-floating-ips/af7eedf8-0b13-4e68-bd9a-f8c7e101087c => generated 0 bytes in 2404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:29:55.440543 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dfdd0118-49be-468e-8420-ef7b499c8bb4 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:55.440941 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-dfdd0118-49be-468e-8420-ef7b499c8bb4 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:55.458283 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dfdd0118-49be-468e-8420-ef7b499c8bb4 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:55.458736 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dfdd0118-49be-468e-8420-ef7b499c8bb4 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:55.459550 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dfdd0118-49be-468e-8420-ef7b499c8bb4 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:55.460036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dfdd0118-49be-468e-8420-ef7b499c8bb4 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:55.848272 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-dfdd0118-49be-468e-8420-ef7b499c8bb4 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:55.864125 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-dfdd0118-49be-468e-8420-ef7b499c8bb4 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:55.865932 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-dfdd0118-49be-468e-8420-ef7b499c8bb4 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:55.868133 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dfdd0118-49be-468e-8420-ef7b499c8bb4 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1874 microversion: 2.42 time: 0.435386 Jul 25 14:29:55.869477 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 646/1330] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:55 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1874 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:55.875485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-abb55fc8-8147-44c1-85cf-8279e441ee06 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Calling method '.version_select at 0x7f4687285f70>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:55.878403 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:29:55.878403 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:29:55.880130 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-abb55fc8-8147-44c1-85cf-8279e441ee06 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:55.880776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-abb55fc8-8147-44c1-85cf-8279e441ee06 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:55.881803 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-abb55fc8-8147-44c1-85cf-8279e441ee06 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:55.887439 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-abb55fc8-8147-44c1-85cf-8279e441ee06 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:55.921138 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-abb55fc8-8147-44c1-85cf-8279e441ee06 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.049801 Jul 25 14:29:55.922339 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 647/1331] 10.222.0.88 () {58 vars in 1128 bytes} [Mon Jul 25 14:29:55 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:55.927754 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-86be079c-d9c2-4891-9a0b-bc10977a00a2 req-acdce4a5-1f71-4728-8f7f-ac0557a38d88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698a551a-c019-4ae5-ba50-0d190e41ff03", "name": "network-vif-unplugged", "status": "completed", "tag": "a454c550-e298-46f0-8c6c-7d7c39505dca"}, {"name": "network-changed", "server_uuid": "698a551a-c019-4ae5-ba50-0d190e41ff03", "tag": "a454c550-e298-46f0-8c6c-7d7c39505dca"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:55.939558 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-86be079c-d9c2-4891-9a0b-bc10977a00a2 req-acdce4a5-1f71-4728-8f7f-ac0557a38d88 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:55.940429 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-86be079c-d9c2-4891-9a0b-bc10977a00a2 req-acdce4a5-1f71-4728-8f7f-ac0557a38d88 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:55.957208 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-86be079c-d9c2-4891-9a0b-bc10977a00a2 req-acdce4a5-1f71-4728-8f7f-ac0557a38d88 service nova] Creating event network-vif-unplugged:a454c550-e298-46f0-8c6c-7d7c39505dca for instance 698a551a-c019-4ae5-ba50-0d190e41ff03 on n-h1-846435-14 Jul 25 14:29:55.958000 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-86be079c-d9c2-4891-9a0b-bc10977a00a2 req-acdce4a5-1f71-4728-8f7f-ac0557a38d88 service nova] Creating event network-changed:a454c550-e298-46f0-8c6c-7d7c39505dca for instance 698a551a-c019-4ae5-ba50-0d190e41ff03 on n-h1-846435-14 Jul 25 14:29:55.966150 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [req-86be079c-d9c2-4891-9a0b-bc10977a00a2 req-acdce4a5-1f71-4728-8f7f-ac0557a38d88 service nova] Instance 698a551a-c019-4ae5-ba50-0d190e41ff03 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119303) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 14:29:55.977658 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-86be079c-d9c2-4891-9a0b-bc10977a00a2 req-acdce4a5-1f71-4728-8f7f-ac0557a38d88 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.053838 Jul 25 14:29:55.978079 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b2d2822e-a4fb-4ebd-b324-b77d1f218acf tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "DELETE /compute/v2.1/os-floating-ips/b2455b2d-5961-4b4a-8272-ed726aaade1a" status: 202 len: 0 microversion: 2.1 time: 0.963225 Jul 25 14:29:55.978578 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 648/1332] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:55.978915 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 685/1333] 10.222.0.88 () {58 vars in 1263 bytes} [Mon Jul 25 14:29:55 2022] DELETE /compute/v2.1/os-floating-ips/b2455b2d-5961-4b4a-8272-ed726aaade1a => generated 0 bytes in 965 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:29:55.985142 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a25ebcec-12d1-4cad-bf3e-eea350b43d1e tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.92"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:55.985762 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3f0153ac-1bc2-4502-a20d-8bc4c0953a5f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:55.986496 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3f0153ac-1bc2-4502-a20d-8bc4c0953a5f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:55.999817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f0153ac-1bc2-4502-a20d-8bc4c0953a5f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:56.000940 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f0153ac-1bc2-4502-a20d-8bc4c0953a5f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:56.002173 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f0153ac-1bc2-4502-a20d-8bc4c0953a5f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:56.003040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f0153ac-1bc2-4502-a20d-8bc4c0953a5f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:56.200917 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3f0153ac-1bc2-4502-a20d-8bc4c0953a5f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:56.209332 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3f0153ac-1bc2-4502-a20d-8bc4c0953a5f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1473 microversion: 2.1 time: 0.229341 Jul 25 14:29:56.210381 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 686/1334] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:55 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1473 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:56.215318 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-451378b2-81d2-4d9e-84e4-5a2f85897983 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Calling method '.version_select at 0x7f468742aa60>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:56.216252 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:29:56.216252 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:29:56.233133 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-451378b2-81d2-4d9e-84e4-5a2f85897983 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:56.233878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-451378b2-81d2-4d9e-84e4-5a2f85897983 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:56.249114 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-451378b2-81d2-4d9e-84e4-5a2f85897983 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:56.249564 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-451378b2-81d2-4d9e-84e4-5a2f85897983 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:56.279250 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-451378b2-81d2-4d9e-84e4-5a2f85897983 tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hosts/n-h1-846435-14" status: 200 len: 867 microversion: 2.1 time: 0.067466 Jul 25 14:29:56.280131 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 687/1335] 10.222.0.88 () {58 vars in 1173 bytes} [Mon Jul 25 14:29:56 2022] GET /compute/v2.1/os-hosts/n-h1-846435-14 => generated 867 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:56.289317 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5b1dfc26-2844-4ae0-b414-f7c93420967e tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:56.289962 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5b1dfc26-2844-4ae0-b414-f7c93420967e tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 1c6f6d12-3660-40ec-bf99-d735fa9d0358] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:56.299713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b1dfc26-2844-4ae0-b414-f7c93420967e tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:56.300760 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b1dfc26-2844-4ae0-b414-f7c93420967e tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:56.301726 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b1dfc26-2844-4ae0-b414-f7c93420967e tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:56.302463 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b1dfc26-2844-4ae0-b414-f7c93420967e tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:56.321266 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:29:56.332929 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5b1dfc26-2844-4ae0-b414-f7c93420967e tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 1c6f6d12-3660-40ec-bf99-d735fa9d0358] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:29:56.423322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:29:56.426690 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a25ebcec-12d1-4cad-bf3e-eea350b43d1e tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] [instance: 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:56.435505 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5b1dfc26-2844-4ae0-b414-f7c93420967e tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "DELETE /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358" status: 204 len: 0 microversion: 2.1 time: 0.150054 Jul 25 14:29:56.436552 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a25ebcec-12d1-4cad-bf3e-eea350b43d1e tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:56.437582 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a25ebcec-12d1-4cad-bf3e-eea350b43d1e tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:56.439074 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a25ebcec-12d1-4cad-bf3e-eea350b43d1e tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:56.439513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a25ebcec-12d1-4cad-bf3e-eea350b43d1e tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:56.442953 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 688/1336] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:29:56 2022] DELETE /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:29:56.454180 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d50a0e9b-9abe-4a96-a4b6-80213613d609 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:56.455081 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d50a0e9b-9abe-4a96-a4b6-80213613d609 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 74d6eac5-76ed-47bb-8e15-d6dea0e5618e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:56.462291 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d50a0e9b-9abe-4a96-a4b6-80213613d609 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:56.462824 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d50a0e9b-9abe-4a96-a4b6-80213613d609 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:56.463742 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d50a0e9b-9abe-4a96-a4b6-80213613d609 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:56.464287 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d50a0e9b-9abe-4a96-a4b6-80213613d609 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:56.694468 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d50a0e9b-9abe-4a96-a4b6-80213613d609 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f53d74a29243759065e68964f638dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d71324b22554a3bb44d6aceb7bc3cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:56.712155 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d50a0e9b-9abe-4a96-a4b6-80213613d609 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e" status: 200 len: 1316 microversion: 2.1 time: 0.260388 Jul 25 14:29:56.713098 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 689/1337] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:56 2022] GET /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e => generated 1316 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:56.723662 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d091ca6a-9b57-45e1-bf47-799d5ce8c47f tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Calling method '.version_select at 0x7f46873fe160>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:56.726946 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:29:56.726946 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:29:56.744504 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d091ca6a-9b57-45e1-bf47-799d5ce8c47f tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:56.745581 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d091ca6a-9b57-45e1-bf47-799d5ce8c47f tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:56.764552 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d091ca6a-9b57-45e1-bf47-799d5ce8c47f tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:56.765210 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d091ca6a-9b57-45e1-bf47-799d5ce8c47f tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:56.790918 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d091ca6a-9b57-45e1-bf47-799d5ce8c47f tempest-HostsAdminTestJSON-1883948259 tempest-HostsAdminTestJSON-1883948259-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hosts/n-h2-846435-14" status: 200 len: 735 microversion: 2.1 time: 0.075237 Jul 25 14:29:56.791564 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 690/1338] 10.222.0.88 () {58 vars in 1173 bytes} [Mon Jul 25 14:29:56 2022] GET /compute/v2.1/os-hosts/n-h2-846435-14 => generated 735 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:56.802052 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-63102c50-6858-48bd-ae07-29246abf3a1d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:56.802676 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-63102c50-6858-48bd-ae07-29246abf3a1d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 1c6f6d12-3660-40ec-bf99-d735fa9d0358] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:56.809644 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63102c50-6858-48bd-ae07-29246abf3a1d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:56.810126 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63102c50-6858-48bd-ae07-29246abf3a1d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:56.810976 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63102c50-6858-48bd-ae07-29246abf3a1d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:56.811547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63102c50-6858-48bd-ae07-29246abf3a1d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:56.813112 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a25ebcec-12d1-4cad-bf3e-eea350b43d1e tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Acquired lock "refresh_cache-520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff" {{(pid=119303) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 14:29:57.118336 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-63102c50-6858-48bd-ae07-29246abf3a1d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774744dcf62f4ef78b4a2c8dfc96f9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ca1e9beedc4892861051504a5dff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:57.127581 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-63102c50-6858-48bd-ae07-29246abf3a1d tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358" status: 200 len: 1525 microversion: 2.1 time: 0.329421 Jul 25 14:29:57.135014 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 691/1339] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:56 2022] GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358 => generated 1525 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:57.144656 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ce9933c7-4183-4ffe-9d41-99edbea17538 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:57.145989 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ce9933c7-4183-4ffe-9d41-99edbea17538 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:57.167933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce9933c7-4183-4ffe-9d41-99edbea17538 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:57.168423 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce9933c7-4183-4ffe-9d41-99edbea17538 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:57.169227 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce9933c7-4183-4ffe-9d41-99edbea17538 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:57.187109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce9933c7-4183-4ffe-9d41-99edbea17538 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:57.705816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ce9933c7-4183-4ffe-9d41-99edbea17538 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:57.717124 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ce9933c7-4183-4ffe-9d41-99edbea17538 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:57.719120 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ce9933c7-4183-4ffe-9d41-99edbea17538 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:57.720920 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ce9933c7-4183-4ffe-9d41-99edbea17538 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1874 microversion: 2.42 time: 0.584462 Jul 25 14:29:57.734572 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 692/1340] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:29:57 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1874 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:29:57.745556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b3acb68f-2f50-47d6-a8b2-341356702bf1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:57.746209 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b3acb68f-2f50-47d6-a8b2-341356702bf1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:57.756004 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b3acb68f-2f50-47d6-a8b2-341356702bf1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:57.756369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b3acb68f-2f50-47d6-a8b2-341356702bf1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:57.757174 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b3acb68f-2f50-47d6-a8b2-341356702bf1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:57.757662 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b3acb68f-2f50-47d6-a8b2-341356702bf1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:58.312984 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b3acb68f-2f50-47d6-a8b2-341356702bf1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:58.321412 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b3acb68f-2f50-47d6-a8b2-341356702bf1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1470 microversion: 2.1 time: 0.585555 Jul 25 14:29:58.324590 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 693/1341] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:57 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1470 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:58.338338 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-87e71c8e-a731-4f51-97e8-c1478c990a28 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:58.339295 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-87e71c8e-a731-4f51-97e8-c1478c990a28 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 74d6eac5-76ed-47bb-8e15-d6dea0e5618e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:58.347698 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-a25ebcec-12d1-4cad-bf3e-eea350b43d1e tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] [instance: 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff] Building network info cache for instance {{(pid=119303) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 14:29:58.352867 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-87e71c8e-a731-4f51-97e8-c1478c990a28 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:58.364779 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-87e71c8e-a731-4f51-97e8-c1478c990a28 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:58.366087 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-87e71c8e-a731-4f51-97e8-c1478c990a28 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:58.366770 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-87e71c8e-a731-4f51-97e8-c1478c990a28 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:58.764303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-87e71c8e-a731-4f51-97e8-c1478c990a28 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f53d74a29243759065e68964f638dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d71324b22554a3bb44d6aceb7bc3cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:58.772502 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-87e71c8e-a731-4f51-97e8-c1478c990a28 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e" status: 200 len: 1316 microversion: 2.1 time: 0.444294 Jul 25 14:29:58.779784 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 694/1342] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:58 2022] GET /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e => generated 1316 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:58.796875 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-358c72fe-6b61-46f7-a53f-454bd5f08f4f tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:29:58.798731 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-358c72fe-6b61-46f7-a53f-454bd5f08f4f tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 1c6f6d12-3660-40ec-bf99-d735fa9d0358] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:58.854508 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-358c72fe-6b61-46f7-a53f-454bd5f08f4f tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:58.856813 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-358c72fe-6b61-46f7-a53f-454bd5f08f4f tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:58.875051 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-358c72fe-6b61-46f7-a53f-454bd5f08f4f tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:58.875678 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-358c72fe-6b61-46f7-a53f-454bd5f08f4f tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:59.454618 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-358c72fe-6b61-46f7-a53f-454bd5f08f4f tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774744dcf62f4ef78b4a2c8dfc96f9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ca1e9beedc4892861051504a5dff08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:29:59.479621 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-358c72fe-6b61-46f7-a53f-454bd5f08f4f tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358" status: 200 len: 1483 microversion: 2.1 time: 0.694246 Jul 25 14:29:59.481128 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 695/1343] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:29:58 2022] GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358 => generated 1483 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:29:59.494426 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-428b3a53-8815-4ae9-bc50-5f1aa53fdd1c req-a94db381-c7b9-4b75-a7e0-f65c6382a3bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff", "tag": "c9d23981-0c41-4d35-a06a-5e586993cfe1"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:59.512238 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-428b3a53-8815-4ae9-bc50-5f1aa53fdd1c req-a94db381-c7b9-4b75-a7e0-f65c6382a3bb service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:59.513018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-428b3a53-8815-4ae9-bc50-5f1aa53fdd1c req-a94db381-c7b9-4b75-a7e0-f65c6382a3bb service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:59.532949 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-428b3a53-8815-4ae9-bc50-5f1aa53fdd1c req-a94db381-c7b9-4b75-a7e0-f65c6382a3bb service nova] Creating event network-changed:c9d23981-0c41-4d35-a06a-5e586993cfe1 for instance 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff on n-h1-846435-14 Jul 25 14:29:59.546556 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-428b3a53-8815-4ae9-bc50-5f1aa53fdd1c req-a94db381-c7b9-4b75-a7e0-f65c6382a3bb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061493 Jul 25 14:29:59.547710 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 696/1344] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:29:59.554261 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4381f1c4-c9f4-4b89-81d5-1e54e9058583 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:29:59.555422 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4381f1c4-c9f4-4b89-81d5-1e54e9058583 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:29:59.565390 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4381f1c4-c9f4-4b89-81d5-1e54e9058583 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:59.565963 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4381f1c4-c9f4-4b89-81d5-1e54e9058583 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:59.570716 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4381f1c4-c9f4-4b89-81d5-1e54e9058583 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:59.585395 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4381f1c4-c9f4-4b89-81d5-1e54e9058583 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:59.697566 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4381f1c4-c9f4-4b89-81d5-1e54e9058583 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:59.697938 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4381f1c4-c9f4-4b89-81d5-1e54e9058583 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:59.701830 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4381f1c4-c9f4-4b89-81d5-1e54e9058583 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:29:59.702484 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4381f1c4-c9f4-4b89-81d5-1e54e9058583 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:29:59.790299 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-4381f1c4-c9f4-4b89-81d5-1e54e9058583 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Getting quotas for project 887aa20d1838484eb895896f8f76ce41. Resources: {'cores', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:29:59.814116 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-4381f1c4-c9f4-4b89-81d5-1e54e9058583 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Getting quotas for user 00aea97fb95c44cfa5dce25e9a06cd37 and project 887aa20d1838484eb895896f8f76ce41. Resources: {'cores', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:30:00.053533 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4381f1c4-c9f4-4b89-81d5-1e54e9058583 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "POST /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03/action" status: 202 len: 0 microversion: 2.1 time: 0.502138 Jul 25 14:30:00.056410 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 697/1345] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:29:59 2022] POST /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:30:00.077492 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-61a4e415-f0dd-4220-8084-3d24562cecaf tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:00.079556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-61a4e415-f0dd-4220-8084-3d24562cecaf tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:00.106402 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-61a4e415-f0dd-4220-8084-3d24562cecaf tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:00.107374 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-61a4e415-f0dd-4220-8084-3d24562cecaf tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:00.114246 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-61a4e415-f0dd-4220-8084-3d24562cecaf tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:00.115083 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-61a4e415-f0dd-4220-8084-3d24562cecaf tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:00.335858 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-a25ebcec-12d1-4cad-bf3e-eea350b43d1e tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] [instance: 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff] Updating instance_info_cache with network_info: [{"id": "c9d23981-0c41-4d35-a06a-5e586993cfe1", "address": "fa:16:3e:b9:b4:64", "network": {"id": "2e368455-5d90-4a10-bf11-77a659392581", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-221161537-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ad625845a6ea4b87b22bee984224c130", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc9d23981-0c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119303) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 14:30:00.387423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a25ebcec-12d1-4cad-bf3e-eea350b43d1e tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Releasing lock "refresh_cache-520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff" {{(pid=119303) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 14:30:00.390252 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a25ebcec-12d1-4cad-bf3e-eea350b43d1e tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] 10.222.0.88 "POST /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff/action" status: 202 len: 0 microversion: 2.1 time: 4.410195 Jul 25 14:30:00.391077 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 649/1346] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:29:55 2022] POST /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff/action => generated 0 bytes in 4412 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 14:30:00.402088 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-940be8f3-a60b-4144-a71d-eca84f6dae40 req-138c4c18-cf3b-4cda-af42-424a345cb312 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74d6eac5-76ed-47bb-8e15-d6dea0e5618e", "name": "network-vif-plugged", "status": "completed", "tag": "e3504237-5bd2-4a4c-a8ef-533354ad94bb"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:00.421613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-940be8f3-a60b-4144-a71d-eca84f6dae40 req-138c4c18-cf3b-4cda-af42-424a345cb312 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:00.422328 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-940be8f3-a60b-4144-a71d-eca84f6dae40 req-138c4c18-cf3b-4cda-af42-424a345cb312 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:00.454260 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-940be8f3-a60b-4144-a71d-eca84f6dae40 req-138c4c18-cf3b-4cda-af42-424a345cb312 service nova] Creating event network-vif-plugged:e3504237-5bd2-4a4c-a8ef-533354ad94bb for instance 74d6eac5-76ed-47bb-8e15-d6dea0e5618e on n-h2-846435-14 Jul 25 14:30:00.460942 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-940be8f3-a60b-4144-a71d-eca84f6dae40 req-138c4c18-cf3b-4cda-af42-424a345cb312 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067703 Jul 25 14:30:00.462097 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 650/1347] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:30:00.470846 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-39af9514-05eb-4238-92eb-d300b460b419 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:00.472100 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-39af9514-05eb-4238-92eb-d300b460b419 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 74d6eac5-76ed-47bb-8e15-d6dea0e5618e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:00.483354 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-39af9514-05eb-4238-92eb-d300b460b419 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:00.486902 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-39af9514-05eb-4238-92eb-d300b460b419 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:00.488631 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-39af9514-05eb-4238-92eb-d300b460b419 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:00.489316 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-39af9514-05eb-4238-92eb-d300b460b419 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:00.854159 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-39af9514-05eb-4238-92eb-d300b460b419 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f53d74a29243759065e68964f638dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d71324b22554a3bb44d6aceb7bc3cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:00.866795 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-39af9514-05eb-4238-92eb-d300b460b419 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e" status: 200 len: 1316 microversion: 2.1 time: 0.403133 Jul 25 14:30:00.868077 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 651/1348] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:00 2022] GET /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e => generated 1316 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:00.880156 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-25b0d321-f57e-4cb5-bc32-16cd61ce321d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:00.883636 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-25b0d321-f57e-4cb5-bc32-16cd61ce321d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:00.892031 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:30:00.895651 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-25b0d321-f57e-4cb5-bc32-16cd61ce321d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:00.896352 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-25b0d321-f57e-4cb5-bc32-16cd61ce321d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:00.898088 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-25b0d321-f57e-4cb5-bc32-16cd61ce321d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:00.898784 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-25b0d321-f57e-4cb5-bc32-16cd61ce321d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:01.232093 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-25b0d321-f57e-4cb5-bc32-16cd61ce321d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:01.237543 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=4,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=3,nova_cell1:RELEASE=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:30:01.250087 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-25b0d321-f57e-4cb5-bc32-16cd61ce321d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1469 microversion: 2.1 time: 0.380500 Jul 25 14:30:01.254968 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 652/1349] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:00 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1469 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:01.263770 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2bc163bd-259d-4545-bc5b-c08dd977b9ad tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Calling method '.version_select at 0x7f468724a5e0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:01.389849 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-61a4e415-f0dd-4220-8084-3d24562cecaf tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:01.402704 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-61a4e415-f0dd-4220-8084-3d24562cecaf tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:01.405394 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-61a4e415-f0dd-4220-8084-3d24562cecaf tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:01.406843 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-61a4e415-f0dd-4220-8084-3d24562cecaf tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1874 microversion: 2.42 time: 1.348122 Jul 25 14:30:01.407612 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 698/1350] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:30:00 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1874 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:30:01.412652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-97cde8a7-97c9-4f94-90b8-6d4ee96318b5 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:01.413514 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-97cde8a7-97c9-4f94-90b8-6d4ee96318b5 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] [instance: 1c6f6d12-3660-40ec-bf99-d735fa9d0358] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:01.420196 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-97cde8a7-97c9-4f94-90b8-6d4ee96318b5 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:01.420940 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-97cde8a7-97c9-4f94-90b8-6d4ee96318b5 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:01.423705 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-97cde8a7-97c9-4f94-90b8-6d4ee96318b5 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:01.424382 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-97cde8a7-97c9-4f94-90b8-6d4ee96318b5 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:01.441363 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-97cde8a7-97c9-4f94-90b8-6d4ee96318b5 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] HTTP exception thrown: Instance 1c6f6d12-3660-40ec-bf99-d735fa9d0358 could not be found. Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-97cde8a7-97c9-4f94-90b8-6d4ee96318b5 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Request method failure captured: Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358 HTTP/1.1 Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qiNaioZXMvHAxPupfZxzmqs4h9Cwus7RVJAYa6TyjvQb83_RlbMQ9YT1JRYD70WuHhpCPl9f99GXdEwZlhPtNst6oi1voAGgfmapw4V4s_Zur6Hv8mZaqp9S4CxN0ZG4imfeRS1VG-itDkKnnYKqxtpkI78bE45UFx_i7Pn_qhVNTg Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: f1ca1e9beedc4892861051504a5dff08 Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1691880843 Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f1ca1e9beedc4892861051504a5dff08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f1ca1e9beedc4892861051504a5dff08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f1ca1e9beedc4892861051504a5dff08", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f1ca1e9beedc4892861051504a5dff08"}]}] Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1691880843 Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: f1ca1e9beedc4892861051504a5dff08 Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1691880843 Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-FloatingIPsAssociationTestJSON-1691880843-project Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 774744dcf62f4ef78b4a2c8dfc96f9cd Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1691880843-project Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 1c6f6d12-3660-40ec-bf99-d735fa9d0358 could not be found. Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '1c6f6d12-3660-40ec-bf99-d735fa9d0358'} Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c6f6d12-3660-40ec-bf99-d735fa9d0358 could not be found. Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c6f6d12-3660-40ec-bf99-d735fa9d0358 could not be found. Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:01.443414 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:01.448117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:01.448117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:01.448117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:01.448117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:01.448117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:30:01.448117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:30:01.448117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c6f6d12-3660-40ec-bf99-d735fa9d0358 could not be found. Jul 25 14:30:01.448117 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:01.451641 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-97cde8a7-97c9-4f94-90b8-6d4ee96318b5 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] Returning 404 to user: Instance 1c6f6d12-3660-40ec-bf99-d735fa9d0358 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:30:01.452831 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-97cde8a7-97c9-4f94-90b8-6d4ee96318b5 tempest-FloatingIPsAssociationTestJSON-1691880843 tempest-FloatingIPsAssociationTestJSON-1691880843-project] 10.222.0.88 "GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358" status: 404 len: 111 microversion: 2.1 time: 0.043886 Jul 25 14:30:01.454079 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 699/1351] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:01 2022] GET /compute/v2.1/servers/1c6f6d12-3660-40ec-bf99-d735fa9d0358 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:30:01.591810 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-59422701-33c8-4c91-ac89-13852032bc31 req-d8decad3-3540-4f57-898a-38e4aa4e6458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c6f6d12-3660-40ec-bf99-d735fa9d0358", "name": "network-vif-deleted", "tag": "fb6f83eb-2e87-4f51-aa28-9bf153938de2"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:01.615407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-59422701-33c8-4c91-ac89-13852032bc31 req-d8decad3-3540-4f57-898a-38e4aa4e6458 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:01.618438 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-59422701-33c8-4c91-ac89-13852032bc31 req-d8decad3-3540-4f57-898a-38e4aa4e6458 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:01.649849 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-59422701-33c8-4c91-ac89-13852032bc31 req-d8decad3-3540-4f57-898a-38e4aa4e6458 service nova] Creating event network-vif-deleted:fb6f83eb-2e87-4f51-aa28-9bf153938de2 for instance 1c6f6d12-3660-40ec-bf99-d735fa9d0358 on n-h2-846435-14 Jul 25 14:30:01.689896 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-59422701-33c8-4c91-ac89-13852032bc31 req-d8decad3-3540-4f57-898a-38e4aa4e6458 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095247 Jul 25 14:30:01.691770 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 700/1352] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:30:01.890432 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7646d594-4661-4f3e-8b13-7abc455b4320 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:01.891371 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7646d594-4661-4f3e-8b13-7abc455b4320 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 74d6eac5-76ed-47bb-8e15-d6dea0e5618e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:01.917780 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7646d594-4661-4f3e-8b13-7abc455b4320 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:01.919304 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7646d594-4661-4f3e-8b13-7abc455b4320 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:01.921719 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7646d594-4661-4f3e-8b13-7abc455b4320 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:01.926670 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7646d594-4661-4f3e-8b13-7abc455b4320 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:02.620693 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7646d594-4661-4f3e-8b13-7abc455b4320 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f53d74a29243759065e68964f638dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d71324b22554a3bb44d6aceb7bc3cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:02.631524 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7646d594-4661-4f3e-8b13-7abc455b4320 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e" status: 200 len: 1316 microversion: 2.1 time: 0.747746 Jul 25 14:30:02.632163 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 701/1353] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:01 2022] GET /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e => generated 1316 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:02.652137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2e2ae588-6796-4237-b8a4-b403a562fa73 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:02.652766 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2e2ae588-6796-4237-b8a4-b403a562fa73 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:02.677448 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2e2ae588-6796-4237-b8a4-b403a562fa73 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:02.677562 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2e2ae588-6796-4237-b8a4-b403a562fa73 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:02.678313 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2e2ae588-6796-4237-b8a4-b403a562fa73 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:02.678746 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2e2ae588-6796-4237-b8a4-b403a562fa73 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:02.732961 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:30:02.995655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2e2ae588-6796-4237-b8a4-b403a562fa73 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:03.010672 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2e2ae588-6796-4237-b8a4-b403a562fa73 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1469 microversion: 2.1 time: 0.375168 Jul 25 14:30:03.011896 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 702/1354] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:02 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1469 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:03.029269 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-67796fc1-a59e-4de2-953e-10fdbd22e03c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:03.030343 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-67796fc1-a59e-4de2-953e-10fdbd22e03c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:03.041523 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-67796fc1-a59e-4de2-953e-10fdbd22e03c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:03.042342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-67796fc1-a59e-4de2-953e-10fdbd22e03c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:03.043279 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-67796fc1-a59e-4de2-953e-10fdbd22e03c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:03.044973 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-67796fc1-a59e-4de2-953e-10fdbd22e03c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:03.313075 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2bc163bd-259d-4545-bc5b-c08dd977b9ad tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] 10.222.0.88 "DELETE /compute/v2.1/os-floating-ips/92f0471d-e66c-47cd-b853-56efa7b20341" status: 202 len: 0 microversion: 2.1 time: 2.055730 Jul 25 14:30:03.320140 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 653/1355] 10.222.0.88 () {58 vars in 1263 bytes} [Mon Jul 25 14:30:01 2022] DELETE /compute/v2.1/os-floating-ips/92f0471d-e66c-47cd-b853-56efa7b20341 => generated 0 bytes in 2058 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:30:03.325307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-de9ce379-1996-4156-8073-d20e5018f48d tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-de9ce379-1996-4156-8073-d20e5018f48d tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Request method failure captured: Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff/action HTTP/1.1 Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 34 Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qjCfxmZ_zoz5tZWTUa6ftqwLmr82iUZ_14Ovsmd3NdwrBu_a9sVwju_No84u4K9igULZtUJKu9bcoi_ZPmmr3dJFLiR7_vVQJY61rKTl0ctv-PndraeXHk1Y036T9HUysdMjo6ZhuG3ruxiL6bBhR5JOiI4s-6UClYCiowkw8s0Btk Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: ad625845a6ea4b87b22bee984224c130 Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-553112801 Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ad625845a6ea4b87b22bee984224c130"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ad625845a6ea4b87b22bee984224c130"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ad625845a6ea4b87b22bee984224c130", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ad625845a6ea4b87b22bee984224c130"}]}] Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-553112801 Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: ad625845a6ea4b87b22bee984224c130 Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-553112801 Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 88d2a80eed224b4a807463f558bfa37b Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: {"addFloatingIp": {"address": ""}} Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff', 'body': {'addFloatingIp': {'address': ''}}} Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi '' Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:30:03.329479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:30:03.336629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:30:03.336629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 25 14:30:03.336629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:03.336629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:03.336629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:03.336629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:03.336629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:03.336629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:03.336629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:30:03.336629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:30:03.336629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 25 14:30:03.336629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:03.336629 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-de9ce379-1996-4156-8073-d20e5018f48d tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:30:03.336629 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-de9ce379-1996-4156-8073-d20e5018f48d tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] 10.222.0.88 "POST /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff/action" status: 400 len: 142 microversion: 2.1 time: 0.009706 Jul 25 14:30:03.339893 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 654/1356] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:30:03 2022] POST /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff/action => generated 142 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 14:30:03.350399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-67796fc1-a59e-4de2-953e-10fdbd22e03c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:03.356289 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b906b02e-f612-42fc-9867-5c42ad61b512 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:03.362500 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b906b02e-f612-42fc-9867-5c42ad61b512 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] [instance: 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:03.372884 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-67796fc1-a59e-4de2-953e-10fdbd22e03c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:03.374731 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-67796fc1-a59e-4de2-953e-10fdbd22e03c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:03.375962 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-67796fc1-a59e-4de2-953e-10fdbd22e03c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1874 microversion: 2.42 time: 0.362913 Jul 25 14:30:03.376809 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b906b02e-f612-42fc-9867-5c42ad61b512 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:03.380400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b906b02e-f612-42fc-9867-5c42ad61b512 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:03.381569 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b906b02e-f612-42fc-9867-5c42ad61b512 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:03.382184 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b906b02e-f612-42fc-9867-5c42ad61b512 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:03.393483 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 703/1357] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:30:03 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1874 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:30:03.424968 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b906b02e-f612-42fc-9867-5c42ad61b512 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Acquired lock "refresh_cache-520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff" {{(pid=119303) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 14:30:03.589589 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b906b02e-f612-42fc-9867-5c42ad61b512 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Releasing lock "refresh_cache-520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff" {{(pid=119303) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 14:30:03.590296 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-b906b02e-f612-42fc-9867-5c42ad61b512 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] HTTP exception thrown: floating IP not found Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b906b02e-f612-42fc-9867-5c42ad61b512 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Request method failure captured: Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff/action HTTP/1.1 Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 41 Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qjCfxmZ_zoz5tZWTUa6ftqwLmr82iUZ_14Ovsmd3NdwrBu_a9sVwju_No84u4K9igULZtUJKu9bcoi_ZPmmr3dJFLiR7_vVQJY61rKTl0ctv-PndraeXHk1Y036T9HUysdMjo6ZhuG3ruxiL6bBhR5JOiI4s-6UClYCiowkw8s0Btk Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: ad625845a6ea4b87b22bee984224c130 Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-553112801 Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ad625845a6ea4b87b22bee984224c130"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ad625845a6ea4b87b22bee984224c130"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ad625845a6ea4b87b22bee984224c130", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ad625845a6ea4b87b22bee984224c130"}]}] Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-553112801 Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: ad625845a6ea4b87b22bee984224c130 Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-553112801 Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 88d2a80eed224b4a807463f558bfa37b Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: {"addFloatingIp": {"address": "0.0.0.0"}} Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: exception: floating IP not found Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jul 25 14:30:03.592575 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:03.597656 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:03.597656 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:03.597656 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:03.597656 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:03.597656 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:03.597656 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:30:03.597656 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:30:03.597656 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jul 25 14:30:03.597656 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:03.597656 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b906b02e-f612-42fc-9867-5c42ad61b512 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Returning 404 to user: floating IP not found {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:30:03.597656 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b906b02e-f612-42fc-9867-5c42ad61b512 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] 10.222.0.88 "POST /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff/action" status: 404 len: 67 microversion: 2.1 time: 0.253364 Jul 25 14:30:03.597656 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 655/1358] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:30:03 2022] POST /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff/action => generated 67 bytes in 255 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:30:03.606394 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-44e99856-2b5c-4575-9c67-36051b048627 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:03.656071 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-269a636b-599a-4fc7-aa5c-23f8dc9779da tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:03.656697 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-269a636b-599a-4fc7-aa5c-23f8dc9779da tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 74d6eac5-76ed-47bb-8e15-d6dea0e5618e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:03.671718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-269a636b-599a-4fc7-aa5c-23f8dc9779da tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:03.672209 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-269a636b-599a-4fc7-aa5c-23f8dc9779da tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:03.673020 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-269a636b-599a-4fc7-aa5c-23f8dc9779da tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:03.673449 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-269a636b-599a-4fc7-aa5c-23f8dc9779da tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:03.734319 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-44e99856-2b5c-4575-9c67-36051b048627 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-44e99856-2b5c-4575-9c67-36051b048627 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Request method failure captured: Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff/action HTTP/1.1 Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 44 Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qjCfxmZ_zoz5tZWTUa6ftqwLmr82iUZ_14Ovsmd3NdwrBu_a9sVwju_No84u4K9igULZtUJKu9bcoi_ZPmmr3dJFLiR7_vVQJY61rKTl0ctv-PndraeXHk1Y036T9HUysdMjo6ZhuG3ruxiL6bBhR5JOiI4s-6UClYCiowkw8s0Btk Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: ad625845a6ea4b87b22bee984224c130 Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-553112801 Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ad625845a6ea4b87b22bee984224c130"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ad625845a6ea4b87b22bee984224c130"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ad625845a6ea4b87b22bee984224c130", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ad625845a6ea4b87b22bee984224c130"}]}] Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-553112801 Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: ad625845a6ea4b87b22bee984224c130 Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-553112801 Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 88d2a80eed224b4a807463f558bfa37b Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: exception: Floating IP not found for address 0.0.0.0. Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jul 25 14:30:03.736060 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jul 25 14:30:03.741182 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jul 25 14:30:03.741182 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:03.741182 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:03.741182 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:03.741182 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:03.741182 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:03.741182 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:03.741182 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:30:03.741182 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:30:03.741182 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jul 25 14:30:03.741182 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:03.741182 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-44e99856-2b5c-4575-9c67-36051b048627 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:30:03.741182 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-44e99856-2b5c-4575-9c67-36051b048627 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] 10.222.0.88 "POST /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff/action" status: 404 len: 88 microversion: 2.1 time: 0.135967 Jul 25 14:30:03.741182 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 704/1359] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:30:03 2022] POST /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff/action => generated 88 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:30:03.751935 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d758cd9b-b6d2-48ba-8109-b36f62a91197 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:03.752462 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d758cd9b-b6d2-48ba-8109-b36f62a91197 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] [instance: 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:03.785224 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d758cd9b-b6d2-48ba-8109-b36f62a91197 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:03.785926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d758cd9b-b6d2-48ba-8109-b36f62a91197 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:03.791134 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d758cd9b-b6d2-48ba-8109-b36f62a91197 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:03.793571 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d758cd9b-b6d2-48ba-8109-b36f62a91197 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:03.826229 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d758cd9b-b6d2-48ba-8109-b36f62a91197 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] [instance: 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:30:03.979582 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d758cd9b-b6d2-48ba-8109-b36f62a91197 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] 10.222.0.88 "DELETE /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff" status: 204 len: 0 microversion: 2.1 time: 0.231379 Jul 25 14:30:03.983157 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 705/1360] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:30:03 2022] DELETE /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 14:30:04.001721 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-db0eda09-10da-4f5b-8a3c-41e43c714ff1 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:04.002669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-db0eda09-10da-4f5b-8a3c-41e43c714ff1 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] [instance: 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:04.020757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db0eda09-10da-4f5b-8a3c-41e43c714ff1 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:04.021459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db0eda09-10da-4f5b-8a3c-41e43c714ff1 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:04.022569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db0eda09-10da-4f5b-8a3c-41e43c714ff1 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:04.023169 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db0eda09-10da-4f5b-8a3c-41e43c714ff1 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:04.189817 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-269a636b-599a-4fc7-aa5c-23f8dc9779da tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f53d74a29243759065e68964f638dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d71324b22554a3bb44d6aceb7bc3cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:04.205338 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-269a636b-599a-4fc7-aa5c-23f8dc9779da tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e" status: 200 len: 1505 microversion: 2.1 time: 0.555578 Jul 25 14:30:04.205940 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 656/1361] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:03 2022] GET /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e => generated 1505 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:04.221921 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-03c3114c-8d25-4ec1-8d3a-13cb5805c683 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:04.225096 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-03c3114c-8d25-4ec1-8d3a-13cb5805c683 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:04.244928 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03c3114c-8d25-4ec1-8d3a-13cb5805c683 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:04.245718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03c3114c-8d25-4ec1-8d3a-13cb5805c683 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:04.247320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03c3114c-8d25-4ec1-8d3a-13cb5805c683 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:04.248088 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03c3114c-8d25-4ec1-8d3a-13cb5805c683 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:04.420262 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-db0eda09-10da-4f5b-8a3c-41e43c714ff1 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2a80eed224b4a807463f558bfa37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad625845a6ea4b87b22bee984224c130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:04.449364 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-db0eda09-10da-4f5b-8a3c-41e43c714ff1 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] 10.222.0.88 "GET /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff" status: 200 len: 1541 microversion: 2.1 time: 0.461386 Jul 25 14:30:04.450826 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 706/1362] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:03 2022] GET /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff => generated 1541 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:04.484670 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e89cd16d-6993-43b1-a6f1-07e4c2604085 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1761813343"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:04.488106 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e89cd16d-6993-43b1-a6f1-07e4c2604085 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 74d6eac5-76ed-47bb-8e15-d6dea0e5618e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:04.495442 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e89cd16d-6993-43b1-a6f1-07e4c2604085 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:04.495875 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e89cd16d-6993-43b1-a6f1-07e4c2604085 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:04.496999 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e89cd16d-6993-43b1-a6f1-07e4c2604085 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:04.497625 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e89cd16d-6993-43b1-a6f1-07e4c2604085 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:04.726582 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-03c3114c-8d25-4ec1-8d3a-13cb5805c683 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:04.736917 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-03c3114c-8d25-4ec1-8d3a-13cb5805c683 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1535 microversion: 2.1 time: 0.526037 Jul 25 14:30:04.738120 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 657/1363] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:04 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1535 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:04.744998 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cecfc3a1-c501-4db5-9a29-81dcef4fe538 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:04.745883 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cecfc3a1-c501-4db5-9a29-81dcef4fe538 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:04.753610 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cecfc3a1-c501-4db5-9a29-81dcef4fe538 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:04.754769 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cecfc3a1-c501-4db5-9a29-81dcef4fe538 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:04.755833 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cecfc3a1-c501-4db5-9a29-81dcef4fe538 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:04.756485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cecfc3a1-c501-4db5-9a29-81dcef4fe538 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:04.874891 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.network.security_group_api [None req-e89cd16d-6993-43b1-a6f1-07e4c2604085 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Adding security group 8d10a92f-1eab-4815-9359-eae8424ca2f7 to port e3504237-5bd2-4a4c-a8ef-533354ad94bb Jul 25 14:30:05.527480 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cecfc3a1-c501-4db5-9a29-81dcef4fe538 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:05.546441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cecfc3a1-c501-4db5-9a29-81dcef4fe538 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:05.548021 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cecfc3a1-c501-4db5-9a29-81dcef4fe538 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:05.549396 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cecfc3a1-c501-4db5-9a29-81dcef4fe538 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1874 microversion: 2.42 time: 0.810107 Jul 25 14:30:05.550275 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 658/1364] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:30:04 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1874 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:30:05.562297 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d8a2f5a2-9245-4d5f-8b33-305050bd2e11 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:05.563153 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d8a2f5a2-9245-4d5f-8b33-305050bd2e11 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] [instance: 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:05.572813 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8a2f5a2-9245-4d5f-8b33-305050bd2e11 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:05.573512 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8a2f5a2-9245-4d5f-8b33-305050bd2e11 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:05.574512 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8a2f5a2-9245-4d5f-8b33-305050bd2e11 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:05.575138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8a2f5a2-9245-4d5f-8b33-305050bd2e11 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:05.899268 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:30:06.047931 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e89cd16d-6993-43b1-a6f1-07e4c2604085 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "POST /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e/action" status: 202 len: 0 microversion: 2.1 time: 1.595467 Jul 25 14:30:06.050335 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 707/1365] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:30:04 2022] POST /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e/action => generated 0 bytes in 1599 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:30:06.070784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0682ba6d-c372-4b7c-aa34-6b8b9d6e0fd1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:06.072078 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0682ba6d-c372-4b7c-aa34-6b8b9d6e0fd1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:06.089575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0682ba6d-c372-4b7c-aa34-6b8b9d6e0fd1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:06.090577 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0682ba6d-c372-4b7c-aa34-6b8b9d6e0fd1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:06.091574 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0682ba6d-c372-4b7c-aa34-6b8b9d6e0fd1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:06.092748 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0682ba6d-c372-4b7c-aa34-6b8b9d6e0fd1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:06.484280 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d8a2f5a2-9245-4d5f-8b33-305050bd2e11 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d2a80eed224b4a807463f558bfa37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad625845a6ea4b87b22bee984224c130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:06.492252 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d8a2f5a2-9245-4d5f-8b33-305050bd2e11 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] 10.222.0.88 "GET /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff" status: 200 len: 1541 microversion: 2.1 time: 0.940727 Jul 25 14:30:06.505172 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 659/1366] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:05 2022] GET /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff => generated 1541 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:06.537365 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0682ba6d-c372-4b7c-aa34-6b8b9d6e0fd1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:06.547302 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0682ba6d-c372-4b7c-aa34-6b8b9d6e0fd1 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1535 microversion: 2.1 time: 0.486559 Jul 25 14:30:06.554332 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 708/1367] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:06 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1535 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:06.581448 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d28d8aa6-e5d6-48e1-8162-a67bcb06b853 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-879769153"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:06.587755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d28d8aa6-e5d6-48e1-8162-a67bcb06b853 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 74d6eac5-76ed-47bb-8e15-d6dea0e5618e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:06.607244 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d28d8aa6-e5d6-48e1-8162-a67bcb06b853 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:06.609572 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d28d8aa6-e5d6-48e1-8162-a67bcb06b853 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:06.612787 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d28d8aa6-e5d6-48e1-8162-a67bcb06b853 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:06.613464 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d28d8aa6-e5d6-48e1-8162-a67bcb06b853 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:06.797805 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-aa42e01b-904e-4176-b9af-124121c2d09c tempest-FloatingIPDetailsTestJSON-2085568505 tempest-FloatingIPDetailsTestJSON-2085568505-project] Action: 'create', calling method: .version_select at 0x7f46872851f0>, body: {"pool": null} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:07.066786 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.network.security_group_api [None req-d28d8aa6-e5d6-48e1-8162-a67bcb06b853 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Adding security group 4d916572-953b-473f-831a-ef3184f7b626 to port e3504237-5bd2-4a4c-a8ef-533354ad94bb Jul 25 14:30:07.789271 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d28d8aa6-e5d6-48e1-8162-a67bcb06b853 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "POST /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e/action" status: 202 len: 0 microversion: 2.1 time: 1.218201 Jul 25 14:30:07.793888 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 709/1368] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:30:06 2022] POST /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e/action => generated 0 bytes in 1238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:30:07.801166 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-45bff512-d2e7-4548-a5f8-356e592fcbcb req-17347065-edc7-4b02-9f2a-94c1a0ff3091 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74d6eac5-76ed-47bb-8e15-d6dea0e5618e", "tag": "e3504237-5bd2-4a4c-a8ef-533354ad94bb"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:07.816400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-45bff512-d2e7-4548-a5f8-356e592fcbcb req-17347065-edc7-4b02-9f2a-94c1a0ff3091 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:07.817191 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-45bff512-d2e7-4548-a5f8-356e592fcbcb req-17347065-edc7-4b02-9f2a-94c1a0ff3091 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:07.831943 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-45bff512-d2e7-4548-a5f8-356e592fcbcb req-17347065-edc7-4b02-9f2a-94c1a0ff3091 service nova] Creating event network-changed:e3504237-5bd2-4a4c-a8ef-533354ad94bb for instance 74d6eac5-76ed-47bb-8e15-d6dea0e5618e on n-h2-846435-14 Jul 25 14:30:07.837805 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-45bff512-d2e7-4548-a5f8-356e592fcbcb req-17347065-edc7-4b02-9f2a-94c1a0ff3091 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040746 Jul 25 14:30:07.838950 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 710/1369] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:30:07.844941 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7acf3788-f2ec-4e8d-a38c-ca5cda50cd83 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:07.846729 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7acf3788-f2ec-4e8d-a38c-ca5cda50cd83 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:07.854687 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7acf3788-f2ec-4e8d-a38c-ca5cda50cd83 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:07.855408 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7acf3788-f2ec-4e8d-a38c-ca5cda50cd83 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:07.856937 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7acf3788-f2ec-4e8d-a38c-ca5cda50cd83 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:07.857570 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7acf3788-f2ec-4e8d-a38c-ca5cda50cd83 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:08.522943 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7acf3788-f2ec-4e8d-a38c-ca5cda50cd83 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:08.532135 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7acf3788-f2ec-4e8d-a38c-ca5cda50cd83 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:08.533763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7acf3788-f2ec-4e8d-a38c-ca5cda50cd83 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:08.535143 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7acf3788-f2ec-4e8d-a38c-ca5cda50cd83 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1874 microversion: 2.42 time: 0.694938 Jul 25 14:30:08.539430 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 711/1370] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:30:07 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1874 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:30:08.547791 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9b79894a-3e93-43c6-a5f0-4e341bdd14a7 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:08.550653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9b79894a-3e93-43c6-a5f0-4e341bdd14a7 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] [instance: 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:08.560814 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9b79894a-3e93-43c6-a5f0-4e341bdd14a7 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:08.562216 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9b79894a-3e93-43c6-a5f0-4e341bdd14a7 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:08.563036 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9b79894a-3e93-43c6-a5f0-4e341bdd14a7 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:08.563963 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9b79894a-3e93-43c6-a5f0-4e341bdd14a7 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:08.583083 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-9b79894a-3e93-43c6-a5f0-4e341bdd14a7 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] HTTP exception thrown: Instance 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff could not be found. Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9b79894a-3e93-43c6-a5f0-4e341bdd14a7 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Request method failure captured: Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff HTTP/1.1 Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qjCfxmZ_zoz5tZWTUa6ftqwLmr82iUZ_14Ovsmd3NdwrBu_a9sVwju_No84u4K9igULZtUJKu9bcoi_ZPmmr3dJFLiR7_vVQJY61rKTl0ctv-PndraeXHk1Y036T9HUysdMjo6ZhuG3ruxiL6bBhR5JOiI4s-6UClYCiowkw8s0Btk Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: ad625845a6ea4b87b22bee984224c130 Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-553112801 Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ad625845a6ea4b87b22bee984224c130"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ad625845a6ea4b87b22bee984224c130"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ad625845a6ea4b87b22bee984224c130", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ad625845a6ea4b87b22bee984224c130"}]}] Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-553112801 Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: ad625845a6ea4b87b22bee984224c130 Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-553112801 Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 88d2a80eed224b4a807463f558bfa37b Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff could not be found. Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff'} Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff could not be found. Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff could not be found. Jul 25 14:30:08.584844 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:08.592624 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:08.592624 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:08.592624 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:08.592624 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:08.592624 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:08.592624 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:30:08.592624 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:30:08.592624 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff could not be found. Jul 25 14:30:08.592624 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:08.592624 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9b79894a-3e93-43c6-a5f0-4e341bdd14a7 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] Returning 404 to user: Instance 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:30:08.592624 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9b79894a-3e93-43c6-a5f0-4e341bdd14a7 tempest-FloatingIPsAssociationNegativeTestJSON-553112801 tempest-FloatingIPsAssociationNegativeTestJSON-553112801-project] 10.222.0.88 "GET /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff" status: 404 len: 111 microversion: 2.1 time: 0.043928 Jul 25 14:30:08.596168 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 712/1371] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:08 2022] GET /compute/v2.1/servers/520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:30:08.601515 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a7936747-9762-4bcc-bad7-ac57f380354f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:08.602672 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a7936747-9762-4bcc-bad7-ac57f380354f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:08.611761 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a7936747-9762-4bcc-bad7-ac57f380354f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:08.612580 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a7936747-9762-4bcc-bad7-ac57f380354f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:08.614430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a7936747-9762-4bcc-bad7-ac57f380354f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:08.615107 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a7936747-9762-4bcc-bad7-ac57f380354f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:08.896497 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a7936747-9762-4bcc-bad7-ac57f380354f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:08.907120 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a7936747-9762-4bcc-bad7-ac57f380354f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1535 microversion: 2.1 time: 0.309483 Jul 25 14:30:08.908094 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 713/1372] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:08 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1535 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:08.920014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-7148c026-19c1-41ec-91a0-558f37251a1e req-51f9a21d-210a-49e4-9535-04ecb387a74f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "698a551a-c019-4ae5-ba50-0d190e41ff03", "tag": "a454c550-e298-46f0-8c6c-7d7c39505dca"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:08.931347 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-7148c026-19c1-41ec-91a0-558f37251a1e req-51f9a21d-210a-49e4-9535-04ecb387a74f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:08.932316 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-7148c026-19c1-41ec-91a0-558f37251a1e req-51f9a21d-210a-49e4-9535-04ecb387a74f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:08.945974 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-7148c026-19c1-41ec-91a0-558f37251a1e req-51f9a21d-210a-49e4-9535-04ecb387a74f service nova] Creating event network-changed:a454c550-e298-46f0-8c6c-7d7c39505dca for instance 698a551a-c019-4ae5-ba50-0d190e41ff03 on n-h2-846435-14 Jul 25 14:30:08.953624 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [req-7148c026-19c1-41ec-91a0-558f37251a1e req-51f9a21d-210a-49e4-9535-04ecb387a74f service nova] Instance 698a551a-c019-4ae5-ba50-0d190e41ff03 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119304) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 14:30:08.969579 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-7148c026-19c1-41ec-91a0-558f37251a1e req-51f9a21d-210a-49e4-9535-04ecb387a74f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059963 Jul 25 14:30:08.970956 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 714/1373] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:30:08.985979 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-71332c60-57a3-4ae2-8076-aad6de158c02 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:08.994169 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-71332c60-57a3-4ae2-8076-aad6de158c02 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 74d6eac5-76ed-47bb-8e15-d6dea0e5618e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:09.009257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71332c60-57a3-4ae2-8076-aad6de158c02 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:09.010181 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71332c60-57a3-4ae2-8076-aad6de158c02 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:09.011820 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71332c60-57a3-4ae2-8076-aad6de158c02 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:09.013670 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71332c60-57a3-4ae2-8076-aad6de158c02 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:09.435739 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-71332c60-57a3-4ae2-8076-aad6de158c02 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.460991 Jul 25 14:30:09.437890 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 715/1374] 10.222.0.88 () {58 vars in 1293 bytes} [Mon Jul 25 14:30:08 2022] GET /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e/os-security-groups => generated 1158 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:09.453653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1cc063d2-3d28-4585-8507-9965b5d32948 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Action: 'create', calling method: .version_select at 0x7f4687624d30>, body: {"security_group": {"name": " tempest-securitygroup -1266437435 ", "description": "tempest-description-896422891"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:09.729487 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=13 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:30:10.471418 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1cc063d2-3d28-4585-8507-9965b5d32948 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 1.022814 Jul 25 14:30:10.480973 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 716/1375] 10.222.0.88 () {60 vars in 1180 bytes} [Mon Jul 25 14:30:09 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:30:10.487592 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b8456c30-1b42-4a99-b972-eb11f13a1002 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:10.488667 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b8456c30-1b42-4a99-b972-eb11f13a1002 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:10.509186 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8456c30-1b42-4a99-b972-eb11f13a1002 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:10.510205 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8456c30-1b42-4a99-b972-eb11f13a1002 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:10.512561 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8456c30-1b42-4a99-b972-eb11f13a1002 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:10.516377 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8456c30-1b42-4a99-b972-eb11f13a1002 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:10.906052 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b8456c30-1b42-4a99-b972-eb11f13a1002 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:10.917898 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b8456c30-1b42-4a99-b972-eb11f13a1002 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:10.919924 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b8456c30-1b42-4a99-b972-eb11f13a1002 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:10.921502 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b8456c30-1b42-4a99-b972-eb11f13a1002 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1874 microversion: 2.42 time: 0.439100 Jul 25 14:30:10.922268 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 717/1376] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:30:10 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1874 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:30:10.927916 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-e54ee27d-bbd9-4df5-b890-ccf0e7dfed9b req-296ab356-4376-4dd9-b288-2395dc2d1a4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a6128a-580f-4184-ba11-6511d5021242", "name": "network-vif-plugged", "status": "completed", "tag": "1b64c898-66f1-4e5b-be51-5b73f032a6f6"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:10.939152 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-e54ee27d-bbd9-4df5-b890-ccf0e7dfed9b req-296ab356-4376-4dd9-b288-2395dc2d1a4a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:10.939897 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-e54ee27d-bbd9-4df5-b890-ccf0e7dfed9b req-296ab356-4376-4dd9-b288-2395dc2d1a4a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:10.960459 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-e54ee27d-bbd9-4df5-b890-ccf0e7dfed9b req-296ab356-4376-4dd9-b288-2395dc2d1a4a service nova] Creating event network-vif-plugged:1b64c898-66f1-4e5b-be51-5b73f032a6f6 for instance 33a6128a-580f-4184-ba11-6511d5021242 on n-h1-846435-14 Jul 25 14:30:10.966528 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-e54ee27d-bbd9-4df5-b890-ccf0e7dfed9b req-296ab356-4376-4dd9-b288-2395dc2d1a4a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042442 Jul 25 14:30:10.968633 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 718/1377] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:30:10.974588 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-842d9e20-0360-49cc-82ca-4a9606484d19 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:10.975675 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-842d9e20-0360-49cc-82ca-4a9606484d19 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:10.992303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-842d9e20-0360-49cc-82ca-4a9606484d19 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:10.993707 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-842d9e20-0360-49cc-82ca-4a9606484d19 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:10.994764 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-842d9e20-0360-49cc-82ca-4a9606484d19 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:10.995831 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-842d9e20-0360-49cc-82ca-4a9606484d19 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:11.375846 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-842d9e20-0360-49cc-82ca-4a9606484d19 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:11.406046 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-842d9e20-0360-49cc-82ca-4a9606484d19 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1535 microversion: 2.1 time: 0.435881 Jul 25 14:30:11.421883 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 719/1378] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:10 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1535 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:11.429487 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-3e9654c1-25e9-49b9-b50a-eb96f9332b1a req-250e5d77-a8bb-4431-9811-1499fcd3307e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff", "name": "network-vif-deleted", "tag": "c9d23981-0c41-4d35-a06a-5e586993cfe1"}, {"name": "network-changed", "server_uuid": "74d6eac5-76ed-47bb-8e15-d6dea0e5618e", "tag": "e3504237-5bd2-4a4c-a8ef-533354ad94bb"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:11.452444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-3e9654c1-25e9-49b9-b50a-eb96f9332b1a req-250e5d77-a8bb-4431-9811-1499fcd3307e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:11.453963 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-3e9654c1-25e9-49b9-b50a-eb96f9332b1a req-250e5d77-a8bb-4431-9811-1499fcd3307e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:11.548501 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-3e9654c1-25e9-49b9-b50a-eb96f9332b1a req-250e5d77-a8bb-4431-9811-1499fcd3307e service nova] Creating event network-vif-deleted:c9d23981-0c41-4d35-a06a-5e586993cfe1 for instance 520cb4b4-5d1a-43dc-b6fa-6bb43b1a52ff on n-h1-846435-14 Jul 25 14:30:11.549284 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-3e9654c1-25e9-49b9-b50a-eb96f9332b1a req-250e5d77-a8bb-4431-9811-1499fcd3307e service nova] Creating event network-changed:e3504237-5bd2-4a4c-a8ef-533354ad94bb for instance 74d6eac5-76ed-47bb-8e15-d6dea0e5618e on n-h2-846435-14 Jul 25 14:30:11.564282 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-3e9654c1-25e9-49b9-b50a-eb96f9332b1a req-250e5d77-a8bb-4431-9811-1499fcd3307e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.140551 Jul 25 14:30:11.566711 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 720/1379] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:30:11.579476 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0b4a75a6-309f-45d9-9dc6-1baced3607fa tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '.version_select at 0x7f468790fd30>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:11.862241 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0b4a75a6-309f-45d9-9dc6-1baced3607fa tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/os-security-groups/34aa7d87-a034-4b40-9710-f082386b4905" status: 200 len: 223 microversion: 2.1 time: 0.292988 Jul 25 14:30:11.867850 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 721/1380] 10.222.0.88 () {58 vars in 1269 bytes} [Mon Jul 25 14:30:11 2022] GET /compute/v2.1/os-security-groups/34aa7d87-a034-4b40-9710-f082386b4905 => generated 223 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:30:11.882587 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4a27b164-aae6-4b1c-9667-ab95ed6577ec tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '.version_select at 0x7f46876240d0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:12.727391 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4a27b164-aae6-4b1c-9667-ab95ed6577ec tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/34aa7d87-a034-4b40-9710-f082386b4905" status: 202 len: 0 microversion: 2.1 time: 0.851207 Jul 25 14:30:12.729131 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 722/1381] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:30:11 2022] DELETE /compute/v2.1/os-security-groups/34aa7d87-a034-4b40-9710-f082386b4905 => generated 0 bytes in 854 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 14:30:12.736033 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2b0e3405-991c-489c-ac3f-47ef9611b0d0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:12.737608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2b0e3405-991c-489c-ac3f-47ef9611b0d0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:12.755698 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b0e3405-991c-489c-ac3f-47ef9611b0d0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:12.757791 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b0e3405-991c-489c-ac3f-47ef9611b0d0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:12.758917 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b0e3405-991c-489c-ac3f-47ef9611b0d0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:12.761752 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b0e3405-991c-489c-ac3f-47ef9611b0d0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:13.311253 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2b0e3405-991c-489c-ac3f-47ef9611b0d0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:13.331510 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2b0e3405-991c-489c-ac3f-47ef9611b0d0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:13.335446 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2b0e3405-991c-489c-ac3f-47ef9611b0d0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:13.347600 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2b0e3405-991c-489c-ac3f-47ef9611b0d0 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1874 microversion: 2.42 time: 0.617042 Jul 25 14:30:13.351528 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 723/1382] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:30:12 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1874 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:30:13.370858 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-593cdb54-a477-4036-a5d1-2870d22f5e38 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:13.371481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-593cdb54-a477-4036-a5d1-2870d22f5e38 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:13.396720 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-593cdb54-a477-4036-a5d1-2870d22f5e38 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:13.405003 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-593cdb54-a477-4036-a5d1-2870d22f5e38 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:13.408188 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-593cdb54-a477-4036-a5d1-2870d22f5e38 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:13.408656 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-593cdb54-a477-4036-a5d1-2870d22f5e38 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:13.782912 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-aa42e01b-904e-4176-b9af-124121c2d09c tempest-FloatingIPDetailsTestJSON-2085568505 tempest-FloatingIPDetailsTestJSON-2085568505-project] 10.222.0.88 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.270235 Jul 25 14:30:13.783708 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 660/1383] 10.222.0.88 () {60 vars in 1170 bytes} [Mon Jul 25 14:30:06 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:30:13.795786 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-90459218-f92c-4e85-a481-7a11ae75af9f tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '.version_select at 0x7f46872579d0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:13.833064 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-593cdb54-a477-4036-a5d1-2870d22f5e38 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:13.846852 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-593cdb54-a477-4036-a5d1-2870d22f5e38 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1535 microversion: 2.1 time: 0.489211 Jul 25 14:30:13.865155 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 724/1384] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:13 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1535 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:13.893997 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-f587bc16-3047-44e2-ac07-7b9ea9eb44f9 req-ab9d0619-6525-43fa-94aa-92defb343922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a6128a-580f-4184-ba11-6511d5021242", "name": "network-vif-plugged", "status": "completed", "tag": "117e3c70-2257-4ddb-af6d-4e75db8fcb77"}, {"server_uuid": "33a6128a-580f-4184-ba11-6511d5021242", "name": "network-vif-plugged", "status": "completed", "tag": "87364f5a-d3ef-46c2-92c5-1fafec0f79e8"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:13.916503 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-f587bc16-3047-44e2-ac07-7b9ea9eb44f9 req-ab9d0619-6525-43fa-94aa-92defb343922 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:13.921937 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-f587bc16-3047-44e2-ac07-7b9ea9eb44f9 req-ab9d0619-6525-43fa-94aa-92defb343922 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:13.971380 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-f587bc16-3047-44e2-ac07-7b9ea9eb44f9 req-ab9d0619-6525-43fa-94aa-92defb343922 service nova] Creating event network-vif-plugged:117e3c70-2257-4ddb-af6d-4e75db8fcb77 for instance 33a6128a-580f-4184-ba11-6511d5021242 on n-h1-846435-14 Jul 25 14:30:13.971899 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-f587bc16-3047-44e2-ac07-7b9ea9eb44f9 req-ab9d0619-6525-43fa-94aa-92defb343922 service nova] Creating event network-vif-plugged:87364f5a-d3ef-46c2-92c5-1fafec0f79e8 for instance 33a6128a-580f-4184-ba11-6511d5021242 on n-h1-846435-14 Jul 25 14:30:13.992134 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-f587bc16-3047-44e2-ac07-7b9ea9eb44f9 req-ab9d0619-6525-43fa-94aa-92defb343922 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.125350 Jul 25 14:30:13.994121 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 725/1385] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:30:14.012002 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0633a397-e3bc-45bc-81ad-154ab851ef78 tempest-FloatingIPDetailsTestJSON-2085568505 tempest-FloatingIPDetailsTestJSON-2085568505-project] Action: 'create', calling method: .version_select at 0x7f4687bae820>, body: {"pool": null} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:14.207385 n-d-846435-14 devstack@n-api.service[119303]: DEBUG neutronclient.v2_0.client [None req-90459218-f92c-4e85-a481-7a11ae75af9f tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 34aa7d87-a034-4b40-9710-f082386b4905 does not exist", "detail": ""}} {{(pid=119303) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 14:30:14.208546 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.security_group_api [None req-90459218-f92c-4e85-a481-7a11ae75af9f tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Neutron security group 34aa7d87-a034-4b40-9710-f082386b4905 not found {{(pid=119303) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 14:30:14.210242 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-90459218-f92c-4e85-a481-7a11ae75af9f tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] HTTP exception thrown: Security group 34aa7d87-a034-4b40-9710-f082386b4905 does not exist Jul 25 14:30:14.210242 n-d-846435-14 devstack@n-api.service[119303]: Neutron server returns request_ids: ['req-b18863f2-5f23-423c-9d25-33d25776172b'] Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-90459218-f92c-4e85-a481-7a11ae75af9f tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Request method failure captured: Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/os-security-groups/34aa7d87-a034-4b40-9710-f082386b4905 HTTP/1.1 Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qjSWhK-vwJTt9-RUosNUl92O2IH7DXHM__YKwETUuX644ZNnaLPUYLl7n9jfiOhif_9NvqEaG0blLab1mJt658fIFOepG5Z0DCt4IZ2Chl0jBZNJNW6gm_-nwSZ3IWfSAUAPR-qkW1tUiXhGVJPIQGpNlpD2VqkHT6SMzyoZa1fOYg Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 3d71324b22554a3bb44d6aceb7bc3cbd Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d71324b22554a3bb44d6aceb7bc3cbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d71324b22554a3bb44d6aceb7bc3cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3d71324b22554a3bb44d6aceb7bc3cbd", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3d71324b22554a3bb44d6aceb7bc3cbd"}]}] Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 3d71324b22554a3bb44d6aceb7bc3cbd Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-SecurityGroupsTestJSON-81685064-project Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: b3f53d74a29243759065e68964f638dc Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-SecurityGroupsTestJSON-81685064-project Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: exception: Security group 34aa7d87-a034-4b40-9710-f082386b4905 does not exist Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: Neutron server returns request_ids: ['req-b18863f2-5f23-423c-9d25-33d25776172b'] Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '34aa7d87-a034-4b40-9710-f082386b4905'} Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 14:30:14.213928 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 34aa7d87-a034-4b40-9710-f082386b4905 does not exist Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b18863f2-5f23-423c-9d25-33d25776172b'] Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 34aa7d87-a034-4b40-9710-f082386b4905 does not exist Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b18863f2-5f23-423c-9d25-33d25776172b'] Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 34aa7d87-a034-4b40-9710-f082386b4905 does not exist Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b18863f2-5f23-423c-9d25-33d25776172b'] Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 34aa7d87-a034-4b40-9710-f082386b4905 does not exist Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b18863f2-5f23-423c-9d25-33d25776172b'] Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-90459218-f92c-4e85-a481-7a11ae75af9f tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Returning 404 to user: Security group 34aa7d87-a034-4b40-9710-f082386b4905 does not exist Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: Neutron server returns request_ids: ['req-b18863f2-5f23-423c-9d25-33d25776172b'] {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:30:14.222634 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-90459218-f92c-4e85-a481-7a11ae75af9f tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/os-security-groups/34aa7d87-a034-4b40-9710-f082386b4905" status: 404 len: 194 microversion: 2.1 time: 0.431243 Jul 25 14:30:14.226620 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 661/1386] 10.222.0.88 () {58 vars in 1269 bytes} [Mon Jul 25 14:30:13 2022] GET /compute/v2.1/os-security-groups/34aa7d87-a034-4b40-9710-f082386b4905 => generated 194 bytes in 442 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:30:14.252381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8cca8eff-d1dc-48cf-bbc4-4f0039eded11 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Action: 'create', calling method: .version_select at 0x7f4687431940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1769768094", "description": "tempest-description-1959612590"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:15.052617 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8cca8eff-d1dc-48cf-bbc4-4f0039eded11 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.824415 Jul 25 14:30:15.053763 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 662/1387] 10.222.0.88 () {60 vars in 1180 bytes} [Mon Jul 25 14:30:14 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:30:15.059166 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4c6f3fcf-5687-448e-87c1-fa26c5a2902d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:15.059877 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4c6f3fcf-5687-448e-87c1-fa26c5a2902d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:15.076110 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c6f3fcf-5687-448e-87c1-fa26c5a2902d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:15.077373 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c6f3fcf-5687-448e-87c1-fa26c5a2902d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:15.080837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c6f3fcf-5687-448e-87c1-fa26c5a2902d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:15.081671 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c6f3fcf-5687-448e-87c1-fa26c5a2902d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:15.786668 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4c6f3fcf-5687-448e-87c1-fa26c5a2902d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:15.810418 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4c6f3fcf-5687-448e-87c1-fa26c5a2902d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:15.812897 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4c6f3fcf-5687-448e-87c1-fa26c5a2902d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:15.814226 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4c6f3fcf-5687-448e-87c1-fa26c5a2902d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1874 microversion: 2.42 time: 0.759439 Jul 25 14:30:15.816591 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 663/1388] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:30:15 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1874 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:30:15.826341 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d69d0c35-c41b-45b2-8055-bb93dde4319b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:15.831223 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d69d0c35-c41b-45b2-8055-bb93dde4319b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:15.844644 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d69d0c35-c41b-45b2-8055-bb93dde4319b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:15.845448 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d69d0c35-c41b-45b2-8055-bb93dde4319b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:15.846464 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d69d0c35-c41b-45b2-8055-bb93dde4319b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:15.847108 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d69d0c35-c41b-45b2-8055-bb93dde4319b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:16.675778 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d69d0c35-c41b-45b2-8055-bb93dde4319b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:16.745404 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d69d0c35-c41b-45b2-8055-bb93dde4319b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1528 microversion: 2.1 time: 0.915419 Jul 25 14:30:16.747738 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 664/1389] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:15 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1528 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:16.768157 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-42bfc0dc-56e4-498b-937e-1964d09e479f tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Action: 'create', calling method: .version_select at 0x7f46877559d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-767319868", "description": "tempest-description-790731855"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:17.053046 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-42bfc0dc-56e4-498b-937e-1964d09e479f tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.302864 Jul 25 14:30:17.054307 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 665/1390] 10.222.0.88 () {60 vars in 1180 bytes} [Mon Jul 25 14:30:16 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:30:17.059773 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-4e5785d8-3a71-4588-9f15-4abff50a29fd req-1cf98a60-830a-42a8-a114-8d05870074c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a6128a-580f-4184-ba11-6511d5021242", "name": "network-vif-plugged", "status": "completed", "tag": "a5ecb61b-38f2-4d26-8fa4-777375045f83"}, {"server_uuid": "33a6128a-580f-4184-ba11-6511d5021242", "name": "network-vif-plugged", "status": "completed", "tag": "47a20d0d-9969-4add-9f4c-b4a79d222111"}, {"server_uuid": "33a6128a-580f-4184-ba11-6511d5021242", "name": "network-vif-plugged", "status": "completed", "tag": "2119900d-6644-4bf4-bbbb-a819dec5f58d"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:17.084589 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-4e5785d8-3a71-4588-9f15-4abff50a29fd req-1cf98a60-830a-42a8-a114-8d05870074c5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:17.085600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-4e5785d8-3a71-4588-9f15-4abff50a29fd req-1cf98a60-830a-42a8-a114-8d05870074c5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:17.105646 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-4e5785d8-3a71-4588-9f15-4abff50a29fd req-1cf98a60-830a-42a8-a114-8d05870074c5 service nova] Creating event network-vif-plugged:a5ecb61b-38f2-4d26-8fa4-777375045f83 for instance 33a6128a-580f-4184-ba11-6511d5021242 on n-h1-846435-14 Jul 25 14:30:17.106328 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-4e5785d8-3a71-4588-9f15-4abff50a29fd req-1cf98a60-830a-42a8-a114-8d05870074c5 service nova] Creating event network-vif-plugged:47a20d0d-9969-4add-9f4c-b4a79d222111 for instance 33a6128a-580f-4184-ba11-6511d5021242 on n-h1-846435-14 Jul 25 14:30:17.107007 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-4e5785d8-3a71-4588-9f15-4abff50a29fd req-1cf98a60-830a-42a8-a114-8d05870074c5 service nova] Creating event network-vif-plugged:2119900d-6644-4bf4-bbbb-a819dec5f58d for instance 33a6128a-580f-4184-ba11-6511d5021242 on n-h1-846435-14 Jul 25 14:30:17.113279 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-4e5785d8-3a71-4588-9f15-4abff50a29fd req-1cf98a60-830a-42a8-a114-8d05870074c5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.057488 Jul 25 14:30:17.114665 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 666/1391] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:30:17.120588 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-812ca817-1561-4a42-bb70-6158253741e0 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:17.121697 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-812ca817-1561-4a42-bb70-6158253741e0 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:17.129849 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-812ca817-1561-4a42-bb70-6158253741e0 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:17.130597 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-812ca817-1561-4a42-bb70-6158253741e0 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:17.131775 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-812ca817-1561-4a42-bb70-6158253741e0 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:17.132488 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-812ca817-1561-4a42-bb70-6158253741e0 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:17.572603 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-812ca817-1561-4a42-bb70-6158253741e0 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:17.587806 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-812ca817-1561-4a42-bb70-6158253741e0 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1528 microversion: 2.1 time: 0.471634 Jul 25 14:30:17.603220 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 667/1392] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:17 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1528 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:17.615089 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8ff3a4a6-9446-49a6-94e2-9257726533ff tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:17.616182 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8ff3a4a6-9446-49a6-94e2-9257726533ff tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:17.624446 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ff3a4a6-9446-49a6-94e2-9257726533ff tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:17.624896 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ff3a4a6-9446-49a6-94e2-9257726533ff tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:17.625852 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ff3a4a6-9446-49a6-94e2-9257726533ff tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:17.626476 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ff3a4a6-9446-49a6-94e2-9257726533ff tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:18.042145 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0633a397-e3bc-45bc-81ad-154ab851ef78 tempest-FloatingIPDetailsTestJSON-2085568505 tempest-FloatingIPDetailsTestJSON-2085568505-project] 10.222.0.88 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.044796 Jul 25 14:30:18.043083 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 726/1393] 10.222.0.88 () {60 vars in 1170 bytes} [Mon Jul 25 14:30:13 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:30:18.048111 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f938ab46-fb40-45f6-8cd5-3baa6b05a1d5 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Action: 'create', calling method: .version_select at 0x7f468742aaf0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1620705319", "description": "tempest-description-1737460031"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:18.066262 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8ff3a4a6-9446-49a6-94e2-9257726533ff tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:18.087324 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8ff3a4a6-9446-49a6-94e2-9257726533ff tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:18.088869 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8ff3a4a6-9446-49a6-94e2-9257726533ff tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:18.090057 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8ff3a4a6-9446-49a6-94e2-9257726533ff tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1874 microversion: 2.42 time: 0.485783 Jul 25 14:30:18.090623 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 668/1394] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:30:17 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1874 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:30:18.106879 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-58b09360-11df-4231-b2be-2be5603f59a6 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:18.108064 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:30:18.108064 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:30:18.119502 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-58b09360-11df-4231-b2be-2be5603f59a6 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] HTTP exception thrown: Flavor 86f65049-f3d8-4372-9978-5846778c91ed could not be found. Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-58b09360-11df-4231-b2be-2be5603f59a6 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Request method failure captured: Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/flavors/86f65049-f3d8-4372-9978-5846778c91ed HTTP/1.1 Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qgSIuiC7jovl14ks1RCuVKE4o84JtSEliOZL-7XG-cpgFpL8SHLzxUkCNGoZTKFEgc0BLcetcM9mIaTy_mOZfRDQgoA5snp8sMrN3kVTENfS4Ozy2e-YtA5-Xm7C4wdbkUOonGksyePGKX5UJsuo_MUXkeIpMKQRAgzXbZavPi0Q8U Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: a1dcb670bb2e4ec0b747b392ca4139eb Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-MigrationsAdminTest-411857930 Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: X-Role: admin,reader,member Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: admin,reader,member Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a1dcb670bb2e4ec0b747b392ca4139eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a1dcb670bb2e4ec0b747b392ca4139eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a1dcb670bb2e4ec0b747b392ca4139eb", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a1dcb670bb2e4ec0b747b392ca4139eb"}]}] Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-MigrationsAdminTest-411857930 Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: a1dcb670bb2e4ec0b747b392ca4139eb Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-MigrationsAdminTest-411857930 Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-MigrationsAdminTest-411857930-project-admin Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: d8f2a5957f224095933cfaaecc9a800a Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-MigrationsAdminTest-411857930-project-admin Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: exception: Flavor 86f65049-f3d8-4372-9978-5846778c91ed could not be found. Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '86f65049-f3d8-4372-9978-5846778c91ed'} Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi flavor.destroy() Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 86f65049-f3d8-4372-9978-5846778c91ed could not be found. Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 86f65049-f3d8-4372-9978-5846778c91ed could not be found. Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:18.125757 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:18.130999 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:18.130999 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:18.130999 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:18.130999 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:18.130999 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:30:18.130999 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:30:18.130999 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 86f65049-f3d8-4372-9978-5846778c91ed could not be found. Jul 25 14:30:18.130999 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:18.145260 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-58b09360-11df-4231-b2be-2be5603f59a6 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Returning 404 to user: Flavor 86f65049-f3d8-4372-9978-5846778c91ed could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:30:18.146406 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-58b09360-11df-4231-b2be-2be5603f59a6 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/86f65049-f3d8-4372-9978-5846778c91ed" status: 404 len: 109 microversion: 2.1 time: 0.054859 Jul 25 14:30:18.148171 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 669/1395] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:30:18 2022] DELETE /compute/v2.1/flavors/86f65049-f3d8-4372-9978-5846778c91ed => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:30:18.180116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-696cd7fc-52f7-404c-adb0-263d279cef2f tempest-FloatingIPDetailsTestJSON-2085568505 tempest-FloatingIPDetailsTestJSON-2085568505-project] Action: 'create', calling method: .version_select at 0x7f46872571f0>, body: {"pool": null} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:18.563090 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f938ab46-fb40-45f6-8cd5-3baa6b05a1d5 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.518699 Jul 25 14:30:18.570654 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 727/1396] 10.222.0.88 () {60 vars in 1180 bytes} [Mon Jul 25 14:30:18 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:30:18.570654 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b4a50d7f-933b-4354-a72a-8e0a94acaf4b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-615211027", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:18.682577 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-b4a50d7f-933b-4354-a72a-8e0a94acaf4b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] validate_networks() for None {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:30:19.235077 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-b4a50d7f-933b-4354-a72a-8e0a94acaf4b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:30:19.236248 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-b4a50d7f-933b-4354-a72a-8e0a94acaf4b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:30:19.237119 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-b4a50d7f-933b-4354-a72a-8e0a94acaf4b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:30:19.237586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-b4a50d7f-933b-4354-a72a-8e0a94acaf4b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:30:19.238214 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-b4a50d7f-933b-4354-a72a-8e0a94acaf4b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:30:19.248316 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b4a50d7f-933b-4354-a72a-8e0a94acaf4b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:19.249165 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b4a50d7f-933b-4354-a72a-8e0a94acaf4b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:19.250683 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b4a50d7f-933b-4354-a72a-8e0a94acaf4b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:19.251489 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b4a50d7f-933b-4354-a72a-8e0a94acaf4b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:19.262783 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:30:19.280791 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-b4a50d7f-933b-4354-a72a-8e0a94acaf4b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Getting quotas for project 887aa20d1838484eb895896f8f76ce41. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:30:19.287800 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-b4a50d7f-933b-4354-a72a-8e0a94acaf4b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Getting quotas for user 00aea97fb95c44cfa5dce25e9a06cd37 and project 887aa20d1838484eb895896f8f76ce41. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:30:19.291435 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:30:19.304752 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b4a50d7f-933b-4354-a72a-8e0a94acaf4b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:30:19.307083 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b4a50d7f-933b-4354-a72a-8e0a94acaf4b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:30:19.360932 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b4a50d7f-933b-4354-a72a-8e0a94acaf4b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.795613 Jul 25 14:30:19.368277 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 728/1397] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:30:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:30:19.375249 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0aca0bad-a4d6-4e52-b76b-b5513f1ceed5 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '.version_select at 0x7f46874e1040>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:19.906714 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0aca0bad-a4d6-4e52-b76b-b5513f1ceed5 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/os-security-groups" status: 200 len: 1834 microversion: 2.1 time: 0.537020 Jul 25 14:30:19.911156 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 729/1398] 10.222.0.88 () {58 vars in 1158 bytes} [Mon Jul 25 14:30:19 2022] GET /compute/v2.1/os-security-groups => generated 1834 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:19.919937 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-aedec8fe-f001-40d9-8407-ddc16b71b721 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:19.922124 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-aedec8fe-f001-40d9-8407-ddc16b71b721 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:19.939786 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aedec8fe-f001-40d9-8407-ddc16b71b721 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:19.940384 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aedec8fe-f001-40d9-8407-ddc16b71b721 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:19.942572 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aedec8fe-f001-40d9-8407-ddc16b71b721 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:19.943362 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aedec8fe-f001-40d9-8407-ddc16b71b721 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:20.425331 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-aedec8fe-f001-40d9-8407-ddc16b71b721 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:20.446982 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-aedec8fe-f001-40d9-8407-ddc16b71b721 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:20.449089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-aedec8fe-f001-40d9-8407-ddc16b71b721 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:20.450572 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-aedec8fe-f001-40d9-8407-ddc16b71b721 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1874 microversion: 2.42 time: 0.538209 Jul 25 14:30:20.451297 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 730/1399] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:30:19 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1874 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:30:20.461575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-09f7063a-b61f-4d95-8b53-e0449d47d7c5 req-dca67649-255c-49e2-8c93-1f383aa52664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a6128a-580f-4184-ba11-6511d5021242", "name": "network-vif-plugged", "status": "completed", "tag": "66751fc0-fec5-4bc6-859a-9a0368452b30"}, {"server_uuid": "698a551a-c019-4ae5-ba50-0d190e41ff03", "name": "network-vif-plugged", "status": "completed", "tag": "a454c550-e298-46f0-8c6c-7d7c39505dca"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:20.492397 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-09f7063a-b61f-4d95-8b53-e0449d47d7c5 req-dca67649-255c-49e2-8c93-1f383aa52664 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:20.493046 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-09f7063a-b61f-4d95-8b53-e0449d47d7c5 req-dca67649-255c-49e2-8c93-1f383aa52664 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:20.507865 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-09f7063a-b61f-4d95-8b53-e0449d47d7c5 req-dca67649-255c-49e2-8c93-1f383aa52664 service nova] Creating event network-vif-plugged:66751fc0-fec5-4bc6-859a-9a0368452b30 for instance 33a6128a-580f-4184-ba11-6511d5021242 on n-h1-846435-14 Jul 25 14:30:20.508862 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-09f7063a-b61f-4d95-8b53-e0449d47d7c5 req-dca67649-255c-49e2-8c93-1f383aa52664 service nova] Creating event network-vif-plugged:a454c550-e298-46f0-8c6c-7d7c39505dca for instance 698a551a-c019-4ae5-ba50-0d190e41ff03 on n-h2-846435-14 Jul 25 14:30:20.520467 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-09f7063a-b61f-4d95-8b53-e0449d47d7c5 req-dca67649-255c-49e2-8c93-1f383aa52664 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067689 Jul 25 14:30:20.521684 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 731/1400] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:30:20.528386 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-122a2213-6547-4902-a220-3cfa818e776f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:20.529613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-122a2213-6547-4902-a220-3cfa818e776f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:20.537040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-122a2213-6547-4902-a220-3cfa818e776f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:20.537946 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-122a2213-6547-4902-a220-3cfa818e776f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:20.539082 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-122a2213-6547-4902-a220-3cfa818e776f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:20.540472 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-122a2213-6547-4902-a220-3cfa818e776f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:20.620953 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-122a2213-6547-4902-a220-3cfa818e776f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:20.633570 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-122a2213-6547-4902-a220-3cfa818e776f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1208 microversion: 2.1 time: 0.110298 Jul 25 14:30:20.635912 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 732/1401] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:20 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1208 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:20.642278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8c6e6767-e71b-4765-a34a-6134dc2645b1 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '.version_select at 0x7f46876a3ee0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:21.209517 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8c6e6767-e71b-4765-a34a-6134dc2645b1 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/a8ef04a7-41b3-4c47-a896-a85c4bae6354" status: 202 len: 0 microversion: 2.1 time: 0.571959 Jul 25 14:30:21.210740 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 733/1402] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:30:20 2022] DELETE /compute/v2.1/os-security-groups/a8ef04a7-41b3-4c47-a896-a85c4bae6354 => generated 0 bytes in 574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:30:21.272542 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-696cd7fc-52f7-404c-adb0-263d279cef2f tempest-FloatingIPDetailsTestJSON-2085568505 tempest-FloatingIPDetailsTestJSON-2085568505-project] 10.222.0.88 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.122822 Jul 25 14:30:21.273881 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 670/1403] 10.222.0.88 () {60 vars in 1170 bytes} [Mon Jul 25 14:30:18 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:30:21.278821 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5ef95def-91f2-4fe2-bfe6-1e13ace72184 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '.version_select at 0x7f4687493ee0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:21.462585 n-d-846435-14 devstack@n-api.service[119303]: DEBUG neutronclient.v2_0.client [None req-5ef95def-91f2-4fe2-bfe6-1e13ace72184 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a8ef04a7-41b3-4c47-a896-a85c4bae6354 does not exist", "detail": ""}} {{(pid=119303) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 14:30:21.463194 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.security_group_api [None req-5ef95def-91f2-4fe2-bfe6-1e13ace72184 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Neutron security group a8ef04a7-41b3-4c47-a896-a85c4bae6354 not found {{(pid=119303) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 14:30:21.463720 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-5ef95def-91f2-4fe2-bfe6-1e13ace72184 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] HTTP exception thrown: Security group a8ef04a7-41b3-4c47-a896-a85c4bae6354 does not exist Jul 25 14:30:21.463720 n-d-846435-14 devstack@n-api.service[119303]: Neutron server returns request_ids: ['req-63a92beb-34c0-4551-bbe1-24f9ab956acd'] Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5ef95def-91f2-4fe2-bfe6-1e13ace72184 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Request method failure captured: Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/os-security-groups/a8ef04a7-41b3-4c47-a896-a85c4bae6354 HTTP/1.1 Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qjSWhK-vwJTt9-RUosNUl92O2IH7DXHM__YKwETUuX644ZNnaLPUYLl7n9jfiOhif_9NvqEaG0blLab1mJt658fIFOepG5Z0DCt4IZ2Chl0jBZNJNW6gm_-nwSZ3IWfSAUAPR-qkW1tUiXhGVJPIQGpNlpD2VqkHT6SMzyoZa1fOYg Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 3d71324b22554a3bb44d6aceb7bc3cbd Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d71324b22554a3bb44d6aceb7bc3cbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d71324b22554a3bb44d6aceb7bc3cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3d71324b22554a3bb44d6aceb7bc3cbd", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3d71324b22554a3bb44d6aceb7bc3cbd"}]}] Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 3d71324b22554a3bb44d6aceb7bc3cbd Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-SecurityGroupsTestJSON-81685064-project Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: b3f53d74a29243759065e68964f638dc Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-SecurityGroupsTestJSON-81685064-project Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: exception: Security group a8ef04a7-41b3-4c47-a896-a85c4bae6354 does not exist Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: Neutron server returns request_ids: ['req-63a92beb-34c0-4551-bbe1-24f9ab956acd'] Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'a8ef04a7-41b3-4c47-a896-a85c4bae6354'} Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 14:30:21.465619 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a8ef04a7-41b3-4c47-a896-a85c4bae6354 does not exist Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-63a92beb-34c0-4551-bbe1-24f9ab956acd'] Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a8ef04a7-41b3-4c47-a896-a85c4bae6354 does not exist Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-63a92beb-34c0-4551-bbe1-24f9ab956acd'] Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a8ef04a7-41b3-4c47-a896-a85c4bae6354 does not exist Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-63a92beb-34c0-4551-bbe1-24f9ab956acd'] Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a8ef04a7-41b3-4c47-a896-a85c4bae6354 does not exist Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-63a92beb-34c0-4551-bbe1-24f9ab956acd'] Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5ef95def-91f2-4fe2-bfe6-1e13ace72184 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Returning 404 to user: Security group a8ef04a7-41b3-4c47-a896-a85c4bae6354 does not exist Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: Neutron server returns request_ids: ['req-63a92beb-34c0-4551-bbe1-24f9ab956acd'] {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:30:21.470427 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5ef95def-91f2-4fe2-bfe6-1e13ace72184 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/os-security-groups/a8ef04a7-41b3-4c47-a896-a85c4bae6354" status: 404 len: 194 microversion: 2.1 time: 0.192062 Jul 25 14:30:21.474352 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 671/1404] 10.222.0.88 () {58 vars in 1269 bytes} [Mon Jul 25 14:30:21 2022] GET /compute/v2.1/os-security-groups/a8ef04a7-41b3-4c47-a896-a85c4bae6354 => generated 194 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:30:21.475769 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dadc5ca0-4b1b-4aaf-92d6-c599eeb9863e tempest-FloatingIPDetailsTestJSON-2085568505 tempest-FloatingIPDetailsTestJSON-2085568505-project] Action: 'create', calling method: .version_select at 0x7f4687285f70>, body: {"pool": null} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:21.571578 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8791a513-730c-4d29-a12b-fa4c627b126f tempest-ImagesMetadataNegativeTestJSON-1524713161 tempest-ImagesMetadataNegativeTestJSON-1524713161-project] Calling method '.version_select at 0x7f468740aee0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:21.598882 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-8791a513-730c-4d29-a12b-fa4c627b126f tempest-ImagesMetadataNegativeTestJSON-1524713161 tempest-ImagesMetadataNegativeTestJSON-1524713161-project] HTTP exception thrown: Image not found. Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8791a513-730c-4d29-a12b-fa4c627b126f tempest-ImagesMetadataNegativeTestJSON-1524713161 tempest-ImagesMetadataNegativeTestJSON-1524713161-project] Request method failure captured: Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/images/d17e76d4-321c-47e6-98fe-d237f71f2e4b/metadata/os_distro HTTP/1.1 Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qj97iybZjevczkcwNYVBpJyMdoOsJYVgkxtidCjfyyqSoTrBRyLSNWhnhSjL2W1oYpLM8phJRlVhXN_xPXlYlvqtYkFhnh2587Um0cq-pji3_tzvN_kgR8olQ8gRWxptHDBtl0ELjuLAKQEGEu5xWdVP6-GgV-8SJoLqODnthiD7ms Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 5d7614a1dbcb452f8e24db62c32cf44d Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1524713161 Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5d7614a1dbcb452f8e24db62c32cf44d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5d7614a1dbcb452f8e24db62c32cf44d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_5d7614a1dbcb452f8e24db62c32cf44d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/5d7614a1dbcb452f8e24db62c32cf44d"}]}] Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1524713161 Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 5d7614a1dbcb452f8e24db62c32cf44d Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1524713161 Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ImagesMetadataNegativeTestJSON-1524713161-project Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 9cbfb5d1e81e4dca93d63beaf5603db9 Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1524713161-project Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: exception: Image not found. Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'image_id': 'd17e76d4-321c-47e6-98fe-d237f71f2e4b', 'id': 'os_distro'} Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d17e76d4-321c-47e6-98fe-d237f71f2e4b Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 14:30:21.602820 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d17e76d4-321c-47e6-98fe-d237f71f2e4b could not be found. Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 14:30:21.609058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:21.615203 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8791a513-730c-4d29-a12b-fa4c627b126f tempest-ImagesMetadataNegativeTestJSON-1524713161 tempest-ImagesMetadataNegativeTestJSON-1524713161-project] Returning 404 to user: Image not found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:30:21.616343 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8791a513-730c-4d29-a12b-fa4c627b126f tempest-ImagesMetadataNegativeTestJSON-1524713161 tempest-ImagesMetadataNegativeTestJSON-1524713161-project] 10.222.0.88 "DELETE /compute/v2.1/images/d17e76d4-321c-47e6-98fe-d237f71f2e4b/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.404373 Jul 25 14:30:21.617521 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 734/1405] 10.222.0.88 () {58 vars in 1293 bytes} [Mon Jul 25 14:30:21 2022] DELETE /compute/v2.1/images/d17e76d4-321c-47e6-98fe-d237f71f2e4b/metadata/os_distro => generated 62 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:30:21.627465 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b97b3d8a-fce9-4da6-b199-51f3f294f0f7 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:21.628976 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b97b3d8a-fce9-4da6-b199-51f3f294f0f7 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:21.639286 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b97b3d8a-fce9-4da6-b199-51f3f294f0f7 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:21.643050 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b97b3d8a-fce9-4da6-b199-51f3f294f0f7 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:21.646056 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b97b3d8a-fce9-4da6-b199-51f3f294f0f7 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:21.646784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b97b3d8a-fce9-4da6-b199-51f3f294f0f7 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:22.214346 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b97b3d8a-fce9-4da6-b199-51f3f294f0f7 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:22.224603 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b97b3d8a-fce9-4da6-b199-51f3f294f0f7 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:22.226367 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b97b3d8a-fce9-4da6-b199-51f3f294f0f7 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:22.227464 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b97b3d8a-fce9-4da6-b199-51f3f294f0f7 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1874 microversion: 2.42 time: 0.608735 Jul 25 14:30:22.228586 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 735/1406] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:30:21 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1874 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:30:22.258294 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fdf65b7b-ba66-4874-9681-1b58bca71b9f tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '.version_select at 0x7f46873feee0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:22.997248 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fdf65b7b-ba66-4874-9681-1b58bca71b9f tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/22459124-2478-44f8-85a5-493b28676f28" status: 202 len: 0 microversion: 2.1 time: 0.758705 Jul 25 14:30:22.998266 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 736/1407] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:30:22 2022] DELETE /compute/v2.1/os-security-groups/22459124-2478-44f8-85a5-493b28676f28 => generated 0 bytes in 769 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:30:23.004349 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e173003c-3b5e-4e30-8f01-b3ab50d000ce tempest-ImagesMetadataNegativeTestJSON-1524713161 tempest-ImagesMetadataNegativeTestJSON-1524713161-project] Calling method '.version_select at 0x7f4687fe7940>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:23.043707 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-e173003c-3b5e-4e30-8f01-b3ab50d000ce tempest-ImagesMetadataNegativeTestJSON-1524713161 tempest-ImagesMetadataNegativeTestJSON-1524713161-project] HTTP exception thrown: Image not found. Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e173003c-3b5e-4e30-8f01-b3ab50d000ce tempest-ImagesMetadataNegativeTestJSON-1524713161 tempest-ImagesMetadataNegativeTestJSON-1524713161-project] Request method failure captured: Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/images/8962642c-cd70-45a4-8230-ab605bacdeef/metadata/os_version HTTP/1.1 Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qj97iybZjevczkcwNYVBpJyMdoOsJYVgkxtidCjfyyqSoTrBRyLSNWhnhSjL2W1oYpLM8phJRlVhXN_xPXlYlvqtYkFhnh2587Um0cq-pji3_tzvN_kgR8olQ8gRWxptHDBtl0ELjuLAKQEGEu5xWdVP6-GgV-8SJoLqODnthiD7ms Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 5d7614a1dbcb452f8e24db62c32cf44d Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1524713161 Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5d7614a1dbcb452f8e24db62c32cf44d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5d7614a1dbcb452f8e24db62c32cf44d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_5d7614a1dbcb452f8e24db62c32cf44d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/5d7614a1dbcb452f8e24db62c32cf44d"}]}] Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1524713161 Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 5d7614a1dbcb452f8e24db62c32cf44d Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1524713161 Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ImagesMetadataNegativeTestJSON-1524713161-project Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 9cbfb5d1e81e4dca93d63beaf5603db9 Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1524713161-project Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: exception: Image not found. Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'image_id': '8962642c-cd70-45a4-8230-ab605bacdeef', 'id': 'os_version'} Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8962642c-cd70-45a4-8230-ab605bacdeef Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 14:30:23.049720 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8962642c-cd70-45a4-8230-ab605bacdeef could not be found. Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e173003c-3b5e-4e30-8f01-b3ab50d000ce tempest-ImagesMetadataNegativeTestJSON-1524713161 tempest-ImagesMetadataNegativeTestJSON-1524713161-project] Returning 404 to user: Image not found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e173003c-3b5e-4e30-8f01-b3ab50d000ce tempest-ImagesMetadataNegativeTestJSON-1524713161 tempest-ImagesMetadataNegativeTestJSON-1524713161-project] 10.222.0.88 "GET /compute/v2.1/images/8962642c-cd70-45a4-8230-ab605bacdeef/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.053311 Jul 25 14:30:23.058850 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 737/1408] 10.222.0.88 () {58 vars in 1293 bytes} [Mon Jul 25 14:30:22 2022] GET /compute/v2.1/images/8962642c-cd70-45a4-8230-ab605bacdeef/metadata/os_version => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:30:23.064268 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-815fc1ef-447e-42ee-b1a2-4697fe1b005d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:23.071071 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-815fc1ef-447e-42ee-b1a2-4697fe1b005d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:23.091857 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-815fc1ef-447e-42ee-b1a2-4697fe1b005d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:23.092426 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-815fc1ef-447e-42ee-b1a2-4697fe1b005d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:23.093233 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-815fc1ef-447e-42ee-b1a2-4697fe1b005d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:23.093667 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-815fc1ef-447e-42ee-b1a2-4697fe1b005d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:23.454212 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-815fc1ef-447e-42ee-b1a2-4697fe1b005d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:23.465585 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-815fc1ef-447e-42ee-b1a2-4697fe1b005d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1312 microversion: 2.1 time: 0.410001 Jul 25 14:30:23.466945 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 738/1409] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:23 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1312 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:23.472938 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-99cf2721-9b51-4f1d-99c2-d37839b64d66 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '.version_select at 0x7f4695e5b430>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:23.535114 n-d-846435-14 devstack@n-api.service[119304]: DEBUG neutronclient.v2_0.client [None req-99cf2721-9b51-4f1d-99c2-d37839b64d66 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 22459124-2478-44f8-85a5-493b28676f28 does not exist", "detail": ""}} {{(pid=119304) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 14:30:23.536846 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.security_group_api [None req-99cf2721-9b51-4f1d-99c2-d37839b64d66 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Neutron security group 22459124-2478-44f8-85a5-493b28676f28 not found {{(pid=119304) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 14:30:23.538815 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-99cf2721-9b51-4f1d-99c2-d37839b64d66 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] HTTP exception thrown: Security group 22459124-2478-44f8-85a5-493b28676f28 does not exist Jul 25 14:30:23.538815 n-d-846435-14 devstack@n-api.service[119304]: Neutron server returns request_ids: ['req-69af9aa0-4983-46ad-8a4a-fd5c4155cd6a'] Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-99cf2721-9b51-4f1d-99c2-d37839b64d66 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Request method failure captured: Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/os-security-groups/22459124-2478-44f8-85a5-493b28676f28 HTTP/1.1 Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qjSWhK-vwJTt9-RUosNUl92O2IH7DXHM__YKwETUuX644ZNnaLPUYLl7n9jfiOhif_9NvqEaG0blLab1mJt658fIFOepG5Z0DCt4IZ2Chl0jBZNJNW6gm_-nwSZ3IWfSAUAPR-qkW1tUiXhGVJPIQGpNlpD2VqkHT6SMzyoZa1fOYg Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 3d71324b22554a3bb44d6aceb7bc3cbd Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d71324b22554a3bb44d6aceb7bc3cbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d71324b22554a3bb44d6aceb7bc3cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3d71324b22554a3bb44d6aceb7bc3cbd", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3d71324b22554a3bb44d6aceb7bc3cbd"}]}] Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 3d71324b22554a3bb44d6aceb7bc3cbd Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-SecurityGroupsTestJSON-81685064-project Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: b3f53d74a29243759065e68964f638dc Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-SecurityGroupsTestJSON-81685064-project Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: exception: Security group 22459124-2478-44f8-85a5-493b28676f28 does not exist Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: Neutron server returns request_ids: ['req-69af9aa0-4983-46ad-8a4a-fd5c4155cd6a'] Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '22459124-2478-44f8-85a5-493b28676f28'} Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 14:30:23.546927 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 22459124-2478-44f8-85a5-493b28676f28 does not exist Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-69af9aa0-4983-46ad-8a4a-fd5c4155cd6a'] Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 22459124-2478-44f8-85a5-493b28676f28 does not exist Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-69af9aa0-4983-46ad-8a4a-fd5c4155cd6a'] Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 22459124-2478-44f8-85a5-493b28676f28 does not exist Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-69af9aa0-4983-46ad-8a4a-fd5c4155cd6a'] Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 22459124-2478-44f8-85a5-493b28676f28 does not exist Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-69af9aa0-4983-46ad-8a4a-fd5c4155cd6a'] Jul 25 14:30:23.551723 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:23.557151 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-99cf2721-9b51-4f1d-99c2-d37839b64d66 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Returning 404 to user: Security group 22459124-2478-44f8-85a5-493b28676f28 does not exist Jul 25 14:30:23.557151 n-d-846435-14 devstack@n-api.service[119304]: Neutron server returns request_ids: ['req-69af9aa0-4983-46ad-8a4a-fd5c4155cd6a'] {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:30:23.558428 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-99cf2721-9b51-4f1d-99c2-d37839b64d66 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/os-security-groups/22459124-2478-44f8-85a5-493b28676f28" status: 404 len: 194 microversion: 2.1 time: 0.090110 Jul 25 14:30:23.559633 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 739/1410] 10.222.0.88 () {58 vars in 1269 bytes} [Mon Jul 25 14:30:23 2022] GET /compute/v2.1/os-security-groups/22459124-2478-44f8-85a5-493b28676f28 => generated 194 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:30:23.565802 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1d75639b-a9ee-4f8d-85e5-fae401c3a767 tempest-ImagesMetadataNegativeTestJSON-1524713161 tempest-ImagesMetadataNegativeTestJSON-1524713161-project] Calling method '.version_select at 0x7f4687624550>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:23.600350 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-1d75639b-a9ee-4f8d-85e5-fae401c3a767 tempest-ImagesMetadataNegativeTestJSON-1524713161 tempest-ImagesMetadataNegativeTestJSON-1524713161-project] HTTP exception thrown: Image not found. Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1d75639b-a9ee-4f8d-85e5-fae401c3a767 tempest-ImagesMetadataNegativeTestJSON-1524713161 tempest-ImagesMetadataNegativeTestJSON-1524713161-project] Request method failure captured: Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/images/a2b5419c-32f4-4f58-888d-5e6a3f5fcd85/metadata HTTP/1.1 Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qj97iybZjevczkcwNYVBpJyMdoOsJYVgkxtidCjfyyqSoTrBRyLSNWhnhSjL2W1oYpLM8phJRlVhXN_xPXlYlvqtYkFhnh2587Um0cq-pji3_tzvN_kgR8olQ8gRWxptHDBtl0ELjuLAKQEGEu5xWdVP6-GgV-8SJoLqODnthiD7ms Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 5d7614a1dbcb452f8e24db62c32cf44d Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1524713161 Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5d7614a1dbcb452f8e24db62c32cf44d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5d7614a1dbcb452f8e24db62c32cf44d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_5d7614a1dbcb452f8e24db62c32cf44d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/5d7614a1dbcb452f8e24db62c32cf44d"}]}] Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1524713161 Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 5d7614a1dbcb452f8e24db62c32cf44d Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1524713161 Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ImagesMetadataNegativeTestJSON-1524713161-project Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 9cbfb5d1e81e4dca93d63beaf5603db9 Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1524713161-project Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: exception: Image not found. Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'image_id': 'a2b5419c-32f4-4f58-888d-5e6a3f5fcd85'} Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a2b5419c-32f4-4f58-888d-5e6a3f5fcd85 Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 14:30:23.606827 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a2b5419c-32f4-4f58-888d-5e6a3f5fcd85 could not be found. Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 14:30:23.611698 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:23.618885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1d75639b-a9ee-4f8d-85e5-fae401c3a767 tempest-ImagesMetadataNegativeTestJSON-1524713161 tempest-ImagesMetadataNegativeTestJSON-1524713161-project] Returning 404 to user: Image not found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:30:23.620381 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1d75639b-a9ee-4f8d-85e5-fae401c3a767 tempest-ImagesMetadataNegativeTestJSON-1524713161 tempest-ImagesMetadataNegativeTestJSON-1524713161-project] 10.222.0.88 "GET /compute/v2.1/images/a2b5419c-32f4-4f58-888d-5e6a3f5fcd85/metadata" status: 404 len: 62 microversion: 2.1 time: 0.059369 Jul 25 14:30:23.626888 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 740/1411] 10.222.0.88 () {58 vars in 1260 bytes} [Mon Jul 25 14:30:23 2022] GET /compute/v2.1/images/a2b5419c-32f4-4f58-888d-5e6a3f5fcd85/metadata => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:30:23.640552 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dbf8cbdc-8d3a-4b73-a4a0-59ea16f7466e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:23.641660 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dbf8cbdc-8d3a-4b73-a4a0-59ea16f7466e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:23.673415 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dbf8cbdc-8d3a-4b73-a4a0-59ea16f7466e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:23.674200 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dbf8cbdc-8d3a-4b73-a4a0-59ea16f7466e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:23.675152 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dbf8cbdc-8d3a-4b73-a4a0-59ea16f7466e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:23.676290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dbf8cbdc-8d3a-4b73-a4a0-59ea16f7466e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:24.353557 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dbf8cbdc-8d3a-4b73-a4a0-59ea16f7466e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:24.417035 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dbf8cbdc-8d3a-4b73-a4a0-59ea16f7466e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:24.479727 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dbf8cbdc-8d3a-4b73-a4a0-59ea16f7466e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:24.492844 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dbf8cbdc-8d3a-4b73-a4a0-59ea16f7466e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 2830 microversion: 2.42 time: 0.864297 Jul 25 14:30:24.516719 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 741/1412] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:30:23 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 2830 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:30:24.527499 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4f2b132c-c940-43ec-9400-d3cca6796427 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '.version_select at 0x7f46874e18b0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:24.952800 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dadc5ca0-4b1b-4aaf-92d6-c599eeb9863e tempest-FloatingIPDetailsTestJSON-2085568505 tempest-FloatingIPDetailsTestJSON-2085568505-project] 10.222.0.88 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.479719 Jul 25 14:30:24.953497 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 672/1413] 10.222.0.88 () {60 vars in 1170 bytes} [Mon Jul 25 14:30:21 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:30:24.962535 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b5d08a15-63f3-4ff9-b2e2-7389e9546a94 tempest-ImagesMetadataNegativeTestJSON-1524713161 tempest-ImagesMetadataNegativeTestJSON-1524713161-project] Action: 'update_all', calling method: .version_select at 0x7f46872b8700>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:25.007089 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-b5d08a15-63f3-4ff9-b2e2-7389e9546a94 tempest-ImagesMetadataNegativeTestJSON-1524713161 tempest-ImagesMetadataNegativeTestJSON-1524713161-project] HTTP exception thrown: Image not found. Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b5d08a15-63f3-4ff9-b2e2-7389e9546a94 tempest-ImagesMetadataNegativeTestJSON-1524713161 tempest-ImagesMetadataNegativeTestJSON-1524713161-project] Request method failure captured: Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: request: PUT /compute/v2.1/images/88af5a57-b8f7-430f-bf24-322e09e4be8e/metadata HTTP/1.1 Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 57 Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qj97iybZjevczkcwNYVBpJyMdoOsJYVgkxtidCjfyyqSoTrBRyLSNWhnhSjL2W1oYpLM8phJRlVhXN_xPXlYlvqtYkFhnh2587Um0cq-pji3_tzvN_kgR8olQ8gRWxptHDBtl0ELjuLAKQEGEu5xWdVP6-GgV-8SJoLqODnthiD7ms Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 5d7614a1dbcb452f8e24db62c32cf44d Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1524713161 Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5d7614a1dbcb452f8e24db62c32cf44d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5d7614a1dbcb452f8e24db62c32cf44d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_5d7614a1dbcb452f8e24db62c32cf44d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/5d7614a1dbcb452f8e24db62c32cf44d"}]}] Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1524713161 Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 5d7614a1dbcb452f8e24db62c32cf44d Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1524713161 Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ImagesMetadataNegativeTestJSON-1524713161-project Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 9cbfb5d1e81e4dca93d63beaf5603db9 Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1524713161-project Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: exception: Image not found. Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'image_id': '88af5a57-b8f7-430f-bf24-322e09e4be8e', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 88af5a57-b8f7-430f-bf24-322e09e4be8e Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 14:30:25.016219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 88af5a57-b8f7-430f-bf24-322e09e4be8e could not be found. Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b5d08a15-63f3-4ff9-b2e2-7389e9546a94 tempest-ImagesMetadataNegativeTestJSON-1524713161 tempest-ImagesMetadataNegativeTestJSON-1524713161-project] Returning 404 to user: Image not found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:30:25.020535 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b5d08a15-63f3-4ff9-b2e2-7389e9546a94 tempest-ImagesMetadataNegativeTestJSON-1524713161 tempest-ImagesMetadataNegativeTestJSON-1524713161-project] 10.222.0.88 "PUT /compute/v2.1/images/88af5a57-b8f7-430f-bf24-322e09e4be8e/metadata" status: 404 len: 62 microversion: 2.1 time: 0.065371 Jul 25 14:30:25.024370 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 673/1414] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Jul 25 14:30:24 2022] PUT /compute/v2.1/images/88af5a57-b8f7-430f-bf24-322e09e4be8e/metadata => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:30:25.031486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-53d7197c-89c0-4632-b99c-1745c0b17d7c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:25.032210 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-53d7197c-89c0-4632-b99c-1745c0b17d7c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:25.065483 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-53d7197c-89c0-4632-b99c-1745c0b17d7c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:25.073721 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-53d7197c-89c0-4632-b99c-1745c0b17d7c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:25.075321 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-53d7197c-89c0-4632-b99c-1745c0b17d7c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:25.075899 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-53d7197c-89c0-4632-b99c-1745c0b17d7c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:25.564834 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4f2b132c-c940-43ec-9400-d3cca6796427 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/1752a74f-9a98-4cbb-8fdc-d39eb3c577dd" status: 202 len: 0 microversion: 2.1 time: 1.046753 Jul 25 14:30:25.566993 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 742/1415] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:30:24 2022] DELETE /compute/v2.1/os-security-groups/1752a74f-9a98-4cbb-8fdc-d39eb3c577dd => generated 0 bytes in 1050 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:30:25.573022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a7e5401b-ebfd-458b-99d1-c7eb5b6165d7 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:25.573947 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a7e5401b-ebfd-458b-99d1-c7eb5b6165d7 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:25.584489 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a7e5401b-ebfd-458b-99d1-c7eb5b6165d7 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:25.585152 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a7e5401b-ebfd-458b-99d1-c7eb5b6165d7 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:25.586930 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a7e5401b-ebfd-458b-99d1-c7eb5b6165d7 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:25.588213 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a7e5401b-ebfd-458b-99d1-c7eb5b6165d7 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:25.594451 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-53d7197c-89c0-4632-b99c-1745c0b17d7c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:25.605893 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-53d7197c-89c0-4632-b99c-1745c0b17d7c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1312 microversion: 2.1 time: 0.582218 Jul 25 14:30:25.606761 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 674/1416] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:25 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1312 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:25.633352 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ce991f2d-84cc-4bf4-96bd-a5c77d5f0a5d tempest-FloatingIPDetailsTestJSON-2085568505 tempest-FloatingIPDetailsTestJSON-2085568505-project] Calling method '.version_select at 0x7f4687257c10>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:25.913543 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a7e5401b-ebfd-458b-99d1-c7eb5b6165d7 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.345051 Jul 25 14:30:25.914158 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 743/1417] 10.222.0.88 () {60 vars in 1316 bytes} [Mon Jul 25 14:30:25 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242/os-interface => generated 1830 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:30:25.919534 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-beef03bc-6482-489c-9bc1-62fa9a133825 req-7905dcb5-16b3-482c-b5bf-4b54862608b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "115f3b11-988d-43c1-a81f-998139d12448", "tag": "f9ae53b2-7ccb-46f9-b164-3d57e251cc2f"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:25.956596 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-beef03bc-6482-489c-9bc1-62fa9a133825 req-7905dcb5-16b3-482c-b5bf-4b54862608b7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:25.958380 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-beef03bc-6482-489c-9bc1-62fa9a133825 req-7905dcb5-16b3-482c-b5bf-4b54862608b7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:25.980759 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-beef03bc-6482-489c-9bc1-62fa9a133825 req-7905dcb5-16b3-482c-b5bf-4b54862608b7 service nova] Creating event network-changed:f9ae53b2-7ccb-46f9-b164-3d57e251cc2f for instance 115f3b11-988d-43c1-a81f-998139d12448 on n-h2-846435-14 Jul 25 14:30:25.992099 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-beef03bc-6482-489c-9bc1-62fa9a133825 req-7905dcb5-16b3-482c-b5bf-4b54862608b7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074707 Jul 25 14:30:25.994877 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 744/1418] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:30:26.007250 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6c807f9a-f19a-447c-b0b0-8e95d1252d1f tempest-ImagesMetadataNegativeTestJSON-1524713161 tempest-ImagesMetadataNegativeTestJSON-1524713161-project] Action: 'update', calling method: .version_select at 0x7f46878d9a60>, body: {"meta": {"os_distro": "alt"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:26.017246 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ce991f2d-84cc-4bf4-96bd-a5c77d5f0a5d tempest-FloatingIPDetailsTestJSON-2085568505 tempest-FloatingIPDetailsTestJSON-2085568505-project] 10.222.0.88 "GET /compute/v2.1/os-floating-ips/3b0f7e2d-e77a-459e-b074-9fabf8f48aa6" status: 200 len: 142 microversion: 2.1 time: 0.396370 Jul 25 14:30:26.018328 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 675/1419] 10.222.0.88 () {58 vars in 1260 bytes} [Mon Jul 25 14:30:25 2022] GET /compute/v2.1/os-floating-ips/3b0f7e2d-e77a-459e-b074-9fabf8f48aa6 => generated 142 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:30:26.024121 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-11a64c0e-1695-4acf-b85a-3ec852906a05 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '.version_select at 0x7f46872c0160>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:26.052503 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-6c807f9a-f19a-447c-b0b0-8e95d1252d1f tempest-ImagesMetadataNegativeTestJSON-1524713161 tempest-ImagesMetadataNegativeTestJSON-1524713161-project] HTTP exception thrown: Image not found. Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6c807f9a-f19a-447c-b0b0-8e95d1252d1f tempest-ImagesMetadataNegativeTestJSON-1524713161 tempest-ImagesMetadataNegativeTestJSON-1524713161-project] Request method failure captured: Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: request: PUT /compute/v2.1/images/48b3df2e-da48-44ff-9e32-bf152c39478b/metadata/os_distro HTTP/1.1 Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 30 Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qj97iybZjevczkcwNYVBpJyMdoOsJYVgkxtidCjfyyqSoTrBRyLSNWhnhSjL2W1oYpLM8phJRlVhXN_xPXlYlvqtYkFhnh2587Um0cq-pji3_tzvN_kgR8olQ8gRWxptHDBtl0ELjuLAKQEGEu5xWdVP6-GgV-8SJoLqODnthiD7ms Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 5d7614a1dbcb452f8e24db62c32cf44d Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1524713161 Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5d7614a1dbcb452f8e24db62c32cf44d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5d7614a1dbcb452f8e24db62c32cf44d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_5d7614a1dbcb452f8e24db62c32cf44d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/5d7614a1dbcb452f8e24db62c32cf44d"}]}] Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1524713161 Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 5d7614a1dbcb452f8e24db62c32cf44d Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1524713161 Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ImagesMetadataNegativeTestJSON-1524713161-project Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 9cbfb5d1e81e4dca93d63beaf5603db9 Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1524713161-project Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: {"meta": {"os_distro": "alt"}} Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: exception: Image not found. Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'image_id': '48b3df2e-da48-44ff-9e32-bf152c39478b', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 48b3df2e-da48-44ff-9e32-bf152c39478b Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 14:30:26.058350 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 48b3df2e-da48-44ff-9e32-bf152c39478b could not be found. Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:26.063819 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6c807f9a-f19a-447c-b0b0-8e95d1252d1f tempest-ImagesMetadataNegativeTestJSON-1524713161 tempest-ImagesMetadataNegativeTestJSON-1524713161-project] Returning 404 to user: Image not found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:30:26.072124 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6c807f9a-f19a-447c-b0b0-8e95d1252d1f tempest-ImagesMetadataNegativeTestJSON-1524713161 tempest-ImagesMetadataNegativeTestJSON-1524713161-project] 10.222.0.88 "PUT /compute/v2.1/images/48b3df2e-da48-44ff-9e32-bf152c39478b/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.072950 Jul 25 14:30:26.078033 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 745/1420] 10.222.0.88 () {60 vars in 1310 bytes} [Mon Jul 25 14:30:25 2022] PUT /compute/v2.1/images/48b3df2e-da48-44ff-9e32-bf152c39478b/metadata/os_distro => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:30:26.087346 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4dbb1479-8b87-4814-aa0a-afa93378efb5 tempest-FloatingIPDetailsTestJSON-2085568505 tempest-FloatingIPDetailsTestJSON-2085568505-project] Calling method '.version_select at 0x7f4687fe7040>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:26.088577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG neutronclient.v2_0.client [None req-11a64c0e-1695-4acf-b85a-3ec852906a05 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1752a74f-9a98-4cbb-8fdc-d39eb3c577dd does not exist", "detail": ""}} {{(pid=119303) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 14:30:26.089219 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.security_group_api [None req-11a64c0e-1695-4acf-b85a-3ec852906a05 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Neutron security group 1752a74f-9a98-4cbb-8fdc-d39eb3c577dd not found {{(pid=119303) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 14:30:26.094577 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-11a64c0e-1695-4acf-b85a-3ec852906a05 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] HTTP exception thrown: Security group 1752a74f-9a98-4cbb-8fdc-d39eb3c577dd does not exist Jul 25 14:30:26.094577 n-d-846435-14 devstack@n-api.service[119303]: Neutron server returns request_ids: ['req-7e7f7089-1e79-4952-ae4e-4e41a291050f'] Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-11a64c0e-1695-4acf-b85a-3ec852906a05 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Request method failure captured: Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/os-security-groups/1752a74f-9a98-4cbb-8fdc-d39eb3c577dd HTTP/1.1 Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qjSWhK-vwJTt9-RUosNUl92O2IH7DXHM__YKwETUuX644ZNnaLPUYLl7n9jfiOhif_9NvqEaG0blLab1mJt658fIFOepG5Z0DCt4IZ2Chl0jBZNJNW6gm_-nwSZ3IWfSAUAPR-qkW1tUiXhGVJPIQGpNlpD2VqkHT6SMzyoZa1fOYg Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 3d71324b22554a3bb44d6aceb7bc3cbd Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d71324b22554a3bb44d6aceb7bc3cbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d71324b22554a3bb44d6aceb7bc3cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3d71324b22554a3bb44d6aceb7bc3cbd", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3d71324b22554a3bb44d6aceb7bc3cbd"}]}] Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 3d71324b22554a3bb44d6aceb7bc3cbd Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-SecurityGroupsTestJSON-81685064-project Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: b3f53d74a29243759065e68964f638dc Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-SecurityGroupsTestJSON-81685064-project Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: exception: Security group 1752a74f-9a98-4cbb-8fdc-d39eb3c577dd does not exist Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: Neutron server returns request_ids: ['req-7e7f7089-1e79-4952-ae4e-4e41a291050f'] Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '1752a74f-9a98-4cbb-8fdc-d39eb3c577dd'} Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 14:30:26.096513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1752a74f-9a98-4cbb-8fdc-d39eb3c577dd does not exist Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e7f7089-1e79-4952-ae4e-4e41a291050f'] Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1752a74f-9a98-4cbb-8fdc-d39eb3c577dd does not exist Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e7f7089-1e79-4952-ae4e-4e41a291050f'] Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1752a74f-9a98-4cbb-8fdc-d39eb3c577dd does not exist Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e7f7089-1e79-4952-ae4e-4e41a291050f'] Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1752a74f-9a98-4cbb-8fdc-d39eb3c577dd does not exist Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e7f7089-1e79-4952-ae4e-4e41a291050f'] Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-11a64c0e-1695-4acf-b85a-3ec852906a05 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Returning 404 to user: Security group 1752a74f-9a98-4cbb-8fdc-d39eb3c577dd does not exist Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: Neutron server returns request_ids: ['req-7e7f7089-1e79-4952-ae4e-4e41a291050f'] {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-11a64c0e-1695-4acf-b85a-3ec852906a05 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/os-security-groups/1752a74f-9a98-4cbb-8fdc-d39eb3c577dd" status: 404 len: 194 microversion: 2.1 time: 0.078336 Jul 25 14:30:26.101422 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 676/1421] 10.222.0.88 () {58 vars in 1269 bytes} [Mon Jul 25 14:30:26 2022] GET /compute/v2.1/os-security-groups/1752a74f-9a98-4cbb-8fdc-d39eb3c577dd => generated 194 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:30:26.107211 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dec88a4f-4f87-4117-8d99-6227ab06f2b8 tempest-ImagesMetadataNegativeTestJSON-1524713161 tempest-ImagesMetadataNegativeTestJSON-1524713161-project] Action: 'create', calling method: .version_select at 0x7f468727d670>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:26.149223 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-dec88a4f-4f87-4117-8d99-6227ab06f2b8 tempest-ImagesMetadataNegativeTestJSON-1524713161 tempest-ImagesMetadataNegativeTestJSON-1524713161-project] HTTP exception thrown: Image not found. Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dec88a4f-4f87-4117-8d99-6227ab06f2b8 tempest-ImagesMetadataNegativeTestJSON-1524713161 tempest-ImagesMetadataNegativeTestJSON-1524713161-project] Request method failure captured: Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/images/584cf336-e4e0-4b08-ba7b-eb5ce9a82c9e/metadata HTTP/1.1 Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 57 Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qj97iybZjevczkcwNYVBpJyMdoOsJYVgkxtidCjfyyqSoTrBRyLSNWhnhSjL2W1oYpLM8phJRlVhXN_xPXlYlvqtYkFhnh2587Um0cq-pji3_tzvN_kgR8olQ8gRWxptHDBtl0ELjuLAKQEGEu5xWdVP6-GgV-8SJoLqODnthiD7ms Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 5d7614a1dbcb452f8e24db62c32cf44d Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1524713161 Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5d7614a1dbcb452f8e24db62c32cf44d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5d7614a1dbcb452f8e24db62c32cf44d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_5d7614a1dbcb452f8e24db62c32cf44d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/5d7614a1dbcb452f8e24db62c32cf44d"}]}] Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1524713161 Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 5d7614a1dbcb452f8e24db62c32cf44d Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1524713161 Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ImagesMetadataNegativeTestJSON-1524713161-project Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 9cbfb5d1e81e4dca93d63beaf5603db9 Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1524713161-project Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: exception: Image not found. Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'image_id': '584cf336-e4e0-4b08-ba7b-eb5ce9a82c9e', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 584cf336-e4e0-4b08-ba7b-eb5ce9a82c9e Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 14:30:26.151341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 584cf336-e4e0-4b08-ba7b-eb5ce9a82c9e could not be found. Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dec88a4f-4f87-4117-8d99-6227ab06f2b8 tempest-ImagesMetadataNegativeTestJSON-1524713161 tempest-ImagesMetadataNegativeTestJSON-1524713161-project] Returning 404 to user: Image not found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dec88a4f-4f87-4117-8d99-6227ab06f2b8 tempest-ImagesMetadataNegativeTestJSON-1524713161 tempest-ImagesMetadataNegativeTestJSON-1524713161-project] 10.222.0.88 "POST /compute/v2.1/images/584cf336-e4e0-4b08-ba7b-eb5ce9a82c9e/metadata" status: 404 len: 62 microversion: 2.1 time: 0.053216 Jul 25 14:30:26.156336 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 677/1422] 10.222.0.88 () {60 vars in 1281 bytes} [Mon Jul 25 14:30:26 2022] POST /compute/v2.1/images/584cf336-e4e0-4b08-ba7b-eb5ce9a82c9e/metadata => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:30:26.166118 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b86f0d5a-2728-4dc9-960e-d5562d6b85fe tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '.version_select at 0x7f4687285040>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:26.472758 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b86f0d5a-2728-4dc9-960e-d5562d6b85fe tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.312217 Jul 25 14:30:26.473365 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 678/1423] 10.222.0.88 () {58 vars in 1158 bytes} [Mon Jul 25 14:30:26 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:26.489919 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-74548ce1-257a-4488-8108-824aae890583 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Action: 'create', calling method: .version_select at 0x7f4687200700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-23682283", "description": "tempest-description-512328348"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:26.742013 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-74548ce1-257a-4488-8108-824aae890583 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.256065 Jul 25 14:30:26.744718 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 679/1424] 10.222.0.88 () {60 vars in 1180 bytes} [Mon Jul 25 14:30:26 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:30:26.752677 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-00611cab-cfa8-4d00-81b2-68255d052898 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:26.753365 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-00611cab-cfa8-4d00-81b2-68255d052898 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:26.774680 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00611cab-cfa8-4d00-81b2-68255d052898 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:26.775302 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00611cab-cfa8-4d00-81b2-68255d052898 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:26.780552 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00611cab-cfa8-4d00-81b2-68255d052898 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:26.784769 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00611cab-cfa8-4d00-81b2-68255d052898 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:26.961330 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-00611cab-cfa8-4d00-81b2-68255d052898 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:26.970746 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-00611cab-cfa8-4d00-81b2-68255d052898 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1312 microversion: 2.1 time: 0.223794 Jul 25 14:30:26.971548 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 680/1425] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:26 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1312 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:26.981487 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a919afcb-8926-4511-8432-9ca4aef572fc tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:26.982708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a919afcb-8926-4511-8432-9ca4aef572fc tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:26.993884 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a919afcb-8926-4511-8432-9ca4aef572fc tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:26.994400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a919afcb-8926-4511-8432-9ca4aef572fc tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:26.995444 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a919afcb-8926-4511-8432-9ca4aef572fc tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:26.996337 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a919afcb-8926-4511-8432-9ca4aef572fc tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:27.208713 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-a919afcb-8926-4511-8432-9ca4aef572fc tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lazy-loading 'services' on Instance uuid 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:30:27.225580 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a919afcb-8926-4511-8432-9ca4aef572fc tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 2346 microversion: 2.25 time: 0.252786 Jul 25 14:30:27.226169 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 681/1426] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:30:26 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 2346 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:30:27.232822 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ebbcb667-97a4-4b83-aecc-28c413ac486f tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Action: 'create', calling method: .version_select at 0x7f4687318ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1258392415", "description": "tempest-description-927159600"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:27.481802 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ebbcb667-97a4-4b83-aecc-28c413ac486f tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.254545 Jul 25 14:30:27.496471 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 682/1427] 10.222.0.88 () {60 vars in 1180 bytes} [Mon Jul 25 14:30:27 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:30:27.502347 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-086bd6c3-ccc1-4d59-aca5-f6f392e796f2 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:27.505161 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:30:27.505161 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:30:27.510985 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-086bd6c3-ccc1-4d59-aca5-f6f392e796f2 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:27.511481 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-086bd6c3-ccc1-4d59-aca5-f6f392e796f2 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:27.515744 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-086bd6c3-ccc1-4d59-aca5-f6f392e796f2 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:27.522160 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-086bd6c3-ccc1-4d59-aca5-f6f392e796f2 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:27.622268 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-086bd6c3-ccc1-4d59-aca5-f6f392e796f2 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.138024 Jul 25 14:30:27.643277 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 683/1428] 10.222.0.88 () {60 vars in 1217 bytes} [Mon Jul 25 14:30:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:30:27.659131 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-77f5a6f5-17e1-4171-9833-80bfc5d04dbc tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-919375906", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "9c10ea26-e276-4e9b-9f29-592bd546ef76"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:27.789341 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-77f5a6f5-17e1-4171-9833-80bfc5d04dbc tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] validate_networks() for [('9c10ea26-e276-4e9b-9f29-592bd546ef76', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:30:29.263929 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:30:29.297663 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:30:29.803720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-77f5a6f5-17e1-4171-9833-80bfc5d04dbc tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:30:29.804303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-77f5a6f5-17e1-4171-9833-80bfc5d04dbc tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:30:29.804537 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-77f5a6f5-17e1-4171-9833-80bfc5d04dbc tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:30:29.804945 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-77f5a6f5-17e1-4171-9833-80bfc5d04dbc tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:30:29.805348 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-77f5a6f5-17e1-4171-9833-80bfc5d04dbc tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:30:29.831407 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77f5a6f5-17e1-4171-9833-80bfc5d04dbc tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:29.831856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77f5a6f5-17e1-4171-9833-80bfc5d04dbc tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:29.833455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77f5a6f5-17e1-4171-9833-80bfc5d04dbc tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:29.834071 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77f5a6f5-17e1-4171-9833-80bfc5d04dbc tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:29.880699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-77f5a6f5-17e1-4171-9833-80bfc5d04dbc tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Getting quotas for project 3d71324b22554a3bb44d6aceb7bc3cbd. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:30:29.902517 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-77f5a6f5-17e1-4171-9833-80bfc5d04dbc tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Getting quotas for user b3f53d74a29243759065e68964f638dc and project 3d71324b22554a3bb44d6aceb7bc3cbd. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:30:29.945133 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-77f5a6f5-17e1-4171-9833-80bfc5d04dbc tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:30:29.950977 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-77f5a6f5-17e1-4171-9833-80bfc5d04dbc tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 633a0bd6-3680-40d7-9e3d-224e349c0f22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:30:30.071300 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-77f5a6f5-17e1-4171-9833-80bfc5d04dbc tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.417384 Jul 25 14:30:30.077539 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 684/1429] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:30:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2426 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:30:30.086454 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-aecd3849-0489-4678-bb03-42369d7991e5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:30.094268 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-aecd3849-0489-4678-bb03-42369d7991e5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:30.104132 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aecd3849-0489-4678-bb03-42369d7991e5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:30.104703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aecd3849-0489-4678-bb03-42369d7991e5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:30.105757 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aecd3849-0489-4678-bb03-42369d7991e5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:30.106473 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aecd3849-0489-4678-bb03-42369d7991e5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:31.270480 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-aecd3849-0489-4678-bb03-42369d7991e5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:31.284931 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-aecd3849-0489-4678-bb03-42369d7991e5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1312 microversion: 2.1 time: 1.200692 Jul 25 14:30:31.287655 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 685/1430] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:30 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1312 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:31.301965 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-379e88b2-0d65-4a50-99c3-9be716fc2919 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:31.303110 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-379e88b2-0d65-4a50-99c3-9be716fc2919 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 633a0bd6-3680-40d7-9e3d-224e349c0f22] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:31.322914 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:30:31.327227 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-379e88b2-0d65-4a50-99c3-9be716fc2919 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:31.332013 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-379e88b2-0d65-4a50-99c3-9be716fc2919 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:31.333199 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-379e88b2-0d65-4a50-99c3-9be716fc2919 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:31.333908 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-379e88b2-0d65-4a50-99c3-9be716fc2919 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:31.403395 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=85 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:30:31.804160 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4dbb1479-8b87-4814-aa0a-afa93378efb5 tempest-FloatingIPDetailsTestJSON-2085568505 tempest-FloatingIPDetailsTestJSON-2085568505-project] 10.222.0.88 "DELETE /compute/v2.1/os-floating-ips/3b0f7e2d-e77a-459e-b074-9fabf8f48aa6" status: 202 len: 0 microversion: 2.1 time: 5.729391 Jul 25 14:30:31.805350 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 746/1431] 10.222.0.88 () {58 vars in 1263 bytes} [Mon Jul 25 14:30:26 2022] DELETE /compute/v2.1/os-floating-ips/3b0f7e2d-e77a-459e-b074-9fabf8f48aa6 => generated 0 bytes in 5731 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:30:31.811195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-6069ac21-d977-4e25-a3c5-e553e9517411 req-29831984-3788-43d0-b622-f1a043738eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "115f3b11-988d-43c1-a81f-998139d12448", "name": "network-vif-plugged", "status": "completed", "tag": "f9ae53b2-7ccb-46f9-b164-3d57e251cc2f"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:31.825416 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-6069ac21-d977-4e25-a3c5-e553e9517411 req-29831984-3788-43d0-b622-f1a043738eae service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:31.825956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-6069ac21-d977-4e25-a3c5-e553e9517411 req-29831984-3788-43d0-b622-f1a043738eae service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:31.859501 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-6069ac21-d977-4e25-a3c5-e553e9517411 req-29831984-3788-43d0-b622-f1a043738eae service nova] Creating event network-vif-plugged:f9ae53b2-7ccb-46f9-b164-3d57e251cc2f for instance 115f3b11-988d-43c1-a81f-998139d12448 on n-h2-846435-14 Jul 25 14:30:31.877555 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-6069ac21-d977-4e25-a3c5-e553e9517411 req-29831984-3788-43d0-b622-f1a043738eae service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071372 Jul 25 14:30:31.880396 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 747/1432] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:30:31.900585 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-24d4f40a-19b7-4e7e-a3e2-1bc93d2ccac3 req-515f1e21-7dca-49bf-ad57-9196087c873c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33a6128a-580f-4184-ba11-6511d5021242", "tag": "117e3c70-2257-4ddb-af6d-4e75db8fcb77"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:31.936423 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-24d4f40a-19b7-4e7e-a3e2-1bc93d2ccac3 req-515f1e21-7dca-49bf-ad57-9196087c873c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:31.939886 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-24d4f40a-19b7-4e7e-a3e2-1bc93d2ccac3 req-515f1e21-7dca-49bf-ad57-9196087c873c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:31.999480 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-24d4f40a-19b7-4e7e-a3e2-1bc93d2ccac3 req-515f1e21-7dca-49bf-ad57-9196087c873c service nova] Creating event network-changed:117e3c70-2257-4ddb-af6d-4e75db8fcb77 for instance 33a6128a-580f-4184-ba11-6511d5021242 on n-h1-846435-14 Jul 25 14:30:32.025299 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-24d4f40a-19b7-4e7e-a3e2-1bc93d2ccac3 req-515f1e21-7dca-49bf-ad57-9196087c873c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135876 Jul 25 14:30:32.027082 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 748/1433] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:30:32.055550 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8825c817-96bd-417c-bb7a-8ea71169b0d4 tempest-FloatingIPDetailsTestJSON-2085568505 tempest-FloatingIPDetailsTestJSON-2085568505-project] Calling method '.version_select at 0x7f46879b48b0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:32.603658 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8825c817-96bd-417c-bb7a-8ea71169b0d4 tempest-FloatingIPDetailsTestJSON-2085568505 tempest-FloatingIPDetailsTestJSON-2085568505-project] 10.222.0.88 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.573335 Jul 25 14:30:32.606867 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 749/1434] 10.222.0.88 () {58 vars in 1164 bytes} [Mon Jul 25 14:30:32 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:30:32.615599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d8b4629d-29eb-4823-831b-c0d1bb0f6f4c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "926bc227-e97d-41d9-94b7-892e6ede6538", "device": "/dev/xvdb"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:32.619389 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-379e88b2-0d65-4a50-99c3-9be716fc2919 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f53d74a29243759065e68964f638dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d71324b22554a3bb44d6aceb7bc3cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:32.623251 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d8b4629d-29eb-4823-831b-c0d1bb0f6f4c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:32.640117 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-379e88b2-0d65-4a50-99c3-9be716fc2919 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22" status: 200 len: 1219 microversion: 2.1 time: 1.350350 Jul 25 14:30:32.641067 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 686/1435] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:31 2022] GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22 => generated 1219 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:32.655098 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8780bca0-61ee-4629-95c7-9f03b7390825 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:32.656699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8780bca0-61ee-4629-95c7-9f03b7390825 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:32.658711 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d8b4629d-29eb-4823-831b-c0d1bb0f6f4c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:32.659487 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d8b4629d-29eb-4823-831b-c0d1bb0f6f4c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:32.674179 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d8b4629d-29eb-4823-831b-c0d1bb0f6f4c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:32.675832 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d8b4629d-29eb-4823-831b-c0d1bb0f6f4c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:32.684324 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8780bca0-61ee-4629-95c7-9f03b7390825 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:32.691747 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8780bca0-61ee-4629-95c7-9f03b7390825 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:32.694016 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8780bca0-61ee-4629-95c7-9f03b7390825 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:32.694689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8780bca0-61ee-4629-95c7-9f03b7390825 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:33.256696 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d8b4629d-29eb-4823-831b-c0d1bb0f6f4c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "POST /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.647977 Jul 25 14:30:33.284867 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 750/1436] 10.222.0.88 () {62 vars in 1364 bytes} [Mon Jul 25 14:30:32 2022] POST /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c/os-volume_attachments => generated 194 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:30:33.326729 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-49f6b51d-6eb5-4a94-8d8a-5070a35c1a74 tempest-FloatingIPDetailsTestJSON-2085568505 tempest-FloatingIPDetailsTestJSON-2085568505-project] Calling method '.version_select at 0x7f4687ff5b80>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:33.483888 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8780bca0-61ee-4629-95c7-9f03b7390825 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:33.495891 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8780bca0-61ee-4629-95c7-9f03b7390825 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1312 microversion: 2.1 time: 0.848697 Jul 25 14:30:33.511096 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 687/1437] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:32 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1312 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:33.661896 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-17e1c8da-1db3-41e9-87d1-581003cc8da2 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:33.662493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-17e1c8da-1db3-41e9-87d1-581003cc8da2 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 633a0bd6-3680-40d7-9e3d-224e349c0f22] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:33.675466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-17e1c8da-1db3-41e9-87d1-581003cc8da2 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:33.675918 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-17e1c8da-1db3-41e9-87d1-581003cc8da2 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:33.681066 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-17e1c8da-1db3-41e9-87d1-581003cc8da2 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:33.681524 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-17e1c8da-1db3-41e9-87d1-581003cc8da2 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:34.413105 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-17e1c8da-1db3-41e9-87d1-581003cc8da2 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f53d74a29243759065e68964f638dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d71324b22554a3bb44d6aceb7bc3cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:34.446795 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-17e1c8da-1db3-41e9-87d1-581003cc8da2 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22" status: 200 len: 1273 microversion: 2.1 time: 0.789930 Jul 25 14:30:34.472355 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 688/1438] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:33 2022] GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22 => generated 1273 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:30:34.518846 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-61d78513-d619-45dc-9828-861bc776e85d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:34.519464 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-61d78513-d619-45dc-9828-861bc776e85d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:34.543133 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-61d78513-d619-45dc-9828-861bc776e85d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:34.543580 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-61d78513-d619-45dc-9828-861bc776e85d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:34.564770 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-61d78513-d619-45dc-9828-861bc776e85d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:34.565365 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-61d78513-d619-45dc-9828-861bc776e85d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:35.232040 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-49f6b51d-6eb5-4a94-8d8a-5070a35c1a74 tempest-FloatingIPDetailsTestJSON-2085568505 tempest-FloatingIPDetailsTestJSON-2085568505-project] 10.222.0.88 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 1.943391 Jul 25 14:30:35.232962 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 751/1439] 10.222.0.88 () {58 vars in 1149 bytes} [Mon Jul 25 14:30:33 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 1948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:30:35.247653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6731444e-d484-4520-bd29-15f315b11e3f tempest-FloatingIPDetailsTestJSON-2085568505 tempest-FloatingIPDetailsTestJSON-2085568505-project] Calling method '.version_select at 0x7f4694438b80>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:35.574697 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-61d78513-d619-45dc-9828-861bc776e85d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:35.586903 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-61d78513-d619-45dc-9828-861bc776e85d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1312 microversion: 2.1 time: 1.072215 Jul 25 14:30:35.592210 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 689/1440] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:34 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1312 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:30:35.606418 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-25c55d65-d429-419e-85f8-4fca5f4f76d0 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:35.607567 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-25c55d65-d429-419e-85f8-4fca5f4f76d0 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 633a0bd6-3680-40d7-9e3d-224e349c0f22] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:35.666891 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-25c55d65-d429-419e-85f8-4fca5f4f76d0 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:35.667654 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-25c55d65-d429-419e-85f8-4fca5f4f76d0 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:35.669410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-25c55d65-d429-419e-85f8-4fca5f4f76d0 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:35.671317 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-25c55d65-d429-419e-85f8-4fca5f4f76d0 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:36.462806 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-25c55d65-d429-419e-85f8-4fca5f4f76d0 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f53d74a29243759065e68964f638dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d71324b22554a3bb44d6aceb7bc3cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:36.473994 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-25c55d65-d429-419e-85f8-4fca5f4f76d0 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22" status: 200 len: 1315 microversion: 2.1 time: 0.880282 Jul 25 14:30:36.490845 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 690/1441] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:35 2022] GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22 => generated 1315 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:36.611073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b653e1ab-c936-4aa0-9fb6-fafd5711e52e tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:36.611827 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b653e1ab-c936-4aa0-9fb6-fafd5711e52e tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:36.624118 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b653e1ab-c936-4aa0-9fb6-fafd5711e52e tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:36.624570 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b653e1ab-c936-4aa0-9fb6-fafd5711e52e tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:36.631904 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b653e1ab-c936-4aa0-9fb6-fafd5711e52e tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:36.632814 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b653e1ab-c936-4aa0-9fb6-fafd5711e52e tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:37.263561 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b653e1ab-c936-4aa0-9fb6-fafd5711e52e tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:37.291960 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b653e1ab-c936-4aa0-9fb6-fafd5711e52e tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1462 microversion: 2.1 time: 0.681350 Jul 25 14:30:37.293648 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 691/1442] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:36 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1462 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:37.333696 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a3e5044a-14d4-4ed2-b9f3-fc1c578092d3 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:37.334702 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a3e5044a-14d4-4ed2-b9f3-fc1c578092d3 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:37.355396 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a3e5044a-14d4-4ed2-b9f3-fc1c578092d3 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:37.356514 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a3e5044a-14d4-4ed2-b9f3-fc1c578092d3 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:37.359037 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a3e5044a-14d4-4ed2-b9f3-fc1c578092d3 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:37.363161 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a3e5044a-14d4-4ed2-b9f3-fc1c578092d3 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:37.688183 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a3e5044a-14d4-4ed2-b9f3-fc1c578092d3 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1615 microversion: 2.1 time: 0.370120 Jul 25 14:30:37.693627 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 692/1443] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:37 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1615 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:30:37.713156 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-baa94c24-e6f0-4094-99a2-5497487270d0 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:37.718226 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-baa94c24-e6f0-4094-99a2-5497487270d0 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 633a0bd6-3680-40d7-9e3d-224e349c0f22] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:37.746695 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-baa94c24-e6f0-4094-99a2-5497487270d0 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:37.747658 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-baa94c24-e6f0-4094-99a2-5497487270d0 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:37.749594 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-baa94c24-e6f0-4094-99a2-5497487270d0 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:37.751512 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-baa94c24-e6f0-4094-99a2-5497487270d0 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:38.743806 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-baa94c24-e6f0-4094-99a2-5497487270d0 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f53d74a29243759065e68964f638dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d71324b22554a3bb44d6aceb7bc3cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:38.772408 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-baa94c24-e6f0-4094-99a2-5497487270d0 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22" status: 200 len: 1315 microversion: 2.1 time: 1.065885 Jul 25 14:30:38.773506 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 693/1444] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:37 2022] GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22 => generated 1315 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:38.797689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cf9f1bc7-6e9a-4530-b4d3-d79c99d7a2c6 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:38.798748 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cf9f1bc7-6e9a-4530-b4d3-d79c99d7a2c6 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:38.839836 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf9f1bc7-6e9a-4530-b4d3-d79c99d7a2c6 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:38.844791 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf9f1bc7-6e9a-4530-b4d3-d79c99d7a2c6 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:38.849274 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf9f1bc7-6e9a-4530-b4d3-d79c99d7a2c6 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:38.849962 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf9f1bc7-6e9a-4530-b4d3-d79c99d7a2c6 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:38.994469 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cf9f1bc7-6e9a-4530-b4d3-d79c99d7a2c6 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd8f2a5957f224095933cfaaecc9a800a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1dcb670bb2e4ec0b747b392ca4139eb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:38.998794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cf9f1bc7-6e9a-4530-b4d3-d79c99d7a2c6 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] [instance: 115f3b11-988d-43c1-a81f-998139d12448] flavor_id is None. Assuming migration. {{(pid=119303) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 25 14:30:38.999297 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cf9f1bc7-6e9a-4530-b4d3-d79c99d7a2c6 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119303) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 14:30:39.457567 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cf9f1bc7-6e9a-4530-b4d3-d79c99d7a2c6 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448/action" status: 202 len: 0 microversion: 2.1 time: 0.670911 Jul 25 14:30:39.463988 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 694/1445] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:30:38 2022] POST /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448/action => generated 0 bytes in 684 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:30:39.740988 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-133753bc-0f4f-4b45-865d-10bbc8af53b5 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1848137049", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "02a1497d-2151-4500-a802-575a0ee651dc"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:39.853962 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-133753bc-0f4f-4b45-865d-10bbc8af53b5 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] validate_networks() for [('02a1497d-2151-4500-a802-575a0ee651dc', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:30:39.863647 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:30:39.919930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:30:41.820558 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-133753bc-0f4f-4b45-865d-10bbc8af53b5 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:30:41.821289 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-133753bc-0f4f-4b45-865d-10bbc8af53b5 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:30:41.821461 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-133753bc-0f4f-4b45-865d-10bbc8af53b5 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:30:41.821941 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-133753bc-0f4f-4b45-865d-10bbc8af53b5 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:30:41.822576 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-133753bc-0f4f-4b45-865d-10bbc8af53b5 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:30:41.843079 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-133753bc-0f4f-4b45-865d-10bbc8af53b5 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:41.844872 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-133753bc-0f4f-4b45-865d-10bbc8af53b5 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:41.847301 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-133753bc-0f4f-4b45-865d-10bbc8af53b5 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:41.847777 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-133753bc-0f4f-4b45-865d-10bbc8af53b5 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:41.903450 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-133753bc-0f4f-4b45-865d-10bbc8af53b5 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Getting quotas for project c8a6408dd1d343b0a82c8ec6d1b7d5af. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:30:41.919945 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-133753bc-0f4f-4b45-865d-10bbc8af53b5 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Getting quotas for user 0f6a08479a4a4520b25a5b2e20c99670 and project c8a6408dd1d343b0a82c8ec6d1b7d5af. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:30:41.951791 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-133753bc-0f4f-4b45-865d-10bbc8af53b5 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:30:41.963597 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-133753bc-0f4f-4b45-865d-10bbc8af53b5 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:30:42.074620 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-133753bc-0f4f-4b45-865d-10bbc8af53b5 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.607134 Jul 25 14:30:42.075896 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 695/1446] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:30:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:30:42.089689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-397c2d86-6d8f-4b90-b89d-34f90048c926 req-1445ef17-1001-4bad-8cff-552a0d29d882 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "633a0bd6-3680-40d7-9e3d-224e349c0f22", "tag": "07cddb3e-f068-459f-9f01-a2ee486806fb"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:42.126501 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-397c2d86-6d8f-4b90-b89d-34f90048c926 req-1445ef17-1001-4bad-8cff-552a0d29d882 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:42.127010 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-397c2d86-6d8f-4b90-b89d-34f90048c926 req-1445ef17-1001-4bad-8cff-552a0d29d882 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:42.193584 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-397c2d86-6d8f-4b90-b89d-34f90048c926 req-1445ef17-1001-4bad-8cff-552a0d29d882 service nova] Creating event network-changed:07cddb3e-f068-459f-9f01-a2ee486806fb for instance 633a0bd6-3680-40d7-9e3d-224e349c0f22 on n-h2-846435-14 Jul 25 14:30:42.209002 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-397c2d86-6d8f-4b90-b89d-34f90048c926 req-1445ef17-1001-4bad-8cff-552a0d29d882 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130080 Jul 25 14:30:42.211926 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 696/1447] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:30:42.243739 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-65894fa1-592f-42d3-9787-331be367d46f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:42.251561 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-65894fa1-592f-42d3-9787-331be367d46f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:42.259830 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-65894fa1-592f-42d3-9787-331be367d46f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:42.262532 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-65894fa1-592f-42d3-9787-331be367d46f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:42.264043 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-65894fa1-592f-42d3-9787-331be367d46f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:42.267314 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-65894fa1-592f-42d3-9787-331be367d46f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:42.632431 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:30:42.721776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-65894fa1-592f-42d3-9787-331be367d46f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:42.738198 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-65894fa1-592f-42d3-9787-331be367d46f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1471 microversion: 2.1 time: 0.520780 Jul 25 14:30:42.738786 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 697/1448] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:42 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1471 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:42.767240 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-70a02fac-327a-42be-91ca-b9e5336ed16e tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:42.774118 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-70a02fac-327a-42be-91ca-b9e5336ed16e tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 633a0bd6-3680-40d7-9e3d-224e349c0f22] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:42.803817 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70a02fac-327a-42be-91ca-b9e5336ed16e tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:42.806056 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70a02fac-327a-42be-91ca-b9e5336ed16e tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:42.807075 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70a02fac-327a-42be-91ca-b9e5336ed16e tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:42.807669 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70a02fac-327a-42be-91ca-b9e5336ed16e tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:43.124942 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-70a02fac-327a-42be-91ca-b9e5336ed16e tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f53d74a29243759065e68964f638dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d71324b22554a3bb44d6aceb7bc3cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:43.154788 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-70a02fac-327a-42be-91ca-b9e5336ed16e tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22" status: 200 len: 1315 microversion: 2.1 time: 0.400859 Jul 25 14:30:43.166878 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 698/1449] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:42 2022] GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22 => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:43.172731 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1cbd7499-bed9-49fb-b95e-e2e4a5646c0c tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:43.173719 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1cbd7499-bed9-49fb-b95e-e2e4a5646c0c tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:43.238606 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:30:43.334821 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1cbd7499-bed9-49fb-b95e-e2e4a5646c0c tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:43.349400 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1cbd7499-bed9-49fb-b95e-e2e4a5646c0c tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1218 microversion: 2.1 time: 0.180272 Jul 25 14:30:43.360638 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 699/1450] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:43 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1218 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:43.560953 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6731444e-d484-4520-bd29-15f315b11e3f tempest-FloatingIPDetailsTestJSON-2085568505 tempest-FloatingIPDetailsTestJSON-2085568505-project] 10.222.0.88 "DELETE /compute/v2.1/os-floating-ips/f63742e9-4b97-4e14-9e07-3cddc732d5c3" status: 202 len: 0 microversion: 2.1 time: 8.317640 Jul 25 14:30:43.565107 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 752/1451] 10.222.0.88 () {58 vars in 1263 bytes} [Mon Jul 25 14:30:35 2022] DELETE /compute/v2.1/os-floating-ips/f63742e9-4b97-4e14-9e07-3cddc732d5c3 => generated 0 bytes in 8323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 14:30:43.572294 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-aa5775af-aeb6-4b8d-b80d-55d8f38ea4c5 tempest-FloatingIPDetailsTestJSON-2085568505 tempest-FloatingIPDetailsTestJSON-2085568505-project] Calling method '.version_select at 0x7f4687200820>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:43.759098 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d4538fae-d33d-4fbf-bea9-361053d67644 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:43.760574 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d4538fae-d33d-4fbf-bea9-361053d67644 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:43.767666 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d4538fae-d33d-4fbf-bea9-361053d67644 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:43.779354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d4538fae-d33d-4fbf-bea9-361053d67644 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:43.780629 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d4538fae-d33d-4fbf-bea9-361053d67644 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:43.781323 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d4538fae-d33d-4fbf-bea9-361053d67644 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:44.558525 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d4538fae-d33d-4fbf-bea9-361053d67644 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:44.582939 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d4538fae-d33d-4fbf-bea9-361053d67644 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1471 microversion: 2.1 time: 0.827732 Jul 25 14:30:44.584921 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 753/1452] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:43 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1471 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:30:44.592207 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6b54f32c-b2fe-41ea-b517-9daaf8e83bc4 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:44.593345 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6b54f32c-b2fe-41ea-b517-9daaf8e83bc4 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 633a0bd6-3680-40d7-9e3d-224e349c0f22] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:44.604710 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6b54f32c-b2fe-41ea-b517-9daaf8e83bc4 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:44.605469 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6b54f32c-b2fe-41ea-b517-9daaf8e83bc4 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:44.606848 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6b54f32c-b2fe-41ea-b517-9daaf8e83bc4 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:44.608615 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6b54f32c-b2fe-41ea-b517-9daaf8e83bc4 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:44.812585 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6b54f32c-b2fe-41ea-b517-9daaf8e83bc4 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f53d74a29243759065e68964f638dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d71324b22554a3bb44d6aceb7bc3cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:44.831369 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6b54f32c-b2fe-41ea-b517-9daaf8e83bc4 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22" status: 200 len: 1315 microversion: 2.1 time: 0.244968 Jul 25 14:30:44.832731 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 754/1453] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:44 2022] GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:44.850733 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6d84cce5-147a-4952-9585-be610b32cbff tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:44.851475 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6d84cce5-147a-4952-9585-be610b32cbff tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:44.863213 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d84cce5-147a-4952-9585-be610b32cbff tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:44.865120 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d84cce5-147a-4952-9585-be610b32cbff tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:44.867687 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d84cce5-147a-4952-9585-be610b32cbff tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:44.870044 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d84cce5-147a-4952-9585-be610b32cbff tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:45.118824 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6d84cce5-147a-4952-9585-be610b32cbff tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:45.134598 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6d84cce5-147a-4952-9585-be610b32cbff tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1276 microversion: 2.1 time: 0.287903 Jul 25 14:30:45.138362 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 755/1454] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:44 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1276 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:45.412084 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-37cbdb8f-5835-4ea2-a4cc-cd4326f67d53 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1385121395", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "9e0e98c7-e5b7-4308-ae4f-fa50e9a340ed"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:45.499075 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-37cbdb8f-5835-4ea2-a4cc-cd4326f67d53 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] validate_networks() for [('9e0e98c7-e5b7-4308-ae4f-fa50e9a340ed', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:30:46.112465 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-aa5775af-aeb6-4b8d-b80d-55d8f38ea4c5 tempest-FloatingIPDetailsTestJSON-2085568505 tempest-FloatingIPDetailsTestJSON-2085568505-project] 10.222.0.88 "DELETE /compute/v2.1/os-floating-ips/0efec306-6956-4e36-ab7f-986e725122a1" status: 202 len: 0 microversion: 2.1 time: 2.545849 Jul 25 14:30:46.114547 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 700/1455] 10.222.0.88 () {58 vars in 1263 bytes} [Mon Jul 25 14:30:43 2022] DELETE /compute/v2.1/os-floating-ips/0efec306-6956-4e36-ab7f-986e725122a1 => generated 0 bytes in 2549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:30:46.121935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-77369bf0-4017-42e3-a1c2-d369a7d45667 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:46.122856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-77369bf0-4017-42e3-a1c2-d369a7d45667 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:46.130987 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77369bf0-4017-42e3-a1c2-d369a7d45667 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:46.132193 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77369bf0-4017-42e3-a1c2-d369a7d45667 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:46.133257 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77369bf0-4017-42e3-a1c2-d369a7d45667 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:46.133747 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77369bf0-4017-42e3-a1c2-d369a7d45667 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:46.312898 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-77369bf0-4017-42e3-a1c2-d369a7d45667 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:46.323236 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-77369bf0-4017-42e3-a1c2-d369a7d45667 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1476 microversion: 2.1 time: 0.206223 Jul 25 14:30:46.334022 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 701/1456] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:46 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1476 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:46.345488 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-84ae0bd1-e1ec-4c34-89d9-679bc6eaf0c0 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:46.349004 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-84ae0bd1-e1ec-4c34-89d9-679bc6eaf0c0 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 633a0bd6-3680-40d7-9e3d-224e349c0f22] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:46.377375 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-84ae0bd1-e1ec-4c34-89d9-679bc6eaf0c0 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:46.378558 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-84ae0bd1-e1ec-4c34-89d9-679bc6eaf0c0 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:46.381949 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-84ae0bd1-e1ec-4c34-89d9-679bc6eaf0c0 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:46.382723 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-84ae0bd1-e1ec-4c34-89d9-679bc6eaf0c0 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:46.595333 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-84ae0bd1-e1ec-4c34-89d9-679bc6eaf0c0 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f53d74a29243759065e68964f638dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d71324b22554a3bb44d6aceb7bc3cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:46.605480 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-84ae0bd1-e1ec-4c34-89d9-679bc6eaf0c0 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22" status: 200 len: 1315 microversion: 2.1 time: 0.269196 Jul 25 14:30:46.609230 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 702/1457] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:46 2022] GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:46.615609 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-13fd8b62-a4b3-4647-a29e-0c2864b270d9 tempest-FloatingIPDetailsTestJSON-2085568505 tempest-FloatingIPDetailsTestJSON-2085568505-project] Calling method '.version_select at 0x7f468729e9d0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:46.747530 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-37cbdb8f-5835-4ea2-a4cc-cd4326f67d53 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:30:46.749100 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-37cbdb8f-5835-4ea2-a4cc-cd4326f67d53 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:30:46.749762 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-37cbdb8f-5835-4ea2-a4cc-cd4326f67d53 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:30:46.751582 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-37cbdb8f-5835-4ea2-a4cc-cd4326f67d53 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:30:46.752369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-37cbdb8f-5835-4ea2-a4cc-cd4326f67d53 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:30:46.782142 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37cbdb8f-5835-4ea2-a4cc-cd4326f67d53 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:46.782766 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37cbdb8f-5835-4ea2-a4cc-cd4326f67d53 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:46.783666 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37cbdb8f-5835-4ea2-a4cc-cd4326f67d53 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:46.784143 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37cbdb8f-5835-4ea2-a4cc-cd4326f67d53 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:46.828766 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-37cbdb8f-5835-4ea2-a4cc-cd4326f67d53 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Getting quotas for project ceaa4430d1864bc2bf9afdec9cd0cf64. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:30:46.842152 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-37cbdb8f-5835-4ea2-a4cc-cd4326f67d53 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Getting quotas for user 3da7c9a3c01f4dbca93d5e7aa688fc70 and project ceaa4430d1864bc2bf9afdec9cd0cf64. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:30:46.875811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-37cbdb8f-5835-4ea2-a4cc-cd4326f67d53 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:30:46.881388 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-37cbdb8f-5835-4ea2-a4cc-cd4326f67d53 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:30:46.957730 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-37cbdb8f-5835-4ea2-a4cc-cd4326f67d53 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.679440 Jul 25 14:30:46.959653 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 756/1458] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:30:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:30:46.970771 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6b327581-8a4b-48f5-b250-fd3d64bda3a8 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:46.973234 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6b327581-8a4b-48f5-b250-fd3d64bda3a8 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:46.984741 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6b327581-8a4b-48f5-b250-fd3d64bda3a8 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:46.985588 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6b327581-8a4b-48f5-b250-fd3d64bda3a8 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:46.986571 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6b327581-8a4b-48f5-b250-fd3d64bda3a8 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:46.987164 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6b327581-8a4b-48f5-b250-fd3d64bda3a8 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:47.118880 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6b327581-8a4b-48f5-b250-fd3d64bda3a8 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:47.128519 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6b327581-8a4b-48f5-b250-fd3d64bda3a8 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1276 microversion: 2.1 time: 0.167450 Jul 25 14:30:47.147565 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 757/1459] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:46 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1276 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:47.161708 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fc3dfc3c-ef2f-4f79-a2e4-2ba1daeb9f3c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:47.162332 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fc3dfc3c-ef2f-4f79-a2e4-2ba1daeb9f3c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:47.356439 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fc3dfc3c-ef2f-4f79-a2e4-2ba1daeb9f3c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:47.372643 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fc3dfc3c-ef2f-4f79-a2e4-2ba1daeb9f3c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd" status: 200 len: 1211 microversion: 2.1 time: 0.223704 Jul 25 14:30:47.377985 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 758/1460] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:47 2022] GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd => generated 1211 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:47.390244 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b5c3ad9a-60f4-4f19-be81-7f56b58ff195 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:47.395918 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b5c3ad9a-60f4-4f19-be81-7f56b58ff195 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:47.419938 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b5c3ad9a-60f4-4f19-be81-7f56b58ff195 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:47.420870 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b5c3ad9a-60f4-4f19-be81-7f56b58ff195 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:47.424132 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b5c3ad9a-60f4-4f19-be81-7f56b58ff195 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:47.425571 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b5c3ad9a-60f4-4f19-be81-7f56b58ff195 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:48.260447 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b5c3ad9a-60f4-4f19-be81-7f56b58ff195 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:48.276578 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b5c3ad9a-60f4-4f19-be81-7f56b58ff195 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1476 microversion: 2.1 time: 0.896938 Jul 25 14:30:48.291269 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 759/1461] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:47 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1476 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:48.301785 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bec42f56-4d96-4172-8e29-46e0a2f63619 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:48.302436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bec42f56-4d96-4172-8e29-46e0a2f63619 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 633a0bd6-3680-40d7-9e3d-224e349c0f22] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:48.314134 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bec42f56-4d96-4172-8e29-46e0a2f63619 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:48.314670 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bec42f56-4d96-4172-8e29-46e0a2f63619 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:48.315530 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bec42f56-4d96-4172-8e29-46e0a2f63619 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:48.323062 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-13fd8b62-a4b3-4647-a29e-0c2864b270d9 tempest-FloatingIPDetailsTestJSON-2085568505 tempest-FloatingIPDetailsTestJSON-2085568505-project] 10.222.0.88 "DELETE /compute/v2.1/os-floating-ips/0eb44ca1-ecb2-4619-b0e7-0c9dd52376da" status: 202 len: 0 microversion: 2.1 time: 1.712410 Jul 25 14:30:48.328565 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bec42f56-4d96-4172-8e29-46e0a2f63619 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:48.335296 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 703/1462] 10.222.0.88 () {58 vars in 1263 bytes} [Mon Jul 25 14:30:46 2022] DELETE /compute/v2.1/os-floating-ips/0eb44ca1-ecb2-4619-b0e7-0c9dd52376da => generated 0 bytes in 1725 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:30:48.341492 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-ed951ed6-20ae-4606-b555-482e65eea96b req-d685d802-f11c-4938-ae22-07be71a93264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "633a0bd6-3680-40d7-9e3d-224e349c0f22", "name": "network-vif-plugged", "status": "completed", "tag": "07cddb3e-f068-459f-9f01-a2ee486806fb"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:48.364605 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ed951ed6-20ae-4606-b555-482e65eea96b req-d685d802-f11c-4938-ae22-07be71a93264 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:48.369215 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ed951ed6-20ae-4606-b555-482e65eea96b req-d685d802-f11c-4938-ae22-07be71a93264 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:48.407325 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-ed951ed6-20ae-4606-b555-482e65eea96b req-d685d802-f11c-4938-ae22-07be71a93264 service nova] Creating event network-vif-plugged:07cddb3e-f068-459f-9f01-a2ee486806fb for instance 633a0bd6-3680-40d7-9e3d-224e349c0f22 on n-h2-846435-14 Jul 25 14:30:48.413854 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-ed951ed6-20ae-4606-b555-482e65eea96b req-d685d802-f11c-4938-ae22-07be71a93264 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077033 Jul 25 14:30:48.415001 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 704/1463] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:30:48.422160 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3c076629-7159-4f6e-8ab5-ba2a50777ce8 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:48.423155 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3c076629-7159-4f6e-8ab5-ba2a50777ce8 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:48.429811 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c076629-7159-4f6e-8ab5-ba2a50777ce8 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:48.430441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c076629-7159-4f6e-8ab5-ba2a50777ce8 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:48.431354 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c076629-7159-4f6e-8ab5-ba2a50777ce8 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:48.431934 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c076629-7159-4f6e-8ab5-ba2a50777ce8 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:48.714334 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3c076629-7159-4f6e-8ab5-ba2a50777ce8 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:48.727325 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3c076629-7159-4f6e-8ab5-ba2a50777ce8 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1318 microversion: 2.1 time: 0.310843 Jul 25 14:30:48.731075 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 705/1464] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:48 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:48.747292 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3b65b806-b080-4152-a0ac-69c999c23670 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:48.748813 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3b65b806-b080-4152-a0ac-69c999c23670 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:48.771942 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b65b806-b080-4152-a0ac-69c999c23670 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:48.772826 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b65b806-b080-4152-a0ac-69c999c23670 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:48.773944 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b65b806-b080-4152-a0ac-69c999c23670 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:48.774390 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b65b806-b080-4152-a0ac-69c999c23670 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:48.791417 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:30:49.037649 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3b65b806-b080-4152-a0ac-69c999c23670 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:49.052598 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3b65b806-b080-4152-a0ac-69c999c23670 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd" status: 200 len: 1271 microversion: 2.1 time: 0.318014 Jul 25 14:30:49.055657 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 706/1465] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:48 2022] GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd => generated 1271 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:49.070093 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bec42f56-4d96-4172-8e29-46e0a2f63619 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f53d74a29243759065e68964f638dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d71324b22554a3bb44d6aceb7bc3cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:49.084008 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bec42f56-4d96-4172-8e29-46e0a2f63619 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22" status: 200 len: 1315 microversion: 2.1 time: 0.791348 Jul 25 14:30:49.087768 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 760/1466] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:48 2022] GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22 => generated 1315 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:49.333258 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-84b21d67-9450-4453-81d3-0fb471cbe2cb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:49.339852 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-84b21d67-9450-4453-81d3-0fb471cbe2cb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:49.371291 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-84b21d67-9450-4453-81d3-0fb471cbe2cb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:49.372619 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-84b21d67-9450-4453-81d3-0fb471cbe2cb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:49.398343 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-84b21d67-9450-4453-81d3-0fb471cbe2cb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:49.400580 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-84b21d67-9450-4453-81d3-0fb471cbe2cb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:49.729303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-84b21d67-9450-4453-81d3-0fb471cbe2cb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:49.741652 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-84b21d67-9450-4453-81d3-0fb471cbe2cb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1476 microversion: 2.1 time: 0.446880 Jul 25 14:30:49.742972 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 707/1467] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:49 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1476 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:49.760958 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-93535928-118d-4790-bc7e-bc5f86d1abdf tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:49.761607 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-93535928-118d-4790-bc7e-bc5f86d1abdf tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:49.770184 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-93535928-118d-4790-bc7e-bc5f86d1abdf tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:49.770710 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-93535928-118d-4790-bc7e-bc5f86d1abdf tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:49.771527 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-93535928-118d-4790-bc7e-bc5f86d1abdf tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:49.772104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-93535928-118d-4790-bc7e-bc5f86d1abdf tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:50.081433 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-83e7b6c1-e28d-4b88-9509-279e64769890 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:50.082641 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-83e7b6c1-e28d-4b88-9509-279e64769890 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:50.094102 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-83e7b6c1-e28d-4b88-9509-279e64769890 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:50.094623 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-83e7b6c1-e28d-4b88-9509-279e64769890 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:50.095429 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-83e7b6c1-e28d-4b88-9509-279e64769890 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:50.096135 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-83e7b6c1-e28d-4b88-9509-279e64769890 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:50.244736 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-93535928-118d-4790-bc7e-bc5f86d1abdf tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:50.259556 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-93535928-118d-4790-bc7e-bc5f86d1abdf tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1318 microversion: 2.1 time: 0.500413 Jul 25 14:30:50.261307 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 761/1468] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:49 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1318 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:50.272844 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c3b0c54b-80ae-4a5a-b6d5-01a11de42be3 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:50.275664 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c3b0c54b-80ae-4a5a-b6d5-01a11de42be3 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 633a0bd6-3680-40d7-9e3d-224e349c0f22] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:50.292001 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c3b0c54b-80ae-4a5a-b6d5-01a11de42be3 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:50.292953 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c3b0c54b-80ae-4a5a-b6d5-01a11de42be3 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:50.294739 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c3b0c54b-80ae-4a5a-b6d5-01a11de42be3 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:50.295810 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c3b0c54b-80ae-4a5a-b6d5-01a11de42be3 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:50.715994 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-83e7b6c1-e28d-4b88-9509-279e64769890 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:50.731707 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-83e7b6c1-e28d-4b88-9509-279e64769890 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd" status: 200 len: 1311 microversion: 2.1 time: 0.653180 Jul 25 14:30:50.736506 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 708/1469] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:50 2022] GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd => generated 1311 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:30:50.767308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f6d702d7-9209-40d3-8b60-f0ad232e4ecd tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:50.769212 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f6d702d7-9209-40d3-8b60-f0ad232e4ecd tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:50.802802 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f6d702d7-9209-40d3-8b60-f0ad232e4ecd tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:50.828518 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f6d702d7-9209-40d3-8b60-f0ad232e4ecd tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:50.830559 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f6d702d7-9209-40d3-8b60-f0ad232e4ecd tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:50.831295 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f6d702d7-9209-40d3-8b60-f0ad232e4ecd tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:50.922990 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c3b0c54b-80ae-4a5a-b6d5-01a11de42be3 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f53d74a29243759065e68964f638dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d71324b22554a3bb44d6aceb7bc3cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:50.935457 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c3b0c54b-80ae-4a5a-b6d5-01a11de42be3 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22" status: 200 len: 1315 microversion: 2.1 time: 0.672362 Jul 25 14:30:50.939334 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 762/1470] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:50 2022] GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22 => generated 1315 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:51.236989 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-84875171-409c-4cac-9d62-73c1f36d8cb6 req-0a1082fa-7709-43dc-a95a-f6c6c70d5674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5694bd9c-d7e8-4f20-8404-fc5e747c93cd", "tag": "972e03f2-20ce-491f-a29a-2936da24a706"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:51.269052 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-84875171-409c-4cac-9d62-73c1f36d8cb6 req-0a1082fa-7709-43dc-a95a-f6c6c70d5674 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:51.271677 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-84875171-409c-4cac-9d62-73c1f36d8cb6 req-0a1082fa-7709-43dc-a95a-f6c6c70d5674 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:51.290065 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f6d702d7-9209-40d3-8b60-f0ad232e4ecd tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:51.320253 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f6d702d7-9209-40d3-8b60-f0ad232e4ecd tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1476 microversion: 2.1 time: 0.559175 Jul 25 14:30:51.321525 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 709/1471] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:50 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1476 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:30:51.326006 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-84875171-409c-4cac-9d62-73c1f36d8cb6 req-0a1082fa-7709-43dc-a95a-f6c6c70d5674 service nova] Creating event network-changed:972e03f2-20ce-491f-a29a-2936da24a706 for instance 5694bd9c-d7e8-4f20-8404-fc5e747c93cd on n-h2-846435-14 Jul 25 14:30:51.342801 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-84875171-409c-4cac-9d62-73c1f36d8cb6 req-0a1082fa-7709-43dc-a95a-f6c6c70d5674 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107172 Jul 25 14:30:51.344409 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b91c1609-c963-43c7-b7c1-1e5284befcc1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:51.344787 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 763/1472] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:30:51.349430 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b91c1609-c963-43c7-b7c1-1e5284befcc1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:51.371887 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b91c1609-c963-43c7-b7c1-1e5284befcc1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:51.372648 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b91c1609-c963-43c7-b7c1-1e5284befcc1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:51.373926 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b91c1609-c963-43c7-b7c1-1e5284befcc1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:51.376577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b91c1609-c963-43c7-b7c1-1e5284befcc1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:51.703570 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b91c1609-c963-43c7-b7c1-1e5284befcc1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:51.715597 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b91c1609-c963-43c7-b7c1-1e5284befcc1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1318 microversion: 2.1 time: 0.390538 Jul 25 14:30:51.716318 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 710/1473] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:51 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:51.773923 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9af4c611-4c6e-4cca-9478-156a8ccc10a1 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:51.774745 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9af4c611-4c6e-4cca-9478-156a8ccc10a1 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:51.782992 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9af4c611-4c6e-4cca-9478-156a8ccc10a1 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:51.783925 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9af4c611-4c6e-4cca-9478-156a8ccc10a1 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:51.785106 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9af4c611-4c6e-4cca-9478-156a8ccc10a1 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:51.785755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9af4c611-4c6e-4cca-9478-156a8ccc10a1 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:51.962824 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-000570f5-c374-4da9-871f-84423f91127d tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:51.965886 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-000570f5-c374-4da9-871f-84423f91127d tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 633a0bd6-3680-40d7-9e3d-224e349c0f22] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:51.972212 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:30:51.982211 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-000570f5-c374-4da9-871f-84423f91127d tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:51.983604 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-000570f5-c374-4da9-871f-84423f91127d tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:51.985383 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-000570f5-c374-4da9-871f-84423f91127d tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:51.986043 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-000570f5-c374-4da9-871f-84423f91127d tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:52.176760 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-000570f5-c374-4da9-871f-84423f91127d tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f53d74a29243759065e68964f638dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d71324b22554a3bb44d6aceb7bc3cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:52.188491 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-000570f5-c374-4da9-871f-84423f91127d tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22" status: 200 len: 1503 microversion: 2.1 time: 0.233522 Jul 25 14:30:52.190006 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 711/1474] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:51 2022] GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22 => generated 1503 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:52.195374 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1001526d-2bd7-499f-8d3b-39a3af6fc693 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:52.196309 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1001526d-2bd7-499f-8d3b-39a3af6fc693 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:52.203647 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1001526d-2bd7-499f-8d3b-39a3af6fc693 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:52.204708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1001526d-2bd7-499f-8d3b-39a3af6fc693 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:52.205769 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1001526d-2bd7-499f-8d3b-39a3af6fc693 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:52.207377 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1001526d-2bd7-499f-8d3b-39a3af6fc693 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:52.351734 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-1001526d-2bd7-499f-8d3b-39a3af6fc693 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lazy-loading 'services' on Instance uuid 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:30:52.368561 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1001526d-2bd7-499f-8d3b-39a3af6fc693 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 2424 microversion: 2.25 time: 0.177094 Jul 25 14:30:52.369233 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 712/1475] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:30:52 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 2424 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:30:52.435000 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-565ed988-30d8-4a08-a883-27175722083d req-2d702713-39f6-4554-adce-b8a6b5467aba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c87c840-4e2c-4bc2-822b-93b046f8fab5", "tag": "0606594f-9a23-44eb-9ac0-96b677c84884"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:52.446630 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-565ed988-30d8-4a08-a883-27175722083d req-2d702713-39f6-4554-adce-b8a6b5467aba service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:52.447072 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-565ed988-30d8-4a08-a883-27175722083d req-2d702713-39f6-4554-adce-b8a6b5467aba service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:52.461054 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-565ed988-30d8-4a08-a883-27175722083d req-2d702713-39f6-4554-adce-b8a6b5467aba service nova] Creating event network-changed:0606594f-9a23-44eb-9ac0-96b677c84884 for instance 9c87c840-4e2c-4bc2-822b-93b046f8fab5 on n-h1-846435-14 Jul 25 14:30:52.466613 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-565ed988-30d8-4a08-a883-27175722083d req-2d702713-39f6-4554-adce-b8a6b5467aba service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096055 Jul 25 14:30:52.467335 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 713/1476] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:30:52.472750 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-22be1e51-5dae-4fac-8553-f3ea30255732 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-23682283"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:52.473435 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-22be1e51-5dae-4fac-8553-f3ea30255732 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 633a0bd6-3680-40d7-9e3d-224e349c0f22] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:52.480713 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-22be1e51-5dae-4fac-8553-f3ea30255732 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:52.481163 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-22be1e51-5dae-4fac-8553-f3ea30255732 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:52.481982 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-22be1e51-5dae-4fac-8553-f3ea30255732 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:52.482407 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-22be1e51-5dae-4fac-8553-f3ea30255732 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:52.518596 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9af4c611-4c6e-4cca-9478-156a8ccc10a1 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:52.526834 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9af4c611-4c6e-4cca-9478-156a8ccc10a1 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd" status: 200 len: 1311 microversion: 2.1 time: 0.757705 Jul 25 14:30:52.527712 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 764/1477] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:51 2022] GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd => generated 1311 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:52.533098 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-48f96528-e882-4d4e-a329-8ad798e4306f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:52.534001 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-48f96528-e882-4d4e-a329-8ad798e4306f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:52.540977 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48f96528-e882-4d4e-a329-8ad798e4306f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:52.541788 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48f96528-e882-4d4e-a329-8ad798e4306f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:52.542805 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48f96528-e882-4d4e-a329-8ad798e4306f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:52.543348 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48f96528-e882-4d4e-a329-8ad798e4306f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:52.631665 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.network.security_group_api [None req-22be1e51-5dae-4fac-8553-f3ea30255732 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Adding security group 279b61a4-5928-46e0-92b2-077efa31f9c8 to port 07cddb3e-f068-459f-9f01-a2ee486806fb Jul 25 14:30:53.023759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-48f96528-e882-4d4e-a329-8ad798e4306f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:53.047284 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-22be1e51-5dae-4fac-8553-f3ea30255732 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "POST /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22/action" status: 202 len: 0 microversion: 2.1 time: 0.577893 Jul 25 14:30:53.047993 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 714/1478] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:30:52 2022] POST /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22/action => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:30:53.050140 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-48f96528-e882-4d4e-a329-8ad798e4306f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1476 microversion: 2.1 time: 0.520373 Jul 25 14:30:53.052317 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 765/1479] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:52 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1476 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:53.052707 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d7270d21-6e20-4d5e-b529-890645ec25e3 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846435-14", "block_migration": "auto"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:53.055385 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d7270d21-6e20-4d5e-b529-890645ec25e3 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:53.067561 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a771811e-91b5-4a4c-9b94-28712c9340a7 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:53.069613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d7270d21-6e20-4d5e-b529-890645ec25e3 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:53.069927 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a771811e-91b5-4a4c-9b94-28712c9340a7 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:53.072547 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d7270d21-6e20-4d5e-b529-890645ec25e3 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:53.078241 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d7270d21-6e20-4d5e-b529-890645ec25e3 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:53.078823 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d7270d21-6e20-4d5e-b529-890645ec25e3 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:53.086481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a771811e-91b5-4a4c-9b94-28712c9340a7 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:53.086927 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a771811e-91b5-4a4c-9b94-28712c9340a7 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:53.087702 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a771811e-91b5-4a4c-9b94-28712c9340a7 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:53.088369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a771811e-91b5-4a4c-9b94-28712c9340a7 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:53.135489 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-d7270d21-6e20-4d5e-b529-890645ec25e3 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lazy-loading 'flavor' on Instance uuid 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:30:53.154208 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d7270d21-6e20-4d5e-b529-890645ec25e3 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Going to try to live migrate instance to n-h2-846435-14 {{(pid=119303) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 14:30:53.339418 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=8 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:30:53.655306 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a771811e-91b5-4a4c-9b94-28712c9340a7 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:53.687087 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a771811e-91b5-4a4c-9b94-28712c9340a7 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1318 microversion: 2.1 time: 0.631408 Jul 25 14:30:53.689770 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 766/1480] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:53 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1318 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:53.697521 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dc661d46-c376-4fd7-bc02-2343dcac36ef tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '.version_select at 0x7f4687857ca0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:54.038546 n-d-846435-14 devstack@n-api.service[119304]: DEBUG neutronclient.v2_0.client [None req-dc661d46-c376-4fd7-bc02-2343dcac36ef tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 279b61a4-5928-46e0-92b2-077efa31f9c8 in use.", "detail": ""}} {{(pid=119304) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 14:30:54.039631 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-dc661d46-c376-4fd7-bc02-2343dcac36ef tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] HTTP exception thrown: Security Group 279b61a4-5928-46e0-92b2-077efa31f9c8 in use. Jul 25 14:30:54.039631 n-d-846435-14 devstack@n-api.service[119304]: Neutron server returns request_ids: ['req-6281f0e7-b4dc-46ec-bc3c-78e4cb8d73a1'] Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dc661d46-c376-4fd7-bc02-2343dcac36ef tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Request method failure captured: Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/os-security-groups/279b61a4-5928-46e0-92b2-077efa31f9c8 HTTP/1.1 Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qjSWhK-vwJTt9-RUosNUl92O2IH7DXHM__YKwETUuX644ZNnaLPUYLl7n9jfiOhif_9NvqEaG0blLab1mJt658fIFOepG5Z0DCt4IZ2Chl0jBZNJNW6gm_-nwSZ3IWfSAUAPR-qkW1tUiXhGVJPIQGpNlpD2VqkHT6SMzyoZa1fOYg Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 3d71324b22554a3bb44d6aceb7bc3cbd Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d71324b22554a3bb44d6aceb7bc3cbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d71324b22554a3bb44d6aceb7bc3cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3d71324b22554a3bb44d6aceb7bc3cbd", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3d71324b22554a3bb44d6aceb7bc3cbd"}]}] Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 3d71324b22554a3bb44d6aceb7bc3cbd Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-SecurityGroupsTestJSON-81685064-project Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: b3f53d74a29243759065e68964f638dc Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-SecurityGroupsTestJSON-81685064-project Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: exception: Security Group 279b61a4-5928-46e0-92b2-077efa31f9c8 in use. Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: Neutron server returns request_ids: ['req-6281f0e7-b4dc-46ec-bc3c-78e4cb8d73a1'] Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '279b61a4-5928-46e0-92b2-077efa31f9c8'} Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 279b61a4-5928-46e0-92b2-077efa31f9c8 in use. Jul 25 14:30:54.041821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6281f0e7-b4dc-46ec-bc3c-78e4cb8d73a1'] Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 279b61a4-5928-46e0-92b2-077efa31f9c8 in use. Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6281f0e7-b4dc-46ec-bc3c-78e4cb8d73a1'] Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 279b61a4-5928-46e0-92b2-077efa31f9c8 in use. Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6281f0e7-b4dc-46ec-bc3c-78e4cb8d73a1'] Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 279b61a4-5928-46e0-92b2-077efa31f9c8 in use. Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6281f0e7-b4dc-46ec-bc3c-78e4cb8d73a1'] Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dc661d46-c376-4fd7-bc02-2343dcac36ef tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Returning 400 to user: Security Group 279b61a4-5928-46e0-92b2-077efa31f9c8 in use. Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: Neutron server returns request_ids: ['req-6281f0e7-b4dc-46ec-bc3c-78e4cb8d73a1'] {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dc661d46-c376-4fd7-bc02-2343dcac36ef tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/279b61a4-5928-46e0-92b2-077efa31f9c8" status: 400 len: 185 microversion: 2.1 time: 0.353451 Jul 25 14:30:54.046779 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 767/1481] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:30:53 2022] DELETE /compute/v2.1/os-security-groups/279b61a4-5928-46e0-92b2-077efa31f9c8 => generated 185 bytes in 356 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:30:54.052009 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-c711bbdb-5283-4a9e-b1c3-a537aad19ba3 req-9daacb47-f08b-436e-a9f2-28d7a0879262 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "633a0bd6-3680-40d7-9e3d-224e349c0f22", "tag": "07cddb3e-f068-459f-9f01-a2ee486806fb"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:54.062843 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c711bbdb-5283-4a9e-b1c3-a537aad19ba3 req-9daacb47-f08b-436e-a9f2-28d7a0879262 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:54.063355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c711bbdb-5283-4a9e-b1c3-a537aad19ba3 req-9daacb47-f08b-436e-a9f2-28d7a0879262 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:54.074785 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-c711bbdb-5283-4a9e-b1c3-a537aad19ba3 req-9daacb47-f08b-436e-a9f2-28d7a0879262 service nova] Creating event network-changed:07cddb3e-f068-459f-9f01-a2ee486806fb for instance 633a0bd6-3680-40d7-9e3d-224e349c0f22 on n-h2-846435-14 Jul 25 14:30:54.080076 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-c711bbdb-5283-4a9e-b1c3-a537aad19ba3 req-9daacb47-f08b-436e-a9f2-28d7a0879262 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032044 Jul 25 14:30:54.080856 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 768/1482] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:30:54.086442 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f66a43a6-686f-4fae-886e-6540edad0459 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:54.087177 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f66a43a6-686f-4fae-886e-6540edad0459 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:54.093586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f66a43a6-686f-4fae-886e-6540edad0459 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:54.094116 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f66a43a6-686f-4fae-886e-6540edad0459 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:54.094961 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f66a43a6-686f-4fae-886e-6540edad0459 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:54.095471 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f66a43a6-686f-4fae-886e-6540edad0459 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:54.344010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f66a43a6-686f-4fae-886e-6540edad0459 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:54.353761 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f66a43a6-686f-4fae-886e-6540edad0459 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd" status: 200 len: 1311 microversion: 2.1 time: 0.271446 Jul 25 14:30:54.368055 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 769/1483] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:54 2022] GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd => generated 1311 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:54.374078 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a4a3dfe4-a56c-445b-a215-f99d93fef69b tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:54.376865 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a4a3dfe4-a56c-445b-a215-f99d93fef69b tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 633a0bd6-3680-40d7-9e3d-224e349c0f22] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:54.384199 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4a3dfe4-a56c-445b-a215-f99d93fef69b tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:54.384863 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4a3dfe4-a56c-445b-a215-f99d93fef69b tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:54.385789 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4a3dfe4-a56c-445b-a215-f99d93fef69b tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:54.386363 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4a3dfe4-a56c-445b-a215-f99d93fef69b tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:54.489781 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a4a3dfe4-a56c-445b-a215-f99d93fef69b tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "POST /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22/action" status: 202 len: 0 microversion: 2.1 time: 0.119555 Jul 25 14:30:54.491498 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 770/1484] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:30:54 2022] POST /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:30:54.498851 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-40296172-1c3f-49ef-ba18-42d10c47e91d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:54.499600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-40296172-1c3f-49ef-ba18-42d10c47e91d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:54.509137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-40296172-1c3f-49ef-ba18-42d10c47e91d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:54.509597 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-40296172-1c3f-49ef-ba18-42d10c47e91d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:54.510907 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-40296172-1c3f-49ef-ba18-42d10c47e91d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:54.511503 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-40296172-1c3f-49ef-ba18-42d10c47e91d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:54.831854 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-40296172-1c3f-49ef-ba18-42d10c47e91d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:54.847381 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-40296172-1c3f-49ef-ba18-42d10c47e91d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1476 microversion: 2.1 time: 0.354284 Jul 25 14:30:54.848026 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 771/1485] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:54 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1476 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:54.983782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9e8148e2-a138-4a05-87a9-084e4b45b1fe tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-589554924", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "efea5460-9051-45a5-854f-83687b364836"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:55.073924 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-9e8148e2-a138-4a05-87a9-084e4b45b1fe tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] validate_networks() for [('efea5460-9051-45a5-854f-83687b364836', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:30:56.276492 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-9e8148e2-a138-4a05-87a9-084e4b45b1fe tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:30:56.277128 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-9e8148e2-a138-4a05-87a9-084e4b45b1fe tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:30:56.277439 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-9e8148e2-a138-4a05-87a9-084e4b45b1fe tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:30:56.277854 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-9e8148e2-a138-4a05-87a9-084e4b45b1fe tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:30:56.278269 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-9e8148e2-a138-4a05-87a9-084e4b45b1fe tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:30:56.288041 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9e8148e2-a138-4a05-87a9-084e4b45b1fe tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:56.288492 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9e8148e2-a138-4a05-87a9-084e4b45b1fe tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:56.289602 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9e8148e2-a138-4a05-87a9-084e4b45b1fe tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:56.290218 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9e8148e2-a138-4a05-87a9-084e4b45b1fe tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:56.312313 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-9e8148e2-a138-4a05-87a9-084e4b45b1fe tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Getting quotas for project ced9025cae5c4c43a111119b99ae9233. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:30:56.318770 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-9e8148e2-a138-4a05-87a9-084e4b45b1fe tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Getting quotas for user 7ef2558f586447408bbce6b9b0dcd62f and project ced9025cae5c4c43a111119b99ae9233. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:30:56.332481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9e8148e2-a138-4a05-87a9-084e4b45b1fe tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:30:56.335225 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9e8148e2-a138-4a05-87a9-084e4b45b1fe tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] [instance: 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:30:56.392313 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9e8148e2-a138-4a05-87a9-084e4b45b1fe tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.510775 Jul 25 14:30:56.393603 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 772/1486] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:30:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:30:56.398685 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b6ab2113-c876-4fc7-95f2-b599dbe6c7cb tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:56.399555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b6ab2113-c876-4fc7-95f2-b599dbe6c7cb tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 633a0bd6-3680-40d7-9e3d-224e349c0f22] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:56.408902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b6ab2113-c876-4fc7-95f2-b599dbe6c7cb tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:56.409884 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b6ab2113-c876-4fc7-95f2-b599dbe6c7cb tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:56.412092 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b6ab2113-c876-4fc7-95f2-b599dbe6c7cb tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:56.412734 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b6ab2113-c876-4fc7-95f2-b599dbe6c7cb tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:56.419852 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:30:56.636374 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b6ab2113-c876-4fc7-95f2-b599dbe6c7cb tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f53d74a29243759065e68964f638dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d71324b22554a3bb44d6aceb7bc3cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:56.644260 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b6ab2113-c876-4fc7-95f2-b599dbe6c7cb tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22" status: 200 len: 1572 microversion: 2.1 time: 0.249296 Jul 25 14:30:56.668670 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 773/1487] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:56 2022] GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22 => generated 1572 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:56.674858 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-27a73e69-0e73-4afa-a30c-9e7fee020775 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:56.676190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-27a73e69-0e73-4afa-a30c-9e7fee020775 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:56.691914 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-27a73e69-0e73-4afa-a30c-9e7fee020775 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:56.692537 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-27a73e69-0e73-4afa-a30c-9e7fee020775 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:56.693437 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-27a73e69-0e73-4afa-a30c-9e7fee020775 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:56.694277 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-27a73e69-0e73-4afa-a30c-9e7fee020775 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:56.791142 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d7270d21-6e20-4d5e-b529-890645ec25e3 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c/action" status: 202 len: 0 microversion: 2.25 time: 3.741940 Jul 25 14:30:56.792323 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 715/1488] 10.222.0.88 () {62 vars in 1319 bytes} [Mon Jul 25 14:30:53 2022] POST /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c/action => generated 0 bytes in 3744 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:30:56.805569 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1e0b727d-ffe0-4d6e-8fbd-fc963e537274 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:56.826561 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1e0b727d-ffe0-4d6e-8fbd-fc963e537274 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:56.863727 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e0b727d-ffe0-4d6e-8fbd-fc963e537274 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:56.865521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e0b727d-ffe0-4d6e-8fbd-fc963e537274 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:56.867374 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e0b727d-ffe0-4d6e-8fbd-fc963e537274 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:56.868491 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e0b727d-ffe0-4d6e-8fbd-fc963e537274 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:57.259138 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-27a73e69-0e73-4afa-a30c-9e7fee020775 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:57.267639 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-27a73e69-0e73-4afa-a30c-9e7fee020775 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1318 microversion: 2.1 time: 0.597695 Jul 25 14:30:57.272692 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 774/1489] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:56 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1318 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:57.288038 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-02421121-990c-4e23-9c13-30f172f9f3b9 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:57.289892 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-02421121-990c-4e23-9c13-30f172f9f3b9 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:57.296643 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-02421121-990c-4e23-9c13-30f172f9f3b9 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:57.297355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-02421121-990c-4e23-9c13-30f172f9f3b9 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:57.298410 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-02421121-990c-4e23-9c13-30f172f9f3b9 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:57.299009 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-02421121-990c-4e23-9c13-30f172f9f3b9 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:57.345126 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1e0b727d-ffe0-4d6e-8fbd-fc963e537274 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:57.372207 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1e0b727d-ffe0-4d6e-8fbd-fc963e537274 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd" status: 200 len: 1311 microversion: 2.1 time: 0.576709 Jul 25 14:30:57.375590 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 716/1490] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:56 2022] GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd => generated 1311 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:57.382390 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c8fa0f6b-5057-412d-861a-d1f66e9ec7ef tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:57.383008 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c8fa0f6b-5057-412d-861a-d1f66e9ec7ef tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] [instance: 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:57.397937 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c8fa0f6b-5057-412d-861a-d1f66e9ec7ef tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:57.398415 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c8fa0f6b-5057-412d-861a-d1f66e9ec7ef tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:57.399776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c8fa0f6b-5057-412d-861a-d1f66e9ec7ef tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:57.400244 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c8fa0f6b-5057-412d-861a-d1f66e9ec7ef tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:57.530042 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c8fa0f6b-5057-412d-861a-d1f66e9ec7ef tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef2558f586447408bbce6b9b0dcd62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced9025cae5c4c43a111119b99ae9233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:57.547816 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c8fa0f6b-5057-412d-861a-d1f66e9ec7ef tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] 10.222.0.88 "GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4" status: 200 len: 1211 microversion: 2.1 time: 0.170879 Jul 25 14:30:57.558773 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 717/1491] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:57 2022] GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 => generated 1211 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:57.558773 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7099b859-7aca-4b10-9cce-11e3132fa12a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:57.558773 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7099b859-7aca-4b10-9cce-11e3132fa12a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:57.565019 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7099b859-7aca-4b10-9cce-11e3132fa12a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:57.565802 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7099b859-7aca-4b10-9cce-11e3132fa12a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:57.567936 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7099b859-7aca-4b10-9cce-11e3132fa12a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:57.571642 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7099b859-7aca-4b10-9cce-11e3132fa12a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:57.927839 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-02421121-990c-4e23-9c13-30f172f9f3b9 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:57.939587 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-02421121-990c-4e23-9c13-30f172f9f3b9 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1476 microversion: 2.1 time: 0.662137 Jul 25 14:30:57.940507 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 775/1492] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:57 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1476 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:57.948281 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-68f28e21-ac45-4892-ac1a-e22a808ae306 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:57.951244 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-68f28e21-ac45-4892-ac1a-e22a808ae306 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 633a0bd6-3680-40d7-9e3d-224e349c0f22] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:57.961635 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68f28e21-ac45-4892-ac1a-e22a808ae306 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:57.964785 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68f28e21-ac45-4892-ac1a-e22a808ae306 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:57.977689 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68f28e21-ac45-4892-ac1a-e22a808ae306 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:57.979770 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68f28e21-ac45-4892-ac1a-e22a808ae306 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:58.085215 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7099b859-7aca-4b10-9cce-11e3132fa12a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:58.109335 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7099b859-7aca-4b10-9cce-11e3132fa12a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:58.112720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7099b859-7aca-4b10-9cce-11e3132fa12a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:58.117502 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7099b859-7aca-4b10-9cce-11e3132fa12a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1814 microversion: 2.25 time: 0.567100 Jul 25 14:30:58.118893 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 718/1493] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:30:57 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1814 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:30:58.294273 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bf0b31f0-4b54-4af0-984a-b9950e55f23a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:58.295050 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bf0b31f0-4b54-4af0-984a-b9950e55f23a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:58.305566 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bf0b31f0-4b54-4af0-984a-b9950e55f23a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:58.306048 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bf0b31f0-4b54-4af0-984a-b9950e55f23a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:58.306871 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bf0b31f0-4b54-4af0-984a-b9950e55f23a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:58.307318 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bf0b31f0-4b54-4af0-984a-b9950e55f23a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:58.503129 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bf0b31f0-4b54-4af0-984a-b9950e55f23a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:58.513321 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bf0b31f0-4b54-4af0-984a-b9950e55f23a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1318 microversion: 2.1 time: 0.222452 Jul 25 14:30:58.514894 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 719/1494] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:58 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:30:58.525663 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-791c6c90-37b4-409e-9352-1bddbcbe01a3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:58.526580 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-791c6c90-37b4-409e-9352-1bddbcbe01a3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:58.533193 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-791c6c90-37b4-409e-9352-1bddbcbe01a3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:58.533649 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-791c6c90-37b4-409e-9352-1bddbcbe01a3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:58.535785 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-791c6c90-37b4-409e-9352-1bddbcbe01a3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:58.536266 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-791c6c90-37b4-409e-9352-1bddbcbe01a3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:58.699329 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-791c6c90-37b4-409e-9352-1bddbcbe01a3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:58.707740 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-791c6c90-37b4-409e-9352-1bddbcbe01a3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd" status: 200 len: 1311 microversion: 2.1 time: 0.190988 Jul 25 14:30:58.708703 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 720/1495] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:58 2022] GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd => generated 1311 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:58.714125 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c9e70c62-0d34-4928-9dd8-5e204f6b785d tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:58.714991 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c9e70c62-0d34-4928-9dd8-5e204f6b785d tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] [instance: 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:58.715192 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-68f28e21-ac45-4892-ac1a-e22a808ae306 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f53d74a29243759065e68964f638dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d71324b22554a3bb44d6aceb7bc3cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:58.724699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c9e70c62-0d34-4928-9dd8-5e204f6b785d tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:58.725493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c9e70c62-0d34-4928-9dd8-5e204f6b785d tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:58.726515 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c9e70c62-0d34-4928-9dd8-5e204f6b785d tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:58.727171 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c9e70c62-0d34-4928-9dd8-5e204f6b785d tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:58.728055 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-68f28e21-ac45-4892-ac1a-e22a808ae306 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22" status: 200 len: 1572 microversion: 2.1 time: 0.786240 Jul 25 14:30:58.728854 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 776/1496] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:57 2022] GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22 => generated 1572 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:58.746628 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:30:58.803171 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c9e70c62-0d34-4928-9dd8-5e204f6b785d tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef2558f586447408bbce6b9b0dcd62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced9025cae5c4c43a111119b99ae9233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:58.813732 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c9e70c62-0d34-4928-9dd8-5e204f6b785d tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] 10.222.0.88 "GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4" status: 200 len: 1273 microversion: 2.1 time: 0.103624 Jul 25 14:30:58.814516 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 721/1497] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:58 2022] GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 => generated 1273 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:58.962578 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-865c72d9-67e7-4ea2-a385-b40628c0bbef tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:58.963341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-865c72d9-67e7-4ea2-a385-b40628c0bbef tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:58.974481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-865c72d9-67e7-4ea2-a385-b40628c0bbef tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:58.979968 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-865c72d9-67e7-4ea2-a385-b40628c0bbef tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:58.981077 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-865c72d9-67e7-4ea2-a385-b40628c0bbef tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:58.981735 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-865c72d9-67e7-4ea2-a385-b40628c0bbef tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:59.142251 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2790a90b-f2a8-4409-b06f-67b1d074e7b3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:59.143943 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2790a90b-f2a8-4409-b06f-67b1d074e7b3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:59.158691 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2790a90b-f2a8-4409-b06f-67b1d074e7b3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:59.160424 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2790a90b-f2a8-4409-b06f-67b1d074e7b3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:59.161620 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2790a90b-f2a8-4409-b06f-67b1d074e7b3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:59.162248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2790a90b-f2a8-4409-b06f-67b1d074e7b3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:59.380557 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2790a90b-f2a8-4409-b06f-67b1d074e7b3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:59.392189 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2790a90b-f2a8-4409-b06f-67b1d074e7b3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:59.393701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2790a90b-f2a8-4409-b06f-67b1d074e7b3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:59.395862 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2790a90b-f2a8-4409-b06f-67b1d074e7b3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1814 microversion: 2.25 time: 0.256974 Jul 25 14:30:59.396950 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 722/1498] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:30:59 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1814 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:30:59.403751 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-2112b4f8-eef9-484b-970b-713c3a3cab8f req-def621ab-543b-49a3-a695-3dd239514132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c87c840-4e2c-4bc2-822b-93b046f8fab5", "name": "network-vif-plugged", "status": "completed", "tag": "0606594f-9a23-44eb-9ac0-96b677c84884"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:30:59.415218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-2112b4f8-eef9-484b-970b-713c3a3cab8f req-def621ab-543b-49a3-a695-3dd239514132 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:59.416627 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-2112b4f8-eef9-484b-970b-713c3a3cab8f req-def621ab-543b-49a3-a695-3dd239514132 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:59.433293 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-2112b4f8-eef9-484b-970b-713c3a3cab8f req-def621ab-543b-49a3-a695-3dd239514132 service nova] Creating event network-vif-plugged:0606594f-9a23-44eb-9ac0-96b677c84884 for instance 9c87c840-4e2c-4bc2-822b-93b046f8fab5 on n-h1-846435-14 Jul 25 14:30:59.438832 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-2112b4f8-eef9-484b-970b-713c3a3cab8f req-def621ab-543b-49a3-a695-3dd239514132 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040606 Jul 25 14:30:59.440723 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 723/1499] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:30:59.444124 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-865c72d9-67e7-4ea2-a385-b40628c0bbef tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:59.457442 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-865c72d9-67e7-4ea2-a385-b40628c0bbef tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1476 microversion: 2.1 time: 0.500060 Jul 25 14:30:59.464362 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 777/1500] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:58 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1476 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:59.541185 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e301c1e9-60df-451b-af3e-d8a48638eed3 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:59.542293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e301c1e9-60df-451b-af3e-d8a48638eed3 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:59.551559 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e301c1e9-60df-451b-af3e-d8a48638eed3 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:59.554891 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e301c1e9-60df-451b-af3e-d8a48638eed3 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:59.555953 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e301c1e9-60df-451b-af3e-d8a48638eed3 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:59.559394 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e301c1e9-60df-451b-af3e-d8a48638eed3 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:59.733862 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d302790a-6b29-4b21-8964-3cb7b1c6ce09 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:59.735360 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d302790a-6b29-4b21-8964-3cb7b1c6ce09 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:59.752386 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d302790a-6b29-4b21-8964-3cb7b1c6ce09 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:59.752961 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d302790a-6b29-4b21-8964-3cb7b1c6ce09 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:59.754091 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d302790a-6b29-4b21-8964-3cb7b1c6ce09 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:59.755923 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d302790a-6b29-4b21-8964-3cb7b1c6ce09 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:59.841933 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e301c1e9-60df-451b-af3e-d8a48638eed3 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:30:59.852045 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e301c1e9-60df-451b-af3e-d8a48638eed3 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1318 microversion: 2.1 time: 0.318048 Jul 25 14:30:59.864994 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 724/1501] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:59 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:30:59.874376 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2a8d9395-5cbe-40d6-addf-1243d24316db tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:30:59.875459 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2a8d9395-5cbe-40d6-addf-1243d24316db tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 633a0bd6-3680-40d7-9e3d-224e349c0f22] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:30:59.882529 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a8d9395-5cbe-40d6-addf-1243d24316db tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:59.883464 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a8d9395-5cbe-40d6-addf-1243d24316db tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:30:59.885120 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a8d9395-5cbe-40d6-addf-1243d24316db tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:30:59.885868 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a8d9395-5cbe-40d6-addf-1243d24316db tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:00.004192 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d302790a-6b29-4b21-8964-3cb7b1c6ce09 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:00.013064 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d302790a-6b29-4b21-8964-3cb7b1c6ce09 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd" status: 200 len: 1311 microversion: 2.1 time: 0.285901 Jul 25 14:31:00.014401 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 778/1502] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:59 2022] GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd => generated 1311 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:31:00.021842 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f6027dba-906f-4d05-b06f-cb8b5e409c47 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:00.024894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f6027dba-906f-4d05-b06f-cb8b5e409c47 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] [instance: 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:00.034805 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6027dba-906f-4d05-b06f-cb8b5e409c47 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:00.035598 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6027dba-906f-4d05-b06f-cb8b5e409c47 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:00.036662 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6027dba-906f-4d05-b06f-cb8b5e409c47 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:00.037414 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6027dba-906f-4d05-b06f-cb8b5e409c47 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:00.208643 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2a8d9395-5cbe-40d6-addf-1243d24316db tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f53d74a29243759065e68964f638dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d71324b22554a3bb44d6aceb7bc3cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:00.218717 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2a8d9395-5cbe-40d6-addf-1243d24316db tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22" status: 200 len: 1570 microversion: 2.1 time: 0.352304 Jul 25 14:31:00.221114 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 725/1503] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:30:59 2022] GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22 => generated 1570 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:00.248754 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-94d63e0e-89d9-4d34-b325-74bf48393f44 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1258392415"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:00.252059 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-94d63e0e-89d9-4d34-b325-74bf48393f44 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 633a0bd6-3680-40d7-9e3d-224e349c0f22] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:00.267358 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-94d63e0e-89d9-4d34-b325-74bf48393f44 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:00.268151 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-94d63e0e-89d9-4d34-b325-74bf48393f44 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:00.269187 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-94d63e0e-89d9-4d34-b325-74bf48393f44 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:00.269798 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-94d63e0e-89d9-4d34-b325-74bf48393f44 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:00.322554 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f6027dba-906f-4d05-b06f-cb8b5e409c47 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef2558f586447408bbce6b9b0dcd62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced9025cae5c4c43a111119b99ae9233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:00.337353 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f6027dba-906f-4d05-b06f-cb8b5e409c47 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] 10.222.0.88 "GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4" status: 200 len: 1315 microversion: 2.1 time: 0.321242 Jul 25 14:31:00.338804 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 779/1504] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:00 2022] GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:00.423091 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-13b78f71-18ae-4c1d-b144-868214f3b37b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:00.424440 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-13b78f71-18ae-4c1d-b144-868214f3b37b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:00.432782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-13b78f71-18ae-4c1d-b144-868214f3b37b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:00.433493 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-13b78f71-18ae-4c1d-b144-868214f3b37b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:00.434481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-13b78f71-18ae-4c1d-b144-868214f3b37b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:00.435144 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-13b78f71-18ae-4c1d-b144-868214f3b37b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:00.463701 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.network.security_group_api [None req-94d63e0e-89d9-4d34-b325-74bf48393f44 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Adding security group 02f23a6f-aeb3-4b28-b7ce-602a5f13bdf9 to port 07cddb3e-f068-459f-9f01-a2ee486806fb Jul 25 14:31:00.625207 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-13b78f71-18ae-4c1d-b144-868214f3b37b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:00.636271 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-13b78f71-18ae-4c1d-b144-868214f3b37b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:00.638048 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-13b78f71-18ae-4c1d-b144-868214f3b37b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:00.639896 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-13b78f71-18ae-4c1d-b144-868214f3b37b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1814 microversion: 2.25 time: 0.221535 Jul 25 14:31:00.650829 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 780/1505] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:31:00 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1814 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:31:00.663326 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9a041307-54a8-4bac-be1d-705983b6547b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:00.664530 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9a041307-54a8-4bac-be1d-705983b6547b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:00.671783 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9a041307-54a8-4bac-be1d-705983b6547b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:00.672504 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9a041307-54a8-4bac-be1d-705983b6547b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:00.673488 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9a041307-54a8-4bac-be1d-705983b6547b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:00.674066 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9a041307-54a8-4bac-be1d-705983b6547b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:00.937288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9a041307-54a8-4bac-be1d-705983b6547b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:00.945288 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9a041307-54a8-4bac-be1d-705983b6547b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1476 microversion: 2.1 time: 0.286342 Jul 25 14:31:00.945911 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 781/1506] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:00 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1476 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:00.957275 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f5fd8a68-6c5f-4571-abbe-2cf49084f7b5 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:00.961168 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f5fd8a68-6c5f-4571-abbe-2cf49084f7b5 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:00.972476 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5fd8a68-6c5f-4571-abbe-2cf49084f7b5 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:00.979211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5fd8a68-6c5f-4571-abbe-2cf49084f7b5 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:00.980261 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5fd8a68-6c5f-4571-abbe-2cf49084f7b5 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:00.992756 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5fd8a68-6c5f-4571-abbe-2cf49084f7b5 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:01.099560 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-94d63e0e-89d9-4d34-b325-74bf48393f44 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "POST /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22/action" status: 202 len: 0 microversion: 2.1 time: 0.861512 Jul 25 14:31:01.100741 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 726/1507] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:31:00 2022] POST /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22/action => generated 0 bytes in 863 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 14:31:01.107605 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-268a4560-ef87-46bf-99ab-939fb23571d3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:01.113325 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-268a4560-ef87-46bf-99ab-939fb23571d3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:01.134245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-268a4560-ef87-46bf-99ab-939fb23571d3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:01.135019 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-268a4560-ef87-46bf-99ab-939fb23571d3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:01.136846 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-268a4560-ef87-46bf-99ab-939fb23571d3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:01.138225 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-268a4560-ef87-46bf-99ab-939fb23571d3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:01.432720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-268a4560-ef87-46bf-99ab-939fb23571d3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:01.444394 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-268a4560-ef87-46bf-99ab-939fb23571d3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd" status: 200 len: 1311 microversion: 2.1 time: 0.339936 Jul 25 14:31:01.463341 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 727/1508] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:01 2022] GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd => generated 1311 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:01.474854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6611364c-3597-452e-94d3-af10cb488585 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '.version_select at 0x7f4687257280>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:01.628890 n-d-846435-14 devstack@n-api.service[119303]: DEBUG neutronclient.v2_0.client [None req-6611364c-3597-452e-94d3-af10cb488585 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 02f23a6f-aeb3-4b28-b7ce-602a5f13bdf9 in use.", "detail": ""}} {{(pid=119303) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 14:31:01.629884 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-6611364c-3597-452e-94d3-af10cb488585 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] HTTP exception thrown: Security Group 02f23a6f-aeb3-4b28-b7ce-602a5f13bdf9 in use. Jul 25 14:31:01.629884 n-d-846435-14 devstack@n-api.service[119303]: Neutron server returns request_ids: ['req-2478d605-b034-4dd0-9ab4-fe62c0158555'] Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6611364c-3597-452e-94d3-af10cb488585 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Request method failure captured: Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/os-security-groups/02f23a6f-aeb3-4b28-b7ce-602a5f13bdf9 HTTP/1.1 Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qjSWhK-vwJTt9-RUosNUl92O2IH7DXHM__YKwETUuX644ZNnaLPUYLl7n9jfiOhif_9NvqEaG0blLab1mJt658fIFOepG5Z0DCt4IZ2Chl0jBZNJNW6gm_-nwSZ3IWfSAUAPR-qkW1tUiXhGVJPIQGpNlpD2VqkHT6SMzyoZa1fOYg Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 3d71324b22554a3bb44d6aceb7bc3cbd Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d71324b22554a3bb44d6aceb7bc3cbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d71324b22554a3bb44d6aceb7bc3cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3d71324b22554a3bb44d6aceb7bc3cbd", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3d71324b22554a3bb44d6aceb7bc3cbd"}]}] Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 3d71324b22554a3bb44d6aceb7bc3cbd Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-SecurityGroupsTestJSON-81685064-project Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: b3f53d74a29243759065e68964f638dc Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-SecurityGroupsTestJSON-81685064-project Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: exception: Security Group 02f23a6f-aeb3-4b28-b7ce-602a5f13bdf9 in use. Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: Neutron server returns request_ids: ['req-2478d605-b034-4dd0-9ab4-fe62c0158555'] Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '02f23a6f-aeb3-4b28-b7ce-602a5f13bdf9'} Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 02f23a6f-aeb3-4b28-b7ce-602a5f13bdf9 in use. Jul 25 14:31:01.632555 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2478d605-b034-4dd0-9ab4-fe62c0158555'] Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 02f23a6f-aeb3-4b28-b7ce-602a5f13bdf9 in use. Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2478d605-b034-4dd0-9ab4-fe62c0158555'] Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 02f23a6f-aeb3-4b28-b7ce-602a5f13bdf9 in use. Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2478d605-b034-4dd0-9ab4-fe62c0158555'] Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 02f23a6f-aeb3-4b28-b7ce-602a5f13bdf9 in use. Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2478d605-b034-4dd0-9ab4-fe62c0158555'] Jul 25 14:31:01.638388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:01.646209 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6611364c-3597-452e-94d3-af10cb488585 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Returning 400 to user: Security Group 02f23a6f-aeb3-4b28-b7ce-602a5f13bdf9 in use. Jul 25 14:31:01.646209 n-d-846435-14 devstack@n-api.service[119303]: Neutron server returns request_ids: ['req-2478d605-b034-4dd0-9ab4-fe62c0158555'] {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:01.647630 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6611364c-3597-452e-94d3-af10cb488585 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/02f23a6f-aeb3-4b28-b7ce-602a5f13bdf9" status: 400 len: 185 microversion: 2.1 time: 0.182995 Jul 25 14:31:01.648520 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 728/1509] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:31:01 2022] DELETE /compute/v2.1/os-security-groups/02f23a6f-aeb3-4b28-b7ce-602a5f13bdf9 => generated 185 bytes in 185 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:31:01.851083 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-a9c687e7-e5f5-498d-b3ed-9fbdacc0fd30 req-36bec14b-7997-4269-9402-740a4d61c6ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "633a0bd6-3680-40d7-9e3d-224e349c0f22", "tag": "07cddb3e-f068-459f-9f01-a2ee486806fb"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:01.858722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:31:01.872937 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-a9c687e7-e5f5-498d-b3ed-9fbdacc0fd30 req-36bec14b-7997-4269-9402-740a4d61c6ed service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:01.874351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-a9c687e7-e5f5-498d-b3ed-9fbdacc0fd30 req-36bec14b-7997-4269-9402-740a4d61c6ed service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:01.899213 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-a9c687e7-e5f5-498d-b3ed-9fbdacc0fd30 req-36bec14b-7997-4269-9402-740a4d61c6ed service nova] Creating event network-changed:07cddb3e-f068-459f-9f01-a2ee486806fb for instance 633a0bd6-3680-40d7-9e3d-224e349c0f22 on n-h2-846435-14 Jul 25 14:31:01.912668 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-a9c687e7-e5f5-498d-b3ed-9fbdacc0fd30 req-36bec14b-7997-4269-9402-740a4d61c6ed service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.261679 Jul 25 14:31:01.915002 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 729/1510] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:01.944574 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9d351796-b6fd-4f72-8e64-a6767d39d4bc tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:01.945102 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9d351796-b6fd-4f72-8e64-a6767d39d4bc tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] [instance: 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:01.973997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d351796-b6fd-4f72-8e64-a6767d39d4bc tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:01.974800 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d351796-b6fd-4f72-8e64-a6767d39d4bc tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:01.975762 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d351796-b6fd-4f72-8e64-a6767d39d4bc tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:01.976497 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d351796-b6fd-4f72-8e64-a6767d39d4bc tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:02.083344 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f5fd8a68-6c5f-4571-abbe-2cf49084f7b5 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:02.096831 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f5fd8a68-6c5f-4571-abbe-2cf49084f7b5 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1318 microversion: 2.1 time: 1.149735 Jul 25 14:31:02.098621 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 782/1511] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:00 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1318 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:02.117883 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-557b3066-25dd-4727-9bec-ea74e483acd1 req-6b0363e7-0b6d-4488-9e6b-2b75188d5cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5694bd9c-d7e8-4f20-8404-fc5e747c93cd", "name": "network-vif-plugged", "status": "completed", "tag": "972e03f2-20ce-491f-a29a-2936da24a706"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:02.141317 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-557b3066-25dd-4727-9bec-ea74e483acd1 req-6b0363e7-0b6d-4488-9e6b-2b75188d5cd4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:02.143570 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-557b3066-25dd-4727-9bec-ea74e483acd1 req-6b0363e7-0b6d-4488-9e6b-2b75188d5cd4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:02.179433 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-557b3066-25dd-4727-9bec-ea74e483acd1 req-6b0363e7-0b6d-4488-9e6b-2b75188d5cd4 service nova] Creating event network-vif-plugged:972e03f2-20ce-491f-a29a-2936da24a706 for instance 5694bd9c-d7e8-4f20-8404-fc5e747c93cd on n-h2-846435-14 Jul 25 14:31:02.192773 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-557b3066-25dd-4727-9bec-ea74e483acd1 req-6b0363e7-0b6d-4488-9e6b-2b75188d5cd4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083321 Jul 25 14:31:02.195370 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 783/1512] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:02.236328 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9d351796-b6fd-4f72-8e64-a6767d39d4bc tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef2558f586447408bbce6b9b0dcd62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced9025cae5c4c43a111119b99ae9233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:02.244750 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9d351796-b6fd-4f72-8e64-a6767d39d4bc tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] 10.222.0.88 "GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4" status: 200 len: 1315 microversion: 2.1 time: 0.310957 Jul 25 14:31:02.259037 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 730/1513] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:01 2022] GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:02.265292 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-504ce839-6b1f-42e7-8bf0-295d5bf7ae2a tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:02.266215 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-504ce839-6b1f-42e7-8bf0-295d5bf7ae2a tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 633a0bd6-3680-40d7-9e3d-224e349c0f22] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:02.274273 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-504ce839-6b1f-42e7-8bf0-295d5bf7ae2a tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:02.274987 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-504ce839-6b1f-42e7-8bf0-295d5bf7ae2a tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:02.275941 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-504ce839-6b1f-42e7-8bf0-295d5bf7ae2a tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:02.276543 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-504ce839-6b1f-42e7-8bf0-295d5bf7ae2a tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:02.287210 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c06c12d3-5925-4f2d-bd01-8a575f7bfc1b tempest-ImagesDeleteNegativeTestJSON-405216062 tempest-ImagesDeleteNegativeTestJSON-405216062-project] 10.222.0.88 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.090351 Jul 25 14:31:02.292758 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 784/1514] 10.222.0.88 () {58 vars in 1128 bytes} [Mon Jul 25 14:31:02 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 14:31:02.301976 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-28c92699-385a-4af4-b684-917ab89fe0f7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:02.306814 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-28c92699-385a-4af4-b684-917ab89fe0f7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:02.312057 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-504ce839-6b1f-42e7-8bf0-295d5bf7ae2a tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 633a0bd6-3680-40d7-9e3d-224e349c0f22] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:31:02.320050 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28c92699-385a-4af4-b684-917ab89fe0f7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:02.323999 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28c92699-385a-4af4-b684-917ab89fe0f7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:02.325122 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28c92699-385a-4af4-b684-917ab89fe0f7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:02.328692 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28c92699-385a-4af4-b684-917ab89fe0f7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:02.431098 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-504ce839-6b1f-42e7-8bf0-295d5bf7ae2a tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "DELETE /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22" status: 204 len: 0 microversion: 2.1 time: 0.169603 Jul 25 14:31:02.431875 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 731/1515] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:31:02 2022] DELETE /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:31:02.439106 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-93e262cd-9e87-46ef-8364-7cacbb070215 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:02.439747 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-93e262cd-9e87-46ef-8364-7cacbb070215 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:02.447370 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93e262cd-9e87-46ef-8364-7cacbb070215 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:02.448234 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93e262cd-9e87-46ef-8364-7cacbb070215 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:02.448820 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93e262cd-9e87-46ef-8364-7cacbb070215 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:02.449284 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93e262cd-9e87-46ef-8364-7cacbb070215 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:02.604375 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-93e262cd-9e87-46ef-8364-7cacbb070215 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:02.615389 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-93e262cd-9e87-46ef-8364-7cacbb070215 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1476 microversion: 2.1 time: 0.182090 Jul 25 14:31:02.628125 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 732/1516] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:02 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1476 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:02.633318 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1d8b6039-9468-4738-8d71-464311ada2c2 tempest-ImagesDeleteNegativeTestJSON-405216062 tempest-ImagesDeleteNegativeTestJSON-405216062-project] Calling method '.version_select at 0x7f46873d9a60>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:02.658986 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-1d8b6039-9468-4738-8d71-464311ada2c2 tempest-ImagesDeleteNegativeTestJSON-405216062 tempest-ImagesDeleteNegativeTestJSON-405216062-project] HTTP exception thrown: Image not found. Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1d8b6039-9468-4738-8d71-464311ada2c2 tempest-ImagesDeleteNegativeTestJSON-405216062 tempest-ImagesDeleteNegativeTestJSON-405216062-project] Request method failure captured: Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qklq_adY46AdM2LgrOq97jDWm4mz-RH-9bRnEAMQhivJED27xyoxWUlht5bo7hwhcNFbvnQyBpZ97EqQ7U22G5fOwwP-P0Sc2ka_mYx9cezzhZRZc9wRFNZpQOLvUuaoVXDL28NX8BFRt3jPayrb9Y5EPOiD_yn7VHGinTEV5v8B6c Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: e3be89b73183454c8192a26fbed81706 Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-405216062 Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e3be89b73183454c8192a26fbed81706"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e3be89b73183454c8192a26fbed81706"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e3be89b73183454c8192a26fbed81706", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e3be89b73183454c8192a26fbed81706"}]}] Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-405216062 Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: e3be89b73183454c8192a26fbed81706 Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-405216062 Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ImagesDeleteNegativeTestJSON-405216062-project Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: dce0bd75db264b0d84e15955870169c8 Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-405216062-project Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: exception: Image not found. Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '-1'} Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:02.661680 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:02.671894 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:02.671894 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:02.671894 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:02.671894 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:02.671894 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:31:02.671894 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:31:02.671894 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:02.671894 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:02.671894 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 14:31:02.671894 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 14:31:02.671894 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 14:31:02.671894 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:02.671894 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:02.671894 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:02.671894 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:02.671894 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:02.671894 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:02.671894 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:02.671894 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:02.671894 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 14:31:02.671894 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:02.671894 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1d8b6039-9468-4738-8d71-464311ada2c2 tempest-ImagesDeleteNegativeTestJSON-405216062 tempest-ImagesDeleteNegativeTestJSON-405216062-project] Returning 404 to user: Image not found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:02.671894 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1d8b6039-9468-4738-8d71-464311ada2c2 tempest-ImagesDeleteNegativeTestJSON-405216062 tempest-ImagesDeleteNegativeTestJSON-405216062-project] 10.222.0.88 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.045696 Jul 25 14:31:02.671894 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 733/1517] 10.222.0.88 () {58 vars in 1134 bytes} [Mon Jul 25 14:31:02 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:31:02.671894 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-636cce2c-a7aa-4299-ae59-f8503db73af6 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:02.671894 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-636cce2c-a7aa-4299-ae59-f8503db73af6 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 633a0bd6-3680-40d7-9e3d-224e349c0f22] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:02.680307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-636cce2c-a7aa-4299-ae59-f8503db73af6 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:02.680817 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-636cce2c-a7aa-4299-ae59-f8503db73af6 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:02.681622 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-636cce2c-a7aa-4299-ae59-f8503db73af6 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:02.682066 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-636cce2c-a7aa-4299-ae59-f8503db73af6 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:02.802883 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-28c92699-385a-4af4-b684-917ab89fe0f7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:02.824421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-28c92699-385a-4af4-b684-917ab89fe0f7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:02.826367 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-28c92699-385a-4af4-b684-917ab89fe0f7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:02.827722 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-28c92699-385a-4af4-b684-917ab89fe0f7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1814 microversion: 2.25 time: 0.533703 Jul 25 14:31:02.831328 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 785/1518] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:31:02 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1814 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:31:02.843596 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cef5309e-ce51-4973-883c-ff6d80712e7f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:02.844587 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cef5309e-ce51-4973-883c-ff6d80712e7f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:02.862066 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cef5309e-ce51-4973-883c-ff6d80712e7f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:02.862988 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cef5309e-ce51-4973-883c-ff6d80712e7f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:02.864148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cef5309e-ce51-4973-883c-ff6d80712e7f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:02.864747 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cef5309e-ce51-4973-883c-ff6d80712e7f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:02.896969 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-636cce2c-a7aa-4299-ae59-f8503db73af6 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f53d74a29243759065e68964f638dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d71324b22554a3bb44d6aceb7bc3cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:02.908578 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-636cce2c-a7aa-4299-ae59-f8503db73af6 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22" status: 200 len: 1645 microversion: 2.1 time: 0.242785 Jul 25 14:31:02.909181 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 734/1519] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:02 2022] GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22 => generated 1645 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:02.920781 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0c170aa3-d4bf-4edb-bb47-6557bc73f6cd tempest-ImagesDeleteNegativeTestJSON-405216062 tempest-ImagesDeleteNegativeTestJSON-405216062-project] Calling method '.version_select at 0x7f46873d9790>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:02.944835 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-0c170aa3-d4bf-4edb-bb47-6557bc73f6cd tempest-ImagesDeleteNegativeTestJSON-405216062 tempest-ImagesDeleteNegativeTestJSON-405216062-project] HTTP exception thrown: Image not found. Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0c170aa3-d4bf-4edb-bb47-6557bc73f6cd tempest-ImagesDeleteNegativeTestJSON-405216062 tempest-ImagesDeleteNegativeTestJSON-405216062-project] Request method failure captured: Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/images/e01c5417-016c-4dc5-bdec-706c48b9013j HTTP/1.1 Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qklq_adY46AdM2LgrOq97jDWm4mz-RH-9bRnEAMQhivJED27xyoxWUlht5bo7hwhcNFbvnQyBpZ97EqQ7U22G5fOwwP-P0Sc2ka_mYx9cezzhZRZc9wRFNZpQOLvUuaoVXDL28NX8BFRt3jPayrb9Y5EPOiD_yn7VHGinTEV5v8B6c Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: e3be89b73183454c8192a26fbed81706 Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-405216062 Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e3be89b73183454c8192a26fbed81706"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e3be89b73183454c8192a26fbed81706"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e3be89b73183454c8192a26fbed81706", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e3be89b73183454c8192a26fbed81706"}]}] Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-405216062 Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: e3be89b73183454c8192a26fbed81706 Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-405216062 Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ImagesDeleteNegativeTestJSON-405216062-project Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: dce0bd75db264b0d84e15955870169c8 Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-405216062-project Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: exception: Image not found. Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'e01c5417-016c-4dc5-bdec-706c48b9013j'} Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e01c5417-016c-4dc5-bdec-706c48b9013j to delete Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e01c5417-016c-4dc5-bdec-706c48b9013j could not be found. Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:02.946870 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:02.952045 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:02.952045 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:02.952045 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:02.952045 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:02.952045 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:02.952045 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:31:02.952045 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:31:02.952045 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:02.952045 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:02.952045 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 14:31:02.952045 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 14:31:02.952045 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 14:31:02.952045 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:02.952045 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:02.952045 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:02.952045 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:02.952045 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:02.952045 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:02.952045 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:02.952045 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:02.952045 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 14:31:02.952045 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:02.955150 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0c170aa3-d4bf-4edb-bb47-6557bc73f6cd tempest-ImagesDeleteNegativeTestJSON-405216062 tempest-ImagesDeleteNegativeTestJSON-405216062-project] Returning 404 to user: Image not found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:02.956322 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0c170aa3-d4bf-4edb-bb47-6557bc73f6cd tempest-ImagesDeleteNegativeTestJSON-405216062 tempest-ImagesDeleteNegativeTestJSON-405216062-project] 10.222.0.88 "DELETE /compute/v2.1/images/e01c5417-016c-4dc5-bdec-706c48b9013j" status: 404 len: 62 microversion: 2.1 time: 0.040027 Jul 25 14:31:02.957123 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 735/1520] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:02 2022] DELETE /compute/v2.1/images/e01c5417-016c-4dc5-bdec-706c48b9013j => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:31:02.962077 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-c5e33033-f4d5-4a38-a349-7e5171edded4 req-43b621bb-d227-4b31-8edb-2e79491784d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a13ead5-0102-4ed4-a1d9-42414cd7ffb4", "tag": "2174faa6-514a-432a-b58b-9472df90d0a4"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:02.974403 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c5e33033-f4d5-4a38-a349-7e5171edded4 req-43b621bb-d227-4b31-8edb-2e79491784d4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:02.975053 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c5e33033-f4d5-4a38-a349-7e5171edded4 req-43b621bb-d227-4b31-8edb-2e79491784d4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:02.988878 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-c5e33033-f4d5-4a38-a349-7e5171edded4 req-43b621bb-d227-4b31-8edb-2e79491784d4 service nova] Creating event network-changed:2174faa6-514a-432a-b58b-9472df90d0a4 for instance 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 on n-h1-846435-14 Jul 25 14:31:02.995029 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-c5e33033-f4d5-4a38-a349-7e5171edded4 req-43b621bb-d227-4b31-8edb-2e79491784d4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036269 Jul 25 14:31:02.996039 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 736/1521] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:03.001979 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-52fa703c-c463-45ca-9f86-a182c7ff10ab tempest-ImagesDeleteNegativeTestJSON-405216062 tempest-ImagesDeleteNegativeTestJSON-405216062-project] Calling method '.version_select at 0x7f46873d9160>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:03.019173 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-52fa703c-c463-45ca-9f86-a182c7ff10ab tempest-ImagesDeleteNegativeTestJSON-405216062 tempest-ImagesDeleteNegativeTestJSON-405216062-project] HTTP exception thrown: Image not found. Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-52fa703c-c463-45ca-9f86-a182c7ff10ab tempest-ImagesDeleteNegativeTestJSON-405216062 tempest-ImagesDeleteNegativeTestJSON-405216062-project] Request method failure captured: Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/images/b5a6024f-5589-4827-b807-0e5e48a6e3e81 HTTP/1.1 Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qklq_adY46AdM2LgrOq97jDWm4mz-RH-9bRnEAMQhivJED27xyoxWUlht5bo7hwhcNFbvnQyBpZ97EqQ7U22G5fOwwP-P0Sc2ka_mYx9cezzhZRZc9wRFNZpQOLvUuaoVXDL28NX8BFRt3jPayrb9Y5EPOiD_yn7VHGinTEV5v8B6c Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: e3be89b73183454c8192a26fbed81706 Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-405216062 Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e3be89b73183454c8192a26fbed81706"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e3be89b73183454c8192a26fbed81706"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e3be89b73183454c8192a26fbed81706", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e3be89b73183454c8192a26fbed81706"}]}] Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-405216062 Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: e3be89b73183454c8192a26fbed81706 Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-405216062 Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ImagesDeleteNegativeTestJSON-405216062-project Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: dce0bd75db264b0d84e15955870169c8 Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-405216062-project Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: exception: Image not found. Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'b5a6024f-5589-4827-b807-0e5e48a6e3e81'} Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b5a6024f-5589-4827-b807-0e5e48a6e3e81 to delete Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b5a6024f-5589-4827-b807-0e5e48a6e3e81 could not be found. Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:03.021484 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:03.025799 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:03.025799 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:03.025799 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:03.025799 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:03.025799 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:03.025799 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:31:03.025799 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:31:03.025799 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:03.025799 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:03.025799 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 14:31:03.025799 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 14:31:03.025799 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 14:31:03.025799 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:03.025799 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:03.025799 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:03.025799 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:03.025799 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:03.025799 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:03.025799 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:03.025799 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:03.025799 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 14:31:03.025799 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:03.025799 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-52fa703c-c463-45ca-9f86-a182c7ff10ab tempest-ImagesDeleteNegativeTestJSON-405216062 tempest-ImagesDeleteNegativeTestJSON-405216062-project] Returning 404 to user: Image not found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:03.025799 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-52fa703c-c463-45ca-9f86-a182c7ff10ab tempest-ImagesDeleteNegativeTestJSON-405216062 tempest-ImagesDeleteNegativeTestJSON-405216062-project] 10.222.0.88 "DELETE /compute/v2.1/images/b5a6024f-5589-4827-b807-0e5e48a6e3e81" status: 404 len: 62 microversion: 2.1 time: 0.025781 Jul 25 14:31:03.025799 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 737/1522] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:31:02 2022] DELETE /compute/v2.1/images/b5a6024f-5589-4827-b807-0e5e48a6e3e81 => generated 62 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:31:03.037005 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-13d36cab-1e49-46e7-9fea-ea46977b7a28 tempest-ImagesDeleteNegativeTestJSON-405216062 tempest-ImagesDeleteNegativeTestJSON-405216062-project] Calling method '.version_select at 0x7f46873d9a60>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:03.067768 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-13d36cab-1e49-46e7-9fea-ea46977b7a28 tempest-ImagesDeleteNegativeTestJSON-405216062 tempest-ImagesDeleteNegativeTestJSON-405216062-project] HTTP exception thrown: Image not found. Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-13d36cab-1e49-46e7-9fea-ea46977b7a28 tempest-ImagesDeleteNegativeTestJSON-405216062 tempest-ImagesDeleteNegativeTestJSON-405216062-project] Request method failure captured: Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/images/tempest-invalid-1744353913 HTTP/1.1 Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qklq_adY46AdM2LgrOq97jDWm4mz-RH-9bRnEAMQhivJED27xyoxWUlht5bo7hwhcNFbvnQyBpZ97EqQ7U22G5fOwwP-P0Sc2ka_mYx9cezzhZRZc9wRFNZpQOLvUuaoVXDL28NX8BFRt3jPayrb9Y5EPOiD_yn7VHGinTEV5v8B6c Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: e3be89b73183454c8192a26fbed81706 Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-405216062 Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e3be89b73183454c8192a26fbed81706"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e3be89b73183454c8192a26fbed81706"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e3be89b73183454c8192a26fbed81706", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e3be89b73183454c8192a26fbed81706"}]}] Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-405216062 Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: e3be89b73183454c8192a26fbed81706 Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-405216062 Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ImagesDeleteNegativeTestJSON-405216062-project Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: dce0bd75db264b0d84e15955870169c8 Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-405216062-project Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: exception: Image not found. Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'tempest-invalid-1744353913'} Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1744353913 to delete Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1744353913 could not be found. Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:03.069912 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:03.075047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:03.075047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:03.075047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:03.075047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:03.075047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:31:03.075047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:31:03.075047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:03.075047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:03.075047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 14:31:03.075047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 14:31:03.075047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 14:31:03.075047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:03.075047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:03.075047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:03.075047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:03.075047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:03.075047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:03.075047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:03.075047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:03.075047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 14:31:03.075047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:03.077944 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-13d36cab-1e49-46e7-9fea-ea46977b7a28 tempest-ImagesDeleteNegativeTestJSON-405216062 tempest-ImagesDeleteNegativeTestJSON-405216062-project] Returning 404 to user: Image not found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:03.078944 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-13d36cab-1e49-46e7-9fea-ea46977b7a28 tempest-ImagesDeleteNegativeTestJSON-405216062 tempest-ImagesDeleteNegativeTestJSON-405216062-project] 10.222.0.88 "DELETE /compute/v2.1/images/tempest-invalid-1744353913" status: 404 len: 62 microversion: 2.1 time: 0.048315 Jul 25 14:31:03.080218 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 738/1523] 10.222.0.88 () {58 vars in 1206 bytes} [Mon Jul 25 14:31:03 2022] DELETE /compute/v2.1/images/tempest-invalid-1744353913 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 25 14:31:03.093239 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1ccfac66-86a7-4d47-884d-cd9814243b10 tempest-ImagesDeleteNegativeTestJSON-405216062 tempest-ImagesDeleteNegativeTestJSON-405216062-project] Calling method '.version_select at 0x7f4687349820>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:03.120194 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-1ccfac66-86a7-4d47-884d-cd9814243b10 tempest-ImagesDeleteNegativeTestJSON-405216062 tempest-ImagesDeleteNegativeTestJSON-405216062-project] HTTP exception thrown: Image not found. Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1ccfac66-86a7-4d47-884d-cd9814243b10 tempest-ImagesDeleteNegativeTestJSON-405216062 tempest-ImagesDeleteNegativeTestJSON-405216062-project] Request method failure captured: Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/images/0d3af1cd-e886-4ef7-befd-5ae4e23f057a HTTP/1.1 Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qklq_adY46AdM2LgrOq97jDWm4mz-RH-9bRnEAMQhivJED27xyoxWUlht5bo7hwhcNFbvnQyBpZ97EqQ7U22G5fOwwP-P0Sc2ka_mYx9cezzhZRZc9wRFNZpQOLvUuaoVXDL28NX8BFRt3jPayrb9Y5EPOiD_yn7VHGinTEV5v8B6c Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: e3be89b73183454c8192a26fbed81706 Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-405216062 Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e3be89b73183454c8192a26fbed81706"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e3be89b73183454c8192a26fbed81706"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e3be89b73183454c8192a26fbed81706", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e3be89b73183454c8192a26fbed81706"}]}] Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-405216062 Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: e3be89b73183454c8192a26fbed81706 Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-405216062 Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ImagesDeleteNegativeTestJSON-405216062-project Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: dce0bd75db264b0d84e15955870169c8 Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-405216062-project Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: exception: Image not found. Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '0d3af1cd-e886-4ef7-befd-5ae4e23f057a'} Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0d3af1cd-e886-4ef7-befd-5ae4e23f057a to delete Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0d3af1cd-e886-4ef7-befd-5ae4e23f057a could not be found. Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:03.122743 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:03.130217 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:03.130217 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:03.130217 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:03.130217 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:03.130217 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:03.130217 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:31:03.130217 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:31:03.130217 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:03.130217 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:03.130217 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 14:31:03.130217 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 14:31:03.130217 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 14:31:03.130217 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:03.130217 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:03.130217 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:03.130217 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:03.130217 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:03.130217 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:03.130217 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:03.130217 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:03.130217 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 14:31:03.130217 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:03.130217 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1ccfac66-86a7-4d47-884d-cd9814243b10 tempest-ImagesDeleteNegativeTestJSON-405216062 tempest-ImagesDeleteNegativeTestJSON-405216062-project] Returning 404 to user: Image not found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:03.132411 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1ccfac66-86a7-4d47-884d-cd9814243b10 tempest-ImagesDeleteNegativeTestJSON-405216062 tempest-ImagesDeleteNegativeTestJSON-405216062-project] 10.222.0.88 "DELETE /compute/v2.1/images/0d3af1cd-e886-4ef7-befd-5ae4e23f057a" status: 404 len: 62 microversion: 2.1 time: 0.041565 Jul 25 14:31:03.137692 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 739/1524] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:03 2022] DELETE /compute/v2.1/images/0d3af1cd-e886-4ef7-befd-5ae4e23f057a => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:31:03.152389 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e6795ea8-77db-4281-b267-88f684d95fd1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:03.153268 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e6795ea8-77db-4281-b267-88f684d95fd1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:03.161232 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e6795ea8-77db-4281-b267-88f684d95fd1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:03.161693 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e6795ea8-77db-4281-b267-88f684d95fd1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:03.162486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e6795ea8-77db-4281-b267-88f684d95fd1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:03.162930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e6795ea8-77db-4281-b267-88f684d95fd1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:03.196445 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cef5309e-ce51-4973-883c-ff6d80712e7f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:03.205440 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cef5309e-ce51-4973-883c-ff6d80712e7f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd" status: 200 len: 1311 microversion: 2.1 time: 0.371753 Jul 25 14:31:03.211457 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 786/1525] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:02 2022] GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd => generated 1311 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:03.267572 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5b8991cd-3f06-4c2e-99b6-5894e8906900 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:03.268335 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5b8991cd-3f06-4c2e-99b6-5894e8906900 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] [instance: 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:03.279950 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b8991cd-3f06-4c2e-99b6-5894e8906900 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:03.280798 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b8991cd-3f06-4c2e-99b6-5894e8906900 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:03.284219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b8991cd-3f06-4c2e-99b6-5894e8906900 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:03.284883 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b8991cd-3f06-4c2e-99b6-5894e8906900 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:03.379310 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e6795ea8-77db-4281-b267-88f684d95fd1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:03.391048 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e6795ea8-77db-4281-b267-88f684d95fd1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1508 microversion: 2.1 time: 0.256986 Jul 25 14:31:03.391874 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 740/1526] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:03 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1508 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:03.413246 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2fda1b78-8a10-4a52-89d2-3495fda01344 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:03.413854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2fda1b78-8a10-4a52-89d2-3495fda01344 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:03.433463 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2fda1b78-8a10-4a52-89d2-3495fda01344 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:03.433877 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2fda1b78-8a10-4a52-89d2-3495fda01344 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:03.434669 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2fda1b78-8a10-4a52-89d2-3495fda01344 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:03.435184 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2fda1b78-8a10-4a52-89d2-3495fda01344 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:03.521805 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5b8991cd-3f06-4c2e-99b6-5894e8906900 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef2558f586447408bbce6b9b0dcd62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced9025cae5c4c43a111119b99ae9233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:03.529710 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5b8991cd-3f06-4c2e-99b6-5894e8906900 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] 10.222.0.88 "GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4" status: 200 len: 1315 microversion: 2.1 time: 0.267004 Jul 25 14:31:03.545263 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 787/1527] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:03 2022] GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:31:03.598358 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2fda1b78-8a10-4a52-89d2-3495fda01344 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:03.606143 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2fda1b78-8a10-4a52-89d2-3495fda01344 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1508 microversion: 2.1 time: 0.197046 Jul 25 14:31:03.606686 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 741/1528] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:03 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1508 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:03.629308 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e147ba1d-1532-4c42-b89c-dbb8f8c42891 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:03.632473 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e147ba1d-1532-4c42-b89c-dbb8f8c42891 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:03.638780 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b3b9ac78-60c6-4d2c-b1b9-ff484e6e92bc tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:03.639394 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b3b9ac78-60c6-4d2c-b1b9-ff484e6e92bc tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:03.639781 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e147ba1d-1532-4c42-b89c-dbb8f8c42891 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:03.640490 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e147ba1d-1532-4c42-b89c-dbb8f8c42891 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:03.641509 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e147ba1d-1532-4c42-b89c-dbb8f8c42891 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:03.642166 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e147ba1d-1532-4c42-b89c-dbb8f8c42891 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:03.646966 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3b9ac78-60c6-4d2c-b1b9-ff484e6e92bc tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:03.647638 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3b9ac78-60c6-4d2c-b1b9-ff484e6e92bc tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:03.648476 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3b9ac78-60c6-4d2c-b1b9-ff484e6e92bc tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:03.649098 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3b9ac78-60c6-4d2c-b1b9-ff484e6e92bc tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:03.757295 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:31:03.763396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-e147ba1d-1532-4c42-b89c-dbb8f8c42891 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:31:03.764120 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-e147ba1d-1532-4c42-b89c-dbb8f8c42891 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:31:03.764952 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-e147ba1d-1532-4c42-b89c-dbb8f8c42891 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:31:03.765542 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-e147ba1d-1532-4c42-b89c-dbb8f8c42891 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:31:03.766326 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-e147ba1d-1532-4c42-b89c-dbb8f8c42891 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:31:03.842804 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b3b9ac78-60c6-4d2c-b1b9-ff484e6e92bc tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:03.853323 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e147ba1d-1532-4c42-b89c-dbb8f8c42891 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:03.854428 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b3b9ac78-60c6-4d2c-b1b9-ff484e6e92bc tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1476 microversion: 2.1 time: 0.220283 Jul 25 14:31:03.862070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e147ba1d-1532-4c42-b89c-dbb8f8c42891 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:03.863130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e147ba1d-1532-4c42-b89c-dbb8f8c42891 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:03.865016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e147ba1d-1532-4c42-b89c-dbb8f8c42891 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:03.865755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e147ba1d-1532-4c42-b89c-dbb8f8c42891 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:03.868522 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 742/1529] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:03 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1476 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:31:03.874720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d5ddc7a6-521d-4d3c-b928-ef91ef9e2fca tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:03.875682 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d5ddc7a6-521d-4d3c-b928-ef91ef9e2fca tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:03.882390 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d5ddc7a6-521d-4d3c-b928-ef91ef9e2fca tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:03.883237 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d5ddc7a6-521d-4d3c-b928-ef91ef9e2fca tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:03.884263 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d5ddc7a6-521d-4d3c-b928-ef91ef9e2fca tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:03.884947 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d5ddc7a6-521d-4d3c-b928-ef91ef9e2fca tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:03.906227 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e147ba1d-1532-4c42-b89c-dbb8f8c42891 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "POST /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5/action" status: 202 len: 1110 microversion: 2.1 time: 0.280425 Jul 25 14:31:03.916028 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 788/1530] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:31:03 2022] POST /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5/action => generated 1110 bytes in 283 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 14:31:03.927712 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e7e786d9-55db-47fe-be9a-0392921a8d01 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:03.928730 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e7e786d9-55db-47fe-be9a-0392921a8d01 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:03.935480 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e7e786d9-55db-47fe-be9a-0392921a8d01 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:03.936403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e7e786d9-55db-47fe-be9a-0392921a8d01 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:03.937572 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e7e786d9-55db-47fe-be9a-0392921a8d01 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:03.938257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e7e786d9-55db-47fe-be9a-0392921a8d01 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:03.968649 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:31:04.076271 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d5ddc7a6-521d-4d3c-b928-ef91ef9e2fca tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:04.086915 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d5ddc7a6-521d-4d3c-b928-ef91ef9e2fca tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:04.088499 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d5ddc7a6-521d-4d3c-b928-ef91ef9e2fca tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:04.089787 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d5ddc7a6-521d-4d3c-b928-ef91ef9e2fca tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1814 microversion: 2.25 time: 0.220220 Jul 25 14:31:04.090400 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 743/1531] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:31:03 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1814 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:31:04.095601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8aa55a2d-fd06-4921-b7cd-cf05c0308d71 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:04.096587 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8aa55a2d-fd06-4921-b7cd-cf05c0308d71 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 633a0bd6-3680-40d7-9e3d-224e349c0f22] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:04.104308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8aa55a2d-fd06-4921-b7cd-cf05c0308d71 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:04.105145 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8aa55a2d-fd06-4921-b7cd-cf05c0308d71 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:04.106246 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8aa55a2d-fd06-4921-b7cd-cf05c0308d71 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:04.106978 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8aa55a2d-fd06-4921-b7cd-cf05c0308d71 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:04.250681 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e7e786d9-55db-47fe-be9a-0392921a8d01 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:04.260037 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e7e786d9-55db-47fe-be9a-0392921a8d01 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1515 microversion: 2.1 time: 0.337996 Jul 25 14:31:04.273226 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 789/1532] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:03 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1515 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:31:04.280034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e6f98239-2756-4f80-a4e5-b4bf4c1fce97 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:04.280723 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e6f98239-2756-4f80-a4e5-b4bf4c1fce97 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:04.287061 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6f98239-2756-4f80-a4e5-b4bf4c1fce97 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:04.287579 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6f98239-2756-4f80-a4e5-b4bf4c1fce97 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:04.288660 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6f98239-2756-4f80-a4e5-b4bf4c1fce97 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:04.289440 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6f98239-2756-4f80-a4e5-b4bf4c1fce97 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:04.343062 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8aa55a2d-fd06-4921-b7cd-cf05c0308d71 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f53d74a29243759065e68964f638dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d71324b22554a3bb44d6aceb7bc3cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:04.348015 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:31:04.357985 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8aa55a2d-fd06-4921-b7cd-cf05c0308d71 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22" status: 200 len: 1645 microversion: 2.1 time: 0.265441 Jul 25 14:31:04.360740 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 744/1533] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:04 2022] GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22 => generated 1645 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:04.467583 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e6f98239-2756-4f80-a4e5-b4bf4c1fce97 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:04.478723 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e6f98239-2756-4f80-a4e5-b4bf4c1fce97 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd" status: 200 len: 1311 microversion: 2.1 time: 0.203178 Jul 25 14:31:04.493066 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 790/1534] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:04 2022] GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd => generated 1311 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:04.555870 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d24008ec-96be-4f8e-baa3-e246c7fa6fb2 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:04.556542 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d24008ec-96be-4f8e-baa3-e246c7fa6fb2 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] [instance: 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:04.569535 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d24008ec-96be-4f8e-baa3-e246c7fa6fb2 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:04.570042 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d24008ec-96be-4f8e-baa3-e246c7fa6fb2 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:04.572420 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d24008ec-96be-4f8e-baa3-e246c7fa6fb2 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:04.573003 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d24008ec-96be-4f8e-baa3-e246c7fa6fb2 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:04.882742 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3a07c455-5094-4f6b-8b07-9346ce4a6db6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:04.883366 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3a07c455-5094-4f6b-8b07-9346ce4a6db6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:04.898792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a07c455-5094-4f6b-8b07-9346ce4a6db6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:04.899246 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a07c455-5094-4f6b-8b07-9346ce4a6db6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:04.900961 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a07c455-5094-4f6b-8b07-9346ce4a6db6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:04.908804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a07c455-5094-4f6b-8b07-9346ce4a6db6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:04.967984 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d24008ec-96be-4f8e-baa3-e246c7fa6fb2 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef2558f586447408bbce6b9b0dcd62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced9025cae5c4c43a111119b99ae9233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:04.979857 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d24008ec-96be-4f8e-baa3-e246c7fa6fb2 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] 10.222.0.88 "GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4" status: 200 len: 1315 microversion: 2.1 time: 0.429487 Jul 25 14:31:04.980493 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 745/1535] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:04 2022] GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 => generated 1315 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:05.118904 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-793f3498-b78d-4a1c-a81c-dc82d3a729c0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:05.119816 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-793f3498-b78d-4a1c-a81c-dc82d3a729c0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:05.132144 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-793f3498-b78d-4a1c-a81c-dc82d3a729c0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:05.133003 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-793f3498-b78d-4a1c-a81c-dc82d3a729c0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:05.134138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-793f3498-b78d-4a1c-a81c-dc82d3a729c0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:05.134732 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-793f3498-b78d-4a1c-a81c-dc82d3a729c0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:05.407007 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-793f3498-b78d-4a1c-a81c-dc82d3a729c0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:05.416638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3a07c455-5094-4f6b-8b07-9346ce4a6db6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:05.431090 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-793f3498-b78d-4a1c-a81c-dc82d3a729c0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:05.433228 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-793f3498-b78d-4a1c-a81c-dc82d3a729c0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:05.434967 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-793f3498-b78d-4a1c-a81c-dc82d3a729c0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1814 microversion: 2.25 time: 0.322531 Jul 25 14:31:05.450803 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 746/1536] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:31:05 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1814 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:31:05.451013 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3a07c455-5094-4f6b-8b07-9346ce4a6db6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1476 microversion: 2.1 time: 0.549917 Jul 25 14:31:05.451143 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3e3f04ac-9c52-4b42-bb0d-80d43cee6b38 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:05.451143 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3e3f04ac-9c52-4b42-bb0d-80d43cee6b38 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:05.451143 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3e3f04ac-9c52-4b42-bb0d-80d43cee6b38 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:05.451143 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3e3f04ac-9c52-4b42-bb0d-80d43cee6b38 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:05.451143 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3e3f04ac-9c52-4b42-bb0d-80d43cee6b38 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:05.451143 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3e3f04ac-9c52-4b42-bb0d-80d43cee6b38 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:05.460365 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 791/1537] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:04 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1476 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:05.472956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-692988fd-58e1-43b2-a589-4c222f814a04 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:05.473573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-692988fd-58e1-43b2-a589-4c222f814a04 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 633a0bd6-3680-40d7-9e3d-224e349c0f22] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:05.492280 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-692988fd-58e1-43b2-a589-4c222f814a04 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:05.492989 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-692988fd-58e1-43b2-a589-4c222f814a04 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:05.494089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-692988fd-58e1-43b2-a589-4c222f814a04 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:05.494676 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-692988fd-58e1-43b2-a589-4c222f814a04 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:05.657450 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-692988fd-58e1-43b2-a589-4c222f814a04 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f53d74a29243759065e68964f638dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d71324b22554a3bb44d6aceb7bc3cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:05.691132 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-692988fd-58e1-43b2-a589-4c222f814a04 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22" status: 200 len: 1467 microversion: 2.1 time: 0.227993 Jul 25 14:31:05.694080 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 792/1538] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:05 2022] GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22 => generated 1467 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:05.703613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-77151042-68fd-45b3-815b-60f179a3a130 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:05.708393 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-77151042-68fd-45b3-815b-60f179a3a130 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:05.726242 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-77151042-68fd-45b3-815b-60f179a3a130 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:05.726804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-77151042-68fd-45b3-815b-60f179a3a130 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:05.727661 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-77151042-68fd-45b3-815b-60f179a3a130 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:05.731689 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-77151042-68fd-45b3-815b-60f179a3a130 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:05.788911 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3e3f04ac-9c52-4b42-bb0d-80d43cee6b38 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:05.799278 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3e3f04ac-9c52-4b42-bb0d-80d43cee6b38 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1515 microversion: 2.1 time: 0.360807 Jul 25 14:31:05.806861 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 747/1539] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:05 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1515 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:05.838431 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-1ef4c682-5068-4c39-8811-c658f3337650 req-64231a73-682b-44b1-a7ec-be293e65bfee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "633a0bd6-3680-40d7-9e3d-224e349c0f22", "name": "network-vif-deleted", "tag": "07cddb3e-f068-459f-9f01-a2ee486806fb"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:05.873030 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-1ef4c682-5068-4c39-8811-c658f3337650 req-64231a73-682b-44b1-a7ec-be293e65bfee service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:05.876809 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-1ef4c682-5068-4c39-8811-c658f3337650 req-64231a73-682b-44b1-a7ec-be293e65bfee service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:05.897683 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-1ef4c682-5068-4c39-8811-c658f3337650 req-64231a73-682b-44b1-a7ec-be293e65bfee service nova] Creating event network-vif-deleted:07cddb3e-f068-459f-9f01-a2ee486806fb for instance 633a0bd6-3680-40d7-9e3d-224e349c0f22 on n-h2-846435-14 Jul 25 14:31:05.910434 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-1ef4c682-5068-4c39-8811-c658f3337650 req-64231a73-682b-44b1-a7ec-be293e65bfee service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079225 Jul 25 14:31:05.916835 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 748/1540] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:31:06.004961 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3e6c49e2-8329-408e-ac9a-84df74818b72 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:06.006080 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3e6c49e2-8329-408e-ac9a-84df74818b72 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] [instance: 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:06.025787 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3e6c49e2-8329-408e-ac9a-84df74818b72 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:06.026444 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3e6c49e2-8329-408e-ac9a-84df74818b72 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:06.027298 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3e6c49e2-8329-408e-ac9a-84df74818b72 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:06.027737 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3e6c49e2-8329-408e-ac9a-84df74818b72 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:06.139067 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-77151042-68fd-45b3-815b-60f179a3a130 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:06.147101 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-77151042-68fd-45b3-815b-60f179a3a130 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd" status: 200 len: 1493 microversion: 2.1 time: 0.451901 Jul 25 14:31:06.147673 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 793/1541] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:05 2022] GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd => generated 1493 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:06.300229 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=4 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:31:06.303382 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3e6c49e2-8329-408e-ac9a-84df74818b72 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef2558f586447408bbce6b9b0dcd62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced9025cae5c4c43a111119b99ae9233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:06.320609 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3e6c49e2-8329-408e-ac9a-84df74818b72 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] 10.222.0.88 "GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4" status: 200 len: 1315 microversion: 2.1 time: 0.320564 Jul 25 14:31:06.323103 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 749/1542] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:05 2022] GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:06.335245 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=14 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:31:06.407838 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9a7dbfa9-06e8-45e8-9530-a377bfa6c211 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:06.410542 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9a7dbfa9-06e8-45e8-9530-a377bfa6c211 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:06.435695 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9a7dbfa9-06e8-45e8-9530-a377bfa6c211 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:06.436364 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9a7dbfa9-06e8-45e8-9530-a377bfa6c211 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:06.436949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9a7dbfa9-06e8-45e8-9530-a377bfa6c211 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:06.437384 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9a7dbfa9-06e8-45e8-9530-a377bfa6c211 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:06.459081 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9892aec0-d782-43b3-850d-d2ebd8fb120b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:06.459754 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9892aec0-d782-43b3-850d-d2ebd8fb120b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:06.466744 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9892aec0-d782-43b3-850d-d2ebd8fb120b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:06.467086 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9892aec0-d782-43b3-850d-d2ebd8fb120b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:06.467859 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9892aec0-d782-43b3-850d-d2ebd8fb120b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:06.468310 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9892aec0-d782-43b3-850d-d2ebd8fb120b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:06.631877 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9892aec0-d782-43b3-850d-d2ebd8fb120b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:06.642850 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9892aec0-d782-43b3-850d-d2ebd8fb120b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1476 microversion: 2.1 time: 0.188210 Jul 25 14:31:06.644681 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 750/1543] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:06 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1476 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:06.660461 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-aba62865-8347-487c-af0a-168070e78f7f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:06.661539 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-aba62865-8347-487c-af0a-168070e78f7f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:06.669329 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aba62865-8347-487c-af0a-168070e78f7f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:06.670691 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aba62865-8347-487c-af0a-168070e78f7f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:06.671702 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aba62865-8347-487c-af0a-168070e78f7f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:06.672403 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aba62865-8347-487c-af0a-168070e78f7f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:06.757424 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9a7dbfa9-06e8-45e8-9530-a377bfa6c211 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd" status: 200 len: 1646 microversion: 2.1 time: 0.580387 Jul 25 14:31:06.757424 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 794/1544] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:06 2022] GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd => generated 1646 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:06.757424 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ce58ec73-3faf-4e56-81ba-27ed5ef983b9 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:06.757424 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ce58ec73-3faf-4e56-81ba-27ed5ef983b9 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 633a0bd6-3680-40d7-9e3d-224e349c0f22] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:06.760758 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce58ec73-3faf-4e56-81ba-27ed5ef983b9 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:06.761810 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce58ec73-3faf-4e56-81ba-27ed5ef983b9 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:06.762654 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce58ec73-3faf-4e56-81ba-27ed5ef983b9 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:06.763119 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce58ec73-3faf-4e56-81ba-27ed5ef983b9 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:06.782156 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-ce58ec73-3faf-4e56-81ba-27ed5ef983b9 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] HTTP exception thrown: Instance 633a0bd6-3680-40d7-9e3d-224e349c0f22 could not be found. Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ce58ec73-3faf-4e56-81ba-27ed5ef983b9 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Request method failure captured: Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22 HTTP/1.1 Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qjSWhK-vwJTt9-RUosNUl92O2IH7DXHM__YKwETUuX644ZNnaLPUYLl7n9jfiOhif_9NvqEaG0blLab1mJt658fIFOepG5Z0DCt4IZ2Chl0jBZNJNW6gm_-nwSZ3IWfSAUAPR-qkW1tUiXhGVJPIQGpNlpD2VqkHT6SMzyoZa1fOYg Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 3d71324b22554a3bb44d6aceb7bc3cbd Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d71324b22554a3bb44d6aceb7bc3cbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d71324b22554a3bb44d6aceb7bc3cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3d71324b22554a3bb44d6aceb7bc3cbd", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3d71324b22554a3bb44d6aceb7bc3cbd"}]}] Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 3d71324b22554a3bb44d6aceb7bc3cbd Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-SecurityGroupsTestJSON-81685064-project Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: b3f53d74a29243759065e68964f638dc Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-SecurityGroupsTestJSON-81685064-project Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 633a0bd6-3680-40d7-9e3d-224e349c0f22 could not be found. Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '633a0bd6-3680-40d7-9e3d-224e349c0f22'} Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 633a0bd6-3680-40d7-9e3d-224e349c0f22 could not be found. Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 633a0bd6-3680-40d7-9e3d-224e349c0f22 could not be found. Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:06.787460 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:06.798586 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:06.798586 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:06.798586 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:06.798586 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:06.798586 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:06.798586 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 633a0bd6-3680-40d7-9e3d-224e349c0f22 could not be found. Jul 25 14:31:06.798586 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:06.798586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ce58ec73-3faf-4e56-81ba-27ed5ef983b9 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Returning 404 to user: Instance 633a0bd6-3680-40d7-9e3d-224e349c0f22 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:06.798586 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ce58ec73-3faf-4e56-81ba-27ed5ef983b9 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22" status: 404 len: 111 microversion: 2.1 time: 0.036632 Jul 25 14:31:06.798586 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 795/1545] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:06 2022] GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:31:06.798586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c15dadcc-9eb0-4a69-88fb-81ec6cf96c6b tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:06.798586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c15dadcc-9eb0-4a69-88fb-81ec6cf96c6b tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:06.798586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c15dadcc-9eb0-4a69-88fb-81ec6cf96c6b tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:06.806744 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c15dadcc-9eb0-4a69-88fb-81ec6cf96c6b tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:06.806744 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c15dadcc-9eb0-4a69-88fb-81ec6cf96c6b tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:06.806744 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c15dadcc-9eb0-4a69-88fb-81ec6cf96c6b tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:06.894175 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-aba62865-8347-487c-af0a-168070e78f7f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:06.904382 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-aba62865-8347-487c-af0a-168070e78f7f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:06.907046 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-aba62865-8347-487c-af0a-168070e78f7f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:06.908513 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-aba62865-8347-487c-af0a-168070e78f7f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1814 microversion: 2.25 time: 0.262387 Jul 25 14:31:06.909416 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 751/1546] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:31:06 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1814 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:31:06.922344 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3de8f4d9-c102-4c31-9188-fc1e5572c8fa tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '.version_select at 0x7f46873b48b0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:07.015270 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c15dadcc-9eb0-4a69-88fb-81ec6cf96c6b tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd" status: 200 len: 1646 microversion: 2.1 time: 0.227831 Jul 25 14:31:07.016671 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 796/1547] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:06 2022] GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd => generated 1646 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:07.033275 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a658249d-75f0-4f1b-bae2-50b4d265da0a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:07.035840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a658249d-75f0-4f1b-bae2-50b4d265da0a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:07.049744 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a658249d-75f0-4f1b-bae2-50b4d265da0a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:07.050488 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a658249d-75f0-4f1b-bae2-50b4d265da0a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:07.052599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a658249d-75f0-4f1b-bae2-50b4d265da0a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:07.054595 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a658249d-75f0-4f1b-bae2-50b4d265da0a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:07.143725 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3de8f4d9-c102-4c31-9188-fc1e5572c8fa tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/279b61a4-5928-46e0-92b2-077efa31f9c8" status: 202 len: 0 microversion: 2.1 time: 0.233192 Jul 25 14:31:07.147446 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 752/1548] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:31:06 2022] DELETE /compute/v2.1/os-security-groups/279b61a4-5928-46e0-92b2-077efa31f9c8 => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:31:07.157969 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7dafafbb-c869-4da7-9085-3af5f02f4929 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:07.169638 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:31:07.169638 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:31:07.176908 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7dafafbb-c869-4da7-9085-3af5f02f4929 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:07.177639 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7dafafbb-c869-4da7-9085-3af5f02f4929 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:07.178714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7dafafbb-c869-4da7-9085-3af5f02f4929 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:07.182164 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7dafafbb-c869-4da7-9085-3af5f02f4929 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:07.230273 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7dafafbb-c869-4da7-9085-3af5f02f4929 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.084125 Jul 25 14:31:07.230899 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 753/1549] 10.222.0.88 () {58 vars in 1176 bytes} [Mon Jul 25 14:31:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:07.243020 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2407fbf1-dea3-4dcf-9d7c-3961f59a7704 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '.version_select at 0x7f4687332a60>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:07.310055 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a658249d-75f0-4f1b-bae2-50b4d265da0a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:07.319521 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a658249d-75f0-4f1b-bae2-50b4d265da0a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1515 microversion: 2.1 time: 0.301224 Jul 25 14:31:07.333991 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 797/1550] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:07 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1515 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:07.341156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e2d242b2-0564-4469-b931-c392ef5e88e0 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-846435-14", "block_migration": true, "disk_over_commit": false}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:07.344303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e2d242b2-0564-4469-b931-c392ef5e88e0 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:07.350678 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2d242b2-0564-4469-b931-c392ef5e88e0 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:07.351541 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2d242b2-0564-4469-b931-c392ef5e88e0 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:07.352618 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2d242b2-0564-4469-b931-c392ef5e88e0 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:07.353499 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2d242b2-0564-4469-b931-c392ef5e88e0 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:07.397806 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-e2d242b2-0564-4469-b931-c392ef5e88e0 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lazy-loading 'flavor' on Instance uuid 5694bd9c-d7e8-4f20-8404-fc5e747c93cd {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:31:07.413647 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e2d242b2-0564-4469-b931-c392ef5e88e0 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Going to try to live migrate instance to n-h1-846435-14 {{(pid=119304) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 14:31:07.488584 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2407fbf1-dea3-4dcf-9d7c-3961f59a7704 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/02f23a6f-aeb3-4b28-b7ce-602a5f13bdf9" status: 202 len: 0 microversion: 2.1 time: 0.256272 Jul 25 14:31:07.489506 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 754/1551] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:31:07 2022] DELETE /compute/v2.1/os-security-groups/02f23a6f-aeb3-4b28-b7ce-602a5f13bdf9 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:31:07.495794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8f9c3371-2034-49a9-9f24-a128331a7228 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:07.496499 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8f9c3371-2034-49a9-9f24-a128331a7228 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] [instance: 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:07.513752 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f9c3371-2034-49a9-9f24-a128331a7228 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:07.514220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f9c3371-2034-49a9-9f24-a128331a7228 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:07.515894 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f9c3371-2034-49a9-9f24-a128331a7228 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:07.516579 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f9c3371-2034-49a9-9f24-a128331a7228 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:07.709328 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8f9c3371-2034-49a9-9f24-a128331a7228 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef2558f586447408bbce6b9b0dcd62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced9025cae5c4c43a111119b99ae9233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:07.718064 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8f9c3371-2034-49a9-9f24-a128331a7228 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] 10.222.0.88 "GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4" status: 200 len: 1315 microversion: 2.1 time: 0.227319 Jul 25 14:31:07.731914 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 755/1552] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:07 2022] GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:07.737665 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5ec3c845-1ea6-4293-a5a1-90736c466f31 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Action: 'create', calling method: .version_select at 0x7f4687285af0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1882786413", "description": "tempest-description-1853341970"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:07.973691 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5ec3c845-1ea6-4293-a5a1-90736c466f31 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.239847 Jul 25 14:31:07.974481 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 756/1553] 10.222.0.88 () {60 vars in 1180 bytes} [Mon Jul 25 14:31:07 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:07.989148 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bddefecf-69e3-42df-8e24-f408ac0e1905 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:07.993677 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bddefecf-69e3-42df-8e24-f408ac0e1905 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:08.015072 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bddefecf-69e3-42df-8e24-f408ac0e1905 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:08.015535 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bddefecf-69e3-42df-8e24-f408ac0e1905 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:08.016589 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bddefecf-69e3-42df-8e24-f408ac0e1905 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:08.017040 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bddefecf-69e3-42df-8e24-f408ac0e1905 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:08.255962 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bddefecf-69e3-42df-8e24-f408ac0e1905 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:08.267071 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bddefecf-69e3-42df-8e24-f408ac0e1905 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1476 microversion: 2.1 time: 0.291446 Jul 25 14:31:08.267668 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 757/1554] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:07 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1476 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:08.278004 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5a536eec-dc1f-444f-95ca-984ab006a98b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:08.281707 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5a536eec-dc1f-444f-95ca-984ab006a98b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:08.288547 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5a536eec-dc1f-444f-95ca-984ab006a98b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:08.289556 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5a536eec-dc1f-444f-95ca-984ab006a98b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:08.290524 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5a536eec-dc1f-444f-95ca-984ab006a98b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:08.291385 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5a536eec-dc1f-444f-95ca-984ab006a98b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:08.455066 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5a536eec-dc1f-444f-95ca-984ab006a98b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:08.465034 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5a536eec-dc1f-444f-95ca-984ab006a98b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:08.467011 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5a536eec-dc1f-444f-95ca-984ab006a98b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:08.468264 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5a536eec-dc1f-444f-95ca-984ab006a98b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1814 microversion: 2.25 time: 0.196319 Jul 25 14:31:08.472187 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 758/1555] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:31:08 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1814 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:31:08.481233 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-743104a7-65fc-4ebb-8879-8087e06020ce tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Action: 'update', calling method: .version_select at 0x7f46873b7c10>, body: {"security_group": {"name": "tempest-sg-hth-1436988292", "description": "tempest-description-hth-237959634"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:08.699689 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-743104a7-65fc-4ebb-8879-8087e06020ce tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "PUT /compute/v2.1/os-security-groups/49a132ac-90c7-483a-9974-9b091a023cf6" status: 200 len: 217 microversion: 2.1 time: 0.226132 Jul 25 14:31:08.700731 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 759/1556] 10.222.0.88 () {60 vars in 1290 bytes} [Mon Jul 25 14:31:08 2022] PUT /compute/v2.1/os-security-groups/49a132ac-90c7-483a-9974-9b091a023cf6 => generated 217 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:08.705502 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-55f5c1c7-2ad3-4930-8c5f-d52fe7cc619a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:08.706120 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-55f5c1c7-2ad3-4930-8c5f-d52fe7cc619a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:08.718806 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-55f5c1c7-2ad3-4930-8c5f-d52fe7cc619a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:08.719547 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-55f5c1c7-2ad3-4930-8c5f-d52fe7cc619a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:08.733118 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-55f5c1c7-2ad3-4930-8c5f-d52fe7cc619a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:08.736861 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-55f5c1c7-2ad3-4930-8c5f-d52fe7cc619a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:08.898599 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-55f5c1c7-2ad3-4930-8c5f-d52fe7cc619a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:08.911589 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-55f5c1c7-2ad3-4930-8c5f-d52fe7cc619a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1515 microversion: 2.1 time: 0.209683 Jul 25 14:31:08.914460 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 760/1557] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:08 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1515 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:08.923668 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-235bafeb-2fc6-4efe-82f9-c0147a33cb26 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '.version_select at 0x7f46873df700>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:08.994991 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-235bafeb-2fc6-4efe-82f9-c0147a33cb26 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/os-security-groups/49a132ac-90c7-483a-9974-9b091a023cf6" status: 200 len: 217 microversion: 2.1 time: 0.078107 Jul 25 14:31:08.995935 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 761/1558] 10.222.0.88 () {58 vars in 1269 bytes} [Mon Jul 25 14:31:08 2022] GET /compute/v2.1/os-security-groups/49a132ac-90c7-483a-9974-9b091a023cf6 => generated 217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:09.004525 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-180ab7e5-5c15-4ae1-971c-5abd3817dc79 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:09.005479 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-180ab7e5-5c15-4ae1-971c-5abd3817dc79 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] [instance: 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:09.014597 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-180ab7e5-5c15-4ae1-971c-5abd3817dc79 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:09.015309 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-180ab7e5-5c15-4ae1-971c-5abd3817dc79 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:09.016304 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-180ab7e5-5c15-4ae1-971c-5abd3817dc79 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:09.016748 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-180ab7e5-5c15-4ae1-971c-5abd3817dc79 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:09.167051 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-180ab7e5-5c15-4ae1-971c-5abd3817dc79 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef2558f586447408bbce6b9b0dcd62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced9025cae5c4c43a111119b99ae9233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:09.175186 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-180ab7e5-5c15-4ae1-971c-5abd3817dc79 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] 10.222.0.88 "GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4" status: 200 len: 1315 microversion: 2.1 time: 0.177431 Jul 25 14:31:09.190492 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 762/1559] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:08 2022] GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:09.195759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5449431c-93da-4c9c-9f7a-b10867f84728 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '.version_select at 0x7f46873d9af0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:09.450914 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5449431c-93da-4c9c-9f7a-b10867f84728 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/49a132ac-90c7-483a-9974-9b091a023cf6" status: 202 len: 0 microversion: 2.1 time: 0.259139 Jul 25 14:31:09.456131 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 763/1560] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:31:09 2022] DELETE /compute/v2.1/os-security-groups/49a132ac-90c7-483a-9974-9b091a023cf6 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:31:09.461690 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-08286ad6-6954-4663-b00a-08483ce55ca2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:09.462588 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-08286ad6-6954-4663-b00a-08483ce55ca2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:09.472327 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08286ad6-6954-4663-b00a-08483ce55ca2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:09.473381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08286ad6-6954-4663-b00a-08483ce55ca2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:09.474888 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08286ad6-6954-4663-b00a-08483ce55ca2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:09.476101 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08286ad6-6954-4663-b00a-08483ce55ca2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:09.626721 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-08286ad6-6954-4663-b00a-08483ce55ca2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:09.637486 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-08286ad6-6954-4663-b00a-08483ce55ca2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1475 microversion: 2.1 time: 0.179956 Jul 25 14:31:09.649803 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 764/1561] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:09 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1475 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:09.729658 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-4757eb61-d882-4409-859d-435e1f736b2b req-96ec97c8-f3e8-4060-b082-aebf5bd8283d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a13ead5-0102-4ed4-a1d9-42414cd7ffb4", "name": "network-vif-plugged", "status": "completed", "tag": "2174faa6-514a-432a-b58b-9472df90d0a4"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:09.740024 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-4757eb61-d882-4409-859d-435e1f736b2b req-96ec97c8-f3e8-4060-b082-aebf5bd8283d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:09.740463 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-4757eb61-d882-4409-859d-435e1f736b2b req-96ec97c8-f3e8-4060-b082-aebf5bd8283d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:09.752210 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-4757eb61-d882-4409-859d-435e1f736b2b req-96ec97c8-f3e8-4060-b082-aebf5bd8283d service nova] Creating event network-vif-plugged:2174faa6-514a-432a-b58b-9472df90d0a4 for instance 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 on n-h1-846435-14 Jul 25 14:31:09.757747 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-4757eb61-d882-4409-859d-435e1f736b2b req-96ec97c8-f3e8-4060-b082-aebf5bd8283d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105887 Jul 25 14:31:09.758733 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 765/1562] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:09.764966 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9cd60d74-fd5f-4ce9-8b9d-8a8846d0f5dd tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:09.766136 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9cd60d74-fd5f-4ce9-8b9d-8a8846d0f5dd tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 633a0bd6-3680-40d7-9e3d-224e349c0f22] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:09.776534 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9cd60d74-fd5f-4ce9-8b9d-8a8846d0f5dd tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:09.777353 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9cd60d74-fd5f-4ce9-8b9d-8a8846d0f5dd tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:09.778680 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9cd60d74-fd5f-4ce9-8b9d-8a8846d0f5dd tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:09.779444 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9cd60d74-fd5f-4ce9-8b9d-8a8846d0f5dd tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:09.797088 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-9cd60d74-fd5f-4ce9-8b9d-8a8846d0f5dd tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] HTTP exception thrown: Instance 633a0bd6-3680-40d7-9e3d-224e349c0f22 could not be found. Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9cd60d74-fd5f-4ce9-8b9d-8a8846d0f5dd tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Request method failure captured: Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22 HTTP/1.1 Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qjSWhK-vwJTt9-RUosNUl92O2IH7DXHM__YKwETUuX644ZNnaLPUYLl7n9jfiOhif_9NvqEaG0blLab1mJt658fIFOepG5Z0DCt4IZ2Chl0jBZNJNW6gm_-nwSZ3IWfSAUAPR-qkW1tUiXhGVJPIQGpNlpD2VqkHT6SMzyoZa1fOYg Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 3d71324b22554a3bb44d6aceb7bc3cbd Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d71324b22554a3bb44d6aceb7bc3cbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d71324b22554a3bb44d6aceb7bc3cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3d71324b22554a3bb44d6aceb7bc3cbd", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3d71324b22554a3bb44d6aceb7bc3cbd"}]}] Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 3d71324b22554a3bb44d6aceb7bc3cbd Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-SecurityGroupsTestJSON-81685064-project Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: b3f53d74a29243759065e68964f638dc Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-SecurityGroupsTestJSON-81685064-project Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 633a0bd6-3680-40d7-9e3d-224e349c0f22 could not be found. Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '633a0bd6-3680-40d7-9e3d-224e349c0f22'} Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 633a0bd6-3680-40d7-9e3d-224e349c0f22 could not be found. Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:31:09.799242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:31:09.804985 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 633a0bd6-3680-40d7-9e3d-224e349c0f22 could not be found. Jul 25 14:31:09.804985 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:09.804985 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:09.804985 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:09.804985 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:09.804985 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:09.804985 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:09.804985 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:09.804985 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:09.804985 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 633a0bd6-3680-40d7-9e3d-224e349c0f22 could not be found. Jul 25 14:31:09.804985 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:09.804985 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9cd60d74-fd5f-4ce9-8b9d-8a8846d0f5dd tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Returning 404 to user: Instance 633a0bd6-3680-40d7-9e3d-224e349c0f22 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:09.804985 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9cd60d74-fd5f-4ce9-8b9d-8a8846d0f5dd tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "DELETE /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22" status: 404 len: 111 microversion: 2.1 time: 0.040833 Jul 25 14:31:09.804985 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 766/1563] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:31:09 2022] DELETE /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:31:09.809918 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9d235e06-db27-4c80-8371-ce8af9199f91 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:09.811333 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9d235e06-db27-4c80-8371-ce8af9199f91 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:09.817920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d235e06-db27-4c80-8371-ce8af9199f91 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:09.818372 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d235e06-db27-4c80-8371-ce8af9199f91 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:09.819338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d235e06-db27-4c80-8371-ce8af9199f91 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:09.819853 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d235e06-db27-4c80-8371-ce8af9199f91 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:10.037424 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9d235e06-db27-4c80-8371-ce8af9199f91 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:10.050123 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9d235e06-db27-4c80-8371-ce8af9199f91 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:10.052220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9d235e06-db27-4c80-8371-ce8af9199f91 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:10.053509 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9d235e06-db27-4c80-8371-ce8af9199f91 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1814 microversion: 2.25 time: 0.247822 Jul 25 14:31:10.069196 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 767/1564] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:31:09 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1814 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:31:10.076272 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-947b79e1-ee7b-47a6-a0a3-3a6472d81599 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:10.077220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-947b79e1-ee7b-47a6-a0a3-3a6472d81599 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 633a0bd6-3680-40d7-9e3d-224e349c0f22] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:10.079749 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e2d242b2-0564-4469-b931-c392ef5e88e0 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd/action" status: 202 len: 0 microversion: 2.1 time: 2.743911 Jul 25 14:31:10.081339 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 798/1565] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:31:07 2022] POST /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd/action => generated 0 bytes in 2746 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:31:10.086030 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-947b79e1-ee7b-47a6-a0a3-3a6472d81599 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:10.086902 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-947b79e1-ee7b-47a6-a0a3-3a6472d81599 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:10.087872 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-947b79e1-ee7b-47a6-a0a3-3a6472d81599 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:10.088499 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-947b79e1-ee7b-47a6-a0a3-3a6472d81599 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:10.089111 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-50cb0432-5611-49f1-b17f-65c5af090004 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:10.090370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-50cb0432-5611-49f1-b17f-65c5af090004 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:10.099585 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50cb0432-5611-49f1-b17f-65c5af090004 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:10.100174 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50cb0432-5611-49f1-b17f-65c5af090004 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:10.101407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50cb0432-5611-49f1-b17f-65c5af090004 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:10.101921 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50cb0432-5611-49f1-b17f-65c5af090004 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:10.106567 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-947b79e1-ee7b-47a6-a0a3-3a6472d81599 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] HTTP exception thrown: Instance 633a0bd6-3680-40d7-9e3d-224e349c0f22 could not be found. Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-947b79e1-ee7b-47a6-a0a3-3a6472d81599 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Request method failure captured: Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22 HTTP/1.1 Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qjSWhK-vwJTt9-RUosNUl92O2IH7DXHM__YKwETUuX644ZNnaLPUYLl7n9jfiOhif_9NvqEaG0blLab1mJt658fIFOepG5Z0DCt4IZ2Chl0jBZNJNW6gm_-nwSZ3IWfSAUAPR-qkW1tUiXhGVJPIQGpNlpD2VqkHT6SMzyoZa1fOYg Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 3d71324b22554a3bb44d6aceb7bc3cbd Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d71324b22554a3bb44d6aceb7bc3cbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d71324b22554a3bb44d6aceb7bc3cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3d71324b22554a3bb44d6aceb7bc3cbd", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3d71324b22554a3bb44d6aceb7bc3cbd"}]}] Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 3d71324b22554a3bb44d6aceb7bc3cbd Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-SecurityGroupsTestJSON-81685064-project Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: b3f53d74a29243759065e68964f638dc Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-SecurityGroupsTestJSON-81685064-project Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 633a0bd6-3680-40d7-9e3d-224e349c0f22 could not be found. Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '633a0bd6-3680-40d7-9e3d-224e349c0f22'} Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 633a0bd6-3680-40d7-9e3d-224e349c0f22 could not be found. Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 633a0bd6-3680-40d7-9e3d-224e349c0f22 could not be found. Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:10.108580 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:10.113527 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:10.113527 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:10.113527 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:10.113527 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:10.113527 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:10.113527 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 633a0bd6-3680-40d7-9e3d-224e349c0f22 could not be found. Jul 25 14:31:10.113527 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:10.115110 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-947b79e1-ee7b-47a6-a0a3-3a6472d81599 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Returning 404 to user: Instance 633a0bd6-3680-40d7-9e3d-224e349c0f22 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:10.116314 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-947b79e1-ee7b-47a6-a0a3-3a6472d81599 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22" status: 404 len: 111 microversion: 2.1 time: 0.045762 Jul 25 14:31:10.120526 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 768/1566] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:10 2022] GET /compute/v2.1/servers/633a0bd6-3680-40d7-9e3d-224e349c0f22 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:31:10.128081 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-bd7b5b6e-c06d-4ce1-b938-96c2af6dfd2e req-e8865271-0795-4dab-98fd-40bdf528cba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "115f3b11-988d-43c1-a81f-998139d12448", "name": "network-vif-unplugged", "status": "completed", "tag": "f9ae53b2-7ccb-46f9-b164-3d57e251cc2f"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:10.149106 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-bd7b5b6e-c06d-4ce1-b938-96c2af6dfd2e req-e8865271-0795-4dab-98fd-40bdf528cba5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:10.155749 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-bd7b5b6e-c06d-4ce1-b938-96c2af6dfd2e req-e8865271-0795-4dab-98fd-40bdf528cba5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:10.177659 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-bd7b5b6e-c06d-4ce1-b938-96c2af6dfd2e req-e8865271-0795-4dab-98fd-40bdf528cba5 service nova] Creating event network-vif-unplugged:f9ae53b2-7ccb-46f9-b164-3d57e251cc2f for instance 115f3b11-988d-43c1-a81f-998139d12448 on n-h1-846435-14 Jul 25 14:31:10.186497 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [req-bd7b5b6e-c06d-4ce1-b938-96c2af6dfd2e req-e8865271-0795-4dab-98fd-40bdf528cba5 service nova] Instance 115f3b11-988d-43c1-a81f-998139d12448 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119303) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 14:31:10.199012 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-bd7b5b6e-c06d-4ce1-b938-96c2af6dfd2e req-e8865271-0795-4dab-98fd-40bdf528cba5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075695 Jul 25 14:31:10.200270 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 769/1567] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:10.208017 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e4171c1e-2450-4a9b-a74b-26be903dcb1c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:10.208931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e4171c1e-2450-4a9b-a74b-26be903dcb1c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:10.219417 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e4171c1e-2450-4a9b-a74b-26be903dcb1c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:10.220244 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e4171c1e-2450-4a9b-a74b-26be903dcb1c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:10.221496 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e4171c1e-2450-4a9b-a74b-26be903dcb1c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:10.222272 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e4171c1e-2450-4a9b-a74b-26be903dcb1c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:10.493027 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-50cb0432-5611-49f1-b17f-65c5af090004 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:10.506349 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-50cb0432-5611-49f1-b17f-65c5af090004 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1515 microversion: 2.1 time: 0.422888 Jul 25 14:31:10.507665 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 799/1568] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:10 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1515 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:10.516522 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5f73be06-5e91-4aa2-964b-c7426996bb52 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '.version_select at 0x7f46878f15e0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:10.573152 n-d-846435-14 devstack@n-api.service[119304]: DEBUG neutronclient.v2_0.client [None req-5f73be06-5e91-4aa2-964b-c7426996bb52 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 02f23a6f-aeb3-4b28-b7ce-602a5f13bdf9 does not exist", "detail": ""}} {{(pid=119304) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 14:31:10.574252 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.security_group_api [None req-5f73be06-5e91-4aa2-964b-c7426996bb52 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Neutron security group 02f23a6f-aeb3-4b28-b7ce-602a5f13bdf9 not found {{(pid=119304) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 14:31:10.575906 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-5f73be06-5e91-4aa2-964b-c7426996bb52 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] HTTP exception thrown: Security group 02f23a6f-aeb3-4b28-b7ce-602a5f13bdf9 does not exist Jul 25 14:31:10.575906 n-d-846435-14 devstack@n-api.service[119304]: Neutron server returns request_ids: ['req-0c846bb7-c359-4741-a47a-7f7d5b2086da'] Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5f73be06-5e91-4aa2-964b-c7426996bb52 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Request method failure captured: Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/os-security-groups/02f23a6f-aeb3-4b28-b7ce-602a5f13bdf9 HTTP/1.1 Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qjSWhK-vwJTt9-RUosNUl92O2IH7DXHM__YKwETUuX644ZNnaLPUYLl7n9jfiOhif_9NvqEaG0blLab1mJt658fIFOepG5Z0DCt4IZ2Chl0jBZNJNW6gm_-nwSZ3IWfSAUAPR-qkW1tUiXhGVJPIQGpNlpD2VqkHT6SMzyoZa1fOYg Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 3d71324b22554a3bb44d6aceb7bc3cbd Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d71324b22554a3bb44d6aceb7bc3cbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d71324b22554a3bb44d6aceb7bc3cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3d71324b22554a3bb44d6aceb7bc3cbd", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3d71324b22554a3bb44d6aceb7bc3cbd"}]}] Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 3d71324b22554a3bb44d6aceb7bc3cbd Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-SecurityGroupsTestJSON-81685064-project Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: b3f53d74a29243759065e68964f638dc Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-SecurityGroupsTestJSON-81685064-project Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: exception: Security group 02f23a6f-aeb3-4b28-b7ce-602a5f13bdf9 does not exist Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: Neutron server returns request_ids: ['req-0c846bb7-c359-4741-a47a-7f7d5b2086da'] Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '02f23a6f-aeb3-4b28-b7ce-602a5f13bdf9'} Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 14:31:10.578191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 02f23a6f-aeb3-4b28-b7ce-602a5f13bdf9 does not exist Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c846bb7-c359-4741-a47a-7f7d5b2086da'] Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 02f23a6f-aeb3-4b28-b7ce-602a5f13bdf9 does not exist Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c846bb7-c359-4741-a47a-7f7d5b2086da'] Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 02f23a6f-aeb3-4b28-b7ce-602a5f13bdf9 does not exist Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c846bb7-c359-4741-a47a-7f7d5b2086da'] Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 02f23a6f-aeb3-4b28-b7ce-602a5f13bdf9 does not exist Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c846bb7-c359-4741-a47a-7f7d5b2086da'] Jul 25 14:31:10.582205 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:10.588474 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5f73be06-5e91-4aa2-964b-c7426996bb52 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Returning 404 to user: Security group 02f23a6f-aeb3-4b28-b7ce-602a5f13bdf9 does not exist Jul 25 14:31:10.588474 n-d-846435-14 devstack@n-api.service[119304]: Neutron server returns request_ids: ['req-0c846bb7-c359-4741-a47a-7f7d5b2086da'] {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:10.588474 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5f73be06-5e91-4aa2-964b-c7426996bb52 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/02f23a6f-aeb3-4b28-b7ce-602a5f13bdf9" status: 404 len: 194 microversion: 2.1 time: 0.075607 Jul 25 14:31:10.588474 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 800/1569] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:31:10 2022] DELETE /compute/v2.1/os-security-groups/02f23a6f-aeb3-4b28-b7ce-602a5f13bdf9 => generated 194 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:31:10.595950 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7773ef36-d258-436e-82a5-96ba7a6dc53c tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:10.602308 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7773ef36-d258-436e-82a5-96ba7a6dc53c tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] [instance: 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:10.613524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7773ef36-d258-436e-82a5-96ba7a6dc53c tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:10.613982 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7773ef36-d258-436e-82a5-96ba7a6dc53c tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:10.614762 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7773ef36-d258-436e-82a5-96ba7a6dc53c tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:10.615494 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7773ef36-d258-436e-82a5-96ba7a6dc53c tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:10.841541 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e4171c1e-2450-4a9b-a74b-26be903dcb1c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:10.851783 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e4171c1e-2450-4a9b-a74b-26be903dcb1c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd" status: 200 len: 1503 microversion: 2.1 time: 0.650045 Jul 25 14:31:10.852442 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 770/1570] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:10 2022] GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd => generated 1503 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:10.857301 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7fb59383-888a-47d7-b437-fc3a4e728734 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '.version_select at 0x7f46873b4dc0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:10.868610 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7773ef36-d258-436e-82a5-96ba7a6dc53c tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef2558f586447408bbce6b9b0dcd62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced9025cae5c4c43a111119b99ae9233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:10.906896 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7773ef36-d258-436e-82a5-96ba7a6dc53c tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] 10.222.0.88 "GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4" status: 200 len: 1315 microversion: 2.1 time: 0.312588 Jul 25 14:31:10.908570 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 801/1571] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:10 2022] GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:10.916394 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8c0ada4a-806f-4579-b4b2-9ca67b27b2cb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:10.923421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8c0ada4a-806f-4579-b4b2-9ca67b27b2cb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:10.941077 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8c0ada4a-806f-4579-b4b2-9ca67b27b2cb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:10.941544 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8c0ada4a-806f-4579-b4b2-9ca67b27b2cb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:10.942351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8c0ada4a-806f-4579-b4b2-9ca67b27b2cb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:10.942790 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8c0ada4a-806f-4579-b4b2-9ca67b27b2cb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:10.990072 n-d-846435-14 devstack@n-api.service[119303]: DEBUG neutronclient.v2_0.client [None req-7fb59383-888a-47d7-b437-fc3a4e728734 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 279b61a4-5928-46e0-92b2-077efa31f9c8 does not exist", "detail": ""}} {{(pid=119303) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 14:31:10.990703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.security_group_api [None req-7fb59383-888a-47d7-b437-fc3a4e728734 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Neutron security group 279b61a4-5928-46e0-92b2-077efa31f9c8 not found {{(pid=119303) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 14:31:10.991240 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-7fb59383-888a-47d7-b437-fc3a4e728734 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] HTTP exception thrown: Security group 279b61a4-5928-46e0-92b2-077efa31f9c8 does not exist Jul 25 14:31:10.991240 n-d-846435-14 devstack@n-api.service[119303]: Neutron server returns request_ids: ['req-0fed862b-a048-4e59-97dd-f859357a0b54'] Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7fb59383-888a-47d7-b437-fc3a4e728734 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Request method failure captured: Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/os-security-groups/279b61a4-5928-46e0-92b2-077efa31f9c8 HTTP/1.1 Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qjSWhK-vwJTt9-RUosNUl92O2IH7DXHM__YKwETUuX644ZNnaLPUYLl7n9jfiOhif_9NvqEaG0blLab1mJt658fIFOepG5Z0DCt4IZ2Chl0jBZNJNW6gm_-nwSZ3IWfSAUAPR-qkW1tUiXhGVJPIQGpNlpD2VqkHT6SMzyoZa1fOYg Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 3d71324b22554a3bb44d6aceb7bc3cbd Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d71324b22554a3bb44d6aceb7bc3cbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d71324b22554a3bb44d6aceb7bc3cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3d71324b22554a3bb44d6aceb7bc3cbd", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3d71324b22554a3bb44d6aceb7bc3cbd"}]}] Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 3d71324b22554a3bb44d6aceb7bc3cbd Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-SecurityGroupsTestJSON-81685064-project Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: b3f53d74a29243759065e68964f638dc Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-SecurityGroupsTestJSON-81685064-project Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: exception: Security group 279b61a4-5928-46e0-92b2-077efa31f9c8 does not exist Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: Neutron server returns request_ids: ['req-0fed862b-a048-4e59-97dd-f859357a0b54'] Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '279b61a4-5928-46e0-92b2-077efa31f9c8'} Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 14:31:10.993237 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 279b61a4-5928-46e0-92b2-077efa31f9c8 does not exist Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0fed862b-a048-4e59-97dd-f859357a0b54'] Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 279b61a4-5928-46e0-92b2-077efa31f9c8 does not exist Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0fed862b-a048-4e59-97dd-f859357a0b54'] Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 279b61a4-5928-46e0-92b2-077efa31f9c8 does not exist Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0fed862b-a048-4e59-97dd-f859357a0b54'] Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 279b61a4-5928-46e0-92b2-077efa31f9c8 does not exist Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0fed862b-a048-4e59-97dd-f859357a0b54'] Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7fb59383-888a-47d7-b437-fc3a4e728734 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Returning 404 to user: Security group 279b61a4-5928-46e0-92b2-077efa31f9c8 does not exist Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: Neutron server returns request_ids: ['req-0fed862b-a048-4e59-97dd-f859357a0b54'] {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7fb59383-888a-47d7-b437-fc3a4e728734 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/279b61a4-5928-46e0-92b2-077efa31f9c8" status: 404 len: 194 microversion: 2.1 time: 0.141243 Jul 25 14:31:10.998660 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 771/1572] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:31:10 2022] DELETE /compute/v2.1/os-security-groups/279b61a4-5928-46e0-92b2-077efa31f9c8 => generated 194 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:31:11.003632 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-80fa8168-60bc-4632-9bb1-6d12fcd30b77 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '.version_select at 0x7f4687257b80>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:11.054736 n-d-846435-14 devstack@n-api.service[119303]: DEBUG neutronclient.v2_0.client [None req-80fa8168-60bc-4632-9bb1-6d12fcd30b77 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1752a74f-9a98-4cbb-8fdc-d39eb3c577dd does not exist", "detail": ""}} {{(pid=119303) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 14:31:11.055348 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.security_group_api [None req-80fa8168-60bc-4632-9bb1-6d12fcd30b77 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Neutron security group 1752a74f-9a98-4cbb-8fdc-d39eb3c577dd not found {{(pid=119303) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 14:31:11.055875 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-80fa8168-60bc-4632-9bb1-6d12fcd30b77 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] HTTP exception thrown: Security group 1752a74f-9a98-4cbb-8fdc-d39eb3c577dd does not exist Jul 25 14:31:11.055875 n-d-846435-14 devstack@n-api.service[119303]: Neutron server returns request_ids: ['req-46896e4f-6dfb-40f5-b285-e5f518a127ed'] Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-80fa8168-60bc-4632-9bb1-6d12fcd30b77 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Request method failure captured: Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/os-security-groups/1752a74f-9a98-4cbb-8fdc-d39eb3c577dd HTTP/1.1 Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qjSWhK-vwJTt9-RUosNUl92O2IH7DXHM__YKwETUuX644ZNnaLPUYLl7n9jfiOhif_9NvqEaG0blLab1mJt658fIFOepG5Z0DCt4IZ2Chl0jBZNJNW6gm_-nwSZ3IWfSAUAPR-qkW1tUiXhGVJPIQGpNlpD2VqkHT6SMzyoZa1fOYg Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 3d71324b22554a3bb44d6aceb7bc3cbd Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d71324b22554a3bb44d6aceb7bc3cbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d71324b22554a3bb44d6aceb7bc3cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3d71324b22554a3bb44d6aceb7bc3cbd", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3d71324b22554a3bb44d6aceb7bc3cbd"}]}] Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 3d71324b22554a3bb44d6aceb7bc3cbd Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-SecurityGroupsTestJSON-81685064-project Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: b3f53d74a29243759065e68964f638dc Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-SecurityGroupsTestJSON-81685064-project Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: exception: Security group 1752a74f-9a98-4cbb-8fdc-d39eb3c577dd does not exist Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: Neutron server returns request_ids: ['req-46896e4f-6dfb-40f5-b285-e5f518a127ed'] Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '1752a74f-9a98-4cbb-8fdc-d39eb3c577dd'} Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 14:31:11.058506 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1752a74f-9a98-4cbb-8fdc-d39eb3c577dd does not exist Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46896e4f-6dfb-40f5-b285-e5f518a127ed'] Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1752a74f-9a98-4cbb-8fdc-d39eb3c577dd does not exist Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46896e4f-6dfb-40f5-b285-e5f518a127ed'] Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1752a74f-9a98-4cbb-8fdc-d39eb3c577dd does not exist Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46896e4f-6dfb-40f5-b285-e5f518a127ed'] Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1752a74f-9a98-4cbb-8fdc-d39eb3c577dd does not exist Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46896e4f-6dfb-40f5-b285-e5f518a127ed'] Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-80fa8168-60bc-4632-9bb1-6d12fcd30b77 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Returning 404 to user: Security group 1752a74f-9a98-4cbb-8fdc-d39eb3c577dd does not exist Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: Neutron server returns request_ids: ['req-46896e4f-6dfb-40f5-b285-e5f518a127ed'] {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-80fa8168-60bc-4632-9bb1-6d12fcd30b77 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/1752a74f-9a98-4cbb-8fdc-d39eb3c577dd" status: 404 len: 194 microversion: 2.1 time: 0.060557 Jul 25 14:31:11.062559 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 772/1573] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:31:10 2022] DELETE /compute/v2.1/os-security-groups/1752a74f-9a98-4cbb-8fdc-d39eb3c577dd => generated 194 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:31:11.072511 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-179fa7e3-ce26-421b-b46c-9b430697e03b tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '.version_select at 0x7f46872c0820>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:11.148288 n-d-846435-14 devstack@n-api.service[119303]: DEBUG neutronclient.v2_0.client [None req-179fa7e3-ce26-421b-b46c-9b430697e03b tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 22459124-2478-44f8-85a5-493b28676f28 does not exist", "detail": ""}} {{(pid=119303) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 14:31:11.149180 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.security_group_api [None req-179fa7e3-ce26-421b-b46c-9b430697e03b tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Neutron security group 22459124-2478-44f8-85a5-493b28676f28 not found {{(pid=119303) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 14:31:11.149908 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-179fa7e3-ce26-421b-b46c-9b430697e03b tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] HTTP exception thrown: Security group 22459124-2478-44f8-85a5-493b28676f28 does not exist Jul 25 14:31:11.149908 n-d-846435-14 devstack@n-api.service[119303]: Neutron server returns request_ids: ['req-8904e823-94b2-41c9-bbc4-070d95ce5314'] Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-179fa7e3-ce26-421b-b46c-9b430697e03b tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Request method failure captured: Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/os-security-groups/22459124-2478-44f8-85a5-493b28676f28 HTTP/1.1 Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qjSWhK-vwJTt9-RUosNUl92O2IH7DXHM__YKwETUuX644ZNnaLPUYLl7n9jfiOhif_9NvqEaG0blLab1mJt658fIFOepG5Z0DCt4IZ2Chl0jBZNJNW6gm_-nwSZ3IWfSAUAPR-qkW1tUiXhGVJPIQGpNlpD2VqkHT6SMzyoZa1fOYg Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 3d71324b22554a3bb44d6aceb7bc3cbd Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d71324b22554a3bb44d6aceb7bc3cbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d71324b22554a3bb44d6aceb7bc3cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3d71324b22554a3bb44d6aceb7bc3cbd", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3d71324b22554a3bb44d6aceb7bc3cbd"}]}] Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 3d71324b22554a3bb44d6aceb7bc3cbd Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-SecurityGroupsTestJSON-81685064-project Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: b3f53d74a29243759065e68964f638dc Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-SecurityGroupsTestJSON-81685064-project Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: exception: Security group 22459124-2478-44f8-85a5-493b28676f28 does not exist Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: Neutron server returns request_ids: ['req-8904e823-94b2-41c9-bbc4-070d95ce5314'] Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '22459124-2478-44f8-85a5-493b28676f28'} Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 14:31:11.152066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 22459124-2478-44f8-85a5-493b28676f28 does not exist Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8904e823-94b2-41c9-bbc4-070d95ce5314'] Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 22459124-2478-44f8-85a5-493b28676f28 does not exist Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8904e823-94b2-41c9-bbc4-070d95ce5314'] Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 22459124-2478-44f8-85a5-493b28676f28 does not exist Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8904e823-94b2-41c9-bbc4-070d95ce5314'] Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 22459124-2478-44f8-85a5-493b28676f28 does not exist Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8904e823-94b2-41c9-bbc4-070d95ce5314'] Jul 25 14:31:11.156047 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:11.160614 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-179fa7e3-ce26-421b-b46c-9b430697e03b tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Returning 404 to user: Security group 22459124-2478-44f8-85a5-493b28676f28 does not exist Jul 25 14:31:11.160614 n-d-846435-14 devstack@n-api.service[119303]: Neutron server returns request_ids: ['req-8904e823-94b2-41c9-bbc4-070d95ce5314'] {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:11.161842 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-179fa7e3-ce26-421b-b46c-9b430697e03b tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/22459124-2478-44f8-85a5-493b28676f28" status: 404 len: 194 microversion: 2.1 time: 0.097007 Jul 25 14:31:11.162948 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 773/1574] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:31:11 2022] DELETE /compute/v2.1/os-security-groups/22459124-2478-44f8-85a5-493b28676f28 => generated 194 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:31:11.169270 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a4e440cd-b068-499a-b3d6-abbec165648c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:11.170235 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a4e440cd-b068-499a-b3d6-abbec165648c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:11.179042 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a4e440cd-b068-499a-b3d6-abbec165648c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:11.179857 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a4e440cd-b068-499a-b3d6-abbec165648c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:11.181371 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a4e440cd-b068-499a-b3d6-abbec165648c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:11.182055 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a4e440cd-b068-499a-b3d6-abbec165648c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:11.207397 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:31:11.217467 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8c0ada4a-806f-4579-b4b2-9ca67b27b2cb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:11.227550 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8c0ada4a-806f-4579-b4b2-9ca67b27b2cb tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1475 microversion: 2.1 time: 0.315442 Jul 25 14:31:11.229404 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 802/1575] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:10 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1475 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:11.234283 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d941a9d8-6d06-4f01-a0bc-cbd5afff8d7d tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '.version_select at 0x7f46879245e0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:11.259355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG neutronclient.v2_0.client [None req-d941a9d8-6d06-4f01-a0bc-cbd5afff8d7d tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a8ef04a7-41b3-4c47-a896-a85c4bae6354 does not exist", "detail": ""}} {{(pid=119304) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 14:31:11.260232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.security_group_api [None req-d941a9d8-6d06-4f01-a0bc-cbd5afff8d7d tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Neutron security group a8ef04a7-41b3-4c47-a896-a85c4bae6354 not found {{(pid=119304) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 14:31:11.260867 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-d941a9d8-6d06-4f01-a0bc-cbd5afff8d7d tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] HTTP exception thrown: Security group a8ef04a7-41b3-4c47-a896-a85c4bae6354 does not exist Jul 25 14:31:11.260867 n-d-846435-14 devstack@n-api.service[119304]: Neutron server returns request_ids: ['req-d3435210-8915-4bd3-abbb-8725bf5c8498'] Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d941a9d8-6d06-4f01-a0bc-cbd5afff8d7d tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Request method failure captured: Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/os-security-groups/a8ef04a7-41b3-4c47-a896-a85c4bae6354 HTTP/1.1 Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qjSWhK-vwJTt9-RUosNUl92O2IH7DXHM__YKwETUuX644ZNnaLPUYLl7n9jfiOhif_9NvqEaG0blLab1mJt658fIFOepG5Z0DCt4IZ2Chl0jBZNJNW6gm_-nwSZ3IWfSAUAPR-qkW1tUiXhGVJPIQGpNlpD2VqkHT6SMzyoZa1fOYg Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 3d71324b22554a3bb44d6aceb7bc3cbd Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d71324b22554a3bb44d6aceb7bc3cbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d71324b22554a3bb44d6aceb7bc3cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3d71324b22554a3bb44d6aceb7bc3cbd", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3d71324b22554a3bb44d6aceb7bc3cbd"}]}] Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 3d71324b22554a3bb44d6aceb7bc3cbd Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-SecurityGroupsTestJSON-81685064-project Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: b3f53d74a29243759065e68964f638dc Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-SecurityGroupsTestJSON-81685064-project Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: exception: Security group a8ef04a7-41b3-4c47-a896-a85c4bae6354 does not exist Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: Neutron server returns request_ids: ['req-d3435210-8915-4bd3-abbb-8725bf5c8498'] Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'a8ef04a7-41b3-4c47-a896-a85c4bae6354'} Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 14:31:11.262952 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a8ef04a7-41b3-4c47-a896-a85c4bae6354 does not exist Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d3435210-8915-4bd3-abbb-8725bf5c8498'] Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a8ef04a7-41b3-4c47-a896-a85c4bae6354 does not exist Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d3435210-8915-4bd3-abbb-8725bf5c8498'] Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a8ef04a7-41b3-4c47-a896-a85c4bae6354 does not exist Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d3435210-8915-4bd3-abbb-8725bf5c8498'] Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a8ef04a7-41b3-4c47-a896-a85c4bae6354 does not exist Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d3435210-8915-4bd3-abbb-8725bf5c8498'] Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d941a9d8-6d06-4f01-a0bc-cbd5afff8d7d tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Returning 404 to user: Security group a8ef04a7-41b3-4c47-a896-a85c4bae6354 does not exist Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: Neutron server returns request_ids: ['req-d3435210-8915-4bd3-abbb-8725bf5c8498'] {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d941a9d8-6d06-4f01-a0bc-cbd5afff8d7d tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/a8ef04a7-41b3-4c47-a896-a85c4bae6354" status: 404 len: 194 microversion: 2.1 time: 0.036051 Jul 25 14:31:11.268129 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 803/1576] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:31:11 2022] DELETE /compute/v2.1/os-security-groups/a8ef04a7-41b3-4c47-a896-a85c4bae6354 => generated 194 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:31:11.281024 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-237aa627-4f62-4755-9dc8-f0034b0a42d8 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '.version_select at 0x7f468783c550>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:11.338292 n-d-846435-14 devstack@n-api.service[119304]: DEBUG neutronclient.v2_0.client [None req-237aa627-4f62-4755-9dc8-f0034b0a42d8 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 34aa7d87-a034-4b40-9710-f082386b4905 does not exist", "detail": ""}} {{(pid=119304) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 14:31:11.341024 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.security_group_api [None req-237aa627-4f62-4755-9dc8-f0034b0a42d8 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Neutron security group 34aa7d87-a034-4b40-9710-f082386b4905 not found {{(pid=119304) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 14:31:11.342044 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-237aa627-4f62-4755-9dc8-f0034b0a42d8 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] HTTP exception thrown: Security group 34aa7d87-a034-4b40-9710-f082386b4905 does not exist Jul 25 14:31:11.342044 n-d-846435-14 devstack@n-api.service[119304]: Neutron server returns request_ids: ['req-4524996d-d57a-415b-93a2-c1ad7950ec58'] Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-237aa627-4f62-4755-9dc8-f0034b0a42d8 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Request method failure captured: Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/os-security-groups/34aa7d87-a034-4b40-9710-f082386b4905 HTTP/1.1 Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qjSWhK-vwJTt9-RUosNUl92O2IH7DXHM__YKwETUuX644ZNnaLPUYLl7n9jfiOhif_9NvqEaG0blLab1mJt658fIFOepG5Z0DCt4IZ2Chl0jBZNJNW6gm_-nwSZ3IWfSAUAPR-qkW1tUiXhGVJPIQGpNlpD2VqkHT6SMzyoZa1fOYg Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 3d71324b22554a3bb44d6aceb7bc3cbd Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d71324b22554a3bb44d6aceb7bc3cbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d71324b22554a3bb44d6aceb7bc3cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3d71324b22554a3bb44d6aceb7bc3cbd", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3d71324b22554a3bb44d6aceb7bc3cbd"}]}] Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 3d71324b22554a3bb44d6aceb7bc3cbd Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-SecurityGroupsTestJSON-81685064-project Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: b3f53d74a29243759065e68964f638dc Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-SecurityGroupsTestJSON-81685064-project Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: exception: Security group 34aa7d87-a034-4b40-9710-f082386b4905 does not exist Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: Neutron server returns request_ids: ['req-4524996d-d57a-415b-93a2-c1ad7950ec58'] Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '34aa7d87-a034-4b40-9710-f082386b4905'} Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 14:31:11.346443 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 34aa7d87-a034-4b40-9710-f082386b4905 does not exist Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4524996d-d57a-415b-93a2-c1ad7950ec58'] Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 34aa7d87-a034-4b40-9710-f082386b4905 does not exist Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4524996d-d57a-415b-93a2-c1ad7950ec58'] Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 34aa7d87-a034-4b40-9710-f082386b4905 does not exist Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4524996d-d57a-415b-93a2-c1ad7950ec58'] Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 34aa7d87-a034-4b40-9710-f082386b4905 does not exist Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4524996d-d57a-415b-93a2-c1ad7950ec58'] Jul 25 14:31:11.352352 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:11.361416 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-237aa627-4f62-4755-9dc8-f0034b0a42d8 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Returning 404 to user: Security group 34aa7d87-a034-4b40-9710-f082386b4905 does not exist Jul 25 14:31:11.361416 n-d-846435-14 devstack@n-api.service[119304]: Neutron server returns request_ids: ['req-4524996d-d57a-415b-93a2-c1ad7950ec58'] {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:11.362544 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-237aa627-4f62-4755-9dc8-f0034b0a42d8 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/34aa7d87-a034-4b40-9710-f082386b4905" status: 404 len: 194 microversion: 2.1 time: 0.091110 Jul 25 14:31:11.368245 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 804/1577] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:31:11 2022] DELETE /compute/v2.1/os-security-groups/34aa7d87-a034-4b40-9710-f082386b4905 => generated 194 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:31:11.379429 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fe9750f3-18ef-421f-874d-55e9acf217e9 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:11.380219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fe9750f3-18ef-421f-874d-55e9acf217e9 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 74d6eac5-76ed-47bb-8e15-d6dea0e5618e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:11.392203 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fe9750f3-18ef-421f-874d-55e9acf217e9 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:11.392767 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fe9750f3-18ef-421f-874d-55e9acf217e9 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:11.393835 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fe9750f3-18ef-421f-874d-55e9acf217e9 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:11.394276 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fe9750f3-18ef-421f-874d-55e9acf217e9 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:11.428203 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fe9750f3-18ef-421f-874d-55e9acf217e9 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 74d6eac5-76ed-47bb-8e15-d6dea0e5618e] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:31:11.590747 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fe9750f3-18ef-421f-874d-55e9acf217e9 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "DELETE /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e" status: 204 len: 0 microversion: 2.1 time: 0.218710 Jul 25 14:31:11.598280 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 805/1578] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:31:11 2022] DELETE /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:31:11.606202 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7c25a76d-e1ce-4aa8-8eeb-4f566768bb19 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:11.607140 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7c25a76d-e1ce-4aa8-8eeb-4f566768bb19 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:11.615123 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7c25a76d-e1ce-4aa8-8eeb-4f566768bb19 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:11.615877 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7c25a76d-e1ce-4aa8-8eeb-4f566768bb19 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:11.616865 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7c25a76d-e1ce-4aa8-8eeb-4f566768bb19 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:11.617472 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7c25a76d-e1ce-4aa8-8eeb-4f566768bb19 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:11.643861 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a4e440cd-b068-499a-b3d6-abbec165648c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:11.652209 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:31:11.659221 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a4e440cd-b068-499a-b3d6-abbec165648c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:11.661049 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a4e440cd-b068-499a-b3d6-abbec165648c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:11.662285 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a4e440cd-b068-499a-b3d6-abbec165648c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1814 microversion: 2.25 time: 0.498153 Jul 25 14:31:11.673136 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 774/1579] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:31:11 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1814 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:31:11.679855 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e617f106-7297-470b-8c44-0d340ff8e5b2 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:11.680855 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e617f106-7297-470b-8c44-0d340ff8e5b2 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 74d6eac5-76ed-47bb-8e15-d6dea0e5618e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:11.700634 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e617f106-7297-470b-8c44-0d340ff8e5b2 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:11.701844 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e617f106-7297-470b-8c44-0d340ff8e5b2 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:11.702843 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e617f106-7297-470b-8c44-0d340ff8e5b2 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:11.703585 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e617f106-7297-470b-8c44-0d340ff8e5b2 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:11.833130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7c25a76d-e1ce-4aa8-8eeb-4f566768bb19 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:11.842552 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7c25a76d-e1ce-4aa8-8eeb-4f566768bb19 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1515 microversion: 2.1 time: 0.241838 Jul 25 14:31:11.843070 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 806/1580] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:11 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1515 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:11.862153 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-588f9b71-6734-4b3f-89e8-786b3a7ebc2e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:11.863026 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-588f9b71-6734-4b3f-89e8-786b3a7ebc2e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:11.871427 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-588f9b71-6734-4b3f-89e8-786b3a7ebc2e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:11.872248 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-588f9b71-6734-4b3f-89e8-786b3a7ebc2e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:11.873187 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-588f9b71-6734-4b3f-89e8-786b3a7ebc2e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:11.873783 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-588f9b71-6734-4b3f-89e8-786b3a7ebc2e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:12.110496 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-588f9b71-6734-4b3f-89e8-786b3a7ebc2e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:12.121077 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-588f9b71-6734-4b3f-89e8-786b3a7ebc2e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:12.122709 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-588f9b71-6734-4b3f-89e8-786b3a7ebc2e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:12.124339 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-588f9b71-6734-4b3f-89e8-786b3a7ebc2e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 2949 microversion: 2.42 time: 0.266846 Jul 25 14:31:12.139575 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 807/1581] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:31:11 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 2949 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:31:12.147945 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fb76a237-3a38-4eaf-bec1-2199f71aa49c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:12.148854 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fb76a237-3a38-4eaf-bec1-2199f71aa49c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:12.156416 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fb76a237-3a38-4eaf-bec1-2199f71aa49c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:12.156864 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fb76a237-3a38-4eaf-bec1-2199f71aa49c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:12.157633 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fb76a237-3a38-4eaf-bec1-2199f71aa49c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:12.158290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fb76a237-3a38-4eaf-bec1-2199f71aa49c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:12.175309 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e617f106-7297-470b-8c44-0d340ff8e5b2 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f53d74a29243759065e68964f638dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d71324b22554a3bb44d6aceb7bc3cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:12.183453 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e617f106-7297-470b-8c44-0d340ff8e5b2 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e" status: 200 len: 1648 microversion: 2.1 time: 0.508828 Jul 25 14:31:12.184173 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 775/1582] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:11 2022] GET /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e => generated 1648 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:12.189248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7384aedb-969a-4f7d-b7b9-f67c091634ce tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:12.190089 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7384aedb-969a-4f7d-b7b9-f67c091634ce tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] [instance: 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:12.196217 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7384aedb-969a-4f7d-b7b9-f67c091634ce tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:12.196946 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7384aedb-969a-4f7d-b7b9-f67c091634ce tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:12.197837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7384aedb-969a-4f7d-b7b9-f67c091634ce tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:12.198549 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7384aedb-969a-4f7d-b7b9-f67c091634ce tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:12.334421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fb76a237-3a38-4eaf-bec1-2199f71aa49c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:12.342439 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fb76a237-3a38-4eaf-bec1-2199f71aa49c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd" status: 200 len: 1503 microversion: 2.1 time: 0.201097 Jul 25 14:31:12.343211 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 808/1583] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:12 2022] GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd => generated 1503 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:12.348145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d292ebcd-81b9-4586-83c0-099c15305916 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:12.348808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d292ebcd-81b9-4586-83c0-099c15305916 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:12.361269 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d292ebcd-81b9-4586-83c0-099c15305916 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:12.362153 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d292ebcd-81b9-4586-83c0-099c15305916 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:12.362906 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d292ebcd-81b9-4586-83c0-099c15305916 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:12.363376 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d292ebcd-81b9-4586-83c0-099c15305916 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:12.445933 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7384aedb-969a-4f7d-b7b9-f67c091634ce tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef2558f586447408bbce6b9b0dcd62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced9025cae5c4c43a111119b99ae9233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:12.487162 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7384aedb-969a-4f7d-b7b9-f67c091634ce tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] 10.222.0.88 "GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4" status: 200 len: 1504 microversion: 2.1 time: 0.301625 Jul 25 14:31:12.487752 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 776/1584] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:12 2022] GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 => generated 1504 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:12.493272 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-1833c3b4-3f50-4df5-a702-9f5e8e804cb2 req-5f18ee5c-f0e5-44f9-ad7f-b97f7436ccc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "115f3b11-988d-43c1-a81f-998139d12448", "tag": "f9ae53b2-7ccb-46f9-b164-3d57e251cc2f"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:12.505798 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-1833c3b4-3f50-4df5-a702-9f5e8e804cb2 req-5f18ee5c-f0e5-44f9-ad7f-b97f7436ccc2 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:12.506245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-1833c3b4-3f50-4df5-a702-9f5e8e804cb2 req-5f18ee5c-f0e5-44f9-ad7f-b97f7436ccc2 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:12.524875 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-1833c3b4-3f50-4df5-a702-9f5e8e804cb2 req-5f18ee5c-f0e5-44f9-ad7f-b97f7436ccc2 service nova] Creating event network-changed:f9ae53b2-7ccb-46f9-b164-3d57e251cc2f for instance 115f3b11-988d-43c1-a81f-998139d12448 on n-h1-846435-14 Jul 25 14:31:12.528970 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d292ebcd-81b9-4586-83c0-099c15305916 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.184413 Jul 25 14:31:12.535834 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [req-1833c3b4-3f50-4df5-a702-9f5e8e804cb2 req-5f18ee5c-f0e5-44f9-ad7f-b97f7436ccc2 service nova] Instance 115f3b11-988d-43c1-a81f-998139d12448 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119303) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 14:31:12.539742 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 809/1585] 10.222.0.88 () {60 vars in 1316 bytes} [Mon Jul 25 14:31:12 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242/os-interface => generated 1830 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:31:12.546103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2fdd773f-5e15-4582-a7dd-4183b01b1375 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:12.546963 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2fdd773f-5e15-4582-a7dd-4183b01b1375 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:12.555321 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2fdd773f-5e15-4582-a7dd-4183b01b1375 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:12.555872 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2fdd773f-5e15-4582-a7dd-4183b01b1375 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:12.556991 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2fdd773f-5e15-4582-a7dd-4183b01b1375 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:12.557418 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2fdd773f-5e15-4582-a7dd-4183b01b1375 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:12.559930 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-1833c3b4-3f50-4df5-a702-9f5e8e804cb2 req-5f18ee5c-f0e5-44f9-ad7f-b97f7436ccc2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070425 Jul 25 14:31:12.560660 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 777/1586] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:12.566246 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9e76c03c-0995-4984-97d1-6f29ab2bdac3 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:12.567116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9e76c03c-0995-4984-97d1-6f29ab2bdac3 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] [instance: 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:12.574633 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9e76c03c-0995-4984-97d1-6f29ab2bdac3 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:12.575578 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9e76c03c-0995-4984-97d1-6f29ab2bdac3 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:12.576813 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9e76c03c-0995-4984-97d1-6f29ab2bdac3 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:12.577275 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9e76c03c-0995-4984-97d1-6f29ab2bdac3 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:12.606500 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9e76c03c-0995-4984-97d1-6f29ab2bdac3 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] [instance: 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:31:12.717287 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9e76c03c-0995-4984-97d1-6f29ab2bdac3 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] 10.222.0.88 "DELETE /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4" status: 204 len: 0 microversion: 2.1 time: 0.154975 Jul 25 14:31:12.724377 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 778/1587] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:31:12 2022] DELETE /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:31:12.727001 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4bc75775-b7a4-432d-8307-7cf1e22d1dec tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:12.727903 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4bc75775-b7a4-432d-8307-7cf1e22d1dec tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:12.734428 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2fdd773f-5e15-4582-a7dd-4183b01b1375 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:12.735109 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4bc75775-b7a4-432d-8307-7cf1e22d1dec tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:12.735570 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4bc75775-b7a4-432d-8307-7cf1e22d1dec tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:12.736386 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4bc75775-b7a4-432d-8307-7cf1e22d1dec tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:12.736815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4bc75775-b7a4-432d-8307-7cf1e22d1dec tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:12.754330 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2fdd773f-5e15-4582-a7dd-4183b01b1375 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1473 microversion: 2.1 time: 0.212763 Jul 25 14:31:12.756823 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 810/1588] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:12 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1473 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:12.765631 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a20e2095-6bfb-4273-9758-a43f7ee386fe tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:12.766242 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a20e2095-6bfb-4273-9758-a43f7ee386fe tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] [instance: 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:12.790458 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a20e2095-6bfb-4273-9758-a43f7ee386fe tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:12.790608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a20e2095-6bfb-4273-9758-a43f7ee386fe tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:12.792572 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a20e2095-6bfb-4273-9758-a43f7ee386fe tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:12.794147 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a20e2095-6bfb-4273-9758-a43f7ee386fe tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:13.033057 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a20e2095-6bfb-4273-9758-a43f7ee386fe tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef2558f586447408bbce6b9b0dcd62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced9025cae5c4c43a111119b99ae9233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:13.043575 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a20e2095-6bfb-4273-9758-a43f7ee386fe tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] 10.222.0.88 "GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4" status: 200 len: 1510 microversion: 2.1 time: 0.285468 Jul 25 14:31:13.045699 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 811/1589] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:12 2022] GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 => generated 1510 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:13.061326 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4bc75775-b7a4-432d-8307-7cf1e22d1dec tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:13.063623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2d9bc59b-2dcb-49ed-8b80-2cdde8e000d6 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:13.065021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2d9bc59b-2dcb-49ed-8b80-2cdde8e000d6 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:13.076979 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4bc75775-b7a4-432d-8307-7cf1e22d1dec tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:13.078208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d9bc59b-2dcb-49ed-8b80-2cdde8e000d6 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:13.078696 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d9bc59b-2dcb-49ed-8b80-2cdde8e000d6 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:13.079910 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d9bc59b-2dcb-49ed-8b80-2cdde8e000d6 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:13.081518 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d9bc59b-2dcb-49ed-8b80-2cdde8e000d6 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:13.083192 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4bc75775-b7a4-432d-8307-7cf1e22d1dec tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:13.085031 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4bc75775-b7a4-432d-8307-7cf1e22d1dec tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1814 microversion: 2.25 time: 0.362515 Jul 25 14:31:13.088584 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 779/1590] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:31:12 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1814 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:31:13.207422 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bdcb6f20-897f-47fb-b7c9-873af0729a16 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:13.210968 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bdcb6f20-897f-47fb-b7c9-873af0729a16 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 74d6eac5-76ed-47bb-8e15-d6dea0e5618e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:13.220285 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bdcb6f20-897f-47fb-b7c9-873af0729a16 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:13.221024 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bdcb6f20-897f-47fb-b7c9-873af0729a16 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:13.221989 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bdcb6f20-897f-47fb-b7c9-873af0729a16 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:13.222735 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bdcb6f20-897f-47fb-b7c9-873af0729a16 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:13.342243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2d9bc59b-2dcb-49ed-8b80-2cdde8e000d6 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:13.352557 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2d9bc59b-2dcb-49ed-8b80-2cdde8e000d6 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1515 microversion: 2.1 time: 0.305183 Jul 25 14:31:13.353698 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 812/1591] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:13 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1515 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:13.374657 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-00f0e1ee-d197-457a-bca4-cf6c6ecf4bd5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:13.374891 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-00f0e1ee-d197-457a-bca4-cf6c6ecf4bd5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:13.385904 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-00f0e1ee-d197-457a-bca4-cf6c6ecf4bd5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:13.387147 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-00f0e1ee-d197-457a-bca4-cf6c6ecf4bd5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:13.391208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-00f0e1ee-d197-457a-bca4-cf6c6ecf4bd5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:13.392699 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-00f0e1ee-d197-457a-bca4-cf6c6ecf4bd5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:13.537973 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-00f0e1ee-d197-457a-bca4-cf6c6ecf4bd5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:13.546624 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-00f0e1ee-d197-457a-bca4-cf6c6ecf4bd5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd" status: 200 len: 1503 microversion: 2.1 time: 0.176881 Jul 25 14:31:13.547483 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 813/1592] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:13 2022] GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd => generated 1503 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:13.551948 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bdcb6f20-897f-47fb-b7c9-873af0729a16 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f53d74a29243759065e68964f638dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d71324b22554a3bb44d6aceb7bc3cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:13.561764 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bdcb6f20-897f-47fb-b7c9-873af0729a16 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e" status: 200 len: 1648 microversion: 2.1 time: 0.361366 Jul 25 14:31:13.562376 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 780/1593] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:13 2022] GET /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e => generated 1648 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:31:13.781191 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1daae4e6-9e7c-48e0-8292-58823d06800f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:13.782146 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1daae4e6-9e7c-48e0-8292-58823d06800f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:13.794653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1daae4e6-9e7c-48e0-8292-58823d06800f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:13.795248 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1daae4e6-9e7c-48e0-8292-58823d06800f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:13.796189 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1daae4e6-9e7c-48e0-8292-58823d06800f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:13.796727 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1daae4e6-9e7c-48e0-8292-58823d06800f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:13.960420 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1daae4e6-9e7c-48e0-8292-58823d06800f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:13.969442 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1daae4e6-9e7c-48e0-8292-58823d06800f tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1473 microversion: 2.1 time: 0.192184 Jul 25 14:31:13.970541 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 814/1594] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:13 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1473 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:14.067224 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f72fa4a6-a746-4a79-9987-7e5424f7af85 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:14.067850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f72fa4a6-a746-4a79-9987-7e5424f7af85 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] [instance: 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:14.074606 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f72fa4a6-a746-4a79-9987-7e5424f7af85 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:14.075098 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f72fa4a6-a746-4a79-9987-7e5424f7af85 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:14.075878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f72fa4a6-a746-4a79-9987-7e5424f7af85 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:14.076348 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f72fa4a6-a746-4a79-9987-7e5424f7af85 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:14.129367 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ac47666c-37dd-4414-8b91-2e53c1b679e4 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:14.131487 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ac47666c-37dd-4414-8b91-2e53c1b679e4 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:14.142895 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac47666c-37dd-4414-8b91-2e53c1b679e4 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:14.143369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac47666c-37dd-4414-8b91-2e53c1b679e4 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:14.144341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac47666c-37dd-4414-8b91-2e53c1b679e4 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:14.144774 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac47666c-37dd-4414-8b91-2e53c1b679e4 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:14.243313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f72fa4a6-a746-4a79-9987-7e5424f7af85 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef2558f586447408bbce6b9b0dcd62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced9025cae5c4c43a111119b99ae9233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:14.253012 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f72fa4a6-a746-4a79-9987-7e5424f7af85 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] 10.222.0.88 "GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4" status: 200 len: 1510 microversion: 2.1 time: 0.190510 Jul 25 14:31:14.253825 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 781/1595] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:14 2022] GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 => generated 1510 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:14.320197 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a03d4706-db82-442e-81b9-cb110a348201 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Action: 'create', calling method: .version_select at 0x7f46872c0550>, body: {"keypair": {"name": "tempest-keypair-709633153", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLx3hGC+Y8y9HeEdTgj6m/qI9AnQnijaODbLTFMA26MSyS0fE0YVVEXHcm+QcZ45vBieLyHqm636oTS0coJTyD5LJadL9OXFpkDRCi/iz9yFOGealwdA50MPldMLtz/7cQ=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:14.340298 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-a03d4706-db82-442e-81b9-cb110a348201 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Getting quotas for project 01423e9ea2b94eef87188b26f99f9ae4. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:31:14.346233 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-a03d4706-db82-442e-81b9-cb110a348201 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Getting quotas for user 2bd9f6ef6ef34b51a55bb71f5d06040d and project 01423e9ea2b94eef87188b26f99f9ae4. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:31:14.356159 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:31:14.379691 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a03d4706-db82-442e-81b9-cb110a348201 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.124266 Jul 25 14:31:14.380358 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 782/1596] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:31:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:14.388235 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cbdf95fe-ebc6-4f91-9322-317b60421bc9 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:14.390099 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cbdf95fe-ebc6-4f91-9322-317b60421bc9 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:14.396209 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ac47666c-37dd-4414-8b91-2e53c1b679e4 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:14.397881 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cbdf95fe-ebc6-4f91-9322-317b60421bc9 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:14.398478 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cbdf95fe-ebc6-4f91-9322-317b60421bc9 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:14.399548 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cbdf95fe-ebc6-4f91-9322-317b60421bc9 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:14.400660 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cbdf95fe-ebc6-4f91-9322-317b60421bc9 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:14.414232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ac47666c-37dd-4414-8b91-2e53c1b679e4 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:14.416544 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ac47666c-37dd-4414-8b91-2e53c1b679e4 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:14.421297 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ac47666c-37dd-4414-8b91-2e53c1b679e4 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1814 microversion: 2.25 time: 0.312927 Jul 25 14:31:14.421961 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 815/1597] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:31:14 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1814 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:31:14.581783 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cbdf95fe-ebc6-4f91-9322-317b60421bc9 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:14.582745 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cbfeb6e5-18f7-4d42-8ddd-924e01eea868 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:14.584707 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cbfeb6e5-18f7-4d42-8ddd-924e01eea868 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:14.599153 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cbdf95fe-ebc6-4f91-9322-317b60421bc9 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1515 microversion: 2.1 time: 0.216078 Jul 25 14:31:14.606735 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cbfeb6e5-18f7-4d42-8ddd-924e01eea868 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:14.608636 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cbfeb6e5-18f7-4d42-8ddd-924e01eea868 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:14.609839 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cbfeb6e5-18f7-4d42-8ddd-924e01eea868 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:14.612969 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cbfeb6e5-18f7-4d42-8ddd-924e01eea868 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:14.617037 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 783/1598] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:14 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1515 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:14.635555 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9615b103-5a7f-4994-b055-c06f14712588 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:14.637026 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9615b103-5a7f-4994-b055-c06f14712588 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 74d6eac5-76ed-47bb-8e15-d6dea0e5618e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:14.653540 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9615b103-5a7f-4994-b055-c06f14712588 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:14.655792 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9615b103-5a7f-4994-b055-c06f14712588 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:14.657568 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9615b103-5a7f-4994-b055-c06f14712588 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:14.658017 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9615b103-5a7f-4994-b055-c06f14712588 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:14.866726 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9615b103-5a7f-4994-b055-c06f14712588 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f53d74a29243759065e68964f638dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d71324b22554a3bb44d6aceb7bc3cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:14.882594 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9615b103-5a7f-4994-b055-c06f14712588 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e" status: 200 len: 1469 microversion: 2.1 time: 0.259660 Jul 25 14:31:14.885397 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 784/1599] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:14 2022] GET /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e => generated 1469 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:14.885567 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cbfeb6e5-18f7-4d42-8ddd-924e01eea868 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:14.897419 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-9d49fd82-17b1-405d-816e-da2ae4ac0c75 req-7116532a-85d6-4da8-96bc-22cddfa7d2d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74d6eac5-76ed-47bb-8e15-d6dea0e5618e", "name": "network-vif-deleted", "tag": "e3504237-5bd2-4a4c-a8ef-533354ad94bb"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:14.900951 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cbfeb6e5-18f7-4d42-8ddd-924e01eea868 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd" status: 200 len: 1503 microversion: 2.1 time: 0.335903 Jul 25 14:31:14.902557 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 816/1600] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:14 2022] GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd => generated 1503 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:14.953443 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-9d49fd82-17b1-405d-816e-da2ae4ac0c75 req-7116532a-85d6-4da8-96bc-22cddfa7d2d9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:14.954479 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-9d49fd82-17b1-405d-816e-da2ae4ac0c75 req-7116532a-85d6-4da8-96bc-22cddfa7d2d9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:14.981145 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-9d49fd82-17b1-405d-816e-da2ae4ac0c75 req-7116532a-85d6-4da8-96bc-22cddfa7d2d9 service nova] Creating event network-vif-deleted:e3504237-5bd2-4a4c-a8ef-533354ad94bb for instance 74d6eac5-76ed-47bb-8e15-d6dea0e5618e on n-h2-846435-14 Jul 25 14:31:14.999239 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-47aa2d0b-d5cf-4d67-b58b-87b01fa7b48a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:14.999919 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-47aa2d0b-d5cf-4d67-b58b-87b01fa7b48a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:15.005345 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-9d49fd82-17b1-405d-816e-da2ae4ac0c75 req-7116532a-85d6-4da8-96bc-22cddfa7d2d9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115492 Jul 25 14:31:15.006631 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 785/1601] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:15.021042 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-47aa2d0b-d5cf-4d67-b58b-87b01fa7b48a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:15.021777 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-47aa2d0b-d5cf-4d67-b58b-87b01fa7b48a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:15.026349 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-47aa2d0b-d5cf-4d67-b58b-87b01fa7b48a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:15.026815 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-47aa2d0b-d5cf-4d67-b58b-87b01fa7b48a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:15.275365 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c0de310c-e8bd-4d22-8071-b242d5d1fcb6 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:15.279069 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c0de310c-e8bd-4d22-8071-b242d5d1fcb6 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] [instance: 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:15.302901 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c0de310c-e8bd-4d22-8071-b242d5d1fcb6 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:15.303371 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c0de310c-e8bd-4d22-8071-b242d5d1fcb6 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:15.304182 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c0de310c-e8bd-4d22-8071-b242d5d1fcb6 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:15.304616 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c0de310c-e8bd-4d22-8071-b242d5d1fcb6 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:15.920198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-47aa2d0b-d5cf-4d67-b58b-87b01fa7b48a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:15.932669 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-47aa2d0b-d5cf-4d67-b58b-87b01fa7b48a tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1473 microversion: 2.1 time: 0.937389 Jul 25 14:31:15.938476 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 817/1602] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:14 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1473 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:15.983737 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f03b7575-4ab9-4546-824a-9c8a6dd47f68 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:15.987221 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f03b7575-4ab9-4546-824a-9c8a6dd47f68 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:16.015710 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f03b7575-4ab9-4546-824a-9c8a6dd47f68 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:16.017763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f03b7575-4ab9-4546-824a-9c8a6dd47f68 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:16.019491 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f03b7575-4ab9-4546-824a-9c8a6dd47f68 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:16.020888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f03b7575-4ab9-4546-824a-9c8a6dd47f68 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:16.896717 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f03b7575-4ab9-4546-824a-9c8a6dd47f68 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:16.914348 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f03b7575-4ab9-4546-824a-9c8a6dd47f68 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:16.922205 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f03b7575-4ab9-4546-824a-9c8a6dd47f68 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:16.923527 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f03b7575-4ab9-4546-824a-9c8a6dd47f68 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1814 microversion: 2.25 time: 0.983666 Jul 25 14:31:16.928304 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 818/1603] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:31:15 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1814 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:31:16.954348 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ebabff04-274b-4969-b04e-d12a83150c86 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:16.955076 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ebabff04-274b-4969-b04e-d12a83150c86 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:16.967668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ebabff04-274b-4969-b04e-d12a83150c86 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:16.968955 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ebabff04-274b-4969-b04e-d12a83150c86 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:16.969865 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ebabff04-274b-4969-b04e-d12a83150c86 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:16.972779 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ebabff04-274b-4969-b04e-d12a83150c86 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:17.208087 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:31:17.383620 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c0de310c-e8bd-4d22-8071-b242d5d1fcb6 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef2558f586447408bbce6b9b0dcd62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced9025cae5c4c43a111119b99ae9233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:17.406827 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c0de310c-e8bd-4d22-8071-b242d5d1fcb6 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] 10.222.0.88 "GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4" status: 200 len: 1510 microversion: 2.1 time: 2.126263 Jul 25 14:31:17.410103 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 786/1604] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:15 2022] GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 => generated 1510 bytes in 2140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:17.415731 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7f05d4e3-7789-41a5-8839-c5007b9d3ee2 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:17.416715 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7f05d4e3-7789-41a5-8839-c5007b9d3ee2 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] [instance: 74d6eac5-76ed-47bb-8e15-d6dea0e5618e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:17.441010 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7f05d4e3-7789-41a5-8839-c5007b9d3ee2 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:17.441437 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7f05d4e3-7789-41a5-8839-c5007b9d3ee2 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:17.442222 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7f05d4e3-7789-41a5-8839-c5007b9d3ee2 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:17.442650 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7f05d4e3-7789-41a5-8839-c5007b9d3ee2 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:17.473669 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-7f05d4e3-7789-41a5-8839-c5007b9d3ee2 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] HTTP exception thrown: Instance 74d6eac5-76ed-47bb-8e15-d6dea0e5618e could not be found. Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7f05d4e3-7789-41a5-8839-c5007b9d3ee2 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Request method failure captured: Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e HTTP/1.1 Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qjSWhK-vwJTt9-RUosNUl92O2IH7DXHM__YKwETUuX644ZNnaLPUYLl7n9jfiOhif_9NvqEaG0blLab1mJt658fIFOepG5Z0DCt4IZ2Chl0jBZNJNW6gm_-nwSZ3IWfSAUAPR-qkW1tUiXhGVJPIQGpNlpD2VqkHT6SMzyoZa1fOYg Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 3d71324b22554a3bb44d6aceb7bc3cbd Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d71324b22554a3bb44d6aceb7bc3cbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d71324b22554a3bb44d6aceb7bc3cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3d71324b22554a3bb44d6aceb7bc3cbd", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3d71324b22554a3bb44d6aceb7bc3cbd"}]}] Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 3d71324b22554a3bb44d6aceb7bc3cbd Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-81685064 Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-SecurityGroupsTestJSON-81685064-project Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: b3f53d74a29243759065e68964f638dc Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-SecurityGroupsTestJSON-81685064-project Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 74d6eac5-76ed-47bb-8e15-d6dea0e5618e could not be found. Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '74d6eac5-76ed-47bb-8e15-d6dea0e5618e'} Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74d6eac5-76ed-47bb-8e15-d6dea0e5618e could not be found. Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74d6eac5-76ed-47bb-8e15-d6dea0e5618e could not be found. Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:17.482219 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:17.488868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:17.488868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:17.488868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:17.488868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:17.488868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:17.488868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74d6eac5-76ed-47bb-8e15-d6dea0e5618e could not be found. Jul 25 14:31:17.488868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:17.488868 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7f05d4e3-7789-41a5-8839-c5007b9d3ee2 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Returning 404 to user: Instance 74d6eac5-76ed-47bb-8e15-d6dea0e5618e could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:17.488868 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7f05d4e3-7789-41a5-8839-c5007b9d3ee2 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "GET /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e" status: 404 len: 111 microversion: 2.1 time: 0.072323 Jul 25 14:31:17.488868 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 787/1605] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:17 2022] GET /compute/v2.1/servers/74d6eac5-76ed-47bb-8e15-d6dea0e5618e => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:31:17.499766 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0dab5acc-8fdb-4ada-a0c9-ad680a8f9159 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:17.500442 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0dab5acc-8fdb-4ada-a0c9-ad680a8f9159 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:17.516170 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0dab5acc-8fdb-4ada-a0c9-ad680a8f9159 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:17.516621 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0dab5acc-8fdb-4ada-a0c9-ad680a8f9159 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:17.517421 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0dab5acc-8fdb-4ada-a0c9-ad680a8f9159 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:17.517860 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0dab5acc-8fdb-4ada-a0c9-ad680a8f9159 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:17.626835 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ebabff04-274b-4969-b04e-d12a83150c86 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:17.641881 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ebabff04-274b-4969-b04e-d12a83150c86 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1515 microversion: 2.1 time: 0.707992 Jul 25 14:31:17.644129 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 819/1606] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:16 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1515 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:17.659836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a726b6c3-86a9-4416-9fc0-7015da7b85db tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:17.664819 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a726b6c3-86a9-4416-9fc0-7015da7b85db tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:17.672182 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a726b6c3-86a9-4416-9fc0-7015da7b85db tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:17.682218 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a726b6c3-86a9-4416-9fc0-7015da7b85db tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:17.684741 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a726b6c3-86a9-4416-9fc0-7015da7b85db tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:17.686910 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a726b6c3-86a9-4416-9fc0-7015da7b85db tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:18.111012 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a726b6c3-86a9-4416-9fc0-7015da7b85db tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:18.128506 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a726b6c3-86a9-4416-9fc0-7015da7b85db tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1470 microversion: 2.1 time: 0.482425 Jul 25 14:31:18.129665 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 820/1607] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:17 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1470 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:18.151176 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-5fd6fba3-f70e-4d79-8a0d-dc3531b9ea77 req-b4bae4f2-cfc7-413d-9348-fa3d8fb374cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5694bd9c-d7e8-4f20-8404-fc5e747c93cd", "name": "network-vif-unplugged", "status": "completed", "tag": "972e03f2-20ce-491f-a29a-2936da24a706"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:18.161672 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-5fd6fba3-f70e-4d79-8a0d-dc3531b9ea77 req-b4bae4f2-cfc7-413d-9348-fa3d8fb374cf service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:18.162645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-5fd6fba3-f70e-4d79-8a0d-dc3531b9ea77 req-b4bae4f2-cfc7-413d-9348-fa3d8fb374cf service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:18.177466 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-5fd6fba3-f70e-4d79-8a0d-dc3531b9ea77 req-b4bae4f2-cfc7-413d-9348-fa3d8fb374cf service nova] Creating event network-vif-unplugged:972e03f2-20ce-491f-a29a-2936da24a706 for instance 5694bd9c-d7e8-4f20-8404-fc5e747c93cd on n-h2-846435-14 Jul 25 14:31:18.184783 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-5fd6fba3-f70e-4d79-8a0d-dc3531b9ea77 req-b4bae4f2-cfc7-413d-9348-fa3d8fb374cf service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038276 Jul 25 14:31:18.186674 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 821/1608] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:18.200951 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a79fb852-2cec-4ee3-b049-bf76841824e1 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '.version_select at 0x7f46879bc0d0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:18.220824 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0dab5acc-8fdb-4ada-a0c9-ad680a8f9159 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:18.231362 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0dab5acc-8fdb-4ada-a0c9-ad680a8f9159 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd" status: 200 len: 1503 microversion: 2.1 time: 0.738864 Jul 25 14:31:18.232928 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 788/1609] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:17 2022] GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd => generated 1503 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:18.242551 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5b77a5e0-d93d-4990-a70e-39e9b3303b32 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:18.248296 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5b77a5e0-d93d-4990-a70e-39e9b3303b32 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:18.259196 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5b77a5e0-d93d-4990-a70e-39e9b3303b32 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:18.259657 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5b77a5e0-d93d-4990-a70e-39e9b3303b32 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:18.260492 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5b77a5e0-d93d-4990-a70e-39e9b3303b32 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:18.260946 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5b77a5e0-d93d-4990-a70e-39e9b3303b32 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:18.762823 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a79fb852-2cec-4ee3-b049-bf76841824e1 tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/4d916572-953b-473f-831a-ef3184f7b626" status: 202 len: 0 microversion: 2.1 time: 0.574264 Jul 25 14:31:18.766096 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 822/1610] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:31:18 2022] DELETE /compute/v2.1/os-security-groups/4d916572-953b-473f-831a-ef3184f7b626 => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:31:18.772741 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c50e6e19-9477-4b9c-aa26-4f359bd31784 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:18.783891 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c50e6e19-9477-4b9c-aa26-4f359bd31784 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:18.791646 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c50e6e19-9477-4b9c-aa26-4f359bd31784 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:18.792218 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c50e6e19-9477-4b9c-aa26-4f359bd31784 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:18.793846 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c50e6e19-9477-4b9c-aa26-4f359bd31784 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:18.794536 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c50e6e19-9477-4b9c-aa26-4f359bd31784 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:18.884182 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:31:18.954987 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c50e6e19-9477-4b9c-aa26-4f359bd31784 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "POST /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448/action" status: 202 len: 0 microversion: 2.1 time: 0.187263 Jul 25 14:31:18.955994 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 823/1611] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:31:18 2022] POST /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:31:18.962247 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ebb396f4-dc5f-4744-bc3d-7e9773fbb159 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:18.963256 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ebb396f4-dc5f-4744-bc3d-7e9773fbb159 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] [instance: 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:18.971021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ebb396f4-dc5f-4744-bc3d-7e9773fbb159 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:18.971764 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ebb396f4-dc5f-4744-bc3d-7e9773fbb159 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:18.972899 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ebb396f4-dc5f-4744-bc3d-7e9773fbb159 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:18.973531 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ebb396f4-dc5f-4744-bc3d-7e9773fbb159 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:18.983384 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5b77a5e0-d93d-4990-a70e-39e9b3303b32 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:19.000356 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5b77a5e0-d93d-4990-a70e-39e9b3303b32 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:19.002364 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5b77a5e0-d93d-4990-a70e-39e9b3303b32 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:19.003779 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5b77a5e0-d93d-4990-a70e-39e9b3303b32 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1814 microversion: 2.25 time: 0.769035 Jul 25 14:31:19.006050 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 789/1612] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:31:18 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1814 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:31:19.011687 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-aa217c87-88e3-441f-8f8b-ea946f3f1c1b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:19.012743 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-aa217c87-88e3-441f-8f8b-ea946f3f1c1b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:19.019467 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aa217c87-88e3-441f-8f8b-ea946f3f1c1b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:19.020246 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aa217c87-88e3-441f-8f8b-ea946f3f1c1b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:19.021547 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aa217c87-88e3-441f-8f8b-ea946f3f1c1b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:19.022228 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aa217c87-88e3-441f-8f8b-ea946f3f1c1b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:19.084441 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ebb396f4-dc5f-4744-bc3d-7e9773fbb159 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef2558f586447408bbce6b9b0dcd62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced9025cae5c4c43a111119b99ae9233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:19.096721 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ebb396f4-dc5f-4744-bc3d-7e9773fbb159 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] 10.222.0.88 "GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4" status: 200 len: 1468 microversion: 2.1 time: 0.139189 Jul 25 14:31:19.112068 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 824/1613] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:18 2022] GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 => generated 1468 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:19.117459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7ade5377-2282-43dd-a0e1-134aaa81913c tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] Calling method '.version_select at 0x7f46876244c0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:19.536511 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7ade5377-2282-43dd-a0e1-134aaa81913c tempest-SecurityGroupsTestJSON-81685064 tempest-SecurityGroupsTestJSON-81685064-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/8d10a92f-1eab-4815-9359-eae8424ca2f7" status: 202 len: 0 microversion: 2.1 time: 0.423091 Jul 25 14:31:19.537208 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 825/1614] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:31:19 2022] DELETE /compute/v2.1/os-security-groups/8d10a92f-1eab-4815-9359-eae8424ca2f7 => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:31:19.543604 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e99b49f8-ed78-40e0-b7cf-cd47e04d9e07 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:19.544358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e99b49f8-ed78-40e0-b7cf-cd47e04d9e07 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:19.563267 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e99b49f8-ed78-40e0-b7cf-cd47e04d9e07 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:19.563861 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e99b49f8-ed78-40e0-b7cf-cd47e04d9e07 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:19.565000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e99b49f8-ed78-40e0-b7cf-cd47e04d9e07 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:19.565430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e99b49f8-ed78-40e0-b7cf-cd47e04d9e07 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:19.841292 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-aa217c87-88e3-441f-8f8b-ea946f3f1c1b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:19.862625 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-aa217c87-88e3-441f-8f8b-ea946f3f1c1b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1515 microversion: 2.1 time: 0.848189 Jul 25 14:31:19.864935 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 790/1615] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:19 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1515 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:19.886414 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c21b7964-2119-4008-9547-93eacd8c1b48 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:19.887787 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c21b7964-2119-4008-9547-93eacd8c1b48 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:19.899174 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c21b7964-2119-4008-9547-93eacd8c1b48 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:19.901297 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c21b7964-2119-4008-9547-93eacd8c1b48 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:19.904024 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c21b7964-2119-4008-9547-93eacd8c1b48 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:19.904996 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c21b7964-2119-4008-9547-93eacd8c1b48 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:20.259450 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c21b7964-2119-4008-9547-93eacd8c1b48 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:20.262055 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:31:20.271098 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c21b7964-2119-4008-9547-93eacd8c1b48 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd" status: 200 len: 1503 microversion: 2.1 time: 0.405026 Jul 25 14:31:20.272519 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 791/1616] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:19 2022] GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd => generated 1503 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:20.278366 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-f93234b9-884b-4f36-996f-9eb1c5a7ca71 req-7d158d7a-a9a9-4323-ad49-f52037b79e49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a13ead5-0102-4ed4-a1d9-42414cd7ffb4", "name": "network-vif-deleted", "tag": "2174faa6-514a-432a-b58b-9472df90d0a4"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:20.282756 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e99b49f8-ed78-40e0-b7cf-cd47e04d9e07 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:20.291326 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e99b49f8-ed78-40e0-b7cf-cd47e04d9e07 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1469 microversion: 2.1 time: 0.752240 Jul 25 14:31:20.291764 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f93234b9-884b-4f36-996f-9eb1c5a7ca71 req-7d158d7a-a9a9-4323-ad49-f52037b79e49 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:20.291924 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 826/1617] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:19 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1469 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:20.302775 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f93234b9-884b-4f36-996f-9eb1c5a7ca71 req-7d158d7a-a9a9-4323-ad49-f52037b79e49 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:20.302917 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-e0dd1d9e-047d-494b-b509-b09e83a5abe8 req-3cf6b888-d4ab-41d8-bcdd-ebdc3913f793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "115f3b11-988d-43c1-a81f-998139d12448", "name": "network-vif-plugged", "status": "completed", "tag": "f9ae53b2-7ccb-46f9-b164-3d57e251cc2f"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:20.319578 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-f93234b9-884b-4f36-996f-9eb1c5a7ca71 req-7d158d7a-a9a9-4323-ad49-f52037b79e49 service nova] Creating event network-vif-deleted:2174faa6-514a-432a-b58b-9472df90d0a4 for instance 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 on n-h1-846435-14 Jul 25 14:31:20.328600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-e0dd1d9e-047d-494b-b509-b09e83a5abe8 req-3cf6b888-d4ab-41d8-bcdd-ebdc3913f793 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:20.329325 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-e0dd1d9e-047d-494b-b509-b09e83a5abe8 req-3cf6b888-d4ab-41d8-bcdd-ebdc3913f793 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:20.332158 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-f93234b9-884b-4f36-996f-9eb1c5a7ca71 req-7d158d7a-a9a9-4323-ad49-f52037b79e49 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057487 Jul 25 14:31:20.333102 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 792/1618] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:20.339610 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f0b29b42-fd70-4c1b-b803-cd3fadf199b3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:20.340369 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f0b29b42-fd70-4c1b-b803-cd3fadf199b3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:20.346959 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f0b29b42-fd70-4c1b-b803-cd3fadf199b3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:20.347414 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f0b29b42-fd70-4c1b-b803-cd3fadf199b3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:20.348222 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f0b29b42-fd70-4c1b-b803-cd3fadf199b3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:20.348657 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f0b29b42-fd70-4c1b-b803-cd3fadf199b3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:20.349803 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-e0dd1d9e-047d-494b-b509-b09e83a5abe8 req-3cf6b888-d4ab-41d8-bcdd-ebdc3913f793 service nova] Creating event network-vif-plugged:f9ae53b2-7ccb-46f9-b164-3d57e251cc2f for instance 115f3b11-988d-43c1-a81f-998139d12448 on n-h1-846435-14 Jul 25 14:31:20.360016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [req-e0dd1d9e-047d-494b-b509-b09e83a5abe8 req-3cf6b888-d4ab-41d8-bcdd-ebdc3913f793 service nova] Instance 115f3b11-988d-43c1-a81f-998139d12448 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119304) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 14:31:20.377545 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-e0dd1d9e-047d-494b-b509-b09e83a5abe8 req-3cf6b888-d4ab-41d8-bcdd-ebdc3913f793 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083415 Jul 25 14:31:20.379283 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 827/1619] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:20.388030 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ee86d68b-55db-4563-ac25-e2f20c6e054b tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:20.389400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ee86d68b-55db-4563-ac25-e2f20c6e054b tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] [instance: 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:20.396348 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee86d68b-55db-4563-ac25-e2f20c6e054b tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:20.397254 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee86d68b-55db-4563-ac25-e2f20c6e054b tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:20.398600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee86d68b-55db-4563-ac25-e2f20c6e054b tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:20.399054 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee86d68b-55db-4563-ac25-e2f20c6e054b tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:20.416602 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-ee86d68b-55db-4563-ac25-e2f20c6e054b tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] HTTP exception thrown: Instance 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 could not be found. Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ee86d68b-55db-4563-ac25-e2f20c6e054b tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Request method failure captured: Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 HTTP/1.1 Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qkeFQYRP0ZXioY3jUZpkHD0LrCsLqpctXZeWmx5F3cGtsg_gXp4m02CvRFgLcwtBpx3wD1wG_oH4-AlBgusVD6Q4XAAjjdnvFDVfJ-uY4ZMx_0ww13VX0cTLepiMPKHobAH1qvL7V9Ud22o31DoANDbpLkkTc5czCNxk1uO8Jrmwn0 Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: ced9025cae5c4c43a111119b99ae9233 Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ImagesNegativeTestJSON-1770050483 Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ced9025cae5c4c43a111119b99ae9233"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ced9025cae5c4c43a111119b99ae9233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ced9025cae5c4c43a111119b99ae9233", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ced9025cae5c4c43a111119b99ae9233"}]}] Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ImagesNegativeTestJSON-1770050483 Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: ced9025cae5c4c43a111119b99ae9233 Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1770050483 Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ImagesNegativeTestJSON-1770050483-project Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 7ef2558f586447408bbce6b9b0dcd62f Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ImagesNegativeTestJSON-1770050483-project Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 could not be found. Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '2a13ead5-0102-4ed4-a1d9-42414cd7ffb4'} Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 could not be found. Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 could not be found. Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:20.419487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.425249 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:20.425249 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:20.425249 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:20.425249 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:20.425249 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:20.425249 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 could not be found. Jul 25 14:31:20.425249 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.426679 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ee86d68b-55db-4563-ac25-e2f20c6e054b tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Returning 404 to user: Instance 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:20.427630 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ee86d68b-55db-4563-ac25-e2f20c6e054b tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] 10.222.0.88 "GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4" status: 404 len: 111 microversion: 2.1 time: 0.046359 Jul 25 14:31:20.428387 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 828/1620] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:20 2022] GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:31:20.439045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-ee1a042e-c3c0-45ef-a54a-b8eeaebd9bd5 req-3449ddcb-56a6-4ca8-9f4b-d35ee8aefe7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c", "name": "network-vif-unplugged", "status": "completed", "tag": "eedb59eb-f3ec-476b-a198-201c579f3456"}, {"name": "network-changed", "server_uuid": "5694bd9c-d7e8-4f20-8404-fc5e747c93cd", "tag": "972e03f2-20ce-491f-a29a-2936da24a706"}, {"name": "network-changed", "server_uuid": "395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c", "tag": "eedb59eb-f3ec-476b-a198-201c579f3456"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:20.458494 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ee1a042e-c3c0-45ef-a54a-b8eeaebd9bd5 req-3449ddcb-56a6-4ca8-9f4b-d35ee8aefe7e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:20.460623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ee1a042e-c3c0-45ef-a54a-b8eeaebd9bd5 req-3449ddcb-56a6-4ca8-9f4b-d35ee8aefe7e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:20.483343 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-ee1a042e-c3c0-45ef-a54a-b8eeaebd9bd5 req-3449ddcb-56a6-4ca8-9f4b-d35ee8aefe7e service nova] Creating event network-vif-unplugged:eedb59eb-f3ec-476b-a198-201c579f3456 for instance 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c on n-h1-846435-14 Jul 25 14:31:20.485029 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-ee1a042e-c3c0-45ef-a54a-b8eeaebd9bd5 req-3449ddcb-56a6-4ca8-9f4b-d35ee8aefe7e service nova] Creating event network-changed:972e03f2-20ce-491f-a29a-2936da24a706 for instance 5694bd9c-d7e8-4f20-8404-fc5e747c93cd on n-h2-846435-14 Jul 25 14:31:20.485805 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-ee1a042e-c3c0-45ef-a54a-b8eeaebd9bd5 req-3449ddcb-56a6-4ca8-9f4b-d35ee8aefe7e service nova] Creating event network-changed:eedb59eb-f3ec-476b-a198-201c579f3456 for instance 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c on n-h1-846435-14 Jul 25 14:31:20.497463 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-ee1a042e-c3c0-45ef-a54a-b8eeaebd9bd5 req-3449ddcb-56a6-4ca8-9f4b-d35ee8aefe7e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.067687 Jul 25 14:31:20.498657 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 829/1621] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:20.510349 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-07f5921f-f3c6-4191-9578-b98aa3e5a05a tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1402447621", "metadata": {"image_type": "test"}}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:20.513306 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-07f5921f-f3c6-4191-9578-b98aa3e5a05a tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] [instance: 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:20.533284 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-07f5921f-f3c6-4191-9578-b98aa3e5a05a tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:20.533726 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-07f5921f-f3c6-4191-9578-b98aa3e5a05a tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:20.534502 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-07f5921f-f3c6-4191-9578-b98aa3e5a05a tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:20.535117 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-07f5921f-f3c6-4191-9578-b98aa3e5a05a tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:20.552839 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-07f5921f-f3c6-4191-9578-b98aa3e5a05a tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] HTTP exception thrown: Instance 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 could not be found. Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-07f5921f-f3c6-4191-9578-b98aa3e5a05a tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Request method failure captured: Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4/action HTTP/1.1 Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 112 Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qkeFQYRP0ZXioY3jUZpkHD0LrCsLqpctXZeWmx5F3cGtsg_gXp4m02CvRFgLcwtBpx3wD1wG_oH4-AlBgusVD6Q4XAAjjdnvFDVfJ-uY4ZMx_0ww13VX0cTLepiMPKHobAH1qvL7V9Ud22o31DoANDbpLkkTc5czCNxk1uO8Jrmwn0 Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: ced9025cae5c4c43a111119b99ae9233 Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ImagesNegativeTestJSON-1770050483 Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ced9025cae5c4c43a111119b99ae9233"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ced9025cae5c4c43a111119b99ae9233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ced9025cae5c4c43a111119b99ae9233", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ced9025cae5c4c43a111119b99ae9233"}]}] Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ImagesNegativeTestJSON-1770050483 Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: ced9025cae5c4c43a111119b99ae9233 Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1770050483 Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ImagesNegativeTestJSON-1770050483-project Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 7ef2558f586447408bbce6b9b0dcd62f Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ImagesNegativeTestJSON-1770050483-project Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1402447621", "metadata": {"image_type": "test"}}} Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 could not be found. Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '2a13ead5-0102-4ed4-a1d9-42414cd7ffb4', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1402447621', 'metadata': {'image_type': 'test'}}}} Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 could not be found. Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 25 14:31:20.554190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:31:20.558596 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:31:20.558596 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:31:20.558596 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:31:20.558596 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 could not be found. Jul 25 14:31:20.558596 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.558596 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:20.558596 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.558596 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:20.558596 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:20.558596 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:20.558596 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:20.558596 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:20.558596 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 could not be found. Jul 25 14:31:20.558596 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.558596 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-07f5921f-f3c6-4191-9578-b98aa3e5a05a tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Returning 404 to user: Instance 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:20.558596 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-07f5921f-f3c6-4191-9578-b98aa3e5a05a tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] 10.222.0.88 "POST /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4/action" status: 404 len: 111 microversion: 2.1 time: 0.055322 Jul 25 14:31:20.558596 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 830/1622] 10.222.0.88 () {60 vars in 1279 bytes} [Mon Jul 25 14:31:20 2022] POST /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:31:20.570507 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-82c7cf9c-f683-494c-9476-27413e27c78c tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-816698793", "metadata": {"image_type": "test"}}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:20.574201 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-82c7cf9c-f683-494c-9476-27413e27c78c tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Failed to fetch instance by id tempest-invalid-1755669419 {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 25 14:31:20.575179 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-82c7cf9c-f683-494c-9476-27413e27c78c tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] HTTP exception thrown: Instance tempest-invalid-1755669419 could not be found. Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-82c7cf9c-f683-494c-9476-27413e27c78c tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Request method failure captured: Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers/tempest-invalid-1755669419/action HTTP/1.1 Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 111 Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qkeFQYRP0ZXioY3jUZpkHD0LrCsLqpctXZeWmx5F3cGtsg_gXp4m02CvRFgLcwtBpx3wD1wG_oH4-AlBgusVD6Q4XAAjjdnvFDVfJ-uY4ZMx_0ww13VX0cTLepiMPKHobAH1qvL7V9Ud22o31DoANDbpLkkTc5czCNxk1uO8Jrmwn0 Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: ced9025cae5c4c43a111119b99ae9233 Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ImagesNegativeTestJSON-1770050483 Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ced9025cae5c4c43a111119b99ae9233"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ced9025cae5c4c43a111119b99ae9233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ced9025cae5c4c43a111119b99ae9233", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ced9025cae5c4c43a111119b99ae9233"}]}] Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ImagesNegativeTestJSON-1770050483 Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: ced9025cae5c4c43a111119b99ae9233 Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1770050483 Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ImagesNegativeTestJSON-1770050483-project Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 7ef2558f586447408bbce6b9b0dcd62f Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ImagesNegativeTestJSON-1770050483-project Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-816698793", "metadata": {"image_type": "test"}}} Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance tempest-invalid-1755669419 could not be found. Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'tempest-invalid-1755669419', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-816698793', 'metadata': {'image_type': 'test'}}}} Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1755669419 could not be found. Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:31:20.577582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1755669419 could not be found. Jul 25 14:31:20.581822 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.581822 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:20.581822 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.581822 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:20.581822 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:20.581822 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:20.581822 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:20.581822 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:20.581822 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1755669419 could not be found. Jul 25 14:31:20.581822 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.581822 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-82c7cf9c-f683-494c-9476-27413e27c78c tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Returning 404 to user: Instance tempest-invalid-1755669419 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:20.581822 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-82c7cf9c-f683-494c-9476-27413e27c78c tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] 10.222.0.88 "POST /compute/v2.1/servers/tempest-invalid-1755669419/action" status: 404 len: 101 microversion: 2.1 time: 0.014814 Jul 25 14:31:20.587779 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 831/1623] 10.222.0.88 () {60 vars in 1249 bytes} [Mon Jul 25 14:31:20 2022] POST /compute/v2.1/servers/tempest-invalid-1755669419/action => generated 101 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:31:20.592658 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-39843475-ddbe-4b36-9326-7eb435acc49c tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1801287508"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:20.595745 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-39843475-ddbe-4b36-9326-7eb435acc49c tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 25 14:31:20.596656 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-39843475-ddbe-4b36-9326-7eb435acc49c tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-39843475-ddbe-4b36-9326-7eb435acc49c tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Request method failure captured: Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 57 Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qkeFQYRP0ZXioY3jUZpkHD0LrCsLqpctXZeWmx5F3cGtsg_gXp4m02CvRFgLcwtBpx3wD1wG_oH4-AlBgusVD6Q4XAAjjdnvFDVfJ-uY4ZMx_0ww13VX0cTLepiMPKHobAH1qvL7V9Ud22o31DoANDbpLkkTc5czCNxk1uO8Jrmwn0 Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: ced9025cae5c4c43a111119b99ae9233 Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ImagesNegativeTestJSON-1770050483 Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ced9025cae5c4c43a111119b99ae9233"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ced9025cae5c4c43a111119b99ae9233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ced9025cae5c4c43a111119b99ae9233", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ced9025cae5c4c43a111119b99ae9233"}]}] Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ImagesNegativeTestJSON-1770050483 Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: ced9025cae5c4c43a111119b99ae9233 Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1770050483 Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ImagesNegativeTestJSON-1770050483-project Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 7ef2558f586447408bbce6b9b0dcd62f Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ImagesNegativeTestJSON-1770050483-project Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: {"createImage": {"name": "tempest-test-snap-1801287508"}} Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1801287508'}}} Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 14:31:20.599953 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.604477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:20.604477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.604477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:20.604477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:20.604477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:20.604477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:20.604477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:20.604477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 14:31:20.604477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.604477 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-39843475-ddbe-4b36-9326-7eb435acc49c tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:20.604477 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-39843475-ddbe-4b36-9326-7eb435acc49c tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] 10.222.0.88 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.012414 Jul 25 14:31:20.607245 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 832/1624] 10.222.0.88 () {60 vars in 1275 bytes} [Mon Jul 25 14:31:20 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:31:20.611405 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-14b6ee88-dcdd-40e7-911c-8459f965678b tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2025336355"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:20.613883 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-14b6ee88-dcdd-40e7-911c-8459f965678b tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 25 14:31:20.614397 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-14b6ee88-dcdd-40e7-911c-8459f965678b tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-14b6ee88-dcdd-40e7-911c-8459f965678b tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Request method failure captured: Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 57 Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qkeFQYRP0ZXioY3jUZpkHD0LrCsLqpctXZeWmx5F3cGtsg_gXp4m02CvRFgLcwtBpx3wD1wG_oH4-AlBgusVD6Q4XAAjjdnvFDVfJ-uY4ZMx_0ww13VX0cTLepiMPKHobAH1qvL7V9Ud22o31DoANDbpLkkTc5czCNxk1uO8Jrmwn0 Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: ced9025cae5c4c43a111119b99ae9233 Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ImagesNegativeTestJSON-1770050483 Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ced9025cae5c4c43a111119b99ae9233"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ced9025cae5c4c43a111119b99ae9233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ced9025cae5c4c43a111119b99ae9233", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ced9025cae5c4c43a111119b99ae9233"}]}] Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ImagesNegativeTestJSON-1770050483 Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: ced9025cae5c4c43a111119b99ae9233 Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1770050483 Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ImagesNegativeTestJSON-1770050483-project Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 7ef2558f586447408bbce6b9b0dcd62f Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ImagesNegativeTestJSON-1770050483-project Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: {"createImage": {"name": "tempest-test-snap-2025336355"}} Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-2025336355'}}} Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 14:31:20.615951 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.623391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:20.623391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.623391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:20.623391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:20.623391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:20.623391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:20.623391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:20.623391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 14:31:20.623391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.623391 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-14b6ee88-dcdd-40e7-911c-8459f965678b tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:20.623391 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-14b6ee88-dcdd-40e7-911c-8459f965678b tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] 10.222.0.88 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.010253 Jul 25 14:31:20.623391 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 833/1625] 10.222.0.88 () {60 vars in 1281 bytes} [Mon Jul 25 14:31:20 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:31:20.627857 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-661133fa-52d4-42d9-a605-5dadf65f6870 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:20.628800 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-661133fa-52d4-42d9-a605-5dadf65f6870 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] [instance: 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:20.636125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-661133fa-52d4-42d9-a605-5dadf65f6870 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:20.636613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-661133fa-52d4-42d9-a605-5dadf65f6870 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:20.637364 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-661133fa-52d4-42d9-a605-5dadf65f6870 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:20.637893 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-661133fa-52d4-42d9-a605-5dadf65f6870 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:20.652238 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-661133fa-52d4-42d9-a605-5dadf65f6870 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] HTTP exception thrown: Instance 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 could not be found. Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-661133fa-52d4-42d9-a605-5dadf65f6870 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Request method failure captured: Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 HTTP/1.1 Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qkeFQYRP0ZXioY3jUZpkHD0LrCsLqpctXZeWmx5F3cGtsg_gXp4m02CvRFgLcwtBpx3wD1wG_oH4-AlBgusVD6Q4XAAjjdnvFDVfJ-uY4ZMx_0ww13VX0cTLepiMPKHobAH1qvL7V9Ud22o31DoANDbpLkkTc5czCNxk1uO8Jrmwn0 Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: ced9025cae5c4c43a111119b99ae9233 Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ImagesNegativeTestJSON-1770050483 Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ced9025cae5c4c43a111119b99ae9233"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ced9025cae5c4c43a111119b99ae9233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ced9025cae5c4c43a111119b99ae9233", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ced9025cae5c4c43a111119b99ae9233"}]}] Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ImagesNegativeTestJSON-1770050483 Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: ced9025cae5c4c43a111119b99ae9233 Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1770050483 Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ImagesNegativeTestJSON-1770050483-project Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 7ef2558f586447408bbce6b9b0dcd62f Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ImagesNegativeTestJSON-1770050483-project Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 could not be found. Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '2a13ead5-0102-4ed4-a1d9-42414cd7ffb4'} Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 could not be found. Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:31:20.653880 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:31:20.662464 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 could not be found. Jul 25 14:31:20.662464 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.662464 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:20.662464 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.662464 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:20.662464 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:20.662464 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:20.662464 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:20.662464 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:20.662464 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 could not be found. Jul 25 14:31:20.662464 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.662464 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-661133fa-52d4-42d9-a605-5dadf65f6870 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Returning 404 to user: Instance 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:20.662464 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-661133fa-52d4-42d9-a605-5dadf65f6870 tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] 10.222.0.88 "DELETE /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4" status: 404 len: 111 microversion: 2.1 time: 0.031394 Jul 25 14:31:20.662464 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 834/1626] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:31:20 2022] DELETE /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:31:20.667930 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0112c570-2788-4165-91f5-8b63f8d0adfa tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:20.668626 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0112c570-2788-4165-91f5-8b63f8d0adfa tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] [instance: 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:20.674878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0112c570-2788-4165-91f5-8b63f8d0adfa tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:20.675320 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0112c570-2788-4165-91f5-8b63f8d0adfa tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:20.676135 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0112c570-2788-4165-91f5-8b63f8d0adfa tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:20.676572 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0112c570-2788-4165-91f5-8b63f8d0adfa tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:20.691889 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-0112c570-2788-4165-91f5-8b63f8d0adfa tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] HTTP exception thrown: Instance 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 could not be found. Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0112c570-2788-4165-91f5-8b63f8d0adfa tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Request method failure captured: Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 HTTP/1.1 Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qkeFQYRP0ZXioY3jUZpkHD0LrCsLqpctXZeWmx5F3cGtsg_gXp4m02CvRFgLcwtBpx3wD1wG_oH4-AlBgusVD6Q4XAAjjdnvFDVfJ-uY4ZMx_0ww13VX0cTLepiMPKHobAH1qvL7V9Ud22o31DoANDbpLkkTc5czCNxk1uO8Jrmwn0 Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: ced9025cae5c4c43a111119b99ae9233 Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ImagesNegativeTestJSON-1770050483 Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ced9025cae5c4c43a111119b99ae9233"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ced9025cae5c4c43a111119b99ae9233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ced9025cae5c4c43a111119b99ae9233", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ced9025cae5c4c43a111119b99ae9233"}]}] Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ImagesNegativeTestJSON-1770050483 Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: ced9025cae5c4c43a111119b99ae9233 Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1770050483 Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ImagesNegativeTestJSON-1770050483-project Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 7ef2558f586447408bbce6b9b0dcd62f Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ImagesNegativeTestJSON-1770050483-project Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 could not be found. Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '2a13ead5-0102-4ed4-a1d9-42414cd7ffb4'} Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 could not be found. Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 could not be found. Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:20.693452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.700679 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:20.700679 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:20.700679 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:20.700679 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:20.700679 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:20.700679 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 could not be found. Jul 25 14:31:20.700679 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:20.701750 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f0b29b42-fd70-4c1b-b803-cd3fadf199b3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:20.701859 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0112c570-2788-4165-91f5-8b63f8d0adfa tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] Returning 404 to user: Instance 2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:20.708825 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0112c570-2788-4165-91f5-8b63f8d0adfa tempest-ImagesNegativeTestJSON-1770050483 tempest-ImagesNegativeTestJSON-1770050483-project] 10.222.0.88 "GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4" status: 404 len: 111 microversion: 2.1 time: 0.048269 Jul 25 14:31:20.709243 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 835/1627] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:20 2022] GET /compute/v2.1/servers/2a13ead5-0102-4ed4-a1d9-42414cd7ffb4 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:31:20.715130 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f0b29b42-fd70-4c1b-b803-cd3fadf199b3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:20.717858 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f0b29b42-fd70-4c1b-b803-cd3fadf199b3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:20.719824 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f0b29b42-fd70-4c1b-b803-cd3fadf199b3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1814 microversion: 2.25 time: 0.385058 Jul 25 14:31:20.720535 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 793/1628] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:31:20 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1814 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:31:20.889711 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-080cbc9b-1d10-446b-8c6c-428bdf462aed tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:20.890578 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-080cbc9b-1d10-446b-8c6c-428bdf462aed tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:20.899534 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-080cbc9b-1d10-446b-8c6c-428bdf462aed tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:20.900259 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-080cbc9b-1d10-446b-8c6c-428bdf462aed tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:20.901631 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-080cbc9b-1d10-446b-8c6c-428bdf462aed tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:20.904278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-080cbc9b-1d10-446b-8c6c-428bdf462aed tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:21.297861 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e531f2ec-8223-49c0-b622-c21d4d357853 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:21.299067 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e531f2ec-8223-49c0-b622-c21d4d357853 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:21.309538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e531f2ec-8223-49c0-b622-c21d4d357853 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:21.309762 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-080cbc9b-1d10-446b-8c6c-428bdf462aed tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:21.313363 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e531f2ec-8223-49c0-b622-c21d4d357853 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:21.314428 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e531f2ec-8223-49c0-b622-c21d4d357853 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:21.315764 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e531f2ec-8223-49c0-b622-c21d4d357853 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:21.329335 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-080cbc9b-1d10-446b-8c6c-428bdf462aed tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1515 microversion: 2.1 time: 0.448596 Jul 25 14:31:21.330696 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 836/1629] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:20 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1515 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:21.343330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b4024426-1e2c-4a38-9cc8-fd2aa62b0e71 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:21.344283 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b4024426-1e2c-4a38-9cc8-fd2aa62b0e71 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:21.355330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b4024426-1e2c-4a38-9cc8-fd2aa62b0e71 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:21.356138 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b4024426-1e2c-4a38-9cc8-fd2aa62b0e71 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:21.357150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b4024426-1e2c-4a38-9cc8-fd2aa62b0e71 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:21.358468 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b4024426-1e2c-4a38-9cc8-fd2aa62b0e71 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:21.604114 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e531f2ec-8223-49c0-b622-c21d4d357853 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:21.612611 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e531f2ec-8223-49c0-b622-c21d4d357853 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd" status: 200 len: 1503 microversion: 2.1 time: 0.318830 Jul 25 14:31:21.613212 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 794/1630] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:21 2022] GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd => generated 1503 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:31:21.622300 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6cf49228-930b-41e7-aa88-062e58949e8f tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-447155232", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "662b1ab1-6b2a-4812-9411-33027479cf08"}], "security_groups": [{"name": "tempest-securitygroup--49051933"}], "key_name": "tempest-keypair-709633153", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:21.731287 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b4024426-1e2c-4a38-9cc8-fd2aa62b0e71 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:21.742609 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b4024426-1e2c-4a38-9cc8-fd2aa62b0e71 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1469 microversion: 2.1 time: 0.410850 Jul 25 14:31:21.743534 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 837/1631] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:21 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1469 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:21.751238 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dc848ea3-b3f8-492b-97aa-79822cde687a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:21.752068 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dc848ea3-b3f8-492b-97aa-79822cde687a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:21.783138 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dc848ea3-b3f8-492b-97aa-79822cde687a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:21.783878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dc848ea3-b3f8-492b-97aa-79822cde687a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:21.785022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dc848ea3-b3f8-492b-97aa-79822cde687a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:21.786206 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dc848ea3-b3f8-492b-97aa-79822cde687a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:21.797814 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-6cf49228-930b-41e7-aa88-062e58949e8f tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] validate_networks() for [('662b1ab1-6b2a-4812-9411-33027479cf08', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:31:22.126161 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dc848ea3-b3f8-492b-97aa-79822cde687a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:22.136330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dc848ea3-b3f8-492b-97aa-79822cde687a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:22.138379 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dc848ea3-b3f8-492b-97aa-79822cde687a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:22.139746 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dc848ea3-b3f8-492b-97aa-79822cde687a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1814 microversion: 2.25 time: 0.392711 Jul 25 14:31:22.140457 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 838/1632] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:31:21 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1814 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:31:22.358716 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-101befb0-ddb1-41d7-9403-c0dc610a1cf7 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:22.359457 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-101befb0-ddb1-41d7-9403-c0dc610a1cf7 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:22.363225 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:31:22.367073 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-101befb0-ddb1-41d7-9403-c0dc610a1cf7 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:22.367538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-101befb0-ddb1-41d7-9403-c0dc610a1cf7 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:22.368397 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-101befb0-ddb1-41d7-9403-c0dc610a1cf7 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:22.368821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-101befb0-ddb1-41d7-9403-c0dc610a1cf7 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:22.422226 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-6cf49228-930b-41e7-aa88-062e58949e8f tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Getting quotas for project 01423e9ea2b94eef87188b26f99f9ae4. Resources: dict_keys(['metadata_items']) {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:31:22.438835 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-6cf49228-930b-41e7-aa88-062e58949e8f tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Getting quotas for user 2bd9f6ef6ef34b51a55bb71f5d06040d and project 01423e9ea2b94eef87188b26f99f9ae4. Resources: dict_keys(['metadata_items']) {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:31:22.465980 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-6cf49228-930b-41e7-aa88-062e58949e8f tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:31:22.466411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-6cf49228-930b-41e7-aa88-062e58949e8f tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:31:22.466889 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-6cf49228-930b-41e7-aa88-062e58949e8f tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:31:22.467300 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-6cf49228-930b-41e7-aa88-062e58949e8f tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:31:22.467728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-6cf49228-930b-41e7-aa88-062e58949e8f tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:31:22.476504 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6cf49228-930b-41e7-aa88-062e58949e8f tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:22.476959 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6cf49228-930b-41e7-aa88-062e58949e8f tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:22.477762 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6cf49228-930b-41e7-aa88-062e58949e8f tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:22.478189 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6cf49228-930b-41e7-aa88-062e58949e8f tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:22.494938 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-6cf49228-930b-41e7-aa88-062e58949e8f tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Getting quotas for project 01423e9ea2b94eef87188b26f99f9ae4. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:31:22.500314 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-6cf49228-930b-41e7-aa88-062e58949e8f tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Getting quotas for user 2bd9f6ef6ef34b51a55bb71f5d06040d and project 01423e9ea2b94eef87188b26f99f9ae4. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:31:22.513420 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6cf49228-930b-41e7-aa88-062e58949e8f tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:31:22.515754 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6cf49228-930b-41e7-aa88-062e58949e8f tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] [instance: a1ee79ec-d346-42f8-ae58-06b110abdef0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:31:22.563215 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6cf49228-930b-41e7-aa88-062e58949e8f tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.948603 Jul 25 14:31:22.564110 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 795/1633] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:31:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:31:22.575121 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-706d8603-eb33-4dcc-89be-b74320064baa tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:22.576007 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-706d8603-eb33-4dcc-89be-b74320064baa tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] [instance: a1ee79ec-d346-42f8-ae58-06b110abdef0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:22.636932 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-706d8603-eb33-4dcc-89be-b74320064baa tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd9f6ef6ef34b51a55bb71f5d06040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01423e9ea2b94eef87188b26f99f9ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:22.644937 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-706d8603-eb33-4dcc-89be-b74320064baa tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] 10.222.0.88 "GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0" status: 200 len: 1268 microversion: 2.1 time: 0.074165 Jul 25 14:31:22.646277 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 796/1634] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:22 2022] GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0 => generated 1268 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:22.651771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-203d6673-405d-44b0-8a12-a3e06a2cbf7a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:22.652418 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-203d6673-405d-44b0-8a12-a3e06a2cbf7a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:22.659030 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-203d6673-405d-44b0-8a12-a3e06a2cbf7a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:22.659488 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-203d6673-405d-44b0-8a12-a3e06a2cbf7a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:22.660301 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-203d6673-405d-44b0-8a12-a3e06a2cbf7a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:22.660743 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-203d6673-405d-44b0-8a12-a3e06a2cbf7a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:22.858928 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-203d6673-405d-44b0-8a12-a3e06a2cbf7a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:22.868844 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-203d6673-405d-44b0-8a12-a3e06a2cbf7a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd" status: 200 len: 1503 microversion: 2.1 time: 0.221207 Jul 25 14:31:22.869560 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 797/1635] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:22 2022] GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd => generated 1503 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:22.874509 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5f49f7b9-6fe0-4dd3-bdec-b87a1dc7d9b6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:22.876142 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5f49f7b9-6fe0-4dd3-bdec-b87a1dc7d9b6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:22.886334 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f49f7b9-6fe0-4dd3-bdec-b87a1dc7d9b6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:22.887094 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f49f7b9-6fe0-4dd3-bdec-b87a1dc7d9b6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:22.889235 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f49f7b9-6fe0-4dd3-bdec-b87a1dc7d9b6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:22.889906 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f49f7b9-6fe0-4dd3-bdec-b87a1dc7d9b6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:22.913146 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-101befb0-ddb1-41d7-9403-c0dc610a1cf7 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:22.922844 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-101befb0-ddb1-41d7-9403-c0dc610a1cf7 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1515 microversion: 2.1 time: 0.568669 Jul 25 14:31:22.936950 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 839/1636] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:22 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1515 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:23.168229 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e042f8a1-f219-46f1-ad66-784826b0d43d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:23.169336 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e042f8a1-f219-46f1-ad66-784826b0d43d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:23.178520 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e042f8a1-f219-46f1-ad66-784826b0d43d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:23.179337 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e042f8a1-f219-46f1-ad66-784826b0d43d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:23.181597 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e042f8a1-f219-46f1-ad66-784826b0d43d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:23.182472 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e042f8a1-f219-46f1-ad66-784826b0d43d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:23.209167 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5f49f7b9-6fe0-4dd3-bdec-b87a1dc7d9b6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:23.228163 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5f49f7b9-6fe0-4dd3-bdec-b87a1dc7d9b6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1469 microversion: 2.1 time: 0.357076 Jul 25 14:31:23.229562 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 798/1637] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:22 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1469 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:23.566646 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e042f8a1-f219-46f1-ad66-784826b0d43d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:23.578531 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e042f8a1-f219-46f1-ad66-784826b0d43d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:23.580224 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e042f8a1-f219-46f1-ad66-784826b0d43d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:23.581869 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e042f8a1-f219-46f1-ad66-784826b0d43d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1814 microversion: 2.25 time: 0.422191 Jul 25 14:31:23.582725 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 840/1638] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:31:23 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1814 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:31:23.666538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7ab49870-edb0-4e8a-a75f-cdd709d3f7ab tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:23.667822 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7ab49870-edb0-4e8a-a75f-cdd709d3f7ab tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] [instance: a1ee79ec-d346-42f8-ae58-06b110abdef0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:23.675223 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ab49870-edb0-4e8a-a75f-cdd709d3f7ab tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:23.675687 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ab49870-edb0-4e8a-a75f-cdd709d3f7ab tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:23.676499 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ab49870-edb0-4e8a-a75f-cdd709d3f7ab tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:23.677110 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ab49870-edb0-4e8a-a75f-cdd709d3f7ab tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:23.760381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7ab49870-edb0-4e8a-a75f-cdd709d3f7ab tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd9f6ef6ef34b51a55bb71f5d06040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01423e9ea2b94eef87188b26f99f9ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:23.770521 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7ab49870-edb0-4e8a-a75f-cdd709d3f7ab tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] 10.222.0.88 "GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0" status: 200 len: 1320 microversion: 2.1 time: 0.108227 Jul 25 14:31:23.784780 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 799/1639] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:23 2022] GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0 => generated 1320 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:23.893074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0b902348-6a31-44fc-9a0c-ed207a9d00f2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:23.894223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0b902348-6a31-44fc-9a0c-ed207a9d00f2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:23.906695 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b902348-6a31-44fc-9a0c-ed207a9d00f2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:23.907540 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b902348-6a31-44fc-9a0c-ed207a9d00f2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:23.908934 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b902348-6a31-44fc-9a0c-ed207a9d00f2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:23.912599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b902348-6a31-44fc-9a0c-ed207a9d00f2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:23.946978 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a84f01d6-5605-4a0c-9220-a50c4e7e35a0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:23.948041 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a84f01d6-5605-4a0c-9220-a50c4e7e35a0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:23.964930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a84f01d6-5605-4a0c-9220-a50c4e7e35a0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:23.967639 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a84f01d6-5605-4a0c-9220-a50c4e7e35a0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:23.968699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a84f01d6-5605-4a0c-9220-a50c4e7e35a0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:23.976672 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a84f01d6-5605-4a0c-9220-a50c4e7e35a0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:24.567767 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0b902348-6a31-44fc-9a0c-ed207a9d00f2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:24.574979 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a84f01d6-5605-4a0c-9220-a50c4e7e35a0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:24.580263 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0b902348-6a31-44fc-9a0c-ed207a9d00f2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd" status: 200 len: 1503 microversion: 2.1 time: 0.692254 Jul 25 14:31:24.583642 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a84f01d6-5605-4a0c-9220-a50c4e7e35a0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1515 microversion: 2.1 time: 0.641621 Jul 25 14:31:24.583888 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 841/1640] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:23 2022] GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd => generated 1503 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:24.584245 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 800/1641] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:23 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1515 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:24.590735 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8e05894c-e024-438d-9456-21649cb1697b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:24.591460 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8e05894c-e024-438d-9456-21649cb1697b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:24.607197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e05894c-e024-438d-9456-21649cb1697b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:24.607402 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3e070d58-a44f-41e8-bdef-d669831bd381 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:24.607898 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3e070d58-a44f-41e8-bdef-d669831bd381 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:24.609941 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e05894c-e024-438d-9456-21649cb1697b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:24.610877 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e05894c-e024-438d-9456-21649cb1697b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:24.616207 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e05894c-e024-438d-9456-21649cb1697b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:24.620177 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3e070d58-a44f-41e8-bdef-d669831bd381 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:24.620989 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3e070d58-a44f-41e8-bdef-d669831bd381 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:24.623766 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3e070d58-a44f-41e8-bdef-d669831bd381 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:24.624252 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3e070d58-a44f-41e8-bdef-d669831bd381 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:24.972089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8e05894c-e024-438d-9456-21649cb1697b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:24.985849 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8e05894c-e024-438d-9456-21649cb1697b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1469 microversion: 2.1 time: 0.400533 Jul 25 14:31:24.987365 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 842/1642] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:24 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1469 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:25.003538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3b13d881-497a-4070-8f2d-5423523b9895 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:25.004194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3b13d881-497a-4070-8f2d-5423523b9895 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] [instance: a1ee79ec-d346-42f8-ae58-06b110abdef0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:25.013232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b13d881-497a-4070-8f2d-5423523b9895 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:25.013919 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b13d881-497a-4070-8f2d-5423523b9895 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:25.014942 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b13d881-497a-4070-8f2d-5423523b9895 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:25.015797 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b13d881-497a-4070-8f2d-5423523b9895 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:25.391103 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3e070d58-a44f-41e8-bdef-d669831bd381 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:25.394801 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3b13d881-497a-4070-8f2d-5423523b9895 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd9f6ef6ef34b51a55bb71f5d06040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01423e9ea2b94eef87188b26f99f9ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:25.401103 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3e070d58-a44f-41e8-bdef-d669831bd381 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:25.403856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3e070d58-a44f-41e8-bdef-d669831bd381 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:25.405793 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3e070d58-a44f-41e8-bdef-d669831bd381 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1814 microversion: 2.25 time: 0.803713 Jul 25 14:31:25.417214 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3b13d881-497a-4070-8f2d-5423523b9895 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] 10.222.0.88 "GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0" status: 200 len: 1326 microversion: 2.1 time: 0.428401 Jul 25 14:31:25.418970 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 843/1643] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:24 2022] GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0 => generated 1326 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:25.422509 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 801/1644] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:31:24 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1814 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:31:25.602016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-11445256-4e8b-4742-8097-04840714c1d1 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:25.608796 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-57b7c7f2-3401-4f2e-9beb-8ea61fcdec50 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:25.609729 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-57b7c7f2-3401-4f2e-9beb-8ea61fcdec50 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:25.612858 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-11445256-4e8b-4742-8097-04840714c1d1 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:25.623393 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11445256-4e8b-4742-8097-04840714c1d1 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:25.624192 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57b7c7f2-3401-4f2e-9beb-8ea61fcdec50 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:25.624840 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57b7c7f2-3401-4f2e-9beb-8ea61fcdec50 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:25.625481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11445256-4e8b-4742-8097-04840714c1d1 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:25.626500 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57b7c7f2-3401-4f2e-9beb-8ea61fcdec50 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:25.627498 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11445256-4e8b-4742-8097-04840714c1d1 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:25.628161 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57b7c7f2-3401-4f2e-9beb-8ea61fcdec50 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:25.628788 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11445256-4e8b-4742-8097-04840714c1d1 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:25.988025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-11445256-4e8b-4742-8097-04840714c1d1 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:26.002986 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-11445256-4e8b-4742-8097-04840714c1d1 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd" status: 200 len: 1503 microversion: 2.1 time: 0.405409 Jul 25 14:31:26.004218 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 844/1645] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:25 2022] GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd => generated 1503 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:26.009713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-2d555c53-71d1-4cf3-84ec-4d467db3fa03 req-9649a511-1de3-483c-a68a-95e81bfe2b84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "115f3b11-988d-43c1-a81f-998139d12448", "name": "network-vif-unplugged", "status": "completed", "tag": "f9ae53b2-7ccb-46f9-b164-3d57e251cc2f"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:26.021209 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-2d555c53-71d1-4cf3-84ec-4d467db3fa03 req-9649a511-1de3-483c-a68a-95e81bfe2b84 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:26.021655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-2d555c53-71d1-4cf3-84ec-4d467db3fa03 req-9649a511-1de3-483c-a68a-95e81bfe2b84 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:26.034764 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-2d555c53-71d1-4cf3-84ec-4d467db3fa03 req-9649a511-1de3-483c-a68a-95e81bfe2b84 service nova] Creating event network-vif-unplugged:f9ae53b2-7ccb-46f9-b164-3d57e251cc2f for instance 115f3b11-988d-43c1-a81f-998139d12448 on n-h2-846435-14 Jul 25 14:31:26.047082 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [req-2d555c53-71d1-4cf3-84ec-4d467db3fa03 req-9649a511-1de3-483c-a68a-95e81bfe2b84 service nova] Instance 115f3b11-988d-43c1-a81f-998139d12448 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119304) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 14:31:26.058262 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-2d555c53-71d1-4cf3-84ec-4d467db3fa03 req-9649a511-1de3-483c-a68a-95e81bfe2b84 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052352 Jul 25 14:31:26.058878 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 845/1646] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:26.064358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f52d6c9c-0b9c-489b-81d1-5cd7c61faeb5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:26.065303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f52d6c9c-0b9c-489b-81d1-5cd7c61faeb5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:26.071628 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f52d6c9c-0b9c-489b-81d1-5cd7c61faeb5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:26.072100 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f52d6c9c-0b9c-489b-81d1-5cd7c61faeb5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:26.072929 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f52d6c9c-0b9c-489b-81d1-5cd7c61faeb5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:26.073367 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f52d6c9c-0b9c-489b-81d1-5cd7c61faeb5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:26.119833 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-57b7c7f2-3401-4f2e-9beb-8ea61fcdec50 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:26.132896 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-57b7c7f2-3401-4f2e-9beb-8ea61fcdec50 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1515 microversion: 2.1 time: 0.528017 Jul 25 14:31:26.135378 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 802/1647] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:25 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1515 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:26.430672 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e09ffe26-ef7b-4983-b823-e45d749b900a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:26.432500 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e09ffe26-ef7b-4983-b823-e45d749b900a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:26.439890 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e09ffe26-ef7b-4983-b823-e45d749b900a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:26.453338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e09ffe26-ef7b-4983-b823-e45d749b900a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:26.454242 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e09ffe26-ef7b-4983-b823-e45d749b900a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:26.454690 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e09ffe26-ef7b-4983-b823-e45d749b900a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:26.624370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f52d6c9c-0b9c-489b-81d1-5cd7c61faeb5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:26.639961 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f52d6c9c-0b9c-489b-81d1-5cd7c61faeb5 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1469 microversion: 2.1 time: 0.579565 Jul 25 14:31:26.641508 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 846/1648] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:26 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1469 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:26.647330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b0aa2002-dfbd-494e-95ec-7f3a5c8a10ba tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:26.652284 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b0aa2002-dfbd-494e-95ec-7f3a5c8a10ba tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] [instance: a1ee79ec-d346-42f8-ae58-06b110abdef0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:26.670802 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0aa2002-dfbd-494e-95ec-7f3a5c8a10ba tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:26.680499 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0aa2002-dfbd-494e-95ec-7f3a5c8a10ba tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:26.683151 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0aa2002-dfbd-494e-95ec-7f3a5c8a10ba tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:26.683772 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0aa2002-dfbd-494e-95ec-7f3a5c8a10ba tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:27.109182 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b0aa2002-dfbd-494e-95ec-7f3a5c8a10ba tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd9f6ef6ef34b51a55bb71f5d06040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01423e9ea2b94eef87188b26f99f9ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:27.111939 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:31:27.122074 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b0aa2002-dfbd-494e-95ec-7f3a5c8a10ba tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] 10.222.0.88 "GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0" status: 200 len: 1392 microversion: 2.1 time: 0.479451 Jul 25 14:31:27.122880 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 847/1649] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:26 2022] GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0 => generated 1392 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:27.141383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-38d36cc8-fbcf-4af4-b838-7060bce79d81 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:27.142338 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-38d36cc8-fbcf-4af4-b838-7060bce79d81 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:27.149926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-38d36cc8-fbcf-4af4-b838-7060bce79d81 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:27.151668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-38d36cc8-fbcf-4af4-b838-7060bce79d81 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:27.152784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-38d36cc8-fbcf-4af4-b838-7060bce79d81 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:27.153518 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-38d36cc8-fbcf-4af4-b838-7060bce79d81 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:27.156959 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e09ffe26-ef7b-4983-b823-e45d749b900a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:27.218753 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e09ffe26-ef7b-4983-b823-e45d749b900a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:27.223694 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e09ffe26-ef7b-4983-b823-e45d749b900a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:27.230523 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e09ffe26-ef7b-4983-b823-e45d749b900a tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1814 microversion: 2.25 time: 0.805248 Jul 25 14:31:27.234108 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 803/1650] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:31:26 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1814 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:31:27.247695 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b6b590eb-ed87-46db-a658-caae57ceac53 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:27.248568 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b6b590eb-ed87-46db-a658-caae57ceac53 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:27.255626 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b6b590eb-ed87-46db-a658-caae57ceac53 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:27.256396 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b6b590eb-ed87-46db-a658-caae57ceac53 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:27.258719 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b6b590eb-ed87-46db-a658-caae57ceac53 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:27.260132 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b6b590eb-ed87-46db-a658-caae57ceac53 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:27.618117 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-38d36cc8-fbcf-4af4-b838-7060bce79d81 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:27.628408 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-38d36cc8-fbcf-4af4-b838-7060bce79d81 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd" status: 200 len: 1503 microversion: 2.1 time: 0.491515 Jul 25 14:31:27.645142 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 848/1651] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:27 2022] GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd => generated 1503 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:27.809272 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d574e7a5-83ac-4b2c-8152-e1f9abdae921 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:27.810287 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d574e7a5-83ac-4b2c-8152-e1f9abdae921 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:27.832486 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d574e7a5-83ac-4b2c-8152-e1f9abdae921 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:27.835821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d574e7a5-83ac-4b2c-8152-e1f9abdae921 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:27.836811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d574e7a5-83ac-4b2c-8152-e1f9abdae921 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:27.839359 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d574e7a5-83ac-4b2c-8152-e1f9abdae921 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:28.089783 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d574e7a5-83ac-4b2c-8152-e1f9abdae921 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:28.098601 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d574e7a5-83ac-4b2c-8152-e1f9abdae921 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1469 microversion: 2.1 time: 0.440333 Jul 25 14:31:28.099541 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 849/1652] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:27 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1469 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:31:28.111054 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-f70618b5-9d73-4a0c-aee5-b771bd91aeb1 req-dd36451f-1513-4e0a-a90e-865d024e6eaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5694bd9c-d7e8-4f20-8404-fc5e747c93cd", "name": "network-vif-unplugged", "status": "completed", "tag": "972e03f2-20ce-491f-a29a-2936da24a706"}, {"name": "network-changed", "server_uuid": "115f3b11-988d-43c1-a81f-998139d12448", "tag": "f9ae53b2-7ccb-46f9-b164-3d57e251cc2f"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:28.132003 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-f70618b5-9d73-4a0c-aee5-b771bd91aeb1 req-dd36451f-1513-4e0a-a90e-865d024e6eaf service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:28.132618 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-f70618b5-9d73-4a0c-aee5-b771bd91aeb1 req-dd36451f-1513-4e0a-a90e-865d024e6eaf service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:28.156898 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b6b590eb-ed87-46db-a658-caae57ceac53 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:28.177002 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b6b590eb-ed87-46db-a658-caae57ceac53 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1515 microversion: 2.1 time: 0.940595 Jul 25 14:31:28.177682 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 804/1653] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:27 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1515 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:28.177968 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-f70618b5-9d73-4a0c-aee5-b771bd91aeb1 req-dd36451f-1513-4e0a-a90e-865d024e6eaf service nova] Creating event network-vif-unplugged:972e03f2-20ce-491f-a29a-2936da24a706 for instance 5694bd9c-d7e8-4f20-8404-fc5e747c93cd on n-h2-846435-14 Jul 25 14:31:28.181765 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-f70618b5-9d73-4a0c-aee5-b771bd91aeb1 req-dd36451f-1513-4e0a-a90e-865d024e6eaf service nova] Creating event network-changed:f9ae53b2-7ccb-46f9-b164-3d57e251cc2f for instance 115f3b11-988d-43c1-a81f-998139d12448 on n-h2-846435-14 Jul 25 14:31:28.191224 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-af27bf54-db15-4bb8-a2ce-d9028624e164 req-b9a36868-4f6d-4d45-a300-f98732326588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1ee79ec-d346-42f8-ae58-06b110abdef0", "tag": "8ba120e0-d996-462a-92c0-223ea6dc26e9"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:28.199041 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [req-f70618b5-9d73-4a0c-aee5-b771bd91aeb1 req-dd36451f-1513-4e0a-a90e-865d024e6eaf service nova] Instance 115f3b11-988d-43c1-a81f-998139d12448 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119304) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 14:31:28.218165 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-af27bf54-db15-4bb8-a2ce-d9028624e164 req-b9a36868-4f6d-4d45-a300-f98732326588 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:28.221538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-af27bf54-db15-4bb8-a2ce-d9028624e164 req-b9a36868-4f6d-4d45-a300-f98732326588 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:28.232498 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-f70618b5-9d73-4a0c-aee5-b771bd91aeb1 req-dd36451f-1513-4e0a-a90e-865d024e6eaf service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.127027 Jul 25 14:31:28.233429 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 850/1654] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:31:28.239925 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4dad4f30-148e-46d9-813b-d18d0b33b1b5 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:28.241019 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4dad4f30-148e-46d9-813b-d18d0b33b1b5 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] [instance: a1ee79ec-d346-42f8-ae58-06b110abdef0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:28.245138 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-af27bf54-db15-4bb8-a2ce-d9028624e164 req-b9a36868-4f6d-4d45-a300-f98732326588 service nova] Creating event network-changed:8ba120e0-d996-462a-92c0-223ea6dc26e9 for instance a1ee79ec-d346-42f8-ae58-06b110abdef0 on n-h2-846435-14 Jul 25 14:31:28.249627 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4dad4f30-148e-46d9-813b-d18d0b33b1b5 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:28.252926 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-af27bf54-db15-4bb8-a2ce-d9028624e164 req-b9a36868-4f6d-4d45-a300-f98732326588 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071012 Jul 25 14:31:28.254125 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 805/1655] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:28.260225 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-03b89412-b49e-4596-a481-d569185f8a0d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:28.260399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4dad4f30-148e-46d9-813b-d18d0b33b1b5 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:28.261301 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-03b89412-b49e-4596-a481-d569185f8a0d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:28.265062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4dad4f30-148e-46d9-813b-d18d0b33b1b5 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:28.267441 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4dad4f30-148e-46d9-813b-d18d0b33b1b5 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:28.269556 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03b89412-b49e-4596-a481-d569185f8a0d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:28.270722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03b89412-b49e-4596-a481-d569185f8a0d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:28.272360 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03b89412-b49e-4596-a481-d569185f8a0d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:28.272989 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03b89412-b49e-4596-a481-d569185f8a0d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:28.823112 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4dad4f30-148e-46d9-813b-d18d0b33b1b5 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd9f6ef6ef34b51a55bb71f5d06040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01423e9ea2b94eef87188b26f99f9ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:28.832719 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4dad4f30-148e-46d9-813b-d18d0b33b1b5 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] 10.222.0.88 "GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0" status: 200 len: 1392 microversion: 2.1 time: 0.597530 Jul 25 14:31:28.837208 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 851/1656] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:28 2022] GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0 => generated 1392 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:28.855785 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-aa48f525-c974-4f4d-ac1e-087d86572dbf tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:28.857287 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-aa48f525-c974-4f4d-ac1e-087d86572dbf tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:28.857989 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-03b89412-b49e-4596-a481-d569185f8a0d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:28.864273 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aa48f525-c974-4f4d-ac1e-087d86572dbf tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:28.864964 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aa48f525-c974-4f4d-ac1e-087d86572dbf tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:28.865901 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aa48f525-c974-4f4d-ac1e-087d86572dbf tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:28.866480 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aa48f525-c974-4f4d-ac1e-087d86572dbf tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:28.874555 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-03b89412-b49e-4596-a481-d569185f8a0d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:28.876227 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-03b89412-b49e-4596-a481-d569185f8a0d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:28.877463 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-03b89412-b49e-4596-a481-d569185f8a0d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1814 microversion: 2.25 time: 0.621835 Jul 25 14:31:28.879190 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 806/1657] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:31:28 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1814 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:31:29.123699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-89482b43-6d72-4a5b-95e3-108f2db4e917 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:29.124820 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-89482b43-6d72-4a5b-95e3-108f2db4e917 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:29.133847 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89482b43-6d72-4a5b-95e3-108f2db4e917 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:29.134942 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89482b43-6d72-4a5b-95e3-108f2db4e917 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:29.135936 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89482b43-6d72-4a5b-95e3-108f2db4e917 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:29.136770 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89482b43-6d72-4a5b-95e3-108f2db4e917 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:29.423073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-89482b43-6d72-4a5b-95e3-108f2db4e917 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:29.436196 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-89482b43-6d72-4a5b-95e3-108f2db4e917 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1469 microversion: 2.1 time: 0.317261 Jul 25 14:31:29.437389 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 807/1658] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:29 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1469 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:29.443553 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d49c5383-9daa-49d5-9a0a-7f75bb83df35 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:29.444385 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d49c5383-9daa-49d5-9a0a-7f75bb83df35 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:29.453521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d49c5383-9daa-49d5-9a0a-7f75bb83df35 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:29.454319 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d49c5383-9daa-49d5-9a0a-7f75bb83df35 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:29.458534 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d49c5383-9daa-49d5-9a0a-7f75bb83df35 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:29.459087 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-aa48f525-c974-4f4d-ac1e-087d86572dbf tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:29.459430 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d49c5383-9daa-49d5-9a0a-7f75bb83df35 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:29.470755 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-aa48f525-c974-4f4d-ac1e-087d86572dbf tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd" status: 200 len: 1503 microversion: 2.1 time: 0.618883 Jul 25 14:31:29.471364 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 852/1659] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:28 2022] GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd => generated 1503 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:29.857120 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1b76ef1d-508a-4ee1-9c4b-bfa2955c9917 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:29.857811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1b76ef1d-508a-4ee1-9c4b-bfa2955c9917 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] [instance: a1ee79ec-d346-42f8-ae58-06b110abdef0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:29.864474 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1b76ef1d-508a-4ee1-9c4b-bfa2955c9917 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:29.865018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1b76ef1d-508a-4ee1-9c4b-bfa2955c9917 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:29.865868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1b76ef1d-508a-4ee1-9c4b-bfa2955c9917 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:29.866295 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1b76ef1d-508a-4ee1-9c4b-bfa2955c9917 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:30.016499 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1b76ef1d-508a-4ee1-9c4b-bfa2955c9917 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd9f6ef6ef34b51a55bb71f5d06040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01423e9ea2b94eef87188b26f99f9ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:30.025393 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1b76ef1d-508a-4ee1-9c4b-bfa2955c9917 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] 10.222.0.88 "GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0" status: 200 len: 1392 microversion: 2.1 time: 0.172389 Jul 25 14:31:30.026177 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 853/1660] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:29 2022] GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0 => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:30.030645 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d49c5383-9daa-49d5-9a0a-7f75bb83df35 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:30.041201 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d49c5383-9daa-49d5-9a0a-7f75bb83df35 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1515 microversion: 2.1 time: 0.602469 Jul 25 14:31:30.044780 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fb562610-33b7-4967-8b45-6f238e9eb0f1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:30.045549 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 808/1661] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:29 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1515 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:30.046420 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fb562610-33b7-4967-8b45-6f238e9eb0f1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:30.053640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fb562610-33b7-4967-8b45-6f238e9eb0f1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:30.054360 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fb562610-33b7-4967-8b45-6f238e9eb0f1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:30.055369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fb562610-33b7-4967-8b45-6f238e9eb0f1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:30.056218 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fb562610-33b7-4967-8b45-6f238e9eb0f1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:30.230385 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fb562610-33b7-4967-8b45-6f238e9eb0f1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:30.240538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fb562610-33b7-4967-8b45-6f238e9eb0f1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:30.242224 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fb562610-33b7-4967-8b45-6f238e9eb0f1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:30.243594 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fb562610-33b7-4967-8b45-6f238e9eb0f1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1814 microversion: 2.25 time: 0.216225 Jul 25 14:31:30.262696 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 854/1662] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:31:30 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1814 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:31:30.463623 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c6fae819-e26a-4350-a04b-c2a70c2d93ad tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:30.464300 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c6fae819-e26a-4350-a04b-c2a70c2d93ad tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:30.473662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c6fae819-e26a-4350-a04b-c2a70c2d93ad tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:30.474652 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c6fae819-e26a-4350-a04b-c2a70c2d93ad tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:30.476064 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c6fae819-e26a-4350-a04b-c2a70c2d93ad tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:30.477472 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c6fae819-e26a-4350-a04b-c2a70c2d93ad tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:30.494955 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-60053e81-df4d-4eba-af30-b6e4e64c4d8a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:30.495576 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-60053e81-df4d-4eba-af30-b6e4e64c4d8a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:30.513293 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60053e81-df4d-4eba-af30-b6e4e64c4d8a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:30.514122 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60053e81-df4d-4eba-af30-b6e4e64c4d8a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:30.516930 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60053e81-df4d-4eba-af30-b6e4e64c4d8a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:30.518397 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60053e81-df4d-4eba-af30-b6e4e64c4d8a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:30.686964 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c6fae819-e26a-4350-a04b-c2a70c2d93ad tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:30.695589 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c6fae819-e26a-4350-a04b-c2a70c2d93ad tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1469 microversion: 2.1 time: 0.236729 Jul 25 14:31:30.707188 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 809/1663] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:30 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1469 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:30.792136 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-60053e81-df4d-4eba-af30-b6e4e64c4d8a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:30.801717 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-60053e81-df4d-4eba-af30-b6e4e64c4d8a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd" status: 200 len: 1493 microversion: 2.1 time: 0.311224 Jul 25 14:31:30.806526 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 855/1664] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:30 2022] GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd => generated 1493 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:30.827269 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e443522b-2525-46f0-9369-1799f2ebc560 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Calling method '.version_select at 0x7f468753f310>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:30.832196 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e443522b-2525-46f0-9369-1799f2ebc560 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:30.833054 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e443522b-2525-46f0-9369-1799f2ebc560 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:30.849169 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e443522b-2525-46f0-9369-1799f2ebc560 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] 10.222.0.88 "GET /compute/v2.1/os-migrations" status: 200 len: 3150 microversion: 2.1 time: 0.025563 Jul 25 14:31:30.850267 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 810/1665] 10.222.0.88 () {58 vars in 1143 bytes} [Mon Jul 25 14:31:30 2022] GET /compute/v2.1/os-migrations => generated 3150 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:30.872538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-11d305d2-fa82-42ba-99d4-a56d11e749eb tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:30.876277 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-11d305d2-fa82-42ba-99d4-a56d11e749eb tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:30.903698 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11d305d2-fa82-42ba-99d4-a56d11e749eb tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:30.904461 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11d305d2-fa82-42ba-99d4-a56d11e749eb tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:30.905315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11d305d2-fa82-42ba-99d4-a56d11e749eb tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:30.905755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11d305d2-fa82-42ba-99d4-a56d11e749eb tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:31.050293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-06688e16-bef2-4ff3-8511-c114fc9a86ca tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:31.051375 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-06688e16-bef2-4ff3-8511-c114fc9a86ca tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] [instance: a1ee79ec-d346-42f8-ae58-06b110abdef0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:31.071581 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-06688e16-bef2-4ff3-8511-c114fc9a86ca tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:31.072334 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-06688e16-bef2-4ff3-8511-c114fc9a86ca tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:31.077207 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-06688e16-bef2-4ff3-8511-c114fc9a86ca tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:31.077864 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-06688e16-bef2-4ff3-8511-c114fc9a86ca tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:31.114543 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-11d305d2-fa82-42ba-99d4-a56d11e749eb tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd" status: 200 len: 1646 microversion: 2.1 time: 0.245824 Jul 25 14:31:31.115481 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 856/1666] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:30 2022] GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd => generated 1646 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:31.133274 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ed456caa-e64b-47ab-9982-ecca13cdc7ce tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:31.136166 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ed456caa-e64b-47ab-9982-ecca13cdc7ce tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:31.166520 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed456caa-e64b-47ab-9982-ecca13cdc7ce tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:31.167486 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed456caa-e64b-47ab-9982-ecca13cdc7ce tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:31.169877 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed456caa-e64b-47ab-9982-ecca13cdc7ce tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:31.171556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed456caa-e64b-47ab-9982-ecca13cdc7ce tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:31.466056 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ed456caa-e64b-47ab-9982-ecca13cdc7ce tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:31.483908 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ed456caa-e64b-47ab-9982-ecca13cdc7ce tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1515 microversion: 2.1 time: 0.365641 Jul 25 14:31:31.485456 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 857/1667] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:31 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1515 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:31.510188 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0d1bb2a5-3c88-4e74-9c14-48194cb6cb74 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:31.511675 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0d1bb2a5-3c88-4e74-9c14-48194cb6cb74 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:31.525376 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0d1bb2a5-3c88-4e74-9c14-48194cb6cb74 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:31.526537 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0d1bb2a5-3c88-4e74-9c14-48194cb6cb74 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:31.527573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0d1bb2a5-3c88-4e74-9c14-48194cb6cb74 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:31.528254 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0d1bb2a5-3c88-4e74-9c14-48194cb6cb74 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:31.742329 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-06688e16-bef2-4ff3-8511-c114fc9a86ca tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd9f6ef6ef34b51a55bb71f5d06040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01423e9ea2b94eef87188b26f99f9ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:31.753320 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-06688e16-bef2-4ff3-8511-c114fc9a86ca tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] 10.222.0.88 "GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0" status: 200 len: 1392 microversion: 2.1 time: 0.710034 Jul 25 14:31:31.754286 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 811/1668] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:31 2022] GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0 => generated 1392 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:31.761497 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-335f2ee7-e957-4811-a8e4-118a61ac072a req-eef4e836-0a94-477c-8f8d-d6bb689dc5f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c", "name": "network-vif-unplugged", "status": "completed", "tag": "eedb59eb-f3ec-476b-a198-201c579f3456"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:31.783955 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-335f2ee7-e957-4811-a8e4-118a61ac072a req-eef4e836-0a94-477c-8f8d-d6bb689dc5f8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:31.786688 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-335f2ee7-e957-4811-a8e4-118a61ac072a req-eef4e836-0a94-477c-8f8d-d6bb689dc5f8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:31.793793 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:31:31.814480 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-335f2ee7-e957-4811-a8e4-118a61ac072a req-eef4e836-0a94-477c-8f8d-d6bb689dc5f8 service nova] Creating event network-vif-unplugged:eedb59eb-f3ec-476b-a198-201c579f3456 for instance 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c on n-h1-846435-14 Jul 25 14:31:31.830722 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-335f2ee7-e957-4811-a8e4-118a61ac072a req-eef4e836-0a94-477c-8f8d-d6bb689dc5f8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074946 Jul 25 14:31:31.836237 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 812/1669] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:31.847618 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ee3ab750-19bc-43c8-9e46-0570422dbd37 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-298163819", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "9e0e98c7-e5b7-4308-ae4f-fa50e9a340ed"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:31.939241 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-ee3ab750-19bc-43c8-9e46-0570422dbd37 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] validate_networks() for [('9e0e98c7-e5b7-4308-ae4f-fa50e9a340ed', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:31:32.202906 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0d1bb2a5-3c88-4e74-9c14-48194cb6cb74 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:32.218123 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0d1bb2a5-3c88-4e74-9c14-48194cb6cb74 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:32.220652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0d1bb2a5-3c88-4e74-9c14-48194cb6cb74 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:32.222125 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0d1bb2a5-3c88-4e74-9c14-48194cb6cb74 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1814 microversion: 2.25 time: 0.735356 Jul 25 14:31:32.222912 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 858/1670] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:31:31 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1814 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:31:32.228021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b02d97bc-2dec-40e5-ba81-d731fc9c03a6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:32.228908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b02d97bc-2dec-40e5-ba81-d731fc9c03a6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:32.235465 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b02d97bc-2dec-40e5-ba81-d731fc9c03a6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:32.236248 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b02d97bc-2dec-40e5-ba81-d731fc9c03a6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:32.237862 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b02d97bc-2dec-40e5-ba81-d731fc9c03a6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:32.238541 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b02d97bc-2dec-40e5-ba81-d731fc9c03a6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:32.486306 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:31:32.596094 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b02d97bc-2dec-40e5-ba81-d731fc9c03a6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:32.608552 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b02d97bc-2dec-40e5-ba81-d731fc9c03a6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1469 microversion: 2.1 time: 0.382295 Jul 25 14:31:32.610016 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 859/1671] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:32 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1469 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:32.642150 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=16 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:31:32.824576 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-aa0cd441-2189-41b4-8202-88efc272b870 tempest-AbsoluteLimitsTestJSON-986568251 tempest-AbsoluteLimitsTestJSON-986568251-project] Calling method '.version_select at 0x7f4687328f70>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:32.845357 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aa0cd441-2189-41b4-8202-88efc272b870 tempest-AbsoluteLimitsTestJSON-986568251 tempest-AbsoluteLimitsTestJSON-986568251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:32.845780 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aa0cd441-2189-41b4-8202-88efc272b870 tempest-AbsoluteLimitsTestJSON-986568251 tempest-AbsoluteLimitsTestJSON-986568251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:32.846569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aa0cd441-2189-41b4-8202-88efc272b870 tempest-AbsoluteLimitsTestJSON-986568251 tempest-AbsoluteLimitsTestJSON-986568251-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:32.846999 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aa0cd441-2189-41b4-8202-88efc272b870 tempest-AbsoluteLimitsTestJSON-986568251 tempest-AbsoluteLimitsTestJSON-986568251-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:32.885271 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-aa0cd441-2189-41b4-8202-88efc272b870 tempest-AbsoluteLimitsTestJSON-986568251 tempest-AbsoluteLimitsTestJSON-986568251-project] 10.222.0.88 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.273825 Jul 25 14:31:32.887789 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 860/1672] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Jul 25 14:31:32 2022] GET /compute/v2.1/limits => generated 511 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:32.894538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d25e7605-705a-41ed-95f7-359698d973ea tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:32.896364 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d25e7605-705a-41ed-95f7-359698d973ea tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:32.911843 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d25e7605-705a-41ed-95f7-359698d973ea tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:32.916755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d25e7605-705a-41ed-95f7-359698d973ea tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:32.917642 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d25e7605-705a-41ed-95f7-359698d973ea tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:32.918032 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d25e7605-705a-41ed-95f7-359698d973ea tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:33.006810 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-ee3ab750-19bc-43c8-9e46-0570422dbd37 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:31:33.007364 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-ee3ab750-19bc-43c8-9e46-0570422dbd37 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:31:33.007919 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-ee3ab750-19bc-43c8-9e46-0570422dbd37 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:31:33.008495 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-ee3ab750-19bc-43c8-9e46-0570422dbd37 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:31:33.008978 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-ee3ab750-19bc-43c8-9e46-0570422dbd37 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:31:33.026900 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee3ab750-19bc-43c8-9e46-0570422dbd37 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:33.028869 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee3ab750-19bc-43c8-9e46-0570422dbd37 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:33.032466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee3ab750-19bc-43c8-9e46-0570422dbd37 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:33.034357 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee3ab750-19bc-43c8-9e46-0570422dbd37 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:33.071185 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-ee3ab750-19bc-43c8-9e46-0570422dbd37 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Getting quotas for project ceaa4430d1864bc2bf9afdec9cd0cf64. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:31:33.082020 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-ee3ab750-19bc-43c8-9e46-0570422dbd37 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Getting quotas for user 3da7c9a3c01f4dbca93d5e7aa688fc70 and project ceaa4430d1864bc2bf9afdec9cd0cf64. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:31:33.102260 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ee3ab750-19bc-43c8-9e46-0570422dbd37 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:31:33.106760 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ee3ab750-19bc-43c8-9e46-0570422dbd37 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:31:33.157313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:31:33.208075 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d25e7605-705a-41ed-95f7-359698d973ea tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:33.211874 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ee3ab750-19bc-43c8-9e46-0570422dbd37 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.372195 Jul 25 14:31:33.214461 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 813/1673] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:31:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:31:33.216419 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d25e7605-705a-41ed-95f7-359698d973ea tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1515 microversion: 2.1 time: 0.328935 Jul 25 14:31:33.216991 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 861/1674] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:32 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1515 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:33.229952 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f903c9bd-fda2-4e4b-8481-2b0290c061fd tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:33.230933 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f903c9bd-fda2-4e4b-8481-2b0290c061fd tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] [instance: a1ee79ec-d346-42f8-ae58-06b110abdef0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:33.231067 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-99c6b99c-5f09-4a50-b4ae-7dd8260585ce tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:33.231619 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-99c6b99c-5f09-4a50-b4ae-7dd8260585ce tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:33.241740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f903c9bd-fda2-4e4b-8481-2b0290c061fd tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:33.242539 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f903c9bd-fda2-4e4b-8481-2b0290c061fd tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:33.243925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f903c9bd-fda2-4e4b-8481-2b0290c061fd tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:33.245108 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f903c9bd-fda2-4e4b-8481-2b0290c061fd tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:33.339511 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-99c6b99c-5f09-4a50-b4ae-7dd8260585ce tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:33.347025 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-99c6b99c-5f09-4a50-b4ae-7dd8260585ce tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e" status: 200 len: 1210 microversion: 2.1 time: 0.126306 Jul 25 14:31:33.352352 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 862/1675] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:33 2022] GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e => generated 1210 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:33.364937 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c9af983a-a053-479b-8868-ceb9f2b6a15b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:33.365547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c9af983a-a053-479b-8868-ceb9f2b6a15b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:33.377825 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c9af983a-a053-479b-8868-ceb9f2b6a15b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:33.378510 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c9af983a-a053-479b-8868-ceb9f2b6a15b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:33.379461 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c9af983a-a053-479b-8868-ceb9f2b6a15b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:33.380105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c9af983a-a053-479b-8868-ceb9f2b6a15b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:33.523596 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f903c9bd-fda2-4e4b-8481-2b0290c061fd tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd9f6ef6ef34b51a55bb71f5d06040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01423e9ea2b94eef87188b26f99f9ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:33.540664 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f903c9bd-fda2-4e4b-8481-2b0290c061fd tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] 10.222.0.88 "GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0" status: 200 len: 1392 microversion: 2.1 time: 0.321401 Jul 25 14:31:33.553323 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 814/1676] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:33 2022] GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0 => generated 1392 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:33.632273 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bc96411f-8ece-45dd-999a-4ad2fb70d400 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:33.633195 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bc96411f-8ece-45dd-999a-4ad2fb70d400 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:33.646912 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bc96411f-8ece-45dd-999a-4ad2fb70d400 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:33.647598 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bc96411f-8ece-45dd-999a-4ad2fb70d400 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:33.649718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bc96411f-8ece-45dd-999a-4ad2fb70d400 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:33.650749 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bc96411f-8ece-45dd-999a-4ad2fb70d400 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:33.717340 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c9af983a-a053-479b-8868-ceb9f2b6a15b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:33.732526 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c9af983a-a053-479b-8868-ceb9f2b6a15b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:33.736061 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c9af983a-a053-479b-8868-ceb9f2b6a15b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:33.740867 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c9af983a-a053-479b-8868-ceb9f2b6a15b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1814 microversion: 2.25 time: 0.386093 Jul 25 14:31:33.742514 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 863/1677] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:31:33 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1814 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:31:34.104906 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bc96411f-8ece-45dd-999a-4ad2fb70d400 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:34.119287 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bc96411f-8ece-45dd-999a-4ad2fb70d400 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1469 microversion: 2.1 time: 0.491477 Jul 25 14:31:34.121104 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 815/1678] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:33 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1469 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:34.238602 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-50e5584b-d4b4-431e-8a31-a99d52e1b2b4 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:34.239246 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-50e5584b-d4b4-431e-8a31-a99d52e1b2b4 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:34.246484 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50e5584b-d4b4-431e-8a31-a99d52e1b2b4 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:34.246943 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50e5584b-d4b4-431e-8a31-a99d52e1b2b4 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:34.247726 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50e5584b-d4b4-431e-8a31-a99d52e1b2b4 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:34.248553 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50e5584b-d4b4-431e-8a31-a99d52e1b2b4 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:34.367827 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a3f38976-a700-4526-81c5-1469364f0f7f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:34.368516 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a3f38976-a700-4526-81c5-1469364f0f7f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:34.380746 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a3f38976-a700-4526-81c5-1469364f0f7f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:34.382434 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a3f38976-a700-4526-81c5-1469364f0f7f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:34.383498 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a3f38976-a700-4526-81c5-1469364f0f7f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:34.384720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a3f38976-a700-4526-81c5-1469364f0f7f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:34.474282 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-50e5584b-d4b4-431e-8a31-a99d52e1b2b4 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:34.485670 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-50e5584b-d4b4-431e-8a31-a99d52e1b2b4 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1515 microversion: 2.1 time: 0.251035 Jul 25 14:31:34.487272 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 864/1679] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:34 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1515 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:34.508009 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a3f38976-a700-4526-81c5-1469364f0f7f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:34.517489 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a3f38976-a700-4526-81c5-1469364f0f7f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e" status: 200 len: 1214 microversion: 2.1 time: 0.153600 Jul 25 14:31:34.518631 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 816/1680] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:34 2022] GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e => generated 1214 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:34.567308 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b3dbf7fc-8d95-43ae-814c-1a19cf5f30dc tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:34.568329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b3dbf7fc-8d95-43ae-814c-1a19cf5f30dc tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] [instance: a1ee79ec-d346-42f8-ae58-06b110abdef0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:34.576406 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b3dbf7fc-8d95-43ae-814c-1a19cf5f30dc tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:34.576856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b3dbf7fc-8d95-43ae-814c-1a19cf5f30dc tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:34.577789 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b3dbf7fc-8d95-43ae-814c-1a19cf5f30dc tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:34.578049 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b3dbf7fc-8d95-43ae-814c-1a19cf5f30dc tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:34.749841 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b3dbf7fc-8d95-43ae-814c-1a19cf5f30dc tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd9f6ef6ef34b51a55bb71f5d06040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01423e9ea2b94eef87188b26f99f9ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:34.761572 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b3dbf7fc-8d95-43ae-814c-1a19cf5f30dc tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] 10.222.0.88 "GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0" status: 200 len: 1392 microversion: 2.1 time: 0.198088 Jul 25 14:31:34.775517 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 865/1681] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:34 2022] GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0 => generated 1392 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:31:34.778605 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f1577c63-d992-42f3-a0b0-6c0a3b6fec66 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:34.779447 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f1577c63-d992-42f3-a0b0-6c0a3b6fec66 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:34.786510 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f1577c63-d992-42f3-a0b0-6c0a3b6fec66 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:34.786974 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f1577c63-d992-42f3-a0b0-6c0a3b6fec66 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:34.787872 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f1577c63-d992-42f3-a0b0-6c0a3b6fec66 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:34.788219 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f1577c63-d992-42f3-a0b0-6c0a3b6fec66 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:35.122861 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f1577c63-d992-42f3-a0b0-6c0a3b6fec66 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:35.134434 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f1577c63-d992-42f3-a0b0-6c0a3b6fec66 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:35.136352 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f1577c63-d992-42f3-a0b0-6c0a3b6fec66 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:35.137898 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f1577c63-d992-42f3-a0b0-6c0a3b6fec66 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1814 microversion: 2.25 time: 0.364482 Jul 25 14:31:35.138479 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 817/1682] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:31:34 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1814 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:31:35.142684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6f892b47-a327-4831-ba12-4280bfed6caa tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:35.143305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6f892b47-a327-4831-ba12-4280bfed6caa tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:35.157421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f892b47-a327-4831-ba12-4280bfed6caa tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:35.157877 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f892b47-a327-4831-ba12-4280bfed6caa tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:35.159018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f892b47-a327-4831-ba12-4280bfed6caa tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:35.159718 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f892b47-a327-4831-ba12-4280bfed6caa tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:35.215475 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:31:35.376508 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6f892b47-a327-4831-ba12-4280bfed6caa tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:35.388199 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6f892b47-a327-4831-ba12-4280bfed6caa tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1469 microversion: 2.1 time: 0.249408 Jul 25 14:31:35.403630 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 866/1683] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:35 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1469 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:35.511538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ab38355e-edad-4b19-a4fa-a1029a975472 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:35.513104 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ab38355e-edad-4b19-a4fa-a1029a975472 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:35.522140 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab38355e-edad-4b19-a4fa-a1029a975472 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:35.522973 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab38355e-edad-4b19-a4fa-a1029a975472 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:35.524053 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab38355e-edad-4b19-a4fa-a1029a975472 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:35.525111 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab38355e-edad-4b19-a4fa-a1029a975472 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:35.539473 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-611cbbd8-b120-405a-b162-8053214455a6 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:35.540670 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-611cbbd8-b120-405a-b162-8053214455a6 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:35.548789 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-611cbbd8-b120-405a-b162-8053214455a6 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:35.549602 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-611cbbd8-b120-405a-b162-8053214455a6 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:35.553024 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-611cbbd8-b120-405a-b162-8053214455a6 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:35.553732 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-611cbbd8-b120-405a-b162-8053214455a6 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:35.742888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-611cbbd8-b120-405a-b162-8053214455a6 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:35.762754 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-611cbbd8-b120-405a-b162-8053214455a6 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e" status: 200 len: 1206 microversion: 2.1 time: 0.226548 Jul 25 14:31:35.765281 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 867/1684] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:35 2022] GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e => generated 1206 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:35.784760 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-00ce2dcc-3896-4f24-a415-f9be22cc1ac6 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:35.785693 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-00ce2dcc-3896-4f24-a415-f9be22cc1ac6 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] [instance: a1ee79ec-d346-42f8-ae58-06b110abdef0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:35.795023 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-00ce2dcc-3896-4f24-a415-f9be22cc1ac6 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:35.795782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-00ce2dcc-3896-4f24-a415-f9be22cc1ac6 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:35.796740 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-00ce2dcc-3896-4f24-a415-f9be22cc1ac6 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:35.797324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-00ce2dcc-3896-4f24-a415-f9be22cc1ac6 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:36.148131 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-00ce2dcc-3896-4f24-a415-f9be22cc1ac6 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd9f6ef6ef34b51a55bb71f5d06040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01423e9ea2b94eef87188b26f99f9ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:36.172729 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-00ce2dcc-3896-4f24-a415-f9be22cc1ac6 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] 10.222.0.88 "GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0" status: 200 len: 1392 microversion: 2.1 time: 0.377086 Jul 25 14:31:36.185977 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 868/1685] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:35 2022] GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0 => generated 1392 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:36.190964 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-362f825d-8c7f-4477-8044-aa56ee61fbec req-46353c6e-dc7d-460d-8758-abb0af65e1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1ee79ec-d346-42f8-ae58-06b110abdef0", "name": "network-vif-plugged", "status": "completed", "tag": "8ba120e0-d996-462a-92c0-223ea6dc26e9"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:36.234450 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-362f825d-8c7f-4477-8044-aa56ee61fbec req-46353c6e-dc7d-460d-8758-abb0af65e1f5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:36.234904 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-362f825d-8c7f-4477-8044-aa56ee61fbec req-46353c6e-dc7d-460d-8758-abb0af65e1f5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:36.261103 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ab38355e-edad-4b19-a4fa-a1029a975472 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:36.275144 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ab38355e-edad-4b19-a4fa-a1029a975472 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1515 microversion: 2.1 time: 0.771955 Jul 25 14:31:36.276252 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 818/1686] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:35 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1515 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:36.288998 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-362f825d-8c7f-4477-8044-aa56ee61fbec req-46353c6e-dc7d-460d-8758-abb0af65e1f5 service nova] Creating event network-vif-plugged:8ba120e0-d996-462a-92c0-223ea6dc26e9 for instance a1ee79ec-d346-42f8-ae58-06b110abdef0 on n-h2-846435-14 Jul 25 14:31:36.293376 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7881bd8c-040b-40c6-aaf0-c8e53e457e96 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:36.294245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7881bd8c-040b-40c6-aaf0-c8e53e457e96 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:36.302230 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-362f825d-8c7f-4477-8044-aa56ee61fbec req-46353c6e-dc7d-460d-8758-abb0af65e1f5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112924 Jul 25 14:31:36.304208 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 869/1687] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:36.310305 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7881bd8c-040b-40c6-aaf0-c8e53e457e96 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:36.311268 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7881bd8c-040b-40c6-aaf0-c8e53e457e96 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:36.315194 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7881bd8c-040b-40c6-aaf0-c8e53e457e96 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:36.316003 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7881bd8c-040b-40c6-aaf0-c8e53e457e96 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:36.412576 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-539c5cdd-03a1-4b5e-9b49-7d14c72cb391 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:36.414611 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-539c5cdd-03a1-4b5e-9b49-7d14c72cb391 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:36.424852 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-539c5cdd-03a1-4b5e-9b49-7d14c72cb391 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:36.425495 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-539c5cdd-03a1-4b5e-9b49-7d14c72cb391 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:36.426586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-539c5cdd-03a1-4b5e-9b49-7d14c72cb391 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:36.427357 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-539c5cdd-03a1-4b5e-9b49-7d14c72cb391 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:36.951894 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7881bd8c-040b-40c6-aaf0-c8e53e457e96 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:36.973770 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7881bd8c-040b-40c6-aaf0-c8e53e457e96 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:36.976926 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7881bd8c-040b-40c6-aaf0-c8e53e457e96 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:36.982046 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7881bd8c-040b-40c6-aaf0-c8e53e457e96 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1814 microversion: 2.25 time: 0.702459 Jul 25 14:31:36.984886 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-539c5cdd-03a1-4b5e-9b49-7d14c72cb391 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:36.988090 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 819/1688] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:31:36 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1814 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:31:36.997755 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-32f96faa-8aa6-472b-9818-612c3dd8a0a9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:36.998615 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-32f96faa-8aa6-472b-9818-612c3dd8a0a9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:37.004041 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-539c5cdd-03a1-4b5e-9b49-7d14c72cb391 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1462 microversion: 2.1 time: 0.587613 Jul 25 14:31:37.008026 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 870/1689] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:36 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1462 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:31:37.019035 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-32f96faa-8aa6-472b-9818-612c3dd8a0a9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:37.019499 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-32f96faa-8aa6-472b-9818-612c3dd8a0a9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:37.020317 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-32f96faa-8aa6-472b-9818-612c3dd8a0a9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:37.024756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-32f96faa-8aa6-472b-9818-612c3dd8a0a9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:37.025331 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6afda87c-797f-4b0c-a778-f0046444a999 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:37.025940 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6afda87c-797f-4b0c-a778-f0046444a999 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:37.038082 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6afda87c-797f-4b0c-a778-f0046444a999 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:37.039097 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6afda87c-797f-4b0c-a778-f0046444a999 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:37.040392 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6afda87c-797f-4b0c-a778-f0046444a999 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:37.041024 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6afda87c-797f-4b0c-a778-f0046444a999 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:37.409149 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6afda87c-797f-4b0c-a778-f0046444a999 tempest-MigrationsAdminTest-411857930 tempest-MigrationsAdminTest-411857930-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1615 microversion: 2.1 time: 0.387367 Jul 25 14:31:37.409889 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 871/1690] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:37 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1615 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:31:37.418223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ff4fc6ac-b8ab-4e59-81ed-3eecebafae02 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:37.419830 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ff4fc6ac-b8ab-4e59-81ed-3eecebafae02 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] [instance: a1ee79ec-d346-42f8-ae58-06b110abdef0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:37.444621 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff4fc6ac-b8ab-4e59-81ed-3eecebafae02 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:37.445274 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff4fc6ac-b8ab-4e59-81ed-3eecebafae02 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:37.446437 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff4fc6ac-b8ab-4e59-81ed-3eecebafae02 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:37.447022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff4fc6ac-b8ab-4e59-81ed-3eecebafae02 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:37.484669 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-32f96faa-8aa6-472b-9818-612c3dd8a0a9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:37.502647 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-32f96faa-8aa6-472b-9818-612c3dd8a0a9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e" status: 200 len: 1268 microversion: 2.1 time: 0.512594 Jul 25 14:31:37.503591 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 820/1691] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:36 2022] GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e => generated 1268 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:37.509141 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c6e8fdce-0d95-4fa5-b67a-202e4a42dcde tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:37.510264 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c6e8fdce-0d95-4fa5-b67a-202e4a42dcde tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:37.531339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c6e8fdce-0d95-4fa5-b67a-202e4a42dcde tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:37.533839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c6e8fdce-0d95-4fa5-b67a-202e4a42dcde tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:37.540503 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c6e8fdce-0d95-4fa5-b67a-202e4a42dcde tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:37.542857 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c6e8fdce-0d95-4fa5-b67a-202e4a42dcde tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:37.785238 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c6e8fdce-0d95-4fa5-b67a-202e4a42dcde tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:37.796150 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c6e8fdce-0d95-4fa5-b67a-202e4a42dcde tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1521 microversion: 2.1 time: 0.291080 Jul 25 14:31:37.800028 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 821/1692] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:37 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:37.810037 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-12e6abf7-dec2-44d6-8f9f-dd0016a07276 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:37.810585 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-12e6abf7-dec2-44d6-8f9f-dd0016a07276 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:37.818586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ff4fc6ac-b8ab-4e59-81ed-3eecebafae02 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd9f6ef6ef34b51a55bb71f5d06040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01423e9ea2b94eef87188b26f99f9ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:37.828883 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-12e6abf7-dec2-44d6-8f9f-dd0016a07276 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:37.833537 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-12e6abf7-dec2-44d6-8f9f-dd0016a07276 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:37.834396 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-12e6abf7-dec2-44d6-8f9f-dd0016a07276 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:37.835344 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-12e6abf7-dec2-44d6-8f9f-dd0016a07276 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:37.836405 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ff4fc6ac-b8ab-4e59-81ed-3eecebafae02 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] 10.222.0.88 "GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0" status: 200 len: 1392 microversion: 2.1 time: 0.424978 Jul 25 14:31:37.837207 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 872/1693] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:37 2022] GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0 => generated 1392 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:37.873706 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-12e6abf7-dec2-44d6-8f9f-dd0016a07276 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:31:37.976485 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-12e6abf7-dec2-44d6-8f9f-dd0016a07276 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "DELETE /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 204 len: 0 microversion: 2.1 time: 0.177561 Jul 25 14:31:37.977562 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 822/1694] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:31:37 2022] DELETE /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:31:37.988988 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-078c1520-2828-488d-853f-52bafd7fe57d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:37.990503 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-078c1520-2828-488d-853f-52bafd7fe57d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:37.997444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-078c1520-2828-488d-853f-52bafd7fe57d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:37.998007 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-078c1520-2828-488d-853f-52bafd7fe57d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:37.998866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-078c1520-2828-488d-853f-52bafd7fe57d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:37.999387 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-078c1520-2828-488d-853f-52bafd7fe57d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:38.013067 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-06d3498e-d064-4141-9ffa-ac2c28990b55 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:38.014740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-06d3498e-d064-4141-9ffa-ac2c28990b55 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:38.022676 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-06d3498e-d064-4141-9ffa-ac2c28990b55 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:38.023787 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-06d3498e-d064-4141-9ffa-ac2c28990b55 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:38.025512 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-06d3498e-d064-4141-9ffa-ac2c28990b55 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:38.026498 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-06d3498e-d064-4141-9ffa-ac2c28990b55 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:38.363721 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-06d3498e-d064-4141-9ffa-ac2c28990b55 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:38.379328 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-06d3498e-d064-4141-9ffa-ac2c28990b55 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:38.381689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-06d3498e-d064-4141-9ffa-ac2c28990b55 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:38.383999 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-06d3498e-d064-4141-9ffa-ac2c28990b55 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1814 microversion: 2.25 time: 0.375802 Jul 25 14:31:38.400179 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 823/1695] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:31:38 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1814 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:31:38.418617 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-078c1520-2828-488d-853f-52bafd7fe57d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:38.442612 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-078c1520-2828-488d-853f-52bafd7fe57d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1468 microversion: 2.1 time: 0.460715 Jul 25 14:31:38.444248 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 873/1696] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:37 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1468 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:38.530216 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6c30a35b-8f89-49c4-a48b-d50ce88fc263 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:38.533693 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6c30a35b-8f89-49c4-a48b-d50ce88fc263 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:38.572354 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6c30a35b-8f89-49c4-a48b-d50ce88fc263 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:38.574882 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6c30a35b-8f89-49c4-a48b-d50ce88fc263 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:38.577563 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6c30a35b-8f89-49c4-a48b-d50ce88fc263 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:38.580449 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6c30a35b-8f89-49c4-a48b-d50ce88fc263 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:38.824706 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-50310961-c1a7-43f9-b20a-88c40c0fcd6a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:38.825586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-50310961-c1a7-43f9-b20a-88c40c0fcd6a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:38.833888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50310961-c1a7-43f9-b20a-88c40c0fcd6a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:38.834317 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50310961-c1a7-43f9-b20a-88c40c0fcd6a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:38.835306 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50310961-c1a7-43f9-b20a-88c40c0fcd6a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:38.836037 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50310961-c1a7-43f9-b20a-88c40c0fcd6a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:39.000952 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-50310961-c1a7-43f9-b20a-88c40c0fcd6a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:39.010845 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-50310961-c1a7-43f9-b20a-88c40c0fcd6a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1521 microversion: 2.1 time: 0.191305 Jul 25 14:31:39.020484 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 874/1697] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:38 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:39.032429 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6c30a35b-8f89-49c4-a48b-d50ce88fc263 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:39.033863 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-88036985-14f7-4c28-86f8-beed97b3acf1 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:39.034583 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-88036985-14f7-4c28-86f8-beed97b3acf1 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] [instance: a1ee79ec-d346-42f8-ae58-06b110abdef0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:39.042558 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-88036985-14f7-4c28-86f8-beed97b3acf1 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:39.043342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-88036985-14f7-4c28-86f8-beed97b3acf1 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:39.044421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-88036985-14f7-4c28-86f8-beed97b3acf1 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:39.045207 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-88036985-14f7-4c28-86f8-beed97b3acf1 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:39.047152 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6c30a35b-8f89-49c4-a48b-d50ce88fc263 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e" status: 200 len: 1310 microversion: 2.1 time: 0.525926 Jul 25 14:31:39.057582 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 824/1698] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:38 2022] GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e => generated 1310 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:39.220282 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-88036985-14f7-4c28-86f8-beed97b3acf1 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd9f6ef6ef34b51a55bb71f5d06040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01423e9ea2b94eef87188b26f99f9ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:39.230465 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-88036985-14f7-4c28-86f8-beed97b3acf1 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] 10.222.0.88 "GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0" status: 200 len: 1392 microversion: 2.1 time: 0.208139 Jul 25 14:31:39.231699 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 875/1699] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:39 2022] GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0 => generated 1392 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:39.410835 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d8036a33-7d9e-45a4-929d-8865c7bfc88f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:39.412611 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d8036a33-7d9e-45a4-929d-8865c7bfc88f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:39.437775 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8036a33-7d9e-45a4-929d-8865c7bfc88f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:39.439142 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8036a33-7d9e-45a4-929d-8865c7bfc88f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:39.441437 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8036a33-7d9e-45a4-929d-8865c7bfc88f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:39.442226 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8036a33-7d9e-45a4-929d-8865c7bfc88f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:39.468626 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c0cf3f18-1001-43ff-aa18-05190d4bd79b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:39.469722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c0cf3f18-1001-43ff-aa18-05190d4bd79b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:39.501035 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c0cf3f18-1001-43ff-aa18-05190d4bd79b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:39.502996 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c0cf3f18-1001-43ff-aa18-05190d4bd79b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:39.505198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c0cf3f18-1001-43ff-aa18-05190d4bd79b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:39.508013 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c0cf3f18-1001-43ff-aa18-05190d4bd79b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:39.846130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c0cf3f18-1001-43ff-aa18-05190d4bd79b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:39.858799 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c0cf3f18-1001-43ff-aa18-05190d4bd79b tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1468 microversion: 2.1 time: 0.397851 Jul 25 14:31:39.861865 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 876/1700] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:39 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1468 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:40.062391 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-eb945e53-0cc7-46dc-8429-7ee2a68d2ef0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:40.065924 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-eb945e53-0cc7-46dc-8429-7ee2a68d2ef0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:40.089586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eb945e53-0cc7-46dc-8429-7ee2a68d2ef0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:40.090219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eb945e53-0cc7-46dc-8429-7ee2a68d2ef0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:40.092458 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eb945e53-0cc7-46dc-8429-7ee2a68d2ef0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:40.093019 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eb945e53-0cc7-46dc-8429-7ee2a68d2ef0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:40.211329 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d8036a33-7d9e-45a4-929d-8865c7bfc88f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:40.231836 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d8036a33-7d9e-45a4-929d-8865c7bfc88f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:40.241320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d8036a33-7d9e-45a4-929d-8865c7bfc88f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:40.243474 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d8036a33-7d9e-45a4-929d-8865c7bfc88f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1814 microversion: 2.25 time: 0.836555 Jul 25 14:31:40.250050 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 825/1701] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:31:39 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1814 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:31:40.261825 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a5ddbc2b-ed3a-4b67-ab80-18c8529395ad tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:40.264431 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a5ddbc2b-ed3a-4b67-ab80-18c8529395ad tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:40.272939 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a5ddbc2b-ed3a-4b67-ab80-18c8529395ad tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:40.273792 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a5ddbc2b-ed3a-4b67-ab80-18c8529395ad tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:40.274992 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a5ddbc2b-ed3a-4b67-ab80-18c8529395ad tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:40.275707 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a5ddbc2b-ed3a-4b67-ab80-18c8529395ad tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:40.800992 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-eb945e53-0cc7-46dc-8429-7ee2a68d2ef0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:40.808426 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a5ddbc2b-ed3a-4b67-ab80-18c8529395ad tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:40.816686 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-eb945e53-0cc7-46dc-8429-7ee2a68d2ef0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1521 microversion: 2.1 time: 0.774816 Jul 25 14:31:40.817697 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 877/1702] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:40 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1521 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:31:40.819326 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a5ddbc2b-ed3a-4b67-ab80-18c8529395ad tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e" status: 200 len: 1310 microversion: 2.1 time: 0.567673 Jul 25 14:31:40.820024 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 826/1703] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:40 2022] GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e => generated 1310 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:40.827738 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-67f29a45-4467-42cd-a535-416f632400d2 req-688241ef-420b-4f0a-a35b-76719f725d76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "115f3b11-988d-43c1-a81f-998139d12448", "name": "network-vif-plugged", "status": "completed", "tag": "f9ae53b2-7ccb-46f9-b164-3d57e251cc2f"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:40.843568 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-76c77ae1-a80b-487b-b918-0db0cc8438f9 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:40.847575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-76c77ae1-a80b-487b-b918-0db0cc8438f9 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] [instance: a1ee79ec-d346-42f8-ae58-06b110abdef0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:40.854073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-67f29a45-4467-42cd-a535-416f632400d2 req-688241ef-420b-4f0a-a35b-76719f725d76 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:40.854806 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-67f29a45-4467-42cd-a535-416f632400d2 req-688241ef-420b-4f0a-a35b-76719f725d76 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:40.863957 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-76c77ae1-a80b-487b-b918-0db0cc8438f9 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:40.864719 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-76c77ae1-a80b-487b-b918-0db0cc8438f9 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:40.865702 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-76c77ae1-a80b-487b-b918-0db0cc8438f9 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:40.866137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-76c77ae1-a80b-487b-b918-0db0cc8438f9 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:40.879056 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-67f29a45-4467-42cd-a535-416f632400d2 req-688241ef-420b-4f0a-a35b-76719f725d76 service nova] Creating event network-vif-plugged:f9ae53b2-7ccb-46f9-b164-3d57e251cc2f for instance 115f3b11-988d-43c1-a81f-998139d12448 on n-h2-846435-14 Jul 25 14:31:40.897962 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-67f29a45-4467-42cd-a535-416f632400d2 req-688241ef-420b-4f0a-a35b-76719f725d76 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076722 Jul 25 14:31:40.898882 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 827/1704] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:40.905609 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7013ad27-ac5e-4391-9c3e-bbf37ce6925d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:40.906544 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7013ad27-ac5e-4391-9c3e-bbf37ce6925d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:40.920604 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7013ad27-ac5e-4391-9c3e-bbf37ce6925d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:40.921303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7013ad27-ac5e-4391-9c3e-bbf37ce6925d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:40.924518 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7013ad27-ac5e-4391-9c3e-bbf37ce6925d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:40.925055 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7013ad27-ac5e-4391-9c3e-bbf37ce6925d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:41.371305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-76c77ae1-a80b-487b-b918-0db0cc8438f9 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd9f6ef6ef34b51a55bb71f5d06040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01423e9ea2b94eef87188b26f99f9ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:41.382654 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-76c77ae1-a80b-487b-b918-0db0cc8438f9 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] 10.222.0.88 "GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0" status: 200 len: 1573 microversion: 2.1 time: 0.563601 Jul 25 14:31:41.384987 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 878/1705] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:40 2022] GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0 => generated 1573 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:41.391832 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e44cf395-d1ed-43b2-9164-520d45948ce1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:41.392489 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e44cf395-d1ed-43b2-9164-520d45948ce1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:41.420574 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e44cf395-d1ed-43b2-9164-520d45948ce1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:41.421235 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e44cf395-d1ed-43b2-9164-520d45948ce1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:41.423315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e44cf395-d1ed-43b2-9164-520d45948ce1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:41.424894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e44cf395-d1ed-43b2-9164-520d45948ce1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:41.626839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7013ad27-ac5e-4391-9c3e-bbf37ce6925d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:41.650785 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7013ad27-ac5e-4391-9c3e-bbf37ce6925d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 200 len: 1468 microversion: 2.1 time: 0.749559 Jul 25 14:31:41.651402 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 828/1706] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:40 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 1468 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:41.656598 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2c59e909-db3f-4ea0-8f4e-84117ea7398c tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:41.657326 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2c59e909-db3f-4ea0-8f4e-84117ea7398c tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] [instance: a1ee79ec-d346-42f8-ae58-06b110abdef0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:41.671117 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c59e909-db3f-4ea0-8f4e-84117ea7398c tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:41.675682 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c59e909-db3f-4ea0-8f4e-84117ea7398c tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:41.676826 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c59e909-db3f-4ea0-8f4e-84117ea7398c tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:41.677434 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c59e909-db3f-4ea0-8f4e-84117ea7398c tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:41.698466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:31:41.780119 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e44cf395-d1ed-43b2-9164-520d45948ce1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:41.796042 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e44cf395-d1ed-43b2-9164-520d45948ce1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:41.802320 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e44cf395-d1ed-43b2-9164-520d45948ce1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:41.805690 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e44cf395-d1ed-43b2-9164-520d45948ce1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1804 microversion: 2.25 time: 0.418331 Jul 25 14:31:41.807273 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 879/1707] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:31:41 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1804 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:31:41.836812 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3c143b3b-f35b-4ba8-b48c-d5ae49e789b5 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Calling method '.version_select at 0x7f46989b8550>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:41.841570 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c143b3b-f35b-4ba8-b48c-d5ae49e789b5 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:41.846973 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c143b3b-f35b-4ba8-b48c-d5ae49e789b5 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:41.876636 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3c143b3b-f35b-4ba8-b48c-d5ae49e789b5 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] 10.222.0.88 "GET /compute/v2.1/os-migrations" status: 200 len: 3660 microversion: 2.25 time: 0.047316 Jul 25 14:31:41.879009 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 880/1708] 10.222.0.88 () {60 vars in 1184 bytes} [Mon Jul 25 14:31:41 2022] GET /compute/v2.1/os-migrations => generated 3660 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:31:41.895886 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-df7feaad-28fa-4249-b65a-fbcf76448fd7 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:41.903780 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-df7feaad-28fa-4249-b65a-fbcf76448fd7 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:41.922604 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-df7feaad-28fa-4249-b65a-fbcf76448fd7 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:41.924403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-df7feaad-28fa-4249-b65a-fbcf76448fd7 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:41.926831 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-df7feaad-28fa-4249-b65a-fbcf76448fd7 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:41.929445 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-df7feaad-28fa-4249-b65a-fbcf76448fd7 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:42.192020 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2c59e909-db3f-4ea0-8f4e-84117ea7398c tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] 10.222.0.88 "GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.539235 Jul 25 14:31:42.193709 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 829/1709] 10.222.0.88 () {58 vars in 1275 bytes} [Mon Jul 25 14:31:41 2022] GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0/os-interface => generated 284 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:42.207282 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-64216ea5-7494-4fdb-a8d3-7c933dc4e11b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:42.207905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-64216ea5-7494-4fdb-a8d3-7c933dc4e11b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:42.248227 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-64216ea5-7494-4fdb-a8d3-7c933dc4e11b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:42.248694 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-64216ea5-7494-4fdb-a8d3-7c933dc4e11b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:42.257531 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-64216ea5-7494-4fdb-a8d3-7c933dc4e11b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:42.259172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-64216ea5-7494-4fdb-a8d3-7c933dc4e11b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:42.841449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-df7feaad-28fa-4249-b65a-fbcf76448fd7 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:42.857966 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-df7feaad-28fa-4249-b65a-fbcf76448fd7 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e" status: 200 len: 1310 microversion: 2.1 time: 0.977591 Jul 25 14:31:42.860972 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 881/1710] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:41 2022] GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e => generated 1310 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:42.867522 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ad03d749-1a1d-452f-96b1-e2639e66bc25 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:42.869207 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ad03d749-1a1d-452f-96b1-e2639e66bc25 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:42.878404 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:31:42.880536 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad03d749-1a1d-452f-96b1-e2639e66bc25 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:42.881229 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad03d749-1a1d-452f-96b1-e2639e66bc25 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:42.882397 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad03d749-1a1d-452f-96b1-e2639e66bc25 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:42.883045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad03d749-1a1d-452f-96b1-e2639e66bc25 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:43.060559 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:31:43.092860 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:31:43.186959 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-64216ea5-7494-4fdb-a8d3-7c933dc4e11b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:43.216287 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-64216ea5-7494-4fdb-a8d3-7c933dc4e11b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1521 microversion: 2.1 time: 1.021310 Jul 25 14:31:43.218451 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 830/1711] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:42 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1521 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:43.229856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-4996919c-0856-455a-b07a-6f0df865d6b6 req-e355c381-4b03-4eb7-b2af-cd025d341946 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48341efc-a4b6-4532-8a2b-ac8d8f50a26e", "tag": "2b310f15-4cbb-46d3-87df-2b7fb95774aa"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:43.264015 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-4996919c-0856-455a-b07a-6f0df865d6b6 req-e355c381-4b03-4eb7-b2af-cd025d341946 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:43.265305 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-4996919c-0856-455a-b07a-6f0df865d6b6 req-e355c381-4b03-4eb7-b2af-cd025d341946 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:43.282169 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-4996919c-0856-455a-b07a-6f0df865d6b6 req-e355c381-4b03-4eb7-b2af-cd025d341946 service nova] Creating event network-changed:2b310f15-4cbb-46d3-87df-2b7fb95774aa for instance 48341efc-a4b6-4532-8a2b-ac8d8f50a26e on n-h2-846435-14 Jul 25 14:31:43.289276 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-4996919c-0856-455a-b07a-6f0df865d6b6 req-e355c381-4b03-4eb7-b2af-cd025d341946 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069161 Jul 25 14:31:43.292491 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 831/1712] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:43.299882 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-87c8d279-868f-47e0-8a66-aa7c82a1365b req-ef163414-267d-40c9-918b-b6a9c0298fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "115f3b11-988d-43c1-a81f-998139d12448", "name": "network-vif-deleted", "tag": "f9ae53b2-7ccb-46f9-b164-3d57e251cc2f"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:43.315649 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-87c8d279-868f-47e0-8a66-aa7c82a1365b req-ef163414-267d-40c9-918b-b6a9c0298fe9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:43.317299 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-87c8d279-868f-47e0-8a66-aa7c82a1365b req-ef163414-267d-40c9-918b-b6a9c0298fe9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:43.334524 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-87c8d279-868f-47e0-8a66-aa7c82a1365b req-ef163414-267d-40c9-918b-b6a9c0298fe9 service nova] Creating event network-vif-deleted:f9ae53b2-7ccb-46f9-b164-3d57e251cc2f for instance 115f3b11-988d-43c1-a81f-998139d12448 on n-h2-846435-14 Jul 25 14:31:43.343622 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-87c8d279-868f-47e0-8a66-aa7c82a1365b req-ef163414-267d-40c9-918b-b6a9c0298fe9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049230 Jul 25 14:31:43.344726 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 832/1713] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:43.346668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=4 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:31:43.361444 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-97e7f416-4564-45f6-9a3f-225e40051d06 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:43.362783 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-97e7f416-4564-45f6-9a3f-225e40051d06 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 115f3b11-988d-43c1-a81f-998139d12448] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:43.374045 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-97e7f416-4564-45f6-9a3f-225e40051d06 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:43.374663 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-97e7f416-4564-45f6-9a3f-225e40051d06 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:43.378105 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-97e7f416-4564-45f6-9a3f-225e40051d06 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:43.380333 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-97e7f416-4564-45f6-9a3f-225e40051d06 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:43.401973 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-97e7f416-4564-45f6-9a3f-225e40051d06 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] HTTP exception thrown: Instance 115f3b11-988d-43c1-a81f-998139d12448 could not be found. Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-97e7f416-4564-45f6-9a3f-225e40051d06 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Request method failure captured: Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 HTTP/1.1 Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qgQ0giBIKJS3p1fKMOwG5iykKOb_7z2xkUwzX9ZOQP9w2TF7jf5B2qoIekEaNujbgYY0003fI8cBRBWofwaT6xURCwj33RgtUgI5CEAt7_13L8_mUPvgHP5u7-q-4hdnU9gOvpZrSenVJEtvuSYp_43hbO7IzDEh1EZa5FB6U8bMTY Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 887aa20d1838484eb895896f8f76ce41 Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-MigrationsAdminTest-1396799549 Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/887aa20d1838484eb895896f8f76ce41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/887aa20d1838484eb895896f8f76ce41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_887aa20d1838484eb895896f8f76ce41", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/887aa20d1838484eb895896f8f76ce41"}]}] Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-MigrationsAdminTest-1396799549 Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 887aa20d1838484eb895896f8f76ce41 Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-MigrationsAdminTest-1396799549 Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-MigrationsAdminTest-1396799549-project Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 00aea97fb95c44cfa5dce25e9a06cd37 Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-MigrationsAdminTest-1396799549-project Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 115f3b11-988d-43c1-a81f-998139d12448 could not be found. Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '115f3b11-988d-43c1-a81f-998139d12448'} Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 115f3b11-988d-43c1-a81f-998139d12448 could not be found. Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 115f3b11-988d-43c1-a81f-998139d12448 could not be found. Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:43.404725 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:43.409381 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:43.409381 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:43.409381 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:43.409381 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:43.409381 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:43.409381 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 115f3b11-988d-43c1-a81f-998139d12448 could not be found. Jul 25 14:31:43.409381 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:43.413815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-97e7f416-4564-45f6-9a3f-225e40051d06 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Returning 404 to user: Instance 115f3b11-988d-43c1-a81f-998139d12448 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:43.415916 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-97e7f416-4564-45f6-9a3f-225e40051d06 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448" status: 404 len: 111 microversion: 2.1 time: 0.069469 Jul 25 14:31:43.423166 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 833/1714] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:43 2022] GET /compute/v2.1/servers/115f3b11-988d-43c1-a81f-998139d12448 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:31:43.444624 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-972fa4d3-861d-47f2-a0ff-6c03f8121c8f req-4106099e-fdb4-45b8-80c7-fe3da8b1d626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c87c840-4e2c-4bc2-822b-93b046f8fab5", "name": "network-vif-unplugged", "status": "completed", "tag": "0606594f-9a23-44eb-9ac0-96b677c84884"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:43.472118 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-972fa4d3-861d-47f2-a0ff-6c03f8121c8f req-4106099e-fdb4-45b8-80c7-fe3da8b1d626 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:43.472602 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-972fa4d3-861d-47f2-a0ff-6c03f8121c8f req-4106099e-fdb4-45b8-80c7-fe3da8b1d626 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:43.495844 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-972fa4d3-861d-47f2-a0ff-6c03f8121c8f req-4106099e-fdb4-45b8-80c7-fe3da8b1d626 service nova] Creating event network-vif-unplugged:0606594f-9a23-44eb-9ac0-96b677c84884 for instance 9c87c840-4e2c-4bc2-822b-93b046f8fab5 on n-h1-846435-14 Jul 25 14:31:43.505268 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-972fa4d3-861d-47f2-a0ff-6c03f8121c8f req-4106099e-fdb4-45b8-80c7-fe3da8b1d626 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067407 Jul 25 14:31:43.506782 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 834/1715] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:43.785658 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-02e05ec6-2f42-44ac-b856-aec4954d0149 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Action: 'create', calling method: .version_select at 0x7f46873dfd30>, body: {"keypair": {"name": "tempest-keypair-1297777237", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGk5DUE+//EBS86vp6JSXVVxI6Z8N2WaW9rzhJnhwcWXX/4CwPWHjx4rJKQqcHCK9FOO3/vunMBqwnanfVQRNQlGMoPe1RT/TlpPLpiupI57/RGsmovM9vet8uB9t9QCrg=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:43.824280 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-02e05ec6-2f42-44ac-b856-aec4954d0149 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Getting quotas for project c4bbc39957d740eeb578bf4e7ebb931e. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:31:43.843569 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-02e05ec6-2f42-44ac-b856-aec4954d0149 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Getting quotas for user 99cd21f1fcc145d7a854c1a6b3005a59 and project c4bbc39957d740eeb578bf4e7ebb931e. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:31:43.883214 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-ad03d749-1a1d-452f-96b1-e2639e66bc25 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lazy-loading 'services' on Instance uuid 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:31:43.912189 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-02e05ec6-2f42-44ac-b856-aec4954d0149 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.403587 Jul 25 14:31:43.913527 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 835/1716] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:31:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:43.920420 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fd0b0883-3c86-48e5-8898-b0c1443e3492 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:43.924653 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ad03d749-1a1d-452f-96b1-e2639e66bc25 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 2424 microversion: 2.25 time: 1.062157 Jul 25 14:31:43.925610 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fd0b0883-3c86-48e5-8898-b0c1443e3492 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:43.928106 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 882/1717] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:31:42 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 2424 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:31:43.935052 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fd0b0883-3c86-48e5-8898-b0c1443e3492 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:43.935803 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fd0b0883-3c86-48e5-8898-b0c1443e3492 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:43.937817 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fd0b0883-3c86-48e5-8898-b0c1443e3492 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:43.938466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fd0b0883-3c86-48e5-8898-b0c1443e3492 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:43.949971 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b3aa2219-9faf-4779-85f2-b2c7febb13c9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:43.951145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b3aa2219-9faf-4779-85f2-b2c7febb13c9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:43.963059 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b3aa2219-9faf-4779-85f2-b2c7febb13c9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:43.963914 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b3aa2219-9faf-4779-85f2-b2c7febb13c9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:43.965862 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b3aa2219-9faf-4779-85f2-b2c7febb13c9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:43.966523 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b3aa2219-9faf-4779-85f2-b2c7febb13c9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:44.010053 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fd0b0883-3c86-48e5-8898-b0c1443e3492 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:31:44.181691 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fd0b0883-3c86-48e5-8898-b0c1443e3492 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "DELETE /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 204 len: 0 microversion: 2.1 time: 0.266464 Jul 25 14:31:44.188387 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 836/1718] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:31:43 2022] DELETE /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:31:44.197833 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-966224f8-d952-444c-ae8e-44f3e6ab7a5e tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:44.198548 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-966224f8-d952-444c-ae8e-44f3e6ab7a5e tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:44.206094 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-966224f8-d952-444c-ae8e-44f3e6ab7a5e tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:44.206094 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-966224f8-d952-444c-ae8e-44f3e6ab7a5e tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:44.206749 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-966224f8-d952-444c-ae8e-44f3e6ab7a5e tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:44.207193 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-966224f8-d952-444c-ae8e-44f3e6ab7a5e tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:44.466770 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b3aa2219-9faf-4779-85f2-b2c7febb13c9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:44.476181 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b3aa2219-9faf-4779-85f2-b2c7febb13c9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e" status: 200 len: 1310 microversion: 2.1 time: 0.545127 Jul 25 14:31:44.488358 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 883/1719] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:43 2022] GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e => generated 1310 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:44.495185 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-eaca86f7-3504-47f7-9323-3acb43425df3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:44.495804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-eaca86f7-3504-47f7-9323-3acb43425df3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:44.512511 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eaca86f7-3504-47f7-9323-3acb43425df3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:44.512971 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eaca86f7-3504-47f7-9323-3acb43425df3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:44.513761 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eaca86f7-3504-47f7-9323-3acb43425df3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:44.514203 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eaca86f7-3504-47f7-9323-3acb43425df3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:44.518649 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:31:44.658586 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-966224f8-d952-444c-ae8e-44f3e6ab7a5e tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lazy-loading 'services' on Instance uuid 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:31:44.696708 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-966224f8-d952-444c-ae8e-44f3e6ab7a5e tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 2424 microversion: 2.25 time: 0.506856 Jul 25 14:31:44.698178 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 837/1720] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:31:44 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 2424 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:31:44.738223 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0e8069f4-a83b-4dfd-bb3f-9f36cb5ec5a4 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:44.741703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0e8069f4-a83b-4dfd-bb3f-9f36cb5ec5a4 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:44.750377 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-eaca86f7-3504-47f7-9323-3acb43425df3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:44.763574 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-eaca86f7-3504-47f7-9323-3acb43425df3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1534 microversion: 2.1 time: 0.273634 Jul 25 14:31:44.766751 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e8069f4-a83b-4dfd-bb3f-9f36cb5ec5a4 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:44.770574 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e8069f4-a83b-4dfd-bb3f-9f36cb5ec5a4 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:44.771604 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e8069f4-a83b-4dfd-bb3f-9f36cb5ec5a4 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:44.772310 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e8069f4-a83b-4dfd-bb3f-9f36cb5ec5a4 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:44.778258 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 884/1721] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:44 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1534 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:44.870561 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f4030707-2b6c-43df-9d98-42d543d4665e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:44.871597 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f4030707-2b6c-43df-9d98-42d543d4665e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:44.880678 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f4030707-2b6c-43df-9d98-42d543d4665e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:44.881495 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f4030707-2b6c-43df-9d98-42d543d4665e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:44.882747 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f4030707-2b6c-43df-9d98-42d543d4665e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:44.883399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f4030707-2b6c-43df-9d98-42d543d4665e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:45.092259 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-f4030707-2b6c-43df-9d98-42d543d4665e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lazy-loading 'services' on Instance uuid 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:31:45.312356 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f4030707-2b6c-43df-9d98-42d543d4665e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "DELETE /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c/os-volume_attachments/926bc227-e97d-41d9-94b7-892e6ede6538" status: 202 len: 0 microversion: 2.25 time: 0.445859 Jul 25 14:31:45.312969 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 885/1722] 10.222.0.88 () {60 vars in 1457 bytes} [Mon Jul 25 14:31:44 2022] DELETE /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c/os-volume_attachments/926bc227-e97d-41d9-94b7-892e6ede6538 => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:31:45.320294 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0e8069f4-a83b-4dfd-bb3f-9f36cb5ec5a4 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:45.330558 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0e8069f4-a83b-4dfd-bb3f-9f36cb5ec5a4 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1521 microversion: 2.1 time: 0.605102 Jul 25 14:31:45.333906 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 838/1723] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:44 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1521 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:45.341499 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cfbeaeb2-dc02-4a2d-b7f0-39284abf8a1f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:45.341852 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5f27dc53-51e7-47bc-a584-ab07b117d816 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:45.345407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5f27dc53-51e7-47bc-a584-ab07b117d816 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] [instance: a1ee79ec-d346-42f8-ae58-06b110abdef0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:45.347561 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cfbeaeb2-dc02-4a2d-b7f0-39284abf8a1f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:45.364492 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cfbeaeb2-dc02-4a2d-b7f0-39284abf8a1f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:45.365395 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cfbeaeb2-dc02-4a2d-b7f0-39284abf8a1f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:45.365991 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5f27dc53-51e7-47bc-a584-ab07b117d816 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:45.366575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5f27dc53-51e7-47bc-a584-ab07b117d816 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:45.367566 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5f27dc53-51e7-47bc-a584-ab07b117d816 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:45.368142 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5f27dc53-51e7-47bc-a584-ab07b117d816 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:45.368409 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cfbeaeb2-dc02-4a2d-b7f0-39284abf8a1f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:45.369019 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cfbeaeb2-dc02-4a2d-b7f0-39284abf8a1f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:45.487363 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cfbeaeb2-dc02-4a2d-b7f0-39284abf8a1f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.152149 Jul 25 14:31:45.492047 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 839/1724] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Jul 25 14:31:45 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:31:45.499498 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-f475bc2f-1839-4e4e-bd71-8a30ee646794 req-5030bba3-b222-4141-a576-1f2016eeeeec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1ee79ec-d346-42f8-ae58-06b110abdef0", "tag": "8ba120e0-d996-462a-92c0-223ea6dc26e9"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:45.532816 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f475bc2f-1839-4e4e-bd71-8a30ee646794 req-5030bba3-b222-4141-a576-1f2016eeeeec service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:45.533618 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f475bc2f-1839-4e4e-bd71-8a30ee646794 req-5030bba3-b222-4141-a576-1f2016eeeeec service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:45.555773 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-f475bc2f-1839-4e4e-bd71-8a30ee646794 req-5030bba3-b222-4141-a576-1f2016eeeeec service nova] Creating event network-changed:8ba120e0-d996-462a-92c0-223ea6dc26e9 for instance a1ee79ec-d346-42f8-ae58-06b110abdef0 on n-h2-846435-14 Jul 25 14:31:45.565980 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-f475bc2f-1839-4e4e-bd71-8a30ee646794 req-5030bba3-b222-4141-a576-1f2016eeeeec service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072044 Jul 25 14:31:45.567084 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 840/1725] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:45.576317 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-21b3e5fd-7aa9-4499-88f0-9ae5495dd561 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:45.577462 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-21b3e5fd-7aa9-4499-88f0-9ae5495dd561 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:45.589245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-21b3e5fd-7aa9-4499-88f0-9ae5495dd561 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:45.589421 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-21b3e5fd-7aa9-4499-88f0-9ae5495dd561 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:45.590414 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-21b3e5fd-7aa9-4499-88f0-9ae5495dd561 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:45.590926 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-21b3e5fd-7aa9-4499-88f0-9ae5495dd561 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:45.718629 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5f27dc53-51e7-47bc-a584-ab07b117d816 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd9f6ef6ef34b51a55bb71f5d06040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01423e9ea2b94eef87188b26f99f9ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:45.729090 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5f27dc53-51e7-47bc-a584-ab07b117d816 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] 10.222.0.88 "GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0" status: 200 len: 1573 microversion: 2.1 time: 0.414615 Jul 25 14:31:45.730266 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 886/1726] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:45 2022] GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0 => generated 1573 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:45.791145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f163ee19-da78-494f-a95c-847ce06f8e75 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:45.792247 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f163ee19-da78-494f-a95c-847ce06f8e75 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:45.798201 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:31:45.799962 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f163ee19-da78-494f-a95c-847ce06f8e75 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:45.800621 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f163ee19-da78-494f-a95c-847ce06f8e75 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:45.801575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f163ee19-da78-494f-a95c-847ce06f8e75 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:45.802591 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f163ee19-da78-494f-a95c-847ce06f8e75 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:45.926827 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-21b3e5fd-7aa9-4499-88f0-9ae5495dd561 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:45.951211 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-21b3e5fd-7aa9-4499-88f0-9ae5495dd561 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e" status: 200 len: 1310 microversion: 2.1 time: 0.382444 Jul 25 14:31:45.951817 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 841/1727] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:45 2022] GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e => generated 1310 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:46.002415 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f163ee19-da78-494f-a95c-847ce06f8e75 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:46.012679 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f163ee19-da78-494f-a95c-847ce06f8e75 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1534 microversion: 2.1 time: 0.226069 Jul 25 14:31:46.024818 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 887/1728] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:45 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1534 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:31:46.164882 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-d9b8dd9d-e911-4935-bc59-e7953d69da0e req-ef847ca9-7957-40da-9ad2-4a4c1c11df97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c87c840-4e2c-4bc2-822b-93b046f8fab5", "name": "network-vif-plugged", "status": "completed", "tag": "0606594f-9a23-44eb-9ac0-96b677c84884"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:46.176496 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-d9b8dd9d-e911-4935-bc59-e7953d69da0e req-ef847ca9-7957-40da-9ad2-4a4c1c11df97 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:46.177416 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-d9b8dd9d-e911-4935-bc59-e7953d69da0e req-ef847ca9-7957-40da-9ad2-4a4c1c11df97 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:46.192448 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-d9b8dd9d-e911-4935-bc59-e7953d69da0e req-ef847ca9-7957-40da-9ad2-4a4c1c11df97 service nova] Creating event network-vif-plugged:0606594f-9a23-44eb-9ac0-96b677c84884 for instance 9c87c840-4e2c-4bc2-822b-93b046f8fab5 on n-h1-846435-14 Jul 25 14:31:46.199178 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-d9b8dd9d-e911-4935-bc59-e7953d69da0e req-ef847ca9-7957-40da-9ad2-4a4c1c11df97 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043525 Jul 25 14:31:46.200267 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 842/1729] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:31:46.354998 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-796b7cfe-2ea6-44e5-aea4-ef133704c546 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:46.355690 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-796b7cfe-2ea6-44e5-aea4-ef133704c546 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:46.364666 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-796b7cfe-2ea6-44e5-aea4-ef133704c546 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:46.364985 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-796b7cfe-2ea6-44e5-aea4-ef133704c546 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:46.369286 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-796b7cfe-2ea6-44e5-aea4-ef133704c546 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:46.369813 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-796b7cfe-2ea6-44e5-aea4-ef133704c546 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:46.509446 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ec82d282-a120-406c-b175-8fe597960419 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:46.512439 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ec82d282-a120-406c-b175-8fe597960419 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:46.531087 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec82d282-a120-406c-b175-8fe597960419 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:46.531538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec82d282-a120-406c-b175-8fe597960419 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:46.533347 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec82d282-a120-406c-b175-8fe597960419 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:46.535767 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec82d282-a120-406c-b175-8fe597960419 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:46.620873 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ec82d282-a120-406c-b175-8fe597960419 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.105337 Jul 25 14:31:46.621535 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 843/1730] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Jul 25 14:31:46 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 14:31:46.646809 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-796b7cfe-2ea6-44e5-aea4-ef133704c546 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:46.657825 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-796b7cfe-2ea6-44e5-aea4-ef133704c546 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1521 microversion: 2.1 time: 0.306963 Jul 25 14:31:46.669656 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 888/1731] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:46 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:46.976263 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-645aa30c-bf12-4094-b099-212fa9102395 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:46.977023 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-645aa30c-bf12-4094-b099-212fa9102395 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:46.984769 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-645aa30c-bf12-4094-b099-212fa9102395 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:46.985496 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-645aa30c-bf12-4094-b099-212fa9102395 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:46.986461 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-645aa30c-bf12-4094-b099-212fa9102395 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:46.987051 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-645aa30c-bf12-4094-b099-212fa9102395 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:47.035713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-26e59580-4af8-4f77-ad96-0d0539a357a3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:47.036354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-26e59580-4af8-4f77-ad96-0d0539a357a3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:47.060162 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26e59580-4af8-4f77-ad96-0d0539a357a3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:47.061004 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26e59580-4af8-4f77-ad96-0d0539a357a3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:47.062011 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26e59580-4af8-4f77-ad96-0d0539a357a3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:47.062907 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26e59580-4af8-4f77-ad96-0d0539a357a3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:47.292624 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-645aa30c-bf12-4094-b099-212fa9102395 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:47.311771 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-645aa30c-bf12-4094-b099-212fa9102395 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e" status: 200 len: 1310 microversion: 2.1 time: 0.338926 Jul 25 14:31:47.314367 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 844/1732] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:46 2022] GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e => generated 1310 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:47.336653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-26e59580-4af8-4f77-ad96-0d0539a357a3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:47.346163 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-26e59580-4af8-4f77-ad96-0d0539a357a3 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1534 microversion: 2.1 time: 0.315161 Jul 25 14:31:47.365190 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 889/1733] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:47 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1534 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:47.633987 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c3896a8e-5920-4b4f-9abf-577d1934b4e3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:47.637095 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c3896a8e-5920-4b4f-9abf-577d1934b4e3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:47.643997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c3896a8e-5920-4b4f-9abf-577d1934b4e3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:47.644756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c3896a8e-5920-4b4f-9abf-577d1934b4e3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:47.646074 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c3896a8e-5920-4b4f-9abf-577d1934b4e3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:47.646684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c3896a8e-5920-4b4f-9abf-577d1934b4e3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:47.683456 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ecfef826-7228-4277-b04f-06ad720d9826 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:47.684371 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ecfef826-7228-4277-b04f-06ad720d9826 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:47.687590 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c3896a8e-5920-4b4f-9abf-577d1934b4e3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.057887 Jul 25 14:31:47.688399 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 845/1734] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Jul 25 14:31:47 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:31:47.698146 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ecfef826-7228-4277-b04f-06ad720d9826 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:47.698764 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ecfef826-7228-4277-b04f-06ad720d9826 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:47.699901 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ecfef826-7228-4277-b04f-06ad720d9826 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:47.700981 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ecfef826-7228-4277-b04f-06ad720d9826 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:47.900016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ecfef826-7228-4277-b04f-06ad720d9826 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:47.909139 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ecfef826-7228-4277-b04f-06ad720d9826 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1521 microversion: 2.1 time: 0.230132 Jul 25 14:31:47.910361 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 890/1735] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:47 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:48.335462 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-91fb2786-e508-4d42-801d-82afc18de1f0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:48.336122 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-91fb2786-e508-4d42-801d-82afc18de1f0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:48.344696 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-91fb2786-e508-4d42-801d-82afc18de1f0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:48.345148 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-91fb2786-e508-4d42-801d-82afc18de1f0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:48.347691 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-91fb2786-e508-4d42-801d-82afc18de1f0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:48.348371 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-91fb2786-e508-4d42-801d-82afc18de1f0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:48.372984 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8f5aafa9-8226-41fb-b70e-64f88462e889 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:48.373555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8f5aafa9-8226-41fb-b70e-64f88462e889 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:48.384638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f5aafa9-8226-41fb-b70e-64f88462e889 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:48.392845 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f5aafa9-8226-41fb-b70e-64f88462e889 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:48.394823 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f5aafa9-8226-41fb-b70e-64f88462e889 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:48.395296 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f5aafa9-8226-41fb-b70e-64f88462e889 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:48.609672 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8f5aafa9-8226-41fb-b70e-64f88462e889 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:48.617728 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8f5aafa9-8226-41fb-b70e-64f88462e889 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1534 microversion: 2.1 time: 0.250864 Jul 25 14:31:48.622232 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 891/1736] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:48 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1534 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:31:48.704329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0c8237c8-00a0-4947-94e1-a9ad93f5ea9d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:48.707216 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0c8237c8-00a0-4947-94e1-a9ad93f5ea9d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:48.715138 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c8237c8-00a0-4947-94e1-a9ad93f5ea9d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:48.715883 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c8237c8-00a0-4947-94e1-a9ad93f5ea9d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:48.717946 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c8237c8-00a0-4947-94e1-a9ad93f5ea9d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:48.719045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c8237c8-00a0-4947-94e1-a9ad93f5ea9d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:48.765955 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0c8237c8-00a0-4947-94e1-a9ad93f5ea9d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.066579 Jul 25 14:31:48.766770 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 892/1737] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Jul 25 14:31:48 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 14:31:48.932032 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8575703d-14f2-4c37-b2ac-83556a22c9b0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:48.932885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8575703d-14f2-4c37-b2ac-83556a22c9b0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:48.943501 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8575703d-14f2-4c37-b2ac-83556a22c9b0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:48.944072 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8575703d-14f2-4c37-b2ac-83556a22c9b0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:48.952798 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8575703d-14f2-4c37-b2ac-83556a22c9b0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:48.953249 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8575703d-14f2-4c37-b2ac-83556a22c9b0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:49.067590 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-91fb2786-e508-4d42-801d-82afc18de1f0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:49.080708 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-91fb2786-e508-4d42-801d-82afc18de1f0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e" status: 200 len: 1310 microversion: 2.1 time: 0.749140 Jul 25 14:31:49.081313 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 846/1738] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:48 2022] GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e => generated 1310 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:49.413636 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cfa57cf1-949b-42d9-a4e0-b509d20a1d34 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "b322da5f-57f9-43f8-9611-60c71532ce5f"}], "security_groups": [{"name": "tempest-securitygroup--341111733"}], "key_name": "tempest-keypair-1297777237", "user_data": "}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:49.648923 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-cfa57cf1-949b-42d9-a4e0-b509d20a1d34 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] validate_networks() for [('b322da5f-57f9-43f8-9611-60c71532ce5f', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:31:49.707176 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8575703d-14f2-4c37-b2ac-83556a22c9b0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:49.716623 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8575703d-14f2-4c37-b2ac-83556a22c9b0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1506 microversion: 2.1 time: 0.788952 Jul 25 14:31:49.717898 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 893/1739] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:48 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1506 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:31:49.847754 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-025db9de-0cf7-4a40-a3c1-b7e535b29642 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Action: 'create', calling method: .version_select at 0x7f4687328f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-984010912", "description": "tempest-description-1981985195"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:50.317075 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-025db9de-0cf7-4a40-a3c1-b7e535b29642 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.597752 Jul 25 14:31:50.317872 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 894/1740] 10.222.0.88 () {60 vars in 1180 bytes} [Mon Jul 25 14:31:49 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:50.327414 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dc146aed-fc08-48f7-9730-bb593efc6650 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:50.332249 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dc146aed-fc08-48f7-9730-bb593efc6650 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:50.349856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dc146aed-fc08-48f7-9730-bb593efc6650 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:50.356344 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dc146aed-fc08-48f7-9730-bb593efc6650 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:50.361338 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dc146aed-fc08-48f7-9730-bb593efc6650 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:50.362051 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dc146aed-fc08-48f7-9730-bb593efc6650 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:50.451831 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-cfa57cf1-949b-42d9-a4e0-b509d20a1d34 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:31:50.452429 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-cfa57cf1-949b-42d9-a4e0-b509d20a1d34 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:31:50.452920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-cfa57cf1-949b-42d9-a4e0-b509d20a1d34 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:31:50.453335 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-cfa57cf1-949b-42d9-a4e0-b509d20a1d34 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:31:50.453757 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-cfa57cf1-949b-42d9-a4e0-b509d20a1d34 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:31:50.467328 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cfa57cf1-949b-42d9-a4e0-b509d20a1d34 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:50.467878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cfa57cf1-949b-42d9-a4e0-b509d20a1d34 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:50.468912 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cfa57cf1-949b-42d9-a4e0-b509d20a1d34 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:50.469295 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cfa57cf1-949b-42d9-a4e0-b509d20a1d34 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:50.503315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dc146aed-fc08-48f7-9730-bb593efc6650 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:50.511849 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dc146aed-fc08-48f7-9730-bb593efc6650 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 200 len: 1492 microversion: 2.1 time: 0.192269 Jul 25 14:31:50.514565 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 895/1741] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:50 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 1492 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:50.529452 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-cfa57cf1-949b-42d9-a4e0-b509d20a1d34 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Getting quotas for project c4bbc39957d740eeb578bf4e7ebb931e. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:31:50.534370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-742ce0ce-3987-4359-9173-d341bd1950c5 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:50.535367 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:31:50.536406 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-742ce0ce-3987-4359-9173-d341bd1950c5 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:50.537057 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-cfa57cf1-949b-42d9-a4e0-b509d20a1d34 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Getting quotas for user 99cd21f1fcc145d7a854c1a6b3005a59 and project c4bbc39957d740eeb578bf4e7ebb931e. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:31:50.549174 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-742ce0ce-3987-4359-9173-d341bd1950c5 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:50.550035 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-742ce0ce-3987-4359-9173-d341bd1950c5 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:50.551083 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-742ce0ce-3987-4359-9173-d341bd1950c5 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:50.556950 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-742ce0ce-3987-4359-9173-d341bd1950c5 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:50.561964 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cfa57cf1-949b-42d9-a4e0-b509d20a1d34 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:31:50.565016 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cfa57cf1-949b-42d9-a4e0-b509d20a1d34 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] [instance: 44ad669c-e3e8-4b12-a64a-2245d98dea47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:31:50.634803 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cfa57cf1-949b-42d9-a4e0-b509d20a1d34 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.226436 Jul 25 14:31:50.636716 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 847/1742] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:31:49 2022] POST /compute/v2.1/servers => generated 408 bytes in 1229 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:31:50.646707 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-694c0da7-78c2-4721-92ac-e12dbb72b6e0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:50.649262 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-694c0da7-78c2-4721-92ac-e12dbb72b6e0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:50.656996 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-694c0da7-78c2-4721-92ac-e12dbb72b6e0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:50.657727 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-694c0da7-78c2-4721-92ac-e12dbb72b6e0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:50.658724 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-694c0da7-78c2-4721-92ac-e12dbb72b6e0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:50.659335 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-694c0da7-78c2-4721-92ac-e12dbb72b6e0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:50.730838 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-694c0da7-78c2-4721-92ac-e12dbb72b6e0 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.092664 Jul 25 14:31:50.731347 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 848/1743] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Jul 25 14:31:50 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:31:50.738125 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e9423315-2199-4ab9-8aa0-24b77f3968af tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:50.738780 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e9423315-2199-4ab9-8aa0-24b77f3968af tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:50.745562 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e9423315-2199-4ab9-8aa0-24b77f3968af tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:50.746264 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e9423315-2199-4ab9-8aa0-24b77f3968af tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:50.752410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e9423315-2199-4ab9-8aa0-24b77f3968af tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:50.761180 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e9423315-2199-4ab9-8aa0-24b77f3968af tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:51.215324 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e9423315-2199-4ab9-8aa0-24b77f3968af tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:51.217870 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:31:51.238990 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e9423315-2199-4ab9-8aa0-24b77f3968af tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e" status: 200 len: 1310 microversion: 2.1 time: 0.506168 Jul 25 14:31:51.239879 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 849/1744] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:50 2022] GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e => generated 1310 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:51.244942 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6f60b05b-73a8-4142-ad46-123c00905af4 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Action: 'create', calling method: .version_select at 0x7f46873df0d0>, body: {"security_group_rule": {"parent_group_id": "96b58664-2bcb-4f2b-852f-a74cf6791978", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:51.442312 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-742ce0ce-3987-4359-9173-d341bd1950c5 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:51.452827 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-742ce0ce-3987-4359-9173-d341bd1950c5 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 200 len: 1506 microversion: 2.1 time: 0.936983 Jul 25 14:31:51.454581 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 896/1745] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:50 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 1506 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:51.460307 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-83b86052-df83-410b-a8f8-cefa2f8fc277 req-c63e820d-fe6c-453f-aba4-74d3cc98d996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698a551a-c019-4ae5-ba50-0d190e41ff03", "name": "network-vif-deleted", "tag": "a454c550-e298-46f0-8c6c-7d7c39505dca"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:51.474249 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-83b86052-df83-410b-a8f8-cefa2f8fc277 req-c63e820d-fe6c-453f-aba4-74d3cc98d996 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:51.476193 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-83b86052-df83-410b-a8f8-cefa2f8fc277 req-c63e820d-fe6c-453f-aba4-74d3cc98d996 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:51.508909 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-83b86052-df83-410b-a8f8-cefa2f8fc277 req-c63e820d-fe6c-453f-aba4-74d3cc98d996 service nova] Creating event network-vif-deleted:a454c550-e298-46f0-8c6c-7d7c39505dca for instance 698a551a-c019-4ae5-ba50-0d190e41ff03 on n-h2-846435-14 Jul 25 14:31:51.515398 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-83b86052-df83-410b-a8f8-cefa2f8fc277 req-c63e820d-fe6c-453f-aba4-74d3cc98d996 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059191 Jul 25 14:31:51.517249 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 897/1746] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:51.531368 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-66c03a06-f709-49e1-a009-cc9b8f0265cc tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:51.535684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-66c03a06-f709-49e1-a009-cc9b8f0265cc tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] [instance: 44ad669c-e3e8-4b12-a64a-2245d98dea47] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:51.637699 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-66c03a06-f709-49e1-a009-cc9b8f0265cc tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cd21f1fcc145d7a854c1a6b3005a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bbc39957d740eeb578bf4e7ebb931e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:51.646870 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-66c03a06-f709-49e1-a009-cc9b8f0265cc tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] 10.222.0.88 "GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47" status: 200 len: 1226 microversion: 2.1 time: 0.125668 Jul 25 14:31:51.647752 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6f60b05b-73a8-4142-ad46-123c00905af4 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] 10.222.0.88 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.406554 Jul 25 14:31:51.648838 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 850/1747] 10.222.0.88 () {60 vars in 1195 bytes} [Mon Jul 25 14:31:51 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:51.654499 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ecc9aeb8-e0dd-4da7-bd07-5810c49ef2c6 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:51.655462 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ecc9aeb8-e0dd-4da7-bd07-5810c49ef2c6 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:51.661899 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 898/1748] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:51 2022] GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47 => generated 1226 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:51.673634 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4966114a-7bdc-4061-9432-739d7ff3d3d8 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:51.674583 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4966114a-7bdc-4061-9432-739d7ff3d3d8 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 698a551a-c019-4ae5-ba50-0d190e41ff03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:51.675936 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ecc9aeb8-e0dd-4da7-bd07-5810c49ef2c6 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:51.676634 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ecc9aeb8-e0dd-4da7-bd07-5810c49ef2c6 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:51.677429 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ecc9aeb8-e0dd-4da7-bd07-5810c49ef2c6 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:51.678042 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ecc9aeb8-e0dd-4da7-bd07-5810c49ef2c6 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:51.692021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4966114a-7bdc-4061-9432-739d7ff3d3d8 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:51.692562 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4966114a-7bdc-4061-9432-739d7ff3d3d8 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:51.695232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4966114a-7bdc-4061-9432-739d7ff3d3d8 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:51.695741 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4966114a-7bdc-4061-9432-739d7ff3d3d8 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:51.716571 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-4966114a-7bdc-4061-9432-739d7ff3d3d8 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] HTTP exception thrown: Instance 698a551a-c019-4ae5-ba50-0d190e41ff03 could not be found. Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4966114a-7bdc-4061-9432-739d7ff3d3d8 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Request method failure captured: Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 HTTP/1.1 Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qgQ0giBIKJS3p1fKMOwG5iykKOb_7z2xkUwzX9ZOQP9w2TF7jf5B2qoIekEaNujbgYY0003fI8cBRBWofwaT6xURCwj33RgtUgI5CEAt7_13L8_mUPvgHP5u7-q-4hdnU9gOvpZrSenVJEtvuSYp_43hbO7IzDEh1EZa5FB6U8bMTY Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 887aa20d1838484eb895896f8f76ce41 Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-MigrationsAdminTest-1396799549 Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/887aa20d1838484eb895896f8f76ce41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/887aa20d1838484eb895896f8f76ce41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_887aa20d1838484eb895896f8f76ce41", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/887aa20d1838484eb895896f8f76ce41"}]}] Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-MigrationsAdminTest-1396799549 Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 887aa20d1838484eb895896f8f76ce41 Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-MigrationsAdminTest-1396799549 Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-MigrationsAdminTest-1396799549-project Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 00aea97fb95c44cfa5dce25e9a06cd37 Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-MigrationsAdminTest-1396799549-project Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 698a551a-c019-4ae5-ba50-0d190e41ff03 could not be found. Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '698a551a-c019-4ae5-ba50-0d190e41ff03'} Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 698a551a-c019-4ae5-ba50-0d190e41ff03 could not be found. Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 698a551a-c019-4ae5-ba50-0d190e41ff03 could not be found. Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:51.719539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:51.724518 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:51.724518 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:51.724518 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:51.724518 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:51.724518 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:51.724518 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 698a551a-c019-4ae5-ba50-0d190e41ff03 could not be found. Jul 25 14:31:51.724518 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:51.731628 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ecc9aeb8-e0dd-4da7-bd07-5810c49ef2c6 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:31:51.739402 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4966114a-7bdc-4061-9432-739d7ff3d3d8 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Returning 404 to user: Instance 698a551a-c019-4ae5-ba50-0d190e41ff03 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:51.740750 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4966114a-7bdc-4061-9432-739d7ff3d3d8 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03" status: 404 len: 111 microversion: 2.1 time: 0.077556 Jul 25 14:31:51.741608 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 899/1749] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:51 2022] GET /compute/v2.1/servers/698a551a-c019-4ae5-ba50-0d190e41ff03 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:31:51.749500 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-436f7390-173a-4c22-8f9c-53ea42247266 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Action: 'create', calling method: .version_select at 0x7f46988f0a60>, body: {"security_group_rule": {"parent_group_id": "96b58664-2bcb-4f2b-852f-a74cf6791978", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:51.874633 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ecc9aeb8-e0dd-4da7-bd07-5810c49ef2c6 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "DELETE /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 204 len: 0 microversion: 2.1 time: 0.224155 Jul 25 14:31:51.876042 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 851/1750] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:31:51 2022] DELETE /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:31:51.882625 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ae52802d-ce54-42df-b40a-cdf3419e7161 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:51.885366 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ae52802d-ce54-42df-b40a-cdf3419e7161 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:51.894076 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae52802d-ce54-42df-b40a-cdf3419e7161 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:51.895333 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae52802d-ce54-42df-b40a-cdf3419e7161 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:51.895475 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-436f7390-173a-4c22-8f9c-53ea42247266 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] HTTP exception thrown: This rule already exists in group 96b58664-2bcb-4f2b-852f-a74cf6791978 Jul 25 14:31:51.896554 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae52802d-ce54-42df-b40a-cdf3419e7161 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:51.897386 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae52802d-ce54-42df-b40a-cdf3419e7161 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-436f7390-173a-4c22-8f9c-53ea42247266 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Request method failure captured: Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 138 Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qlVeoUgFBKBbmkc_yjfoqij1HRwOL8Oxz00KB4CntvW5PWBxtm3K4ah2l_7sTvSQwSCL5qKB3qS6PgFZksMqY87FgfOaw694U2CnUWNo1WC25rzgOv14NVh4zvksd3b7Hz6X2bs_STPxowGYVMs67zy1e6s5Y9w4Tgem1_UrUxOyGQ Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: a8ae8ed9ff4e4db794443c44bd07b87c Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-965494295 Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a8ae8ed9ff4e4db794443c44bd07b87c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a8ae8ed9ff4e4db794443c44bd07b87c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a8ae8ed9ff4e4db794443c44bd07b87c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a8ae8ed9ff4e4db794443c44bd07b87c"}]}] Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-965494295 Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: a8ae8ed9ff4e4db794443c44bd07b87c Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-965494295 Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-965494295-project Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 2fadc6caa6fb47fabf771d771e244e83 Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-965494295-project Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: {"security_group_rule": {"parent_group_id": "96b58664-2bcb-4f2b-852f-a74cf6791978", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: exception: This rule already exists in group 96b58664-2bcb-4f2b-852f-a74cf6791978 Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'body': {'security_group_rule': {'parent_group_id': '96b58664-2bcb-4f2b-852f-a74cf6791978', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 96b58664-2bcb-4f2b-852f-a74cf6791978 Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 96b58664-2bcb-4f2b-852f-a74cf6791978 Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:51.897520 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:51.902580 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:51.902580 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:51.902580 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 96b58664-2bcb-4f2b-852f-a74cf6791978 Jul 25 14:31:51.902580 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:51.902580 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-436f7390-173a-4c22-8f9c-53ea42247266 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Returning 400 to user: This rule already exists in group 96b58664-2bcb-4f2b-852f-a74cf6791978 {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:51.902580 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-436f7390-173a-4c22-8f9c-53ea42247266 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] 10.222.0.88 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.156036 Jul 25 14:31:51.904082 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 900/1751] 10.222.0.88 () {60 vars in 1195 bytes} [Mon Jul 25 14:31:51 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 161 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:31:51.911807 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2ebdec3b-973e-45d8-8d68-45019efb170c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '.version_select at 0x7f46989e3550>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:51.941577 n-d-846435-14 devstack@n-api.service[119304]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2ebdec3b-973e-45d8-8d68-45019efb170c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [56f6bbb3-d79b-419b-8d71-b05e55801b63] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 14:31:51.948144 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ae52802d-ce54-42df-b40a-cdf3419e7161 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.070064 Jul 25 14:31:51.949272 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 852/1752] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Jul 25 14:31:51 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:31:51.956792 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4d7378ce-11dd-4dea-be44-4af254e2a0ca tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Calling method '.version_select at 0x7f46874ec1f0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:52.176022 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4d7378ce-11dd-4dea-be44-4af254e2a0ca tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-group-rules/b710d8c4-e00c-4db5-b72d-568b6647e82d" status: 202 len: 0 microversion: 2.1 time: 0.225347 Jul 25 14:31:52.177075 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 853/1753] 10.222.0.88 () {58 vars in 1287 bytes} [Mon Jul 25 14:31:51 2022] DELETE /compute/v2.1/os-security-group-rules/b710d8c4-e00c-4db5-b72d-568b6647e82d => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:31:52.187110 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a9d80fc5-ee09-4d7a-9b6e-c2e78adf48fe tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1319650824", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "02a1497d-2151-4500-a802-575a0ee651dc"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:52.244136 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-a9d80fc5-ee09-4d7a-9b6e-c2e78adf48fe tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] validate_networks() for [('02a1497d-2151-4500-a802-575a0ee651dc', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:31:52.624598 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-a9d80fc5-ee09-4d7a-9b6e-c2e78adf48fe tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:31:52.625029 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-a9d80fc5-ee09-4d7a-9b6e-c2e78adf48fe tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:31:52.625510 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-a9d80fc5-ee09-4d7a-9b6e-c2e78adf48fe tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:31:52.625924 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-a9d80fc5-ee09-4d7a-9b6e-c2e78adf48fe tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:31:52.626337 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-a9d80fc5-ee09-4d7a-9b6e-c2e78adf48fe tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:31:52.635932 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a9d80fc5-ee09-4d7a-9b6e-c2e78adf48fe tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:52.636427 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a9d80fc5-ee09-4d7a-9b6e-c2e78adf48fe tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:52.637278 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a9d80fc5-ee09-4d7a-9b6e-c2e78adf48fe tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:52.637715 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a9d80fc5-ee09-4d7a-9b6e-c2e78adf48fe tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:52.655683 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-a9d80fc5-ee09-4d7a-9b6e-c2e78adf48fe tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Getting quotas for project c8a6408dd1d343b0a82c8ec6d1b7d5af. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:31:52.660891 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-a9d80fc5-ee09-4d7a-9b6e-c2e78adf48fe tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Getting quotas for user 0f6a08479a4a4520b25a5b2e20c99670 and project c8a6408dd1d343b0a82c8ec6d1b7d5af. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:31:52.674339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a9d80fc5-ee09-4d7a-9b6e-c2e78adf48fe tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:31:52.676659 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a9d80fc5-ee09-4d7a-9b6e-c2e78adf48fe tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:31:52.724963 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a9d80fc5-ee09-4d7a-9b6e-c2e78adf48fe tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546137 Jul 25 14:31:52.731576 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 854/1754] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:31:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:31:52.731576 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-5bb8a0f8-a3c9-4cbd-b34a-3443617ae30f req-fbb62570-c4be-4ddb-8444-11d81273f5de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48341efc-a4b6-4532-8a2b-ac8d8f50a26e", "name": "network-vif-plugged", "status": "completed", "tag": "2b310f15-4cbb-46d3-87df-2b7fb95774aa"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:52.741564 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-5bb8a0f8-a3c9-4cbd-b34a-3443617ae30f req-fbb62570-c4be-4ddb-8444-11d81273f5de service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:52.742474 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-5bb8a0f8-a3c9-4cbd-b34a-3443617ae30f req-fbb62570-c4be-4ddb-8444-11d81273f5de service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:52.755180 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-5bb8a0f8-a3c9-4cbd-b34a-3443617ae30f req-fbb62570-c4be-4ddb-8444-11d81273f5de service nova] Creating event network-vif-plugged:2b310f15-4cbb-46d3-87df-2b7fb95774aa for instance 48341efc-a4b6-4532-8a2b-ac8d8f50a26e on n-h2-846435-14 Jul 25 14:31:52.762421 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-5bb8a0f8-a3c9-4cbd-b34a-3443617ae30f req-fbb62570-c4be-4ddb-8444-11d81273f5de service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035441 Jul 25 14:31:52.763310 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 855/1755] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:52.770807 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6fb31bcf-aa27-41ae-8aa0-104bb44e2b19 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Action: 'create', calling method: .version_select at 0x7f46873dfe50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2135353788", "description": "tempest-description-2020794858"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:52.951278 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [None req-2ebdec3b-973e-45d8-8d68-45019efb170c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [56f6bbb3-d79b-419b-8d71-b05e55801b63] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 46136. Jul 25 14:31:52.967741 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6fb31bcf-aa27-41ae-8aa0-104bb44e2b19 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.199356 Jul 25 14:31:52.983583 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2ebdec3b-973e-45d8-8d68-45019efb170c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1801699491" status: 202 len: 0 microversion: 2.1 time: 1.077203 Jul 25 14:31:52.983935 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 901/1756] 10.222.0.88 () {58 vars in 1221 bytes} [Mon Jul 25 14:31:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1801699491 => generated 0 bytes in 1080 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:31:52.987303 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 856/1757] 10.222.0.88 () {60 vars in 1180 bytes} [Mon Jul 25 14:31:52 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:52.992405 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-eabe9d34-85b1-472b-9847-2807633c0fad tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:52.993193 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-eabe9d34-85b1-472b-9847-2807633c0fad tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:52.996410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e6b12a66-a806-462d-a9fd-d8ada2585d18 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:52.997288 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e6b12a66-a806-462d-a9fd-d8ada2585d18 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] [instance: 44ad669c-e3e8-4b12-a64a-2245d98dea47] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:53.001330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eabe9d34-85b1-472b-9847-2807633c0fad tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:53.002223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eabe9d34-85b1-472b-9847-2807633c0fad tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:53.003314 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eabe9d34-85b1-472b-9847-2807633c0fad tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:53.003906 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eabe9d34-85b1-472b-9847-2807633c0fad tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:53.013316 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e6b12a66-a806-462d-a9fd-d8ada2585d18 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:53.014675 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e6b12a66-a806-462d-a9fd-d8ada2585d18 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:53.015709 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e6b12a66-a806-462d-a9fd-d8ada2585d18 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:53.016432 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e6b12a66-a806-462d-a9fd-d8ada2585d18 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:53.190386 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e6b12a66-a806-462d-a9fd-d8ada2585d18 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cd21f1fcc145d7a854c1a6b3005a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bbc39957d740eeb578bf4e7ebb931e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:53.206055 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e6b12a66-a806-462d-a9fd-d8ada2585d18 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] 10.222.0.88 "GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47" status: 200 len: 1222 microversion: 2.1 time: 0.217368 Jul 25 14:31:53.208470 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 857/1758] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:52 2022] GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47 => generated 1222 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:53.220279 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bc1658d1-ef3e-4ad9-848e-1fc61f33c02c tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:53.222152 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bc1658d1-ef3e-4ad9-848e-1fc61f33c02c tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:53.389770 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bc1658d1-ef3e-4ad9-848e-1fc61f33c02c tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:53.401370 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bc1658d1-ef3e-4ad9-848e-1fc61f33c02c tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1218 microversion: 2.1 time: 0.191490 Jul 25 14:31:53.402686 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 858/1759] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:53 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1218 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:53.409364 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-962fdb02-e7bf-4a3b-aec6-0c87935235a5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:53.412621 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-962fdb02-e7bf-4a3b-aec6-0c87935235a5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:53.433301 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-962fdb02-e7bf-4a3b-aec6-0c87935235a5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:53.437681 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-962fdb02-e7bf-4a3b-aec6-0c87935235a5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:53.438785 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-962fdb02-e7bf-4a3b-aec6-0c87935235a5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:53.441161 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-962fdb02-e7bf-4a3b-aec6-0c87935235a5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:53.472195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-eabe9d34-85b1-472b-9847-2807633c0fad tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:53.485665 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-eabe9d34-85b1-472b-9847-2807633c0fad tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e" status: 200 len: 1310 microversion: 2.1 time: 0.499636 Jul 25 14:31:53.486910 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 902/1760] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:52 2022] GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e => generated 1310 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:53.495043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-616e6b78-c221-4e8f-83d2-c92d188bc339 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Action: 'create', calling method: .version_select at 0x7f4687532d30>, body: {"security_group_rule": {"parent_group_id": "8016aa3d-27a4-4847-b025-640f54f436c3", "ip_protocol": "tcp", "from_port": 1791979626, "to_port": 22}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:53.546156 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-962fdb02-e7bf-4a3b-aec6-0c87935235a5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.141741 Jul 25 14:31:53.546751 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 859/1761] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Jul 25 14:31:53 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:31:53.727399 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-616e6b78-c221-4e8f-83d2-c92d188bc339 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] HTTP exception thrown: Invalid port range 1791979626:22. Former value cannot be greater than the later Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-616e6b78-c221-4e8f-83d2-c92d188bc339 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Request method failure captured: Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 146 Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qlVeoUgFBKBbmkc_yjfoqij1HRwOL8Oxz00KB4CntvW5PWBxtm3K4ah2l_7sTvSQwSCL5qKB3qS6PgFZksMqY87FgfOaw694U2CnUWNo1WC25rzgOv14NVh4zvksd3b7Hz6X2bs_STPxowGYVMs67zy1e6s5Y9w4Tgem1_UrUxOyGQ Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: a8ae8ed9ff4e4db794443c44bd07b87c Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-965494295 Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a8ae8ed9ff4e4db794443c44bd07b87c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a8ae8ed9ff4e4db794443c44bd07b87c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a8ae8ed9ff4e4db794443c44bd07b87c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a8ae8ed9ff4e4db794443c44bd07b87c"}]}] Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-965494295 Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: a8ae8ed9ff4e4db794443c44bd07b87c Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-965494295 Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-965494295-project Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 2fadc6caa6fb47fabf771d771e244e83 Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-965494295-project Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: {"security_group_rule": {"parent_group_id": "8016aa3d-27a4-4847-b025-640f54f436c3", "ip_protocol": "tcp", "from_port": 1791979626, "to_port": 22}} Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: exception: Invalid port range 1791979626:22. Former value cannot be greater than the later Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8016aa3d-27a4-4847-b025-640f54f436c3', 'ip_protocol': 'tcp', 'from_port': 1791979626, 'to_port': 22}}} Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1791979626:22. Former value cannot be greater than the later Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1791979626:22. Former value cannot be greater than the later Jul 25 14:31:53.729297 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:53.734582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:53.734582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:53.734582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:53.734582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:53.734582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:53.734582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:53.734582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:53.734582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1791979626:22. Former value cannot be greater than the later Jul 25 14:31:53.734582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:53.746482 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-616e6b78-c221-4e8f-83d2-c92d188bc339 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Returning 400 to user: Invalid port range 1791979626:22. Former value cannot be greater than the later {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:53.747851 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-616e6b78-c221-4e8f-83d2-c92d188bc339 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] 10.222.0.88 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.258551 Jul 25 14:31:53.749052 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 903/1762] 10.222.0.88 () {60 vars in 1195 bytes} [Mon Jul 25 14:31:53 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 261 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:31:53.762332 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7005bb8a-3fbd-4f40-992d-f5d8a4b4c95b tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Action: 'create', calling method: .version_select at 0x7f46874f1af0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-489543628", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:53.764343 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-7005bb8a-3fbd-4f40-992d-f5d8a4b4c95b tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] HTTP exception thrown: Security group id should be uuid Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7005bb8a-3fbd-4f40-992d-f5d8a4b4c95b tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Request method failure captured: Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 130 Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qlVeoUgFBKBbmkc_yjfoqij1HRwOL8Oxz00KB4CntvW5PWBxtm3K4ah2l_7sTvSQwSCL5qKB3qS6PgFZksMqY87FgfOaw694U2CnUWNo1WC25rzgOv14NVh4zvksd3b7Hz6X2bs_STPxowGYVMs67zy1e6s5Y9w4Tgem1_UrUxOyGQ Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: a8ae8ed9ff4e4db794443c44bd07b87c Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-965494295 Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a8ae8ed9ff4e4db794443c44bd07b87c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a8ae8ed9ff4e4db794443c44bd07b87c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a8ae8ed9ff4e4db794443c44bd07b87c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a8ae8ed9ff4e4db794443c44bd07b87c"}]}] Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-965494295 Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: a8ae8ed9ff4e4db794443c44bd07b87c Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-965494295 Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-965494295-project Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 2fadc6caa6fb47fabf771d771e244e83 Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-965494295-project Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-489543628", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: exception: Security group id should be uuid Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-489543628', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:53.775125 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:53.779756 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jul 25 14:31:53.779756 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:53.780063 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7005bb8a-3fbd-4f40-992d-f5d8a4b4c95b tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Returning 400 to user: Security group id should be uuid {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:53.784369 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7005bb8a-3fbd-4f40-992d-f5d8a4b4c95b tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] 10.222.0.88 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.027687 Jul 25 14:31:53.784976 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 860/1763] 10.222.0.88 () {60 vars in 1195 bytes} [Mon Jul 25 14:31:53 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 14:31:53.796866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c779db8e-3591-4713-8e54-f9ccc3fc5ece tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Action: 'create', calling method: .version_select at 0x7f46988ff1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-614719191", "description": "tempest-description-742239259"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:54.235884 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5b93f5ea-411b-4eb1-a8ce-58155e3aed7a tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:54.236474 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5b93f5ea-411b-4eb1-a8ce-58155e3aed7a tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] [instance: 44ad669c-e3e8-4b12-a64a-2245d98dea47] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:54.257982 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5b93f5ea-411b-4eb1-a8ce-58155e3aed7a tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:54.267691 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5b93f5ea-411b-4eb1-a8ce-58155e3aed7a tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:54.268985 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5b93f5ea-411b-4eb1-a8ce-58155e3aed7a tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:54.269559 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5b93f5ea-411b-4eb1-a8ce-58155e3aed7a tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:54.422046 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5b93f5ea-411b-4eb1-a8ce-58155e3aed7a tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cd21f1fcc145d7a854c1a6b3005a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bbc39957d740eeb578bf4e7ebb931e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:54.460222 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5b93f5ea-411b-4eb1-a8ce-58155e3aed7a tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] 10.222.0.88 "GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47" status: 200 len: 1284 microversion: 2.1 time: 0.229071 Jul 25 14:31:54.485096 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 861/1764] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:54 2022] GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47 => generated 1284 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:54.499579 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-eb950236-57ca-4996-8bbf-97868eb75abb tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:54.500655 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-eb950236-57ca-4996-8bbf-97868eb75abb tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:54.515221 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eb950236-57ca-4996-8bbf-97868eb75abb tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:54.516220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eb950236-57ca-4996-8bbf-97868eb75abb tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:54.517291 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eb950236-57ca-4996-8bbf-97868eb75abb tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:54.518227 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eb950236-57ca-4996-8bbf-97868eb75abb tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:54.678223 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-eb950236-57ca-4996-8bbf-97868eb75abb tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:54.712236 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-eb950236-57ca-4996-8bbf-97868eb75abb tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1278 microversion: 2.1 time: 0.220979 Jul 25 14:31:54.713857 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 862/1765] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:54 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1278 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:54.731575 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-3f8b176d-0643-4fae-9178-ad7e2feb4c38 req-903e8427-bdcc-46ff-89c9-a75a681acb11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c87c840-4e2c-4bc2-822b-93b046f8fab5", "name": "network-vif-deleted", "tag": "0606594f-9a23-44eb-9ac0-96b677c84884"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:54.755275 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-3f8b176d-0643-4fae-9178-ad7e2feb4c38 req-903e8427-bdcc-46ff-89c9-a75a681acb11 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:54.763811 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-3f8b176d-0643-4fae-9178-ad7e2feb4c38 req-903e8427-bdcc-46ff-89c9-a75a681acb11 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:54.800111 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-3f8b176d-0643-4fae-9178-ad7e2feb4c38 req-903e8427-bdcc-46ff-89c9-a75a681acb11 service nova] Creating event network-vif-deleted:0606594f-9a23-44eb-9ac0-96b677c84884 for instance 9c87c840-4e2c-4bc2-822b-93b046f8fab5 on n-h1-846435-14 Jul 25 14:31:54.811113 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-3f8b176d-0643-4fae-9178-ad7e2feb4c38 req-903e8427-bdcc-46ff-89c9-a75a681acb11 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092970 Jul 25 14:31:54.812967 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 863/1766] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:54.820274 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-87812863-0638-42c3-9bbe-5c0a714b8c27 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:54.822185 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-87812863-0638-42c3-9bbe-5c0a714b8c27 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:54.850495 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-87812863-0638-42c3-9bbe-5c0a714b8c27 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:54.851187 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-87812863-0638-42c3-9bbe-5c0a714b8c27 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:54.852210 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-87812863-0638-42c3-9bbe-5c0a714b8c27 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:54.852800 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-87812863-0638-42c3-9bbe-5c0a714b8c27 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:54.889939 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c779db8e-3591-4713-8e54-f9ccc3fc5ece tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.097103 Jul 25 14:31:54.892121 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 904/1767] 10.222.0.88 () {60 vars in 1180 bytes} [Mon Jul 25 14:31:53 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:54.901363 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-45c11fb8-50e4-4d82-bef4-fd4bc009ad7b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:54.906085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-45c11fb8-50e4-4d82-bef4-fd4bc009ad7b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:54.925068 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45c11fb8-50e4-4d82-bef4-fd4bc009ad7b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:54.925948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45c11fb8-50e4-4d82-bef4-fd4bc009ad7b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:54.926957 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45c11fb8-50e4-4d82-bef4-fd4bc009ad7b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:54.928959 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45c11fb8-50e4-4d82-bef4-fd4bc009ad7b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:55.022644 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-45c11fb8-50e4-4d82-bef4-fd4bc009ad7b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.126563 Jul 25 14:31:55.023919 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 905/1768] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Jul 25 14:31:54 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:31:55.036543 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-724a11e1-373b-46c4-9147-8aa7b3389765 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Action: 'create', calling method: .version_select at 0x7f4698964ca0>, body: {"security_group_rule": {"parent_group_id": "20190644-1326-49d8-885d-2d610336e4fc", "ip_protocol": "tempest-999-2032186644", "from_port": 22, "to_port": 22}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:55.249393 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-87812863-0638-42c3-9bbe-5c0a714b8c27 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:55.260679 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-87812863-0638-42c3-9bbe-5c0a714b8c27 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e" status: 200 len: 1493 microversion: 2.1 time: 0.445760 Jul 25 14:31:55.264485 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 864/1769] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:54 2022] GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e => generated 1493 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:55.283043 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cbee1464-8e29-4453-8bed-b672b284d363 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:55.283662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cbee1464-8e29-4453-8bed-b672b284d363 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:55.296132 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cbee1464-8e29-4453-8bed-b672b284d363 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:55.296866 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cbee1464-8e29-4453-8bed-b672b284d363 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:55.297966 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-724a11e1-373b-46c4-9147-8aa7b3389765 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] HTTP exception thrown: Invalid IP protocol tempest-999-2032186644. Jul 25 14:31:55.299021 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cbee1464-8e29-4453-8bed-b672b284d363 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-724a11e1-373b-46c4-9147-8aa7b3389765 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Request method failure captured: Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 157 Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qlVeoUgFBKBbmkc_yjfoqij1HRwOL8Oxz00KB4CntvW5PWBxtm3K4ah2l_7sTvSQwSCL5qKB3qS6PgFZksMqY87FgfOaw694U2CnUWNo1WC25rzgOv14NVh4zvksd3b7Hz6X2bs_STPxowGYVMs67zy1e6s5Y9w4Tgem1_UrUxOyGQ Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: a8ae8ed9ff4e4db794443c44bd07b87c Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-965494295 Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a8ae8ed9ff4e4db794443c44bd07b87c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a8ae8ed9ff4e4db794443c44bd07b87c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a8ae8ed9ff4e4db794443c44bd07b87c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a8ae8ed9ff4e4db794443c44bd07b87c"}]}] Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-965494295 Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: a8ae8ed9ff4e4db794443c44bd07b87c Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-965494295 Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-965494295-project Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 2fadc6caa6fb47fabf771d771e244e83 Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-965494295-project Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: {"security_group_rule": {"parent_group_id": "20190644-1326-49d8-885d-2d610336e4fc", "ip_protocol": "tempest-999-2032186644", "from_port": 22, "to_port": 22}} Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: exception: Invalid IP protocol tempest-999-2032186644. Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'body': {'security_group_rule': {'parent_group_id': '20190644-1326-49d8-885d-2d610336e4fc', 'ip_protocol': 'tempest-999-2032186644', 'from_port': 22, 'to_port': 22}}} Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-2032186644. Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-2032186644. Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:55.299493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:55.304504 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:55.304504 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:55.304504 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:55.304504 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:55.304504 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:55.304504 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:55.304504 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-2032186644. Jul 25 14:31:55.304504 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:55.304504 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-724a11e1-373b-46c4-9147-8aa7b3389765 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Returning 400 to user: Invalid IP protocol tempest-999-2032186644. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:55.304504 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-724a11e1-373b-46c4-9147-8aa7b3389765 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] 10.222.0.88 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.275750 Jul 25 14:31:55.307132 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 906/1770] 10.222.0.88 () {60 vars in 1195 bytes} [Mon Jul 25 14:31:55 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 282 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 14:31:55.307323 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cbee1464-8e29-4453-8bed-b672b284d363 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:55.316371 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-783f9f9d-608d-4c64-9387-26d48f343fa3 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Action: 'create', calling method: .version_select at 0x7f46988ff5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1397436676", "description": "tempest-description-1092311265"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:55.605006 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cbee1464-8e29-4453-8bed-b672b284d363 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e" status: 200 len: 1646 microversion: 2.1 time: 0.321701 Jul 25 14:31:55.613601 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 865/1771] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:55 2022] GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e => generated 1646 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:31:55.625097 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a5fba254-e762-4852-878f-1be1d05d528e tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:55.625622 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a5fba254-e762-4852-878f-1be1d05d528e tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:55.640553 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a5fba254-e762-4852-878f-1be1d05d528e tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:55.641050 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a5fba254-e762-4852-878f-1be1d05d528e tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:55.643221 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a5fba254-e762-4852-878f-1be1d05d528e tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:55.645474 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a5fba254-e762-4852-878f-1be1d05d528e tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:55.725128 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a5fba254-e762-4852-878f-1be1d05d528e tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:31:55.897405 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a5fba254-e762-4852-878f-1be1d05d528e tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "DELETE /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 204 len: 0 microversion: 2.1 time: 0.289041 Jul 25 14:31:55.899104 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 866/1772] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:31:55 2022] DELETE /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:31:55.909914 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1fcda5d3-e1a5-45c9-824b-d018c7aa97dc tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:55.914848 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1fcda5d3-e1a5-45c9-824b-d018c7aa97dc tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] [instance: 44ad669c-e3e8-4b12-a64a-2245d98dea47] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:55.936529 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1fcda5d3-e1a5-45c9-824b-d018c7aa97dc tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:55.937087 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1fcda5d3-e1a5-45c9-824b-d018c7aa97dc tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:55.940776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1fcda5d3-e1a5-45c9-824b-d018c7aa97dc tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:55.942744 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1fcda5d3-e1a5-45c9-824b-d018c7aa97dc tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:56.136245 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-783f9f9d-608d-4c64-9387-26d48f343fa3 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.827636 Jul 25 14:31:56.136881 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 907/1773] 10.222.0.88 () {60 vars in 1180 bytes} [Mon Jul 25 14:31:55 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:56.150379 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-93d8d649-83dd-4a03-89a3-7aaad378f08d tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:56.155412 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-93d8d649-83dd-4a03-89a3-7aaad378f08d tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:56.171529 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-93d8d649-83dd-4a03-89a3-7aaad378f08d tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:56.172477 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-93d8d649-83dd-4a03-89a3-7aaad378f08d tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:56.176424 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-93d8d649-83dd-4a03-89a3-7aaad378f08d tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:56.177078 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-93d8d649-83dd-4a03-89a3-7aaad378f08d tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:56.594720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1fcda5d3-e1a5-45c9-824b-d018c7aa97dc tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cd21f1fcc145d7a854c1a6b3005a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bbc39957d740eeb578bf4e7ebb931e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:56.608888 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1fcda5d3-e1a5-45c9-824b-d018c7aa97dc tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] 10.222.0.88 "GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47" status: 200 len: 1351 microversion: 2.1 time: 0.708089 Jul 25 14:31:56.622083 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 867/1774] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:55 2022] GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47 => generated 1351 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:56.627011 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6e9d2cf1-4181-479c-be04-76198531946c tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:56.627630 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6e9d2cf1-4181-479c-be04-76198531946c tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:56.650386 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e9d2cf1-4181-479c-be04-76198531946c tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:56.650942 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e9d2cf1-4181-479c-be04-76198531946c tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:56.653455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e9d2cf1-4181-479c-be04-76198531946c tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:56.654523 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e9d2cf1-4181-479c-be04-76198531946c tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:56.686367 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-93d8d649-83dd-4a03-89a3-7aaad378f08d tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e" status: 200 len: 1646 microversion: 2.1 time: 0.538417 Jul 25 14:31:56.687195 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 908/1775] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:56 2022] GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e => generated 1646 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:56.713387 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-293f27cf-38dc-4815-a882-a7c6d650fb1c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:56.718342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-293f27cf-38dc-4815-a882-a7c6d650fb1c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:56.752201 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-293f27cf-38dc-4815-a882-a7c6d650fb1c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:56.753549 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-293f27cf-38dc-4815-a882-a7c6d650fb1c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:56.754404 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-293f27cf-38dc-4815-a882-a7c6d650fb1c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:56.754847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-293f27cf-38dc-4815-a882-a7c6d650fb1c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:56.787096 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6e9d2cf1-4181-479c-be04-76198531946c tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:56.810823 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:31:56.849099 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6e9d2cf1-4181-479c-be04-76198531946c tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1276 microversion: 2.1 time: 0.225577 Jul 25 14:31:56.852450 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 868/1776] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:56 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1276 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:56.859393 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-efbfbbd5-b6da-45a1-b966-a65396861041 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:56.861939 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-efbfbbd5-b6da-45a1-b966-a65396861041 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:56.875618 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-efbfbbd5-b6da-45a1-b966-a65396861041 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:56.876091 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-efbfbbd5-b6da-45a1-b966-a65396861041 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:56.876872 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-efbfbbd5-b6da-45a1-b966-a65396861041 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:56.877301 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-efbfbbd5-b6da-45a1-b966-a65396861041 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:56.935814 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-efbfbbd5-b6da-45a1-b966-a65396861041 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.080609 Jul 25 14:31:56.936961 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 869/1777] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Jul 25 14:31:56 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:56.942838 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-aa532af6-7f2c-41b7-b985-c967ac9d3e75 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Action: 'create', calling method: .version_select at 0x7f468751b8b0>, body: {"security_group_rule": {"parent_group_id": "a02755a4-b812-4bc8-836e-871e6de62d68", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:57.043806 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-293f27cf-38dc-4815-a882-a7c6d650fb1c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:57.097469 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-293f27cf-38dc-4815-a882-a7c6d650fb1c tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1469 microversion: 2.1 time: 0.394140 Jul 25 14:31:57.097631 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-aa532af6-7f2c-41b7-b985-c967ac9d3e75 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jul 25 14:31:57.098531 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 909/1778] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:56 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1469 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-aa532af6-7f2c-41b7-b985-c967ac9d3e75 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Request method failure captured: Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 138 Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qlVeoUgFBKBbmkc_yjfoqij1HRwOL8Oxz00KB4CntvW5PWBxtm3K4ah2l_7sTvSQwSCL5qKB3qS6PgFZksMqY87FgfOaw694U2CnUWNo1WC25rzgOv14NVh4zvksd3b7Hz6X2bs_STPxowGYVMs67zy1e6s5Y9w4Tgem1_UrUxOyGQ Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: a8ae8ed9ff4e4db794443c44bd07b87c Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-965494295 Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a8ae8ed9ff4e4db794443c44bd07b87c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a8ae8ed9ff4e4db794443c44bd07b87c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a8ae8ed9ff4e4db794443c44bd07b87c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a8ae8ed9ff4e4db794443c44bd07b87c"}]}] Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-965494295 Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: a8ae8ed9ff4e4db794443c44bd07b87c Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-965494295 Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-965494295-project Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 2fadc6caa6fb47fabf771d771e244e83 Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-965494295-project Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: {"security_group_rule": {"parent_group_id": "a02755a4-b812-4bc8-836e-871e6de62d68", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a02755a4-b812-4bc8-836e-871e6de62d68', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jul 25 14:31:57.102470 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:57.106937 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:57.106937 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:57.106937 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:57.106937 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:57.106937 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:57.106937 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:57.106937 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:57.106937 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jul 25 14:31:57.106937 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:57.106937 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-aa532af6-7f2c-41b7-b985-c967ac9d3e75 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:57.106937 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-aa532af6-7f2c-41b7-b985-c967ac9d3e75 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] 10.222.0.88 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.166245 Jul 25 14:31:57.110476 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 870/1779] 10.222.0.88 () {60 vars in 1195 bytes} [Mon Jul 25 14:31:56 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 173 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:31:57.118667 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-121fabd4-7c85-4202-bd25-e2a192f50de5 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Action: 'create', calling method: .version_select at 0x7f468777ef70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-611667479", "description": "tempest-description-505545706"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:57.119185 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f2f2a877-3a58-41dc-8e5f-af0adbffde29 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:57.129328 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:31:57.129328 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:31:57.133556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f2f2a877-3a58-41dc-8e5f-af0adbffde29 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:57.138146 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f2f2a877-3a58-41dc-8e5f-af0adbffde29 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:57.139808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f2f2a877-3a58-41dc-8e5f-af0adbffde29 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:57.140466 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f2f2a877-3a58-41dc-8e5f-af0adbffde29 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:57.201541 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f2f2a877-3a58-41dc-8e5f-af0adbffde29 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.101628 Jul 25 14:31:57.208686 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 910/1780] 10.222.0.88 () {58 vars in 1176 bytes} [Mon Jul 25 14:31:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:57.223183 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-636f82de-669a-4893-942e-f198e091b7b5 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:57.223949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-636f82de-669a-4893-942e-f198e091b7b5 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:57.232174 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-636f82de-669a-4893-942e-f198e091b7b5 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:57.232770 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-636f82de-669a-4893-942e-f198e091b7b5 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:57.235126 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-636f82de-669a-4893-942e-f198e091b7b5 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:57.235821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-636f82de-669a-4893-942e-f198e091b7b5 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:57.359892 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-636f82de-669a-4893-942e-f198e091b7b5 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e/action" status: 202 len: 0 microversion: 2.1 time: 0.142958 Jul 25 14:31:57.363912 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 911/1781] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:31:57 2022] POST /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:31:57.371758 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2d2ec081-3ce6-4065-a0d5-ec062c3088ca tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:57.372728 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2d2ec081-3ce6-4065-a0d5-ec062c3088ca tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:57.381742 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d2ec081-3ce6-4065-a0d5-ec062c3088ca tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:57.382439 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d2ec081-3ce6-4065-a0d5-ec062c3088ca tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:57.383406 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d2ec081-3ce6-4065-a0d5-ec062c3088ca tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:57.384078 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d2ec081-3ce6-4065-a0d5-ec062c3088ca tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:57.661043 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2d2ec081-3ce6-4065-a0d5-ec062c3088ca tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e" status: 200 len: 1651 microversion: 2.1 time: 0.295183 Jul 25 14:31:57.661633 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 912/1782] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:57 2022] GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e => generated 1651 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:57.680257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8de2e5cd-e108-4f3c-b344-b8f76130ecd7 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:57.681092 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8de2e5cd-e108-4f3c-b344-b8f76130ecd7 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] [instance: 44ad669c-e3e8-4b12-a64a-2245d98dea47] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:57.688356 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8de2e5cd-e108-4f3c-b344-b8f76130ecd7 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:57.689144 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8de2e5cd-e108-4f3c-b344-b8f76130ecd7 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:57.690063 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8de2e5cd-e108-4f3c-b344-b8f76130ecd7 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:57.690648 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8de2e5cd-e108-4f3c-b344-b8f76130ecd7 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:57.935569 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-121fabd4-7c85-4202-bd25-e2a192f50de5 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.823895 Jul 25 14:31:57.936197 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 871/1783] 10.222.0.88 () {60 vars in 1180 bytes} [Mon Jul 25 14:31:57 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:57.941566 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-07454c4d-0c30-466b-b604-f8bff8d0bbf0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:57.942975 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-07454c4d-0c30-466b-b604-f8bff8d0bbf0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:57.955083 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8de2e5cd-e108-4f3c-b344-b8f76130ecd7 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cd21f1fcc145d7a854c1a6b3005a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bbc39957d740eeb578bf4e7ebb931e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:57.972622 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8de2e5cd-e108-4f3c-b344-b8f76130ecd7 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] 10.222.0.88 "GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47" status: 200 len: 1351 microversion: 2.1 time: 0.296268 Jul 25 14:31:57.975746 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 913/1784] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:57 2022] GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47 => generated 1351 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:57.979776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-07454c4d-0c30-466b-b604-f8bff8d0bbf0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:57.982894 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-07454c4d-0c30-466b-b604-f8bff8d0bbf0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:57.983704 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-07454c4d-0c30-466b-b604-f8bff8d0bbf0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:57.984188 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-07454c4d-0c30-466b-b604-f8bff8d0bbf0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:58.001927 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-56acf05e-3113-4cb3-b76f-767aa0132c32 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Action: 'create', calling method: .version_select at 0x7f46988ff160>, body: {"security_group_rule": {"parent_group_id": "6fb56fc7-c5d8-4bec-a736-1b309d473ad2", "ip_protocol": "tcp", "from_port": 22, "to_port": 702821815}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:58.012536 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:31:58.118605 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-56acf05e-3113-4cb3-b76f-767aa0132c32 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] HTTP exception thrown: Invalid port range 22:702821815. Valid TCP ports should be between 1-65535 Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-56acf05e-3113-4cb3-b76f-767aa0132c32 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Request method failure captured: Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 145 Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qlVeoUgFBKBbmkc_yjfoqij1HRwOL8Oxz00KB4CntvW5PWBxtm3K4ah2l_7sTvSQwSCL5qKB3qS6PgFZksMqY87FgfOaw694U2CnUWNo1WC25rzgOv14NVh4zvksd3b7Hz6X2bs_STPxowGYVMs67zy1e6s5Y9w4Tgem1_UrUxOyGQ Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: a8ae8ed9ff4e4db794443c44bd07b87c Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-965494295 Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a8ae8ed9ff4e4db794443c44bd07b87c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a8ae8ed9ff4e4db794443c44bd07b87c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a8ae8ed9ff4e4db794443c44bd07b87c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a8ae8ed9ff4e4db794443c44bd07b87c"}]}] Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-965494295 Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: a8ae8ed9ff4e4db794443c44bd07b87c Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-965494295 Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-965494295-project Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 2fadc6caa6fb47fabf771d771e244e83 Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-965494295-project Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: {"security_group_rule": {"parent_group_id": "6fb56fc7-c5d8-4bec-a736-1b309d473ad2", "ip_protocol": "tcp", "from_port": 22, "to_port": 702821815}} Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: exception: Invalid port range 22:702821815. Valid TCP ports should be between 1-65535 Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6fb56fc7-c5d8-4bec-a736-1b309d473ad2', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 702821815}}} Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:702821815. Valid TCP ports should be between 1-65535 Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:702821815. Valid TCP ports should be between 1-65535 Jul 25 14:31:58.120543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:58.126966 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:58.126966 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:58.126966 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:58.126966 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:58.126966 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:58.126966 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:58.126966 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:58.126966 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:702821815. Valid TCP ports should be between 1-65535 Jul 25 14:31:58.126966 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:31:58.126966 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-56acf05e-3113-4cb3-b76f-767aa0132c32 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Returning 400 to user: Invalid port range 22:702821815. Valid TCP ports should be between 1-65535 {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:58.126966 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-56acf05e-3113-4cb3-b76f-767aa0132c32 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] 10.222.0.88 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.144673 Jul 25 14:31:58.126966 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 914/1785] 10.222.0.88 () {60 vars in 1195 bytes} [Mon Jul 25 14:31:57 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 146 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:31:58.132577 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7f79a24b-3f6d-480f-a718-592af11062ae tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:58.133283 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7f79a24b-3f6d-480f-a718-592af11062ae tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:58.148959 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7f79a24b-3f6d-480f-a718-592af11062ae tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:58.155124 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7f79a24b-3f6d-480f-a718-592af11062ae tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:58.156244 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7f79a24b-3f6d-480f-a718-592af11062ae tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:58.158267 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7f79a24b-3f6d-480f-a718-592af11062ae tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:58.364208 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-07454c4d-0c30-466b-b604-f8bff8d0bbf0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:58.376606 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-07454c4d-0c30-466b-b604-f8bff8d0bbf0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1318 microversion: 2.1 time: 0.438537 Jul 25 14:31:58.382785 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 872/1786] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:57 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1318 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:58.392334 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d886888c-1169-4399-9375-3f7a39bcc230 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Action: 'create', calling method: .version_select at 0x7f468751b8b0>, body: {"security_group_rule": {"parent_group_id": "c261493a-5c8b-4533-909e-4a5bf28ebf9e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:58.463481 n-d-846435-14 devstack@n-api.service[119303]: DEBUG neutronclient.v2_0.client [None req-d886888c-1169-4399-9375-3f7a39bcc230 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c261493a-5c8b-4533-909e-4a5bf28ebf9e does not exist", "detail": ""}} {{(pid=119303) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 14:31:58.464851 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.security_group_api [None req-d886888c-1169-4399-9375-3f7a39bcc230 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Neutron security group c261493a-5c8b-4533-909e-4a5bf28ebf9e not found {{(pid=119303) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 14:31:58.465582 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-d886888c-1169-4399-9375-3f7a39bcc230 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] HTTP exception thrown: Security group c261493a-5c8b-4533-909e-4a5bf28ebf9e does not exist Jul 25 14:31:58.465582 n-d-846435-14 devstack@n-api.service[119303]: Neutron server returns request_ids: ['req-6ecfcd79-fd7c-4e3c-8349-dca9af017b2b'] Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d886888c-1169-4399-9375-3f7a39bcc230 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Request method failure captured: Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 138 Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qlVeoUgFBKBbmkc_yjfoqij1HRwOL8Oxz00KB4CntvW5PWBxtm3K4ah2l_7sTvSQwSCL5qKB3qS6PgFZksMqY87FgfOaw694U2CnUWNo1WC25rzgOv14NVh4zvksd3b7Hz6X2bs_STPxowGYVMs67zy1e6s5Y9w4Tgem1_UrUxOyGQ Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: a8ae8ed9ff4e4db794443c44bd07b87c Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-965494295 Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a8ae8ed9ff4e4db794443c44bd07b87c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a8ae8ed9ff4e4db794443c44bd07b87c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a8ae8ed9ff4e4db794443c44bd07b87c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a8ae8ed9ff4e4db794443c44bd07b87c"}]}] Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-965494295 Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: a8ae8ed9ff4e4db794443c44bd07b87c Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-965494295 Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-965494295-project Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 2fadc6caa6fb47fabf771d771e244e83 Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-965494295-project Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: {"security_group_rule": {"parent_group_id": "c261493a-5c8b-4533-909e-4a5bf28ebf9e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: exception: Security group c261493a-5c8b-4533-909e-4a5bf28ebf9e does not exist Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: Neutron server returns request_ids: ['req-6ecfcd79-fd7c-4e3c-8349-dca9af017b2b'] Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c261493a-5c8b-4533-909e-4a5bf28ebf9e', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 14:31:58.467953 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c261493a-5c8b-4533-909e-4a5bf28ebf9e does not exist Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ecfcd79-fd7c-4e3c-8349-dca9af017b2b'] Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c261493a-5c8b-4533-909e-4a5bf28ebf9e does not exist Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ecfcd79-fd7c-4e3c-8349-dca9af017b2b'] Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c261493a-5c8b-4533-909e-4a5bf28ebf9e does not exist Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ecfcd79-fd7c-4e3c-8349-dca9af017b2b'] Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c261493a-5c8b-4533-909e-4a5bf28ebf9e does not exist Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ecfcd79-fd7c-4e3c-8349-dca9af017b2b'] Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d886888c-1169-4399-9375-3f7a39bcc230 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Returning 404 to user: Security group c261493a-5c8b-4533-909e-4a5bf28ebf9e does not exist Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: Neutron server returns request_ids: ['req-6ecfcd79-fd7c-4e3c-8349-dca9af017b2b'] {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:58.472850 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d886888c-1169-4399-9375-3f7a39bcc230 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] 10.222.0.88 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.081337 Jul 25 14:31:58.476684 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 873/1787] 10.222.0.88 () {60 vars in 1195 bytes} [Mon Jul 25 14:31:58 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:31:58.488766 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-71ca2d44-894e-413b-8802-4349c0e375b4 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Calling method '.version_select at 0x7f46875fc430>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:58.509914 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7f79a24b-3f6d-480f-a718-592af11062ae tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:58.519266 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7f79a24b-3f6d-480f-a718-592af11062ae tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 200 len: 1469 microversion: 2.1 time: 0.394746 Jul 25 14:31:58.523366 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 915/1788] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:58 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 1469 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:58.568430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-2108be91-0777-4a9b-8cb7-fd53e6b3ef49 req-46d51b63-fe75-4efa-bab9-5df729ac37ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44ad669c-e3e8-4b12-a64a-2245d98dea47", "tag": "20563043-6910-4985-80ca-a42cb70b9786"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:58.595283 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-2108be91-0777-4a9b-8cb7-fd53e6b3ef49 req-46d51b63-fe75-4efa-bab9-5df729ac37ea service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:58.595509 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-2108be91-0777-4a9b-8cb7-fd53e6b3ef49 req-46d51b63-fe75-4efa-bab9-5df729ac37ea service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:58.602073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG neutronclient.v2_0.client [None req-71ca2d44-894e-413b-8802-4349c0e375b4 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule e5e794da-8724-45b6-8c00-b06bebcbbabb does not exist", "detail": ""}} {{(pid=119303) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 14:31:58.602891 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.security_group_api [None req-71ca2d44-894e-413b-8802-4349c0e375b4 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Neutron security group rule e5e794da-8724-45b6-8c00-b06bebcbbabb not found {{(pid=119303) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jul 25 14:31:58.603638 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-71ca2d44-894e-413b-8802-4349c0e375b4 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] HTTP exception thrown: Security group rule e5e794da-8724-45b6-8c00-b06bebcbbabb does not exist Jul 25 14:31:58.603638 n-d-846435-14 devstack@n-api.service[119303]: Neutron server returns request_ids: ['req-eb230ef3-5c6e-47f7-87a5-3f054c4d9d76'] Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-71ca2d44-894e-413b-8802-4349c0e375b4 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Request method failure captured: Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/os-security-group-rules/e5e794da-8724-45b6-8c00-b06bebcbbabb HTTP/1.1 Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qlVeoUgFBKBbmkc_yjfoqij1HRwOL8Oxz00KB4CntvW5PWBxtm3K4ah2l_7sTvSQwSCL5qKB3qS6PgFZksMqY87FgfOaw694U2CnUWNo1WC25rzgOv14NVh4zvksd3b7Hz6X2bs_STPxowGYVMs67zy1e6s5Y9w4Tgem1_UrUxOyGQ Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: a8ae8ed9ff4e4db794443c44bd07b87c Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-965494295 Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a8ae8ed9ff4e4db794443c44bd07b87c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a8ae8ed9ff4e4db794443c44bd07b87c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a8ae8ed9ff4e4db794443c44bd07b87c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a8ae8ed9ff4e4db794443c44bd07b87c"}]}] Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-965494295 Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: a8ae8ed9ff4e4db794443c44bd07b87c Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-965494295 Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-965494295-project Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 2fadc6caa6fb47fabf771d771e244e83 Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-965494295-project Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: exception: Security group rule e5e794da-8724-45b6-8c00-b06bebcbbabb does not exist Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: Neutron server returns request_ids: ['req-eb230ef3-5c6e-47f7-87a5-3f054c4d9d76'] Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'e5e794da-8724-45b6-8c00-b06bebcbbabb'} Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 14:31:58.609479 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule e5e794da-8724-45b6-8c00-b06bebcbbabb does not exist Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eb230ef3-5c6e-47f7-87a5-3f054c4d9d76'] Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule e5e794da-8724-45b6-8c00-b06bebcbbabb does not exist Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eb230ef3-5c6e-47f7-87a5-3f054c4d9d76'] Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule e5e794da-8724-45b6-8c00-b06bebcbbabb does not exist Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eb230ef3-5c6e-47f7-87a5-3f054c4d9d76'] Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule e5e794da-8724-45b6-8c00-b06bebcbbabb does not exist Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eb230ef3-5c6e-47f7-87a5-3f054c4d9d76'] Jul 25 14:31:58.613858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:31:58.621547 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-71ca2d44-894e-413b-8802-4349c0e375b4 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Returning 404 to user: Security group rule e5e794da-8724-45b6-8c00-b06bebcbbabb does not exist Jul 25 14:31:58.621547 n-d-846435-14 devstack@n-api.service[119303]: Neutron server returns request_ids: ['req-eb230ef3-5c6e-47f7-87a5-3f054c4d9d76'] {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:31:58.621547 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-71ca2d44-894e-413b-8802-4349c0e375b4 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-group-rules/e5e794da-8724-45b6-8c00-b06bebcbbabb" status: 404 len: 199 microversion: 2.1 time: 0.143339 Jul 25 14:31:58.621547 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 874/1789] 10.222.0.88 () {58 vars in 1287 bytes} [Mon Jul 25 14:31:58 2022] DELETE /compute/v2.1/os-security-group-rules/e5e794da-8724-45b6-8c00-b06bebcbbabb => generated 199 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:31:58.633586 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-83edae22-3955-4178-844c-3fc7085a3f52 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Calling method '.version_select at 0x7f46879388b0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:58.658927 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-2108be91-0777-4a9b-8cb7-fd53e6b3ef49 req-46d51b63-fe75-4efa-bab9-5df729ac37ea service nova] Creating event network-changed:20563043-6910-4985-80ca-a42cb70b9786 for instance 44ad669c-e3e8-4b12-a64a-2245d98dea47 on n-h1-846435-14 Jul 25 14:31:58.668444 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-2108be91-0777-4a9b-8cb7-fd53e6b3ef49 req-46d51b63-fe75-4efa-bab9-5df729ac37ea service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108080 Jul 25 14:31:58.671273 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 916/1790] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 25 14:31:58.685096 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-49759819-9070-4253-933e-20b5a4de9bb9 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:58.685814 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-49759819-9070-4253-933e-20b5a4de9bb9 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:58.698597 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-49759819-9070-4253-933e-20b5a4de9bb9 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:58.699414 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-49759819-9070-4253-933e-20b5a4de9bb9 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:58.700399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-49759819-9070-4253-933e-20b5a4de9bb9 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:58.719418 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-49759819-9070-4253-933e-20b5a4de9bb9 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:59.105322 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-49759819-9070-4253-933e-20b5a4de9bb9 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e" status: 200 len: 1631 microversion: 2.1 time: 0.424391 Jul 25 14:31:59.106722 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 917/1791] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:58 2022] GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e => generated 1631 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:59.128198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-53a09818-136e-4d32-aa89-2fd7b23a88f8 req-838bfafc-ea3a-4eb4-bd42-173cb1e7bf9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5db8a05-a27e-4426-9166-44727d5cc4ff", "name": "network-vif-deleted", "tag": "f34d13c0-b812-4793-bcd0-55fe6e34bc46"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:59.141269 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-53a09818-136e-4d32-aa89-2fd7b23a88f8 req-838bfafc-ea3a-4eb4-bd42-173cb1e7bf9a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:59.141992 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-53a09818-136e-4d32-aa89-2fd7b23a88f8 req-838bfafc-ea3a-4eb4-bd42-173cb1e7bf9a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:59.158379 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-53a09818-136e-4d32-aa89-2fd7b23a88f8 req-838bfafc-ea3a-4eb4-bd42-173cb1e7bf9a service nova] Creating event network-vif-deleted:f34d13c0-b812-4793-bcd0-55fe6e34bc46 for instance d5db8a05-a27e-4426-9166-44727d5cc4ff on n-h1-846435-14 Jul 25 14:31:59.167033 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-53a09818-136e-4d32-aa89-2fd7b23a88f8 req-838bfafc-ea3a-4eb4-bd42-173cb1e7bf9a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058780 Jul 25 14:31:59.168220 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 918/1792] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:31:59.174776 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2be5cf21-bb35-41b3-a6c6-2a3a30a7971b tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:59.175782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2be5cf21-bb35-41b3-a6c6-2a3a30a7971b tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] [instance: 44ad669c-e3e8-4b12-a64a-2245d98dea47] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:59.196866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2be5cf21-bb35-41b3-a6c6-2a3a30a7971b tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:59.199192 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2be5cf21-bb35-41b3-a6c6-2a3a30a7971b tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:59.207775 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2be5cf21-bb35-41b3-a6c6-2a3a30a7971b tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:59.210302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2be5cf21-bb35-41b3-a6c6-2a3a30a7971b tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:59.362435 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-83edae22-3955-4178-844c-3fc7085a3f52 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/6fb56fc7-c5d8-4bec-a736-1b309d473ad2" status: 202 len: 0 microversion: 2.1 time: 0.733484 Jul 25 14:31:59.364820 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 875/1793] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:31:58 2022] DELETE /compute/v2.1/os-security-groups/6fb56fc7-c5d8-4bec-a736-1b309d473ad2 => generated 0 bytes in 737 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:31:59.374595 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e009e805-35f8-4d38-a154-a88b12bf552b tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-846435-14", "block_migration": true, "disk_over_commit": false}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:31:59.379725 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e009e805-35f8-4d38-a154-a88b12bf552b tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:59.416414 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e009e805-35f8-4d38-a154-a88b12bf552b tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:59.419568 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e009e805-35f8-4d38-a154-a88b12bf552b tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:59.420679 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e009e805-35f8-4d38-a154-a88b12bf552b tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:59.421112 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e009e805-35f8-4d38-a154-a88b12bf552b tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:59.472569 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-e009e805-35f8-4d38-a154-a88b12bf552b tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lazy-loading 'flavor' on Instance uuid 48341efc-a4b6-4532-8a2b-ac8d8f50a26e {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:31:59.493262 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e009e805-35f8-4d38-a154-a88b12bf552b tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Going to try to live migrate instance to n-h1-846435-14 {{(pid=119303) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 14:31:59.561686 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2be5cf21-bb35-41b3-a6c6-2a3a30a7971b tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cd21f1fcc145d7a854c1a6b3005a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bbc39957d740eeb578bf4e7ebb931e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:31:59.569775 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2be5cf21-bb35-41b3-a6c6-2a3a30a7971b tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] 10.222.0.88 "GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47" status: 200 len: 1351 microversion: 2.1 time: 0.399892 Jul 25 14:31:59.584483 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 919/1794] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:59 2022] GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47 => generated 1351 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:31:59.591692 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f8c3bdb7-4c44-475a-8c76-58773941a6fd tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Calling method '.version_select at 0x7f46988ff1f0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:59.952369 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f8c3bdb7-4c44-475a-8c76-58773941a6fd tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/a02755a4-b812-4bc8-836e-871e6de62d68" status: 202 len: 0 microversion: 2.1 time: 0.364877 Jul 25 14:31:59.953029 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 920/1795] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:31:59 2022] DELETE /compute/v2.1/os-security-groups/a02755a4-b812-4bc8-836e-871e6de62d68 => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:31:59.958844 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7acd63e5-a878-4bbb-be05-d0adae7b8a6d tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:31:59.959668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7acd63e5-a878-4bbb-be05-d0adae7b8a6d tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:31:59.976110 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7acd63e5-a878-4bbb-be05-d0adae7b8a6d tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:59.978471 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7acd63e5-a878-4bbb-be05-d0adae7b8a6d tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:31:59.979454 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7acd63e5-a878-4bbb-be05-d0adae7b8a6d tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:31:59.980960 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7acd63e5-a878-4bbb-be05-d0adae7b8a6d tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:00.186204 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7acd63e5-a878-4bbb-be05-d0adae7b8a6d tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:00.196000 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7acd63e5-a878-4bbb-be05-d0adae7b8a6d tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1318 microversion: 2.1 time: 0.240774 Jul 25 14:32:00.196595 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 921/1796] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:31:59 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:00.203010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2ece2553-a2f6-400a-840d-17aeba79c6e6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:00.203638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2ece2553-a2f6-400a-840d-17aeba79c6e6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: d5db8a05-a27e-4426-9166-44727d5cc4ff] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:00.213835 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2ece2553-a2f6-400a-840d-17aeba79c6e6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:00.214601 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2ece2553-a2f6-400a-840d-17aeba79c6e6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:00.215372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2ece2553-a2f6-400a-840d-17aeba79c6e6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:00.215802 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2ece2553-a2f6-400a-840d-17aeba79c6e6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:00.232028 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-2ece2553-a2f6-400a-840d-17aeba79c6e6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] HTTP exception thrown: Instance d5db8a05-a27e-4426-9166-44727d5cc4ff could not be found. Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2ece2553-a2f6-400a-840d-17aeba79c6e6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Request method failure captured: Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff HTTP/1.1 Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qgQ0giBIKJS3p1fKMOwG5iykKOb_7z2xkUwzX9ZOQP9w2TF7jf5B2qoIekEaNujbgYY0003fI8cBRBWofwaT6xURCwj33RgtUgI5CEAt7_13L8_mUPvgHP5u7-q-4hdnU9gOvpZrSenVJEtvuSYp_43hbO7IzDEh1EZa5FB6U8bMTY Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 887aa20d1838484eb895896f8f76ce41 Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-MigrationsAdminTest-1396799549 Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/887aa20d1838484eb895896f8f76ce41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/887aa20d1838484eb895896f8f76ce41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_887aa20d1838484eb895896f8f76ce41", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/887aa20d1838484eb895896f8f76ce41"}]}] Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-MigrationsAdminTest-1396799549 Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 887aa20d1838484eb895896f8f76ce41 Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-MigrationsAdminTest-1396799549 Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-MigrationsAdminTest-1396799549-project Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 00aea97fb95c44cfa5dce25e9a06cd37 Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-MigrationsAdminTest-1396799549-project Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance d5db8a05-a27e-4426-9166-44727d5cc4ff could not be found. Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'd5db8a05-a27e-4426-9166-44727d5cc4ff'} Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5db8a05-a27e-4426-9166-44727d5cc4ff could not be found. Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5db8a05-a27e-4426-9166-44727d5cc4ff could not be found. Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:32:00.233974 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:32:00.238456 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:32:00.238456 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:32:00.238456 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:32:00.238456 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:32:00.238456 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:32:00.238456 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5db8a05-a27e-4426-9166-44727d5cc4ff could not be found. Jul 25 14:32:00.238456 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:32:00.238456 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2ece2553-a2f6-400a-840d-17aeba79c6e6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Returning 404 to user: Instance d5db8a05-a27e-4426-9166-44727d5cc4ff could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:32:00.239081 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2ece2553-a2f6-400a-840d-17aeba79c6e6 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff" status: 404 len: 111 microversion: 2.1 time: 0.041283 Jul 25 14:32:00.242822 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 922/1797] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:00 2022] GET /compute/v2.1/servers/d5db8a05-a27e-4426-9166-44727d5cc4ff => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:32:00.245121 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f970e349-63b4-4f7f-abaf-bda9cb3e34f6 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Calling method '.version_select at 0x7f4698903ca0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:00.442192 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f970e349-63b4-4f7f-abaf-bda9cb3e34f6 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/20190644-1326-49d8-885d-2d610336e4fc" status: 202 len: 0 microversion: 2.1 time: 0.201347 Jul 25 14:32:00.443164 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 923/1798] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:32:00 2022] DELETE /compute/v2.1/os-security-groups/20190644-1326-49d8-885d-2d610336e4fc => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:32:00.450956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d5115897-aef2-4294-a912-7febd5796e56 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:00.451759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d5115897-aef2-4294-a912-7febd5796e56 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:00.469506 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5115897-aef2-4294-a912-7febd5796e56 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:00.470214 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5115897-aef2-4294-a912-7febd5796e56 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:00.471772 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5115897-aef2-4294-a912-7febd5796e56 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:00.472426 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5115897-aef2-4294-a912-7febd5796e56 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:00.499152 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d5115897-aef2-4294-a912-7febd5796e56 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:32:00.578748 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d5115897-aef2-4294-a912-7febd5796e56 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "DELETE /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 204 len: 0 microversion: 2.1 time: 0.133853 Jul 25 14:32:00.579341 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 924/1799] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:32:00 2022] DELETE /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:32:00.584596 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-350a1dab-948a-4bb4-b49a-6cf0e9e2021e tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Calling method '.version_select at 0x7f46989dda60>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:00.771221 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-350a1dab-948a-4bb4-b49a-6cf0e9e2021e tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/8016aa3d-27a4-4847-b025-640f54f436c3" status: 202 len: 0 microversion: 2.1 time: 0.190573 Jul 25 14:32:00.771857 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 925/1800] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:32:00 2022] DELETE /compute/v2.1/os-security-groups/8016aa3d-27a4-4847-b025-640f54f436c3 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:32:00.780134 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6b696850-b600-4ddb-9429-e9afdaed5e2d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:00.781214 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6b696850-b600-4ddb-9429-e9afdaed5e2d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:00.793059 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6b696850-b600-4ddb-9429-e9afdaed5e2d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:00.793715 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6b696850-b600-4ddb-9429-e9afdaed5e2d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:00.794721 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6b696850-b600-4ddb-9429-e9afdaed5e2d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:00.795161 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6b696850-b600-4ddb-9429-e9afdaed5e2d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:00.956807 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6b696850-b600-4ddb-9429-e9afdaed5e2d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:00.964670 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6b696850-b600-4ddb-9429-e9afdaed5e2d tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1466 microversion: 2.1 time: 0.191338 Jul 25 14:32:00.965444 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 926/1801] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:00 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1466 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:00.970474 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f8005e34-7cde-4606-a14b-bdd00c328cd8 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:00.971125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f8005e34-7cde-4606-a14b-bdd00c328cd8 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] [instance: 44ad669c-e3e8-4b12-a64a-2245d98dea47] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:00.977419 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8005e34-7cde-4606-a14b-bdd00c328cd8 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:00.977866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8005e34-7cde-4606-a14b-bdd00c328cd8 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:00.978821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8005e34-7cde-4606-a14b-bdd00c328cd8 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:00.979476 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8005e34-7cde-4606-a14b-bdd00c328cd8 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:01.117722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f8005e34-7cde-4606-a14b-bdd00c328cd8 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cd21f1fcc145d7a854c1a6b3005a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bbc39957d740eeb578bf4e7ebb931e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:01.125353 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f8005e34-7cde-4606-a14b-bdd00c328cd8 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] 10.222.0.88 "GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47" status: 200 len: 1351 microversion: 2.1 time: 0.158569 Jul 25 14:32:01.125947 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 927/1802] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:00 2022] GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47 => generated 1351 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:01.137868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-96022fe3-96fb-48bd-9e52-265d477e59d3 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] Calling method '.version_select at 0x7f4698964b80>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:01.401594 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-96022fe3-96fb-48bd-9e52-265d477e59d3 tempest-SecurityGroupRulesNegativeTestJSON-965494295 tempest-SecurityGroupRulesNegativeTestJSON-965494295-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/96b58664-2bcb-4f2b-852f-a74cf6791978" status: 202 len: 0 microversion: 2.1 time: 0.274591 Jul 25 14:32:01.402706 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 928/1803] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:32:01 2022] DELETE /compute/v2.1/os-security-groups/96b58664-2bcb-4f2b-852f-a74cf6791978 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:32:01.416738 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-54e1dbd5-7802-42e6-a625-978a958e3b3d req-f584f2c5-b54b-437c-979f-acf9063d290c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aacb7718-eb99-45ae-a61c-4e5e8770be8a", "tag": "0bbbda3d-8d02-4c28-9926-89b52f83ac0e"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:01.429788 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-54e1dbd5-7802-42e6-a625-978a958e3b3d req-f584f2c5-b54b-437c-979f-acf9063d290c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:01.431166 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-54e1dbd5-7802-42e6-a625-978a958e3b3d req-f584f2c5-b54b-437c-979f-acf9063d290c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:01.450582 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-54e1dbd5-7802-42e6-a625-978a958e3b3d req-f584f2c5-b54b-437c-979f-acf9063d290c service nova] Creating event network-changed:0bbbda3d-8d02-4c28-9926-89b52f83ac0e for instance aacb7718-eb99-45ae-a61c-4e5e8770be8a on n-h1-846435-14 Jul 25 14:32:01.456212 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-54e1dbd5-7802-42e6-a625-978a958e3b3d req-f584f2c5-b54b-437c-979f-acf9063d290c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051085 Jul 25 14:32:01.456848 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 929/1804] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:32:01.462181 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-72b88310-9181-4a5e-9fb9-bcd540ec64d1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:01.462884 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-72b88310-9181-4a5e-9fb9-bcd540ec64d1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:01.469227 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72b88310-9181-4a5e-9fb9-bcd540ec64d1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:01.469873 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72b88310-9181-4a5e-9fb9-bcd540ec64d1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:01.470650 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72b88310-9181-4a5e-9fb9-bcd540ec64d1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:01.471258 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72b88310-9181-4a5e-9fb9-bcd540ec64d1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:01.627086 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-72b88310-9181-4a5e-9fb9-bcd540ec64d1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:01.635785 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-72b88310-9181-4a5e-9fb9-bcd540ec64d1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1318 microversion: 2.1 time: 0.177562 Jul 25 14:32:01.637048 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 930/1805] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:01 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:01.986111 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-98b325bc-f7a6-49c6-b8eb-3c129a458db2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:01.987070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-98b325bc-f7a6-49c6-b8eb-3c129a458db2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:01.992919 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:32:01.995372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98b325bc-f7a6-49c6-b8eb-3c129a458db2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:01.996397 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98b325bc-f7a6-49c6-b8eb-3c129a458db2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:01.997507 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98b325bc-f7a6-49c6-b8eb-3c129a458db2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:01.998160 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98b325bc-f7a6-49c6-b8eb-3c129a458db2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:02.154745 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-98b325bc-f7a6-49c6-b8eb-3c129a458db2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:02.159915 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:32:02.170392 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-98b325bc-f7a6-49c6-b8eb-3c129a458db2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1466 microversion: 2.1 time: 0.188067 Jul 25 14:32:02.180601 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 931/1806] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:01 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1466 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:32:02.180601 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-67e256a2-75da-44e2-9f88-ef9d80f4153d tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:02.180601 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-67e256a2-75da-44e2-9f88-ef9d80f4153d tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] [instance: 44ad669c-e3e8-4b12-a64a-2245d98dea47] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:02.190962 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-67e256a2-75da-44e2-9f88-ef9d80f4153d tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:02.191828 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-67e256a2-75da-44e2-9f88-ef9d80f4153d tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:02.193201 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-67e256a2-75da-44e2-9f88-ef9d80f4153d tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:02.193832 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-67e256a2-75da-44e2-9f88-ef9d80f4153d tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:02.419075 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-67e256a2-75da-44e2-9f88-ef9d80f4153d tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cd21f1fcc145d7a854c1a6b3005a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bbc39957d740eeb578bf4e7ebb931e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:02.427995 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-67e256a2-75da-44e2-9f88-ef9d80f4153d tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] 10.222.0.88 "GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47" status: 200 len: 1351 microversion: 2.1 time: 0.255753 Jul 25 14:32:02.450557 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 932/1807] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:02 2022] GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47 => generated 1351 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:02.644008 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:32:02.660062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-543e6eb7-30c8-4dda-a450-b7ed7ed26fe1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:02.661312 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-543e6eb7-30c8-4dda-a450-b7ed7ed26fe1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:02.669257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-543e6eb7-30c8-4dda-a450-b7ed7ed26fe1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:02.670066 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-543e6eb7-30c8-4dda-a450-b7ed7ed26fe1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:02.670849 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-543e6eb7-30c8-4dda-a450-b7ed7ed26fe1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:02.671763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-543e6eb7-30c8-4dda-a450-b7ed7ed26fe1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:02.839860 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-543e6eb7-30c8-4dda-a450-b7ed7ed26fe1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:02.847668 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-543e6eb7-30c8-4dda-a450-b7ed7ed26fe1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1318 microversion: 2.1 time: 0.194394 Jul 25 14:32:02.848486 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 933/1808] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:02 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:32:03.192104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-033d5ac3-ae14-47a8-b50f-9bfb3bcc4cb2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:03.193015 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-033d5ac3-ae14-47a8-b50f-9bfb3bcc4cb2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:03.207065 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-033d5ac3-ae14-47a8-b50f-9bfb3bcc4cb2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:03.209285 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-033d5ac3-ae14-47a8-b50f-9bfb3bcc4cb2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:03.213282 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-033d5ac3-ae14-47a8-b50f-9bfb3bcc4cb2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:03.214701 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-033d5ac3-ae14-47a8-b50f-9bfb3bcc4cb2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:03.401434 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=18 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:32:03.543692 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-033d5ac3-ae14-47a8-b50f-9bfb3bcc4cb2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:03.554670 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-033d5ac3-ae14-47a8-b50f-9bfb3bcc4cb2 tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1466 microversion: 2.1 time: 0.366869 Jul 25 14:32:03.555531 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 934/1809] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:03 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1466 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:32:03.561039 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-af856b68-4e63-4ac6-b52a-e8fb6653e7d1 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:03.561963 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-af856b68-4e63-4ac6-b52a-e8fb6653e7d1 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] [instance: 44ad669c-e3e8-4b12-a64a-2245d98dea47] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:03.570808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af856b68-4e63-4ac6-b52a-e8fb6653e7d1 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:03.571632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af856b68-4e63-4ac6-b52a-e8fb6653e7d1 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:03.593183 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af856b68-4e63-4ac6-b52a-e8fb6653e7d1 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:03.594285 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af856b68-4e63-4ac6-b52a-e8fb6653e7d1 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:03.917874 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-af856b68-4e63-4ac6-b52a-e8fb6653e7d1 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cd21f1fcc145d7a854c1a6b3005a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bbc39957d740eeb578bf4e7ebb931e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:03.927473 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-af856b68-4e63-4ac6-b52a-e8fb6653e7d1 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] 10.222.0.88 "GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47" status: 200 len: 1351 microversion: 2.1 time: 0.370559 Jul 25 14:32:03.928364 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 935/1810] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:03 2022] GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47 => generated 1351 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:03.933314 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a6febbe7-0c09-4b50-b452-3fe12b0dc9f2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:03.934247 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a6febbe7-0c09-4b50-b452-3fe12b0dc9f2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:03.940624 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a6febbe7-0c09-4b50-b452-3fe12b0dc9f2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:03.941302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a6febbe7-0c09-4b50-b452-3fe12b0dc9f2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:03.942232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a6febbe7-0c09-4b50-b452-3fe12b0dc9f2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:03.942807 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a6febbe7-0c09-4b50-b452-3fe12b0dc9f2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:04.393929 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a6febbe7-0c09-4b50-b452-3fe12b0dc9f2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:04.409392 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a6febbe7-0c09-4b50-b452-3fe12b0dc9f2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1318 microversion: 2.1 time: 0.475921 Jul 25 14:32:04.410037 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 936/1811] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:03 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1318 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:04.584361 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-29e61383-6a30-42a4-bb64-ef7e63e31aba tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:04.585215 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-29e61383-6a30-42a4-bb64-ef7e63e31aba tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:04.606688 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-29e61383-6a30-42a4-bb64-ef7e63e31aba tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:04.611195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-29e61383-6a30-42a4-bb64-ef7e63e31aba tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:04.634456 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-29e61383-6a30-42a4-bb64-ef7e63e31aba tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:04.638473 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e009e805-35f8-4d38-a154-a88b12bf552b tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e/action" status: 202 len: 0 microversion: 2.1 time: 5.272336 Jul 25 14:32:04.639783 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 876/1812] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:31:59 2022] POST /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e/action => generated 0 bytes in 5274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:32:04.643885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-29e61383-6a30-42a4-bb64-ef7e63e31aba tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:04.650942 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4f8db92d-1f75-4797-afe7-17ec87bf2497 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:04.651709 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4f8db92d-1f75-4797-afe7-17ec87bf2497 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:04.687585 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4f8db92d-1f75-4797-afe7-17ec87bf2497 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:04.689215 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4f8db92d-1f75-4797-afe7-17ec87bf2497 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:04.694488 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4f8db92d-1f75-4797-afe7-17ec87bf2497 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:04.695152 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4f8db92d-1f75-4797-afe7-17ec87bf2497 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:04.790021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-29e61383-6a30-42a4-bb64-ef7e63e31aba tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aea97fb95c44cfa5dce25e9a06cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887aa20d1838484eb895896f8f76ce41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:04.812491 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-29e61383-6a30-42a4-bb64-ef7e63e31aba tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 200 len: 1424 microversion: 2.1 time: 0.235899 Jul 25 14:32:04.829883 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 937/1813] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:04 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 1424 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:32:04.949728 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-487b563a-5e15-433b-afdc-36a84ab2107f tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:04.950618 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-487b563a-5e15-433b-afdc-36a84ab2107f tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] [instance: 44ad669c-e3e8-4b12-a64a-2245d98dea47] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:04.968610 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-487b563a-5e15-433b-afdc-36a84ab2107f tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:04.969317 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-487b563a-5e15-433b-afdc-36a84ab2107f tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:04.970278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-487b563a-5e15-433b-afdc-36a84ab2107f tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:04.970864 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-487b563a-5e15-433b-afdc-36a84ab2107f tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:05.304318 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-487b563a-5e15-433b-afdc-36a84ab2107f tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cd21f1fcc145d7a854c1a6b3005a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bbc39957d740eeb578bf4e7ebb931e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:05.315765 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-487b563a-5e15-433b-afdc-36a84ab2107f tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] 10.222.0.88 "GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47" status: 200 len: 1351 microversion: 2.1 time: 0.370724 Jul 25 14:32:05.318043 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 938/1814] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:04 2022] GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47 => generated 1351 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:32:05.329175 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-39d5adab-c461-4ce1-afc3-2ca08dd9f1c6 req-45f567cf-4c7b-404b-b74e-dcf3b6f31717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a419853-5f31-4fae-8a4e-da15efb145fb", "name": "network-vif-deleted", "tag": "7bf3ba29-6559-4754-8d9e-31166ec3ecb3"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:05.346734 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-39d5adab-c461-4ce1-afc3-2ca08dd9f1c6 req-45f567cf-4c7b-404b-b74e-dcf3b6f31717 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:05.348079 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-39d5adab-c461-4ce1-afc3-2ca08dd9f1c6 req-45f567cf-4c7b-404b-b74e-dcf3b6f31717 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:05.365666 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-39d5adab-c461-4ce1-afc3-2ca08dd9f1c6 req-45f567cf-4c7b-404b-b74e-dcf3b6f31717 service nova] Creating event network-vif-deleted:7bf3ba29-6559-4754-8d9e-31166ec3ecb3 for instance 1a419853-5f31-4fae-8a4e-da15efb145fb on n-h1-846435-14 Jul 25 14:32:05.373748 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4f8db92d-1f75-4797-afe7-17ec87bf2497 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:05.380442 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-39d5adab-c461-4ce1-afc3-2ca08dd9f1c6 req-45f567cf-4c7b-404b-b74e-dcf3b6f31717 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059534 Jul 25 14:32:05.381505 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 939/1815] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:32:05.389784 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4f8db92d-1f75-4797-afe7-17ec87bf2497 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e" status: 200 len: 1503 microversion: 2.1 time: 0.745456 Jul 25 14:32:05.392288 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 877/1816] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:04 2022] GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e => generated 1503 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:05.396916 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-1dc7bf0b-ff2b-4447-8bc5-1b8b85e1db9b req-3761c2d3-5a04-4004-8efb-e68a48a466da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ad669c-e3e8-4b12-a64a-2245d98dea47", "name": "network-vif-plugged", "status": "completed", "tag": "20563043-6910-4985-80ca-a42cb70b9786"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:05.417196 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-1dc7bf0b-ff2b-4447-8bc5-1b8b85e1db9b req-3761c2d3-5a04-4004-8efb-e68a48a466da service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:05.418430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-1dc7bf0b-ff2b-4447-8bc5-1b8b85e1db9b req-3761c2d3-5a04-4004-8efb-e68a48a466da service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:05.431182 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-1dc7bf0b-ff2b-4447-8bc5-1b8b85e1db9b req-3761c2d3-5a04-4004-8efb-e68a48a466da service nova] Creating event network-vif-plugged:20563043-6910-4985-80ca-a42cb70b9786 for instance 44ad669c-e3e8-4b12-a64a-2245d98dea47 on n-h1-846435-14 Jul 25 14:32:05.439593 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-1dc7bf0b-ff2b-4447-8bc5-1b8b85e1db9b req-3761c2d3-5a04-4004-8efb-e68a48a466da service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056505 Jul 25 14:32:05.440263 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 940/1817] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:32:05.449150 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b6c1eed7-0923-4ffa-b642-9e0502293394 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:05.455915 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b6c1eed7-0923-4ffa-b642-9e0502293394 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:05.463843 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b6c1eed7-0923-4ffa-b642-9e0502293394 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:05.464693 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b6c1eed7-0923-4ffa-b642-9e0502293394 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:05.465689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b6c1eed7-0923-4ffa-b642-9e0502293394 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:05.466303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b6c1eed7-0923-4ffa-b642-9e0502293394 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:05.839628 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5362b50f-db74-4322-9f53-a82168ed3dec tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:05.840408 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5362b50f-db74-4322-9f53-a82168ed3dec tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] [instance: 1a419853-5f31-4fae-8a4e-da15efb145fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:05.853618 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5362b50f-db74-4322-9f53-a82168ed3dec tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:05.854071 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5362b50f-db74-4322-9f53-a82168ed3dec tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:05.854875 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5362b50f-db74-4322-9f53-a82168ed3dec tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:05.855385 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5362b50f-db74-4322-9f53-a82168ed3dec tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:05.891577 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-5362b50f-db74-4322-9f53-a82168ed3dec tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] HTTP exception thrown: Instance 1a419853-5f31-4fae-8a4e-da15efb145fb could not be found. Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5362b50f-db74-4322-9f53-a82168ed3dec tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Request method failure captured: Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb HTTP/1.1 Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qgQ0giBIKJS3p1fKMOwG5iykKOb_7z2xkUwzX9ZOQP9w2TF7jf5B2qoIekEaNujbgYY0003fI8cBRBWofwaT6xURCwj33RgtUgI5CEAt7_13L8_mUPvgHP5u7-q-4hdnU9gOvpZrSenVJEtvuSYp_43hbO7IzDEh1EZa5FB6U8bMTY Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 887aa20d1838484eb895896f8f76ce41 Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-MigrationsAdminTest-1396799549 Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/887aa20d1838484eb895896f8f76ce41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/887aa20d1838484eb895896f8f76ce41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_887aa20d1838484eb895896f8f76ce41", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/887aa20d1838484eb895896f8f76ce41"}]}] Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-MigrationsAdminTest-1396799549 Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 887aa20d1838484eb895896f8f76ce41 Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-MigrationsAdminTest-1396799549 Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-MigrationsAdminTest-1396799549-project Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 00aea97fb95c44cfa5dce25e9a06cd37 Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-MigrationsAdminTest-1396799549-project Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 1a419853-5f31-4fae-8a4e-da15efb145fb could not be found. Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '1a419853-5f31-4fae-8a4e-da15efb145fb'} Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a419853-5f31-4fae-8a4e-da15efb145fb could not be found. Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a419853-5f31-4fae-8a4e-da15efb145fb could not be found. Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:32:05.902110 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:32:05.907955 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:32:05.907955 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:32:05.907955 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:32:05.907955 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:32:05.907955 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:32:05.907955 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a419853-5f31-4fae-8a4e-da15efb145fb could not be found. Jul 25 14:32:05.907955 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:32:05.908995 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5362b50f-db74-4322-9f53-a82168ed3dec tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] Returning 404 to user: Instance 1a419853-5f31-4fae-8a4e-da15efb145fb could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:32:05.910165 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5362b50f-db74-4322-9f53-a82168ed3dec tempest-MigrationsAdminTest-1396799549 tempest-MigrationsAdminTest-1396799549-project] 10.222.0.88 "GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb" status: 404 len: 111 microversion: 2.1 time: 0.076778 Jul 25 14:32:05.911922 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 941/1818] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:05 2022] GET /compute/v2.1/servers/1a419853-5f31-4fae-8a4e-da15efb145fb => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:32:06.338459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8a3e8820-ab91-41cf-9817-91a29b21d25a tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:06.340102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8a3e8820-ab91-41cf-9817-91a29b21d25a tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] [instance: 44ad669c-e3e8-4b12-a64a-2245d98dea47] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:06.351575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:32:06.352866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8a3e8820-ab91-41cf-9817-91a29b21d25a tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:06.353274 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8a3e8820-ab91-41cf-9817-91a29b21d25a tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:06.354623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8a3e8820-ab91-41cf-9817-91a29b21d25a tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:06.355276 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8a3e8820-ab91-41cf-9817-91a29b21d25a tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:06.370231 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b6c1eed7-0923-4ffa-b642-9e0502293394 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:06.382514 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b6c1eed7-0923-4ffa-b642-9e0502293394 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1318 microversion: 2.1 time: 0.954420 Jul 25 14:32:06.384684 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 878/1819] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:05 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1318 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:06.419911 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-18bdc71a-e939-41f2-bed9-414000684ff9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:06.420823 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-18bdc71a-e939-41f2-bed9-414000684ff9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:06.429839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-18bdc71a-e939-41f2-bed9-414000684ff9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:06.430277 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-18bdc71a-e939-41f2-bed9-414000684ff9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:06.431063 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-18bdc71a-e939-41f2-bed9-414000684ff9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:06.431499 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-18bdc71a-e939-41f2-bed9-414000684ff9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:06.590079 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8a3e8820-ab91-41cf-9817-91a29b21d25a tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cd21f1fcc145d7a854c1a6b3005a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bbc39957d740eeb578bf4e7ebb931e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:06.601640 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8a3e8820-ab91-41cf-9817-91a29b21d25a tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] 10.222.0.88 "GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47" status: 200 len: 1351 microversion: 2.1 time: 0.266651 Jul 25 14:32:06.604018 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 942/1820] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:06 2022] GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47 => generated 1351 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:32:06.846422 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-18bdc71a-e939-41f2-bed9-414000684ff9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:06.875866 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-18bdc71a-e939-41f2-bed9-414000684ff9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e" status: 200 len: 1503 microversion: 2.1 time: 0.460121 Jul 25 14:32:06.880594 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 879/1821] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:06 2022] GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e => generated 1503 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:32:07.408191 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9c8c9dd2-c9a9-4f44-8ade-00ea412ebdaa tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:07.410167 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9c8c9dd2-c9a9-4f44-8ade-00ea412ebdaa tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:07.418443 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:32:07.422450 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9c8c9dd2-c9a9-4f44-8ade-00ea412ebdaa tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:07.423072 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9c8c9dd2-c9a9-4f44-8ade-00ea412ebdaa tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:07.424281 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9c8c9dd2-c9a9-4f44-8ade-00ea412ebdaa tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:07.425029 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9c8c9dd2-c9a9-4f44-8ade-00ea412ebdaa tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:07.466153 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-86e66f4d-7b1f-4955-beb9-e2181de977d0 req-74653bd0-ab46-4820-92db-45a361a778f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aacb7718-eb99-45ae-a61c-4e5e8770be8a", "name": "network-vif-plugged", "status": "completed", "tag": "0bbbda3d-8d02-4c28-9926-89b52f83ac0e"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:07.508683 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-86e66f4d-7b1f-4955-beb9-e2181de977d0 req-74653bd0-ab46-4820-92db-45a361a778f9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:07.509210 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-86e66f4d-7b1f-4955-beb9-e2181de977d0 req-74653bd0-ab46-4820-92db-45a361a778f9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:07.540064 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-86e66f4d-7b1f-4955-beb9-e2181de977d0 req-74653bd0-ab46-4820-92db-45a361a778f9 service nova] Creating event network-vif-plugged:0bbbda3d-8d02-4c28-9926-89b52f83ac0e for instance aacb7718-eb99-45ae-a61c-4e5e8770be8a on n-h1-846435-14 Jul 25 14:32:07.560548 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-86e66f4d-7b1f-4955-beb9-e2181de977d0 req-74653bd0-ab46-4820-92db-45a361a778f9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099220 Jul 25 14:32:07.562274 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 880/1822] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:32:07.623287 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8bef4b51-198e-4619-8ecc-c9ce136a76b2 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:07.624363 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8bef4b51-198e-4619-8ecc-c9ce136a76b2 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] [instance: 44ad669c-e3e8-4b12-a64a-2245d98dea47] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:07.633923 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8bef4b51-198e-4619-8ecc-c9ce136a76b2 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:07.637082 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8bef4b51-198e-4619-8ecc-c9ce136a76b2 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:07.638099 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8bef4b51-198e-4619-8ecc-c9ce136a76b2 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:07.640381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8bef4b51-198e-4619-8ecc-c9ce136a76b2 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:07.746638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9c8c9dd2-c9a9-4f44-8ade-00ea412ebdaa tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:07.763754 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9c8c9dd2-c9a9-4f44-8ade-00ea412ebdaa tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1318 microversion: 2.1 time: 0.363654 Jul 25 14:32:07.779339 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 943/1823] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:07 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:07.902966 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-42e892a0-0f36-46f0-8aa1-8c4f49055292 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:07.903852 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-42e892a0-0f36-46f0-8aa1-8c4f49055292 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:07.913228 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-42e892a0-0f36-46f0-8aa1-8c4f49055292 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:07.914555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-42e892a0-0f36-46f0-8aa1-8c4f49055292 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:07.916400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-42e892a0-0f36-46f0-8aa1-8c4f49055292 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:07.917851 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-42e892a0-0f36-46f0-8aa1-8c4f49055292 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:08.130703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8bef4b51-198e-4619-8ecc-c9ce136a76b2 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cd21f1fcc145d7a854c1a6b3005a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bbc39957d740eeb578bf4e7ebb931e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:08.140800 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8bef4b51-198e-4619-8ecc-c9ce136a76b2 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] 10.222.0.88 "GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47" status: 200 len: 1539 microversion: 2.1 time: 0.521662 Jul 25 14:32:08.143830 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 881/1824] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:07 2022] GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47 => generated 1539 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:32:08.163073 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-42e892a0-0f36-46f0-8aa1-8c4f49055292 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:08.164558 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-15ff0b21-386e-4cc2-911b-3d71fa06caa0 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:08.165513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-15ff0b21-386e-4cc2-911b-3d71fa06caa0 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] [instance: 44ad669c-e3e8-4b12-a64a-2245d98dea47] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:08.176788 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-42e892a0-0f36-46f0-8aa1-8c4f49055292 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e" status: 200 len: 1503 microversion: 2.1 time: 0.279160 Jul 25 14:32:08.177418 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-15ff0b21-386e-4cc2-911b-3d71fa06caa0 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:08.178057 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-15ff0b21-386e-4cc2-911b-3d71fa06caa0 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:08.179173 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-15ff0b21-386e-4cc2-911b-3d71fa06caa0 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:08.181229 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-15ff0b21-386e-4cc2-911b-3d71fa06caa0 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:08.194001 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 944/1825] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:07 2022] GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e => generated 1503 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:08.360948 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-15ff0b21-386e-4cc2-911b-3d71fa06caa0 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] 10.222.0.88 "GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.201133 Jul 25 14:32:08.361537 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 882/1826] 10.222.0.88 () {58 vars in 1275 bytes} [Mon Jul 25 14:32:08 2022] GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47/os-interface => generated 284 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:32:08.484516 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-cb79fce8-e52d-4e00-9bd6-d52dfdb0d2e6 req-3ecde971-8d56-4d13-aea0-c1f16fae8407 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48341efc-a4b6-4532-8a2b-ac8d8f50a26e", "name": "network-vif-unplugged", "status": "completed", "tag": "2b310f15-4cbb-46d3-87df-2b7fb95774aa"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:08.500608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-cb79fce8-e52d-4e00-9bd6-d52dfdb0d2e6 req-3ecde971-8d56-4d13-aea0-c1f16fae8407 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:08.501052 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-cb79fce8-e52d-4e00-9bd6-d52dfdb0d2e6 req-3ecde971-8d56-4d13-aea0-c1f16fae8407 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:08.532327 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-cb79fce8-e52d-4e00-9bd6-d52dfdb0d2e6 req-3ecde971-8d56-4d13-aea0-c1f16fae8407 service nova] Creating event network-vif-unplugged:2b310f15-4cbb-46d3-87df-2b7fb95774aa for instance 48341efc-a4b6-4532-8a2b-ac8d8f50a26e on n-h2-846435-14 Jul 25 14:32:08.549088 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-cb79fce8-e52d-4e00-9bd6-d52dfdb0d2e6 req-3ecde971-8d56-4d13-aea0-c1f16fae8407 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077663 Jul 25 14:32:08.550266 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 945/1827] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:32:08.788333 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-09ff2f47-8f51-44a6-8f97-47068c606014 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:08.788949 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-09ff2f47-8f51-44a6-8f97-47068c606014 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:08.798538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-09ff2f47-8f51-44a6-8f97-47068c606014 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:08.803675 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-09ff2f47-8f51-44a6-8f97-47068c606014 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:08.804839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-09ff2f47-8f51-44a6-8f97-47068c606014 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:08.805363 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-09ff2f47-8f51-44a6-8f97-47068c606014 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:09.191324 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-09ff2f47-8f51-44a6-8f97-47068c606014 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:09.201659 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-98ed0635-72b2-4f56-bfd3-96e41e786a50 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:09.202349 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-98ed0635-72b2-4f56-bfd3-96e41e786a50 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:09.217374 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-09ff2f47-8f51-44a6-8f97-47068c606014 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1318 microversion: 2.1 time: 0.433185 Jul 25 14:32:09.217986 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 883/1828] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:08 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1318 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:09.260014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98ed0635-72b2-4f56-bfd3-96e41e786a50 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:09.260903 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98ed0635-72b2-4f56-bfd3-96e41e786a50 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:09.261815 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98ed0635-72b2-4f56-bfd3-96e41e786a50 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:09.262461 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98ed0635-72b2-4f56-bfd3-96e41e786a50 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:09.697908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-98ed0635-72b2-4f56-bfd3-96e41e786a50 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:09.709454 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-98ed0635-72b2-4f56-bfd3-96e41e786a50 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e" status: 200 len: 1503 microversion: 2.1 time: 0.512414 Jul 25 14:32:09.711653 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 946/1829] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:09 2022] GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e => generated 1503 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:10.253950 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0bc72f3b-122e-48d5-9d46-de5d499ffc4f tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:10.254702 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0bc72f3b-122e-48d5-9d46-de5d499ffc4f tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:10.267882 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0bc72f3b-122e-48d5-9d46-de5d499ffc4f tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:10.271579 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0bc72f3b-122e-48d5-9d46-de5d499ffc4f tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:10.274808 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0bc72f3b-122e-48d5-9d46-de5d499ffc4f tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:10.276438 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0bc72f3b-122e-48d5-9d46-de5d499ffc4f tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:10.695739 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0bc72f3b-122e-48d5-9d46-de5d499ffc4f tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:10.707018 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0bc72f3b-122e-48d5-9d46-de5d499ffc4f tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1508 microversion: 2.1 time: 0.457951 Jul 25 14:32:10.708863 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 884/1830] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:10 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1508 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:10.745290 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-c8fa292a-be18-4462-bcff-3c40c02f0347 req-1056dbc9-a886-4aac-84e5-9724a369498f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48341efc-a4b6-4532-8a2b-ac8d8f50a26e", "tag": "2b310f15-4cbb-46d3-87df-2b7fb95774aa"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:10.761970 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c8fa292a-be18-4462-bcff-3c40c02f0347 req-1056dbc9-a886-4aac-84e5-9724a369498f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:10.762967 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c8fa292a-be18-4462-bcff-3c40c02f0347 req-1056dbc9-a886-4aac-84e5-9724a369498f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:10.786701 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-c8fa292a-be18-4462-bcff-3c40c02f0347 req-1056dbc9-a886-4aac-84e5-9724a369498f service nova] Creating event network-changed:2b310f15-4cbb-46d3-87df-2b7fb95774aa for instance 48341efc-a4b6-4532-8a2b-ac8d8f50a26e on n-h2-846435-14 Jul 25 14:32:10.794097 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-c8fa292a-be18-4462-bcff-3c40c02f0347 req-1056dbc9-a886-4aac-84e5-9724a369498f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080805 Jul 25 14:32:10.795362 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 885/1831] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:32:10.806732 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-4a42a869-d5ee-4608-8506-ac3b4e0b9688 req-91d6f7e1-91f1-42bb-8e48-521bc6471748 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44ad669c-e3e8-4b12-a64a-2245d98dea47", "tag": "20563043-6910-4985-80ca-a42cb70b9786"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:10.844406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-4a42a869-d5ee-4608-8506-ac3b4e0b9688 req-91d6f7e1-91f1-42bb-8e48-521bc6471748 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:10.845106 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-4a42a869-d5ee-4608-8506-ac3b4e0b9688 req-91d6f7e1-91f1-42bb-8e48-521bc6471748 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:10.860612 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-4a42a869-d5ee-4608-8506-ac3b4e0b9688 req-91d6f7e1-91f1-42bb-8e48-521bc6471748 service nova] Creating event network-changed:20563043-6910-4985-80ca-a42cb70b9786 for instance 44ad669c-e3e8-4b12-a64a-2245d98dea47 on n-h1-846435-14 Jul 25 14:32:10.869062 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-4a42a869-d5ee-4608-8506-ac3b4e0b9688 req-91d6f7e1-91f1-42bb-8e48-521bc6471748 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071681 Jul 25 14:32:10.869950 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 886/1832] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:32:10.879596 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d6ae1afd-1334-4b99-9a17-6c1028af4764 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:10.881467 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d6ae1afd-1334-4b99-9a17-6c1028af4764 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:10.892170 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:32:10.899240 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d6ae1afd-1334-4b99-9a17-6c1028af4764 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:10.900132 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d6ae1afd-1334-4b99-9a17-6c1028af4764 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:10.901435 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d6ae1afd-1334-4b99-9a17-6c1028af4764 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:10.902151 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d6ae1afd-1334-4b99-9a17-6c1028af4764 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:10.984591 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c4a33f80-b0b3-4e56-b423-9aff27aaeaaf tempest-NetworksTest-1659377385 tempest-NetworksTest-1659377385-project-admin] Calling method '.version_select at 0x7f469893e1f0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:11.422304 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d6ae1afd-1334-4b99-9a17-6c1028af4764 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:11.456278 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d6ae1afd-1334-4b99-9a17-6c1028af4764 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1508 microversion: 2.1 time: 0.584572 Jul 25 14:32:11.457244 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 887/1833] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:10 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1508 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:11.465072 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2bf7ab73-ece3-42f9-a2a9-6fe1c4d314ec tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:11.465700 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2bf7ab73-ece3-42f9-a2a9-6fe1c4d314ec tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:11.473195 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2bf7ab73-ece3-42f9-a2a9-6fe1c4d314ec tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:11.473771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2bf7ab73-ece3-42f9-a2a9-6fe1c4d314ec tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:11.474661 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2bf7ab73-ece3-42f9-a2a9-6fe1c4d314ec tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:11.476094 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2bf7ab73-ece3-42f9-a2a9-6fe1c4d314ec tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:11.567486 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c4a33f80-b0b3-4e56-b423-9aff27aaeaaf tempest-NetworksTest-1659377385 tempest-NetworksTest-1659377385-project-admin] 10.222.0.88 "GET /compute/v2.1/os-networks" status: 200 len: 9446 microversion: 2.1 time: 1.074820 Jul 25 14:32:11.568744 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 947/1834] 10.222.0.88 () {58 vars in 1137 bytes} [Mon Jul 25 14:32:10 2022] GET /compute/v2.1/os-networks => generated 9446 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:11.574541 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-23e4d7a0-1230-4656-9a08-ed771e7b30fe tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:11.577694 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-23e4d7a0-1230-4656-9a08-ed771e7b30fe tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:11.586330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23e4d7a0-1230-4656-9a08-ed771e7b30fe tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:11.592230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23e4d7a0-1230-4656-9a08-ed771e7b30fe tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:11.593355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23e4d7a0-1230-4656-9a08-ed771e7b30fe tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:11.594061 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23e4d7a0-1230-4656-9a08-ed771e7b30fe tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:11.677722 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-23e4d7a0-1230-4656-9a08-ed771e7b30fe tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "PUT /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1080 microversion: 2.1 time: 0.107439 Jul 25 14:32:11.678369 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 948/1835] 10.222.0.88 () {60 vars in 1256 bytes} [Mon Jul 25 14:32:11 2022] PUT /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1080 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:11.686618 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ab52f472-f4bb-46a9-b5be-d173d56212aa tempest-NetworksTest-1659377385 tempest-NetworksTest-1659377385-project-admin] Calling method '.version_select at 0x7f4698903a60>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:11.934831 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2bf7ab73-ece3-42f9-a2a9-6fe1c4d314ec tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:11.946146 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2bf7ab73-ece3-42f9-a2a9-6fe1c4d314ec tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e" status: 200 len: 1503 microversion: 2.1 time: 0.487642 Jul 25 14:32:11.946755 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 888/1836] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:11 2022] GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e => generated 1503 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:11.958649 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c5ba1242-f7f4-405c-814e-3fab798b8e9e tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:11.959523 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c5ba1242-f7f4-405c-814e-3fab798b8e9e tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:11.963074 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ab52f472-f4bb-46a9-b5be-d173d56212aa tempest-NetworksTest-1659377385 tempest-NetworksTest-1659377385-project-admin] 10.222.0.88 "GET /compute/v2.1/os-networks/0e482852-0013-452e-b205-cea1a4f78a15" status: 200 len: 652 microversion: 2.1 time: 0.283363 Jul 25 14:32:11.968137 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 949/1837] 10.222.0.88 () {58 vars in 1248 bytes} [Mon Jul 25 14:32:11 2022] GET /compute/v2.1/os-networks/0e482852-0013-452e-b205-cea1a4f78a15 => generated 652 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:32:11.974667 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4acc149c-8932-4fba-b798-831cc78b093d tempest-NetworksTest-1659377385 tempest-NetworksTest-1659377385-project-admin] Calling method '.version_select at 0x7f4698903700>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:11.984308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c5ba1242-f7f4-405c-814e-3fab798b8e9e tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:11.984799 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c5ba1242-f7f4-405c-814e-3fab798b8e9e tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:11.986230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c5ba1242-f7f4-405c-814e-3fab798b8e9e tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:11.986230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c5ba1242-f7f4-405c-814e-3fab798b8e9e tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:12.422119 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4acc149c-8932-4fba-b798-831cc78b093d tempest-NetworksTest-1659377385 tempest-NetworksTest-1659377385-project-admin] 10.222.0.88 "GET /compute/v2.1/os-networks" status: 200 len: 10137 microversion: 2.1 time: 0.452461 Jul 25 14:32:12.423816 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 950/1838] 10.222.0.88 () {58 vars in 1137 bytes} [Mon Jul 25 14:32:11 2022] GET /compute/v2.1/os-networks => generated 10137 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 14:32:12.572184 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c5ba1242-f7f4-405c-814e-3fab798b8e9e tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:12.581609 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c5ba1242-f7f4-405c-814e-3fab798b8e9e tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1506 microversion: 2.1 time: 0.632381 Jul 25 14:32:12.582416 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 889/1839] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:11 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1506 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:12.607572 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-eaea8f46-aa76-4223-9c14-613461c35f22 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:12.608254 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-eaea8f46-aa76-4223-9c14-613461c35f22 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:12.622197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eaea8f46-aa76-4223-9c14-613461c35f22 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:12.624715 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eaea8f46-aa76-4223-9c14-613461c35f22 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:12.625560 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eaea8f46-aa76-4223-9c14-613461c35f22 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:12.643523 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eaea8f46-aa76-4223-9c14-613461c35f22 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:12.967117 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f6b7adcc-3885-4f03-b482-e57a6551322c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:12.968098 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f6b7adcc-3885-4f03-b482-e57a6551322c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:12.970733 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-eaea8f46-aa76-4223-9c14-613461c35f22 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:12.981035 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f6b7adcc-3885-4f03-b482-e57a6551322c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:12.981905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f6b7adcc-3885-4f03-b482-e57a6551322c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:12.982905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f6b7adcc-3885-4f03-b482-e57a6551322c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:12.985022 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-eaea8f46-aa76-4223-9c14-613461c35f22 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1506 microversion: 2.1 time: 0.383886 Jul 25 14:32:12.986143 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 951/1840] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:12 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1506 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:12.989157 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f6b7adcc-3885-4f03-b482-e57a6551322c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:13.008083 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-31932678-db1a-42ba-9f1a-4293a33c03fd tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:13.012260 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-31932678-db1a-42ba-9f1a-4293a33c03fd tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:13.030040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-31932678-db1a-42ba-9f1a-4293a33c03fd tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:13.032049 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-31932678-db1a-42ba-9f1a-4293a33c03fd tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:13.036823 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-31932678-db1a-42ba-9f1a-4293a33c03fd tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:13.038522 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-31932678-db1a-42ba-9f1a-4293a33c03fd tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:13.233283 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-31932678-db1a-42ba-9f1a-4293a33c03fd tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:32:13.233727 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-31932678-db1a-42ba-9f1a-4293a33c03fd tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:32:13.234398 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-31932678-db1a-42ba-9f1a-4293a33c03fd tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:32:13.234973 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-31932678-db1a-42ba-9f1a-4293a33c03fd tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:32:13.236191 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-31932678-db1a-42ba-9f1a-4293a33c03fd tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:32:13.286889 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:32:13.302392 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f6b7adcc-3885-4f03-b482-e57a6551322c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:13.310190 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f6b7adcc-3885-4f03-b482-e57a6551322c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e" status: 200 len: 1503 microversion: 2.1 time: 0.347110 Jul 25 14:32:13.310775 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 890/1841] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:12 2022] GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e => generated 1503 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:32:13.382042 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-31932678-db1a-42ba-9f1a-4293a33c03fd tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:13.394594 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-31932678-db1a-42ba-9f1a-4293a33c03fd tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:13.400139 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-31932678-db1a-42ba-9f1a-4293a33c03fd tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:13.402620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-31932678-db1a-42ba-9f1a-4293a33c03fd tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:13.404454 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-31932678-db1a-42ba-9f1a-4293a33c03fd tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:13.468370 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-31932678-db1a-42ba-9f1a-4293a33c03fd tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "POST /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a/action" status: 202 len: 1112 microversion: 2.1 time: 0.465370 Jul 25 14:32:13.481402 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 952/1842] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:32:13 2022] POST /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a/action => generated 1112 bytes in 479 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 25 14:32:13.488662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c977da55-9f30-4fe1-8590-73980494d110 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:13.490019 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c977da55-9f30-4fe1-8590-73980494d110 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:13.503603 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c977da55-9f30-4fe1-8590-73980494d110 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:13.504589 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c977da55-9f30-4fe1-8590-73980494d110 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:13.506113 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c977da55-9f30-4fe1-8590-73980494d110 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:13.506893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c977da55-9f30-4fe1-8590-73980494d110 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:13.815388 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c977da55-9f30-4fe1-8590-73980494d110 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:13.831258 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c977da55-9f30-4fe1-8590-73980494d110 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1517 microversion: 2.1 time: 0.347088 Jul 25 14:32:13.834109 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 891/1843] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:13 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1517 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:14.175089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-ba54b0ae-fa3b-4e7a-9ec8-f92e2a4fccc4 req-fe622d16-63fd-4cc5-9ff8-3061829f9a0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48341efc-a4b6-4532-8a2b-ac8d8f50a26e", "name": "network-vif-unplugged", "status": "completed", "tag": "2b310f15-4cbb-46d3-87df-2b7fb95774aa"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:14.190343 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ba54b0ae-fa3b-4e7a-9ec8-f92e2a4fccc4 req-fe622d16-63fd-4cc5-9ff8-3061829f9a0b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:14.192509 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ba54b0ae-fa3b-4e7a-9ec8-f92e2a4fccc4 req-fe622d16-63fd-4cc5-9ff8-3061829f9a0b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:14.211630 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-ba54b0ae-fa3b-4e7a-9ec8-f92e2a4fccc4 req-fe622d16-63fd-4cc5-9ff8-3061829f9a0b service nova] Creating event network-vif-unplugged:2b310f15-4cbb-46d3-87df-2b7fb95774aa for instance 48341efc-a4b6-4532-8a2b-ac8d8f50a26e on n-h2-846435-14 Jul 25 14:32:14.249675 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-ba54b0ae-fa3b-4e7a-9ec8-f92e2a4fccc4 req-fe622d16-63fd-4cc5-9ff8-3061829f9a0b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050538 Jul 25 14:32:14.253374 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 953/1844] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:32:14.332577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-551893f3-febe-49f0-9396-5aa72f4ba311 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:14.333783 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-551893f3-febe-49f0-9396-5aa72f4ba311 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:14.343302 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-551893f3-febe-49f0-9396-5aa72f4ba311 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:14.343930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-551893f3-febe-49f0-9396-5aa72f4ba311 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:14.345100 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-551893f3-febe-49f0-9396-5aa72f4ba311 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:14.345613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-551893f3-febe-49f0-9396-5aa72f4ba311 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:14.378339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:32:14.585646 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-551893f3-febe-49f0-9396-5aa72f4ba311 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:14.596488 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-551893f3-febe-49f0-9396-5aa72f4ba311 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e" status: 200 len: 1503 microversion: 2.1 time: 0.267579 Jul 25 14:32:14.599528 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 892/1845] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:14 2022] GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e => generated 1503 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:14.870516 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-70c3b791-e491-4f18-a56c-cf849c27cacc tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:14.871234 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-70c3b791-e491-4f18-a56c-cf849c27cacc tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:14.892876 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-70c3b791-e491-4f18-a56c-cf849c27cacc tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:14.893333 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-70c3b791-e491-4f18-a56c-cf849c27cacc tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:14.894138 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-70c3b791-e491-4f18-a56c-cf849c27cacc tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:14.894584 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-70c3b791-e491-4f18-a56c-cf849c27cacc tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:15.619477 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2d58324b-00fa-4c29-a61c-76dd2fddd55b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:15.621200 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2d58324b-00fa-4c29-a61c-76dd2fddd55b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:15.630240 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2d58324b-00fa-4c29-a61c-76dd2fddd55b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:15.631297 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2d58324b-00fa-4c29-a61c-76dd2fddd55b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:15.632433 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2d58324b-00fa-4c29-a61c-76dd2fddd55b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:15.633128 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2d58324b-00fa-4c29-a61c-76dd2fddd55b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:15.740351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-70c3b791-e491-4f18-a56c-cf849c27cacc tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:15.750807 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-70c3b791-e491-4f18-a56c-cf849c27cacc tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1517 microversion: 2.1 time: 0.899658 Jul 25 14:32:15.760230 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 954/1846] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:14 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1517 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:16.020330 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2d58324b-00fa-4c29-a61c-76dd2fddd55b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:16.033327 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2d58324b-00fa-4c29-a61c-76dd2fddd55b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e" status: 200 len: 1503 microversion: 2.1 time: 0.417815 Jul 25 14:32:16.049112 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 893/1847] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:15 2022] GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e => generated 1503 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:16.777995 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c0634179-5fee-4ea8-a71d-09557880b958 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:16.779312 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c0634179-5fee-4ea8-a71d-09557880b958 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:16.790334 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c0634179-5fee-4ea8-a71d-09557880b958 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:16.793317 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c0634179-5fee-4ea8-a71d-09557880b958 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:16.794645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c0634179-5fee-4ea8-a71d-09557880b958 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:16.796365 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c0634179-5fee-4ea8-a71d-09557880b958 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:17.067435 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-decab8f2-6b92-4f9a-af8e-fb5f4d189462 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:17.068925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-decab8f2-6b92-4f9a-af8e-fb5f4d189462 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:17.078771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-decab8f2-6b92-4f9a-af8e-fb5f4d189462 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:17.082071 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-decab8f2-6b92-4f9a-af8e-fb5f4d189462 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:17.083017 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-decab8f2-6b92-4f9a-af8e-fb5f4d189462 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:17.084465 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-decab8f2-6b92-4f9a-af8e-fb5f4d189462 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:17.362789 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-decab8f2-6b92-4f9a-af8e-fb5f4d189462 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:17.372698 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-decab8f2-6b92-4f9a-af8e-fb5f4d189462 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e" status: 200 len: 1478 microversion: 2.1 time: 0.310154 Jul 25 14:32:17.373571 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 894/1848] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:17 2022] GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e => generated 1478 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:17.385090 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c0634179-5fee-4ea8-a71d-09557880b958 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:17.401849 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c0634179-5fee-4ea8-a71d-09557880b958 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1517 microversion: 2.1 time: 0.620562 Jul 25 14:32:17.413019 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 955/1849] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:16 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1517 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:17.435608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a48ed82a-9b74-4afe-a3ee-ee9c2228a09c tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Calling method '.version_select at 0x7f46989b9f70>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:17.451671 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a48ed82a-9b74-4afe-a3ee-ee9c2228a09c tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:17.457175 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a48ed82a-9b74-4afe-a3ee-ee9c2228a09c tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:17.479091 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a48ed82a-9b74-4afe-a3ee-ee9c2228a09c tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] 10.222.0.88 "GET /compute/v2.1/os-migrations" status: 200 len: 1956 microversion: 2.1 time: 0.064627 Jul 25 14:32:17.496412 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 956/1850] 10.222.0.88 () {58 vars in 1143 bytes} [Mon Jul 25 14:32:17 2022] GET /compute/v2.1/os-migrations => generated 1956 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:17.504678 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e08ec9bb-e670-4b26-bc05-c51cad996fac tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:17.505410 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e08ec9bb-e670-4b26-bc05-c51cad996fac tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:17.518027 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e08ec9bb-e670-4b26-bc05-c51cad996fac tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:17.519110 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e08ec9bb-e670-4b26-bc05-c51cad996fac tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:17.521435 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e08ec9bb-e670-4b26-bc05-c51cad996fac tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:17.525322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e08ec9bb-e670-4b26-bc05-c51cad996fac tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:17.642722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-951b3783-fb4c-4961-9d2e-886f6f698a43 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-792587992", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:17.713255 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-951b3783-fb4c-4961-9d2e-886f6f698a43 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] validate_networks() for None {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:32:17.977412 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-951b3783-fb4c-4961-9d2e-886f6f698a43 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:32:17.978120 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-951b3783-fb4c-4961-9d2e-886f6f698a43 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:32:17.978758 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-951b3783-fb4c-4961-9d2e-886f6f698a43 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:32:17.979351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-951b3783-fb4c-4961-9d2e-886f6f698a43 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:32:17.979969 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-951b3783-fb4c-4961-9d2e-886f6f698a43 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:32:18.000777 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-951b3783-fb4c-4961-9d2e-886f6f698a43 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:18.002557 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-951b3783-fb4c-4961-9d2e-886f6f698a43 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:18.004521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-951b3783-fb4c-4961-9d2e-886f6f698a43 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:18.005562 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-951b3783-fb4c-4961-9d2e-886f6f698a43 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:18.032889 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-951b3783-fb4c-4961-9d2e-886f6f698a43 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for project e60b88c2aea642658a5bfc14780d5d51. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:32:18.040792 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-951b3783-fb4c-4961-9d2e-886f6f698a43 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for user ef351be3886949f9985b3244301435a9 and project e60b88c2aea642658a5bfc14780d5d51. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:32:18.041930 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e08ec9bb-e670-4b26-bc05-c51cad996fac tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e" status: 200 len: 1631 microversion: 2.1 time: 0.540314 Jul 25 14:32:18.057125 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-951b3783-fb4c-4961-9d2e-886f6f698a43 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:32:18.059162 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 957/1851] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:17 2022] GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e => generated 1631 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:32:18.060156 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-951b3783-fb4c-4961-9d2e-886f6f698a43 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 1a97e112-b45b-4dcb-ad9f-e979e5c183d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:32:18.073575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5badcd85-fd06-4925-bb91-1a22d4c42fba tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Action: 'create', calling method: .version_select at 0x7f469893ed30>, body: {"keypair": {"name": "tempest-keypair-1446891271", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGN2Efl2yQ+PJLDNt1jO4yLvgh+zsQ0ftaIyY288gu5EisZPSsqN2zLMy+TugADjADIYp91SgWnDd1cTY2osWt0F9RvoJqCGeVSxit1rD6aA+gZTzQJ2cz5pbnWbBV6UvQ=="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:18.101959 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-5badcd85-fd06-4925-bb91-1a22d4c42fba tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Getting quotas for project ceaa4430d1864bc2bf9afdec9cd0cf64. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:32:18.110884 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-5badcd85-fd06-4925-bb91-1a22d4c42fba tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Getting quotas for user 3da7c9a3c01f4dbca93d5e7aa688fc70 and project ceaa4430d1864bc2bf9afdec9cd0cf64. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:32:18.147020 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-951b3783-fb4c-4961-9d2e-886f6f698a43 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.772190 Jul 25 14:32:18.159931 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 895/1852] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:32:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:32:18.168296 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e6993911-316d-4c87-850a-878b920e3e46 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:18.169206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e6993911-316d-4c87-850a-878b920e3e46 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 1a97e112-b45b-4dcb-ad9f-e979e5c183d9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:18.179323 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5badcd85-fd06-4925-bb91-1a22d4c42fba tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.111208 Jul 25 14:32:18.183870 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 958/1853] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:32:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:32:18.362522 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e6993911-316d-4c87-850a-878b920e3e46 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:18.390665 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e6993911-316d-4c87-850a-878b920e3e46 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9" status: 200 len: 1216 microversion: 2.1 time: 0.209449 Jul 25 14:32:18.394407 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 896/1854] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:18 2022] GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9 => generated 1216 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:18.427740 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0226badb-fcbf-4c40-a52c-d00bf7dd3608 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:18.428998 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0226badb-fcbf-4c40-a52c-d00bf7dd3608 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:18.440987 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0226badb-fcbf-4c40-a52c-d00bf7dd3608 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:18.441995 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0226badb-fcbf-4c40-a52c-d00bf7dd3608 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:18.442906 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0226badb-fcbf-4c40-a52c-d00bf7dd3608 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:18.443432 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0226badb-fcbf-4c40-a52c-d00bf7dd3608 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:18.986393 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0226badb-fcbf-4c40-a52c-d00bf7dd3608 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:19.014396 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0226badb-fcbf-4c40-a52c-d00bf7dd3608 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1517 microversion: 2.1 time: 0.586489 Jul 25 14:32:19.017258 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 959/1855] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:18 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1517 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:19.421161 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c057acf2-a3eb-4186-b3a4-e4053b29d728 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:19.422607 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c057acf2-a3eb-4186-b3a4-e4053b29d728 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 1a97e112-b45b-4dcb-ad9f-e979e5c183d9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:19.453695 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c057acf2-a3eb-4186-b3a4-e4053b29d728 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:19.454600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c057acf2-a3eb-4186-b3a4-e4053b29d728 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:19.460751 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c057acf2-a3eb-4186-b3a4-e4053b29d728 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:19.465801 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c057acf2-a3eb-4186-b3a4-e4053b29d728 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:19.596499 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c057acf2-a3eb-4186-b3a4-e4053b29d728 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:19.610439 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c057acf2-a3eb-4186-b3a4-e4053b29d728 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9" status: 200 len: 1268 microversion: 2.1 time: 0.195699 Jul 25 14:32:19.625644 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 897/1856] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:19 2022] GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9 => generated 1268 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:20.044546 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3c249a63-f67e-43f6-a719-6abba5347070 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:20.046438 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3c249a63-f67e-43f6-a719-6abba5347070 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:20.082581 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c249a63-f67e-43f6-a719-6abba5347070 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:20.083026 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c249a63-f67e-43f6-a719-6abba5347070 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:20.083814 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c249a63-f67e-43f6-a719-6abba5347070 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:20.084265 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c249a63-f67e-43f6-a719-6abba5347070 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:20.331354 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7c50af22-b17e-403b-98b6-4fa44f3582e2 tempest-SecurityGroupsNegativeTestJSON-1531638564 tempest-SecurityGroupsNegativeTestJSON-1531638564-project] Calling method '.version_select at 0x7f46873d99d0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:20.412669 n-d-846435-14 devstack@n-api.service[119303]: DEBUG neutronclient.v2_0.client [None req-7c50af22-b17e-403b-98b6-4fa44f3582e2 tempest-SecurityGroupsNegativeTestJSON-1531638564 tempest-SecurityGroupsNegativeTestJSON-1531638564-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b9916db5-4af7-4748-be92-b38cccf21faf does not exist", "detail": ""}} {{(pid=119303) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 14:32:20.413562 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.security_group_api [None req-7c50af22-b17e-403b-98b6-4fa44f3582e2 tempest-SecurityGroupsNegativeTestJSON-1531638564 tempest-SecurityGroupsNegativeTestJSON-1531638564-project] Neutron security group b9916db5-4af7-4748-be92-b38cccf21faf not found {{(pid=119303) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 14:32:20.415132 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-7c50af22-b17e-403b-98b6-4fa44f3582e2 tempest-SecurityGroupsNegativeTestJSON-1531638564 tempest-SecurityGroupsNegativeTestJSON-1531638564-project] HTTP exception thrown: Security group b9916db5-4af7-4748-be92-b38cccf21faf does not exist Jul 25 14:32:20.415132 n-d-846435-14 devstack@n-api.service[119303]: Neutron server returns request_ids: ['req-2f20a695-b477-4aa4-8eb2-bc678cf19db8'] Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7c50af22-b17e-403b-98b6-4fa44f3582e2 tempest-SecurityGroupsNegativeTestJSON-1531638564 tempest-SecurityGroupsNegativeTestJSON-1531638564-project] Request method failure captured: Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/os-security-groups/b9916db5-4af7-4748-be92-b38cccf21faf HTTP/1.1 Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3ql0-M-LAp-ZFa7dnneLPV0eU1P54iE3A39pj0m9U_vRbtLFoIDJCJf5s7DqM14Ptm1dldClcvzwI3LVpZBGbopspkI4tvejH0VEdNmfBxWpjFXnhvjpRzW98fVCP3eRYTIXhCnRO6ZqW75cw9MdFmwnGE0DIBbou1LKKA1bjTHUbaU Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 27ef96b7a15f45249aa779ba227ced28 Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1531638564 Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27ef96b7a15f45249aa779ba227ced28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27ef96b7a15f45249aa779ba227ced28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27ef96b7a15f45249aa779ba227ced28", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27ef96b7a15f45249aa779ba227ced28"}]}] Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1531638564 Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 27ef96b7a15f45249aa779ba227ced28 Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1531638564 Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-SecurityGroupsNegativeTestJSON-1531638564-project Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 9e268bd1c40d467db4bf4022b91fb099 Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1531638564-project Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: exception: Security group b9916db5-4af7-4748-be92-b38cccf21faf does not exist Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: Neutron server returns request_ids: ['req-2f20a695-b477-4aa4-8eb2-bc678cf19db8'] Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'b9916db5-4af7-4748-be92-b38cccf21faf'} Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 14:32:20.418083 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b9916db5-4af7-4748-be92-b38cccf21faf does not exist Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f20a695-b477-4aa4-8eb2-bc678cf19db8'] Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b9916db5-4af7-4748-be92-b38cccf21faf does not exist Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f20a695-b477-4aa4-8eb2-bc678cf19db8'] Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b9916db5-4af7-4748-be92-b38cccf21faf does not exist Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f20a695-b477-4aa4-8eb2-bc678cf19db8'] Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b9916db5-4af7-4748-be92-b38cccf21faf does not exist Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f20a695-b477-4aa4-8eb2-bc678cf19db8'] Jul 25 14:32:20.422940 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:32:20.426039 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3c249a63-f67e-43f6-a719-6abba5347070 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:20.429005 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7c50af22-b17e-403b-98b6-4fa44f3582e2 tempest-SecurityGroupsNegativeTestJSON-1531638564 tempest-SecurityGroupsNegativeTestJSON-1531638564-project] Returning 404 to user: Security group b9916db5-4af7-4748-be92-b38cccf21faf does not exist Jul 25 14:32:20.429005 n-d-846435-14 devstack@n-api.service[119303]: Neutron server returns request_ids: ['req-2f20a695-b477-4aa4-8eb2-bc678cf19db8'] {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:32:20.429907 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7c50af22-b17e-403b-98b6-4fa44f3582e2 tempest-SecurityGroupsNegativeTestJSON-1531638564 tempest-SecurityGroupsNegativeTestJSON-1531638564-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/b9916db5-4af7-4748-be92-b38cccf21faf" status: 404 len: 194 microversion: 2.1 time: 0.172660 Jul 25 14:32:20.430486 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 898/1857] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:32:20 2022] DELETE /compute/v2.1/os-security-groups/b9916db5-4af7-4748-be92-b38cccf21faf => generated 194 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:32:20.436653 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3c249a63-f67e-43f6-a719-6abba5347070 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1517 microversion: 2.1 time: 0.389757 Jul 25 14:32:20.436653 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 960/1858] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:20 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1517 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:20.444854 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5116a794-3ed6-4e54-beb3-19c6e834aec4 tempest-SecurityGroupsNegativeTestJSON-1531638564 tempest-SecurityGroupsNegativeTestJSON-1531638564-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.005552 Jul 25 14:32:20.449297 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 961/1859] 10.222.0.88 () {58 vars in 1164 bytes} [Mon Jul 25 14:32:20 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 14:32:20.457506 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-44f001e8-8d13-4169-9922-d104c662909f tempest-SecurityGroupsNegativeTestJSON-1531638564 tempest-SecurityGroupsNegativeTestJSON-1531638564-project] Calling method '.version_select at 0x7f46878f3d30>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:20.632936 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-440f0162-37fa-48c6-a532-b59d5018f1cc tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:20.634557 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-440f0162-37fa-48c6-a532-b59d5018f1cc tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 1a97e112-b45b-4dcb-ad9f-e979e5c183d9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:20.643585 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-440f0162-37fa-48c6-a532-b59d5018f1cc tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:20.644485 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-440f0162-37fa-48c6-a532-b59d5018f1cc tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:20.645525 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-440f0162-37fa-48c6-a532-b59d5018f1cc tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:20.646370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-440f0162-37fa-48c6-a532-b59d5018f1cc tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:20.754900 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-440f0162-37fa-48c6-a532-b59d5018f1cc tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:20.767189 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-440f0162-37fa-48c6-a532-b59d5018f1cc tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9" status: 200 len: 1274 microversion: 2.1 time: 0.139783 Jul 25 14:32:20.780085 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 962/1860] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:20 2022] GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9 => generated 1274 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:32:20.876868 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-44f001e8-8d13-4169-9922-d104c662909f tempest-SecurityGroupsNegativeTestJSON-1531638564 tempest-SecurityGroupsNegativeTestJSON-1531638564-project] 10.222.0.88 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.423709 Jul 25 14:32:20.877993 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 899/1861] 10.222.0.88 () {58 vars in 1158 bytes} [Mon Jul 25 14:32:20 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:32:20.893846 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d1aa5e4b-14be-4108-8668-b21ed3f16c55 tempest-SecurityGroupsNegativeTestJSON-1531638564 tempest-SecurityGroupsNegativeTestJSON-1531638564-project] Calling method '.version_select at 0x7f4698903430>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:21.070557 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6179edb7-58b5-485c-85b8-48d860c8267f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1935455030", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "9e0e98c7-e5b7-4308-ae4f-fa50e9a340ed"}], "security_groups": [{"name": "tempest-securitygroup--1360501043"}], "key_name": "tempest-keypair-1446891271", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:21.124812 n-d-846435-14 devstack@n-api.service[119304]: DEBUG neutronclient.v2_0.client [None req-d1aa5e4b-14be-4108-8668-b21ed3f16c55 tempest-SecurityGroupsNegativeTestJSON-1531638564 tempest-SecurityGroupsNegativeTestJSON-1531638564-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=119304) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 14:32:21.126632 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-d1aa5e4b-14be-4108-8668-b21ed3f16c55 tempest-SecurityGroupsNegativeTestJSON-1531638564 tempest-SecurityGroupsNegativeTestJSON-1531638564-project] HTTP exception thrown: Insufficient rights for removing default security group. Jul 25 14:32:21.126632 n-d-846435-14 devstack@n-api.service[119304]: Neutron server returns request_ids: ['req-8c888d4d-afdd-46b3-b1d0-bcd023dece3f'] Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d1aa5e4b-14be-4108-8668-b21ed3f16c55 tempest-SecurityGroupsNegativeTestJSON-1531638564 tempest-SecurityGroupsNegativeTestJSON-1531638564-project] Request method failure captured: Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/os-security-groups/2e97dbb4-1bfd-4190-a930-c016b7691877 HTTP/1.1 Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3ql0-M-LAp-ZFa7dnneLPV0eU1P54iE3A39pj0m9U_vRbtLFoIDJCJf5s7DqM14Ptm1dldClcvzwI3LVpZBGbopspkI4tvejH0VEdNmfBxWpjFXnhvjpRzW98fVCP3eRYTIXhCnRO6ZqW75cw9MdFmwnGE0DIBbou1LKKA1bjTHUbaU Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 27ef96b7a15f45249aa779ba227ced28 Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1531638564 Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27ef96b7a15f45249aa779ba227ced28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27ef96b7a15f45249aa779ba227ced28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27ef96b7a15f45249aa779ba227ced28", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27ef96b7a15f45249aa779ba227ced28"}]}] Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1531638564 Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 27ef96b7a15f45249aa779ba227ced28 Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1531638564 Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-SecurityGroupsNegativeTestJSON-1531638564-project Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 9e268bd1c40d467db4bf4022b91fb099 Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1531638564-project Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: exception: Insufficient rights for removing default security group. Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: Neutron server returns request_ids: ['req-8c888d4d-afdd-46b3-b1d0-bcd023dece3f'] Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '2e97dbb4-1bfd-4190-a930-c016b7691877'} Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 14:32:21.132477 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c888d4d-afdd-46b3-b1d0-bcd023dece3f'] Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c888d4d-afdd-46b3-b1d0-bcd023dece3f'] Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c888d4d-afdd-46b3-b1d0-bcd023dece3f'] Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c888d4d-afdd-46b3-b1d0-bcd023dece3f'] Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d1aa5e4b-14be-4108-8668-b21ed3f16c55 tempest-SecurityGroupsNegativeTestJSON-1531638564 tempest-SecurityGroupsNegativeTestJSON-1531638564-project] Returning 400 to user: Insufficient rights for removing default security group. Jul 25 14:32:21.138068 n-d-846435-14 devstack@n-api.service[119304]: Neutron server returns request_ids: ['req-8c888d4d-afdd-46b3-b1d0-bcd023dece3f'] {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:32:21.144907 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d1aa5e4b-14be-4108-8668-b21ed3f16c55 tempest-SecurityGroupsNegativeTestJSON-1531638564 tempest-SecurityGroupsNegativeTestJSON-1531638564-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/2e97dbb4-1bfd-4190-a930-c016b7691877" status: 400 len: 182 microversion: 2.1 time: 0.251988 Jul 25 14:32:21.150639 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 963/1862] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:32:20 2022] DELETE /compute/v2.1/os-security-groups/2e97dbb4-1bfd-4190-a930-c016b7691877 => generated 182 bytes in 263 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:32:21.168057 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c661dd3a-d527-4689-8617-7414e1149a03 tempest-SecurityGroupsNegativeTestJSON-1531638564 tempest-SecurityGroupsNegativeTestJSON-1531638564-project] Calling method '.version_select at 0x7f46989dd940>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:21.279680 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-6179edb7-58b5-485c-85b8-48d860c8267f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] validate_networks() for [('9e0e98c7-e5b7-4308-ae4f-fa50e9a340ed', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:32:21.608940 n-d-846435-14 devstack@n-api.service[119304]: DEBUG neutronclient.v2_0.client [None req-c661dd3a-d527-4689-8617-7414e1149a03 tempest-SecurityGroupsNegativeTestJSON-1531638564 tempest-SecurityGroupsNegativeTestJSON-1531638564-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 61b76ce1-d045-49c1-98bf-1885a39f02c6 does not exist", "detail": ""}} {{(pid=119304) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 14:32:21.609985 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.security_group_api [None req-c661dd3a-d527-4689-8617-7414e1149a03 tempest-SecurityGroupsNegativeTestJSON-1531638564 tempest-SecurityGroupsNegativeTestJSON-1531638564-project] Neutron security group 61b76ce1-d045-49c1-98bf-1885a39f02c6 not found {{(pid=119304) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 14:32:21.611629 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-c661dd3a-d527-4689-8617-7414e1149a03 tempest-SecurityGroupsNegativeTestJSON-1531638564 tempest-SecurityGroupsNegativeTestJSON-1531638564-project] HTTP exception thrown: Security group 61b76ce1-d045-49c1-98bf-1885a39f02c6 does not exist Jul 25 14:32:21.611629 n-d-846435-14 devstack@n-api.service[119304]: Neutron server returns request_ids: ['req-54f7ad6a-bf5b-4f83-8ebe-5455c03f88c1'] Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c661dd3a-d527-4689-8617-7414e1149a03 tempest-SecurityGroupsNegativeTestJSON-1531638564 tempest-SecurityGroupsNegativeTestJSON-1531638564-project] Request method failure captured: Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/os-security-groups/61b76ce1-d045-49c1-98bf-1885a39f02c6 HTTP/1.1 Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3ql0-M-LAp-ZFa7dnneLPV0eU1P54iE3A39pj0m9U_vRbtLFoIDJCJf5s7DqM14Ptm1dldClcvzwI3LVpZBGbopspkI4tvejH0VEdNmfBxWpjFXnhvjpRzW98fVCP3eRYTIXhCnRO6ZqW75cw9MdFmwnGE0DIBbou1LKKA1bjTHUbaU Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 27ef96b7a15f45249aa779ba227ced28 Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1531638564 Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27ef96b7a15f45249aa779ba227ced28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27ef96b7a15f45249aa779ba227ced28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27ef96b7a15f45249aa779ba227ced28", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27ef96b7a15f45249aa779ba227ced28"}]}] Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1531638564 Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 27ef96b7a15f45249aa779ba227ced28 Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1531638564 Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-SecurityGroupsNegativeTestJSON-1531638564-project Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 9e268bd1c40d467db4bf4022b91fb099 Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1531638564-project Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: exception: Security group 61b76ce1-d045-49c1-98bf-1885a39f02c6 does not exist Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: Neutron server returns request_ids: ['req-54f7ad6a-bf5b-4f83-8ebe-5455c03f88c1'] Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '61b76ce1-d045-49c1-98bf-1885a39f02c6'} Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 14:32:21.614830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 61b76ce1-d045-49c1-98bf-1885a39f02c6 does not exist Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-54f7ad6a-bf5b-4f83-8ebe-5455c03f88c1'] Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 61b76ce1-d045-49c1-98bf-1885a39f02c6 does not exist Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-54f7ad6a-bf5b-4f83-8ebe-5455c03f88c1'] Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 61b76ce1-d045-49c1-98bf-1885a39f02c6 does not exist Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-54f7ad6a-bf5b-4f83-8ebe-5455c03f88c1'] Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 61b76ce1-d045-49c1-98bf-1885a39f02c6 does not exist Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-54f7ad6a-bf5b-4f83-8ebe-5455c03f88c1'] Jul 25 14:32:21.620833 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:32:21.628605 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c661dd3a-d527-4689-8617-7414e1149a03 tempest-SecurityGroupsNegativeTestJSON-1531638564 tempest-SecurityGroupsNegativeTestJSON-1531638564-project] Returning 404 to user: Security group 61b76ce1-d045-49c1-98bf-1885a39f02c6 does not exist Jul 25 14:32:21.628605 n-d-846435-14 devstack@n-api.service[119304]: Neutron server returns request_ids: ['req-54f7ad6a-bf5b-4f83-8ebe-5455c03f88c1'] {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:32:21.630681 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c661dd3a-d527-4689-8617-7414e1149a03 tempest-SecurityGroupsNegativeTestJSON-1531638564 tempest-SecurityGroupsNegativeTestJSON-1531638564-project] 10.222.0.88 "GET /compute/v2.1/os-security-groups/61b76ce1-d045-49c1-98bf-1885a39f02c6" status: 404 len: 194 microversion: 2.1 time: 0.475587 Jul 25 14:32:21.633820 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 964/1863] 10.222.0.88 () {58 vars in 1269 bytes} [Mon Jul 25 14:32:21 2022] GET /compute/v2.1/os-security-groups/61b76ce1-d045-49c1-98bf-1885a39f02c6 => generated 194 bytes in 483 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:32:21.643928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-73999b64-3f20-4022-ac9e-0e406b5bd120 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:21.648932 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-73999b64-3f20-4022-ac9e-0e406b5bd120 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:21.664508 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-73999b64-3f20-4022-ac9e-0e406b5bd120 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:21.665928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-73999b64-3f20-4022-ac9e-0e406b5bd120 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:21.668451 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-73999b64-3f20-4022-ac9e-0e406b5bd120 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:21.668910 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-73999b64-3f20-4022-ac9e-0e406b5bd120 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:21.977816 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-6179edb7-58b5-485c-85b8-48d860c8267f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:32:21.978740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-6179edb7-58b5-485c-85b8-48d860c8267f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:32:21.979416 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-6179edb7-58b5-485c-85b8-48d860c8267f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:32:21.980548 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-6179edb7-58b5-485c-85b8-48d860c8267f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:32:21.981186 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-6179edb7-58b5-485c-85b8-48d860c8267f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:32:22.002543 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6179edb7-58b5-485c-85b8-48d860c8267f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:22.003004 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6179edb7-58b5-485c-85b8-48d860c8267f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:22.003910 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6179edb7-58b5-485c-85b8-48d860c8267f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:22.004384 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6179edb7-58b5-485c-85b8-48d860c8267f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:22.052630 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-73999b64-3f20-4022-ac9e-0e406b5bd120 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:22.054659 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-6179edb7-58b5-485c-85b8-48d860c8267f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Getting quotas for project ceaa4430d1864bc2bf9afdec9cd0cf64. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:32:22.065642 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-73999b64-3f20-4022-ac9e-0e406b5bd120 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1517 microversion: 2.1 time: 0.430080 Jul 25 14:32:22.066400 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 965/1864] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:21 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1517 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:22.071414 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9a5771ad-7b58-4bc0-939e-bad0d2e873be tempest-SecurityGroupsNegativeTestJSON-1531638564 tempest-SecurityGroupsNegativeTestJSON-1531638564-project] Action: 'update', calling method: .version_select at 0x7f4698964160>, body: {"security_group": {"name": "tempest-sg-891446275", "description": "tempest-description-176227819"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:22.072753 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-6179edb7-58b5-485c-85b8-48d860c8267f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Getting quotas for user 3da7c9a3c01f4dbca93d5e7aa688fc70 and project ceaa4430d1864bc2bf9afdec9cd0cf64. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:32:22.090225 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6179edb7-58b5-485c-85b8-48d860c8267f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:32:22.092805 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6179edb7-58b5-485c-85b8-48d860c8267f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:32:22.120248 n-d-846435-14 devstack@n-api.service[119304]: DEBUG neutronclient.v2_0.client [None req-9a5771ad-7b58-4bc0-939e-bad0d2e873be tempest-SecurityGroupsNegativeTestJSON-1531638564 tempest-SecurityGroupsNegativeTestJSON-1531638564-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d47e6c6a-312b-4d2d-93e9-1305094b2125 does not exist", "detail": ""}} {{(pid=119304) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 14:32:22.121175 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.security_group_api [None req-9a5771ad-7b58-4bc0-939e-bad0d2e873be tempest-SecurityGroupsNegativeTestJSON-1531638564 tempest-SecurityGroupsNegativeTestJSON-1531638564-project] Neutron security group d47e6c6a-312b-4d2d-93e9-1305094b2125 not found {{(pid=119304) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 14:32:22.122077 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-9a5771ad-7b58-4bc0-939e-bad0d2e873be tempest-SecurityGroupsNegativeTestJSON-1531638564 tempest-SecurityGroupsNegativeTestJSON-1531638564-project] HTTP exception thrown: Security group d47e6c6a-312b-4d2d-93e9-1305094b2125 does not exist Jul 25 14:32:22.122077 n-d-846435-14 devstack@n-api.service[119304]: Neutron server returns request_ids: ['req-bca785bb-0374-4839-a774-35eb0110d0be'] Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9a5771ad-7b58-4bc0-939e-bad0d2e873be tempest-SecurityGroupsNegativeTestJSON-1531638564 tempest-SecurityGroupsNegativeTestJSON-1531638564-project] Request method failure captured: Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: request: PUT /compute/v2.1/os-security-groups/d47e6c6a-312b-4d2d-93e9-1305094b2125 HTTP/1.1 Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 100 Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3ql0-M-LAp-ZFa7dnneLPV0eU1P54iE3A39pj0m9U_vRbtLFoIDJCJf5s7DqM14Ptm1dldClcvzwI3LVpZBGbopspkI4tvejH0VEdNmfBxWpjFXnhvjpRzW98fVCP3eRYTIXhCnRO6ZqW75cw9MdFmwnGE0DIBbou1LKKA1bjTHUbaU Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 27ef96b7a15f45249aa779ba227ced28 Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1531638564 Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27ef96b7a15f45249aa779ba227ced28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27ef96b7a15f45249aa779ba227ced28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27ef96b7a15f45249aa779ba227ced28", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27ef96b7a15f45249aa779ba227ced28"}]}] Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1531638564 Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 27ef96b7a15f45249aa779ba227ced28 Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1531638564 Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-SecurityGroupsNegativeTestJSON-1531638564-project Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 9e268bd1c40d467db4bf4022b91fb099 Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1531638564-project Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: {"security_group": {"name": "tempest-sg-891446275", "description": "tempest-description-176227819"}} Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: exception: Security group d47e6c6a-312b-4d2d-93e9-1305094b2125 does not exist Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: Neutron server returns request_ids: ['req-bca785bb-0374-4839-a774-35eb0110d0be'] Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'd47e6c6a-312b-4d2d-93e9-1305094b2125', 'body': {'security_group': {'name': 'tempest-sg-891446275', 'description': 'tempest-description-176227819'}}} Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 14:32:22.124367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d47e6c6a-312b-4d2d-93e9-1305094b2125 does not exist Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bca785bb-0374-4839-a774-35eb0110d0be'] Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d47e6c6a-312b-4d2d-93e9-1305094b2125 does not exist Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bca785bb-0374-4839-a774-35eb0110d0be'] Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d47e6c6a-312b-4d2d-93e9-1305094b2125 does not exist Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bca785bb-0374-4839-a774-35eb0110d0be'] Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d47e6c6a-312b-4d2d-93e9-1305094b2125 does not exist Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bca785bb-0374-4839-a774-35eb0110d0be'] Jul 25 14:32:22.129161 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:32:22.133883 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9a5771ad-7b58-4bc0-939e-bad0d2e873be tempest-SecurityGroupsNegativeTestJSON-1531638564 tempest-SecurityGroupsNegativeTestJSON-1531638564-project] Returning 404 to user: Security group d47e6c6a-312b-4d2d-93e9-1305094b2125 does not exist Jul 25 14:32:22.133883 n-d-846435-14 devstack@n-api.service[119304]: Neutron server returns request_ids: ['req-bca785bb-0374-4839-a774-35eb0110d0be'] {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:32:22.135170 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9a5771ad-7b58-4bc0-939e-bad0d2e873be tempest-SecurityGroupsNegativeTestJSON-1531638564 tempest-SecurityGroupsNegativeTestJSON-1531638564-project] 10.222.0.88 "PUT /compute/v2.1/os-security-groups/d47e6c6a-312b-4d2d-93e9-1305094b2125" status: 404 len: 194 microversion: 2.1 time: 0.067735 Jul 25 14:32:22.136129 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 966/1865] 10.222.0.88 () {60 vars in 1290 bytes} [Mon Jul 25 14:32:22 2022] PUT /compute/v2.1/os-security-groups/d47e6c6a-312b-4d2d-93e9-1305094b2125 => generated 194 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:32:22.141078 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-52900409-3f58-4437-a0e2-a06939cd37e5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:22.148566 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-52900409-3f58-4437-a0e2-a06939cd37e5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 1a97e112-b45b-4dcb-ad9f-e979e5c183d9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:22.167149 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52900409-3f58-4437-a0e2-a06939cd37e5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:22.170435 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52900409-3f58-4437-a0e2-a06939cd37e5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:22.171632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52900409-3f58-4437-a0e2-a06939cd37e5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:22.173208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52900409-3f58-4437-a0e2-a06939cd37e5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:22.198961 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6179edb7-58b5-485c-85b8-48d860c8267f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.135488 Jul 25 14:32:22.201081 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 900/1866] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:32:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 1139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 14:32:22.215116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dfce3308-7ab2-4861-8659-2c63e7663a2e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:22.216148 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-dfce3308-7ab2-4861-8659-2c63e7663a2e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:22.372755 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-dfce3308-7ab2-4861-8659-2c63e7663a2e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:22.385094 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dfce3308-7ab2-4861-8659-2c63e7663a2e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1235 microversion: 2.1 time: 0.176390 Jul 25 14:32:22.403894 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 901/1867] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:22 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1235 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:32:22.768744 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-52900409-3f58-4437-a0e2-a06939cd37e5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:22.788637 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-52900409-3f58-4437-a0e2-a06939cd37e5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9" status: 200 len: 1316 microversion: 2.1 time: 0.651140 Jul 25 14:32:22.789248 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 967/1868] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:22 2022] GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9 => generated 1316 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:23.090881 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1abcffa7-587f-4b38-abb5-6dc5ec6d6249 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:23.093442 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1abcffa7-587f-4b38-abb5-6dc5ec6d6249 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:23.105799 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1abcffa7-587f-4b38-abb5-6dc5ec6d6249 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:23.108576 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1abcffa7-587f-4b38-abb5-6dc5ec6d6249 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:23.110347 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1abcffa7-587f-4b38-abb5-6dc5ec6d6249 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:23.111537 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1abcffa7-587f-4b38-abb5-6dc5ec6d6249 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:23.405584 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-48fff8f1-4139-44b7-8f7c-a174860e80e8 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:23.406207 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-48fff8f1-4139-44b7-8f7c-a174860e80e8 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:23.425814 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48fff8f1-4139-44b7-8f7c-a174860e80e8 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:23.429682 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48fff8f1-4139-44b7-8f7c-a174860e80e8 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:23.435031 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48fff8f1-4139-44b7-8f7c-a174860e80e8 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:23.438595 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48fff8f1-4139-44b7-8f7c-a174860e80e8 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:23.615592 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1abcffa7-587f-4b38-abb5-6dc5ec6d6249 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:23.628787 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1abcffa7-587f-4b38-abb5-6dc5ec6d6249 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1517 microversion: 2.1 time: 0.544441 Jul 25 14:32:23.643296 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 902/1869] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:23 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1517 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:23.681658 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-48fff8f1-4139-44b7-8f7c-a174860e80e8 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:23.697641 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-48fff8f1-4139-44b7-8f7c-a174860e80e8 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1231 microversion: 2.1 time: 0.293318 Jul 25 14:32:23.698860 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 968/1870] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:23 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1231 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:32:23.740572 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-161bf72f-b156-4d4e-b3b0-81ce76e7f10c req-f080338d-4a6e-44c4-be45-2c8866ab5e5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a97e112-b45b-4dcb-ad9f-e979e5c183d9", "tag": "cab2f4ca-b8c8-4ec9-ae12-c233d24b429f"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:23.765624 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-161bf72f-b156-4d4e-b3b0-81ce76e7f10c req-f080338d-4a6e-44c4-be45-2c8866ab5e5a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:23.766310 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-161bf72f-b156-4d4e-b3b0-81ce76e7f10c req-f080338d-4a6e-44c4-be45-2c8866ab5e5a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:23.779545 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-161bf72f-b156-4d4e-b3b0-81ce76e7f10c req-f080338d-4a6e-44c4-be45-2c8866ab5e5a service nova] Creating event network-changed:cab2f4ca-b8c8-4ec9-ae12-c233d24b429f for instance 1a97e112-b45b-4dcb-ad9f-e979e5c183d9 on n-h2-846435-14 Jul 25 14:32:23.786177 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-161bf72f-b156-4d4e-b3b0-81ce76e7f10c req-f080338d-4a6e-44c4-be45-2c8866ab5e5a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052909 Jul 25 14:32:23.787679 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 903/1871] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:32:23.810808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fdedcfbd-4d6f-419e-90b4-31f2ec46d8c2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:23.813605 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fdedcfbd-4d6f-419e-90b4-31f2ec46d8c2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 1a97e112-b45b-4dcb-ad9f-e979e5c183d9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:23.823313 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fdedcfbd-4d6f-419e-90b4-31f2ec46d8c2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:23.824104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fdedcfbd-4d6f-419e-90b4-31f2ec46d8c2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:23.835055 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fdedcfbd-4d6f-419e-90b4-31f2ec46d8c2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:23.838104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fdedcfbd-4d6f-419e-90b4-31f2ec46d8c2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:24.643458 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fdedcfbd-4d6f-419e-90b4-31f2ec46d8c2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:24.654611 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0799743b-435e-4177-898c-6d63d42b1821 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:24.655404 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0799743b-435e-4177-898c-6d63d42b1821 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:24.668402 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fdedcfbd-4d6f-419e-90b4-31f2ec46d8c2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9" status: 200 len: 1316 microversion: 2.1 time: 0.859298 Jul 25 14:32:24.668870 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0799743b-435e-4177-898c-6d63d42b1821 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:24.669549 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 969/1872] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:23 2022] GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9 => generated 1316 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:24.669761 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0799743b-435e-4177-898c-6d63d42b1821 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:24.670817 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0799743b-435e-4177-898c-6d63d42b1821 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:24.671575 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0799743b-435e-4177-898c-6d63d42b1821 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:24.723707 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-72bfbcc9-b27a-4e44-9b0a-d8b06dfd3b0b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:24.724351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-72bfbcc9-b27a-4e44-9b0a-d8b06dfd3b0b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:24.741821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72bfbcc9-b27a-4e44-9b0a-d8b06dfd3b0b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:24.742301 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72bfbcc9-b27a-4e44-9b0a-d8b06dfd3b0b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:24.743102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72bfbcc9-b27a-4e44-9b0a-d8b06dfd3b0b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:24.743528 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72bfbcc9-b27a-4e44-9b0a-d8b06dfd3b0b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:24.868695 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-72bfbcc9-b27a-4e44-9b0a-d8b06dfd3b0b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:24.879544 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-72bfbcc9-b27a-4e44-9b0a-d8b06dfd3b0b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1293 microversion: 2.1 time: 0.160947 Jul 25 14:32:24.880894 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 970/1873] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:24 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1293 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:25.081034 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0799743b-435e-4177-898c-6d63d42b1821 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:25.099161 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0799743b-435e-4177-898c-6d63d42b1821 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1517 microversion: 2.1 time: 0.453489 Jul 25 14:32:25.101576 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 904/1874] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:24 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1517 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:25.391340 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b18a81e8-981f-41c6-8566-a5126b0834d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1517740472", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "89585d8f-fb83-418b-9add-e96b30bdd24c"}], "block_device_mapping_v2": [{"uuid": "17907ba5-b76d-4f66-ab5d-165f1bfb772b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:25.466628 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-b18a81e8-981f-41c6-8566-a5126b0834d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] validate_networks() for [('89585d8f-fb83-418b-9add-e96b30bdd24c', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:32:25.690912 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-37373c2c-f27a-4ef8-90e1-c8777b753a7d tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:25.692161 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-37373c2c-f27a-4ef8-90e1-c8777b753a7d tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 1a97e112-b45b-4dcb-ad9f-e979e5c183d9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:25.699061 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37373c2c-f27a-4ef8-90e1-c8777b753a7d tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:25.699802 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37373c2c-f27a-4ef8-90e1-c8777b753a7d tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:25.700617 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37373c2c-f27a-4ef8-90e1-c8777b753a7d tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:25.701213 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37373c2c-f27a-4ef8-90e1-c8777b753a7d tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:25.971547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-b18a81e8-981f-41c6-8566-a5126b0834d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:32:25.972113 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-b18a81e8-981f-41c6-8566-a5126b0834d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:32:25.972451 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-b18a81e8-981f-41c6-8566-a5126b0834d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:32:25.972857 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-b18a81e8-981f-41c6-8566-a5126b0834d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:32:25.973263 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-b18a81e8-981f-41c6-8566-a5126b0834d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:32:25.978059 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-37373c2c-f27a-4ef8-90e1-c8777b753a7d tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:25.983653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b18a81e8-981f-41c6-8566-a5126b0834d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:25.985196 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b18a81e8-981f-41c6-8566-a5126b0834d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:25.986617 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b18a81e8-981f-41c6-8566-a5126b0834d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:25.987075 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b18a81e8-981f-41c6-8566-a5126b0834d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:25.988306 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-37373c2c-f27a-4ef8-90e1-c8777b753a7d tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9" status: 200 len: 1316 microversion: 2.1 time: 0.301291 Jul 25 14:32:25.988999 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 905/1875] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:25 2022] GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9 => generated 1316 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:26.005782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-b18a81e8-981f-41c6-8566-a5126b0834d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Getting quotas for project fb2b9ba0bede403bafb665d5e0818dfb. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:32:26.006877 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fe19786f-39d6-4cf0-8c89-2532c2028316 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:26.007600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fe19786f-39d6-4cf0-8c89-2532c2028316 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:26.011149 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-b18a81e8-981f-41c6-8566-a5126b0834d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Getting quotas for user 94b57069a56c4fedb1d4546c1d0415c7 and project fb2b9ba0bede403bafb665d5e0818dfb. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:32:26.014311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fe19786f-39d6-4cf0-8c89-2532c2028316 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:26.014874 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fe19786f-39d6-4cf0-8c89-2532c2028316 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:26.015751 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fe19786f-39d6-4cf0-8c89-2532c2028316 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:26.016386 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fe19786f-39d6-4cf0-8c89-2532c2028316 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:26.074756 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b18a81e8-981f-41c6-8566-a5126b0834d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:32:26.076938 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b18a81e8-981f-41c6-8566-a5126b0834d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='17907ba5-b76d-4f66-ab5d-165f1bfb772b',volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:32:26.214240 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b18a81e8-981f-41c6-8566-a5126b0834d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.827070 Jul 25 14:32:26.215455 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 971/1876] 10.222.0.88 () {62 vars in 1188 bytes} [Mon Jul 25 14:32:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 14:32:26.220391 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e6aa5fec-9742-46fb-a917-3d1ebd0c12df tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:26.221538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e6aa5fec-9742-46fb-a917-3d1ebd0c12df tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:26.228549 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6aa5fec-9742-46fb-a917-3d1ebd0c12df tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:26.229177 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6aa5fec-9742-46fb-a917-3d1ebd0c12df tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:26.230339 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6aa5fec-9742-46fb-a917-3d1ebd0c12df tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:26.230963 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6aa5fec-9742-46fb-a917-3d1ebd0c12df tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:26.338180 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fe19786f-39d6-4cf0-8c89-2532c2028316 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:26.346752 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fe19786f-39d6-4cf0-8c89-2532c2028316 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1361 microversion: 2.1 time: 0.345306 Jul 25 14:32:26.366106 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 906/1877] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:26 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1361 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:26.372496 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1e4a19c4-7f97-487c-a0b9-ee733266f9d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:26.373450 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1e4a19c4-7f97-487c-a0b9-ee733266f9d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:26.439328 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1e4a19c4-7f97-487c-a0b9-ee733266f9d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:26.452416 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1e4a19c4-7f97-487c-a0b9-ee733266f9d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:26.457252 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1e4a19c4-7f97-487c-a0b9-ee733266f9d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:26.461321 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1e4a19c4-7f97-487c-a0b9-ee733266f9d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1104 microversion: 2.25 time: 0.094068 Jul 25 14:32:26.461899 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 907/1878] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:32:26 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1104 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:32:26.589952 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e6aa5fec-9742-46fb-a917-3d1ebd0c12df tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:26.600654 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e6aa5fec-9742-46fb-a917-3d1ebd0c12df tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1517 microversion: 2.1 time: 0.383616 Jul 25 14:32:26.602188 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 972/1879] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:26 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1517 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:27.014641 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-737410b6-8173-4e6f-a2c2-4671977f34f0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:27.016095 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-737410b6-8173-4e6f-a2c2-4671977f34f0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 1a97e112-b45b-4dcb-ad9f-e979e5c183d9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:27.025723 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-737410b6-8173-4e6f-a2c2-4671977f34f0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:27.026590 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-737410b6-8173-4e6f-a2c2-4671977f34f0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:27.027605 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-737410b6-8173-4e6f-a2c2-4671977f34f0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:27.029098 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-737410b6-8173-4e6f-a2c2-4671977f34f0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:27.189671 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-737410b6-8173-4e6f-a2c2-4671977f34f0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:27.197604 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-737410b6-8173-4e6f-a2c2-4671977f34f0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9" status: 200 len: 1316 microversion: 2.1 time: 0.187893 Jul 25 14:32:27.198196 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 908/1880] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:27 2022] GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9 => generated 1316 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:27.367129 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-35891240-be9e-44f8-8137-4e973d63c68c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:27.367868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-35891240-be9e-44f8-8137-4e973d63c68c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:27.376162 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35891240-be9e-44f8-8137-4e973d63c68c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:27.376664 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35891240-be9e-44f8-8137-4e973d63c68c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:27.377689 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35891240-be9e-44f8-8137-4e973d63c68c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:27.379153 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35891240-be9e-44f8-8137-4e973d63c68c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:27.489467 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bb7a1c9c-d306-430e-8dd0-f6865ded97f2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:27.491696 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bb7a1c9c-d306-430e-8dd0-f6865ded97f2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:27.499266 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bb7a1c9c-d306-430e-8dd0-f6865ded97f2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:27.499997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bb7a1c9c-d306-430e-8dd0-f6865ded97f2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:27.501242 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bb7a1c9c-d306-430e-8dd0-f6865ded97f2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:27.519152 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bb7a1c9c-d306-430e-8dd0-f6865ded97f2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:27.585523 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-35891240-be9e-44f8-8137-4e973d63c68c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:27.598195 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-35891240-be9e-44f8-8137-4e973d63c68c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1361 microversion: 2.1 time: 0.235089 Jul 25 14:32:27.599713 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 973/1881] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:27 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1361 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:27.628440 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9f0e4f79-e4f0-464d-8950-9ba79ca11ae4 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:27.629576 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9f0e4f79-e4f0-464d-8950-9ba79ca11ae4 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:27.638413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f0e4f79-e4f0-464d-8950-9ba79ca11ae4 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:27.639347 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f0e4f79-e4f0-464d-8950-9ba79ca11ae4 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:27.644692 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f0e4f79-e4f0-464d-8950-9ba79ca11ae4 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:27.645147 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f0e4f79-e4f0-464d-8950-9ba79ca11ae4 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:27.676527 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bb7a1c9c-d306-430e-8dd0-f6865ded97f2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:27.690920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bb7a1c9c-d306-430e-8dd0-f6865ded97f2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:27.692964 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bb7a1c9c-d306-430e-8dd0-f6865ded97f2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:27.694345 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bb7a1c9c-d306-430e-8dd0-f6865ded97f2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1233 microversion: 2.25 time: 0.213021 Jul 25 14:32:27.696470 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 909/1882] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:32:27 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1233 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:32:27.951314 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9f0e4f79-e4f0-464d-8950-9ba79ca11ae4 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:27.964761 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9f0e4f79-e4f0-464d-8950-9ba79ca11ae4 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1517 microversion: 2.1 time: 0.346576 Jul 25 14:32:27.980077 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 974/1883] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:27 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1517 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:32:28.229341 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2c6f54d2-4123-4da8-984b-b10925d21399 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:28.231066 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2c6f54d2-4123-4da8-984b-b10925d21399 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 1a97e112-b45b-4dcb-ad9f-e979e5c183d9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:28.247018 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c6f54d2-4123-4da8-984b-b10925d21399 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:28.247615 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c6f54d2-4123-4da8-984b-b10925d21399 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:28.248403 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c6f54d2-4123-4da8-984b-b10925d21399 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:28.260735 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c6f54d2-4123-4da8-984b-b10925d21399 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:28.624714 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-704a4dd2-f8a1-4622-8b7f-5a903e0559e0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:28.625922 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-704a4dd2-f8a1-4622-8b7f-5a903e0559e0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:28.635518 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-704a4dd2-f8a1-4622-8b7f-5a903e0559e0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:28.636324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-704a4dd2-f8a1-4622-8b7f-5a903e0559e0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:28.637986 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-704a4dd2-f8a1-4622-8b7f-5a903e0559e0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:28.638652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-704a4dd2-f8a1-4622-8b7f-5a903e0559e0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:28.642378 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:32:28.880825 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-704a4dd2-f8a1-4622-8b7f-5a903e0559e0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:28.910688 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-704a4dd2-f8a1-4622-8b7f-5a903e0559e0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1361 microversion: 2.1 time: 0.290531 Jul 25 14:32:28.914075 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 975/1884] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:28 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1361 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:32:28.920068 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-afae898b-e591-46bb-bcbf-855cc054611d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:28.927194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-afae898b-e591-46bb-bcbf-855cc054611d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:28.931717 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2c6f54d2-4123-4da8-984b-b10925d21399 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:28.937695 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-afae898b-e591-46bb-bcbf-855cc054611d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:28.938160 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-afae898b-e591-46bb-bcbf-855cc054611d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:28.940005 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-afae898b-e591-46bb-bcbf-855cc054611d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:28.940698 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-afae898b-e591-46bb-bcbf-855cc054611d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:28.945620 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2c6f54d2-4123-4da8-984b-b10925d21399 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9" status: 200 len: 1316 microversion: 2.1 time: 0.730366 Jul 25 14:32:28.946558 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 910/1885] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:28 2022] GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9 => generated 1316 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:28.989109 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-90d74f9d-fe5d-4917-b6cb-4408238086e4 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:28.989738 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-90d74f9d-fe5d-4917-b6cb-4408238086e4 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:29.004982 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-90d74f9d-fe5d-4917-b6cb-4408238086e4 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:29.005335 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-90d74f9d-fe5d-4917-b6cb-4408238086e4 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:29.006111 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-90d74f9d-fe5d-4917-b6cb-4408238086e4 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:29.006564 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-90d74f9d-fe5d-4917-b6cb-4408238086e4 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:29.109357 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-afae898b-e591-46bb-bcbf-855cc054611d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:29.121312 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-afae898b-e591-46bb-bcbf-855cc054611d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:29.122741 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-afae898b-e591-46bb-bcbf-855cc054611d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:29.124246 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-afae898b-e591-46bb-bcbf-855cc054611d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1251 microversion: 2.25 time: 0.209098 Jul 25 14:32:29.125156 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 976/1886] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:32:28 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1251 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:32:29.366567 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-7ab78018-bddf-40b9-8914-2d3318277ad3 req-baee6d72-0d69-414a-bbd5-ef51b3c6078c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a85a57f0-715f-47cd-ae19-463dfc5e7aca", "tag": "b6bbf444-a731-43c2-bb7a-c5a47d378689"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:29.389483 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-7ab78018-bddf-40b9-8914-2d3318277ad3 req-baee6d72-0d69-414a-bbd5-ef51b3c6078c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:29.390095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-7ab78018-bddf-40b9-8914-2d3318277ad3 req-baee6d72-0d69-414a-bbd5-ef51b3c6078c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:29.403151 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-7ab78018-bddf-40b9-8914-2d3318277ad3 req-baee6d72-0d69-414a-bbd5-ef51b3c6078c service nova] Creating event network-changed:b6bbf444-a731-43c2-bb7a-c5a47d378689 for instance a85a57f0-715f-47cd-ae19-463dfc5e7aca on n-h2-846435-14 Jul 25 14:32:29.409426 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-7ab78018-bddf-40b9-8914-2d3318277ad3 req-baee6d72-0d69-414a-bbd5-ef51b3c6078c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049373 Jul 25 14:32:29.410701 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 977/1887] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:32:29.564408 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-90d74f9d-fe5d-4917-b6cb-4408238086e4 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:29.575178 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-90d74f9d-fe5d-4917-b6cb-4408238086e4 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1517 microversion: 2.1 time: 0.589975 Jul 25 14:32:29.577508 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 911/1888] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:28 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1517 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:32:29.934499 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7c7208d1-0a44-4f21-bac0-eeff33c28b4e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:29.935205 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7c7208d1-0a44-4f21-bac0-eeff33c28b4e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:29.956605 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7c7208d1-0a44-4f21-bac0-eeff33c28b4e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:29.957163 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7c7208d1-0a44-4f21-bac0-eeff33c28b4e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:29.958158 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7c7208d1-0a44-4f21-bac0-eeff33c28b4e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:29.958786 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7c7208d1-0a44-4f21-bac0-eeff33c28b4e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:29.969534 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-848136f4-230f-4524-a675-8d34a3d9e8d7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:29.970240 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-848136f4-230f-4524-a675-8d34a3d9e8d7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 1a97e112-b45b-4dcb-ad9f-e979e5c183d9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:29.979097 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-848136f4-230f-4524-a675-8d34a3d9e8d7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:29.984556 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-848136f4-230f-4524-a675-8d34a3d9e8d7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:29.985543 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-848136f4-230f-4524-a675-8d34a3d9e8d7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:29.986442 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-848136f4-230f-4524-a675-8d34a3d9e8d7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:30.265369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7c7208d1-0a44-4f21-bac0-eeff33c28b4e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:30.277977 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7c7208d1-0a44-4f21-bac0-eeff33c28b4e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1361 microversion: 2.1 time: 0.348669 Jul 25 14:32:30.279066 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 978/1889] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:29 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1361 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:30.292390 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-59a42b89-3d2b-4e41-a2a8-24b1322593c1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:30.293266 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-59a42b89-3d2b-4e41-a2a8-24b1322593c1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:30.308972 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59a42b89-3d2b-4e41-a2a8-24b1322593c1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:30.309424 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59a42b89-3d2b-4e41-a2a8-24b1322593c1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:30.310204 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59a42b89-3d2b-4e41-a2a8-24b1322593c1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:30.310635 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59a42b89-3d2b-4e41-a2a8-24b1322593c1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:30.534108 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-848136f4-230f-4524-a675-8d34a3d9e8d7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:30.541455 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-59a42b89-3d2b-4e41-a2a8-24b1322593c1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:30.547864 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-848136f4-230f-4524-a675-8d34a3d9e8d7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9" status: 200 len: 1316 microversion: 2.1 time: 0.579592 Jul 25 14:32:30.549301 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 912/1890] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:29 2022] GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9 => generated 1316 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:30.554396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-59a42b89-3d2b-4e41-a2a8-24b1322593c1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:30.555908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-59a42b89-3d2b-4e41-a2a8-24b1322593c1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:30.557111 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-59a42b89-3d2b-4e41-a2a8-24b1322593c1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1293 microversion: 2.25 time: 0.276929 Jul 25 14:32:30.575485 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 979/1891] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:32:30 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1293 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:32:30.597634 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0689973a-8a52-4068-91f9-57078f4879b1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:30.598248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0689973a-8a52-4068-91f9-57078f4879b1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:30.609511 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0689973a-8a52-4068-91f9-57078f4879b1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:30.609971 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0689973a-8a52-4068-91f9-57078f4879b1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:30.612714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0689973a-8a52-4068-91f9-57078f4879b1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:30.612714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0689973a-8a52-4068-91f9-57078f4879b1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:30.919128 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0689973a-8a52-4068-91f9-57078f4879b1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:30.930696 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0689973a-8a52-4068-91f9-57078f4879b1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1517 microversion: 2.1 time: 0.337311 Jul 25 14:32:30.931304 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 913/1892] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:30 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1517 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:31.300845 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-27381d89-51dd-47b8-820e-024c6775b17a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:31.301507 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-27381d89-51dd-47b8-820e-024c6775b17a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:31.313765 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-27381d89-51dd-47b8-820e-024c6775b17a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:31.314237 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-27381d89-51dd-47b8-820e-024c6775b17a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:31.315071 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-27381d89-51dd-47b8-820e-024c6775b17a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:31.315508 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-27381d89-51dd-47b8-820e-024c6775b17a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:31.536899 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-52b669c2-5483-424d-a039-c7c27b43a6cb req-45a97e95-b096-4614-9e8e-d43ae18ef13c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "324085c2-5228-46ba-8b72-5ee6f112b1d2", "tag": "de9facd1-8929-497d-9f75-3802fcffc1d0"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:31.561008 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-52b669c2-5483-424d-a039-c7c27b43a6cb req-45a97e95-b096-4614-9e8e-d43ae18ef13c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:31.561767 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-52b669c2-5483-424d-a039-c7c27b43a6cb req-45a97e95-b096-4614-9e8e-d43ae18ef13c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:31.580020 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-52b669c2-5483-424d-a039-c7c27b43a6cb req-45a97e95-b096-4614-9e8e-d43ae18ef13c service nova] Creating event network-changed:de9facd1-8929-497d-9f75-3802fcffc1d0 for instance 324085c2-5228-46ba-8b72-5ee6f112b1d2 on n-h1-846435-14 Jul 25 14:32:31.584865 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-27381d89-51dd-47b8-820e-024c6775b17a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:31.585823 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-52b669c2-5483-424d-a039-c7c27b43a6cb req-45a97e95-b096-4614-9e8e-d43ae18ef13c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056645 Jul 25 14:32:31.586986 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 914/1893] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:32:31.593470 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a8b5557b-0a0c-4b43-8a82-77ad1d0cf350 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:31.594378 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a8b5557b-0a0c-4b43-8a82-77ad1d0cf350 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 1a97e112-b45b-4dcb-ad9f-e979e5c183d9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:31.596368 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-27381d89-51dd-47b8-820e-024c6775b17a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1361 microversion: 2.1 time: 0.299497 Jul 25 14:32:31.608804 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a8b5557b-0a0c-4b43-8a82-77ad1d0cf350 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:31.608804 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a8b5557b-0a0c-4b43-8a82-77ad1d0cf350 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:31.608804 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a8b5557b-0a0c-4b43-8a82-77ad1d0cf350 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:31.608804 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a8b5557b-0a0c-4b43-8a82-77ad1d0cf350 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:31.610605 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 980/1894] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:31 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1361 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:31.623422 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4a72fbeb-d6d1-496f-a150-d41e7f92f0f6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:31.625097 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4a72fbeb-d6d1-496f-a150-d41e7f92f0f6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:31.634008 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4a72fbeb-d6d1-496f-a150-d41e7f92f0f6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:31.634838 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4a72fbeb-d6d1-496f-a150-d41e7f92f0f6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:31.635965 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4a72fbeb-d6d1-496f-a150-d41e7f92f0f6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:31.636736 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4a72fbeb-d6d1-496f-a150-d41e7f92f0f6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:31.843148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4a72fbeb-d6d1-496f-a150-d41e7f92f0f6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:31.854675 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4a72fbeb-d6d1-496f-a150-d41e7f92f0f6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:31.856529 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4a72fbeb-d6d1-496f-a150-d41e7f92f0f6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:31.857663 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4a72fbeb-d6d1-496f-a150-d41e7f92f0f6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1293 microversion: 2.25 time: 0.245686 Jul 25 14:32:31.858399 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 981/1895] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:32:31 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1293 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:32:31.953364 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-71f997f8-b99d-4ca9-bf23-1925ae398b0b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:31.953983 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-71f997f8-b99d-4ca9-bf23-1925ae398b0b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:31.961012 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71f997f8-b99d-4ca9-bf23-1925ae398b0b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:31.961463 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71f997f8-b99d-4ca9-bf23-1925ae398b0b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:31.962245 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71f997f8-b99d-4ca9-bf23-1925ae398b0b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:31.962680 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71f997f8-b99d-4ca9-bf23-1925ae398b0b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:32.022945 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:32:32.121623 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a8b5557b-0a0c-4b43-8a82-77ad1d0cf350 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:32.129430 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a8b5557b-0a0c-4b43-8a82-77ad1d0cf350 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9" status: 200 len: 1316 microversion: 2.1 time: 0.540590 Jul 25 14:32:32.133049 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 915/1896] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:31 2022] GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9 => generated 1316 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:32.155577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-a3c89aca-721f-490e-946e-ce39b8a52974 req-306b713a-8846-43b9-9606-77f601ce03d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a97e112-b45b-4dcb-ad9f-e979e5c183d9", "name": "network-vif-plugged", "status": "completed", "tag": "cab2f4ca-b8c8-4ec9-ae12-c233d24b429f"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:32.168274 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-a3c89aca-721f-490e-946e-ce39b8a52974 req-306b713a-8846-43b9-9606-77f601ce03d7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:32.169101 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-a3c89aca-721f-490e-946e-ce39b8a52974 req-306b713a-8846-43b9-9606-77f601ce03d7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:32.186316 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-a3c89aca-721f-490e-946e-ce39b8a52974 req-306b713a-8846-43b9-9606-77f601ce03d7 service nova] Creating event network-vif-plugged:cab2f4ca-b8c8-4ec9-ae12-c233d24b429f for instance 1a97e112-b45b-4dcb-ad9f-e979e5c183d9 on n-h2-846435-14 Jul 25 14:32:32.192652 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-a3c89aca-721f-490e-946e-ce39b8a52974 req-306b713a-8846-43b9-9606-77f601ce03d7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041338 Jul 25 14:32:32.193912 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 916/1897] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:32:32.220538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-71f997f8-b99d-4ca9-bf23-1925ae398b0b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:32.230924 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-71f997f8-b99d-4ca9-bf23-1925ae398b0b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1517 microversion: 2.1 time: 0.281429 Jul 25 14:32:32.231520 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 982/1898] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:31 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1517 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:32:32.624416 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9b0f228c-0f62-4dcb-81bd-63c6bb6bdf35 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:32.625763 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9b0f228c-0f62-4dcb-81bd-63c6bb6bdf35 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:32.637833 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9b0f228c-0f62-4dcb-81bd-63c6bb6bdf35 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:32.638563 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9b0f228c-0f62-4dcb-81bd-63c6bb6bdf35 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:32.639738 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9b0f228c-0f62-4dcb-81bd-63c6bb6bdf35 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:32.640385 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9b0f228c-0f62-4dcb-81bd-63c6bb6bdf35 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:32.665395 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:32:32.839251 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9b0f228c-0f62-4dcb-81bd-63c6bb6bdf35 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:32.856352 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9b0f228c-0f62-4dcb-81bd-63c6bb6bdf35 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1361 microversion: 2.1 time: 0.235814 Jul 25 14:32:32.859259 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 917/1899] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:32 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1361 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:32.881175 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3f1a29ef-84d1-49b7-8595-68b6ae9cb852 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:32.881769 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3f1a29ef-84d1-49b7-8595-68b6ae9cb852 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:32.900128 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f1a29ef-84d1-49b7-8595-68b6ae9cb852 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:32.900593 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f1a29ef-84d1-49b7-8595-68b6ae9cb852 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:32.905123 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f1a29ef-84d1-49b7-8595-68b6ae9cb852 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:32.905576 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f1a29ef-84d1-49b7-8595-68b6ae9cb852 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:33.153830 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d086f5ab-9b9c-4958-8b43-7a7491f40c30 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:33.155429 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d086f5ab-9b9c-4958-8b43-7a7491f40c30 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 1a97e112-b45b-4dcb-ad9f-e979e5c183d9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:33.163441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d086f5ab-9b9c-4958-8b43-7a7491f40c30 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:33.164170 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d086f5ab-9b9c-4958-8b43-7a7491f40c30 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:33.165217 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d086f5ab-9b9c-4958-8b43-7a7491f40c30 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:33.165855 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d086f5ab-9b9c-4958-8b43-7a7491f40c30 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:33.302004 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3f1a29ef-84d1-49b7-8595-68b6ae9cb852 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:33.311744 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3f1a29ef-84d1-49b7-8595-68b6ae9cb852 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:33.316661 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3f1a29ef-84d1-49b7-8595-68b6ae9cb852 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:33.326488 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3f1a29ef-84d1-49b7-8595-68b6ae9cb852 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1293 microversion: 2.25 time: 0.449341 Jul 25 14:32:33.327466 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 983/1900] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:32:32 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1293 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:32:33.332403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-86482402-e491-4a15-92d8-d31421c348a9 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:33.336187 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-86482402-e491-4a15-92d8-d31421c348a9 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:33.348937 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-86482402-e491-4a15-92d8-d31421c348a9 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:33.352659 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-86482402-e491-4a15-92d8-d31421c348a9 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:33.356579 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d086f5ab-9b9c-4958-8b43-7a7491f40c30 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:33.361511 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-86482402-e491-4a15-92d8-d31421c348a9 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:33.366310 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d086f5ab-9b9c-4958-8b43-7a7491f40c30 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9" status: 200 len: 1316 microversion: 2.1 time: 0.216481 Jul 25 14:32:33.367804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-86482402-e491-4a15-92d8-d31421c348a9 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:33.372725 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 918/1901] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:33 2022] GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9 => generated 1316 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:33.764493 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-86482402-e491-4a15-92d8-d31421c348a9 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:33.777445 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-86482402-e491-4a15-92d8-d31421c348a9 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1517 microversion: 2.1 time: 0.447528 Jul 25 14:32:33.778333 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 984/1902] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:33 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1517 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:33.878412 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-95c9ab7f-a10f-4c5d-8e2a-9c46633049a0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:33.879763 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-95c9ab7f-a10f-4c5d-8e2a-9c46633049a0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:33.901887 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-95c9ab7f-a10f-4c5d-8e2a-9c46633049a0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:33.902593 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-95c9ab7f-a10f-4c5d-8e2a-9c46633049a0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:33.903414 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-95c9ab7f-a10f-4c5d-8e2a-9c46633049a0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:33.903870 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-95c9ab7f-a10f-4c5d-8e2a-9c46633049a0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:34.191728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-95c9ab7f-a10f-4c5d-8e2a-9c46633049a0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:34.200214 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-95c9ab7f-a10f-4c5d-8e2a-9c46633049a0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1361 microversion: 2.1 time: 0.325866 Jul 25 14:32:34.200795 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 919/1903] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:33 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1361 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:34.360279 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c04aaa2f-0069-4a78-9ca7-f15fb8d368f7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:34.362933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c04aaa2f-0069-4a78-9ca7-f15fb8d368f7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:34.369820 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c04aaa2f-0069-4a78-9ca7-f15fb8d368f7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:34.370884 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c04aaa2f-0069-4a78-9ca7-f15fb8d368f7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:34.371949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c04aaa2f-0069-4a78-9ca7-f15fb8d368f7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:34.372517 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c04aaa2f-0069-4a78-9ca7-f15fb8d368f7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:34.401979 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fff9ef1d-7f0e-4516-856b-f796db131df9 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:34.402801 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fff9ef1d-7f0e-4516-856b-f796db131df9 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 1a97e112-b45b-4dcb-ad9f-e979e5c183d9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:34.412743 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fff9ef1d-7f0e-4516-856b-f796db131df9 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:34.414673 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fff9ef1d-7f0e-4516-856b-f796db131df9 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:34.418196 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fff9ef1d-7f0e-4516-856b-f796db131df9 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:34.418783 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fff9ef1d-7f0e-4516-856b-f796db131df9 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:34.640889 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fff9ef1d-7f0e-4516-856b-f796db131df9 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:34.652262 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fff9ef1d-7f0e-4516-856b-f796db131df9 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9" status: 200 len: 1316 microversion: 2.1 time: 0.254630 Jul 25 14:32:34.653690 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 920/1904] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:34 2022] GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9 => generated 1316 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:32:34.785432 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c04aaa2f-0069-4a78-9ca7-f15fb8d368f7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:34.800856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c04aaa2f-0069-4a78-9ca7-f15fb8d368f7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:34.805808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c04aaa2f-0069-4a78-9ca7-f15fb8d368f7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:34.808504 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-aa58baa6-2a05-4530-83e7-0a74ff00cdbe tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:34.809342 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-aa58baa6-2a05-4530-83e7-0a74ff00cdbe tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:34.810348 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c04aaa2f-0069-4a78-9ca7-f15fb8d368f7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1293 microversion: 2.25 time: 0.456177 Jul 25 14:32:34.811152 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 985/1905] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:32:34 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1293 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:32:34.812612 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:32:34.818882 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aa58baa6-2a05-4530-83e7-0a74ff00cdbe tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:34.820601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aa58baa6-2a05-4530-83e7-0a74ff00cdbe tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:34.820601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aa58baa6-2a05-4530-83e7-0a74ff00cdbe tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:34.820981 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aa58baa6-2a05-4530-83e7-0a74ff00cdbe tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:35.003669 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-aa58baa6-2a05-4530-83e7-0a74ff00cdbe tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:35.021222 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-aa58baa6-2a05-4530-83e7-0a74ff00cdbe tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1517 microversion: 2.1 time: 0.221267 Jul 25 14:32:35.036497 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 921/1906] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:34 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1517 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:32:35.229612 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8fcf079c-6d53-439d-943b-fd05e5d56cf2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:35.230761 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8fcf079c-6d53-439d-943b-fd05e5d56cf2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:35.237767 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:32:35.239698 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8fcf079c-6d53-439d-943b-fd05e5d56cf2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:35.240518 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8fcf079c-6d53-439d-943b-fd05e5d56cf2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:35.241534 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8fcf079c-6d53-439d-943b-fd05e5d56cf2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:35.242127 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8fcf079c-6d53-439d-943b-fd05e5d56cf2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:35.504528 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8fcf079c-6d53-439d-943b-fd05e5d56cf2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:35.514545 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8fcf079c-6d53-439d-943b-fd05e5d56cf2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1361 microversion: 2.1 time: 0.297014 Jul 25 14:32:35.515171 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 986/1907] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:35 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1361 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:35.673775 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0b1d4b93-4ee1-4ffb-bc71-b01ecb93d001 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:35.674981 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0b1d4b93-4ee1-4ffb-bc71-b01ecb93d001 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 1a97e112-b45b-4dcb-ad9f-e979e5c183d9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:35.682776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b1d4b93-4ee1-4ffb-bc71-b01ecb93d001 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:35.683604 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b1d4b93-4ee1-4ffb-bc71-b01ecb93d001 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:35.685076 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b1d4b93-4ee1-4ffb-bc71-b01ecb93d001 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:35.685947 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b1d4b93-4ee1-4ffb-bc71-b01ecb93d001 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:35.833068 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0b1d4b93-4ee1-4ffb-bc71-b01ecb93d001 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:35.833642 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-056011dd-8441-407a-b952-16016a1745e2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:35.834257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-056011dd-8441-407a-b952-16016a1745e2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:35.840620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-056011dd-8441-407a-b952-16016a1745e2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:35.841364 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-056011dd-8441-407a-b952-16016a1745e2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:35.842326 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-056011dd-8441-407a-b952-16016a1745e2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:35.842926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-056011dd-8441-407a-b952-16016a1745e2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:35.843722 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0b1d4b93-4ee1-4ffb-bc71-b01ecb93d001 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9" status: 200 len: 1465 microversion: 2.1 time: 0.173805 Jul 25 14:32:35.859995 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 922/1908] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:35 2022] GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9 => generated 1465 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:35.996257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:32:36.021819 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=10 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:32:36.050038 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-056011dd-8441-407a-b952-16016a1745e2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:36.062773 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-056011dd-8441-407a-b952-16016a1745e2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:36.065009 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-056011dd-8441-407a-b952-16016a1745e2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:36.066393 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-056011dd-8441-407a-b952-16016a1745e2 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1281 microversion: 2.25 time: 0.236798 Jul 25 14:32:36.067503 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 987/1909] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:32:35 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1281 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:32:36.084471 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-62ee6066-d26c-42ac-b2fd-1131e9a46b47 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:36.085232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-62ee6066-d26c-42ac-b2fd-1131e9a46b47 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:36.092458 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-62ee6066-d26c-42ac-b2fd-1131e9a46b47 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:36.092955 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-62ee6066-d26c-42ac-b2fd-1131e9a46b47 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:36.093963 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-62ee6066-d26c-42ac-b2fd-1131e9a46b47 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:36.094561 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-62ee6066-d26c-42ac-b2fd-1131e9a46b47 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:36.096721 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0064ccc1-e3ca-4f12-bbb3-38b65653a7b5 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:36.097350 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0064ccc1-e3ca-4f12-bbb3-38b65653a7b5 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] [instance: 1a97e112-b45b-4dcb-ad9f-e979e5c183d9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:36.104703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0064ccc1-e3ca-4f12-bbb3-38b65653a7b5 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:36.105461 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0064ccc1-e3ca-4f12-bbb3-38b65653a7b5 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:36.106425 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0064ccc1-e3ca-4f12-bbb3-38b65653a7b5 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:36.107024 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0064ccc1-e3ca-4f12-bbb3-38b65653a7b5 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:36.318613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-62ee6066-d26c-42ac-b2fd-1131e9a46b47 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:36.341907 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-62ee6066-d26c-42ac-b2fd-1131e9a46b47 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1517 microversion: 2.1 time: 0.272416 Jul 25 14:32:36.358777 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 988/1910] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:36 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1517 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:36.451420 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=18 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:32:36.537871 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d25ef03e-6a81-4da9-baba-da7ff53e4da2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:36.538929 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d25ef03e-6a81-4da9-baba-da7ff53e4da2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:36.560104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d25ef03e-6a81-4da9-baba-da7ff53e4da2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:36.560966 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d25ef03e-6a81-4da9-baba-da7ff53e4da2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:36.562861 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d25ef03e-6a81-4da9-baba-da7ff53e4da2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:36.563374 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d25ef03e-6a81-4da9-baba-da7ff53e4da2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:36.828455 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0064ccc1-e3ca-4f12-bbb3-38b65653a7b5 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9" status: 200 len: 1618 microversion: 2.1 time: 0.961786 Jul 25 14:32:36.829298 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 923/1911] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:35 2022] GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9 => generated 1618 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:36.831339 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d25ef03e-6a81-4da9-baba-da7ff53e4da2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:36.851070 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-71d699f8-4c58-476b-8c91-c91b744d7efa tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Action: 'create', calling method: .version_select at 0x7f468727df70>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-738703745", "policies": ["affinity"]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:36.875157 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d25ef03e-6a81-4da9-baba-da7ff53e4da2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1361 microversion: 2.1 time: 0.341998 Jul 25 14:32:36.892237 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 989/1912] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:36 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1361 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:32:36.907937 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-71d699f8-4c58-476b-8c91-c91b744d7efa tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for project e60b88c2aea642658a5bfc14780d5d51. Resources: {'server_groups'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:32:36.913744 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-71d699f8-4c58-476b-8c91-c91b744d7efa tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for user ef351be3886949f9985b3244301435a9 and project e60b88c2aea642658a5bfc14780d5d51. Resources: {'server_groups'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:32:36.975404 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-71d699f8-4c58-476b-8c91-c91b744d7efa tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for project e60b88c2aea642658a5bfc14780d5d51. Resources: {'server_groups'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:32:36.981830 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-71d699f8-4c58-476b-8c91-c91b744d7efa tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for user ef351be3886949f9985b3244301435a9 and project e60b88c2aea642658a5bfc14780d5d51. Resources: {'server_groups'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:32:36.995965 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-71d699f8-4c58-476b-8c91-c91b744d7efa tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.149246 Jul 25 14:32:37.004442 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 924/1913] 10.222.0.88 () {60 vars in 1174 bytes} [Mon Jul 25 14:32:36 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:32:37.093492 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f022787b-53ed-497d-b684-40d695579775 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:37.094407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f022787b-53ed-497d-b684-40d695579775 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:37.103042 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f022787b-53ed-497d-b684-40d695579775 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:37.103835 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f022787b-53ed-497d-b684-40d695579775 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:37.104894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f022787b-53ed-497d-b684-40d695579775 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:37.105326 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f022787b-53ed-497d-b684-40d695579775 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:37.134942 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-59082406-66b0-4f25-8b21-32deb32a2d14 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1120526138", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "4f723bc4-eaed-48cf-a946-6282c20f4328"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:37.213788 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-59082406-66b0-4f25-8b21-32deb32a2d14 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] validate_networks() for None {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:32:37.381966 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f022787b-53ed-497d-b684-40d695579775 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:37.391180 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f022787b-53ed-497d-b684-40d695579775 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:37.393601 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f022787b-53ed-497d-b684-40d695579775 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:37.394910 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f022787b-53ed-497d-b684-40d695579775 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1281 microversion: 2.25 time: 0.306267 Jul 25 14:32:37.396157 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 990/1914] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:32:37 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1281 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:32:37.402173 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-34010035-2107-482a-8850-96d3b9e95c9c tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:37.403152 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-34010035-2107-482a-8850-96d3b9e95c9c tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:37.421598 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-34010035-2107-482a-8850-96d3b9e95c9c tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:37.422387 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-34010035-2107-482a-8850-96d3b9e95c9c tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:37.423629 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-34010035-2107-482a-8850-96d3b9e95c9c tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:37.425766 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-34010035-2107-482a-8850-96d3b9e95c9c tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:37.535611 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-59082406-66b0-4f25-8b21-32deb32a2d14 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:32:37.536193 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-59082406-66b0-4f25-8b21-32deb32a2d14 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:32:37.536759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-59082406-66b0-4f25-8b21-32deb32a2d14 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:32:37.537895 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-59082406-66b0-4f25-8b21-32deb32a2d14 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:32:37.538399 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-59082406-66b0-4f25-8b21-32deb32a2d14 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:32:37.571661 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59082406-66b0-4f25-8b21-32deb32a2d14 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:37.576546 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59082406-66b0-4f25-8b21-32deb32a2d14 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:37.577523 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59082406-66b0-4f25-8b21-32deb32a2d14 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:37.577976 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59082406-66b0-4f25-8b21-32deb32a2d14 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:37.602601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-59082406-66b0-4f25-8b21-32deb32a2d14 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for project e60b88c2aea642658a5bfc14780d5d51. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:32:37.609589 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-59082406-66b0-4f25-8b21-32deb32a2d14 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for user ef351be3886949f9985b3244301435a9 and project e60b88c2aea642658a5bfc14780d5d51. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:32:37.624426 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-59082406-66b0-4f25-8b21-32deb32a2d14 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Going to run 2 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:32:37.626790 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-59082406-66b0-4f25-8b21-32deb32a2d14 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 735eedac-478a-4b11-9fb3-479179270d35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:32:37.667842 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-59082406-66b0-4f25-8b21-32deb32a2d14 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119303) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 25 14:32:37.692696 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-59082406-66b0-4f25-8b21-32deb32a2d14 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for project e60b88c2aea642658a5bfc14780d5d51. Resources: {'server_group_members'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:32:37.697935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-59082406-66b0-4f25-8b21-32deb32a2d14 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for user ef351be3886949f9985b3244301435a9 and project e60b88c2aea642658a5bfc14780d5d51. Resources: {'server_group_members'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:32:37.745088 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-59082406-66b0-4f25-8b21-32deb32a2d14 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for project e60b88c2aea642658a5bfc14780d5d51. Resources: {'server_group_members'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:32:37.750504 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-59082406-66b0-4f25-8b21-32deb32a2d14 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for user ef351be3886949f9985b3244301435a9 and project e60b88c2aea642658a5bfc14780d5d51. Resources: {'server_group_members'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:32:37.764682 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-59082406-66b0-4f25-8b21-32deb32a2d14 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 742f8126-e737-4716-bb05-66e2ba318535] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=735eedac-478a-4b11-9fb3-479179270d35,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:32:37.815265 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-59082406-66b0-4f25-8b21-32deb32a2d14 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for project e60b88c2aea642658a5bfc14780d5d51. Resources: {'server_group_members'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:32:37.820339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-59082406-66b0-4f25-8b21-32deb32a2d14 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for user ef351be3886949f9985b3244301435a9 and project e60b88c2aea642658a5bfc14780d5d51. Resources: {'server_group_members'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:32:37.862668 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-59082406-66b0-4f25-8b21-32deb32a2d14 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for project e60b88c2aea642658a5bfc14780d5d51. Resources: {'server_group_members'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:32:37.865138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:32:37.869486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-59082406-66b0-4f25-8b21-32deb32a2d14 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for user ef351be3886949f9985b3244301435a9 and project e60b88c2aea642658a5bfc14780d5d51. Resources: {'server_group_members'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:32:37.913036 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-59082406-66b0-4f25-8b21-32deb32a2d14 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.780892 Jul 25 14:32:37.913036 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 925/1915] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:32:37 2022] POST /compute/v2.1/servers => generated 32 bytes in 783 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 25 14:32:37.918579 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-686c7602-07b8-4b00-8f50-cc7e0ef0d8df tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:37.919203 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-686c7602-07b8-4b00-8f50-cc7e0ef0d8df tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:37.920070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-34010035-2107-482a-8850-96d3b9e95c9c tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:37.926528 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-686c7602-07b8-4b00-8f50-cc7e0ef0d8df tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:37.927060 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-686c7602-07b8-4b00-8f50-cc7e0ef0d8df tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:37.927937 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-686c7602-07b8-4b00-8f50-cc7e0ef0d8df tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:37.928465 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-686c7602-07b8-4b00-8f50-cc7e0ef0d8df tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:37.931546 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-34010035-2107-482a-8850-96d3b9e95c9c tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1517 microversion: 2.1 time: 0.534085 Jul 25 14:32:37.935150 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 991/1916] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:37 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1517 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:37.940013 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2ac7fd49-e2bb-4d00-ba6d-27edc4564122 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:37.945419 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2ac7fd49-e2bb-4d00-ba6d-27edc4564122 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:37.946481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2ac7fd49-e2bb-4d00-ba6d-27edc4564122 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Searching by: {'deleted': False, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:32:37.977010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2ac7fd49-e2bb-4d00-ba6d-27edc4564122 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:37.977914 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2ac7fd49-e2bb-4d00-ba6d-27edc4564122 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:37.978952 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2ac7fd49-e2bb-4d00-ba6d-27edc4564122 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:37.979694 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2ac7fd49-e2bb-4d00-ba6d-27edc4564122 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:38.114230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-686c7602-07b8-4b00-8f50-cc7e0ef0d8df tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:38.116132 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:32:38.120729 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.multi_cell_list [None req-2ac7fd49-e2bb-4d00-ba6d-27edc4564122 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=119304) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:32:38.125601 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-686c7602-07b8-4b00-8f50-cc7e0ef0d8df tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1361 microversion: 2.1 time: 0.210392 Jul 25 14:32:38.126466 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 926/1917] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:37 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1361 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:38.209086 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2ac7fd49-e2bb-4d00-ba6d-27edc4564122 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.272700 Jul 25 14:32:38.209659 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 992/1918] 10.222.0.88 () {58 vars in 1125 bytes} [Mon Jul 25 14:32:37 2022] GET /compute/v2.1/servers => generated 1003 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:38.221993 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1092b8ed-20c9-4eba-80a1-87c1fa6c8423 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:38.223807 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1092b8ed-20c9-4eba-80a1-87c1fa6c8423 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 742f8126-e737-4716-bb05-66e2ba318535] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:38.349799 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1092b8ed-20c9-4eba-80a1-87c1fa6c8423 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:38.359408 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1092b8ed-20c9-4eba-80a1-87c1fa6c8423 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535" status: 200 len: 1219 microversion: 2.1 time: 0.140944 Jul 25 14:32:38.360634 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 927/1919] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:38 2022] GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535 => generated 1219 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:38.422648 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8a4f48bd-bc3e-4ea7-b302-84f36de42187 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:38.423843 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8a4f48bd-bc3e-4ea7-b302-84f36de42187 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:38.431064 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8a4f48bd-bc3e-4ea7-b302-84f36de42187 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:38.431812 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8a4f48bd-bc3e-4ea7-b302-84f36de42187 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:38.432911 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8a4f48bd-bc3e-4ea7-b302-84f36de42187 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:38.433715 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8a4f48bd-bc3e-4ea7-b302-84f36de42187 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:38.697722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8a4f48bd-bc3e-4ea7-b302-84f36de42187 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:38.706964 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8a4f48bd-bc3e-4ea7-b302-84f36de42187 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:38.708925 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8a4f48bd-bc3e-4ea7-b302-84f36de42187 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:38.710820 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8a4f48bd-bc3e-4ea7-b302-84f36de42187 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1281 microversion: 2.25 time: 0.291856 Jul 25 14:32:38.712315 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 993/1920] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:32:38 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1281 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:32:38.893349 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-fe626be4-fd94-4311-9a19-b9e20a2683c3 req-5c1f3c60-ddd5-4ecf-8333-023f53b6a27d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a85a57f0-715f-47cd-ae19-463dfc5e7aca", "name": "network-vif-plugged", "status": "completed", "tag": "b6bbf444-a731-43c2-bb7a-c5a47d378689"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:38.929038 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-fe626be4-fd94-4311-9a19-b9e20a2683c3 req-5c1f3c60-ddd5-4ecf-8333-023f53b6a27d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:38.932593 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-fe626be4-fd94-4311-9a19-b9e20a2683c3 req-5c1f3c60-ddd5-4ecf-8333-023f53b6a27d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:38.957302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-638a60b8-6c83-45eb-88a5-d350afbb2a51 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:38.958063 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-638a60b8-6c83-45eb-88a5-d350afbb2a51 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:38.973368 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-638a60b8-6c83-45eb-88a5-d350afbb2a51 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:38.973827 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-638a60b8-6c83-45eb-88a5-d350afbb2a51 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:38.974711 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-638a60b8-6c83-45eb-88a5-d350afbb2a51 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:38.977851 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-638a60b8-6c83-45eb-88a5-d350afbb2a51 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:39.003102 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-fe626be4-fd94-4311-9a19-b9e20a2683c3 req-5c1f3c60-ddd5-4ecf-8333-023f53b6a27d service nova] Creating event network-vif-plugged:b6bbf444-a731-43c2-bb7a-c5a47d378689 for instance a85a57f0-715f-47cd-ae19-463dfc5e7aca on n-h2-846435-14 Jul 25 14:32:39.017722 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-fe626be4-fd94-4311-9a19-b9e20a2683c3 req-5c1f3c60-ddd5-4ecf-8333-023f53b6a27d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127214 Jul 25 14:32:39.019631 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 928/1921] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:32:39.149956 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-90eb5cef-e5ad-4a62-93e5-e8fd0a07c99b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:39.151370 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-90eb5cef-e5ad-4a62-93e5-e8fd0a07c99b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:39.166414 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-90eb5cef-e5ad-4a62-93e5-e8fd0a07c99b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:39.166886 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-90eb5cef-e5ad-4a62-93e5-e8fd0a07c99b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:39.167687 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-90eb5cef-e5ad-4a62-93e5-e8fd0a07c99b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:39.168151 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-90eb5cef-e5ad-4a62-93e5-e8fd0a07c99b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:39.329312 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-638a60b8-6c83-45eb-88a5-d350afbb2a51 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:39.337299 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-638a60b8-6c83-45eb-88a5-d350afbb2a51 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1517 microversion: 2.1 time: 0.386607 Jul 25 14:32:39.339908 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 994/1922] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:38 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1517 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:39.381373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-78b6d7f9-7fac-4df1-b7a2-87d8b81873f3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:39.382375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-78b6d7f9-7fac-4df1-b7a2-87d8b81873f3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 742f8126-e737-4716-bb05-66e2ba318535] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:39.391062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-78b6d7f9-7fac-4df1-b7a2-87d8b81873f3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:39.391860 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-78b6d7f9-7fac-4df1-b7a2-87d8b81873f3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:39.393110 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-78b6d7f9-7fac-4df1-b7a2-87d8b81873f3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:39.393770 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-78b6d7f9-7fac-4df1-b7a2-87d8b81873f3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:39.530815 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-78b6d7f9-7fac-4df1-b7a2-87d8b81873f3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:39.539936 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-78b6d7f9-7fac-4df1-b7a2-87d8b81873f3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535" status: 200 len: 1215 microversion: 2.1 time: 0.162915 Jul 25 14:32:39.541146 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 995/1923] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:39 2022] GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535 => generated 1215 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:39.564908 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-90eb5cef-e5ad-4a62-93e5-e8fd0a07c99b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:39.574424 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-90eb5cef-e5ad-4a62-93e5-e8fd0a07c99b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1361 microversion: 2.1 time: 0.429631 Jul 25 14:32:39.575382 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 929/1924] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:39 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1361 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:39.899913 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-633c2391-1579-4952-b71b-b72c7aeb0b98 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:39.900551 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-633c2391-1579-4952-b71b-b72c7aeb0b98 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:39.915341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-633c2391-1579-4952-b71b-b72c7aeb0b98 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:39.916212 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-633c2391-1579-4952-b71b-b72c7aeb0b98 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:39.917812 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-633c2391-1579-4952-b71b-b72c7aeb0b98 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:39.918438 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-633c2391-1579-4952-b71b-b72c7aeb0b98 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:40.083633 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-633c2391-1579-4952-b71b-b72c7aeb0b98 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:40.093696 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-633c2391-1579-4952-b71b-b72c7aeb0b98 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:40.096059 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-633c2391-1579-4952-b71b-b72c7aeb0b98 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:40.097529 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-633c2391-1579-4952-b71b-b72c7aeb0b98 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1281 microversion: 2.25 time: 0.366954 Jul 25 14:32:40.098357 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 996/1925] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:32:39 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1281 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:32:40.330850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-133ea99b-a751-4b32-aa3f-add369d596ce tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-87188291", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "08ff6c4d-9014-407c-a8b4-e5371f268da5"}, {"uuid": "4c6fb3b4-0c3d-44eb-aa05-7cb851af149a"}, {"uuid": "08ff6c4d-9014-407c-a8b4-e5371f268da5"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:40.360744 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d961a5ff-9510-4d1f-bc4a-eb2786e33c68 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:40.361366 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d961a5ff-9510-4d1f-bc4a-eb2786e33c68 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:40.367562 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d961a5ff-9510-4d1f-bc4a-eb2786e33c68 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:40.368417 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d961a5ff-9510-4d1f-bc4a-eb2786e33c68 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:40.368811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d961a5ff-9510-4d1f-bc4a-eb2786e33c68 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:40.369618 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d961a5ff-9510-4d1f-bc4a-eb2786e33c68 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:40.394150 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-133ea99b-a751-4b32-aa3f-add369d596ce tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] validate_networks() for [('08ff6c4d-9014-407c-a8b4-e5371f268da5', None, None, None, None, None), ('4c6fb3b4-0c3d-44eb-aa05-7cb851af149a', None, None, None, None, None), ('08ff6c4d-9014-407c-a8b4-e5371f268da5', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:32:40.637445 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d961a5ff-9510-4d1f-bc4a-eb2786e33c68 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:40.653595 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d961a5ff-9510-4d1f-bc4a-eb2786e33c68 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1517 microversion: 2.1 time: 0.296667 Jul 25 14:32:40.654209 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 997/1926] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:40 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1517 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:32:40.660353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-faaac79a-5d6d-4ad1-9047-02f91ebf115a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:40.661242 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-faaac79a-5d6d-4ad1-9047-02f91ebf115a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 742f8126-e737-4716-bb05-66e2ba318535] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:40.668181 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-faaac79a-5d6d-4ad1-9047-02f91ebf115a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:40.668826 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-faaac79a-5d6d-4ad1-9047-02f91ebf115a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:40.669791 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-faaac79a-5d6d-4ad1-9047-02f91ebf115a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:40.670410 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-faaac79a-5d6d-4ad1-9047-02f91ebf115a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:40.766389 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-faaac79a-5d6d-4ad1-9047-02f91ebf115a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:40.776682 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-faaac79a-5d6d-4ad1-9047-02f91ebf115a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535" status: 200 len: 1271 microversion: 2.1 time: 0.120808 Jul 25 14:32:40.777570 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 998/1927] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:40 2022] GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535 => generated 1271 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:40.783349 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-585815f2-9b7e-4c22-9e2c-99127371030d tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:40.784273 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-585815f2-9b7e-4c22-9e2c-99127371030d tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:40.794188 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-585815f2-9b7e-4c22-9e2c-99127371030d tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:40.794632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-585815f2-9b7e-4c22-9e2c-99127371030d tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:40.795410 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-585815f2-9b7e-4c22-9e2c-99127371030d tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:40.795847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-585815f2-9b7e-4c22-9e2c-99127371030d tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:40.991931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-585815f2-9b7e-4c22-9e2c-99127371030d tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:41.002221 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-585815f2-9b7e-4c22-9e2c-99127371030d tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1361 microversion: 2.1 time: 0.223173 Jul 25 14:32:41.003508 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 999/1928] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:40 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1361 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:41.122410 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9235f9f4-0ab2-4ec4-aac5-0715327664af tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:41.125081 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9235f9f4-0ab2-4ec4-aac5-0715327664af tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:41.156890 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9235f9f4-0ab2-4ec4-aac5-0715327664af tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:41.160436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9235f9f4-0ab2-4ec4-aac5-0715327664af tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:41.165351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9235f9f4-0ab2-4ec4-aac5-0715327664af tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:41.168428 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9235f9f4-0ab2-4ec4-aac5-0715327664af tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:41.697797 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9235f9f4-0ab2-4ec4-aac5-0715327664af tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:41.712262 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9235f9f4-0ab2-4ec4-aac5-0715327664af tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:41.714021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9235f9f4-0ab2-4ec4-aac5-0715327664af tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:41.716947 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9235f9f4-0ab2-4ec4-aac5-0715327664af tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1281 microversion: 2.25 time: 0.599694 Jul 25 14:32:41.724061 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1000/1929] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:32:41 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1281 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:32:41.731144 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-983fb190-6ebe-4124-99ae-020c015fcfd8 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:41.732168 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-983fb190-6ebe-4124-99ae-020c015fcfd8 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:41.739731 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-983fb190-6ebe-4124-99ae-020c015fcfd8 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:41.744498 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-983fb190-6ebe-4124-99ae-020c015fcfd8 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:41.745908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-983fb190-6ebe-4124-99ae-020c015fcfd8 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:41.746576 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-983fb190-6ebe-4124-99ae-020c015fcfd8 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:42.004134 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-133ea99b-a751-4b32-aa3f-add369d596ce tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:32:42.004655 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-133ea99b-a751-4b32-aa3f-add369d596ce tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:32:42.005021 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-133ea99b-a751-4b32-aa3f-add369d596ce tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:32:42.005440 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-133ea99b-a751-4b32-aa3f-add369d596ce tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:32:42.005871 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-133ea99b-a751-4b32-aa3f-add369d596ce tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:32:42.014702 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-983fb190-6ebe-4124-99ae-020c015fcfd8 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:42.023913 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-133ea99b-a751-4b32-aa3f-add369d596ce tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:42.024392 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-133ea99b-a751-4b32-aa3f-add369d596ce tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:42.025203 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-133ea99b-a751-4b32-aa3f-add369d596ce tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:42.025646 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-133ea99b-a751-4b32-aa3f-add369d596ce tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:42.028116 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-983fb190-6ebe-4124-99ae-020c015fcfd8 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1523 microversion: 2.1 time: 0.302469 Jul 25 14:32:42.030296 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1001/1930] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:41 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1523 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:42.047250 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a2b53883-6cc3-42bf-928c-34526a97b5f1 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:42.052460 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a2b53883-6cc3-42bf-928c-34526a97b5f1 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 742f8126-e737-4716-bb05-66e2ba318535] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:42.072285 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a2b53883-6cc3-42bf-928c-34526a97b5f1 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:42.073212 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a2b53883-6cc3-42bf-928c-34526a97b5f1 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:42.074355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a2b53883-6cc3-42bf-928c-34526a97b5f1 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:42.076056 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a2b53883-6cc3-42bf-928c-34526a97b5f1 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:42.080661 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-133ea99b-a751-4b32-aa3f-add369d596ce tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Getting quotas for project 041b46dd05384e47a74bfaa8dc3c838f. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:32:42.099277 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-133ea99b-a751-4b32-aa3f-add369d596ce tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Getting quotas for user 3e2beeccba594f01b83983a2ec729a98 and project 041b46dd05384e47a74bfaa8dc3c838f. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:32:42.133584 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-133ea99b-a751-4b32-aa3f-add369d596ce tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:32:42.139332 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-133ea99b-a751-4b32-aa3f-add369d596ce tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:32:42.235228 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a2b53883-6cc3-42bf-928c-34526a97b5f1 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:42.250369 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-133ea99b-a751-4b32-aa3f-add369d596ce tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.923438 Jul 25 14:32:42.253796 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a2b53883-6cc3-42bf-928c-34526a97b5f1 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535" status: 200 len: 1277 microversion: 2.1 time: 0.214969 Jul 25 14:32:42.254776 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 930/1931] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:32:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:32:42.255589 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1002/1932] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:42 2022] GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535 => generated 1277 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:42.272505 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-839649f5-2204-4a27-9d7f-2c265076bcf7 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:42.273698 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e25145c2-6639-49a5-9833-11187397fe68 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:42.276001 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e25145c2-6639-49a5-9833-11187397fe68 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:42.304883 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-839649f5-2204-4a27-9d7f-2c265076bcf7 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:42.327881 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e25145c2-6639-49a5-9833-11187397fe68 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:42.328363 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e25145c2-6639-49a5-9833-11187397fe68 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:42.336045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e25145c2-6639-49a5-9833-11187397fe68 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:42.338686 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e25145c2-6639-49a5-9833-11187397fe68 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:42.530706 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-839649f5-2204-4a27-9d7f-2c265076bcf7 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:42.539104 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-839649f5-2204-4a27-9d7f-2c265076bcf7 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 200 len: 1211 microversion: 2.1 time: 0.271640 Jul 25 14:32:42.542119 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 931/1933] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:42 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 1211 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:42.758943 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5fa292a5-b4e2-409d-b842-ec4a307fe064 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:42.760431 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5fa292a5-b4e2-409d-b842-ec4a307fe064 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:42.790738 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e25145c2-6639-49a5-9833-11187397fe68 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:42.808419 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e25145c2-6639-49a5-9833-11187397fe68 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1544 microversion: 2.1 time: 0.543339 Jul 25 14:32:42.809245 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1003/1934] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:42 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1544 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:42.821762 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5fa292a5-b4e2-409d-b842-ec4a307fe064 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:42.823031 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5fa292a5-b4e2-409d-b842-ec4a307fe064 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:42.836179 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5fa292a5-b4e2-409d-b842-ec4a307fe064 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:42.836683 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5fa292a5-b4e2-409d-b842-ec4a307fe064 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:42.845630 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-83990914-7802-4e0f-866f-da3175cb9369 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:42.852308 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-83990914-7802-4e0f-866f-da3175cb9369 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:42.874412 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83990914-7802-4e0f-866f-da3175cb9369 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:42.874779 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83990914-7802-4e0f-866f-da3175cb9369 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:42.875571 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83990914-7802-4e0f-866f-da3175cb9369 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:42.885160 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83990914-7802-4e0f-866f-da3175cb9369 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:43.132640 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5fa292a5-b4e2-409d-b842-ec4a307fe064 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:43.153384 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5fa292a5-b4e2-409d-b842-ec4a307fe064 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:43.156376 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5fa292a5-b4e2-409d-b842-ec4a307fe064 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:43.165309 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5fa292a5-b4e2-409d-b842-ec4a307fe064 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1281 microversion: 2.25 time: 0.418820 Jul 25 14:32:43.193610 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 932/1935] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:32:42 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1281 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:32:43.205296 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-59700f9b-b0c0-4417-afe3-652e89de42c2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:43.208108 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-59700f9b-b0c0-4417-afe3-652e89de42c2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:43.236137 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59700f9b-b0c0-4417-afe3-652e89de42c2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:43.236591 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59700f9b-b0c0-4417-afe3-652e89de42c2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:43.237381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59700f9b-b0c0-4417-afe3-652e89de42c2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:43.238527 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59700f9b-b0c0-4417-afe3-652e89de42c2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:43.247925 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-83990914-7802-4e0f-866f-da3175cb9369 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.418059 Jul 25 14:32:43.249045 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1004/1936] 10.222.0.88 () {58 vars in 1275 bytes} [Mon Jul 25 14:32:42 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca/os-interface => generated 285 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:32:43.281174 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ea071281-4899-44d6-b46f-6e4867b51c59 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:43.281799 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ea071281-4899-44d6-b46f-6e4867b51c59 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 742f8126-e737-4716-bb05-66e2ba318535] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:43.306511 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea071281-4899-44d6-b46f-6e4867b51c59 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:43.306959 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea071281-4899-44d6-b46f-6e4867b51c59 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:43.318610 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea071281-4899-44d6-b46f-6e4867b51c59 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:43.319123 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea071281-4899-44d6-b46f-6e4867b51c59 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:43.799226 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ea071281-4899-44d6-b46f-6e4867b51c59 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:43.812071 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ea071281-4899-44d6-b46f-6e4867b51c59 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535" status: 200 len: 1319 microversion: 2.1 time: 0.531905 Jul 25 14:32:43.812970 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1005/1937] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:43 2022] GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535 => generated 1319 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:43.828544 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-34433583-e54b-4527-8d49-64d7b3a46a67 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:43.829330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-34433583-e54b-4527-8d49-64d7b3a46a67 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:43.843755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-34433583-e54b-4527-8d49-64d7b3a46a67 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:43.845938 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-34433583-e54b-4527-8d49-64d7b3a46a67 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:43.848164 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-34433583-e54b-4527-8d49-64d7b3a46a67 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:43.848916 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-34433583-e54b-4527-8d49-64d7b3a46a67 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:43.978406 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-34433583-e54b-4527-8d49-64d7b3a46a67 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:43.990335 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-34433583-e54b-4527-8d49-64d7b3a46a67 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 200 len: 1263 microversion: 2.1 time: 0.174489 Jul 25 14:32:43.992257 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1006/1938] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:43 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 1263 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:44.215150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-10e16a54-3b99-4d0d-bdba-c46bf1b90822 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:44.215768 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-10e16a54-3b99-4d0d-bdba-c46bf1b90822 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:44.223135 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-10e16a54-3b99-4d0d-bdba-c46bf1b90822 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:44.223573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-10e16a54-3b99-4d0d-bdba-c46bf1b90822 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:44.224518 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-10e16a54-3b99-4d0d-bdba-c46bf1b90822 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:44.224953 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-10e16a54-3b99-4d0d-bdba-c46bf1b90822 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:44.580215 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-10e16a54-3b99-4d0d-bdba-c46bf1b90822 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:44.593012 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-10e16a54-3b99-4d0d-bdba-c46bf1b90822 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:44.595848 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-10e16a54-3b99-4d0d-bdba-c46bf1b90822 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:44.597020 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-10e16a54-3b99-4d0d-bdba-c46bf1b90822 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1281 microversion: 2.25 time: 0.387664 Jul 25 14:32:44.598420 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1007/1939] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:32:44 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1281 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:32:44.622115 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-59700f9b-b0c0-4417-afe3-652e89de42c2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:44.636408 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-59700f9b-b0c0-4417-afe3-652e89de42c2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1523 microversion: 2.1 time: 1.436190 Jul 25 14:32:44.637066 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 933/1940] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:43 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1523 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:44.838738 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-25faf31b-fac2-46c0-aa76-f187cbe85879 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:44.840450 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-25faf31b-fac2-46c0-aa76-f187cbe85879 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 742f8126-e737-4716-bb05-66e2ba318535] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:44.849883 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25faf31b-fac2-46c0-aa76-f187cbe85879 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:44.850496 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25faf31b-fac2-46c0-aa76-f187cbe85879 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:44.851551 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25faf31b-fac2-46c0-aa76-f187cbe85879 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:44.852182 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25faf31b-fac2-46c0-aa76-f187cbe85879 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:45.015926 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9a22b179-16e4-40f8-92bc-e5a1ba62dea8 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:45.016611 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9a22b179-16e4-40f8-92bc-e5a1ba62dea8 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:45.034359 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9a22b179-16e4-40f8-92bc-e5a1ba62dea8 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:45.034826 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9a22b179-16e4-40f8-92bc-e5a1ba62dea8 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:45.035919 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9a22b179-16e4-40f8-92bc-e5a1ba62dea8 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:45.036556 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9a22b179-16e4-40f8-92bc-e5a1ba62dea8 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:45.062397 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-25faf31b-fac2-46c0-aa76-f187cbe85879 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:45.077470 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-25faf31b-fac2-46c0-aa76-f187cbe85879 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535" status: 200 len: 1319 microversion: 2.1 time: 0.242727 Jul 25 14:32:45.085120 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1008/1941] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:44 2022] GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535 => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:45.192916 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-1611b0f9-4177-4ef0-8997-0c8426dfe974 req-9b703af8-6800-4251-aae0-5e7a2eeed69c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aacb7718-eb99-45ae-a61c-4e5e8770be8a", "name": "network-vif-unplugged", "status": "completed", "tag": "0bbbda3d-8d02-4c28-9926-89b52f83ac0e"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:45.204015 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-1611b0f9-4177-4ef0-8997-0c8426dfe974 req-9b703af8-6800-4251-aae0-5e7a2eeed69c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:45.204800 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-1611b0f9-4177-4ef0-8997-0c8426dfe974 req-9b703af8-6800-4251-aae0-5e7a2eeed69c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:45.209576 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:32:45.218737 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-1611b0f9-4177-4ef0-8997-0c8426dfe974 req-9b703af8-6800-4251-aae0-5e7a2eeed69c service nova] Creating event network-vif-unplugged:0bbbda3d-8d02-4c28-9926-89b52f83ac0e for instance aacb7718-eb99-45ae-a61c-4e5e8770be8a on n-h1-846435-14 Jul 25 14:32:45.226064 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-1611b0f9-4177-4ef0-8997-0c8426dfe974 req-9b703af8-6800-4251-aae0-5e7a2eeed69c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035831 Jul 25 14:32:45.227213 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1009/1942] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:32:45.258201 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9a22b179-16e4-40f8-92bc-e5a1ba62dea8 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:45.267280 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9a22b179-16e4-40f8-92bc-e5a1ba62dea8 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 200 len: 1269 microversion: 2.1 time: 0.255328 Jul 25 14:32:45.268576 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 934/1943] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:45 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 1269 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:45.622292 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-49567e5d-a522-4d38-9ec7-ac5deac63eb6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:45.622965 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-49567e5d-a522-4d38-9ec7-ac5deac63eb6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:45.630044 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-49567e5d-a522-4d38-9ec7-ac5deac63eb6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:45.630491 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-49567e5d-a522-4d38-9ec7-ac5deac63eb6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:45.631266 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-49567e5d-a522-4d38-9ec7-ac5deac63eb6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:45.631737 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-49567e5d-a522-4d38-9ec7-ac5deac63eb6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:45.663669 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a1bc1523-981b-4bae-b5ed-7c3ec276ee0f tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:45.665088 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a1bc1523-981b-4bae-b5ed-7c3ec276ee0f tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:45.682281 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a1bc1523-981b-4bae-b5ed-7c3ec276ee0f tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:45.684602 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a1bc1523-981b-4bae-b5ed-7c3ec276ee0f tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:45.685906 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a1bc1523-981b-4bae-b5ed-7c3ec276ee0f tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:45.686561 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a1bc1523-981b-4bae-b5ed-7c3ec276ee0f tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:45.886029 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-49567e5d-a522-4d38-9ec7-ac5deac63eb6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:45.893794 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-49567e5d-a522-4d38-9ec7-ac5deac63eb6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:45.895287 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-49567e5d-a522-4d38-9ec7-ac5deac63eb6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:45.907338 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-49567e5d-a522-4d38-9ec7-ac5deac63eb6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1281 microversion: 2.25 time: 0.289628 Jul 25 14:32:45.907940 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1010/1944] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:32:45 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1281 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:32:46.099055 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-355e382f-ce1a-4bc8-9ba5-0977c661c4d0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:46.099571 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-355e382f-ce1a-4bc8-9ba5-0977c661c4d0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 742f8126-e737-4716-bb05-66e2ba318535] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:46.115880 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-355e382f-ce1a-4bc8-9ba5-0977c661c4d0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:46.116627 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-355e382f-ce1a-4bc8-9ba5-0977c661c4d0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:46.117630 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-355e382f-ce1a-4bc8-9ba5-0977c661c4d0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:46.118222 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-355e382f-ce1a-4bc8-9ba5-0977c661c4d0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:46.348536 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a1bc1523-981b-4bae-b5ed-7c3ec276ee0f tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:46.357383 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a1bc1523-981b-4bae-b5ed-7c3ec276ee0f tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1523 microversion: 2.1 time: 0.702718 Jul 25 14:32:46.362166 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 935/1945] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:45 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1523 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:46.373293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bc93789b-168f-48fc-8ca7-9f2febfbbb44 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:46.374751 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bc93789b-168f-48fc-8ca7-9f2febfbbb44 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:46.376456 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-355e382f-ce1a-4bc8-9ba5-0977c661c4d0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:46.393177 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-355e382f-ce1a-4bc8-9ba5-0977c661c4d0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535" status: 200 len: 1319 microversion: 2.1 time: 0.297813 Jul 25 14:32:46.393621 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1011/1946] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:46 2022] GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535 => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:32:46.408366 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bc93789b-168f-48fc-8ca7-9f2febfbbb44 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:46.409773 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bc93789b-168f-48fc-8ca7-9f2febfbbb44 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:46.410821 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bc93789b-168f-48fc-8ca7-9f2febfbbb44 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:46.411513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bc93789b-168f-48fc-8ca7-9f2febfbbb44 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:46.531931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bc93789b-168f-48fc-8ca7-9f2febfbbb44 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:46.545526 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bc93789b-168f-48fc-8ca7-9f2febfbbb44 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 200 len: 1269 microversion: 2.1 time: 0.179080 Jul 25 14:32:46.546660 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 936/1947] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:46 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 1269 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:46.609021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-acdfb996-95a7-4e21-903f-098bf44331cd req-64d70baa-0c6d-42d8-8813-5a12cd2e6160 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "742f8126-e737-4716-bb05-66e2ba318535", "tag": "4b3247ac-f0ea-4ca8-b22b-8bb5e2406e66"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:46.626075 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-acdfb996-95a7-4e21-903f-098bf44331cd req-64d70baa-0c6d-42d8-8813-5a12cd2e6160 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:46.628473 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-acdfb996-95a7-4e21-903f-098bf44331cd req-64d70baa-0c6d-42d8-8813-5a12cd2e6160 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:46.644177 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-acdfb996-95a7-4e21-903f-098bf44331cd req-64d70baa-0c6d-42d8-8813-5a12cd2e6160 service nova] Creating event network-changed:4b3247ac-f0ea-4ca8-b22b-8bb5e2406e66 for instance 742f8126-e737-4716-bb05-66e2ba318535 on n-h2-846435-14 Jul 25 14:32:46.656262 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-acdfb996-95a7-4e21-903f-098bf44331cd req-64d70baa-0c6d-42d8-8813-5a12cd2e6160 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055915 Jul 25 14:32:46.658317 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1012/1948] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:32:46.935470 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-30a3c899-e1ce-4742-8ca6-e5b554254064 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:46.937448 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-30a3c899-e1ce-4742-8ca6-e5b554254064 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:46.956937 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-30a3c899-e1ce-4742-8ca6-e5b554254064 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:46.958213 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-30a3c899-e1ce-4742-8ca6-e5b554254064 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:46.960203 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-30a3c899-e1ce-4742-8ca6-e5b554254064 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:46.961176 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-30a3c899-e1ce-4742-8ca6-e5b554254064 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:47.253011 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-25106238-560e-419d-bcb0-74079fb5e14b req-1052dc62-44f2-4632-bf2f-e1bea02a1ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "324085c2-5228-46ba-8b72-5ee6f112b1d2", "name": "network-vif-plugged", "status": "completed", "tag": "de9facd1-8929-497d-9f75-3802fcffc1d0"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:47.268688 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-25106238-560e-419d-bcb0-74079fb5e14b req-1052dc62-44f2-4632-bf2f-e1bea02a1ac9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:47.270592 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-25106238-560e-419d-bcb0-74079fb5e14b req-1052dc62-44f2-4632-bf2f-e1bea02a1ac9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:47.289179 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-25106238-560e-419d-bcb0-74079fb5e14b req-1052dc62-44f2-4632-bf2f-e1bea02a1ac9 service nova] Creating event network-vif-plugged:de9facd1-8929-497d-9f75-3802fcffc1d0 for instance 324085c2-5228-46ba-8b72-5ee6f112b1d2 on n-h1-846435-14 Jul 25 14:32:47.295647 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-25106238-560e-419d-bcb0-74079fb5e14b req-1052dc62-44f2-4632-bf2f-e1bea02a1ac9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049103 Jul 25 14:32:47.296293 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1013/1949] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:32:47.399852 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-70aaf412-6870-462d-b52e-14fcec78307e tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:47.400578 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-70aaf412-6870-462d-b52e-14fcec78307e tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:47.410899 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-70aaf412-6870-462d-b52e-14fcec78307e tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:47.411487 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-70aaf412-6870-462d-b52e-14fcec78307e tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:47.413096 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-70aaf412-6870-462d-b52e-14fcec78307e tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:47.413597 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-70aaf412-6870-462d-b52e-14fcec78307e tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:47.565463 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-70aaf412-6870-462d-b52e-14fcec78307e tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:47.573695 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-70aaf412-6870-462d-b52e-14fcec78307e tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1523 microversion: 2.1 time: 0.179857 Jul 25 14:32:47.574247 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1014/1950] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:47 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:47.591558 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-56b96a4e-cd09-48b7-a825-e9ddd9601728 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:47.592544 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-56b96a4e-cd09-48b7-a825-e9ddd9601728 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 742f8126-e737-4716-bb05-66e2ba318535] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:47.599201 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-56b96a4e-cd09-48b7-a825-e9ddd9601728 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:47.599706 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-56b96a4e-cd09-48b7-a825-e9ddd9601728 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:47.600761 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-56b96a4e-cd09-48b7-a825-e9ddd9601728 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:47.601252 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-56b96a4e-cd09-48b7-a825-e9ddd9601728 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:47.752717 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-56b96a4e-cd09-48b7-a825-e9ddd9601728 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:47.761090 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-56b96a4e-cd09-48b7-a825-e9ddd9601728 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535" status: 200 len: 1319 microversion: 2.1 time: 0.185507 Jul 25 14:32:47.762103 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1015/1951] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:47 2022] GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:47.779893 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bca3b8b6-7373-4b92-af09-37e4cc81c289 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:47.780775 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bca3b8b6-7373-4b92-af09-37e4cc81c289 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:47.787784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bca3b8b6-7373-4b92-af09-37e4cc81c289 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:47.787784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bca3b8b6-7373-4b92-af09-37e4cc81c289 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:47.788515 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bca3b8b6-7373-4b92-af09-37e4cc81c289 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:47.788933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bca3b8b6-7373-4b92-af09-37e4cc81c289 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:47.850190 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-30a3c899-e1ce-4742-8ca6-e5b554254064 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:47.861878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-30a3c899-e1ce-4742-8ca6-e5b554254064 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:47.864802 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-30a3c899-e1ce-4742-8ca6-e5b554254064 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:47.867922 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-30a3c899-e1ce-4742-8ca6-e5b554254064 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1281 microversion: 2.25 time: 0.937325 Jul 25 14:32:47.868839 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 937/1952] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:32:46 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1281 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:32:47.888741 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-94ec67b6-113d-4d95-98a8-edaf25a6e827 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:47.889194 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-94ec67b6-113d-4d95-98a8-edaf25a6e827 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] [instance: 44ad669c-e3e8-4b12-a64a-2245d98dea47] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:47.902400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-94ec67b6-113d-4d95-98a8-edaf25a6e827 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:47.902854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-94ec67b6-113d-4d95-98a8-edaf25a6e827 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:47.903638 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-94ec67b6-113d-4d95-98a8-edaf25a6e827 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:47.907574 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-94ec67b6-113d-4d95-98a8-edaf25a6e827 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:47.957017 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-94ec67b6-113d-4d95-98a8-edaf25a6e827 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] [instance: 44ad669c-e3e8-4b12-a64a-2245d98dea47] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:32:47.965860 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:32:48.012452 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bca3b8b6-7373-4b92-af09-37e4cc81c289 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:48.021696 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bca3b8b6-7373-4b92-af09-37e4cc81c289 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 200 len: 1311 microversion: 2.1 time: 0.245465 Jul 25 14:32:48.035919 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1016/1953] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:47 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 1311 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:48.043286 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-8adf9aad-da65-4d79-88b7-cc732a119de9 req-3e4dc12e-cdbd-4ddb-bc9e-830b63b62959 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a85a57f0-715f-47cd-ae19-463dfc5e7aca", "tag": "b6bbf444-a731-43c2-bb7a-c5a47d378689"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:48.052814 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:32:48.055805 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-8adf9aad-da65-4d79-88b7-cc732a119de9 req-3e4dc12e-cdbd-4ddb-bc9e-830b63b62959 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:48.056475 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-8adf9aad-da65-4d79-88b7-cc732a119de9 req-3e4dc12e-cdbd-4ddb-bc9e-830b63b62959 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:48.069771 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-8adf9aad-da65-4d79-88b7-cc732a119de9 req-3e4dc12e-cdbd-4ddb-bc9e-830b63b62959 service nova] Creating event network-changed:b6bbf444-a731-43c2-bb7a-c5a47d378689 for instance a85a57f0-715f-47cd-ae19-463dfc5e7aca on n-h2-846435-14 Jul 25 14:32:48.084166 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-8adf9aad-da65-4d79-88b7-cc732a119de9 req-3e4dc12e-cdbd-4ddb-bc9e-830b63b62959 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045339 Jul 25 14:32:48.085582 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-94ec67b6-113d-4d95-98a8-edaf25a6e827 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] 10.222.0.88 "DELETE /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47" status: 204 len: 0 microversion: 2.1 time: 0.212500 Jul 25 14:32:48.086596 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1017/1954] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:32:48.090141 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 938/1955] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:32:47 2022] DELETE /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:32:48.100086 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2398dde4-718e-4d6f-9ed4-e15d3bd71811 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:48.100920 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2398dde4-718e-4d6f-9ed4-e15d3bd71811 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] [instance: 44ad669c-e3e8-4b12-a64a-2245d98dea47] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:48.124757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2398dde4-718e-4d6f-9ed4-e15d3bd71811 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:48.126349 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2398dde4-718e-4d6f-9ed4-e15d3bd71811 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:48.127454 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2398dde4-718e-4d6f-9ed4-e15d3bd71811 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:48.128264 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2398dde4-718e-4d6f-9ed4-e15d3bd71811 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:48.306513 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2398dde4-718e-4d6f-9ed4-e15d3bd71811 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cd21f1fcc145d7a854c1a6b3005a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bbc39957d740eeb578bf4e7ebb931e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:48.314583 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2398dde4-718e-4d6f-9ed4-e15d3bd71811 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] 10.222.0.88 "GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47" status: 200 len: 1664 microversion: 2.1 time: 0.222607 Jul 25 14:32:48.315164 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1018/1956] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:48 2022] GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47 => generated 1664 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:48.597213 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2e93b9c2-8df7-437a-9a68-144d54c3269a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:48.597923 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2e93b9c2-8df7-437a-9a68-144d54c3269a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:48.606772 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2e93b9c2-8df7-437a-9a68-144d54c3269a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:48.607791 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2e93b9c2-8df7-437a-9a68-144d54c3269a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:48.608741 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2e93b9c2-8df7-437a-9a68-144d54c3269a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:48.609433 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2e93b9c2-8df7-437a-9a68-144d54c3269a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:48.782253 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-99d76c04-7e01-4df1-936d-244cd0dfc388 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:48.782868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-99d76c04-7e01-4df1-936d-244cd0dfc388 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 742f8126-e737-4716-bb05-66e2ba318535] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:48.789375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-99d76c04-7e01-4df1-936d-244cd0dfc388 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:48.790032 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-99d76c04-7e01-4df1-936d-244cd0dfc388 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:48.790991 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-99d76c04-7e01-4df1-936d-244cd0dfc388 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:48.791483 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-99d76c04-7e01-4df1-936d-244cd0dfc388 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:48.829066 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2e93b9c2-8df7-437a-9a68-144d54c3269a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:48.843728 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2e93b9c2-8df7-437a-9a68-144d54c3269a tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1523 microversion: 2.1 time: 0.251146 Jul 25 14:32:48.846785 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 939/1957] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:48 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1523 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:48.900393 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5efe297c-f31f-49c1-99dc-0a1694ed9b68 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:48.901307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5efe297c-f31f-49c1-99dc-0a1694ed9b68 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:48.907909 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5efe297c-f31f-49c1-99dc-0a1694ed9b68 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:48.908768 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5efe297c-f31f-49c1-99dc-0a1694ed9b68 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:48.909747 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5efe297c-f31f-49c1-99dc-0a1694ed9b68 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:48.910340 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5efe297c-f31f-49c1-99dc-0a1694ed9b68 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:48.939932 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-99d76c04-7e01-4df1-936d-244cd0dfc388 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:48.950164 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-99d76c04-7e01-4df1-936d-244cd0dfc388 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535" status: 200 len: 1319 microversion: 2.1 time: 0.171644 Jul 25 14:32:48.950758 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1019/1958] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:48 2022] GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:32:49.045693 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b2178378-1aaa-48cd-897c-45896cbc9bde tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:49.046369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b2178378-1aaa-48cd-897c-45896cbc9bde tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:49.055406 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b2178378-1aaa-48cd-897c-45896cbc9bde tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:49.055859 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b2178378-1aaa-48cd-897c-45896cbc9bde tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:49.056671 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b2178378-1aaa-48cd-897c-45896cbc9bde tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:49.057303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b2178378-1aaa-48cd-897c-45896cbc9bde tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:49.118198 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5efe297c-f31f-49c1-99dc-0a1694ed9b68 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:49.130745 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5efe297c-f31f-49c1-99dc-0a1694ed9b68 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:49.131931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5efe297c-f31f-49c1-99dc-0a1694ed9b68 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:49.138347 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5efe297c-f31f-49c1-99dc-0a1694ed9b68 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1281 microversion: 2.25 time: 0.244267 Jul 25 14:32:49.139484 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 940/1959] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:32:48 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1281 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:32:49.217813 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b2178378-1aaa-48cd-897c-45896cbc9bde tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:49.225828 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b2178378-1aaa-48cd-897c-45896cbc9bde tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 200 len: 1332 microversion: 2.1 time: 0.186145 Jul 25 14:32:49.226411 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1020/1960] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:49 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 1332 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:49.336029 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a5a56f76-294a-4edf-ac8f-64646cdd3ba2 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:49.336807 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a5a56f76-294a-4edf-ac8f-64646cdd3ba2 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] [instance: 44ad669c-e3e8-4b12-a64a-2245d98dea47] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:49.343438 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a5a56f76-294a-4edf-ac8f-64646cdd3ba2 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:49.343942 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a5a56f76-294a-4edf-ac8f-64646cdd3ba2 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:49.344720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a5a56f76-294a-4edf-ac8f-64646cdd3ba2 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:49.345152 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a5a56f76-294a-4edf-ac8f-64646cdd3ba2 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:49.345853 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-a7a47c1f-75e6-4206-8427-ee0beefd2fcd req-27cc8f00-e7fb-48fe-a945-6a44de4e5c26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aacb7718-eb99-45ae-a61c-4e5e8770be8a", "name": "network-vif-plugged", "status": "completed", "tag": "0bbbda3d-8d02-4c28-9926-89b52f83ac0e"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:49.363396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a7a47c1f-75e6-4206-8427-ee0beefd2fcd req-27cc8f00-e7fb-48fe-a945-6a44de4e5c26 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:49.366453 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a7a47c1f-75e6-4206-8427-ee0beefd2fcd req-27cc8f00-e7fb-48fe-a945-6a44de4e5c26 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:49.379830 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-a7a47c1f-75e6-4206-8427-ee0beefd2fcd req-27cc8f00-e7fb-48fe-a945-6a44de4e5c26 service nova] Creating event network-vif-plugged:0bbbda3d-8d02-4c28-9926-89b52f83ac0e for instance aacb7718-eb99-45ae-a61c-4e5e8770be8a on n-h1-846435-14 Jul 25 14:32:49.387123 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-a7a47c1f-75e6-4206-8427-ee0beefd2fcd req-27cc8f00-e7fb-48fe-a945-6a44de4e5c26 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045322 Jul 25 14:32:49.388118 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1021/1961] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:32:49.602949 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a5a56f76-294a-4edf-ac8f-64646cdd3ba2 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cd21f1fcc145d7a854c1a6b3005a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bbc39957d740eeb578bf4e7ebb931e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:49.622607 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a5a56f76-294a-4edf-ac8f-64646cdd3ba2 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] 10.222.0.88 "GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47" status: 200 len: 1664 microversion: 2.1 time: 0.290638 Jul 25 14:32:49.623843 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 941/1962] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:49 2022] GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47 => generated 1664 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:49.870282 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3553b759-a8ea-457d-8d64-0202194dd554 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:49.871564 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3553b759-a8ea-457d-8d64-0202194dd554 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:49.877793 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3553b759-a8ea-457d-8d64-0202194dd554 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:49.878242 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3553b759-a8ea-457d-8d64-0202194dd554 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:49.879014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3553b759-a8ea-457d-8d64-0202194dd554 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:49.879447 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3553b759-a8ea-457d-8d64-0202194dd554 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:49.974329 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-98523ff6-b5cf-41f0-8179-36f2184c0fa0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:49.975070 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-98523ff6-b5cf-41f0-8179-36f2184c0fa0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 742f8126-e737-4716-bb05-66e2ba318535] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:49.984429 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-98523ff6-b5cf-41f0-8179-36f2184c0fa0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:49.985316 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-98523ff6-b5cf-41f0-8179-36f2184c0fa0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:49.987204 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-98523ff6-b5cf-41f0-8179-36f2184c0fa0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:49.988015 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-98523ff6-b5cf-41f0-8179-36f2184c0fa0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:50.209510 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3553b759-a8ea-457d-8d64-0202194dd554 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:50.221170 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3553b759-a8ea-457d-8d64-0202194dd554 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1523 microversion: 2.1 time: 0.355322 Jul 25 14:32:50.230637 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1022/1963] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:49 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1523 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:50.236570 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-682f4510-c6fe-4daa-a805-5fa4ac43cf12 req-8d9c8483-304a-4f1d-9c57-29ec079f6d85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "735eedac-478a-4b11-9fb3-479179270d35", "tag": "b41659ca-fc34-401c-8b74-8f49d9f18e92"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:50.250597 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-682f4510-c6fe-4daa-a805-5fa4ac43cf12 req-8d9c8483-304a-4f1d-9c57-29ec079f6d85 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:50.251824 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-682f4510-c6fe-4daa-a805-5fa4ac43cf12 req-8d9c8483-304a-4f1d-9c57-29ec079f6d85 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:50.266806 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-682f4510-c6fe-4daa-a805-5fa4ac43cf12 req-8d9c8483-304a-4f1d-9c57-29ec079f6d85 service nova] Creating event network-changed:b41659ca-fc34-401c-8b74-8f49d9f18e92 for instance 735eedac-478a-4b11-9fb3-479179270d35 on n-h2-846435-14 Jul 25 14:32:50.271433 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-682f4510-c6fe-4daa-a805-5fa4ac43cf12 req-8d9c8483-304a-4f1d-9c57-29ec079f6d85 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039202 Jul 25 14:32:50.272252 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1023/1964] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:32:50.277355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a1e53d4e-7128-4326-932b-bb9028bd1f10 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:50.278079 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a1e53d4e-7128-4326-932b-bb9028bd1f10 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:50.284687 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1e53d4e-7128-4326-932b-bb9028bd1f10 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:50.285136 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1e53d4e-7128-4326-932b-bb9028bd1f10 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:50.285913 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1e53d4e-7128-4326-932b-bb9028bd1f10 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:50.286388 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1e53d4e-7128-4326-932b-bb9028bd1f10 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:50.391331 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-98523ff6-b5cf-41f0-8179-36f2184c0fa0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:50.402694 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-98523ff6-b5cf-41f0-8179-36f2184c0fa0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535" status: 200 len: 1319 microversion: 2.1 time: 0.433044 Jul 25 14:32:50.403923 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 942/1965] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:49 2022] GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535 => generated 1319 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:50.409400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0d367c99-6d75-42b6-a94f-62cce373ec8c tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:50.410674 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0d367c99-6d75-42b6-a94f-62cce373ec8c tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:50.418229 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0d367c99-6d75-42b6-a94f-62cce373ec8c tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:50.418939 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0d367c99-6d75-42b6-a94f-62cce373ec8c tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:50.419914 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0d367c99-6d75-42b6-a94f-62cce373ec8c tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:50.420566 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0d367c99-6d75-42b6-a94f-62cce373ec8c tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:50.915598 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0d367c99-6d75-42b6-a94f-62cce373ec8c tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:50.930237 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0d367c99-6d75-42b6-a94f-62cce373ec8c tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 200 len: 1332 microversion: 2.1 time: 0.524805 Jul 25 14:32:50.941526 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 943/1966] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:50 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 1332 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:50.946949 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-21b6e3b2-6c9b-48a6-95ab-c9c85351ea00 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:50.947535 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-21b6e3b2-6c9b-48a6-95ab-c9c85351ea00 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] [instance: 44ad669c-e3e8-4b12-a64a-2245d98dea47] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:50.958425 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-21b6e3b2-6c9b-48a6-95ab-c9c85351ea00 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:50.959140 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-21b6e3b2-6c9b-48a6-95ab-c9c85351ea00 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:50.960300 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-21b6e3b2-6c9b-48a6-95ab-c9c85351ea00 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:50.960905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-21b6e3b2-6c9b-48a6-95ab-c9c85351ea00 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:51.003413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a1e53d4e-7128-4326-932b-bb9028bd1f10 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:51.015811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a1e53d4e-7128-4326-932b-bb9028bd1f10 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:51.017883 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a1e53d4e-7128-4326-932b-bb9028bd1f10 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:51.019424 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a1e53d4e-7128-4326-932b-bb9028bd1f10 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1281 microversion: 2.25 time: 0.746248 Jul 25 14:32:51.020800 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1024/1967] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:32:50 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1281 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:32:51.243395 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-722f1616-e689-472a-8cda-cff48eb74e06 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:51.244166 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-722f1616-e689-472a-8cda-cff48eb74e06 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:51.250747 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-722f1616-e689-472a-8cda-cff48eb74e06 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:51.251304 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-722f1616-e689-472a-8cda-cff48eb74e06 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:51.252271 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-722f1616-e689-472a-8cda-cff48eb74e06 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:51.253210 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-722f1616-e689-472a-8cda-cff48eb74e06 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:51.400390 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-722f1616-e689-472a-8cda-cff48eb74e06 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:51.409204 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-722f1616-e689-472a-8cda-cff48eb74e06 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1523 microversion: 2.1 time: 0.170866 Jul 25 14:32:51.409807 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1025/1968] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:51 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:32:51.428926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0fd8fd44-ce81-4a92-9587-80f7ce99befb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:51.429674 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0fd8fd44-ce81-4a92-9587-80f7ce99befb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 742f8126-e737-4716-bb05-66e2ba318535] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:51.436358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0fd8fd44-ce81-4a92-9587-80f7ce99befb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:51.436812 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0fd8fd44-ce81-4a92-9587-80f7ce99befb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:51.437583 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0fd8fd44-ce81-4a92-9587-80f7ce99befb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:51.438021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0fd8fd44-ce81-4a92-9587-80f7ce99befb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:51.565712 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-21b6e3b2-6c9b-48a6-95ab-c9c85351ea00 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cd21f1fcc145d7a854c1a6b3005a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bbc39957d740eeb578bf4e7ebb931e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:51.574419 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-21b6e3b2-6c9b-48a6-95ab-c9c85351ea00 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] 10.222.0.88 "GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47" status: 200 len: 1664 microversion: 2.1 time: 0.631413 Jul 25 14:32:51.575003 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 944/1969] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:50 2022] GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47 => generated 1664 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:51.579168 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0fd8fd44-ce81-4a92-9587-80f7ce99befb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:51.588468 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0fd8fd44-ce81-4a92-9587-80f7ce99befb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535" status: 200 len: 1319 microversion: 2.1 time: 0.168076 Jul 25 14:32:51.589058 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1026/1970] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:51 2022] GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:51.959928 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-23cc5a37-647b-452d-be5c-1cf39eb4cb14 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:51.960563 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-23cc5a37-647b-452d-be5c-1cf39eb4cb14 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:51.967008 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-23cc5a37-647b-452d-be5c-1cf39eb4cb14 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:51.967491 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-23cc5a37-647b-452d-be5c-1cf39eb4cb14 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:51.968428 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-23cc5a37-647b-452d-be5c-1cf39eb4cb14 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:51.968909 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-23cc5a37-647b-452d-be5c-1cf39eb4cb14 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:52.043714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:32:52.044137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-107b58b4-f22d-4025-9efd-feb2fdf5dce5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:52.045287 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-107b58b4-f22d-4025-9efd-feb2fdf5dce5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:52.052808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-107b58b4-f22d-4025-9efd-feb2fdf5dce5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:52.053257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-107b58b4-f22d-4025-9efd-feb2fdf5dce5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:52.054016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-107b58b4-f22d-4025-9efd-feb2fdf5dce5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:52.054444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-107b58b4-f22d-4025-9efd-feb2fdf5dce5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:52.207317 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-107b58b4-f22d-4025-9efd-feb2fdf5dce5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:52.218262 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-107b58b4-f22d-4025-9efd-feb2fdf5dce5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:52.220006 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-107b58b4-f22d-4025-9efd-feb2fdf5dce5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:52.221309 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-107b58b4-f22d-4025-9efd-feb2fdf5dce5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1478 microversion: 2.25 time: 0.181841 Jul 25 14:32:52.224401 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1027/1971] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:32:52 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1478 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:32:52.244083 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-671b34f5-5c75-4d3a-8642-68893a5fa351 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:52.255662 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-671b34f5-5c75-4d3a-8642-68893a5fa351 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:52.269068 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-671b34f5-5c75-4d3a-8642-68893a5fa351 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:52.271244 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-671b34f5-5c75-4d3a-8642-68893a5fa351 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:52.272836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-671b34f5-5c75-4d3a-8642-68893a5fa351 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:52.273635 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-671b34f5-5c75-4d3a-8642-68893a5fa351 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:52.361739 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-23cc5a37-647b-452d-be5c-1cf39eb4cb14 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:52.378692 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-23cc5a37-647b-452d-be5c-1cf39eb4cb14 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 200 len: 1353 microversion: 2.1 time: 0.422611 Jul 25 14:32:52.397344 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 945/1972] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:51 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 1353 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:52.437373 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-40d434d3-3c4b-4539-bc1b-397474553ae8 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:52.438295 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-40d434d3-3c4b-4539-bc1b-397474553ae8 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:52.449452 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-40d434d3-3c4b-4539-bc1b-397474553ae8 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:52.450213 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-40d434d3-3c4b-4539-bc1b-397474553ae8 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:52.453084 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-40d434d3-3c4b-4539-bc1b-397474553ae8 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:52.453543 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-40d434d3-3c4b-4539-bc1b-397474553ae8 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:52.510141 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-671b34f5-5c75-4d3a-8642-68893a5fa351 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lazy-loading 'services' on Instance uuid 324085c2-5228-46ba-8b72-5ee6f112b1d2 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:32:52.530665 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-671b34f5-5c75-4d3a-8642-68893a5fa351 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1973 microversion: 2.25 time: 0.288659 Jul 25 14:32:52.537453 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1028/1973] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:32:52 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1973 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:32:52.538515 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=40 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:32:52.547273 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-6b394bfc-58cc-46fb-ac58-1e9f5ce739e3 req-fe46a537-8850-4a1d-8512-801ba7f2c117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ad669c-e3e8-4b12-a64a-2245d98dea47", "name": "network-vif-deleted", "tag": "20563043-6910-4985-80ca-a42cb70b9786"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:52.561964 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-6b394bfc-58cc-46fb-ac58-1e9f5ce739e3 req-fe46a537-8850-4a1d-8512-801ba7f2c117 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:52.562686 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-6b394bfc-58cc-46fb-ac58-1e9f5ce739e3 req-fe46a537-8850-4a1d-8512-801ba7f2c117 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:52.576364 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-6b394bfc-58cc-46fb-ac58-1e9f5ce739e3 req-fe46a537-8850-4a1d-8512-801ba7f2c117 service nova] Creating event network-vif-deleted:20563043-6910-4985-80ca-a42cb70b9786 for instance 44ad669c-e3e8-4b12-a64a-2245d98dea47 on n-h1-846435-14 Jul 25 14:32:52.583626 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-6b394bfc-58cc-46fb-ac58-1e9f5ce739e3 req-fe46a537-8850-4a1d-8512-801ba7f2c117 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042174 Jul 25 14:32:52.584672 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1029/1974] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:32:52.590891 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-93ab0348-5461-49e8-8d89-6cf6b6c53321 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:52.591867 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-93ab0348-5461-49e8-8d89-6cf6b6c53321 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:52.602657 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-93ab0348-5461-49e8-8d89-6cf6b6c53321 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:52.603375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-93ab0348-5461-49e8-8d89-6cf6b6c53321 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:52.604586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-93ab0348-5461-49e8-8d89-6cf6b6c53321 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:52.605187 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-93ab0348-5461-49e8-8d89-6cf6b6c53321 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:52.611871 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:32:52.783724 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-93ab0348-5461-49e8-8d89-6cf6b6c53321 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lazy-loading 'services' on Instance uuid 324085c2-5228-46ba-8b72-5ee6f112b1d2 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:32:52.784350 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-40d434d3-3c4b-4539-bc1b-397474553ae8 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:52.799711 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-93ab0348-5461-49e8-8d89-6cf6b6c53321 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1973 microversion: 2.25 time: 0.213691 Jul 25 14:32:52.812010 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1030/1975] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:32:52 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1973 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:32:52.812230 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-40d434d3-3c4b-4539-bc1b-397474553ae8 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1508 microversion: 2.1 time: 0.371334 Jul 25 14:32:52.812230 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 946/1976] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:52 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1508 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:52.812440 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cd121676-ed1e-4af6-bf10-186da4359c4e tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:52.812440 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cd121676-ed1e-4af6-bf10-186da4359c4e tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] [instance: 44ad669c-e3e8-4b12-a64a-2245d98dea47] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:52.812601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fccfb40e-1483-4e29-bdca-b9621298b9f5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:52.812601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fccfb40e-1483-4e29-bdca-b9621298b9f5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 742f8126-e737-4716-bb05-66e2ba318535] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:52.812939 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cd121676-ed1e-4af6-bf10-186da4359c4e tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:52.813388 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cd121676-ed1e-4af6-bf10-186da4359c4e tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:52.814172 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cd121676-ed1e-4af6-bf10-186da4359c4e tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:52.814671 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cd121676-ed1e-4af6-bf10-186da4359c4e tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:52.841554 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fccfb40e-1483-4e29-bdca-b9621298b9f5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:52.842216 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fccfb40e-1483-4e29-bdca-b9621298b9f5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:52.843181 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fccfb40e-1483-4e29-bdca-b9621298b9f5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:52.846172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fccfb40e-1483-4e29-bdca-b9621298b9f5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:52.867215 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cd121676-ed1e-4af6-bf10-186da4359c4e tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:52.867664 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cd121676-ed1e-4af6-bf10-186da4359c4e tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:52.868149 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-cd121676-ed1e-4af6-bf10-186da4359c4e tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lazy-loading 'fault' on Instance uuid 44ad669c-e3e8-4b12-a64a-2245d98dea47 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:32:52.918004 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cd121676-ed1e-4af6-bf10-186da4359c4e tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cd21f1fcc145d7a854c1a6b3005a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bbc39957d740eeb578bf4e7ebb931e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:52.928635 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cd121676-ed1e-4af6-bf10-186da4359c4e tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] 10.222.0.88 "GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47" status: 200 len: 1316 microversion: 2.1 time: 0.126629 Jul 25 14:32:52.929238 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1031/1977] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:52 2022] GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47 => generated 1316 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:52.938299 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-35663803-f819-41c5-a975-7eeb61a71f72 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:52.939425 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-35663803-f819-41c5-a975-7eeb61a71f72 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:52.948220 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35663803-f819-41c5-a975-7eeb61a71f72 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:52.948734 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35663803-f819-41c5-a975-7eeb61a71f72 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:52.949786 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35663803-f819-41c5-a975-7eeb61a71f72 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:52.950231 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35663803-f819-41c5-a975-7eeb61a71f72 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:53.134364 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-35663803-f819-41c5-a975-7eeb61a71f72 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:53.143415 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-35663803-f819-41c5-a975-7eeb61a71f72 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 200 len: 1508 microversion: 2.1 time: 0.208843 Jul 25 14:32:53.144304 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1032/1978] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:52 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 1508 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:53.155542 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fccfb40e-1483-4e29-bdca-b9621298b9f5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:53.165527 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fccfb40e-1483-4e29-bdca-b9621298b9f5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535" status: 200 len: 1319 microversion: 2.1 time: 0.360559 Jul 25 14:32:53.166317 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1e207a74-2244-4d67-bd78-bdda71e02d20 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:53.168741 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 947/1979] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:52 2022] GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535 => generated 1319 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:53.170060 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:32:53.170060 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:32:53.171590 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1e207a74-2244-4d67-bd78-bdda71e02d20 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:53.172207 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1e207a74-2244-4d67-bd78-bdda71e02d20 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:53.173096 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1e207a74-2244-4d67-bd78-bdda71e02d20 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:53.173745 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1e207a74-2244-4d67-bd78-bdda71e02d20 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:53.184238 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7ab8217e-1891-4113-be40-e3bc0a501692 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:53.185086 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7ab8217e-1891-4113-be40-e3bc0a501692 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:53.200814 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ab8217e-1891-4113-be40-e3bc0a501692 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:53.201560 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ab8217e-1891-4113-be40-e3bc0a501692 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:53.202570 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ab8217e-1891-4113-be40-e3bc0a501692 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:53.203241 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ab8217e-1891-4113-be40-e3bc0a501692 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:53.204259 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1e207a74-2244-4d67-bd78-bdda71e02d20 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.046399 Jul 25 14:32:53.205072 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1033/1980] 10.222.0.88 () {60 vars in 1217 bytes} [Mon Jul 25 14:32:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:32:53.227462 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-48bce85f-393c-4477-b2cc-c7060b6b7ef4 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846435-14", "block_migration": "auto"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:53.230120 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-48bce85f-393c-4477-b2cc-c7060b6b7ef4 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:53.239224 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:32:53.241149 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48bce85f-393c-4477-b2cc-c7060b6b7ef4 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:53.241697 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48bce85f-393c-4477-b2cc-c7060b6b7ef4 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:53.245745 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48bce85f-393c-4477-b2cc-c7060b6b7ef4 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:53.246638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48bce85f-393c-4477-b2cc-c7060b6b7ef4 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:53.266677 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7ab8217e-1891-4113-be40-e3bc0a501692 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:32:53.282266 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-48bce85f-393c-4477-b2cc-c7060b6b7ef4 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lazy-loading 'flavor' on Instance uuid 324085c2-5228-46ba-8b72-5ee6f112b1d2 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:32:53.307607 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-48bce85f-393c-4477-b2cc-c7060b6b7ef4 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Going to try to live migrate instance to n-h2-846435-14 {{(pid=119304) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 14:32:53.427435 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7ab8217e-1891-4113-be40-e3bc0a501692 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "DELETE /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 204 len: 0 microversion: 2.1 time: 0.256839 Jul 25 14:32:53.428800 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 948/1981] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:32:53 2022] DELETE /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:32:53.457770 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-14e1c873-5891-4580-ac51-46d58f4b0a7e req-d5df3714-9f73-4254-85f5-7c8ea7bfdf82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "742f8126-e737-4716-bb05-66e2ba318535", "name": "network-vif-plugged", "status": "completed", "tag": "4b3247ac-f0ea-4ca8-b22b-8bb5e2406e66"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:53.493311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-14e1c873-5891-4580-ac51-46d58f4b0a7e req-d5df3714-9f73-4254-85f5-7c8ea7bfdf82 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:53.493956 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-14e1c873-5891-4580-ac51-46d58f4b0a7e req-d5df3714-9f73-4254-85f5-7c8ea7bfdf82 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:53.531201 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-14e1c873-5891-4580-ac51-46d58f4b0a7e req-d5df3714-9f73-4254-85f5-7c8ea7bfdf82 service nova] Creating event network-vif-plugged:4b3247ac-f0ea-4ca8-b22b-8bb5e2406e66 for instance 742f8126-e737-4716-bb05-66e2ba318535 on n-h2-846435-14 Jul 25 14:32:53.546966 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-14e1c873-5891-4580-ac51-46d58f4b0a7e req-d5df3714-9f73-4254-85f5-7c8ea7bfdf82 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113592 Jul 25 14:32:53.549094 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 949/1982] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:32:53.556468 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ccdd4981-5843-46c3-affd-1c4a9d0d4a67 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:53.557386 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ccdd4981-5843-46c3-affd-1c4a9d0d4a67 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:53.564310 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ccdd4981-5843-46c3-affd-1c4a9d0d4a67 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:53.564745 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ccdd4981-5843-46c3-affd-1c4a9d0d4a67 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:53.565866 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ccdd4981-5843-46c3-affd-1c4a9d0d4a67 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:53.566457 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ccdd4981-5843-46c3-affd-1c4a9d0d4a67 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:53.866188 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ccdd4981-5843-46c3-affd-1c4a9d0d4a67 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:53.877107 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ccdd4981-5843-46c3-affd-1c4a9d0d4a67 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 200 len: 1353 microversion: 2.1 time: 0.326751 Jul 25 14:32:53.881363 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 950/1983] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:53 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 1353 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:53.905087 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-019a327f-2a7e-4060-9666-eeb0fbc77742 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1506717232", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "02a1497d-2151-4500-a802-575a0ee651dc"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:54.005614 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-019a327f-2a7e-4060-9666-eeb0fbc77742 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] validate_networks() for [('02a1497d-2151-4500-a802-575a0ee651dc', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:32:54.895040 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-019a327f-2a7e-4060-9666-eeb0fbc77742 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:32:54.896239 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-019a327f-2a7e-4060-9666-eeb0fbc77742 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:32:54.896953 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-019a327f-2a7e-4060-9666-eeb0fbc77742 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:32:54.898139 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-019a327f-2a7e-4060-9666-eeb0fbc77742 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:32:54.898791 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-019a327f-2a7e-4060-9666-eeb0fbc77742 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:32:54.908266 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-019a327f-2a7e-4060-9666-eeb0fbc77742 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:54.908701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-019a327f-2a7e-4060-9666-eeb0fbc77742 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:54.909703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-019a327f-2a7e-4060-9666-eeb0fbc77742 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:54.910149 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-019a327f-2a7e-4060-9666-eeb0fbc77742 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:54.928756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-019a327f-2a7e-4060-9666-eeb0fbc77742 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Getting quotas for project c8a6408dd1d343b0a82c8ec6d1b7d5af. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:32:54.934724 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-019a327f-2a7e-4060-9666-eeb0fbc77742 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Getting quotas for user 0f6a08479a4a4520b25a5b2e20c99670 and project c8a6408dd1d343b0a82c8ec6d1b7d5af. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:32:54.948266 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-019a327f-2a7e-4060-9666-eeb0fbc77742 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:32:54.950641 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-019a327f-2a7e-4060-9666-eeb0fbc77742 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:32:54.983638 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:32:55.004921 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-019a327f-2a7e-4060-9666-eeb0fbc77742 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.107363 Jul 25 14:32:55.005778 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 951/1984] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:32:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:32:55.010331 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c91d6c86-2637-4c43-9e57-664721a85c40 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:55.011108 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c91d6c86-2637-4c43-9e57-664721a85c40 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] [instance: 44ad669c-e3e8-4b12-a64a-2245d98dea47] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:55.021563 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c91d6c86-2637-4c43-9e57-664721a85c40 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:55.022154 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c91d6c86-2637-4c43-9e57-664721a85c40 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:55.023316 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c91d6c86-2637-4c43-9e57-664721a85c40 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:55.023867 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c91d6c86-2637-4c43-9e57-664721a85c40 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:55.039410 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-c91d6c86-2637-4c43-9e57-664721a85c40 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] HTTP exception thrown: Instance 44ad669c-e3e8-4b12-a64a-2245d98dea47 could not be found. Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c91d6c86-2637-4c43-9e57-664721a85c40 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Request method failure captured: Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47 HTTP/1.1 Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qlPnzMM1fuoM39zW7b_1uWrxKlexK5Q171QlfLl4GvZ8hK7W9z5myQ7SYyE0nqkBpBaBHEsbuI-Y0lQsLBy-bu92NF9EQf3G00hYsGXMvGbT_8e-jRqGwELH6RsBeq-rFnGsvv4ggBFj8EwsVEf-cUsRO4ohQbpe18KtSTOlGQkqjk Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: c4bbc39957d740eeb578bf4e7ebb931e Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersTestFqdnHostnames-2146575728 Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c4bbc39957d740eeb578bf4e7ebb931e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c4bbc39957d740eeb578bf4e7ebb931e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c4bbc39957d740eeb578bf4e7ebb931e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c4bbc39957d740eeb578bf4e7ebb931e"}]}] Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersTestFqdnHostnames-2146575728 Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: c4bbc39957d740eeb578bf4e7ebb931e Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-2146575728 Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersTestFqdnHostnames-2146575728-project Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 99cd21f1fcc145d7a854c1a6b3005a59 Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersTestFqdnHostnames-2146575728-project Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 44ad669c-e3e8-4b12-a64a-2245d98dea47 could not be found. Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '44ad669c-e3e8-4b12-a64a-2245d98dea47'} Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44ad669c-e3e8-4b12-a64a-2245d98dea47 could not be found. Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44ad669c-e3e8-4b12-a64a-2245d98dea47 could not be found. Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:32:55.041255 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:32:55.047642 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:32:55.047642 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:32:55.047642 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:32:55.047642 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:32:55.047642 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:32:55.047642 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44ad669c-e3e8-4b12-a64a-2245d98dea47 could not be found. Jul 25 14:32:55.047642 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:32:55.047642 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c91d6c86-2637-4c43-9e57-664721a85c40 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Returning 404 to user: Instance 44ad669c-e3e8-4b12-a64a-2245d98dea47 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:32:55.047642 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c91d6c86-2637-4c43-9e57-664721a85c40 tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] 10.222.0.88 "GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47" status: 404 len: 111 microversion: 2.1 time: 0.036094 Jul 25 14:32:55.047642 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 952/1985] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:55 2022] GET /compute/v2.1/servers/44ad669c-e3e8-4b12-a64a-2245d98dea47 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:32:55.052631 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-176532eb-2779-4c95-8d2d-b6457b1fbfc8 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:55.053526 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-176532eb-2779-4c95-8d2d-b6457b1fbfc8 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 742f8126-e737-4716-bb05-66e2ba318535] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:55.059946 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-176532eb-2779-4c95-8d2d-b6457b1fbfc8 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:55.060500 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-176532eb-2779-4c95-8d2d-b6457b1fbfc8 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:55.061501 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-176532eb-2779-4c95-8d2d-b6457b1fbfc8 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:55.062004 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-176532eb-2779-4c95-8d2d-b6457b1fbfc8 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:55.658857 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-48bce85f-393c-4477-b2cc-c7060b6b7ef4 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2/action" status: 202 len: 0 microversion: 2.25 time: 2.444460 Jul 25 14:32:55.660739 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1034/1986] 10.222.0.88 () {62 vars in 1319 bytes} [Mon Jul 25 14:32:53 2022] POST /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2/action => generated 0 bytes in 2447 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:32:55.669359 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-61f21d37-8a9b-4358-b161-abbb59bec74a req-19df856f-2846-4920-8683-534cbf657941 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc", "tag": "a73bae6a-8192-437d-9578-029a5f5211b2"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:55.685353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-61f21d37-8a9b-4358-b161-abbb59bec74a req-19df856f-2846-4920-8683-534cbf657941 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:55.686490 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-61f21d37-8a9b-4358-b161-abbb59bec74a req-19df856f-2846-4920-8683-534cbf657941 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:55.701326 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-61f21d37-8a9b-4358-b161-abbb59bec74a req-19df856f-2846-4920-8683-534cbf657941 service nova] Creating event network-changed:a73bae6a-8192-437d-9578-029a5f5211b2 for instance c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc on n-h1-846435-14 Jul 25 14:32:55.707789 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-61f21d37-8a9b-4358-b161-abbb59bec74a req-19df856f-2846-4920-8683-534cbf657941 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045000 Jul 25 14:32:55.709012 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1035/1987] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:32:55.716568 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-176532eb-2779-4c95-8d2d-b6457b1fbfc8 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:55.717526 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-65f470b5-6c7b-4402-a7f4-837311bfe22b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:55.718463 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-65f470b5-6c7b-4402-a7f4-837311bfe22b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:55.730886 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-176532eb-2779-4c95-8d2d-b6457b1fbfc8 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535" status: 200 len: 1319 microversion: 2.1 time: 0.682349 Jul 25 14:32:55.746681 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 953/1988] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:55 2022] GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535 => generated 1319 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:55.759823 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4e27acd8-25d3-4a54-aa56-67a1a3bb94d2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:55.760793 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4e27acd8-25d3-4a54-aa56-67a1a3bb94d2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:55.765785 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-65f470b5-6c7b-4402-a7f4-837311bfe22b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:55.768394 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4e27acd8-25d3-4a54-aa56-67a1a3bb94d2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:55.768568 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-65f470b5-6c7b-4402-a7f4-837311bfe22b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:55.769251 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4e27acd8-25d3-4a54-aa56-67a1a3bb94d2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:55.769397 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-65f470b5-6c7b-4402-a7f4-837311bfe22b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:55.770435 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4e27acd8-25d3-4a54-aa56-67a1a3bb94d2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:55.771135 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4e27acd8-25d3-4a54-aa56-67a1a3bb94d2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:55.773220 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-65f470b5-6c7b-4402-a7f4-837311bfe22b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:55.779939 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:32:55.894274 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4e27acd8-25d3-4a54-aa56-67a1a3bb94d2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:55.907844 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4e27acd8-25d3-4a54-aa56-67a1a3bb94d2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10" status: 200 len: 1214 microversion: 2.1 time: 0.156220 Jul 25 14:32:55.910183 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 954/1989] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:55 2022] GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 => generated 1214 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:55.918595 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6f7326bb-e908-4daf-b04a-32f00b788dcc tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] Calling method '.version_select at 0x7f46875a0dc0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:55.949328 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6f7326bb-e908-4daf-b04a-32f00b788dcc tempest-ServersTestFqdnHostnames-2146575728 tempest-ServersTestFqdnHostnames-2146575728-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1297777237" status: 202 len: 0 microversion: 2.1 time: 0.036568 Jul 25 14:32:55.952303 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 955/1990] 10.222.0.88 () {58 vars in 1221 bytes} [Mon Jul 25 14:32:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1297777237 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:32:55.961323 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-568425ee-1ceb-4557-b4ed-47472eb99079 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:55.962409 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-568425ee-1ceb-4557-b4ed-47472eb99079 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:55.972043 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-568425ee-1ceb-4557-b4ed-47472eb99079 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:55.972846 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-568425ee-1ceb-4557-b4ed-47472eb99079 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:55.973986 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-568425ee-1ceb-4557-b4ed-47472eb99079 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:55.975153 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-568425ee-1ceb-4557-b4ed-47472eb99079 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:56.576180 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-65f470b5-6c7b-4402-a7f4-837311bfe22b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:56.594145 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-65f470b5-6c7b-4402-a7f4-837311bfe22b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 200 len: 1353 microversion: 2.1 time: 0.883641 Jul 25 14:32:56.598445 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1036/1991] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:55 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 1353 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:56.643350 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-568425ee-1ceb-4557-b4ed-47472eb99079 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:56.658866 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-568425ee-1ceb-4557-b4ed-47472eb99079 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:56.660482 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-568425ee-1ceb-4557-b4ed-47472eb99079 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:56.662039 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-568425ee-1ceb-4557-b4ed-47472eb99079 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1488 microversion: 2.25 time: 0.706431 Jul 25 14:32:56.672705 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 956/1992] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:32:55 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1488 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:32:56.757525 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-830749ea-5940-40d5-a737-519092b64bef tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:56.758881 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-830749ea-5940-40d5-a737-519092b64bef tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 742f8126-e737-4716-bb05-66e2ba318535] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:56.773830 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-830749ea-5940-40d5-a737-519092b64bef tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:56.774286 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-830749ea-5940-40d5-a737-519092b64bef tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:56.775117 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-830749ea-5940-40d5-a737-519092b64bef tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:56.775649 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-830749ea-5940-40d5-a737-519092b64bef tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:56.932082 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ee96c24f-34e4-4109-8979-7f1eeb54b701 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:56.932575 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ee96c24f-34e4-4109-8979-7f1eeb54b701 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:56.942142 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee96c24f-34e4-4109-8979-7f1eeb54b701 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:56.947740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee96c24f-34e4-4109-8979-7f1eeb54b701 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:56.949420 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee96c24f-34e4-4109-8979-7f1eeb54b701 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:56.952195 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee96c24f-34e4-4109-8979-7f1eeb54b701 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:57.157433 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ee96c24f-34e4-4109-8979-7f1eeb54b701 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:57.195112 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ee96c24f-34e4-4109-8979-7f1eeb54b701 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10" status: 200 len: 1276 microversion: 2.1 time: 0.267528 Jul 25 14:32:57.199185 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 957/1993] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:56 2022] GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 => generated 1276 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:57.417472 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-830749ea-5940-40d5-a737-519092b64bef tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:57.443534 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-830749ea-5940-40d5-a737-519092b64bef tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535" status: 200 len: 1469 microversion: 2.1 time: 0.688703 Jul 25 14:32:57.445080 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1037/1994] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:56 2022] GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535 => generated 1469 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:57.471531 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-752f00b8-3ca2-460e-955d-898798c828f4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:57.472931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-752f00b8-3ca2-460e-955d-898798c828f4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 735eedac-478a-4b11-9fb3-479179270d35] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:57.482946 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-752f00b8-3ca2-460e-955d-898798c828f4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:57.483665 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-752f00b8-3ca2-460e-955d-898798c828f4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:57.484675 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-752f00b8-3ca2-460e-955d-898798c828f4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:57.485332 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-752f00b8-3ca2-460e-955d-898798c828f4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:57.618844 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ed1b0b08-66fb-4932-ac13-c32f4dd311c1 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:57.619479 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ed1b0b08-66fb-4932-ac13-c32f4dd311c1 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:57.630555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed1b0b08-66fb-4932-ac13-c32f4dd311c1 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:57.630979 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed1b0b08-66fb-4932-ac13-c32f4dd311c1 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:57.631777 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed1b0b08-66fb-4932-ac13-c32f4dd311c1 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:57.632492 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed1b0b08-66fb-4932-ac13-c32f4dd311c1 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:57.876367 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-752f00b8-3ca2-460e-955d-898798c828f4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:57.885189 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-752f00b8-3ca2-460e-955d-898798c828f4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/735eedac-478a-4b11-9fb3-479179270d35" status: 200 len: 1319 microversion: 2.1 time: 0.421550 Jul 25 14:32:57.886455 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 958/1995] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:57 2022] GET /compute/v2.1/servers/735eedac-478a-4b11-9fb3-479179270d35 => generated 1319 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:57.891436 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e005ac02-4d4a-49ff-b17e-de3bfee911bd tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:57.892339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e005ac02-4d4a-49ff-b17e-de3bfee911bd tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:57.903450 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e005ac02-4d4a-49ff-b17e-de3bfee911bd tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:57.904244 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e005ac02-4d4a-49ff-b17e-de3bfee911bd tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:57.905214 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e005ac02-4d4a-49ff-b17e-de3bfee911bd tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:57.905839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e005ac02-4d4a-49ff-b17e-de3bfee911bd tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:58.233310 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ed1b0b08-66fb-4932-ac13-c32f4dd311c1 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:58.243015 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ed1b0b08-66fb-4932-ac13-c32f4dd311c1 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 200 len: 1353 microversion: 2.1 time: 0.627941 Jul 25 14:32:58.244802 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1038/1996] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:57 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 1353 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:58.250656 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-a1d7cf99-6be0-433f-ace6-23f366c63e9e req-52194e2b-49c4-4d8e-b844-e544ea304724 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc", "tag": "3407a14a-b3dc-4c7c-8bfa-7a1be3bcbd9e"}, {"server_uuid": "aacb7718-eb99-45ae-a61c-4e5e8770be8a", "name": "network-vif-deleted", "tag": "0bbbda3d-8d02-4c28-9926-89b52f83ac0e"}, {"name": "network-changed", "server_uuid": "c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc", "tag": "aaa9b232-7d76-46cd-a94b-3ff365af44d0"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:58.265924 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a1d7cf99-6be0-433f-ace6-23f366c63e9e req-52194e2b-49c4-4d8e-b844-e544ea304724 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:58.267629 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a1d7cf99-6be0-433f-ace6-23f366c63e9e req-52194e2b-49c4-4d8e-b844-e544ea304724 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:58.309704 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-a1d7cf99-6be0-433f-ace6-23f366c63e9e req-52194e2b-49c4-4d8e-b844-e544ea304724 service nova] Creating event network-changed:3407a14a-b3dc-4c7c-8bfa-7a1be3bcbd9e for instance c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc on n-h1-846435-14 Jul 25 14:32:58.312864 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-a1d7cf99-6be0-433f-ace6-23f366c63e9e req-52194e2b-49c4-4d8e-b844-e544ea304724 service nova] Creating event network-vif-deleted:0bbbda3d-8d02-4c28-9926-89b52f83ac0e for instance aacb7718-eb99-45ae-a61c-4e5e8770be8a on n-h1-846435-14 Jul 25 14:32:58.314281 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-a1d7cf99-6be0-433f-ace6-23f366c63e9e req-52194e2b-49c4-4d8e-b844-e544ea304724 service nova] Creating event network-changed:aaa9b232-7d76-46cd-a94b-3ff365af44d0 for instance c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc on n-h1-846435-14 Jul 25 14:32:58.323467 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-a1d7cf99-6be0-433f-ace6-23f366c63e9e req-52194e2b-49c4-4d8e-b844-e544ea304724 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.077180 Jul 25 14:32:58.327664 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e005ac02-4d4a-49ff-b17e-de3bfee911bd tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:58.328546 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1039/1997] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:32:58.341690 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e511ef60-4f87-400d-9f2d-94ebe463ad03 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:58.342390 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e511ef60-4f87-400d-9f2d-94ebe463ad03 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:58.346762 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e005ac02-4d4a-49ff-b17e-de3bfee911bd tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:58.356219 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e005ac02-4d4a-49ff-b17e-de3bfee911bd tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:58.359571 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e005ac02-4d4a-49ff-b17e-de3bfee911bd tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1488 microversion: 2.25 time: 0.471919 Jul 25 14:32:58.361465 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 959/1998] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:32:57 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1488 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:32:58.361764 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e511ef60-4f87-400d-9f2d-94ebe463ad03 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:58.363148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e511ef60-4f87-400d-9f2d-94ebe463ad03 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:58.364116 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e511ef60-4f87-400d-9f2d-94ebe463ad03 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:58.364909 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e511ef60-4f87-400d-9f2d-94ebe463ad03 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:58.672761 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e511ef60-4f87-400d-9f2d-94ebe463ad03 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:58.682346 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e511ef60-4f87-400d-9f2d-94ebe463ad03 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10" status: 200 len: 1318 microversion: 2.1 time: 0.348990 Jul 25 14:32:58.682760 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1040/1999] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:58 2022] GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:58.909009 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f5026ec3-3b74-47aa-adc3-73526260ed83 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:58.910485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f5026ec3-3b74-47aa-adc3-73526260ed83 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 735eedac-478a-4b11-9fb3-479179270d35] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:58.921408 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f5026ec3-3b74-47aa-adc3-73526260ed83 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:58.921867 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f5026ec3-3b74-47aa-adc3-73526260ed83 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:58.922672 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f5026ec3-3b74-47aa-adc3-73526260ed83 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:58.923108 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f5026ec3-3b74-47aa-adc3-73526260ed83 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:59.141489 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-4a1ad0d7-7e92-4dc5-9abb-f0de561fc54a req-3236f997-6f52-4cf0-9a1d-3171d96de293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "735eedac-478a-4b11-9fb3-479179270d35", "name": "network-vif-plugged", "status": "completed", "tag": "b41659ca-fc34-401c-8b74-8f49d9f18e92"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:32:59.159190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-4a1ad0d7-7e92-4dc5-9abb-f0de561fc54a req-3236f997-6f52-4cf0-9a1d-3171d96de293 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:59.162450 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-4a1ad0d7-7e92-4dc5-9abb-f0de561fc54a req-3236f997-6f52-4cf0-9a1d-3171d96de293 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:59.191000 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-4a1ad0d7-7e92-4dc5-9abb-f0de561fc54a req-3236f997-6f52-4cf0-9a1d-3171d96de293 service nova] Creating event network-vif-plugged:b41659ca-fc34-401c-8b74-8f49d9f18e92 for instance 735eedac-478a-4b11-9fb3-479179270d35 on n-h2-846435-14 Jul 25 14:32:59.204504 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-4a1ad0d7-7e92-4dc5-9abb-f0de561fc54a req-3236f997-6f52-4cf0-9a1d-3171d96de293 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066305 Jul 25 14:32:59.208687 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1041/2000] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:32:59.267748 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-48ffec96-137c-43c9-ab34-980178140196 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:59.268672 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-48ffec96-137c-43c9-ab34-980178140196 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:59.275610 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48ffec96-137c-43c9-ab34-980178140196 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:59.276253 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48ffec96-137c-43c9-ab34-980178140196 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:59.277114 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48ffec96-137c-43c9-ab34-980178140196 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:59.278245 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48ffec96-137c-43c9-ab34-980178140196 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:59.382439 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f5026ec3-3b74-47aa-adc3-73526260ed83 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:59.395301 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f5026ec3-3b74-47aa-adc3-73526260ed83 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/735eedac-478a-4b11-9fb3-479179270d35" status: 200 len: 1319 microversion: 2.1 time: 0.492741 Jul 25 14:32:59.396660 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 960/2001] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:58 2022] GET /compute/v2.1/servers/735eedac-478a-4b11-9fb3-479179270d35 => generated 1319 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:32:59.402571 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-68362939-b5c0-4d41-ab78-58bdb10b6f27 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:59.403485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-68362939-b5c0-4d41-ab78-58bdb10b6f27 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:59.410998 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-68362939-b5c0-4d41-ab78-58bdb10b6f27 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:59.411912 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-68362939-b5c0-4d41-ab78-58bdb10b6f27 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:59.413065 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-68362939-b5c0-4d41-ab78-58bdb10b6f27 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:59.413577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-68362939-b5c0-4d41-ab78-58bdb10b6f27 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:59.592610 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-48ffec96-137c-43c9-ab34-980178140196 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:59.606501 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-48ffec96-137c-43c9-ab34-980178140196 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 200 len: 1353 microversion: 2.1 time: 0.343237 Jul 25 14:32:59.620464 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1042/2002] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:59 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 1353 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:32:59.706698 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-083264ea-d1e5-418e-ad86-d7b3429bd095 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:32:59.707473 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-083264ea-d1e5-418e-ad86-d7b3429bd095 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:32:59.718258 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-083264ea-d1e5-418e-ad86-d7b3429bd095 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:59.720254 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-083264ea-d1e5-418e-ad86-d7b3429bd095 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:59.721134 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-083264ea-d1e5-418e-ad86-d7b3429bd095 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:32:59.723086 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-083264ea-d1e5-418e-ad86-d7b3429bd095 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:32:59.728922 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-68362939-b5c0-4d41-ab78-58bdb10b6f27 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:59.738410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-68362939-b5c0-4d41-ab78-58bdb10b6f27 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:59.749464 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-68362939-b5c0-4d41-ab78-58bdb10b6f27 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:32:59.751235 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-68362939-b5c0-4d41-ab78-58bdb10b6f27 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1488 microversion: 2.25 time: 0.353189 Jul 25 14:32:59.752039 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 961/2003] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:32:59 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1488 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:33:00.014555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-083264ea-d1e5-418e-ad86-d7b3429bd095 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:00.024835 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-083264ea-d1e5-418e-ad86-d7b3429bd095 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10" status: 200 len: 1318 microversion: 2.1 time: 0.322175 Jul 25 14:33:00.026326 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1043/2004] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:32:59 2022] GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:33:00.417168 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b2e2fbc7-4619-418c-baf1-54e7aecf8ac2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:00.417794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b2e2fbc7-4619-418c-baf1-54e7aecf8ac2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 735eedac-478a-4b11-9fb3-479179270d35] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:00.427819 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b2e2fbc7-4619-418c-baf1-54e7aecf8ac2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:00.438735 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b2e2fbc7-4619-418c-baf1-54e7aecf8ac2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:00.449089 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b2e2fbc7-4619-418c-baf1-54e7aecf8ac2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:00.449649 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b2e2fbc7-4619-418c-baf1-54e7aecf8ac2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:00.501442 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-9a0e11a7-29d5-4ac9-a574-ad2a8d0ae4bc req-b367728e-05b4-48ef-b77e-32a4f22960eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fd8f96b-72ae-4a66-a6a4-cf708a0bba10", "tag": "a09cef79-5865-4d30-8077-46a9d142f0d0"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:00.516108 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-9a0e11a7-29d5-4ac9-a574-ad2a8d0ae4bc req-b367728e-05b4-48ef-b77e-32a4f22960eb service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:00.516979 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-9a0e11a7-29d5-4ac9-a574-ad2a8d0ae4bc req-b367728e-05b4-48ef-b77e-32a4f22960eb service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:00.542339 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-9a0e11a7-29d5-4ac9-a574-ad2a8d0ae4bc req-b367728e-05b4-48ef-b77e-32a4f22960eb service nova] Creating event network-changed:a09cef79-5865-4d30-8077-46a9d142f0d0 for instance 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 on n-h1-846435-14 Jul 25 14:33:00.552427 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-9a0e11a7-29d5-4ac9-a574-ad2a8d0ae4bc req-b367728e-05b4-48ef-b77e-32a4f22960eb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054528 Jul 25 14:33:00.553605 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1044/2005] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:33:00.647781 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c88a8080-63ec-4e19-9bb7-d4fea84e69f0 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:00.648809 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c88a8080-63ec-4e19-9bb7-d4fea84e69f0 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:00.669857 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c88a8080-63ec-4e19-9bb7-d4fea84e69f0 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:00.670300 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c88a8080-63ec-4e19-9bb7-d4fea84e69f0 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:00.672807 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c88a8080-63ec-4e19-9bb7-d4fea84e69f0 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:00.673249 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c88a8080-63ec-4e19-9bb7-d4fea84e69f0 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:00.701461 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b2e2fbc7-4619-418c-baf1-54e7aecf8ac2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:00.717873 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b2e2fbc7-4619-418c-baf1-54e7aecf8ac2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/735eedac-478a-4b11-9fb3-479179270d35" status: 200 len: 1319 microversion: 2.1 time: 0.303653 Jul 25 14:33:00.729630 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 962/2006] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:00 2022] GET /compute/v2.1/servers/735eedac-478a-4b11-9fb3-479179270d35 => generated 1319 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:00.777450 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bac5beaa-498d-4518-916c-35b34bc1be83 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:00.778368 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bac5beaa-498d-4518-916c-35b34bc1be83 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:00.787106 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bac5beaa-498d-4518-916c-35b34bc1be83 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:00.788353 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bac5beaa-498d-4518-916c-35b34bc1be83 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:00.789441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bac5beaa-498d-4518-916c-35b34bc1be83 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:00.790488 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bac5beaa-498d-4518-916c-35b34bc1be83 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:00.966148 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bac5beaa-498d-4518-916c-35b34bc1be83 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:00.978000 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bac5beaa-498d-4518-916c-35b34bc1be83 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:00.979359 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bac5beaa-498d-4518-916c-35b34bc1be83 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:00.980590 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bac5beaa-498d-4518-916c-35b34bc1be83 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1488 microversion: 2.25 time: 0.207168 Jul 25 14:33:00.981545 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 963/2007] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:00 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1488 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:33:00.995164 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c88a8080-63ec-4e19-9bb7-d4fea84e69f0 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:01.004565 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c88a8080-63ec-4e19-9bb7-d4fea84e69f0 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 200 len: 1353 microversion: 2.1 time: 0.380646 Jul 25 14:33:01.005879 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1045/2008] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:00 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 1353 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:33:01.046789 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-05c86ce5-01d0-43e5-819c-9a2c9c731c93 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:01.047420 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-05c86ce5-01d0-43e5-819c-9a2c9c731c93 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:01.054891 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-05c86ce5-01d0-43e5-819c-9a2c9c731c93 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:01.055349 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-05c86ce5-01d0-43e5-819c-9a2c9c731c93 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:01.056185 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-05c86ce5-01d0-43e5-819c-9a2c9c731c93 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:01.056629 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-05c86ce5-01d0-43e5-819c-9a2c9c731c93 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:01.248356 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-05c86ce5-01d0-43e5-819c-9a2c9c731c93 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:01.260742 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-05c86ce5-01d0-43e5-819c-9a2c9c731c93 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10" status: 200 len: 1318 microversion: 2.1 time: 0.217885 Jul 25 14:33:01.262981 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 964/2009] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:01 2022] GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:33:01.747060 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3b31e87e-5314-47e3-8e37-2c8efaa0e1fe tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:01.747701 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3b31e87e-5314-47e3-8e37-2c8efaa0e1fe tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 735eedac-478a-4b11-9fb3-479179270d35] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:01.761325 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b31e87e-5314-47e3-8e37-2c8efaa0e1fe tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:01.761870 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b31e87e-5314-47e3-8e37-2c8efaa0e1fe tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:01.762551 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b31e87e-5314-47e3-8e37-2c8efaa0e1fe tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:01.763198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b31e87e-5314-47e3-8e37-2c8efaa0e1fe tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:02.007528 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6faef6a7-7a1d-4e23-900c-dae39b9c9b85 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:02.008883 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6faef6a7-7a1d-4e23-900c-dae39b9c9b85 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:02.023505 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6faef6a7-7a1d-4e23-900c-dae39b9c9b85 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:02.024795 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6faef6a7-7a1d-4e23-900c-dae39b9c9b85 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:02.028319 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6faef6a7-7a1d-4e23-900c-dae39b9c9b85 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:02.029085 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6faef6a7-7a1d-4e23-900c-dae39b9c9b85 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:02.052508 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3b31e87e-5314-47e3-8e37-2c8efaa0e1fe tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:02.064319 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3b31e87e-5314-47e3-8e37-2c8efaa0e1fe tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/735eedac-478a-4b11-9fb3-479179270d35" status: 200 len: 1468 microversion: 2.1 time: 0.325629 Jul 25 14:33:02.068010 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1046/2010] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:01 2022] GET /compute/v2.1/servers/735eedac-478a-4b11-9fb3-479179270d35 => generated 1468 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:02.081800 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5e7548a8-7bb6-40f2-86d7-85d13d687a42 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:02.099587 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5e7548a8-7bb6-40f2-86d7-85d13d687a42 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:02.114338 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5e7548a8-7bb6-40f2-86d7-85d13d687a42 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:02.118861 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5e7548a8-7bb6-40f2-86d7-85d13d687a42 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:02.122259 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5e7548a8-7bb6-40f2-86d7-85d13d687a42 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:02.123040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5e7548a8-7bb6-40f2-86d7-85d13d687a42 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:02.151911 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:33:02.797885 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6faef6a7-7a1d-4e23-900c-dae39b9c9b85 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:02.810522 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6faef6a7-7a1d-4e23-900c-dae39b9c9b85 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:02.813148 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6faef6a7-7a1d-4e23-900c-dae39b9c9b85 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:02.814702 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6faef6a7-7a1d-4e23-900c-dae39b9c9b85 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1488 microversion: 2.25 time: 0.812193 Jul 25 14:33:02.816154 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 965/2011] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:02 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1488 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:33:02.822400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6cfd3c89-4334-41be-bfdf-c3253a80e6cb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:02.829856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6cfd3c89-4334-41be-bfdf-c3253a80e6cb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:02.831083 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6cfd3c89-4334-41be-bfdf-c3253a80e6cb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Searching by: {'reservation_id': 'r-rfn9czdh', 'deleted': False, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51'} {{(pid=119303) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:33:02.839505 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6cfd3c89-4334-41be-bfdf-c3253a80e6cb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:02.840349 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6cfd3c89-4334-41be-bfdf-c3253a80e6cb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:02.841351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6cfd3c89-4334-41be-bfdf-c3253a80e6cb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:02.842412 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6cfd3c89-4334-41be-bfdf-c3253a80e6cb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:02.876466 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5e7548a8-7bb6-40f2-86d7-85d13d687a42 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:02.885185 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5e7548a8-7bb6-40f2-86d7-85d13d687a42 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 200 len: 1353 microversion: 2.1 time: 0.815220 Jul 25 14:33:02.886254 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1047/2012] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:02 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 1353 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:02.905439 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f2583d8a-720f-4d2c-af8c-4eb1e9d55054 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:02.911456 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f2583d8a-720f-4d2c-af8c-4eb1e9d55054 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2bd9f6ef6ef34b51a55bb71f5d06040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01423e9ea2b94eef87188b26f99f9ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:02.912921 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f2583d8a-720f-4d2c-af8c-4eb1e9d55054 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Searching by: {'deleted': False, 'project_id': '01423e9ea2b94eef87188b26f99f9ae4'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:33:02.919388 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f2583d8a-720f-4d2c-af8c-4eb1e9d55054 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:02.920096 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f2583d8a-720f-4d2c-af8c-4eb1e9d55054 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:02.921790 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f2583d8a-720f-4d2c-af8c-4eb1e9d55054 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:02.922432 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f2583d8a-720f-4d2c-af8c-4eb1e9d55054 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:02.967778 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.multi_cell_list [None req-f2583d8a-720f-4d2c-af8c-4eb1e9d55054 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119304) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:33:03.024092 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f2583d8a-720f-4d2c-af8c-4eb1e9d55054 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] 10.222.0.88 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.124789 Jul 25 14:33:03.025963 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1048/2013] 10.222.0.88 () {58 vars in 1125 bytes} [Mon Jul 25 14:33:02 2022] GET /compute/v2.1/servers => generated 333 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:33:03.031070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-039833ee-8b0a-4bc8-a482-6254a5330835 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:03.033922 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-039833ee-8b0a-4bc8-a482-6254a5330835 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:03.041070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-039833ee-8b0a-4bc8-a482-6254a5330835 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:03.041830 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-039833ee-8b0a-4bc8-a482-6254a5330835 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:03.042899 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-039833ee-8b0a-4bc8-a482-6254a5330835 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:03.043782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-039833ee-8b0a-4bc8-a482-6254a5330835 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:03.106014 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.multi_cell_list [None req-6cfd3c89-4334-41be-bfdf-c3253a80e6cb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119303) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:33:03.186350 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6cfd3c89-4334-41be-bfdf-c3253a80e6cb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:03.194744 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6cfd3c89-4334-41be-bfdf-c3253a80e6cb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:03.195440 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6cfd3c89-4334-41be-bfdf-c3253a80e6cb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:03.338936 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-039833ee-8b0a-4bc8-a482-6254a5330835 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:03.351415 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-039833ee-8b0a-4bc8-a482-6254a5330835 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10" status: 200 len: 1318 microversion: 2.1 time: 0.323940 Jul 25 14:33:03.352663 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1049/2014] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:03 2022] GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:03.357557 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fb765bb1-cc6b-4774-8545-a5bb23bf2d1b tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:03.374826 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fb765bb1-cc6b-4774-8545-a5bb23bf2d1b tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2bd9f6ef6ef34b51a55bb71f5d06040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01423e9ea2b94eef87188b26f99f9ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:03.378843 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fb765bb1-cc6b-4774-8545-a5bb23bf2d1b tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Searching by: {'deleted': False, 'project_id': '01423e9ea2b94eef87188b26f99f9ae4'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:33:03.396701 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fb765bb1-cc6b-4774-8545-a5bb23bf2d1b tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:03.397401 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fb765bb1-cc6b-4774-8545-a5bb23bf2d1b tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:03.400194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fb765bb1-cc6b-4774-8545-a5bb23bf2d1b tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:03.404636 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fb765bb1-cc6b-4774-8545-a5bb23bf2d1b tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:03.459478 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.multi_cell_list [None req-fb765bb1-cc6b-4774-8545-a5bb23bf2d1b tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119304) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:33:03.560689 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6cfd3c89-4334-41be-bfdf-c3253a80e6cb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/detail?reservation_id=r-rfn9czdh" status: 200 len: 2930 microversion: 2.1 time: 0.743146 Jul 25 14:33:03.561906 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 966/2015] 10.222.0.88 () {58 vars in 1197 bytes} [Mon Jul 25 14:33:02 2022] GET /compute/v2.1/servers/detail?reservation_id=r-rfn9czdh => generated 2930 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:03.564744 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fb765bb1-cc6b-4774-8545-a5bb23bf2d1b tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd9f6ef6ef34b51a55bb71f5d06040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01423e9ea2b94eef87188b26f99f9ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:03.572695 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fb765bb1-cc6b-4774-8545-a5bb23bf2d1b tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:03.573223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fb765bb1-cc6b-4774-8545-a5bb23bf2d1b tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:03.585636 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-927beca3-bf6b-4eba-ad99-84e0d3e82c6f tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:03.606063 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.compute.server_groups [None req-927beca3-bf6b-4eba-ad99-84e0d3e82c6f tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Querying cell cadb07ed-5464-41eb-afb8-bf9dd92401b6(cell1) for 2 instances {{(pid=119303) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 25 14:33:03.607409 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-927beca3-bf6b-4eba-ad99-84e0d3e82c6f tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:03.608258 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-927beca3-bf6b-4eba-ad99-84e0d3e82c6f tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:03.683444 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-927beca3-bf6b-4eba-ad99-84e0d3e82c6f tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/os-server-groups/4f723bc4-eaed-48cf-a946-6282c20f4328" status: 200 len: 265 microversion: 2.1 time: 0.100887 Jul 25 14:33:03.684853 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 967/2016] 10.222.0.88 () {58 vars in 1263 bytes} [Mon Jul 25 14:33:03 2022] GET /compute/v2.1/os-server-groups/4f723bc4-eaed-48cf-a946-6282c20f4328 => generated 265 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:33:03.696184 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6c56a0ff-b859-4c31-8a98-a3fef5e31df7 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:03.699510 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6c56a0ff-b859-4c31-8a98-a3fef5e31df7 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] [instance: 735eedac-478a-4b11-9fb3-479179270d35] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:03.716543 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6c56a0ff-b859-4c31-8a98-a3fef5e31df7 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:03.717345 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6c56a0ff-b859-4c31-8a98-a3fef5e31df7 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:03.720340 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6c56a0ff-b859-4c31-8a98-a3fef5e31df7 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:03.723321 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6c56a0ff-b859-4c31-8a98-a3fef5e31df7 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:03.901402 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fb765bb1-cc6b-4774-8545-a5bb23bf2d1b tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] 10.222.0.88 "GET /compute/v2.1/servers/detail" status: 200 len: 1695 microversion: 2.1 time: 0.547378 Jul 25 14:33:03.902697 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1050/2017] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:33:03 2022] GET /compute/v2.1/servers/detail => generated 1695 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:03.909645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-eaa96b93-7456-4cb2-96c4-0445cc49f196 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:03.910556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-eaa96b93-7456-4cb2-96c4-0445cc49f196 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:03.922990 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eaa96b93-7456-4cb2-96c4-0445cc49f196 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:03.923455 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eaa96b93-7456-4cb2-96c4-0445cc49f196 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:03.924372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eaa96b93-7456-4cb2-96c4-0445cc49f196 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:03.925002 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eaa96b93-7456-4cb2-96c4-0445cc49f196 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:04.030313 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6c56a0ff-b859-4c31-8a98-a3fef5e31df7 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/735eedac-478a-4b11-9fb3-479179270d35" status: 200 len: 1621 microversion: 2.1 time: 0.338757 Jul 25 14:33:04.031438 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 968/2018] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:03 2022] GET /compute/v2.1/servers/735eedac-478a-4b11-9fb3-479179270d35 => generated 1621 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:33:04.036222 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-65353899-8101-47b7-a00b-949b5ff2dd26 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:04.037331 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-65353899-8101-47b7-a00b-949b5ff2dd26 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:04.043623 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-65353899-8101-47b7-a00b-949b5ff2dd26 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:04.044107 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-65353899-8101-47b7-a00b-949b5ff2dd26 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:04.045104 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-65353899-8101-47b7-a00b-949b5ff2dd26 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:04.045777 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-65353899-8101-47b7-a00b-949b5ff2dd26 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:04.122924 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-eaa96b93-7456-4cb2-96c4-0445cc49f196 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:04.132005 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-eaa96b93-7456-4cb2-96c4-0445cc49f196 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:04.133831 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-eaa96b93-7456-4cb2-96c4-0445cc49f196 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:04.136852 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-eaa96b93-7456-4cb2-96c4-0445cc49f196 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1488 microversion: 2.25 time: 0.232970 Jul 25 14:33:04.138168 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1051/2019] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:03 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1488 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:33:04.157586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1b1d4b4e-2d44-4530-a603-1184167930aa tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:04.167385 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1b1d4b4e-2d44-4530-a603-1184167930aa tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] 10.222.0.88 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027934 Jul 25 14:33:04.168276 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1052/2020] 10.222.0.88 () {58 vars in 1137 bytes} [Mon Jul 25 14:33:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:33:04.173817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c153add2-802b-4381-9c79-e582a3ca5c04 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:04.174374 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c153add2-802b-4381-9c79-e582a3ca5c04 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] [instance: 742f8126-e737-4716-bb05-66e2ba318535] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:04.181451 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c153add2-802b-4381-9c79-e582a3ca5c04 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:04.181878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c153add2-802b-4381-9c79-e582a3ca5c04 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:04.183012 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c153add2-802b-4381-9c79-e582a3ca5c04 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:04.183665 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c153add2-802b-4381-9c79-e582a3ca5c04 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:04.263765 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-65353899-8101-47b7-a00b-949b5ff2dd26 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:04.274937 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-65353899-8101-47b7-a00b-949b5ff2dd26 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 200 len: 1353 microversion: 2.1 time: 0.241988 Jul 25 14:33:04.284495 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 969/2021] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:04 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 1353 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:04.376113 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3c7ae7f8-efb6-486f-820a-8fe976ab4b82 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:04.378651 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3c7ae7f8-efb6-486f-820a-8fe976ab4b82 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:04.392618 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c7ae7f8-efb6-486f-820a-8fe976ab4b82 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:04.393420 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c7ae7f8-efb6-486f-820a-8fe976ab4b82 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:04.394304 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c7ae7f8-efb6-486f-820a-8fe976ab4b82 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:04.394732 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c7ae7f8-efb6-486f-820a-8fe976ab4b82 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:04.593456 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3c7ae7f8-efb6-486f-820a-8fe976ab4b82 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:04.600312 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c153add2-802b-4381-9c79-e582a3ca5c04 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535" status: 200 len: 1622 microversion: 2.1 time: 0.430519 Jul 25 14:33:04.601427 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1053/2022] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:04 2022] GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535 => generated 1622 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:04.603134 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3c7ae7f8-efb6-486f-820a-8fe976ab4b82 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10" status: 200 len: 1318 microversion: 2.1 time: 0.231663 Jul 25 14:33:04.608385 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 970/2023] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:04 2022] GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:33:04.617671 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-800662d1-01ac-4b88-bd08-77dd32f125e0 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:04.618488 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-800662d1-01ac-4b88-bd08-77dd32f125e0 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] [instance: a1ee79ec-d346-42f8-ae58-06b110abdef0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:04.628110 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-68c9cf7a-fd74-4a77-a1a5-b3298bdfd6dc tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Action: 'create', calling method: .version_select at 0x7f46989c6af0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-545266475", "policies": ["anti-affinity"]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:04.630025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-800662d1-01ac-4b88-bd08-77dd32f125e0 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:04.630451 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-800662d1-01ac-4b88-bd08-77dd32f125e0 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:04.631294 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-800662d1-01ac-4b88-bd08-77dd32f125e0 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:04.631709 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-800662d1-01ac-4b88-bd08-77dd32f125e0 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:04.655739 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-68c9cf7a-fd74-4a77-a1a5-b3298bdfd6dc tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for project e60b88c2aea642658a5bfc14780d5d51. Resources: {'server_groups'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:33:04.663969 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-68c9cf7a-fd74-4a77-a1a5-b3298bdfd6dc tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for user ef351be3886949f9985b3244301435a9 and project e60b88c2aea642658a5bfc14780d5d51. Resources: {'server_groups'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:33:04.665681 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-800662d1-01ac-4b88-bd08-77dd32f125e0 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] [instance: a1ee79ec-d346-42f8-ae58-06b110abdef0] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:33:04.712756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-68c9cf7a-fd74-4a77-a1a5-b3298bdfd6dc tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for project e60b88c2aea642658a5bfc14780d5d51. Resources: {'server_groups'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:33:04.718907 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-68c9cf7a-fd74-4a77-a1a5-b3298bdfd6dc tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for user ef351be3886949f9985b3244301435a9 and project e60b88c2aea642658a5bfc14780d5d51. Resources: {'server_groups'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:33:04.733305 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-68c9cf7a-fd74-4a77-a1a5-b3298bdfd6dc tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.110883 Jul 25 14:33:04.734882 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 971/2024] 10.222.0.88 () {60 vars in 1174 bytes} [Mon Jul 25 14:33:04 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:33:04.781807 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-800662d1-01ac-4b88-bd08-77dd32f125e0 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0" status: 204 len: 0 microversion: 2.1 time: 0.177286 Jul 25 14:33:04.782492 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1054/2025] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:33:04 2022] DELETE /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:33:04.791087 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0f5587b2-fe69-437f-aac4-a5e1ef0fdf6f tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:04.791858 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0f5587b2-fe69-437f-aac4-a5e1ef0fdf6f tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] [instance: a1ee79ec-d346-42f8-ae58-06b110abdef0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:04.800261 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f5587b2-fe69-437f-aac4-a5e1ef0fdf6f tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:04.800717 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f5587b2-fe69-437f-aac4-a5e1ef0fdf6f tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:04.801488 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f5587b2-fe69-437f-aac4-a5e1ef0fdf6f tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:04.801916 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f5587b2-fe69-437f-aac4-a5e1ef0fdf6f tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:04.832452 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:33:04.883388 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bb29d996-7a04-43c9-887b-1e1d74f82d2a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-242035398", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "76c3d209-2d0e-4027-a911-f11bd860a5da"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:04.962223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-bb29d996-7a04-43c9-887b-1e1d74f82d2a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] validate_networks() for None {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:33:04.981282 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0f5587b2-fe69-437f-aac4-a5e1ef0fdf6f tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd9f6ef6ef34b51a55bb71f5d06040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01423e9ea2b94eef87188b26f99f9ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:04.990060 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0f5587b2-fe69-437f-aac4-a5e1ef0fdf6f tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] 10.222.0.88 "GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0" status: 200 len: 1698 microversion: 2.1 time: 0.202635 Jul 25 14:33:04.996522 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 972/2026] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:04 2022] GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0 => generated 1698 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:05.162077 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6ae06eef-80bb-4b96-8d3d-3e8692cffa3b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:05.162808 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6ae06eef-80bb-4b96-8d3d-3e8692cffa3b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:05.172315 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ae06eef-80bb-4b96-8d3d-3e8692cffa3b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:05.175385 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ae06eef-80bb-4b96-8d3d-3e8692cffa3b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:05.176475 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ae06eef-80bb-4b96-8d3d-3e8692cffa3b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:05.178841 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ae06eef-80bb-4b96-8d3d-3e8692cffa3b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:05.200406 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-bb29d996-7a04-43c9-887b-1e1d74f82d2a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:33:05.201243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-bb29d996-7a04-43c9-887b-1e1d74f82d2a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:33:05.201882 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-bb29d996-7a04-43c9-887b-1e1d74f82d2a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:33:05.202415 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-bb29d996-7a04-43c9-887b-1e1d74f82d2a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:33:05.202972 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-bb29d996-7a04-43c9-887b-1e1d74f82d2a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:33:05.230484 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bb29d996-7a04-43c9-887b-1e1d74f82d2a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:05.231029 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bb29d996-7a04-43c9-887b-1e1d74f82d2a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:05.231902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bb29d996-7a04-43c9-887b-1e1d74f82d2a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:05.232478 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bb29d996-7a04-43c9-887b-1e1d74f82d2a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:05.250865 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-bb29d996-7a04-43c9-887b-1e1d74f82d2a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for project e60b88c2aea642658a5bfc14780d5d51. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:33:05.256061 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-bb29d996-7a04-43c9-887b-1e1d74f82d2a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for user ef351be3886949f9985b3244301435a9 and project e60b88c2aea642658a5bfc14780d5d51. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:33:05.269094 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bb29d996-7a04-43c9-887b-1e1d74f82d2a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Going to run 2 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:33:05.271602 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bb29d996-7a04-43c9-887b-1e1d74f82d2a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 8aff0899-f62a-4ffc-924c-c782f7eb417f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:33:05.312565 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-bb29d996-7a04-43c9-887b-1e1d74f82d2a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119304) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 25 14:33:05.332326 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-bb29d996-7a04-43c9-887b-1e1d74f82d2a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for project e60b88c2aea642658a5bfc14780d5d51. Resources: {'server_group_members'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:33:05.337936 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-bb29d996-7a04-43c9-887b-1e1d74f82d2a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for user ef351be3886949f9985b3244301435a9 and project e60b88c2aea642658a5bfc14780d5d51. Resources: {'server_group_members'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:33:05.382557 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-bb29d996-7a04-43c9-887b-1e1d74f82d2a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for project e60b88c2aea642658a5bfc14780d5d51. Resources: {'server_group_members'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:33:05.387765 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-bb29d996-7a04-43c9-887b-1e1d74f82d2a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for user ef351be3886949f9985b3244301435a9 and project e60b88c2aea642658a5bfc14780d5d51. Resources: {'server_group_members'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:33:05.402665 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bb29d996-7a04-43c9-887b-1e1d74f82d2a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 95cc15d2-9357-439c-8b9c-ed54768c1697] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=8aff0899-f62a-4ffc-924c-c782f7eb417f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:33:05.445366 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:33:05.461359 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6ae06eef-80bb-4b96-8d3d-3e8692cffa3b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:05.468537 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-bb29d996-7a04-43c9-887b-1e1d74f82d2a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for project e60b88c2aea642658a5bfc14780d5d51. Resources: {'server_group_members'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:33:05.473091 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6ae06eef-80bb-4b96-8d3d-3e8692cffa3b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:05.473704 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-bb29d996-7a04-43c9-887b-1e1d74f82d2a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for user ef351be3886949f9985b3244301435a9 and project e60b88c2aea642658a5bfc14780d5d51. Resources: {'server_group_members'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:33:05.474624 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6ae06eef-80bb-4b96-8d3d-3e8692cffa3b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:05.479854 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6ae06eef-80bb-4b96-8d3d-3e8692cffa3b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1488 microversion: 2.25 time: 0.318471 Jul 25 14:33:05.480840 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 973/2027] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:05 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1488 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:33:05.495967 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-62033b42-46d5-4bde-97c1-9ffad06d361a tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:05.496629 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-62033b42-46d5-4bde-97c1-9ffad06d361a tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:05.504030 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-62033b42-46d5-4bde-97c1-9ffad06d361a tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:05.504519 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-62033b42-46d5-4bde-97c1-9ffad06d361a tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:05.505880 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-62033b42-46d5-4bde-97c1-9ffad06d361a tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:05.506516 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-62033b42-46d5-4bde-97c1-9ffad06d361a tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:05.537040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-bb29d996-7a04-43c9-887b-1e1d74f82d2a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for project e60b88c2aea642658a5bfc14780d5d51. Resources: {'server_group_members'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:33:05.543241 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-bb29d996-7a04-43c9-887b-1e1d74f82d2a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for user ef351be3886949f9985b3244301435a9 and project e60b88c2aea642658a5bfc14780d5d51. Resources: {'server_group_members'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:33:05.578276 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bb29d996-7a04-43c9-887b-1e1d74f82d2a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.699803 Jul 25 14:33:05.579435 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1055/2028] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:33:04 2022] POST /compute/v2.1/servers => generated 32 bytes in 702 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Jul 25 14:33:05.587070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-30bc1526-3c9e-4f5d-a56a-908aae0b0a40 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:05.592284 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-30bc1526-3c9e-4f5d-a56a-908aae0b0a40 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:05.592713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-30bc1526-3c9e-4f5d-a56a-908aae0b0a40 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Searching by: {'deleted': False, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:33:05.611946 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-30bc1526-3c9e-4f5d-a56a-908aae0b0a40 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:05.612446 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-30bc1526-3c9e-4f5d-a56a-908aae0b0a40 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:05.613296 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-30bc1526-3c9e-4f5d-a56a-908aae0b0a40 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:05.613718 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-30bc1526-3c9e-4f5d-a56a-908aae0b0a40 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:05.645063 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.multi_cell_list [None req-30bc1526-3c9e-4f5d-a56a-908aae0b0a40 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=119304) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:33:05.683271 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-30bc1526-3c9e-4f5d-a56a-908aae0b0a40 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.099724 Jul 25 14:33:05.694084 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1056/2029] 10.222.0.88 () {58 vars in 1125 bytes} [Mon Jul 25 14:33:05 2022] GET /compute/v2.1/servers => generated 1663 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:33:05.699393 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8475b64f-232b-44d7-b201-58f08a44b1a7 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:05.700251 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8475b64f-232b-44d7-b201-58f08a44b1a7 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:05.707455 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8475b64f-232b-44d7-b201-58f08a44b1a7 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:05.708174 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8475b64f-232b-44d7-b201-58f08a44b1a7 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:05.709248 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8475b64f-232b-44d7-b201-58f08a44b1a7 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:05.710436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8475b64f-232b-44d7-b201-58f08a44b1a7 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:05.829760 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-62033b42-46d5-4bde-97c1-9ffad06d361a tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:05.844525 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-62033b42-46d5-4bde-97c1-9ffad06d361a tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 200 len: 1353 microversion: 2.1 time: 0.362362 Jul 25 14:33:05.870296 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 974/2030] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:05 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 1353 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:05.882577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9a21dc62-18c6-43ad-8c4a-abe367803ba0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:05.884652 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9a21dc62-18c6-43ad-8c4a-abe367803ba0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 95cc15d2-9357-439c-8b9c-ed54768c1697] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:05.968047 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8475b64f-232b-44d7-b201-58f08a44b1a7 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:05.998432 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8475b64f-232b-44d7-b201-58f08a44b1a7 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10" status: 200 len: 1318 microversion: 2.1 time: 0.301720 Jul 25 14:33:06.000673 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1057/2031] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:05 2022] GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:06.025560 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ce7ed026-f85d-4518-8611-01d15d21cb92 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:06.032629 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ce7ed026-f85d-4518-8611-01d15d21cb92 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] [instance: a1ee79ec-d346-42f8-ae58-06b110abdef0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:06.044272 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce7ed026-f85d-4518-8611-01d15d21cb92 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:06.045027 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce7ed026-f85d-4518-8611-01d15d21cb92 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:06.046549 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce7ed026-f85d-4518-8611-01d15d21cb92 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:06.048047 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce7ed026-f85d-4518-8611-01d15d21cb92 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:06.062464 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9a21dc62-18c6-43ad-8c4a-abe367803ba0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:06.088079 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9a21dc62-18c6-43ad-8c4a-abe367803ba0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697" status: 200 len: 1218 microversion: 2.1 time: 0.198062 Jul 25 14:33:06.088841 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 975/2032] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:05 2022] GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697 => generated 1218 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:06.485007 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ce7ed026-f85d-4518-8611-01d15d21cb92 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd9f6ef6ef34b51a55bb71f5d06040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01423e9ea2b94eef87188b26f99f9ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:06.493492 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ce7ed026-f85d-4518-8611-01d15d21cb92 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] 10.222.0.88 "GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0" status: 200 len: 1698 microversion: 2.1 time: 0.477593 Jul 25 14:33:06.508184 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1058/2033] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:06 2022] GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0 => generated 1698 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:06.508913 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fe4252b8-5f63-46e9-89cf-7b958a662a01 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:06.509567 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fe4252b8-5f63-46e9-89cf-7b958a662a01 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:06.521531 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fe4252b8-5f63-46e9-89cf-7b958a662a01 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:06.521982 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fe4252b8-5f63-46e9-89cf-7b958a662a01 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:06.524495 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fe4252b8-5f63-46e9-89cf-7b958a662a01 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:06.525298 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fe4252b8-5f63-46e9-89cf-7b958a662a01 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:06.813084 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fe4252b8-5f63-46e9-89cf-7b958a662a01 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:06.836046 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fe4252b8-5f63-46e9-89cf-7b958a662a01 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:06.870406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fe4252b8-5f63-46e9-89cf-7b958a662a01 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:06.872752 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fe4252b8-5f63-46e9-89cf-7b958a662a01 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1488 microversion: 2.25 time: 0.373566 Jul 25 14:33:06.873703 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 976/2034] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:06 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1488 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:33:06.879841 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-84b5c2dd-4217-4cc7-b846-ac1eb019eac9 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:06.880621 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-84b5c2dd-4217-4cc7-b846-ac1eb019eac9 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:06.896709 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-84b5c2dd-4217-4cc7-b846-ac1eb019eac9 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:06.899586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-84b5c2dd-4217-4cc7-b846-ac1eb019eac9 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:06.901409 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-84b5c2dd-4217-4cc7-b846-ac1eb019eac9 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:06.901409 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-84b5c2dd-4217-4cc7-b846-ac1eb019eac9 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:07.039296 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5bd7d23b-52a0-40a6-9e5d-454dca73a156 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:07.039904 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5bd7d23b-52a0-40a6-9e5d-454dca73a156 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:07.046472 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5bd7d23b-52a0-40a6-9e5d-454dca73a156 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:07.046946 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5bd7d23b-52a0-40a6-9e5d-454dca73a156 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:07.047722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5bd7d23b-52a0-40a6-9e5d-454dca73a156 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:07.048183 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5bd7d23b-52a0-40a6-9e5d-454dca73a156 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:07.205934 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-84b5c2dd-4217-4cc7-b846-ac1eb019eac9 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:07.216599 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-84b5c2dd-4217-4cc7-b846-ac1eb019eac9 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 200 len: 1353 microversion: 2.1 time: 0.341740 Jul 25 14:33:07.217499 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1059/2035] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:06 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 1353 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:07.222346 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-db384043-aea5-4476-8ce0-59942afc19f4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:07.223171 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-db384043-aea5-4476-8ce0-59942afc19f4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 95cc15d2-9357-439c-8b9c-ed54768c1697] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:07.230428 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db384043-aea5-4476-8ce0-59942afc19f4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:07.231287 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db384043-aea5-4476-8ce0-59942afc19f4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:07.232370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db384043-aea5-4476-8ce0-59942afc19f4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:07.232978 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db384043-aea5-4476-8ce0-59942afc19f4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:07.307425 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5bd7d23b-52a0-40a6-9e5d-454dca73a156 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:07.320930 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5bd7d23b-52a0-40a6-9e5d-454dca73a156 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10" status: 200 len: 1318 microversion: 2.1 time: 0.285678 Jul 25 14:33:07.322464 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 977/2036] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:07 2022] GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:07.361204 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-db384043-aea5-4476-8ce0-59942afc19f4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:07.371019 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-db384043-aea5-4476-8ce0-59942afc19f4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697" status: 200 len: 1270 microversion: 2.1 time: 0.152221 Jul 25 14:33:07.371666 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1060/2037] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:07 2022] GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697 => generated 1270 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:07.514948 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9bff5a1e-79b1-4104-b48c-96d0a3b8cccb tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:07.515564 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9bff5a1e-79b1-4104-b48c-96d0a3b8cccb tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] [instance: a1ee79ec-d346-42f8-ae58-06b110abdef0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:07.522164 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9bff5a1e-79b1-4104-b48c-96d0a3b8cccb tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:07.522616 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9bff5a1e-79b1-4104-b48c-96d0a3b8cccb tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:07.523393 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9bff5a1e-79b1-4104-b48c-96d0a3b8cccb tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:07.523832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9bff5a1e-79b1-4104-b48c-96d0a3b8cccb tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:07.914069 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e8150385-cc41-422c-bd33-29a5cd917dce tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:07.915732 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e8150385-cc41-422c-bd33-29a5cd917dce tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:07.927849 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e8150385-cc41-422c-bd33-29a5cd917dce tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:07.928719 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e8150385-cc41-422c-bd33-29a5cd917dce tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:07.929798 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e8150385-cc41-422c-bd33-29a5cd917dce tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:07.930453 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e8150385-cc41-422c-bd33-29a5cd917dce tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:08.268930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9bff5a1e-79b1-4104-b48c-96d0a3b8cccb tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd9f6ef6ef34b51a55bb71f5d06040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01423e9ea2b94eef87188b26f99f9ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:08.280489 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9bff5a1e-79b1-4104-b48c-96d0a3b8cccb tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] 10.222.0.88 "GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0" status: 200 len: 1698 microversion: 2.1 time: 0.769123 Jul 25 14:33:08.282535 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 978/2038] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:07 2022] GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0 => generated 1698 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:08.289727 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ffe4cb95-b73f-4290-84a0-c24ab5042aff tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:08.295721 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ffe4cb95-b73f-4290-84a0-c24ab5042aff tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:08.315130 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ffe4cb95-b73f-4290-84a0-c24ab5042aff tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:08.318503 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ffe4cb95-b73f-4290-84a0-c24ab5042aff tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:08.320190 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ffe4cb95-b73f-4290-84a0-c24ab5042aff tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:08.321747 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ffe4cb95-b73f-4290-84a0-c24ab5042aff tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:08.381721 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e8150385-cc41-422c-bd33-29a5cd917dce tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:08.403172 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e8150385-cc41-422c-bd33-29a5cd917dce tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:08.405333 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e8150385-cc41-422c-bd33-29a5cd917dce tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:08.410019 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e8150385-cc41-422c-bd33-29a5cd917dce tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1488 microversion: 2.25 time: 0.500928 Jul 25 14:33:08.411124 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1061/2039] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:07 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1488 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:33:08.438465 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8f605745-ee9a-4ef7-8615-7a13d9012e9e tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:08.443829 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8f605745-ee9a-4ef7-8615-7a13d9012e9e tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:08.457598 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f605745-ee9a-4ef7-8615-7a13d9012e9e tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:08.458273 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f605745-ee9a-4ef7-8615-7a13d9012e9e tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:08.459571 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f605745-ee9a-4ef7-8615-7a13d9012e9e tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:08.460215 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f605745-ee9a-4ef7-8615-7a13d9012e9e tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:08.744105 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ffe4cb95-b73f-4290-84a0-c24ab5042aff tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:08.754687 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ffe4cb95-b73f-4290-84a0-c24ab5042aff tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 200 len: 1353 microversion: 2.1 time: 0.470714 Jul 25 14:33:08.775606 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 979/2040] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:08 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 1353 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:08.775606 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-715fc377-e50b-4527-8106-f15eb9cf4528 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:08.775606 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-715fc377-e50b-4527-8106-f15eb9cf4528 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 95cc15d2-9357-439c-8b9c-ed54768c1697] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:08.786481 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-715fc377-e50b-4527-8106-f15eb9cf4528 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:08.793639 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-715fc377-e50b-4527-8106-f15eb9cf4528 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:08.795065 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-715fc377-e50b-4527-8106-f15eb9cf4528 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:08.796832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-715fc377-e50b-4527-8106-f15eb9cf4528 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:08.894942 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8f605745-ee9a-4ef7-8615-7a13d9012e9e tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:08.900244 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:33:08.913703 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8f605745-ee9a-4ef7-8615-7a13d9012e9e tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10" status: 200 len: 1318 microversion: 2.1 time: 0.500593 Jul 25 14:33:08.935582 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1062/2041] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:08 2022] GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 => generated 1318 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:08.937422 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-715fc377-e50b-4527-8106-f15eb9cf4528 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:08.949937 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-715fc377-e50b-4527-8106-f15eb9cf4528 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697" status: 200 len: 1276 microversion: 2.1 time: 0.183885 Jul 25 14:33:08.964187 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 980/2042] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:08 2022] GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697 => generated 1276 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:09.230643 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-e1abfc49-bac0-458b-81c1-b95c84e34617 req-036ac806-363a-4c19-a67f-fcfd4f7e7d50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1ee79ec-d346-42f8-ae58-06b110abdef0", "name": "network-vif-deleted", "tag": "8ba120e0-d996-462a-92c0-223ea6dc26e9"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:09.246743 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-e1abfc49-bac0-458b-81c1-b95c84e34617 req-036ac806-363a-4c19-a67f-fcfd4f7e7d50 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:09.247188 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-e1abfc49-bac0-458b-81c1-b95c84e34617 req-036ac806-363a-4c19-a67f-fcfd4f7e7d50 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:09.281206 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-e1abfc49-bac0-458b-81c1-b95c84e34617 req-036ac806-363a-4c19-a67f-fcfd4f7e7d50 service nova] Creating event network-vif-deleted:8ba120e0-d996-462a-92c0-223ea6dc26e9 for instance a1ee79ec-d346-42f8-ae58-06b110abdef0 on n-h2-846435-14 Jul 25 14:33:09.298215 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-e1abfc49-bac0-458b-81c1-b95c84e34617 req-036ac806-363a-4c19-a67f-fcfd4f7e7d50 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071656 Jul 25 14:33:09.299409 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1063/2043] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:33:09.303843 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9f007f96-adeb-4390-a3a3-409af672a72d tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:09.304575 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9f007f96-adeb-4390-a3a3-409af672a72d tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] [instance: a1ee79ec-d346-42f8-ae58-06b110abdef0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:09.326351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f007f96-adeb-4390-a3a3-409af672a72d tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:09.327732 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f007f96-adeb-4390-a3a3-409af672a72d tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:09.329097 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f007f96-adeb-4390-a3a3-409af672a72d tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:09.330754 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f007f96-adeb-4390-a3a3-409af672a72d tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:09.409843 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f007f96-adeb-4390-a3a3-409af672a72d tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:09.410300 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f007f96-adeb-4390-a3a3-409af672a72d tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:09.410778 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-9f007f96-adeb-4390-a3a3-409af672a72d tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lazy-loading 'fault' on Instance uuid a1ee79ec-d346-42f8-ae58-06b110abdef0 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:33:09.435696 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-21da2925-4455-46e7-8e61-8b42213ef703 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:09.437214 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-21da2925-4455-46e7-8e61-8b42213ef703 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:09.444958 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-21da2925-4455-46e7-8e61-8b42213ef703 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:09.445828 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-21da2925-4455-46e7-8e61-8b42213ef703 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:09.448504 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-21da2925-4455-46e7-8e61-8b42213ef703 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:09.449860 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-21da2925-4455-46e7-8e61-8b42213ef703 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:09.565793 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9f007f96-adeb-4390-a3a3-409af672a72d tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd9f6ef6ef34b51a55bb71f5d06040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01423e9ea2b94eef87188b26f99f9ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:09.577877 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9f007f96-adeb-4390-a3a3-409af672a72d tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] 10.222.0.88 "GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0" status: 200 len: 1358 microversion: 2.1 time: 0.278114 Jul 25 14:33:09.580801 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 981/2044] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:09 2022] GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0 => generated 1358 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:09.805054 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ad68129c-ecd8-45d2-a071-6ca35fffba8b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:09.811359 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ad68129c-ecd8-45d2-a071-6ca35fffba8b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:09.827586 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ad68129c-ecd8-45d2-a071-6ca35fffba8b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:09.828445 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ad68129c-ecd8-45d2-a071-6ca35fffba8b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:09.830811 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ad68129c-ecd8-45d2-a071-6ca35fffba8b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:09.845975 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ad68129c-ecd8-45d2-a071-6ca35fffba8b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:10.582681 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-21da2925-4455-46e7-8e61-8b42213ef703 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:10.623037 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-21da2925-4455-46e7-8e61-8b42213ef703 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:10.627437 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-21da2925-4455-46e7-8e61-8b42213ef703 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:10.629211 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-21da2925-4455-46e7-8e61-8b42213ef703 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1488 microversion: 2.25 time: 1.198775 Jul 25 14:33:10.634440 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1064/2045] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:09 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1488 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:33:10.649599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-97a0d596-0c31-4d76-8c37-61860415be91 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:10.666239 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-97a0d596-0c31-4d76-8c37-61860415be91 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:10.688523 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-97a0d596-0c31-4d76-8c37-61860415be91 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:10.689055 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-97a0d596-0c31-4d76-8c37-61860415be91 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:10.690008 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-97a0d596-0c31-4d76-8c37-61860415be91 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:10.690349 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-97a0d596-0c31-4d76-8c37-61860415be91 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:10.877293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ad68129c-ecd8-45d2-a071-6ca35fffba8b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:10.892490 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ad68129c-ecd8-45d2-a071-6ca35fffba8b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 200 len: 1353 microversion: 2.1 time: 1.112271 Jul 25 14:33:10.908676 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 982/2046] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:09 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 1353 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:10.915171 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cf120127-f870-497e-b885-42cc5d96b7c3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:10.916176 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cf120127-f870-497e-b885-42cc5d96b7c3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 95cc15d2-9357-439c-8b9c-ed54768c1697] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:10.923146 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf120127-f870-497e-b885-42cc5d96b7c3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:10.923886 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf120127-f870-497e-b885-42cc5d96b7c3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:10.924956 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf120127-f870-497e-b885-42cc5d96b7c3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:10.925594 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf120127-f870-497e-b885-42cc5d96b7c3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:11.043987 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-97a0d596-0c31-4d76-8c37-61860415be91 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:11.053849 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-97a0d596-0c31-4d76-8c37-61860415be91 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10" status: 200 len: 1318 microversion: 2.1 time: 0.417744 Jul 25 14:33:11.057174 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1065/2047] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:10 2022] GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 => generated 1318 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:11.067871 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-51eb662e-d642-4352-a86a-b4270604722c tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:11.068571 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-51eb662e-d642-4352-a86a-b4270604722c tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] [instance: a1ee79ec-d346-42f8-ae58-06b110abdef0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:11.086509 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51eb662e-d642-4352-a86a-b4270604722c tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:11.087220 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51eb662e-d642-4352-a86a-b4270604722c tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:11.088129 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51eb662e-d642-4352-a86a-b4270604722c tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:11.088686 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51eb662e-d642-4352-a86a-b4270604722c tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:11.166676 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51eb662e-d642-4352-a86a-b4270604722c tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:11.167029 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51eb662e-d642-4352-a86a-b4270604722c tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:11.167521 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-51eb662e-d642-4352-a86a-b4270604722c tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lazy-loading 'fault' on Instance uuid a1ee79ec-d346-42f8-ae58-06b110abdef0 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:33:11.253501 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-51eb662e-d642-4352-a86a-b4270604722c tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd9f6ef6ef34b51a55bb71f5d06040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01423e9ea2b94eef87188b26f99f9ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:11.261131 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-51eb662e-d642-4352-a86a-b4270604722c tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] 10.222.0.88 "GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0" status: 200 len: 1358 microversion: 2.1 time: 0.201629 Jul 25 14:33:11.261781 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1066/2048] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:11 2022] GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0 => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:11.532656 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cf120127-f870-497e-b885-42cc5d96b7c3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:11.542159 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cf120127-f870-497e-b885-42cc5d96b7c3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697" status: 200 len: 1318 microversion: 2.1 time: 0.631782 Jul 25 14:33:11.549811 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 983/2049] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:10 2022] GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697 => generated 1318 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:11.665141 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-81b39522-21e5-4a48-8bfc-9723ddd83af5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:11.665765 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-81b39522-21e5-4a48-8bfc-9723ddd83af5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:11.682038 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-81b39522-21e5-4a48-8bfc-9723ddd83af5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:11.691171 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-81b39522-21e5-4a48-8bfc-9723ddd83af5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:11.692580 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-81b39522-21e5-4a48-8bfc-9723ddd83af5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:11.693216 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-81b39522-21e5-4a48-8bfc-9723ddd83af5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:11.920291 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b6694516-bd7b-484d-9a1d-c705b4d72550 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:11.921844 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b6694516-bd7b-484d-9a1d-c705b4d72550 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:11.933459 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:33:11.947853 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b6694516-bd7b-484d-9a1d-c705b4d72550 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:11.950705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b6694516-bd7b-484d-9a1d-c705b4d72550 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:11.954791 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b6694516-bd7b-484d-9a1d-c705b4d72550 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:11.955382 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b6694516-bd7b-484d-9a1d-c705b4d72550 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:12.675867 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b6694516-bd7b-484d-9a1d-c705b4d72550 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:12.684570 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b6694516-bd7b-484d-9a1d-c705b4d72550 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 200 len: 1353 microversion: 2.1 time: 0.771825 Jul 25 14:33:12.685189 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 984/2050] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:11 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 1353 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:12.700298 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c6538ad3-e3ea-486c-9e06-eee3cdfaf75b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:12.700949 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c6538ad3-e3ea-486c-9e06-eee3cdfaf75b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:12.717882 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c6538ad3-e3ea-486c-9e06-eee3cdfaf75b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:12.718057 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-81b39522-21e5-4a48-8bfc-9723ddd83af5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:12.718538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c6538ad3-e3ea-486c-9e06-eee3cdfaf75b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:12.719457 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c6538ad3-e3ea-486c-9e06-eee3cdfaf75b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:12.720391 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c6538ad3-e3ea-486c-9e06-eee3cdfaf75b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:12.737601 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-81b39522-21e5-4a48-8bfc-9723ddd83af5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:12.739824 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-81b39522-21e5-4a48-8bfc-9723ddd83af5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:12.741162 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-81b39522-21e5-4a48-8bfc-9723ddd83af5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1488 microversion: 2.25 time: 1.081722 Jul 25 14:33:12.742116 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1067/2051] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:11 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1488 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:33:12.747105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-00717e48-97bb-48a0-aa93-92bc214c5c60 req-60cbcbb8-5e81-4832-bf30-3eecc2708077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc", "name": "network-vif-plugged", "status": "completed", "tag": "a73bae6a-8192-437d-9578-029a5f5211b2"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:12.770077 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-00717e48-97bb-48a0-aa93-92bc214c5c60 req-60cbcbb8-5e81-4832-bf30-3eecc2708077 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:12.773833 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-00717e48-97bb-48a0-aa93-92bc214c5c60 req-60cbcbb8-5e81-4832-bf30-3eecc2708077 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:12.803540 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-00717e48-97bb-48a0-aa93-92bc214c5c60 req-60cbcbb8-5e81-4832-bf30-3eecc2708077 service nova] Creating event network-vif-plugged:a73bae6a-8192-437d-9578-029a5f5211b2 for instance c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc on n-h1-846435-14 Jul 25 14:33:12.830007 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-00717e48-97bb-48a0-aa93-92bc214c5c60 req-60cbcbb8-5e81-4832-bf30-3eecc2708077 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086546 Jul 25 14:33:12.831005 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1068/2052] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:33:12.838831 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-8320cf97-1f10-4988-827d-cde8cf3d5225 req-77dbc8ef-a0c7-469b-95a0-ad26681adda4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8aff0899-f62a-4ffc-924c-c782f7eb417f", "tag": "a7527035-2f22-4802-9d4e-d50a95d010a1"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:12.864591 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-8320cf97-1f10-4988-827d-cde8cf3d5225 req-77dbc8ef-a0c7-469b-95a0-ad26681adda4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:12.865437 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-8320cf97-1f10-4988-827d-cde8cf3d5225 req-77dbc8ef-a0c7-469b-95a0-ad26681adda4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:12.893370 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-8320cf97-1f10-4988-827d-cde8cf3d5225 req-77dbc8ef-a0c7-469b-95a0-ad26681adda4 service nova] Creating event network-changed:a7527035-2f22-4802-9d4e-d50a95d010a1 for instance 8aff0899-f62a-4ffc-924c-c782f7eb417f on n-h1-846435-14 Jul 25 14:33:12.894561 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:33:12.900041 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-8320cf97-1f10-4988-827d-cde8cf3d5225 req-77dbc8ef-a0c7-469b-95a0-ad26681adda4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067293 Jul 25 14:33:12.901180 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1069/2053] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:33:12.909453 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4cfc7714-92ba-492d-9365-181e93c48ac6 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:12.910527 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4cfc7714-92ba-492d-9365-181e93c48ac6 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] [instance: a1ee79ec-d346-42f8-ae58-06b110abdef0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:12.919916 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4cfc7714-92ba-492d-9365-181e93c48ac6 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:12.920667 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4cfc7714-92ba-492d-9365-181e93c48ac6 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:12.922183 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4cfc7714-92ba-492d-9365-181e93c48ac6 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:12.922960 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4cfc7714-92ba-492d-9365-181e93c48ac6 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:12.966574 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-4cfc7714-92ba-492d-9365-181e93c48ac6 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] HTTP exception thrown: Instance a1ee79ec-d346-42f8-ae58-06b110abdef0 could not be found. Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4cfc7714-92ba-492d-9365-181e93c48ac6 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Request method failure captured: Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0 HTTP/1.1 Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qkyvrwhFUGPYs2f8r0bonNS2arfPsi4OpzKHV5Tbv2xQSTHTN-kNyp3sY6KhNIe0E2kbKbbMeIzRwxomGawCyu7UJIaekSV533l1NTKOoUA_ZPm_bDaJdA4BT2cDCHjNPH4yTgZSBiFHFZshfG_7yRmuYVri-j1baks5KH0X2JDG20 Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 01423e9ea2b94eef87188b26f99f9ae4 Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersTestJSON-91549264 Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/01423e9ea2b94eef87188b26f99f9ae4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/01423e9ea2b94eef87188b26f99f9ae4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_01423e9ea2b94eef87188b26f99f9ae4", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/01423e9ea2b94eef87188b26f99f9ae4"}]}] Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersTestJSON-91549264 Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 01423e9ea2b94eef87188b26f99f9ae4 Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersTestJSON-91549264 Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersTestJSON-91549264-project Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 2bd9f6ef6ef34b51a55bb71f5d06040d Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersTestJSON-91549264-project Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance a1ee79ec-d346-42f8-ae58-06b110abdef0 could not be found. Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'a1ee79ec-d346-42f8-ae58-06b110abdef0'} Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1ee79ec-d346-42f8-ae58-06b110abdef0 could not be found. Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1ee79ec-d346-42f8-ae58-06b110abdef0 could not be found. Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:12.968852 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:33:12.975662 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:33:12.975662 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:33:12.975662 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:33:12.975662 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:33:12.975662 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1ee79ec-d346-42f8-ae58-06b110abdef0 could not be found. Jul 25 14:33:12.975662 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:12.975662 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4cfc7714-92ba-492d-9365-181e93c48ac6 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Returning 404 to user: Instance a1ee79ec-d346-42f8-ae58-06b110abdef0 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:33:12.975662 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4cfc7714-92ba-492d-9365-181e93c48ac6 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] 10.222.0.88 "GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0" status: 404 len: 111 microversion: 2.1 time: 0.071627 Jul 25 14:33:12.980081 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1070/2054] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:12 2022] GET /compute/v2.1/servers/a1ee79ec-d346-42f8-ae58-06b110abdef0 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:33:12.982888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a52b1da8-afdf-47a4-aa79-63b3e162ea04 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:12.983646 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a52b1da8-afdf-47a4-aa79-63b3e162ea04 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 95cc15d2-9357-439c-8b9c-ed54768c1697] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:12.990598 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a52b1da8-afdf-47a4-aa79-63b3e162ea04 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:12.991165 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a52b1da8-afdf-47a4-aa79-63b3e162ea04 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:12.993681 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a52b1da8-afdf-47a4-aa79-63b3e162ea04 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:12.994450 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a52b1da8-afdf-47a4-aa79-63b3e162ea04 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:13.254319 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c6538ad3-e3ea-486c-9e06-eee3cdfaf75b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:13.264167 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c6538ad3-e3ea-486c-9e06-eee3cdfaf75b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10" status: 200 len: 1318 microversion: 2.1 time: 0.577850 Jul 25 14:33:13.269461 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 985/2055] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:12 2022] GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 => generated 1318 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:13.282888 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7b2c6d2d-7425-41c5-bfc8-ce107db6c495 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] Calling method '.version_select at 0x7f46988ad9d0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:13.327491 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7b2c6d2d-7425-41c5-bfc8-ce107db6c495 tempest-ServersTestJSON-91549264 tempest-ServersTestJSON-91549264-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-709633153" status: 202 len: 0 microversion: 2.1 time: 0.056540 Jul 25 14:33:13.338033 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 986/2056] 10.222.0.88 () {58 vars in 1218 bytes} [Mon Jul 25 14:33:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-709633153 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:33:13.347484 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-20dd9fd4-49f6-48d3-9b81-3da156eaf3ba req-274ebae5-aa2b-41b1-854d-c751b45c84f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "324085c2-5228-46ba-8b72-5ee6f112b1d2", "name": "network-vif-unplugged", "status": "completed", "tag": "de9facd1-8929-497d-9f75-3802fcffc1d0"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:13.363458 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-20dd9fd4-49f6-48d3-9b81-3da156eaf3ba req-274ebae5-aa2b-41b1-854d-c751b45c84f7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:13.364333 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-20dd9fd4-49f6-48d3-9b81-3da156eaf3ba req-274ebae5-aa2b-41b1-854d-c751b45c84f7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:13.379526 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-20dd9fd4-49f6-48d3-9b81-3da156eaf3ba req-274ebae5-aa2b-41b1-854d-c751b45c84f7 service nova] Creating event network-vif-unplugged:de9facd1-8929-497d-9f75-3802fcffc1d0 for instance 324085c2-5228-46ba-8b72-5ee6f112b1d2 on n-h1-846435-14 Jul 25 14:33:13.395800 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-20dd9fd4-49f6-48d3-9b81-3da156eaf3ba req-274ebae5-aa2b-41b1-854d-c751b45c84f7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055202 Jul 25 14:33:13.397616 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 987/2057] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:33:13.711433 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5763a613-91da-423d-86e2-1c4f8edb4d64 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:13.712462 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5763a613-91da-423d-86e2-1c4f8edb4d64 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:13.741788 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5763a613-91da-423d-86e2-1c4f8edb4d64 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:13.743718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5763a613-91da-423d-86e2-1c4f8edb4d64 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:13.747761 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5763a613-91da-423d-86e2-1c4f8edb4d64 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:13.750816 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5763a613-91da-423d-86e2-1c4f8edb4d64 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:13.968426 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a52b1da8-afdf-47a4-aa79-63b3e162ea04 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:13.979265 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a52b1da8-afdf-47a4-aa79-63b3e162ea04 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697" status: 200 len: 1318 microversion: 2.1 time: 1.000931 Jul 25 14:33:13.980240 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1071/2058] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:12 2022] GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697 => generated 1318 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:13.986525 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-44d4c8bb-1b58-4044-af57-021d8533b3b1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:13.988010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-44d4c8bb-1b58-4044-af57-021d8533b3b1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:14.002673 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-44d4c8bb-1b58-4044-af57-021d8533b3b1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:14.004357 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-44d4c8bb-1b58-4044-af57-021d8533b3b1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:14.006879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-44d4c8bb-1b58-4044-af57-021d8533b3b1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:14.008076 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-44d4c8bb-1b58-4044-af57-021d8533b3b1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:14.710463 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-44d4c8bb-1b58-4044-af57-021d8533b3b1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:14.761848 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-44d4c8bb-1b58-4044-af57-021d8533b3b1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:14.767176 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-44d4c8bb-1b58-4044-af57-021d8533b3b1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:14.772956 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-44d4c8bb-1b58-4044-af57-021d8533b3b1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1488 microversion: 2.25 time: 0.790753 Jul 25 14:33:14.777388 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1072/2059] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:13 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1488 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:33:14.794653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-88ce548e-4faf-4d99-b4d3-af3749b7dfc2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:14.794653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-88ce548e-4faf-4d99-b4d3-af3749b7dfc2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:14.809848 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-88ce548e-4faf-4d99-b4d3-af3749b7dfc2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:14.810838 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-88ce548e-4faf-4d99-b4d3-af3749b7dfc2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:14.815301 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-88ce548e-4faf-4d99-b4d3-af3749b7dfc2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:14.815900 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-88ce548e-4faf-4d99-b4d3-af3749b7dfc2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:14.818038 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5763a613-91da-423d-86e2-1c4f8edb4d64 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:14.827877 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5763a613-91da-423d-86e2-1c4f8edb4d64 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 200 len: 1353 microversion: 2.1 time: 1.122446 Jul 25 14:33:14.838398 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 988/2060] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:13 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 1353 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:14.915029 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-e932ce51-fd23-4d3b-8992-e3c20e9b4618 req-36066352-7f4d-4f43-bac3-4fa7b1c2493d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc", "name": "network-vif-plugged", "status": "completed", "tag": "aaa9b232-7d76-46cd-a94b-3ff365af44d0"}, {"server_uuid": "c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc", "name": "network-vif-plugged", "status": "completed", "tag": "3407a14a-b3dc-4c7c-8bfa-7a1be3bcbd9e"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:14.936810 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-e932ce51-fd23-4d3b-8992-e3c20e9b4618 req-36066352-7f4d-4f43-bac3-4fa7b1c2493d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:14.939560 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-e932ce51-fd23-4d3b-8992-e3c20e9b4618 req-36066352-7f4d-4f43-bac3-4fa7b1c2493d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:14.976599 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-e932ce51-fd23-4d3b-8992-e3c20e9b4618 req-36066352-7f4d-4f43-bac3-4fa7b1c2493d service nova] Creating event network-vif-plugged:aaa9b232-7d76-46cd-a94b-3ff365af44d0 for instance c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc on n-h1-846435-14 Jul 25 14:33:14.977640 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-e932ce51-fd23-4d3b-8992-e3c20e9b4618 req-36066352-7f4d-4f43-bac3-4fa7b1c2493d service nova] Creating event network-vif-plugged:3407a14a-b3dc-4c7c-8bfa-7a1be3bcbd9e for instance c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc on n-h1-846435-14 Jul 25 14:33:14.993157 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-e932ce51-fd23-4d3b-8992-e3c20e9b4618 req-36066352-7f4d-4f43-bac3-4fa7b1c2493d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.077720 Jul 25 14:33:14.995291 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 989/2061] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:33:15.004679 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-607f87bb-c016-4703-82da-13462d18008e req-9c7d6acc-37b0-42cc-9f66-9f1fb3a882b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95cc15d2-9357-439c-8b9c-ed54768c1697", "tag": "35ae9ccc-747f-47db-bfd7-635c2296eb8f"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:15.031217 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-607f87bb-c016-4703-82da-13462d18008e req-9c7d6acc-37b0-42cc-9f66-9f1fb3a882b2 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:15.031665 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-607f87bb-c016-4703-82da-13462d18008e req-9c7d6acc-37b0-42cc-9f66-9f1fb3a882b2 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:15.049775 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-607f87bb-c016-4703-82da-13462d18008e req-9c7d6acc-37b0-42cc-9f66-9f1fb3a882b2 service nova] Creating event network-changed:35ae9ccc-747f-47db-bfd7-635c2296eb8f for instance 95cc15d2-9357-439c-8b9c-ed54768c1697 on n-h2-846435-14 Jul 25 14:33:15.057133 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-607f87bb-c016-4703-82da-13462d18008e req-9c7d6acc-37b0-42cc-9f66-9f1fb3a882b2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057778 Jul 25 14:33:15.058381 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 990/2062] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:33:15.065539 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-56e50a28-5949-4a51-81ea-ea0cbdd0f46e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:15.066650 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-56e50a28-5949-4a51-81ea-ea0cbdd0f46e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 95cc15d2-9357-439c-8b9c-ed54768c1697] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:15.084486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56e50a28-5949-4a51-81ea-ea0cbdd0f46e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:15.087172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56e50a28-5949-4a51-81ea-ea0cbdd0f46e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:15.091549 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56e50a28-5949-4a51-81ea-ea0cbdd0f46e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:15.092652 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56e50a28-5949-4a51-81ea-ea0cbdd0f46e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:15.281299 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-88ce548e-4faf-4d99-b4d3-af3749b7dfc2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:15.289900 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-88ce548e-4faf-4d99-b4d3-af3749b7dfc2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10" status: 200 len: 1318 microversion: 2.1 time: 0.508410 Jul 25 14:33:15.304330 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1073/2063] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:14 2022] GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 => generated 1318 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:15.448348 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-9bdadecb-3fa8-477e-b8c6-850147d8040c req-ce3bdfc9-dffa-4367-8da5-595ca572734a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "324085c2-5228-46ba-8b72-5ee6f112b1d2", "tag": "de9facd1-8929-497d-9f75-3802fcffc1d0"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:15.477846 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-9bdadecb-3fa8-477e-b8c6-850147d8040c req-ce3bdfc9-dffa-4367-8da5-595ca572734a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:15.478311 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-9bdadecb-3fa8-477e-b8c6-850147d8040c req-ce3bdfc9-dffa-4367-8da5-595ca572734a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:15.509308 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-9bdadecb-3fa8-477e-b8c6-850147d8040c req-ce3bdfc9-dffa-4367-8da5-595ca572734a service nova] Creating event network-changed:de9facd1-8929-497d-9f75-3802fcffc1d0 for instance 324085c2-5228-46ba-8b72-5ee6f112b1d2 on n-h1-846435-14 Jul 25 14:33:15.518183 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-9bdadecb-3fa8-477e-b8c6-850147d8040c req-ce3bdfc9-dffa-4367-8da5-595ca572734a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076007 Jul 25 14:33:15.524477 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1074/2064] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:33:15.663845 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-56e50a28-5949-4a51-81ea-ea0cbdd0f46e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:15.677306 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-56e50a28-5949-4a51-81ea-ea0cbdd0f46e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697" status: 200 len: 1318 microversion: 2.1 time: 0.617302 Jul 25 14:33:15.678227 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 991/2065] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:15 2022] GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697 => generated 1318 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:15.806062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fab26632-4f9c-4ad2-b9fb-90c3cf8bce5d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:15.806062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fab26632-4f9c-4ad2-b9fb-90c3cf8bce5d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:15.810733 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=24 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:33:15.813049 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=10 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:33:15.819625 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fab26632-4f9c-4ad2-b9fb-90c3cf8bce5d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:15.820417 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fab26632-4f9c-4ad2-b9fb-90c3cf8bce5d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:15.821410 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fab26632-4f9c-4ad2-b9fb-90c3cf8bce5d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:15.822900 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fab26632-4f9c-4ad2-b9fb-90c3cf8bce5d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:15.854510 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-24c7676c-2efc-4209-88d3-a1bb5c250bef tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:15.855910 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-24c7676c-2efc-4209-88d3-a1bb5c250bef tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:15.869029 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-24c7676c-2efc-4209-88d3-a1bb5c250bef tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:15.869526 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-24c7676c-2efc-4209-88d3-a1bb5c250bef tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:15.870362 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-24c7676c-2efc-4209-88d3-a1bb5c250bef tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:15.870796 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-24c7676c-2efc-4209-88d3-a1bb5c250bef tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:16.068022 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=18 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:33:16.542556 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-24c7676c-2efc-4209-88d3-a1bb5c250bef tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:16.550850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:33:16.563808 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-24c7676c-2efc-4209-88d3-a1bb5c250bef tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 200 len: 1353 microversion: 2.1 time: 0.710945 Jul 25 14:33:16.565190 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 992/2066] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:15 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 1353 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:16.582041 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-869a74ae-09b0-4b3b-b995-c6b6edd84e83 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:16.582386 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-869a74ae-09b0-4b3b-b995-c6b6edd84e83 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:16.589837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-869a74ae-09b0-4b3b-b995-c6b6edd84e83 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:16.590296 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-869a74ae-09b0-4b3b-b995-c6b6edd84e83 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:16.591272 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-869a74ae-09b0-4b3b-b995-c6b6edd84e83 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:16.591693 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-869a74ae-09b0-4b3b-b995-c6b6edd84e83 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:16.740033 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fab26632-4f9c-4ad2-b9fb-90c3cf8bce5d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:16.749861 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fab26632-4f9c-4ad2-b9fb-90c3cf8bce5d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:16.751995 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fab26632-4f9c-4ad2-b9fb-90c3cf8bce5d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:16.753597 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fab26632-4f9c-4ad2-b9fb-90c3cf8bce5d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1488 microversion: 2.25 time: 0.954408 Jul 25 14:33:16.754423 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1075/2067] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:15 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1488 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:33:16.775362 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-07b56998-b424-465c-ae79-470f2a9805d1 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:16.776530 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-07b56998-b424-465c-ae79-470f2a9805d1 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 95cc15d2-9357-439c-8b9c-ed54768c1697] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:16.784344 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-07b56998-b424-465c-ae79-470f2a9805d1 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:16.785210 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-07b56998-b424-465c-ae79-470f2a9805d1 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:16.786281 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-07b56998-b424-465c-ae79-470f2a9805d1 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:16.787321 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-07b56998-b424-465c-ae79-470f2a9805d1 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:16.922525 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-869a74ae-09b0-4b3b-b995-c6b6edd84e83 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:16.935889 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-869a74ae-09b0-4b3b-b995-c6b6edd84e83 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10" status: 200 len: 1318 microversion: 2.1 time: 0.366061 Jul 25 14:33:16.936917 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 993/2068] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:16 2022] GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:16.992074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-07b56998-b424-465c-ae79-470f2a9805d1 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:17.000629 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-07b56998-b424-465c-ae79-470f2a9805d1 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697" status: 200 len: 1318 microversion: 2.1 time: 0.230947 Jul 25 14:33:17.015684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-8cb5bff9-4426-4d4d-a78a-a3f84304d27a req-e8b4671f-b41a-4ba3-b3c3-65fb638ccdd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fd8f96b-72ae-4a66-a6a4-cf708a0bba10", "name": "network-vif-plugged", "status": "completed", "tag": "a09cef79-5865-4d30-8077-46a9d142f0d0"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:17.016224 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1076/2069] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:16 2022] GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:17.031919 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-8cb5bff9-4426-4d4d-a78a-a3f84304d27a req-e8b4671f-b41a-4ba3-b3c3-65fb638ccdd7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:17.032900 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-8cb5bff9-4426-4d4d-a78a-a3f84304d27a req-e8b4671f-b41a-4ba3-b3c3-65fb638ccdd7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:17.049153 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-8cb5bff9-4426-4d4d-a78a-a3f84304d27a req-e8b4671f-b41a-4ba3-b3c3-65fb638ccdd7 service nova] Creating event network-vif-plugged:a09cef79-5865-4d30-8077-46a9d142f0d0 for instance 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 on n-h1-846435-14 Jul 25 14:33:17.055556 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-8cb5bff9-4426-4d4d-a78a-a3f84304d27a req-e8b4671f-b41a-4ba3-b3c3-65fb638ccdd7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043633 Jul 25 14:33:17.056403 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 994/2070] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:33:17.427766 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1c97dc5c-e29d-468a-a524-9af6f1589531 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-2094106166", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "4345ae92-84ce-43bf-81a1-5c1f865e1517"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:17.501315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-1c97dc5c-e29d-468a-a524-9af6f1589531 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] validate_networks() for [('4345ae92-84ce-43bf-81a1-5c1f865e1517', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:33:17.587393 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-523329e8-444e-4cfe-991a-883cf2afb97b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:17.588472 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-523329e8-444e-4cfe-991a-883cf2afb97b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:17.595499 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-523329e8-444e-4cfe-991a-883cf2afb97b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:17.596360 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-523329e8-444e-4cfe-991a-883cf2afb97b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:17.597410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-523329e8-444e-4cfe-991a-883cf2afb97b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:17.598073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-523329e8-444e-4cfe-991a-883cf2afb97b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:17.863560 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-523329e8-444e-4cfe-991a-883cf2afb97b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:17.898132 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-523329e8-444e-4cfe-991a-883cf2afb97b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 200 len: 1353 microversion: 2.1 time: 0.314029 Jul 25 14:33:17.898745 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 995/2071] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:17 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 1353 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:33:17.913042 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1e726c60-b3ec-4f8b-992b-292bc3444e84 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:17.917579 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1e726c60-b3ec-4f8b-992b-292bc3444e84 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:17.954362 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e726c60-b3ec-4f8b-992b-292bc3444e84 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:17.956164 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e726c60-b3ec-4f8b-992b-292bc3444e84 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:17.959690 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e726c60-b3ec-4f8b-992b-292bc3444e84 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:17.960537 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e726c60-b3ec-4f8b-992b-292bc3444e84 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:18.089522 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-1c97dc5c-e29d-468a-a524-9af6f1589531 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:33:18.090105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-1c97dc5c-e29d-468a-a524-9af6f1589531 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:33:18.090397 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-1c97dc5c-e29d-468a-a524-9af6f1589531 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:33:18.090840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-1c97dc5c-e29d-468a-a524-9af6f1589531 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:33:18.091460 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-1c97dc5c-e29d-468a-a524-9af6f1589531 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:33:18.102882 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1c97dc5c-e29d-468a-a524-9af6f1589531 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:18.103761 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1c97dc5c-e29d-468a-a524-9af6f1589531 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:18.105499 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1c97dc5c-e29d-468a-a524-9af6f1589531 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:18.105946 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1c97dc5c-e29d-468a-a524-9af6f1589531 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:18.128666 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-1c97dc5c-e29d-468a-a524-9af6f1589531 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Getting quotas for project 9f2c3dda90594fd3a3a244455e927dc1. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:33:18.135583 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-1c97dc5c-e29d-468a-a524-9af6f1589531 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Getting quotas for user 51d8c4ea897e4b22919abd8ff4cf3e9b and project 9f2c3dda90594fd3a3a244455e927dc1. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:33:18.149552 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1c97dc5c-e29d-468a-a524-9af6f1589531 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:33:18.152486 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1c97dc5c-e29d-468a-a524-9af6f1589531 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] [instance: 5a4c1f93-ad00-410d-aaa7-726ba1b3a262] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:33:18.209972 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1c97dc5c-e29d-468a-a524-9af6f1589531 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.953281 Jul 25 14:33:18.217117 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1077/2072] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:33:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:33:18.223618 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4207de9f-c890-4142-9b76-502d6b792402 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:18.224573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4207de9f-c890-4142-9b76-502d6b792402 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:18.232997 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4207de9f-c890-4142-9b76-502d6b792402 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:18.233913 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4207de9f-c890-4142-9b76-502d6b792402 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:18.240818 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4207de9f-c890-4142-9b76-502d6b792402 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:18.241750 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4207de9f-c890-4142-9b76-502d6b792402 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:18.290675 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1e726c60-b3ec-4f8b-992b-292bc3444e84 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:18.299699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1e726c60-b3ec-4f8b-992b-292bc3444e84 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:18.301103 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1e726c60-b3ec-4f8b-992b-292bc3444e84 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:18.302381 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1e726c60-b3ec-4f8b-992b-292bc3444e84 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1488 microversion: 2.25 time: 0.400747 Jul 25 14:33:18.302960 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 996/2073] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:17 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1488 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:33:18.314567 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cafa4fac-a477-458d-9227-5836a7e65624 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:18.315193 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cafa4fac-a477-458d-9227-5836a7e65624 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 95cc15d2-9357-439c-8b9c-ed54768c1697] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:18.333123 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cafa4fac-a477-458d-9227-5836a7e65624 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:18.333123 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cafa4fac-a477-458d-9227-5836a7e65624 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:18.333716 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cafa4fac-a477-458d-9227-5836a7e65624 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:18.335467 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cafa4fac-a477-458d-9227-5836a7e65624 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:18.510936 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4207de9f-c890-4142-9b76-502d6b792402 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:18.520940 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4207de9f-c890-4142-9b76-502d6b792402 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10" status: 200 len: 1318 microversion: 2.1 time: 0.302197 Jul 25 14:33:18.537044 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1078/2074] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:18 2022] GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:18.553490 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f51778b5-8843-4774-92df-165b5cd7b760 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:18.554705 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f51778b5-8843-4774-92df-165b5cd7b760 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] [instance: 5a4c1f93-ad00-410d-aaa7-726ba1b3a262] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:18.673423 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f51778b5-8843-4774-92df-165b5cd7b760 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8c4ea897e4b22919abd8ff4cf3e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c3dda90594fd3a3a244455e927dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:18.685603 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f51778b5-8843-4774-92df-165b5cd7b760 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] 10.222.0.88 "GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262" status: 200 len: 1216 microversion: 2.1 time: 0.146128 Jul 25 14:33:18.688268 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1079/2075] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:18 2022] GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262 => generated 1216 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:18.777311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cafa4fac-a477-458d-9227-5836a7e65624 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:18.787535 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cafa4fac-a477-458d-9227-5836a7e65624 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697" status: 200 len: 1318 microversion: 2.1 time: 0.483382 Jul 25 14:33:18.789896 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 997/2076] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:18 2022] GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697 => generated 1318 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:18.925867 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3e94dcbb-ddf3-403e-96d0-87e98dd92eca tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:18.926835 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3e94dcbb-ddf3-403e-96d0-87e98dd92eca tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:18.938826 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e94dcbb-ddf3-403e-96d0-87e98dd92eca tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:18.940438 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e94dcbb-ddf3-403e-96d0-87e98dd92eca tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:18.947804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e94dcbb-ddf3-403e-96d0-87e98dd92eca tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:18.948413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e94dcbb-ddf3-403e-96d0-87e98dd92eca tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:19.221446 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3e94dcbb-ddf3-403e-96d0-87e98dd92eca tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:19.231627 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3e94dcbb-ddf3-403e-96d0-87e98dd92eca tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 200 len: 1802 microversion: 2.1 time: 0.312359 Jul 25 14:33:19.233773 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1080/2077] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:18 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 1802 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:33:19.255428 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-539409e7-e821-42fc-83af-3fc563b974b9 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:19.257220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-539409e7-e821-42fc-83af-3fc563b974b9 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:19.265531 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-539409e7-e821-42fc-83af-3fc563b974b9 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:19.266275 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-539409e7-e821-42fc-83af-3fc563b974b9 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:19.267265 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-539409e7-e821-42fc-83af-3fc563b974b9 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:19.267922 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-539409e7-e821-42fc-83af-3fc563b974b9 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:19.310303 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-539409e7-e821-42fc-83af-3fc563b974b9 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc/ips" status: 200 len: 217 microversion: 2.1 time: 0.060098 Jul 25 14:33:19.312462 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 998/2078] 10.222.0.88 () {58 vars in 1248 bytes} [Mon Jul 25 14:33:19 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc/ips => generated 217 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:33:19.331388 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-68834624-2290-47c8-ab9d-720107ed3cd4 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:19.331704 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-68834624-2290-47c8-ab9d-720107ed3cd4 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:19.341100 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3fb87fed-c9e4-482d-b75e-95e7125f6649 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:19.341718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3fb87fed-c9e4-482d-b75e-95e7125f6649 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:19.349570 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68834624-2290-47c8-ab9d-720107ed3cd4 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:19.350025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68834624-2290-47c8-ab9d-720107ed3cd4 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:19.350816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68834624-2290-47c8-ab9d-720107ed3cd4 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:19.351471 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68834624-2290-47c8-ab9d-720107ed3cd4 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:19.360240 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3fb87fed-c9e4-482d-b75e-95e7125f6649 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:19.360949 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3fb87fed-c9e4-482d-b75e-95e7125f6649 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:19.361920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3fb87fed-c9e4-482d-b75e-95e7125f6649 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:19.367678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3fb87fed-c9e4-482d-b75e-95e7125f6649 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:19.409763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-68834624-2290-47c8-ab9d-720107ed3cd4 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:33:19.526400 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-68834624-2290-47c8-ab9d-720107ed3cd4 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 204 len: 0 microversion: 2.1 time: 0.206367 Jul 25 14:33:19.527135 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1081/2079] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:33:19 2022] DELETE /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 14:33:19.537677 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9e06ac2a-045f-4351-89c8-f7f973f19eb3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:19.538959 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9e06ac2a-045f-4351-89c8-f7f973f19eb3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:19.542987 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:33:19.547421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9e06ac2a-045f-4351-89c8-f7f973f19eb3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:19.548373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9e06ac2a-045f-4351-89c8-f7f973f19eb3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:19.549369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9e06ac2a-045f-4351-89c8-f7f973f19eb3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:19.549988 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9e06ac2a-045f-4351-89c8-f7f973f19eb3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:19.584978 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:33:19.760532 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9e06ac2a-045f-4351-89c8-f7f973f19eb3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:19.771029 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9e06ac2a-045f-4351-89c8-f7f973f19eb3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 200 len: 1808 microversion: 2.1 time: 0.238263 Jul 25 14:33:19.772339 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1082/2080] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:19 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 1808 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:19.779195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a5215405-0e62-4596-a8cf-9ac2c9f7310d tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:19.781463 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a5215405-0e62-4596-a8cf-9ac2c9f7310d tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:19.799221 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5215405-0e62-4596-a8cf-9ac2c9f7310d tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:19.800298 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5215405-0e62-4596-a8cf-9ac2c9f7310d tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:19.802309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5215405-0e62-4596-a8cf-9ac2c9f7310d tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:19.803904 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5215405-0e62-4596-a8cf-9ac2c9f7310d tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:20.082822 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a5215405-0e62-4596-a8cf-9ac2c9f7310d tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:20.093507 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a5215405-0e62-4596-a8cf-9ac2c9f7310d tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10" status: 200 len: 1508 microversion: 2.1 time: 0.319793 Jul 25 14:33:20.094664 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1083/2081] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:19 2022] GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 => generated 1508 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:20.100407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f32db1a3-d5af-4663-a91d-d700d1e983e9 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:20.101148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f32db1a3-d5af-4663-a91d-d700d1e983e9 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] [instance: 5a4c1f93-ad00-410d-aaa7-726ba1b3a262] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:20.107608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f32db1a3-d5af-4663-a91d-d700d1e983e9 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:20.108194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f32db1a3-d5af-4663-a91d-d700d1e983e9 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:20.115896 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f32db1a3-d5af-4663-a91d-d700d1e983e9 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:20.116405 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f32db1a3-d5af-4663-a91d-d700d1e983e9 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:20.192946 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3fb87fed-c9e4-482d-b75e-95e7125f6649 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:20.213567 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3fb87fed-c9e4-482d-b75e-95e7125f6649 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:20.215509 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3fb87fed-c9e4-482d-b75e-95e7125f6649 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:20.217062 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3fb87fed-c9e4-482d-b75e-95e7125f6649 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1488 microversion: 2.25 time: 0.882798 Jul 25 14:33:20.217633 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 999/2082] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:19 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1488 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:33:20.225596 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2cb773bd-1891-4606-9da4-b52cebdbd299 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:20.226301 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2cb773bd-1891-4606-9da4-b52cebdbd299 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 95cc15d2-9357-439c-8b9c-ed54768c1697] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:20.246841 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2cb773bd-1891-4606-9da4-b52cebdbd299 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:20.247298 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2cb773bd-1891-4606-9da4-b52cebdbd299 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:20.248205 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2cb773bd-1891-4606-9da4-b52cebdbd299 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:20.248650 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2cb773bd-1891-4606-9da4-b52cebdbd299 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:20.353690 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f32db1a3-d5af-4663-a91d-d700d1e983e9 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8c4ea897e4b22919abd8ff4cf3e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c3dda90594fd3a3a244455e927dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:20.375548 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f32db1a3-d5af-4663-a91d-d700d1e983e9 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] 10.222.0.88 "GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262" status: 200 len: 1212 microversion: 2.1 time: 0.280247 Jul 25 14:33:20.376167 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1084/2083] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:20 2022] GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262 => generated 1212 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:20.381235 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-758ac791-2541-40b6-ac19-fb4a686162a6 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:20.381887 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-758ac791-2541-40b6-ac19-fb4a686162a6 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:20.399074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-758ac791-2541-40b6-ac19-fb4a686162a6 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:20.399524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-758ac791-2541-40b6-ac19-fb4a686162a6 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:20.400948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-758ac791-2541-40b6-ac19-fb4a686162a6 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:20.401407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-758ac791-2541-40b6-ac19-fb4a686162a6 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:20.842361 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-758ac791-2541-40b6-ac19-fb4a686162a6 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:20.857372 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-758ac791-2541-40b6-ac19-fb4a686162a6 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10" status: 200 len: 1508 microversion: 2.1 time: 0.480113 Jul 25 14:33:20.873387 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1085/2084] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:20 2022] GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 => generated 1508 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:20.873387 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-126621d3-5ae5-42a5-8f6f-a077140e3b1b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:20.874477 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-126621d3-5ae5-42a5-8f6f-a077140e3b1b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:20.889568 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-126621d3-5ae5-42a5-8f6f-a077140e3b1b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:20.890011 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-126621d3-5ae5-42a5-8f6f-a077140e3b1b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:20.890798 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-126621d3-5ae5-42a5-8f6f-a077140e3b1b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:20.891227 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-126621d3-5ae5-42a5-8f6f-a077140e3b1b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:20.997574 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2cb773bd-1891-4606-9da4-b52cebdbd299 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:21.018659 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2cb773bd-1891-4606-9da4-b52cebdbd299 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697" status: 200 len: 1318 microversion: 2.1 time: 0.797612 Jul 25 14:33:21.019249 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1000/2085] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:20 2022] GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697 => generated 1318 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:21.044476 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-9a8f7603-db62-4b55-8e2a-e5241339cf94 req-aecba069-2b67-4523-abf3-932190371732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aff0899-f62a-4ffc-924c-c782f7eb417f", "name": "network-vif-plugged", "status": "completed", "tag": "a7527035-2f22-4802-9d4e-d50a95d010a1"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:21.097902 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-9a8f7603-db62-4b55-8e2a-e5241339cf94 req-aecba069-2b67-4523-abf3-932190371732 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:21.098416 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-9a8f7603-db62-4b55-8e2a-e5241339cf94 req-aecba069-2b67-4523-abf3-932190371732 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:21.150896 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-9a8f7603-db62-4b55-8e2a-e5241339cf94 req-aecba069-2b67-4523-abf3-932190371732 service nova] Creating event network-vif-plugged:a7527035-2f22-4802-9d4e-d50a95d010a1 for instance 8aff0899-f62a-4ffc-924c-c782f7eb417f on n-h1-846435-14 Jul 25 14:33:21.163451 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-9a8f7603-db62-4b55-8e2a-e5241339cf94 req-aecba069-2b67-4523-abf3-932190371732 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139054 Jul 25 14:33:21.169434 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1001/2086] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:33:21.191914 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f0502b84-c880-4217-8781-53062c71fe05 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:21.199668 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f0502b84-c880-4217-8781-53062c71fe05 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:21.225984 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f0502b84-c880-4217-8781-53062c71fe05 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:21.239269 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f0502b84-c880-4217-8781-53062c71fe05 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:21.245321 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f0502b84-c880-4217-8781-53062c71fe05 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:21.253136 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f0502b84-c880-4217-8781-53062c71fe05 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:21.405962 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f0502b84-c880-4217-8781-53062c71fe05 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "PUT /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10" status: 200 len: 1080 microversion: 2.1 time: 0.234790 Jul 25 14:33:21.419259 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1002/2087] 10.222.0.88 () {60 vars in 1256 bytes} [Mon Jul 25 14:33:21 2022] PUT /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 => generated 1080 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:21.442493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d230fd71-d4cf-412d-9f03-8b294efb51cf tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:21.445312 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d230fd71-d4cf-412d-9f03-8b294efb51cf tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:21.461016 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d230fd71-d4cf-412d-9f03-8b294efb51cf tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:21.461465 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d230fd71-d4cf-412d-9f03-8b294efb51cf tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:21.462312 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d230fd71-d4cf-412d-9f03-8b294efb51cf tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:21.462746 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d230fd71-d4cf-412d-9f03-8b294efb51cf tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:21.475399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-126621d3-5ae5-42a5-8f6f-a077140e3b1b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:21.492976 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-126621d3-5ae5-42a5-8f6f-a077140e3b1b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 200 len: 1808 microversion: 2.1 time: 0.629213 Jul 25 14:33:21.495373 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1086/2088] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:20 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 1808 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:21.513512 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5c45e384-1b43-46f5-9205-3360c0d8657e tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:21.517383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5c45e384-1b43-46f5-9205-3360c0d8657e tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] [instance: 5a4c1f93-ad00-410d-aaa7-726ba1b3a262] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:21.545139 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c45e384-1b43-46f5-9205-3360c0d8657e tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:21.546397 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c45e384-1b43-46f5-9205-3360c0d8657e tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:21.548092 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c45e384-1b43-46f5-9205-3360c0d8657e tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:21.552709 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c45e384-1b43-46f5-9205-3360c0d8657e tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:21.706650 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5c45e384-1b43-46f5-9205-3360c0d8657e tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8c4ea897e4b22919abd8ff4cf3e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c3dda90594fd3a3a244455e927dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:21.732341 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5c45e384-1b43-46f5-9205-3360c0d8657e tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] 10.222.0.88 "GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262" status: 200 len: 1268 microversion: 2.1 time: 0.233467 Jul 25 14:33:21.747915 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1087/2089] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:21 2022] GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262 => generated 1268 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:21.759222 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7fe8bc95-3c13-4a31-8653-c0bd69ec2525 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:21.760264 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7fe8bc95-3c13-4a31-8653-c0bd69ec2525 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:21.773324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7fe8bc95-3c13-4a31-8653-c0bd69ec2525 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:21.774189 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7fe8bc95-3c13-4a31-8653-c0bd69ec2525 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:21.775652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7fe8bc95-3c13-4a31-8653-c0bd69ec2525 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:21.776472 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7fe8bc95-3c13-4a31-8653-c0bd69ec2525 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:22.460283 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7fe8bc95-3c13-4a31-8653-c0bd69ec2525 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:22.476185 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7fe8bc95-3c13-4a31-8653-c0bd69ec2525 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10" status: 200 len: 1506 microversion: 2.1 time: 0.724703 Jul 25 14:33:22.478084 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1088/2090] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:21 2022] GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 => generated 1506 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:22.503309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1036c30a-7d01-4e77-b5de-76860c15f3ac tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:22.504194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1036c30a-7d01-4e77-b5de-76860c15f3ac tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 95cc15d2-9357-439c-8b9c-ed54768c1697] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:22.533031 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1036c30a-7d01-4e77-b5de-76860c15f3ac tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:22.533987 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1036c30a-7d01-4e77-b5de-76860c15f3ac tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:22.534834 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1036c30a-7d01-4e77-b5de-76860c15f3ac tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:22.535267 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1036c30a-7d01-4e77-b5de-76860c15f3ac tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:22.713313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d230fd71-d4cf-412d-9f03-8b294efb51cf tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:22.724082 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d230fd71-d4cf-412d-9f03-8b294efb51cf tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:22.725645 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d230fd71-d4cf-412d-9f03-8b294efb51cf tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:22.737485 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d230fd71-d4cf-412d-9f03-8b294efb51cf tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1488 microversion: 2.25 time: 1.308310 Jul 25 14:33:22.738092 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1003/2091] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:21 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1488 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:33:22.765441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2189fcf1-a8d7-430c-9d10-de879ed1c611 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:22.766184 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2189fcf1-a8d7-430c-9d10-de879ed1c611 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:22.773878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2189fcf1-a8d7-430c-9d10-de879ed1c611 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:22.773878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2189fcf1-a8d7-430c-9d10-de879ed1c611 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:22.775617 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2189fcf1-a8d7-430c-9d10-de879ed1c611 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:22.776115 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2189fcf1-a8d7-430c-9d10-de879ed1c611 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:22.948152 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1036c30a-7d01-4e77-b5de-76860c15f3ac tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:22.956152 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1036c30a-7d01-4e77-b5de-76860c15f3ac tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697" status: 200 len: 1318 microversion: 2.1 time: 0.476567 Jul 25 14:33:22.957522 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1089/2092] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:22 2022] GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697 => generated 1318 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:22.962971 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2b96495e-8af1-448f-93d5-575b8d2201a0 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:22.963994 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2b96495e-8af1-448f-93d5-575b8d2201a0 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:22.970682 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b96495e-8af1-448f-93d5-575b8d2201a0 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:22.971403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b96495e-8af1-448f-93d5-575b8d2201a0 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:22.972414 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b96495e-8af1-448f-93d5-575b8d2201a0 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:22.973038 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b96495e-8af1-448f-93d5-575b8d2201a0 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:23.232901 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2b96495e-8af1-448f-93d5-575b8d2201a0 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:23.241381 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2b96495e-8af1-448f-93d5-575b8d2201a0 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 200 len: 1808 microversion: 2.1 time: 0.282354 Jul 25 14:33:23.248450 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1090/2093] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:22 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 1808 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:23.248450 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a3b5d5a5-f96e-4809-b90c-5a778f825055 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:23.248450 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a3b5d5a5-f96e-4809-b90c-5a778f825055 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] [instance: 5a4c1f93-ad00-410d-aaa7-726ba1b3a262] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:23.261309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3b5d5a5-f96e-4809-b90c-5a778f825055 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:23.261760 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3b5d5a5-f96e-4809-b90c-5a778f825055 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:23.264354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3b5d5a5-f96e-4809-b90c-5a778f825055 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:23.265204 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3b5d5a5-f96e-4809-b90c-5a778f825055 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:23.275820 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2189fcf1-a8d7-430c-9d10-de879ed1c611 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:23.295317 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2189fcf1-a8d7-430c-9d10-de879ed1c611 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10" status: 200 len: 1506 microversion: 2.1 time: 0.546800 Jul 25 14:33:23.297640 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1004/2094] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:22 2022] GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 => generated 1506 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:23.302331 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-ae8f67cf-9ab9-44ad-a9c7-ad75df80537c req-0c42a14b-380b-46d3-995d-d9a39a34aeed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "324085c2-5228-46ba-8b72-5ee6f112b1d2", "name": "network-vif-unplugged", "status": "completed", "tag": "de9facd1-8929-497d-9f75-3802fcffc1d0"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:23.355754 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ae8f67cf-9ab9-44ad-a9c7-ad75df80537c req-0c42a14b-380b-46d3-995d-d9a39a34aeed service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:23.356266 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ae8f67cf-9ab9-44ad-a9c7-ad75df80537c req-0c42a14b-380b-46d3-995d-d9a39a34aeed service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:23.414666 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-ae8f67cf-9ab9-44ad-a9c7-ad75df80537c req-0c42a14b-380b-46d3-995d-d9a39a34aeed service nova] Creating event network-vif-unplugged:de9facd1-8929-497d-9f75-3802fcffc1d0 for instance 324085c2-5228-46ba-8b72-5ee6f112b1d2 on n-h1-846435-14 Jul 25 14:33:23.439599 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-ae8f67cf-9ab9-44ad-a9c7-ad75df80537c req-0c42a14b-380b-46d3-995d-d9a39a34aeed service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.140658 Jul 25 14:33:23.444130 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1005/2095] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:33:23.463496 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0f56c64b-0ea1-4bc3-9730-cde80384189c tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:23.475134 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0f56c64b-0ea1-4bc3-9730-cde80384189c tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:23.499118 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f56c64b-0ea1-4bc3-9730-cde80384189c tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:23.500731 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f56c64b-0ea1-4bc3-9730-cde80384189c tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:23.503770 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f56c64b-0ea1-4bc3-9730-cde80384189c tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:23.504552 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f56c64b-0ea1-4bc3-9730-cde80384189c tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:23.706561 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0f56c64b-0ea1-4bc3-9730-cde80384189c tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "PUT /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10" status: 200 len: 1082 microversion: 2.1 time: 0.260118 Jul 25 14:33:23.708121 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1006/2096] 10.222.0.88 () {60 vars in 1256 bytes} [Mon Jul 25 14:33:23 2022] PUT /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 => generated 1082 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:23.734760 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-09944f3d-bb47-4b63-bdf4-5d829d899016 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:23.735436 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-09944f3d-bb47-4b63-bdf4-5d829d899016 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:23.753299 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-09944f3d-bb47-4b63-bdf4-5d829d899016 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:23.753750 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-09944f3d-bb47-4b63-bdf4-5d829d899016 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:23.769615 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-09944f3d-bb47-4b63-bdf4-5d829d899016 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:23.770526 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-09944f3d-bb47-4b63-bdf4-5d829d899016 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:23.934897 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a3b5d5a5-f96e-4809-b90c-5a778f825055 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8c4ea897e4b22919abd8ff4cf3e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c3dda90594fd3a3a244455e927dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:23.942589 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a3b5d5a5-f96e-4809-b90c-5a778f825055 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] 10.222.0.88 "GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262" status: 200 len: 1316 microversion: 2.1 time: 0.699611 Jul 25 14:33:23.948228 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1091/2097] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:23 2022] GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262 => generated 1316 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:23.958438 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dfe1a006-0c37-4b0a-bfb8-bb64b8a04bb6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:23.959062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dfe1a006-0c37-4b0a-bfb8-bb64b8a04bb6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:23.969282 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dfe1a006-0c37-4b0a-bfb8-bb64b8a04bb6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:23.969752 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dfe1a006-0c37-4b0a-bfb8-bb64b8a04bb6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:23.970615 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dfe1a006-0c37-4b0a-bfb8-bb64b8a04bb6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:23.971083 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dfe1a006-0c37-4b0a-bfb8-bb64b8a04bb6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:24.233128 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dfe1a006-0c37-4b0a-bfb8-bb64b8a04bb6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:24.254134 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dfe1a006-0c37-4b0a-bfb8-bb64b8a04bb6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:24.259103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dfe1a006-0c37-4b0a-bfb8-bb64b8a04bb6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:24.288570 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dfe1a006-0c37-4b0a-bfb8-bb64b8a04bb6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1488 microversion: 2.25 time: 0.338991 Jul 25 14:33:24.289740 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1092/2098] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:23 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1488 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:33:24.296639 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-316bab4e-68eb-4bbd-8ea3-8b9d33e58576 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:24.297261 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-316bab4e-68eb-4bbd-8ea3-8b9d33e58576 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 95cc15d2-9357-439c-8b9c-ed54768c1697] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:24.305323 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-316bab4e-68eb-4bbd-8ea3-8b9d33e58576 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:24.305781 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-316bab4e-68eb-4bbd-8ea3-8b9d33e58576 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:24.306561 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-316bab4e-68eb-4bbd-8ea3-8b9d33e58576 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:24.307032 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-316bab4e-68eb-4bbd-8ea3-8b9d33e58576 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:24.341947 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-09944f3d-bb47-4b63-bdf4-5d829d899016 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:24.350374 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-09944f3d-bb47-4b63-bdf4-5d829d899016 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10" status: 200 len: 1508 microversion: 2.1 time: 0.626324 Jul 25 14:33:24.350991 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1007/2099] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:23 2022] GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 => generated 1508 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:24.369608 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4abe5af9-551e-44df-ba60-e2c1c3fca8e4 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:24.370408 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4abe5af9-551e-44df-ba60-e2c1c3fca8e4 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:24.385741 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4abe5af9-551e-44df-ba60-e2c1c3fca8e4 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:24.386642 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4abe5af9-551e-44df-ba60-e2c1c3fca8e4 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:24.387728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4abe5af9-551e-44df-ba60-e2c1c3fca8e4 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:24.388425 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4abe5af9-551e-44df-ba60-e2c1c3fca8e4 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:24.608934 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-316bab4e-68eb-4bbd-8ea3-8b9d33e58576 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:24.621718 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-316bab4e-68eb-4bbd-8ea3-8b9d33e58576 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697" status: 200 len: 1318 microversion: 2.1 time: 0.330114 Jul 25 14:33:24.622373 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1093/2100] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:24 2022] GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697 => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:24.626946 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-47569b2b-45a2-43b6-8af1-d9055d969f57 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:24.627914 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-47569b2b-45a2-43b6-8af1-d9055d969f57 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:24.654317 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-47569b2b-45a2-43b6-8af1-d9055d969f57 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:24.654757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-47569b2b-45a2-43b6-8af1-d9055d969f57 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:24.655537 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-47569b2b-45a2-43b6-8af1-d9055d969f57 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:24.656226 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-47569b2b-45a2-43b6-8af1-d9055d969f57 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:24.945339 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-47569b2b-45a2-43b6-8af1-d9055d969f57 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:24.960818 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-47569b2b-45a2-43b6-8af1-d9055d969f57 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10" status: 200 len: 1508 microversion: 2.1 time: 0.337437 Jul 25 14:33:24.961921 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1094/2101] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:24 2022] GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 => generated 1508 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:24.967077 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-040f8ff8-ae82-4e08-960b-05e46bd4f5b8 req-d5f02f39-f94c-40f0-b198-fe0a1949d12f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc", "name": "network-vif-deleted", "tag": "a73bae6a-8192-437d-9578-029a5f5211b2"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:24.989398 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-040f8ff8-ae82-4e08-960b-05e46bd4f5b8 req-d5f02f39-f94c-40f0-b198-fe0a1949d12f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:24.989896 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-040f8ff8-ae82-4e08-960b-05e46bd4f5b8 req-d5f02f39-f94c-40f0-b198-fe0a1949d12f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:25.009506 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-040f8ff8-ae82-4e08-960b-05e46bd4f5b8 req-d5f02f39-f94c-40f0-b198-fe0a1949d12f service nova] Creating event network-vif-deleted:a73bae6a-8192-437d-9578-029a5f5211b2 for instance c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc on n-h1-846435-14 Jul 25 14:33:25.017160 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-040f8ff8-ae82-4e08-960b-05e46bd4f5b8 req-d5f02f39-f94c-40f0-b198-fe0a1949d12f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053830 Jul 25 14:33:25.018911 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1095/2102] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:33:25.025833 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2d9913a0-3d8f-4167-b90b-6d7c9617714f tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:25.027141 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2d9913a0-3d8f-4167-b90b-6d7c9617714f tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] [instance: 5a4c1f93-ad00-410d-aaa7-726ba1b3a262] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:25.041801 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d9913a0-3d8f-4167-b90b-6d7c9617714f tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:25.042644 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d9913a0-3d8f-4167-b90b-6d7c9617714f tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:25.044708 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d9913a0-3d8f-4167-b90b-6d7c9617714f tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:25.045786 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d9913a0-3d8f-4167-b90b-6d7c9617714f tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:25.046481 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4abe5af9-551e-44df-ba60-e2c1c3fca8e4 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:25.059644 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4abe5af9-551e-44df-ba60-e2c1c3fca8e4 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 200 len: 1787 microversion: 2.1 time: 0.694353 Jul 25 14:33:25.066604 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1008/2103] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:24 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 1787 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:25.086197 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e26dd5d9-577d-4147-afb1-ed28baebaee9 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:25.086994 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e26dd5d9-577d-4147-afb1-ed28baebaee9 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:25.096129 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e26dd5d9-577d-4147-afb1-ed28baebaee9 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:25.096894 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e26dd5d9-577d-4147-afb1-ed28baebaee9 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:25.097880 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e26dd5d9-577d-4147-afb1-ed28baebaee9 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:25.098505 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e26dd5d9-577d-4147-afb1-ed28baebaee9 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:25.138257 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e26dd5d9-577d-4147-afb1-ed28baebaee9 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:33:25.180025 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:33:25.266443 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e26dd5d9-577d-4147-afb1-ed28baebaee9 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "DELETE /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10" status: 204 len: 0 microversion: 2.1 time: 0.195346 Jul 25 14:33:25.267690 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1009/2104] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:33:25 2022] DELETE /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:33:25.285542 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-77d82048-2c79-47e9-8e5d-9cf8b28e90e1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:25.286856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-77d82048-2c79-47e9-8e5d-9cf8b28e90e1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:25.298193 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77d82048-2c79-47e9-8e5d-9cf8b28e90e1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:25.298744 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77d82048-2c79-47e9-8e5d-9cf8b28e90e1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:25.299475 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77d82048-2c79-47e9-8e5d-9cf8b28e90e1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:25.299960 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77d82048-2c79-47e9-8e5d-9cf8b28e90e1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:25.327077 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-77d82048-2c79-47e9-8e5d-9cf8b28e90e1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:33:25.378657 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.compute.api [None req-77d82048-2c79-47e9-8e5d-9cf8b28e90e1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10] Instance is already in deleting state, ignoring this request Jul 25 14:33:25.379571 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-77d82048-2c79-47e9-8e5d-9cf8b28e90e1 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "DELETE /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10" status: 204 len: 0 microversion: 2.1 time: 0.100915 Jul 25 14:33:25.380717 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1010/2105] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:33:25 2022] DELETE /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:33:25.386449 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-53470b32-b428-475d-90a2-563583088a29 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:25.386658 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2d9913a0-3d8f-4167-b90b-6d7c9617714f tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8c4ea897e4b22919abd8ff4cf3e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c3dda90594fd3a3a244455e927dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:25.387192 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-53470b32-b428-475d-90a2-563583088a29 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:25.393979 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-53470b32-b428-475d-90a2-563583088a29 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:25.394759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-53470b32-b428-475d-90a2-563583088a29 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:25.395765 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-53470b32-b428-475d-90a2-563583088a29 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:25.396471 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-53470b32-b428-475d-90a2-563583088a29 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:25.402736 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2d9913a0-3d8f-4167-b90b-6d7c9617714f tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] 10.222.0.88 "GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262" status: 200 len: 1316 microversion: 2.1 time: 0.382283 Jul 25 14:33:25.403607 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1096/2106] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:25 2022] GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262 => generated 1316 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:25.414351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-987fa099-af3e-4691-96de-d7951b0790f0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:25.421029 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-987fa099-af3e-4691-96de-d7951b0790f0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:25.441233 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-987fa099-af3e-4691-96de-d7951b0790f0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:25.441701 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-987fa099-af3e-4691-96de-d7951b0790f0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:25.443278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-987fa099-af3e-4691-96de-d7951b0790f0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:25.443887 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-987fa099-af3e-4691-96de-d7951b0790f0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:25.619793 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-987fa099-af3e-4691-96de-d7951b0790f0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:25.628593 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-987fa099-af3e-4691-96de-d7951b0790f0 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10" status: 200 len: 1514 microversion: 2.1 time: 0.223302 Jul 25 14:33:25.629549 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1097/2107] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:25 2022] GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 => generated 1514 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:25.634831 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-3e54df3a-cb64-4e43-b7ce-a3db370a6301 req-11c3f683-ccd6-4396-a013-084da30019af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a4c1f93-ad00-410d-aaa7-726ba1b3a262", "tag": "7cba35a1-e35c-4a9a-876b-96197f0fb886"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:25.647943 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-3e54df3a-cb64-4e43-b7ce-a3db370a6301 req-11c3f683-ccd6-4396-a013-084da30019af service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:25.648427 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-3e54df3a-cb64-4e43-b7ce-a3db370a6301 req-11c3f683-ccd6-4396-a013-084da30019af service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:25.663125 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-3e54df3a-cb64-4e43-b7ce-a3db370a6301 req-11c3f683-ccd6-4396-a013-084da30019af service nova] Creating event network-changed:7cba35a1-e35c-4a9a-876b-96197f0fb886 for instance 5a4c1f93-ad00-410d-aaa7-726ba1b3a262 on n-h1-846435-14 Jul 25 14:33:25.668320 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-3e54df3a-cb64-4e43-b7ce-a3db370a6301 req-11c3f683-ccd6-4396-a013-084da30019af service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037530 Jul 25 14:33:25.668930 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1098/2108] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:33:25.674518 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-cb02242e-3511-4853-8a50-3baad18f936f req-c865f138-7295-4f67-91e2-88849e5591b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95cc15d2-9357-439c-8b9c-ed54768c1697", "name": "network-vif-plugged", "status": "completed", "tag": "35ae9ccc-747f-47db-bfd7-635c2296eb8f"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:25.685384 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-cb02242e-3511-4853-8a50-3baad18f936f req-c865f138-7295-4f67-91e2-88849e5591b2 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:25.685826 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-cb02242e-3511-4853-8a50-3baad18f936f req-c865f138-7295-4f67-91e2-88849e5591b2 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:25.696711 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-cb02242e-3511-4853-8a50-3baad18f936f req-c865f138-7295-4f67-91e2-88849e5591b2 service nova] Creating event network-vif-plugged:35ae9ccc-747f-47db-bfd7-635c2296eb8f for instance 95cc15d2-9357-439c-8b9c-ed54768c1697 on n-h2-846435-14 Jul 25 14:33:25.703414 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-cb02242e-3511-4853-8a50-3baad18f936f req-c865f138-7295-4f67-91e2-88849e5591b2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032922 Jul 25 14:33:25.704043 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1099/2109] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:33:25.709220 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6db29bd1-6079-4c30-a427-4ab18138d813 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:25.709916 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6db29bd1-6079-4c30-a427-4ab18138d813 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 95cc15d2-9357-439c-8b9c-ed54768c1697] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:25.717520 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6db29bd1-6079-4c30-a427-4ab18138d813 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:25.717897 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6db29bd1-6079-4c30-a427-4ab18138d813 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:25.718673 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6db29bd1-6079-4c30-a427-4ab18138d813 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:25.719101 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6db29bd1-6079-4c30-a427-4ab18138d813 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:25.871493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-53470b32-b428-475d-90a2-563583088a29 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:25.881795 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-53470b32-b428-475d-90a2-563583088a29 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:25.883714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-53470b32-b428-475d-90a2-563583088a29 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:25.885413 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-53470b32-b428-475d-90a2-563583088a29 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1488 microversion: 2.25 time: 0.503124 Jul 25 14:33:25.895928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6db29bd1-6079-4c30-a427-4ab18138d813 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:25.896513 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1011/2110] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:25 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1488 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:33:25.906348 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6db29bd1-6079-4c30-a427-4ab18138d813 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697" status: 200 len: 1318 microversion: 2.1 time: 0.200993 Jul 25 14:33:25.907093 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1100/2111] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:25 2022] GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:26.089060 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8ecf2d54-3d00-4345-844d-46edfad7dc63 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:26.090559 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8ecf2d54-3d00-4345-844d-46edfad7dc63 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:26.098772 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ecf2d54-3d00-4345-844d-46edfad7dc63 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:26.099224 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ecf2d54-3d00-4345-844d-46edfad7dc63 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:26.100184 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ecf2d54-3d00-4345-844d-46edfad7dc63 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:26.100812 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ecf2d54-3d00-4345-844d-46edfad7dc63 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:26.356558 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8ecf2d54-3d00-4345-844d-46edfad7dc63 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:26.374138 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8ecf2d54-3d00-4345-844d-46edfad7dc63 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 200 len: 1652 microversion: 2.1 time: 0.288889 Jul 25 14:33:26.376230 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1012/2112] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:26 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 1652 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:26.425457 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9dd71b0e-7183-4f66-babc-8d01d650452e tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:26.426085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9dd71b0e-7183-4f66-babc-8d01d650452e tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] [instance: 5a4c1f93-ad00-410d-aaa7-726ba1b3a262] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:26.434535 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9dd71b0e-7183-4f66-babc-8d01d650452e tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:26.434965 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9dd71b0e-7183-4f66-babc-8d01d650452e tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:26.436235 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9dd71b0e-7183-4f66-babc-8d01d650452e tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:26.437195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9dd71b0e-7183-4f66-babc-8d01d650452e tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:26.441632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:33:26.600516 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9dd71b0e-7183-4f66-babc-8d01d650452e tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8c4ea897e4b22919abd8ff4cf3e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c3dda90594fd3a3a244455e927dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:26.609459 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9dd71b0e-7183-4f66-babc-8d01d650452e tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] 10.222.0.88 "GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262" status: 200 len: 1316 microversion: 2.1 time: 0.188738 Jul 25 14:33:26.610570 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1101/2113] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:26 2022] GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262 => generated 1316 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:26.651873 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-59905bd0-baf3-4fb8-9814-d67b86ef3ecb tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:26.652675 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-59905bd0-baf3-4fb8-9814-d67b86ef3ecb tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:26.660510 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59905bd0-baf3-4fb8-9814-d67b86ef3ecb tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:26.660968 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59905bd0-baf3-4fb8-9814-d67b86ef3ecb tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:26.662737 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59905bd0-baf3-4fb8-9814-d67b86ef3ecb tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:26.663434 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59905bd0-baf3-4fb8-9814-d67b86ef3ecb tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:26.915419 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4de7cf99-a1cf-4512-98a9-ce504b729be7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:26.915419 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4de7cf99-a1cf-4512-98a9-ce504b729be7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:26.922860 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4de7cf99-a1cf-4512-98a9-ce504b729be7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:26.928337 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4de7cf99-a1cf-4512-98a9-ce504b729be7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:26.929375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4de7cf99-a1cf-4512-98a9-ce504b729be7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:26.929861 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4de7cf99-a1cf-4512-98a9-ce504b729be7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:27.180539 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-59905bd0-baf3-4fb8-9814-d67b86ef3ecb tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f6a08479a4a4520b25a5b2e20c99670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6408dd1d343b0a82c8ec6d1b7d5af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:27.190419 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-59905bd0-baf3-4fb8-9814-d67b86ef3ecb tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10" status: 200 len: 1514 microversion: 2.1 time: 0.543095 Jul 25 14:33:27.191670 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1013/2114] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:26 2022] GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 => generated 1514 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:27.196709 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2c10bf08-a87e-42c4-9375-80504a8f1b0b tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:27.197672 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2c10bf08-a87e-42c4-9375-80504a8f1b0b tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 95cc15d2-9357-439c-8b9c-ed54768c1697] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:27.204374 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c10bf08-a87e-42c4-9375-80504a8f1b0b tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:27.205150 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c10bf08-a87e-42c4-9375-80504a8f1b0b tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:27.206172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c10bf08-a87e-42c4-9375-80504a8f1b0b tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:27.206833 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c10bf08-a87e-42c4-9375-80504a8f1b0b tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:27.218732 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4de7cf99-a1cf-4512-98a9-ce504b729be7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:27.236479 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4de7cf99-a1cf-4512-98a9-ce504b729be7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:27.239966 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4de7cf99-a1cf-4512-98a9-ce504b729be7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:27.241880 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4de7cf99-a1cf-4512-98a9-ce504b729be7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1488 microversion: 2.25 time: 0.336555 Jul 25 14:33:27.266712 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1102/2115] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:26 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1488 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:33:27.266712 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-bbf109d1-2b8f-430f-a855-7a5a0e54baf2 req-5dd87927-dc89-4b9f-83dc-d480c53060b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc", "name": "network-vif-deleted", "tag": "aaa9b232-7d76-46cd-a94b-3ff365af44d0"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:27.281446 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-bbf109d1-2b8f-430f-a855-7a5a0e54baf2 req-5dd87927-dc89-4b9f-83dc-d480c53060b9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:27.282490 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-bbf109d1-2b8f-430f-a855-7a5a0e54baf2 req-5dd87927-dc89-4b9f-83dc-d480c53060b9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:27.302747 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-bbf109d1-2b8f-430f-a855-7a5a0e54baf2 req-5dd87927-dc89-4b9f-83dc-d480c53060b9 service nova] Creating event network-vif-deleted:aaa9b232-7d76-46cd-a94b-3ff365af44d0 for instance c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc on n-h1-846435-14 Jul 25 14:33:27.309502 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-bbf109d1-2b8f-430f-a855-7a5a0e54baf2 req-5dd87927-dc89-4b9f-83dc-d480c53060b9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049245 Jul 25 14:33:27.311540 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1103/2116] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:33:27.399781 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a3d36bbd-0234-4eae-81d2-029d7494abde tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:27.400519 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a3d36bbd-0234-4eae-81d2-029d7494abde tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:27.407152 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3d36bbd-0234-4eae-81d2-029d7494abde tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:27.407611 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3d36bbd-0234-4eae-81d2-029d7494abde tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:27.409238 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3d36bbd-0234-4eae-81d2-029d7494abde tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:27.409645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3d36bbd-0234-4eae-81d2-029d7494abde tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:27.626506 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a3d36bbd-0234-4eae-81d2-029d7494abde tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:27.635671 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a3d36bbd-0234-4eae-81d2-029d7494abde tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 200 len: 1495 microversion: 2.1 time: 0.240182 Jul 25 14:33:27.636325 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1104/2117] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:27 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 1495 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:27.641411 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bab30f4d-739c-46f1-a95d-127fe1591f39 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:27.642509 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bab30f4d-739c-46f1-a95d-127fe1591f39 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] [instance: 5a4c1f93-ad00-410d-aaa7-726ba1b3a262] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:27.649427 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bab30f4d-739c-46f1-a95d-127fe1591f39 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:27.650355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bab30f4d-739c-46f1-a95d-127fe1591f39 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:27.651445 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bab30f4d-739c-46f1-a95d-127fe1591f39 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:27.652190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bab30f4d-739c-46f1-a95d-127fe1591f39 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:27.813967 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bab30f4d-739c-46f1-a95d-127fe1591f39 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8c4ea897e4b22919abd8ff4cf3e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c3dda90594fd3a3a244455e927dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:27.822884 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bab30f4d-739c-46f1-a95d-127fe1591f39 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] 10.222.0.88 "GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262" status: 200 len: 1316 microversion: 2.1 time: 0.185166 Jul 25 14:33:27.823553 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1105/2118] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:27 2022] GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262 => generated 1316 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:27.828742 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-ae0baae0-fc49-4af2-a3ed-3c3903fe3f40 req-752848e6-cdcb-42bb-b60d-b058216d8c1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fd8f96b-72ae-4a66-a6a4-cf708a0bba10", "name": "network-vif-deleted", "tag": "a09cef79-5865-4d30-8077-46a9d142f0d0"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:27.838894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ae0baae0-fc49-4af2-a3ed-3c3903fe3f40 req-752848e6-cdcb-42bb-b60d-b058216d8c1c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:27.839361 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ae0baae0-fc49-4af2-a3ed-3c3903fe3f40 req-752848e6-cdcb-42bb-b60d-b058216d8c1c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:27.851620 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-ae0baae0-fc49-4af2-a3ed-3c3903fe3f40 req-752848e6-cdcb-42bb-b60d-b058216d8c1c service nova] Creating event network-vif-deleted:a09cef79-5865-4d30-8077-46a9d142f0d0 for instance 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 on n-h1-846435-14 Jul 25 14:33:27.856691 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-ae0baae0-fc49-4af2-a3ed-3c3903fe3f40 req-752848e6-cdcb-42bb-b60d-b058216d8c1c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031922 Jul 25 14:33:27.857324 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1106/2119] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:33:27.862726 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-463450ab-e2c9-45c6-a661-e1a9fd7704b7 req-8a25ee70-ba8a-491a-a973-a99d6671aa61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc", "name": "network-vif-unplugged", "status": "completed", "tag": "3407a14a-b3dc-4c7c-8bfa-7a1be3bcbd9e"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:27.873186 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-463450ab-e2c9-45c6-a661-e1a9fd7704b7 req-8a25ee70-ba8a-491a-a973-a99d6671aa61 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:27.873604 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-463450ab-e2c9-45c6-a661-e1a9fd7704b7 req-8a25ee70-ba8a-491a-a973-a99d6671aa61 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:27.885898 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-463450ab-e2c9-45c6-a661-e1a9fd7704b7 req-8a25ee70-ba8a-491a-a973-a99d6671aa61 service nova] Creating event network-vif-unplugged:3407a14a-b3dc-4c7c-8bfa-7a1be3bcbd9e for instance c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc on n-h1-846435-14 Jul 25 14:33:27.891066 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-463450ab-e2c9-45c6-a661-e1a9fd7704b7 req-8a25ee70-ba8a-491a-a973-a99d6671aa61 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032399 Jul 25 14:33:27.891958 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1107/2120] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:33:28.030140 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2c10bf08-a87e-42c4-9375-80504a8f1b0b tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:28.042599 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2c10bf08-a87e-42c4-9375-80504a8f1b0b tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697" status: 200 len: 1318 microversion: 2.1 time: 0.849590 Jul 25 14:33:28.043194 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1014/2121] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:27 2022] GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697 => generated 1318 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:28.212853 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:33:28.218247 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-690ad22a-5366-465e-9184-ba16da2081d2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:28.219158 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-690ad22a-5366-465e-9184-ba16da2081d2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:28.226870 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-690ad22a-5366-465e-9184-ba16da2081d2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:28.227694 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-690ad22a-5366-465e-9184-ba16da2081d2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:28.228864 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-690ad22a-5366-465e-9184-ba16da2081d2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:28.229869 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-690ad22a-5366-465e-9184-ba16da2081d2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:28.253300 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-690ad22a-5366-465e-9184-ba16da2081d2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] HTTP exception thrown: Instance 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 could not be found. Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-690ad22a-5366-465e-9184-ba16da2081d2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Request method failure captured: Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 HTTP/1.1 Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qkNpJO9cM7W93J-VBKnbzBfqns2Vu6TBE1BshZ4rFux6EmX91w_lHCcOAFYBtqd80cESEsEQoky0g9lDJOz8cNTIgHj0Rwb7xEJ6SepAETe20XVEHbf-fIDFXe0zPZWKYAXly0LeScUyPhBOfbk1tc6Glpy3NlfRxoYC59oWrb6f7w Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: c8a6408dd1d343b0a82c8ec6d1b7d5af Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1292421392 Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c8a6408dd1d343b0a82c8ec6d1b7d5af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c8a6408dd1d343b0a82c8ec6d1b7d5af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c8a6408dd1d343b0a82c8ec6d1b7d5af", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c8a6408dd1d343b0a82c8ec6d1b7d5af"}]}] Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerDiskConfigTestJSON-1292421392 Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: c8a6408dd1d343b0a82c8ec6d1b7d5af Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1292421392 Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerDiskConfigTestJSON-1292421392-project Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 0f6a08479a4a4520b25a5b2e20c99670 Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerDiskConfigTestJSON-1292421392-project Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 could not be found. Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '0fd8f96b-72ae-4a66-a6a4-cf708a0bba10'} Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 could not be found. Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 could not be found. Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:33:28.255573 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:28.260547 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:33:28.260547 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:33:28.260547 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:33:28.260547 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:33:28.260547 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:33:28.260547 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 could not be found. Jul 25 14:33:28.260547 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:28.260547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-690ad22a-5366-465e-9184-ba16da2081d2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Returning 404 to user: Instance 0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:33:28.260547 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-690ad22a-5366-465e-9184-ba16da2081d2 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10" status: 404 len: 111 microversion: 2.1 time: 0.045882 Jul 25 14:33:28.261799 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1108/2122] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:28 2022] GET /compute/v2.1/servers/0fd8f96b-72ae-4a66-a6a4-cf708a0bba10 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:33:28.266364 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8fc925ef-edec-4602-a7ba-882a46b8b101 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:28.266851 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8fc925ef-edec-4602-a7ba-882a46b8b101 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:28.276248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8fc925ef-edec-4602-a7ba-882a46b8b101 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:28.276874 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8fc925ef-edec-4602-a7ba-882a46b8b101 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:28.277767 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8fc925ef-edec-4602-a7ba-882a46b8b101 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:28.278421 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8fc925ef-edec-4602-a7ba-882a46b8b101 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:28.296217 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-8fc925ef-edec-4602-a7ba-882a46b8b101 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] HTTP exception thrown: Instance aacb7718-eb99-45ae-a61c-4e5e8770be8a could not be found. Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8fc925ef-edec-4602-a7ba-882a46b8b101 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Request method failure captured: Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a HTTP/1.1 Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qkNpJO9cM7W93J-VBKnbzBfqns2Vu6TBE1BshZ4rFux6EmX91w_lHCcOAFYBtqd80cESEsEQoky0g9lDJOz8cNTIgHj0Rwb7xEJ6SepAETe20XVEHbf-fIDFXe0zPZWKYAXly0LeScUyPhBOfbk1tc6Glpy3NlfRxoYC59oWrb6f7w Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: c8a6408dd1d343b0a82c8ec6d1b7d5af Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1292421392 Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c8a6408dd1d343b0a82c8ec6d1b7d5af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c8a6408dd1d343b0a82c8ec6d1b7d5af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c8a6408dd1d343b0a82c8ec6d1b7d5af", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c8a6408dd1d343b0a82c8ec6d1b7d5af"}]}] Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServerDiskConfigTestJSON-1292421392 Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: c8a6408dd1d343b0a82c8ec6d1b7d5af Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1292421392 Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServerDiskConfigTestJSON-1292421392-project Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 0f6a08479a4a4520b25a5b2e20c99670 Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServerDiskConfigTestJSON-1292421392-project Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance aacb7718-eb99-45ae-a61c-4e5e8770be8a could not be found. Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'aacb7718-eb99-45ae-a61c-4e5e8770be8a'} Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aacb7718-eb99-45ae-a61c-4e5e8770be8a could not be found. Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:33:28.298310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:33:28.304751 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aacb7718-eb99-45ae-a61c-4e5e8770be8a could not be found. Jul 25 14:33:28.304751 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:33:28.304751 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:33:28.304751 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:33:28.304751 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:33:28.304751 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:33:28.304751 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:33:28.304751 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:33:28.304751 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:33:28.304751 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aacb7718-eb99-45ae-a61c-4e5e8770be8a could not be found. Jul 25 14:33:28.304751 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:33:28.304751 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8fc925ef-edec-4602-a7ba-882a46b8b101 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Returning 404 to user: Instance aacb7718-eb99-45ae-a61c-4e5e8770be8a could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:33:28.304751 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8fc925ef-edec-4602-a7ba-882a46b8b101 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "DELETE /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 404 len: 111 microversion: 2.1 time: 0.037466 Jul 25 14:33:28.304751 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1015/2123] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:33:28 2022] DELETE /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:33:28.309012 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8c2a39ee-b04a-4f4b-b49f-4a0d644faa8b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:28.309836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8c2a39ee-b04a-4f4b-b49f-4a0d644faa8b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: aacb7718-eb99-45ae-a61c-4e5e8770be8a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:28.317047 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8c2a39ee-b04a-4f4b-b49f-4a0d644faa8b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:28.317519 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8c2a39ee-b04a-4f4b-b49f-4a0d644faa8b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:28.318305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8c2a39ee-b04a-4f4b-b49f-4a0d644faa8b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:28.318900 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8c2a39ee-b04a-4f4b-b49f-4a0d644faa8b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:28.334301 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-8c2a39ee-b04a-4f4b-b49f-4a0d644faa8b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] HTTP exception thrown: Instance aacb7718-eb99-45ae-a61c-4e5e8770be8a could not be found. Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8c2a39ee-b04a-4f4b-b49f-4a0d644faa8b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Request method failure captured: Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a HTTP/1.1 Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qkNpJO9cM7W93J-VBKnbzBfqns2Vu6TBE1BshZ4rFux6EmX91w_lHCcOAFYBtqd80cESEsEQoky0g9lDJOz8cNTIgHj0Rwb7xEJ6SepAETe20XVEHbf-fIDFXe0zPZWKYAXly0LeScUyPhBOfbk1tc6Glpy3NlfRxoYC59oWrb6f7w Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: c8a6408dd1d343b0a82c8ec6d1b7d5af Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1292421392 Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c8a6408dd1d343b0a82c8ec6d1b7d5af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c8a6408dd1d343b0a82c8ec6d1b7d5af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c8a6408dd1d343b0a82c8ec6d1b7d5af", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c8a6408dd1d343b0a82c8ec6d1b7d5af"}]}] Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerDiskConfigTestJSON-1292421392 Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: c8a6408dd1d343b0a82c8ec6d1b7d5af Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1292421392 Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerDiskConfigTestJSON-1292421392-project Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 0f6a08479a4a4520b25a5b2e20c99670 Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerDiskConfigTestJSON-1292421392-project Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance aacb7718-eb99-45ae-a61c-4e5e8770be8a could not be found. Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'aacb7718-eb99-45ae-a61c-4e5e8770be8a'} Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aacb7718-eb99-45ae-a61c-4e5e8770be8a could not be found. Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aacb7718-eb99-45ae-a61c-4e5e8770be8a could not be found. Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:33:28.336057 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:28.345361 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:33:28.345361 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:33:28.345361 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:33:28.345361 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:33:28.345361 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:33:28.345361 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aacb7718-eb99-45ae-a61c-4e5e8770be8a could not be found. Jul 25 14:33:28.345361 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:28.345361 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8c2a39ee-b04a-4f4b-b49f-4a0d644faa8b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Returning 404 to user: Instance aacb7718-eb99-45ae-a61c-4e5e8770be8a could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:33:28.345361 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8c2a39ee-b04a-4f4b-b49f-4a0d644faa8b tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a" status: 404 len: 111 microversion: 2.1 time: 0.032684 Jul 25 14:33:28.345361 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1109/2124] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:28 2022] GET /compute/v2.1/servers/aacb7718-eb99-45ae-a61c-4e5e8770be8a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:33:28.347378 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b075dbc0-a43d-41de-aaed-52ba64701b72 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:28.347723 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b075dbc0-a43d-41de-aaed-52ba64701b72 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:28.352572 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-28ddd9dd-2c88-4d5d-beba-5ca1dde39293 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:28.353167 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-28ddd9dd-2c88-4d5d-beba-5ca1dde39293 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:28.361034 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b075dbc0-a43d-41de-aaed-52ba64701b72 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:28.362063 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b075dbc0-a43d-41de-aaed-52ba64701b72 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:28.363388 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b075dbc0-a43d-41de-aaed-52ba64701b72 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:28.364171 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b075dbc0-a43d-41de-aaed-52ba64701b72 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:28.367658 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28ddd9dd-2c88-4d5d-beba-5ca1dde39293 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:28.369575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28ddd9dd-2c88-4d5d-beba-5ca1dde39293 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:28.373211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28ddd9dd-2c88-4d5d-beba-5ca1dde39293 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:28.374601 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28ddd9dd-2c88-4d5d-beba-5ca1dde39293 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:28.403684 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-28ddd9dd-2c88-4d5d-beba-5ca1dde39293 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] HTTP exception thrown: Instance 9c87c840-4e2c-4bc2-822b-93b046f8fab5 could not be found. Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-28ddd9dd-2c88-4d5d-beba-5ca1dde39293 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Request method failure captured: Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 HTTP/1.1 Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qkNpJO9cM7W93J-VBKnbzBfqns2Vu6TBE1BshZ4rFux6EmX91w_lHCcOAFYBtqd80cESEsEQoky0g9lDJOz8cNTIgHj0Rwb7xEJ6SepAETe20XVEHbf-fIDFXe0zPZWKYAXly0LeScUyPhBOfbk1tc6Glpy3NlfRxoYC59oWrb6f7w Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: c8a6408dd1d343b0a82c8ec6d1b7d5af Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1292421392 Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c8a6408dd1d343b0a82c8ec6d1b7d5af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c8a6408dd1d343b0a82c8ec6d1b7d5af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c8a6408dd1d343b0a82c8ec6d1b7d5af", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c8a6408dd1d343b0a82c8ec6d1b7d5af"}]}] Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerDiskConfigTestJSON-1292421392 Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: c8a6408dd1d343b0a82c8ec6d1b7d5af Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1292421392 Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerDiskConfigTestJSON-1292421392-project Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 0f6a08479a4a4520b25a5b2e20c99670 Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerDiskConfigTestJSON-1292421392-project Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 9c87c840-4e2c-4bc2-822b-93b046f8fab5 could not be found. Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '9c87c840-4e2c-4bc2-822b-93b046f8fab5'} Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c87c840-4e2c-4bc2-822b-93b046f8fab5 could not be found. Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:33:28.406890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:33:28.413211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c87c840-4e2c-4bc2-822b-93b046f8fab5 could not be found. Jul 25 14:33:28.413211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:28.413211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:33:28.413211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:28.413211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:33:28.413211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:33:28.413211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:33:28.413211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:33:28.413211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:33:28.413211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c87c840-4e2c-4bc2-822b-93b046f8fab5 could not be found. Jul 25 14:33:28.413211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:28.413211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-28ddd9dd-2c88-4d5d-beba-5ca1dde39293 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Returning 404 to user: Instance 9c87c840-4e2c-4bc2-822b-93b046f8fab5 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:33:28.413211 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-28ddd9dd-2c88-4d5d-beba-5ca1dde39293 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "DELETE /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 404 len: 111 microversion: 2.1 time: 0.068716 Jul 25 14:33:28.417829 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1110/2125] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:33:28 2022] DELETE /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:33:28.427223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3cbe0b0d-16c3-42c6-83a3-676618f07c52 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:28.428499 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3cbe0b0d-16c3-42c6-83a3-676618f07c52 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] [instance: 9c87c840-4e2c-4bc2-822b-93b046f8fab5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:28.438315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3cbe0b0d-16c3-42c6-83a3-676618f07c52 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:28.438825 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3cbe0b0d-16c3-42c6-83a3-676618f07c52 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:28.439848 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3cbe0b0d-16c3-42c6-83a3-676618f07c52 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:28.440621 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3cbe0b0d-16c3-42c6-83a3-676618f07c52 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:28.458437 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-3cbe0b0d-16c3-42c6-83a3-676618f07c52 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] HTTP exception thrown: Instance 9c87c840-4e2c-4bc2-822b-93b046f8fab5 could not be found. Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3cbe0b0d-16c3-42c6-83a3-676618f07c52 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Request method failure captured: Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 HTTP/1.1 Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qkNpJO9cM7W93J-VBKnbzBfqns2Vu6TBE1BshZ4rFux6EmX91w_lHCcOAFYBtqd80cESEsEQoky0g9lDJOz8cNTIgHj0Rwb7xEJ6SepAETe20XVEHbf-fIDFXe0zPZWKYAXly0LeScUyPhBOfbk1tc6Glpy3NlfRxoYC59oWrb6f7w Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: c8a6408dd1d343b0a82c8ec6d1b7d5af Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1292421392 Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c8a6408dd1d343b0a82c8ec6d1b7d5af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c8a6408dd1d343b0a82c8ec6d1b7d5af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c8a6408dd1d343b0a82c8ec6d1b7d5af", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c8a6408dd1d343b0a82c8ec6d1b7d5af"}]}] Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerDiskConfigTestJSON-1292421392 Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: c8a6408dd1d343b0a82c8ec6d1b7d5af Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1292421392 Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerDiskConfigTestJSON-1292421392-project Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 0f6a08479a4a4520b25a5b2e20c99670 Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerDiskConfigTestJSON-1292421392-project Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 9c87c840-4e2c-4bc2-822b-93b046f8fab5 could not be found. Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '9c87c840-4e2c-4bc2-822b-93b046f8fab5'} Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c87c840-4e2c-4bc2-822b-93b046f8fab5 could not be found. Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c87c840-4e2c-4bc2-822b-93b046f8fab5 could not be found. Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:33:28.460028 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:28.465274 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:33:28.465274 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:33:28.465274 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:33:28.465274 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:33:28.465274 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:33:28.465274 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c87c840-4e2c-4bc2-822b-93b046f8fab5 could not be found. Jul 25 14:33:28.465274 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:28.466592 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3cbe0b0d-16c3-42c6-83a3-676618f07c52 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] Returning 404 to user: Instance 9c87c840-4e2c-4bc2-822b-93b046f8fab5 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:33:28.467635 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3cbe0b0d-16c3-42c6-83a3-676618f07c52 tempest-ServerDiskConfigTestJSON-1292421392 tempest-ServerDiskConfigTestJSON-1292421392-project] 10.222.0.88 "GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5" status: 404 len: 111 microversion: 2.1 time: 0.048136 Jul 25 14:33:28.468423 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1111/2126] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:28 2022] GET /compute/v2.1/servers/9c87c840-4e2c-4bc2-822b-93b046f8fab5 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:33:28.665246 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0e22c948-6533-4ea8-b89d-49d88ff3a263 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:28.667314 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0e22c948-6533-4ea8-b89d-49d88ff3a263 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:28.678568 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=8 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:33:28.680735 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0e22c948-6533-4ea8-b89d-49d88ff3a263 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:28.681586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0e22c948-6533-4ea8-b89d-49d88ff3a263 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:28.682816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0e22c948-6533-4ea8-b89d-49d88ff3a263 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:28.683481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0e22c948-6533-4ea8-b89d-49d88ff3a263 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:28.699897 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b075dbc0-a43d-41de-aaed-52ba64701b72 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:28.719997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b075dbc0-a43d-41de-aaed-52ba64701b72 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:28.724882 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b075dbc0-a43d-41de-aaed-52ba64701b72 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:28.729241 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b075dbc0-a43d-41de-aaed-52ba64701b72 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1488 microversion: 2.25 time: 0.394294 Jul 25 14:33:28.731422 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0e22c948-6533-4ea8-b89d-49d88ff3a263 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:28.732095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0e22c948-6533-4ea8-b89d-49d88ff3a263 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:28.732845 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-0e22c948-6533-4ea8-b89d-49d88ff3a263 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lazy-loading 'fault' on Instance uuid c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:33:28.741680 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1016/2127] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:28 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1488 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:33:28.804877 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0e22c948-6533-4ea8-b89d-49d88ff3a263 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:28.817095 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0e22c948-6533-4ea8-b89d-49d88ff3a263 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 200 len: 1301 microversion: 2.1 time: 0.161387 Jul 25 14:33:28.818205 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1112/2128] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:28 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 1301 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:28.852359 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7bab1289-c16a-4439-99ca-9c4560da3e0b tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:28.853510 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7bab1289-c16a-4439-99ca-9c4560da3e0b tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] [instance: 5a4c1f93-ad00-410d-aaa7-726ba1b3a262] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:28.861821 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7bab1289-c16a-4439-99ca-9c4560da3e0b tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:28.862646 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7bab1289-c16a-4439-99ca-9c4560da3e0b tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:28.864053 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7bab1289-c16a-4439-99ca-9c4560da3e0b tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:28.865413 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7bab1289-c16a-4439-99ca-9c4560da3e0b tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:29.063346 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1a5d0926-7132-4ec6-be5d-fb3e185b1697 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:29.063958 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1a5d0926-7132-4ec6-be5d-fb3e185b1697 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 95cc15d2-9357-439c-8b9c-ed54768c1697] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:29.074570 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1a5d0926-7132-4ec6-be5d-fb3e185b1697 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:29.075195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1a5d0926-7132-4ec6-be5d-fb3e185b1697 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:29.076229 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1a5d0926-7132-4ec6-be5d-fb3e185b1697 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:29.077087 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1a5d0926-7132-4ec6-be5d-fb3e185b1697 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:29.323074 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7bab1289-c16a-4439-99ca-9c4560da3e0b tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8c4ea897e4b22919abd8ff4cf3e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c3dda90594fd3a3a244455e927dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:29.343276 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7bab1289-c16a-4439-99ca-9c4560da3e0b tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] 10.222.0.88 "GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262" status: 200 len: 1316 microversion: 2.1 time: 0.501231 Jul 25 14:33:29.344678 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1017/2129] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:28 2022] GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262 => generated 1316 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:33:29.359284 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-86f388af-f050-4871-84d7-9d0d44c01b35 req-117e30a6-05ff-4b5e-9e00-d9ce54a2bd20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc", "name": "network-vif-deleted", "tag": "3407a14a-b3dc-4c7c-8bfa-7a1be3bcbd9e"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:29.367177 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1a5d0926-7132-4ec6-be5d-fb3e185b1697 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:29.374680 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-86f388af-f050-4871-84d7-9d0d44c01b35 req-117e30a6-05ff-4b5e-9e00-d9ce54a2bd20 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:29.375381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-86f388af-f050-4871-84d7-9d0d44c01b35 req-117e30a6-05ff-4b5e-9e00-d9ce54a2bd20 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:29.380529 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1a5d0926-7132-4ec6-be5d-fb3e185b1697 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697" status: 200 len: 1468 microversion: 2.1 time: 0.320614 Jul 25 14:33:29.383216 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1113/2130] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:29 2022] GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697 => generated 1468 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:33:29.396473 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-86f388af-f050-4871-84d7-9d0d44c01b35 req-117e30a6-05ff-4b5e-9e00-d9ce54a2bd20 service nova] Creating event network-vif-deleted:3407a14a-b3dc-4c7c-8bfa-7a1be3bcbd9e for instance c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc on n-h1-846435-14 Jul 25 14:33:29.408322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-849c23dc-e090-49a5-9e5b-fdb6eae2b6e4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:29.408955 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-849c23dc-e090-49a5-9e5b-fdb6eae2b6e4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 8aff0899-f62a-4ffc-924c-c782f7eb417f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:29.419913 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-849c23dc-e090-49a5-9e5b-fdb6eae2b6e4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:29.421132 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-86f388af-f050-4871-84d7-9d0d44c01b35 req-117e30a6-05ff-4b5e-9e00-d9ce54a2bd20 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066252 Jul 25 14:33:29.422451 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-849c23dc-e090-49a5-9e5b-fdb6eae2b6e4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:29.422861 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1018/2131] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:33:29.424452 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-849c23dc-e090-49a5-9e5b-fdb6eae2b6e4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:29.425098 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-849c23dc-e090-49a5-9e5b-fdb6eae2b6e4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:29.761922 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dcfe13b5-ae7c-4443-98d4-e1d51fd24da5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:29.762854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-dcfe13b5-ae7c-4443-98d4-e1d51fd24da5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:29.786959 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dcfe13b5-ae7c-4443-98d4-e1d51fd24da5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:29.788668 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dcfe13b5-ae7c-4443-98d4-e1d51fd24da5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:29.793849 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dcfe13b5-ae7c-4443-98d4-e1d51fd24da5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:29.797724 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dcfe13b5-ae7c-4443-98d4-e1d51fd24da5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:29.988085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-849c23dc-e090-49a5-9e5b-fdb6eae2b6e4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:29.996942 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-849c23dc-e090-49a5-9e5b-fdb6eae2b6e4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/8aff0899-f62a-4ffc-924c-c782f7eb417f" status: 200 len: 1468 microversion: 2.1 time: 0.593085 Jul 25 14:33:29.997572 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1114/2132] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:29 2022] GET /compute/v2.1/servers/8aff0899-f62a-4ffc-924c-c782f7eb417f => generated 1468 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:30.008747 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-dcfe13b5-ae7c-4443-98d4-e1d51fd24da5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:30.009102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f065affc-a3d3-4527-a52f-426e69862fd7 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:30.009102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f065affc-a3d3-4527-a52f-426e69862fd7 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:30.009102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f065affc-a3d3-4527-a52f-426e69862fd7 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:30.013278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f065affc-a3d3-4527-a52f-426e69862fd7 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:30.013278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f065affc-a3d3-4527-a52f-426e69862fd7 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:30.013278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f065affc-a3d3-4527-a52f-426e69862fd7 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:30.013605 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-dcfe13b5-ae7c-4443-98d4-e1d51fd24da5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:30.013935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-dcfe13b5-ae7c-4443-98d4-e1d51fd24da5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:30.015416 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dcfe13b5-ae7c-4443-98d4-e1d51fd24da5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1478 microversion: 2.25 time: 0.262109 Jul 25 14:33:30.024500 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1019/2133] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:29 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1478 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:33:30.030074 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-f065affc-a3d3-4527-a52f-426e69862fd7 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] HTTP exception thrown: Instance c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc could not be found. Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f065affc-a3d3-4527-a52f-426e69862fd7 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Request method failure captured: Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc HTTP/1.1 Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qmFYWx9KOzJ47zTj_xy6_dMrFe8mbVr2eoxoU4fBSAvPaL6_V18DrJCqhfAaWe_brOymODzcadm8auFn0b-SnaSOztIL6209Kms93pKFTQlQDxx0IWHS2k5X8je65H4G7DaIrFeaLZIOx04kvq1FpfZo9y_MxArgBJ39whS-uFZ1kc Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 041b46dd05384e47a74bfaa8dc3c838f Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersTestMultiNic-1424548640 Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/041b46dd05384e47a74bfaa8dc3c838f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/041b46dd05384e47a74bfaa8dc3c838f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_041b46dd05384e47a74bfaa8dc3c838f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/041b46dd05384e47a74bfaa8dc3c838f"}]}] Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersTestMultiNic-1424548640 Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 041b46dd05384e47a74bfaa8dc3c838f Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersTestMultiNic-1424548640 Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersTestMultiNic-1424548640-project Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 3e2beeccba594f01b83983a2ec729a98 Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersTestMultiNic-1424548640-project Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc could not be found. Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc'} Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc could not be found. Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc could not be found. Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:33:30.031691 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:30.036830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:33:30.036830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:33:30.036830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:33:30.036830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:33:30.036830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:33:30.036830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc could not be found. Jul 25 14:33:30.036830 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:30.040808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f065affc-a3d3-4527-a52f-426e69862fd7 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Returning 404 to user: Instance c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:33:30.040961 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e0c852f6-4385-45df-80b4-d1215d1e2873 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:30.042178 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f065affc-a3d3-4527-a52f-426e69862fd7 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 404 len: 111 microversion: 2.1 time: 0.043650 Jul 25 14:33:30.043173 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1115/2134] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:29 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:33:30.046781 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e0c852f6-4385-45df-80b4-d1215d1e2873 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:30.047783 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e0c852f6-4385-45df-80b4-d1215d1e2873 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Searching by: {'reservation_id': 'r-j0hawog3', 'deleted': False, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51'} {{(pid=119303) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:33:30.048422 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-613e4f82-7ba2-47a3-bb41-966e71554835 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Calling method '.version_select at 0x7f46988c53a0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:30.052350 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-613e4f82-7ba2-47a3-bb41-966e71554835 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:30.052868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-613e4f82-7ba2-47a3-bb41-966e71554835 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:30.054649 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e0c852f6-4385-45df-80b4-d1215d1e2873 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:30.055568 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e0c852f6-4385-45df-80b4-d1215d1e2873 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:30.056630 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e0c852f6-4385-45df-80b4-d1215d1e2873 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:30.057311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e0c852f6-4385-45df-80b4-d1215d1e2873 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:30.077248 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-613e4f82-7ba2-47a3-bb41-966e71554835 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] 10.222.0.88 "GET /compute/v2.1/os-migrations" status: 200 len: 2807 microversion: 2.25 time: 0.032637 Jul 25 14:33:30.085956 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1116/2135] 10.222.0.88 () {60 vars in 1184 bytes} [Mon Jul 25 14:33:30 2022] GET /compute/v2.1/os-migrations => generated 2807 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:33:30.095050 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-14fbc0e5-abc7-48e5-8ec6-503924acb420 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:30.095667 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-14fbc0e5-abc7-48e5-8ec6-503924acb420 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:30.103327 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-14fbc0e5-abc7-48e5-8ec6-503924acb420 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:30.103842 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-14fbc0e5-abc7-48e5-8ec6-503924acb420 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:30.104701 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-14fbc0e5-abc7-48e5-8ec6-503924acb420 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:30.105142 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-14fbc0e5-abc7-48e5-8ec6-503924acb420 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:30.219718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.multi_cell_list [None req-e0c852f6-4385-45df-80b4-d1215d1e2873 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119303) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:33:30.328005 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e0c852f6-4385-45df-80b4-d1215d1e2873 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:30.337624 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e0c852f6-4385-45df-80b4-d1215d1e2873 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:30.338265 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e0c852f6-4385-45df-80b4-d1215d1e2873 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:30.361700 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-14fbc0e5-abc7-48e5-8ec6-503924acb420 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] Lazy-loading 'services' on Instance uuid 324085c2-5228-46ba-8b72-5ee6f112b1d2 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:33:30.388371 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-14fbc0e5-abc7-48e5-8ec6-503924acb420 tempest-LiveAutoBlockMigrationV225Test-1769802084 tempest-LiveAutoBlockMigrationV225Test-1769802084-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1973 microversion: 2.25 time: 0.296980 Jul 25 14:33:30.391842 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1117/2136] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:30 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1973 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:33:30.413085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2569b415-8802-4301-8972-78df6ec25eb5 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:30.413726 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2569b415-8802-4301-8972-78df6ec25eb5 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] [instance: 5a4c1f93-ad00-410d-aaa7-726ba1b3a262] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:30.433986 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2569b415-8802-4301-8972-78df6ec25eb5 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:30.435647 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2569b415-8802-4301-8972-78df6ec25eb5 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:30.437461 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2569b415-8802-4301-8972-78df6ec25eb5 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:30.439179 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2569b415-8802-4301-8972-78df6ec25eb5 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:30.703599 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e0c852f6-4385-45df-80b4-d1215d1e2873 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/detail?reservation_id=r-j0hawog3" status: 200 len: 2929 microversion: 2.1 time: 0.677206 Jul 25 14:33:30.713612 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1020/2137] 10.222.0.88 () {58 vars in 1197 bytes} [Mon Jul 25 14:33:30 2022] GET /compute/v2.1/servers/detail?reservation_id=r-j0hawog3 => generated 2929 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:30.736455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-18076ab8-4c29-4a18-93ec-3ba983ffdfa5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:30.737140 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-18076ab8-4c29-4a18-93ec-3ba983ffdfa5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:30.746360 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-18076ab8-4c29-4a18-93ec-3ba983ffdfa5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:30.746985 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-18076ab8-4c29-4a18-93ec-3ba983ffdfa5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:30.747958 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-18076ab8-4c29-4a18-93ec-3ba983ffdfa5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:30.748507 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-18076ab8-4c29-4a18-93ec-3ba983ffdfa5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:30.789569 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-18076ab8-4c29-4a18-93ec-3ba983ffdfa5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:33:30.833020 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2569b415-8802-4301-8972-78df6ec25eb5 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8c4ea897e4b22919abd8ff4cf3e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c3dda90594fd3a3a244455e927dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:30.849936 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2569b415-8802-4301-8972-78df6ec25eb5 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] 10.222.0.88 "GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262" status: 200 len: 1316 microversion: 2.1 time: 0.456728 Jul 25 14:33:30.864465 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1118/2138] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:30 2022] GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262 => generated 1316 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:30.871388 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2dd44c38-e25b-4158-90ee-b959aa1df3fc tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:30.890544 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.compute.server_groups [None req-2dd44c38-e25b-4158-90ee-b959aa1df3fc tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Querying cell cadb07ed-5464-41eb-afb8-bf9dd92401b6(cell1) for 2 instances {{(pid=119304) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 25 14:33:30.891778 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2dd44c38-e25b-4158-90ee-b959aa1df3fc tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:30.892677 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2dd44c38-e25b-4158-90ee-b959aa1df3fc tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:30.936342 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-18076ab8-4c29-4a18-93ec-3ba983ffdfa5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "DELETE /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 204 len: 0 microversion: 2.25 time: 0.219418 Jul 25 14:33:30.939507 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1021/2139] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Jul 25 14:33:30 2022] DELETE /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 14:33:30.951671 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2dd44c38-e25b-4158-90ee-b959aa1df3fc tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/os-server-groups/76c3d209-2d0e-4027-a911-f11bd860a5da" status: 200 len: 270 microversion: 2.1 time: 0.085877 Jul 25 14:33:30.952409 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1119/2140] 10.222.0.88 () {58 vars in 1263 bytes} [Mon Jul 25 14:33:30 2022] GET /compute/v2.1/os-server-groups/76c3d209-2d0e-4027-a911-f11bd860a5da => generated 270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:33:30.956861 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-306f3eb7-f418-4773-af79-bbeae7a53132 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:30.957785 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-306f3eb7-f418-4773-af79-bbeae7a53132 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:30.971709 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fcbf3546-6472-494f-a2dc-8d6245bbcc66 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:30.973883 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-306f3eb7-f418-4773-af79-bbeae7a53132 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:30.974542 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fcbf3546-6472-494f-a2dc-8d6245bbcc66 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] [instance: 8aff0899-f62a-4ffc-924c-c782f7eb417f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:30.977902 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-306f3eb7-f418-4773-af79-bbeae7a53132 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:30.980776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-306f3eb7-f418-4773-af79-bbeae7a53132 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:30.981239 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-306f3eb7-f418-4773-af79-bbeae7a53132 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:30.990372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fcbf3546-6472-494f-a2dc-8d6245bbcc66 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:30.991391 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fcbf3546-6472-494f-a2dc-8d6245bbcc66 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:30.991762 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fcbf3546-6472-494f-a2dc-8d6245bbcc66 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:30.992229 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fcbf3546-6472-494f-a2dc-8d6245bbcc66 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:31.461143 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fcbf3546-6472-494f-a2dc-8d6245bbcc66 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/8aff0899-f62a-4ffc-924c-c782f7eb417f" status: 200 len: 1621 microversion: 2.1 time: 0.500353 Jul 25 14:33:31.461449 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1120/2141] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:30 2022] GET /compute/v2.1/servers/8aff0899-f62a-4ffc-924c-c782f7eb417f => generated 1621 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:31.486708 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-630e7332-9600-4f55-87ff-2f777c4e6c6a tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:31.488422 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-630e7332-9600-4f55-87ff-2f777c4e6c6a tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] [instance: 95cc15d2-9357-439c-8b9c-ed54768c1697] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:31.488555 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-306f3eb7-f418-4773-af79-bbeae7a53132 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:31.497790 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-306f3eb7-f418-4773-af79-bbeae7a53132 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:31.499302 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-306f3eb7-f418-4773-af79-bbeae7a53132 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:31.500512 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-306f3eb7-f418-4773-af79-bbeae7a53132 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1484 microversion: 2.25 time: 0.556463 Jul 25 14:33:31.502097 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-630e7332-9600-4f55-87ff-2f777c4e6c6a tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:31.502946 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-630e7332-9600-4f55-87ff-2f777c4e6c6a tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:31.504345 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-630e7332-9600-4f55-87ff-2f777c4e6c6a tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:31.505024 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-630e7332-9600-4f55-87ff-2f777c4e6c6a tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:31.514227 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1022/2142] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:30 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1484 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:33:31.874838 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1386dab8-a43a-4e7b-882b-146a86825f11 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:31.875731 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1386dab8-a43a-4e7b-882b-146a86825f11 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] [instance: 5a4c1f93-ad00-410d-aaa7-726ba1b3a262] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:31.882595 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1386dab8-a43a-4e7b-882b-146a86825f11 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:31.883966 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1386dab8-a43a-4e7b-882b-146a86825f11 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:31.885365 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1386dab8-a43a-4e7b-882b-146a86825f11 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:31.885978 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1386dab8-a43a-4e7b-882b-146a86825f11 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:31.932488 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:33:31.938135 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-630e7332-9600-4f55-87ff-2f777c4e6c6a tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697" status: 200 len: 1621 microversion: 2.1 time: 0.457348 Jul 25 14:33:31.939377 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1121/2143] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:31 2022] GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697 => generated 1621 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:33:32.168522 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9bdac357-024d-43e0-a9a4-7f2c268b1f5e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1169170637", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "1a97e112-b45b-4dcb-ad9f-e979e5c183d9"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:32.264721 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-9bdac357-024d-43e0-a9a4-7f2c268b1f5e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] validate_networks() for None {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:33:32.390165 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1386dab8-a43a-4e7b-882b-146a86825f11 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8c4ea897e4b22919abd8ff4cf3e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c3dda90594fd3a3a244455e927dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:32.398437 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1386dab8-a43a-4e7b-882b-146a86825f11 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] 10.222.0.88 "GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262" status: 200 len: 1316 microversion: 2.1 time: 0.527455 Jul 25 14:33:32.399047 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1023/2144] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:31 2022] GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262 => generated 1316 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:33:32.539034 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ea529576-fe8a-48a5-a4e8-26a7132a0ee7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:32.539729 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ea529576-fe8a-48a5-a4e8-26a7132a0ee7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:32.548379 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ea529576-fe8a-48a5-a4e8-26a7132a0ee7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:32.549088 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ea529576-fe8a-48a5-a4e8-26a7132a0ee7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:32.550040 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ea529576-fe8a-48a5-a4e8-26a7132a0ee7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:32.550640 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ea529576-fe8a-48a5-a4e8-26a7132a0ee7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:32.729532 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-9bdac357-024d-43e0-a9a4-7f2c268b1f5e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:33:32.730165 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-9bdac357-024d-43e0-a9a4-7f2c268b1f5e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:33:32.730894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-9bdac357-024d-43e0-a9a4-7f2c268b1f5e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:33:32.731582 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-9bdac357-024d-43e0-a9a4-7f2c268b1f5e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:33:32.732340 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-9bdac357-024d-43e0-a9a4-7f2c268b1f5e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:33:32.745385 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9bdac357-024d-43e0-a9a4-7f2c268b1f5e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:32.746228 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9bdac357-024d-43e0-a9a4-7f2c268b1f5e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:32.747262 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9bdac357-024d-43e0-a9a4-7f2c268b1f5e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:32.747924 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9bdac357-024d-43e0-a9a4-7f2c268b1f5e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:32.777840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-9bdac357-024d-43e0-a9a4-7f2c268b1f5e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for project e60b88c2aea642658a5bfc14780d5d51. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:33:32.790586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-9bdac357-024d-43e0-a9a4-7f2c268b1f5e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for user ef351be3886949f9985b3244301435a9 and project e60b88c2aea642658a5bfc14780d5d51. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:33:32.820650 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9bdac357-024d-43e0-a9a4-7f2c268b1f5e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:33:32.826235 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9bdac357-024d-43e0-a9a4-7f2c268b1f5e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: c43e707b-4a9f-48d2-8338-5a680cd51f06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:33:32.951321 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9bdac357-024d-43e0-a9a4-7f2c268b1f5e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.788249 Jul 25 14:33:32.953281 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1122/2145] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:33:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:33:32.972576 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6998dbff-9f11-4c0f-b1e1-9661431dcfad tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:32.974864 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6998dbff-9f11-4c0f-b1e1-9661431dcfad tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: c43e707b-4a9f-48d2-8338-5a680cd51f06] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:33.021668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:33:33.080001 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ea529576-fe8a-48a5-a4e8-26a7132a0ee7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:33.096193 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ea529576-fe8a-48a5-a4e8-26a7132a0ee7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:33.102596 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ea529576-fe8a-48a5-a4e8-26a7132a0ee7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:33.115344 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ea529576-fe8a-48a5-a4e8-26a7132a0ee7 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1484 microversion: 2.25 time: 0.570840 Jul 25 14:33:33.119771 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1024/2146] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:32 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1484 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:33:33.187495 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6998dbff-9f11-4c0f-b1e1-9661431dcfad tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:33.197855 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6998dbff-9f11-4c0f-b1e1-9661431dcfad tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06" status: 200 len: 1217 microversion: 2.1 time: 0.236671 Jul 25 14:33:33.225579 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1123/2147] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:32 2022] GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06 => generated 1217 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:33.423692 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5c5ec600-ba83-420e-82a6-c6e2a1d63278 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:33.424350 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5c5ec600-ba83-420e-82a6-c6e2a1d63278 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] [instance: 5a4c1f93-ad00-410d-aaa7-726ba1b3a262] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:33.435941 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5c5ec600-ba83-420e-82a6-c6e2a1d63278 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:33.436733 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5c5ec600-ba83-420e-82a6-c6e2a1d63278 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:33.437686 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5c5ec600-ba83-420e-82a6-c6e2a1d63278 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:33.440379 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5c5ec600-ba83-420e-82a6-c6e2a1d63278 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:33.934367 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5c5ec600-ba83-420e-82a6-c6e2a1d63278 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8c4ea897e4b22919abd8ff4cf3e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c3dda90594fd3a3a244455e927dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:33.965545 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5c5ec600-ba83-420e-82a6-c6e2a1d63278 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] 10.222.0.88 "GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262" status: 200 len: 1316 microversion: 2.1 time: 0.546149 Jul 25 14:33:33.969656 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1025/2148] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:33 2022] GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262 => generated 1316 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:34.000808 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-887ec0f2-a8b6-4eac-9279-74d72d71cc60 req-43d0b7f3-6b5d-450b-a088-7ad68c653c25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "324085c2-5228-46ba-8b72-5ee6f112b1d2", "name": "network-vif-deleted", "tag": "de9facd1-8929-497d-9f75-3802fcffc1d0"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:34.033485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:33:34.043247 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8214d4f4-d762-4444-a284-99a8dc5ac062 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2020558111", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "c1409048-56d4-4974-b862-8fda8a2087e1"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:34.049682 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-887ec0f2-a8b6-4eac-9279-74d72d71cc60 req-43d0b7f3-6b5d-450b-a088-7ad68c653c25 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:34.051824 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-887ec0f2-a8b6-4eac-9279-74d72d71cc60 req-43d0b7f3-6b5d-450b-a088-7ad68c653c25 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:34.112813 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-887ec0f2-a8b6-4eac-9279-74d72d71cc60 req-43d0b7f3-6b5d-450b-a088-7ad68c653c25 service nova] Creating event network-vif-deleted:de9facd1-8929-497d-9f75-3802fcffc1d0 for instance 324085c2-5228-46ba-8b72-5ee6f112b1d2 on n-h2-846435-14 Jul 25 14:33:34.129049 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-887ec0f2-a8b6-4eac-9279-74d72d71cc60 req-43d0b7f3-6b5d-450b-a088-7ad68c653c25 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151917 Jul 25 14:33:34.130843 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1026/2149] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:33:34.157045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-8214d4f4-d762-4444-a284-99a8dc5ac062 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] validate_networks() for [('c1409048-56d4-4974-b862-8fda8a2087e1', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:33:34.165894 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-999cf5a8-d0f4-48f8-87a4-c5408a4ff223 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:34.166670 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-999cf5a8-d0f4-48f8-87a4-c5408a4ff223 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:34.187300 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-999cf5a8-d0f4-48f8-87a4-c5408a4ff223 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:34.187659 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-999cf5a8-d0f4-48f8-87a4-c5408a4ff223 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:34.188531 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-999cf5a8-d0f4-48f8-87a4-c5408a4ff223 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:34.188951 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-999cf5a8-d0f4-48f8-87a4-c5408a4ff223 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:34.311571 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-999cf5a8-d0f4-48f8-87a4-c5408a4ff223 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:34.327900 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-999cf5a8-d0f4-48f8-87a4-c5408a4ff223 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:34.329995 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-999cf5a8-d0f4-48f8-87a4-c5408a4ff223 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:34.331381 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-999cf5a8-d0f4-48f8-87a4-c5408a4ff223 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1266 microversion: 2.25 time: 0.182070 Jul 25 14:33:34.332654 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1027/2150] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:34 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:33:34.337370 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-83999cda-7fe7-448d-a2d5-efa1f3dccd9a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:34.342612 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-83999cda-7fe7-448d-a2d5-efa1f3dccd9a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: c43e707b-4a9f-48d2-8338-5a680cd51f06] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:34.352620 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-83999cda-7fe7-448d-a2d5-efa1f3dccd9a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:34.357783 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-83999cda-7fe7-448d-a2d5-efa1f3dccd9a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:34.359007 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-83999cda-7fe7-448d-a2d5-efa1f3dccd9a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:34.359627 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-83999cda-7fe7-448d-a2d5-efa1f3dccd9a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:34.445036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-83999cda-7fe7-448d-a2d5-efa1f3dccd9a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:34.455463 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-83999cda-7fe7-448d-a2d5-efa1f3dccd9a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06" status: 200 len: 1269 microversion: 2.1 time: 0.121565 Jul 25 14:33:34.456909 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1028/2151] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:34 2022] GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06 => generated 1269 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:34.991633 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-856cb21d-ae84-4b5f-b0dc-657a774dd8b8 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:34.992446 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-856cb21d-ae84-4b5f-b0dc-657a774dd8b8 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] [instance: 5a4c1f93-ad00-410d-aaa7-726ba1b3a262] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:35.008984 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-856cb21d-ae84-4b5f-b0dc-657a774dd8b8 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:35.013311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-856cb21d-ae84-4b5f-b0dc-657a774dd8b8 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:35.015381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-856cb21d-ae84-4b5f-b0dc-657a774dd8b8 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:35.018797 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-856cb21d-ae84-4b5f-b0dc-657a774dd8b8 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:35.248652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-8214d4f4-d762-4444-a284-99a8dc5ac062 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:33:35.249180 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-8214d4f4-d762-4444-a284-99a8dc5ac062 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:33:35.250261 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-8214d4f4-d762-4444-a284-99a8dc5ac062 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:33:35.250948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-8214d4f4-d762-4444-a284-99a8dc5ac062 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:33:35.251584 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-8214d4f4-d762-4444-a284-99a8dc5ac062 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:33:35.264168 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8214d4f4-d762-4444-a284-99a8dc5ac062 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:35.264809 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8214d4f4-d762-4444-a284-99a8dc5ac062 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:35.265765 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8214d4f4-d762-4444-a284-99a8dc5ac062 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:35.266309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8214d4f4-d762-4444-a284-99a8dc5ac062 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:35.289495 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-8214d4f4-d762-4444-a284-99a8dc5ac062 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Getting quotas for project 2383030b07e34f93b9637c637f8f0ae7. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:33:35.295948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-8214d4f4-d762-4444-a284-99a8dc5ac062 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Getting quotas for user 5a4fe4300ea142eb88bde8deab2d1e3c and project 2383030b07e34f93b9637c637f8f0ae7. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:33:35.311288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8214d4f4-d762-4444-a284-99a8dc5ac062 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:33:35.316395 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8214d4f4-d762-4444-a284-99a8dc5ac062 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 542ab1a2-380f-4f4f-95ec-5d68eb9bd091] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:33:35.377862 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8214d4f4-d762-4444-a284-99a8dc5ac062 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.662469 Jul 25 14:33:35.379020 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1124/2152] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:33:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:33:35.396674 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ff0b31b7-0c78-4e3c-a5af-baf467d27eb5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:35.398983 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ff0b31b7-0c78-4e3c-a5af-baf467d27eb5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:35.420305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff0b31b7-0c78-4e3c-a5af-baf467d27eb5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:35.421956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff0b31b7-0c78-4e3c-a5af-baf467d27eb5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:35.422894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff0b31b7-0c78-4e3c-a5af-baf467d27eb5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:35.426677 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff0b31b7-0c78-4e3c-a5af-baf467d27eb5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:35.604109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ff0b31b7-0c78-4e3c-a5af-baf467d27eb5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:35.604109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:33:35.604109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ff0b31b7-0c78-4e3c-a5af-baf467d27eb5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:35.604109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ff0b31b7-0c78-4e3c-a5af-baf467d27eb5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:35.604109 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ff0b31b7-0c78-4e3c-a5af-baf467d27eb5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1266 microversion: 2.25 time: 0.196257 Jul 25 14:33:35.604109 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1125/2153] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:35 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:33:35.604109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ffc42aff-242d-4ce3-9a62-5e75c9361942 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1992439389", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "c1409048-56d4-4974-b862-8fda8a2087e1"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:35.687702 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-ffc42aff-242d-4ce3-9a62-5e75c9361942 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] validate_networks() for [('c1409048-56d4-4974-b862-8fda8a2087e1', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:33:36.454109 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-856cb21d-ae84-4b5f-b0dc-657a774dd8b8 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8c4ea897e4b22919abd8ff4cf3e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c3dda90594fd3a3a244455e927dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:36.470420 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-856cb21d-ae84-4b5f-b0dc-657a774dd8b8 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] 10.222.0.88 "GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262" status: 200 len: 1316 microversion: 2.1 time: 1.482546 Jul 25 14:33:36.484505 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1029/2154] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:34 2022] GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262 => generated 1316 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:33:36.490136 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-37934144-8239-4297-9368-b227919f6cef tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:36.491170 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-37934144-8239-4297-9368-b227919f6cef tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: c43e707b-4a9f-48d2-8338-5a680cd51f06] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:36.500471 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37934144-8239-4297-9368-b227919f6cef tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:36.501277 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37934144-8239-4297-9368-b227919f6cef tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:36.502206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37934144-8239-4297-9368-b227919f6cef tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:36.502768 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37934144-8239-4297-9368-b227919f6cef tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:36.828561 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-ffc42aff-242d-4ce3-9a62-5e75c9361942 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:33:36.828561 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-ffc42aff-242d-4ce3-9a62-5e75c9361942 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:33:36.829008 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-ffc42aff-242d-4ce3-9a62-5e75c9361942 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:33:36.829273 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-ffc42aff-242d-4ce3-9a62-5e75c9361942 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:33:36.829839 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-ffc42aff-242d-4ce3-9a62-5e75c9361942 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:33:36.837920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-37934144-8239-4297-9368-b227919f6cef tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:36.843663 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ffc42aff-242d-4ce3-9a62-5e75c9361942 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:36.844887 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ffc42aff-242d-4ce3-9a62-5e75c9361942 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:36.845539 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-37934144-8239-4297-9368-b227919f6cef tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06" status: 200 len: 1275 microversion: 2.1 time: 0.359593 Jul 25 14:33:36.846424 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ffc42aff-242d-4ce3-9a62-5e75c9361942 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:36.847275 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ffc42aff-242d-4ce3-9a62-5e75c9361942 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:36.848279 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1030/2155] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:36 2022] GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06 => generated 1275 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:36.853123 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3eabc91d-3a9d-4dc8-b5c8-7678b14e86bf tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:36.861900 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3eabc91d-3a9d-4dc8-b5c8-7678b14e86bf tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:36.871291 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3eabc91d-3a9d-4dc8-b5c8-7678b14e86bf tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:36.872981 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3eabc91d-3a9d-4dc8-b5c8-7678b14e86bf tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:36.873797 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-ffc42aff-242d-4ce3-9a62-5e75c9361942 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Getting quotas for project 2383030b07e34f93b9637c637f8f0ae7. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:33:36.876304 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3eabc91d-3a9d-4dc8-b5c8-7678b14e86bf tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:36.876997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3eabc91d-3a9d-4dc8-b5c8-7678b14e86bf tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:36.880088 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-ffc42aff-242d-4ce3-9a62-5e75c9361942 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Getting quotas for user 5a4fe4300ea142eb88bde8deab2d1e3c and project 2383030b07e34f93b9637c637f8f0ae7. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:33:36.894435 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ffc42aff-242d-4ce3-9a62-5e75c9361942 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:33:36.897352 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ffc42aff-242d-4ce3-9a62-5e75c9361942 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 079ec21d-9dbc-4c93-a119-bf1bd0c06a15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:33:36.999156 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ffc42aff-242d-4ce3-9a62-5e75c9361942 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.419812 Jul 25 14:33:37.005810 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1126/2156] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:33:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:33:37.102422 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-aeec7bd7-80f4-4bf9-8240-98e8dfb439fc tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2103792667", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "451", "networks": [{"uuid": "c1409048-56d4-4974-b862-8fda8a2087e1"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:37.167170 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3eabc91d-3a9d-4dc8-b5c8-7678b14e86bf tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:37.182690 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3eabc91d-3a9d-4dc8-b5c8-7678b14e86bf tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:37.186546 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3eabc91d-3a9d-4dc8-b5c8-7678b14e86bf tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:37.188084 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3eabc91d-3a9d-4dc8-b5c8-7678b14e86bf tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1266 microversion: 2.25 time: 0.338670 Jul 25 14:33:37.193004 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1031/2157] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:36 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1266 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:33:37.196817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-aeec7bd7-80f4-4bf9-8240-98e8dfb439fc tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] validate_networks() for [('c1409048-56d4-4974-b862-8fda8a2087e1', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:33:37.433480 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-aa190d3c-6165-41d7-82e8-693fd232e618 req-118df7ff-a405-4f29-a084-9da26b2a7c99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a4c1f93-ad00-410d-aaa7-726ba1b3a262", "name": "network-vif-plugged", "status": "completed", "tag": "7cba35a1-e35c-4a9a-876b-96197f0fb886"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:37.453441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-aa190d3c-6165-41d7-82e8-693fd232e618 req-118df7ff-a405-4f29-a084-9da26b2a7c99 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:37.457682 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-aa190d3c-6165-41d7-82e8-693fd232e618 req-118df7ff-a405-4f29-a084-9da26b2a7c99 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:37.479762 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-aa190d3c-6165-41d7-82e8-693fd232e618 req-118df7ff-a405-4f29-a084-9da26b2a7c99 service nova] Creating event network-vif-plugged:7cba35a1-e35c-4a9a-876b-96197f0fb886 for instance 5a4c1f93-ad00-410d-aaa7-726ba1b3a262 on n-h1-846435-14 Jul 25 14:33:37.488652 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-aa190d3c-6165-41d7-82e8-693fd232e618 req-118df7ff-a405-4f29-a084-9da26b2a7c99 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064631 Jul 25 14:33:37.493071 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1032/2158] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:33:37.498757 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f54ec81c-576d-4969-b8dc-49bf156f6e13 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:37.506920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f54ec81c-576d-4969-b8dc-49bf156f6e13 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] [instance: 5a4c1f93-ad00-410d-aaa7-726ba1b3a262] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:37.538469 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f54ec81c-576d-4969-b8dc-49bf156f6e13 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:37.539210 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f54ec81c-576d-4969-b8dc-49bf156f6e13 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:37.540207 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f54ec81c-576d-4969-b8dc-49bf156f6e13 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:37.541452 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f54ec81c-576d-4969-b8dc-49bf156f6e13 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:38.057403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-aeec7bd7-80f4-4bf9-8240-98e8dfb439fc tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:33:38.057928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-aeec7bd7-80f4-4bf9-8240-98e8dfb439fc tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:33:38.058379 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-aeec7bd7-80f4-4bf9-8240-98e8dfb439fc tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:33:38.059310 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-aeec7bd7-80f4-4bf9-8240-98e8dfb439fc tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:33:38.059807 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-aeec7bd7-80f4-4bf9-8240-98e8dfb439fc tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:33:38.075415 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aeec7bd7-80f4-4bf9-8240-98e8dfb439fc tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:38.076442 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aeec7bd7-80f4-4bf9-8240-98e8dfb439fc tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:38.079877 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aeec7bd7-80f4-4bf9-8240-98e8dfb439fc tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:38.080851 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aeec7bd7-80f4-4bf9-8240-98e8dfb439fc tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:38.109097 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-aeec7bd7-80f4-4bf9-8240-98e8dfb439fc tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Getting quotas for project 2383030b07e34f93b9637c637f8f0ae7. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:33:38.116854 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-aeec7bd7-80f4-4bf9-8240-98e8dfb439fc tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Getting quotas for user 5a4fe4300ea142eb88bde8deab2d1e3c and project 2383030b07e34f93b9637c637f8f0ae7. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:33:38.138601 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-aeec7bd7-80f4-4bf9-8240-98e8dfb439fc tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:33:38.141808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-aeec7bd7-80f4-4bf9-8240-98e8dfb439fc tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 493e0a70-7ee8-498b-83e5-f66f83344edf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:33:38.243473 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-aeec7bd7-80f4-4bf9-8240-98e8dfb439fc tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.141629 Jul 25 14:33:38.245525 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1127/2159] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:33:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 14:33:38.257959 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-281ac9b6-88e4-4079-a2d4-0703c111228b tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:38.258817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-281ac9b6-88e4-4079-a2d4-0703c111228b tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: c43e707b-4a9f-48d2-8338-5a680cd51f06] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:38.289018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-281ac9b6-88e4-4079-a2d4-0703c111228b tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:38.289677 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-281ac9b6-88e4-4079-a2d4-0703c111228b tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:38.291653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-281ac9b6-88e4-4079-a2d4-0703c111228b tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:38.292134 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-281ac9b6-88e4-4079-a2d4-0703c111228b tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:38.426755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-281ac9b6-88e4-4079-a2d4-0703c111228b tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:38.439951 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-281ac9b6-88e4-4079-a2d4-0703c111228b tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06" status: 200 len: 1275 microversion: 2.1 time: 0.193031 Jul 25 14:33:38.442033 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1128/2160] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:38 2022] GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06 => generated 1275 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:38.449103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9ed90022-3028-47ee-96fe-93b3b92da01c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:38.449918 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9ed90022-3028-47ee-96fe-93b3b92da01c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:38.456374 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ed90022-3028-47ee-96fe-93b3b92da01c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:38.456822 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ed90022-3028-47ee-96fe-93b3b92da01c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:38.457721 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ed90022-3028-47ee-96fe-93b3b92da01c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:38.458354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ed90022-3028-47ee-96fe-93b3b92da01c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:38.564265 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9ed90022-3028-47ee-96fe-93b3b92da01c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:38.578640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9ed90022-3028-47ee-96fe-93b3b92da01c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:38.580304 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9ed90022-3028-47ee-96fe-93b3b92da01c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:38.582465 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9ed90022-3028-47ee-96fe-93b3b92da01c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1266 microversion: 2.25 time: 0.138999 Jul 25 14:33:38.584148 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1129/2161] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:38 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:33:38.589142 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-39640c0b-0bad-4c3d-8ab0-08c7a03a2cef tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:38.589768 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-39640c0b-0bad-4c3d-8ab0-08c7a03a2cef tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 493e0a70-7ee8-498b-83e5-f66f83344edf] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:38.661115 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-39640c0b-0bad-4c3d-8ab0-08c7a03a2cef tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:38.668979 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-39640c0b-0bad-4c3d-8ab0-08c7a03a2cef tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf" status: 200 len: 1221 microversion: 2.1 time: 0.083582 Jul 25 14:33:38.669831 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1130/2162] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:38 2022] GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf => generated 1221 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:38.741474 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f54ec81c-576d-4969-b8dc-49bf156f6e13 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8c4ea897e4b22919abd8ff4cf3e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c3dda90594fd3a3a244455e927dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:38.749489 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f54ec81c-576d-4969-b8dc-49bf156f6e13 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] 10.222.0.88 "GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262" status: 200 len: 1316 microversion: 2.1 time: 1.254940 Jul 25 14:33:38.750607 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1033/2163] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:37 2022] GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262 => generated 1316 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:39.461301 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-463399c7-fe41-4755-8231-2f50828d0e27 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:39.462010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-463399c7-fe41-4755-8231-2f50828d0e27 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: c43e707b-4a9f-48d2-8338-5a680cd51f06] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:39.476247 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-463399c7-fe41-4755-8231-2f50828d0e27 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:39.476703 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-463399c7-fe41-4755-8231-2f50828d0e27 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:39.477547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-463399c7-fe41-4755-8231-2f50828d0e27 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:39.478177 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-463399c7-fe41-4755-8231-2f50828d0e27 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:39.608529 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e251331f-0fd2-4629-ae73-b595b297e322 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:39.610150 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e251331f-0fd2-4629-ae73-b595b297e322 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:39.623887 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e251331f-0fd2-4629-ae73-b595b297e322 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:39.624359 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e251331f-0fd2-4629-ae73-b595b297e322 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:39.627749 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e251331f-0fd2-4629-ae73-b595b297e322 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:39.630585 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e251331f-0fd2-4629-ae73-b595b297e322 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:39.639579 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-463399c7-fe41-4755-8231-2f50828d0e27 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:39.654167 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-463399c7-fe41-4755-8231-2f50828d0e27 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06" status: 200 len: 1275 microversion: 2.1 time: 0.196646 Jul 25 14:33:39.668052 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1131/2164] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:39 2022] GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06 => generated 1275 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:39.696853 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-940b9cde-101d-4143-901b-151bf8ee3046 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:39.697335 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-940b9cde-101d-4143-901b-151bf8ee3046 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 493e0a70-7ee8-498b-83e5-f66f83344edf] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:39.721300 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-940b9cde-101d-4143-901b-151bf8ee3046 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:39.722299 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-940b9cde-101d-4143-901b-151bf8ee3046 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:39.723168 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-940b9cde-101d-4143-901b-151bf8ee3046 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:39.723608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-940b9cde-101d-4143-901b-151bf8ee3046 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:39.845443 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-940b9cde-101d-4143-901b-151bf8ee3046 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:39.860919 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-940b9cde-101d-4143-901b-151bf8ee3046 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf" status: 200 len: 1217 microversion: 2.1 time: 0.174003 Jul 25 14:33:39.866487 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1132/2165] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:39 2022] GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf => generated 1217 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:33:39.883689 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d27266fc-2931-4446-af2f-c9afbb11350a tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:39.887438 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d27266fc-2931-4446-af2f-c9afbb11350a tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] [instance: 5a4c1f93-ad00-410d-aaa7-726ba1b3a262] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:39.920441 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d27266fc-2931-4446-af2f-c9afbb11350a tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:39.921267 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d27266fc-2931-4446-af2f-c9afbb11350a tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:39.922309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d27266fc-2931-4446-af2f-c9afbb11350a tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:39.924499 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d27266fc-2931-4446-af2f-c9afbb11350a tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:40.010361 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e251331f-0fd2-4629-ae73-b595b297e322 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:40.025375 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e251331f-0fd2-4629-ae73-b595b297e322 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:40.044740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e251331f-0fd2-4629-ae73-b595b297e322 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:40.045963 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e251331f-0fd2-4629-ae73-b595b297e322 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1266 microversion: 2.25 time: 0.443990 Jul 25 14:33:40.049979 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1034/2166] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:39 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1266 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:33:40.282677 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d27266fc-2931-4446-af2f-c9afbb11350a tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8c4ea897e4b22919abd8ff4cf3e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c3dda90594fd3a3a244455e927dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:40.301567 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d27266fc-2931-4446-af2f-c9afbb11350a tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] 10.222.0.88 "GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262" status: 200 len: 1316 microversion: 2.1 time: 0.433215 Jul 25 14:33:40.302777 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1133/2167] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:39 2022] GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262 => generated 1316 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:40.681552 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-086df04e-86c1-4a35-9dbf-9f2a2887e44a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:40.682176 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-086df04e-86c1-4a35-9dbf-9f2a2887e44a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: c43e707b-4a9f-48d2-8338-5a680cd51f06] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:40.684275 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:33:40.684936 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:33:40.696699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-086df04e-86c1-4a35-9dbf-9f2a2887e44a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:40.700564 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-086df04e-86c1-4a35-9dbf-9f2a2887e44a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:40.701632 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-086df04e-86c1-4a35-9dbf-9f2a2887e44a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:40.702245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-086df04e-86c1-4a35-9dbf-9f2a2887e44a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:40.898131 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a51b11fa-27da-41a2-92a8-b83ce9893a64 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:40.899412 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a51b11fa-27da-41a2-92a8-b83ce9893a64 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 493e0a70-7ee8-498b-83e5-f66f83344edf] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:40.916989 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a51b11fa-27da-41a2-92a8-b83ce9893a64 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:40.923387 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a51b11fa-27da-41a2-92a8-b83ce9893a64 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:40.924979 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a51b11fa-27da-41a2-92a8-b83ce9893a64 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:40.931550 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a51b11fa-27da-41a2-92a8-b83ce9893a64 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:41.162008 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a51b11fa-27da-41a2-92a8-b83ce9893a64 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:41.176944 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a51b11fa-27da-41a2-92a8-b83ce9893a64 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf" status: 200 len: 1279 microversion: 2.1 time: 0.283144 Jul 25 14:33:41.178519 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1134/2168] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:40 2022] GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf => generated 1279 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:41.202466 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6ca0a94b-ef94-43a5-a463-1532b7e08236 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:41.203109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6ca0a94b-ef94-43a5-a463-1532b7e08236 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:41.214958 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6ca0a94b-ef94-43a5-a463-1532b7e08236 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:41.215688 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6ca0a94b-ef94-43a5-a463-1532b7e08236 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:41.217273 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6ca0a94b-ef94-43a5-a463-1532b7e08236 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:41.219128 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6ca0a94b-ef94-43a5-a463-1532b7e08236 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:41.351314 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6ca0a94b-ef94-43a5-a463-1532b7e08236 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:41.372885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6ca0a94b-ef94-43a5-a463-1532b7e08236 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:41.376920 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6ca0a94b-ef94-43a5-a463-1532b7e08236 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:41.380393 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6ca0a94b-ef94-43a5-a463-1532b7e08236 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 200 len: 1266 microversion: 2.25 time: 0.195274 Jul 25 14:33:41.388464 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1135/2169] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:41 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:33:41.401407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c4bc1b71-a815-400c-96a3-fbcff27e5437 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:41.408111 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c4bc1b71-a815-400c-96a3-fbcff27e5437 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] [instance: 5a4c1f93-ad00-410d-aaa7-726ba1b3a262] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:41.426647 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c4bc1b71-a815-400c-96a3-fbcff27e5437 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:41.426647 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c4bc1b71-a815-400c-96a3-fbcff27e5437 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:41.427715 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c4bc1b71-a815-400c-96a3-fbcff27e5437 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:41.428250 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c4bc1b71-a815-400c-96a3-fbcff27e5437 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:41.779346 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-086df04e-86c1-4a35-9dbf-9f2a2887e44a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:41.801969 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-086df04e-86c1-4a35-9dbf-9f2a2887e44a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06" status: 200 len: 1317 microversion: 2.1 time: 1.123034 Jul 25 14:33:41.807916 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1035/2170] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:40 2022] GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06 => generated 1317 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:41.999733 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2965c8c2-f8dd-4887-a6e2-0c8cceae42af tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-461052788", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "3e226189-c0b7-4225-ae0e-58df387aff5c"}, {"uuid": "ada1c61b-1cbf-4850-bccb-028392604fdc"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:42.103780 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-2965c8c2-f8dd-4887-a6e2-0c8cceae42af tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] validate_networks() for [('3e226189-c0b7-4225-ae0e-58df387aff5c', None, None, None, None, None), ('ada1c61b-1cbf-4850-bccb-028392604fdc', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:33:42.171360 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c4bc1b71-a815-400c-96a3-fbcff27e5437 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8c4ea897e4b22919abd8ff4cf3e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c3dda90594fd3a3a244455e927dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:42.191402 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c4bc1b71-a815-400c-96a3-fbcff27e5437 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] 10.222.0.88 "GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262" status: 200 len: 1505 microversion: 2.1 time: 0.808753 Jul 25 14:33:42.193440 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1136/2171] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:41 2022] GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262 => generated 1505 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:42.213392 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-46e91b3d-6fd3-48ec-886d-0d082b7817c5 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:42.215944 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-46e91b3d-6fd3-48ec-886d-0d082b7817c5 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 493e0a70-7ee8-498b-83e5-f66f83344edf] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:42.237124 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-46e91b3d-6fd3-48ec-886d-0d082b7817c5 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:42.238092 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-46e91b3d-6fd3-48ec-886d-0d082b7817c5 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:42.239339 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-46e91b3d-6fd3-48ec-886d-0d082b7817c5 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:42.239957 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-46e91b3d-6fd3-48ec-886d-0d082b7817c5 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:42.595672 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-46e91b3d-6fd3-48ec-886d-0d082b7817c5 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:42.605672 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-46e91b3d-6fd3-48ec-886d-0d082b7817c5 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf" status: 200 len: 1321 microversion: 2.1 time: 0.409641 Jul 25 14:33:42.609120 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1137/2172] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:42 2022] GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf => generated 1321 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:42.623798 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7d7d16f5-a7ac-4438-a9aa-f9994a9be8ce tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:42.624429 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7d7d16f5-a7ac-4438-a9aa-f9994a9be8ce tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] [instance: 5a4c1f93-ad00-410d-aaa7-726ba1b3a262] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:42.638446 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d7d16f5-a7ac-4438-a9aa-f9994a9be8ce tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:42.639716 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d7d16f5-a7ac-4438-a9aa-f9994a9be8ce tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:42.642947 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d7d16f5-a7ac-4438-a9aa-f9994a9be8ce tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:42.643755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d7d16f5-a7ac-4438-a9aa-f9994a9be8ce tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:42.865071 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7d7d16f5-a7ac-4438-a9aa-f9994a9be8ce tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] 10.222.0.88 "DELETE /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.253381 Jul 25 14:33:42.867299 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1138/2173] 10.222.0.88 () {58 vars in 1296 bytes} [Mon Jul 25 14:33:42 2022] DELETE /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262/os-server-password => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:33:42.885299 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-426063b6-93e8-4ded-af16-5558d8af2f74 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:42.888299 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-426063b6-93e8-4ded-af16-5558d8af2f74 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 324085c2-5228-46ba-8b72-5ee6f112b1d2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:42.899604 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-426063b6-93e8-4ded-af16-5558d8af2f74 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:42.900576 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-426063b6-93e8-4ded-af16-5558d8af2f74 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:42.923009 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-426063b6-93e8-4ded-af16-5558d8af2f74 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:42.923716 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-426063b6-93e8-4ded-af16-5558d8af2f74 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:42.955328 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-426063b6-93e8-4ded-af16-5558d8af2f74 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] HTTP exception thrown: Instance 324085c2-5228-46ba-8b72-5ee6f112b1d2 could not be found. Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-426063b6-93e8-4ded-af16-5558d8af2f74 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Request method failure captured: Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 HTTP/1.1 Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qhLhys1-RVNY_YaGf_npt4Z4KJsS5p2XN4AruTf8qUewb9rE4XpUKgQisrocQQqeMtAKoOdmeeflmBSnHF2TZP6D35IBCijfuSNw5WWc9aPp3krfOSwqRap_JaduPaA1FUwutai5h24FHDHo9d0VUQIMA_69Md-gnXmGVpnXGjrxd8 Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: X-Openstack-Nova-Api-Version: 2.25 Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: fb2b9ba0bede403bafb665d5e0818dfb Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1229899115 Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fb2b9ba0bede403bafb665d5e0818dfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fb2b9ba0bede403bafb665d5e0818dfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_fb2b9ba0bede403bafb665d5e0818dfb", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/fb2b9ba0bede403bafb665d5e0818dfb"}]}] Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1229899115 Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: fb2b9ba0bede403bafb665d5e0818dfb Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1229899115 Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-LiveAutoBlockMigrationV225Test-1229899115-project Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 94b57069a56c4fedb1d4546c1d0415c7 Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1229899115-project Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 324085c2-5228-46ba-8b72-5ee6f112b1d2 could not be found. Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '324085c2-5228-46ba-8b72-5ee6f112b1d2'} Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 324085c2-5228-46ba-8b72-5ee6f112b1d2 could not be found. Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 324085c2-5228-46ba-8b72-5ee6f112b1d2 could not be found. Jul 25 14:33:42.958487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:42.961957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:33:42.961957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:42.961957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:33:42.961957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:33:42.961957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:33:42.961957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:33:42.961957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:33:42.961957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 324085c2-5228-46ba-8b72-5ee6f112b1d2 could not be found. Jul 25 14:33:42.961957 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:42.964373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-426063b6-93e8-4ded-af16-5558d8af2f74 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Returning 404 to user: Instance 324085c2-5228-46ba-8b72-5ee6f112b1d2 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:33:42.965535 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-426063b6-93e8-4ded-af16-5558d8af2f74 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2" status: 404 len: 111 microversion: 2.25 time: 0.097175 Jul 25 14:33:42.966352 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1139/2174] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:42 2022] GET /compute/v2.1/servers/324085c2-5228-46ba-8b72-5ee6f112b1d2 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:33:42.997706 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-79212049-11bf-4645-b99c-a1102ea6d9e1 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:42.998913 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-79212049-11bf-4645-b99c-a1102ea6d9e1 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: c43e707b-4a9f-48d2-8338-5a680cd51f06] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:43.014398 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-79212049-11bf-4645-b99c-a1102ea6d9e1 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:43.015554 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-79212049-11bf-4645-b99c-a1102ea6d9e1 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:43.017139 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-79212049-11bf-4645-b99c-a1102ea6d9e1 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:43.018268 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-79212049-11bf-4645-b99c-a1102ea6d9e1 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:43.541920 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-79212049-11bf-4645-b99c-a1102ea6d9e1 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:43.561961 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-79212049-11bf-4645-b99c-a1102ea6d9e1 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06" status: 200 len: 1317 microversion: 2.1 time: 0.587779 Jul 25 14:33:43.563868 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1140/2175] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:42 2022] GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06 => generated 1317 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:43.578529 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e9689ed8-cb4f-4a65-a1c3-55029af864b2 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:43.579370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e9689ed8-cb4f-4a65-a1c3-55029af864b2 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] [instance: 5a4c1f93-ad00-410d-aaa7-726ba1b3a262] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:43.596668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e9689ed8-cb4f-4a65-a1c3-55029af864b2 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:43.601113 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e9689ed8-cb4f-4a65-a1c3-55029af864b2 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:43.601999 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e9689ed8-cb4f-4a65-a1c3-55029af864b2 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:43.602449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e9689ed8-cb4f-4a65-a1c3-55029af864b2 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:43.671723 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e9689ed8-cb4f-4a65-a1c3-55029af864b2 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] 10.222.0.88 "GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.104873 Jul 25 14:33:43.672472 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1141/2176] 10.222.0.88 () {58 vars in 1293 bytes} [Mon Jul 25 14:33:43 2022] GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262/os-server-password => generated 16 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:33:43.679355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a4d48b91-2d15-4cb0-a1bd-d93384420122 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:43.680541 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a4d48b91-2d15-4cb0-a1bd-d93384420122 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 493e0a70-7ee8-498b-83e5-f66f83344edf] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:43.688847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4d48b91-2d15-4cb0-a1bd-d93384420122 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:43.689342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4d48b91-2d15-4cb0-a1bd-d93384420122 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:43.691248 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4d48b91-2d15-4cb0-a1bd-d93384420122 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:43.691698 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4d48b91-2d15-4cb0-a1bd-d93384420122 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:44.000634 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a4d48b91-2d15-4cb0-a1bd-d93384420122 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:44.013135 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a4d48b91-2d15-4cb0-a1bd-d93384420122 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf" status: 200 len: 1321 microversion: 2.1 time: 0.337464 Jul 25 14:33:44.013775 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1142/2177] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:43 2022] GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf => generated 1321 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:44.037259 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e56f7579-ad41-4357-abdf-ee6e7c90bff7 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:44.043058 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e56f7579-ad41-4357-abdf-ee6e7c90bff7 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] [instance: 5a4c1f93-ad00-410d-aaa7-726ba1b3a262] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:44.066996 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e56f7579-ad41-4357-abdf-ee6e7c90bff7 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:44.071458 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e56f7579-ad41-4357-abdf-ee6e7c90bff7 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:44.072638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e56f7579-ad41-4357-abdf-ee6e7c90bff7 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:44.077567 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e56f7579-ad41-4357-abdf-ee6e7c90bff7 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:44.178024 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e56f7579-ad41-4357-abdf-ee6e7c90bff7 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] [instance: 5a4c1f93-ad00-410d-aaa7-726ba1b3a262] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:33:44.271611 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:33:44.378070 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e56f7579-ad41-4357-abdf-ee6e7c90bff7 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] 10.222.0.88 "DELETE /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262" status: 204 len: 0 microversion: 2.1 time: 0.354756 Jul 25 14:33:44.378698 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1143/2178] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:33:44 2022] DELETE /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:33:44.391557 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-05067bff-6ef4-4c00-b015-cdedec8920e9 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:44.392469 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-05067bff-6ef4-4c00-b015-cdedec8920e9 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] [instance: 5a4c1f93-ad00-410d-aaa7-726ba1b3a262] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:44.399774 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-05067bff-6ef4-4c00-b015-cdedec8920e9 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:44.400630 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-05067bff-6ef4-4c00-b015-cdedec8920e9 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:44.401607 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-05067bff-6ef4-4c00-b015-cdedec8920e9 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:44.402158 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-05067bff-6ef4-4c00-b015-cdedec8920e9 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:44.748885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-05067bff-6ef4-4c00-b015-cdedec8920e9 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8c4ea897e4b22919abd8ff4cf3e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c3dda90594fd3a3a244455e927dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:44.761085 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-05067bff-6ef4-4c00-b015-cdedec8920e9 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] 10.222.0.88 "GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262" status: 200 len: 1511 microversion: 2.1 time: 0.377390 Jul 25 14:33:44.778622 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1144/2179] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:44 2022] GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262 => generated 1511 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:33:44.784504 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-98c6d73f-7e84-444a-a0f0-05b35be0eb61 req-aa53ba6c-3268-4923-aea2-9a9cff9670ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "493e0a70-7ee8-498b-83e5-f66f83344edf", "tag": "59b7d34a-577f-450a-994b-02cfc971c6f7"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:44.799142 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-98c6d73f-7e84-444a-a0f0-05b35be0eb61 req-aa53ba6c-3268-4923-aea2-9a9cff9670ac service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:44.799795 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-98c6d73f-7e84-444a-a0f0-05b35be0eb61 req-aa53ba6c-3268-4923-aea2-9a9cff9670ac service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:44.815952 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-98c6d73f-7e84-444a-a0f0-05b35be0eb61 req-aa53ba6c-3268-4923-aea2-9a9cff9670ac service nova] Creating event network-changed:59b7d34a-577f-450a-994b-02cfc971c6f7 for instance 493e0a70-7ee8-498b-83e5-f66f83344edf on n-h1-846435-14 Jul 25 14:33:44.823895 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-98c6d73f-7e84-444a-a0f0-05b35be0eb61 req-aa53ba6c-3268-4923-aea2-9a9cff9670ac service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043665 Jul 25 14:33:44.832179 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1145/2180] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:33:44.838389 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e14fcbb9-7cbe-44a5-8e9f-87205814acbb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:44.840445 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e14fcbb9-7cbe-44a5-8e9f-87205814acbb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: c43e707b-4a9f-48d2-8338-5a680cd51f06] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:44.850413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e14fcbb9-7cbe-44a5-8e9f-87205814acbb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:44.851047 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e14fcbb9-7cbe-44a5-8e9f-87205814acbb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:44.852095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e14fcbb9-7cbe-44a5-8e9f-87205814acbb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:44.852696 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e14fcbb9-7cbe-44a5-8e9f-87205814acbb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:45.101843 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e14fcbb9-7cbe-44a5-8e9f-87205814acbb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:45.111047 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e14fcbb9-7cbe-44a5-8e9f-87205814acbb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06" status: 200 len: 1317 microversion: 2.1 time: 0.277327 Jul 25 14:33:45.111645 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1146/2181] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:44 2022] GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06 => generated 1317 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:45.129333 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d1aba7b7-23db-4f55-9643-c3f752329568 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:45.129972 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d1aba7b7-23db-4f55-9643-c3f752329568 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 493e0a70-7ee8-498b-83e5-f66f83344edf] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:45.137701 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1aba7b7-23db-4f55-9643-c3f752329568 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:45.144320 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1aba7b7-23db-4f55-9643-c3f752329568 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:45.147703 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1aba7b7-23db-4f55-9643-c3f752329568 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:45.148382 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1aba7b7-23db-4f55-9643-c3f752329568 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:45.453090 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d1aba7b7-23db-4f55-9643-c3f752329568 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:45.462457 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d1aba7b7-23db-4f55-9643-c3f752329568 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf" status: 200 len: 1321 microversion: 2.1 time: 0.337002 Jul 25 14:33:45.468336 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1147/2182] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:45 2022] GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf => generated 1321 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:45.782329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fcf6acef-87fa-474c-82d1-77aa6a8692a8 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:45.783724 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fcf6acef-87fa-474c-82d1-77aa6a8692a8 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] [instance: 5a4c1f93-ad00-410d-aaa7-726ba1b3a262] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:45.792911 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:33:45.795096 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fcf6acef-87fa-474c-82d1-77aa6a8692a8 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:45.798372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fcf6acef-87fa-474c-82d1-77aa6a8692a8 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:45.799427 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fcf6acef-87fa-474c-82d1-77aa6a8692a8 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:45.800125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fcf6acef-87fa-474c-82d1-77aa6a8692a8 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:46.175387 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fcf6acef-87fa-474c-82d1-77aa6a8692a8 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8c4ea897e4b22919abd8ff4cf3e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c3dda90594fd3a3a244455e927dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:46.189227 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fcf6acef-87fa-474c-82d1-77aa6a8692a8 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] 10.222.0.88 "GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262" status: 200 len: 1511 microversion: 2.1 time: 0.410657 Jul 25 14:33:46.190449 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1148/2183] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:45 2022] GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262 => generated 1511 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:46.197874 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c2e76d6b-163e-4ebe-927b-b29e65118838 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:46.199659 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c2e76d6b-163e-4ebe-927b-b29e65118838 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: c43e707b-4a9f-48d2-8338-5a680cd51f06] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:46.225907 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c2e76d6b-163e-4ebe-927b-b29e65118838 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:46.229054 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c2e76d6b-163e-4ebe-927b-b29e65118838 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:46.230059 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c2e76d6b-163e-4ebe-927b-b29e65118838 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:46.230517 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c2e76d6b-163e-4ebe-927b-b29e65118838 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:46.683829 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c2e76d6b-163e-4ebe-927b-b29e65118838 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:46.716886 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c2e76d6b-163e-4ebe-927b-b29e65118838 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06" status: 200 len: 1317 microversion: 2.1 time: 0.525033 Jul 25 14:33:46.728016 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1149/2184] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:46 2022] GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06 => generated 1317 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:46.761744 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-41fb0b78-df1c-421c-b8ff-54bf70cd4a16 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:46.763321 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-41fb0b78-df1c-421c-b8ff-54bf70cd4a16 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 493e0a70-7ee8-498b-83e5-f66f83344edf] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:46.780412 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-41fb0b78-df1c-421c-b8ff-54bf70cd4a16 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:46.782198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-41fb0b78-df1c-421c-b8ff-54bf70cd4a16 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:46.784395 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-41fb0b78-df1c-421c-b8ff-54bf70cd4a16 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:46.785663 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-41fb0b78-df1c-421c-b8ff-54bf70cd4a16 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:47.340547 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-2965c8c2-f8dd-4887-a6e2-0c8cceae42af tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:33:47.341077 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-2965c8c2-f8dd-4887-a6e2-0c8cceae42af tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:33:47.341633 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-2965c8c2-f8dd-4887-a6e2-0c8cceae42af tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:33:47.342100 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-2965c8c2-f8dd-4887-a6e2-0c8cceae42af tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:33:47.342571 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-2965c8c2-f8dd-4887-a6e2-0c8cceae42af tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:33:47.373956 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2965c8c2-f8dd-4887-a6e2-0c8cceae42af tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:47.374993 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2965c8c2-f8dd-4887-a6e2-0c8cceae42af tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:47.376225 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2965c8c2-f8dd-4887-a6e2-0c8cceae42af tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:47.377317 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2965c8c2-f8dd-4887-a6e2-0c8cceae42af tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:47.433973 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-2965c8c2-f8dd-4887-a6e2-0c8cceae42af tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Getting quotas for project 041b46dd05384e47a74bfaa8dc3c838f. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:33:47.454320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-2965c8c2-f8dd-4887-a6e2-0c8cceae42af tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Getting quotas for user 3e2beeccba594f01b83983a2ec729a98 and project 041b46dd05384e47a74bfaa8dc3c838f. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:33:47.490489 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2965c8c2-f8dd-4887-a6e2-0c8cceae42af tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:33:47.492856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2965c8c2-f8dd-4887-a6e2-0c8cceae42af tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:33:47.516587 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-41fb0b78-df1c-421c-b8ff-54bf70cd4a16 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:47.530264 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-41fb0b78-df1c-421c-b8ff-54bf70cd4a16 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf" status: 200 len: 1321 microversion: 2.1 time: 0.799264 Jul 25 14:33:47.532613 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1150/2185] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:46 2022] GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf => generated 1321 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:47.540599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c22de425-4f50-4534-8891-6aefdbc97756 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:47.555811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c22de425-4f50-4534-8891-6aefdbc97756 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] [instance: 5a4c1f93-ad00-410d-aaa7-726ba1b3a262] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:47.574651 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c22de425-4f50-4534-8891-6aefdbc97756 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:47.576748 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c22de425-4f50-4534-8891-6aefdbc97756 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:47.579882 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c22de425-4f50-4534-8891-6aefdbc97756 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:47.580669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c22de425-4f50-4534-8891-6aefdbc97756 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:47.623044 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2965c8c2-f8dd-4887-a6e2-0c8cceae42af tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.629133 Jul 25 14:33:47.633249 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1036/2186] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:33:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 5639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 14:33:47.647267 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9b9804ac-2f18-43ac-b0eb-ea645bbc74d4 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:47.649456 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9b9804ac-2f18-43ac-b0eb-ea645bbc74d4 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:47.873334 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c22de425-4f50-4534-8891-6aefdbc97756 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8c4ea897e4b22919abd8ff4cf3e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c3dda90594fd3a3a244455e927dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:47.882801 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c22de425-4f50-4534-8891-6aefdbc97756 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] 10.222.0.88 "GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262" status: 200 len: 1511 microversion: 2.1 time: 0.347628 Jul 25 14:33:47.896858 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1151/2187] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:47 2022] GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262 => generated 1511 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:47.903650 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b5742f0a-3d9f-4fb3-9788-55f0e0532767 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:47.904270 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b5742f0a-3d9f-4fb3-9788-55f0e0532767 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: c43e707b-4a9f-48d2-8338-5a680cd51f06] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:47.910656 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b5742f0a-3d9f-4fb3-9788-55f0e0532767 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:47.911304 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b5742f0a-3d9f-4fb3-9788-55f0e0532767 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:47.912603 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b5742f0a-3d9f-4fb3-9788-55f0e0532767 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:47.913186 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b5742f0a-3d9f-4fb3-9788-55f0e0532767 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:48.070720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9b9804ac-2f18-43ac-b0eb-ea645bbc74d4 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:48.081719 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9b9804ac-2f18-43ac-b0eb-ea645bbc74d4 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630" status: 200 len: 1212 microversion: 2.1 time: 0.446777 Jul 25 14:33:48.082315 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1037/2188] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:47 2022] GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 => generated 1212 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:48.097851 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=8 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:33:48.266723 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b5742f0a-3d9f-4fb3-9788-55f0e0532767 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:48.279640 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b5742f0a-3d9f-4fb3-9788-55f0e0532767 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06" status: 200 len: 1317 microversion: 2.1 time: 0.379637 Jul 25 14:33:48.280649 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1152/2189] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:47 2022] GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06 => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:48.558284 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0f622225-2d9a-48c3-a58b-29d0818db71c tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:48.558905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0f622225-2d9a-48c3-a58b-29d0818db71c tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 493e0a70-7ee8-498b-83e5-f66f83344edf] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:48.579616 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f622225-2d9a-48c3-a58b-29d0818db71c tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:48.580787 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f622225-2d9a-48c3-a58b-29d0818db71c tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:48.585600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f622225-2d9a-48c3-a58b-29d0818db71c tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:48.592378 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f622225-2d9a-48c3-a58b-29d0818db71c tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:48.662255 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-81df09b9-35c1-4f54-a51f-2294587ac721 req-455c0974-3f74-42ef-b964-42a8a9b048d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c43e707b-4a9f-48d2-8338-5a680cd51f06", "tag": "ecff7cc7-d9a7-4dd6-b23b-de594526b420"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:48.675531 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=28 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:33:48.693399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-81df09b9-35c1-4f54-a51f-2294587ac721 req-455c0974-3f74-42ef-b964-42a8a9b048d2 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:48.694487 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-81df09b9-35c1-4f54-a51f-2294587ac721 req-455c0974-3f74-42ef-b964-42a8a9b048d2 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:48.737156 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-81df09b9-35c1-4f54-a51f-2294587ac721 req-455c0974-3f74-42ef-b964-42a8a9b048d2 service nova] Creating event network-changed:ecff7cc7-d9a7-4dd6-b23b-de594526b420 for instance c43e707b-4a9f-48d2-8338-5a680cd51f06 on n-h1-846435-14 Jul 25 14:33:48.748549 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-81df09b9-35c1-4f54-a51f-2294587ac721 req-455c0974-3f74-42ef-b964-42a8a9b048d2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096792 Jul 25 14:33:48.749988 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1153/2190] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:33:48.910359 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b7036664-adf9-4e80-b968-43af9cb3c290 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:48.911175 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b7036664-adf9-4e80-b968-43af9cb3c290 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] [instance: 5a4c1f93-ad00-410d-aaa7-726ba1b3a262] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:48.930302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b7036664-adf9-4e80-b968-43af9cb3c290 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:48.931128 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b7036664-adf9-4e80-b968-43af9cb3c290 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:48.932189 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b7036664-adf9-4e80-b968-43af9cb3c290 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:48.936723 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b7036664-adf9-4e80-b968-43af9cb3c290 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:49.082678 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b7036664-adf9-4e80-b968-43af9cb3c290 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51d8c4ea897e4b22919abd8ff4cf3e9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c3dda90594fd3a3a244455e927dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:49.094479 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b7036664-adf9-4e80-b968-43af9cb3c290 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] 10.222.0.88 "GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262" status: 200 len: 1469 microversion: 2.1 time: 0.189258 Jul 25 14:33:49.113382 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1154/2191] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:48 2022] GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262 => generated 1469 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:33:49.128805 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-92d55d88-a078-4860-a6c2-b9b6a8c8da51 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:49.129930 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-92d55d88-a078-4860-a6c2-b9b6a8c8da51 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:49.152120 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-92d55d88-a078-4860-a6c2-b9b6a8c8da51 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:49.153424 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-92d55d88-a078-4860-a6c2-b9b6a8c8da51 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:49.154737 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-92d55d88-a078-4860-a6c2-b9b6a8c8da51 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:49.155412 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-92d55d88-a078-4860-a6c2-b9b6a8c8da51 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:49.309698 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-92d55d88-a078-4860-a6c2-b9b6a8c8da51 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:49.328434 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-92d55d88-a078-4860-a6c2-b9b6a8c8da51 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630" status: 200 len: 1264 microversion: 2.1 time: 0.211030 Jul 25 14:33:49.330070 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1155/2192] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:49 2022] GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 => generated 1264 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:49.345996 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3e13fb9b-047b-45b4-9b0c-48c8a72c8c2d tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:49.346927 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3e13fb9b-047b-45b4-9b0c-48c8a72c8c2d tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: c43e707b-4a9f-48d2-8338-5a680cd51f06] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:49.354140 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e13fb9b-047b-45b4-9b0c-48c8a72c8c2d tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:49.354912 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e13fb9b-047b-45b4-9b0c-48c8a72c8c2d tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:49.355888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e13fb9b-047b-45b4-9b0c-48c8a72c8c2d tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:49.356605 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e13fb9b-047b-45b4-9b0c-48c8a72c8c2d tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:49.363092 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0f622225-2d9a-48c3-a58b-29d0818db71c tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:49.382827 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0f622225-2d9a-48c3-a58b-29d0818db71c tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf" status: 200 len: 1321 microversion: 2.1 time: 0.833687 Jul 25 14:33:49.383879 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1038/2193] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:48 2022] GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf => generated 1321 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:49.807585 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3e13fb9b-047b-45b4-9b0c-48c8a72c8c2d tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:49.818964 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3e13fb9b-047b-45b4-9b0c-48c8a72c8c2d tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06" status: 200 len: 1317 microversion: 2.1 time: 0.486173 Jul 25 14:33:49.823017 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1156/2194] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:49 2022] GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06 => generated 1317 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:49.903466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f3f77e0a-fb46-4d5c-9462-75146dd9849c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:49.904089 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f3f77e0a-fb46-4d5c-9462-75146dd9849c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:49.923000 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3f77e0a-fb46-4d5c-9462-75146dd9849c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:49.923769 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3f77e0a-fb46-4d5c-9462-75146dd9849c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:49.928603 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3f77e0a-fb46-4d5c-9462-75146dd9849c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:49.929311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3f77e0a-fb46-4d5c-9462-75146dd9849c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:50.021604 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f3f77e0a-fb46-4d5c-9462-75146dd9849c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:33:50.123719 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dca04658-6e2a-4749-9e04-db7966841997 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:50.124574 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dca04658-6e2a-4749-9e04-db7966841997 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] [instance: 5a4c1f93-ad00-410d-aaa7-726ba1b3a262] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:50.137509 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dca04658-6e2a-4749-9e04-db7966841997 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:50.137973 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dca04658-6e2a-4749-9e04-db7966841997 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:50.141085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dca04658-6e2a-4749-9e04-db7966841997 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:50.141536 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dca04658-6e2a-4749-9e04-db7966841997 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:50.174491 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-dca04658-6e2a-4749-9e04-db7966841997 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] HTTP exception thrown: Instance 5a4c1f93-ad00-410d-aaa7-726ba1b3a262 could not be found. Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dca04658-6e2a-4749-9e04-db7966841997 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Request method failure captured: Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262 HTTP/1.1 Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qmtBRTSsDsMRRzAQUmGJ7vBXw9jqLKFaZtzUJq6pp_Yd8BUlHG4IxpYCtWu8Ljc-05JQXPRHpK16IeXMwRLxwfY9bbgf7pu0Dtf4LvmXadO3f0fjG88zPa3zkArRAmst4ZbgFBFlZakp6xXDIQEUPLeOQuLn09Guy1EexJdn7W7MXI Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 9f2c3dda90594fd3a3a244455e927dc1 Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerPasswordTestJSON-1323381332 Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9f2c3dda90594fd3a3a244455e927dc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9f2c3dda90594fd3a3a244455e927dc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9f2c3dda90594fd3a3a244455e927dc1", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9f2c3dda90594fd3a3a244455e927dc1"}]}] Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerPasswordTestJSON-1323381332 Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 9f2c3dda90594fd3a3a244455e927dc1 Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1323381332 Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerPasswordTestJSON-1323381332-project Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 51d8c4ea897e4b22919abd8ff4cf3e9b Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerPasswordTestJSON-1323381332-project Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 5a4c1f93-ad00-410d-aaa7-726ba1b3a262 could not be found. Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '5a4c1f93-ad00-410d-aaa7-726ba1b3a262'} Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a4c1f93-ad00-410d-aaa7-726ba1b3a262 could not be found. Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a4c1f93-ad00-410d-aaa7-726ba1b3a262 could not be found. Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:33:50.176769 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:50.179923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:33:50.179923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:33:50.179923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:33:50.179923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:33:50.179923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:33:50.179923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a4c1f93-ad00-410d-aaa7-726ba1b3a262 could not be found. Jul 25 14:33:50.179923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:33:50.182652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dca04658-6e2a-4749-9e04-db7966841997 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] Returning 404 to user: Instance 5a4c1f93-ad00-410d-aaa7-726ba1b3a262 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:33:50.184456 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dca04658-6e2a-4749-9e04-db7966841997 tempest-ServerPasswordTestJSON-1323381332 tempest-ServerPasswordTestJSON-1323381332-project] 10.222.0.88 "GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262" status: 404 len: 111 microversion: 2.1 time: 0.066644 Jul 25 14:33:50.185710 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1157/2195] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:50 2022] GET /compute/v2.1/servers/5a4c1f93-ad00-410d-aaa7-726ba1b3a262 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:33:50.223374 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f3f77e0a-fb46-4d5c-9462-75146dd9849c tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "DELETE /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 204 len: 0 microversion: 2.25 time: 0.324482 Jul 25 14:33:50.225182 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1039/2196] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Jul 25 14:33:49 2022] DELETE /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 14:33:50.233708 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4e321328-e90b-4ad4-a22a-4eca9187676e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:50.234759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4e321328-e90b-4ad4-a22a-4eca9187676e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:50.256030 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e321328-e90b-4ad4-a22a-4eca9187676e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:50.256959 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e321328-e90b-4ad4-a22a-4eca9187676e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:50.258095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e321328-e90b-4ad4-a22a-4eca9187676e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:50.258716 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e321328-e90b-4ad4-a22a-4eca9187676e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:50.351303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-40c52b67-01a4-4fd6-95fd-174fd5151b6f tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:50.351986 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-40c52b67-01a4-4fd6-95fd-174fd5151b6f tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:50.361055 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-40c52b67-01a4-4fd6-95fd-174fd5151b6f tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:50.361512 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-40c52b67-01a4-4fd6-95fd-174fd5151b6f tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:50.362304 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-40c52b67-01a4-4fd6-95fd-174fd5151b6f tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:50.362740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-40c52b67-01a4-4fd6-95fd-174fd5151b6f tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:51.009046 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4e321328-e90b-4ad4-a22a-4eca9187676e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:51.020172 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4e321328-e90b-4ad4-a22a-4eca9187676e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:51.021911 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4e321328-e90b-4ad4-a22a-4eca9187676e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:51.023179 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4e321328-e90b-4ad4-a22a-4eca9187676e tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1732 microversion: 2.25 time: 0.793648 Jul 25 14:33:51.023748 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1158/2197] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:50 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1732 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:33:51.029996 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-46122a71-8138-43b6-9f4e-a56430471e72 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:51.031942 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-46122a71-8138-43b6-9f4e-a56430471e72 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 493e0a70-7ee8-498b-83e5-f66f83344edf] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:51.058672 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-46122a71-8138-43b6-9f4e-a56430471e72 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:51.059656 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-46122a71-8138-43b6-9f4e-a56430471e72 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:51.063372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-46122a71-8138-43b6-9f4e-a56430471e72 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:51.064902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-46122a71-8138-43b6-9f4e-a56430471e72 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:51.295669 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-40c52b67-01a4-4fd6-95fd-174fd5151b6f tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:51.312877 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-40c52b67-01a4-4fd6-95fd-174fd5151b6f tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630" status: 200 len: 1270 microversion: 2.1 time: 0.965761 Jul 25 14:33:51.313479 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1040/2198] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:50 2022] GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 => generated 1270 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:33:51.330563 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c63882ec-54f8-4e49-83cf-e7dcf11be1f8 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:51.331644 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c63882ec-54f8-4e49-83cf-e7dcf11be1f8 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: c43e707b-4a9f-48d2-8338-5a680cd51f06] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:51.345020 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c63882ec-54f8-4e49-83cf-e7dcf11be1f8 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:51.345651 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c63882ec-54f8-4e49-83cf-e7dcf11be1f8 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:51.346668 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c63882ec-54f8-4e49-83cf-e7dcf11be1f8 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:51.347303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c63882ec-54f8-4e49-83cf-e7dcf11be1f8 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:51.353115 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:33:51.711949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-46122a71-8138-43b6-9f4e-a56430471e72 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:51.729930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c63882ec-54f8-4e49-83cf-e7dcf11be1f8 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:51.751752 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c63882ec-54f8-4e49-83cf-e7dcf11be1f8 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06" status: 200 len: 1317 microversion: 2.1 time: 0.436623 Jul 25 14:33:51.753783 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1041/2199] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:51 2022] GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06 => generated 1317 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:51.754291 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-46122a71-8138-43b6-9f4e-a56430471e72 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf" status: 200 len: 1321 microversion: 2.1 time: 0.728951 Jul 25 14:33:51.755035 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1159/2200] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:51 2022] GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf => generated 1321 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:51.762370 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-4be9aed6-005a-49ba-83d4-b62ce45d6230 req-06da4feb-96f2-4b88-a0f0-e730ae83f866 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "542ab1a2-380f-4f4f-95ec-5d68eb9bd091", "tag": "872694ab-62cf-4c73-b402-73cf33e40ecb"}, {"server_uuid": "5a4c1f93-ad00-410d-aaa7-726ba1b3a262", "name": "network-vif-deleted", "tag": "7cba35a1-e35c-4a9a-876b-96197f0fb886"}, {"name": "network-changed", "server_uuid": "079ec21d-9dbc-4c93-a119-bf1bd0c06a15", "tag": "a871744f-f765-4b19-88f6-265233dc20a2"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:51.793745 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-4be9aed6-005a-49ba-83d4-b62ce45d6230 req-06da4feb-96f2-4b88-a0f0-e730ae83f866 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:51.794422 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-4be9aed6-005a-49ba-83d4-b62ce45d6230 req-06da4feb-96f2-4b88-a0f0-e730ae83f866 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:51.818093 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-4be9aed6-005a-49ba-83d4-b62ce45d6230 req-06da4feb-96f2-4b88-a0f0-e730ae83f866 service nova] Creating event network-changed:872694ab-62cf-4c73-b402-73cf33e40ecb for instance 542ab1a2-380f-4f4f-95ec-5d68eb9bd091 on n-h2-846435-14 Jul 25 14:33:51.819035 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-4be9aed6-005a-49ba-83d4-b62ce45d6230 req-06da4feb-96f2-4b88-a0f0-e730ae83f866 service nova] Creating event network-vif-deleted:7cba35a1-e35c-4a9a-876b-96197f0fb886 for instance 5a4c1f93-ad00-410d-aaa7-726ba1b3a262 on n-h1-846435-14 Jul 25 14:33:51.819717 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-4be9aed6-005a-49ba-83d4-b62ce45d6230 req-06da4feb-96f2-4b88-a0f0-e730ae83f866 service nova] Creating event network-changed:a871744f-f765-4b19-88f6-265233dc20a2 for instance 079ec21d-9dbc-4c93-a119-bf1bd0c06a15 on n-h1-846435-14 Jul 25 14:33:51.839524 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-4be9aed6-005a-49ba-83d4-b62ce45d6230 req-06da4feb-96f2-4b88-a0f0-e730ae83f866 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.082801 Jul 25 14:33:51.841100 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1042/2201] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:33:52.051369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-68f3dfeb-3ba3-4706-b278-67c153eed382 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:52.052097 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-68f3dfeb-3ba3-4706-b278-67c153eed382 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:52.059341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68f3dfeb-3ba3-4706-b278-67c153eed382 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:52.059906 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68f3dfeb-3ba3-4706-b278-67c153eed382 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:52.060820 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68f3dfeb-3ba3-4706-b278-67c153eed382 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:52.061336 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68f3dfeb-3ba3-4706-b278-67c153eed382 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:52.335155 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-be509ae1-f2fd-457f-90d1-37786b95f2f0 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:52.336478 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-be509ae1-f2fd-457f-90d1-37786b95f2f0 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:52.344569 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-be509ae1-f2fd-457f-90d1-37786b95f2f0 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:52.345018 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-be509ae1-f2fd-457f-90d1-37786b95f2f0 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:52.345962 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-be509ae1-f2fd-457f-90d1-37786b95f2f0 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:52.346402 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-be509ae1-f2fd-457f-90d1-37786b95f2f0 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:52.426613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-be509ae1-f2fd-457f-90d1-37786b95f2f0 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:52.436950 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-be509ae1-f2fd-457f-90d1-37786b95f2f0 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630" status: 200 len: 1270 microversion: 2.1 time: 0.106771 Jul 25 14:33:52.437755 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1043/2202] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:52 2022] GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 => generated 1270 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:33:52.735163 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-68f3dfeb-3ba3-4706-b278-67c153eed382 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:52.749721 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-68f3dfeb-3ba3-4706-b278-67c153eed382 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:52.754112 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-68f3dfeb-3ba3-4706-b278-67c153eed382 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:52.756206 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-68f3dfeb-3ba3-4706-b278-67c153eed382 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1732 microversion: 2.25 time: 0.708617 Jul 25 14:33:52.758586 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1160/2203] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:52 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1732 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:33:52.797254 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2719bbf2-c826-4807-a873-7eafcebdbabd tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:52.798290 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a3fd9548-9c8b-401a-aff4-0e336abe1a72 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:52.799112 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a3fd9548-9c8b-401a-aff4-0e336abe1a72 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: c43e707b-4a9f-48d2-8338-5a680cd51f06] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:52.799907 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2719bbf2-c826-4807-a873-7eafcebdbabd tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 493e0a70-7ee8-498b-83e5-f66f83344edf] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:52.817979 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a3fd9548-9c8b-401a-aff4-0e336abe1a72 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:52.818706 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2719bbf2-c826-4807-a873-7eafcebdbabd tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:52.820790 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a3fd9548-9c8b-401a-aff4-0e336abe1a72 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:52.831272 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2719bbf2-c826-4807-a873-7eafcebdbabd tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:52.834224 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a3fd9548-9c8b-401a-aff4-0e336abe1a72 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:52.834628 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2719bbf2-c826-4807-a873-7eafcebdbabd tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:52.835895 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2719bbf2-c826-4807-a873-7eafcebdbabd tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:52.836474 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a3fd9548-9c8b-401a-aff4-0e336abe1a72 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:52.880076 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:33:53.358987 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a3fd9548-9c8b-401a-aff4-0e336abe1a72 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:53.368988 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a3fd9548-9c8b-401a-aff4-0e336abe1a72 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06" status: 200 len: 1317 microversion: 2.1 time: 0.586420 Jul 25 14:33:53.383955 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1044/2204] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:52 2022] GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06 => generated 1317 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:53.413512 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2719bbf2-c826-4807-a873-7eafcebdbabd tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:53.422313 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2719bbf2-c826-4807-a873-7eafcebdbabd tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf" status: 200 len: 1321 microversion: 2.1 time: 0.639962 Jul 25 14:33:53.426377 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1161/2205] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:52 2022] GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf => generated 1321 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:53.462368 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-99676734-99b6-4fa8-ac30-733762e6249e tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:53.463421 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-99676734-99b6-4fa8-ac30-733762e6249e tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:53.476965 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99676734-99b6-4fa8-ac30-733762e6249e tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:53.477726 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99676734-99b6-4fa8-ac30-733762e6249e tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:53.478811 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99676734-99b6-4fa8-ac30-733762e6249e tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:53.480142 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99676734-99b6-4fa8-ac30-733762e6249e tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:53.494189 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-d8d55e12-1849-4690-aa55-dd5aec09ed06 req-7ca00d48-48c7-43b9-bb0e-2845d2ecde79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "493e0a70-7ee8-498b-83e5-f66f83344edf", "name": "network-vif-plugged", "status": "completed", "tag": "59b7d34a-577f-450a-994b-02cfc971c6f7"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:53.516332 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-d8d55e12-1849-4690-aa55-dd5aec09ed06 req-7ca00d48-48c7-43b9-bb0e-2845d2ecde79 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:53.517019 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-d8d55e12-1849-4690-aa55-dd5aec09ed06 req-7ca00d48-48c7-43b9-bb0e-2845d2ecde79 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:53.579004 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-d8d55e12-1849-4690-aa55-dd5aec09ed06 req-7ca00d48-48c7-43b9-bb0e-2845d2ecde79 service nova] Creating event network-vif-plugged:59b7d34a-577f-450a-994b-02cfc971c6f7 for instance 493e0a70-7ee8-498b-83e5-f66f83344edf on n-h1-846435-14 Jul 25 14:33:53.591449 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-d8d55e12-1849-4690-aa55-dd5aec09ed06 req-7ca00d48-48c7-43b9-bb0e-2845d2ecde79 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103566 Jul 25 14:33:53.592238 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1162/2206] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:33:53.785283 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ac854845-8aa3-4a6e-9d75-ccdc987d4be5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:53.792999 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ac854845-8aa3-4a6e-9d75-ccdc987d4be5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:53.809774 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac854845-8aa3-4a6e-9d75-ccdc987d4be5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:53.813232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac854845-8aa3-4a6e-9d75-ccdc987d4be5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:53.814283 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac854845-8aa3-4a6e-9d75-ccdc987d4be5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:53.817641 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac854845-8aa3-4a6e-9d75-ccdc987d4be5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:53.848795 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-99676734-99b6-4fa8-ac30-733762e6249e tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:53.857203 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-99676734-99b6-4fa8-ac30-733762e6249e tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630" status: 200 len: 1312 microversion: 2.1 time: 0.401267 Jul 25 14:33:53.864889 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1045/2207] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:53 2022] GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 => generated 1312 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:54.218766 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ac854845-8aa3-4a6e-9d75-ccdc987d4be5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:54.229973 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ac854845-8aa3-4a6e-9d75-ccdc987d4be5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:54.233319 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ac854845-8aa3-4a6e-9d75-ccdc987d4be5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:54.235661 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ac854845-8aa3-4a6e-9d75-ccdc987d4be5 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1664 microversion: 2.25 time: 0.457411 Jul 25 14:33:54.238573 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1163/2208] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:53 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1664 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:33:54.390824 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7a318856-c5f2-4b42-af8f-7b1d64ca3d30 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:54.392172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7a318856-c5f2-4b42-af8f-7b1d64ca3d30 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: c43e707b-4a9f-48d2-8338-5a680cd51f06] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:54.399122 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7a318856-c5f2-4b42-af8f-7b1d64ca3d30 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:54.400204 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7a318856-c5f2-4b42-af8f-7b1d64ca3d30 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:54.401475 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7a318856-c5f2-4b42-af8f-7b1d64ca3d30 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:54.402102 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7a318856-c5f2-4b42-af8f-7b1d64ca3d30 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:54.446097 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f6f452a8-dbb9-48e1-b27e-134ad42e473c tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:54.446929 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f6f452a8-dbb9-48e1-b27e-134ad42e473c tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 493e0a70-7ee8-498b-83e5-f66f83344edf] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:54.455554 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6f452a8-dbb9-48e1-b27e-134ad42e473c tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:54.456226 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6f452a8-dbb9-48e1-b27e-134ad42e473c tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:54.457123 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6f452a8-dbb9-48e1-b27e-134ad42e473c tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:54.457655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6f452a8-dbb9-48e1-b27e-134ad42e473c tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:54.963045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f6f452a8-dbb9-48e1-b27e-134ad42e473c tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:54.979589 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f6f452a8-dbb9-48e1-b27e-134ad42e473c tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf" status: 200 len: 1321 microversion: 2.1 time: 0.534764 Jul 25 14:33:54.982042 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1164/2209] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:54 2022] GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf => generated 1321 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:54.993147 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-697ae74d-6af5-452a-9bf7-b3f411f763ef req-a599e248-9a31-4ed4-bbea-6352b7613a47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c", "name": "network-vif-deleted", "tag": "eedb59eb-f3ec-476b-a198-201c579f3456"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:55.027902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-697ae74d-6af5-452a-9bf7-b3f411f763ef req-a599e248-9a31-4ed4-bbea-6352b7613a47 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:55.029277 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-697ae74d-6af5-452a-9bf7-b3f411f763ef req-a599e248-9a31-4ed4-bbea-6352b7613a47 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:55.072629 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-697ae74d-6af5-452a-9bf7-b3f411f763ef req-a599e248-9a31-4ed4-bbea-6352b7613a47 service nova] Creating event network-vif-deleted:eedb59eb-f3ec-476b-a198-201c579f3456 for instance 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c on n-h2-846435-14 Jul 25 14:33:55.082023 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-697ae74d-6af5-452a-9bf7-b3f411f763ef req-a599e248-9a31-4ed4-bbea-6352b7613a47 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098192 Jul 25 14:33:55.084431 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1165/2210] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:33:55.096561 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0b41e515-dc68-4648-b55e-cb90ff293fe9 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:55.097668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0b41e515-dc68-4648-b55e-cb90ff293fe9 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:55.105636 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b41e515-dc68-4648-b55e-cb90ff293fe9 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:55.110625 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7a318856-c5f2-4b42-af8f-7b1d64ca3d30 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:55.116496 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b41e515-dc68-4648-b55e-cb90ff293fe9 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:55.123953 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7a318856-c5f2-4b42-af8f-7b1d64ca3d30 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06" status: 200 len: 1317 microversion: 2.1 time: 0.737303 Jul 25 14:33:55.125043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b41e515-dc68-4648-b55e-cb90ff293fe9 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:55.125737 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b41e515-dc68-4648-b55e-cb90ff293fe9 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:55.129930 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1046/2211] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:54 2022] GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06 => generated 1317 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:55.260040 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-670579ba-a153-4446-9509-c9dd81aea353 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:55.260946 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-670579ba-a153-4446-9509-c9dd81aea353 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:55.282382 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-670579ba-a153-4446-9509-c9dd81aea353 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:55.283793 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-670579ba-a153-4446-9509-c9dd81aea353 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:55.291065 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-670579ba-a153-4446-9509-c9dd81aea353 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:55.294142 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-670579ba-a153-4446-9509-c9dd81aea353 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:55.423540 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-670579ba-a153-4446-9509-c9dd81aea353 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:55.424236 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-670579ba-a153-4446-9509-c9dd81aea353 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:55.426316 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-670579ba-a153-4446-9509-c9dd81aea353 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lazy-loading 'fault' on Instance uuid 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:33:55.581413 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-670579ba-a153-4446-9509-c9dd81aea353 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:55.593632 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-670579ba-a153-4446-9509-c9dd81aea353 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:55.596680 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-670579ba-a153-4446-9509-c9dd81aea353 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:55.599006 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-670579ba-a153-4446-9509-c9dd81aea353 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 200 len: 1375 microversion: 2.25 time: 0.344083 Jul 25 14:33:55.601701 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1047/2212] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:55 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 1375 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:33:55.883448 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0b41e515-dc68-4648-b55e-cb90ff293fe9 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:55.892152 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0b41e515-dc68-4648-b55e-cb90ff293fe9 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630" status: 200 len: 1312 microversion: 2.1 time: 0.805142 Jul 25 14:33:55.898067 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1166/2213] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:55 2022] GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 => generated 1312 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:56.014879 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-aec63ebc-ddbc-4ad3-b775-e33fdfd5bdda tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:56.018838 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-aec63ebc-ddbc-4ad3-b775-e33fdfd5bdda tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 493e0a70-7ee8-498b-83e5-f66f83344edf] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:56.036937 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aec63ebc-ddbc-4ad3-b775-e33fdfd5bdda tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:56.049153 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aec63ebc-ddbc-4ad3-b775-e33fdfd5bdda tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:56.051488 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aec63ebc-ddbc-4ad3-b775-e33fdfd5bdda tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:56.054096 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aec63ebc-ddbc-4ad3-b775-e33fdfd5bdda tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:56.149238 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-aaa556d9-405b-4cb9-8847-23dd72c977d9 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:56.149855 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-aaa556d9-405b-4cb9-8847-23dd72c977d9 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: c43e707b-4a9f-48d2-8338-5a680cd51f06] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:56.159508 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aaa556d9-405b-4cb9-8847-23dd72c977d9 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:56.164720 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aaa556d9-405b-4cb9-8847-23dd72c977d9 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:56.165774 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aaa556d9-405b-4cb9-8847-23dd72c977d9 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:56.166410 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aaa556d9-405b-4cb9-8847-23dd72c977d9 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:56.647927 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-aec63ebc-ddbc-4ad3-b775-e33fdfd5bdda tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:56.659732 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-aec63ebc-ddbc-4ad3-b775-e33fdfd5bdda tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf" status: 200 len: 1321 microversion: 2.1 time: 0.652514 Jul 25 14:33:56.661848 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1048/2214] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:56 2022] GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf => generated 1321 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:56.671126 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8f38eb44-b009-48c0-9447-fc4a35f770c3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:56.671749 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8f38eb44-b009-48c0-9447-fc4a35f770c3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:56.693250 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f38eb44-b009-48c0-9447-fc4a35f770c3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:56.693708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f38eb44-b009-48c0-9447-fc4a35f770c3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:56.694530 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f38eb44-b009-48c0-9447-fc4a35f770c3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:56.694973 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f38eb44-b009-48c0-9447-fc4a35f770c3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:56.729887 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-8f38eb44-b009-48c0-9447-fc4a35f770c3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] HTTP exception thrown: Instance 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c could not be found. Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8f38eb44-b009-48c0-9447-fc4a35f770c3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Request method failure captured: Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c HTTP/1.1 Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qhLhys1-RVNY_YaGf_npt4Z4KJsS5p2XN4AruTf8qUewb9rE4XpUKgQisrocQQqeMtAKoOdmeeflmBSnHF2TZP6D35IBCijfuSNw5WWc9aPp3krfOSwqRap_JaduPaA1FUwutai5h24FHDHo9d0VUQIMA_69Md-gnXmGVpnXGjrxd8 Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: X-Openstack-Nova-Api-Version: 2.25 Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: fb2b9ba0bede403bafb665d5e0818dfb Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1229899115 Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fb2b9ba0bede403bafb665d5e0818dfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fb2b9ba0bede403bafb665d5e0818dfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_fb2b9ba0bede403bafb665d5e0818dfb", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/fb2b9ba0bede403bafb665d5e0818dfb"}]}] Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1229899115 Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: fb2b9ba0bede403bafb665d5e0818dfb Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1229899115 Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-LiveAutoBlockMigrationV225Test-1229899115-project Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 94b57069a56c4fedb1d4546c1d0415c7 Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1229899115-project Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c could not be found. Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c'} Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c could not be found. Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c could not be found. Jul 25 14:33:56.731909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:33:56.735812 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:33:56.735812 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:33:56.735812 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:33:56.735812 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:33:56.735812 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:33:56.735812 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:33:56.735812 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:33:56.735812 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c could not be found. Jul 25 14:33:56.735812 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:33:56.739737 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8f38eb44-b009-48c0-9447-fc4a35f770c3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Returning 404 to user: Instance 395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:33:56.740890 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8f38eb44-b009-48c0-9447-fc4a35f770c3 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c" status: 404 len: 111 microversion: 2.25 time: 0.077977 Jul 25 14:33:56.746762 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1049/2215] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:56 2022] GET /compute/v2.1/servers/395a80a5-f7e6-4e9c-830f-5ac45dbbbd2c => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:33:56.758218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b082edfe-d5bc-46c7-9a53-d21d9e21046d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '.version_select at 0x7f46987e0280>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:56.792450 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-aaa556d9-405b-4cb9-8847-23dd72c977d9 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:56.804360 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b082edfe-d5bc-46c7-9a53-d21d9e21046d tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1860089630" status: 204 len: 0 microversion: 2.25 time: 0.053618 Jul 25 14:33:56.807295 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1050/2216] 10.222.0.88 () {60 vars in 1262 bytes} [Mon Jul 25 14:33:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1860089630 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 14:33:56.809079 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-aaa556d9-405b-4cb9-8847-23dd72c977d9 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06" status: 200 len: 1317 microversion: 2.1 time: 0.658659 Jul 25 14:33:56.824406 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1167/2217] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:56 2022] GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06 => generated 1317 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:33:56.928766 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2f061df8-c5f7-40e4-94eb-5aba82acad09 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:56.929426 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2f061df8-c5f7-40e4-94eb-5aba82acad09 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:56.941009 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f061df8-c5f7-40e4-94eb-5aba82acad09 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:56.943328 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f061df8-c5f7-40e4-94eb-5aba82acad09 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:56.944339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f061df8-c5f7-40e4-94eb-5aba82acad09 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:56.945904 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f061df8-c5f7-40e4-94eb-5aba82acad09 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:57.435915 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:33:57.518918 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2f061df8-c5f7-40e4-94eb-5aba82acad09 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:57.528690 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2f061df8-c5f7-40e4-94eb-5aba82acad09 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630" status: 200 len: 1333 microversion: 2.1 time: 0.603199 Jul 25 14:33:57.547279 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1051/2218] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:56 2022] GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 => generated 1333 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:57.681339 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d052bca1-292a-4438-be64-7c50b05971f8 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:57.682828 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d052bca1-292a-4438-be64-7c50b05971f8 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 493e0a70-7ee8-498b-83e5-f66f83344edf] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:57.718137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d052bca1-292a-4438-be64-7c50b05971f8 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:57.718832 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d052bca1-292a-4438-be64-7c50b05971f8 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:57.719837 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d052bca1-292a-4438-be64-7c50b05971f8 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:57.720441 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d052bca1-292a-4438-be64-7c50b05971f8 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:57.839139 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ab0436e2-0894-4c8a-a1c7-10c81cde41c7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:57.839791 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ab0436e2-0894-4c8a-a1c7-10c81cde41c7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: c43e707b-4a9f-48d2-8338-5a680cd51f06] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:57.854109 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab0436e2-0894-4c8a-a1c7-10c81cde41c7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:57.854587 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab0436e2-0894-4c8a-a1c7-10c81cde41c7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:57.858700 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab0436e2-0894-4c8a-a1c7-10c81cde41c7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:57.860818 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab0436e2-0894-4c8a-a1c7-10c81cde41c7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:58.079825 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=8 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:33:58.225165 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ab0436e2-0894-4c8a-a1c7-10c81cde41c7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:58.239456 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ab0436e2-0894-4c8a-a1c7-10c81cde41c7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06" status: 200 len: 1317 microversion: 2.1 time: 0.406687 Jul 25 14:33:58.240178 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1052/2219] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:57 2022] GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06 => generated 1317 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:58.298094 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d052bca1-292a-4438-be64-7c50b05971f8 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:58.308261 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d052bca1-292a-4438-be64-7c50b05971f8 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf" status: 200 len: 1511 microversion: 2.1 time: 0.630988 Jul 25 14:33:58.313021 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1168/2220] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:57 2022] GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf => generated 1511 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:58.334163 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-28d776a5-557e-4169-a6d0-c7ea1780ac1b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:58.334913 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-28d776a5-557e-4169-a6d0-c7ea1780ac1b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 542ab1a2-380f-4f4f-95ec-5d68eb9bd091] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:58.345572 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-28d776a5-557e-4169-a6d0-c7ea1780ac1b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:58.352259 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-04004939-d5ae-4300-bcaa-2fc94117b810 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:58.352978 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-04004939-d5ae-4300-bcaa-2fc94117b810 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:58.356817 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-28d776a5-557e-4169-a6d0-c7ea1780ac1b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:58.360441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-28d776a5-557e-4169-a6d0-c7ea1780ac1b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:58.361090 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-28d776a5-557e-4169-a6d0-c7ea1780ac1b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:58.362082 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-04004939-d5ae-4300-bcaa-2fc94117b810 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:58.365581 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-04004939-d5ae-4300-bcaa-2fc94117b810 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:58.366603 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-04004939-d5ae-4300-bcaa-2fc94117b810 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:58.367288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-04004939-d5ae-4300-bcaa-2fc94117b810 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:58.453241 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-04004939-d5ae-4300-bcaa-2fc94117b810 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:33:58.646125 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-04004939-d5ae-4300-bcaa-2fc94117b810 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 204 len: 0 microversion: 2.25 time: 0.297103 Jul 25 14:33:58.660804 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1169/2221] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Jul 25 14:33:58 2022] DELETE /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 25 14:33:58.682231 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-a27492fd-62f9-4157-9666-f5c6b47b8cf5 req-dca4555b-939e-4c1c-b1b5-b2018b59bbab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c43e707b-4a9f-48d2-8338-5a680cd51f06", "name": "network-vif-plugged", "status": "completed", "tag": "ecff7cc7-d9a7-4dd6-b23b-de594526b420"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:33:58.696806 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-28d776a5-557e-4169-a6d0-c7ea1780ac1b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:58.699840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a27492fd-62f9-4157-9666-f5c6b47b8cf5 req-dca4555b-939e-4c1c-b1b5-b2018b59bbab service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:58.700881 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a27492fd-62f9-4157-9666-f5c6b47b8cf5 req-dca4555b-939e-4c1c-b1b5-b2018b59bbab service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:58.709114 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-28d776a5-557e-4169-a6d0-c7ea1780ac1b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091" status: 200 len: 1321 microversion: 2.1 time: 0.379964 Jul 25 14:33:58.710365 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1053/2222] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:58 2022] GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091 => generated 1321 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:58.715616 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6d88b237-9bfb-4fe8-825a-bfc5c2b3a5c5 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:58.717680 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6d88b237-9bfb-4fe8-825a-bfc5c2b3a5c5 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:58.725236 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6d88b237-9bfb-4fe8-825a-bfc5c2b3a5c5 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:58.726566 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6d88b237-9bfb-4fe8-825a-bfc5c2b3a5c5 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:58.727560 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6d88b237-9bfb-4fe8-825a-bfc5c2b3a5c5 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:58.728272 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6d88b237-9bfb-4fe8-825a-bfc5c2b3a5c5 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:58.732332 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-a27492fd-62f9-4157-9666-f5c6b47b8cf5 req-dca4555b-939e-4c1c-b1b5-b2018b59bbab service nova] Creating event network-vif-plugged:ecff7cc7-d9a7-4dd6-b23b-de594526b420 for instance c43e707b-4a9f-48d2-8338-5a680cd51f06 on n-h1-846435-14 Jul 25 14:33:58.737461 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-a27492fd-62f9-4157-9666-f5c6b47b8cf5 req-dca4555b-939e-4c1c-b1b5-b2018b59bbab service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074794 Jul 25 14:33:58.738508 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1170/2223] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:33:58.746796 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-85f1f950-6c4e-41de-a270-673bd0f961ba tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:58.747504 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-85f1f950-6c4e-41de-a270-673bd0f961ba tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:58.755931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-85f1f950-6c4e-41de-a270-673bd0f961ba tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:58.756690 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-85f1f950-6c4e-41de-a270-673bd0f961ba tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:58.757614 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-85f1f950-6c4e-41de-a270-673bd0f961ba tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:58.758191 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-85f1f950-6c4e-41de-a270-673bd0f961ba tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:59.091249 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6d88b237-9bfb-4fe8-825a-bfc5c2b3a5c5 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:59.115694 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6d88b237-9bfb-4fe8-825a-bfc5c2b3a5c5 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630" status: 200 len: 1333 microversion: 2.1 time: 0.403892 Jul 25 14:33:59.129794 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1054/2224] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:58 2022] GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 => generated 1333 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:33:59.261939 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-16e01376-fc82-4254-8b5d-2a8920a73815 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:59.263391 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-16e01376-fc82-4254-8b5d-2a8920a73815 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: c43e707b-4a9f-48d2-8338-5a680cd51f06] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:59.270223 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-16e01376-fc82-4254-8b5d-2a8920a73815 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:59.270986 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-16e01376-fc82-4254-8b5d-2a8920a73815 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:59.271963 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-16e01376-fc82-4254-8b5d-2a8920a73815 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:59.272925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-16e01376-fc82-4254-8b5d-2a8920a73815 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:59.451502 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-16e01376-fc82-4254-8b5d-2a8920a73815 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:59.461296 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-16e01376-fc82-4254-8b5d-2a8920a73815 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06" status: 200 len: 1317 microversion: 2.1 time: 0.204247 Jul 25 14:33:59.472137 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1055/2225] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:59 2022] GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06 => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:33:59.472350 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-85f1f950-6c4e-41de-a270-673bd0f961ba tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:59.476910 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-85f1f950-6c4e-41de-a270-673bd0f961ba tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:59.478463 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-85f1f950-6c4e-41de-a270-673bd0f961ba tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:59.479757 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-85f1f950-6c4e-41de-a270-673bd0f961ba tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 200 len: 1549 microversion: 2.25 time: 0.739468 Jul 25 14:33:59.480853 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1171/2226] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:33:58 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 1549 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:33:59.736145 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-604ef17c-8916-496f-b39a-322d2bcdb06a tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:33:59.737440 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-604ef17c-8916-496f-b39a-322d2bcdb06a tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 542ab1a2-380f-4f4f-95ec-5d68eb9bd091] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:33:59.750267 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-604ef17c-8916-496f-b39a-322d2bcdb06a tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:59.751203 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-604ef17c-8916-496f-b39a-322d2bcdb06a tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:59.752646 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-604ef17c-8916-496f-b39a-322d2bcdb06a tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:33:59.753288 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-604ef17c-8916-496f-b39a-322d2bcdb06a tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:33:59.919057 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-604ef17c-8916-496f-b39a-322d2bcdb06a tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:33:59.929656 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-604ef17c-8916-496f-b39a-322d2bcdb06a tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091" status: 200 len: 1321 microversion: 2.1 time: 0.201129 Jul 25 14:33:59.930243 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1056/2227] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:33:59 2022] GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091 => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:00.140876 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bbabeb7c-54b4-4f4b-b3e7-b8866d6bdd34 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:00.141563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bbabeb7c-54b4-4f4b-b3e7-b8866d6bdd34 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:00.149402 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bbabeb7c-54b4-4f4b-b3e7-b8866d6bdd34 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:00.149786 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bbabeb7c-54b4-4f4b-b3e7-b8866d6bdd34 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:00.150633 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bbabeb7c-54b4-4f4b-b3e7-b8866d6bdd34 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:00.151228 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bbabeb7c-54b4-4f4b-b3e7-b8866d6bdd34 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:00.483032 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5a1e103a-2497-4d0a-8a2c-f6e11987e311 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:00.483653 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5a1e103a-2497-4d0a-8a2c-f6e11987e311 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: c43e707b-4a9f-48d2-8338-5a680cd51f06] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:00.491765 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5a1e103a-2497-4d0a-8a2c-f6e11987e311 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:00.492319 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5a1e103a-2497-4d0a-8a2c-f6e11987e311 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:00.493102 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5a1e103a-2497-4d0a-8a2c-f6e11987e311 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:00.493538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5a1e103a-2497-4d0a-8a2c-f6e11987e311 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:00.656381 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bbabeb7c-54b4-4f4b-b3e7-b8866d6bdd34 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:00.657937 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5a1e103a-2497-4d0a-8a2c-f6e11987e311 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:00.672044 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bbabeb7c-54b4-4f4b-b3e7-b8866d6bdd34 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630" status: 200 len: 1333 microversion: 2.1 time: 0.535078 Jul 25 14:34:00.674441 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5a1e103a-2497-4d0a-8a2c-f6e11987e311 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06" status: 200 len: 1317 microversion: 2.1 time: 0.195980 Jul 25 14:34:00.675046 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1057/2228] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:00 2022] GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06 => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:00.676788 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1172/2229] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:00 2022] GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 => generated 1333 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:00.680445 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-95a235e0-ff09-4867-9d22-4b4c1716c20b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:00.681280 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-95a235e0-ff09-4867-9d22-4b4c1716c20b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:00.688272 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-95a235e0-ff09-4867-9d22-4b4c1716c20b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:00.689086 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-95a235e0-ff09-4867-9d22-4b4c1716c20b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:00.690233 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-95a235e0-ff09-4867-9d22-4b4c1716c20b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:00.690937 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-95a235e0-ff09-4867-9d22-4b4c1716c20b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:00.775959 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-7338bcc7-b0fa-4fbd-901e-1eb9b967a0e6 req-a98f6326-3b72-41a1-a459-a52de8af8f45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "542ab1a2-380f-4f4f-95ec-5d68eb9bd091", "name": "network-vif-plugged", "status": "completed", "tag": "872694ab-62cf-4c73-b402-73cf33e40ecb"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:00.794421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-7338bcc7-b0fa-4fbd-901e-1eb9b967a0e6 req-a98f6326-3b72-41a1-a459-a52de8af8f45 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:00.795067 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-7338bcc7-b0fa-4fbd-901e-1eb9b967a0e6 req-a98f6326-3b72-41a1-a459-a52de8af8f45 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:00.809543 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-7338bcc7-b0fa-4fbd-901e-1eb9b967a0e6 req-a98f6326-3b72-41a1-a459-a52de8af8f45 service nova] Creating event network-vif-plugged:872694ab-62cf-4c73-b402-73cf33e40ecb for instance 542ab1a2-380f-4f4f-95ec-5d68eb9bd091 on n-h2-846435-14 Jul 25 14:34:00.815185 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-7338bcc7-b0fa-4fbd-901e-1eb9b967a0e6 req-a98f6326-3b72-41a1-a459-a52de8af8f45 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042901 Jul 25 14:34:00.816364 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1173/2230] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:34:00.866051 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-95a235e0-ff09-4867-9d22-4b4c1716c20b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:00.875363 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-95a235e0-ff09-4867-9d22-4b4c1716c20b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:00.878953 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-95a235e0-ff09-4867-9d22-4b4c1716c20b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:00.880825 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-95a235e0-ff09-4867-9d22-4b4c1716c20b tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 200 len: 1549 microversion: 2.25 time: 0.204379 Jul 25 14:34:00.889448 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1058/2231] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:34:00 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 1549 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:34:00.953852 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-01c59c89-337a-4628-a7f4-0ce23b58160d tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:00.955418 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-01c59c89-337a-4628-a7f4-0ce23b58160d tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 542ab1a2-380f-4f4f-95ec-5d68eb9bd091] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:00.967568 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01c59c89-337a-4628-a7f4-0ce23b58160d tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:00.969501 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01c59c89-337a-4628-a7f4-0ce23b58160d tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:00.970683 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01c59c89-337a-4628-a7f4-0ce23b58160d tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:00.977699 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01c59c89-337a-4628-a7f4-0ce23b58160d tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:01.039184 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-64e2dbef-238a-4e8d-b9b6-37740793cdbb req-f37bb34a-7d3d-41a4-a5c1-68846a928c35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9982c70-c715-4959-b9a9-fee30117751b", "name": "network-vif-deleted", "tag": "7a86088b-678c-4fae-8f85-06963cf768fa"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:01.064825 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-64e2dbef-238a-4e8d-b9b6-37740793cdbb req-f37bb34a-7d3d-41a4-a5c1-68846a928c35 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:01.065579 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-64e2dbef-238a-4e8d-b9b6-37740793cdbb req-f37bb34a-7d3d-41a4-a5c1-68846a928c35 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:01.082124 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-64e2dbef-238a-4e8d-b9b6-37740793cdbb req-f37bb34a-7d3d-41a4-a5c1-68846a928c35 service nova] Creating event network-vif-deleted:7a86088b-678c-4fae-8f85-06963cf768fa for instance c9982c70-c715-4959-b9a9-fee30117751b on n-h2-846435-14 Jul 25 14:34:01.090917 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-64e2dbef-238a-4e8d-b9b6-37740793cdbb req-f37bb34a-7d3d-41a4-a5c1-68846a928c35 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056692 Jul 25 14:34:01.092093 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1059/2232] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:34:01.705568 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b6e7b598-388c-4714-9876-a9a16fb75f8f tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:01.707340 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b6e7b598-388c-4714-9876-a9a16fb75f8f tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:01.716580 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b6e7b598-388c-4714-9876-a9a16fb75f8f tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:01.717291 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b6e7b598-388c-4714-9876-a9a16fb75f8f tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:01.718202 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b6e7b598-388c-4714-9876-a9a16fb75f8f tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:01.718767 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b6e7b598-388c-4714-9876-a9a16fb75f8f tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:01.758430 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:34:01.892075 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-01c59c89-337a-4628-a7f4-0ce23b58160d tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:01.903272 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-01c59c89-337a-4628-a7f4-0ce23b58160d tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091" status: 200 len: 1321 microversion: 2.1 time: 0.955174 Jul 25 14:34:01.923043 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1174/2233] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:00 2022] GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091 => generated 1321 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:01.934663 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4fcfc9ea-905d-4d58-944a-e63ae378213f tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:01.940432 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4fcfc9ea-905d-4d58-944a-e63ae378213f tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: c43e707b-4a9f-48d2-8338-5a680cd51f06] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:01.961261 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4fcfc9ea-905d-4d58-944a-e63ae378213f tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:01.961802 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4fcfc9ea-905d-4d58-944a-e63ae378213f tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:01.967584 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4fcfc9ea-905d-4d58-944a-e63ae378213f tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:01.971910 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b6e7b598-388c-4714-9876-a9a16fb75f8f tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:01.981918 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b6e7b598-388c-4714-9876-a9a16fb75f8f tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630" status: 200 len: 1333 microversion: 2.1 time: 0.287578 Jul 25 14:34:01.982712 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4fcfc9ea-905d-4d58-944a-e63ae378213f tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:01.987609 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1060/2234] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:01 2022] GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 => generated 1333 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:01.993727 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4246a1a2-212e-418a-9d03-842df3bc22d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:01.994734 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4246a1a2-212e-418a-9d03-842df3bc22d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:02.020014 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4246a1a2-212e-418a-9d03-842df3bc22d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:02.022642 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4246a1a2-212e-418a-9d03-842df3bc22d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:02.024141 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4246a1a2-212e-418a-9d03-842df3bc22d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:02.024795 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4246a1a2-212e-418a-9d03-842df3bc22d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:02.098134 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4246a1a2-212e-418a-9d03-842df3bc22d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:02.098689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4246a1a2-212e-418a-9d03-842df3bc22d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:02.099214 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-4246a1a2-212e-418a-9d03-842df3bc22d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lazy-loading 'fault' on Instance uuid c9982c70-c715-4959-b9a9-fee30117751b {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:34:02.144728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4246a1a2-212e-418a-9d03-842df3bc22d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:02.154078 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4246a1a2-212e-418a-9d03-842df3bc22d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:02.156610 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4246a1a2-212e-418a-9d03-842df3bc22d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:02.157990 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4246a1a2-212e-418a-9d03-842df3bc22d8 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 200 len: 1352 microversion: 2.25 time: 0.168009 Jul 25 14:34:02.159135 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1061/2235] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:34:01 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 1352 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:34:02.334281 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4fcfc9ea-905d-4d58-944a-e63ae378213f tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:02.350382 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4fcfc9ea-905d-4d58-944a-e63ae378213f tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06" status: 200 len: 1467 microversion: 2.1 time: 0.421857 Jul 25 14:34:02.352244 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1175/2236] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:01 2022] GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06 => generated 1467 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:02.373962 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-327d9d23-3d12-49fc-813d-b8da6a8e72cd tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:02.374794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-327d9d23-3d12-49fc-813d-b8da6a8e72cd tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] [instance: c43e707b-4a9f-48d2-8338-5a680cd51f06] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:02.376753 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:34:02.391918 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-327d9d23-3d12-49fc-813d-b8da6a8e72cd tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:02.392582 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-327d9d23-3d12-49fc-813d-b8da6a8e72cd tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:02.393415 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-327d9d23-3d12-49fc-813d-b8da6a8e72cd tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:02.393855 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-327d9d23-3d12-49fc-813d-b8da6a8e72cd tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:02.724186 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-327d9d23-3d12-49fc-813d-b8da6a8e72cd tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06" status: 200 len: 1620 microversion: 2.1 time: 0.352740 Jul 25 14:34:02.725969 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1062/2237] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:02 2022] GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06 => generated 1620 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:02.942545 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-34149fbd-d09b-46f8-a217-67438a053161 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1082657050", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "155a4d7b-56bb-473f-8cde-ec8bf5aff653"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:02.992880 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6f5755b3-187b-4110-b32b-f35cf8606b45 tempest-ExtensionsTest-1620301037 tempest-ExtensionsTest-1620301037-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:02.994807 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6f5755b3-187b-4110-b32b-f35cf8606b45 tempest-ExtensionsTest-1620301037 tempest-ExtensionsTest-1620301037-project] 10.222.0.88 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.267688 Jul 25 14:34:02.995584 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1063/2238] 10.222.0.88 () {58 vars in 1170 bytes} [Mon Jul 25 14:34:02 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:34:03.006618 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-88fc5f27-9633-4a0d-b849-0deeb47e82a3 req-11d4e36f-4da0-4b0e-aac2-9ccd0de60c5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "079ec21d-9dbc-4c93-a119-bf1bd0c06a15", "name": "network-vif-plugged", "status": "completed", "tag": "a871744f-f765-4b19-88f6-265233dc20a2"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:03.029201 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-88fc5f27-9633-4a0d-b849-0deeb47e82a3 req-11d4e36f-4da0-4b0e-aac2-9ccd0de60c5f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:03.029989 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-88fc5f27-9633-4a0d-b849-0deeb47e82a3 req-11d4e36f-4da0-4b0e-aac2-9ccd0de60c5f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:03.050560 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-88fc5f27-9633-4a0d-b849-0deeb47e82a3 req-11d4e36f-4da0-4b0e-aac2-9ccd0de60c5f service nova] Creating event network-vif-plugged:a871744f-f765-4b19-88f6-265233dc20a2 for instance 079ec21d-9dbc-4c93-a119-bf1bd0c06a15 on n-h1-846435-14 Jul 25 14:34:03.053679 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-34149fbd-d09b-46f8-a217-67438a053161 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] validate_networks() for [('155a4d7b-56bb-473f-8cde-ec8bf5aff653', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:34:03.066688 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-88fc5f27-9633-4a0d-b849-0deeb47e82a3 req-11d4e36f-4da0-4b0e-aac2-9ccd0de60c5f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069628 Jul 25 14:34:03.068699 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1064/2239] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:34:03.077983 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-16bfed9f-cd1b-48b9-a694-dd2bfbd2c31b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:03.078725 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-16bfed9f-cd1b-48b9-a694-dd2bfbd2c31b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 542ab1a2-380f-4f4f-95ec-5d68eb9bd091] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:03.089583 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-16bfed9f-cd1b-48b9-a694-dd2bfbd2c31b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:03.092423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-16bfed9f-cd1b-48b9-a694-dd2bfbd2c31b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:03.094198 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-16bfed9f-cd1b-48b9-a694-dd2bfbd2c31b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:03.094656 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-16bfed9f-cd1b-48b9-a694-dd2bfbd2c31b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:03.340468 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-16bfed9f-cd1b-48b9-a694-dd2bfbd2c31b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:03.349690 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-16bfed9f-cd1b-48b9-a694-dd2bfbd2c31b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091" status: 200 len: 1511 microversion: 2.1 time: 0.278970 Jul 25 14:34:03.351574 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1065/2240] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:03 2022] GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091 => generated 1511 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:03.356738 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7f2d0c48-2b43-46a2-ad43-b00c5f3da97e tempest-ExtensionsTest-1620301037 tempest-ExtensionsTest-1620301037-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:03.359175 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7f2d0c48-2b43-46a2-ad43-b00c5f3da97e tempest-ExtensionsTest-1620301037 tempest-ExtensionsTest-1620301037-project] 10.222.0.88 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006381 Jul 25 14:34:03.360487 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1066/2241] 10.222.0.88 () {58 vars in 1134 bytes} [Mon Jul 25 14:34:03 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:34:03.364946 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b8adcd97-ccee-4d68-9c57-52848ce0ea2a tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:03.372631 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b8adcd97-ccee-4d68-9c57-52848ce0ea2a tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:03.381583 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8adcd97-ccee-4d68-9c57-52848ce0ea2a tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:03.384403 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8adcd97-ccee-4d68-9c57-52848ce0ea2a tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:03.385537 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8adcd97-ccee-4d68-9c57-52848ce0ea2a tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:03.386226 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8adcd97-ccee-4d68-9c57-52848ce0ea2a tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:03.652073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b8adcd97-ccee-4d68-9c57-52848ce0ea2a tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:03.684057 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b8adcd97-ccee-4d68-9c57-52848ce0ea2a tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630" status: 200 len: 1333 microversion: 2.1 time: 0.321839 Jul 25 14:34:03.685878 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1067/2242] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:03 2022] GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 => generated 1333 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:03.700505 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1ec5b0bb-71f2-4313-97b4-4257df696fe7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-505531040", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["1a97e112-b45b-4dcb-ad9f-e979e5c183d9"]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:03.791968 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-1ec5b0bb-71f2-4313-97b4-4257df696fe7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] validate_networks() for None {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:34:04.048525 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-34149fbd-d09b-46f8-a217-67438a053161 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:34:04.050337 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-34149fbd-d09b-46f8-a217-67438a053161 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:34:04.052224 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-34149fbd-d09b-46f8-a217-67438a053161 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:34:04.053010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-34149fbd-d09b-46f8-a217-67438a053161 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:34:04.053567 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-34149fbd-d09b-46f8-a217-67438a053161 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:34:04.076622 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-34149fbd-d09b-46f8-a217-67438a053161 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:04.077643 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-34149fbd-d09b-46f8-a217-67438a053161 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:04.079326 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-34149fbd-d09b-46f8-a217-67438a053161 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:04.081051 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-34149fbd-d09b-46f8-a217-67438a053161 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:04.124552 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-34149fbd-d09b-46f8-a217-67438a053161 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Getting quotas for project bfd6aafe78cf4d38afff08ccedef2e51. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:34:04.133373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-34149fbd-d09b-46f8-a217-67438a053161 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Getting quotas for user 5313f5231c864414b7469dae709aa6da and project bfd6aafe78cf4d38afff08ccedef2e51. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:34:04.186124 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-34149fbd-d09b-46f8-a217-67438a053161 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:34:04.189377 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-34149fbd-d09b-46f8-a217-67438a053161 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] [instance: 6993d89b-7a38-42d9-b4ec-cab1a476d4d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:34:04.295900 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-34149fbd-d09b-46f8-a217-67438a053161 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.912712 Jul 25 14:34:04.297140 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1176/2243] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:34:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 14:34:04.315575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-478abaf5-6f6c-4073-b5a8-ac1e287b76b1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:04.318309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-478abaf5-6f6c-4073-b5a8-ac1e287b76b1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: c9982c70-c715-4959-b9a9-fee30117751b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:04.327265 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-478abaf5-6f6c-4073-b5a8-ac1e287b76b1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:04.327878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-478abaf5-6f6c-4073-b5a8-ac1e287b76b1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:04.329005 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-478abaf5-6f6c-4073-b5a8-ac1e287b76b1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:04.329600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-478abaf5-6f6c-4073-b5a8-ac1e287b76b1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:04.344630 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-478abaf5-6f6c-4073-b5a8-ac1e287b76b1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] HTTP exception thrown: Instance c9982c70-c715-4959-b9a9-fee30117751b could not be found. Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-478abaf5-6f6c-4073-b5a8-ac1e287b76b1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Request method failure captured: Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b HTTP/1.1 Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qhLhys1-RVNY_YaGf_npt4Z4KJsS5p2XN4AruTf8qUewb9rE4XpUKgQisrocQQqeMtAKoOdmeeflmBSnHF2TZP6D35IBCijfuSNw5WWc9aPp3krfOSwqRap_JaduPaA1FUwutai5h24FHDHo9d0VUQIMA_69Md-gnXmGVpnXGjrxd8 Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: X-Openstack-Nova-Api-Version: 2.25 Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: fb2b9ba0bede403bafb665d5e0818dfb Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1229899115 Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fb2b9ba0bede403bafb665d5e0818dfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fb2b9ba0bede403bafb665d5e0818dfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_fb2b9ba0bede403bafb665d5e0818dfb", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/fb2b9ba0bede403bafb665d5e0818dfb"}]}] Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1229899115 Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: fb2b9ba0bede403bafb665d5e0818dfb Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1229899115 Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-LiveAutoBlockMigrationV225Test-1229899115-project Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 94b57069a56c4fedb1d4546c1d0415c7 Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1229899115-project Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance c9982c70-c715-4959-b9a9-fee30117751b could not be found. Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'c9982c70-c715-4959-b9a9-fee30117751b'} Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9982c70-c715-4959-b9a9-fee30117751b could not be found. Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9982c70-c715-4959-b9a9-fee30117751b could not be found. Jul 25 14:34:04.346407 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:04.350650 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:34:04.350650 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:04.350650 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:04.350650 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:34:04.350650 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:34:04.350650 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:34:04.350650 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:34:04.350650 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9982c70-c715-4959-b9a9-fee30117751b could not be found. Jul 25 14:34:04.350650 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:04.350650 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-478abaf5-6f6c-4073-b5a8-ac1e287b76b1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Returning 404 to user: Instance c9982c70-c715-4959-b9a9-fee30117751b could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:34:04.350650 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-478abaf5-6f6c-4073-b5a8-ac1e287b76b1 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b" status: 404 len: 111 microversion: 2.25 time: 0.049722 Jul 25 14:34:04.351957 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1177/2244] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:34:04 2022] GET /compute/v2.1/servers/c9982c70-c715-4959-b9a9-fee30117751b => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:34:04.375393 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-5d6c5311-870b-4924-a9f1-0159e80ed35f req-38f5f5dd-af82-4965-a9db-7a72e1e7db03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1152d383-447a-4ffb-80b7-9b5f2b816630", "tag": "e9c737db-06e2-4826-83a4-996006b99e6d"}, {"name": "network-changed", "server_uuid": "1152d383-447a-4ffb-80b7-9b5f2b816630", "tag": "ebcf73c2-ddd3-4578-8aac-087c5351795f"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:04.401950 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-5d6c5311-870b-4924-a9f1-0159e80ed35f req-38f5f5dd-af82-4965-a9db-7a72e1e7db03 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:04.402713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-5d6c5311-870b-4924-a9f1-0159e80ed35f req-38f5f5dd-af82-4965-a9db-7a72e1e7db03 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:04.436876 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-5d6c5311-870b-4924-a9f1-0159e80ed35f req-38f5f5dd-af82-4965-a9db-7a72e1e7db03 service nova] Creating event network-changed:e9c737db-06e2-4826-83a4-996006b99e6d for instance 1152d383-447a-4ffb-80b7-9b5f2b816630 on n-h2-846435-14 Jul 25 14:34:04.437399 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-5d6c5311-870b-4924-a9f1-0159e80ed35f req-38f5f5dd-af82-4965-a9db-7a72e1e7db03 service nova] Creating event network-changed:ebcf73c2-ddd3-4578-8aac-087c5351795f for instance 1152d383-447a-4ffb-80b7-9b5f2b816630 on n-h2-846435-14 Jul 25 14:34:04.458263 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-5d6c5311-870b-4924-a9f1-0159e80ed35f req-38f5f5dd-af82-4965-a9db-7a72e1e7db03 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.087795 Jul 25 14:34:04.459182 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1178/2245] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:34:04.469381 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e2d70ec4-aacd-402d-ac4a-802df2b88599 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:04.475089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e2d70ec4-aacd-402d-ac4a-802df2b88599 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 079ec21d-9dbc-4c93-a119-bf1bd0c06a15] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:04.485704 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-1ec5b0bb-71f2-4313-97b4-4257df696fe7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:34:04.485969 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-1ec5b0bb-71f2-4313-97b4-4257df696fe7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:34:04.486446 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-1ec5b0bb-71f2-4313-97b4-4257df696fe7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:34:04.486855 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-1ec5b0bb-71f2-4313-97b4-4257df696fe7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:34:04.487267 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-1ec5b0bb-71f2-4313-97b4-4257df696fe7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:34:04.500872 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2d70ec4-aacd-402d-ac4a-802df2b88599 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:04.501318 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2d70ec4-aacd-402d-ac4a-802df2b88599 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:04.502114 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2d70ec4-aacd-402d-ac4a-802df2b88599 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:04.502546 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2d70ec4-aacd-402d-ac4a-802df2b88599 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:04.503577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ec5b0bb-71f2-4313-97b4-4257df696fe7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:04.504139 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ec5b0bb-71f2-4313-97b4-4257df696fe7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:04.507664 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ec5b0bb-71f2-4313-97b4-4257df696fe7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:04.509484 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ec5b0bb-71f2-4313-97b4-4257df696fe7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:04.585312 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-1ec5b0bb-71f2-4313-97b4-4257df696fe7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for project e60b88c2aea642658a5bfc14780d5d51. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:34:04.592366 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-1ec5b0bb-71f2-4313-97b4-4257df696fe7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for user ef351be3886949f9985b3244301435a9 and project e60b88c2aea642658a5bfc14780d5d51. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:34:04.610544 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1ec5b0bb-71f2-4313-97b4-4257df696fe7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:34:04.613875 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1ec5b0bb-71f2-4313-97b4-4257df696fe7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 6de04885-8bb7-4d85-b292-ef576bb3fcf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:34:04.700120 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1ec5b0bb-71f2-4313-97b4-4257df696fe7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.013705 Jul 25 14:34:04.719128 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1068/2246] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:34:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:34:04.725829 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-090ff5ce-5160-4e4c-8d2b-aeb4ff383d9a tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:04.727737 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-090ff5ce-5160-4e4c-8d2b-aeb4ff383d9a tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] [instance: 6993d89b-7a38-42d9-b4ec-cab1a476d4d1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:04.829059 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e2d70ec4-aacd-402d-ac4a-802df2b88599 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:04.840378 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e2d70ec4-aacd-402d-ac4a-802df2b88599 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/079ec21d-9dbc-4c93-a119-bf1bd0c06a15" status: 200 len: 1321 microversion: 2.1 time: 0.379314 Jul 25 14:34:04.852300 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1179/2247] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:04 2022] GET /compute/v2.1/servers/079ec21d-9dbc-4c93-a119-bf1bd0c06a15 => generated 1321 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:04.859755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f150c9f7-6936-4c3d-b455-a866dea17b24 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:04.860523 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f150c9f7-6936-4c3d-b455-a866dea17b24 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:04.867403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f150c9f7-6936-4c3d-b455-a866dea17b24 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:04.868224 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f150c9f7-6936-4c3d-b455-a866dea17b24 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:04.869297 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f150c9f7-6936-4c3d-b455-a866dea17b24 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:04.869935 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f150c9f7-6936-4c3d-b455-a866dea17b24 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:04.916370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f150c9f7-6936-4c3d-b455-a866dea17b24 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:34:04.929952 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-090ff5ce-5160-4e4c-8d2b-aeb4ff383d9a tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5313f5231c864414b7469dae709aa6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6aafe78cf4d38afff08ccedef2e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:04.936806 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:34:04.941467 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-090ff5ce-5160-4e4c-8d2b-aeb4ff383d9a tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] 10.222.0.88 "GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1" status: 200 len: 1217 microversion: 2.1 time: 0.220107 Jul 25 14:34:04.942422 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1069/2248] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:04 2022] GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1 => generated 1217 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:04.950055 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-81917b08-4943-4724-8344-6b6eaaf436fa tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:04.950986 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-81917b08-4943-4724-8344-6b6eaaf436fa tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:04.964741 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-81917b08-4943-4724-8344-6b6eaaf436fa tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:04.968103 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-81917b08-4943-4724-8344-6b6eaaf436fa tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:04.968971 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-81917b08-4943-4724-8344-6b6eaaf436fa tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:04.969416 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-81917b08-4943-4724-8344-6b6eaaf436fa tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:05.145763 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f150c9f7-6936-4c3d-b455-a866dea17b24 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 204 len: 0 microversion: 2.25 time: 0.291796 Jul 25 14:34:05.152198 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1180/2249] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Jul 25 14:34:04 2022] DELETE /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 14:34:05.158990 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-03100e9f-e857-4dfc-8a25-1d436112315b tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:05.159961 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-03100e9f-e857-4dfc-8a25-1d436112315b tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 6de04885-8bb7-4d85-b292-ef576bb3fcf0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:05.282407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-03100e9f-e857-4dfc-8a25-1d436112315b tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:05.289080 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-81917b08-4943-4724-8344-6b6eaaf436fa tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:05.297375 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-03100e9f-e857-4dfc-8a25-1d436112315b tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0" status: 200 len: 1216 microversion: 2.1 time: 0.143599 Jul 25 14:34:05.298129 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1181/2250] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:05 2022] GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0 => generated 1216 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:05.298273 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-81917b08-4943-4724-8344-6b6eaaf436fa tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630" status: 200 len: 1333 microversion: 2.1 time: 0.354157 Jul 25 14:34:05.306428 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-506d8a53-7025-4f9d-a88b-e34cac0e3a88 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:05.309887 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-506d8a53-7025-4f9d-a88b-e34cac0e3a88 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:05.313182 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1070/2251] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:04 2022] GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 => generated 1333 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:05.327917 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-506d8a53-7025-4f9d-a88b-e34cac0e3a88 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:05.328625 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-506d8a53-7025-4f9d-a88b-e34cac0e3a88 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:05.330401 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-506d8a53-7025-4f9d-a88b-e34cac0e3a88 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:05.331137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-506d8a53-7025-4f9d-a88b-e34cac0e3a88 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:05.514547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-506d8a53-7025-4f9d-a88b-e34cac0e3a88 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:05.529641 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-506d8a53-7025-4f9d-a88b-e34cac0e3a88 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:05.533097 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-506d8a53-7025-4f9d-a88b-e34cac0e3a88 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:05.534587 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-506d8a53-7025-4f9d-a88b-e34cac0e3a88 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 200 len: 1563 microversion: 2.25 time: 0.235106 Jul 25 14:34:05.549462 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1182/2252] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:34:05 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 1563 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:34:05.865571 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9a0be489-b005-4e60-ae1e-bb2574dfbcfd tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:05.866539 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9a0be489-b005-4e60-ae1e-bb2574dfbcfd tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 079ec21d-9dbc-4c93-a119-bf1bd0c06a15] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:05.874478 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9a0be489-b005-4e60-ae1e-bb2574dfbcfd tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:05.875088 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9a0be489-b005-4e60-ae1e-bb2574dfbcfd tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:05.876001 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9a0be489-b005-4e60-ae1e-bb2574dfbcfd tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:05.876758 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9a0be489-b005-4e60-ae1e-bb2574dfbcfd tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:05.965790 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d9febecf-b9bf-4b4a-b5f2-887a88828a02 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:05.968996 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d9febecf-b9bf-4b4a-b5f2-887a88828a02 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] [instance: 6993d89b-7a38-42d9-b4ec-cab1a476d4d1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:05.981084 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d9febecf-b9bf-4b4a-b5f2-887a88828a02 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:05.981920 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d9febecf-b9bf-4b4a-b5f2-887a88828a02 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:05.983131 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d9febecf-b9bf-4b4a-b5f2-887a88828a02 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:05.983770 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d9febecf-b9bf-4b4a-b5f2-887a88828a02 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:06.073771 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d9febecf-b9bf-4b4a-b5f2-887a88828a02 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5313f5231c864414b7469dae709aa6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6aafe78cf4d38afff08ccedef2e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:06.083529 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d9febecf-b9bf-4b4a-b5f2-887a88828a02 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] 10.222.0.88 "GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1" status: 200 len: 1269 microversion: 2.1 time: 0.124059 Jul 25 14:34:06.084776 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1183/2253] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:05 2022] GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1 => generated 1269 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:06.101662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9a0be489-b005-4e60-ae1e-bb2574dfbcfd tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:06.114903 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9a0be489-b005-4e60-ae1e-bb2574dfbcfd tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/079ec21d-9dbc-4c93-a119-bf1bd0c06a15" status: 200 len: 1512 microversion: 2.1 time: 0.251765 Jul 25 14:34:06.116539 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1071/2254] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:05 2022] GET /compute/v2.1/servers/079ec21d-9dbc-4c93-a119-bf1bd0c06a15 => generated 1512 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:06.144428 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-60b048f6-ba44-4b01-8910-4299a56dfdb0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:06.154246 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-60b048f6-ba44-4b01-8910-4299a56dfdb0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:06.156203 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-60b048f6-ba44-4b01-8910-4299a56dfdb0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '2383030b07e34f93b9637c637f8f0ae7'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:34:06.181893 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:34:06.221364 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60b048f6-ba44-4b01-8910-4299a56dfdb0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:06.222480 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60b048f6-ba44-4b01-8910-4299a56dfdb0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:06.223332 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60b048f6-ba44-4b01-8910-4299a56dfdb0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:06.223775 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60b048f6-ba44-4b01-8910-4299a56dfdb0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:06.320042 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-96746a53-aa9d-4562-9c5d-ce7f4d153747 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:06.320829 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-96746a53-aa9d-4562-9c5d-ce7f4d153747 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 6de04885-8bb7-4d85-b292-ef576bb3fcf0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:06.332253 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-96746a53-aa9d-4562-9c5d-ce7f4d153747 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:06.332378 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.multi_cell_list [None req-60b048f6-ba44-4b01-8910-4299a56dfdb0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119304) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:34:06.332955 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-96746a53-aa9d-4562-9c5d-ce7f4d153747 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:06.337189 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-96746a53-aa9d-4562-9c5d-ce7f4d153747 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:06.337845 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-96746a53-aa9d-4562-9c5d-ce7f4d153747 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:06.420211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-60b048f6-ba44-4b01-8910-4299a56dfdb0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:06.429085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60b048f6-ba44-4b01-8910-4299a56dfdb0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:06.429707 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60b048f6-ba44-4b01-8910-4299a56dfdb0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:06.623835 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-60b048f6-ba44-4b01-8910-4299a56dfdb0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.484306 Jul 25 14:34:06.625055 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1184/2255] 10.222.0.88 () {58 vars in 1167 bytes} [Mon Jul 25 14:34:06 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:06.630418 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-64d016e5-cd86-4a87-a313-57a9e20d25a3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:06.631194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-64d016e5-cd86-4a87-a313-57a9e20d25a3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:06.638172 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-64d016e5-cd86-4a87-a313-57a9e20d25a3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:06.638883 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-64d016e5-cd86-4a87-a313-57a9e20d25a3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:06.640226 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-64d016e5-cd86-4a87-a313-57a9e20d25a3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:06.644725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-64d016e5-cd86-4a87-a313-57a9e20d25a3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:06.684352 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-96746a53-aa9d-4562-9c5d-ce7f4d153747 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:06.700523 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-96746a53-aa9d-4562-9c5d-ce7f4d153747 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0" status: 200 len: 1268 microversion: 2.1 time: 0.385292 Jul 25 14:34:06.701746 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1072/2256] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:06 2022] GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0 => generated 1268 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:06.723757 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-59e52671-9f94-43bc-bc73-1d73b8690d2f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:06.724501 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-59e52671-9f94-43bc-bc73-1d73b8690d2f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:06.739408 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59e52671-9f94-43bc-bc73-1d73b8690d2f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:06.739929 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59e52671-9f94-43bc-bc73-1d73b8690d2f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:06.740811 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59e52671-9f94-43bc-bc73-1d73b8690d2f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:06.742136 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59e52671-9f94-43bc-bc73-1d73b8690d2f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:06.909468 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-59e52671-9f94-43bc-bc73-1d73b8690d2f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:06.928954 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-59e52671-9f94-43bc-bc73-1d73b8690d2f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:06.930585 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-59e52671-9f94-43bc-bc73-1d73b8690d2f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94b57069a56c4fedb1d4546c1d0415c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2b9ba0bede403bafb665d5e0818dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:06.932161 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-59e52671-9f94-43bc-bc73-1d73b8690d2f tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 200 len: 1521 microversion: 2.25 time: 0.229007 Jul 25 14:34:06.934316 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1073/2257] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:34:06 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:34:06.950212 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1ac2be31-e2d5-4c86-ba94-97ca2a97ba75 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:06.964361 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1ac2be31-e2d5-4c86-ba94-97ca2a97ba75 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:06.965692 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1ac2be31-e2d5-4c86-ba94-97ca2a97ba75 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-2020558111', 'deleted': False, 'project_id': '2383030b07e34f93b9637c637f8f0ae7'} {{(pid=119303) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:34:06.972704 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ac2be31-e2d5-4c86-ba94-97ca2a97ba75 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:06.973293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ac2be31-e2d5-4c86-ba94-97ca2a97ba75 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:06.974218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ac2be31-e2d5-4c86-ba94-97ca2a97ba75 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:06.974892 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ac2be31-e2d5-4c86-ba94-97ca2a97ba75 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:07.081749 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.multi_cell_list [None req-1ac2be31-e2d5-4c86-ba94-97ca2a97ba75 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119303) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:34:07.108892 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-64d016e5-cd86-4a87-a313-57a9e20d25a3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:07.116482 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-64d016e5-cd86-4a87-a313-57a9e20d25a3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630" status: 200 len: 1333 microversion: 2.1 time: 0.489890 Jul 25 14:34:07.129601 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1185/2258] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:06 2022] GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 => generated 1333 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:07.129601 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-04c0939b-95b9-46c2-8c09-95d5b747acec req-34b6d2b8-7672-434b-a822-38bde34c5ebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3d2010c-4e0c-412e-9b66-8fbac6510097", "name": "network-vif-deleted", "tag": "520cf9de-1166-4382-a12f-5e27acc8c55e"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:07.153332 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-04c0939b-95b9-46c2-8c09-95d5b747acec req-34b6d2b8-7672-434b-a822-38bde34c5ebb service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:07.153772 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-04c0939b-95b9-46c2-8c09-95d5b747acec req-34b6d2b8-7672-434b-a822-38bde34c5ebb service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:07.188439 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-04c0939b-95b9-46c2-8c09-95d5b747acec req-34b6d2b8-7672-434b-a822-38bde34c5ebb service nova] Creating event network-vif-deleted:520cf9de-1166-4382-a12f-5e27acc8c55e for instance b3d2010c-4e0c-412e-9b66-8fbac6510097 on n-h1-846435-14 Jul 25 14:34:07.197829 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-04c0939b-95b9-46c2-8c09-95d5b747acec req-34b6d2b8-7672-434b-a822-38bde34c5ebb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076124 Jul 25 14:34:07.198461 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1186/2259] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:34:07.203685 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-aa08d1e2-3aae-4334-9718-a6eec54bb909 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:07.208621 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-aa08d1e2-3aae-4334-9718-a6eec54bb909 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] [instance: 6993d89b-7a38-42d9-b4ec-cab1a476d4d1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:07.218571 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1ac2be31-e2d5-4c86-ba94-97ca2a97ba75 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:07.223537 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aa08d1e2-3aae-4334-9718-a6eec54bb909 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:07.224230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aa08d1e2-3aae-4334-9718-a6eec54bb909 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:07.224811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aa08d1e2-3aae-4334-9718-a6eec54bb909 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:07.225214 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aa08d1e2-3aae-4334-9718-a6eec54bb909 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:07.237006 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ac2be31-e2d5-4c86-ba94-97ca2a97ba75 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:07.237766 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ac2be31-e2d5-4c86-ba94-97ca2a97ba75 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:07.341772 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-aa08d1e2-3aae-4334-9718-a6eec54bb909 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5313f5231c864414b7469dae709aa6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6aafe78cf4d38afff08ccedef2e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:07.353160 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-aa08d1e2-3aae-4334-9718-a6eec54bb909 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] 10.222.0.88 "GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1" status: 200 len: 1275 microversion: 2.1 time: 0.153437 Jul 25 14:34:07.354222 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1187/2260] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:07 2022] GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1 => generated 1275 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:07.621536 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1ac2be31-e2d5-4c86-ba94-97ca2a97ba75 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-2020558111" status: 200 len: 1514 microversion: 2.1 time: 0.685739 Jul 25 14:34:07.624274 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1074/2261] 10.222.0.88 () {58 vars in 1263 bytes} [Mon Jul 25 14:34:06 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-2020558111 => generated 1514 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:07.651309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-73b2717d-899d-40c4-a066-d1367d425bc6 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:07.662203 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-73b2717d-899d-40c4-a066-d1367d425bc6 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:07.665338 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-73b2717d-899d-40c4-a066-d1367d425bc6 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '2383030b07e34f93b9637c637f8f0ae7'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:34:07.677406 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-73b2717d-899d-40c4-a066-d1367d425bc6 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:07.678460 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-73b2717d-899d-40c4-a066-d1367d425bc6 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:07.679863 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-73b2717d-899d-40c4-a066-d1367d425bc6 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:07.680604 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-73b2717d-899d-40c4-a066-d1367d425bc6 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:07.727639 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3b78770c-3ce5-4cb6-8804-34abd7743c0d tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:07.728785 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3b78770c-3ce5-4cb6-8804-34abd7743c0d tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 6de04885-8bb7-4d85-b292-ef576bb3fcf0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:07.740687 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b78770c-3ce5-4cb6-8804-34abd7743c0d tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:07.741958 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b78770c-3ce5-4cb6-8804-34abd7743c0d tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:07.745027 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b78770c-3ce5-4cb6-8804-34abd7743c0d tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:07.746442 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b78770c-3ce5-4cb6-8804-34abd7743c0d tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:07.824952 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.multi_cell_list [None req-73b2717d-899d-40c4-a066-d1367d425bc6 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119304) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:34:07.882340 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3b78770c-3ce5-4cb6-8804-34abd7743c0d tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:07.894114 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3b78770c-3ce5-4cb6-8804-34abd7743c0d tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0" status: 200 len: 1274 microversion: 2.1 time: 0.171019 Jul 25 14:34:07.897512 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1075/2262] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:07 2022] GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0 => generated 1274 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:07.925850 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-73b2717d-899d-40c4-a066-d1367d425bc6 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:07.936749 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-73b2717d-899d-40c4-a066-d1367d425bc6 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:07.937440 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-73b2717d-899d-40c4-a066-d1367d425bc6 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:07.959451 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-01e0b987-1e93-4a60-9f38-15b88e4f22c6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:07.960166 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-01e0b987-1e93-4a60-9f38-15b88e4f22c6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] [instance: b3d2010c-4e0c-412e-9b66-8fbac6510097] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:07.968808 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-01e0b987-1e93-4a60-9f38-15b88e4f22c6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:07.969531 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-01e0b987-1e93-4a60-9f38-15b88e4f22c6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:07.970492 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-01e0b987-1e93-4a60-9f38-15b88e4f22c6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:07.971077 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-01e0b987-1e93-4a60-9f38-15b88e4f22c6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:07.988730 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-01e0b987-1e93-4a60-9f38-15b88e4f22c6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] HTTP exception thrown: Instance b3d2010c-4e0c-412e-9b66-8fbac6510097 could not be found. Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-01e0b987-1e93-4a60-9f38-15b88e4f22c6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Request method failure captured: Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 HTTP/1.1 Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qhLhys1-RVNY_YaGf_npt4Z4KJsS5p2XN4AruTf8qUewb9rE4XpUKgQisrocQQqeMtAKoOdmeeflmBSnHF2TZP6D35IBCijfuSNw5WWc9aPp3krfOSwqRap_JaduPaA1FUwutai5h24FHDHo9d0VUQIMA_69Md-gnXmGVpnXGjrxd8 Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: X-Openstack-Nova-Api-Version: 2.25 Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: fb2b9ba0bede403bafb665d5e0818dfb Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1229899115 Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fb2b9ba0bede403bafb665d5e0818dfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/fb2b9ba0bede403bafb665d5e0818dfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_fb2b9ba0bede403bafb665d5e0818dfb", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/fb2b9ba0bede403bafb665d5e0818dfb"}]}] Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1229899115 Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: fb2b9ba0bede403bafb665d5e0818dfb Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1229899115 Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-LiveAutoBlockMigrationV225Test-1229899115-project Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 94b57069a56c4fedb1d4546c1d0415c7 Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1229899115-project Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance b3d2010c-4e0c-412e-9b66-8fbac6510097 could not be found. Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'b3d2010c-4e0c-412e-9b66-8fbac6510097'} Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3d2010c-4e0c-412e-9b66-8fbac6510097 could not be found. Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3d2010c-4e0c-412e-9b66-8fbac6510097 could not be found. Jul 25 14:34:07.991305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:34:07.994731 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:34:07.994731 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:34:07.994731 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:07.994731 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:34:07.994731 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:34:07.994731 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:34:07.994731 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:34:07.994731 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3d2010c-4e0c-412e-9b66-8fbac6510097 could not be found. Jul 25 14:34:07.994731 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:34:07.996663 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-01e0b987-1e93-4a60-9f38-15b88e4f22c6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] Returning 404 to user: Instance b3d2010c-4e0c-412e-9b66-8fbac6510097 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:34:07.998671 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-01e0b987-1e93-4a60-9f38-15b88e4f22c6 tempest-LiveAutoBlockMigrationV225Test-1229899115 tempest-LiveAutoBlockMigrationV225Test-1229899115-project] 10.222.0.88 "GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097" status: 404 len: 111 microversion: 2.25 time: 0.043079 Jul 25 14:34:07.999892 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1076/2263] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:34:07 2022] GET /compute/v2.1/servers/b3d2010c-4e0c-412e-9b66-8fbac6510097 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 25 14:34:08.137279 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-aaf53b72-cc62-41c3-bfd2-8f6c58e506e9 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:08.138206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-aaf53b72-cc62-41c3-bfd2-8f6c58e506e9 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:08.144928 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aaf53b72-cc62-41c3-bfd2-8f6c58e506e9 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:08.145619 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aaf53b72-cc62-41c3-bfd2-8f6c58e506e9 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:08.146638 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aaf53b72-cc62-41c3-bfd2-8f6c58e506e9 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:08.147344 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aaf53b72-cc62-41c3-bfd2-8f6c58e506e9 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:08.293206 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-73b2717d-899d-40c4-a066-d1367d425bc6 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 0.650962 Jul 25 14:34:08.306324 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1188/2264] 10.222.0.88 () {58 vars in 1173 bytes} [Mon Jul 25 14:34:07 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:08.330459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4eeef009-4722-4b69-8ff0-e844ba36f8c4 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:08.339124 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4eeef009-4722-4b69-8ff0-e844ba36f8c4 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:08.342914 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.compute.servers [None req-4eeef009-4722-4b69-8ff0-e844ba36f8c4 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Removing options 'limit' from query {{(pid=119304) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 25 14:34:08.343735 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4eeef009-4722-4b69-8ff0-e844ba36f8c4 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Searching by: {'deleted': False, 'project_id': '2383030b07e34f93b9637c637f8f0ae7'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:34:08.357612 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4eeef009-4722-4b69-8ff0-e844ba36f8c4 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:08.358070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4eeef009-4722-4b69-8ff0-e844ba36f8c4 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:08.358885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4eeef009-4722-4b69-8ff0-e844ba36f8c4 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:08.359316 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4eeef009-4722-4b69-8ff0-e844ba36f8c4 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:08.418569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4eeef009-4722-4b69-8ff0-e844ba36f8c4 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:08.426116 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4eeef009-4722-4b69-8ff0-e844ba36f8c4 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:08.426709 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4eeef009-4722-4b69-8ff0-e844ba36f8c4 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:08.695592 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-aaf53b72-cc62-41c3-bfd2-8f6c58e506e9 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:08.709149 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-aaf53b72-cc62-41c3-bfd2-8f6c58e506e9 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630" status: 200 len: 1333 microversion: 2.1 time: 0.575233 Jul 25 14:34:08.710016 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1077/2265] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:08 2022] GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 => generated 1333 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:08.716005 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-099a0000-4f62-4ebc-8de0-6b96f4ac24ca tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:08.716907 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-099a0000-4f62-4ebc-8de0-6b96f4ac24ca tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] [instance: 6993d89b-7a38-42d9-b4ec-cab1a476d4d1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:08.738276 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-099a0000-4f62-4ebc-8de0-6b96f4ac24ca tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:08.739440 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-099a0000-4f62-4ebc-8de0-6b96f4ac24ca tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:08.741205 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-099a0000-4f62-4ebc-8de0-6b96f4ac24ca tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:08.742249 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-099a0000-4f62-4ebc-8de0-6b96f4ac24ca tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:08.810758 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4eeef009-4722-4b69-8ff0-e844ba36f8c4 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.487002 Jul 25 14:34:08.811876 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1189/2266] 10.222.0.88 () {58 vars in 1161 bytes} [Mon Jul 25 14:34:08 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:08.843563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-559a0fe9-38da-48e1-a9dd-1c06e528442c tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:08.848473 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-559a0fe9-38da-48e1-a9dd-1c06e528442c tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:08.849203 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-559a0fe9-38da-48e1-a9dd-1c06e528442c tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '2383030b07e34f93b9637c637f8f0ae7'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:34:08.860253 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-099a0000-4f62-4ebc-8de0-6b96f4ac24ca tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5313f5231c864414b7469dae709aa6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6aafe78cf4d38afff08ccedef2e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:08.880256 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-559a0fe9-38da-48e1-a9dd-1c06e528442c tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:08.883426 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-099a0000-4f62-4ebc-8de0-6b96f4ac24ca tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] 10.222.0.88 "GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1" status: 200 len: 1275 microversion: 2.1 time: 0.171724 Jul 25 14:34:08.884564 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-559a0fe9-38da-48e1-a9dd-1c06e528442c tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:08.885037 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1078/2267] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:08 2022] GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1 => generated 1275 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:08.886118 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-559a0fe9-38da-48e1-a9dd-1c06e528442c tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:08.886631 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-559a0fe9-38da-48e1-a9dd-1c06e528442c tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:08.924071 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0d6eed7e-7347-4b67-ae4f-f8778f834e87 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:08.925324 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0d6eed7e-7347-4b67-ae4f-f8778f834e87 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 6de04885-8bb7-4d85-b292-ef576bb3fcf0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:08.961206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0d6eed7e-7347-4b67-ae4f-f8778f834e87 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:08.961695 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0d6eed7e-7347-4b67-ae4f-f8778f834e87 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:08.962501 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0d6eed7e-7347-4b67-ae4f-f8778f834e87 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:08.962933 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0d6eed7e-7347-4b67-ae4f-f8778f834e87 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:09.044113 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.multi_cell_list [None req-559a0fe9-38da-48e1-a9dd-1c06e528442c tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119304) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:34:09.170478 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-559a0fe9-38da-48e1-a9dd-1c06e528442c tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers?status=active" status: 200 len: 1012 microversion: 2.1 time: 0.332417 Jul 25 14:34:09.181153 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1190/2268] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jul 25 14:34:08 2022] GET /compute/v2.1/servers?status=active => generated 1012 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:09.186430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d14f35c4-bb75-492f-91fa-bc8bf16473a5 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:09.191988 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d14f35c4-bb75-492f-91fa-bc8bf16473a5 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:09.192700 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.compute.servers [None req-d14f35c4-bb75-492f-91fa-bc8bf16473a5 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Removing options 'limit' from query {{(pid=119304) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 25 14:34:09.193534 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d14f35c4-bb75-492f-91fa-bc8bf16473a5 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Searching by: {'deleted': False, 'project_id': '2383030b07e34f93b9637c637f8f0ae7'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:34:09.207178 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d14f35c4-bb75-492f-91fa-bc8bf16473a5 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:09.207828 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d14f35c4-bb75-492f-91fa-bc8bf16473a5 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:09.208809 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d14f35c4-bb75-492f-91fa-bc8bf16473a5 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:09.209419 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d14f35c4-bb75-492f-91fa-bc8bf16473a5 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:09.247252 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.multi_cell_list [None req-d14f35c4-bb75-492f-91fa-bc8bf16473a5 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119304) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:34:09.303023 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d14f35c4-bb75-492f-91fa-bc8bf16473a5 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1012 microversion: 2.1 time: 0.120106 Jul 25 14:34:09.305221 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1191/2269] 10.222.0.88 () {58 vars in 1150 bytes} [Mon Jul 25 14:34:09 2022] GET /compute/v2.1/servers?limit=100000 => generated 1012 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:09.316897 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-93fc04df-3d8f-4a52-8a9e-e4461bcad778 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:09.322752 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-93fc04df-3d8f-4a52-8a9e-e4461bcad778 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:09.323808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-93fc04df-3d8f-4a52-8a9e-e4461bcad778 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Searching by: {'deleted': False, 'project_id': '2383030b07e34f93b9637c637f8f0ae7'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:34:09.329950 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-93fc04df-3d8f-4a52-8a9e-e4461bcad778 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:09.331267 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-93fc04df-3d8f-4a52-8a9e-e4461bcad778 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:09.332691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-93fc04df-3d8f-4a52-8a9e-e4461bcad778 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:09.333745 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-93fc04df-3d8f-4a52-8a9e-e4461bcad778 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:09.380330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.multi_cell_list [None req-93fc04df-3d8f-4a52-8a9e-e4461bcad778 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119304) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:34:09.477329 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-93fc04df-3d8f-4a52-8a9e-e4461bcad778 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers" status: 200 len: 1012 microversion: 2.1 time: 0.164451 Jul 25 14:34:09.478393 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1192/2270] 10.222.0.88 () {58 vars in 1125 bytes} [Mon Jul 25 14:34:09 2022] GET /compute/v2.1/servers => generated 1012 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:09.497572 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d92f5d26-cfd5-448b-b9d2-8ff4150d98ad tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:09.510746 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d92f5d26-cfd5-448b-b9d2-8ff4150d98ad tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:09.511439 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d92f5d26-cfd5-448b-b9d2-8ff4150d98ad tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '2383030b07e34f93b9637c637f8f0ae7'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:34:09.531897 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d92f5d26-cfd5-448b-b9d2-8ff4150d98ad tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:09.532742 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d92f5d26-cfd5-448b-b9d2-8ff4150d98ad tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:09.533754 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d92f5d26-cfd5-448b-b9d2-8ff4150d98ad tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:09.534444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d92f5d26-cfd5-448b-b9d2-8ff4150d98ad tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:09.799561 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.multi_cell_list [None req-d92f5d26-cfd5-448b-b9d2-8ff4150d98ad tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119304) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:34:09.929724 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d92f5d26-cfd5-448b-b9d2-8ff4150d98ad tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.439863 Jul 25 14:34:09.932322 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1193/2271] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:34:09 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:34:09.953338 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fc399248-9427-4a8a-ac73-3696eef3fd04 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:09.954121 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fc399248-9427-4a8a-ac73-3696eef3fd04 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:09.971889 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fc399248-9427-4a8a-ac73-3696eef3fd04 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:09.972292 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fc399248-9427-4a8a-ac73-3696eef3fd04 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:09.973089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fc399248-9427-4a8a-ac73-3696eef3fd04 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:09.973640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fc399248-9427-4a8a-ac73-3696eef3fd04 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:10.045797 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0d6eed7e-7347-4b67-ae4f-f8778f834e87 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:10.058309 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0d6eed7e-7347-4b67-ae4f-f8778f834e87 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0" status: 200 len: 1316 microversion: 2.1 time: 1.141875 Jul 25 14:34:10.059475 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1079/2272] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:08 2022] GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0 => generated 1316 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:10.077157 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-88763e32-1872-4659-bb20-26d98391412c tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:10.078124 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-88763e32-1872-4659-bb20-26d98391412c tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] [instance: 6993d89b-7a38-42d9-b4ec-cab1a476d4d1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:10.091026 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-88763e32-1872-4659-bb20-26d98391412c tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:10.091635 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-88763e32-1872-4659-bb20-26d98391412c tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:10.096314 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-88763e32-1872-4659-bb20-26d98391412c tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:10.096979 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-88763e32-1872-4659-bb20-26d98391412c tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:10.636806 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fc399248-9427-4a8a-ac73-3696eef3fd04 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:10.648304 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fc399248-9427-4a8a-ac73-3696eef3fd04 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630" status: 200 len: 1333 microversion: 2.1 time: 0.714513 Jul 25 14:34:10.649888 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1194/2273] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:09 2022] GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 => generated 1333 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:10.656302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cb4e715f-a5d8-4aee-b0e0-2edbffe52513 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:10.667107 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cb4e715f-a5d8-4aee-b0e0-2edbffe52513 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:10.668419 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.compute.servers [None req-cb4e715f-a5d8-4aee-b0e0-2edbffe52513 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Removing options 'limit' from query {{(pid=119304) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 25 14:34:10.669551 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cb4e715f-a5d8-4aee-b0e0-2edbffe52513 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Searching by: {'deleted': False, 'project_id': '2383030b07e34f93b9637c637f8f0ae7'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:34:10.679397 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb4e715f-a5d8-4aee-b0e0-2edbffe52513 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:10.680442 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb4e715f-a5d8-4aee-b0e0-2edbffe52513 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:10.682206 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb4e715f-a5d8-4aee-b0e0-2edbffe52513 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:10.682865 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb4e715f-a5d8-4aee-b0e0-2edbffe52513 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:10.729970 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:34:10.765008 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cb4e715f-a5d8-4aee-b0e0-2edbffe52513 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.113613 Jul 25 14:34:10.770203 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1195/2274] 10.222.0.88 () {58 vars in 1140 bytes} [Mon Jul 25 14:34:10 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:34:10.804034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-13ef52a9-6b30-4c2e-9290-189e08f4b8f3 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:10.819410 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-13ef52a9-6b30-4c2e-9290-189e08f4b8f3 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:10.822985 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-13ef52a9-6b30-4c2e-9290-189e08f4b8f3 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-2020558111', 'deleted': False, 'project_id': '2383030b07e34f93b9637c637f8f0ae7'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:34:10.844651 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-13ef52a9-6b30-4c2e-9290-189e08f4b8f3 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:10.845121 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-13ef52a9-6b30-4c2e-9290-189e08f4b8f3 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:10.846000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-13ef52a9-6b30-4c2e-9290-189e08f4b8f3 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:10.848976 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-13ef52a9-6b30-4c2e-9290-189e08f4b8f3 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:10.932343 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-88763e32-1872-4659-bb20-26d98391412c tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5313f5231c864414b7469dae709aa6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6aafe78cf4d38afff08ccedef2e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:10.956942 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-88763e32-1872-4659-bb20-26d98391412c tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] 10.222.0.88 "GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1" status: 200 len: 1317 microversion: 2.1 time: 0.896132 Jul 25 14:34:10.967963 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1080/2275] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:10 2022] GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1 => generated 1317 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:11.067170 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.multi_cell_list [None req-13ef52a9-6b30-4c2e-9290-189e08f4b8f3 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119304) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:34:11.084696 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7dfad9a8-0d66-4b73-90ba-0716ad299912 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:11.085931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7dfad9a8-0d66-4b73-90ba-0716ad299912 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 6de04885-8bb7-4d85-b292-ef576bb3fcf0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:11.102340 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7dfad9a8-0d66-4b73-90ba-0716ad299912 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:11.103026 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7dfad9a8-0d66-4b73-90ba-0716ad299912 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:11.104256 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7dfad9a8-0d66-4b73-90ba-0716ad299912 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:11.104908 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7dfad9a8-0d66-4b73-90ba-0716ad299912 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:11.110973 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:34:11.228947 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-13ef52a9-6b30-4c2e-9290-189e08f4b8f3 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-2020558111" status: 200 len: 346 microversion: 2.1 time: 0.447968 Jul 25 14:34:11.230026 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1196/2276] 10.222.0.88 () {58 vars in 1242 bytes} [Mon Jul 25 14:34:10 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-2020558111 => generated 346 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:34:11.244947 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-35bd1d1a-d569-4931-9762-3891a5542a09 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:11.256292 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35bd1d1a-d569-4931-9762-3891a5542a09 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:11.256743 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35bd1d1a-d569-4931-9762-3891a5542a09 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:11.351559 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-35bd1d1a-d569-4931-9762-3891a5542a09 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 542ab1a2-380f-4f4f-95ec-5d68eb9bd091] Going to try to stop instance {{(pid=119304) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 14:34:11.408876 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-35bd1d1a-d569-4931-9762-3891a5542a09 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "POST /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091/action" status: 202 len: 0 microversion: 2.1 time: 0.170528 Jul 25 14:34:11.409919 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1197/2277] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:34:11 2022] POST /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:34:11.419947 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-df26dacc-f097-4c9b-88b6-51df600e5d43 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:11.421231 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-df26dacc-f097-4c9b-88b6-51df600e5d43 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 542ab1a2-380f-4f4f-95ec-5d68eb9bd091] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:11.431543 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-df26dacc-f097-4c9b-88b6-51df600e5d43 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:11.432073 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-df26dacc-f097-4c9b-88b6-51df600e5d43 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:11.432873 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-df26dacc-f097-4c9b-88b6-51df600e5d43 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:11.433306 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-df26dacc-f097-4c9b-88b6-51df600e5d43 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:11.606157 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7dfad9a8-0d66-4b73-90ba-0716ad299912 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:11.621552 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7dfad9a8-0d66-4b73-90ba-0716ad299912 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0" status: 200 len: 1316 microversion: 2.1 time: 0.541565 Jul 25 14:34:11.626132 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1081/2278] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:11 2022] GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0 => generated 1316 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:11.658449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-df26dacc-f097-4c9b-88b6-51df600e5d43 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:11.679436 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-df26dacc-f097-4c9b-88b6-51df600e5d43 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091" status: 200 len: 1521 microversion: 2.1 time: 0.264114 Jul 25 14:34:11.680580 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1198/2279] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:11 2022] GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:11.681738 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-31419902-5bf3-4bb5-a47f-7745e3486f82 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:11.682423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-31419902-5bf3-4bb5-a47f-7745e3486f82 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:11.692054 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-31419902-5bf3-4bb5-a47f-7745e3486f82 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:11.692514 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-31419902-5bf3-4bb5-a47f-7745e3486f82 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:11.693307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-31419902-5bf3-4bb5-a47f-7745e3486f82 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:11.693744 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-31419902-5bf3-4bb5-a47f-7745e3486f82 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:11.989800 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-baad4e2e-c4ab-4c57-add6-78f3b42cd744 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:11.990550 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-baad4e2e-c4ab-4c57-add6-78f3b42cd744 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] [instance: 6993d89b-7a38-42d9-b4ec-cab1a476d4d1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:12.002783 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-baad4e2e-c4ab-4c57-add6-78f3b42cd744 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:12.004857 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-baad4e2e-c4ab-4c57-add6-78f3b42cd744 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:12.005757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-baad4e2e-c4ab-4c57-add6-78f3b42cd744 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:12.010106 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-baad4e2e-c4ab-4c57-add6-78f3b42cd744 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:12.237207 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-31419902-5bf3-4bb5-a47f-7745e3486f82 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:12.245963 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-31419902-5bf3-4bb5-a47f-7745e3486f82 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630" status: 200 len: 1333 microversion: 2.1 time: 0.574465 Jul 25 14:34:12.256374 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1082/2280] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:11 2022] GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 => generated 1333 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:12.297373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-baad4e2e-c4ab-4c57-add6-78f3b42cd744 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5313f5231c864414b7469dae709aa6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6aafe78cf4d38afff08ccedef2e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:12.307351 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-baad4e2e-c4ab-4c57-add6-78f3b42cd744 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] 10.222.0.88 "GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1" status: 200 len: 1317 microversion: 2.1 time: 0.322834 Jul 25 14:34:12.307967 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1199/2281] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:11 2022] GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1 => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:12.646337 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-377cdc79-9b4b-4711-8cc6-63ffaea9a189 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:12.646978 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-377cdc79-9b4b-4711-8cc6-63ffaea9a189 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 6de04885-8bb7-4d85-b292-ef576bb3fcf0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:12.659069 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-377cdc79-9b4b-4711-8cc6-63ffaea9a189 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:12.659526 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-377cdc79-9b4b-4711-8cc6-63ffaea9a189 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:12.660348 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-377cdc79-9b4b-4711-8cc6-63ffaea9a189 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:12.660790 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-377cdc79-9b4b-4711-8cc6-63ffaea9a189 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:12.700449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f04e1e28-4c3b-4a9d-9522-1cf39df73c4b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:12.701121 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f04e1e28-4c3b-4a9d-9522-1cf39df73c4b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 542ab1a2-380f-4f4f-95ec-5d68eb9bd091] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:12.711010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f04e1e28-4c3b-4a9d-9522-1cf39df73c4b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:12.711500 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f04e1e28-4c3b-4a9d-9522-1cf39df73c4b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:12.712508 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f04e1e28-4c3b-4a9d-9522-1cf39df73c4b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:12.714589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f04e1e28-4c3b-4a9d-9522-1cf39df73c4b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:13.157413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f04e1e28-4c3b-4a9d-9522-1cf39df73c4b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:13.167363 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f04e1e28-4c3b-4a9d-9522-1cf39df73c4b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091" status: 200 len: 1521 microversion: 2.1 time: 0.471113 Jul 25 14:34:13.188815 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1200/2282] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:12 2022] GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091 => generated 1521 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:13.200982 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-a9177a97-b34f-42d9-8b86-6d2194705183 req-4a63c0f3-9623-4d93-b9de-4450b8deda20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6de04885-8bb7-4d85-b292-ef576bb3fcf0", "tag": "592a0c75-e6eb-4556-a0a2-689d67fbe5b9"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:13.228987 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a9177a97-b34f-42d9-8b86-6d2194705183 req-4a63c0f3-9623-4d93-b9de-4450b8deda20 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:13.230810 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a9177a97-b34f-42d9-8b86-6d2194705183 req-4a63c0f3-9623-4d93-b9de-4450b8deda20 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:13.261463 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-a9177a97-b34f-42d9-8b86-6d2194705183 req-4a63c0f3-9623-4d93-b9de-4450b8deda20 service nova] Creating event network-changed:592a0c75-e6eb-4556-a0a2-689d67fbe5b9 for instance 6de04885-8bb7-4d85-b292-ef576bb3fcf0 on n-h1-846435-14 Jul 25 14:34:13.267028 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-a9177a97-b34f-42d9-8b86-6d2194705183 req-4a63c0f3-9623-4d93-b9de-4450b8deda20 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076301 Jul 25 14:34:13.268314 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1201/2283] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:34:13.275105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2c39b8e8-e706-45c0-8de3-2ed18bf8af52 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:13.275926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2c39b8e8-e706-45c0-8de3-2ed18bf8af52 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:13.289652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2c39b8e8-e706-45c0-8de3-2ed18bf8af52 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:13.290213 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2c39b8e8-e706-45c0-8de3-2ed18bf8af52 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:13.293876 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2c39b8e8-e706-45c0-8de3-2ed18bf8af52 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:13.294555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2c39b8e8-e706-45c0-8de3-2ed18bf8af52 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:13.433188 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-377cdc79-9b4b-4711-8cc6-63ffaea9a189 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:13.449544 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-377cdc79-9b4b-4711-8cc6-63ffaea9a189 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0" status: 200 len: 1316 microversion: 2.1 time: 0.807029 Jul 25 14:34:13.462841 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1083/2284] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:12 2022] GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0 => generated 1316 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:13.469367 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-338e0a12-610a-4324-9045-59586981e447 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:13.470283 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-338e0a12-610a-4324-9045-59586981e447 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] [instance: 6993d89b-7a38-42d9-b4ec-cab1a476d4d1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:13.477883 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-338e0a12-610a-4324-9045-59586981e447 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:13.479156 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-338e0a12-610a-4324-9045-59586981e447 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:13.480209 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-338e0a12-610a-4324-9045-59586981e447 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:13.480816 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-338e0a12-610a-4324-9045-59586981e447 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:13.647897 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2c39b8e8-e706-45c0-8de3-2ed18bf8af52 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:13.659769 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2c39b8e8-e706-45c0-8de3-2ed18bf8af52 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630" status: 200 len: 1333 microversion: 2.1 time: 0.390017 Jul 25 14:34:13.662337 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1202/2285] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:13 2022] GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 => generated 1333 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:14.202003 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fffea171-2d88-47fc-a708-c1c0392551fe tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:14.202682 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fffea171-2d88-47fc-a708-c1c0392551fe tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 542ab1a2-380f-4f4f-95ec-5d68eb9bd091] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:14.213339 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fffea171-2d88-47fc-a708-c1c0392551fe tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:14.213858 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fffea171-2d88-47fc-a708-c1c0392551fe tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:14.220516 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fffea171-2d88-47fc-a708-c1c0392551fe tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:14.221125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fffea171-2d88-47fc-a708-c1c0392551fe tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:14.277092 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-338e0a12-610a-4324-9045-59586981e447 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5313f5231c864414b7469dae709aa6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6aafe78cf4d38afff08ccedef2e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:14.285092 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-338e0a12-610a-4324-9045-59586981e447 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] 10.222.0.88 "GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1" status: 200 len: 1317 microversion: 2.1 time: 0.820728 Jul 25 14:34:14.302560 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1084/2286] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:13 2022] GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1 => generated 1317 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:14.470461 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dce1f211-26c2-4909-a310-31b41370646c tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:14.471909 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-dce1f211-26c2-4909-a310-31b41370646c tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 6de04885-8bb7-4d85-b292-ef576bb3fcf0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:14.483341 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dce1f211-26c2-4909-a310-31b41370646c tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:14.483867 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dce1f211-26c2-4909-a310-31b41370646c tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:14.486840 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dce1f211-26c2-4909-a310-31b41370646c tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:14.487380 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dce1f211-26c2-4909-a310-31b41370646c tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:14.521219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fffea171-2d88-47fc-a708-c1c0392551fe tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:14.533442 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fffea171-2d88-47fc-a708-c1c0392551fe tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091" status: 200 len: 1521 microversion: 2.1 time: 0.335737 Jul 25 14:34:14.537527 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1203/2287] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:14 2022] GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091 => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:14.681322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e57a9e97-ad8b-4e10-9fd7-0b3eaa5f1d70 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:14.682836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e57a9e97-ad8b-4e10-9fd7-0b3eaa5f1d70 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:14.690882 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e57a9e97-ad8b-4e10-9fd7-0b3eaa5f1d70 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:14.691342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e57a9e97-ad8b-4e10-9fd7-0b3eaa5f1d70 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:14.692180 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e57a9e97-ad8b-4e10-9fd7-0b3eaa5f1d70 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:14.698328 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e57a9e97-ad8b-4e10-9fd7-0b3eaa5f1d70 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:14.941644 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-dce1f211-26c2-4909-a310-31b41370646c tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:14.956507 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dce1f211-26c2-4909-a310-31b41370646c tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0" status: 200 len: 1316 microversion: 2.1 time: 0.489434 Jul 25 14:34:14.969098 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1085/2288] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:14 2022] GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0 => generated 1316 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:15.136359 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e57a9e97-ad8b-4e10-9fd7-0b3eaa5f1d70 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:15.146064 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e57a9e97-ad8b-4e10-9fd7-0b3eaa5f1d70 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630" status: 200 len: 1333 microversion: 2.1 time: 0.468743 Jul 25 14:34:15.152995 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1204/2289] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:14 2022] GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 => generated 1333 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:15.169915 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e574b8f5-0734-4148-95b8-3f05bba776a4 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:15.170836 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e574b8f5-0734-4148-95b8-3f05bba776a4 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:15.177996 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e574b8f5-0734-4148-95b8-3f05bba776a4 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:15.178799 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e574b8f5-0734-4148-95b8-3f05bba776a4 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:15.179781 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e574b8f5-0734-4148-95b8-3f05bba776a4 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:15.180443 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e574b8f5-0734-4148-95b8-3f05bba776a4 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:15.310448 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-91edb30d-4417-4a63-ae9f-11337c450a6d tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:15.311084 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-91edb30d-4417-4a63-ae9f-11337c450a6d tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] [instance: 6993d89b-7a38-42d9-b4ec-cab1a476d4d1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:15.325136 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-91edb30d-4417-4a63-ae9f-11337c450a6d tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:15.326263 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-91edb30d-4417-4a63-ae9f-11337c450a6d tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:15.330276 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-91edb30d-4417-4a63-ae9f-11337c450a6d tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:15.330913 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-91edb30d-4417-4a63-ae9f-11337c450a6d tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:15.347723 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e574b8f5-0734-4148-95b8-3f05bba776a4 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1815 microversion: 2.1 time: 0.190509 Jul 25 14:34:15.360953 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1086/2290] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:15 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1815 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:15.371229 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-3edf20e2-8107-42f7-92f8-2dbdbbfee292 req-b71aa89b-330e-423d-8229-6dea51bd0808 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6993d89b-7a38-42d9-b4ec-cab1a476d4d1", "tag": "e290f89d-d3dd-489e-9853-9cc2f9516d16"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:15.386345 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-3edf20e2-8107-42f7-92f8-2dbdbbfee292 req-b71aa89b-330e-423d-8229-6dea51bd0808 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:15.387033 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-3edf20e2-8107-42f7-92f8-2dbdbbfee292 req-b71aa89b-330e-423d-8229-6dea51bd0808 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:15.401603 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-3edf20e2-8107-42f7-92f8-2dbdbbfee292 req-b71aa89b-330e-423d-8229-6dea51bd0808 service nova] Creating event network-changed:e290f89d-d3dd-489e-9853-9cc2f9516d16 for instance 6993d89b-7a38-42d9-b4ec-cab1a476d4d1 on n-h1-846435-14 Jul 25 14:34:15.407430 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-3edf20e2-8107-42f7-92f8-2dbdbbfee292 req-b71aa89b-330e-423d-8229-6dea51bd0808 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045073 Jul 25 14:34:15.412919 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1087/2291] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:34:15.418409 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e4bfd825-a3f7-4ba9-9194-7ad2a911a3e2 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:15.421579 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:34:15.421579 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:34:15.424343 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e4bfd825-a3f7-4ba9-9194-7ad2a911a3e2 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:15.425392 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e4bfd825-a3f7-4ba9-9194-7ad2a911a3e2 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:15.426359 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e4bfd825-a3f7-4ba9-9194-7ad2a911a3e2 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:15.427580 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e4bfd825-a3f7-4ba9-9194-7ad2a911a3e2 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:15.465067 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e4bfd825-a3f7-4ba9-9194-7ad2a911a3e2 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.050606 Jul 25 14:34:15.465900 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1088/2292] 10.222.0.88 () {58 vars in 1176 bytes} [Mon Jul 25 14:34:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:34:15.485671 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-69a01700-bd73-484c-be4b-becec4911c41 req-912a2946-3634-401e-b2b4-611c87d67b33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1152d383-447a-4ffb-80b7-9b5f2b816630", "name": "network-vif-plugged", "status": "completed", "tag": "e9c737db-06e2-4826-83a4-996006b99e6d"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:15.500937 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-69a01700-bd73-484c-be4b-becec4911c41 req-912a2946-3634-401e-b2b4-611c87d67b33 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:15.501565 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-69a01700-bd73-484c-be4b-becec4911c41 req-912a2946-3634-401e-b2b4-611c87d67b33 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:15.523159 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-69a01700-bd73-484c-be4b-becec4911c41 req-912a2946-3634-401e-b2b4-611c87d67b33 service nova] Creating event network-vif-plugged:e9c737db-06e2-4826-83a4-996006b99e6d for instance 1152d383-447a-4ffb-80b7-9b5f2b816630 on n-h2-846435-14 Jul 25 14:34:15.547579 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-69a01700-bd73-484c-be4b-becec4911c41 req-912a2946-3634-401e-b2b4-611c87d67b33 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060265 Jul 25 14:34:15.548589 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1089/2293] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:34:15.561764 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-326e7078-dc3e-4df7-ad3b-aab3d2365774 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:15.562474 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-326e7078-dc3e-4df7-ad3b-aab3d2365774 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 542ab1a2-380f-4f4f-95ec-5d68eb9bd091] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:15.575787 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-326e7078-dc3e-4df7-ad3b-aab3d2365774 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:15.576277 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-326e7078-dc3e-4df7-ad3b-aab3d2365774 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:15.577096 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-326e7078-dc3e-4df7-ad3b-aab3d2365774 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:15.577528 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-326e7078-dc3e-4df7-ad3b-aab3d2365774 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:15.672589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-91edb30d-4417-4a63-ae9f-11337c450a6d tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5313f5231c864414b7469dae709aa6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6aafe78cf4d38afff08ccedef2e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:15.683377 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-91edb30d-4417-4a63-ae9f-11337c450a6d tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] 10.222.0.88 "GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1" status: 200 len: 1317 microversion: 2.1 time: 0.377283 Jul 25 14:34:15.687233 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1205/2294] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:15 2022] GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1 => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:15.816061 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-326e7078-dc3e-4df7-ad3b-aab3d2365774 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:15.829055 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-326e7078-dc3e-4df7-ad3b-aab3d2365774 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091" status: 200 len: 1521 microversion: 2.1 time: 0.272045 Jul 25 14:34:15.829765 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1090/2295] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:15 2022] GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:15.980601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-15960245-1cec-43ec-83f9-f77f4f77ef72 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:15.981240 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-15960245-1cec-43ec-83f9-f77f4f77ef72 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 6de04885-8bb7-4d85-b292-ef576bb3fcf0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:15.995763 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-15960245-1cec-43ec-83f9-f77f4f77ef72 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:15.996293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-15960245-1cec-43ec-83f9-f77f4f77ef72 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:15.997121 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-15960245-1cec-43ec-83f9-f77f4f77ef72 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:15.997560 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-15960245-1cec-43ec-83f9-f77f4f77ef72 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:16.199499 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-22fa53d5-1982-49a3-81cb-e60bb6d37f58 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Action: 'create', calling method: .version_select at 0x7f46874fdc10>, body: {"keypair": {"name": "tempest-keypair-1596996577", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+s/IL8MU6SWn9eWTEfgqtjQ86Wn6mztu8y5G6t15D6lQkaMutLhk491UOJArBrCw4CQQC96WjHVR3jpdn8bvBe5IB5LoLkMdJRk3FtrIm4kxInQXJIHX2ZpJYnYbYOAQ=="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:16.211457 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-15960245-1cec-43ec-83f9-f77f4f77ef72 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:16.222223 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-15960245-1cec-43ec-83f9-f77f4f77ef72 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0" status: 200 len: 1316 microversion: 2.1 time: 0.247018 Jul 25 14:34:16.223061 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1091/2296] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:15 2022] GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0 => generated 1316 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:16.229569 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e8988f54-93a0-4264-8e40-ef25a7f2143b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:16.230636 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e8988f54-93a0-4264-8e40-ef25a7f2143b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:16.238973 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e8988f54-93a0-4264-8e40-ef25a7f2143b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:16.239795 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e8988f54-93a0-4264-8e40-ef25a7f2143b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:16.241108 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e8988f54-93a0-4264-8e40-ef25a7f2143b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:16.241743 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e8988f54-93a0-4264-8e40-ef25a7f2143b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:16.253949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-22fa53d5-1982-49a3-81cb-e60bb6d37f58 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Getting quotas for project 973384a032e54cd5bee455a1c6f39725. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:34:16.273575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-22fa53d5-1982-49a3-81cb-e60bb6d37f58 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Getting quotas for user 060523597bbb409193f8814648fb40fc and project 973384a032e54cd5bee455a1c6f39725. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:34:16.314990 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-22fa53d5-1982-49a3-81cb-e60bb6d37f58 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.418677 Jul 25 14:34:16.316420 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1206/2297] 10.222.0.88 () {62 vars in 1200 bytes} [Mon Jul 25 14:34:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 421 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 14:34:16.542633 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e8988f54-93a0-4264-8e40-ef25a7f2143b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:16.562811 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e8988f54-93a0-4264-8e40-ef25a7f2143b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630" status: 200 len: 1333 microversion: 2.1 time: 0.336865 Jul 25 14:34:16.564163 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1092/2298] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:16 2022] GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 => generated 1333 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:16.707928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-72d99976-704c-4dbd-a77c-068207201371 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:16.708677 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-72d99976-704c-4dbd-a77c-068207201371 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] [instance: 6993d89b-7a38-42d9-b4ec-cab1a476d4d1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:16.718409 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72d99976-704c-4dbd-a77c-068207201371 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:16.719557 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72d99976-704c-4dbd-a77c-068207201371 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:16.720573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72d99976-704c-4dbd-a77c-068207201371 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:16.721194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72d99976-704c-4dbd-a77c-068207201371 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:16.867417 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c10e2a44-7215-44dc-b60a-b4ee52961bda tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:16.872058 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c10e2a44-7215-44dc-b60a-b4ee52961bda tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 542ab1a2-380f-4f4f-95ec-5d68eb9bd091] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:16.892771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c10e2a44-7215-44dc-b60a-b4ee52961bda tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:16.896427 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c10e2a44-7215-44dc-b60a-b4ee52961bda tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:16.897638 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c10e2a44-7215-44dc-b60a-b4ee52961bda tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:16.898547 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c10e2a44-7215-44dc-b60a-b4ee52961bda tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:17.042453 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-72d99976-704c-4dbd-a77c-068207201371 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5313f5231c864414b7469dae709aa6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6aafe78cf4d38afff08ccedef2e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:17.055830 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-72d99976-704c-4dbd-a77c-068207201371 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] 10.222.0.88 "GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1" status: 200 len: 1317 microversion: 2.1 time: 0.351795 Jul 25 14:34:17.056985 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1207/2299] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:16 2022] GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1 => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:17.216840 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=10 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:34:17.258395 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c10e2a44-7215-44dc-b60a-b4ee52961bda tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:17.260569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4a880f95-637e-4b48-8add-6cc9c5ea5fac tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:17.264815 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4a880f95-637e-4b48-8add-6cc9c5ea5fac tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 6de04885-8bb7-4d85-b292-ef576bb3fcf0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:17.293488 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c10e2a44-7215-44dc-b60a-b4ee52961bda tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091" status: 200 len: 1521 microversion: 2.1 time: 0.438787 Jul 25 14:34:17.298977 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4a880f95-637e-4b48-8add-6cc9c5ea5fac tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:17.299585 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1093/2300] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:16 2022] GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091 => generated 1521 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:17.305065 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4a880f95-637e-4b48-8add-6cc9c5ea5fac tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:17.307451 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4a880f95-637e-4b48-8add-6cc9c5ea5fac tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:17.311633 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4a880f95-637e-4b48-8add-6cc9c5ea5fac tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:17.585921 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-619ba69b-7442-4d38-ac74-386fc30a4840 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:17.589128 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-619ba69b-7442-4d38-ac74-386fc30a4840 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:17.598327 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-619ba69b-7442-4d38-ac74-386fc30a4840 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:17.598919 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-619ba69b-7442-4d38-ac74-386fc30a4840 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:17.599785 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-619ba69b-7442-4d38-ac74-386fc30a4840 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:17.600323 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-619ba69b-7442-4d38-ac74-386fc30a4840 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:17.620258 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4a880f95-637e-4b48-8add-6cc9c5ea5fac tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:17.630235 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4a880f95-637e-4b48-8add-6cc9c5ea5fac tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0" status: 200 len: 1316 microversion: 2.1 time: 0.385600 Jul 25 14:34:17.631357 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1208/2301] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:17 2022] GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0 => generated 1316 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:17.636424 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-54ff9e6d-2a75-4aed-8522-cec79c8ec5d7 req-0efbb5aa-e701-4211-9b7e-e9ee789ac475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1152d383-447a-4ffb-80b7-9b5f2b816630", "name": "network-vif-plugged", "status": "completed", "tag": "ebcf73c2-ddd3-4578-8aac-087c5351795f"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:17.647168 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-54ff9e6d-2a75-4aed-8522-cec79c8ec5d7 req-0efbb5aa-e701-4211-9b7e-e9ee789ac475 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:17.647839 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-54ff9e6d-2a75-4aed-8522-cec79c8ec5d7 req-0efbb5aa-e701-4211-9b7e-e9ee789ac475 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:17.660194 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-54ff9e6d-2a75-4aed-8522-cec79c8ec5d7 req-0efbb5aa-e701-4211-9b7e-e9ee789ac475 service nova] Creating event network-vif-plugged:ebcf73c2-ddd3-4578-8aac-087c5351795f for instance 1152d383-447a-4ffb-80b7-9b5f2b816630 on n-h2-846435-14 Jul 25 14:34:17.665927 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-54ff9e6d-2a75-4aed-8522-cec79c8ec5d7 req-0efbb5aa-e701-4211-9b7e-e9ee789ac475 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033141 Jul 25 14:34:17.666867 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1209/2302] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:34:18.084140 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-619ba69b-7442-4d38-ac74-386fc30a4840 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:18.088781 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-517b478e-04f5-4243-a3e8-2eb591175cea tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:18.089797 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-517b478e-04f5-4243-a3e8-2eb591175cea tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] [instance: 6993d89b-7a38-42d9-b4ec-cab1a476d4d1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:18.101519 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-619ba69b-7442-4d38-ac74-386fc30a4840 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630" status: 200 len: 1333 microversion: 2.1 time: 0.519418 Jul 25 14:34:18.108955 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-517b478e-04f5-4243-a3e8-2eb591175cea tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:18.109727 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-517b478e-04f5-4243-a3e8-2eb591175cea tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:18.110802 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-517b478e-04f5-4243-a3e8-2eb591175cea tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:18.111377 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-517b478e-04f5-4243-a3e8-2eb591175cea tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:18.117173 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1094/2303] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:17 2022] GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 => generated 1333 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:18.324397 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6c7c8693-6a8e-4fd6-b25f-a60452a02543 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:18.325247 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6c7c8693-6a8e-4fd6-b25f-a60452a02543 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 542ab1a2-380f-4f4f-95ec-5d68eb9bd091] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:18.336623 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6c7c8693-6a8e-4fd6-b25f-a60452a02543 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:18.343610 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6c7c8693-6a8e-4fd6-b25f-a60452a02543 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:18.344692 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6c7c8693-6a8e-4fd6-b25f-a60452a02543 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:18.345387 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6c7c8693-6a8e-4fd6-b25f-a60452a02543 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:18.412473 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-517b478e-04f5-4243-a3e8-2eb591175cea tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5313f5231c864414b7469dae709aa6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6aafe78cf4d38afff08ccedef2e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:18.422659 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-517b478e-04f5-4243-a3e8-2eb591175cea tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] 10.222.0.88 "GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1" status: 200 len: 1317 microversion: 2.1 time: 0.347720 Jul 25 14:34:18.440735 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1210/2304] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:18 2022] GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1 => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:18.505072 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d6dadbda-4dd8-4ecb-b3f9-504ec77952b5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f9913a7-ffc2-4c62-92c4-ef402ee3f024", "device": "/dev/xvdb"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:18.507454 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d6dadbda-4dd8-4ecb-b3f9-504ec77952b5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:18.514430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d6dadbda-4dd8-4ecb-b3f9-504ec77952b5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:18.515602 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d6dadbda-4dd8-4ecb-b3f9-504ec77952b5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:18.518657 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d6dadbda-4dd8-4ecb-b3f9-504ec77952b5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:18.519579 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d6dadbda-4dd8-4ecb-b3f9-504ec77952b5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:19.196922 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d6dadbda-4dd8-4ecb-b3f9-504ec77952b5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "POST /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.695597 Jul 25 14:34:19.198100 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1211/2305] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Jul 25 14:34:18 2022] POST /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca/os-volume_attachments => generated 194 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:34:19.206909 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c6d8c6bb-9c7e-46cd-b4ad-ba2db5345bad tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:19.208256 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c6d8c6bb-9c7e-46cd-b4ad-ba2db5345bad tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 6de04885-8bb7-4d85-b292-ef576bb3fcf0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:19.220955 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c6d8c6bb-9c7e-46cd-b4ad-ba2db5345bad tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:19.220955 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c6d8c6bb-9c7e-46cd-b4ad-ba2db5345bad tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:19.221784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c6d8c6bb-9c7e-46cd-b4ad-ba2db5345bad tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:19.228407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c6d8c6bb-9c7e-46cd-b4ad-ba2db5345bad tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:19.237976 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:34:19.456643 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6c7c8693-6a8e-4fd6-b25f-a60452a02543 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:19.468252 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6c7c8693-6a8e-4fd6-b25f-a60452a02543 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091" status: 200 len: 1521 microversion: 2.1 time: 1.148013 Jul 25 14:34:19.469373 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1095/2306] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:18 2022] GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091 => generated 1521 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:19.475733 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cb24b7af-47e9-42fd-88ff-897e6473ed87 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:19.476598 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cb24b7af-47e9-42fd-88ff-897e6473ed87 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:19.484115 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cb24b7af-47e9-42fd-88ff-897e6473ed87 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:19.485150 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cb24b7af-47e9-42fd-88ff-897e6473ed87 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:19.486118 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cb24b7af-47e9-42fd-88ff-897e6473ed87 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:19.487325 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cb24b7af-47e9-42fd-88ff-897e6473ed87 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:19.503121 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c6d8c6bb-9c7e-46cd-b4ad-ba2db5345bad tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:19.520555 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c6d8c6bb-9c7e-46cd-b4ad-ba2db5345bad tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0" status: 200 len: 1316 microversion: 2.1 time: 0.315253 Jul 25 14:34:19.521237 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1212/2307] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:19 2022] GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0 => generated 1316 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:19.540943 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2468efc0-e928-4efb-849b-c9595b001bec tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:19.544207 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2468efc0-e928-4efb-849b-c9595b001bec tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] [instance: 6993d89b-7a38-42d9-b4ec-cab1a476d4d1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:19.562026 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2468efc0-e928-4efb-849b-c9595b001bec tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:19.562560 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2468efc0-e928-4efb-849b-c9595b001bec tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:19.563404 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2468efc0-e928-4efb-849b-c9595b001bec tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:19.564038 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2468efc0-e928-4efb-849b-c9595b001bec tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:19.836248 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2468efc0-e928-4efb-849b-c9595b001bec tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5313f5231c864414b7469dae709aa6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6aafe78cf4d38afff08ccedef2e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:19.847015 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2468efc0-e928-4efb-849b-c9595b001bec tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] 10.222.0.88 "GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1" status: 200 len: 1317 microversion: 2.1 time: 0.318334 Jul 25 14:34:19.847623 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1213/2308] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:19 2022] GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1 => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:20.244334 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cb24b7af-47e9-42fd-88ff-897e6473ed87 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:20.272906 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cb24b7af-47e9-42fd-88ff-897e6473ed87 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630" status: 200 len: 1333 microversion: 2.1 time: 0.801526 Jul 25 14:34:20.274286 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1096/2309] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:19 2022] GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 => generated 1333 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:20.493964 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c35c6558-fffd-4833-b15f-d989ce1c52de tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:20.495195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c35c6558-fffd-4833-b15f-d989ce1c52de tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 542ab1a2-380f-4f4f-95ec-5d68eb9bd091] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:20.502666 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c35c6558-fffd-4833-b15f-d989ce1c52de tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:20.503479 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c35c6558-fffd-4833-b15f-d989ce1c52de tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:20.504484 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c35c6558-fffd-4833-b15f-d989ce1c52de tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:20.505060 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c35c6558-fffd-4833-b15f-d989ce1c52de tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:20.542654 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a639260e-e051-430d-8946-8654c94f6885 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:20.543282 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a639260e-e051-430d-8946-8654c94f6885 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 6de04885-8bb7-4d85-b292-ef576bb3fcf0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:20.558954 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a639260e-e051-430d-8946-8654c94f6885 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:20.559411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a639260e-e051-430d-8946-8654c94f6885 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:20.562848 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a639260e-e051-430d-8946-8654c94f6885 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:20.563352 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a639260e-e051-430d-8946-8654c94f6885 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:20.730876 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c35c6558-fffd-4833-b15f-d989ce1c52de tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:20.745318 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c35c6558-fffd-4833-b15f-d989ce1c52de tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091" status: 200 len: 1521 microversion: 2.1 time: 0.255085 Jul 25 14:34:20.745920 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1214/2310] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:20 2022] GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:20.869099 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7bebc790-bcce-4620-99db-db06d1ae396a tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:20.869814 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7bebc790-bcce-4620-99db-db06d1ae396a tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] [instance: 6993d89b-7a38-42d9-b4ec-cab1a476d4d1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:20.882911 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7bebc790-bcce-4620-99db-db06d1ae396a tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:20.883357 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7bebc790-bcce-4620-99db-db06d1ae396a tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:20.886745 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7bebc790-bcce-4620-99db-db06d1ae396a tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:20.887429 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7bebc790-bcce-4620-99db-db06d1ae396a tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:20.898806 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=20 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:34:20.956408 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a639260e-e051-430d-8946-8654c94f6885 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:20.970611 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a639260e-e051-430d-8946-8654c94f6885 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0" status: 200 len: 1316 microversion: 2.1 time: 0.429897 Jul 25 14:34:20.972760 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1097/2311] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:20 2022] GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0 => generated 1316 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:21.130272 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7bebc790-bcce-4620-99db-db06d1ae396a tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5313f5231c864414b7469dae709aa6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6aafe78cf4d38afff08ccedef2e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:21.142902 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7bebc790-bcce-4620-99db-db06d1ae396a tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] 10.222.0.88 "GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1" status: 200 len: 1317 microversion: 2.1 time: 0.277838 Jul 25 14:34:21.151120 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1215/2312] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:20 2022] GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1 => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:21.193855 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-ce5be355-2993-47bf-aa4d-f6a46bc0f42e req-b7e5394e-ee2f-4091-9d17-50fa0086da70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6de04885-8bb7-4d85-b292-ef576bb3fcf0", "name": "network-vif-plugged", "status": "completed", "tag": "592a0c75-e6eb-4556-a0a2-689d67fbe5b9"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:21.212947 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ce5be355-2993-47bf-aa4d-f6a46bc0f42e req-b7e5394e-ee2f-4091-9d17-50fa0086da70 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:21.213651 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ce5be355-2993-47bf-aa4d-f6a46bc0f42e req-b7e5394e-ee2f-4091-9d17-50fa0086da70 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:21.231302 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-ce5be355-2993-47bf-aa4d-f6a46bc0f42e req-b7e5394e-ee2f-4091-9d17-50fa0086da70 service nova] Creating event network-vif-plugged:592a0c75-e6eb-4556-a0a2-689d67fbe5b9 for instance 6de04885-8bb7-4d85-b292-ef576bb3fcf0 on n-h1-846435-14 Jul 25 14:34:21.236880 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-ce5be355-2993-47bf-aa4d-f6a46bc0f42e req-b7e5394e-ee2f-4091-9d17-50fa0086da70 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046978 Jul 25 14:34:21.238071 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1098/2313] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:34:21.297819 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a62ca3a9-4ac3-48fa-93e0-47814d42d04c tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:21.298693 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a62ca3a9-4ac3-48fa-93e0-47814d42d04c tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:21.307833 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a62ca3a9-4ac3-48fa-93e0-47814d42d04c tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:21.308543 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a62ca3a9-4ac3-48fa-93e0-47814d42d04c tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:21.309506 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a62ca3a9-4ac3-48fa-93e0-47814d42d04c tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:21.310127 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a62ca3a9-4ac3-48fa-93e0-47814d42d04c tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:21.522169 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a62ca3a9-4ac3-48fa-93e0-47814d42d04c tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:21.532226 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a62ca3a9-4ac3-48fa-93e0-47814d42d04c tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630" status: 200 len: 1668 microversion: 2.1 time: 0.242065 Jul 25 14:34:21.556091 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e0f6a8e7-a444-4296-9b4c-4757ee656bc3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:21.557422 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e0f6a8e7-a444-4296-9b4c-4757ee656bc3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:21.563895 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1216/2314] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:21 2022] GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 => generated 1668 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:21.566800 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e0f6a8e7-a444-4296-9b4c-4757ee656bc3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:21.567444 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e0f6a8e7-a444-4296-9b4c-4757ee656bc3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:21.569748 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e0f6a8e7-a444-4296-9b4c-4757ee656bc3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:21.570407 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e0f6a8e7-a444-4296-9b4c-4757ee656bc3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:21.645161 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e0f6a8e7-a444-4296-9b4c-4757ee656bc3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630/ips" status: 200 len: 179 microversion: 2.1 time: 0.084966 Jul 25 14:34:21.646222 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1099/2315] 10.222.0.88 () {58 vars in 1248 bytes} [Mon Jul 25 14:34:21 2022] GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630/ips => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:34:21.659816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f27213da-cb1f-4c79-8a03-ae0d387ab958 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:21.660629 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f27213da-cb1f-4c79-8a03-ae0d387ab958 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:21.668936 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f27213da-cb1f-4c79-8a03-ae0d387ab958 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:21.669632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f27213da-cb1f-4c79-8a03-ae0d387ab958 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:21.670815 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f27213da-cb1f-4c79-8a03-ae0d387ab958 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:21.671394 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f27213da-cb1f-4c79-8a03-ae0d387ab958 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:21.715002 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f27213da-cb1f-4c79-8a03-ae0d387ab958 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:34:21.769542 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b1251c1b-7fa0-4db9-9bf3-3005118beb14 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:21.771603 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b1251c1b-7fa0-4db9-9bf3-3005118beb14 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 542ab1a2-380f-4f4f-95ec-5d68eb9bd091] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:21.780105 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b1251c1b-7fa0-4db9-9bf3-3005118beb14 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:21.780820 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b1251c1b-7fa0-4db9-9bf3-3005118beb14 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:21.781803 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b1251c1b-7fa0-4db9-9bf3-3005118beb14 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:21.782385 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b1251c1b-7fa0-4db9-9bf3-3005118beb14 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:21.842211 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f27213da-cb1f-4c79-8a03-ae0d387ab958 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "DELETE /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630" status: 204 len: 0 microversion: 2.1 time: 0.186139 Jul 25 14:34:21.847931 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1217/2316] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:34:21 2022] DELETE /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:34:21.854852 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c695f9c4-d8f0-4e5f-8071-f9a203b8954b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:21.855747 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c695f9c4-d8f0-4e5f-8071-f9a203b8954b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:21.869029 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c695f9c4-d8f0-4e5f-8071-f9a203b8954b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:21.869503 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c695f9c4-d8f0-4e5f-8071-f9a203b8954b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:21.871357 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c695f9c4-d8f0-4e5f-8071-f9a203b8954b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:21.871717 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c695f9c4-d8f0-4e5f-8071-f9a203b8954b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:22.027586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c695f9c4-d8f0-4e5f-8071-f9a203b8954b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:22.037182 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c695f9c4-d8f0-4e5f-8071-f9a203b8954b tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630" status: 200 len: 1674 microversion: 2.1 time: 0.186236 Jul 25 14:34:22.038010 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1218/2317] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:21 2022] GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 => generated 1674 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:22.053682 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2004700c-6347-4c2a-b0b0-807806443e17 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:22.054495 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2004700c-6347-4c2a-b0b0-807806443e17 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 6de04885-8bb7-4d85-b292-ef576bb3fcf0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:22.061420 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2004700c-6347-4c2a-b0b0-807806443e17 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:22.062201 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2004700c-6347-4c2a-b0b0-807806443e17 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:22.064015 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2004700c-6347-4c2a-b0b0-807806443e17 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:22.064015 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2004700c-6347-4c2a-b0b0-807806443e17 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:22.213003 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2004700c-6347-4c2a-b0b0-807806443e17 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:22.222875 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2004700c-6347-4c2a-b0b0-807806443e17 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0" status: 200 len: 1316 microversion: 2.1 time: 0.173626 Jul 25 14:34:22.223694 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1219/2318] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:22 2022] GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0 => generated 1316 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:22.228514 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-af307f99-a392-457f-b47b-672ffc26f247 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:22.229192 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-af307f99-a392-457f-b47b-672ffc26f247 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] [instance: 6993d89b-7a38-42d9-b4ec-cab1a476d4d1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:22.239326 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af307f99-a392-457f-b47b-672ffc26f247 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:22.239853 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af307f99-a392-457f-b47b-672ffc26f247 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:22.240820 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af307f99-a392-457f-b47b-672ffc26f247 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:22.241536 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af307f99-a392-457f-b47b-672ffc26f247 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:22.388341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-af307f99-a392-457f-b47b-672ffc26f247 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5313f5231c864414b7469dae709aa6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6aafe78cf4d38afff08ccedef2e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:22.401325 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-af307f99-a392-457f-b47b-672ffc26f247 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] 10.222.0.88 "GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1" status: 200 len: 1317 microversion: 2.1 time: 0.176115 Jul 25 14:34:22.402240 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1220/2319] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:22 2022] GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:22.473742 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b1251c1b-7fa0-4db9-9bf3-3005118beb14 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:22.476498 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:34:22.483795 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b1251c1b-7fa0-4db9-9bf3-3005118beb14 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091" status: 200 len: 1521 microversion: 2.1 time: 0.719355 Jul 25 14:34:22.484903 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1100/2320] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:21 2022] GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091 => generated 1521 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:22.584545 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8c1b5e9a-8d95-42e1-86ee-db8cf5d31df2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-868486611", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b891963-4f5c-4f60-ba03-a7025ea9318f"}], "security_groups": [{"name": "tempest-securitygroup--1036429475"}], "key_name": "tempest-keypair-1596996577", "user_data": "}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:22.600054 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:34:22.723601 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-8c1b5e9a-8d95-42e1-86ee-db8cf5d31df2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] validate_networks() for [('7b891963-4f5c-4f60-ba03-a7025ea9318f', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:34:23.058713 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7920813b-cb4d-4fd3-8eff-667e78aa1518 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:23.059821 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7920813b-cb4d-4fd3-8eff-667e78aa1518 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:23.066846 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7920813b-cb4d-4fd3-8eff-667e78aa1518 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:23.067481 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7920813b-cb4d-4fd3-8eff-667e78aa1518 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:23.068418 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7920813b-cb4d-4fd3-8eff-667e78aa1518 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:23.069718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7920813b-cb4d-4fd3-8eff-667e78aa1518 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:23.244015 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-8c1b5e9a-8d95-42e1-86ee-db8cf5d31df2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:34:23.244494 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-8c1b5e9a-8d95-42e1-86ee-db8cf5d31df2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:34:23.246396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-8c1b5e9a-8d95-42e1-86ee-db8cf5d31df2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:34:23.246396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-8c1b5e9a-8d95-42e1-86ee-db8cf5d31df2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:34:23.246396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-8c1b5e9a-8d95-42e1-86ee-db8cf5d31df2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:34:23.257254 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8c1b5e9a-8d95-42e1-86ee-db8cf5d31df2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:23.257696 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8c1b5e9a-8d95-42e1-86ee-db8cf5d31df2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:23.258902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8c1b5e9a-8d95-42e1-86ee-db8cf5d31df2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:23.259332 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8c1b5e9a-8d95-42e1-86ee-db8cf5d31df2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:23.279834 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-8c1b5e9a-8d95-42e1-86ee-db8cf5d31df2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Getting quotas for project 973384a032e54cd5bee455a1c6f39725. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:34:23.310734 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-8c1b5e9a-8d95-42e1-86ee-db8cf5d31df2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Getting quotas for user 060523597bbb409193f8814648fb40fc and project 973384a032e54cd5bee455a1c6f39725. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:34:23.324638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8c1b5e9a-8d95-42e1-86ee-db8cf5d31df2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:34:23.327085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8c1b5e9a-8d95-42e1-86ee-db8cf5d31df2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:34:23.385173 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8c1b5e9a-8d95-42e1-86ee-db8cf5d31df2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.802722 Jul 25 14:34:23.386189 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1221/2321] 10.222.0.88 () {62 vars in 1188 bytes} [Mon Jul 25 14:34:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 14:34:23.391013 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4148aca4-1709-40f4-8ab2-bec8222af723 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:23.392668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4148aca4-1709-40f4-8ab2-bec8222af723 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 6de04885-8bb7-4d85-b292-ef576bb3fcf0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:23.403367 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4148aca4-1709-40f4-8ab2-bec8222af723 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:23.404084 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4148aca4-1709-40f4-8ab2-bec8222af723 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:23.405278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4148aca4-1709-40f4-8ab2-bec8222af723 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:23.406018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4148aca4-1709-40f4-8ab2-bec8222af723 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:23.415201 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7920813b-cb4d-4fd3-8eff-667e78aa1518 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:23.427521 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7920813b-cb4d-4fd3-8eff-667e78aa1518 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630" status: 200 len: 1674 microversion: 2.1 time: 0.371445 Jul 25 14:34:23.430018 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1101/2322] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:23 2022] GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 => generated 1674 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:23.434954 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d0ff17cb-dd2b-4bb1-8a94-95e10043a724 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:23.439389 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d0ff17cb-dd2b-4bb1-8a94-95e10043a724 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:23.584784 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d0ff17cb-dd2b-4bb1-8a94-95e10043a724 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:23.592678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d0ff17cb-dd2b-4bb1-8a94-95e10043a724 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:23.594218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d0ff17cb-dd2b-4bb1-8a94-95e10043a724 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:23.595381 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d0ff17cb-dd2b-4bb1-8a94-95e10043a724 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1281 microversion: 2.20 time: 0.164234 Jul 25 14:34:23.595950 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1102/2323] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:34:23 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1281 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:34:23.625034 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ef784c16-3ade-484a-aed7-6a6deacf1cd8 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:23.625675 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ef784c16-3ade-484a-aed7-6a6deacf1cd8 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] [instance: 6993d89b-7a38-42d9-b4ec-cab1a476d4d1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:23.627607 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:34:23.633189 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4148aca4-1709-40f4-8ab2-bec8222af723 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:23.644277 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4148aca4-1709-40f4-8ab2-bec8222af723 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0" status: 200 len: 1316 microversion: 2.1 time: 0.254871 Jul 25 14:34:23.645220 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1222/2324] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:23 2022] GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0 => generated 1316 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:23.670490 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ef784c16-3ade-484a-aed7-6a6deacf1cd8 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:23.670953 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ef784c16-3ade-484a-aed7-6a6deacf1cd8 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:23.671380 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b218785f-7551-4398-9a60-b52e85415282 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:23.671746 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ef784c16-3ade-484a-aed7-6a6deacf1cd8 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:23.672021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b218785f-7551-4398-9a60-b52e85415282 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 542ab1a2-380f-4f4f-95ec-5d68eb9bd091] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:23.672215 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ef784c16-3ade-484a-aed7-6a6deacf1cd8 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:23.704708 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b218785f-7551-4398-9a60-b52e85415282 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:23.705171 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b218785f-7551-4398-9a60-b52e85415282 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:23.705966 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b218785f-7551-4398-9a60-b52e85415282 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:23.706405 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b218785f-7551-4398-9a60-b52e85415282 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:24.473240 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ef784c16-3ade-484a-aed7-6a6deacf1cd8 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5313f5231c864414b7469dae709aa6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6aafe78cf4d38afff08ccedef2e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:24.486023 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ef784c16-3ade-484a-aed7-6a6deacf1cd8 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] 10.222.0.88 "GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1" status: 200 len: 1317 microversion: 2.1 time: 0.865078 Jul 25 14:34:24.486990 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1103/2325] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:23 2022] GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1 => generated 1317 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:24.496015 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-e43010f2-a216-42d2-b0ea-fe207d6e09fc req-ad4fc597-2bd8-4c7f-aeb3-1f3b8d729a3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6993d89b-7a38-42d9-b4ec-cab1a476d4d1", "name": "network-vif-plugged", "status": "completed", "tag": "e290f89d-d3dd-489e-9853-9cc2f9516d16"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:24.522216 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-e43010f2-a216-42d2-b0ea-fe207d6e09fc req-ad4fc597-2bd8-4c7f-aeb3-1f3b8d729a3f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:24.524170 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-e43010f2-a216-42d2-b0ea-fe207d6e09fc req-ad4fc597-2bd8-4c7f-aeb3-1f3b8d729a3f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:24.556055 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-e43010f2-a216-42d2-b0ea-fe207d6e09fc req-ad4fc597-2bd8-4c7f-aeb3-1f3b8d729a3f service nova] Creating event network-vif-plugged:e290f89d-d3dd-489e-9853-9cc2f9516d16 for instance 6993d89b-7a38-42d9-b4ec-cab1a476d4d1 on n-h1-846435-14 Jul 25 14:34:24.565612 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-e43010f2-a216-42d2-b0ea-fe207d6e09fc req-ad4fc597-2bd8-4c7f-aeb3-1f3b8d729a3f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076987 Jul 25 14:34:24.566873 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1104/2326] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:34:24.577483 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f3e85d5b-6fbb-41f4-b8df-53192ef1bd56 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:24.581742 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f3e85d5b-6fbb-41f4-b8df-53192ef1bd56 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:24.598842 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3e85d5b-6fbb-41f4-b8df-53192ef1bd56 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:24.600279 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3e85d5b-6fbb-41f4-b8df-53192ef1bd56 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:24.602709 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3e85d5b-6fbb-41f4-b8df-53192ef1bd56 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:24.604400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3e85d5b-6fbb-41f4-b8df-53192ef1bd56 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:24.618774 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b218785f-7551-4398-9a60-b52e85415282 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:24.629353 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b218785f-7551-4398-9a60-b52e85415282 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091" status: 200 len: 1521 microversion: 2.1 time: 0.967587 Jul 25 14:34:24.645054 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1223/2327] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:23 2022] GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091 => generated 1521 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:24.652314 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d96cb676-718d-4c70-be78-ca3437a268a3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:24.653159 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d96cb676-718d-4c70-be78-ca3437a268a3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:24.660769 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d96cb676-718d-4c70-be78-ca3437a268a3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:24.661826 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d96cb676-718d-4c70-be78-ca3437a268a3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:24.663050 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d96cb676-718d-4c70-be78-ca3437a268a3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:24.663618 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d96cb676-718d-4c70-be78-ca3437a268a3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:24.760195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d96cb676-718d-4c70-be78-ca3437a268a3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:24.775216 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d96cb676-718d-4c70-be78-ca3437a268a3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:24.776980 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d96cb676-718d-4c70-be78-ca3437a268a3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:24.778371 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d96cb676-718d-4c70-be78-ca3437a268a3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1333 microversion: 2.20 time: 0.131021 Jul 25 14:34:24.779299 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1224/2328] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:34:24 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1333 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:34:24.798436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8d4eb76e-386f-4712-93af-b0bbea1233b2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:24.799135 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8d4eb76e-386f-4712-93af-b0bbea1233b2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 6de04885-8bb7-4d85-b292-ef576bb3fcf0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:24.806340 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d4eb76e-386f-4712-93af-b0bbea1233b2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:24.806830 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d4eb76e-386f-4712-93af-b0bbea1233b2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:24.808804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d4eb76e-386f-4712-93af-b0bbea1233b2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:24.809272 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d4eb76e-386f-4712-93af-b0bbea1233b2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:25.005211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8d4eb76e-386f-4712-93af-b0bbea1233b2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:25.016857 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8d4eb76e-386f-4712-93af-b0bbea1233b2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0" status: 200 len: 1466 microversion: 2.1 time: 0.236443 Jul 25 14:34:25.017470 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1225/2329] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:24 2022] GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0 => generated 1466 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:25.049995 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c35d4eab-e2bb-40b9-b5aa-6d0233da0c42 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:25.053541 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c35d4eab-e2bb-40b9-b5aa-6d0233da0c42 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] [instance: 6de04885-8bb7-4d85-b292-ef576bb3fcf0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:25.079044 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c35d4eab-e2bb-40b9-b5aa-6d0233da0c42 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:25.079592 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c35d4eab-e2bb-40b9-b5aa-6d0233da0c42 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:25.081604 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c35d4eab-e2bb-40b9-b5aa-6d0233da0c42 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:25.082545 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c35d4eab-e2bb-40b9-b5aa-6d0233da0c42 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:25.438016 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:34:25.488759 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c35d4eab-e2bb-40b9-b5aa-6d0233da0c42 tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0" status: 200 len: 1619 microversion: 2.1 time: 0.451106 Jul 25 14:34:25.504674 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1226/2330] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:25 2022] GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0 => generated 1619 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:25.516774 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-44b3acd8-b5b3-4230-8d57-dddd32cea4d5 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:25.517419 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-44b3acd8-b5b3-4230-8d57-dddd32cea4d5 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] [instance: 6993d89b-7a38-42d9-b4ec-cab1a476d4d1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:25.528475 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-44b3acd8-b5b3-4230-8d57-dddd32cea4d5 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:25.528475 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-44b3acd8-b5b3-4230-8d57-dddd32cea4d5 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:25.529052 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-44b3acd8-b5b3-4230-8d57-dddd32cea4d5 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:25.529489 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-44b3acd8-b5b3-4230-8d57-dddd32cea4d5 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:25.730498 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f3e85d5b-6fbb-41f4-b8df-53192ef1bd56 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:25.748753 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f3e85d5b-6fbb-41f4-b8df-53192ef1bd56 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630" status: 200 len: 1674 microversion: 2.1 time: 1.180428 Jul 25 14:34:25.749594 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1105/2331] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:24 2022] GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 => generated 1674 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:25.754467 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ae759876-36cd-4320-b2f7-e7cc8400b5eb tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:25.755088 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ae759876-36cd-4320-b2f7-e7cc8400b5eb tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 542ab1a2-380f-4f4f-95ec-5d68eb9bd091] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:25.774709 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae759876-36cd-4320-b2f7-e7cc8400b5eb tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:25.778793 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae759876-36cd-4320-b2f7-e7cc8400b5eb tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:25.782992 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae759876-36cd-4320-b2f7-e7cc8400b5eb tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:25.783765 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae759876-36cd-4320-b2f7-e7cc8400b5eb tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:25.898670 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-44b3acd8-b5b3-4230-8d57-dddd32cea4d5 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5313f5231c864414b7469dae709aa6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6aafe78cf4d38afff08ccedef2e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:25.901027 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:34:25.925038 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-44b3acd8-b5b3-4230-8d57-dddd32cea4d5 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] 10.222.0.88 "GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1" status: 200 len: 1317 microversion: 2.1 time: 0.418005 Jul 25 14:34:25.925711 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1227/2332] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:25 2022] GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1 => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:25.932017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-862c2068-be3d-4015-8635-e3e9d67a98c0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-782457784", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "1a97e112-b45b-4dcb-ad9f-e979e5c183d9"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:26.039936 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-862c2068-be3d-4015-8635-e3e9d67a98c0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] validate_networks() for None {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:34:26.260901 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ae759876-36cd-4320-b2f7-e7cc8400b5eb tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:26.270573 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ae759876-36cd-4320-b2f7-e7cc8400b5eb tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091" status: 200 len: 1521 microversion: 2.1 time: 0.519667 Jul 25 14:34:26.271871 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1106/2333] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:25 2022] GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091 => generated 1521 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:26.281159 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4da5ab6b-613f-48c8-a782-a6d979a05a57 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:26.282813 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4da5ab6b-613f-48c8-a782-a6d979a05a57 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:26.293064 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4da5ab6b-613f-48c8-a782-a6d979a05a57 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:26.293515 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4da5ab6b-613f-48c8-a782-a6d979a05a57 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:26.294375 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4da5ab6b-613f-48c8-a782-a6d979a05a57 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:26.295008 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4da5ab6b-613f-48c8-a782-a6d979a05a57 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:26.452380 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4da5ab6b-613f-48c8-a782-a6d979a05a57 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:26.462739 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4da5ab6b-613f-48c8-a782-a6d979a05a57 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:26.464677 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4da5ab6b-613f-48c8-a782-a6d979a05a57 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:26.466069 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4da5ab6b-613f-48c8-a782-a6d979a05a57 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1339 microversion: 2.20 time: 0.192824 Jul 25 14:34:26.467175 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1107/2334] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:34:26 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1339 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:34:26.480612 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-862c2068-be3d-4015-8635-e3e9d67a98c0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:34:26.482350 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-862c2068-be3d-4015-8635-e3e9d67a98c0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:34:26.483021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-862c2068-be3d-4015-8635-e3e9d67a98c0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:34:26.485530 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-862c2068-be3d-4015-8635-e3e9d67a98c0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:34:26.485530 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-862c2068-be3d-4015-8635-e3e9d67a98c0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:34:26.500127 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-862c2068-be3d-4015-8635-e3e9d67a98c0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:26.500885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-862c2068-be3d-4015-8635-e3e9d67a98c0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:26.501715 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-862c2068-be3d-4015-8635-e3e9d67a98c0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:26.502147 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-862c2068-be3d-4015-8635-e3e9d67a98c0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:26.527695 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-862c2068-be3d-4015-8635-e3e9d67a98c0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for project e60b88c2aea642658a5bfc14780d5d51. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:34:26.548902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-862c2068-be3d-4015-8635-e3e9d67a98c0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Getting quotas for user ef351be3886949f9985b3244301435a9 and project e60b88c2aea642658a5bfc14780d5d51. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:34:26.575763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-862c2068-be3d-4015-8635-e3e9d67a98c0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:34:26.578882 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-862c2068-be3d-4015-8635-e3e9d67a98c0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: d553191e-ef64-4d5c-8e11-fae84f68532d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:34:26.689739 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-862c2068-be3d-4015-8635-e3e9d67a98c0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.762173 Jul 25 14:34:26.696465 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1228/2335] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:34:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:34:26.709367 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b3c5ddc2-84c0-4ee8-8ce1-07b2cfbc6673 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:26.710123 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b3c5ddc2-84c0-4ee8-8ce1-07b2cfbc6673 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: d553191e-ef64-4d5c-8e11-fae84f68532d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:26.744633 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-15caa369-eec8-42dc-8160-20a7cc7e33cb req-2e52454d-3a4d-435c-9eac-319d7dcdc071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1152d383-447a-4ffb-80b7-9b5f2b816630", "name": "network-vif-deleted", "tag": "e9c737db-06e2-4826-83a4-996006b99e6d"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:26.763554 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-15caa369-eec8-42dc-8160-20a7cc7e33cb req-2e52454d-3a4d-435c-9eac-319d7dcdc071 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:26.769174 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-15caa369-eec8-42dc-8160-20a7cc7e33cb req-2e52454d-3a4d-435c-9eac-319d7dcdc071 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:26.811764 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-15caa369-eec8-42dc-8160-20a7cc7e33cb req-2e52454d-3a4d-435c-9eac-319d7dcdc071 service nova] Creating event network-vif-deleted:e9c737db-06e2-4826-83a4-996006b99e6d for instance 1152d383-447a-4ffb-80b7-9b5f2b816630 on n-h2-846435-14 Jul 25 14:34:26.824802 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-15caa369-eec8-42dc-8160-20a7cc7e33cb req-2e52454d-3a4d-435c-9eac-319d7dcdc071 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084624 Jul 25 14:34:26.825954 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1229/2336] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:34:26.835527 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b3c5ddc2-84c0-4ee8-8ce1-07b2cfbc6673 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:26.841312 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8be7239a-94d8-488e-a743-7b7d50622549 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:26.842391 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8be7239a-94d8-488e-a743-7b7d50622549 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:26.843273 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b3c5ddc2-84c0-4ee8-8ce1-07b2cfbc6673 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d" status: 200 len: 1216 microversion: 2.1 time: 0.139611 Jul 25 14:34:26.863032 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8be7239a-94d8-488e-a743-7b7d50622549 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:26.863840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8be7239a-94d8-488e-a743-7b7d50622549 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:26.865441 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8be7239a-94d8-488e-a743-7b7d50622549 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:26.867174 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8be7239a-94d8-488e-a743-7b7d50622549 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:26.867647 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1108/2337] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:26 2022] GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d => generated 1216 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:26.946722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7b2ca17c-f9d0-4694-b9fa-090bc31a4c02 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:26.947394 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7b2ca17c-f9d0-4694-b9fa-090bc31a4c02 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] [instance: 6993d89b-7a38-42d9-b4ec-cab1a476d4d1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:26.970110 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b2ca17c-f9d0-4694-b9fa-090bc31a4c02 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:26.970603 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b2ca17c-f9d0-4694-b9fa-090bc31a4c02 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:26.971575 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b2ca17c-f9d0-4694-b9fa-090bc31a4c02 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:26.972248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b2ca17c-f9d0-4694-b9fa-090bc31a4c02 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:27.223138 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8be7239a-94d8-488e-a743-7b7d50622549 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:27.239140 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8be7239a-94d8-488e-a743-7b7d50622549 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630" status: 200 len: 1495 microversion: 2.1 time: 0.408756 Jul 25 14:34:27.245597 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1230/2338] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:26 2022] GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 => generated 1495 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:27.294640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-97477e83-9bb5-4d3b-8cf4-7592e3456a9a tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:27.295257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-97477e83-9bb5-4d3b-8cf4-7592e3456a9a tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 542ab1a2-380f-4f4f-95ec-5d68eb9bd091] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:27.302277 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-97477e83-9bb5-4d3b-8cf4-7592e3456a9a tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:27.309661 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-97477e83-9bb5-4d3b-8cf4-7592e3456a9a tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:27.310510 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-97477e83-9bb5-4d3b-8cf4-7592e3456a9a tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:27.311106 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-97477e83-9bb5-4d3b-8cf4-7592e3456a9a tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:27.566124 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-97477e83-9bb5-4d3b-8cf4-7592e3456a9a tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:27.575698 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-97477e83-9bb5-4d3b-8cf4-7592e3456a9a tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091" status: 200 len: 1498 microversion: 2.1 time: 0.284907 Jul 25 14:34:27.577133 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1231/2339] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:27 2022] GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091 => generated 1498 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:27.583193 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-49d1eda9-297c-476c-936f-762241b416d5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:27.584037 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-49d1eda9-297c-476c-936f-762241b416d5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:27.591873 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-49d1eda9-297c-476c-936f-762241b416d5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:27.592961 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-49d1eda9-297c-476c-936f-762241b416d5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:27.594016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-49d1eda9-297c-476c-936f-762241b416d5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:27.594596 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-49d1eda9-297c-476c-936f-762241b416d5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:27.662126 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7b2ca17c-f9d0-4694-b9fa-090bc31a4c02 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5313f5231c864414b7469dae709aa6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6aafe78cf4d38afff08ccedef2e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:27.669947 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7b2ca17c-f9d0-4694-b9fa-090bc31a4c02 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] 10.222.0.88 "GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1" status: 200 len: 1317 microversion: 2.1 time: 0.727093 Jul 25 14:34:27.671087 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1109/2340] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:26 2022] GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1 => generated 1317 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:27.676261 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-64664020-240a-459c-94c9-e54804b479e7 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:27.681570 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-64664020-240a-459c-94c9-e54804b479e7 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:27.682788 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-64664020-240a-459c-94c9-e54804b479e7 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '2383030b07e34f93b9637c637f8f0ae7'} {{(pid=119303) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:34:27.692293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-64664020-240a-459c-94c9-e54804b479e7 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:27.692752 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-64664020-240a-459c-94c9-e54804b479e7 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:27.693615 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-64664020-240a-459c-94c9-e54804b479e7 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:27.694276 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-64664020-240a-459c-94c9-e54804b479e7 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:27.740358 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.multi_cell_list [None req-64664020-240a-459c-94c9-e54804b479e7 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119303) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:34:27.798843 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-64664020-240a-459c-94c9-e54804b479e7 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.125319 Jul 25 14:34:27.800132 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1110/2341] 10.222.0.88 () {58 vars in 1154 bytes} [Mon Jul 25 14:34:27 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:34:27.813713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-49d1eda9-297c-476c-936f-762241b416d5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:27.819920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2a77f1a5-6bd6-46b8-9976-bcd29232099e tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:27.827808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-49d1eda9-297c-476c-936f-762241b416d5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:27.829190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-49d1eda9-297c-476c-936f-762241b416d5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:27.830451 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-49d1eda9-297c-476c-936f-762241b416d5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1407 microversion: 2.20 time: 0.252126 Jul 25 14:34:27.831083 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1232/2342] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:34:27 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:34:27.837172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a77f1a5-6bd6-46b8-9976-bcd29232099e tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:27.838291 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a77f1a5-6bd6-46b8-9976-bcd29232099e tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:27.868172 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e6cb527c-2baa-460f-ab45-b2cb5306cbeb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:27.869400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e6cb527c-2baa-460f-ab45-b2cb5306cbeb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: d553191e-ef64-4d5c-8e11-fae84f68532d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:27.887965 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6cb527c-2baa-460f-ab45-b2cb5306cbeb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:27.888439 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6cb527c-2baa-460f-ab45-b2cb5306cbeb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:27.889431 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6cb527c-2baa-460f-ab45-b2cb5306cbeb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:27.890049 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6cb527c-2baa-460f-ab45-b2cb5306cbeb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:27.925482 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2a77f1a5-6bd6-46b8-9976-bcd29232099e tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 542ab1a2-380f-4f4f-95ec-5d68eb9bd091] Going to try to start instance {{(pid=119303) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 14:34:28.005699 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2a77f1a5-6bd6-46b8-9976-bcd29232099e tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "POST /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091/action" status: 202 len: 0 microversion: 2.1 time: 0.197854 Jul 25 14:34:28.006324 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1111/2343] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:34:27 2022] POST /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 14:34:28.015344 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3cf82298-5991-4649-87bb-4c9be754f4db tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:28.016315 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3cf82298-5991-4649-87bb-4c9be754f4db tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 542ab1a2-380f-4f4f-95ec-5d68eb9bd091] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:28.027735 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3cf82298-5991-4649-87bb-4c9be754f4db tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:28.028336 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3cf82298-5991-4649-87bb-4c9be754f4db tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:28.029133 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3cf82298-5991-4649-87bb-4c9be754f4db tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:28.029569 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3cf82298-5991-4649-87bb-4c9be754f4db tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:28.040655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e6cb527c-2baa-460f-ab45-b2cb5306cbeb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:28.058766 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e6cb527c-2baa-460f-ab45-b2cb5306cbeb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d" status: 200 len: 1268 microversion: 2.1 time: 0.194387 Jul 25 14:34:28.059381 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1233/2344] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:27 2022] GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d => generated 1268 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:28.262865 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4314c7b0-3c04-4f0b-af1b-a866282e98c1 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:28.264284 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4314c7b0-3c04-4f0b-af1b-a866282e98c1 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:28.272833 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4314c7b0-3c04-4f0b-af1b-a866282e98c1 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:28.273997 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4314c7b0-3c04-4f0b-af1b-a866282e98c1 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:28.274652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4314c7b0-3c04-4f0b-af1b-a866282e98c1 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:28.275173 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4314c7b0-3c04-4f0b-af1b-a866282e98c1 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:28.668888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4314c7b0-3c04-4f0b-af1b-a866282e98c1 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:28.679441 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4314c7b0-3c04-4f0b-af1b-a866282e98c1 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630" status: 200 len: 1495 microversion: 2.1 time: 0.420911 Jul 25 14:34:28.680644 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1234/2345] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:28 2022] GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 => generated 1495 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:28.685999 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-0e99858c-d7d2-4c59-8c73-70d53b772c66 req-9fb12d3d-e4f9-4e84-8154-59aba28c14f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1009be4-53ff-4893-836c-ba96f07a0d60", "tag": "a70f2535-e346-4125-80e5-abda9464ab7e"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:28.701146 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-0e99858c-d7d2-4c59-8c73-70d53b772c66 req-9fb12d3d-e4f9-4e84-8154-59aba28c14f0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:28.701632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-0e99858c-d7d2-4c59-8c73-70d53b772c66 req-9fb12d3d-e4f9-4e84-8154-59aba28c14f0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:28.719740 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-0e99858c-d7d2-4c59-8c73-70d53b772c66 req-9fb12d3d-e4f9-4e84-8154-59aba28c14f0 service nova] Creating event network-changed:a70f2535-e346-4125-80e5-abda9464ab7e for instance f1009be4-53ff-4893-836c-ba96f07a0d60 on n-h2-846435-14 Jul 25 14:34:28.725174 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-0e99858c-d7d2-4c59-8c73-70d53b772c66 req-9fb12d3d-e4f9-4e84-8154-59aba28c14f0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043058 Jul 25 14:34:28.726438 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1235/2346] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:34:28.732901 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-24a7365b-bbc0-4c20-a5af-5364083cb0e2 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:28.733898 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-24a7365b-bbc0-4c20-a5af-5364083cb0e2 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] [instance: 6993d89b-7a38-42d9-b4ec-cab1a476d4d1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:28.743859 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-24a7365b-bbc0-4c20-a5af-5364083cb0e2 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:28.744396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-24a7365b-bbc0-4c20-a5af-5364083cb0e2 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:28.745209 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-24a7365b-bbc0-4c20-a5af-5364083cb0e2 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:28.745648 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-24a7365b-bbc0-4c20-a5af-5364083cb0e2 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:29.018523 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-24a7365b-bbc0-4c20-a5af-5364083cb0e2 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5313f5231c864414b7469dae709aa6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6aafe78cf4d38afff08ccedef2e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:29.044768 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-24a7365b-bbc0-4c20-a5af-5364083cb0e2 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] 10.222.0.88 "GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1" status: 200 len: 1505 microversion: 2.1 time: 0.316888 Jul 25 14:34:29.047940 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1236/2347] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:28 2022] GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1 => generated 1505 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:29.066206 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a64257a2-dc83-4da1-9c5a-4d29db9599ba tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:29.067755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a64257a2-dc83-4da1-9c5a-4d29db9599ba tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:29.087191 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3cf82298-5991-4649-87bb-4c9be754f4db tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:29.087692 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a64257a2-dc83-4da1-9c5a-4d29db9599ba tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:29.088240 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a64257a2-dc83-4da1-9c5a-4d29db9599ba tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:29.089021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a64257a2-dc83-4da1-9c5a-4d29db9599ba tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:29.089459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a64257a2-dc83-4da1-9c5a-4d29db9599ba tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:29.100225 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3cf82298-5991-4649-87bb-4c9be754f4db tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091" status: 200 len: 1507 microversion: 2.1 time: 1.088977 Jul 25 14:34:29.104294 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1112/2348] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:28 2022] GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091 => generated 1507 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:29.114968 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cba10fe3-cd69-471d-a508-d63b3efd46da tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:29.117894 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cba10fe3-cd69-471d-a508-d63b3efd46da tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] [instance: 6993d89b-7a38-42d9-b4ec-cab1a476d4d1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:29.134592 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cba10fe3-cd69-471d-a508-d63b3efd46da tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:29.135081 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cba10fe3-cd69-471d-a508-d63b3efd46da tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:29.135884 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cba10fe3-cd69-471d-a508-d63b3efd46da tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:29.136349 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cba10fe3-cd69-471d-a508-d63b3efd46da tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:29.188708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cba10fe3-cd69-471d-a508-d63b3efd46da tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '5313f5231c864414b7469dae709aa6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6aafe78cf4d38afff08ccedef2e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:29.189902 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cba10fe3-cd69-471d-a508-d63b3efd46da tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] 10.222.0.88 "GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1/os-instance-actions/req-34149fbd-d09b-46f8-a217-67438a053161" status: 200 len: 313 microversion: 2.1 time: 0.084452 Jul 25 14:34:29.190946 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1113/2349] 10.222.0.88 () {58 vars in 1419 bytes} [Mon Jul 25 14:34:29 2022] GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1/os-instance-actions/req-34149fbd-d09b-46f8-a217-67438a053161 => generated 313 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:34:29.196724 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-67d65ecd-f7d1-4a3e-8360-acee7d52c896 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:29.197686 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-67d65ecd-f7d1-4a3e-8360-acee7d52c896 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: d553191e-ef64-4d5c-8e11-fae84f68532d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:29.206519 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-67d65ecd-f7d1-4a3e-8360-acee7d52c896 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:29.207375 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-67d65ecd-f7d1-4a3e-8360-acee7d52c896 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:29.208480 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-67d65ecd-f7d1-4a3e-8360-acee7d52c896 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:29.212361 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-67d65ecd-f7d1-4a3e-8360-acee7d52c896 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:29.633421 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-67d65ecd-f7d1-4a3e-8360-acee7d52c896 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:29.642265 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-67d65ecd-f7d1-4a3e-8360-acee7d52c896 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d" status: 200 len: 1274 microversion: 2.1 time: 0.449867 Jul 25 14:34:29.656053 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1114/2350] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:29 2022] GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d => generated 1274 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:29.656053 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8e9ff7ee-ac80-492a-807f-350b96d034c6 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:29.656053 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8e9ff7ee-ac80-492a-807f-350b96d034c6 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] [instance: 6993d89b-7a38-42d9-b4ec-cab1a476d4d1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:29.662099 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8e9ff7ee-ac80-492a-807f-350b96d034c6 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:29.662882 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8e9ff7ee-ac80-492a-807f-350b96d034c6 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:29.663742 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8e9ff7ee-ac80-492a-807f-350b96d034c6 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:29.664556 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8e9ff7ee-ac80-492a-807f-350b96d034c6 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:29.689323 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a64257a2-dc83-4da1-9c5a-4d29db9599ba tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:29.715422 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a64257a2-dc83-4da1-9c5a-4d29db9599ba tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:29.727679 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a64257a2-dc83-4da1-9c5a-4d29db9599ba tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:29.729885 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a64257a2-dc83-4da1-9c5a-4d29db9599ba tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1407 microversion: 2.20 time: 0.680605 Jul 25 14:34:29.731051 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1237/2351] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:34:29 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1407 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:34:29.745372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-6a0dad15-4a7a-4c1b-a45f-607259795638 req-098191ad-1fc5-4831-83bf-362a7136233c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1152d383-447a-4ffb-80b7-9b5f2b816630", "name": "network-vif-deleted", "tag": "ebcf73c2-ddd3-4578-8aac-087c5351795f"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:29.773392 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-6a0dad15-4a7a-4c1b-a45f-607259795638 req-098191ad-1fc5-4831-83bf-362a7136233c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:29.774194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-6a0dad15-4a7a-4c1b-a45f-607259795638 req-098191ad-1fc5-4831-83bf-362a7136233c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:29.797059 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8e9ff7ee-ac80-492a-807f-350b96d034c6 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] 10.222.0.88 "POST /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1/action" status: 202 len: 0 microversion: 2.1 time: 0.150850 Jul 25 14:34:29.798881 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1115/2352] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:34:29 2022] POST /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:34:29.818932 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3adf584b-e877-45f6-bb4e-3d7c7513a325 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:29.820630 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3adf584b-e877-45f6-bb4e-3d7c7513a325 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:29.830227 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-6a0dad15-4a7a-4c1b-a45f-607259795638 req-098191ad-1fc5-4831-83bf-362a7136233c service nova] Creating event network-vif-deleted:ebcf73c2-ddd3-4578-8aac-087c5351795f for instance 1152d383-447a-4ffb-80b7-9b5f2b816630 on n-h2-846435-14 Jul 25 14:34:29.834505 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3adf584b-e877-45f6-bb4e-3d7c7513a325 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:29.835368 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3adf584b-e877-45f6-bb4e-3d7c7513a325 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:29.842957 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-6a0dad15-4a7a-4c1b-a45f-607259795638 req-098191ad-1fc5-4831-83bf-362a7136233c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107181 Jul 25 14:34:29.843764 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1238/2353] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:34:29.852216 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3adf584b-e877-45f6-bb4e-3d7c7513a325 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:29.852813 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3adf584b-e877-45f6-bb4e-3d7c7513a325 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:29.857698 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-667b1fe2-4532-49a6-9b7a-090cd0fa7545 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:29.859605 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-667b1fe2-4532-49a6-9b7a-090cd0fa7545 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] [instance: 6993d89b-7a38-42d9-b4ec-cab1a476d4d1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:29.880767 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-667b1fe2-4532-49a6-9b7a-090cd0fa7545 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:29.881568 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-667b1fe2-4532-49a6-9b7a-090cd0fa7545 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:29.883028 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-667b1fe2-4532-49a6-9b7a-090cd0fa7545 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:29.886496 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-667b1fe2-4532-49a6-9b7a-090cd0fa7545 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:29.958303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3adf584b-e877-45f6-bb4e-3d7c7513a325 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:29.958303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3adf584b-e877-45f6-bb4e-3d7c7513a325 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:29.958693 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-3adf584b-e877-45f6-bb4e-3d7c7513a325 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lazy-loading 'fault' on Instance uuid 1152d383-447a-4ffb-80b7-9b5f2b816630 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:34:30.121718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3adf584b-e877-45f6-bb4e-3d7c7513a325 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2beeccba594f01b83983a2ec729a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b46dd05384e47a74bfaa8dc3c838f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:30.131826 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3adf584b-e877-45f6-bb4e-3d7c7513a325 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630" status: 200 len: 1302 microversion: 2.1 time: 0.331111 Jul 25 14:34:30.133297 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1116/2354] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:29 2022] GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 => generated 1302 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:30.139474 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c35b7fc8-c618-4f8b-a192-6167279ee284 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:30.140369 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c35b7fc8-c618-4f8b-a192-6167279ee284 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 542ab1a2-380f-4f4f-95ec-5d68eb9bd091] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:30.149337 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c35b7fc8-c618-4f8b-a192-6167279ee284 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:30.149942 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c35b7fc8-c618-4f8b-a192-6167279ee284 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:30.151863 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c35b7fc8-c618-4f8b-a192-6167279ee284 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:30.152948 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c35b7fc8-c618-4f8b-a192-6167279ee284 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:30.182128 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:34:30.330833 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-667b1fe2-4532-49a6-9b7a-090cd0fa7545 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5313f5231c864414b7469dae709aa6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6aafe78cf4d38afff08ccedef2e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:30.345190 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-667b1fe2-4532-49a6-9b7a-090cd0fa7545 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] 10.222.0.88 "GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1" status: 200 len: 1507 microversion: 2.1 time: 0.499238 Jul 25 14:34:30.363058 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1239/2355] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:29 2022] GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1 => generated 1507 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:30.666302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f7e1a77a-d3bd-49d8-a96e-f265aa5365cd tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:30.667016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f7e1a77a-d3bd-49d8-a96e-f265aa5365cd tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: d553191e-ef64-4d5c-8e11-fae84f68532d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:30.674812 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f7e1a77a-d3bd-49d8-a96e-f265aa5365cd tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:30.675475 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f7e1a77a-d3bd-49d8-a96e-f265aa5365cd tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:30.675663 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c35b7fc8-c618-4f8b-a192-6167279ee284 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:30.677170 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f7e1a77a-d3bd-49d8-a96e-f265aa5365cd tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:30.678360 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f7e1a77a-d3bd-49d8-a96e-f265aa5365cd tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:30.686807 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c35b7fc8-c618-4f8b-a192-6167279ee284 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091" status: 200 len: 1507 microversion: 2.1 time: 0.551136 Jul 25 14:34:30.687464 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1117/2356] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:30 2022] GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091 => generated 1507 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:30.754685 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f0d5af10-0cf0-4f17-a5a6-72cae2274218 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:30.755305 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f0d5af10-0cf0-4f17-a5a6-72cae2274218 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:30.762290 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f0d5af10-0cf0-4f17-a5a6-72cae2274218 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:30.763000 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f0d5af10-0cf0-4f17-a5a6-72cae2274218 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:30.763989 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f0d5af10-0cf0-4f17-a5a6-72cae2274218 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:30.764625 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f0d5af10-0cf0-4f17-a5a6-72cae2274218 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:30.831501 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f7e1a77a-d3bd-49d8-a96e-f265aa5365cd tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:30.843746 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f7e1a77a-d3bd-49d8-a96e-f265aa5365cd tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d" status: 200 len: 1316 microversion: 2.1 time: 0.181847 Jul 25 14:34:30.844483 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1240/2357] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:30 2022] GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d => generated 1316 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:31.151807 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f0d5af10-0cf0-4f17-a5a6-72cae2274218 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:31.155102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-09c4a45b-e739-46ee-a5c2-8e609f8d4d07 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:31.156316 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-09c4a45b-e739-46ee-a5c2-8e609f8d4d07 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:31.160416 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f0d5af10-0cf0-4f17-a5a6-72cae2274218 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:31.162324 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f0d5af10-0cf0-4f17-a5a6-72cae2274218 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:31.163491 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f0d5af10-0cf0-4f17-a5a6-72cae2274218 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1407 microversion: 2.20 time: 0.412937 Jul 25 14:34:31.166797 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09c4a45b-e739-46ee-a5c2-8e609f8d4d07 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:31.167402 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09c4a45b-e739-46ee-a5c2-8e609f8d4d07 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:31.168380 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09c4a45b-e739-46ee-a5c2-8e609f8d4d07 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:31.169404 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09c4a45b-e739-46ee-a5c2-8e609f8d4d07 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:31.179036 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1118/2358] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:34:30 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1407 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:34:31.186286 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-09c4a45b-e739-46ee-a5c2-8e609f8d4d07 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] HTTP exception thrown: Instance 1152d383-447a-4ffb-80b7-9b5f2b816630 could not be found. Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-09c4a45b-e739-46ee-a5c2-8e609f8d4d07 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Request method failure captured: Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 HTTP/1.1 Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qmFYWx9KOzJ47zTj_xy6_dMrFe8mbVr2eoxoU4fBSAvPaL6_V18DrJCqhfAaWe_brOymODzcadm8auFn0b-SnaSOztIL6209Kms93pKFTQlQDxx0IWHS2k5X8je65H4G7DaIrFeaLZIOx04kvq1FpfZo9y_MxArgBJ39whS-uFZ1kc Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 041b46dd05384e47a74bfaa8dc3c838f Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersTestMultiNic-1424548640 Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/041b46dd05384e47a74bfaa8dc3c838f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/041b46dd05384e47a74bfaa8dc3c838f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_041b46dd05384e47a74bfaa8dc3c838f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/041b46dd05384e47a74bfaa8dc3c838f"}]}] Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersTestMultiNic-1424548640 Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 041b46dd05384e47a74bfaa8dc3c838f Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersTestMultiNic-1424548640 Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersTestMultiNic-1424548640-project Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 3e2beeccba594f01b83983a2ec729a98 Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersTestMultiNic-1424548640-project Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 1152d383-447a-4ffb-80b7-9b5f2b816630 could not be found. Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '1152d383-447a-4ffb-80b7-9b5f2b816630'} Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1152d383-447a-4ffb-80b7-9b5f2b816630 could not be found. Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1152d383-447a-4ffb-80b7-9b5f2b816630 could not be found. Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:34:31.187996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:31.192378 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:31.192378 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:34:31.192378 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:34:31.192378 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:34:31.192378 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:34:31.192378 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1152d383-447a-4ffb-80b7-9b5f2b816630 could not be found. Jul 25 14:34:31.192378 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:31.192378 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-09c4a45b-e739-46ee-a5c2-8e609f8d4d07 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Returning 404 to user: Instance 1152d383-447a-4ffb-80b7-9b5f2b816630 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:34:31.192378 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-09c4a45b-e739-46ee-a5c2-8e609f8d4d07 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630" status: 404 len: 111 microversion: 2.1 time: 0.039673 Jul 25 14:34:31.203797 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1241/2359] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:31 2022] GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:34:31.370363 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b97472ab-da36-4609-bf46-9724f87b9377 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:31.370990 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b97472ab-da36-4609-bf46-9724f87b9377 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] [instance: 6993d89b-7a38-42d9-b4ec-cab1a476d4d1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:31.383631 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b97472ab-da36-4609-bf46-9724f87b9377 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:31.384070 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b97472ab-da36-4609-bf46-9724f87b9377 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:31.384939 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b97472ab-da36-4609-bf46-9724f87b9377 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:31.385383 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b97472ab-da36-4609-bf46-9724f87b9377 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:31.708664 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-eb295edf-2019-4a08-9f4e-0964268bf43b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:31.708929 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-eb295edf-2019-4a08-9f4e-0964268bf43b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 542ab1a2-380f-4f4f-95ec-5d68eb9bd091] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:31.717400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eb295edf-2019-4a08-9f4e-0964268bf43b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:31.718208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eb295edf-2019-4a08-9f4e-0964268bf43b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:31.719201 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eb295edf-2019-4a08-9f4e-0964268bf43b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:31.719853 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eb295edf-2019-4a08-9f4e-0964268bf43b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:31.924123 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-eb295edf-2019-4a08-9f4e-0964268bf43b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:31.938630 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-eb295edf-2019-4a08-9f4e-0964268bf43b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091" status: 200 len: 1507 microversion: 2.1 time: 0.230942 Jul 25 14:34:31.942629 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1242/2360] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:31 2022] GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091 => generated 1507 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:31.954433 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6cb8565b-c3db-454e-872b-cb663bd29e83 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:31.957101 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6cb8565b-c3db-454e-872b-cb663bd29e83 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: d553191e-ef64-4d5c-8e11-fae84f68532d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:31.973665 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6cb8565b-c3db-454e-872b-cb663bd29e83 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:31.974128 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6cb8565b-c3db-454e-872b-cb663bd29e83 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:31.974921 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6cb8565b-c3db-454e-872b-cb663bd29e83 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:31.975350 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6cb8565b-c3db-454e-872b-cb663bd29e83 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:32.193302 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b97472ab-da36-4609-bf46-9724f87b9377 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5313f5231c864414b7469dae709aa6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6aafe78cf4d38afff08ccedef2e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:32.218308 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b97472ab-da36-4609-bf46-9724f87b9377 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] 10.222.0.88 "GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1" status: 200 len: 1507 microversion: 2.1 time: 0.851964 Jul 25 14:34:32.219804 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1119/2361] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:31 2022] GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1 => generated 1507 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:32.225435 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d58ac0ed-5157-480e-9c04-8771c448c648 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:32.226343 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d58ac0ed-5157-480e-9c04-8771c448c648 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:32.233330 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d58ac0ed-5157-480e-9c04-8771c448c648 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:32.234195 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d58ac0ed-5157-480e-9c04-8771c448c648 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:32.235265 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d58ac0ed-5157-480e-9c04-8771c448c648 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:32.248708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d58ac0ed-5157-480e-9c04-8771c448c648 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:32.515268 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d58ac0ed-5157-480e-9c04-8771c448c648 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:32.527717 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d58ac0ed-5157-480e-9c04-8771c448c648 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:32.529423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d58ac0ed-5157-480e-9c04-8771c448c648 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:32.530721 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d58ac0ed-5157-480e-9c04-8771c448c648 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1407 microversion: 2.20 time: 0.309292 Jul 25 14:34:32.531401 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1120/2362] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:34:32 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1407 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:34:32.817192 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6cb8565b-c3db-454e-872b-cb663bd29e83 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:32.830390 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6cb8565b-c3db-454e-872b-cb663bd29e83 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d" status: 200 len: 1316 microversion: 2.1 time: 0.885889 Jul 25 14:34:32.842553 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1243/2363] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:31 2022] GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d => generated 1316 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:32.962772 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f85b887e-23c5-40f9-af38-c9d404cb3027 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:32.963460 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f85b887e-23c5-40f9-af38-c9d404cb3027 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 542ab1a2-380f-4f4f-95ec-5d68eb9bd091] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:32.969747 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f85b887e-23c5-40f9-af38-c9d404cb3027 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:32.970177 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f85b887e-23c5-40f9-af38-c9d404cb3027 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:32.970975 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f85b887e-23c5-40f9-af38-c9d404cb3027 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:32.971407 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f85b887e-23c5-40f9-af38-c9d404cb3027 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:33.240418 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-970276b4-a96f-4dae-8315-3d71fcaec8ba tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:33.241934 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-970276b4-a96f-4dae-8315-3d71fcaec8ba tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] [instance: 6993d89b-7a38-42d9-b4ec-cab1a476d4d1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:33.258109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-970276b4-a96f-4dae-8315-3d71fcaec8ba tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:33.262368 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-970276b4-a96f-4dae-8315-3d71fcaec8ba tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:33.263411 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-970276b4-a96f-4dae-8315-3d71fcaec8ba tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:33.264571 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-970276b4-a96f-4dae-8315-3d71fcaec8ba tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:33.302972 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f85b887e-23c5-40f9-af38-c9d404cb3027 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:33.310795 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f85b887e-23c5-40f9-af38-c9d404cb3027 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091" status: 200 len: 1507 microversion: 2.1 time: 0.351872 Jul 25 14:34:33.311386 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1121/2364] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:32 2022] GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091 => generated 1507 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:33.554970 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0f13b72c-3508-49e9-ba4a-27c46f6e66b5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:33.555875 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0f13b72c-3508-49e9-ba4a-27c46f6e66b5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:33.559206 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-970276b4-a96f-4dae-8315-3d71fcaec8ba tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5313f5231c864414b7469dae709aa6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6aafe78cf4d38afff08ccedef2e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:33.575236 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f13b72c-3508-49e9-ba4a-27c46f6e66b5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:33.580134 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f13b72c-3508-49e9-ba4a-27c46f6e66b5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:33.581253 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f13b72c-3508-49e9-ba4a-27c46f6e66b5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:33.582000 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-970276b4-a96f-4dae-8315-3d71fcaec8ba tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] 10.222.0.88 "GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1" status: 200 len: 1505 microversion: 2.1 time: 0.343329 Jul 25 14:34:33.582224 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f13b72c-3508-49e9-ba4a-27c46f6e66b5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:33.583905 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1244/2365] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:33 2022] GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1 => generated 1505 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:33.610407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1cb3808b-98db-4f33-a2a0-76b3ab3dea87 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Calling method '.version_select at 0x7f46877059d0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:33.611198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1cb3808b-98db-4f33-a2a0-76b3ab3dea87 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] [instance: 6993d89b-7a38-42d9-b4ec-cab1a476d4d1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:33.622623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1cb3808b-98db-4f33-a2a0-76b3ab3dea87 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:33.623126 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1cb3808b-98db-4f33-a2a0-76b3ab3dea87 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:33.623960 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1cb3808b-98db-4f33-a2a0-76b3ab3dea87 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:33.624593 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1cb3808b-98db-4f33-a2a0-76b3ab3dea87 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:33.670763 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1cb3808b-98db-4f33-a2a0-76b3ab3dea87 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] 10.222.0.88 "GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.069277 Jul 25 14:34:33.672495 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1245/2366] 10.222.0.88 () {58 vars in 1296 bytes} [Mon Jul 25 14:34:33 2022] GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1/os-instance-actions => generated 611 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:34:33.698331 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9c71ff07-0b93-483d-b3ff-2e069b1eee5b tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:33.699103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9c71ff07-0b93-483d-b3ff-2e069b1eee5b tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] [instance: 6993d89b-7a38-42d9-b4ec-cab1a476d4d1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:33.710303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9c71ff07-0b93-483d-b3ff-2e069b1eee5b tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:33.710753 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9c71ff07-0b93-483d-b3ff-2e069b1eee5b tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:33.713235 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9c71ff07-0b93-483d-b3ff-2e069b1eee5b tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:33.713691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9c71ff07-0b93-483d-b3ff-2e069b1eee5b tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:33.777492 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9c71ff07-0b93-483d-b3ff-2e069b1eee5b tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] [instance: 6993d89b-7a38-42d9-b4ec-cab1a476d4d1] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:34:33.838505 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:34:33.867921 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0f13b72c-3508-49e9-ba4a-27c46f6e66b5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:33.882212 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0f13b72c-3508-49e9-ba4a-27c46f6e66b5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:33.885176 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0f13b72c-3508-49e9-ba4a-27c46f6e66b5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:33.886766 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0f13b72c-3508-49e9-ba4a-27c46f6e66b5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1407 microversion: 2.20 time: 0.335867 Jul 25 14:34:33.889191 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1122/2367] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:34:33 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1407 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:34:33.894281 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c9bcc9e6-5f7f-41f1-9b32-5df1d7bfce60 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:33.895266 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c9bcc9e6-5f7f-41f1-9b32-5df1d7bfce60 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:33.924048 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c9bcc9e6-5f7f-41f1-9b32-5df1d7bfce60 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:33.924920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c9bcc9e6-5f7f-41f1-9b32-5df1d7bfce60 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:33.925785 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9c71ff07-0b93-483d-b3ff-2e069b1eee5b tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] 10.222.0.88 "DELETE /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1" status: 204 len: 0 microversion: 2.1 time: 0.238988 Jul 25 14:34:33.929968 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c9bcc9e6-5f7f-41f1-9b32-5df1d7bfce60 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:33.930145 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1246/2368] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:34:33 2022] DELETE /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:34:33.932768 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c9bcc9e6-5f7f-41f1-9b32-5df1d7bfce60 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:33.946249 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2266f984-c9f4-416a-ac61-75d91b24efa9 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:33.948262 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2266f984-c9f4-416a-ac61-75d91b24efa9 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: d553191e-ef64-4d5c-8e11-fae84f68532d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:33.964500 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2266f984-c9f4-416a-ac61-75d91b24efa9 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:33.968893 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2266f984-c9f4-416a-ac61-75d91b24efa9 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:33.973705 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2266f984-c9f4-416a-ac61-75d91b24efa9 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:33.975773 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2266f984-c9f4-416a-ac61-75d91b24efa9 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:34.386496 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c9bcc9e6-5f7f-41f1-9b32-5df1d7bfce60 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1861 microversion: 2.1 time: 0.495890 Jul 25 14:34:34.387912 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1123/2369] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:33 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1861 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:34.392862 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2c15c7bf-1eca-4b9b-83a9-9b2685015d11 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:34.396296 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2c15c7bf-1eca-4b9b-83a9-9b2685015d11 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] [instance: 6993d89b-7a38-42d9-b4ec-cab1a476d4d1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:34.412500 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c15c7bf-1eca-4b9b-83a9-9b2685015d11 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:34.416333 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c15c7bf-1eca-4b9b-83a9-9b2685015d11 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:34.417373 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c15c7bf-1eca-4b9b-83a9-9b2685015d11 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:34.418532 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c15c7bf-1eca-4b9b-83a9-9b2685015d11 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:34.426789 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2266f984-c9f4-416a-ac61-75d91b24efa9 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:34.452944 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2266f984-c9f4-416a-ac61-75d91b24efa9 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d" status: 200 len: 1316 microversion: 2.1 time: 0.521689 Jul 25 14:34:34.453603 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1247/2370] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:33 2022] GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d => generated 1316 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:34.460288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-faaa8b16-3b9d-49cd-ae0c-5abcc400fbe1 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:34.461237 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-faaa8b16-3b9d-49cd-ae0c-5abcc400fbe1 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 542ab1a2-380f-4f4f-95ec-5d68eb9bd091] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:34.469312 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-faaa8b16-3b9d-49cd-ae0c-5abcc400fbe1 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:34.470033 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-faaa8b16-3b9d-49cd-ae0c-5abcc400fbe1 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:34.471297 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-faaa8b16-3b9d-49cd-ae0c-5abcc400fbe1 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:34.472022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-faaa8b16-3b9d-49cd-ae0c-5abcc400fbe1 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:34.695286 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2c15c7bf-1eca-4b9b-83a9-9b2685015d11 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5313f5231c864414b7469dae709aa6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6aafe78cf4d38afff08ccedef2e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:34.712739 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2c15c7bf-1eca-4b9b-83a9-9b2685015d11 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] 10.222.0.88 "GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1" status: 200 len: 1511 microversion: 2.1 time: 0.323351 Jul 25 14:34:34.713459 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1124/2371] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:34 2022] GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1 => generated 1511 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:34.745337 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-577408e3-b208-4a6a-a1aa-376b0fbdd284 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-846435-14", "block_migration": true, "disk_over_commit": false}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:34.752687 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-577408e3-b208-4a6a-a1aa-376b0fbdd284 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:34.769083 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-577408e3-b208-4a6a-a1aa-376b0fbdd284 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:34.770898 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-577408e3-b208-4a6a-a1aa-376b0fbdd284 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:34.775858 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-577408e3-b208-4a6a-a1aa-376b0fbdd284 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:34.776497 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-577408e3-b208-4a6a-a1aa-376b0fbdd284 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:34.832711 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-577408e3-b208-4a6a-a1aa-376b0fbdd284 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lazy-loading 'flavor' on Instance uuid a85a57f0-715f-47cd-ae19-463dfc5e7aca {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:34:34.849853 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-577408e3-b208-4a6a-a1aa-376b0fbdd284 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Going to try to live migrate instance to n-h1-846435-14 {{(pid=119303) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 14:34:35.014953 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-faaa8b16-3b9d-49cd-ae0c-5abcc400fbe1 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:35.030466 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-faaa8b16-3b9d-49cd-ae0c-5abcc400fbe1 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091" status: 200 len: 1511 microversion: 2.1 time: 0.569748 Jul 25 14:34:35.031449 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1248/2372] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:34 2022] GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091 => generated 1511 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:35.046758 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e32c6028-f130-4be0-a4b7-621eb0d8a2b6 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:35.049139 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e32c6028-f130-4be0-a4b7-621eb0d8a2b6 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:35.065815 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e32c6028-f130-4be0-a4b7-621eb0d8a2b6 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:35.066524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e32c6028-f130-4be0-a4b7-621eb0d8a2b6 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:35.067627 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e32c6028-f130-4be0-a4b7-621eb0d8a2b6 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:35.068356 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e32c6028-f130-4be0-a4b7-621eb0d8a2b6 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:35.620351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e32c6028-f130-4be0-a4b7-621eb0d8a2b6 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:35.670140 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e32c6028-f130-4be0-a4b7-621eb0d8a2b6 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:35.672403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e32c6028-f130-4be0-a4b7-621eb0d8a2b6 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:35.686116 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e32c6028-f130-4be0-a4b7-621eb0d8a2b6 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1407 microversion: 2.20 time: 0.653308 Jul 25 14:34:35.686838 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1249/2373] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:34:35 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1407 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:34:35.697708 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-8e2eb9e5-91b5-426b-8a2a-09495cb367c5 req-ea52b327-deda-4ca0-80d1-a69bbfc3b267 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d553191e-ef64-4d5c-8e11-fae84f68532d", "tag": "3a833966-d87a-4d80-a6b6-a0ab454a4377"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:35.724251 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-8e2eb9e5-91b5-426b-8a2a-09495cb367c5 req-ea52b327-deda-4ca0-80d1-a69bbfc3b267 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:35.724871 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-8e2eb9e5-91b5-426b-8a2a-09495cb367c5 req-ea52b327-deda-4ca0-80d1-a69bbfc3b267 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:35.743354 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-8e2eb9e5-91b5-426b-8a2a-09495cb367c5 req-ea52b327-deda-4ca0-80d1-a69bbfc3b267 service nova] Creating event network-changed:3a833966-d87a-4d80-a6b6-a0ab454a4377 for instance d553191e-ef64-4d5c-8e11-fae84f68532d on n-h2-846435-14 Jul 25 14:34:35.748622 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-8e2eb9e5-91b5-426b-8a2a-09495cb367c5 req-ea52b327-deda-4ca0-80d1-a69bbfc3b267 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059208 Jul 25 14:34:35.749305 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1250/2374] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:34:35.754915 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-16256c21-0a3c-458e-9dce-cf19a98abbc8 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:35.761167 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-16256c21-0a3c-458e-9dce-cf19a98abbc8 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:35.761635 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.compute.servers [None req-16256c21-0a3c-458e-9dce-cf19a98abbc8 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Removing options 'limit' from query {{(pid=119304) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 25 14:34:35.762383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-16256c21-0a3c-458e-9dce-cf19a98abbc8 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Searching by: {'deleted': False, 'project_id': '2383030b07e34f93b9637c637f8f0ae7'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:34:35.763781 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-16256c21-0a3c-458e-9dce-cf19a98abbc8 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:35.764521 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-16256c21-0a3c-458e-9dce-cf19a98abbc8 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:35.765450 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-16256c21-0a3c-458e-9dce-cf19a98abbc8 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:35.766300 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-16256c21-0a3c-458e-9dce-cf19a98abbc8 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:35.768752 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-16256c21-0a3c-458e-9dce-cf19a98abbc8 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.017700 Jul 25 14:34:35.769476 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1251/2375] 10.222.0.88 () {58 vars in 1140 bytes} [Mon Jul 25 14:34:35 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:34:35.778508 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7a6609e6-1c80-4e88-be70-359d6ebf2f96 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:35.779467 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7a6609e6-1c80-4e88-be70-359d6ebf2f96 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:35.788499 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a6609e6-1c80-4e88-be70-359d6ebf2f96 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:35.789182 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a6609e6-1c80-4e88-be70-359d6ebf2f96 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:35.790516 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a6609e6-1c80-4e88-be70-359d6ebf2f96 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:35.791198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a6609e6-1c80-4e88-be70-359d6ebf2f96 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:35.807092 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-7a6609e6-1c80-4e88-be70-359d6ebf2f96 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] HTTP exception thrown: Instance 1152d383-447a-4ffb-80b7-9b5f2b816630 could not be found. Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7a6609e6-1c80-4e88-be70-359d6ebf2f96 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Request method failure captured: Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 HTTP/1.1 Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qmFYWx9KOzJ47zTj_xy6_dMrFe8mbVr2eoxoU4fBSAvPaL6_V18DrJCqhfAaWe_brOymODzcadm8auFn0b-SnaSOztIL6209Kms93pKFTQlQDxx0IWHS2k5X8je65H4G7DaIrFeaLZIOx04kvq1FpfZo9y_MxArgBJ39whS-uFZ1kc Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 041b46dd05384e47a74bfaa8dc3c838f Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersTestMultiNic-1424548640 Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/041b46dd05384e47a74bfaa8dc3c838f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/041b46dd05384e47a74bfaa8dc3c838f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_041b46dd05384e47a74bfaa8dc3c838f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/041b46dd05384e47a74bfaa8dc3c838f"}]}] Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersTestMultiNic-1424548640 Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 041b46dd05384e47a74bfaa8dc3c838f Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersTestMultiNic-1424548640 Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersTestMultiNic-1424548640-project Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 3e2beeccba594f01b83983a2ec729a98 Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersTestMultiNic-1424548640-project Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 1152d383-447a-4ffb-80b7-9b5f2b816630 could not be found. Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '1152d383-447a-4ffb-80b7-9b5f2b816630'} Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1152d383-447a-4ffb-80b7-9b5f2b816630 could not be found. Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:34:35.808947 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:34:35.814026 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1152d383-447a-4ffb-80b7-9b5f2b816630 could not be found. Jul 25 14:34:35.814026 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:35.814026 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:34:35.814026 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:35.814026 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:35.814026 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:34:35.814026 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:34:35.814026 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:34:35.814026 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:34:35.814026 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1152d383-447a-4ffb-80b7-9b5f2b816630 could not be found. Jul 25 14:34:35.814026 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:35.814026 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7a6609e6-1c80-4e88-be70-359d6ebf2f96 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Returning 404 to user: Instance 1152d383-447a-4ffb-80b7-9b5f2b816630 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:34:35.814026 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7a6609e6-1c80-4e88-be70-359d6ebf2f96 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "DELETE /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630" status: 404 len: 111 microversion: 2.1 time: 0.043131 Jul 25 14:34:35.815520 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1252/2376] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:34:35 2022] DELETE /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:34:35.820484 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c8fe7211-1bc7-47a6-8e29-33fefefaa846 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:35.821186 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c8fe7211-1bc7-47a6-8e29-33fefefaa846 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: d553191e-ef64-4d5c-8e11-fae84f68532d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:35.832151 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c8fe7211-1bc7-47a6-8e29-33fefefaa846 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:35.832780 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c8fe7211-1bc7-47a6-8e29-33fefefaa846 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:35.833691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c8fe7211-1bc7-47a6-8e29-33fefefaa846 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:35.836640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c8fe7211-1bc7-47a6-8e29-33fefefaa846 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:36.152613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c8fe7211-1bc7-47a6-8e29-33fefefaa846 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:36.164200 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c8fe7211-1bc7-47a6-8e29-33fefefaa846 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d" status: 200 len: 1316 microversion: 2.1 time: 0.347432 Jul 25 14:34:36.176508 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1253/2377] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:35 2022] GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d => generated 1316 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:36.184589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-83c79052-291d-4c94-9940-7b5850b11724 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:36.185416 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-83c79052-291d-4c94-9940-7b5850b11724 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] [instance: 6993d89b-7a38-42d9-b4ec-cab1a476d4d1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:36.192062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:34:36.195560 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83c79052-291d-4c94-9940-7b5850b11724 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:36.195560 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83c79052-291d-4c94-9940-7b5850b11724 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:36.196225 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83c79052-291d-4c94-9940-7b5850b11724 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:36.196802 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83c79052-291d-4c94-9940-7b5850b11724 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:36.333194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-83c79052-291d-4c94-9940-7b5850b11724 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5313f5231c864414b7469dae709aa6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd6aafe78cf4d38afff08ccedef2e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:36.345132 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-83c79052-291d-4c94-9940-7b5850b11724 tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] 10.222.0.88 "GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1" status: 200 len: 1469 microversion: 2.1 time: 0.166453 Jul 25 14:34:36.345737 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1254/2378] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:36 2022] GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1 => generated 1469 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:36.365837 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-562f2e77-c76e-470a-84d7-a36561beaeca tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:36.367669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-562f2e77-c76e-470a-84d7-a36561beaeca tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 542ab1a2-380f-4f4f-95ec-5d68eb9bd091] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:36.374716 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-562f2e77-c76e-470a-84d7-a36561beaeca tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:36.375172 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-562f2e77-c76e-470a-84d7-a36561beaeca tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:36.375961 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-562f2e77-c76e-470a-84d7-a36561beaeca tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:36.376419 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-562f2e77-c76e-470a-84d7-a36561beaeca tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:36.513603 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=4 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:34:36.567896 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-562f2e77-c76e-470a-84d7-a36561beaeca tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:36.574646 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=30 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:34:36.578289 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-562f2e77-c76e-470a-84d7-a36561beaeca tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091" status: 200 len: 1511 microversion: 2.1 time: 0.218749 Jul 25 14:34:36.579185 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1255/2379] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:36 2022] GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091 => generated 1511 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:36.590178 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c2eda1b8-ae18-4ef1-bb75-7ec7098e7c84 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:36.591097 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c2eda1b8-ae18-4ef1-bb75-7ec7098e7c84 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: 1152d383-447a-4ffb-80b7-9b5f2b816630] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:36.602567 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c2eda1b8-ae18-4ef1-bb75-7ec7098e7c84 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:36.603482 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c2eda1b8-ae18-4ef1-bb75-7ec7098e7c84 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:36.604692 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c2eda1b8-ae18-4ef1-bb75-7ec7098e7c84 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:36.605826 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c2eda1b8-ae18-4ef1-bb75-7ec7098e7c84 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:36.623913 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-c2eda1b8-ae18-4ef1-bb75-7ec7098e7c84 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] HTTP exception thrown: Instance 1152d383-447a-4ffb-80b7-9b5f2b816630 could not be found. Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c2eda1b8-ae18-4ef1-bb75-7ec7098e7c84 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Request method failure captured: Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 HTTP/1.1 Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qmFYWx9KOzJ47zTj_xy6_dMrFe8mbVr2eoxoU4fBSAvPaL6_V18DrJCqhfAaWe_brOymODzcadm8auFn0b-SnaSOztIL6209Kms93pKFTQlQDxx0IWHS2k5X8je65H4G7DaIrFeaLZIOx04kvq1FpfZo9y_MxArgBJ39whS-uFZ1kc Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 041b46dd05384e47a74bfaa8dc3c838f Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersTestMultiNic-1424548640 Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/041b46dd05384e47a74bfaa8dc3c838f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/041b46dd05384e47a74bfaa8dc3c838f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_041b46dd05384e47a74bfaa8dc3c838f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/041b46dd05384e47a74bfaa8dc3c838f"}]}] Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersTestMultiNic-1424548640 Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 041b46dd05384e47a74bfaa8dc3c838f Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersTestMultiNic-1424548640 Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersTestMultiNic-1424548640-project Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 3e2beeccba594f01b83983a2ec729a98 Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersTestMultiNic-1424548640-project Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 1152d383-447a-4ffb-80b7-9b5f2b816630 could not be found. Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '1152d383-447a-4ffb-80b7-9b5f2b816630'} Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1152d383-447a-4ffb-80b7-9b5f2b816630 could not be found. Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1152d383-447a-4ffb-80b7-9b5f2b816630 could not be found. Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:34:36.625704 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:36.630791 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:36.630791 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:34:36.630791 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:34:36.630791 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:34:36.630791 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:34:36.630791 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1152d383-447a-4ffb-80b7-9b5f2b816630 could not be found. Jul 25 14:34:36.630791 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:36.630791 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c2eda1b8-ae18-4ef1-bb75-7ec7098e7c84 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Returning 404 to user: Instance 1152d383-447a-4ffb-80b7-9b5f2b816630 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:34:36.630791 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c2eda1b8-ae18-4ef1-bb75-7ec7098e7c84 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630" status: 404 len: 111 microversion: 2.1 time: 0.046779 Jul 25 14:34:36.631472 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1256/2380] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:36 2022] GET /compute/v2.1/servers/1152d383-447a-4ffb-80b7-9b5f2b816630 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:34:36.635547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-2727e79f-897a-47cf-8449-d7ac6b3f2cac req-1b0a5b42-1e69-4ff4-a678-f7d472789238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6993d89b-7a38-42d9-b4ec-cab1a476d4d1", "name": "network-vif-deleted", "tag": "e290f89d-d3dd-489e-9853-9cc2f9516d16"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:36.646788 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-2727e79f-897a-47cf-8449-d7ac6b3f2cac req-1b0a5b42-1e69-4ff4-a678-f7d472789238 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:36.647242 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-2727e79f-897a-47cf-8449-d7ac6b3f2cac req-1b0a5b42-1e69-4ff4-a678-f7d472789238 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:36.659399 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-2727e79f-897a-47cf-8449-d7ac6b3f2cac req-1b0a5b42-1e69-4ff4-a678-f7d472789238 service nova] Creating event network-vif-deleted:e290f89d-d3dd-489e-9853-9cc2f9516d16 for instance 6993d89b-7a38-42d9-b4ec-cab1a476d4d1 on n-h1-846435-14 Jul 25 14:34:36.664657 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-2727e79f-897a-47cf-8449-d7ac6b3f2cac req-1b0a5b42-1e69-4ff4-a678-f7d472789238 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032676 Jul 25 14:34:36.665259 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1257/2381] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:34:36.670219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6044becf-d4ad-4865-97c5-559c5f7c3085 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:36.670931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6044becf-d4ad-4865-97c5-559c5f7c3085 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 079ec21d-9dbc-4c93-a119-bf1bd0c06a15] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:36.677107 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6044becf-d4ad-4865-97c5-559c5f7c3085 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:36.677555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6044becf-d4ad-4865-97c5-559c5f7c3085 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:36.678316 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6044becf-d4ad-4865-97c5-559c5f7c3085 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:36.678744 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6044becf-d4ad-4865-97c5-559c5f7c3085 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:36.826360 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6044becf-d4ad-4865-97c5-559c5f7c3085 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:36.834972 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6044becf-d4ad-4865-97c5-559c5f7c3085 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/079ec21d-9dbc-4c93-a119-bf1bd0c06a15" status: 200 len: 1512 microversion: 2.1 time: 0.168536 Jul 25 14:34:36.835649 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1258/2382] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:36 2022] GET /compute/v2.1/servers/079ec21d-9dbc-4c93-a119-bf1bd0c06a15 => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:36.841984 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3d373144-6f5e-4963-a97e-d5bd51e1429f tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:36.842859 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3d373144-6f5e-4963-a97e-d5bd51e1429f tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:36.845346 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:34:36.854050 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3d373144-6f5e-4963-a97e-d5bd51e1429f tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:36.854653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3d373144-6f5e-4963-a97e-d5bd51e1429f tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:36.855536 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3d373144-6f5e-4963-a97e-d5bd51e1429f tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:36.856272 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3d373144-6f5e-4963-a97e-d5bd51e1429f tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:36.874370 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-3d373144-6f5e-4963-a97e-d5bd51e1429f tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] HTTP exception thrown: Instance c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc could not be found. Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3d373144-6f5e-4963-a97e-d5bd51e1429f tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Request method failure captured: Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc HTTP/1.1 Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qmFYWx9KOzJ47zTj_xy6_dMrFe8mbVr2eoxoU4fBSAvPaL6_V18DrJCqhfAaWe_brOymODzcadm8auFn0b-SnaSOztIL6209Kms93pKFTQlQDxx0IWHS2k5X8je65H4G7DaIrFeaLZIOx04kvq1FpfZo9y_MxArgBJ39whS-uFZ1kc Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 041b46dd05384e47a74bfaa8dc3c838f Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersTestMultiNic-1424548640 Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/041b46dd05384e47a74bfaa8dc3c838f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/041b46dd05384e47a74bfaa8dc3c838f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_041b46dd05384e47a74bfaa8dc3c838f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/041b46dd05384e47a74bfaa8dc3c838f"}]}] Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersTestMultiNic-1424548640 Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 041b46dd05384e47a74bfaa8dc3c838f Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersTestMultiNic-1424548640 Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersTestMultiNic-1424548640-project Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 3e2beeccba594f01b83983a2ec729a98 Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersTestMultiNic-1424548640-project Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc could not be found. Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc'} Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc could not be found. Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:34:36.876381 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:34:36.889455 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc could not be found. Jul 25 14:34:36.889455 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:36.889455 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:34:36.889455 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:36.889455 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:36.889455 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:34:36.889455 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:34:36.889455 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:34:36.889455 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:34:36.889455 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc could not be found. Jul 25 14:34:36.889455 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:36.889455 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3d373144-6f5e-4963-a97e-d5bd51e1429f tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Returning 404 to user: Instance c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:34:36.889455 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3d373144-6f5e-4963-a97e-d5bd51e1429f tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 404 len: 111 microversion: 2.1 time: 0.040957 Jul 25 14:34:36.889455 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1259/2383] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:34:36 2022] DELETE /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:34:36.889455 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a8bd5200-581c-4055-adbb-551c57b7254d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:36.889455 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a8bd5200-581c-4055-adbb-551c57b7254d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:36.894116 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a8bd5200-581c-4055-adbb-551c57b7254d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:36.894296 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a8bd5200-581c-4055-adbb-551c57b7254d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:36.895023 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a8bd5200-581c-4055-adbb-551c57b7254d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:36.895457 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a8bd5200-581c-4055-adbb-551c57b7254d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:37.063714 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a8bd5200-581c-4055-adbb-551c57b7254d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:37.076562 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a8bd5200-581c-4055-adbb-551c57b7254d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:37.078383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a8bd5200-581c-4055-adbb-551c57b7254d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:37.079895 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a8bd5200-581c-4055-adbb-551c57b7254d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1407 microversion: 2.20 time: 0.199722 Jul 25 14:34:37.081192 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1260/2384] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:34:36 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:34:37.088216 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a4bf7bd1-61b9-4bd4-a5b8-9990f75ab345 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:37.099590 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a4bf7bd1-61b9-4bd4-a5b8-9990f75ab345 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 493e0a70-7ee8-498b-83e5-f66f83344edf] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:37.116616 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4bf7bd1-61b9-4bd4-a5b8-9990f75ab345 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:37.117402 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4bf7bd1-61b9-4bd4-a5b8-9990f75ab345 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:37.118608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4bf7bd1-61b9-4bd4-a5b8-9990f75ab345 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:37.119324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4bf7bd1-61b9-4bd4-a5b8-9990f75ab345 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:37.306209 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a4bf7bd1-61b9-4bd4-a5b8-9990f75ab345 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:37.315093 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a4bf7bd1-61b9-4bd4-a5b8-9990f75ab345 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf" status: 200 len: 1511 microversion: 2.1 time: 0.232191 Jul 25 14:34:37.316072 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1261/2385] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:37 2022] GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf => generated 1511 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:37.321240 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6f9946fa-a9c4-4c4c-aba5-4963c2e091c3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:37.321951 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6f9946fa-a9c4-4c4c-aba5-4963c2e091c3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] [instance: c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:37.328211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f9946fa-a9c4-4c4c-aba5-4963c2e091c3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:37.328933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f9946fa-a9c4-4c4c-aba5-4963c2e091c3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:37.329852 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f9946fa-a9c4-4c4c-aba5-4963c2e091c3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:37.330378 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f9946fa-a9c4-4c4c-aba5-4963c2e091c3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:37.345817 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-6f9946fa-a9c4-4c4c-aba5-4963c2e091c3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] HTTP exception thrown: Instance c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc could not be found. Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6f9946fa-a9c4-4c4c-aba5-4963c2e091c3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Request method failure captured: Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc HTTP/1.1 Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qmFYWx9KOzJ47zTj_xy6_dMrFe8mbVr2eoxoU4fBSAvPaL6_V18DrJCqhfAaWe_brOymODzcadm8auFn0b-SnaSOztIL6209Kms93pKFTQlQDxx0IWHS2k5X8je65H4G7DaIrFeaLZIOx04kvq1FpfZo9y_MxArgBJ39whS-uFZ1kc Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 041b46dd05384e47a74bfaa8dc3c838f Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersTestMultiNic-1424548640 Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/041b46dd05384e47a74bfaa8dc3c838f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/041b46dd05384e47a74bfaa8dc3c838f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_041b46dd05384e47a74bfaa8dc3c838f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/041b46dd05384e47a74bfaa8dc3c838f"}]}] Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersTestMultiNic-1424548640 Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 041b46dd05384e47a74bfaa8dc3c838f Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersTestMultiNic-1424548640 Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersTestMultiNic-1424548640-project Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 3e2beeccba594f01b83983a2ec729a98 Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersTestMultiNic-1424548640-project Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc could not be found. Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc'} Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc could not be found. Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc could not be found. Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:34:37.347911 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:37.351890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:37.351890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:34:37.351890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:34:37.351890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:34:37.351890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:34:37.351890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc could not be found. Jul 25 14:34:37.351890 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:37.351890 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6f9946fa-a9c4-4c4c-aba5-4963c2e091c3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] Returning 404 to user: Instance c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:34:37.351890 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6f9946fa-a9c4-4c4c-aba5-4963c2e091c3 tempest-ServersTestMultiNic-1424548640 tempest-ServersTestMultiNic-1424548640-project] 10.222.0.88 "GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc" status: 404 len: 111 microversion: 2.1 time: 0.032136 Jul 25 14:34:37.351890 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1262/2386] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:37 2022] GET /compute/v2.1/servers/c486cfa1-58cc-42d8-ba3a-8c8d4533bdfc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:34:37.359952 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-72f1d4f0-2a41-4891-9dc0-af402212fe73 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:37.361559 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-72f1d4f0-2a41-4891-9dc0-af402212fe73 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: d553191e-ef64-4d5c-8e11-fae84f68532d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:37.370385 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72f1d4f0-2a41-4891-9dc0-af402212fe73 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:37.371141 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72f1d4f0-2a41-4891-9dc0-af402212fe73 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:37.372168 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72f1d4f0-2a41-4891-9dc0-af402212fe73 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:37.372675 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72f1d4f0-2a41-4891-9dc0-af402212fe73 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:37.544464 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-72f1d4f0-2a41-4891-9dc0-af402212fe73 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:37.553304 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-72f1d4f0-2a41-4891-9dc0-af402212fe73 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d" status: 200 len: 1316 microversion: 2.1 time: 0.200684 Jul 25 14:34:37.553901 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1263/2387] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:37 2022] GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d => generated 1316 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:37.558926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-42d8f809-fb05-47b1-89c3-c0fccc0f88d1 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:37.565698 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-42d8f809-fb05-47b1-89c3-c0fccc0f88d1 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:37.566576 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-42d8f809-fb05-47b1-89c3-c0fccc0f88d1 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': '2383030b07e34f93b9637c637f8f0ae7'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:34:37.676640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-42d8f809-fb05-47b1-89c3-c0fccc0f88d1 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:37.677266 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-42d8f809-fb05-47b1-89c3-c0fccc0f88d1 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:37.677894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-42d8f809-fb05-47b1-89c3-c0fccc0f88d1 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:37.678328 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-42d8f809-fb05-47b1-89c3-c0fccc0f88d1 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:37.707447 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:34:37.778974 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.multi_cell_list [None req-42d8f809-fb05-47b1-89c3-c0fccc0f88d1 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119304) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:34:37.840657 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-42d8f809-fb05-47b1-89c3-c0fccc0f88d1 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 346 microversion: 2.1 time: 0.285390 Jul 25 14:34:37.841252 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1264/2388] 10.222.0.88 () {58 vars in 1154 bytes} [Mon Jul 25 14:34:37 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 346 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:34:37.854892 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1c83e0ea-1f3f-44ee-bca6-09908f236f6b tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:37.855498 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1c83e0ea-1f3f-44ee-bca6-09908f236f6b tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] [instance: 6993d89b-7a38-42d9-b4ec-cab1a476d4d1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:37.861784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1c83e0ea-1f3f-44ee-bca6-09908f236f6b tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:37.862459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1c83e0ea-1f3f-44ee-bca6-09908f236f6b tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:37.863221 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1c83e0ea-1f3f-44ee-bca6-09908f236f6b tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:37.863789 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1c83e0ea-1f3f-44ee-bca6-09908f236f6b tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:37.879489 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-1c83e0ea-1f3f-44ee-bca6-09908f236f6b tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] HTTP exception thrown: Instance 6993d89b-7a38-42d9-b4ec-cab1a476d4d1 could not be found. Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1c83e0ea-1f3f-44ee-bca6-09908f236f6b tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Request method failure captured: Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1 HTTP/1.1 Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qnau7EbTbGJtvq-17B8rqW2UpsMNbZfhe5EObBDnvKaoKOhOvy57TfT_NyKV0K2CndoMcl1fzutuIpKa1Ma7GGtBfmu8n-5g_I2JMOTtdkSzuCLbS4syXuB_z5O4NGDhPBLHsnJUaGYlE8n3b2rN1qnOlMez3UOCWkTSwYW-PJCORY Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: bfd6aafe78cf4d38afff08ccedef2e51 Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-InstanceActionsTestJSON-771491829 Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/bfd6aafe78cf4d38afff08ccedef2e51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/bfd6aafe78cf4d38afff08ccedef2e51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_bfd6aafe78cf4d38afff08ccedef2e51", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/bfd6aafe78cf4d38afff08ccedef2e51"}]}] Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-InstanceActionsTestJSON-771491829 Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: bfd6aafe78cf4d38afff08ccedef2e51 Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-InstanceActionsTestJSON-771491829 Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-InstanceActionsTestJSON-771491829-project Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 5313f5231c864414b7469dae709aa6da Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-InstanceActionsTestJSON-771491829-project Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 6993d89b-7a38-42d9-b4ec-cab1a476d4d1 could not be found. Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '6993d89b-7a38-42d9-b4ec-cab1a476d4d1'} Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6993d89b-7a38-42d9-b4ec-cab1a476d4d1 could not be found. Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6993d89b-7a38-42d9-b4ec-cab1a476d4d1 could not be found. Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:34:37.881114 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:37.886605 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:37.886605 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:34:37.886605 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:34:37.886605 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:34:37.886605 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:34:37.886605 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6993d89b-7a38-42d9-b4ec-cab1a476d4d1 could not be found. Jul 25 14:34:37.886605 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:37.886605 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1c83e0ea-1f3f-44ee-bca6-09908f236f6b tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] Returning 404 to user: Instance 6993d89b-7a38-42d9-b4ec-cab1a476d4d1 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:34:37.886605 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1c83e0ea-1f3f-44ee-bca6-09908f236f6b tempest-InstanceActionsTestJSON-771491829 tempest-InstanceActionsTestJSON-771491829-project] 10.222.0.88 "GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1" status: 404 len: 111 microversion: 2.1 time: 0.040825 Jul 25 14:34:37.887962 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1265/2389] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:37 2022] GET /compute/v2.1/servers/6993d89b-7a38-42d9-b4ec-cab1a476d4d1 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:34:37.894229 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-1c5e04af-dca4-4116-9fb5-c00306c2cf9a req-69e7d0d0-359e-4880-80a6-273fe7c4700a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1009be4-53ff-4893-836c-ba96f07a0d60", "name": "network-vif-plugged", "status": "completed", "tag": "a70f2535-e346-4125-80e5-abda9464ab7e"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:37.906025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-1c5e04af-dca4-4116-9fb5-c00306c2cf9a req-69e7d0d0-359e-4880-80a6-273fe7c4700a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:37.907797 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-1c5e04af-dca4-4116-9fb5-c00306c2cf9a req-69e7d0d0-359e-4880-80a6-273fe7c4700a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:37.919875 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-1c5e04af-dca4-4116-9fb5-c00306c2cf9a req-69e7d0d0-359e-4880-80a6-273fe7c4700a service nova] Creating event network-vif-plugged:a70f2535-e346-4125-80e5-abda9464ab7e for instance f1009be4-53ff-4893-836c-ba96f07a0d60 on n-h2-846435-14 Jul 25 14:34:37.925749 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-1c5e04af-dca4-4116-9fb5-c00306c2cf9a req-69e7d0d0-359e-4880-80a6-273fe7c4700a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036086 Jul 25 14:34:37.926348 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1266/2390] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:34:37.931591 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-199e1bf0-8ad6-499c-8997-8a72dc76b461 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:37.932340 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-199e1bf0-8ad6-499c-8997-8a72dc76b461 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 542ab1a2-380f-4f4f-95ec-5d68eb9bd091] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:37.938902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-199e1bf0-8ad6-499c-8997-8a72dc76b461 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:37.939366 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-199e1bf0-8ad6-499c-8997-8a72dc76b461 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:37.940149 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-199e1bf0-8ad6-499c-8997-8a72dc76b461 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:37.940579 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-199e1bf0-8ad6-499c-8997-8a72dc76b461 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:38.141153 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-199e1bf0-8ad6-499c-8997-8a72dc76b461 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:38.148496 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-199e1bf0-8ad6-499c-8997-8a72dc76b461 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091" status: 200 len: 1511 microversion: 2.1 time: 0.220661 Jul 25 14:34:38.149348 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1267/2391] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:37 2022] GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091 => generated 1511 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:38.160104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f367ff56-d0f2-41d5-a2db-81aa2159ccd0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:38.160104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f367ff56-d0f2-41d5-a2db-81aa2159ccd0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:38.166483 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f367ff56-d0f2-41d5-a2db-81aa2159ccd0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:38.166483 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f367ff56-d0f2-41d5-a2db-81aa2159ccd0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:38.166483 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f367ff56-d0f2-41d5-a2db-81aa2159ccd0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:38.166483 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f367ff56-d0f2-41d5-a2db-81aa2159ccd0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:38.334065 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f367ff56-d0f2-41d5-a2db-81aa2159ccd0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:38.337009 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:34:38.345220 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f367ff56-d0f2-41d5-a2db-81aa2159ccd0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:38.346926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f367ff56-d0f2-41d5-a2db-81aa2159ccd0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:38.348252 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f367ff56-d0f2-41d5-a2db-81aa2159ccd0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1407 microversion: 2.20 time: 0.196308 Jul 25 14:34:38.348961 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1268/2392] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:34:38 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:34:38.354491 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a2716c51-b484-471a-992c-7b96f91d6503 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:38.355248 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a2716c51-b484-471a-992c-7b96f91d6503 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 079ec21d-9dbc-4c93-a119-bf1bd0c06a15] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:38.363005 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a2716c51-b484-471a-992c-7b96f91d6503 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:38.363602 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a2716c51-b484-471a-992c-7b96f91d6503 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:38.364564 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a2716c51-b484-471a-992c-7b96f91d6503 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:38.365263 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a2716c51-b484-471a-992c-7b96f91d6503 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:38.543749 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a2716c51-b484-471a-992c-7b96f91d6503 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:38.552427 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a2716c51-b484-471a-992c-7b96f91d6503 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/079ec21d-9dbc-4c93-a119-bf1bd0c06a15" status: 200 len: 1512 microversion: 2.1 time: 0.202164 Jul 25 14:34:38.556024 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1269/2393] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:38 2022] GET /compute/v2.1/servers/079ec21d-9dbc-4c93-a119-bf1bd0c06a15 => generated 1512 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:38.573133 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b1b480e3-3fac-4ba3-9717-c540cff91b2e tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:38.573743 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b1b480e3-3fac-4ba3-9717-c540cff91b2e tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 493e0a70-7ee8-498b-83e5-f66f83344edf] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:38.586809 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b1b480e3-3fac-4ba3-9717-c540cff91b2e tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:38.587417 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b1b480e3-3fac-4ba3-9717-c540cff91b2e tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:38.588444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b1b480e3-3fac-4ba3-9717-c540cff91b2e tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:38.589001 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b1b480e3-3fac-4ba3-9717-c540cff91b2e tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:38.734562 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b1b480e3-3fac-4ba3-9717-c540cff91b2e tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:38.743884 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b1b480e3-3fac-4ba3-9717-c540cff91b2e tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf" status: 200 len: 1511 microversion: 2.1 time: 0.174697 Jul 25 14:34:38.755741 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1270/2394] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:38 2022] GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf => generated 1511 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:38.755741 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ce5a7fc3-9de8-4507-9c16-98100c4b0812 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:38.755741 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ce5a7fc3-9de8-4507-9c16-98100c4b0812 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: d553191e-ef64-4d5c-8e11-fae84f68532d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:38.761076 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce5a7fc3-9de8-4507-9c16-98100c4b0812 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:38.762384 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce5a7fc3-9de8-4507-9c16-98100c4b0812 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:38.763169 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce5a7fc3-9de8-4507-9c16-98100c4b0812 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:38.763599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce5a7fc3-9de8-4507-9c16-98100c4b0812 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:38.904987 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ce5a7fc3-9de8-4507-9c16-98100c4b0812 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:38.915916 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ce5a7fc3-9de8-4507-9c16-98100c4b0812 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d" status: 200 len: 1316 microversion: 2.1 time: 0.168925 Jul 25 14:34:38.916846 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1271/2395] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:38 2022] GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d => generated 1316 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:38.922683 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9977b8e4-7604-4853-acf5-9e7d75a2f806 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:38.927626 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9977b8e4-7604-4853-acf5-9e7d75a2f806 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:38.928885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9977b8e4-7604-4853-acf5-9e7d75a2f806 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Searching by: {'deleted': False, 'project_id': '2383030b07e34f93b9637c637f8f0ae7'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:34:38.935156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9977b8e4-7604-4853-acf5-9e7d75a2f806 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:38.935851 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9977b8e4-7604-4853-acf5-9e7d75a2f806 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:38.936873 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9977b8e4-7604-4853-acf5-9e7d75a2f806 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:38.937311 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9977b8e4-7604-4853-acf5-9e7d75a2f806 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:38.969753 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.multi_cell_list [None req-9977b8e4-7604-4853-acf5-9e7d75a2f806 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119304) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:34:39.008466 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9977b8e4-7604-4853-acf5-9e7d75a2f806 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:39.020232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9977b8e4-7604-4853-acf5-9e7d75a2f806 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:39.020774 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9977b8e4-7604-4853-acf5-9e7d75a2f806 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:39.539809 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9977b8e4-7604-4853-acf5-9e7d75a2f806 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 0.615826 Jul 25 14:34:39.556004 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1272/2396] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:34:38 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:39.557755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e7df67b4-947c-475f-bd17-2f0ce735aa7b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:39.558716 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e7df67b4-947c-475f-bd17-2f0ce735aa7b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:39.568516 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e7df67b4-947c-475f-bd17-2f0ce735aa7b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:39.569294 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e7df67b4-947c-475f-bd17-2f0ce735aa7b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:39.570259 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e7df67b4-947c-475f-bd17-2f0ce735aa7b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:39.572033 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e7df67b4-947c-475f-bd17-2f0ce735aa7b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:39.792914 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e7df67b4-947c-475f-bd17-2f0ce735aa7b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:39.804381 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e7df67b4-947c-475f-bd17-2f0ce735aa7b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:39.805919 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e7df67b4-947c-475f-bd17-2f0ce735aa7b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:39.807243 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e7df67b4-947c-475f-bd17-2f0ce735aa7b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1407 microversion: 2.20 time: 0.264599 Jul 25 14:34:39.808068 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1273/2397] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:34:39 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:34:39.819092 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f44ef30d-5400-4209-915b-143a779a0ef0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:39.825065 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f44ef30d-5400-4209-915b-143a779a0ef0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:39.825926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f44ef30d-5400-4209-915b-143a779a0ef0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '2383030b07e34f93b9637c637f8f0ae7'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:34:39.902812 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f44ef30d-5400-4209-915b-143a779a0ef0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:39.903259 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f44ef30d-5400-4209-915b-143a779a0ef0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:39.904971 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f44ef30d-5400-4209-915b-143a779a0ef0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:39.905432 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f44ef30d-5400-4209-915b-143a779a0ef0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:39.944116 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.multi_cell_list [None req-f44ef30d-5400-4209-915b-143a779a0ef0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119304) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:34:39.977419 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f44ef30d-5400-4209-915b-143a779a0ef0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1012 microversion: 2.1 time: 0.164177 Jul 25 14:34:39.978127 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1274/2398] 10.222.0.88 () {58 vars in 1150 bytes} [Mon Jul 25 14:34:39 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1012 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:39.982794 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d87b6067-e64e-4839-a7b8-57c33aefba12 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:39.983412 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d87b6067-e64e-4839-a7b8-57c33aefba12 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: d553191e-ef64-4d5c-8e11-fae84f68532d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:39.989894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d87b6067-e64e-4839-a7b8-57c33aefba12 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:39.990348 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d87b6067-e64e-4839-a7b8-57c33aefba12 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:39.991119 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d87b6067-e64e-4839-a7b8-57c33aefba12 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:39.991548 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d87b6067-e64e-4839-a7b8-57c33aefba12 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:40.241580 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d87b6067-e64e-4839-a7b8-57c33aefba12 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:40.249772 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d87b6067-e64e-4839-a7b8-57c33aefba12 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d" status: 200 len: 1316 microversion: 2.1 time: 0.270038 Jul 25 14:34:40.250024 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1275/2399] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:39 2022] GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d => generated 1316 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:40.254721 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-22d8bb2f-4a21-4947-8723-16fb0b40ab9a tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:40.260155 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-22d8bb2f-4a21-4947-8723-16fb0b40ab9a tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:40.260507 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-22d8bb2f-4a21-4947-8723-16fb0b40ab9a tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '2383030b07e34f93b9637c637f8f0ae7'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:34:40.266278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-22d8bb2f-4a21-4947-8723-16fb0b40ab9a tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:40.266715 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-22d8bb2f-4a21-4947-8723-16fb0b40ab9a tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:40.267522 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-22d8bb2f-4a21-4947-8723-16fb0b40ab9a tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:40.267939 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-22d8bb2f-4a21-4947-8723-16fb0b40ab9a tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:40.354849 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.multi_cell_list [None req-22d8bb2f-4a21-4947-8723-16fb0b40ab9a tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119304) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:34:40.661895 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-22d8bb2f-4a21-4947-8723-16fb0b40ab9a tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1012 microversion: 2.1 time: 0.410529 Jul 25 14:34:40.669427 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1276/2400] 10.222.0.88 () {58 vars in 1212 bytes} [Mon Jul 25 14:34:40 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1012 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:40.674851 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7008ea7f-3925-4954-bba5-6eef6f5324f7 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:40.680280 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7008ea7f-3925-4954-bba5-6eef6f5324f7 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:40.680976 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7008ea7f-3925-4954-bba5-6eef6f5324f7 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '2383030b07e34f93b9637c637f8f0ae7'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:34:40.686998 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7008ea7f-3925-4954-bba5-6eef6f5324f7 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:40.687444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7008ea7f-3925-4954-bba5-6eef6f5324f7 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:40.688280 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7008ea7f-3925-4954-bba5-6eef6f5324f7 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:40.688713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7008ea7f-3925-4954-bba5-6eef6f5324f7 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:40.786090 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.multi_cell_list [None req-7008ea7f-3925-4954-bba5-6eef6f5324f7 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119304) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:34:40.868532 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7008ea7f-3925-4954-bba5-6eef6f5324f7 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1012 microversion: 2.1 time: 0.197550 Jul 25 14:34:40.870280 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1277/2401] 10.222.0.88 () {58 vars in 1196 bytes} [Mon Jul 25 14:34:40 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1012 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:40.874796 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f119fb15-6faf-4a4a-b9fa-68b55ad4ee1b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:40.875641 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f119fb15-6faf-4a4a-b9fa-68b55ad4ee1b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:40.883732 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f119fb15-6faf-4a4a-b9fa-68b55ad4ee1b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:40.884391 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f119fb15-6faf-4a4a-b9fa-68b55ad4ee1b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:40.885373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f119fb15-6faf-4a4a-b9fa-68b55ad4ee1b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:40.885901 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f119fb15-6faf-4a4a-b9fa-68b55ad4ee1b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:41.051558 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f119fb15-6faf-4a4a-b9fa-68b55ad4ee1b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:41.063725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f119fb15-6faf-4a4a-b9fa-68b55ad4ee1b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:41.065907 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f119fb15-6faf-4a4a-b9fa-68b55ad4ee1b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:41.067417 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f119fb15-6faf-4a4a-b9fa-68b55ad4ee1b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1407 microversion: 2.20 time: 0.196679 Jul 25 14:34:41.080143 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1278/2402] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:34:40 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:34:41.102295 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a3d7f654-2253-40f9-8215-1fa3f1b01fdd tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:41.113481 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-577408e3-b208-4a6a-a1aa-376b0fbdd284 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca/action" status: 202 len: 0 microversion: 2.1 time: 6.373907 Jul 25 14:34:41.114197 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1125/2403] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:34:34 2022] POST /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca/action => generated 0 bytes in 6400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:34:41.120665 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a3d7f654-2253-40f9-8215-1fa3f1b01fdd tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:41.123954 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-aac12a9c-8197-406d-9d25-05c9dbe83064 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:41.124729 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a3d7f654-2253-40f9-8215-1fa3f1b01fdd tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Searching by: {'name': '2020558111', 'deleted': False, 'project_id': '2383030b07e34f93b9637c637f8f0ae7'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:34:41.125461 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-aac12a9c-8197-406d-9d25-05c9dbe83064 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:41.130996 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3d7f654-2253-40f9-8215-1fa3f1b01fdd tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:41.131565 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3d7f654-2253-40f9-8215-1fa3f1b01fdd tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:41.132412 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3d7f654-2253-40f9-8215-1fa3f1b01fdd tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:41.132852 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3d7f654-2253-40f9-8215-1fa3f1b01fdd tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:41.133580 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aac12a9c-8197-406d-9d25-05c9dbe83064 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:41.134241 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aac12a9c-8197-406d-9d25-05c9dbe83064 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:41.135487 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aac12a9c-8197-406d-9d25-05c9dbe83064 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:41.136170 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aac12a9c-8197-406d-9d25-05c9dbe83064 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:41.253135 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.multi_cell_list [None req-a3d7f654-2253-40f9-8215-1fa3f1b01fdd tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119304) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:34:41.337591 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a3d7f654-2253-40f9-8215-1fa3f1b01fdd tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers?name=2020558111" status: 200 len: 346 microversion: 2.1 time: 0.260843 Jul 25 14:34:41.348586 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1279/2404] 10.222.0.88 () {58 vars in 1156 bytes} [Mon Jul 25 14:34:41 2022] GET /compute/v2.1/servers?name=2020558111 => generated 346 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:34:41.348586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-623e21ed-5bf1-4cf8-8ed1-a43fa322c6a0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:41.348586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-623e21ed-5bf1-4cf8-8ed1-a43fa322c6a0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: d553191e-ef64-4d5c-8e11-fae84f68532d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:41.354125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-623e21ed-5bf1-4cf8-8ed1-a43fa322c6a0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:41.354594 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-623e21ed-5bf1-4cf8-8ed1-a43fa322c6a0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:41.355419 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-623e21ed-5bf1-4cf8-8ed1-a43fa322c6a0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:41.356008 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-623e21ed-5bf1-4cf8-8ed1-a43fa322c6a0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:41.525048 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-623e21ed-5bf1-4cf8-8ed1-a43fa322c6a0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:41.533735 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-623e21ed-5bf1-4cf8-8ed1-a43fa322c6a0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d" status: 200 len: 1316 microversion: 2.1 time: 0.193526 Jul 25 14:34:41.534314 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1280/2405] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:41 2022] GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d => generated 1316 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:41.541517 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-031f5630-c411-4203-97e0-27e94164c76e tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:41.547197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-031f5630-c411-4203-97e0-27e94164c76e tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:41.548547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-031f5630-c411-4203-97e0-27e94164c76e tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '2383030b07e34f93b9637c637f8f0ae7'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:34:41.559056 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-031f5630-c411-4203-97e0-27e94164c76e tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:41.559615 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-031f5630-c411-4203-97e0-27e94164c76e tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:41.560640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-031f5630-c411-4203-97e0-27e94164c76e tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:41.561805 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-031f5630-c411-4203-97e0-27e94164c76e tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:41.657700 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.multi_cell_list [None req-031f5630-c411-4203-97e0-27e94164c76e tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119304) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:34:41.711891 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-aac12a9c-8197-406d-9d25-05c9dbe83064 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:41.728773 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-031f5630-c411-4203-97e0-27e94164c76e tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1012 microversion: 2.1 time: 0.192965 Jul 25 14:34:41.729889 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1281/2406] 10.222.0.88 () {58 vars in 1154 bytes} [Mon Jul 25 14:34:41 2022] GET /compute/v2.1/servers?name=-instance => generated 1012 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:41.743171 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e632801b-21af-4f57-93a2-73652c9daa07 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:41.747356 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-aac12a9c-8197-406d-9d25-05c9dbe83064 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1718 microversion: 2.1 time: 0.627676 Jul 25 14:34:41.759998 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1126/2407] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:41 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1718 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:41.760208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e632801b-21af-4f57-93a2-73652c9daa07 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:41.760208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e632801b-21af-4f57-93a2-73652c9daa07 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-202055811', 'deleted': False, 'project_id': '2383030b07e34f93b9637c637f8f0ae7'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:34:41.760208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e632801b-21af-4f57-93a2-73652c9daa07 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:41.760208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e632801b-21af-4f57-93a2-73652c9daa07 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:41.760208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e632801b-21af-4f57-93a2-73652c9daa07 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:41.760208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e632801b-21af-4f57-93a2-73652c9daa07 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:41.878051 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.multi_cell_list [None req-e632801b-21af-4f57-93a2-73652c9daa07 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119304) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:34:41.920533 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:34:41.974039 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e632801b-21af-4f57-93a2-73652c9daa07 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-202055811" status: 200 len: 346 microversion: 2.1 time: 0.236187 Jul 25 14:34:41.975434 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1282/2408] 10.222.0.88 () {58 vars in 1228 bytes} [Mon Jul 25 14:34:41 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-202055811 => generated 346 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:34:41.988987 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c25b23c6-1bc2-4d55-a0c5-fa79244a7550 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:41.990019 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c25b23c6-1bc2-4d55-a0c5-fa79244a7550 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 493e0a70-7ee8-498b-83e5-f66f83344edf] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:42.002666 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c25b23c6-1bc2-4d55-a0c5-fa79244a7550 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:42.007029 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c25b23c6-1bc2-4d55-a0c5-fa79244a7550 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:42.008138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c25b23c6-1bc2-4d55-a0c5-fa79244a7550 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:42.008721 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c25b23c6-1bc2-4d55-a0c5-fa79244a7550 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:42.048290 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c25b23c6-1bc2-4d55-a0c5-fa79244a7550 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 493e0a70-7ee8-498b-83e5-f66f83344edf] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:34:42.092198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-440a163d-d8fa-42d2-a829-6401634b727e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:42.092889 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-440a163d-d8fa-42d2-a829-6401634b727e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:42.110980 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-440a163d-d8fa-42d2-a829-6401634b727e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:42.111960 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-440a163d-d8fa-42d2-a829-6401634b727e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:42.112948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-440a163d-d8fa-42d2-a829-6401634b727e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:42.113533 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-440a163d-d8fa-42d2-a829-6401634b727e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:42.182880 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c25b23c6-1bc2-4d55-a0c5-fa79244a7550 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "DELETE /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf" status: 204 len: 0 microversion: 2.1 time: 0.198157 Jul 25 14:34:42.184496 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1127/2409] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:34:41 2022] DELETE /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:34:42.207284 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ab93452d-38aa-4d4a-9b41-8ca160e042c0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:42.208419 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ab93452d-38aa-4d4a-9b41-8ca160e042c0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 493e0a70-7ee8-498b-83e5-f66f83344edf] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:42.224638 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab93452d-38aa-4d4a-9b41-8ca160e042c0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:42.225364 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab93452d-38aa-4d4a-9b41-8ca160e042c0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:42.226465 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab93452d-38aa-4d4a-9b41-8ca160e042c0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:42.227055 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab93452d-38aa-4d4a-9b41-8ca160e042c0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:42.716067 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ab93452d-38aa-4d4a-9b41-8ca160e042c0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:42.730065 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ab93452d-38aa-4d4a-9b41-8ca160e042c0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf" status: 200 len: 1517 microversion: 2.1 time: 0.537982 Jul 25 14:34:42.743944 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1128/2410] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:42 2022] GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf => generated 1517 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:42.744834 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8e48f742-9ead-454c-bbff-b1021ad209d9 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:42.746161 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8e48f742-9ead-454c-bbff-b1021ad209d9 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: d553191e-ef64-4d5c-8e11-fae84f68532d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:42.765406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8e48f742-9ead-454c-bbff-b1021ad209d9 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:42.767645 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8e48f742-9ead-454c-bbff-b1021ad209d9 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:42.770658 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8e48f742-9ead-454c-bbff-b1021ad209d9 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:42.771247 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8e48f742-9ead-454c-bbff-b1021ad209d9 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:43.139155 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-440a163d-d8fa-42d2-a829-6401634b727e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:43.152245 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-440a163d-d8fa-42d2-a829-6401634b727e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:43.156734 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-440a163d-d8fa-42d2-a829-6401634b727e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:43.160629 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-440a163d-d8fa-42d2-a829-6401634b727e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1599 microversion: 2.20 time: 1.071434 Jul 25 14:34:43.168231 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1283/2411] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:34:42 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1599 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:34:43.182758 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a3ad0bf3-1130-47e8-9307-ed7537c89d4e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:43.186609 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a3ad0bf3-1130-47e8-9307-ed7537c89d4e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:43.201836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3ad0bf3-1130-47e8-9307-ed7537c89d4e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:43.202421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3ad0bf3-1130-47e8-9307-ed7537c89d4e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:43.203211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3ad0bf3-1130-47e8-9307-ed7537c89d4e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:43.203639 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3ad0bf3-1130-47e8-9307-ed7537c89d4e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:43.409887 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8e48f742-9ead-454c-bbff-b1021ad209d9 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:43.420125 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8e48f742-9ead-454c-bbff-b1021ad209d9 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d" status: 200 len: 1316 microversion: 2.1 time: 0.686075 Jul 25 14:34:43.433281 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1129/2412] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:42 2022] GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d => generated 1316 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:43.441867 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a76f2420-4341-4212-bd2b-7487759c60d0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:43.442754 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a76f2420-4341-4212-bd2b-7487759c60d0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:43.450997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a76f2420-4341-4212-bd2b-7487759c60d0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:43.451704 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a76f2420-4341-4212-bd2b-7487759c60d0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:43.452909 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a76f2420-4341-4212-bd2b-7487759c60d0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:43.453703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a76f2420-4341-4212-bd2b-7487759c60d0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:43.478686 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:34:43.525208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a3ad0bf3-1130-47e8-9307-ed7537c89d4e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:43.534824 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a3ad0bf3-1130-47e8-9307-ed7537c89d4e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1718 microversion: 2.1 time: 0.364516 Jul 25 14:34:43.536027 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1284/2413] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:43 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1718 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:43.752470 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-98dc437c-24b1-40e7-801c-5886149d02a0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:43.753808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-98dc437c-24b1-40e7-801c-5886149d02a0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 493e0a70-7ee8-498b-83e5-f66f83344edf] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:43.793835 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98dc437c-24b1-40e7-801c-5886149d02a0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:43.794496 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98dc437c-24b1-40e7-801c-5886149d02a0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:43.798701 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98dc437c-24b1-40e7-801c-5886149d02a0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:43.806639 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98dc437c-24b1-40e7-801c-5886149d02a0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:43.982366 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a76f2420-4341-4212-bd2b-7487759c60d0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.547285 Jul 25 14:34:43.983625 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1130/2414] 10.222.0.88 () {60 vars in 1316 bytes} [Mon Jul 25 14:34:43 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60/os-interface => generated 284 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:34:44.447243 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-43b0d759-2b8e-4139-bdff-584fc4024ca8 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:44.447924 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-43b0d759-2b8e-4139-bdff-584fc4024ca8 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: d553191e-ef64-4d5c-8e11-fae84f68532d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:44.462819 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43b0d759-2b8e-4139-bdff-584fc4024ca8 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:44.463434 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43b0d759-2b8e-4139-bdff-584fc4024ca8 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:44.471731 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43b0d759-2b8e-4139-bdff-584fc4024ca8 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:44.473428 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43b0d759-2b8e-4139-bdff-584fc4024ca8 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:44.535202 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-98dc437c-24b1-40e7-801c-5886149d02a0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:44.544359 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-98dc437c-24b1-40e7-801c-5886149d02a0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf" status: 200 len: 1517 microversion: 2.1 time: 0.797199 Jul 25 14:34:44.544992 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1285/2415] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:43 2022] GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf => generated 1517 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:44.569915 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-18bfdb9b-33a9-40d4-863f-fd40f3ccd203 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:44.574106 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-18bfdb9b-33a9-40d4-863f-fd40f3ccd203 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:44.594341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-18bfdb9b-33a9-40d4-863f-fd40f3ccd203 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:44.594811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-18bfdb9b-33a9-40d4-863f-fd40f3ccd203 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:44.595846 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-18bfdb9b-33a9-40d4-863f-fd40f3ccd203 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:44.596520 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-18bfdb9b-33a9-40d4-863f-fd40f3ccd203 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:44.943328 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-18bfdb9b-33a9-40d4-863f-fd40f3ccd203 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:44.959122 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-18bfdb9b-33a9-40d4-863f-fd40f3ccd203 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1718 microversion: 2.1 time: 0.393987 Jul 25 14:34:44.960228 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1286/2416] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:44 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1718 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:45.197359 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-a60ebccb-4ffe-44d6-b87c-d5ae573074ee req-f11e19ee-108c-4a85-a044-f7caa4dbaab8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d553191e-ef64-4d5c-8e11-fae84f68532d", "name": "network-vif-plugged", "status": "completed", "tag": "3a833966-d87a-4d80-a6b6-a0ab454a4377"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:45.211322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a60ebccb-4ffe-44d6-b87c-d5ae573074ee req-f11e19ee-108c-4a85-a044-f7caa4dbaab8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:45.213825 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a60ebccb-4ffe-44d6-b87c-d5ae573074ee req-f11e19ee-108c-4a85-a044-f7caa4dbaab8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:45.242468 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-a60ebccb-4ffe-44d6-b87c-d5ae573074ee req-f11e19ee-108c-4a85-a044-f7caa4dbaab8 service nova] Creating event network-vif-plugged:3a833966-d87a-4d80-a6b6-a0ab454a4377 for instance d553191e-ef64-4d5c-8e11-fae84f68532d on n-h2-846435-14 Jul 25 14:34:45.252865 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-a60ebccb-4ffe-44d6-b87c-d5ae573074ee req-f11e19ee-108c-4a85-a044-f7caa4dbaab8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060118 Jul 25 14:34:45.254274 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1287/2417] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:34:45.289108 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-43b0d759-2b8e-4139-bdff-584fc4024ca8 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:45.299430 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-43b0d759-2b8e-4139-bdff-584fc4024ca8 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d" status: 200 len: 1316 microversion: 2.1 time: 0.856977 Jul 25 14:34:45.300933 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1131/2418] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:44 2022] GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d => generated 1316 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:45.575620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-403dcca5-f415-492b-9045-fb9e41ecdeb6 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:45.578384 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-403dcca5-f415-492b-9045-fb9e41ecdeb6 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 493e0a70-7ee8-498b-83e5-f66f83344edf] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:45.587689 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-403dcca5-f415-492b-9045-fb9e41ecdeb6 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:45.588645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-403dcca5-f415-492b-9045-fb9e41ecdeb6 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:45.589714 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-403dcca5-f415-492b-9045-fb9e41ecdeb6 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:45.590389 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-403dcca5-f415-492b-9045-fb9e41ecdeb6 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:45.985177 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-08145892-0efd-4256-aa46-b7ff7fdccd8f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:45.987605 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-08145892-0efd-4256-aa46-b7ff7fdccd8f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:45.996544 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08145892-0efd-4256-aa46-b7ff7fdccd8f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:45.999116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08145892-0efd-4256-aa46-b7ff7fdccd8f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:46.000822 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08145892-0efd-4256-aa46-b7ff7fdccd8f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:46.001613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08145892-0efd-4256-aa46-b7ff7fdccd8f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:46.252394 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-403dcca5-f415-492b-9045-fb9e41ecdeb6 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:46.264359 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-403dcca5-f415-492b-9045-fb9e41ecdeb6 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf" status: 200 len: 1517 microversion: 2.1 time: 0.698716 Jul 25 14:34:46.270257 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1288/2419] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:45 2022] GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf => generated 1517 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:46.322341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-98c7f89d-af91-4b76-83f0-33450d3ee0a5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:46.323141 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-98c7f89d-af91-4b76-83f0-33450d3ee0a5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: d553191e-ef64-4d5c-8e11-fae84f68532d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:46.340005 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98c7f89d-af91-4b76-83f0-33450d3ee0a5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:46.340466 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98c7f89d-af91-4b76-83f0-33450d3ee0a5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:46.341283 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98c7f89d-af91-4b76-83f0-33450d3ee0a5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:46.341697 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98c7f89d-af91-4b76-83f0-33450d3ee0a5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:46.488262 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-08145892-0efd-4256-aa46-b7ff7fdccd8f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:46.506255 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-08145892-0efd-4256-aa46-b7ff7fdccd8f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1718 microversion: 2.1 time: 0.525473 Jul 25 14:34:46.506925 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1132/2420] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:45 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1718 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:46.586965 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-ec289835-79ee-47c7-add7-01ce26a61433 req-04427ac5-e2bf-4197-a06e-78e625d13640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "493e0a70-7ee8-498b-83e5-f66f83344edf", "name": "network-vif-deleted", "tag": "59b7d34a-577f-450a-994b-02cfc971c6f7"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:46.609867 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ec289835-79ee-47c7-add7-01ce26a61433 req-04427ac5-e2bf-4197-a06e-78e625d13640 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:46.611167 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ec289835-79ee-47c7-add7-01ce26a61433 req-04427ac5-e2bf-4197-a06e-78e625d13640 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:46.626552 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-ec289835-79ee-47c7-add7-01ce26a61433 req-04427ac5-e2bf-4197-a06e-78e625d13640 service nova] Creating event network-vif-deleted:59b7d34a-577f-450a-994b-02cfc971c6f7 for instance 493e0a70-7ee8-498b-83e5-f66f83344edf on n-h1-846435-14 Jul 25 14:34:46.636368 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-ec289835-79ee-47c7-add7-01ce26a61433 req-04427ac5-e2bf-4197-a06e-78e625d13640 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051275 Jul 25 14:34:46.637832 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1133/2421] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:34:46.847125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-98c7f89d-af91-4b76-83f0-33450d3ee0a5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:46.858646 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-98c7f89d-af91-4b76-83f0-33450d3ee0a5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d" status: 200 len: 1316 microversion: 2.1 time: 0.539308 Jul 25 14:34:46.861191 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1289/2422] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:46 2022] GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d => generated 1316 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:47.291386 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a0eb955c-0466-49ae-a20f-a52b580e1502 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:47.292155 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a0eb955c-0466-49ae-a20f-a52b580e1502 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 493e0a70-7ee8-498b-83e5-f66f83344edf] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:47.310893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a0eb955c-0466-49ae-a20f-a52b580e1502 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:47.311604 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a0eb955c-0466-49ae-a20f-a52b580e1502 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:47.312600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a0eb955c-0466-49ae-a20f-a52b580e1502 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:47.313192 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a0eb955c-0466-49ae-a20f-a52b580e1502 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:47.384174 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a0eb955c-0466-49ae-a20f-a52b580e1502 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:47.392822 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a0eb955c-0466-49ae-a20f-a52b580e1502 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:47.393737 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-a0eb955c-0466-49ae-a20f-a52b580e1502 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lazy-loading 'fault' on Instance uuid 493e0a70-7ee8-498b-83e5-f66f83344edf {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:34:47.471163 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a0eb955c-0466-49ae-a20f-a52b580e1502 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:47.482934 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a0eb955c-0466-49ae-a20f-a52b580e1502 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf" status: 200 len: 1311 microversion: 2.1 time: 0.194039 Jul 25 14:34:47.485549 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1134/2423] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:47 2022] GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf => generated 1311 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:47.538976 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cbf63618-efbc-43f0-874a-c59f2af223c3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:47.541448 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cbf63618-efbc-43f0-874a-c59f2af223c3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:47.558114 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cbf63618-efbc-43f0-874a-c59f2af223c3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:47.558857 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cbf63618-efbc-43f0-874a-c59f2af223c3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:47.559822 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cbf63618-efbc-43f0-874a-c59f2af223c3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:47.563596 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cbf63618-efbc-43f0-874a-c59f2af223c3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:47.879544 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2f9bd5ca-aaec-495e-9f33-caf69ecfeffa tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:47.880330 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2f9bd5ca-aaec-495e-9f33-caf69ecfeffa tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: d553191e-ef64-4d5c-8e11-fae84f68532d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:47.895092 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f9bd5ca-aaec-495e-9f33-caf69ecfeffa tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:47.895678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f9bd5ca-aaec-495e-9f33-caf69ecfeffa tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:47.898507 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f9bd5ca-aaec-495e-9f33-caf69ecfeffa tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:47.899114 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f9bd5ca-aaec-495e-9f33-caf69ecfeffa tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:48.021805 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cbf63618-efbc-43f0-874a-c59f2af223c3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:48.040680 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cbf63618-efbc-43f0-874a-c59f2af223c3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1718 microversion: 2.1 time: 0.508486 Jul 25 14:34:48.043562 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1290/2424] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:47 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1718 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:48.243444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-ac33f4eb-e353-489a-b916-8b7df4be1518 req-93b476e6-75d1-44c7-8588-d07a9e00d366 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1009be4-53ff-4893-836c-ba96f07a0d60", "tag": "a70f2535-e346-4125-80e5-abda9464ab7e"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:48.260255 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ac33f4eb-e353-489a-b916-8b7df4be1518 req-93b476e6-75d1-44c7-8588-d07a9e00d366 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:48.261067 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ac33f4eb-e353-489a-b916-8b7df4be1518 req-93b476e6-75d1-44c7-8588-d07a9e00d366 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:48.283138 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-ac33f4eb-e353-489a-b916-8b7df4be1518 req-93b476e6-75d1-44c7-8588-d07a9e00d366 service nova] Creating event network-changed:a70f2535-e346-4125-80e5-abda9464ab7e for instance f1009be4-53ff-4893-836c-ba96f07a0d60 on n-h2-846435-14 Jul 25 14:34:48.298141 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-ac33f4eb-e353-489a-b916-8b7df4be1518 req-93b476e6-75d1-44c7-8588-d07a9e00d366 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060010 Jul 25 14:34:48.300570 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1291/2425] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:34:48.509109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c366cfa6-4cc7-4974-a018-0feb760b315e tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:48.510146 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c366cfa6-4cc7-4974-a018-0feb760b315e tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 493e0a70-7ee8-498b-83e5-f66f83344edf] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:48.525266 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c366cfa6-4cc7-4974-a018-0feb760b315e tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:48.526011 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c366cfa6-4cc7-4974-a018-0feb760b315e tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:48.531494 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c366cfa6-4cc7-4974-a018-0feb760b315e tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:48.532396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c366cfa6-4cc7-4974-a018-0feb760b315e tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:48.586738 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-c366cfa6-4cc7-4974-a018-0feb760b315e tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] HTTP exception thrown: Instance 493e0a70-7ee8-498b-83e5-f66f83344edf could not be found. Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c366cfa6-4cc7-4974-a018-0feb760b315e tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Request method failure captured: Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf HTTP/1.1 Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qm9Y6fIcUUMNN_WmLcReF_jReU5s5msg3f28sFxhaj657su6UEJIPBccFR9PAMgyPrPyTOFNADSAOKT3BWeu9sJn_hfj7Wgsm5PFycRzrNT40ZbNTRiNYynTh2TmXYiJlz5IbA8U9GsR8uM5H3cYo2iza_3WnarcTTKIhFc8ydY7A4 Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 2383030b07e34f93b9637c637f8f0ae7 Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ListServerFiltersTestJSON-1203309932 Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2383030b07e34f93b9637c637f8f0ae7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2383030b07e34f93b9637c637f8f0ae7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2383030b07e34f93b9637c637f8f0ae7", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2383030b07e34f93b9637c637f8f0ae7"}]}] Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ListServerFiltersTestJSON-1203309932 Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 2383030b07e34f93b9637c637f8f0ae7 Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1203309932 Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ListServerFiltersTestJSON-1203309932-project Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 5a4fe4300ea142eb88bde8deab2d1e3c Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ListServerFiltersTestJSON-1203309932-project Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 493e0a70-7ee8-498b-83e5-f66f83344edf could not be found. Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '493e0a70-7ee8-498b-83e5-f66f83344edf'} Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 493e0a70-7ee8-498b-83e5-f66f83344edf could not be found. Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 493e0a70-7ee8-498b-83e5-f66f83344edf could not be found. Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:34:48.591051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:48.595356 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:48.595356 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:34:48.595356 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:34:48.595356 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:34:48.595356 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:34:48.595356 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 493e0a70-7ee8-498b-83e5-f66f83344edf could not be found. Jul 25 14:34:48.595356 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:48.595356 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c366cfa6-4cc7-4974-a018-0feb760b315e tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Returning 404 to user: Instance 493e0a70-7ee8-498b-83e5-f66f83344edf could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:34:48.595356 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c366cfa6-4cc7-4974-a018-0feb760b315e tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf" status: 404 len: 111 microversion: 2.1 time: 0.089235 Jul 25 14:34:48.600730 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1292/2426] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:48 2022] GET /compute/v2.1/servers/493e0a70-7ee8-498b-83e5-f66f83344edf => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:34:48.618778 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8d4bf3f4-c19e-4b40-883c-edf0938a0632 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:48.619599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8d4bf3f4-c19e-4b40-883c-edf0938a0632 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 079ec21d-9dbc-4c93-a119-bf1bd0c06a15] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:48.631103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d4bf3f4-c19e-4b40-883c-edf0938a0632 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:48.631866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d4bf3f4-c19e-4b40-883c-edf0938a0632 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:48.639662 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d4bf3f4-c19e-4b40-883c-edf0938a0632 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:48.640416 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d4bf3f4-c19e-4b40-883c-edf0938a0632 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:48.698958 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8d4bf3f4-c19e-4b40-883c-edf0938a0632 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 079ec21d-9dbc-4c93-a119-bf1bd0c06a15] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:34:48.795317 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2f9bd5ca-aaec-495e-9f33-caf69ecfeffa tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:48.820200 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2f9bd5ca-aaec-495e-9f33-caf69ecfeffa tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d" status: 200 len: 1465 microversion: 2.1 time: 0.944368 Jul 25 14:34:48.821903 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1135/2427] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:47 2022] GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d => generated 1465 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:48.842821 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-56c58deb-3b74-4fc8-af73-593feb02b58b tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:48.844605 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-56c58deb-3b74-4fc8-af73-593feb02b58b tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] [instance: d553191e-ef64-4d5c-8e11-fae84f68532d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:48.858723 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56c58deb-3b74-4fc8-af73-593feb02b58b tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:48.861117 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56c58deb-3b74-4fc8-af73-593feb02b58b tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:48.863055 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56c58deb-3b74-4fc8-af73-593feb02b58b tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:48.866244 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56c58deb-3b74-4fc8-af73-593feb02b58b tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:48.903709 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8d4bf3f4-c19e-4b40-883c-edf0938a0632 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "DELETE /compute/v2.1/servers/079ec21d-9dbc-4c93-a119-bf1bd0c06a15" status: 204 len: 0 microversion: 2.1 time: 0.301110 Jul 25 14:34:48.909604 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1293/2428] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:34:48 2022] DELETE /compute/v2.1/servers/079ec21d-9dbc-4c93-a119-bf1bd0c06a15 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:34:48.924387 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3e502535-9945-4917-b7a6-e99035bd9426 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:48.925438 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3e502535-9945-4917-b7a6-e99035bd9426 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 079ec21d-9dbc-4c93-a119-bf1bd0c06a15] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:48.943118 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e502535-9945-4917-b7a6-e99035bd9426 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:48.943896 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e502535-9945-4917-b7a6-e99035bd9426 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:48.945026 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e502535-9945-4917-b7a6-e99035bd9426 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:48.947129 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e502535-9945-4917-b7a6-e99035bd9426 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:49.034836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:34:49.342375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3e502535-9945-4917-b7a6-e99035bd9426 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:49.351869 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3e502535-9945-4917-b7a6-e99035bd9426 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/079ec21d-9dbc-4c93-a119-bf1bd0c06a15" status: 200 len: 1518 microversion: 2.1 time: 0.434438 Jul 25 14:34:49.356908 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1294/2429] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:48 2022] GET /compute/v2.1/servers/079ec21d-9dbc-4c93-a119-bf1bd0c06a15 => generated 1518 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:49.372251 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-37ffb03b-3ddd-4d01-96db-b233c053fd8f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:49.373275 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-37ffb03b-3ddd-4d01-96db-b233c053fd8f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:49.390050 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37ffb03b-3ddd-4d01-96db-b233c053fd8f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:49.390861 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37ffb03b-3ddd-4d01-96db-b233c053fd8f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:49.391909 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37ffb03b-3ddd-4d01-96db-b233c053fd8f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:49.392608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37ffb03b-3ddd-4d01-96db-b233c053fd8f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:49.761912 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-37ffb03b-3ddd-4d01-96db-b233c053fd8f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:49.772117 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-37ffb03b-3ddd-4d01-96db-b233c053fd8f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1718 microversion: 2.1 time: 0.413764 Jul 25 14:34:49.812554 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1295/2430] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:49 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1718 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:50.198171 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-56c58deb-3b74-4fc8-af73-593feb02b58b tempest-ServersOnMultiNodesTest-1484434793 tempest-ServersOnMultiNodesTest-1484434793-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d" status: 200 len: 1618 microversion: 2.1 time: 1.358916 Jul 25 14:34:50.202782 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1136/2431] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:48 2022] GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d => generated 1618 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:50.225277 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-22abf691-82b6-42b5-a9d1-b518ed4b6732 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:50.226456 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-22abf691-82b6-42b5-a9d1-b518ed4b6732 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: d553191e-ef64-4d5c-8e11-fae84f68532d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:50.234351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-22abf691-82b6-42b5-a9d1-b518ed4b6732 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:50.235103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-22abf691-82b6-42b5-a9d1-b518ed4b6732 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:50.236085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-22abf691-82b6-42b5-a9d1-b518ed4b6732 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:50.236654 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-22abf691-82b6-42b5-a9d1-b518ed4b6732 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:50.283586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-22abf691-82b6-42b5-a9d1-b518ed4b6732 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: d553191e-ef64-4d5c-8e11-fae84f68532d] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:34:50.395522 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c028e08c-5cc8-4d77-aaaf-651a3b94fcb0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:50.396788 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c028e08c-5cc8-4d77-aaaf-651a3b94fcb0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 079ec21d-9dbc-4c93-a119-bf1bd0c06a15] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:50.416801 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c028e08c-5cc8-4d77-aaaf-651a3b94fcb0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:50.418537 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c028e08c-5cc8-4d77-aaaf-651a3b94fcb0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:50.421118 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c028e08c-5cc8-4d77-aaaf-651a3b94fcb0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:50.424125 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c028e08c-5cc8-4d77-aaaf-651a3b94fcb0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:50.512500 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-22abf691-82b6-42b5-a9d1-b518ed4b6732 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "DELETE /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d" status: 204 len: 0 microversion: 2.1 time: 0.290841 Jul 25 14:34:50.513876 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1296/2432] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:34:50 2022] DELETE /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 14:34:50.526713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7e0c723a-e4ce-40ba-8b48-329e3743a611 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:50.529451 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7e0c723a-e4ce-40ba-8b48-329e3743a611 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: d553191e-ef64-4d5c-8e11-fae84f68532d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:50.546957 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7e0c723a-e4ce-40ba-8b48-329e3743a611 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:50.550945 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7e0c723a-e4ce-40ba-8b48-329e3743a611 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:50.552914 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7e0c723a-e4ce-40ba-8b48-329e3743a611 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:50.555772 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7e0c723a-e4ce-40ba-8b48-329e3743a611 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:50.863767 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7e0c723a-e4ce-40ba-8b48-329e3743a611 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:50.878711 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7e0c723a-e4ce-40ba-8b48-329e3743a611 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d" status: 200 len: 1471 microversion: 2.1 time: 0.356748 Jul 25 14:34:50.879595 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1297/2433] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:50 2022] GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d => generated 1471 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:50.894663 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-55fdeec7-ea36-404f-ba17-60a8f5e6b5bc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:50.901617 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-55fdeec7-ea36-404f-ba17-60a8f5e6b5bc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:50.915472 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55fdeec7-ea36-404f-ba17-60a8f5e6b5bc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:50.917355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55fdeec7-ea36-404f-ba17-60a8f5e6b5bc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:50.921402 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55fdeec7-ea36-404f-ba17-60a8f5e6b5bc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:50.921851 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55fdeec7-ea36-404f-ba17-60a8f5e6b5bc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:50.941837 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:34:51.205616 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c028e08c-5cc8-4d77-aaaf-651a3b94fcb0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:51.227786 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c028e08c-5cc8-4d77-aaaf-651a3b94fcb0 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/079ec21d-9dbc-4c93-a119-bf1bd0c06a15" status: 200 len: 1518 microversion: 2.1 time: 0.851573 Jul 25 14:34:51.231138 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1137/2434] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:50 2022] GET /compute/v2.1/servers/079ec21d-9dbc-4c93-a119-bf1bd0c06a15 => generated 1518 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:51.551335 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-55fdeec7-ea36-404f-ba17-60a8f5e6b5bc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:51.569053 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-55fdeec7-ea36-404f-ba17-60a8f5e6b5bc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1718 microversion: 2.1 time: 0.684539 Jul 25 14:34:51.581271 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1298/2435] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:50 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1718 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:51.901185 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-155685b4-a525-49b7-b84e-a30053d75620 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:51.902068 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-155685b4-a525-49b7-b84e-a30053d75620 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: d553191e-ef64-4d5c-8e11-fae84f68532d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:51.926011 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-155685b4-a525-49b7-b84e-a30053d75620 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:51.928154 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-155685b4-a525-49b7-b84e-a30053d75620 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:51.929160 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-155685b4-a525-49b7-b84e-a30053d75620 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:51.932437 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-155685b4-a525-49b7-b84e-a30053d75620 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:52.251073 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-94a9075d-450d-4430-9481-7348ff73dd93 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:52.251823 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-94a9075d-450d-4430-9481-7348ff73dd93 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 079ec21d-9dbc-4c93-a119-bf1bd0c06a15] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:52.254421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=16 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:34:52.264699 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:34:52.269284 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94a9075d-450d-4430-9481-7348ff73dd93 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:52.271319 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94a9075d-450d-4430-9481-7348ff73dd93 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:52.274661 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94a9075d-450d-4430-9481-7348ff73dd93 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:52.288316 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94a9075d-450d-4430-9481-7348ff73dd93 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:52.487058 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-155685b4-a525-49b7-b84e-a30053d75620 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:52.501227 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-155685b4-a525-49b7-b84e-a30053d75620 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d" status: 200 len: 1471 microversion: 2.1 time: 0.599144 Jul 25 14:34:52.502629 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1138/2436] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:51 2022] GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d => generated 1471 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:52.519591 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-8f4a8a95-ce0e-43fa-9a84-4097ed0ff133 req-922d9990-276f-4d86-af87-5e0404e6e829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "079ec21d-9dbc-4c93-a119-bf1bd0c06a15", "name": "network-vif-deleted", "tag": "a871744f-f765-4b19-88f6-265233dc20a2"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:52.534179 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-8f4a8a95-ce0e-43fa-9a84-4097ed0ff133 req-922d9990-276f-4d86-af87-5e0404e6e829 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:52.536863 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-8f4a8a95-ce0e-43fa-9a84-4097ed0ff133 req-922d9990-276f-4d86-af87-5e0404e6e829 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:52.562652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-94a9075d-450d-4430-9481-7348ff73dd93 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:52.563743 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-8f4a8a95-ce0e-43fa-9a84-4097ed0ff133 req-922d9990-276f-4d86-af87-5e0404e6e829 service nova] Creating event network-vif-deleted:a871744f-f765-4b19-88f6-265233dc20a2 for instance 079ec21d-9dbc-4c93-a119-bf1bd0c06a15 on n-h1-846435-14 Jul 25 14:34:52.579247 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-8f4a8a95-ce0e-43fa-9a84-4097ed0ff133 req-922d9990-276f-4d86-af87-5e0404e6e829 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075074 Jul 25 14:34:52.580025 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1139/2437] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:34:52.593402 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-94a9075d-450d-4430-9481-7348ff73dd93 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/079ec21d-9dbc-4c93-a119-bf1bd0c06a15" status: 200 len: 1306 microversion: 2.1 time: 0.341899 Jul 25 14:34:52.595355 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a65289a2-a638-4f9d-b2d5-850874b132f9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:52.596216 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a65289a2-a638-4f9d-b2d5-850874b132f9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:52.606193 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a65289a2-a638-4f9d-b2d5-850874b132f9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:52.609245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a65289a2-a638-4f9d-b2d5-850874b132f9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:52.610248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a65289a2-a638-4f9d-b2d5-850874b132f9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:52.614223 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1299/2438] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:52 2022] GET /compute/v2.1/servers/079ec21d-9dbc-4c93-a119-bf1bd0c06a15 => generated 1306 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:52.615024 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a65289a2-a638-4f9d-b2d5-850874b132f9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:53.072919 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a65289a2-a638-4f9d-b2d5-850874b132f9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:53.086051 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a65289a2-a638-4f9d-b2d5-850874b132f9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1718 microversion: 2.1 time: 0.493079 Jul 25 14:34:53.102285 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1140/2439] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:52 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1718 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:53.524198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4648c1a7-b448-4784-8a08-c35f4f9a38c2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:53.525099 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4648c1a7-b448-4784-8a08-c35f4f9a38c2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: d553191e-ef64-4d5c-8e11-fae84f68532d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:53.543049 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4648c1a7-b448-4784-8a08-c35f4f9a38c2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:53.545718 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4648c1a7-b448-4784-8a08-c35f4f9a38c2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:53.550033 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4648c1a7-b448-4784-8a08-c35f4f9a38c2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:53.550972 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4648c1a7-b448-4784-8a08-c35f4f9a38c2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:53.614198 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bcc56198-cf8a-48e4-92f2-0d5e4cc6bbcb tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:53.614769 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bcc56198-cf8a-48e4-92f2-0d5e4cc6bbcb tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 079ec21d-9dbc-4c93-a119-bf1bd0c06a15] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:53.634385 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bcc56198-cf8a-48e4-92f2-0d5e4cc6bbcb tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:53.635116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bcc56198-cf8a-48e4-92f2-0d5e4cc6bbcb tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:53.636016 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bcc56198-cf8a-48e4-92f2-0d5e4cc6bbcb tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:53.636435 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bcc56198-cf8a-48e4-92f2-0d5e4cc6bbcb tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:53.691685 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-bcc56198-cf8a-48e4-92f2-0d5e4cc6bbcb tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] HTTP exception thrown: Instance 079ec21d-9dbc-4c93-a119-bf1bd0c06a15 could not be found. Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bcc56198-cf8a-48e4-92f2-0d5e4cc6bbcb tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Request method failure captured: Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/079ec21d-9dbc-4c93-a119-bf1bd0c06a15 HTTP/1.1 Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qm9Y6fIcUUMNN_WmLcReF_jReU5s5msg3f28sFxhaj657su6UEJIPBccFR9PAMgyPrPyTOFNADSAOKT3BWeu9sJn_hfj7Wgsm5PFycRzrNT40ZbNTRiNYynTh2TmXYiJlz5IbA8U9GsR8uM5H3cYo2iza_3WnarcTTKIhFc8ydY7A4 Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 2383030b07e34f93b9637c637f8f0ae7 Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ListServerFiltersTestJSON-1203309932 Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2383030b07e34f93b9637c637f8f0ae7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2383030b07e34f93b9637c637f8f0ae7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2383030b07e34f93b9637c637f8f0ae7", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2383030b07e34f93b9637c637f8f0ae7"}]}] Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ListServerFiltersTestJSON-1203309932 Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 2383030b07e34f93b9637c637f8f0ae7 Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1203309932 Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ListServerFiltersTestJSON-1203309932-project Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 5a4fe4300ea142eb88bde8deab2d1e3c Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ListServerFiltersTestJSON-1203309932-project Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 079ec21d-9dbc-4c93-a119-bf1bd0c06a15 could not be found. Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '079ec21d-9dbc-4c93-a119-bf1bd0c06a15'} Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 079ec21d-9dbc-4c93-a119-bf1bd0c06a15 could not be found. Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 079ec21d-9dbc-4c93-a119-bf1bd0c06a15 could not be found. Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:34:53.695601 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:34:53.699499 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:53.699499 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:34:53.699499 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:34:53.699499 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:34:53.699499 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:34:53.699499 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 079ec21d-9dbc-4c93-a119-bf1bd0c06a15 could not be found. Jul 25 14:34:53.699499 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:34:53.699499 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bcc56198-cf8a-48e4-92f2-0d5e4cc6bbcb tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Returning 404 to user: Instance 079ec21d-9dbc-4c93-a119-bf1bd0c06a15 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:34:53.699499 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bcc56198-cf8a-48e4-92f2-0d5e4cc6bbcb tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/079ec21d-9dbc-4c93-a119-bf1bd0c06a15" status: 404 len: 111 microversion: 2.1 time: 0.089458 Jul 25 14:34:53.702285 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1141/2440] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:53 2022] GET /compute/v2.1/servers/079ec21d-9dbc-4c93-a119-bf1bd0c06a15 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:34:53.709068 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-10a42e43-1000-4cb0-a23d-2c8f3dc981a6 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:53.712678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-10a42e43-1000-4cb0-a23d-2c8f3dc981a6 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 542ab1a2-380f-4f4f-95ec-5d68eb9bd091] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:53.717358 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:34:53.729531 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-10a42e43-1000-4cb0-a23d-2c8f3dc981a6 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:53.731373 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-10a42e43-1000-4cb0-a23d-2c8f3dc981a6 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:53.732393 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-10a42e43-1000-4cb0-a23d-2c8f3dc981a6 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:53.733557 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-10a42e43-1000-4cb0-a23d-2c8f3dc981a6 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:53.815236 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-10a42e43-1000-4cb0-a23d-2c8f3dc981a6 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 542ab1a2-380f-4f4f-95ec-5d68eb9bd091] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:34:53.985247 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-10a42e43-1000-4cb0-a23d-2c8f3dc981a6 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "DELETE /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091" status: 204 len: 0 microversion: 2.1 time: 0.279756 Jul 25 14:34:53.986503 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1142/2441] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:34:53 2022] DELETE /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:34:54.004675 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c2b07a5c-fec1-4566-b39c-9d693362328b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:54.005808 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c2b07a5c-fec1-4566-b39c-9d693362328b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 542ab1a2-380f-4f4f-95ec-5d68eb9bd091] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:54.019756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c2b07a5c-fec1-4566-b39c-9d693362328b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:54.022213 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c2b07a5c-fec1-4566-b39c-9d693362328b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:54.024613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c2b07a5c-fec1-4566-b39c-9d693362328b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:54.025585 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c2b07a5c-fec1-4566-b39c-9d693362328b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:54.425935 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4648c1a7-b448-4784-8a08-c35f4f9a38c2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:54.447007 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4648c1a7-b448-4784-8a08-c35f4f9a38c2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d" status: 200 len: 1471 microversion: 2.1 time: 0.927943 Jul 25 14:34:54.448852 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1300/2442] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:53 2022] GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d => generated 1471 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:54.465960 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-276094cc-2646-44a3-a1f5-fb1aa786dd31 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:54.467292 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-276094cc-2646-44a3-a1f5-fb1aa786dd31 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:54.477926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-276094cc-2646-44a3-a1f5-fb1aa786dd31 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:54.478877 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-276094cc-2646-44a3-a1f5-fb1aa786dd31 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:54.480604 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-276094cc-2646-44a3-a1f5-fb1aa786dd31 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:54.482608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-276094cc-2646-44a3-a1f5-fb1aa786dd31 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:54.793203 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-276094cc-2646-44a3-a1f5-fb1aa786dd31 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:54.811316 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-276094cc-2646-44a3-a1f5-fb1aa786dd31 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1718 microversion: 2.1 time: 0.361114 Jul 25 14:34:54.811960 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1301/2443] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:54 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1718 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:54.822669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-e3d464a3-8f68-46ed-a087-d55d38c8668c req-dc71bb0d-6b6a-46cd-9dd0-883777df65cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d553191e-ef64-4d5c-8e11-fae84f68532d", "name": "network-vif-deleted", "tag": "3a833966-d87a-4d80-a6b6-a0ab454a4377"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:54.846327 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-e3d464a3-8f68-46ed-a087-d55d38c8668c req-dc71bb0d-6b6a-46cd-9dd0-883777df65cd service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:54.850412 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-e3d464a3-8f68-46ed-a087-d55d38c8668c req-dc71bb0d-6b6a-46cd-9dd0-883777df65cd service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:54.880367 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-e3d464a3-8f68-46ed-a087-d55d38c8668c req-dc71bb0d-6b6a-46cd-9dd0-883777df65cd service nova] Creating event network-vif-deleted:3a833966-d87a-4d80-a6b6-a0ab454a4377 for instance d553191e-ef64-4d5c-8e11-fae84f68532d on n-h2-846435-14 Jul 25 14:34:54.891000 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-e3d464a3-8f68-46ed-a087-d55d38c8668c req-dc71bb0d-6b6a-46cd-9dd0-883777df65cd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073021 Jul 25 14:34:54.892337 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1302/2444] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:34:54.899950 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c2b07a5c-fec1-4566-b39c-9d693362328b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:54.912259 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c2b07a5c-fec1-4566-b39c-9d693362328b tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091" status: 200 len: 1517 microversion: 2.1 time: 0.916436 Jul 25 14:34:54.916582 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1143/2445] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:53 2022] GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091 => generated 1517 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:55.207615 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-48e6b9d4-6d9f-4334-ab55-9d7bffa0ab03 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-60514322", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": "none"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:55.304739 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-48e6b9d4-6d9f-4334-ab55-9d7bffa0ab03 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:34:55.305409 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-48e6b9d4-6d9f-4334-ab55-9d7bffa0ab03 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:34:55.306155 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-48e6b9d4-6d9f-4334-ab55-9d7bffa0ab03 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:34:55.306911 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-48e6b9d4-6d9f-4334-ab55-9d7bffa0ab03 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:34:55.307512 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-48e6b9d4-6d9f-4334-ab55-9d7bffa0ab03 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:34:55.318608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48e6b9d4-6d9f-4334-ab55-9d7bffa0ab03 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:55.319403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48e6b9d4-6d9f-4334-ab55-9d7bffa0ab03 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:55.320421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48e6b9d4-6d9f-4334-ab55-9d7bffa0ab03 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:55.321063 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48e6b9d4-6d9f-4334-ab55-9d7bffa0ab03 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:55.342000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-48e6b9d4-6d9f-4334-ab55-9d7bffa0ab03 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Getting quotas for project 424cf1b5a203481cb710072586047c96. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:34:55.349208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-48e6b9d4-6d9f-4334-ab55-9d7bffa0ab03 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Getting quotas for user 35de8fc36e374d458912d66b2c12e8bf and project 424cf1b5a203481cb710072586047c96. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:34:55.367439 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-48e6b9d4-6d9f-4334-ab55-9d7bffa0ab03 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:34:55.370713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-48e6b9d4-6d9f-4334-ab55-9d7bffa0ab03 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] [instance: a907dc6b-f4b7-4f2e-9871-23a5ae4db92d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:34:55.470283 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-58b81319-8440-4189-8faa-f3527a8b0975 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:55.472057 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-58b81319-8440-4189-8faa-f3527a8b0975 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: d553191e-ef64-4d5c-8e11-fae84f68532d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:55.482875 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-58b81319-8440-4189-8faa-f3527a8b0975 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:55.483310 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-58b81319-8440-4189-8faa-f3527a8b0975 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:55.489660 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-58b81319-8440-4189-8faa-f3527a8b0975 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:55.490374 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-58b81319-8440-4189-8faa-f3527a8b0975 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:55.499720 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-48e6b9d4-6d9f-4334-ab55-9d7bffa0ab03 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.605861 Jul 25 14:34:55.503391 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1303/2446] 10.222.0.88 () {62 vars in 1188 bytes} [Mon Jul 25 14:34:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 14:34:55.519466 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0ef9e0f6-9e42-4b9c-aac8-7075281574fd tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:55.520566 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0ef9e0f6-9e42-4b9c-aac8-7075281574fd tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] [instance: a907dc6b-f4b7-4f2e-9871-23a5ae4db92d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:55.691438 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-58b81319-8440-4189-8faa-f3527a8b0975 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:55.713000 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-58b81319-8440-4189-8faa-f3527a8b0975 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d" status: 200 len: 1301 microversion: 2.1 time: 0.246432 Jul 25 14:34:55.713952 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1144/2447] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:55 2022] GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d => generated 1301 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:55.837662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6afc3640-5b86-485d-a788-99e7e265d985 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:55.838325 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6afc3640-5b86-485d-a788-99e7e265d985 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:55.845597 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6afc3640-5b86-485d-a788-99e7e265d985 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:55.846042 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6afc3640-5b86-485d-a788-99e7e265d985 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:55.850416 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6afc3640-5b86-485d-a788-99e7e265d985 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:55.855945 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6afc3640-5b86-485d-a788-99e7e265d985 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:55.897749 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0ef9e0f6-9e42-4b9c-aac8-7075281574fd tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35de8fc36e374d458912d66b2c12e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424cf1b5a203481cb710072586047c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:55.906361 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0ef9e0f6-9e42-4b9c-aac8-7075281574fd tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35de8fc36e374d458912d66b2c12e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424cf1b5a203481cb710072586047c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:55.916639 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0ef9e0f6-9e42-4b9c-aac8-7075281574fd tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35de8fc36e374d458912d66b2c12e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424cf1b5a203481cb710072586047c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:55.919825 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0ef9e0f6-9e42-4b9c-aac8-7075281574fd tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] 10.222.0.88 "GET /compute/v2.1/servers/a907dc6b-f4b7-4f2e-9871-23a5ae4db92d" status: 200 len: 1279 microversion: 2.47 time: 0.408012 Jul 25 14:34:55.935383 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1304/2448] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:34:55 2022] GET /compute/v2.1/servers/a907dc6b-f4b7-4f2e-9871-23a5ae4db92d => generated 1279 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:34:55.950804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7eabd2d6-4f0e-408d-aaf9-c446f767c8ce tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:55.952421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7eabd2d6-4f0e-408d-aaf9-c446f767c8ce tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 542ab1a2-380f-4f4f-95ec-5d68eb9bd091] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:55.970678 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7eabd2d6-4f0e-408d-aaf9-c446f767c8ce tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:55.976841 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7eabd2d6-4f0e-408d-aaf9-c446f767c8ce tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:55.979493 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7eabd2d6-4f0e-408d-aaf9-c446f767c8ce tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:55.980208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7eabd2d6-4f0e-408d-aaf9-c446f767c8ce tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:56.258969 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6afc3640-5b86-485d-a788-99e7e265d985 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:56.269490 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6afc3640-5b86-485d-a788-99e7e265d985 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1718 microversion: 2.1 time: 0.436327 Jul 25 14:34:56.272883 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1145/2449] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:55 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1718 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:34:56.589256 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7eabd2d6-4f0e-408d-aaf9-c446f767c8ce tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:56.600428 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7eabd2d6-4f0e-408d-aaf9-c446f767c8ce tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091" status: 200 len: 1517 microversion: 2.1 time: 0.661227 Jul 25 14:34:56.632576 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1305/2450] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:55 2022] GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091 => generated 1517 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:56.734906 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5ecc3784-3941-4a0b-bfc2-6948a9801a5e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:56.735529 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5ecc3784-3941-4a0b-bfc2-6948a9801a5e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: d553191e-ef64-4d5c-8e11-fae84f68532d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:56.745675 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5ecc3784-3941-4a0b-bfc2-6948a9801a5e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:56.746365 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5ecc3784-3941-4a0b-bfc2-6948a9801a5e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:56.747502 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5ecc3784-3941-4a0b-bfc2-6948a9801a5e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:56.748735 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5ecc3784-3941-4a0b-bfc2-6948a9801a5e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:56.767848 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-5ecc3784-3941-4a0b-bfc2-6948a9801a5e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] HTTP exception thrown: Instance d553191e-ef64-4d5c-8e11-fae84f68532d could not be found. Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5ecc3784-3941-4a0b-bfc2-6948a9801a5e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Request method failure captured: Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d HTTP/1.1 Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qlv3rUVhKaGUoIKKGCuOMD0I6MIoDHjqjO5RyR6Pj_BNVDpq--kNeH85TVlPgBPT3niD-JaccAzA0CF2Z_lYSTDSSqak2SKY3MirR2urYA-2v4fgO5i4-3PmjSM_AwPL5Le0cUs5lB3O6LfBXz1C0XPouGEhH0PZroAvYlxtcrUeto Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: e60b88c2aea642658a5bfc14780d5d51 Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersOnMultiNodesTest-1245955740 Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e60b88c2aea642658a5bfc14780d5d51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e60b88c2aea642658a5bfc14780d5d51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e60b88c2aea642658a5bfc14780d5d51", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e60b88c2aea642658a5bfc14780d5d51"}]}] Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersOnMultiNodesTest-1245955740 Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: e60b88c2aea642658a5bfc14780d5d51 Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1245955740 Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersOnMultiNodesTest-1245955740-project Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: ef351be3886949f9985b3244301435a9 Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersOnMultiNodesTest-1245955740-project Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance d553191e-ef64-4d5c-8e11-fae84f68532d could not be found. Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'd553191e-ef64-4d5c-8e11-fae84f68532d'} Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d553191e-ef64-4d5c-8e11-fae84f68532d could not be found. Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d553191e-ef64-4d5c-8e11-fae84f68532d could not be found. Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:34:56.769858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:34:56.773962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:56.773962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:34:56.773962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:34:56.773962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:34:56.773962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:34:56.773962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d553191e-ef64-4d5c-8e11-fae84f68532d could not be found. Jul 25 14:34:56.773962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:34:56.773962 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5ecc3784-3941-4a0b-bfc2-6948a9801a5e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Returning 404 to user: Instance d553191e-ef64-4d5c-8e11-fae84f68532d could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:34:56.773962 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5ecc3784-3941-4a0b-bfc2-6948a9801a5e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d" status: 404 len: 111 microversion: 2.1 time: 0.040554 Jul 25 14:34:56.773962 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1146/2451] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:56 2022] GET /compute/v2.1/servers/d553191e-ef64-4d5c-8e11-fae84f68532d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:34:56.789209 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a04de54f-2b12-4627-ab49-cb76798f1cee tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:56.790358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a04de54f-2b12-4627-ab49-cb76798f1cee tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 6de04885-8bb7-4d85-b292-ef576bb3fcf0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:56.816615 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a04de54f-2b12-4627-ab49-cb76798f1cee tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:56.818261 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a04de54f-2b12-4627-ab49-cb76798f1cee tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:56.820440 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a04de54f-2b12-4627-ab49-cb76798f1cee tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:56.822812 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a04de54f-2b12-4627-ab49-cb76798f1cee tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:56.874304 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a04de54f-2b12-4627-ab49-cb76798f1cee tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 6de04885-8bb7-4d85-b292-ef576bb3fcf0] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:34:56.946980 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4e7720c4-569e-450e-b7f2-c15d5aca9f8c tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:56.948177 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4e7720c4-569e-450e-b7f2-c15d5aca9f8c tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] [instance: a907dc6b-f4b7-4f2e-9871-23a5ae4db92d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:56.962173 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4e7720c4-569e-450e-b7f2-c15d5aca9f8c tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:56.964574 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4e7720c4-569e-450e-b7f2-c15d5aca9f8c tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:56.966479 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4e7720c4-569e-450e-b7f2-c15d5aca9f8c tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:56.967690 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4e7720c4-569e-450e-b7f2-c15d5aca9f8c tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:57.043104 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a04de54f-2b12-4627-ab49-cb76798f1cee tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "DELETE /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0" status: 204 len: 0 microversion: 2.1 time: 0.264412 Jul 25 14:34:57.043943 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1306/2452] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:34:56 2022] DELETE /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:34:57.057811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2d6b720b-07ff-4959-9738-41782753dcc0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:57.060296 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2d6b720b-07ff-4959-9738-41782753dcc0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 6de04885-8bb7-4d85-b292-ef576bb3fcf0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:57.068444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d6b720b-07ff-4959-9738-41782753dcc0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:57.069307 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d6b720b-07ff-4959-9738-41782753dcc0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:57.070419 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d6b720b-07ff-4959-9738-41782753dcc0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:57.071054 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d6b720b-07ff-4959-9738-41782753dcc0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:57.126412 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4e7720c4-569e-450e-b7f2-c15d5aca9f8c tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35de8fc36e374d458912d66b2c12e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424cf1b5a203481cb710072586047c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:57.138109 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4e7720c4-569e-450e-b7f2-c15d5aca9f8c tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35de8fc36e374d458912d66b2c12e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424cf1b5a203481cb710072586047c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:57.146456 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4e7720c4-569e-450e-b7f2-c15d5aca9f8c tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35de8fc36e374d458912d66b2c12e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424cf1b5a203481cb710072586047c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:57.147900 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4e7720c4-569e-450e-b7f2-c15d5aca9f8c tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] 10.222.0.88 "GET /compute/v2.1/servers/a907dc6b-f4b7-4f2e-9871-23a5ae4db92d" status: 200 len: 1331 microversion: 2.47 time: 0.205731 Jul 25 14:34:57.160830 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1147/2453] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:34:56 2022] GET /compute/v2.1/servers/a907dc6b-f4b7-4f2e-9871-23a5ae4db92d => generated 1331 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:34:57.296000 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f7e93dd2-db29-4cf8-a24e-767539945218 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:57.298095 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f7e93dd2-db29-4cf8-a24e-767539945218 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:57.313121 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f7e93dd2-db29-4cf8-a24e-767539945218 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:57.315488 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f7e93dd2-db29-4cf8-a24e-767539945218 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:57.318766 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f7e93dd2-db29-4cf8-a24e-767539945218 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:57.322925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f7e93dd2-db29-4cf8-a24e-767539945218 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:57.328837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:34:57.707164 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2d6b720b-07ff-4959-9738-41782753dcc0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:57.721273 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2d6b720b-07ff-4959-9738-41782753dcc0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0" status: 200 len: 1472 microversion: 2.1 time: 0.672498 Jul 25 14:34:57.721880 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1307/2454] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:57 2022] GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0 => generated 1472 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:57.735074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-ba70e6e2-8d4c-4ac5-b934-079cfe0f74c2 req-5b4c9dc1-8676-437b-a444-c2fce76ba139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "542ab1a2-380f-4f4f-95ec-5d68eb9bd091", "name": "network-vif-deleted", "tag": "872694ab-62cf-4c73-b402-73cf33e40ecb"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:34:57.761613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ba70e6e2-8d4c-4ac5-b934-079cfe0f74c2 req-5b4c9dc1-8676-437b-a444-c2fce76ba139 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:57.762075 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ba70e6e2-8d4c-4ac5-b934-079cfe0f74c2 req-5b4c9dc1-8676-437b-a444-c2fce76ba139 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:57.800621 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-ba70e6e2-8d4c-4ac5-b934-079cfe0f74c2 req-5b4c9dc1-8676-437b-a444-c2fce76ba139 service nova] Creating event network-vif-deleted:872694ab-62cf-4c73-b402-73cf33e40ecb for instance 542ab1a2-380f-4f4f-95ec-5d68eb9bd091 on n-h2-846435-14 Jul 25 14:34:57.813418 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-ba70e6e2-8d4c-4ac5-b934-079cfe0f74c2 req-5b4c9dc1-8676-437b-a444-c2fce76ba139 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089972 Jul 25 14:34:57.814766 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1308/2455] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:34:57.823455 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2b036ce9-2d0f-496f-9512-439703c81d2d tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:57.823455 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2b036ce9-2d0f-496f-9512-439703c81d2d tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 542ab1a2-380f-4f4f-95ec-5d68eb9bd091] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:57.870049 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b036ce9-2d0f-496f-9512-439703c81d2d tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:57.870847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b036ce9-2d0f-496f-9512-439703c81d2d tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:57.872122 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b036ce9-2d0f-496f-9512-439703c81d2d tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:57.872773 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b036ce9-2d0f-496f-9512-439703c81d2d tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:57.919605 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b036ce9-2d0f-496f-9512-439703c81d2d tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:57.920934 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b036ce9-2d0f-496f-9512-439703c81d2d tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:57.921561 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-2b036ce9-2d0f-496f-9512-439703c81d2d tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lazy-loading 'fault' on Instance uuid 542ab1a2-380f-4f4f-95ec-5d68eb9bd091 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:34:58.012700 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2b036ce9-2d0f-496f-9512-439703c81d2d tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4fe4300ea142eb88bde8deab2d1e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2383030b07e34f93b9637c637f8f0ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:58.014594 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f7e93dd2-db29-4cf8-a24e-767539945218 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:58.023893 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2b036ce9-2d0f-496f-9512-439703c81d2d tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091" status: 200 len: 1311 microversion: 2.1 time: 0.207712 Jul 25 14:34:58.025180 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1309/2456] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:57 2022] GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091 => generated 1311 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:58.044469 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f7e93dd2-db29-4cf8-a24e-767539945218 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1718 microversion: 2.1 time: 0.733374 Jul 25 14:34:58.046119 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1148/2457] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:57 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1718 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:58.175367 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f326c9b8-8685-4bf4-93e1-561382fd90b0 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:58.176209 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f326c9b8-8685-4bf4-93e1-561382fd90b0 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] [instance: a907dc6b-f4b7-4f2e-9871-23a5ae4db92d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:58.183458 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f326c9b8-8685-4bf4-93e1-561382fd90b0 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:58.192506 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f326c9b8-8685-4bf4-93e1-561382fd90b0 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:58.213096 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f326c9b8-8685-4bf4-93e1-561382fd90b0 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:58.218658 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f326c9b8-8685-4bf4-93e1-561382fd90b0 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:58.369332 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f326c9b8-8685-4bf4-93e1-561382fd90b0 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35de8fc36e374d458912d66b2c12e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424cf1b5a203481cb710072586047c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:58.386459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f326c9b8-8685-4bf4-93e1-561382fd90b0 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35de8fc36e374d458912d66b2c12e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424cf1b5a203481cb710072586047c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:58.388519 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f326c9b8-8685-4bf4-93e1-561382fd90b0 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35de8fc36e374d458912d66b2c12e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424cf1b5a203481cb710072586047c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:58.389908 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f326c9b8-8685-4bf4-93e1-561382fd90b0 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] 10.222.0.88 "GET /compute/v2.1/servers/a907dc6b-f4b7-4f2e-9871-23a5ae4db92d" status: 200 len: 1339 microversion: 2.47 time: 0.220095 Jul 25 14:34:58.400724 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1310/2458] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:34:58 2022] GET /compute/v2.1/servers/a907dc6b-f4b7-4f2e-9871-23a5ae4db92d => generated 1339 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:34:58.743534 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d6649a1a-ca04-4879-be65-6060ec8d03b3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:58.744926 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d6649a1a-ca04-4879-be65-6060ec8d03b3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 6de04885-8bb7-4d85-b292-ef576bb3fcf0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:58.754362 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d6649a1a-ca04-4879-be65-6060ec8d03b3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:58.755190 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d6649a1a-ca04-4879-be65-6060ec8d03b3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:58.756724 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d6649a1a-ca04-4879-be65-6060ec8d03b3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:58.757171 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d6649a1a-ca04-4879-be65-6060ec8d03b3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:59.055158 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9ae52701-fa31-4702-9e88-21fe8f0b1125 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:59.057737 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9ae52701-fa31-4702-9e88-21fe8f0b1125 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] [instance: 542ab1a2-380f-4f4f-95ec-5d68eb9bd091] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:59.070764 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d6649a1a-ca04-4879-be65-6060ec8d03b3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:59.074109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ae52701-fa31-4702-9e88-21fe8f0b1125 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:59.075013 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ae52701-fa31-4702-9e88-21fe8f0b1125 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:59.076007 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ae52701-fa31-4702-9e88-21fe8f0b1125 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:59.076922 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ae52701-fa31-4702-9e88-21fe8f0b1125 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:59.079722 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d6649a1a-ca04-4879-be65-6060ec8d03b3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0" status: 200 len: 1472 microversion: 2.1 time: 0.340583 Jul 25 14:34:59.083382 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1149/2459] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:58 2022] GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0 => generated 1472 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:59.094094 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-098b6bb0-7bb1-4960-95ec-b7845d3a9770 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:59.094711 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-098b6bb0-7bb1-4960-95ec-b7845d3a9770 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:59.099018 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-9ae52701-fa31-4702-9e88-21fe8f0b1125 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] HTTP exception thrown: Instance 542ab1a2-380f-4f4f-95ec-5d68eb9bd091 could not be found. Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9ae52701-fa31-4702-9e88-21fe8f0b1125 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Request method failure captured: Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091 HTTP/1.1 Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qm9Y6fIcUUMNN_WmLcReF_jReU5s5msg3f28sFxhaj657su6UEJIPBccFR9PAMgyPrPyTOFNADSAOKT3BWeu9sJn_hfj7Wgsm5PFycRzrNT40ZbNTRiNYynTh2TmXYiJlz5IbA8U9GsR8uM5H3cYo2iza_3WnarcTTKIhFc8ydY7A4 Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 2383030b07e34f93b9637c637f8f0ae7 Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ListServerFiltersTestJSON-1203309932 Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2383030b07e34f93b9637c637f8f0ae7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2383030b07e34f93b9637c637f8f0ae7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2383030b07e34f93b9637c637f8f0ae7", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2383030b07e34f93b9637c637f8f0ae7"}]}] Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ListServerFiltersTestJSON-1203309932 Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 2383030b07e34f93b9637c637f8f0ae7 Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1203309932 Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ListServerFiltersTestJSON-1203309932-project Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 5a4fe4300ea142eb88bde8deab2d1e3c Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ListServerFiltersTestJSON-1203309932-project Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 542ab1a2-380f-4f4f-95ec-5d68eb9bd091 could not be found. Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '542ab1a2-380f-4f4f-95ec-5d68eb9bd091'} Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 542ab1a2-380f-4f4f-95ec-5d68eb9bd091 could not be found. Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 542ab1a2-380f-4f4f-95ec-5d68eb9bd091 could not be found. Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:34:59.102214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:59.107432 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:34:59.107432 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:34:59.107432 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:34:59.107432 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:34:59.107432 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:34:59.107432 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 542ab1a2-380f-4f4f-95ec-5d68eb9bd091 could not be found. Jul 25 14:34:59.107432 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:34:59.107432 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9ae52701-fa31-4702-9e88-21fe8f0b1125 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] Returning 404 to user: Instance 542ab1a2-380f-4f4f-95ec-5d68eb9bd091 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:34:59.108092 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9ae52701-fa31-4702-9e88-21fe8f0b1125 tempest-ListServerFiltersTestJSON-1203309932 tempest-ListServerFiltersTestJSON-1203309932-project] 10.222.0.88 "GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091" status: 404 len: 111 microversion: 2.1 time: 0.062020 Jul 25 14:34:59.109251 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1311/2460] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:59 2022] GET /compute/v2.1/servers/542ab1a2-380f-4f4f-95ec-5d68eb9bd091 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:34:59.110407 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-098b6bb0-7bb1-4960-95ec-b7845d3a9770 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:59.111061 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-098b6bb0-7bb1-4960-95ec-b7845d3a9770 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:59.111876 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-098b6bb0-7bb1-4960-95ec-b7845d3a9770 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:59.114821 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-098b6bb0-7bb1-4960-95ec-b7845d3a9770 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:59.421182 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1298fdc5-23f5-48fc-ba7d-4ad36d872f96 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:34:59.422010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1298fdc5-23f5-48fc-ba7d-4ad36d872f96 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] [instance: a907dc6b-f4b7-4f2e-9871-23a5ae4db92d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:34:59.435766 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1298fdc5-23f5-48fc-ba7d-4ad36d872f96 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:59.435926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1298fdc5-23f5-48fc-ba7d-4ad36d872f96 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:59.436898 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1298fdc5-23f5-48fc-ba7d-4ad36d872f96 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:34:59.437479 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1298fdc5-23f5-48fc-ba7d-4ad36d872f96 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:34:59.587284 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-098b6bb0-7bb1-4960-95ec-b7845d3a9770 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:59.595922 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-098b6bb0-7bb1-4960-95ec-b7845d3a9770 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1718 microversion: 2.1 time: 0.506261 Jul 25 14:34:59.597189 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1298fdc5-23f5-48fc-ba7d-4ad36d872f96 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35de8fc36e374d458912d66b2c12e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424cf1b5a203481cb710072586047c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:59.612492 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1150/2461] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:34:59 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1718 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:34:59.615428 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1298fdc5-23f5-48fc-ba7d-4ad36d872f96 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35de8fc36e374d458912d66b2c12e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424cf1b5a203481cb710072586047c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:59.617151 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1298fdc5-23f5-48fc-ba7d-4ad36d872f96 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35de8fc36e374d458912d66b2c12e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424cf1b5a203481cb710072586047c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:34:59.618503 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1298fdc5-23f5-48fc-ba7d-4ad36d872f96 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] 10.222.0.88 "GET /compute/v2.1/servers/a907dc6b-f4b7-4f2e-9871-23a5ae4db92d" status: 200 len: 1337 microversion: 2.47 time: 0.202373 Jul 25 14:34:59.619265 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1312/2462] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:34:59 2022] GET /compute/v2.1/servers/a907dc6b-f4b7-4f2e-9871-23a5ae4db92d => generated 1337 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:35:00.108462 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cb00485d-2fe2-4411-bae1-5e4a396a932f tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:00.109750 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cb00485d-2fe2-4411-bae1-5e4a396a932f tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 6de04885-8bb7-4d85-b292-ef576bb3fcf0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:00.117411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cb00485d-2fe2-4411-bae1-5e4a396a932f tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:00.118188 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cb00485d-2fe2-4411-bae1-5e4a396a932f tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:00.119252 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cb00485d-2fe2-4411-bae1-5e4a396a932f tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:00.119838 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cb00485d-2fe2-4411-bae1-5e4a396a932f tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:00.625072 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4d3486b1-d4db-469b-91f6-837d3638f9cf tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:00.626629 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4d3486b1-d4db-469b-91f6-837d3638f9cf tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:00.639633 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4d3486b1-d4db-469b-91f6-837d3638f9cf tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:00.640352 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4d3486b1-d4db-469b-91f6-837d3638f9cf tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:00.641286 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4d3486b1-d4db-469b-91f6-837d3638f9cf tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:00.642505 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4d3486b1-d4db-469b-91f6-837d3638f9cf tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:00.880303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4d3486b1-d4db-469b-91f6-837d3638f9cf tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:00.893825 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4d3486b1-d4db-469b-91f6-837d3638f9cf tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1718 microversion: 2.1 time: 0.271527 Jul 25 14:35:00.894446 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1313/2463] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:00 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1718 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:00.901836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a86ff764-f033-4b41-9a8a-b96e2e2c0fcd tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:00.902883 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a86ff764-f033-4b41-9a8a-b96e2e2c0fcd tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] [instance: a907dc6b-f4b7-4f2e-9871-23a5ae4db92d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:00.912165 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a86ff764-f033-4b41-9a8a-b96e2e2c0fcd tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:00.912948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a86ff764-f033-4b41-9a8a-b96e2e2c0fcd tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:00.914844 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a86ff764-f033-4b41-9a8a-b96e2e2c0fcd tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:00.915423 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a86ff764-f033-4b41-9a8a-b96e2e2c0fcd tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:01.019781 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a86ff764-f033-4b41-9a8a-b96e2e2c0fcd tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35de8fc36e374d458912d66b2c12e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424cf1b5a203481cb710072586047c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:01.030718 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a86ff764-f033-4b41-9a8a-b96e2e2c0fcd tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35de8fc36e374d458912d66b2c12e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424cf1b5a203481cb710072586047c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:01.032332 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a86ff764-f033-4b41-9a8a-b96e2e2c0fcd tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35de8fc36e374d458912d66b2c12e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424cf1b5a203481cb710072586047c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:01.033514 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a86ff764-f033-4b41-9a8a-b96e2e2c0fcd tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] 10.222.0.88 "GET /compute/v2.1/servers/a907dc6b-f4b7-4f2e-9871-23a5ae4db92d" status: 200 len: 1337 microversion: 2.47 time: 0.137938 Jul 25 14:35:01.034649 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1314/2464] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:35:00 2022] GET /compute/v2.1/servers/a907dc6b-f4b7-4f2e-9871-23a5ae4db92d => generated 1337 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:35:01.082565 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cb00485d-2fe2-4411-bae1-5e4a396a932f tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:01.119533 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cb00485d-2fe2-4411-bae1-5e4a396a932f tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0" status: 200 len: 1472 microversion: 2.1 time: 1.013628 Jul 25 14:35:01.123718 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1151/2465] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:00 2022] GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0 => generated 1472 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:01.918289 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0a66f5a5-5075-4b2e-9e67-72e23d311842 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:01.919847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0a66f5a5-5075-4b2e-9e67-72e23d311842 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:01.929524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0a66f5a5-5075-4b2e-9e67-72e23d311842 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:01.929972 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0a66f5a5-5075-4b2e-9e67-72e23d311842 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:01.930926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0a66f5a5-5075-4b2e-9e67-72e23d311842 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:01.931364 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0a66f5a5-5075-4b2e-9e67-72e23d311842 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:02.060059 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b3091023-6b4e-4718-8a13-3fe561a95969 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:02.061091 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b3091023-6b4e-4718-8a13-3fe561a95969 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] [instance: a907dc6b-f4b7-4f2e-9871-23a5ae4db92d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:02.080837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3091023-6b4e-4718-8a13-3fe561a95969 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:02.083966 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3091023-6b4e-4718-8a13-3fe561a95969 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:02.084843 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3091023-6b4e-4718-8a13-3fe561a95969 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:02.085295 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3091023-6b4e-4718-8a13-3fe561a95969 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:02.166176 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0a66f5a5-5075-4b2e-9e67-72e23d311842 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:02.177049 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0a66f5a5-5075-4b2e-9e67-72e23d311842 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1718 microversion: 2.1 time: 0.266036 Jul 25 14:35:02.179036 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1315/2466] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:01 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1718 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:02.185955 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-47212a89-a21b-4a6e-9e35-a5ce34540d92 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:02.186861 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-47212a89-a21b-4a6e-9e35-a5ce34540d92 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 6de04885-8bb7-4d85-b292-ef576bb3fcf0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:02.196437 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-47212a89-a21b-4a6e-9e35-a5ce34540d92 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:02.197146 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-47212a89-a21b-4a6e-9e35-a5ce34540d92 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:02.198239 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-47212a89-a21b-4a6e-9e35-a5ce34540d92 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:02.199017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-47212a89-a21b-4a6e-9e35-a5ce34540d92 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:02.220693 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:35:02.342079 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-47212a89-a21b-4a6e-9e35-a5ce34540d92 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:02.342272 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b3091023-6b4e-4718-8a13-3fe561a95969 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35de8fc36e374d458912d66b2c12e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424cf1b5a203481cb710072586047c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:02.354594 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-47212a89-a21b-4a6e-9e35-a5ce34540d92 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0" status: 200 len: 1430 microversion: 2.1 time: 0.171450 Jul 25 14:35:02.355631 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1316/2467] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:02 2022] GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0 => generated 1430 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:02.358926 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b3091023-6b4e-4718-8a13-3fe561a95969 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35de8fc36e374d458912d66b2c12e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424cf1b5a203481cb710072586047c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:02.360556 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b3091023-6b4e-4718-8a13-3fe561a95969 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35de8fc36e374d458912d66b2c12e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424cf1b5a203481cb710072586047c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:02.361785 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b3091023-6b4e-4718-8a13-3fe561a95969 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] 10.222.0.88 "GET /compute/v2.1/servers/a907dc6b-f4b7-4f2e-9871-23a5ae4db92d" status: 200 len: 1358 microversion: 2.47 time: 0.306634 Jul 25 14:35:02.362358 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1152/2468] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:35:02 2022] GET /compute/v2.1/servers/a907dc6b-f4b7-4f2e-9871-23a5ae4db92d => generated 1358 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:35:02.392889 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f28a7865-e9f8-405b-b89a-8c4cbf99d751 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1887817620"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:02.396384 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f28a7865-e9f8-405b-b89a-8c4cbf99d751 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] [instance: a907dc6b-f4b7-4f2e-9871-23a5ae4db92d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:02.412970 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f28a7865-e9f8-405b-b89a-8c4cbf99d751 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:02.414432 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f28a7865-e9f8-405b-b89a-8c4cbf99d751 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:02.417251 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f28a7865-e9f8-405b-b89a-8c4cbf99d751 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:02.418585 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f28a7865-e9f8-405b-b89a-8c4cbf99d751 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:02.722843 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-c4962c36-679b-4604-af45-8feeaa2a9725 req-e4990e16-7287-46a1-82ec-d8c3aef30312 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6de04885-8bb7-4d85-b292-ef576bb3fcf0", "name": "network-vif-deleted", "tag": "592a0c75-e6eb-4556-a0a2-689d67fbe5b9"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:02.740904 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c4962c36-679b-4604-af45-8feeaa2a9725 req-e4990e16-7287-46a1-82ec-d8c3aef30312 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:02.741988 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c4962c36-679b-4604-af45-8feeaa2a9725 req-e4990e16-7287-46a1-82ec-d8c3aef30312 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:02.806759 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-c4962c36-679b-4604-af45-8feeaa2a9725 req-e4990e16-7287-46a1-82ec-d8c3aef30312 service nova] Creating event network-vif-deleted:592a0c75-e6eb-4556-a0a2-689d67fbe5b9 for instance 6de04885-8bb7-4d85-b292-ef576bb3fcf0 on n-h1-846435-14 Jul 25 14:35:02.829765 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-c4962c36-679b-4604-af45-8feeaa2a9725 req-e4990e16-7287-46a1-82ec-d8c3aef30312 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122568 Jul 25 14:35:02.833562 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1153/2469] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:35:02.849637 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f28a7865-e9f8-405b-b89a-8c4cbf99d751 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] 10.222.0.88 "POST /compute/v2.1/servers/a907dc6b-f4b7-4f2e-9871-23a5ae4db92d/action" status: 202 len: 52 microversion: 2.47 time: 0.460817 Jul 25 14:35:02.850762 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1317/2470] 10.222.0.88 () {62 vars in 1319 bytes} [Mon Jul 25 14:35:02 2022] POST /compute/v2.1/servers/a907dc6b-f4b7-4f2e-9871-23a5ae4db92d/action => generated 52 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Jul 25 14:35:02.864233 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cd134507-6cec-417b-a662-e4e44c7c6af9 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:02.865150 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cd134507-6cec-417b-a662-e4e44c7c6af9 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] [instance: a907dc6b-f4b7-4f2e-9871-23a5ae4db92d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:02.883380 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cd134507-6cec-417b-a662-e4e44c7c6af9 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:02.883861 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cd134507-6cec-417b-a662-e4e44c7c6af9 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:02.887155 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cd134507-6cec-417b-a662-e4e44c7c6af9 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:02.889554 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cd134507-6cec-417b-a662-e4e44c7c6af9 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:02.965336 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cd134507-6cec-417b-a662-e4e44c7c6af9 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] [instance: a907dc6b-f4b7-4f2e-9871-23a5ae4db92d] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:35:03.151635 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cd134507-6cec-417b-a662-e4e44c7c6af9 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a907dc6b-f4b7-4f2e-9871-23a5ae4db92d" status: 204 len: 0 microversion: 2.47 time: 0.291382 Jul 25 14:35:03.154801 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1154/2471] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Jul 25 14:35:02 2022] DELETE /compute/v2.1/servers/a907dc6b-f4b7-4f2e-9871-23a5ae4db92d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 14:35:03.170982 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-37dc05eb-22a4-4f6e-8fce-52c473b4b21d tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:03.172541 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-37dc05eb-22a4-4f6e-8fce-52c473b4b21d tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] [instance: a907dc6b-f4b7-4f2e-9871-23a5ae4db92d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:03.182630 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37dc05eb-22a4-4f6e-8fce-52c473b4b21d tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:03.183339 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37dc05eb-22a4-4f6e-8fce-52c473b4b21d tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:03.184307 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37dc05eb-22a4-4f6e-8fce-52c473b4b21d tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:03.184894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37dc05eb-22a4-4f6e-8fce-52c473b4b21d tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:03.219549 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-365c5262-7fea-4dd2-b29a-ab46067d9d44 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:03.222230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-365c5262-7fea-4dd2-b29a-ab46067d9d44 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:03.242232 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-365c5262-7fea-4dd2-b29a-ab46067d9d44 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:03.245003 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-365c5262-7fea-4dd2-b29a-ab46067d9d44 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:03.246114 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-365c5262-7fea-4dd2-b29a-ab46067d9d44 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:03.248543 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-365c5262-7fea-4dd2-b29a-ab46067d9d44 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:03.421037 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-37dc05eb-22a4-4f6e-8fce-52c473b4b21d tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35de8fc36e374d458912d66b2c12e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424cf1b5a203481cb710072586047c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:03.450548 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-37dc05eb-22a4-4f6e-8fce-52c473b4b21d tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35de8fc36e374d458912d66b2c12e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424cf1b5a203481cb710072586047c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:03.452213 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-37dc05eb-22a4-4f6e-8fce-52c473b4b21d tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35de8fc36e374d458912d66b2c12e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424cf1b5a203481cb710072586047c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:03.453439 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-37dc05eb-22a4-4f6e-8fce-52c473b4b21d tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] 10.222.0.88 "GET /compute/v2.1/servers/a907dc6b-f4b7-4f2e-9871-23a5ae4db92d" status: 200 len: 1364 microversion: 2.47 time: 0.291342 Jul 25 14:35:03.465680 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1318/2472] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:35:03 2022] GET /compute/v2.1/servers/a907dc6b-f4b7-4f2e-9871-23a5ae4db92d => generated 1364 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:35:03.475347 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-852e851d-992a-4bc1-9234-6cdd854f0e3c tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:03.478685 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-852e851d-992a-4bc1-9234-6cdd854f0e3c tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 6de04885-8bb7-4d85-b292-ef576bb3fcf0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:03.492279 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-852e851d-992a-4bc1-9234-6cdd854f0e3c tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:03.496592 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-852e851d-992a-4bc1-9234-6cdd854f0e3c tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:03.499135 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-852e851d-992a-4bc1-9234-6cdd854f0e3c tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:03.500024 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-852e851d-992a-4bc1-9234-6cdd854f0e3c tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:03.528553 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-852e851d-992a-4bc1-9234-6cdd854f0e3c tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] HTTP exception thrown: Instance 6de04885-8bb7-4d85-b292-ef576bb3fcf0 could not be found. Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-852e851d-992a-4bc1-9234-6cdd854f0e3c tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Request method failure captured: Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0 HTTP/1.1 Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qlv3rUVhKaGUoIKKGCuOMD0I6MIoDHjqjO5RyR6Pj_BNVDpq--kNeH85TVlPgBPT3niD-JaccAzA0CF2Z_lYSTDSSqak2SKY3MirR2urYA-2v4fgO5i4-3PmjSM_AwPL5Le0cUs5lB3O6LfBXz1C0XPouGEhH0PZroAvYlxtcrUeto Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: e60b88c2aea642658a5bfc14780d5d51 Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersOnMultiNodesTest-1245955740 Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e60b88c2aea642658a5bfc14780d5d51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e60b88c2aea642658a5bfc14780d5d51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e60b88c2aea642658a5bfc14780d5d51", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e60b88c2aea642658a5bfc14780d5d51"}]}] Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersOnMultiNodesTest-1245955740 Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: e60b88c2aea642658a5bfc14780d5d51 Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1245955740 Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersOnMultiNodesTest-1245955740-project Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: ef351be3886949f9985b3244301435a9 Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersOnMultiNodesTest-1245955740-project Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 6de04885-8bb7-4d85-b292-ef576bb3fcf0 could not be found. Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '6de04885-8bb7-4d85-b292-ef576bb3fcf0'} Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6de04885-8bb7-4d85-b292-ef576bb3fcf0 could not be found. Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6de04885-8bb7-4d85-b292-ef576bb3fcf0 could not be found. Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:03.534722 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:03.539948 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:03.539948 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:03.539948 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:03.539948 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:35:03.539948 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:35:03.539948 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6de04885-8bb7-4d85-b292-ef576bb3fcf0 could not be found. Jul 25 14:35:03.539948 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:03.542333 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-852e851d-992a-4bc1-9234-6cdd854f0e3c tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Returning 404 to user: Instance 6de04885-8bb7-4d85-b292-ef576bb3fcf0 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:35:03.543472 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-852e851d-992a-4bc1-9234-6cdd854f0e3c tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0" status: 404 len: 111 microversion: 2.1 time: 0.076573 Jul 25 14:35:03.544857 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1319/2473] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:03 2022] GET /compute/v2.1/servers/6de04885-8bb7-4d85-b292-ef576bb3fcf0 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:35:03.558127 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f2dd2477-5274-4c62-aba9-6caf941eefe2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:03.559089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f2dd2477-5274-4c62-aba9-6caf941eefe2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: c43e707b-4a9f-48d2-8338-5a680cd51f06] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:03.568618 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f2dd2477-5274-4c62-aba9-6caf941eefe2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:03.569374 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f2dd2477-5274-4c62-aba9-6caf941eefe2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:03.570334 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f2dd2477-5274-4c62-aba9-6caf941eefe2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:03.572144 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f2dd2477-5274-4c62-aba9-6caf941eefe2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:03.620656 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f2dd2477-5274-4c62-aba9-6caf941eefe2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: c43e707b-4a9f-48d2-8338-5a680cd51f06] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:35:03.783275 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f2dd2477-5274-4c62-aba9-6caf941eefe2 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06" status: 204 len: 0 microversion: 2.1 time: 0.233454 Jul 25 14:35:03.784752 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1320/2474] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:35:03 2022] DELETE /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:35:03.796796 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a7dd5d47-6e69-4c01-8c61-689fdc99ebf0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:03.798390 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a7dd5d47-6e69-4c01-8c61-689fdc99ebf0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: c43e707b-4a9f-48d2-8338-5a680cd51f06] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:03.805854 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a7dd5d47-6e69-4c01-8c61-689fdc99ebf0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:03.806353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a7dd5d47-6e69-4c01-8c61-689fdc99ebf0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:03.807226 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a7dd5d47-6e69-4c01-8c61-689fdc99ebf0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:03.808367 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a7dd5d47-6e69-4c01-8c61-689fdc99ebf0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:04.114883 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a7dd5d47-6e69-4c01-8c61-689fdc99ebf0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:04.124252 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a7dd5d47-6e69-4c01-8c61-689fdc99ebf0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06" status: 200 len: 1473 microversion: 2.1 time: 0.334718 Jul 25 14:35:04.124849 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1321/2475] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:03 2022] GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06 => generated 1473 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:04.489556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-acfa6209-555a-49f2-9954-99d85d075ab8 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:04.490202 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-acfa6209-555a-49f2-9954-99d85d075ab8 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] [instance: a907dc6b-f4b7-4f2e-9871-23a5ae4db92d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:04.507489 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-acfa6209-555a-49f2-9954-99d85d075ab8 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:04.508302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-acfa6209-555a-49f2-9954-99d85d075ab8 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:04.509171 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-acfa6209-555a-49f2-9954-99d85d075ab8 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:04.509633 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-acfa6209-555a-49f2-9954-99d85d075ab8 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:04.607431 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-acfa6209-555a-49f2-9954-99d85d075ab8 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35de8fc36e374d458912d66b2c12e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424cf1b5a203481cb710072586047c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:04.618095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-acfa6209-555a-49f2-9954-99d85d075ab8 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35de8fc36e374d458912d66b2c12e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424cf1b5a203481cb710072586047c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:04.621375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-acfa6209-555a-49f2-9954-99d85d075ab8 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35de8fc36e374d458912d66b2c12e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424cf1b5a203481cb710072586047c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:04.623627 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-acfa6209-555a-49f2-9954-99d85d075ab8 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] 10.222.0.88 "GET /compute/v2.1/servers/a907dc6b-f4b7-4f2e-9871-23a5ae4db92d" status: 200 len: 1364 microversion: 2.47 time: 0.137721 Jul 25 14:35:04.624799 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1322/2476] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:35:04 2022] GET /compute/v2.1/servers/a907dc6b-f4b7-4f2e-9871-23a5ae4db92d => generated 1364 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:35:04.714728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-365c5262-7fea-4dd2-b29a-ab46067d9d44 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:04.724406 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-365c5262-7fea-4dd2-b29a-ab46067d9d44 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1718 microversion: 2.1 time: 1.519590 Jul 25 14:35:04.725010 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1155/2477] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:03 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1718 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:04.955521 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-db40e256-184e-49bc-ba65-48aa5f0ff422 req-6fe9b162-0812-4b4a-b7e3-810336544e23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a85a57f0-715f-47cd-ae19-463dfc5e7aca", "name": "network-vif-unplugged", "status": "completed", "tag": "b6bbf444-a731-43c2-bb7a-c5a47d378689"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:04.979677 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-db40e256-184e-49bc-ba65-48aa5f0ff422 req-6fe9b162-0812-4b4a-b7e3-810336544e23 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:04.980225 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-db40e256-184e-49bc-ba65-48aa5f0ff422 req-6fe9b162-0812-4b4a-b7e3-810336544e23 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:04.993077 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-db40e256-184e-49bc-ba65-48aa5f0ff422 req-6fe9b162-0812-4b4a-b7e3-810336544e23 service nova] Creating event network-vif-unplugged:b6bbf444-a731-43c2-bb7a-c5a47d378689 for instance a85a57f0-715f-47cd-ae19-463dfc5e7aca on n-h2-846435-14 Jul 25 14:35:04.999165 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-db40e256-184e-49bc-ba65-48aa5f0ff422 req-6fe9b162-0812-4b4a-b7e3-810336544e23 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047704 Jul 25 14:35:05.000534 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1323/2478] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:35:05.147130 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8664e3dd-9216-4355-b20b-a7dddb7b21dd tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:05.147758 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8664e3dd-9216-4355-b20b-a7dddb7b21dd tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: c43e707b-4a9f-48d2-8338-5a680cd51f06] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:05.166107 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8664e3dd-9216-4355-b20b-a7dddb7b21dd tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:05.166560 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8664e3dd-9216-4355-b20b-a7dddb7b21dd tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:05.167369 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8664e3dd-9216-4355-b20b-a7dddb7b21dd tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:05.167811 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8664e3dd-9216-4355-b20b-a7dddb7b21dd tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:05.511543 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8664e3dd-9216-4355-b20b-a7dddb7b21dd tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:05.522451 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8664e3dd-9216-4355-b20b-a7dddb7b21dd tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06" status: 200 len: 1473 microversion: 2.1 time: 0.379267 Jul 25 14:35:05.523612 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1156/2479] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:05 2022] GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06 => generated 1473 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:05.645835 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:35:05.652246 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d58199ec-c35f-42b2-9360-712d8be0a39c tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:05.653130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d58199ec-c35f-42b2-9360-712d8be0a39c tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] [instance: a907dc6b-f4b7-4f2e-9871-23a5ae4db92d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:05.670986 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d58199ec-c35f-42b2-9360-712d8be0a39c tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:05.671445 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d58199ec-c35f-42b2-9360-712d8be0a39c tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:05.672268 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d58199ec-c35f-42b2-9360-712d8be0a39c tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:05.677161 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d58199ec-c35f-42b2-9360-712d8be0a39c tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:05.749488 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ab95d89f-b86b-4ad8-be4d-bd3f70520d83 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:05.750750 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ab95d89f-b86b-4ad8-be4d-bd3f70520d83 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:05.757996 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab95d89f-b86b-4ad8-be4d-bd3f70520d83 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:05.758702 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab95d89f-b86b-4ad8-be4d-bd3f70520d83 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:05.759722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab95d89f-b86b-4ad8-be4d-bd3f70520d83 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:05.760344 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab95d89f-b86b-4ad8-be4d-bd3f70520d83 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:05.813961 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d58199ec-c35f-42b2-9360-712d8be0a39c tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35de8fc36e374d458912d66b2c12e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424cf1b5a203481cb710072586047c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:05.842150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d58199ec-c35f-42b2-9360-712d8be0a39c tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35de8fc36e374d458912d66b2c12e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424cf1b5a203481cb710072586047c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:05.845125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d58199ec-c35f-42b2-9360-712d8be0a39c tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35de8fc36e374d458912d66b2c12e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424cf1b5a203481cb710072586047c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:05.847912 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d58199ec-c35f-42b2-9360-712d8be0a39c tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] 10.222.0.88 "GET /compute/v2.1/servers/a907dc6b-f4b7-4f2e-9871-23a5ae4db92d" status: 200 len: 1364 microversion: 2.47 time: 0.202696 Jul 25 14:35:05.859808 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1324/2480] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:35:05 2022] GET /compute/v2.1/servers/a907dc6b-f4b7-4f2e-9871-23a5ae4db92d => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:35:06.371404 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ab95d89f-b86b-4ad8-be4d-bd3f70520d83 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:06.387018 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ab95d89f-b86b-4ad8-be4d-bd3f70520d83 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1718 microversion: 2.1 time: 0.644029 Jul 25 14:35:06.387618 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1157/2481] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:05 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1718 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:35:06.545073 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-19895ab4-2743-410d-897a-91e9f6127716 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:06.545729 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-19895ab4-2743-410d-897a-91e9f6127716 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: c43e707b-4a9f-48d2-8338-5a680cd51f06] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:06.547735 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=8 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:35:06.568310 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-19895ab4-2743-410d-897a-91e9f6127716 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:06.568959 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-19895ab4-2743-410d-897a-91e9f6127716 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:06.570390 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-19895ab4-2743-410d-897a-91e9f6127716 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:06.570840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-19895ab4-2743-410d-897a-91e9f6127716 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:06.873996 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-652c67c7-796f-427a-b794-154d221652d3 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:06.875530 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-652c67c7-796f-427a-b794-154d221652d3 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] [instance: a907dc6b-f4b7-4f2e-9871-23a5ae4db92d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:06.911481 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-652c67c7-796f-427a-b794-154d221652d3 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:06.917118 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-652c67c7-796f-427a-b794-154d221652d3 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:06.922977 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-652c67c7-796f-427a-b794-154d221652d3 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:06.934856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-652c67c7-796f-427a-b794-154d221652d3 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:07.410813 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-652c67c7-796f-427a-b794-154d221652d3 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35de8fc36e374d458912d66b2c12e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424cf1b5a203481cb710072586047c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:07.428175 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-652c67c7-796f-427a-b794-154d221652d3 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35de8fc36e374d458912d66b2c12e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424cf1b5a203481cb710072586047c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:07.429864 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-652c67c7-796f-427a-b794-154d221652d3 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35de8fc36e374d458912d66b2c12e8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424cf1b5a203481cb710072586047c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:07.433320 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-652c67c7-796f-427a-b794-154d221652d3 tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] 10.222.0.88 "GET /compute/v2.1/servers/a907dc6b-f4b7-4f2e-9871-23a5ae4db92d" status: 200 len: 1364 microversion: 2.47 time: 0.563329 Jul 25 14:35:07.440982 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1158/2482] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:35:06 2022] GET /compute/v2.1/servers/a907dc6b-f4b7-4f2e-9871-23a5ae4db92d => generated 1364 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:35:07.451831 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-a520936d-7740-4d8c-be54-f9e9169c528d req-ab7ab7f1-4da0-4025-beb6-9cf06136ed91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a85a57f0-715f-47cd-ae19-463dfc5e7aca", "tag": "b6bbf444-a731-43c2-bb7a-c5a47d378689"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:07.482699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-a520936d-7740-4d8c-be54-f9e9169c528d req-ab7ab7f1-4da0-4025-beb6-9cf06136ed91 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:07.483558 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-a520936d-7740-4d8c-be54-f9e9169c528d req-ab7ab7f1-4da0-4025-beb6-9cf06136ed91 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:07.500536 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-a520936d-7740-4d8c-be54-f9e9169c528d req-ab7ab7f1-4da0-4025-beb6-9cf06136ed91 service nova] Creating event network-changed:b6bbf444-a731-43c2-bb7a-c5a47d378689 for instance a85a57f0-715f-47cd-ae19-463dfc5e7aca on n-h2-846435-14 Jul 25 14:35:07.506439 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-a520936d-7740-4d8c-be54-f9e9169c528d req-ab7ab7f1-4da0-4025-beb6-9cf06136ed91 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063689 Jul 25 14:35:07.507409 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1159/2483] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:35:07.514175 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-869292fb-5ce5-4ff4-8109-f749f65784dc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:07.515386 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-869292fb-5ce5-4ff4-8109-f749f65784dc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:07.523053 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-869292fb-5ce5-4ff4-8109-f749f65784dc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:07.523617 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-869292fb-5ce5-4ff4-8109-f749f65784dc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:07.525487 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-869292fb-5ce5-4ff4-8109-f749f65784dc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:07.526206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-869292fb-5ce5-4ff4-8109-f749f65784dc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:07.560219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-19895ab4-2743-410d-897a-91e9f6127716 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:07.576777 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-19895ab4-2743-410d-897a-91e9f6127716 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06" status: 200 len: 1473 microversion: 2.1 time: 1.037402 Jul 25 14:35:07.591630 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1325/2484] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:06 2022] GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06 => generated 1473 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:08.072249 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-869292fb-5ce5-4ff4-8109-f749f65784dc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:08.113119 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-869292fb-5ce5-4ff4-8109-f749f65784dc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1718 microversion: 2.1 time: 0.601792 Jul 25 14:35:08.115259 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1160/2485] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:07 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1718 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:08.475863 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-47b578c2-c191-4f78-8264-06319714125f tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:08.477482 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-47b578c2-c191-4f78-8264-06319714125f tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] [instance: a907dc6b-f4b7-4f2e-9871-23a5ae4db92d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:08.514403 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-47b578c2-c191-4f78-8264-06319714125f tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:08.515311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-47b578c2-c191-4f78-8264-06319714125f tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:08.528749 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-47b578c2-c191-4f78-8264-06319714125f tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:08.531912 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-47b578c2-c191-4f78-8264-06319714125f tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:08.571596 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-47b578c2-c191-4f78-8264-06319714125f tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] HTTP exception thrown: Instance a907dc6b-f4b7-4f2e-9871-23a5ae4db92d could not be found. Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-47b578c2-c191-4f78-8264-06319714125f tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Request method failure captured: Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/a907dc6b-f4b7-4f2e-9871-23a5ae4db92d HTTP/1.1 Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qoOaSXmrjIquJzONyxijwgkPZ444mV5sMwQcnHsDpJQZeJKA79GTgbb0sOeWmNMd2x_Xzekekzx2Qgm0WjCPPDMgTU7_4rPU4NE1yXsU6aIrXjswMGYOhyQ8pm64Sy53o1xPin_syLWIbdeu9sX8Sr0ke8Rd0JRTu8V6pH5Erfvw8o Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: X-Openstack-Nova-Api-Version: 2.47 Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 424cf1b5a203481cb710072586047c96 Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersAaction247Test-496955898 Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/424cf1b5a203481cb710072586047c96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/424cf1b5a203481cb710072586047c96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_424cf1b5a203481cb710072586047c96", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/424cf1b5a203481cb710072586047c96"}]}] Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersAaction247Test-496955898 Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 424cf1b5a203481cb710072586047c96 Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersAaction247Test-496955898 Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersAaction247Test-496955898-project Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 35de8fc36e374d458912d66b2c12e8bf Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersAaction247Test-496955898-project Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance a907dc6b-f4b7-4f2e-9871-23a5ae4db92d could not be found. Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'a907dc6b-f4b7-4f2e-9871-23a5ae4db92d'} Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a907dc6b-f4b7-4f2e-9871-23a5ae4db92d could not be found. Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a907dc6b-f4b7-4f2e-9871-23a5ae4db92d could not be found. Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:08.574625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:08.579582 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:08.579582 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:08.579582 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:08.579582 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:35:08.579582 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:35:08.579582 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a907dc6b-f4b7-4f2e-9871-23a5ae4db92d could not be found. Jul 25 14:35:08.579582 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:08.584167 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-47b578c2-c191-4f78-8264-06319714125f tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] Returning 404 to user: Instance a907dc6b-f4b7-4f2e-9871-23a5ae4db92d could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:35:08.590692 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-47b578c2-c191-4f78-8264-06319714125f tempest-ServersAaction247Test-496955898 tempest-ServersAaction247Test-496955898-project] 10.222.0.88 "GET /compute/v2.1/servers/a907dc6b-f4b7-4f2e-9871-23a5ae4db92d" status: 404 len: 111 microversion: 2.47 time: 0.118337 Jul 25 14:35:08.599559 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1161/2486] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:35:08 2022] GET /compute/v2.1/servers/a907dc6b-f4b7-4f2e-9871-23a5ae4db92d => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:35:08.614746 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0c3ac5e2-ea20-4e60-8e4c-1e854c7179a1 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:08.615938 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0c3ac5e2-ea20-4e60-8e4c-1e854c7179a1 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: c43e707b-4a9f-48d2-8338-5a680cd51f06] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:08.626049 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0c3ac5e2-ea20-4e60-8e4c-1e854c7179a1 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:08.626965 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0c3ac5e2-ea20-4e60-8e4c-1e854c7179a1 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:08.628027 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0c3ac5e2-ea20-4e60-8e4c-1e854c7179a1 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:08.628706 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0c3ac5e2-ea20-4e60-8e4c-1e854c7179a1 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:08.660315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-25c4e0ad-34bc-43d7-bbbb-9dafd015b2db tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-988449694", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "f4ca8b5a-62cc-44dc-8c84-1131780c2c71"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:08.819653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-25c4e0ad-34bc-43d7-bbbb-9dafd015b2db tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] validate_networks() for [('f4ca8b5a-62cc-44dc-8c84-1131780c2c71', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:35:08.990333 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0c3ac5e2-ea20-4e60-8e4c-1e854c7179a1 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:09.002661 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0c3ac5e2-ea20-4e60-8e4c-1e854c7179a1 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06" status: 200 len: 1431 microversion: 2.1 time: 0.401505 Jul 25 14:35:09.004574 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1162/2487] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:08 2022] GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06 => generated 1431 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:09.137994 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f597615e-44a6-49d8-a327-3e5a035eb78c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:09.138858 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f597615e-44a6-49d8-a327-3e5a035eb78c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:09.154318 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f597615e-44a6-49d8-a327-3e5a035eb78c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:09.156744 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f597615e-44a6-49d8-a327-3e5a035eb78c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:09.158074 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f597615e-44a6-49d8-a327-3e5a035eb78c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:09.162783 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f597615e-44a6-49d8-a327-3e5a035eb78c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:09.820342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-25c4e0ad-34bc-43d7-bbbb-9dafd015b2db tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:35:09.821075 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-25c4e0ad-34bc-43d7-bbbb-9dafd015b2db tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:35:09.821611 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-25c4e0ad-34bc-43d7-bbbb-9dafd015b2db tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:35:09.822798 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-25c4e0ad-34bc-43d7-bbbb-9dafd015b2db tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:35:09.823291 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-25c4e0ad-34bc-43d7-bbbb-9dafd015b2db tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:35:09.846679 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25c4e0ad-34bc-43d7-bbbb-9dafd015b2db tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:09.847295 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25c4e0ad-34bc-43d7-bbbb-9dafd015b2db tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:09.848276 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25c4e0ad-34bc-43d7-bbbb-9dafd015b2db tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:09.848811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25c4e0ad-34bc-43d7-bbbb-9dafd015b2db tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:09.902717 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-25c4e0ad-34bc-43d7-bbbb-9dafd015b2db tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Getting quotas for project d38f2493d8324858a50e5cd969c2692d. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:35:09.909706 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-25c4e0ad-34bc-43d7-bbbb-9dafd015b2db tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Getting quotas for user 122381b421894965a62d4ae5889db93c and project d38f2493d8324858a50e5cd969c2692d. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:35:09.925416 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-25c4e0ad-34bc-43d7-bbbb-9dafd015b2db tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:35:09.928573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-25c4e0ad-34bc-43d7-bbbb-9dafd015b2db tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] [instance: 403f7d8b-1b82-47b3-803c-b96f87d6bc94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:35:10.027503 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-25c4e0ad-34bc-43d7-bbbb-9dafd015b2db tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.727749 Jul 25 14:35:10.031016 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1326/2488] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:35:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:35:10.052226 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-5198ff44-44d3-4106-bd9d-edbd83787f04 req-7573ae3e-48e4-4222-9a5d-2661ce2e4bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c43e707b-4a9f-48d2-8338-5a680cd51f06", "name": "network-vif-deleted", "tag": "ecff7cc7-d9a7-4dd6-b23b-de594526b420"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:10.082670 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:35:10.087785 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-5198ff44-44d3-4106-bd9d-edbd83787f04 req-7573ae3e-48e4-4222-9a5d-2661ce2e4bd0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:10.089213 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-5198ff44-44d3-4106-bd9d-edbd83787f04 req-7573ae3e-48e4-4222-9a5d-2661ce2e4bd0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:10.121090 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-5198ff44-44d3-4106-bd9d-edbd83787f04 req-7573ae3e-48e4-4222-9a5d-2661ce2e4bd0 service nova] Creating event network-vif-deleted:ecff7cc7-d9a7-4dd6-b23b-de594526b420 for instance c43e707b-4a9f-48d2-8338-5a680cd51f06 on n-h1-846435-14 Jul 25 14:35:10.132204 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-5198ff44-44d3-4106-bd9d-edbd83787f04 req-7573ae3e-48e4-4222-9a5d-2661ce2e4bd0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099477 Jul 25 14:35:10.137700 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1327/2489] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:35:10.150720 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-beff724c-be7a-4686-9ff6-402d0e7673a3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:10.153496 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-beff724c-be7a-4686-9ff6-402d0e7673a3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: c43e707b-4a9f-48d2-8338-5a680cd51f06] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:10.173081 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-beff724c-be7a-4686-9ff6-402d0e7673a3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:10.173719 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-beff724c-be7a-4686-9ff6-402d0e7673a3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:10.174619 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-beff724c-be7a-4686-9ff6-402d0e7673a3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:10.175163 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-beff724c-be7a-4686-9ff6-402d0e7673a3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:10.195896 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f597615e-44a6-49d8-a327-3e5a035eb78c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:10.225524 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-beff724c-be7a-4686-9ff6-402d0e7673a3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] HTTP exception thrown: Instance c43e707b-4a9f-48d2-8338-5a680cd51f06 could not be found. Jul 25 14:35:10.227423 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f597615e-44a6-49d8-a327-3e5a035eb78c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1718 microversion: 2.1 time: 1.089933 Jul 25 14:35:10.230478 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1163/2490] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:09 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1718 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-beff724c-be7a-4686-9ff6-402d0e7673a3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Request method failure captured: Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06 HTTP/1.1 Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qlv3rUVhKaGUoIKKGCuOMD0I6MIoDHjqjO5RyR6Pj_BNVDpq--kNeH85TVlPgBPT3niD-JaccAzA0CF2Z_lYSTDSSqak2SKY3MirR2urYA-2v4fgO5i4-3PmjSM_AwPL5Le0cUs5lB3O6LfBXz1C0XPouGEhH0PZroAvYlxtcrUeto Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: e60b88c2aea642658a5bfc14780d5d51 Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersOnMultiNodesTest-1245955740 Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e60b88c2aea642658a5bfc14780d5d51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e60b88c2aea642658a5bfc14780d5d51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e60b88c2aea642658a5bfc14780d5d51", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e60b88c2aea642658a5bfc14780d5d51"}]}] Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersOnMultiNodesTest-1245955740 Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: e60b88c2aea642658a5bfc14780d5d51 Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1245955740 Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersOnMultiNodesTest-1245955740-project Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: ef351be3886949f9985b3244301435a9 Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersOnMultiNodesTest-1245955740-project Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance c43e707b-4a9f-48d2-8338-5a680cd51f06 could not be found. Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'c43e707b-4a9f-48d2-8338-5a680cd51f06'} Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c43e707b-4a9f-48d2-8338-5a680cd51f06 could not be found. Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c43e707b-4a9f-48d2-8338-5a680cd51f06 could not be found. Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:10.231388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:10.235194 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:10.235194 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:10.235194 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:10.235194 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:35:10.235194 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:35:10.235194 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c43e707b-4a9f-48d2-8338-5a680cd51f06 could not be found. Jul 25 14:35:10.235194 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:10.235194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-beff724c-be7a-4686-9ff6-402d0e7673a3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Returning 404 to user: Instance c43e707b-4a9f-48d2-8338-5a680cd51f06 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:35:10.235194 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-beff724c-be7a-4686-9ff6-402d0e7673a3 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06" status: 404 len: 111 microversion: 2.1 time: 0.095829 Jul 25 14:35:10.237626 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-451a69b4-c787-4e6d-b370-c441ed7f68e4 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:10.238342 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-451a69b4-c787-4e6d-b370-c441ed7f68e4 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] [instance: 403f7d8b-1b82-47b3-803c-b96f87d6bc94] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:10.240274 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1328/2491] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:10 2022] GET /compute/v2.1/servers/c43e707b-4a9f-48d2-8338-5a680cd51f06 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:35:10.251833 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8d0c3af8-990d-4380-a69d-69985d61634f tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:10.252887 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8d0c3af8-990d-4380-a69d-69985d61634f tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 8aff0899-f62a-4ffc-924c-c782f7eb417f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:10.268098 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d0c3af8-990d-4380-a69d-69985d61634f tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:10.269358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d0c3af8-990d-4380-a69d-69985d61634f tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:10.270694 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d0c3af8-990d-4380-a69d-69985d61634f tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:10.272211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d0c3af8-990d-4380-a69d-69985d61634f tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:10.357011 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8d0c3af8-990d-4380-a69d-69985d61634f tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 8aff0899-f62a-4ffc-924c-c782f7eb417f] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:35:10.369414 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-451a69b4-c787-4e6d-b370-c441ed7f68e4 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122381b421894965a62d4ae5889db93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38f2493d8324858a50e5cd969c2692d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:10.378484 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-451a69b4-c787-4e6d-b370-c441ed7f68e4 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] 10.222.0.88 "GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94" status: 200 len: 1223 microversion: 2.1 time: 0.146249 Jul 25 14:35:10.393335 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1164/2492] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:10 2022] GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94 => generated 1223 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:10.527091 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8d0c3af8-990d-4380-a69d-69985d61634f tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "DELETE /compute/v2.1/servers/8aff0899-f62a-4ffc-924c-c782f7eb417f" status: 204 len: 0 microversion: 2.1 time: 0.285328 Jul 25 14:35:10.527736 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1329/2493] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:35:10 2022] DELETE /compute/v2.1/servers/8aff0899-f62a-4ffc-924c-c782f7eb417f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:35:10.548871 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2cb9a4af-6064-4795-8796-a0fcd369e9d5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:10.550948 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2cb9a4af-6064-4795-8796-a0fcd369e9d5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 95cc15d2-9357-439c-8b9c-ed54768c1697] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:10.561827 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2cb9a4af-6064-4795-8796-a0fcd369e9d5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:10.565323 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2cb9a4af-6064-4795-8796-a0fcd369e9d5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:10.566847 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2cb9a4af-6064-4795-8796-a0fcd369e9d5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:10.568521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2cb9a4af-6064-4795-8796-a0fcd369e9d5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:10.664978 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2cb9a4af-6064-4795-8796-a0fcd369e9d5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 95cc15d2-9357-439c-8b9c-ed54768c1697] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:35:10.775117 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:35:10.966150 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2cb9a4af-6064-4795-8796-a0fcd369e9d5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "DELETE /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697" status: 204 len: 0 microversion: 2.1 time: 0.433005 Jul 25 14:35:10.967717 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1165/2494] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:35:10 2022] DELETE /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:35:10.976344 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-81cf53aa-1278-4df0-95ef-ba017a40c899 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:10.977040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-81cf53aa-1278-4df0-95ef-ba017a40c899 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 8aff0899-f62a-4ffc-924c-c782f7eb417f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:10.988894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-81cf53aa-1278-4df0-95ef-ba017a40c899 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:10.989340 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-81cf53aa-1278-4df0-95ef-ba017a40c899 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:10.990120 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-81cf53aa-1278-4df0-95ef-ba017a40c899 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:10.990546 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-81cf53aa-1278-4df0-95ef-ba017a40c899 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:11.252509 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-12310c63-d466-45fb-9be1-2fd6437a5850 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:11.254020 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-12310c63-d466-45fb-9be1-2fd6437a5850 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:11.262453 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-12310c63-d466-45fb-9be1-2fd6437a5850 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:11.263146 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-12310c63-d466-45fb-9be1-2fd6437a5850 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:11.264142 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-12310c63-d466-45fb-9be1-2fd6437a5850 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:11.264741 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-12310c63-d466-45fb-9be1-2fd6437a5850 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:11.407294 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-81cf53aa-1278-4df0-95ef-ba017a40c899 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:11.424217 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-81cf53aa-1278-4df0-95ef-ba017a40c899 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/8aff0899-f62a-4ffc-924c-c782f7eb417f" status: 200 len: 1474 microversion: 2.1 time: 0.451876 Jul 25 14:35:11.437997 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1330/2495] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:10 2022] GET /compute/v2.1/servers/8aff0899-f62a-4ffc-924c-c782f7eb417f => generated 1474 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:11.460955 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cacbd7f5-7f11-4dfd-9d2f-734caa69183d tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:11.464351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cacbd7f5-7f11-4dfd-9d2f-734caa69183d tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] [instance: 403f7d8b-1b82-47b3-803c-b96f87d6bc94] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:11.478571 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cacbd7f5-7f11-4dfd-9d2f-734caa69183d tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:11.479351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cacbd7f5-7f11-4dfd-9d2f-734caa69183d tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:11.484805 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cacbd7f5-7f11-4dfd-9d2f-734caa69183d tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:11.485419 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cacbd7f5-7f11-4dfd-9d2f-734caa69183d tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:11.650449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cacbd7f5-7f11-4dfd-9d2f-734caa69183d tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122381b421894965a62d4ae5889db93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38f2493d8324858a50e5cd969c2692d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:11.653398 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:35:11.666558 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cacbd7f5-7f11-4dfd-9d2f-734caa69183d tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] 10.222.0.88 "GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94" status: 200 len: 1227 microversion: 2.1 time: 0.227038 Jul 25 14:35:11.688171 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1331/2496] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:11 2022] GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94 => generated 1227 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:12.067117 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-12310c63-d466-45fb-9be1-2fd6437a5850 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:12.076366 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-12310c63-d466-45fb-9be1-2fd6437a5850 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1718 microversion: 2.1 time: 0.830662 Jul 25 14:35:12.081453 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1166/2497] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:11 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1718 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:35:12.447542 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3c485c67-b3a7-4377-83ae-76d6b413c3fb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:12.449383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3c485c67-b3a7-4377-83ae-76d6b413c3fb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 8aff0899-f62a-4ffc-924c-c782f7eb417f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:12.472684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c485c67-b3a7-4377-83ae-76d6b413c3fb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:12.479064 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c485c67-b3a7-4377-83ae-76d6b413c3fb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:12.480530 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c485c67-b3a7-4377-83ae-76d6b413c3fb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:12.481126 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c485c67-b3a7-4377-83ae-76d6b413c3fb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:12.696009 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-73c2f4ae-ef3d-40a9-aad7-212dc89ac1b1 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:12.696678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-73c2f4ae-ef3d-40a9-aad7-212dc89ac1b1 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] [instance: 403f7d8b-1b82-47b3-803c-b96f87d6bc94] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:12.709338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-73c2f4ae-ef3d-40a9-aad7-212dc89ac1b1 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:12.712132 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-73c2f4ae-ef3d-40a9-aad7-212dc89ac1b1 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:12.715919 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-73c2f4ae-ef3d-40a9-aad7-212dc89ac1b1 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:12.716696 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-73c2f4ae-ef3d-40a9-aad7-212dc89ac1b1 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:13.122650 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-73c2f4ae-ef3d-40a9-aad7-212dc89ac1b1 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122381b421894965a62d4ae5889db93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38f2493d8324858a50e5cd969c2692d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:13.138426 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-73c2f4ae-ef3d-40a9-aad7-212dc89ac1b1 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] 10.222.0.88 "GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94" status: 200 len: 1283 microversion: 2.1 time: 0.447292 Jul 25 14:35:13.139749 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1167/2498] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:12 2022] GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94 => generated 1283 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:35:13.156228 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-904e8360-c3d0-4048-b6bf-bdf5efacbde8 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:13.157271 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-904e8360-c3d0-4048-b6bf-bdf5efacbde8 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:13.174981 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-904e8360-c3d0-4048-b6bf-bdf5efacbde8 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:13.175663 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-904e8360-c3d0-4048-b6bf-bdf5efacbde8 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:13.176822 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-904e8360-c3d0-4048-b6bf-bdf5efacbde8 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:13.177485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-904e8360-c3d0-4048-b6bf-bdf5efacbde8 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:13.522299 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-904e8360-c3d0-4048-b6bf-bdf5efacbde8 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:13.532255 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-904e8360-c3d0-4048-b6bf-bdf5efacbde8 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1718 microversion: 2.1 time: 0.391046 Jul 25 14:35:13.556813 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1168/2499] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:13 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1718 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:14.049893 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3c485c67-b3a7-4377-83ae-76d6b413c3fb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:14.080830 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3c485c67-b3a7-4377-83ae-76d6b413c3fb tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/8aff0899-f62a-4ffc-924c-c782f7eb417f" status: 200 len: 1474 microversion: 2.1 time: 1.636998 Jul 25 14:35:14.094082 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1332/2500] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:12 2022] GET /compute/v2.1/servers/8aff0899-f62a-4ffc-924c-c782f7eb417f => generated 1474 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:14.164289 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b1948a1b-72a0-4407-b1b5-36fabe1a9e60 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:14.165179 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b1948a1b-72a0-4407-b1b5-36fabe1a9e60 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] [instance: 403f7d8b-1b82-47b3-803c-b96f87d6bc94] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:14.189690 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b1948a1b-72a0-4407-b1b5-36fabe1a9e60 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:14.191272 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b1948a1b-72a0-4407-b1b5-36fabe1a9e60 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:14.198196 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b1948a1b-72a0-4407-b1b5-36fabe1a9e60 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:14.198196 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b1948a1b-72a0-4407-b1b5-36fabe1a9e60 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:14.586278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5564493a-3e41-4a82-8865-cb62f604a8a6 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:14.587087 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5564493a-3e41-4a82-8865-cb62f604a8a6 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:14.609597 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5564493a-3e41-4a82-8865-cb62f604a8a6 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:14.610058 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5564493a-3e41-4a82-8865-cb62f604a8a6 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:14.611030 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5564493a-3e41-4a82-8865-cb62f604a8a6 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:14.611459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5564493a-3e41-4a82-8865-cb62f604a8a6 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:14.886990 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b1948a1b-72a0-4407-b1b5-36fabe1a9e60 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122381b421894965a62d4ae5889db93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38f2493d8324858a50e5cd969c2692d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:14.905120 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b1948a1b-72a0-4407-b1b5-36fabe1a9e60 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] 10.222.0.88 "GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94" status: 200 len: 1323 microversion: 2.1 time: 0.745561 Jul 25 14:35:14.909137 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1169/2501] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:14 2022] GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94 => generated 1323 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:14.940654 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-7e75b6b4-1341-4daf-997c-e7b0baaf2df7 req-afb47ef6-ef89-436f-8871-7e8e22d58198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aff0899-f62a-4ffc-924c-c782f7eb417f", "name": "network-vif-deleted", "tag": "a7527035-2f22-4802-9d4e-d50a95d010a1"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:14.964720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-7e75b6b4-1341-4daf-997c-e7b0baaf2df7 req-afb47ef6-ef89-436f-8871-7e8e22d58198 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:14.967939 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-7e75b6b4-1341-4daf-997c-e7b0baaf2df7 req-afb47ef6-ef89-436f-8871-7e8e22d58198 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:14.998595 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-7e75b6b4-1341-4daf-997c-e7b0baaf2df7 req-afb47ef6-ef89-436f-8871-7e8e22d58198 service nova] Creating event network-vif-deleted:a7527035-2f22-4802-9d4e-d50a95d010a1 for instance 8aff0899-f62a-4ffc-924c-c782f7eb417f on n-h1-846435-14 Jul 25 14:35:15.017677 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-7e75b6b4-1341-4daf-997c-e7b0baaf2df7 req-afb47ef6-ef89-436f-8871-7e8e22d58198 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101845 Jul 25 14:35:15.021733 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1170/2502] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:35:15.104110 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-99242e49-83ce-426d-8b9b-7148e12e2daa tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:15.105428 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-99242e49-83ce-426d-8b9b-7148e12e2daa tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 8aff0899-f62a-4ffc-924c-c782f7eb417f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:15.125741 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99242e49-83ce-426d-8b9b-7148e12e2daa tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:15.126799 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99242e49-83ce-426d-8b9b-7148e12e2daa tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:15.129990 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99242e49-83ce-426d-8b9b-7148e12e2daa tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:15.132925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99242e49-83ce-426d-8b9b-7148e12e2daa tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:15.233718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99242e49-83ce-426d-8b9b-7148e12e2daa tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:15.234989 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99242e49-83ce-426d-8b9b-7148e12e2daa tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:15.238835 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-99242e49-83ce-426d-8b9b-7148e12e2daa tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lazy-loading 'fault' on Instance uuid 8aff0899-f62a-4ffc-924c-c782f7eb417f {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:35:15.559758 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5564493a-3e41-4a82-8865-cb62f604a8a6 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:15.582960 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5564493a-3e41-4a82-8865-cb62f604a8a6 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1718 microversion: 2.1 time: 1.007370 Jul 25 14:35:15.584228 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1333/2503] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:14 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1718 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:15.595789 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-5562b3bb-9f5e-432b-9b86-4da833e35041 req-083178c5-001a-45d3-97f4-5c34ed4d68bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95cc15d2-9357-439c-8b9c-ed54768c1697", "name": "network-vif-deleted", "tag": "35ae9ccc-747f-47db-bfd7-635c2296eb8f"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:15.627386 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-5562b3bb-9f5e-432b-9b86-4da833e35041 req-083178c5-001a-45d3-97f4-5c34ed4d68bf service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:15.629057 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-5562b3bb-9f5e-432b-9b86-4da833e35041 req-083178c5-001a-45d3-97f4-5c34ed4d68bf service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:15.668208 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-5562b3bb-9f5e-432b-9b86-4da833e35041 req-083178c5-001a-45d3-97f4-5c34ed4d68bf service nova] Creating event network-vif-deleted:35ae9ccc-747f-47db-bfd7-635c2296eb8f for instance 95cc15d2-9357-439c-8b9c-ed54768c1697 on n-h2-846435-14 Jul 25 14:35:15.688821 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-5562b3bb-9f5e-432b-9b86-4da833e35041 req-083178c5-001a-45d3-97f4-5c34ed4d68bf service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103259 Jul 25 14:35:15.689908 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1334/2504] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:35:15.754580 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-99242e49-83ce-426d-8b9b-7148e12e2daa tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:15.767423 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-99242e49-83ce-426d-8b9b-7148e12e2daa tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/8aff0899-f62a-4ffc-924c-c782f7eb417f" status: 200 len: 1308 microversion: 2.1 time: 0.667275 Jul 25 14:35:15.769618 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1171/2505] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:15 2022] GET /compute/v2.1/servers/8aff0899-f62a-4ffc-924c-c782f7eb417f => generated 1308 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:15.931517 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1f45dea6-d21c-4e84-b56b-7a11b51dd535 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:15.932450 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1f45dea6-d21c-4e84-b56b-7a11b51dd535 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] [instance: 403f7d8b-1b82-47b3-803c-b96f87d6bc94] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:15.950697 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1f45dea6-d21c-4e84-b56b-7a11b51dd535 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:15.953745 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1f45dea6-d21c-4e84-b56b-7a11b51dd535 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:15.954808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1f45dea6-d21c-4e84-b56b-7a11b51dd535 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:15.956620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1f45dea6-d21c-4e84-b56b-7a11b51dd535 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:16.411073 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1f45dea6-d21c-4e84-b56b-7a11b51dd535 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122381b421894965a62d4ae5889db93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38f2493d8324858a50e5cd969c2692d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:16.423862 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1f45dea6-d21c-4e84-b56b-7a11b51dd535 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] 10.222.0.88 "GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94" status: 200 len: 1323 microversion: 2.1 time: 0.493211 Jul 25 14:35:16.425166 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1335/2506] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:15 2022] GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94 => generated 1323 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:16.500852 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-43501bf6-894d-47a5-b0a8-530e431f981c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-462022539", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:16.607937 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-86958576-8ffc-409b-9d3d-4b565c52a31e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:16.608824 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-86958576-8ffc-409b-9d3d-4b565c52a31e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:16.611488 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-43501bf6-894d-47a5-b0a8-530e431f981c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] validate_networks() for [('c1b27c74-63b3-49c6-ab52-66b439d1a6ff', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:35:16.622995 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-86958576-8ffc-409b-9d3d-4b565c52a31e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:16.624350 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-86958576-8ffc-409b-9d3d-4b565c52a31e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:16.626275 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-86958576-8ffc-409b-9d3d-4b565c52a31e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:16.629598 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-86958576-8ffc-409b-9d3d-4b565c52a31e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:17.358745 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-86958576-8ffc-409b-9d3d-4b565c52a31e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:17.381740 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-86958576-8ffc-409b-9d3d-4b565c52a31e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1718 microversion: 2.1 time: 0.779670 Jul 25 14:35:17.382369 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1336/2507] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:16 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1718 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:17.392174 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8e80081f-de58-4426-bf68-27dc92b4e52c tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:17.392174 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8e80081f-de58-4426-bf68-27dc92b4e52c tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 8aff0899-f62a-4ffc-924c-c782f7eb417f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:17.411643 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e80081f-de58-4426-bf68-27dc92b4e52c tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:17.412162 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e80081f-de58-4426-bf68-27dc92b4e52c tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:17.413105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e80081f-de58-4426-bf68-27dc92b4e52c tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:17.413598 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e80081f-de58-4426-bf68-27dc92b4e52c tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:17.432009 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-8e80081f-de58-4426-bf68-27dc92b4e52c tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] HTTP exception thrown: Instance 8aff0899-f62a-4ffc-924c-c782f7eb417f could not be found. Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8e80081f-de58-4426-bf68-27dc92b4e52c tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Request method failure captured: Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/8aff0899-f62a-4ffc-924c-c782f7eb417f HTTP/1.1 Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qlv3rUVhKaGUoIKKGCuOMD0I6MIoDHjqjO5RyR6Pj_BNVDpq--kNeH85TVlPgBPT3niD-JaccAzA0CF2Z_lYSTDSSqak2SKY3MirR2urYA-2v4fgO5i4-3PmjSM_AwPL5Le0cUs5lB3O6LfBXz1C0XPouGEhH0PZroAvYlxtcrUeto Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: e60b88c2aea642658a5bfc14780d5d51 Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersOnMultiNodesTest-1245955740 Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e60b88c2aea642658a5bfc14780d5d51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e60b88c2aea642658a5bfc14780d5d51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e60b88c2aea642658a5bfc14780d5d51", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e60b88c2aea642658a5bfc14780d5d51"}]}] Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersOnMultiNodesTest-1245955740 Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: e60b88c2aea642658a5bfc14780d5d51 Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1245955740 Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersOnMultiNodesTest-1245955740-project Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: ef351be3886949f9985b3244301435a9 Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersOnMultiNodesTest-1245955740-project Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 8aff0899-f62a-4ffc-924c-c782f7eb417f could not be found. Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '8aff0899-f62a-4ffc-924c-c782f7eb417f'} Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8aff0899-f62a-4ffc-924c-c782f7eb417f could not be found. Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8aff0899-f62a-4ffc-924c-c782f7eb417f could not be found. Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:17.434069 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:17.438258 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:17.438258 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:17.438258 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:17.438258 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:35:17.438258 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:35:17.438258 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8aff0899-f62a-4ffc-924c-c782f7eb417f could not be found. Jul 25 14:35:17.438258 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:17.438258 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8e80081f-de58-4426-bf68-27dc92b4e52c tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Returning 404 to user: Instance 8aff0899-f62a-4ffc-924c-c782f7eb417f could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:35:17.438258 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8e80081f-de58-4426-bf68-27dc92b4e52c tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/8aff0899-f62a-4ffc-924c-c782f7eb417f" status: 404 len: 111 microversion: 2.1 time: 0.052190 Jul 25 14:35:17.438258 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1337/2508] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:17 2022] GET /compute/v2.1/servers/8aff0899-f62a-4ffc-924c-c782f7eb417f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:35:17.461025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-2c5f5a3b-6dc8-42d4-9fe7-c2b819b44e03 req-c0a2fe08-adc9-44b8-a9ea-ac80aad1fab9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "403f7d8b-1b82-47b3-803c-b96f87d6bc94", "tag": "3ad6cea3-958a-4bbf-8fef-f1da6ebdf9d9"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:17.476783 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-2c5f5a3b-6dc8-42d4-9fe7-c2b819b44e03 req-c0a2fe08-adc9-44b8-a9ea-ac80aad1fab9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:17.477227 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-2c5f5a3b-6dc8-42d4-9fe7-c2b819b44e03 req-c0a2fe08-adc9-44b8-a9ea-ac80aad1fab9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:17.489790 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-2c5f5a3b-6dc8-42d4-9fe7-c2b819b44e03 req-c0a2fe08-adc9-44b8-a9ea-ac80aad1fab9 service nova] Creating event network-changed:3ad6cea3-958a-4bbf-8fef-f1da6ebdf9d9 for instance 403f7d8b-1b82-47b3-803c-b96f87d6bc94 on n-h1-846435-14 Jul 25 14:35:17.495228 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-2c5f5a3b-6dc8-42d4-9fe7-c2b819b44e03 req-c0a2fe08-adc9-44b8-a9ea-ac80aad1fab9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049631 Jul 25 14:35:17.496524 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1338/2509] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:35:17.504260 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-26ba2251-462d-4cb4-a784-9cd448035ae5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:17.505458 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-26ba2251-462d-4cb4-a784-9cd448035ae5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 95cc15d2-9357-439c-8b9c-ed54768c1697] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:17.512831 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26ba2251-462d-4cb4-a784-9cd448035ae5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:17.513725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26ba2251-462d-4cb4-a784-9cd448035ae5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:17.514710 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26ba2251-462d-4cb4-a784-9cd448035ae5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:17.515305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26ba2251-462d-4cb4-a784-9cd448035ae5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:17.538052 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-26ba2251-462d-4cb4-a784-9cd448035ae5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] HTTP exception thrown: Instance 95cc15d2-9357-439c-8b9c-ed54768c1697 could not be found. Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-26ba2251-462d-4cb4-a784-9cd448035ae5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Request method failure captured: Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697 HTTP/1.1 Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qlv3rUVhKaGUoIKKGCuOMD0I6MIoDHjqjO5RyR6Pj_BNVDpq--kNeH85TVlPgBPT3niD-JaccAzA0CF2Z_lYSTDSSqak2SKY3MirR2urYA-2v4fgO5i4-3PmjSM_AwPL5Le0cUs5lB3O6LfBXz1C0XPouGEhH0PZroAvYlxtcrUeto Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: e60b88c2aea642658a5bfc14780d5d51 Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersOnMultiNodesTest-1245955740 Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e60b88c2aea642658a5bfc14780d5d51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e60b88c2aea642658a5bfc14780d5d51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e60b88c2aea642658a5bfc14780d5d51", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e60b88c2aea642658a5bfc14780d5d51"}]}] Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersOnMultiNodesTest-1245955740 Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: e60b88c2aea642658a5bfc14780d5d51 Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1245955740 Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersOnMultiNodesTest-1245955740-project Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: ef351be3886949f9985b3244301435a9 Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersOnMultiNodesTest-1245955740-project Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 95cc15d2-9357-439c-8b9c-ed54768c1697 could not be found. Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '95cc15d2-9357-439c-8b9c-ed54768c1697'} Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95cc15d2-9357-439c-8b9c-ed54768c1697 could not be found. Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95cc15d2-9357-439c-8b9c-ed54768c1697 could not be found. Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:17.539935 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:17.543507 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:17.543507 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:17.543507 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:17.543507 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:35:17.543507 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:35:17.543507 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95cc15d2-9357-439c-8b9c-ed54768c1697 could not be found. Jul 25 14:35:17.543507 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:17.545593 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-26ba2251-462d-4cb4-a784-9cd448035ae5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Returning 404 to user: Instance 95cc15d2-9357-439c-8b9c-ed54768c1697 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:35:17.546655 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-26ba2251-462d-4cb4-a784-9cd448035ae5 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697" status: 404 len: 111 microversion: 2.1 time: 0.048806 Jul 25 14:35:17.550950 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1339/2510] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:17 2022] GET /compute/v2.1/servers/95cc15d2-9357-439c-8b9c-ed54768c1697 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:35:17.564485 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-28f4793d-da2c-42c8-8a3c-845325012fd2 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:17.565550 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-28f4793d-da2c-42c8-8a3c-845325012fd2 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] [instance: 403f7d8b-1b82-47b3-803c-b96f87d6bc94] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:17.574728 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28f4793d-da2c-42c8-8a3c-845325012fd2 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:17.575698 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28f4793d-da2c-42c8-8a3c-845325012fd2 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:17.576729 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28f4793d-da2c-42c8-8a3c-845325012fd2 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:17.577350 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28f4793d-da2c-42c8-8a3c-845325012fd2 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:18.086515 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-43501bf6-894d-47a5-b0a8-530e431f981c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:35:18.087915 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-43501bf6-894d-47a5-b0a8-530e431f981c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:35:18.088762 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-43501bf6-894d-47a5-b0a8-530e431f981c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:35:18.089911 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-43501bf6-894d-47a5-b0a8-530e431f981c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:35:18.090531 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-43501bf6-894d-47a5-b0a8-530e431f981c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:35:18.102218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43501bf6-894d-47a5-b0a8-530e431f981c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:18.102664 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43501bf6-894d-47a5-b0a8-530e431f981c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:18.103575 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43501bf6-894d-47a5-b0a8-530e431f981c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:18.104022 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43501bf6-894d-47a5-b0a8-530e431f981c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:18.131138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-43501bf6-894d-47a5-b0a8-530e431f981c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Getting quotas for project 2f1bd935e917484799f31ad643eafb2a. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:35:18.144206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-43501bf6-894d-47a5-b0a8-530e431f981c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Getting quotas for user 9f2ddec1bc6244739e9ac3a40c064b53 and project 2f1bd935e917484799f31ad643eafb2a. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:35:18.163933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-28f4793d-da2c-42c8-8a3c-845325012fd2 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122381b421894965a62d4ae5889db93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38f2493d8324858a50e5cd969c2692d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:18.170177 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-43501bf6-894d-47a5-b0a8-530e431f981c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:35:18.173100 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-43501bf6-894d-47a5-b0a8-530e431f981c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:35:18.176719 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-28f4793d-da2c-42c8-8a3c-845325012fd2 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] 10.222.0.88 "GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94" status: 200 len: 1323 microversion: 2.1 time: 0.621118 Jul 25 14:35:18.177455 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1340/2511] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:17 2022] GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94 => generated 1323 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:18.189605 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5bf338e0-46f7-4d62-9203-0b9197418762 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:18.239222 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-43501bf6-894d-47a5-b0a8-530e431f981c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.003178 Jul 25 14:35:18.240510 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1172/2512] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:35:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 2008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 14:35:18.262298 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0a3dc4e0-3cf1-4c8b-a613-7162b10ab4fd tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:18.263770 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0a3dc4e0-3cf1-4c8b-a613-7162b10ab4fd tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:18.268542 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5bf338e0-46f7-4d62-9203-0b9197418762 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "DELETE /compute/v2.1/os-server-groups/76c3d209-2d0e-4027-a911-f11bd860a5da" status: 204 len: 0 microversion: 2.1 time: 0.083226 Jul 25 14:35:18.269268 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1341/2513] 10.222.0.88 () {58 vars in 1266 bytes} [Mon Jul 25 14:35:18 2022] DELETE /compute/v2.1/os-server-groups/76c3d209-2d0e-4027-a911-f11bd860a5da => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:35:18.280474 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e0148de0-8102-4af9-83cf-1bf2dd604fcc tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:18.280991 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e0148de0-8102-4af9-83cf-1bf2dd604fcc tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 735eedac-478a-4b11-9fb3-479179270d35] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:18.285000 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:35:18.303985 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e0148de0-8102-4af9-83cf-1bf2dd604fcc tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:18.304465 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e0148de0-8102-4af9-83cf-1bf2dd604fcc tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:18.305798 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e0148de0-8102-4af9-83cf-1bf2dd604fcc tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:18.306211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e0148de0-8102-4af9-83cf-1bf2dd604fcc tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:18.386698 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e0148de0-8102-4af9-83cf-1bf2dd604fcc tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 735eedac-478a-4b11-9fb3-479179270d35] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:35:18.624318 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e0148de0-8102-4af9-83cf-1bf2dd604fcc tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "DELETE /compute/v2.1/servers/735eedac-478a-4b11-9fb3-479179270d35" status: 204 len: 0 microversion: 2.1 time: 0.346660 Jul 25 14:35:18.624980 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1342/2514] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:35:18 2022] DELETE /compute/v2.1/servers/735eedac-478a-4b11-9fb3-479179270d35 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:35:18.635837 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5d61037b-9696-4952-9e86-34f7e21852fc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:18.639187 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5d61037b-9696-4952-9e86-34f7e21852fc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:18.649828 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d61037b-9696-4952-9e86-34f7e21852fc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:18.650671 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d61037b-9696-4952-9e86-34f7e21852fc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:18.651676 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d61037b-9696-4952-9e86-34f7e21852fc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:18.664594 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d61037b-9696-4952-9e86-34f7e21852fc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:18.682440 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0a3dc4e0-3cf1-4c8b-a613-7162b10ab4fd tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:18.693661 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0a3dc4e0-3cf1-4c8b-a613-7162b10ab4fd tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1221 microversion: 2.1 time: 0.443116 Jul 25 14:35:18.696424 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1173/2515] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:18 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1221 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:18.722477 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e3da5c65-48b1-48ad-9df8-fef42b3466e4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:18.722633 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e3da5c65-48b1-48ad-9df8-fef42b3466e4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 742f8126-e737-4716-bb05-66e2ba318535] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:18.737114 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3da5c65-48b1-48ad-9df8-fef42b3466e4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:18.737585 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3da5c65-48b1-48ad-9df8-fef42b3466e4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:18.738382 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3da5c65-48b1-48ad-9df8-fef42b3466e4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:18.738918 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3da5c65-48b1-48ad-9df8-fef42b3466e4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:18.852515 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e3da5c65-48b1-48ad-9df8-fef42b3466e4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 742f8126-e737-4716-bb05-66e2ba318535] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:35:19.048230 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e3da5c65-48b1-48ad-9df8-fef42b3466e4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "DELETE /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535" status: 204 len: 0 microversion: 2.1 time: 0.349611 Jul 25 14:35:19.048935 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1174/2516] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:35:18 2022] DELETE /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:35:19.058786 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-469f8c13-a6bc-4704-bdc0-1b51a92ea780 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-85807087", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:19.151165 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-469f8c13-a6bc-4704-bdc0-1b51a92ea780 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] validate_networks() for [('c1b27c74-63b3-49c6-ab52-66b439d1a6ff', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:35:19.243005 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5d61037b-9696-4952-9e86-34f7e21852fc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:19.253612 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5d61037b-9696-4952-9e86-34f7e21852fc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1718 microversion: 2.1 time: 0.627141 Jul 25 14:35:19.262648 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1343/2517] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:18 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1718 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:19.268375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8a0dda47-dace-40b9-a9a4-a990fed2c1a0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:19.269003 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8a0dda47-dace-40b9-a9a4-a990fed2c1a0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 735eedac-478a-4b11-9fb3-479179270d35] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:19.285578 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8a0dda47-dace-40b9-a9a4-a990fed2c1a0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:19.286730 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8a0dda47-dace-40b9-a9a4-a990fed2c1a0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:19.293153 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8a0dda47-dace-40b9-a9a4-a990fed2c1a0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:19.293836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8a0dda47-dace-40b9-a9a4-a990fed2c1a0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:19.876667 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:35:19.920449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:35:20.437816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8a0dda47-dace-40b9-a9a4-a990fed2c1a0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:20.451147 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8a0dda47-dace-40b9-a9a4-a990fed2c1a0 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/735eedac-478a-4b11-9fb3-479179270d35" status: 200 len: 1474 microversion: 2.1 time: 1.187126 Jul 25 14:35:20.452309 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1344/2518] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:19 2022] GET /compute/v2.1/servers/735eedac-478a-4b11-9fb3-479179270d35 => generated 1474 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:20.457459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-4caaf1f3-2edb-467a-bac9-2eef7c8b5cef req-34a5a2cc-8de4-429f-9bf1-ca6ca6a6b84b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a85a57f0-715f-47cd-ae19-463dfc5e7aca", "name": "network-vif-unplugged", "status": "completed", "tag": "b6bbf444-a731-43c2-bb7a-c5a47d378689"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:20.469858 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-4caaf1f3-2edb-467a-bac9-2eef7c8b5cef req-34a5a2cc-8de4-429f-9bf1-ca6ca6a6b84b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:20.470507 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-4caaf1f3-2edb-467a-bac9-2eef7c8b5cef req-34a5a2cc-8de4-429f-9bf1-ca6ca6a6b84b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:20.505065 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-4caaf1f3-2edb-467a-bac9-2eef7c8b5cef req-34a5a2cc-8de4-429f-9bf1-ca6ca6a6b84b service nova] Creating event network-vif-unplugged:b6bbf444-a731-43c2-bb7a-c5a47d378689 for instance a85a57f0-715f-47cd-ae19-463dfc5e7aca on n-h2-846435-14 Jul 25 14:35:20.520643 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-4caaf1f3-2edb-467a-bac9-2eef7c8b5cef req-34a5a2cc-8de4-429f-9bf1-ca6ca6a6b84b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066346 Jul 25 14:35:20.522231 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1345/2519] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:35:20.529419 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-222c96ac-9c3e-4f8d-807e-6a7fc0fd3af0 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:20.530472 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-222c96ac-9c3e-4f8d-807e-6a7fc0fd3af0 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] [instance: 403f7d8b-1b82-47b3-803c-b96f87d6bc94] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:20.538830 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-222c96ac-9c3e-4f8d-807e-6a7fc0fd3af0 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:20.539432 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-222c96ac-9c3e-4f8d-807e-6a7fc0fd3af0 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:20.540430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-222c96ac-9c3e-4f8d-807e-6a7fc0fd3af0 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:20.541213 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-222c96ac-9c3e-4f8d-807e-6a7fc0fd3af0 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:20.838780 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-222c96ac-9c3e-4f8d-807e-6a7fc0fd3af0 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122381b421894965a62d4ae5889db93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38f2493d8324858a50e5cd969c2692d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:20.847199 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-222c96ac-9c3e-4f8d-807e-6a7fc0fd3af0 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] 10.222.0.88 "GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94" status: 200 len: 1323 microversion: 2.1 time: 0.322947 Jul 25 14:35:20.861262 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1346/2520] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:20 2022] GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94 => generated 1323 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:20.867314 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3ab33e88-5492-487f-9d56-06cb41a6bbf0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:20.868203 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3ab33e88-5492-487f-9d56-06cb41a6bbf0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:20.874850 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3ab33e88-5492-487f-9d56-06cb41a6bbf0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:20.875547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3ab33e88-5492-487f-9d56-06cb41a6bbf0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:20.876541 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3ab33e88-5492-487f-9d56-06cb41a6bbf0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:20.877183 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3ab33e88-5492-487f-9d56-06cb41a6bbf0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:20.952307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-469f8c13-a6bc-4704-bdc0-1b51a92ea780 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:35:20.953597 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-469f8c13-a6bc-4704-bdc0-1b51a92ea780 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:35:20.954314 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-469f8c13-a6bc-4704-bdc0-1b51a92ea780 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:35:20.954940 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-469f8c13-a6bc-4704-bdc0-1b51a92ea780 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:35:20.955685 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-469f8c13-a6bc-4704-bdc0-1b51a92ea780 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:35:20.969835 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-469f8c13-a6bc-4704-bdc0-1b51a92ea780 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:20.970726 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-469f8c13-a6bc-4704-bdc0-1b51a92ea780 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:20.972141 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-469f8c13-a6bc-4704-bdc0-1b51a92ea780 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:20.972836 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-469f8c13-a6bc-4704-bdc0-1b51a92ea780 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:21.003911 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-469f8c13-a6bc-4704-bdc0-1b51a92ea780 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Getting quotas for project 2f1bd935e917484799f31ad643eafb2a. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:35:21.010922 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-469f8c13-a6bc-4704-bdc0-1b51a92ea780 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Getting quotas for user 9f2ddec1bc6244739e9ac3a40c064b53 and project 2f1bd935e917484799f31ad643eafb2a. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:35:21.025861 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-469f8c13-a6bc-4704-bdc0-1b51a92ea780 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:35:21.029108 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-469f8c13-a6bc-4704-bdc0-1b51a92ea780 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:35:21.086122 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-469f8c13-a6bc-4704-bdc0-1b51a92ea780 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.035724 Jul 25 14:35:21.087312 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1175/2521] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:35:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 2038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:35:21.098719 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-94c617be-d18f-47d4-bbdb-d70ccfb96c9e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:21.104169 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-94c617be-d18f-47d4-bbdb-d70ccfb96c9e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:21.421900 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-94c617be-d18f-47d4-bbdb-d70ccfb96c9e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:21.435675 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-94c617be-d18f-47d4-bbdb-d70ccfb96c9e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1220 microversion: 2.1 time: 0.341105 Jul 25 14:35:21.442470 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1176/2522] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:21 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1220 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:35:21.475248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-628b7554-3fe9-44b5-a5fe-c9eb9502a620 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:21.476341 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-628b7554-3fe9-44b5-a5fe-c9eb9502a620 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 735eedac-478a-4b11-9fb3-479179270d35] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:21.490308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-628b7554-3fe9-44b5-a5fe-c9eb9502a620 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:21.491148 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-628b7554-3fe9-44b5-a5fe-c9eb9502a620 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:21.492301 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-628b7554-3fe9-44b5-a5fe-c9eb9502a620 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:21.492970 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-628b7554-3fe9-44b5-a5fe-c9eb9502a620 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:21.505635 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3ab33e88-5492-487f-9d56-06cb41a6bbf0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:21.513581 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3ab33e88-5492-487f-9d56-06cb41a6bbf0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1718 microversion: 2.1 time: 0.650905 Jul 25 14:35:21.514187 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1347/2523] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:20 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1718 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:21.875389 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0e898742-19b2-4ce2-8b67-44ff6e296bb1 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:21.876264 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0e898742-19b2-4ce2-8b67-44ff6e296bb1 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] [instance: 403f7d8b-1b82-47b3-803c-b96f87d6bc94] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:21.888892 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0e898742-19b2-4ce2-8b67-44ff6e296bb1 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:21.890711 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0e898742-19b2-4ce2-8b67-44ff6e296bb1 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:21.903537 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0e898742-19b2-4ce2-8b67-44ff6e296bb1 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:21.904605 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0e898742-19b2-4ce2-8b67-44ff6e296bb1 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:22.614103 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-628b7554-3fe9-44b5-a5fe-c9eb9502a620 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:22.623017 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-628b7554-3fe9-44b5-a5fe-c9eb9502a620 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/735eedac-478a-4b11-9fb3-479179270d35" status: 200 len: 1474 microversion: 2.1 time: 1.151682 Jul 25 14:35:22.623677 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1177/2524] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:21 2022] GET /compute/v2.1/servers/735eedac-478a-4b11-9fb3-479179270d35 => generated 1474 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:22.642467 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-994360bb-c067-4c4f-9fb2-9de8e7621f62 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:22.643395 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-994360bb-c067-4c4f-9fb2-9de8e7621f62 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:22.657343 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-994360bb-c067-4c4f-9fb2-9de8e7621f62 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:22.659371 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-994360bb-c067-4c4f-9fb2-9de8e7621f62 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:22.661054 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-994360bb-c067-4c4f-9fb2-9de8e7621f62 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:22.663242 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-994360bb-c067-4c4f-9fb2-9de8e7621f62 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:23.169607 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0e898742-19b2-4ce2-8b67-44ff6e296bb1 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122381b421894965a62d4ae5889db93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38f2493d8324858a50e5cd969c2692d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:23.208900 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0e898742-19b2-4ce2-8b67-44ff6e296bb1 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] 10.222.0.88 "GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94" status: 200 len: 1323 microversion: 2.1 time: 1.335596 Jul 25 14:35:23.214105 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1348/2525] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:21 2022] GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94 => generated 1323 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:23.238894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e7380d3c-d910-48d0-8645-1441c14e22fa tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:23.239701 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e7380d3c-d910-48d0-8645-1441c14e22fa tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:23.252139 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e7380d3c-d910-48d0-8645-1441c14e22fa tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:23.252910 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e7380d3c-d910-48d0-8645-1441c14e22fa tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:23.253914 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e7380d3c-d910-48d0-8645-1441c14e22fa tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:23.254125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e7380d3c-d910-48d0-8645-1441c14e22fa tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:23.349919 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-994360bb-c067-4c4f-9fb2-9de8e7621f62 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:23.362641 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-994360bb-c067-4c4f-9fb2-9de8e7621f62 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1272 microversion: 2.1 time: 0.730533 Jul 25 14:35:23.377107 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1178/2526] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:22 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1272 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:23.377253 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-a9f92b8b-1338-4f57-9162-d88a6fc4d6e5 req-7d5e3086-4f01-480a-b9b5-c27305ff5b5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "735eedac-478a-4b11-9fb3-479179270d35", "name": "network-vif-deleted", "tag": "b41659ca-fc34-401c-8b74-8f49d9f18e92"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:23.399164 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-a9f92b8b-1338-4f57-9162-d88a6fc4d6e5 req-7d5e3086-4f01-480a-b9b5-c27305ff5b5a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:23.399626 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-a9f92b8b-1338-4f57-9162-d88a6fc4d6e5 req-7d5e3086-4f01-480a-b9b5-c27305ff5b5a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:23.432555 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-a9f92b8b-1338-4f57-9162-d88a6fc4d6e5 req-7d5e3086-4f01-480a-b9b5-c27305ff5b5a service nova] Creating event network-vif-deleted:b41659ca-fc34-401c-8b74-8f49d9f18e92 for instance 735eedac-478a-4b11-9fb3-479179270d35 on n-h2-846435-14 Jul 25 14:35:23.448190 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-a9f92b8b-1338-4f57-9162-d88a6fc4d6e5 req-7d5e3086-4f01-480a-b9b5-c27305ff5b5a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081579 Jul 25 14:35:23.448858 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1179/2527] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:35:23.652308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2ca65525-c81d-4085-8efc-5203556d4042 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:23.654001 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2ca65525-c81d-4085-8efc-5203556d4042 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 735eedac-478a-4b11-9fb3-479179270d35] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:23.690672 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ca65525-c81d-4085-8efc-5203556d4042 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:23.691485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ca65525-c81d-4085-8efc-5203556d4042 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:23.695512 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ca65525-c81d-4085-8efc-5203556d4042 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:23.696531 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ca65525-c81d-4085-8efc-5203556d4042 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:23.780805 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ca65525-c81d-4085-8efc-5203556d4042 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:23.782237 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ca65525-c81d-4085-8efc-5203556d4042 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:23.782860 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-2ca65525-c81d-4085-8efc-5203556d4042 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lazy-loading 'fault' on Instance uuid 735eedac-478a-4b11-9fb3-479179270d35 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:35:23.900210 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e7380d3c-d910-48d0-8645-1441c14e22fa tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:23.915499 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e7380d3c-d910-48d0-8645-1441c14e22fa tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1718 microversion: 2.1 time: 0.695617 Jul 25 14:35:23.916787 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1349/2528] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:23 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1718 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:24.037734 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2ca65525-c81d-4085-8efc-5203556d4042 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:24.055579 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2ca65525-c81d-4085-8efc-5203556d4042 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/735eedac-478a-4b11-9fb3-479179270d35" status: 200 len: 1309 microversion: 2.1 time: 0.410456 Jul 25 14:35:24.056423 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1180/2529] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:23 2022] GET /compute/v2.1/servers/735eedac-478a-4b11-9fb3-479179270d35 => generated 1309 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:35:24.238049 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4f127788-3c9e-4647-92f8-894639dcc4fa tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:24.239552 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4f127788-3c9e-4647-92f8-894639dcc4fa tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] [instance: 403f7d8b-1b82-47b3-803c-b96f87d6bc94] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:24.258958 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4f127788-3c9e-4647-92f8-894639dcc4fa tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:24.259787 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4f127788-3c9e-4647-92f8-894639dcc4fa tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:24.260956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4f127788-3c9e-4647-92f8-894639dcc4fa tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:24.261652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4f127788-3c9e-4647-92f8-894639dcc4fa tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:24.384482 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-de490ef3-ae0f-4fd0-848d-5345d5e3eb05 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:24.385470 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-de490ef3-ae0f-4fd0-848d-5345d5e3eb05 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:24.393954 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-de490ef3-ae0f-4fd0-848d-5345d5e3eb05 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:24.394667 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-de490ef3-ae0f-4fd0-848d-5345d5e3eb05 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:24.395677 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-de490ef3-ae0f-4fd0-848d-5345d5e3eb05 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:24.396337 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-de490ef3-ae0f-4fd0-848d-5345d5e3eb05 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:24.577077 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-de490ef3-ae0f-4fd0-848d-5345d5e3eb05 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:24.620343 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-de490ef3-ae0f-4fd0-848d-5345d5e3eb05 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1278 microversion: 2.1 time: 0.239894 Jul 25 14:35:24.624250 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1181/2530] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:24 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1278 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:24.938486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9b8b11ef-67e9-4adb-a30d-9f7deba3c4a6 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:24.939805 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9b8b11ef-67e9-4adb-a30d-9f7deba3c4a6 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:24.958729 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9b8b11ef-67e9-4adb-a30d-9f7deba3c4a6 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:24.959180 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9b8b11ef-67e9-4adb-a30d-9f7deba3c4a6 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:24.960216 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9b8b11ef-67e9-4adb-a30d-9f7deba3c4a6 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:24.963953 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9b8b11ef-67e9-4adb-a30d-9f7deba3c4a6 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:24.967283 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4f127788-3c9e-4647-92f8-894639dcc4fa tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122381b421894965a62d4ae5889db93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38f2493d8324858a50e5cd969c2692d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:24.990043 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4f127788-3c9e-4647-92f8-894639dcc4fa tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] 10.222.0.88 "GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94" status: 200 len: 1323 microversion: 2.1 time: 0.758993 Jul 25 14:35:24.992074 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1350/2531] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:24 2022] GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94 => generated 1323 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:25.089790 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9c0dbd75-fb68-4954-b448-c12714b8fad7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:25.091308 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9c0dbd75-fb68-4954-b448-c12714b8fad7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 735eedac-478a-4b11-9fb3-479179270d35] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:25.105757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9c0dbd75-fb68-4954-b448-c12714b8fad7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:25.107445 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9c0dbd75-fb68-4954-b448-c12714b8fad7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:25.110576 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9c0dbd75-fb68-4954-b448-c12714b8fad7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:25.116125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9c0dbd75-fb68-4954-b448-c12714b8fad7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:25.135613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:35:25.188573 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-9c0dbd75-fb68-4954-b448-c12714b8fad7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] HTTP exception thrown: Instance 735eedac-478a-4b11-9fb3-479179270d35 could not be found. Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9c0dbd75-fb68-4954-b448-c12714b8fad7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Request method failure captured: Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/735eedac-478a-4b11-9fb3-479179270d35 HTTP/1.1 Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qlv3rUVhKaGUoIKKGCuOMD0I6MIoDHjqjO5RyR6Pj_BNVDpq--kNeH85TVlPgBPT3niD-JaccAzA0CF2Z_lYSTDSSqak2SKY3MirR2urYA-2v4fgO5i4-3PmjSM_AwPL5Le0cUs5lB3O6LfBXz1C0XPouGEhH0PZroAvYlxtcrUeto Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: e60b88c2aea642658a5bfc14780d5d51 Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersOnMultiNodesTest-1245955740 Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e60b88c2aea642658a5bfc14780d5d51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e60b88c2aea642658a5bfc14780d5d51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e60b88c2aea642658a5bfc14780d5d51", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e60b88c2aea642658a5bfc14780d5d51"}]}] Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersOnMultiNodesTest-1245955740 Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: e60b88c2aea642658a5bfc14780d5d51 Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1245955740 Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersOnMultiNodesTest-1245955740-project Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: ef351be3886949f9985b3244301435a9 Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersOnMultiNodesTest-1245955740-project Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 735eedac-478a-4b11-9fb3-479179270d35 could not be found. Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '735eedac-478a-4b11-9fb3-479179270d35'} Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 735eedac-478a-4b11-9fb3-479179270d35 could not be found. Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 735eedac-478a-4b11-9fb3-479179270d35 could not be found. Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:25.192118 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:25.196434 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:25.196434 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:25.196434 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:25.196434 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:35:25.196434 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:35:25.196434 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 735eedac-478a-4b11-9fb3-479179270d35 could not be found. Jul 25 14:35:25.196434 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:25.204012 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9c0dbd75-fb68-4954-b448-c12714b8fad7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Returning 404 to user: Instance 735eedac-478a-4b11-9fb3-479179270d35 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:35:25.205256 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9c0dbd75-fb68-4954-b448-c12714b8fad7 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/735eedac-478a-4b11-9fb3-479179270d35" status: 404 len: 111 microversion: 2.1 time: 0.129061 Jul 25 14:35:25.210205 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1351/2532] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:25 2022] GET /compute/v2.1/servers/735eedac-478a-4b11-9fb3-479179270d35 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:35:25.227590 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-638a2b74-32ec-44b6-8706-4c14caf04b6b tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:25.232422 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-638a2b74-32ec-44b6-8706-4c14caf04b6b tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 742f8126-e737-4716-bb05-66e2ba318535] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:25.264561 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-638a2b74-32ec-44b6-8706-4c14caf04b6b tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:25.265798 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-638a2b74-32ec-44b6-8706-4c14caf04b6b tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:25.267230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-638a2b74-32ec-44b6-8706-4c14caf04b6b tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:25.269234 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-638a2b74-32ec-44b6-8706-4c14caf04b6b tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:25.393231 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-638a2b74-32ec-44b6-8706-4c14caf04b6b tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:25.395369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-638a2b74-32ec-44b6-8706-4c14caf04b6b tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:25.395929 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-638a2b74-32ec-44b6-8706-4c14caf04b6b tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lazy-loading 'fault' on Instance uuid 742f8126-e737-4716-bb05-66e2ba318535 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:35:25.620078 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-638a2b74-32ec-44b6-8706-4c14caf04b6b tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:25.629395 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-638a2b74-32ec-44b6-8706-4c14caf04b6b tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535" status: 200 len: 1309 microversion: 2.1 time: 0.412415 Jul 25 14:35:25.633324 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1352/2533] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:25 2022] GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535 => generated 1309 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:25.651818 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-d4999460-6a83-4996-9272-d75363e0d83b req-f25ffc09-d40b-480f-9af0-2f882cdd5862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "742f8126-e737-4716-bb05-66e2ba318535", "name": "network-vif-deleted", "tag": "4b3247ac-f0ea-4ca8-b22b-8bb5e2406e66"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:25.708100 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-d4999460-6a83-4996-9272-d75363e0d83b req-f25ffc09-d40b-480f-9af0-2f882cdd5862 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:25.713341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-d4999460-6a83-4996-9272-d75363e0d83b req-f25ffc09-d40b-480f-9af0-2f882cdd5862 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:25.750306 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-d4999460-6a83-4996-9272-d75363e0d83b req-f25ffc09-d40b-480f-9af0-2f882cdd5862 service nova] Creating event network-vif-deleted:4b3247ac-f0ea-4ca8-b22b-8bb5e2406e66 for instance 742f8126-e737-4716-bb05-66e2ba318535 on n-h2-846435-14 Jul 25 14:35:25.764687 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-d4999460-6a83-4996-9272-d75363e0d83b req-f25ffc09-d40b-480f-9af0-2f882cdd5862 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128316 Jul 25 14:35:25.768692 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1353/2534] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:35:25.782233 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-783c5232-c1ac-4bb1-a031-fec674a7411d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:25.784491 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-783c5232-c1ac-4bb1-a031-fec674a7411d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:25.801853 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-783c5232-c1ac-4bb1-a031-fec674a7411d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:25.802698 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-783c5232-c1ac-4bb1-a031-fec674a7411d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:25.804101 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-783c5232-c1ac-4bb1-a031-fec674a7411d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:25.804688 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-783c5232-c1ac-4bb1-a031-fec674a7411d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:25.920877 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-783c5232-c1ac-4bb1-a031-fec674a7411d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:25.935732 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-783c5232-c1ac-4bb1-a031-fec674a7411d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1278 microversion: 2.1 time: 0.165353 Jul 25 14:35:25.936591 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1354/2535] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:25 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1278 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:26.018633 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bd74542d-0d69-48c8-81cb-b76bd559b84e tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:26.019306 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bd74542d-0d69-48c8-81cb-b76bd559b84e tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] [instance: 403f7d8b-1b82-47b3-803c-b96f87d6bc94] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:26.036809 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bd74542d-0d69-48c8-81cb-b76bd559b84e tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:26.037181 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bd74542d-0d69-48c8-81cb-b76bd559b84e tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:26.038015 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bd74542d-0d69-48c8-81cb-b76bd559b84e tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:26.038443 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bd74542d-0d69-48c8-81cb-b76bd559b84e tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:26.218139 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9b8b11ef-67e9-4adb-a30d-9f7deba3c4a6 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:26.232472 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9b8b11ef-67e9-4adb-a30d-9f7deba3c4a6 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1718 microversion: 2.1 time: 1.297914 Jul 25 14:35:26.242745 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1182/2536] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:24 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1718 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:26.451854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-0e0a0bfa-b6ab-4dab-8595-998756b4c47a req-85cdf3cb-3cef-46e2-aa83-14ce87a12720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403f7d8b-1b82-47b3-803c-b96f87d6bc94", "name": "network-vif-plugged", "status": "completed", "tag": "3ad6cea3-958a-4bbf-8fef-f1da6ebdf9d9"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:26.476169 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-0e0a0bfa-b6ab-4dab-8595-998756b4c47a req-85cdf3cb-3cef-46e2-aa83-14ce87a12720 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:26.476864 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-0e0a0bfa-b6ab-4dab-8595-998756b4c47a req-85cdf3cb-3cef-46e2-aa83-14ce87a12720 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:26.526515 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-0e0a0bfa-b6ab-4dab-8595-998756b4c47a req-85cdf3cb-3cef-46e2-aa83-14ce87a12720 service nova] Creating event network-vif-plugged:3ad6cea3-958a-4bbf-8fef-f1da6ebdf9d9 for instance 403f7d8b-1b82-47b3-803c-b96f87d6bc94 on n-h1-846435-14 Jul 25 14:35:26.599083 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-0e0a0bfa-b6ab-4dab-8595-998756b4c47a req-85cdf3cb-3cef-46e2-aa83-14ce87a12720 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142001 Jul 25 14:35:26.599781 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1183/2537] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:35:26.601870 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bd74542d-0d69-48c8-81cb-b76bd559b84e tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122381b421894965a62d4ae5889db93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38f2493d8324858a50e5cd969c2692d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:26.612546 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bd74542d-0d69-48c8-81cb-b76bd559b84e tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] 10.222.0.88 "GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94" status: 200 len: 1323 microversion: 2.1 time: 0.600923 Jul 25 14:35:26.630819 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1355/2538] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:26 2022] GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94 => generated 1323 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:35:26.656464 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6864ac75-5e21-41ff-964e-0f78b4d734c4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:26.657177 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6864ac75-5e21-41ff-964e-0f78b4d734c4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 742f8126-e737-4716-bb05-66e2ba318535] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:26.664612 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6864ac75-5e21-41ff-964e-0f78b4d734c4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:26.665063 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6864ac75-5e21-41ff-964e-0f78b4d734c4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:26.681278 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6864ac75-5e21-41ff-964e-0f78b4d734c4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:26.682006 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6864ac75-5e21-41ff-964e-0f78b4d734c4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:26.686917 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:35:26.706986 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-6864ac75-5e21-41ff-964e-0f78b4d734c4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] HTTP exception thrown: Instance 742f8126-e737-4716-bb05-66e2ba318535 could not be found. Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6864ac75-5e21-41ff-964e-0f78b4d734c4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Request method failure captured: Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535 HTTP/1.1 Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qlv3rUVhKaGUoIKKGCuOMD0I6MIoDHjqjO5RyR6Pj_BNVDpq--kNeH85TVlPgBPT3niD-JaccAzA0CF2Z_lYSTDSSqak2SKY3MirR2urYA-2v4fgO5i4-3PmjSM_AwPL5Le0cUs5lB3O6LfBXz1C0XPouGEhH0PZroAvYlxtcrUeto Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: e60b88c2aea642658a5bfc14780d5d51 Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersOnMultiNodesTest-1245955740 Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e60b88c2aea642658a5bfc14780d5d51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e60b88c2aea642658a5bfc14780d5d51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e60b88c2aea642658a5bfc14780d5d51", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e60b88c2aea642658a5bfc14780d5d51"}]}] Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersOnMultiNodesTest-1245955740 Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: e60b88c2aea642658a5bfc14780d5d51 Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1245955740 Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersOnMultiNodesTest-1245955740-project Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: ef351be3886949f9985b3244301435a9 Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersOnMultiNodesTest-1245955740-project Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 742f8126-e737-4716-bb05-66e2ba318535 could not be found. Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '742f8126-e737-4716-bb05-66e2ba318535'} Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 742f8126-e737-4716-bb05-66e2ba318535 could not be found. Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 742f8126-e737-4716-bb05-66e2ba318535 could not be found. Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:26.709283 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:26.713777 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:26.713777 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:26.713777 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:26.713777 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:35:26.713777 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:35:26.713777 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 742f8126-e737-4716-bb05-66e2ba318535 could not be found. Jul 25 14:35:26.713777 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:26.716784 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6864ac75-5e21-41ff-964e-0f78b4d734c4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Returning 404 to user: Instance 742f8126-e737-4716-bb05-66e2ba318535 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:35:26.718173 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6864ac75-5e21-41ff-964e-0f78b4d734c4 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535" status: 404 len: 111 microversion: 2.1 time: 0.065887 Jul 25 14:35:26.719894 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1184/2539] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:26 2022] GET /compute/v2.1/servers/742f8126-e737-4716-bb05-66e2ba318535 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:35:26.729163 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-34fb8ea5-52cb-474e-9ffd-e9a78fe7e89f tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:26.768647 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-34fb8ea5-52cb-474e-9ffd-e9a78fe7e89f tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "DELETE /compute/v2.1/os-server-groups/4f723bc4-eaed-48cf-a946-6282c20f4328" status: 204 len: 0 microversion: 2.1 time: 0.044352 Jul 25 14:35:26.769941 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1356/2540] 10.222.0.88 () {58 vars in 1266 bytes} [Mon Jul 25 14:35:26 2022] DELETE /compute/v2.1/os-server-groups/4f723bc4-eaed-48cf-a946-6282c20f4328 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 14:35:26.780302 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0151649e-0972-4e0e-ac2f-110f1acddf97 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:26.791644 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0151649e-0972-4e0e-ac2f-110f1acddf97 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 1a97e112-b45b-4dcb-ad9f-e979e5c183d9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:26.804512 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0151649e-0972-4e0e-ac2f-110f1acddf97 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:26.805077 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0151649e-0972-4e0e-ac2f-110f1acddf97 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:26.806008 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0151649e-0972-4e0e-ac2f-110f1acddf97 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:26.806610 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0151649e-0972-4e0e-ac2f-110f1acddf97 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:26.840834 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0151649e-0972-4e0e-ac2f-110f1acddf97 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 1a97e112-b45b-4dcb-ad9f-e979e5c183d9] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:35:26.960502 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e644c492-72d0-4045-a6cb-fd20e0419bfe tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:26.961284 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e644c492-72d0-4045-a6cb-fd20e0419bfe tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:26.971386 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e644c492-72d0-4045-a6cb-fd20e0419bfe tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:26.972199 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e644c492-72d0-4045-a6cb-fd20e0419bfe tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:26.973170 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e644c492-72d0-4045-a6cb-fd20e0419bfe tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:26.974389 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e644c492-72d0-4045-a6cb-fd20e0419bfe tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:27.043371 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0151649e-0972-4e0e-ac2f-110f1acddf97 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "DELETE /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9" status: 204 len: 0 microversion: 2.1 time: 0.268245 Jul 25 14:35:27.043908 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1185/2541] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:35:26 2022] DELETE /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:35:27.052662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-601f347b-df83-4e26-918f-3395fca0ab5a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:27.053703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-601f347b-df83-4e26-918f-3395fca0ab5a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 1a97e112-b45b-4dcb-ad9f-e979e5c183d9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:27.061192 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-601f347b-df83-4e26-918f-3395fca0ab5a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:27.061890 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-601f347b-df83-4e26-918f-3395fca0ab5a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:27.062902 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-601f347b-df83-4e26-918f-3395fca0ab5a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:27.063565 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-601f347b-df83-4e26-918f-3395fca0ab5a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:27.186354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e644c492-72d0-4045-a6cb-fd20e0419bfe tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:27.195587 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e644c492-72d0-4045-a6cb-fd20e0419bfe tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1278 microversion: 2.1 time: 0.240730 Jul 25 14:35:27.199937 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1357/2542] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:26 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1278 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:27.256890 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a7b099e9-dd51-45a3-9900-c80addd70b06 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:27.257807 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a7b099e9-dd51-45a3-9900-c80addd70b06 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:27.269542 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a7b099e9-dd51-45a3-9900-c80addd70b06 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:27.275670 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a7b099e9-dd51-45a3-9900-c80addd70b06 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:27.276728 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a7b099e9-dd51-45a3-9900-c80addd70b06 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:27.277897 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a7b099e9-dd51-45a3-9900-c80addd70b06 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:27.510681 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a7b099e9-dd51-45a3-9900-c80addd70b06 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:27.519621 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a7b099e9-dd51-45a3-9900-c80addd70b06 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1708 microversion: 2.1 time: 0.267364 Jul 25 14:35:27.520345 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1358/2543] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:27 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1708 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:27.544321 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a801027c-0f42-41dc-9fd1-e6f08b537588 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Calling method '.version_select at 0x7f46989d3160>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:27.549286 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a801027c-0f42-41dc-9fd1-e6f08b537588 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:27.549989 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a801027c-0f42-41dc-9fd1-e6f08b537588 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:27.560994 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a801027c-0f42-41dc-9fd1-e6f08b537588 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] 10.222.0.88 "GET /compute/v2.1/os-migrations" status: 200 len: 1179 microversion: 2.1 time: 0.020418 Jul 25 14:35:27.571408 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1359/2544] 10.222.0.88 () {58 vars in 1143 bytes} [Mon Jul 25 14:35:27 2022] GET /compute/v2.1/os-migrations => generated 1179 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:27.572107 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-601f347b-df83-4e26-918f-3395fca0ab5a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:27.572818 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-601f347b-df83-4e26-918f-3395fca0ab5a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9" status: 200 len: 1471 microversion: 2.1 time: 0.524391 Jul 25 14:35:27.573600 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1186/2545] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:27 2022] GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9 => generated 1471 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:27.583722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6d57098f-7b15-4a34-8622-4d32e2621fe5 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:27.585614 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6d57098f-7b15-4a34-8622-4d32e2621fe5 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:27.595158 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d57098f-7b15-4a34-8622-4d32e2621fe5 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:27.595566 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d57098f-7b15-4a34-8622-4d32e2621fe5 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:27.596375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d57098f-7b15-4a34-8622-4d32e2621fe5 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:27.597040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d57098f-7b15-4a34-8622-4d32e2621fe5 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:27.638815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2a684af0-cea1-447d-9473-6e80cfc2e888 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:27.640048 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2a684af0-cea1-447d-9473-6e80cfc2e888 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] [instance: 403f7d8b-1b82-47b3-803c-b96f87d6bc94] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:27.647251 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a684af0-cea1-447d-9473-6e80cfc2e888 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:27.648198 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a684af0-cea1-447d-9473-6e80cfc2e888 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:27.650528 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a684af0-cea1-447d-9473-6e80cfc2e888 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:27.651208 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a684af0-cea1-447d-9473-6e80cfc2e888 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:27.938882 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6d57098f-7b15-4a34-8622-4d32e2621fe5 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1861 microversion: 2.1 time: 0.363859 Jul 25 14:35:27.947237 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1360/2546] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:27 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1861 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:27.964991 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-529f8df7-f792-46ab-bf3f-cb81fd92d9a7 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:27.964991 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-529f8df7-f792-46ab-bf3f-cb81fd92d9a7 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:27.977089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-529f8df7-f792-46ab-bf3f-cb81fd92d9a7 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:27.977710 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-529f8df7-f792-46ab-bf3f-cb81fd92d9a7 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:27.978668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-529f8df7-f792-46ab-bf3f-cb81fd92d9a7 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:27.979196 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-529f8df7-f792-46ab-bf3f-cb81fd92d9a7 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:28.144336 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2a684af0-cea1-447d-9473-6e80cfc2e888 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122381b421894965a62d4ae5889db93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38f2493d8324858a50e5cd969c2692d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:28.154570 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2a684af0-cea1-447d-9473-6e80cfc2e888 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] 10.222.0.88 "GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94" status: 200 len: 1323 microversion: 2.1 time: 0.520779 Jul 25 14:35:28.168469 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1187/2547] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:27 2022] GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94 => generated 1323 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:35:28.219413 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-542894ac-3e2e-4181-93c1-2f9cfb166b00 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:28.221048 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-542894ac-3e2e-4181-93c1-2f9cfb166b00 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:28.237777 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-542894ac-3e2e-4181-93c1-2f9cfb166b00 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:28.238795 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-542894ac-3e2e-4181-93c1-2f9cfb166b00 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:28.240189 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-542894ac-3e2e-4181-93c1-2f9cfb166b00 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:28.241003 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-542894ac-3e2e-4181-93c1-2f9cfb166b00 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:28.255490 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-529f8df7-f792-46ab-bf3f-cb81fd92d9a7 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1861 microversion: 2.1 time: 0.287075 Jul 25 14:35:28.263262 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1361/2548] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:27 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1861 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:28.404885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f091a9e1-7849-43b0-bc79-a75dfb406272 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:28.405635 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f091a9e1-7849-43b0-bc79-a75dfb406272 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:28.415493 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f091a9e1-7849-43b0-bc79-a75dfb406272 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:28.420187 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f091a9e1-7849-43b0-bc79-a75dfb406272 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:28.421331 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f091a9e1-7849-43b0-bc79-a75dfb406272 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:28.421941 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f091a9e1-7849-43b0-bc79-a75dfb406272 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:28.624704 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-f091a9e1-7849-43b0-bc79-a75dfb406272 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lazy-loading 'services' on Instance uuid a85a57f0-715f-47cd-ae19-463dfc5e7aca {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:35:28.805727 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f091a9e1-7849-43b0-bc79-a75dfb406272 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca/os-volume_attachments/6f9913a7-ffc2-4c62-92c4-ef402ee3f024" status: 202 len: 0 microversion: 2.1 time: 0.415362 Jul 25 14:35:28.811913 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1362/2549] 10.222.0.88 () {58 vars in 1416 bytes} [Mon Jul 25 14:35:28 2022] DELETE /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca/os-volume_attachments/6f9913a7-ffc2-4c62-92c4-ef402ee3f024 => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:35:28.832123 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3f34dd00-be1f-43f5-94fb-d1de2ca37e96 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:28.833109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3f34dd00-be1f-43f5-94fb-d1de2ca37e96 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 1a97e112-b45b-4dcb-ad9f-e979e5c183d9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:28.853715 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f34dd00-be1f-43f5-94fb-d1de2ca37e96 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:28.856122 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f34dd00-be1f-43f5-94fb-d1de2ca37e96 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:28.857316 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f34dd00-be1f-43f5-94fb-d1de2ca37e96 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:28.857980 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f34dd00-be1f-43f5-94fb-d1de2ca37e96 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:29.246331 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3f34dd00-be1f-43f5-94fb-d1de2ca37e96 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:29.260196 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3f34dd00-be1f-43f5-94fb-d1de2ca37e96 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9" status: 200 len: 1471 microversion: 2.1 time: 0.444442 Jul 25 14:35:29.263891 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1363/2550] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:28 2022] GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9 => generated 1471 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:29.272327 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ee5b991c-2800-4d99-af20-5b40d9c003b0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:29.277765 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ee5b991c-2800-4d99-af20-5b40d9c003b0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:29.285417 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee5b991c-2800-4d99-af20-5b40d9c003b0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:29.286481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee5b991c-2800-4d99-af20-5b40d9c003b0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:29.288211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee5b991c-2800-4d99-af20-5b40d9c003b0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:29.288211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee5b991c-2800-4d99-af20-5b40d9c003b0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:29.326605 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ee5b991c-2800-4d99-af20-5b40d9c003b0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060471 Jul 25 14:35:29.331327 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1364/2551] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:35:29 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:35:29.333869 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b44cd3dc-8e4e-4e70-a3cc-510225b9bf22 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:29.335151 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b44cd3dc-8e4e-4e70-a3cc-510225b9bf22 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] [instance: 403f7d8b-1b82-47b3-803c-b96f87d6bc94] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:29.346214 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:35:29.349280 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b44cd3dc-8e4e-4e70-a3cc-510225b9bf22 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:29.352436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b44cd3dc-8e4e-4e70-a3cc-510225b9bf22 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:29.354120 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b44cd3dc-8e4e-4e70-a3cc-510225b9bf22 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:29.354120 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b44cd3dc-8e4e-4e70-a3cc-510225b9bf22 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:29.477605 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-542894ac-3e2e-4181-93c1-2f9cfb166b00 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:29.496250 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-542894ac-3e2e-4181-93c1-2f9cfb166b00 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1320 microversion: 2.1 time: 1.280032 Jul 25 14:35:29.501034 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1188/2552] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:28 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1320 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:35:29.618232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b44cd3dc-8e4e-4e70-a3cc-510225b9bf22 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122381b421894965a62d4ae5889db93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38f2493d8324858a50e5cd969c2692d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:29.628393 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b44cd3dc-8e4e-4e70-a3cc-510225b9bf22 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] 10.222.0.88 "GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94" status: 200 len: 1519 microversion: 2.1 time: 0.299611 Jul 25 14:35:29.632548 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1365/2553] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:29 2022] GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94 => generated 1519 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:29.675789 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b4619f0e-fbc9-4350-bed5-ac7f3c6c022f tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1389846594", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "fc051c6f-f5ba-4511-a32c-dead1227f233"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:29.808746 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-b4619f0e-fbc9-4350-bed5-ac7f3c6c022f tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] validate_networks() for [('fc051c6f-f5ba-4511-a32c-dead1227f233', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:35:29.897538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dee8ad65-1816-40d5-8e25-56d77564722f tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1241718398", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "f4ca8b5a-62cc-44dc-8c84-1131780c2c71"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dee8ad65-1816-40d5-8e25-56d77564722f tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Request method failure captured: Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 243 Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qociriWgxAAr7bHs82UUY7uI7_uoa1pMOlAQlrQwwa8zA8K_gRtTszvl0vlry8h560xU6fdiB0_TNan4sX25fdcquITiwxOaRdVISGEPOwSGdk4wjn80oE_hO1sf72hhPvZNxUMsdqjDPcTd2iuhFE1LzaXhCFRtRQzcR_63ERhjDI Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: d38f2493d8324858a50e5cd969c2692d Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-735693176 Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d38f2493d8324858a50e5cd969c2692d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d38f2493d8324858a50e5cd969c2692d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_d38f2493d8324858a50e5cd969c2692d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/d38f2493d8324858a50e5cd969c2692d"}]}] Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-735693176 Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: d38f2493d8324858a50e5cd969c2692d Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-735693176 Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerMetadataNegativeTestJSON-735693176-project Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 122381b421894965a62d4ae5889db93c Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-735693176-project Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1241718398", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "f4ca8b5a-62cc-44dc-8c84-1131780c2c71"}]}} Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1241718398', 'imageRef': 'a7b14aba-1848-4a00-a3e7-b66eb3e97925', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'f4ca8b5a-62cc-44dc-8c84-1131780c2c71'}]}}} Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:35:29.901996 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:35:29.906190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:35:29.906190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:35:29.906190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:35:29.906190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:35:29.906190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:35:29.906190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:35:29.906190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 14:35:29.906190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:29.906190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:29.906190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:29.906190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:29.906190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:29.906190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:29.906190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:35:29.906190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:35:29.906190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 14:35:29.906190 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:29.913071 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dee8ad65-1816-40d5-8e25-56d77564722f tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:35:29.913963 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dee8ad65-1816-40d5-8e25-56d77564722f tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.021058 Jul 25 14:35:29.914948 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1366/2554] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:35:29 2022] POST /compute/v2.1/servers => generated 175 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 14:35:29.929059 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-aaa0192c-b35a-41dd-bcdd-64b25906a6aa tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:29.929547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-aaa0192c-b35a-41dd-bcdd-64b25906a6aa tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] [instance: 840904fb-7c39-460e-b80c-7d238e721945] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:29.937099 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-aaa0192c-b35a-41dd-bcdd-64b25906a6aa tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] HTTP exception thrown: Instance 840904fb-7c39-460e-b80c-7d238e721945 could not be found. Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-aaa0192c-b35a-41dd-bcdd-64b25906a6aa tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Request method failure captured: Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/840904fb-7c39-460e-b80c-7d238e721945/metadata HTTP/1.1 Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qociriWgxAAr7bHs82UUY7uI7_uoa1pMOlAQlrQwwa8zA8K_gRtTszvl0vlry8h560xU6fdiB0_TNan4sX25fdcquITiwxOaRdVISGEPOwSGdk4wjn80oE_hO1sf72hhPvZNxUMsdqjDPcTd2iuhFE1LzaXhCFRtRQzcR_63ERhjDI Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: d38f2493d8324858a50e5cd969c2692d Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-735693176 Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d38f2493d8324858a50e5cd969c2692d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d38f2493d8324858a50e5cd969c2692d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_d38f2493d8324858a50e5cd969c2692d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/d38f2493d8324858a50e5cd969c2692d"}]}] Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-735693176 Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: d38f2493d8324858a50e5cd969c2692d Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-735693176 Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerMetadataNegativeTestJSON-735693176-project Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 122381b421894965a62d4ae5889db93c Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-735693176-project Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 840904fb-7c39-460e-b80c-7d238e721945 could not be found. Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'server_id': '840904fb-7c39-460e-b80c-7d238e721945'} Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 840904fb-7c39-460e-b80c-7d238e721945 could not be found. Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 840904fb-7c39-460e-b80c-7d238e721945 could not be found. Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:29.939165 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:29.942549 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:35:29.942549 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:35:29.942549 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 840904fb-7c39-460e-b80c-7d238e721945 could not be found. Jul 25 14:35:29.942549 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:29.948050 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-aaa0192c-b35a-41dd-bcdd-64b25906a6aa tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Returning 404 to user: Instance 840904fb-7c39-460e-b80c-7d238e721945 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:35:29.949281 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-aaa0192c-b35a-41dd-bcdd-64b25906a6aa tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] 10.222.0.88 "GET /compute/v2.1/servers/840904fb-7c39-460e-b80c-7d238e721945/metadata" status: 404 len: 111 microversion: 2.1 time: 0.024318 Jul 25 14:35:29.963096 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1367/2555] 10.222.0.88 () {58 vars in 1263 bytes} [Mon Jul 25 14:35:29 2022] GET /compute/v2.1/servers/840904fb-7c39-460e-b80c-7d238e721945/metadata => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:35:30.025849 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a896e3eb-9885-4833-8c33-dc12a4d30f64 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1321330375", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f4ca8b5a-62cc-44dc-8c84-1131780c2c71"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a896e3eb-9885-4833-8c33-dc12a4d30f64 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Request method failure captured: Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 499 Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qociriWgxAAr7bHs82UUY7uI7_uoa1pMOlAQlrQwwa8zA8K_gRtTszvl0vlry8h560xU6fdiB0_TNan4sX25fdcquITiwxOaRdVISGEPOwSGdk4wjn80oE_hO1sf72hhPvZNxUMsdqjDPcTd2iuhFE1LzaXhCFRtRQzcR_63ERhjDI Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: d38f2493d8324858a50e5cd969c2692d Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-735693176 Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d38f2493d8324858a50e5cd969c2692d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d38f2493d8324858a50e5cd969c2692d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_d38f2493d8324858a50e5cd969c2692d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/d38f2493d8324858a50e5cd969c2692d"}]}] Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-735693176 Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: d38f2493d8324858a50e5cd969c2692d Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-735693176 Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerMetadataNegativeTestJSON-735693176-project Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 122381b421894965a62d4ae5889db93c Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-735693176-project Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1321330375", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f4ca8b5a-62cc-44dc-8c84-1131780c2c71"}]}} Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1321330375', 'imageRef': 'a7b14aba-1848-4a00-a3e7-b66eb3e97925', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'f4ca8b5a-62cc-44dc-8c84-1131780c2c71'}]}}} Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 25 14:35:30.031690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 25 14:35:30.034380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.034380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 14:35:30.034380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 25 14:35:30.034380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.034380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:30.034380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.034380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:30.034380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:30.034380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:30.034380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:35:30.034380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:35:30.034380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:35:30.034380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:35:30.034380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:35:30.034380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:35:30.034380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:35:30.034380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:35:30.034380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:35:30.034380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:35:30.034380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:35:30.034380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:35:30.034380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 14:35:30.034380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.034380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:30.034380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.034380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:30.034380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:30.034380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:30.034380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:35:30.034380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:35:30.034380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 14:35:30.034380 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.041879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a896e3eb-9885-4833-8c33-dc12a4d30f64 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:35:30.043032 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a896e3eb-9885-4833-8c33-dc12a4d30f64 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.021358 Jul 25 14:35:30.043834 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1368/2556] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:35:30 2022] POST /compute/v2.1/servers => generated 687 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 14:35:30.124006 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a44bdeb6-713e-4f42-b046-e9b05b800cd8 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-974611408", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f4ca8b5a-62cc-44dc-8c84-1131780c2c71"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a44bdeb6-713e-4f42-b046-e9b05b800cd8 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Request method failure captured: Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 499 Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qociriWgxAAr7bHs82UUY7uI7_uoa1pMOlAQlrQwwa8zA8K_gRtTszvl0vlry8h560xU6fdiB0_TNan4sX25fdcquITiwxOaRdVISGEPOwSGdk4wjn80oE_hO1sf72hhPvZNxUMsdqjDPcTd2iuhFE1LzaXhCFRtRQzcR_63ERhjDI Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: d38f2493d8324858a50e5cd969c2692d Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-735693176 Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d38f2493d8324858a50e5cd969c2692d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d38f2493d8324858a50e5cd969c2692d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_d38f2493d8324858a50e5cd969c2692d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/d38f2493d8324858a50e5cd969c2692d"}]}] Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-735693176 Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: d38f2493d8324858a50e5cd969c2692d Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-735693176 Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerMetadataNegativeTestJSON-735693176-project Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 122381b421894965a62d4ae5889db93c Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-735693176-project Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-974611408", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f4ca8b5a-62cc-44dc-8c84-1131780c2c71"}]}} Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-974611408', 'imageRef': 'a7b14aba-1848-4a00-a3e7-b66eb3e97925', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'f4ca8b5a-62cc-44dc-8c84-1131780c2c71'}]}}} Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 25 14:35:30.130126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 14:35:30.132965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.136120 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a44bdeb6-713e-4f42-b046-e9b05b800cd8 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:35:30.137283 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a44bdeb6-713e-4f42-b046-e9b05b800cd8 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.015997 Jul 25 14:35:30.138308 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1369/2557] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:35:30 2022] POST /compute/v2.1/servers => generated 689 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 14:35:30.212626 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-18d6ff66-a221-446d-8e86-42fbf316b22e tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1066975131", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f4ca8b5a-62cc-44dc-8c84-1131780c2c71"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-18d6ff66-a221-446d-8e86-42fbf316b22e tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Request method failure captured: Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 754 Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qociriWgxAAr7bHs82UUY7uI7_uoa1pMOlAQlrQwwa8zA8K_gRtTszvl0vlry8h560xU6fdiB0_TNan4sX25fdcquITiwxOaRdVISGEPOwSGdk4wjn80oE_hO1sf72hhPvZNxUMsdqjDPcTd2iuhFE1LzaXhCFRtRQzcR_63ERhjDI Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: d38f2493d8324858a50e5cd969c2692d Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-735693176 Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d38f2493d8324858a50e5cd969c2692d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d38f2493d8324858a50e5cd969c2692d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_d38f2493d8324858a50e5cd969c2692d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/d38f2493d8324858a50e5cd969c2692d"}]}] Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-735693176 Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: d38f2493d8324858a50e5cd969c2692d Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-735693176 Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerMetadataNegativeTestJSON-735693176-project Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 122381b421894965a62d4ae5889db93c Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-735693176-project Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1066975131", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f4ca8b5a-62cc-44dc-8c84-1131780c2c71"}]}} Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1066975131', 'imageRef': 'a7b14aba-1848-4a00-a3e7-b66eb3e97925', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'f4ca8b5a-62cc-44dc-8c84-1131780c2c71'}]}}} Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:35:30.219754 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:35:30.223273 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:35:30.228755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 14:35:30.228755 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.230496 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-18d6ff66-a221-446d-8e86-42fbf316b22e tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:35:30.231569 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-18d6ff66-a221-446d-8e86-42fbf316b22e tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.024577 Jul 25 14:35:30.236082 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1370/2558] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:35:30 2022] POST /compute/v2.1/servers => generated 1197 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Jul 25 14:35:30.287528 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7807ec4b-d432-4bc2-bcf1-22617fd3bff4 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-953065512", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f4ca8b5a-62cc-44dc-8c84-1131780c2c71"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7807ec4b-d432-4bc2-bcf1-22617fd3bff4 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Request method failure captured: Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 1265 Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qociriWgxAAr7bHs82UUY7uI7_uoa1pMOlAQlrQwwa8zA8K_gRtTszvl0vlry8h560xU6fdiB0_TNan4sX25fdcquITiwxOaRdVISGEPOwSGdk4wjn80oE_hO1sf72hhPvZNxUMsdqjDPcTd2iuhFE1LzaXhCFRtRQzcR_63ERhjDI Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: d38f2493d8324858a50e5cd969c2692d Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-735693176 Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d38f2493d8324858a50e5cd969c2692d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d38f2493d8324858a50e5cd969c2692d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_d38f2493d8324858a50e5cd969c2692d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/d38f2493d8324858a50e5cd969c2692d"}]}] Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-735693176 Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: d38f2493d8324858a50e5cd969c2692d Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-735693176 Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerMetadataNegativeTestJSON-735693176-project Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 122381b421894965a62d4ae5889db93c Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-735693176-project Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-953065512", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f4ca8b5a-62cc-44dc-8c84-1131780c2c71"}]}} Jul 25 14:35:30.293749 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:35:30.295607 n-d-846435-14 devstack@n-api.service[119304]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 14:35:30.295607 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-953065512', 'imageRef': 'a7b14aba-1848-4a00-a3e7-b66eb3e97925', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'f4ca8b5a-62cc-44dc-8c84-1131780c2c71'}]}}} Jul 25 14:35:30.295607 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:35:30.295607 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:30.295607 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:35:30.295607 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:35:30.295607 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:35:30.295607 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:35:30.295607 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 14:35:30.295607 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.295607 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 25 14:35:30.295607 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 25 14:35:30.295607 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 25 14:35:30.295607 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 25 14:35:30.295607 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 25 14:35:30.295607 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.295607 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 14:35:30.298003 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 25 14:35:30.298003 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.298003 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:30.298003 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.298003 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:30.298003 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:30.298003 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:30.298003 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:35:30.298003 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:35:30.298003 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:35:30.298003 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:35:30.298003 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:35:30.298003 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:35:30.298003 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:35:30.298003 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:35:30.298003 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:35:30.298003 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:35:30.298003 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:35:30.298003 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:35:30.298003 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 14:35:30.298003 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.298003 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:30.298003 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.298003 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:30.298003 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:30.298003 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:30.298003 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:35:30.298003 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:35:30.299548 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 14:35:30.299548 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.299548 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7807ec4b-d432-4bc2-bcf1-22617fd3bff4 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:35:30.299548 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7807ec4b-d432-4bc2-bcf1-22617fd3bff4 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.013436 Jul 25 14:35:30.301419 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1371/2559] 10.222.0.88 () {60 vars in 1148 bytes} [Mon Jul 25 14:35:30 2022] POST /compute/v2.1/servers => generated 2221 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Jul 25 14:35:30.307901 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7bd5ae62-4be9-467d-8df6-e0b4bde9270e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:30.308851 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7bd5ae62-4be9-467d-8df6-e0b4bde9270e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 1a97e112-b45b-4dcb-ad9f-e979e5c183d9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:30.316244 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7bd5ae62-4be9-467d-8df6-e0b4bde9270e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:30.316995 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7bd5ae62-4be9-467d-8df6-e0b4bde9270e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:30.317977 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7bd5ae62-4be9-467d-8df6-e0b4bde9270e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:30.318606 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7bd5ae62-4be9-467d-8df6-e0b4bde9270e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:30.483047 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7bd5ae62-4be9-467d-8df6-e0b4bde9270e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:30.492458 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7bd5ae62-4be9-467d-8df6-e0b4bde9270e tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9" status: 200 len: 1471 microversion: 2.1 time: 0.189151 Jul 25 14:35:30.493884 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1372/2560] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:30 2022] GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9 => generated 1471 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:30.499175 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-41ee3ab6-b518-4438-9e83-781340c7e6f0 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:30.499815 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-41ee3ab6-b518-4438-9e83-781340c7e6f0 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] [instance: e3763d17-3454-431f-af9e-ff6b0c172036] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:30.506560 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-41ee3ab6-b518-4438-9e83-781340c7e6f0 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] HTTP exception thrown: Instance e3763d17-3454-431f-af9e-ff6b0c172036 could not be found. Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-41ee3ab6-b518-4438-9e83-781340c7e6f0 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Request method failure captured: Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/e3763d17-3454-431f-af9e-ff6b0c172036/metadata/test2 HTTP/1.1 Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qociriWgxAAr7bHs82UUY7uI7_uoa1pMOlAQlrQwwa8zA8K_gRtTszvl0vlry8h560xU6fdiB0_TNan4sX25fdcquITiwxOaRdVISGEPOwSGdk4wjn80oE_hO1sf72hhPvZNxUMsdqjDPcTd2iuhFE1LzaXhCFRtRQzcR_63ERhjDI Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: d38f2493d8324858a50e5cd969c2692d Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-735693176 Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d38f2493d8324858a50e5cd969c2692d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d38f2493d8324858a50e5cd969c2692d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_d38f2493d8324858a50e5cd969c2692d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/d38f2493d8324858a50e5cd969c2692d"}]}] Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-735693176 Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: d38f2493d8324858a50e5cd969c2692d Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-735693176 Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerMetadataNegativeTestJSON-735693176-project Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 122381b421894965a62d4ae5889db93c Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-735693176-project Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance e3763d17-3454-431f-af9e-ff6b0c172036 could not be found. Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'server_id': 'e3763d17-3454-431f-af9e-ff6b0c172036', 'id': 'test2'} Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3763d17-3454-431f-af9e-ff6b0c172036 could not be found. Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3763d17-3454-431f-af9e-ff6b0c172036 could not be found. Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:30.508426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:30.514478 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:35:30.514478 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:35:30.514478 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3763d17-3454-431f-af9e-ff6b0c172036 could not be found. Jul 25 14:35:30.514478 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:30.514478 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-41ee3ab6-b518-4438-9e83-781340c7e6f0 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Returning 404 to user: Instance e3763d17-3454-431f-af9e-ff6b0c172036 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:35:30.515433 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-41ee3ab6-b518-4438-9e83-781340c7e6f0 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] 10.222.0.88 "GET /compute/v2.1/servers/e3763d17-3454-431f-af9e-ff6b0c172036/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.019762 Jul 25 14:35:30.516108 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1373/2561] 10.222.0.88 () {58 vars in 1281 bytes} [Mon Jul 25 14:35:30 2022] GET /compute/v2.1/servers/e3763d17-3454-431f-af9e-ff6b0c172036/metadata/test2 => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:35:30.521173 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5083948a-d262-457f-87b1-24424209bb86 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:30.523546 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5083948a-d262-457f-87b1-24424209bb86 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:30.531459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5083948a-d262-457f-87b1-24424209bb86 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:30.532029 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5083948a-d262-457f-87b1-24424209bb86 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:30.532968 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5083948a-d262-457f-87b1-24424209bb86 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:30.533573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5083948a-d262-457f-87b1-24424209bb86 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:30.571932 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5083948a-d262-457f-87b1-24424209bb86 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054349 Jul 25 14:35:30.573884 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1374/2562] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:35:30 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:35:30.581879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2fce616d-fae2-4600-905c-c993420410bc tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:30.583414 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2fce616d-fae2-4600-905c-c993420410bc tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:30.593704 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2fce616d-fae2-4600-905c-c993420410bc tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:30.594662 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2fce616d-fae2-4600-905c-c993420410bc tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:30.595675 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2fce616d-fae2-4600-905c-c993420410bc tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:30.596354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2fce616d-fae2-4600-905c-c993420410bc tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:30.802672 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2fce616d-fae2-4600-905c-c993420410bc tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:30.813785 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2fce616d-fae2-4600-905c-c993420410bc tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1320 microversion: 2.1 time: 0.237899 Jul 25 14:35:30.814943 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1375/2563] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:30 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1320 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:30.837334 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9ff9928d-7cda-448f-a8c9-5c6fac8aea84 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:30.838049 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9ff9928d-7cda-448f-a8c9-5c6fac8aea84 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] [instance: 403f7d8b-1b82-47b3-803c-b96f87d6bc94] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:30.850949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ff9928d-7cda-448f-a8c9-5c6fac8aea84 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:30.851571 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ff9928d-7cda-448f-a8c9-5c6fac8aea84 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:30.852594 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ff9928d-7cda-448f-a8c9-5c6fac8aea84 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:30.853256 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ff9928d-7cda-448f-a8c9-5c6fac8aea84 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:30.892971 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9ff9928d-7cda-448f-a8c9-5c6fac8aea84 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] [instance: 403f7d8b-1b82-47b3-803c-b96f87d6bc94] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:35:30.896670 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:35:30.986282 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:35:31.006411 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9ff9928d-7cda-448f-a8c9-5c6fac8aea84 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] 10.222.0.88 "DELETE /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94" status: 204 len: 0 microversion: 2.1 time: 0.189923 Jul 25 14:35:31.007421 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1376/2564] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:35:30 2022] DELETE /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:35:31.018140 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f6f6244b-5624-4dad-bde0-d71e88b00c5c tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:31.020279 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f6f6244b-5624-4dad-bde0-d71e88b00c5c tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] [instance: 403f7d8b-1b82-47b3-803c-b96f87d6bc94] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:31.028147 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6f6244b-5624-4dad-bde0-d71e88b00c5c tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:31.028599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6f6244b-5624-4dad-bde0-d71e88b00c5c tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:31.029407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6f6244b-5624-4dad-bde0-d71e88b00c5c tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:31.030025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6f6244b-5624-4dad-bde0-d71e88b00c5c tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:31.226510 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f6f6244b-5624-4dad-bde0-d71e88b00c5c tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122381b421894965a62d4ae5889db93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38f2493d8324858a50e5cd969c2692d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:31.239226 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f6f6244b-5624-4dad-bde0-d71e88b00c5c tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] 10.222.0.88 "GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94" status: 200 len: 1525 microversion: 2.1 time: 0.225175 Jul 25 14:35:31.241100 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1377/2565] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:31 2022] GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94 => generated 1525 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:35:31.252133 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-8d1f99c0-f809-4e1e-b617-8ce680ac97a3 req-2350204b-e54a-46cf-9de0-48154c80bf2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d3dd486-7c28-4d5a-a177-3f14739f3abc", "tag": "7ffa8887-a294-4e02-abb3-6f1ef72307ba"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:31.267539 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-8d1f99c0-f809-4e1e-b617-8ce680ac97a3 req-2350204b-e54a-46cf-9de0-48154c80bf2a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:31.268298 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-8d1f99c0-f809-4e1e-b617-8ce680ac97a3 req-2350204b-e54a-46cf-9de0-48154c80bf2a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:31.286479 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-8d1f99c0-f809-4e1e-b617-8ce680ac97a3 req-2350204b-e54a-46cf-9de0-48154c80bf2a service nova] Creating event network-changed:7ffa8887-a294-4e02-abb3-6f1ef72307ba for instance 9d3dd486-7c28-4d5a-a177-3f14739f3abc on n-h1-846435-14 Jul 25 14:35:31.293275 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-8d1f99c0-f809-4e1e-b617-8ce680ac97a3 req-2350204b-e54a-46cf-9de0-48154c80bf2a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050351 Jul 25 14:35:31.295939 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1378/2566] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:35:31.440178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=18 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:35:31.524192 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7a60ae3c-526c-4a22-9222-1e8b8ac37303 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:31.525169 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7a60ae3c-526c-4a22-9222-1e8b8ac37303 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 1a97e112-b45b-4dcb-ad9f-e979e5c183d9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:31.546284 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a60ae3c-526c-4a22-9222-1e8b8ac37303 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:31.546743 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a60ae3c-526c-4a22-9222-1e8b8ac37303 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:31.551074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a60ae3c-526c-4a22-9222-1e8b8ac37303 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:31.553291 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a60ae3c-526c-4a22-9222-1e8b8ac37303 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:31.739343 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7a60ae3c-526c-4a22-9222-1e8b8ac37303 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef351be3886949f9985b3244301435a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60b88c2aea642658a5bfc14780d5d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:31.749639 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7a60ae3c-526c-4a22-9222-1e8b8ac37303 tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9" status: 200 len: 1429 microversion: 2.1 time: 0.233551 Jul 25 14:35:31.751367 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1379/2567] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:31 2022] GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9 => generated 1429 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:31.769242 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-10b3933c-07c4-483d-be27-f1d9dbe89512 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:31.773231 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-10b3933c-07c4-483d-be27-f1d9dbe89512 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:31.794197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-10b3933c-07c4-483d-be27-f1d9dbe89512 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:31.794873 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-10b3933c-07c4-483d-be27-f1d9dbe89512 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:31.795804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-10b3933c-07c4-483d-be27-f1d9dbe89512 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:31.796394 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-10b3933c-07c4-483d-be27-f1d9dbe89512 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:31.846996 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-b4619f0e-fbc9-4350-bed5-ac7f3c6c022f tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:35:31.847428 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-b4619f0e-fbc9-4350-bed5-ac7f3c6c022f tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:35:31.848442 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-b4619f0e-fbc9-4350-bed5-ac7f3c6c022f tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:35:31.848877 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-b4619f0e-fbc9-4350-bed5-ac7f3c6c022f tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:35:31.849451 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-b4619f0e-fbc9-4350-bed5-ac7f3c6c022f tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:35:31.896457 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b4619f0e-fbc9-4350-bed5-ac7f3c6c022f tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:31.896925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b4619f0e-fbc9-4350-bed5-ac7f3c6c022f tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:31.903223 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b4619f0e-fbc9-4350-bed5-ac7f3c6c022f tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:31.907076 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b4619f0e-fbc9-4350-bed5-ac7f3c6c022f tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:31.938838 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-10b3933c-07c4-483d-be27-f1d9dbe89512 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185559 Jul 25 14:35:31.940287 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1380/2568] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:35:31 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:35:31.953554 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6f406de4-41aa-4423-ae25-de0b6a7d7e25 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:31.954198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6f406de4-41aa-4423-ae25-de0b6a7d7e25 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:31.991293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-b4619f0e-fbc9-4350-bed5-ac7f3c6c022f tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Getting quotas for project 1ec3e66f4339488faf93e315c7487b7e. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:35:32.010404 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-b4619f0e-fbc9-4350-bed5-ac7f3c6c022f tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Getting quotas for user d90f681305bd4ff380c82f1693613b31 and project 1ec3e66f4339488faf93e315c7487b7e. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:35:32.012775 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f406de4-41aa-4423-ae25-de0b6a7d7e25 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:32.013451 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f406de4-41aa-4423-ae25-de0b6a7d7e25 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:32.020860 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f406de4-41aa-4423-ae25-de0b6a7d7e25 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:32.022380 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f406de4-41aa-4423-ae25-de0b6a7d7e25 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:32.041530 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b4619f0e-fbc9-4350-bed5-ac7f3c6c022f tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:35:32.046607 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b4619f0e-fbc9-4350-bed5-ac7f3c6c022f tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] [instance: 04d99b67-7c1b-4876-a928-e6fa09ec817b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:35:32.229638 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b4619f0e-fbc9-4350-bed5-ac7f3c6c022f tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.693183 Jul 25 14:35:32.235348 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1189/2569] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:35:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:35:32.260683 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1ee54dc0-541e-4e2e-9e89-b206f59036fa tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:32.269640 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1ee54dc0-541e-4e2e-9e89-b206f59036fa tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] [instance: 04d99b67-7c1b-4876-a928-e6fa09ec817b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:32.662345 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1ee54dc0-541e-4e2e-9e89-b206f59036fa tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90f681305bd4ff380c82f1693613b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec3e66f4339488faf93e315c7487b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:32.683501 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1ee54dc0-541e-4e2e-9e89-b206f59036fa tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] 10.222.0.88 "GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b" status: 200 len: 1225 microversion: 2.1 time: 0.439800 Jul 25 14:35:32.684188 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1190/2570] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:32 2022] GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b => generated 1225 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:35:32.699092 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-90f08dc0-666c-4f27-93e7-e54af57e5158 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:32.699738 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-90f08dc0-666c-4f27-93e7-e54af57e5158 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] [instance: 403f7d8b-1b82-47b3-803c-b96f87d6bc94] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:32.720666 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-90f08dc0-666c-4f27-93e7-e54af57e5158 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:32.721117 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-90f08dc0-666c-4f27-93e7-e54af57e5158 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:32.732489 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-90f08dc0-666c-4f27-93e7-e54af57e5158 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:32.733574 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-90f08dc0-666c-4f27-93e7-e54af57e5158 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:32.769777 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6f406de4-41aa-4423-ae25-de0b6a7d7e25 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:32.782312 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6f406de4-41aa-4423-ae25-de0b6a7d7e25 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1320 microversion: 2.1 time: 0.837967 Jul 25 14:35:32.795825 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1381/2571] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:31 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1320 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:32.795825 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3f720ce9-d82d-40d8-923e-ffbe4a92709a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:32.795825 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3f720ce9-d82d-40d8-923e-ffbe4a92709a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] [instance: 1a97e112-b45b-4dcb-ad9f-e979e5c183d9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:32.856814 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f720ce9-d82d-40d8-923e-ffbe4a92709a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:32.874656 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f720ce9-d82d-40d8-923e-ffbe4a92709a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:32.877074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f720ce9-d82d-40d8-923e-ffbe4a92709a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:32.878727 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f720ce9-d82d-40d8-923e-ffbe4a92709a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:32.927676 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-3f720ce9-d82d-40d8-923e-ffbe4a92709a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] HTTP exception thrown: Instance 1a97e112-b45b-4dcb-ad9f-e979e5c183d9 could not be found. Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3f720ce9-d82d-40d8-923e-ffbe4a92709a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Request method failure captured: Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9 HTTP/1.1 Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qlv3rUVhKaGUoIKKGCuOMD0I6MIoDHjqjO5RyR6Pj_BNVDpq--kNeH85TVlPgBPT3niD-JaccAzA0CF2Z_lYSTDSSqak2SKY3MirR2urYA-2v4fgO5i4-3PmjSM_AwPL5Le0cUs5lB3O6LfBXz1C0XPouGEhH0PZroAvYlxtcrUeto Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: e60b88c2aea642658a5bfc14780d5d51 Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersOnMultiNodesTest-1245955740 Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e60b88c2aea642658a5bfc14780d5d51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e60b88c2aea642658a5bfc14780d5d51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e60b88c2aea642658a5bfc14780d5d51", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e60b88c2aea642658a5bfc14780d5d51"}]}] Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersOnMultiNodesTest-1245955740 Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: e60b88c2aea642658a5bfc14780d5d51 Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1245955740 Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersOnMultiNodesTest-1245955740-project Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: ef351be3886949f9985b3244301435a9 Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersOnMultiNodesTest-1245955740-project Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 1a97e112-b45b-4dcb-ad9f-e979e5c183d9 could not be found. Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '1a97e112-b45b-4dcb-ad9f-e979e5c183d9'} Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a97e112-b45b-4dcb-ad9f-e979e5c183d9 could not be found. Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a97e112-b45b-4dcb-ad9f-e979e5c183d9 could not be found. Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:32.934821 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:32.939320 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:32.939320 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:32.939320 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:32.939320 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:35:32.939320 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:35:32.939320 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a97e112-b45b-4dcb-ad9f-e979e5c183d9 could not be found. Jul 25 14:35:32.939320 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:32.940663 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3f720ce9-d82d-40d8-923e-ffbe4a92709a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] Returning 404 to user: Instance 1a97e112-b45b-4dcb-ad9f-e979e5c183d9 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:35:32.941926 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3f720ce9-d82d-40d8-923e-ffbe4a92709a tempest-ServersOnMultiNodesTest-1245955740 tempest-ServersOnMultiNodesTest-1245955740-project] 10.222.0.88 "GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9" status: 404 len: 111 microversion: 2.1 time: 0.157602 Jul 25 14:35:32.943259 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1382/2572] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:32 2022] GET /compute/v2.1/servers/1a97e112-b45b-4dcb-ad9f-e979e5c183d9 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:35:32.955941 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-087a32fe-2617-4044-b0b9-7c843b129ce6 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:32.958254 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-087a32fe-2617-4044-b0b9-7c843b129ce6 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:32.982302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-087a32fe-2617-4044-b0b9-7c843b129ce6 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:32.984336 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-087a32fe-2617-4044-b0b9-7c843b129ce6 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:32.987507 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-087a32fe-2617-4044-b0b9-7c843b129ce6 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:32.990277 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-087a32fe-2617-4044-b0b9-7c843b129ce6 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:33.068750 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-087a32fe-2617-4044-b0b9-7c843b129ce6 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121338 Jul 25 14:35:33.070292 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1383/2573] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:35:32 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:35:33.373095 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-90f08dc0-666c-4f27-93e7-e54af57e5158 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122381b421894965a62d4ae5889db93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38f2493d8324858a50e5cd969c2692d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:33.386631 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-90f08dc0-666c-4f27-93e7-e54af57e5158 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] 10.222.0.88 "GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94" status: 200 len: 1525 microversion: 2.1 time: 0.701309 Jul 25 14:35:33.406778 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1191/2574] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:32 2022] GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94 => generated 1525 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:33.455284 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-fa9be400-7719-4073-88cf-3aa574f3d90f req-7a7562d4-3612-4419-bbe2-036799a9e53e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a97e112-b45b-4dcb-ad9f-e979e5c183d9", "name": "network-vif-deleted", "tag": "cab2f4ca-b8c8-4ec9-ae12-c233d24b429f"}, {"name": "network-changed", "server_uuid": "5aa9ee0e-2d03-42a5-af94-51275e754256", "tag": "668fe7f1-2c75-49ac-8a6c-9a1ca635424e"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:33.507191 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-fa9be400-7719-4073-88cf-3aa574f3d90f req-7a7562d4-3612-4419-bbe2-036799a9e53e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:33.507650 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-fa9be400-7719-4073-88cf-3aa574f3d90f req-7a7562d4-3612-4419-bbe2-036799a9e53e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:33.571381 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-fa9be400-7719-4073-88cf-3aa574f3d90f req-7a7562d4-3612-4419-bbe2-036799a9e53e service nova] Creating event network-vif-deleted:cab2f4ca-b8c8-4ec9-ae12-c233d24b429f for instance 1a97e112-b45b-4dcb-ad9f-e979e5c183d9 on n-h2-846435-14 Jul 25 14:35:33.572375 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-fa9be400-7719-4073-88cf-3aa574f3d90f req-7a7562d4-3612-4419-bbe2-036799a9e53e service nova] Creating event network-changed:668fe7f1-2c75-49ac-8a6c-9a1ca635424e for instance 5aa9ee0e-2d03-42a5-af94-51275e754256 on n-h2-846435-14 Jul 25 14:35:33.581625 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-fa9be400-7719-4073-88cf-3aa574f3d90f req-7a7562d4-3612-4419-bbe2-036799a9e53e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.131802 Jul 25 14:35:33.583008 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1384/2575] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:35:33.704918 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b73f818c-74a9-469d-8351-f9bbdf0ba631 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:33.705461 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b73f818c-74a9-469d-8351-f9bbdf0ba631 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] [instance: 04d99b67-7c1b-4876-a928-e6fa09ec817b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:33.720726 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b73f818c-74a9-469d-8351-f9bbdf0ba631 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:33.721180 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b73f818c-74a9-469d-8351-f9bbdf0ba631 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:33.721977 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b73f818c-74a9-469d-8351-f9bbdf0ba631 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:33.731929 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b73f818c-74a9-469d-8351-f9bbdf0ba631 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:33.805273 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-67d4b751-06bc-4360-bedc-bd647ee9d6f7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:33.807617 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-67d4b751-06bc-4360-bedc-bd647ee9d6f7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:33.857377 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-67d4b751-06bc-4360-bedc-bd647ee9d6f7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:33.861837 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-67d4b751-06bc-4360-bedc-bd647ee9d6f7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:33.865857 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-67d4b751-06bc-4360-bedc-bd647ee9d6f7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:33.867673 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-67d4b751-06bc-4360-bedc-bd647ee9d6f7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:33.962570 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b73f818c-74a9-469d-8351-f9bbdf0ba631 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90f681305bd4ff380c82f1693613b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec3e66f4339488faf93e315c7487b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:33.973901 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b73f818c-74a9-469d-8351-f9bbdf0ba631 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] 10.222.0.88 "GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b" status: 200 len: 1221 microversion: 2.1 time: 0.273667 Jul 25 14:35:33.996281 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1192/2576] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:33 2022] GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b => generated 1221 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:34.087458 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-04df0c6a-3373-4de4-8e30-11c38b6fd692 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:34.089883 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-04df0c6a-3373-4de4-8e30-11c38b6fd692 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:34.102708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-04df0c6a-3373-4de4-8e30-11c38b6fd692 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:34.109453 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-04df0c6a-3373-4de4-8e30-11c38b6fd692 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:34.110632 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-04df0c6a-3373-4de4-8e30-11c38b6fd692 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:34.111102 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-04df0c6a-3373-4de4-8e30-11c38b6fd692 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:34.239217 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-04df0c6a-3373-4de4-8e30-11c38b6fd692 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161415 Jul 25 14:35:34.248488 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1193/2577] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:35:34 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:35:34.426821 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d5fa9751-9f1e-473d-b57b-e422a30b261f tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:34.427487 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d5fa9751-9f1e-473d-b57b-e422a30b261f tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] [instance: 403f7d8b-1b82-47b3-803c-b96f87d6bc94] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:34.448651 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d5fa9751-9f1e-473d-b57b-e422a30b261f tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:34.454053 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d5fa9751-9f1e-473d-b57b-e422a30b261f tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:34.455149 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d5fa9751-9f1e-473d-b57b-e422a30b261f tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:34.455766 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d5fa9751-9f1e-473d-b57b-e422a30b261f tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:34.929086 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-67d4b751-06bc-4360-bedc-bd647ee9d6f7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:34.938396 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-67d4b751-06bc-4360-bedc-bd647ee9d6f7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1320 microversion: 2.1 time: 1.138456 Jul 25 14:35:34.945090 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1385/2578] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:33 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1320 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:35.002997 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-45050552-4699-484c-8f2e-92e5aea6b015 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:35.003937 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-45050552-4699-484c-8f2e-92e5aea6b015 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] [instance: 04d99b67-7c1b-4876-a928-e6fa09ec817b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:35.011593 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45050552-4699-484c-8f2e-92e5aea6b015 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:35.018230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45050552-4699-484c-8f2e-92e5aea6b015 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:35.019304 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45050552-4699-484c-8f2e-92e5aea6b015 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:35.019907 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45050552-4699-484c-8f2e-92e5aea6b015 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:35.193975 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d5fa9751-9f1e-473d-b57b-e422a30b261f tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122381b421894965a62d4ae5889db93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38f2493d8324858a50e5cd969c2692d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:35.206303 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d5fa9751-9f1e-473d-b57b-e422a30b261f tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] 10.222.0.88 "GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94" status: 200 len: 1525 microversion: 2.1 time: 0.784167 Jul 25 14:35:35.209322 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1194/2579] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:34 2022] GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94 => generated 1525 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:35.256395 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1b1dd1cf-f6f3-44fb-aa55-385262b2c58b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:35.259139 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1b1dd1cf-f6f3-44fb-aa55-385262b2c58b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:35.277033 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1b1dd1cf-f6f3-44fb-aa55-385262b2c58b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:35.279131 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1b1dd1cf-f6f3-44fb-aa55-385262b2c58b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:35.281117 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1b1dd1cf-f6f3-44fb-aa55-385262b2c58b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:35.287125 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1b1dd1cf-f6f3-44fb-aa55-385262b2c58b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:35.367209 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1b1dd1cf-f6f3-44fb-aa55-385262b2c58b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114187 Jul 25 14:35:35.370053 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1195/2580] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:35:35 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:35:35.459794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-b6afcc17-63b4-4a80-9503-1309b892b24a req-2c0b2593-de3a-43f5-a30d-11408e0026d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403f7d8b-1b82-47b3-803c-b96f87d6bc94", "name": "network-vif-deleted", "tag": "3ad6cea3-958a-4bbf-8fef-f1da6ebdf9d9"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:35.475304 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-45050552-4699-484c-8f2e-92e5aea6b015 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90f681305bd4ff380c82f1693613b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec3e66f4339488faf93e315c7487b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:35.483447 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b6afcc17-63b4-4a80-9503-1309b892b24a req-2c0b2593-de3a-43f5-a30d-11408e0026d9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:35.484384 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b6afcc17-63b4-4a80-9503-1309b892b24a req-2c0b2593-de3a-43f5-a30d-11408e0026d9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:35.489606 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-45050552-4699-484c-8f2e-92e5aea6b015 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] 10.222.0.88 "GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b" status: 200 len: 1283 microversion: 2.1 time: 0.490584 Jul 25 14:35:35.504545 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1386/2581] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:34 2022] GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b => generated 1283 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:35:35.517557 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-b6afcc17-63b4-4a80-9503-1309b892b24a req-2c0b2593-de3a-43f5-a30d-11408e0026d9 service nova] Creating event network-vif-deleted:3ad6cea3-958a-4bbf-8fef-f1da6ebdf9d9 for instance 403f7d8b-1b82-47b3-803c-b96f87d6bc94 on n-h1-846435-14 Jul 25 14:35:35.531410 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-b6afcc17-63b4-4a80-9503-1309b892b24a req-2c0b2593-de3a-43f5-a30d-11408e0026d9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075474 Jul 25 14:35:35.533833 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1196/2582] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:35:35.968196 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dae3510a-d92f-4e2d-a1b7-c778017592fd tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:35.968824 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dae3510a-d92f-4e2d-a1b7-c778017592fd tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:35.979148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dae3510a-d92f-4e2d-a1b7-c778017592fd tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:35.979858 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dae3510a-d92f-4e2d-a1b7-c778017592fd tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:35.980999 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dae3510a-d92f-4e2d-a1b7-c778017592fd tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:35.981591 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dae3510a-d92f-4e2d-a1b7-c778017592fd tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:36.237394 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2f9532c7-e3e8-4737-8c3d-d190e2703759 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:36.238512 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2f9532c7-e3e8-4737-8c3d-d190e2703759 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] [instance: 403f7d8b-1b82-47b3-803c-b96f87d6bc94] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:36.263726 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f9532c7-e3e8-4737-8c3d-d190e2703759 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:36.263827 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f9532c7-e3e8-4737-8c3d-d190e2703759 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:36.267727 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f9532c7-e3e8-4737-8c3d-d190e2703759 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:36.269796 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f9532c7-e3e8-4737-8c3d-d190e2703759 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:36.310420 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-2f9532c7-e3e8-4737-8c3d-d190e2703759 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] HTTP exception thrown: Instance 403f7d8b-1b82-47b3-803c-b96f87d6bc94 could not be found. Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2f9532c7-e3e8-4737-8c3d-d190e2703759 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Request method failure captured: Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94 HTTP/1.1 Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qociriWgxAAr7bHs82UUY7uI7_uoa1pMOlAQlrQwwa8zA8K_gRtTszvl0vlry8h560xU6fdiB0_TNan4sX25fdcquITiwxOaRdVISGEPOwSGdk4wjn80oE_hO1sf72hhPvZNxUMsdqjDPcTd2iuhFE1LzaXhCFRtRQzcR_63ERhjDI Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: d38f2493d8324858a50e5cd969c2692d Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-735693176 Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d38f2493d8324858a50e5cd969c2692d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d38f2493d8324858a50e5cd969c2692d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_d38f2493d8324858a50e5cd969c2692d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/d38f2493d8324858a50e5cd969c2692d"}]}] Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-735693176 Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: d38f2493d8324858a50e5cd969c2692d Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-735693176 Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServerMetadataNegativeTestJSON-735693176-project Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 122381b421894965a62d4ae5889db93c Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-735693176-project Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 403f7d8b-1b82-47b3-803c-b96f87d6bc94 could not be found. Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '403f7d8b-1b82-47b3-803c-b96f87d6bc94'} Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 403f7d8b-1b82-47b3-803c-b96f87d6bc94 could not be found. Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 403f7d8b-1b82-47b3-803c-b96f87d6bc94 could not be found. Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:36.314372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:36.318678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:36.318678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:36.318678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:36.318678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:36.318678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:35:36.318678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:35:36.318678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 403f7d8b-1b82-47b3-803c-b96f87d6bc94 could not be found. Jul 25 14:35:36.318678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:36.318678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2f9532c7-e3e8-4737-8c3d-d190e2703759 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] Returning 404 to user: Instance 403f7d8b-1b82-47b3-803c-b96f87d6bc94 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:35:36.318678 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2f9532c7-e3e8-4737-8c3d-d190e2703759 tempest-ServerMetadataNegativeTestJSON-735693176 tempest-ServerMetadataNegativeTestJSON-735693176-project] 10.222.0.88 "GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94" status: 404 len: 111 microversion: 2.1 time: 0.085314 Jul 25 14:35:36.323493 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1197/2583] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:36 2022] GET /compute/v2.1/servers/403f7d8b-1b82-47b3-803c-b96f87d6bc94 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:35:36.348757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dae3510a-d92f-4e2d-a1b7-c778017592fd tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:36.360711 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dae3510a-d92f-4e2d-a1b7-c778017592fd tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1320 microversion: 2.1 time: 0.397130 Jul 25 14:35:36.385739 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-627324b2-05cb-4a21-befa-c85075eeb136 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:36.388522 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-627324b2-05cb-4a21-befa-c85075eeb136 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:36.390174 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1387/2584] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:35 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1320 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:36.403768 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-627324b2-05cb-4a21-befa-c85075eeb136 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:36.405269 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-627324b2-05cb-4a21-befa-c85075eeb136 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:36.406897 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-627324b2-05cb-4a21-befa-c85075eeb136 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:36.407501 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-627324b2-05cb-4a21-befa-c85075eeb136 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:36.466370 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-627324b2-05cb-4a21-befa-c85075eeb136 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090400 Jul 25 14:35:36.468465 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1198/2585] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:35:36 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:35:36.517598 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1d4707b9-f978-4cb2-b2aa-cdd7abb92887 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:36.518448 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1d4707b9-f978-4cb2-b2aa-cdd7abb92887 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] [instance: 04d99b67-7c1b-4876-a928-e6fa09ec817b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:36.542788 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1d4707b9-f978-4cb2-b2aa-cdd7abb92887 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:36.544822 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1d4707b9-f978-4cb2-b2aa-cdd7abb92887 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:36.547687 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1d4707b9-f978-4cb2-b2aa-cdd7abb92887 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:36.548477 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1d4707b9-f978-4cb2-b2aa-cdd7abb92887 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:37.013881 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1d4707b9-f978-4cb2-b2aa-cdd7abb92887 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90f681305bd4ff380c82f1693613b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec3e66f4339488faf93e315c7487b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:37.028838 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1d4707b9-f978-4cb2-b2aa-cdd7abb92887 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] 10.222.0.88 "GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b" status: 200 len: 1325 microversion: 2.1 time: 0.517921 Jul 25 14:35:37.036697 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1388/2586] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:36 2022] GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b => generated 1325 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:37.390574 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cba563a2-48d2-4791-9a27-1653ebdcb7a9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:37.391478 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cba563a2-48d2-4791-9a27-1653ebdcb7a9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:37.400025 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cba563a2-48d2-4791-9a27-1653ebdcb7a9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:37.408257 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cba563a2-48d2-4791-9a27-1653ebdcb7a9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:37.409479 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cba563a2-48d2-4791-9a27-1653ebdcb7a9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:37.410088 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cba563a2-48d2-4791-9a27-1653ebdcb7a9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:37.479352 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e3ce48da-7e58-451f-bfbe-45bb770bba8f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:37.482221 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e3ce48da-7e58-451f-bfbe-45bb770bba8f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:37.498676 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3ce48da-7e58-451f-bfbe-45bb770bba8f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:37.505880 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3ce48da-7e58-451f-bfbe-45bb770bba8f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:37.507205 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3ce48da-7e58-451f-bfbe-45bb770bba8f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:37.509436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3ce48da-7e58-451f-bfbe-45bb770bba8f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:37.582131 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e3ce48da-7e58-451f-bfbe-45bb770bba8f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107095 Jul 25 14:35:37.585349 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1389/2587] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:35:37 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:35:38.061335 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1665f50a-0eeb-4036-a113-d2b7c5956ae3 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:38.062407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1665f50a-0eeb-4036-a113-d2b7c5956ae3 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] [instance: 04d99b67-7c1b-4876-a928-e6fa09ec817b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:38.069712 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1665f50a-0eeb-4036-a113-d2b7c5956ae3 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:38.079088 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1665f50a-0eeb-4036-a113-d2b7c5956ae3 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:38.080669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1665f50a-0eeb-4036-a113-d2b7c5956ae3 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:38.082583 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1665f50a-0eeb-4036-a113-d2b7c5956ae3 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:38.608055 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1665f50a-0eeb-4036-a113-d2b7c5956ae3 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90f681305bd4ff380c82f1693613b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec3e66f4339488faf93e315c7487b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:38.624936 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1665f50a-0eeb-4036-a113-d2b7c5956ae3 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] 10.222.0.88 "GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b" status: 200 len: 1325 microversion: 2.1 time: 0.567245 Jul 25 14:35:38.638957 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1390/2588] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:38 2022] GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b => generated 1325 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:35:38.645003 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-83e976dc-0ab3-4c2a-99f4-e1e49a10e781 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:38.648053 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-83e976dc-0ab3-4c2a-99f4-e1e49a10e781 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:38.655026 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83e976dc-0ab3-4c2a-99f4-e1e49a10e781 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:38.655544 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83e976dc-0ab3-4c2a-99f4-e1e49a10e781 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:38.656417 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83e976dc-0ab3-4c2a-99f4-e1e49a10e781 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:38.657394 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83e976dc-0ab3-4c2a-99f4-e1e49a10e781 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:38.697236 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-83e976dc-0ab3-4c2a-99f4-e1e49a10e781 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056964 Jul 25 14:35:38.698320 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1391/2589] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:35:38 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:35:38.871247 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cba563a2-48d2-4791-9a27-1653ebdcb7a9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:38.886252 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cba563a2-48d2-4791-9a27-1653ebdcb7a9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1320 microversion: 2.1 time: 1.502166 Jul 25 14:35:38.887186 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1199/2590] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:37 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1320 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:39.647536 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-754a461c-0d31-4aa4-805b-7baf03a40260 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:39.648387 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-754a461c-0d31-4aa4-805b-7baf03a40260 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] [instance: 04d99b67-7c1b-4876-a928-e6fa09ec817b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:39.684652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-754a461c-0d31-4aa4-805b-7baf03a40260 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:39.685904 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-754a461c-0d31-4aa4-805b-7baf03a40260 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:39.686991 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-754a461c-0d31-4aa4-805b-7baf03a40260 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:39.687658 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-754a461c-0d31-4aa4-805b-7baf03a40260 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:39.915216 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-402aea47-867f-4ef0-a251-6659960942ac tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:39.919505 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-402aea47-867f-4ef0-a251-6659960942ac tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:39.922545 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:35:39.958648 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-402aea47-867f-4ef0-a251-6659960942ac tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:39.961371 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-402aea47-867f-4ef0-a251-6659960942ac tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:39.962792 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-402aea47-867f-4ef0-a251-6659960942ac tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:39.966245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-402aea47-867f-4ef0-a251-6659960942ac tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:40.282079 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-754a461c-0d31-4aa4-805b-7baf03a40260 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90f681305bd4ff380c82f1693613b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec3e66f4339488faf93e315c7487b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:40.292047 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-754a461c-0d31-4aa4-805b-7baf03a40260 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] 10.222.0.88 "GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b" status: 200 len: 1325 microversion: 2.1 time: 0.649695 Jul 25 14:35:40.296289 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1392/2591] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:39 2022] GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b => generated 1325 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:40.383943 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-402aea47-867f-4ef0-a251-6659960942ac tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:40.394025 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-402aea47-867f-4ef0-a251-6659960942ac tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1320 microversion: 2.1 time: 0.488140 Jul 25 14:35:40.401011 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1200/2592] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:39 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1320 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:40.419173 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-4085033d-5de9-4493-ac18-ae71e0cc671e req-b7a546ee-c139-40d9-842c-aadf9b053c57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04d99b67-7c1b-4876-a928-e6fa09ec817b", "tag": "eb49678c-f1bd-4258-8260-6851c3b13615"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:40.439687 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-4085033d-5de9-4493-ac18-ae71e0cc671e req-b7a546ee-c139-40d9-842c-aadf9b053c57 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:40.445239 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-4085033d-5de9-4493-ac18-ae71e0cc671e req-b7a546ee-c139-40d9-842c-aadf9b053c57 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:40.474812 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-4085033d-5de9-4493-ac18-ae71e0cc671e req-b7a546ee-c139-40d9-842c-aadf9b053c57 service nova] Creating event network-changed:eb49678c-f1bd-4258-8260-6851c3b13615 for instance 04d99b67-7c1b-4876-a928-e6fa09ec817b on n-h2-846435-14 Jul 25 14:35:40.490745 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-4085033d-5de9-4493-ac18-ae71e0cc671e req-b7a546ee-c139-40d9-842c-aadf9b053c57 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075406 Jul 25 14:35:40.492152 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1393/2593] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:35:41.316013 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-90d52db5-f6e8-4afe-a231-af52cfdc1efb tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:41.318028 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-90d52db5-f6e8-4afe-a231-af52cfdc1efb tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] [instance: 04d99b67-7c1b-4876-a928-e6fa09ec817b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:41.334110 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-90d52db5-f6e8-4afe-a231-af52cfdc1efb tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:41.335573 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-90d52db5-f6e8-4afe-a231-af52cfdc1efb tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:41.336606 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-90d52db5-f6e8-4afe-a231-af52cfdc1efb tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:41.337991 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-90d52db5-f6e8-4afe-a231-af52cfdc1efb tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:41.423080 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-152d1f64-52e9-479f-a048-47871f1d82b0 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:41.424633 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-152d1f64-52e9-479f-a048-47871f1d82b0 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:41.433366 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-152d1f64-52e9-479f-a048-47871f1d82b0 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:41.434200 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-152d1f64-52e9-479f-a048-47871f1d82b0 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:41.435221 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-152d1f64-52e9-479f-a048-47871f1d82b0 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:41.435859 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-152d1f64-52e9-479f-a048-47871f1d82b0 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:41.462747 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:35:41.745603 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-152d1f64-52e9-479f-a048-47871f1d82b0 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:41.764193 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-152d1f64-52e9-479f-a048-47871f1d82b0 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1320 microversion: 2.1 time: 0.347264 Jul 25 14:35:41.767401 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1394/2594] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:41 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1320 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:41.942414 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-90d52db5-f6e8-4afe-a231-af52cfdc1efb tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90f681305bd4ff380c82f1693613b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec3e66f4339488faf93e315c7487b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:41.945637 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:35:41.961609 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-90d52db5-f6e8-4afe-a231-af52cfdc1efb tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] 10.222.0.88 "GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b" status: 200 len: 1325 microversion: 2.1 time: 0.650403 Jul 25 14:35:41.962527 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1201/2595] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:41 2022] GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b => generated 1325 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:42.788829 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f50f7a41-0399-41ab-8648-96371fc4c341 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:42.789373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f50f7a41-0399-41ab-8648-96371fc4c341 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:42.810732 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f50f7a41-0399-41ab-8648-96371fc4c341 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:42.811326 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f50f7a41-0399-41ab-8648-96371fc4c341 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:42.812386 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f50f7a41-0399-41ab-8648-96371fc4c341 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:42.812932 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f50f7a41-0399-41ab-8648-96371fc4c341 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:42.982097 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9810869b-8f62-4715-b683-b8c1afcaa1a7 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:42.982894 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9810869b-8f62-4715-b683-b8c1afcaa1a7 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] [instance: 04d99b67-7c1b-4876-a928-e6fa09ec817b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:42.993810 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=8 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:35:42.995595 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9810869b-8f62-4715-b683-b8c1afcaa1a7 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:42.996128 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9810869b-8f62-4715-b683-b8c1afcaa1a7 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:42.997021 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9810869b-8f62-4715-b683-b8c1afcaa1a7 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:42.997460 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9810869b-8f62-4715-b683-b8c1afcaa1a7 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:43.221611 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f50f7a41-0399-41ab-8648-96371fc4c341 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:43.236927 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f50f7a41-0399-41ab-8648-96371fc4c341 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1320 microversion: 2.1 time: 0.453349 Jul 25 14:35:43.242054 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1395/2596] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:42 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1320 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:43.261360 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9810869b-8f62-4715-b683-b8c1afcaa1a7 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90f681305bd4ff380c82f1693613b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec3e66f4339488faf93e315c7487b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:43.264465 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:35:43.273476 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9810869b-8f62-4715-b683-b8c1afcaa1a7 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] 10.222.0.88 "GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b" status: 200 len: 1325 microversion: 2.1 time: 0.295500 Jul 25 14:35:43.274571 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1202/2597] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:42 2022] GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b => generated 1325 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:35:44.263401 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a2e7c370-0bfb-4953-a744-13ef38af5270 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:44.264227 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a2e7c370-0bfb-4953-a744-13ef38af5270 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:44.279198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a2e7c370-0bfb-4953-a744-13ef38af5270 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:44.279656 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a2e7c370-0bfb-4953-a744-13ef38af5270 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:44.282028 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a2e7c370-0bfb-4953-a744-13ef38af5270 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:44.282511 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a2e7c370-0bfb-4953-a744-13ef38af5270 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:44.297396 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d614d435-adf5-41c3-a9f1-bd99c886bd1a tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:44.298652 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d614d435-adf5-41c3-a9f1-bd99c886bd1a tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] [instance: 04d99b67-7c1b-4876-a928-e6fa09ec817b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:44.320625 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d614d435-adf5-41c3-a9f1-bd99c886bd1a tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:44.327891 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d614d435-adf5-41c3-a9f1-bd99c886bd1a tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:44.329086 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d614d435-adf5-41c3-a9f1-bd99c886bd1a tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:44.329797 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d614d435-adf5-41c3-a9f1-bd99c886bd1a tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:45.306737 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a2e7c370-0bfb-4953-a744-13ef38af5270 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:45.323622 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a2e7c370-0bfb-4953-a744-13ef38af5270 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1320 microversion: 2.1 time: 1.063847 Jul 25 14:35:45.326866 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1396/2598] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:44 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1320 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:45.566338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d614d435-adf5-41c3-a9f1-bd99c886bd1a tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90f681305bd4ff380c82f1693613b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec3e66f4339488faf93e315c7487b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:45.576386 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d614d435-adf5-41c3-a9f1-bd99c886bd1a tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] 10.222.0.88 "GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b" status: 200 len: 1325 microversion: 2.1 time: 1.285165 Jul 25 14:35:45.595206 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1203/2599] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:44 2022] GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b => generated 1325 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:35:45.721472 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2ae9fa92-6280-4a46-ab56-c2552a55c5f8 tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:45.727039 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:35:45.727039 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:35:45.730863 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2ae9fa92-6280-4a46-ab56-c2552a55c5f8 tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:45.734786 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2ae9fa92-6280-4a46-ab56-c2552a55c5f8 tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:45.740966 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2ae9fa92-6280-4a46-ab56-c2552a55c5f8 tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:45.741886 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2ae9fa92-6280-4a46-ab56-c2552a55c5f8 tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:45.826219 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2ae9fa92-6280-4a46-ab56-c2552a55c5f8 tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.497890 Jul 25 14:35:45.827835 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1397/2600] 10.222.0.88 () {58 vars in 1137 bytes} [Mon Jul 25 14:35:45 2022] GET /compute/v2.1/os-services => generated 949 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:35:45.840720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c62e2ee9-701e-41d0-a975-d95878ebc5a1 tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:45.847725 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:35:45.847725 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:35:45.850956 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c62e2ee9-701e-41d0-a975-d95878ebc5a1 tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:45.851662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c62e2ee9-701e-41d0-a975-d95878ebc5a1 tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:45.855816 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c62e2ee9-701e-41d0-a975-d95878ebc5a1 tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:45.859955 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c62e2ee9-701e-41d0-a975-d95878ebc5a1 tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:45.937508 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c62e2ee9-701e-41d0-a975-d95878ebc5a1 tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.101166 Jul 25 14:35:45.938931 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1204/2601] 10.222.0.88 () {58 vars in 1170 bytes} [Mon Jul 25 14:35:45 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:35:45.954151 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2d4639cf-4360-4012-9883-e6f1ac8aaebb tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:45.957253 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:35:45.957253 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:35:45.959028 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d4639cf-4360-4012-9883-e6f1ac8aaebb tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:45.959691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d4639cf-4360-4012-9883-e6f1ac8aaebb tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:45.960669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d4639cf-4360-4012-9883-e6f1ac8aaebb tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:45.961252 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d4639cf-4360-4012-9883-e6f1ac8aaebb tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:46.005872 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2d4639cf-4360-4012-9883-e6f1ac8aaebb tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.056087 Jul 25 14:35:46.007170 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1398/2602] 10.222.0.88 () {58 vars in 1137 bytes} [Mon Jul 25 14:35:45 2022] GET /compute/v2.1/os-services => generated 949 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:35:46.022683 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-163e9949-d779-4e50-95fd-ecc22fa16b3b tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:46.026741 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:35:46.026741 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:35:46.028728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-163e9949-d779-4e50-95fd-ecc22fa16b3b tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:46.029387 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-163e9949-d779-4e50-95fd-ecc22fa16b3b tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:46.030705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-163e9949-d779-4e50-95fd-ecc22fa16b3b tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:46.031315 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-163e9949-d779-4e50-95fd-ecc22fa16b3b tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:46.089517 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-163e9949-d779-4e50-95fd-ecc22fa16b3b tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?host=n-d-846435-14&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.071233 Jul 25 14:35:46.091080 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1205/2603] 10.222.0.88 () {58 vars in 1196 bytes} [Mon Jul 25 14:35:46 2022] GET /compute/v2.1/os-services?host=n-d-846435-14&binary=xxx => generated 16 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:35:46.104066 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-01b5b134-ebdf-4e21-ae7d-fda1a3931abb tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:46.108168 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:35:46.108168 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:35:46.110788 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01b5b134-ebdf-4e21-ae7d-fda1a3931abb tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:46.111849 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01b5b134-ebdf-4e21-ae7d-fda1a3931abb tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:46.112842 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01b5b134-ebdf-4e21-ae7d-fda1a3931abb tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:46.113444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01b5b134-ebdf-4e21-ae7d-fda1a3931abb tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:46.129571 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-511ae3e5-2375-4cfe-89e3-fadd38e811aa req-43c8b293-4fd5-4d16-b188-030f5a8d9cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d3dd486-7c28-4d5a-a177-3f14739f3abc", "name": "network-vif-plugged", "status": "completed", "tag": "7ffa8887-a294-4e02-abb3-6f1ef72307ba"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:46.152852 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-511ae3e5-2375-4cfe-89e3-fadd38e811aa req-43c8b293-4fd5-4d16-b188-030f5a8d9cc0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:46.155957 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-511ae3e5-2375-4cfe-89e3-fadd38e811aa req-43c8b293-4fd5-4d16-b188-030f5a8d9cc0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:46.187795 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-511ae3e5-2375-4cfe-89e3-fadd38e811aa req-43c8b293-4fd5-4d16-b188-030f5a8d9cc0 service nova] Creating event network-vif-plugged:7ffa8887-a294-4e02-abb3-6f1ef72307ba for instance 9d3dd486-7c28-4d5a-a177-3f14739f3abc on n-h1-846435-14 Jul 25 14:35:46.190295 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-01b5b134-ebdf-4e21-ae7d-fda1a3931abb tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.090269 Jul 25 14:35:46.197589 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1399/2604] 10.222.0.88 () {58 vars in 1137 bytes} [Mon Jul 25 14:35:46 2022] GET /compute/v2.1/os-services => generated 949 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:35:46.202907 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-511ae3e5-2375-4cfe-89e3-fadd38e811aa req-43c8b293-4fd5-4d16-b188-030f5a8d9cc0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078829 Jul 25 14:35:46.216403 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1206/2605] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:35:46.218468 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-41fdfc49-d8a0-489f-8d77-86b3605a7f15 tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:46.224366 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:35:46.224366 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:35:46.227760 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-41fdfc49-d8a0-489f-8d77-86b3605a7f15 tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:46.253929 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-41fdfc49-d8a0-489f-8d77-86b3605a7f15 tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:46.257218 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-41fdfc49-d8a0-489f-8d77-86b3605a7f15 tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:46.261989 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-41fdfc49-d8a0-489f-8d77-86b3605a7f15 tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:46.302589 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-41fdfc49-d8a0-489f-8d77-86b3605a7f15 tempest-ServicesAdminNegativeTestJSON-1845002448 tempest-ServicesAdminNegativeTestJSON-1845002448-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.097614 Jul 25 14:35:46.303826 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1400/2606] 10.222.0.88 () {58 vars in 1198 bytes} [Mon Jul 25 14:35:46 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 14:35:46.361482 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a96d8df7-1f93-4ad0-a913-ffe6fe07fcc4 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:46.363346 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a96d8df7-1f93-4ad0-a913-ffe6fe07fcc4 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:46.398795 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a96d8df7-1f93-4ad0-a913-ffe6fe07fcc4 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:46.399298 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a96d8df7-1f93-4ad0-a913-ffe6fe07fcc4 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:46.405412 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a96d8df7-1f93-4ad0-a913-ffe6fe07fcc4 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:46.406880 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a96d8df7-1f93-4ad0-a913-ffe6fe07fcc4 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:46.580609 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bb6726ec-6956-4e5d-9269-4c773d71dd99 tempest-ServicesAdminNegativeTestJSON-1446560934 tempest-ServicesAdminNegativeTestJSON-1446560934-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:46.584571 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:35:46.584571 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:35:46.587566 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bb6726ec-6956-4e5d-9269-4c773d71dd99 tempest-ServicesAdminNegativeTestJSON-1446560934 tempest-ServicesAdminNegativeTestJSON-1446560934-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '07d0bd87bcf14eea9df9533da0d40eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac332f7f097a411b88819fe29a2443fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bb6726ec-6956-4e5d-9269-4c773d71dd99 tempest-ServicesAdminNegativeTestJSON-1446560934 tempest-ServicesAdminNegativeTestJSON-1446560934-project] Request method failure captured: Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qo_bygUuLpZTUpzDPEgSkJj1F55XBu86C04leiygiw42J1jSRd5LJMJ0Lk-jKEv7w3AL8xSXPnCFNc2zpkHo5p-hfUKNeaGvF98nZDznm1fsehuWjQWIAzPth8YQ3pwVdP0mhry7nHLVAEuontJ-M3fON7BPmuyWsfUHbwFSShLyqw Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: ac332f7f097a411b88819fe29a2443fe Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1446560934 Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ac332f7f097a411b88819fe29a2443fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ac332f7f097a411b88819fe29a2443fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ac332f7f097a411b88819fe29a2443fe", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ac332f7f097a411b88819fe29a2443fe"}]}] Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1446560934 Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: ac332f7f097a411b88819fe29a2443fe Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1446560934 Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServicesAdminNegativeTestJSON-1446560934-project Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 07d0bd87bcf14eea9df9533da0d40eb0 Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1446560934-project Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: action_args: {} Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 25 14:35:46.590312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:46.594851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:46.594851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:46.594851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:46.594851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:46.594851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:46.594851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 14:35:46.594851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 14:35:46.594851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 25 14:35:46.594851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:46.596626 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bb6726ec-6956-4e5d-9269-4c773d71dd99 tempest-ServicesAdminNegativeTestJSON-1446560934 tempest-ServicesAdminNegativeTestJSON-1446560934-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:35:46.597935 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bb6726ec-6956-4e5d-9269-4c773d71dd99 tempest-ServicesAdminNegativeTestJSON-1446560934 tempest-ServicesAdminNegativeTestJSON-1446560934-project] 10.222.0.88 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.284245 Jul 25 14:35:46.612579 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1207/2607] 10.222.0.88 () {58 vars in 1137 bytes} [Mon Jul 25 14:35:46 2022] GET /compute/v2.1/os-services => generated 112 bytes in 299 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:35:46.627078 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e3b136e6-411b-4545-9a10-54e1b9eb189e tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:46.633079 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e3b136e6-411b-4545-9a10-54e1b9eb189e tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] [instance: 04d99b67-7c1b-4876-a928-e6fa09ec817b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:46.662267 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3b136e6-411b-4545-9a10-54e1b9eb189e tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:46.670696 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3b136e6-411b-4545-9a10-54e1b9eb189e tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:46.672480 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3b136e6-411b-4545-9a10-54e1b9eb189e tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:46.675617 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3b136e6-411b-4545-9a10-54e1b9eb189e tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:47.631238 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e3b136e6-411b-4545-9a10-54e1b9eb189e tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90f681305bd4ff380c82f1693613b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec3e66f4339488faf93e315c7487b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:47.659034 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e3b136e6-411b-4545-9a10-54e1b9eb189e tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] 10.222.0.88 "GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b" status: 200 len: 1325 microversion: 2.1 time: 1.037475 Jul 25 14:35:47.662227 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1208/2608] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:46 2022] GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b => generated 1325 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:48.052858 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a96d8df7-1f93-4ad0-a913-ffe6fe07fcc4 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:48.067576 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a96d8df7-1f93-4ad0-a913-ffe6fe07fcc4 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1320 microversion: 2.1 time: 1.721472 Jul 25 14:35:48.068213 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1401/2609] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:46 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1320 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:48.341731 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-ce2d9ebc-1562-44cf-b96a-797744637c12 req-cf2b587d-b97b-4067-b993-c4c3e812fe74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aa9ee0e-2d03-42a5-af94-51275e754256", "name": "network-vif-plugged", "status": "completed", "tag": "668fe7f1-2c75-49ac-8a6c-9a1ca635424e"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:48.358011 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ce2d9ebc-1562-44cf-b96a-797744637c12 req-cf2b587d-b97b-4067-b993-c4c3e812fe74 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:48.358621 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ce2d9ebc-1562-44cf-b96a-797744637c12 req-cf2b587d-b97b-4067-b993-c4c3e812fe74 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:48.403624 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-ce2d9ebc-1562-44cf-b96a-797744637c12 req-cf2b587d-b97b-4067-b993-c4c3e812fe74 service nova] Creating event network-vif-plugged:668fe7f1-2c75-49ac-8a6c-9a1ca635424e for instance 5aa9ee0e-2d03-42a5-af94-51275e754256 on n-h2-846435-14 Jul 25 14:35:48.417690 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-ce2d9ebc-1562-44cf-b96a-797744637c12 req-cf2b587d-b97b-4067-b993-c4c3e812fe74 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085100 Jul 25 14:35:48.457754 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1209/2610] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:35:48.683410 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bf633ab7-1dc7-4331-9a0b-a8ffa7266908 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:48.684660 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bf633ab7-1dc7-4331-9a0b-a8ffa7266908 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] [instance: 04d99b67-7c1b-4876-a928-e6fa09ec817b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:48.703804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bf633ab7-1dc7-4331-9a0b-a8ffa7266908 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:48.710349 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bf633ab7-1dc7-4331-9a0b-a8ffa7266908 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:48.713909 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bf633ab7-1dc7-4331-9a0b-a8ffa7266908 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:48.714366 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bf633ab7-1dc7-4331-9a0b-a8ffa7266908 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:49.078247 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bf633ab7-1dc7-4331-9a0b-a8ffa7266908 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90f681305bd4ff380c82f1693613b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec3e66f4339488faf93e315c7487b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:49.094308 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bf633ab7-1dc7-4331-9a0b-a8ffa7266908 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] 10.222.0.88 "GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b" status: 200 len: 1325 microversion: 2.1 time: 0.415284 Jul 25 14:35:49.095478 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1402/2611] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:48 2022] GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b => generated 1325 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:49.100356 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-37ce5d85-0337-48df-b18a-a282d78d1f37 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:49.101928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-37ce5d85-0337-48df-b18a-a282d78d1f37 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:49.112347 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37ce5d85-0337-48df-b18a-a282d78d1f37 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:49.113060 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37ce5d85-0337-48df-b18a-a282d78d1f37 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:49.114321 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37ce5d85-0337-48df-b18a-a282d78d1f37 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:49.115176 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37ce5d85-0337-48df-b18a-a282d78d1f37 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:49.340480 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-37ce5d85-0337-48df-b18a-a282d78d1f37 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:49.362553 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-37ce5d85-0337-48df-b18a-a282d78d1f37 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1320 microversion: 2.1 time: 0.265694 Jul 25 14:35:49.363149 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1403/2612] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:49 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1320 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:49.551204 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-815e77ee-d60f-487e-a061-0fdcea753af7 tempest-FloatingIPsNegativeTestJSON-1824645067 tempest-FloatingIPsNegativeTestJSON-1824645067-project] Calling method '.version_select at 0x7f46987e0a60>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:49.698638 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-815e77ee-d60f-487e-a061-0fdcea753af7 tempest-FloatingIPsNegativeTestJSON-1824645067 tempest-FloatingIPsNegativeTestJSON-1824645067-project] 10.222.0.88 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.816061 Jul 25 14:35:49.700609 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1210/2613] 10.222.0.88 () {58 vars in 1149 bytes} [Mon Jul 25 14:35:48 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 14:35:49.715833 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3b0841f4-7b00-4f72-9875-22aac6689d05 tempest-FloatingIPsNegativeTestJSON-1824645067 tempest-FloatingIPsNegativeTestJSON-1824645067-project] Action: 'create', calling method: .version_select at 0x7f46989d3f70>, body: {"pool": "non_exist_pool"} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:49.782779 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-3b0841f4-7b00-4f72-9875-22aac6689d05 tempest-FloatingIPsNegativeTestJSON-1824645067 tempest-FloatingIPsNegativeTestJSON-1824645067-project] HTTP exception thrown: Floating IP pool not found. Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3b0841f4-7b00-4f72-9875-22aac6689d05 tempest-FloatingIPsNegativeTestJSON-1824645067 tempest-FloatingIPsNegativeTestJSON-1824645067-project] Request method failure captured: Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 26 Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qpEpG3_OZ62XaX1a1WQJF3jpohLEpub2BZLC9O8SWnWcl1QtXpeEqGey_4i19ILhtMw-EAVyZEcTO-73rkUFcMtb4M4jdjQJbtrLl2v5HW6e2hBqxIMVZVxm68myFXrklpBhTCLRnotYK1wQljQZQBPTqd2JLgFgP3DR8diJrQrNH4 Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: c088c9a5b32e41a896d987e7ff551aeb Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1824645067 Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c088c9a5b32e41a896d987e7ff551aeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c088c9a5b32e41a896d987e7ff551aeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c088c9a5b32e41a896d987e7ff551aeb", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c088c9a5b32e41a896d987e7ff551aeb"}]}] Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1824645067 Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: c088c9a5b32e41a896d987e7ff551aeb Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1824645067 Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-FloatingIPsNegativeTestJSON-1824645067-project Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 3d065f3f3f5a4b60b8308d06b671b3f7 Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1824645067-project Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: {"pool": "non_exist_pool"} Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: exception: Floating IP pool not found. Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'body': {'pool': 'non_exist_pool'}} Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:35:49.784468 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:35:49.789607 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jul 25 14:35:49.789607 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:49.796122 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3b0841f4-7b00-4f72-9875-22aac6689d05 tempest-FloatingIPsNegativeTestJSON-1824645067 tempest-FloatingIPsNegativeTestJSON-1824645067-project] Returning 404 to user: Floating IP pool not found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:35:49.799308 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3b0841f4-7b00-4f72-9875-22aac6689d05 tempest-FloatingIPsNegativeTestJSON-1824645067 tempest-FloatingIPsNegativeTestJSON-1824645067-project] 10.222.0.88 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.088633 Jul 25 14:35:49.805122 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1404/2614] 10.222.0.88 () {60 vars in 1170 bytes} [Mon Jul 25 14:35:49 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:35:49.811140 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ebbd9617-b096-4a51-9232-293e305f6534 tempest-FloatingIPsNegativeTestJSON-1824645067 tempest-FloatingIPsNegativeTestJSON-1824645067-project] Calling method '.version_select at 0x7f46989ad280>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:49.884832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG neutronclient.v2_0.client [None req-ebbd9617-b096-4a51-9232-293e305f6534 tempest-FloatingIPsNegativeTestJSON-1824645067 tempest-FloatingIPsNegativeTestJSON-1824645067-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3741c395-3b1e-4f46-83aa-8efee9cbfd00 could not be found", "detail": ""}} {{(pid=119303) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 14:35:49.885556 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-ebbd9617-b096-4a51-9232-293e305f6534 tempest-FloatingIPsNegativeTestJSON-1824645067 tempest-FloatingIPsNegativeTestJSON-1824645067-project] HTTP exception thrown: Floating IP not found for ID 3741c395-3b1e-4f46-83aa-8efee9cbfd00 Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ebbd9617-b096-4a51-9232-293e305f6534 tempest-FloatingIPsNegativeTestJSON-1824645067 tempest-FloatingIPsNegativeTestJSON-1824645067-project] Request method failure captured: Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/os-floating-ips/3741c395-3b1e-4f46-83aa-8efee9cbfd00 HTTP/1.1 Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qpEpG3_OZ62XaX1a1WQJF3jpohLEpub2BZLC9O8SWnWcl1QtXpeEqGey_4i19ILhtMw-EAVyZEcTO-73rkUFcMtb4M4jdjQJbtrLl2v5HW6e2hBqxIMVZVxm68myFXrklpBhTCLRnotYK1wQljQZQBPTqd2JLgFgP3DR8diJrQrNH4 Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: c088c9a5b32e41a896d987e7ff551aeb Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1824645067 Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c088c9a5b32e41a896d987e7ff551aeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c088c9a5b32e41a896d987e7ff551aeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c088c9a5b32e41a896d987e7ff551aeb", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c088c9a5b32e41a896d987e7ff551aeb"}]}] Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1824645067 Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: c088c9a5b32e41a896d987e7ff551aeb Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1824645067 Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-FloatingIPsNegativeTestJSON-1824645067-project Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 3d065f3f3f5a4b60b8308d06b671b3f7 Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1824645067-project Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: exception: Floating IP not found for ID 3741c395-3b1e-4f46-83aa-8efee9cbfd00 Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '3741c395-3b1e-4f46-83aa-8efee9cbfd00'} Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3741c395-3b1e-4f46-83aa-8efee9cbfd00 could not be found Jul 25 14:35:49.888891 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f0a6a8c0-4b9f-4148-8497-94cbd7efc823'] Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3741c395-3b1e-4f46-83aa-8efee9cbfd00. Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3741c395-3b1e-4f46-83aa-8efee9cbfd00 Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3741c395-3b1e-4f46-83aa-8efee9cbfd00 Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ebbd9617-b096-4a51-9232-293e305f6534 tempest-FloatingIPsNegativeTestJSON-1824645067 tempest-FloatingIPsNegativeTestJSON-1824645067-project] Returning 404 to user: Floating IP not found for ID 3741c395-3b1e-4f46-83aa-8efee9cbfd00 {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:35:49.892517 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ebbd9617-b096-4a51-9232-293e305f6534 tempest-FloatingIPsNegativeTestJSON-1824645067 tempest-FloatingIPsNegativeTestJSON-1824645067-project] 10.222.0.88 "DELETE /compute/v2.1/os-floating-ips/3741c395-3b1e-4f46-83aa-8efee9cbfd00" status: 404 len: 111 microversion: 2.1 time: 0.084564 Jul 25 14:35:49.896795 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1211/2615] 10.222.0.88 () {58 vars in 1263 bytes} [Mon Jul 25 14:35:49 2022] DELETE /compute/v2.1/os-floating-ips/3741c395-3b1e-4f46-83aa-8efee9cbfd00 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:35:50.124778 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e427fd64-d60f-440e-833e-b9b9ba04aa27 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:50.128049 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e427fd64-d60f-440e-833e-b9b9ba04aa27 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] [instance: 04d99b67-7c1b-4876-a928-e6fa09ec817b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:50.157092 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e427fd64-d60f-440e-833e-b9b9ba04aa27 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:50.157779 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e427fd64-d60f-440e-833e-b9b9ba04aa27 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:50.159126 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e427fd64-d60f-440e-833e-b9b9ba04aa27 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:50.159725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e427fd64-d60f-440e-833e-b9b9ba04aa27 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:50.386123 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1d5ffda2-77dc-45f6-a1c0-a83b470dbb98 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:50.387034 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1d5ffda2-77dc-45f6-a1c0-a83b470dbb98 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:50.394578 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d5ffda2-77dc-45f6-a1c0-a83b470dbb98 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:50.395288 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d5ffda2-77dc-45f6-a1c0-a83b470dbb98 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:50.396408 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d5ffda2-77dc-45f6-a1c0-a83b470dbb98 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:50.397296 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d5ffda2-77dc-45f6-a1c0-a83b470dbb98 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:50.581105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e427fd64-d60f-440e-833e-b9b9ba04aa27 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90f681305bd4ff380c82f1693613b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec3e66f4339488faf93e315c7487b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:50.595108 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e427fd64-d60f-440e-833e-b9b9ba04aa27 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] 10.222.0.88 "GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b" status: 200 len: 1325 microversion: 2.1 time: 0.484117 Jul 25 14:35:50.598246 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1405/2616] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:50 2022] GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b => generated 1325 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:50.845596 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1d5ffda2-77dc-45f6-a1c0-a83b470dbb98 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:50.859464 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1d5ffda2-77dc-45f6-a1c0-a83b470dbb98 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1515 microversion: 2.1 time: 0.479621 Jul 25 14:35:50.860414 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1212/2617] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:50 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1515 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:50.887315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1494d7f1-442d-452c-b7c6-8eccffabd3ee tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:50.889932 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1494d7f1-442d-452c-b7c6-8eccffabd3ee tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:50.913481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1494d7f1-442d-452c-b7c6-8eccffabd3ee tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:50.913950 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1494d7f1-442d-452c-b7c6-8eccffabd3ee tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:50.914769 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1494d7f1-442d-452c-b7c6-8eccffabd3ee tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:50.915211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1494d7f1-442d-452c-b7c6-8eccffabd3ee tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:51.046378 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-1494d7f1-442d-452c-b7c6-8eccffabd3ee tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lazy-loading 'flavor' on Instance uuid 5aa9ee0e-2d03-42a5-af94-51275e754256 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:35:51.313682 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-b776bbd6-cff9-42a8-ab99-a21103d0f2cf req-2ec2f4f9-774d-4c84-9d65-b8bd3b9896e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d99b67-7c1b-4876-a928-e6fa09ec817b", "name": "network-vif-plugged", "status": "completed", "tag": "eb49678c-f1bd-4258-8260-6851c3b13615"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:51.332456 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b776bbd6-cff9-42a8-ab99-a21103d0f2cf req-2ec2f4f9-774d-4c84-9d65-b8bd3b9896e1 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:51.336054 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b776bbd6-cff9-42a8-ab99-a21103d0f2cf req-2ec2f4f9-774d-4c84-9d65-b8bd3b9896e1 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:51.367416 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1494d7f1-442d-452c-b7c6-8eccffabd3ee tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "POST /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256/action" status: 200 len: 32 microversion: 2.1 time: 0.486794 Jul 25 14:35:51.369165 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1406/2618] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:35:50 2022] POST /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256/action => generated 32 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:35:51.405424 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f801cab5-0318-439f-9ab1-a933199b958c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:51.406855 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f801cab5-0318-439f-9ab1-a933199b958c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:51.415447 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-b776bbd6-cff9-42a8-ab99-a21103d0f2cf req-2ec2f4f9-774d-4c84-9d65-b8bd3b9896e1 service nova] Creating event network-vif-plugged:eb49678c-f1bd-4258-8260-6851c3b13615 for instance 04d99b67-7c1b-4876-a928-e6fa09ec817b on n-h2-846435-14 Jul 25 14:35:51.419016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f801cab5-0318-439f-9ab1-a933199b958c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:51.419822 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f801cab5-0318-439f-9ab1-a933199b958c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:51.420984 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f801cab5-0318-439f-9ab1-a933199b958c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:51.421640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f801cab5-0318-439f-9ab1-a933199b958c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:51.455903 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-b776bbd6-cff9-42a8-ab99-a21103d0f2cf req-2ec2f4f9-774d-4c84-9d65-b8bd3b9896e1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146189 Jul 25 14:35:51.461755 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1213/2619] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:35:51.619904 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-612936c2-6fe2-4455-81c5-349af7affdf0 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:51.620678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-612936c2-6fe2-4455-81c5-349af7affdf0 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] [instance: 04d99b67-7c1b-4876-a928-e6fa09ec817b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:51.636576 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-612936c2-6fe2-4455-81c5-349af7affdf0 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:51.637092 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-612936c2-6fe2-4455-81c5-349af7affdf0 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:51.642752 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-612936c2-6fe2-4455-81c5-349af7affdf0 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:51.645329 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-612936c2-6fe2-4455-81c5-349af7affdf0 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:51.942080 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f801cab5-0318-439f-9ab1-a933199b958c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:51.954794 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f801cab5-0318-439f-9ab1-a933199b958c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1521 microversion: 2.1 time: 0.572678 Jul 25 14:35:51.958988 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1407/2620] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:51 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1521 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:35:52.226119 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-612936c2-6fe2-4455-81c5-349af7affdf0 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90f681305bd4ff380c82f1693613b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec3e66f4339488faf93e315c7487b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:52.238082 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-612936c2-6fe2-4455-81c5-349af7affdf0 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] 10.222.0.88 "GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b" status: 200 len: 1325 microversion: 2.1 time: 0.623727 Jul 25 14:35:52.239362 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1214/2621] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:51 2022] GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b => generated 1325 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:52.983602 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2d630bf8-3ef6-4a83-addc-46523605a8a4 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:52.984099 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2d630bf8-3ef6-4a83-addc-46523605a8a4 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:52.995745 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d630bf8-3ef6-4a83-addc-46523605a8a4 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:52.999886 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d630bf8-3ef6-4a83-addc-46523605a8a4 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:53.000908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d630bf8-3ef6-4a83-addc-46523605a8a4 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:53.003622 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d630bf8-3ef6-4a83-addc-46523605a8a4 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:53.280470 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ee4723a2-5016-4a98-8ca4-9a546d8b200a tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Action: 'update', calling method: .version_select at 0x7f46989e5a60>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:53.285640 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:35:53.285640 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:35:53.288814 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee4723a2-5016-4a98-8ca4-9a546d8b200a tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:53.294481 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee4723a2-5016-4a98-8ca4-9a546d8b200a tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:53.313435 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee4723a2-5016-4a98-8ca4-9a546d8b200a tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:53.314900 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee4723a2-5016-4a98-8ca4-9a546d8b200a tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:53.340276 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-ee4723a2-5016-4a98-8ca4-9a546d8b200a tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] HTTP exception thrown: Service e357e651-4863-4ba4-b12f-96bd727be1b6 could not be found. Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ee4723a2-5016-4a98-8ca4-9a546d8b200a tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Request method failure captured: Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: request: PUT /compute/v2.1/os-services/e357e651-4863-4ba4-b12f-96bd727be1b6 HTTP/1.1 Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 56 Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qpIDzVsG1T8QbcAys75_mntW7KZpWLWwhB76oq_fgip-XiDsB4sENOvVU22pGG0riTEGpxKrLIkOv2CdEkok8W2E8eTrJgvuFLd-aorb8kASCTy86T1BNLTPzjawz_sUugN8SOVwdqcRh9YTwhy5Vs9ieXb_kvQq3rl57P_S4fGr6g Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: X-Openstack-Nova-Api-Version: 2.53 Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: d298e89135b24d0797bec5e805cf0459 Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-965598909 Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: X-Role: admin,reader,member Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: admin,reader,member Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d298e89135b24d0797bec5e805cf0459"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d298e89135b24d0797bec5e805cf0459"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_d298e89135b24d0797bec5e805cf0459", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/d298e89135b24d0797bec5e805cf0459"}]}] Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-965598909 Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: d298e89135b24d0797bec5e805cf0459 Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-965598909 Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 26f1cea61b7b43fa93a5633509137054 Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: {"status": "disabled", "disabled_reason": "maintenance"} Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: exception: Service e357e651-4863-4ba4-b12f-96bd727be1b6 could not be found. Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'e357e651-4863-4ba4-b12f-96bd727be1b6', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service e357e651-4863-4ba4-b12f-96bd727be1b6 could not be found. Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:35:53.342148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:35:53.346444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 25 14:35:53.346444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:35:53.346444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service e357e651-4863-4ba4-b12f-96bd727be1b6 could not be found. Jul 25 14:35:53.346444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:53.346444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:53.346444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:53.346444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:53.346444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:53.346444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:53.346444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:35:53.346444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:35:53.346444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service e357e651-4863-4ba4-b12f-96bd727be1b6 could not be found. Jul 25 14:35:53.346444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:53.346444 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ee4723a2-5016-4a98-8ca4-9a546d8b200a tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Returning 404 to user: Service e357e651-4863-4ba4-b12f-96bd727be1b6 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:35:53.346444 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ee4723a2-5016-4a98-8ca4-9a546d8b200a tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-services/e357e651-4863-4ba4-b12f-96bd727be1b6" status: 404 len: 110 microversion: 2.53 time: 0.361220 Jul 25 14:35:53.347309 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1215/2622] 10.222.0.88 () {62 vars in 1309 bytes} [Mon Jul 25 14:35:52 2022] PUT /compute/v2.1/os-services/e357e651-4863-4ba4-b12f-96bd727be1b6 => generated 110 bytes in 362 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:35:53.352061 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7e6fa62b-62da-439d-9b21-e68168dfaf92 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:53.356548 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7e6fa62b-62da-439d-9b21-e68168dfaf92 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] [instance: 04d99b67-7c1b-4876-a928-e6fa09ec817b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:53.360845 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2d630bf8-3ef6-4a83-addc-46523605a8a4 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:53.374219 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2d630bf8-3ef6-4a83-addc-46523605a8a4 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1521 microversion: 2.1 time: 0.399511 Jul 25 14:35:53.376293 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1408/2623] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:52 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1521 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:53.390708 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3bce327b-295e-44dc-af48-64aeeac60ce4 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Action: 'update', calling method: .version_select at 0x7f469888b280>, body: {"status": "disabled"} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:53.393421 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7e6fa62b-62da-439d-9b21-e68168dfaf92 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:53.393890 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7e6fa62b-62da-439d-9b21-e68168dfaf92 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:53.399074 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7e6fa62b-62da-439d-9b21-e68168dfaf92 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:53.399892 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7e6fa62b-62da-439d-9b21-e68168dfaf92 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:53.403410 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:35:53.403410 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:35:53.407062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3bce327b-295e-44dc-af48-64aeeac60ce4 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:53.407535 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3bce327b-295e-44dc-af48-64aeeac60ce4 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:53.437607 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3bce327b-295e-44dc-af48-64aeeac60ce4 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:53.439715 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3bce327b-295e-44dc-af48-64aeeac60ce4 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:53.461190 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-3bce327b-295e-44dc-af48-64aeeac60ce4 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] HTTP exception thrown: Service e357e651-4863-4ba4-b12f-96bd727be1b6 could not be found. Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3bce327b-295e-44dc-af48-64aeeac60ce4 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Request method failure captured: Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: request: PUT /compute/v2.1/os-services/e357e651-4863-4ba4-b12f-96bd727be1b6 HTTP/1.1 Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 22 Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qpIDzVsG1T8QbcAys75_mntW7KZpWLWwhB76oq_fgip-XiDsB4sENOvVU22pGG0riTEGpxKrLIkOv2CdEkok8W2E8eTrJgvuFLd-aorb8kASCTy86T1BNLTPzjawz_sUugN8SOVwdqcRh9YTwhy5Vs9ieXb_kvQq3rl57P_S4fGr6g Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: X-Openstack-Nova-Api-Version: 2.53 Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: d298e89135b24d0797bec5e805cf0459 Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-965598909 Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: X-Role: admin,reader,member Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: admin,reader,member Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d298e89135b24d0797bec5e805cf0459"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d298e89135b24d0797bec5e805cf0459"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_d298e89135b24d0797bec5e805cf0459", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/d298e89135b24d0797bec5e805cf0459"}]}] Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-965598909 Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: d298e89135b24d0797bec5e805cf0459 Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-965598909 Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 26f1cea61b7b43fa93a5633509137054 Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: {"status": "disabled"} Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: exception: Service e357e651-4863-4ba4-b12f-96bd727be1b6 could not be found. Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'e357e651-4863-4ba4-b12f-96bd727be1b6', 'body': {'status': 'disabled'}} Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service e357e651-4863-4ba4-b12f-96bd727be1b6 could not be found. Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:35:53.467871 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:35:53.472306 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 25 14:35:53.472306 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:35:53.472306 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service e357e651-4863-4ba4-b12f-96bd727be1b6 could not be found. Jul 25 14:35:53.472306 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:53.472306 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:53.472306 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:53.472306 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:53.472306 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:53.472306 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:53.472306 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:35:53.472306 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:35:53.472306 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service e357e651-4863-4ba4-b12f-96bd727be1b6 could not be found. Jul 25 14:35:53.472306 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:53.474531 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3bce327b-295e-44dc-af48-64aeeac60ce4 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Returning 404 to user: Service e357e651-4863-4ba4-b12f-96bd727be1b6 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:35:53.477241 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3bce327b-295e-44dc-af48-64aeeac60ce4 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-services/e357e651-4863-4ba4-b12f-96bd727be1b6" status: 404 len: 110 microversion: 2.53 time: 0.098750 Jul 25 14:35:53.482513 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1409/2624] 10.222.0.88 () {62 vars in 1309 bytes} [Mon Jul 25 14:35:53 2022] PUT /compute/v2.1/os-services/e357e651-4863-4ba4-b12f-96bd727be1b6 => generated 110 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:35:53.496669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-abf66a61-5724-4cee-95b2-2ba01d7f7301 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Action: 'update', calling method: .version_select at 0x7f4687705a60>, body: {"status": "enabled"} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:53.503862 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-abf66a61-5724-4cee-95b2-2ba01d7f7301 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:53.504956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-abf66a61-5724-4cee-95b2-2ba01d7f7301 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:53.512193 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-abf66a61-5724-4cee-95b2-2ba01d7f7301 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:53.513571 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-abf66a61-5724-4cee-95b2-2ba01d7f7301 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:53.533870 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-abf66a61-5724-4cee-95b2-2ba01d7f7301 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] HTTP exception thrown: Service e357e651-4863-4ba4-b12f-96bd727be1b6 could not be found. Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-abf66a61-5724-4cee-95b2-2ba01d7f7301 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Request method failure captured: Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: request: PUT /compute/v2.1/os-services/e357e651-4863-4ba4-b12f-96bd727be1b6 HTTP/1.1 Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 21 Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qpIDzVsG1T8QbcAys75_mntW7KZpWLWwhB76oq_fgip-XiDsB4sENOvVU22pGG0riTEGpxKrLIkOv2CdEkok8W2E8eTrJgvuFLd-aorb8kASCTy86T1BNLTPzjawz_sUugN8SOVwdqcRh9YTwhy5Vs9ieXb_kvQq3rl57P_S4fGr6g Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: X-Openstack-Nova-Api-Version: 2.53 Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: d298e89135b24d0797bec5e805cf0459 Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-965598909 Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: X-Role: admin,reader,member Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: admin,reader,member Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d298e89135b24d0797bec5e805cf0459"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d298e89135b24d0797bec5e805cf0459"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_d298e89135b24d0797bec5e805cf0459", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/d298e89135b24d0797bec5e805cf0459"}]}] Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-965598909 Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: d298e89135b24d0797bec5e805cf0459 Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-965598909 Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 26f1cea61b7b43fa93a5633509137054 Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: {"status": "enabled"} Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: exception: Service e357e651-4863-4ba4-b12f-96bd727be1b6 could not be found. Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'e357e651-4863-4ba4-b12f-96bd727be1b6', 'body': {'status': 'enabled'}} Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service e357e651-4863-4ba4-b12f-96bd727be1b6 could not be found. Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:35:53.536548 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:35:53.540317 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 25 14:35:53.540317 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:35:53.540317 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service e357e651-4863-4ba4-b12f-96bd727be1b6 could not be found. Jul 25 14:35:53.540317 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:53.540317 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:53.540317 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:53.540317 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:53.540317 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:53.540317 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:53.540317 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:35:53.540317 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:35:53.540317 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service e357e651-4863-4ba4-b12f-96bd727be1b6 could not be found. Jul 25 14:35:53.540317 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:53.543528 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-abf66a61-5724-4cee-95b2-2ba01d7f7301 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Returning 404 to user: Service e357e651-4863-4ba4-b12f-96bd727be1b6 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:35:53.544455 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-abf66a61-5724-4cee-95b2-2ba01d7f7301 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-services/e357e651-4863-4ba4-b12f-96bd727be1b6" status: 404 len: 110 microversion: 2.53 time: 0.054804 Jul 25 14:35:53.548721 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1410/2625] 10.222.0.88 () {62 vars in 1309 bytes} [Mon Jul 25 14:35:53 2022] PUT /compute/v2.1/os-services/e357e651-4863-4ba4-b12f-96bd727be1b6 => generated 110 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 25 14:35:53.560374 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2db1b9e6-d4a8-4f3f-9a5a-e23745b40110 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:53.565884 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:35:53.565884 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:35:53.567354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2db1b9e6-d4a8-4f3f-9a5a-e23745b40110 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:53.567829 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2db1b9e6-d4a8-4f3f-9a5a-e23745b40110 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:53.576126 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2db1b9e6-d4a8-4f3f-9a5a-e23745b40110 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:53.576712 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2db1b9e6-d4a8-4f3f-9a5a-e23745b40110 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:53.610611 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2db1b9e6-d4a8-4f3f-9a5a-e23745b40110 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.054963 Jul 25 14:35:53.612274 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1411/2626] 10.222.0.88 () {60 vars in 1178 bytes} [Mon Jul 25 14:35:53 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:35:53.629309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cc7d04db-4215-4a78-a824-9c6aa82a5fd5 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:53.636755 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:35:53.636755 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:35:53.638826 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cc7d04db-4215-4a78-a824-9c6aa82a5fd5 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:53.639472 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cc7d04db-4215-4a78-a824-9c6aa82a5fd5 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:53.640472 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cc7d04db-4215-4a78-a824-9c6aa82a5fd5 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:53.641062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cc7d04db-4215-4a78-a824-9c6aa82a5fd5 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:53.671634 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cc7d04db-4215-4a78-a824-9c6aa82a5fd5 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.050224 Jul 25 14:35:53.672878 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1412/2627] 10.222.0.88 () {60 vars in 1211 bytes} [Mon Jul 25 14:35:53 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:35:53.690080 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6c98206d-b8dc-4a96-90c8-16449ee96c37 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:53.692974 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:35:53.692974 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:35:53.696439 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6c98206d-b8dc-4a96-90c8-16449ee96c37 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:53.697812 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6c98206d-b8dc-4a96-90c8-16449ee96c37 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:53.701557 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6c98206d-b8dc-4a96-90c8-16449ee96c37 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:53.702193 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6c98206d-b8dc-4a96-90c8-16449ee96c37 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:53.736168 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:35:53.744475 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6c98206d-b8dc-4a96-90c8-16449ee96c37 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.061717 Jul 25 14:35:53.752029 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1413/2628] 10.222.0.88 () {60 vars in 1178 bytes} [Mon Jul 25 14:35:53 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:35:53.766253 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6285c33b-1670-44ae-900b-2e42f66456d0 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:53.769436 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:35:53.769436 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:35:53.771181 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6285c33b-1670-44ae-900b-2e42f66456d0 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:53.771842 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6285c33b-1670-44ae-900b-2e42f66456d0 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:53.772827 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6285c33b-1670-44ae-900b-2e42f66456d0 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:53.773420 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6285c33b-1670-44ae-900b-2e42f66456d0 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:53.802549 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6285c33b-1670-44ae-900b-2e42f66456d0 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?host=n-d-846435-14&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.047139 Jul 25 14:35:53.803503 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1414/2629] 10.222.0.88 () {60 vars in 1237 bytes} [Mon Jul 25 14:35:53 2022] GET /compute/v2.1/os-services?host=n-d-846435-14&binary=xxx => generated 16 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:53.816364 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5c96670f-6bd4-49cb-b415-d91d47a73f94 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:53.819372 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:35:53.819372 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:35:53.820701 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c96670f-6bd4-49cb-b415-d91d47a73f94 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:53.821168 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c96670f-6bd4-49cb-b415-d91d47a73f94 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:53.821990 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c96670f-6bd4-49cb-b415-d91d47a73f94 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:53.822420 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c96670f-6bd4-49cb-b415-d91d47a73f94 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:53.852721 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5c96670f-6bd4-49cb-b415-d91d47a73f94 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.041277 Jul 25 14:35:53.856034 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1415/2630] 10.222.0.88 () {60 vars in 1178 bytes} [Mon Jul 25 14:35:53 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:35:53.865442 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1f957124-02dc-4295-b582-046004483133 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:53.868232 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:35:53.868232 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:35:53.871136 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1f957124-02dc-4295-b582-046004483133 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:53.871136 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1f957124-02dc-4295-b582-046004483133 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:53.871136 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1f957124-02dc-4295-b582-046004483133 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:53.871710 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1f957124-02dc-4295-b582-046004483133 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:53.910438 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1f957124-02dc-4295-b582-046004483133 tempest-ServicesAdminNegativeV253TestJSON-965598909 tempest-ServicesAdminNegativeV253TestJSON-965598909-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.048643 Jul 25 14:35:53.918958 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1416/2631] 10.222.0.88 () {60 vars in 1239 bytes} [Mon Jul 25 14:35:53 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:35:54.112701 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-97640af9-fd27-49fb-a763-2019fa690444 tempest-ServicesAdminNegativeV253TestJSON-110050393 tempest-ServicesAdminNegativeV253TestJSON-110050393-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:54.114149 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7e6fa62b-62da-439d-9b21-e68168dfaf92 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90f681305bd4ff380c82f1693613b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec3e66f4339488faf93e315c7487b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:54.117628 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:35:54.117628 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:35:54.123170 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-97640af9-fd27-49fb-a763-2019fa690444 tempest-ServicesAdminNegativeV253TestJSON-110050393 tempest-ServicesAdminNegativeV253TestJSON-110050393-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '29339c76daf549abb07ea074a2e8b39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87a04b691410482e9c1c994c42a885d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-97640af9-fd27-49fb-a763-2019fa690444 tempest-ServicesAdminNegativeV253TestJSON-110050393 tempest-ServicesAdminNegativeV253TestJSON-110050393-project] Request method failure captured: Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qpH2-c_Bbtg8gDuTZDgt8CN5UkxgHTR95lu7LKn6pC4h7pzX1Aa7a4ZcGWxn_Krzj4jsSa9rR3Z5LQVmY1jJdCcJVpeQ5MTtvf0wC7pqD1Qhez_AvFGi-rISPtaVVmVuo5mzKSY6-7zdkEGsHIfzG2cxEPGMzam-lgw5X22xjQ-DzA Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: X-Openstack-Nova-Api-Version: 2.53 Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 87a04b691410482e9c1c994c42a885d4 Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-110050393 Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/87a04b691410482e9c1c994c42a885d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/87a04b691410482e9c1c994c42a885d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_87a04b691410482e9c1c994c42a885d4", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/87a04b691410482e9c1c994c42a885d4"}]}] Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-110050393 Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 87a04b691410482e9c1c994c42a885d4 Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-110050393 Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServicesAdminNegativeV253TestJSON-110050393-project Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 29339c76daf549abb07ea074a2e8b39b Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-110050393-project Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: action_args: {} Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 25 14:35:54.127051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:54.132401 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:54.132401 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:54.132401 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:54.132401 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:54.132401 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:54.132401 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 14:35:54.132401 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 14:35:54.132401 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 25 14:35:54.132401 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:35:54.133004 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7e6fa62b-62da-439d-9b21-e68168dfaf92 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] 10.222.0.88 "GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b" status: 200 len: 1325 microversion: 2.1 time: 0.785036 Jul 25 14:35:54.133788 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1216/2632] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:53 2022] GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b => generated 1325 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:54.137077 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-97640af9-fd27-49fb-a763-2019fa690444 tempest-ServicesAdminNegativeV253TestJSON-110050393 tempest-ServicesAdminNegativeV253TestJSON-110050393-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:35:54.138984 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-97640af9-fd27-49fb-a763-2019fa690444 tempest-ServicesAdminNegativeV253TestJSON-110050393 tempest-ServicesAdminNegativeV253TestJSON-110050393-project] 10.222.0.88 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.213133 Jul 25 14:35:54.141920 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1417/2633] 10.222.0.88 () {60 vars in 1178 bytes} [Mon Jul 25 14:35:53 2022] GET /compute/v2.1/os-services => generated 112 bytes in 217 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:35:54.406846 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5be4ab7c-1d19-4008-b640-0aff144d6932 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:54.409083 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5be4ab7c-1d19-4008-b640-0aff144d6932 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:54.419074 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5be4ab7c-1d19-4008-b640-0aff144d6932 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:54.419912 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5be4ab7c-1d19-4008-b640-0aff144d6932 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:54.421037 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5be4ab7c-1d19-4008-b640-0aff144d6932 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:54.421738 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5be4ab7c-1d19-4008-b640-0aff144d6932 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:54.675483 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5be4ab7c-1d19-4008-b640-0aff144d6932 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:54.684332 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5be4ab7c-1d19-4008-b640-0aff144d6932 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1521 microversion: 2.1 time: 0.286296 Jul 25 14:35:54.687839 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1217/2634] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:54 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:55.160548 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0914bfb3-dfd3-4af6-b5ae-31d45bc68a26 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:55.161645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0914bfb3-dfd3-4af6-b5ae-31d45bc68a26 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] [instance: 04d99b67-7c1b-4876-a928-e6fa09ec817b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:55.176243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0914bfb3-dfd3-4af6-b5ae-31d45bc68a26 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:55.176780 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0914bfb3-dfd3-4af6-b5ae-31d45bc68a26 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:55.177638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0914bfb3-dfd3-4af6-b5ae-31d45bc68a26 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:55.178141 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0914bfb3-dfd3-4af6-b5ae-31d45bc68a26 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:55.592444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0914bfb3-dfd3-4af6-b5ae-31d45bc68a26 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90f681305bd4ff380c82f1693613b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec3e66f4339488faf93e315c7487b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:55.605956 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0914bfb3-dfd3-4af6-b5ae-31d45bc68a26 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] 10.222.0.88 "GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b" status: 200 len: 1522 microversion: 2.1 time: 0.450578 Jul 25 14:35:55.617807 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1418/2635] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:55 2022] GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b => generated 1522 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:55.639133 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5dc33d65-f91e-47b9-b4e3-c315950d431e tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:55.639694 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5dc33d65-f91e-47b9-b4e3-c315950d431e tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] [instance: 04d99b67-7c1b-4876-a928-e6fa09ec817b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:55.654466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5dc33d65-f91e-47b9-b4e3-c315950d431e tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:55.657267 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5dc33d65-f91e-47b9-b4e3-c315950d431e tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:55.660409 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5dc33d65-f91e-47b9-b4e3-c315950d431e tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:55.661645 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5dc33d65-f91e-47b9-b4e3-c315950d431e tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:55.704772 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-5dc33d65-f91e-47b9-b4e3-c315950d431e tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] HTTP exception thrown: Instance is not a member of specified network Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5dc33d65-f91e-47b9-b4e3-c315950d431e tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Request method failure captured: Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b/ips/invalid HTTP/1.1 Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qoxyB9NXuhZ8gpNqq87pySq5CjurbdLKPNhmiF8NvmTTNk1LRZlqtjYnYEMnc_sw2chtMgSMTCYT0bXKDsShfNnu5m4HhVPncQE3KPykNBaeKCDgLyap6SJx_nZB3MDEuWIfBQ-xGmNAT69aeKwC8eUkV2OtNef6LpDRbIF1mOq7x4 Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 1ec3e66f4339488faf93e315c7487b7e Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-990713256 Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1ec3e66f4339488faf93e315c7487b7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1ec3e66f4339488faf93e315c7487b7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1ec3e66f4339488faf93e315c7487b7e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1ec3e66f4339488faf93e315c7487b7e"}]}] Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-990713256 Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 1ec3e66f4339488faf93e315c7487b7e Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-990713256 Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServerAddressesNegativeTestJSON-990713256-project Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: d90f681305bd4ff380c82f1693613b31 Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-990713256-project Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance is not a member of specified network Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'server_id': '04d99b67-7c1b-4876-a928-e6fa09ec817b', 'id': 'invalid'} Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jul 25 14:35:55.708787 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:55.714615 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-eec2dccf-3e3b-4523-91fe-773f07e69434 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:55.716324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-eec2dccf-3e3b-4523-91fe-773f07e69434 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:55.723665 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5dc33d65-f91e-47b9-b4e3-c315950d431e tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Returning 404 to user: Instance is not a member of specified network {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:35:55.724947 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5dc33d65-f91e-47b9-b4e3-c315950d431e tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] 10.222.0.88 "GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.092853 Jul 25 14:35:55.726128 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1218/2636] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:35:55 2022] GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b/ips/invalid => generated 91 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:35:55.734626 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eec2dccf-3e3b-4523-91fe-773f07e69434 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:55.735371 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eec2dccf-3e3b-4523-91fe-773f07e69434 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:55.739308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0cba07ce-870b-4984-9ca5-97cd5e63df33 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:55.740576 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eec2dccf-3e3b-4523-91fe-773f07e69434 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:55.741237 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eec2dccf-3e3b-4523-91fe-773f07e69434 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:55.744592 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0cba07ce-870b-4984-9ca5-97cd5e63df33 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Failed to fetch instance by id 999 {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 25 14:35:55.745981 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:35:55.746753 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-0cba07ce-870b-4984-9ca5-97cd5e63df33 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] HTTP exception thrown: Instance 999 could not be found. Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0cba07ce-870b-4984-9ca5-97cd5e63df33 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Request method failure captured: Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qoxyB9NXuhZ8gpNqq87pySq5CjurbdLKPNhmiF8NvmTTNk1LRZlqtjYnYEMnc_sw2chtMgSMTCYT0bXKDsShfNnu5m4HhVPncQE3KPykNBaeKCDgLyap6SJx_nZB3MDEuWIfBQ-xGmNAT69aeKwC8eUkV2OtNef6LpDRbIF1mOq7x4 Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 1ec3e66f4339488faf93e315c7487b7e Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-990713256 Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1ec3e66f4339488faf93e315c7487b7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1ec3e66f4339488faf93e315c7487b7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1ec3e66f4339488faf93e315c7487b7e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1ec3e66f4339488faf93e315c7487b7e"}]}] Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-990713256 Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 1ec3e66f4339488faf93e315c7487b7e Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-990713256 Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServerAddressesNegativeTestJSON-990713256-project Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: d90f681305bd4ff380c82f1693613b31 Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-990713256-project Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 999 could not be found. Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'server_id': '999'} Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 25 14:35:55.750946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:35:55.758137 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0cba07ce-870b-4984-9ca5-97cd5e63df33 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Returning 404 to user: Instance 999 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:35:55.760426 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0cba07ce-870b-4984-9ca5-97cd5e63df33 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] 10.222.0.88 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.026598 Jul 25 14:35:55.765008 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1219/2637] 10.222.0.88 () {58 vars in 1149 bytes} [Mon Jul 25 14:35:55 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 25 14:35:55.774423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e64d6c37-8e45-4d57-bc06-828ee8e056cd tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:55.775553 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e64d6c37-8e45-4d57-bc06-828ee8e056cd tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] [instance: 04d99b67-7c1b-4876-a928-e6fa09ec817b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:55.802988 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e64d6c37-8e45-4d57-bc06-828ee8e056cd tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:55.806144 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e64d6c37-8e45-4d57-bc06-828ee8e056cd tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:55.809605 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e64d6c37-8e45-4d57-bc06-828ee8e056cd tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:55.811622 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e64d6c37-8e45-4d57-bc06-828ee8e056cd tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:55.904747 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e64d6c37-8e45-4d57-bc06-828ee8e056cd tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] [instance: 04d99b67-7c1b-4876-a928-e6fa09ec817b] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:35:56.081519 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e64d6c37-8e45-4d57-bc06-828ee8e056cd tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] 10.222.0.88 "DELETE /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b" status: 204 len: 0 microversion: 2.1 time: 0.311151 Jul 25 14:35:56.086167 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1220/2638] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:35:55 2022] DELETE /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 14:35:56.098619 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8b4264c8-9b59-4e3d-b084-b9f8f1aefe30 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:56.101971 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8b4264c8-9b59-4e3d-b084-b9f8f1aefe30 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] [instance: 04d99b67-7c1b-4876-a928-e6fa09ec817b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:56.113265 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b4264c8-9b59-4e3d-b084-b9f8f1aefe30 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:56.113793 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b4264c8-9b59-4e3d-b084-b9f8f1aefe30 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:56.114910 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b4264c8-9b59-4e3d-b084-b9f8f1aefe30 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:56.116299 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b4264c8-9b59-4e3d-b084-b9f8f1aefe30 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:56.339541 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-eec2dccf-3e3b-4523-91fe-773f07e69434 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:56.356771 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-eec2dccf-3e3b-4523-91fe-773f07e69434 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1521 microversion: 2.1 time: 0.653353 Jul 25 14:35:56.359187 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1419/2639] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:55 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1521 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:35:57.026856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8b4264c8-9b59-4e3d-b084-b9f8f1aefe30 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90f681305bd4ff380c82f1693613b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec3e66f4339488faf93e315c7487b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:57.040544 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8b4264c8-9b59-4e3d-b084-b9f8f1aefe30 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] 10.222.0.88 "GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b" status: 200 len: 1528 microversion: 2.1 time: 0.949653 Jul 25 14:35:57.052162 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1221/2640] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:56 2022] GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b => generated 1528 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:57.378931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9795fcba-4631-41f5-83fd-b409750e2b3a tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:57.379558 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9795fcba-4631-41f5-83fd-b409750e2b3a tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:57.394826 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9795fcba-4631-41f5-83fd-b409750e2b3a tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:57.395570 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9795fcba-4631-41f5-83fd-b409750e2b3a tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:57.396809 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9795fcba-4631-41f5-83fd-b409750e2b3a tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:57.400624 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9795fcba-4631-41f5-83fd-b409750e2b3a tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:57.823146 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9795fcba-4631-41f5-83fd-b409750e2b3a tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:57.832972 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9795fcba-4631-41f5-83fd-b409750e2b3a tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1521 microversion: 2.1 time: 0.458002 Jul 25 14:35:57.833961 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1420/2641] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:57 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1521 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:58.066157 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-83462054-d390-4338-85e0-b28c9c233d58 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:58.067025 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-83462054-d390-4338-85e0-b28c9c233d58 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] [instance: 04d99b67-7c1b-4876-a928-e6fa09ec817b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:58.088948 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-83462054-d390-4338-85e0-b28c9c233d58 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:58.090349 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-83462054-d390-4338-85e0-b28c9c233d58 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:58.095899 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-83462054-d390-4338-85e0-b28c9c233d58 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:58.096878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-83462054-d390-4338-85e0-b28c9c233d58 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:58.855624 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1175f659-94fb-49a3-8ed7-cfe3b38da4d6 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:58.857185 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1175f659-94fb-49a3-8ed7-cfe3b38da4d6 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:58.886150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1175f659-94fb-49a3-8ed7-cfe3b38da4d6 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:58.889745 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1175f659-94fb-49a3-8ed7-cfe3b38da4d6 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:58.893069 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1175f659-94fb-49a3-8ed7-cfe3b38da4d6 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:58.893713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1175f659-94fb-49a3-8ed7-cfe3b38da4d6 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:58.893855 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-83462054-d390-4338-85e0-b28c9c233d58 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd90f681305bd4ff380c82f1693613b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec3e66f4339488faf93e315c7487b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:58.903224 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-83462054-d390-4338-85e0-b28c9c233d58 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] 10.222.0.88 "GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b" status: 200 len: 1528 microversion: 2.1 time: 0.843139 Jul 25 14:35:58.906553 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1222/2642] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:58 2022] GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b => generated 1528 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:59.193110 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1175f659-94fb-49a3-8ed7-cfe3b38da4d6 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:35:59.202127 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1175f659-94fb-49a3-8ed7-cfe3b38da4d6 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1521 microversion: 2.1 time: 0.350981 Jul 25 14:35:59.217320 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1421/2643] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:58 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:35:59.291661 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-45d01324-c0ff-405e-9388-736a34d3c1a0 req-317b5ba3-1b7e-452d-9bec-73f2b6263f11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d99b67-7c1b-4876-a928-e6fa09ec817b", "name": "network-vif-deleted", "tag": "eb49678c-f1bd-4258-8260-6851c3b13615"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:59.312276 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-45d01324-c0ff-405e-9388-736a34d3c1a0 req-317b5ba3-1b7e-452d-9bec-73f2b6263f11 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:59.317421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-45d01324-c0ff-405e-9388-736a34d3c1a0 req-317b5ba3-1b7e-452d-9bec-73f2b6263f11 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:59.330935 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-45d01324-c0ff-405e-9388-736a34d3c1a0 req-317b5ba3-1b7e-452d-9bec-73f2b6263f11 service nova] Creating event network-vif-deleted:eb49678c-f1bd-4258-8260-6851c3b13615 for instance 04d99b67-7c1b-4876-a928-e6fa09ec817b on n-h2-846435-14 Jul 25 14:35:59.343427 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-45d01324-c0ff-405e-9388-736a34d3c1a0 req-317b5ba3-1b7e-452d-9bec-73f2b6263f11 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053102 Jul 25 14:35:59.344303 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1422/2644] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:35:59.564036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-62ed7476-334f-4906-bfd3-7b09cee63793 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1961874947", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:35:59.677870 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-62ed7476-334f-4906-bfd3-7b09cee63793 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] validate_networks() for [('f0d31963-aa19-4478-8a48-db619b3cf3f9', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:35:59.936936 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5c1a0fbb-cfdb-4c08-a3e5-7fc00380d629 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:35:59.938928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5c1a0fbb-cfdb-4c08-a3e5-7fc00380d629 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] [instance: 04d99b67-7c1b-4876-a928-e6fa09ec817b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:35:59.961449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c1a0fbb-cfdb-4c08-a3e5-7fc00380d629 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:59.961733 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c1a0fbb-cfdb-4c08-a3e5-7fc00380d629 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:35:59.962690 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c1a0fbb-cfdb-4c08-a3e5-7fc00380d629 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:35:59.973046 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c1a0fbb-cfdb-4c08-a3e5-7fc00380d629 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:00.014373 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-5c1a0fbb-cfdb-4c08-a3e5-7fc00380d629 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] HTTP exception thrown: Instance 04d99b67-7c1b-4876-a928-e6fa09ec817b could not be found. Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5c1a0fbb-cfdb-4c08-a3e5-7fc00380d629 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Request method failure captured: Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b HTTP/1.1 Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qoxyB9NXuhZ8gpNqq87pySq5CjurbdLKPNhmiF8NvmTTNk1LRZlqtjYnYEMnc_sw2chtMgSMTCYT0bXKDsShfNnu5m4HhVPncQE3KPykNBaeKCDgLyap6SJx_nZB3MDEuWIfBQ-xGmNAT69aeKwC8eUkV2OtNef6LpDRbIF1mOq7x4 Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 1ec3e66f4339488faf93e315c7487b7e Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-990713256 Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1ec3e66f4339488faf93e315c7487b7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1ec3e66f4339488faf93e315c7487b7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1ec3e66f4339488faf93e315c7487b7e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1ec3e66f4339488faf93e315c7487b7e"}]}] Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-990713256 Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 1ec3e66f4339488faf93e315c7487b7e Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-990713256 Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerAddressesNegativeTestJSON-990713256-project Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: d90f681305bd4ff380c82f1693613b31 Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-990713256-project Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 04d99b67-7c1b-4876-a928-e6fa09ec817b could not be found. Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '04d99b67-7c1b-4876-a928-e6fa09ec817b'} Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04d99b67-7c1b-4876-a928-e6fa09ec817b could not be found. Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04d99b67-7c1b-4876-a928-e6fa09ec817b could not be found. Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:36:00.021142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:36:00.025321 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:36:00.025321 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:36:00.025321 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:36:00.025321 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:36:00.025321 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:36:00.025321 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:36:00.025321 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04d99b67-7c1b-4876-a928-e6fa09ec817b could not be found. Jul 25 14:36:00.025321 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:36:00.028912 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5c1a0fbb-cfdb-4c08-a3e5-7fc00380d629 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] Returning 404 to user: Instance 04d99b67-7c1b-4876-a928-e6fa09ec817b could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:36:00.033063 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5c1a0fbb-cfdb-4c08-a3e5-7fc00380d629 tempest-ServerAddressesNegativeTestJSON-990713256 tempest-ServerAddressesNegativeTestJSON-990713256-project] 10.222.0.88 "GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b" status: 404 len: 111 microversion: 2.1 time: 0.104951 Jul 25 14:36:00.036482 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1423/2645] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:35:59 2022] GET /compute/v2.1/servers/04d99b67-7c1b-4876-a928-e6fa09ec817b => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:36:00.230339 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f3e549f0-0a33-4f73-aa42-583544acb612 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:00.233437 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f3e549f0-0a33-4f73-aa42-583544acb612 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:00.255530 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f3e549f0-0a33-4f73-aa42-583544acb612 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:00.258479 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f3e549f0-0a33-4f73-aa42-583544acb612 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:00.259689 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f3e549f0-0a33-4f73-aa42-583544acb612 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:00.265569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f3e549f0-0a33-4f73-aa42-583544acb612 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:00.622001 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-62ed7476-334f-4906-bfd3-7b09cee63793 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:36:00.623968 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-62ed7476-334f-4906-bfd3-7b09cee63793 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:36:00.625752 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-62ed7476-334f-4906-bfd3-7b09cee63793 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:36:00.627023 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-62ed7476-334f-4906-bfd3-7b09cee63793 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:36:00.628243 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-62ed7476-334f-4906-bfd3-7b09cee63793 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:36:00.660191 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-62ed7476-334f-4906-bfd3-7b09cee63793 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:00.661508 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-62ed7476-334f-4906-bfd3-7b09cee63793 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:00.664795 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-62ed7476-334f-4906-bfd3-7b09cee63793 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:00.665865 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-62ed7476-334f-4906-bfd3-7b09cee63793 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:00.727932 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-62ed7476-334f-4906-bfd3-7b09cee63793 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Getting quotas for project 3cc39cb570d842d59580e2075f74d50d. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:36:00.736377 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f3e549f0-0a33-4f73-aa42-583544acb612 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:00.749183 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f3e549f0-0a33-4f73-aa42-583544acb612 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1521 microversion: 2.1 time: 0.526190 Jul 25 14:36:00.752584 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1424/2646] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:00 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1521 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:00.754671 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-62ed7476-334f-4906-bfd3-7b09cee63793 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Getting quotas for user 1148d8d49bb94eb497e0c3d867004c33 and project 3cc39cb570d842d59580e2075f74d50d. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:36:00.778977 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-62ed7476-334f-4906-bfd3-7b09cee63793 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:36:00.782989 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-62ed7476-334f-4906-bfd3-7b09cee63793 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:36:00.864076 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-62ed7476-334f-4906-bfd3-7b09cee63793 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.820865 Jul 25 14:36:00.868076 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1223/2647] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:35:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 1826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 14:36:00.884316 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-23023007-03bc-4549-8989-2065e83afa31 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:00.885176 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-23023007-03bc-4549-8989-2065e83afa31 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:01.030898 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-23023007-03bc-4549-8989-2065e83afa31 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:01.043427 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-23023007-03bc-4549-8989-2065e83afa31 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1223 microversion: 2.1 time: 0.167918 Jul 25 14:36:01.056006 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1224/2648] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:00 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1223 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:01.170140 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a614c328-c4fd-49cf-9fcf-da50b1208d4d tempest-AZV2TestJSON-525463053 tempest-AZV2TestJSON-525463053-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:01.171776 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a614c328-c4fd-49cf-9fcf-da50b1208d4d tempest-AZV2TestJSON-525463053 tempest-AZV2TestJSON-525463053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:01.172240 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a614c328-c4fd-49cf-9fcf-da50b1208d4d tempest-AZV2TestJSON-525463053 tempest-AZV2TestJSON-525463053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:01.173178 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a614c328-c4fd-49cf-9fcf-da50b1208d4d tempest-AZV2TestJSON-525463053 tempest-AZV2TestJSON-525463053-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:01.173603 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a614c328-c4fd-49cf-9fcf-da50b1208d4d tempest-AZV2TestJSON-525463053 tempest-AZV2TestJSON-525463053-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:01.240082 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a614c328-c4fd-49cf-9fcf-da50b1208d4d tempest-AZV2TestJSON-525463053 tempest-AZV2TestJSON-525463053-project] 10.222.0.88 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.382075 Jul 25 14:36:01.240960 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1425/2649] 10.222.0.88 () {58 vars in 1164 bytes} [Mon Jul 25 14:36:00 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:36:01.773088 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b8a87ec5-fe0e-452f-bb37-285636bdf96e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:01.774024 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b8a87ec5-fe0e-452f-bb37-285636bdf96e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:01.789266 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8a87ec5-fe0e-452f-bb37-285636bdf96e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:01.789737 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8a87ec5-fe0e-452f-bb37-285636bdf96e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:01.792734 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8a87ec5-fe0e-452f-bb37-285636bdf96e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:01.793592 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8a87ec5-fe0e-452f-bb37-285636bdf96e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:02.066995 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3e5eb4f5-e7b4-4307-9222-0c7adf2362e9 tempest-TenantUsagesNegativeTestJSON-1168454293 tempest-TenantUsagesNegativeTestJSON-1168454293-project-admin] 10.222.0.88 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-24T14%3A36%3A01.572787&end=2022-07-26T14%3A36%3A01.572787" status: 404 len: 112 microversion: - time: 0.490316 Jul 25 14:36:02.069293 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1225/2650] 10.222.0.88 () {58 vars in 1316 bytes} [Mon Jul 25 14:36:01 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-24T14%3A36%3A01.572787&end=2022-07-26T14%3A36%3A01.572787 => generated 112 bytes in 493 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 14:36:02.080021 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0bed7f77-4f7d-49ba-a1e3-123a952ac30d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:02.080876 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0bed7f77-4f7d-49ba-a1e3-123a952ac30d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:02.096905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0bed7f77-4f7d-49ba-a1e3-123a952ac30d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:02.097622 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0bed7f77-4f7d-49ba-a1e3-123a952ac30d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:02.098573 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0bed7f77-4f7d-49ba-a1e3-123a952ac30d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:02.104245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0bed7f77-4f7d-49ba-a1e3-123a952ac30d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:02.249463 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0bed7f77-4f7d-49ba-a1e3-123a952ac30d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:02.265286 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b8a87ec5-fe0e-452f-bb37-285636bdf96e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:02.282980 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b8a87ec5-fe0e-452f-bb37-285636bdf96e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1521 microversion: 2.1 time: 0.513755 Jul 25 14:36:02.284813 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1426/2651] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:01 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1521 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:36:02.295573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-13ad986c-3be3-4c38-b375-aebfb54dd365 tempest-TenantUsagesNegativeTestJSON-1168454293 tempest-TenantUsagesNegativeTestJSON-1168454293-project-admin] Calling method '.version_select at 0x7f46987c5dc0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:02.298722 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0bed7f77-4f7d-49ba-a1e3-123a952ac30d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1227 microversion: 2.1 time: 0.213874 Jul 25 14:36:02.310748 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1226/2652] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:02 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1227 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:02.311504 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-18603f92-3a73-4c50-888b-6809966c3e96 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:02.312493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-18603f92-3a73-4c50-888b-6809966c3e96 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:02.325194 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-13ad986c-3be3-4c38-b375-aebfb54dd365 tempest-TenantUsagesNegativeTestJSON-1168454293 tempest-TenantUsagesNegativeTestJSON-1168454293-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jul 25 14:36:02.347601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-18603f92-3a73-4c50-888b-6809966c3e96 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:02.347601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-18603f92-3a73-4c50-888b-6809966c3e96 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:02.347601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-18603f92-3a73-4c50-888b-6809966c3e96 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-13ad986c-3be3-4c38-b375-aebfb54dd365 tempest-TenantUsagesNegativeTestJSON-1168454293 tempest-TenantUsagesNegativeTestJSON-1168454293-project-admin] Request method failure captured: Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/os-simple-tenant-usage/afb479de6f5d46158241545a15dd35f5?start=2022-07-26T14%3A36%3A01.572787&end=2022-07-24T14%3A36%3A01.572787 HTTP/1.1 Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qpRqwt080CxVF3IdKkPIfRSno90vlZgRcKkGTGs-RkuF4PAXhgC-dl7U_v0m0JKg7npZgHxMrigfxF0Bn-t_nOc4fOiERLIJwRu184100zH4zcaXXyl8JZZxti-zOCSOECbc3BXX6zisAKOD_9Z4aI15zXWGOK9cj83Y3akrNU5L9Q Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 55799f855c97427bb1acaa10e275e5e4 Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1168454293 Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: X-Role: admin,reader,member Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: admin,reader,member Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/55799f855c97427bb1acaa10e275e5e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/55799f855c97427bb1acaa10e275e5e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_55799f855c97427bb1acaa10e275e5e4", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/55799f855c97427bb1acaa10e275e5e4"}]}] Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1168454293 Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 55799f855c97427bb1acaa10e275e5e4 Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1168454293 Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-TenantUsagesNegativeTestJSON-1168454293-project-admin Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: e81846b7b3604a93b2fa61ee9f52a42f Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1168454293-project-admin Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: exception: Invalid start time. The start time cannot occur after the end time. Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'afb479de6f5d46158241545a15dd35f5'} Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jul 25 14:36:02.360515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:36:02.364357 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-13ad986c-3be3-4c38-b375-aebfb54dd365 tempest-TenantUsagesNegativeTestJSON-1168454293 tempest-TenantUsagesNegativeTestJSON-1168454293-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:36:02.364357 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-13ad986c-3be3-4c38-b375-aebfb54dd365 tempest-TenantUsagesNegativeTestJSON-1168454293 tempest-TenantUsagesNegativeTestJSON-1168454293-project-admin] 10.222.0.88 "GET /compute/v2.1/os-simple-tenant-usage/afb479de6f5d46158241545a15dd35f5?start=2022-07-26T14%3A36%3A01.572787&end=2022-07-24T14%3A36%3A01.572787" status: 400 len: 111 microversion: 2.1 time: 0.076349 Jul 25 14:36:02.368788 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1427/2653] 10.222.0.88 () {58 vars in 1412 bytes} [Mon Jul 25 14:36:02 2022] GET /compute/v2.1/os-simple-tenant-usage/afb479de6f5d46158241545a15dd35f5?start=2022-07-26T14%3A36%3A01.572787&end=2022-07-24T14%3A36%3A01.572787 => generated 111 bytes in 83 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:36:02.371697 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-18603f92-3a73-4c50-888b-6809966c3e96 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:02.435059 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-18603f92-3a73-4c50-888b-6809966c3e96 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60/ips" status: 200 len: 151 microversion: 2.20 time: 0.129352 Jul 25 14:36:02.437301 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1227/2654] 10.222.0.88 () {60 vars in 1289 bytes} [Mon Jul 25 14:36:02 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60/ips => generated 151 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:36:02.613817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b44b1a16-2790-43e4-99e4-0ed9f4fc5143 tempest-TenantUsagesNegativeTestJSON-939310189 tempest-TenantUsagesNegativeTestJSON-939310189-project] Calling method '.version_select at 0x7f46875329d0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:02.623491 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b44b1a16-2790-43e4-99e4-0ed9f4fc5143 tempest-TenantUsagesNegativeTestJSON-939310189 tempest-TenantUsagesNegativeTestJSON-939310189-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '1217468be17a461391431d21d1f1accb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb479de6f5d46158241545a15dd35f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b44b1a16-2790-43e4-99e4-0ed9f4fc5143 tempest-TenantUsagesNegativeTestJSON-939310189 tempest-TenantUsagesNegativeTestJSON-939310189-project] Request method failure captured: Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-24T14%3A36%3A01.572787&end=2022-07-26T14%3A36%3A01.572787&detailed=1 HTTP/1.1 Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qpPy9m4nPygQCs9pfLUzWb9PsBFr1zIgvV9LU_B0wMDS8KUaJW6vcKgGymT4QfJ8WlWqQkrd2jGvrtVIaRjbgnrn5wbs62T-H6qtubmsS63Yvb00PfFNswG22BV4Qn8gKwxGWXB9sKm1pc7yYcIGrkHBMDSAhgcfJjTyTrhS-EFtds Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: afb479de6f5d46158241545a15dd35f5 Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-939310189 Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/afb479de6f5d46158241545a15dd35f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/afb479de6f5d46158241545a15dd35f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_afb479de6f5d46158241545a15dd35f5", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/afb479de6f5d46158241545a15dd35f5"}]}] Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-939310189 Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: afb479de6f5d46158241545a15dd35f5 Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-939310189 Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-TenantUsagesNegativeTestJSON-939310189-project Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 1217468be17a461391431d21d1f1accb Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-939310189-project Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: action_args: {} Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 14:36:02.633095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 14:36:02.638025 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 25 14:36:02.638025 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:36:02.638025 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:36:02.638025 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:36:02.638025 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:36:02.638025 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:36:02.638025 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:36:02.638025 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 14:36:02.638025 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 14:36:02.638025 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 25 14:36:02.638025 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:36:02.651894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b44b1a16-2790-43e4-99e4-0ed9f4fc5143 tempest-TenantUsagesNegativeTestJSON-939310189 tempest-TenantUsagesNegativeTestJSON-939310189-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:36:02.653406 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b44b1a16-2790-43e4-99e4-0ed9f4fc5143 tempest-TenantUsagesNegativeTestJSON-939310189 tempest-TenantUsagesNegativeTestJSON-939310189-project] 10.222.0.88 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-24T14%3A36%3A01.572787&end=2022-07-26T14%3A36%3A01.572787&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.278443 Jul 25 14:36:02.654516 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1428/2655] 10.222.0.88 () {58 vars in 1335 bytes} [Mon Jul 25 14:36:02 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-24T14%3A36%3A01.572787&end=2022-07-26T14%3A36%3A01.572787&detailed=1 => generated 123 bytes in 280 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:36:03.309394 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ffff89c4-3102-4ab2-8925-29b7f51ffdf7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:03.310065 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ffff89c4-3102-4ab2-8925-29b7f51ffdf7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:03.332378 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ffff89c4-3102-4ab2-8925-29b7f51ffdf7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:03.334417 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2f0a5c28-435b-4a7f-8770-edb646d1c5d3 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:03.335640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2f0a5c28-435b-4a7f-8770-edb646d1c5d3 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:03.341720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ffff89c4-3102-4ab2-8925-29b7f51ffdf7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:03.347252 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ffff89c4-3102-4ab2-8925-29b7f51ffdf7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:03.347894 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ffff89c4-3102-4ab2-8925-29b7f51ffdf7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:03.353095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2f0a5c28-435b-4a7f-8770-edb646d1c5d3 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:03.353555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2f0a5c28-435b-4a7f-8770-edb646d1c5d3 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:03.354351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2f0a5c28-435b-4a7f-8770-edb646d1c5d3 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:03.354787 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2f0a5c28-435b-4a7f-8770-edb646d1c5d3 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:03.737529 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2f0a5c28-435b-4a7f-8770-edb646d1c5d3 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:03.755780 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2f0a5c28-435b-4a7f-8770-edb646d1c5d3 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1293 microversion: 2.1 time: 0.422649 Jul 25 14:36:03.758478 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1429/2656] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:03 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1293 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:36:04.415518 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ffff89c4-3102-4ab2-8925-29b7f51ffdf7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:04.442557 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ffff89c4-3102-4ab2-8925-29b7f51ffdf7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1521 microversion: 2.1 time: 1.123377 Jul 25 14:36:04.455086 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1228/2657] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:03 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1521 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:04.779512 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f0042d6c-9962-408b-a33a-433e26c0c02d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:04.780894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f0042d6c-9962-408b-a33a-433e26c0c02d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:04.808844 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0042d6c-9962-408b-a33a-433e26c0c02d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:04.809647 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0042d6c-9962-408b-a33a-433e26c0c02d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:04.810671 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0042d6c-9962-408b-a33a-433e26c0c02d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:04.811337 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0042d6c-9962-408b-a33a-433e26c0c02d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:05.336345 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f0042d6c-9962-408b-a33a-433e26c0c02d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:05.348668 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f0042d6c-9962-408b-a33a-433e26c0c02d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1281 microversion: 2.1 time: 0.573093 Jul 25 14:36:05.353669 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1430/2658] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:04 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1281 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:05.478562 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f1e0e655-b982-4e10-89f0-7f5d7ce93080 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:05.485891 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f1e0e655-b982-4e10-89f0-7f5d7ce93080 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:05.495332 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f1e0e655-b982-4e10-89f0-7f5d7ce93080 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:05.496528 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f1e0e655-b982-4e10-89f0-7f5d7ce93080 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:05.497485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f1e0e655-b982-4e10-89f0-7f5d7ce93080 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:05.498075 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f1e0e655-b982-4e10-89f0-7f5d7ce93080 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:05.504197 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:36:05.849511 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f1e0e655-b982-4e10-89f0-7f5d7ce93080 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:05.868892 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f1e0e655-b982-4e10-89f0-7f5d7ce93080 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1521 microversion: 2.1 time: 0.395626 Jul 25 14:36:05.874221 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1229/2659] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:05 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1521 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:05.879866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9f856624-5cbe-44b9-b3c6-96da406e6b2f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:36:05.883841 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9f856624-5cbe-44b9-b3c6-96da406e6b2f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:05.922441 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f856624-5cbe-44b9-b3c6-96da406e6b2f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:05.925036 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f856624-5cbe-44b9-b3c6-96da406e6b2f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:05.928020 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f856624-5cbe-44b9-b3c6-96da406e6b2f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:05.931550 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f856624-5cbe-44b9-b3c6-96da406e6b2f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:06.058588 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-9f856624-5cbe-44b9-b3c6-96da406e6b2f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lazy-loading 'flavor' on Instance uuid f1009be4-53ff-4893-836c-ba96f07a0d60 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:36:06.380485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c3051c06-b58d-41c5-a188-cb91e29bc4e3 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:06.387068 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c3051c06-b58d-41c5-a188-cb91e29bc4e3 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:06.398151 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c3051c06-b58d-41c5-a188-cb91e29bc4e3 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:06.400738 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c3051c06-b58d-41c5-a188-cb91e29bc4e3 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:06.413827 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c3051c06-b58d-41c5-a188-cb91e29bc4e3 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:06.423264 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c3051c06-b58d-41c5-a188-cb91e29bc4e3 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:06.467998 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9f856624-5cbe-44b9-b3c6-96da406e6b2f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "POST /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60/action" status: 202 len: 0 microversion: 2.20 time: 0.575709 Jul 25 14:36:06.470868 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1431/2660] 10.222.0.88 () {62 vars in 1319 bytes} [Mon Jul 25 14:36:05 2022] POST /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60/action => generated 0 bytes in 600 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:36:06.505732 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7bbba0fb-a479-4386-87eb-fc1d82676d42 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:06.513111 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7bbba0fb-a479-4386-87eb-fc1d82676d42 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:06.529515 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7bbba0fb-a479-4386-87eb-fc1d82676d42 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:06.532344 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7bbba0fb-a479-4386-87eb-fc1d82676d42 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:06.534188 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7bbba0fb-a479-4386-87eb-fc1d82676d42 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:06.537286 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7bbba0fb-a479-4386-87eb-fc1d82676d42 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:07.170640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7bbba0fb-a479-4386-87eb-fc1d82676d42 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:07.189459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7bbba0fb-a479-4386-87eb-fc1d82676d42 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:07.196337 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7bbba0fb-a479-4386-87eb-fc1d82676d42 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:07.199592 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7bbba0fb-a479-4386-87eb-fc1d82676d42 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1723 microversion: 2.20 time: 0.724278 Jul 25 14:36:07.200870 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1432/2661] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:36:06 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1723 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:36:07.221043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-51880a23-4d9a-42ac-b2f0-f137c1e09962 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:07.222332 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-51880a23-4d9a-42ac-b2f0-f137c1e09962 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:07.236687 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51880a23-4d9a-42ac-b2f0-f137c1e09962 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:07.237750 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51880a23-4d9a-42ac-b2f0-f137c1e09962 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:07.238733 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51880a23-4d9a-42ac-b2f0-f137c1e09962 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:07.239583 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51880a23-4d9a-42ac-b2f0-f137c1e09962 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:07.459683 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c3051c06-b58d-41c5-a188-cb91e29bc4e3 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:07.473242 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c3051c06-b58d-41c5-a188-cb91e29bc4e3 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1323 microversion: 2.1 time: 1.096524 Jul 25 14:36:07.495879 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1230/2662] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:06 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1323 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:08.085606 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-51880a23-4d9a-42ac-b2f0-f137c1e09962 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:08.095071 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-51880a23-4d9a-42ac-b2f0-f137c1e09962 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1521 microversion: 2.1 time: 0.892765 Jul 25 14:36:08.099916 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1433/2663] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:07 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1521 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:08.227129 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d527879f-2ee5-4309-8c46-890184ec344c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:08.228617 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d527879f-2ee5-4309-8c46-890184ec344c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:08.238868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d527879f-2ee5-4309-8c46-890184ec344c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:08.239359 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d527879f-2ee5-4309-8c46-890184ec344c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:08.242012 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d527879f-2ee5-4309-8c46-890184ec344c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:08.242800 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d527879f-2ee5-4309-8c46-890184ec344c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:08.625616 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-538c791f-562e-4eef-8bef-01ceb6605f6a req-a6b6d41e-ec39-4740-83d4-6f9f79d690c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "756ffb6d-8123-4743-97b5-e3153a7fc28e", "tag": "6fdb0b84-35b3-4673-9dfe-8ceebbbd3e3d"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:36:08.653156 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-538c791f-562e-4eef-8bef-01ceb6605f6a req-a6b6d41e-ec39-4740-83d4-6f9f79d690c8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:08.654044 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-538c791f-562e-4eef-8bef-01ceb6605f6a req-a6b6d41e-ec39-4740-83d4-6f9f79d690c8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:08.672032 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-538c791f-562e-4eef-8bef-01ceb6605f6a req-a6b6d41e-ec39-4740-83d4-6f9f79d690c8 service nova] Creating event network-changed:6fdb0b84-35b3-4673-9dfe-8ceebbbd3e3d for instance 756ffb6d-8123-4743-97b5-e3153a7fc28e on n-h2-846435-14 Jul 25 14:36:08.680126 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-538c791f-562e-4eef-8bef-01ceb6605f6a req-a6b6d41e-ec39-4740-83d4-6f9f79d690c8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.629808 Jul 25 14:36:08.681611 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1231/2664] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:36:08.688687 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-61c02d04-f0df-49b5-ba0a-a76f275f0491 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:08.690689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-61c02d04-f0df-49b5-ba0a-a76f275f0491 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:08.699149 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-61c02d04-f0df-49b5-ba0a-a76f275f0491 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:08.700326 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-61c02d04-f0df-49b5-ba0a-a76f275f0491 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:08.701312 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-61c02d04-f0df-49b5-ba0a-a76f275f0491 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:08.701918 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-61c02d04-f0df-49b5-ba0a-a76f275f0491 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:08.809467 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d527879f-2ee5-4309-8c46-890184ec344c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:08.828146 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d527879f-2ee5-4309-8c46-890184ec344c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:08.830936 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d527879f-2ee5-4309-8c46-890184ec344c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:08.834980 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d527879f-2ee5-4309-8c46-890184ec344c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1723 microversion: 2.20 time: 0.609390 Jul 25 14:36:08.838376 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1434/2665] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:36:08 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1723 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:36:09.141174 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-61c02d04-f0df-49b5-ba0a-a76f275f0491 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:09.143957 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-89f27c08-1120-4c5c-a40e-ba2eea6f5490 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:09.154791 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-89f27c08-1120-4c5c-a40e-ba2eea6f5490 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:09.162679 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-61c02d04-f0df-49b5-ba0a-a76f275f0491 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1323 microversion: 2.1 time: 0.479425 Jul 25 14:36:09.163678 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1232/2666] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:08 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1323 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:09.216527 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-89f27c08-1120-4c5c-a40e-ba2eea6f5490 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:09.220779 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-89f27c08-1120-4c5c-a40e-ba2eea6f5490 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:09.225665 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-89f27c08-1120-4c5c-a40e-ba2eea6f5490 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:09.229352 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-89f27c08-1120-4c5c-a40e-ba2eea6f5490 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:09.519544 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-89f27c08-1120-4c5c-a40e-ba2eea6f5490 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:09.535456 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-89f27c08-1120-4c5c-a40e-ba2eea6f5490 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1521 microversion: 2.1 time: 0.417119 Jul 25 14:36:09.537360 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1435/2667] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:09 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1521 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:09.865825 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-70ee0abf-9ac9-4987-b1fb-3a079a275040 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:09.866689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-70ee0abf-9ac9-4987-b1fb-3a079a275040 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:09.884272 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70ee0abf-9ac9-4987-b1fb-3a079a275040 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:09.886185 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70ee0abf-9ac9-4987-b1fb-3a079a275040 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:09.892319 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70ee0abf-9ac9-4987-b1fb-3a079a275040 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:09.893140 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70ee0abf-9ac9-4987-b1fb-3a079a275040 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:10.186963 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9d0023d6-216b-4216-a17e-dc51a31f5b76 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:10.187595 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9d0023d6-216b-4216-a17e-dc51a31f5b76 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:10.197064 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d0023d6-216b-4216-a17e-dc51a31f5b76 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:10.200757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d0023d6-216b-4216-a17e-dc51a31f5b76 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:10.202907 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d0023d6-216b-4216-a17e-dc51a31f5b76 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:10.204750 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d0023d6-216b-4216-a17e-dc51a31f5b76 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:10.324130 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-70ee0abf-9ac9-4987-b1fb-3a079a275040 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:10.333623 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-70ee0abf-9ac9-4987-b1fb-3a079a275040 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:10.342276 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-70ee0abf-9ac9-4987-b1fb-3a079a275040 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:10.344237 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-70ee0abf-9ac9-4987-b1fb-3a079a275040 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1723 microversion: 2.20 time: 0.484179 Jul 25 14:36:10.361260 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1233/2668] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:36:09 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1723 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:36:10.550059 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9d0023d6-216b-4216-a17e-dc51a31f5b76 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:10.559859 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-93137ee1-c673-4e14-bfdd-1d4e18e19882 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:10.561597 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-93137ee1-c673-4e14-bfdd-1d4e18e19882 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:10.575259 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:36:10.576673 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9d0023d6-216b-4216-a17e-dc51a31f5b76 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1323 microversion: 2.1 time: 0.393715 Jul 25 14:36:10.579296 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93137ee1-c673-4e14-bfdd-1d4e18e19882 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:10.581041 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93137ee1-c673-4e14-bfdd-1d4e18e19882 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:10.582993 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93137ee1-c673-4e14-bfdd-1d4e18e19882 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:10.585589 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93137ee1-c673-4e14-bfdd-1d4e18e19882 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:10.589753 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1436/2669] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:10 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1323 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:10.705576 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=8 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:36:10.888207 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-93137ee1-c673-4e14-bfdd-1d4e18e19882 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:10.906082 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-93137ee1-c673-4e14-bfdd-1d4e18e19882 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1521 microversion: 2.1 time: 0.351228 Jul 25 14:36:10.908129 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1234/2670] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:10 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:11.288491 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f8b7fda8-69fa-444e-b5fd-ee9d1a3057c3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1885590955", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "9e0e98c7-e5b7-4308-ae4f-fa50e9a340ed"}], "block_device_mapping_v2": [{"uuid": "0f9b0ff7-a0b8-484b-84e4-0c4f928be5c4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:36:11.305251 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=26 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:36:11.376180 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-f8b7fda8-69fa-444e-b5fd-ee9d1a3057c3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] validate_networks() for [('9e0e98c7-e5b7-4308-ae4f-fa50e9a340ed', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:36:11.387961 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7c663dda-236c-43c8-8b2a-991b9a477408 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:11.390020 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7c663dda-236c-43c8-8b2a-991b9a477408 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:11.394847 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=8 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:36:11.404110 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7c663dda-236c-43c8-8b2a-991b9a477408 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:11.404576 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7c663dda-236c-43c8-8b2a-991b9a477408 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:11.405423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7c663dda-236c-43c8-8b2a-991b9a477408 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:11.405867 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7c663dda-236c-43c8-8b2a-991b9a477408 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:11.752569 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7c663dda-236c-43c8-8b2a-991b9a477408 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:11.780043 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7c663dda-236c-43c8-8b2a-991b9a477408 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:11.785341 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7c663dda-236c-43c8-8b2a-991b9a477408 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:11.788520 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7c663dda-236c-43c8-8b2a-991b9a477408 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1723 microversion: 2.20 time: 0.416119 Jul 25 14:36:11.791792 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1235/2671] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:36:11 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1723 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:36:11.819229 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f56d4478-7976-4bca-ba8a-20a6aef9a9a1 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:11.820521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f56d4478-7976-4bca-ba8a-20a6aef9a9a1 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:11.847179 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f56d4478-7976-4bca-ba8a-20a6aef9a9a1 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:11.847692 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f56d4478-7976-4bca-ba8a-20a6aef9a9a1 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:11.848475 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f56d4478-7976-4bca-ba8a-20a6aef9a9a1 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:11.850243 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f56d4478-7976-4bca-ba8a-20a6aef9a9a1 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:12.796670 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f8b7fda8-69fa-444e-b5fd-ee9d1a3057c3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:36:12.797177 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f8b7fda8-69fa-444e-b5fd-ee9d1a3057c3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:36:12.797540 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f8b7fda8-69fa-444e-b5fd-ee9d1a3057c3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:36:12.797942 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f8b7fda8-69fa-444e-b5fd-ee9d1a3057c3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:36:12.798350 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f8b7fda8-69fa-444e-b5fd-ee9d1a3057c3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:36:12.809743 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8b7fda8-69fa-444e-b5fd-ee9d1a3057c3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:12.810584 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8b7fda8-69fa-444e-b5fd-ee9d1a3057c3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:12.813257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8b7fda8-69fa-444e-b5fd-ee9d1a3057c3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:12.813881 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8b7fda8-69fa-444e-b5fd-ee9d1a3057c3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:12.845290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-f8b7fda8-69fa-444e-b5fd-ee9d1a3057c3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Getting quotas for project ceaa4430d1864bc2bf9afdec9cd0cf64. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:36:12.851421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-f8b7fda8-69fa-444e-b5fd-ee9d1a3057c3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Getting quotas for user 3da7c9a3c01f4dbca93d5e7aa688fc70 and project ceaa4430d1864bc2bf9afdec9cd0cf64. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:36:12.913028 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f56d4478-7976-4bca-ba8a-20a6aef9a9a1 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:12.932187 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f56d4478-7976-4bca-ba8a-20a6aef9a9a1 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1323 microversion: 2.1 time: 1.138651 Jul 25 14:36:12.936233 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1236/2672] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:11 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1323 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:12.947278 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-66eeac1d-1ee2-4f02-b19d-6238caf19234 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:12.947903 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-66eeac1d-1ee2-4f02-b19d-6238caf19234 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:12.958506 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f8b7fda8-69fa-444e-b5fd-ee9d1a3057c3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:36:12.960872 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-66eeac1d-1ee2-4f02-b19d-6238caf19234 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:12.962012 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-66eeac1d-1ee2-4f02-b19d-6238caf19234 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:12.962176 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-66eeac1d-1ee2-4f02-b19d-6238caf19234 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:12.962682 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-66eeac1d-1ee2-4f02-b19d-6238caf19234 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:12.964577 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f8b7fda8-69fa-444e-b5fd-ee9d1a3057c3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0f9b0ff7-a0b8-484b-84e4-0c4f928be5c4',volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:36:13.261261 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f8b7fda8-69fa-444e-b5fd-ee9d1a3057c3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.975498 Jul 25 14:36:13.265281 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1437/2673] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:36:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:36:13.277087 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e098de43-8e8e-47f3-8cf8-cc4c931274fa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:13.281013 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e098de43-8e8e-47f3-8cf8-cc4c931274fa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:13.291736 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e098de43-8e8e-47f3-8cf8-cc4c931274fa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:13.292571 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e098de43-8e8e-47f3-8cf8-cc4c931274fa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:13.293533 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e098de43-8e8e-47f3-8cf8-cc4c931274fa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:13.294121 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e098de43-8e8e-47f3-8cf8-cc4c931274fa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:13.324068 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:36:14.147117 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e098de43-8e8e-47f3-8cf8-cc4c931274fa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:14.159031 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e098de43-8e8e-47f3-8cf8-cc4c931274fa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:14.164763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e098de43-8e8e-47f3-8cf8-cc4c931274fa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:14.174409 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e098de43-8e8e-47f3-8cf8-cc4c931274fa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1723 microversion: 2.20 time: 0.907701 Jul 25 14:36:14.175245 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1438/2674] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:36:13 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1723 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:36:14.180669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1305379a-796d-4280-b3bf-85ae2cc6aef3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:14.185812 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1305379a-796d-4280-b3bf-85ae2cc6aef3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:14.200651 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1305379a-796d-4280-b3bf-85ae2cc6aef3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:14.202218 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1305379a-796d-4280-b3bf-85ae2cc6aef3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:14.204590 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1305379a-796d-4280-b3bf-85ae2cc6aef3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:14.208055 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1305379a-796d-4280-b3bf-85ae2cc6aef3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:14.334161 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-66eeac1d-1ee2-4f02-b19d-6238caf19234 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:14.352882 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-66eeac1d-1ee2-4f02-b19d-6238caf19234 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1521 microversion: 2.1 time: 1.412196 Jul 25 14:36:14.360472 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1237/2675] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:12 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1521 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:14.374206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c1e3bfaf-dcc1-4d6c-b618-dee4f19f23fd tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:14.382411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c1e3bfaf-dcc1-4d6c-b618-dee4f19f23fd tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:14.403200 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c1e3bfaf-dcc1-4d6c-b618-dee4f19f23fd tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:14.406988 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c1e3bfaf-dcc1-4d6c-b618-dee4f19f23fd tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:14.412375 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c1e3bfaf-dcc1-4d6c-b618-dee4f19f23fd tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:14.413311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c1e3bfaf-dcc1-4d6c-b618-dee4f19f23fd tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:14.463416 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1305379a-796d-4280-b3bf-85ae2cc6aef3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:14.481096 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1305379a-796d-4280-b3bf-85ae2cc6aef3 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1103 microversion: 2.1 time: 0.304504 Jul 25 14:36:14.483105 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1439/2676] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:14 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1103 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:14.892516 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c1e3bfaf-dcc1-4d6c-b618-dee4f19f23fd tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:14.902882 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c1e3bfaf-dcc1-4d6c-b618-dee4f19f23fd tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1323 microversion: 2.1 time: 0.540900 Jul 25 14:36:14.909713 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1238/2677] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:14 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1323 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:15.201471 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d1b5d7f0-c880-48e9-8e36-4e47315701f6 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:15.202870 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d1b5d7f0-c880-48e9-8e36-4e47315701f6 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:15.214123 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1b5d7f0-c880-48e9-8e36-4e47315701f6 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:15.214970 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1b5d7f0-c880-48e9-8e36-4e47315701f6 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:15.217772 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1b5d7f0-c880-48e9-8e36-4e47315701f6 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:15.218427 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1b5d7f0-c880-48e9-8e36-4e47315701f6 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:15.384624 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2f853a3f-15e8-47a5-903f-e5f2e11524d1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:15.385254 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2f853a3f-15e8-47a5-903f-e5f2e11524d1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:15.402159 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f853a3f-15e8-47a5-903f-e5f2e11524d1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:15.402638 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f853a3f-15e8-47a5-903f-e5f2e11524d1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:15.403563 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f853a3f-15e8-47a5-903f-e5f2e11524d1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:15.404018 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f853a3f-15e8-47a5-903f-e5f2e11524d1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:15.534466 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d1b5d7f0-c880-48e9-8e36-4e47315701f6 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:15.552385 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d1b5d7f0-c880-48e9-8e36-4e47315701f6 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:15.555271 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d1b5d7f0-c880-48e9-8e36-4e47315701f6 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:15.557094 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d1b5d7f0-c880-48e9-8e36-4e47315701f6 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1723 microversion: 2.20 time: 0.361643 Jul 25 14:36:15.559218 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1440/2678] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:36:15 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1723 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:36:15.567383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5d21fcf6-0025-4264-8319-e23996a78019 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:15.572376 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5d21fcf6-0025-4264-8319-e23996a78019 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:15.617737 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d21fcf6-0025-4264-8319-e23996a78019 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:15.618919 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d21fcf6-0025-4264-8319-e23996a78019 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:15.620196 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d21fcf6-0025-4264-8319-e23996a78019 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:15.620948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d21fcf6-0025-4264-8319-e23996a78019 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:16.162460 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5d21fcf6-0025-4264-8319-e23996a78019 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:16.178932 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5d21fcf6-0025-4264-8319-e23996a78019 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1169 microversion: 2.1 time: 0.615598 Jul 25 14:36:16.183461 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1441/2679] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:15 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1169 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:16.193999 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e2dcf2e3-54aa-44b4-bac5-ca4f7359f65f tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:16.203776 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e2dcf2e3-54aa-44b4-bac5-ca4f7359f65f tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:16.226455 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2dcf2e3-54aa-44b4-bac5-ca4f7359f65f tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:16.227105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2dcf2e3-54aa-44b4-bac5-ca4f7359f65f tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:16.229035 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2dcf2e3-54aa-44b4-bac5-ca4f7359f65f tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:16.230066 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2dcf2e3-54aa-44b4-bac5-ca4f7359f65f tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:16.317168 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2f853a3f-15e8-47a5-903f-e5f2e11524d1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:16.342972 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2f853a3f-15e8-47a5-903f-e5f2e11524d1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1521 microversion: 2.1 time: 0.962082 Jul 25 14:36:16.343610 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1239/2680] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:15 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1521 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:16.587906 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5afea329-b329-4fa4-bdf1-67e7d2615515 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:16.589357 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5afea329-b329-4fa4-bdf1-67e7d2615515 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:16.630533 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5afea329-b329-4fa4-bdf1-67e7d2615515 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:16.630994 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5afea329-b329-4fa4-bdf1-67e7d2615515 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:16.631797 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5afea329-b329-4fa4-bdf1-67e7d2615515 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:16.644508 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5afea329-b329-4fa4-bdf1-67e7d2615515 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:17.288517 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e2dcf2e3-54aa-44b4-bac5-ca4f7359f65f tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:17.301942 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e2dcf2e3-54aa-44b4-bac5-ca4f7359f65f tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1323 microversion: 2.1 time: 1.116951 Jul 25 14:36:17.307862 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5afea329-b329-4fa4-bdf1-67e7d2615515 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:17.320462 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1442/2681] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:16 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1323 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:17.329538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5afea329-b329-4fa4-bdf1-67e7d2615515 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:17.331066 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5afea329-b329-4fa4-bdf1-67e7d2615515 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:17.332578 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5afea329-b329-4fa4-bdf1-67e7d2615515 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1723 microversion: 2.20 time: 0.750680 Jul 25 14:36:17.333285 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1fc768e5-519f-4bdb-9396-b549966b8007 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:17.334113 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1fc768e5-519f-4bdb-9396-b549966b8007 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:17.334344 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1240/2682] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:36:16 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1723 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:36:17.367383 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c501143c-8c38-4d60-9b0b-7ebe1abde92b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:17.368382 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c501143c-8c38-4d60-9b0b-7ebe1abde92b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:17.375617 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c501143c-8c38-4d60-9b0b-7ebe1abde92b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:17.376414 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c501143c-8c38-4d60-9b0b-7ebe1abde92b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:17.377372 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c501143c-8c38-4d60-9b0b-7ebe1abde92b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:17.377962 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c501143c-8c38-4d60-9b0b-7ebe1abde92b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:17.393363 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1fc768e5-519f-4bdb-9396-b549966b8007 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:17.393824 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1fc768e5-519f-4bdb-9396-b549966b8007 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:17.394679 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1fc768e5-519f-4bdb-9396-b549966b8007 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:17.395468 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1fc768e5-519f-4bdb-9396-b549966b8007 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:17.845302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1fc768e5-519f-4bdb-9396-b549966b8007 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:17.857851 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1fc768e5-519f-4bdb-9396-b549966b8007 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1169 microversion: 2.1 time: 0.535918 Jul 25 14:36:17.859266 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1443/2683] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:17 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1169 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:17.905149 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c501143c-8c38-4d60-9b0b-7ebe1abde92b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:17.918713 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c501143c-8c38-4d60-9b0b-7ebe1abde92b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1521 microversion: 2.1 time: 0.555342 Jul 25 14:36:17.919923 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1241/2684] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:17 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1521 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:18.329896 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-58eb1810-8ec3-4db7-836e-846b9e7921f3 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:18.330676 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-58eb1810-8ec3-4db7-836e-846b9e7921f3 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:18.343296 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-58eb1810-8ec3-4db7-836e-846b9e7921f3 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:18.345164 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-58eb1810-8ec3-4db7-836e-846b9e7921f3 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:18.347276 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-58eb1810-8ec3-4db7-836e-846b9e7921f3 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:18.347696 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-58eb1810-8ec3-4db7-836e-846b9e7921f3 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:18.362264 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ffd03528-a85d-4347-8390-127d8d7b939f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:18.362890 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ffd03528-a85d-4347-8390-127d8d7b939f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:18.375678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ffd03528-a85d-4347-8390-127d8d7b939f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:18.376166 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ffd03528-a85d-4347-8390-127d8d7b939f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:18.383068 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ffd03528-a85d-4347-8390-127d8d7b939f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:18.385976 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ffd03528-a85d-4347-8390-127d8d7b939f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:19.352595 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ffd03528-a85d-4347-8390-127d8d7b939f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:19.368991 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ffd03528-a85d-4347-8390-127d8d7b939f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:19.372131 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ffd03528-a85d-4347-8390-127d8d7b939f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:19.375705 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ffd03528-a85d-4347-8390-127d8d7b939f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1723 microversion: 2.20 time: 1.017456 Jul 25 14:36:19.379490 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1242/2685] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:36:18 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1723 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:36:19.384879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-58eb1810-8ec3-4db7-836e-846b9e7921f3 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:19.398741 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-58eb1810-8ec3-4db7-836e-846b9e7921f3 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1323 microversion: 2.1 time: 1.072189 Jul 25 14:36:19.399385 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1444/2686] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:18 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1323 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:19.417436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2e066443-0515-40d1-aaf1-7b9b2b0687f2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:19.419148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2e066443-0515-40d1-aaf1-7b9b2b0687f2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:19.441391 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2e066443-0515-40d1-aaf1-7b9b2b0687f2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:19.442211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2e066443-0515-40d1-aaf1-7b9b2b0687f2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:19.443253 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2e066443-0515-40d1-aaf1-7b9b2b0687f2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:19.445103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2e066443-0515-40d1-aaf1-7b9b2b0687f2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:19.716981 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6d757881-2068-4eba-bf38-80f7b32a410a tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Action: 'create', calling method: .version_select at 0x7f46875a05e0>, body: {"keypair": {"name": "tempest-keypair-93697299", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRYecsKmUP5GQToF7mB/JDcHq/oUnRlFVr0t9n+CmYr5/ihWT0wbUUf4No9vQt1odqyajC1VD/YAaGNrdixIQIWqV5BuFwOx+jNN0ziMEAPtEiCE+IH6dPf4bFU8cXeTQ=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:36:19.759025 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-6d757881-2068-4eba-bf38-80f7b32a410a tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Getting quotas for project f07edb35c2dd48ef9ea6583468a9b46f. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:36:19.775733 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-6d757881-2068-4eba-bf38-80f7b32a410a tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Getting quotas for user eb708222f6ee4225b1fe18848fb6a1f8 and project f07edb35c2dd48ef9ea6583468a9b46f. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:36:19.843312 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6d757881-2068-4eba-bf38-80f7b32a410a tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.462293 Jul 25 14:36:19.846737 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1243/2687] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:36:19 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:36:19.862055 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-68f617a1-a8f7-4847-a945-88de33dee7e5 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:19.862868 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-68f617a1-a8f7-4847-a945-88de33dee7e5 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:19.885894 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-68f617a1-a8f7-4847-a945-88de33dee7e5 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:19.887510 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-68f617a1-a8f7-4847-a945-88de33dee7e5 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:19.888641 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-68f617a1-a8f7-4847-a945-88de33dee7e5 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:19.896547 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-68f617a1-a8f7-4847-a945-88de33dee7e5 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:20.224460 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2e066443-0515-40d1-aaf1-7b9b2b0687f2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:20.232375 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2e066443-0515-40d1-aaf1-7b9b2b0687f2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1211 microversion: 2.1 time: 0.828506 Jul 25 14:36:20.248358 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1445/2688] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:19 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1211 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:20.396250 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-547e6a19-8a91-43d8-acd6-02a98d6bf613 req-02828ee4-57db-470f-80b0-521c5e73fb1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "756ffb6d-8123-4743-97b5-e3153a7fc28e", "name": "network-vif-plugged", "status": "completed", "tag": "6fdb0b84-35b3-4673-9dfe-8ceebbbd3e3d"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:36:20.429600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-547e6a19-8a91-43d8-acd6-02a98d6bf613 req-02828ee4-57db-470f-80b0-521c5e73fb1e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:20.430255 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-547e6a19-8a91-43d8-acd6-02a98d6bf613 req-02828ee4-57db-470f-80b0-521c5e73fb1e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:20.465639 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-547e6a19-8a91-43d8-acd6-02a98d6bf613 req-02828ee4-57db-470f-80b0-521c5e73fb1e service nova] Creating event network-vif-plugged:6fdb0b84-35b3-4673-9dfe-8ceebbbd3e3d for instance 756ffb6d-8123-4743-97b5-e3153a7fc28e on n-h2-846435-14 Jul 25 14:36:20.479051 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-547e6a19-8a91-43d8-acd6-02a98d6bf613 req-02828ee4-57db-470f-80b0-521c5e73fb1e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228656 Jul 25 14:36:20.479666 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1446/2689] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:36:20.499149 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-29f92f85-4183-47e0-9eea-9ba9a3ce97bd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:20.500129 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-29f92f85-4183-47e0-9eea-9ba9a3ce97bd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:20.508884 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-29f92f85-4183-47e0-9eea-9ba9a3ce97bd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:20.515416 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-29f92f85-4183-47e0-9eea-9ba9a3ce97bd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:20.516975 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-29f92f85-4183-47e0-9eea-9ba9a3ce97bd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:20.518154 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-29f92f85-4183-47e0-9eea-9ba9a3ce97bd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:21.089746 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-29f92f85-4183-47e0-9eea-9ba9a3ce97bd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:21.101194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-29f92f85-4183-47e0-9eea-9ba9a3ce97bd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:21.103183 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-29f92f85-4183-47e0-9eea-9ba9a3ce97bd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:21.111952 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-29f92f85-4183-47e0-9eea-9ba9a3ce97bd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1723 microversion: 2.20 time: 0.627786 Jul 25 14:36:21.112644 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1447/2690] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:36:20 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1723 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:36:21.123469 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-be358bb3-48e3-46bf-8b1c-c91b9ead3a98 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:21.126458 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-be358bb3-48e3-46bf-8b1c-c91b9ead3a98 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:21.155233 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be358bb3-48e3-46bf-8b1c-c91b9ead3a98 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:21.161302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be358bb3-48e3-46bf-8b1c-c91b9ead3a98 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:21.164316 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be358bb3-48e3-46bf-8b1c-c91b9ead3a98 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:21.165042 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be358bb3-48e3-46bf-8b1c-c91b9ead3a98 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:21.705075 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-be358bb3-48e3-46bf-8b1c-c91b9ead3a98 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:21.715752 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-be358bb3-48e3-46bf-8b1c-c91b9ead3a98 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1323 microversion: 2.1 time: 0.601790 Jul 25 14:36:21.722543 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1448/2691] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:21 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1323 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:21.728029 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-063eaa2f-16a2-41d5-be13-9abdbc2ce35f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:21.732867 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-063eaa2f-16a2-41d5-be13-9abdbc2ce35f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:21.745939 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-063eaa2f-16a2-41d5-be13-9abdbc2ce35f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:21.747208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-063eaa2f-16a2-41d5-be13-9abdbc2ce35f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:21.751911 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-063eaa2f-16a2-41d5-be13-9abdbc2ce35f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:21.752568 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-063eaa2f-16a2-41d5-be13-9abdbc2ce35f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:21.762800 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-68f617a1-a8f7-4847-a945-88de33dee7e5 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:21.778401 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-68f617a1-a8f7-4847-a945-88de33dee7e5 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1521 microversion: 2.1 time: 1.929724 Jul 25 14:36:21.794363 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1244/2692] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:19 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1521 bytes in 1947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:22.142040 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-03cf730b-c1f6-4bb2-b580-d52866d1b408 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:22.142692 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-03cf730b-c1f6-4bb2-b580-d52866d1b408 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:22.157637 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03cf730b-c1f6-4bb2-b580-d52866d1b408 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:22.165893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03cf730b-c1f6-4bb2-b580-d52866d1b408 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:22.167121 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03cf730b-c1f6-4bb2-b580-d52866d1b408 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:22.167718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03cf730b-c1f6-4bb2-b580-d52866d1b408 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:22.215673 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-063eaa2f-16a2-41d5-be13-9abdbc2ce35f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:22.224214 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-063eaa2f-16a2-41d5-be13-9abdbc2ce35f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1211 microversion: 2.1 time: 0.500271 Jul 25 14:36:22.238974 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1449/2693] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:21 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1211 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:22.737339 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-57f4db72-2360-4de1-b232-f325a86c582c tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:22.738189 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-57f4db72-2360-4de1-b232-f325a86c582c tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:22.748973 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-57f4db72-2360-4de1-b232-f325a86c582c tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:22.749422 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-57f4db72-2360-4de1-b232-f325a86c582c tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:22.750194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-57f4db72-2360-4de1-b232-f325a86c582c tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:22.750620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-57f4db72-2360-4de1-b232-f325a86c582c tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:22.834645 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-03cf730b-c1f6-4bb2-b580-d52866d1b408 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:22.854028 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-03cf730b-c1f6-4bb2-b580-d52866d1b408 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:22.855871 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-03cf730b-c1f6-4bb2-b580-d52866d1b408 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:22.863092 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-03cf730b-c1f6-4bb2-b580-d52866d1b408 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1723 microversion: 2.20 time: 0.725097 Jul 25 14:36:22.878288 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1245/2694] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:36:22 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1723 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:36:22.881161 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:36:22.886584 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:36:22.889640 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7b2c5eb3-d944-4c39-821f-61cbbb2104ea tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:22.890568 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7b2c5eb3-d944-4c39-821f-61cbbb2104ea tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:22.928121 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b2c5eb3-d944-4c39-821f-61cbbb2104ea tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:22.928794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b2c5eb3-d944-4c39-821f-61cbbb2104ea tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:22.929644 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b2c5eb3-d944-4c39-821f-61cbbb2104ea tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:22.930091 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b2c5eb3-d944-4c39-821f-61cbbb2104ea tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:23.698203 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-57f4db72-2360-4de1-b232-f325a86c582c tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:23.712344 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-57f4db72-2360-4de1-b232-f325a86c582c tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1323 microversion: 2.1 time: 0.978902 Jul 25 14:36:23.728472 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1450/2695] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:22 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1323 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:23.746540 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4e22dc38-a790-42b6-afa8-5a6ddcedc6b7 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:23.747286 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4e22dc38-a790-42b6-afa8-5a6ddcedc6b7 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:23.776148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e22dc38-a790-42b6-afa8-5a6ddcedc6b7 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:23.778735 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e22dc38-a790-42b6-afa8-5a6ddcedc6b7 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:23.779694 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e22dc38-a790-42b6-afa8-5a6ddcedc6b7 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:23.780184 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e22dc38-a790-42b6-afa8-5a6ddcedc6b7 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:23.984137 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7b2c5eb3-d944-4c39-821f-61cbbb2104ea tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:23.994536 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7b2c5eb3-d944-4c39-821f-61cbbb2104ea tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1521 microversion: 2.1 time: 1.125224 Jul 25 14:36:24.000807 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1246/2696] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:22 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1521 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:24.039147 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-67efb088-4d37-4a5d-b2cb-f526efd5d49c req-c3a68df3-e951-4fd7-8d55-2f1ba3a74639 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e", "tag": "53dcf2fd-d803-419e-ac77-4ff7d0c3b117"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:36:24.091940 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-67efb088-4d37-4a5d-b2cb-f526efd5d49c req-c3a68df3-e951-4fd7-8d55-2f1ba3a74639 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:24.095699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-67efb088-4d37-4a5d-b2cb-f526efd5d49c req-c3a68df3-e951-4fd7-8d55-2f1ba3a74639 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:24.122795 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-67efb088-4d37-4a5d-b2cb-f526efd5d49c req-c3a68df3-e951-4fd7-8d55-2f1ba3a74639 service nova] Creating event network-changed:53dcf2fd-d803-419e-ac77-4ff7d0c3b117 for instance 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e on n-h1-846435-14 Jul 25 14:36:24.130142 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-67efb088-4d37-4a5d-b2cb-f526efd5d49c req-c3a68df3-e951-4fd7-8d55-2f1ba3a74639 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111281 Jul 25 14:36:24.133560 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1247/2697] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:36:24.145702 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5dc62cdc-760b-44b1-9297-772daee62b79 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:24.147629 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5dc62cdc-760b-44b1-9297-772daee62b79 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:24.162839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5dc62cdc-760b-44b1-9297-772daee62b79 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:24.164321 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5dc62cdc-760b-44b1-9297-772daee62b79 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:24.165415 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5dc62cdc-760b-44b1-9297-772daee62b79 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:24.166032 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5dc62cdc-760b-44b1-9297-772daee62b79 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:24.227731 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:36:24.587585 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5dc62cdc-760b-44b1-9297-772daee62b79 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:24.605351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5dc62cdc-760b-44b1-9297-772daee62b79 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:24.606964 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5dc62cdc-760b-44b1-9297-772daee62b79 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:24.608555 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5dc62cdc-760b-44b1-9297-772daee62b79 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1744 microversion: 2.20 time: 0.472489 Jul 25 14:36:24.619997 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1248/2698] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:36:24 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1744 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:36:24.735331 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f85dd59f-f670-4690-a60b-8290096a75b9 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:24.736161 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f85dd59f-f670-4690-a60b-8290096a75b9 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:24.752564 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f85dd59f-f670-4690-a60b-8290096a75b9 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:24.753106 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f85dd59f-f670-4690-a60b-8290096a75b9 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:24.753977 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f85dd59f-f670-4690-a60b-8290096a75b9 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:24.754477 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f85dd59f-f670-4690-a60b-8290096a75b9 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:24.820728 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4e22dc38-a790-42b6-afa8-5a6ddcedc6b7 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:24.833122 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4e22dc38-a790-42b6-afa8-5a6ddcedc6b7 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1211 microversion: 2.1 time: 1.093007 Jul 25 14:36:24.838283 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1451/2699] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:23 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1211 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:25.026125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-74136e5e-4b31-436d-8314-2f142fd1c059 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:25.027014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-74136e5e-4b31-436d-8314-2f142fd1c059 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:25.036240 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:36:25.049063 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-74136e5e-4b31-436d-8314-2f142fd1c059 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:25.049186 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-74136e5e-4b31-436d-8314-2f142fd1c059 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:25.049930 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-74136e5e-4b31-436d-8314-2f142fd1c059 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:25.050369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-74136e5e-4b31-436d-8314-2f142fd1c059 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:25.428554 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-74136e5e-4b31-436d-8314-2f142fd1c059 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:25.441928 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-74136e5e-4b31-436d-8314-2f142fd1c059 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1501 microversion: 2.1 time: 0.422233 Jul 25 14:36:25.446473 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1452/2700] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:25 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1501 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:25.470498 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0dfb641d-dde9-4f73-b545-4ceec91810a0 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:25.471104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0dfb641d-dde9-4f73-b545-4ceec91810a0 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:25.483930 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0dfb641d-dde9-4f73-b545-4ceec91810a0 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:25.486142 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0dfb641d-dde9-4f73-b545-4ceec91810a0 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:25.488601 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0dfb641d-dde9-4f73-b545-4ceec91810a0 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:25.489137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0dfb641d-dde9-4f73-b545-4ceec91810a0 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:25.498382 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f85dd59f-f670-4690-a60b-8290096a75b9 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:25.508212 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f85dd59f-f670-4690-a60b-8290096a75b9 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1518 microversion: 2.1 time: 0.777171 Jul 25 14:36:25.512044 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1249/2701] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:24 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1518 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:36:25.543917 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2b2dce52-2fd3-4ac1-bd27-6eac1b46638c tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:36:25.547319 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2b2dce52-2fd3-4ac1-bd27-6eac1b46638c tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:25.567566 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2b2dce52-2fd3-4ac1-bd27-6eac1b46638c tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:25.567566 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2b2dce52-2fd3-4ac1-bd27-6eac1b46638c tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:25.568897 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2b2dce52-2fd3-4ac1-bd27-6eac1b46638c tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:25.572686 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2b2dce52-2fd3-4ac1-bd27-6eac1b46638c tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:25.625338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-2b2dce52-2fd3-4ac1-bd27-6eac1b46638c tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lazy-loading 'flavor' on Instance uuid 756ffb6d-8123-4743-97b5-e3153a7fc28e {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:36:26.033270 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2b2dce52-2fd3-4ac1-bd27-6eac1b46638c tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "POST /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e/action" status: 200 len: 32 microversion: 2.1 time: 0.497257 Jul 25 14:36:26.053433 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1250/2702] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:36:25 2022] POST /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e/action => generated 32 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:36:26.075635 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5840949e-03e0-4471-92a2-399c0ec1e0fd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:26.076638 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5840949e-03e0-4471-92a2-399c0ec1e0fd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:26.087493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5840949e-03e0-4471-92a2-399c0ec1e0fd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:26.091631 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5840949e-03e0-4471-92a2-399c0ec1e0fd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:26.095968 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5840949e-03e0-4471-92a2-399c0ec1e0fd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:26.096793 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5840949e-03e0-4471-92a2-399c0ec1e0fd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:26.332970 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5840949e-03e0-4471-92a2-399c0ec1e0fd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:26.345501 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5840949e-03e0-4471-92a2-399c0ec1e0fd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:26.348050 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5840949e-03e0-4471-92a2-399c0ec1e0fd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:26.349542 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5840949e-03e0-4471-92a2-399c0ec1e0fd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1744 microversion: 2.20 time: 0.291040 Jul 25 14:36:26.350127 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1251/2703] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:36:26 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1744 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:36:26.371765 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dabae05f-b9b8-4d3a-bdca-2ddc08f08d2a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:26.373381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-dabae05f-b9b8-4d3a-bdca-2ddc08f08d2a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:26.382087 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dabae05f-b9b8-4d3a-bdca-2ddc08f08d2a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:26.382773 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dabae05f-b9b8-4d3a-bdca-2ddc08f08d2a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:26.383565 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dabae05f-b9b8-4d3a-bdca-2ddc08f08d2a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:26.384047 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dabae05f-b9b8-4d3a-bdca-2ddc08f08d2a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:26.461732 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0dfb641d-dde9-4f73-b545-4ceec91810a0 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:26.472875 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0dfb641d-dde9-4f73-b545-4ceec91810a0 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1515 microversion: 2.1 time: 1.006284 Jul 25 14:36:26.485869 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1453/2704] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:25 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1515 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:36:26.498420 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-45351b16-0d15-4dab-b573-edb3d5a55d48 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:26.500624 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-45351b16-0d15-4dab-b573-edb3d5a55d48 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:26.516287 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45351b16-0d15-4dab-b573-edb3d5a55d48 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:26.517638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45351b16-0d15-4dab-b573-edb3d5a55d48 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:26.520606 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45351b16-0d15-4dab-b573-edb3d5a55d48 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:26.521790 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45351b16-0d15-4dab-b573-edb3d5a55d48 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:27.098612 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-45351b16-0d15-4dab-b573-edb3d5a55d48 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:27.108197 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-45351b16-0d15-4dab-b573-edb3d5a55d48 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1524 microversion: 2.1 time: 0.620550 Jul 25 14:36:27.112368 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1454/2705] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:26 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1524 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:27.122593 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-87a24b20-cf31-41b5-bf94-3f0049842448 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:36:27.127858 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-87a24b20-cf31-41b5-bf94-3f0049842448 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 95548ec1-d40b-4dbb-ade3-baf665563ae3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:27.145682 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-87a24b20-cf31-41b5-bf94-3f0049842448 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] HTTP exception thrown: Instance 95548ec1-d40b-4dbb-ade3-baf665563ae3 could not be found. Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-87a24b20-cf31-41b5-bf94-3f0049842448 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Request method failure captured: Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers/95548ec1-d40b-4dbb-ade3-baf665563ae3/action HTTP/1.1 Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 14 Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qojWgWRzNqcoFtbKX69HP8TMfJcvgq5mROxrtiAbTRQQhODI65548klI2mwspV0aDgelkydSdF0jDfbt9K1MKvAqBkxkDKwdPBnneXznLL8230WZKLHZUg-qMlSHwLMR2RP6Be2wdwzhEY6xsA-ygO39xLQI8y2VkgTqIORhZUeWIM Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 2f1bd935e917484799f31ad643eafb2a Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-756792154 Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2f1bd935e917484799f31ad643eafb2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2f1bd935e917484799f31ad643eafb2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2f1bd935e917484799f31ad643eafb2a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2f1bd935e917484799f31ad643eafb2a"}]}] Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerRescueNegativeTestJSON-756792154 Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 2f1bd935e917484799f31ad643eafb2a Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-756792154 Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerRescueNegativeTestJSON-756792154-project Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 9f2ddec1bc6244739e9ac3a40c064b53 Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerRescueNegativeTestJSON-756792154-project Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: {"rescue": {}} Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 95548ec1-d40b-4dbb-ade3-baf665563ae3 could not be found. Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '95548ec1-d40b-4dbb-ade3-baf665563ae3', 'body': {'rescue': {}}} Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95548ec1-d40b-4dbb-ade3-baf665563ae3 could not be found. Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95548ec1-d40b-4dbb-ade3-baf665563ae3 could not be found. Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:36:27.147887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:36:27.152433 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:36:27.152433 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:36:27.152433 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:36:27.152433 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:36:27.152433 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95548ec1-d40b-4dbb-ade3-baf665563ae3 could not be found. Jul 25 14:36:27.152433 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:36:27.152433 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-87a24b20-cf31-41b5-bf94-3f0049842448 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Returning 404 to user: Instance 95548ec1-d40b-4dbb-ade3-baf665563ae3 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:36:27.154451 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-87a24b20-cf31-41b5-bf94-3f0049842448 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "POST /compute/v2.1/servers/95548ec1-d40b-4dbb-ade3-baf665563ae3/action" status: 404 len: 111 microversion: 2.1 time: 0.040227 Jul 25 14:36:27.157222 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1455/2706] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:36:27 2022] POST /compute/v2.1/servers/95548ec1-d40b-4dbb-ade3-baf665563ae3/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:36:27.169952 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a104de82-2854-4630-92bc-afae83a28c2e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:36:27.171254 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a104de82-2854-4630-92bc-afae83a28c2e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:27.180502 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a104de82-2854-4630-92bc-afae83a28c2e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:27.182507 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a104de82-2854-4630-92bc-afae83a28c2e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:27.183678 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a104de82-2854-4630-92bc-afae83a28c2e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:27.184810 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a104de82-2854-4630-92bc-afae83a28c2e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:27.240642 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:36:27.277730 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a104de82-2854-4630-92bc-afae83a28c2e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "POST /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc/action" status: 202 len: 0 microversion: 2.1 time: 0.113633 Jul 25 14:36:27.282388 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1456/2707] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:36:27 2022] POST /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:36:27.289662 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-55ed0526-ffaa-4635-bc7a-f4d6a9613529 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:27.290715 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-55ed0526-ffaa-4635-bc7a-f4d6a9613529 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:27.299111 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55ed0526-ffaa-4635-bc7a-f4d6a9613529 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:27.300137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55ed0526-ffaa-4635-bc7a-f4d6a9613529 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:27.301308 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55ed0526-ffaa-4635-bc7a-f4d6a9613529 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:27.302044 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55ed0526-ffaa-4635-bc7a-f4d6a9613529 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:27.499304 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-55ed0526-ffaa-4635-bc7a-f4d6a9613529 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:27.514881 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-55ed0526-ffaa-4635-bc7a-f4d6a9613529 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1520 microversion: 2.1 time: 0.227165 Jul 25 14:36:27.535378 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1457/2708] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:27 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:27.544786 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-acaf5200-9928-45ef-a208-425ce970413a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:27.549392 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-acaf5200-9928-45ef-a208-425ce970413a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:27.569636 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-acaf5200-9928-45ef-a208-425ce970413a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:27.570028 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-acaf5200-9928-45ef-a208-425ce970413a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:27.573258 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-acaf5200-9928-45ef-a208-425ce970413a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:27.573852 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-acaf5200-9928-45ef-a208-425ce970413a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:27.798498 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-dabae05f-b9b8-4d3a-bdca-2ddc08f08d2a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:27.811731 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-acaf5200-9928-45ef-a208-425ce970413a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:27.814003 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dabae05f-b9b8-4d3a-bdca-2ddc08f08d2a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1199 microversion: 2.1 time: 1.443430 Jul 25 14:36:27.828475 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1252/2709] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:26 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1199 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:27.829257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-acaf5200-9928-45ef-a208-425ce970413a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:27.831138 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-acaf5200-9928-45ef-a208-425ce970413a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:27.834841 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-acaf5200-9928-45ef-a208-425ce970413a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1744 microversion: 2.20 time: 0.292145 Jul 25 14:36:27.836850 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1458/2710] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:36:27 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1744 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:36:28.070888 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-558fb2e2-2b30-4479-ab11-64d92b43fcdf tempest-ServerGroup264TestJSON-1418404341 tempest-ServerGroup264TestJSON-1418404341-project] Action: 'create', calling method: .version_select at 0x7f468777edc0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:36:28.119270 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-558fb2e2-2b30-4479-ab11-64d92b43fcdf tempest-ServerGroup264TestJSON-1418404341 tempest-ServerGroup264TestJSON-1418404341-project] Getting quotas for project 28650ef2d0a444729d535ee125e29c32. Resources: {'server_groups'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:36:28.133550 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-558fb2e2-2b30-4479-ab11-64d92b43fcdf tempest-ServerGroup264TestJSON-1418404341 tempest-ServerGroup264TestJSON-1418404341-project] Getting quotas for user c0480bcf41c0443bb58a92d8799bd721 and project 28650ef2d0a444729d535ee125e29c32. Resources: {'server_groups'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:36:28.138020 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-779c15dd-8378-4127-9362-c72c49c5e29a tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:28.138792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-779c15dd-8378-4127-9362-c72c49c5e29a tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:28.155325 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-779c15dd-8378-4127-9362-c72c49c5e29a tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:28.156437 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-779c15dd-8378-4127-9362-c72c49c5e29a tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:28.159925 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-779c15dd-8378-4127-9362-c72c49c5e29a tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:28.161150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-779c15dd-8378-4127-9362-c72c49c5e29a tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:28.266199 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-558fb2e2-2b30-4479-ab11-64d92b43fcdf tempest-ServerGroup264TestJSON-1418404341 tempest-ServerGroup264TestJSON-1418404341-project] Getting quotas for project 28650ef2d0a444729d535ee125e29c32. Resources: {'server_groups'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:36:28.287563 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-558fb2e2-2b30-4479-ab11-64d92b43fcdf tempest-ServerGroup264TestJSON-1418404341 tempest-ServerGroup264TestJSON-1418404341-project] Getting quotas for user c0480bcf41c0443bb58a92d8799bd721 and project 28650ef2d0a444729d535ee125e29c32. Resources: {'server_groups'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:36:28.322348 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-558fb2e2-2b30-4479-ab11-64d92b43fcdf tempest-ServerGroup264TestJSON-1418404341 tempest-ServerGroup264TestJSON-1418404341-project] 10.222.0.88 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.492711 Jul 25 14:36:28.332053 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1253/2711] 10.222.0.88 () {62 vars in 1214 bytes} [Mon Jul 25 14:36:27 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:36:28.351056 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8157ca5f-a52d-4b20-aab9-331b11b7f25b tempest-ServerGroup264TestJSON-1418404341 tempest-ServerGroup264TestJSON-1418404341-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:28.453514 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8157ca5f-a52d-4b20-aab9-331b11b7f25b tempest-ServerGroup264TestJSON-1418404341 tempest-ServerGroup264TestJSON-1418404341-project] 10.222.0.88 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.108989 Jul 25 14:36:28.456571 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1254/2712] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Jul 25 14:36:28 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:36:28.465248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-86339f87-1170-4c54-9cc2-5a41f476c58f tempest-ServerGroup264TestJSON-1418404341 tempest-ServerGroup264TestJSON-1418404341-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:28.500305 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-86339f87-1170-4c54-9cc2-5a41f476c58f tempest-ServerGroup264TestJSON-1418404341 tempest-ServerGroup264TestJSON-1418404341-project] 10.222.0.88 "GET /compute/v2.1/os-server-groups/6bd07484-9c40-4f08-bd89-4fb48f36673d" status: 200 len: 235 microversion: 2.64 time: 0.038856 Jul 25 14:36:28.501683 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1255/2713] 10.222.0.88 () {60 vars in 1304 bytes} [Mon Jul 25 14:36:28 2022] GET /compute/v2.1/os-server-groups/6bd07484-9c40-4f08-bd89-4fb48f36673d => generated 235 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 14:36:28.519571 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cf6c3f2d-938d-4074-b9fe-4124b352b7a8 tempest-ServerGroup264TestJSON-1418404341 tempest-ServerGroup264TestJSON-1418404341-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:28.567471 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cf6c3f2d-938d-4074-b9fe-4124b352b7a8 tempest-ServerGroup264TestJSON-1418404341 tempest-ServerGroup264TestJSON-1418404341-project] 10.222.0.88 "DELETE /compute/v2.1/os-server-groups/6bd07484-9c40-4f08-bd89-4fb48f36673d" status: 204 len: 0 microversion: 2.64 time: 0.057609 Jul 25 14:36:28.569448 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1256/2714] 10.222.0.88 () {60 vars in 1307 bytes} [Mon Jul 25 14:36:28 2022] DELETE /compute/v2.1/os-server-groups/6bd07484-9c40-4f08-bd89-4fb48f36673d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 14:36:28.575512 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e44d31cc-c6ba-434d-a392-8845ddebf0d1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:28.576448 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e44d31cc-c6ba-434d-a392-8845ddebf0d1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:28.583880 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e44d31cc-c6ba-434d-a392-8845ddebf0d1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:28.584612 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e44d31cc-c6ba-434d-a392-8845ddebf0d1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:28.585574 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e44d31cc-c6ba-434d-a392-8845ddebf0d1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:28.588774 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e44d31cc-c6ba-434d-a392-8845ddebf0d1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:28.718325 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-779c15dd-8378-4127-9362-c72c49c5e29a tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:28.736237 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-779c15dd-8378-4127-9362-c72c49c5e29a tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1524 microversion: 2.1 time: 0.603333 Jul 25 14:36:28.738068 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1459/2715] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:28 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1524 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:36:28.758848 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9f1a7da3-c4fc-4c27-9962-2694f46dce10 tempest-ServerGroup264TestJSON-1418404341 tempest-ServerGroup264TestJSON-1418404341-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:28.809525 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-9f1a7da3-c4fc-4c27-9962-2694f46dce10 tempest-ServerGroup264TestJSON-1418404341 tempest-ServerGroup264TestJSON-1418404341-project] HTTP exception thrown: Instance group 6bd07484-9c40-4f08-bd89-4fb48f36673d could not be found. Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9f1a7da3-c4fc-4c27-9962-2694f46dce10 tempest-ServerGroup264TestJSON-1418404341 tempest-ServerGroup264TestJSON-1418404341-project] Request method failure captured: Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/os-server-groups/6bd07484-9c40-4f08-bd89-4fb48f36673d HTTP/1.1 Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qproNkDay3jqoz80nomwyhpZ4m_n676U6VNU3YktJVLeZnYPF-hJwQXNcwtof7M32vd0amgMFEgEfoti6rSfbHJo4MXwG4suxZemWyww1Pa-X5DaYnwsYH3r7ovuPjoDpFUX3ikRSvREhAhEnXHfe1cOZdlHWI4dUnK9hnIW8LTfUk Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: X-Openstack-Nova-Api-Version: 2.64 Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 28650ef2d0a444729d535ee125e29c32 Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerGroup264TestJSON-1418404341 Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/28650ef2d0a444729d535ee125e29c32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/28650ef2d0a444729d535ee125e29c32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_28650ef2d0a444729d535ee125e29c32", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/28650ef2d0a444729d535ee125e29c32"}]}] Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerGroup264TestJSON-1418404341 Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 28650ef2d0a444729d535ee125e29c32 Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1418404341 Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerGroup264TestJSON-1418404341-project Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: c0480bcf41c0443bb58a92d8799bd721 Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerGroup264TestJSON-1418404341-project Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance group 6bd07484-9c40-4f08-bd89-4fb48f36673d could not be found. Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '6bd07484-9c40-4f08-bd89-4fb48f36673d'} Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6bd07484-9c40-4f08-bd89-4fb48f36673d could not be found. Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6bd07484-9c40-4f08-bd89-4fb48f36673d could not be found. Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:36:28.825180 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:36:28.832098 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:36:28.832098 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:36:28.832098 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:36:28.832098 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:36:28.832098 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6bd07484-9c40-4f08-bd89-4fb48f36673d could not be found. Jul 25 14:36:28.832098 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:36:28.832098 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9f1a7da3-c4fc-4c27-9962-2694f46dce10 tempest-ServerGroup264TestJSON-1418404341 tempest-ServerGroup264TestJSON-1418404341-project] Returning 404 to user: Instance group 6bd07484-9c40-4f08-bd89-4fb48f36673d could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:36:28.832098 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9f1a7da3-c4fc-4c27-9962-2694f46dce10 tempest-ServerGroup264TestJSON-1418404341 tempest-ServerGroup264TestJSON-1418404341-project] 10.222.0.88 "DELETE /compute/v2.1/os-server-groups/6bd07484-9c40-4f08-bd89-4fb48f36673d" status: 404 len: 117 microversion: 2.64 time: 0.088640 Jul 25 14:36:28.832098 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1460/2716] 10.222.0.88 () {60 vars in 1307 bytes} [Mon Jul 25 14:36:28 2022] DELETE /compute/v2.1/os-server-groups/6bd07484-9c40-4f08-bd89-4fb48f36673d => generated 117 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:36:28.845541 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e44d31cc-c6ba-434d-a392-8845ddebf0d1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:28.858549 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e335163a-a2a8-4aff-8c68-d6abfd6bfc3b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:28.858707 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e44d31cc-c6ba-434d-a392-8845ddebf0d1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1500 microversion: 2.1 time: 0.285566 Jul 25 14:36:28.864833 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e335163a-a2a8-4aff-8c68-d6abfd6bfc3b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:28.873522 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1257/2717] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:28 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1500 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:28.887962 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8f9babbd-bb0d-4970-bb61-b3ee8d7a8d6e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:28.888354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e335163a-a2a8-4aff-8c68-d6abfd6bfc3b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:28.888811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e335163a-a2a8-4aff-8c68-d6abfd6bfc3b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:28.888920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8f9babbd-bb0d-4970-bb61-b3ee8d7a8d6e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:28.894916 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e335163a-a2a8-4aff-8c68-d6abfd6bfc3b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:28.895642 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e335163a-a2a8-4aff-8c68-d6abfd6bfc3b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:28.905719 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f9babbd-bb0d-4970-bb61-b3ee8d7a8d6e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:28.906188 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f9babbd-bb0d-4970-bb61-b3ee8d7a8d6e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:28.911353 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f9babbd-bb0d-4970-bb61-b3ee8d7a8d6e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:28.911823 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f9babbd-bb0d-4970-bb61-b3ee8d7a8d6e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:29.384961 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e335163a-a2a8-4aff-8c68-d6abfd6bfc3b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:29.394024 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e335163a-a2a8-4aff-8c68-d6abfd6bfc3b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1199 microversion: 2.1 time: 0.562127 Jul 25 14:36:29.396673 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1461/2718] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:28 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1199 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:29.412941 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-29e4901a-228c-408b-9f7c-106ed5da3eff tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:36:29.415868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-29e4901a-228c-408b-9f7c-106ed5da3eff tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:29.423910 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-29e4901a-228c-408b-9f7c-106ed5da3eff tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:29.428342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-29e4901a-228c-408b-9f7c-106ed5da3eff tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:29.436272 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-29e4901a-228c-408b-9f7c-106ed5da3eff tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:29.436886 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-29e4901a-228c-408b-9f7c-106ed5da3eff tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:29.472673 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-29e4901a-228c-408b-9f7c-106ed5da3eff tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lazy-loading 'flavor' on Instance uuid 9d3dd486-7c28-4d5a-a177-3f14739f3abc {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:36:29.497769 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-29e4901a-228c-408b-9f7c-106ed5da3eff tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] HTTP exception thrown: Cannot 'rescue' instance 9d3dd486-7c28-4d5a-a177-3f14739f3abc while it is in vm_state paused Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-29e4901a-228c-408b-9f7c-106ed5da3eff tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Request method failure captured: Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc/action HTTP/1.1 Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 14 Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qojWgWRzNqcoFtbKX69HP8TMfJcvgq5mROxrtiAbTRQQhODI65548klI2mwspV0aDgelkydSdF0jDfbt9K1MKvAqBkxkDKwdPBnneXznLL8230WZKLHZUg-qMlSHwLMR2RP6Be2wdwzhEY6xsA-ygO39xLQI8y2VkgTqIORhZUeWIM Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 2f1bd935e917484799f31ad643eafb2a Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-756792154 Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2f1bd935e917484799f31ad643eafb2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2f1bd935e917484799f31ad643eafb2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2f1bd935e917484799f31ad643eafb2a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2f1bd935e917484799f31ad643eafb2a"}]}] Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerRescueNegativeTestJSON-756792154 Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 2f1bd935e917484799f31ad643eafb2a Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-756792154 Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerRescueNegativeTestJSON-756792154-project Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 9f2ddec1bc6244739e9ac3a40c064b53 Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerRescueNegativeTestJSON-756792154-project Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: {"rescue": {}} Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: exception: Cannot 'rescue' instance 9d3dd486-7c28-4d5a-a177-3f14739f3abc while it is in vm_state paused Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '9d3dd486-7c28-4d5a-a177-3f14739f3abc', 'body': {'rescue': {}}} Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9d3dd486-7c28-4d5a-a177-3f14739f3abc in vm_state paused. Cannot rescue while the instance is in this state. Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 9d3dd486-7c28-4d5a-a177-3f14739f3abc while it is in vm_state paused Jul 25 14:36:29.502254 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:36:29.506749 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:36:29.506749 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:36:29.506749 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:36:29.506749 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:36:29.506749 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:36:29.506749 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:36:29.506749 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:36:29.506749 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 9d3dd486-7c28-4d5a-a177-3f14739f3abc while it is in vm_state paused Jul 25 14:36:29.506749 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:36:29.510971 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-29e4901a-228c-408b-9f7c-106ed5da3eff tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Returning 409 to user: Cannot 'rescue' instance 9d3dd486-7c28-4d5a-a177-3f14739f3abc while it is in vm_state paused {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:36:29.512270 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-29e4901a-228c-408b-9f7c-106ed5da3eff tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "POST /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc/action" status: 409 len: 144 microversion: 2.1 time: 0.112774 Jul 25 14:36:29.513313 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1462/2719] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:36:29 2022] POST /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc/action => generated 144 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:36:29.528931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-824c6ec3-d1c4-42ee-aed4-262633828b28 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:36:29.529774 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-824c6ec3-d1c4-42ee-aed4-262633828b28 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:29.544879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-824c6ec3-d1c4-42ee-aed4-262633828b28 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:29.545645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-824c6ec3-d1c4-42ee-aed4-262633828b28 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:29.546591 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-824c6ec3-d1c4-42ee-aed4-262633828b28 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:29.547181 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-824c6ec3-d1c4-42ee-aed4-262633828b28 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:29.692116 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-824c6ec3-d1c4-42ee-aed4-262633828b28 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "POST /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc/action" status: 202 len: 0 microversion: 2.1 time: 0.173694 Jul 25 14:36:29.694360 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1463/2720] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:36:29 2022] POST /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:36:29.707675 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5160fbdd-effb-4c85-abda-6a7779225885 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:29.710862 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5160fbdd-effb-4c85-abda-6a7779225885 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:29.726519 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5160fbdd-effb-4c85-abda-6a7779225885 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:29.727719 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5160fbdd-effb-4c85-abda-6a7779225885 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:29.746669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5160fbdd-effb-4c85-abda-6a7779225885 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:29.747447 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5160fbdd-effb-4c85-abda-6a7779225885 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:29.816554 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8f9babbd-bb0d-4970-bb61-b3ee8d7a8d6e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:29.834546 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8f9babbd-bb0d-4970-bb61-b3ee8d7a8d6e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:29.845774 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8f9babbd-bb0d-4970-bb61-b3ee8d7a8d6e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:29.851723 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8f9babbd-bb0d-4970-bb61-b3ee8d7a8d6e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1744 microversion: 2.20 time: 0.973061 Jul 25 14:36:29.870891 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1258/2721] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:36:28 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1744 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:36:29.904903 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f5f9aa07-9720-40b8-8962-fe6f26521a02 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:29.907560 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f5f9aa07-9720-40b8-8962-fe6f26521a02 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:29.929164 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f5f9aa07-9720-40b8-8962-fe6f26521a02 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:29.932199 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f5f9aa07-9720-40b8-8962-fe6f26521a02 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:29.938975 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f5f9aa07-9720-40b8-8962-fe6f26521a02 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:29.939707 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f5f9aa07-9720-40b8-8962-fe6f26521a02 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:30.203095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5160fbdd-effb-4c85-abda-6a7779225885 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:30.216787 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5160fbdd-effb-4c85-abda-6a7779225885 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1507 microversion: 2.1 time: 0.517560 Jul 25 14:36:30.230613 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1464/2722] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:29 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1507 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:30.252544 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f5f9aa07-9720-40b8-8962-fe6f26521a02 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:30.263692 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f5f9aa07-9720-40b8-8962-fe6f26521a02 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1524 microversion: 2.1 time: 0.370634 Jul 25 14:36:30.264331 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1259/2723] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:29 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1524 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:30.422704 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9114c724-5f62-41dd-91d2-dd8abed5b714 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:30.424099 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9114c724-5f62-41dd-91d2-dd8abed5b714 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:30.440903 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9114c724-5f62-41dd-91d2-dd8abed5b714 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:30.442737 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9114c724-5f62-41dd-91d2-dd8abed5b714 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:30.445327 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9114c724-5f62-41dd-91d2-dd8abed5b714 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:30.446802 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9114c724-5f62-41dd-91d2-dd8abed5b714 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:30.607778 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-01ff38b9-c465-47ff-9bbf-4ba4fc491637 req-63adf771-1b25-461f-bf7a-f4e18da170c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1009be4-53ff-4893-836c-ba96f07a0d60", "name": "network-vif-plugged", "status": "completed", "tag": "a70f2535-e346-4125-80e5-abda9464ab7e"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:36:30.631508 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-01ff38b9-c465-47ff-9bbf-4ba4fc491637 req-63adf771-1b25-461f-bf7a-f4e18da170c6 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:30.632395 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-01ff38b9-c465-47ff-9bbf-4ba4fc491637 req-63adf771-1b25-461f-bf7a-f4e18da170c6 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:30.664207 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-01ff38b9-c465-47ff-9bbf-4ba4fc491637 req-63adf771-1b25-461f-bf7a-f4e18da170c6 service nova] Creating event network-vif-plugged:a70f2535-e346-4125-80e5-abda9464ab7e for instance f1009be4-53ff-4893-836c-ba96f07a0d60 on n-h2-846435-14 Jul 25 14:36:30.677490 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-01ff38b9-c465-47ff-9bbf-4ba4fc491637 req-63adf771-1b25-461f-bf7a-f4e18da170c6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072794 Jul 25 14:36:30.686866 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1260/2724] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:36:30.888867 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7da0906b-5d5f-49c2-8185-2f90201b8e55 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:30.893709 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7da0906b-5d5f-49c2-8185-2f90201b8e55 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:30.916804 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7da0906b-5d5f-49c2-8185-2f90201b8e55 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:30.917263 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7da0906b-5d5f-49c2-8185-2f90201b8e55 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:30.926188 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7da0906b-5d5f-49c2-8185-2f90201b8e55 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:30.926850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7da0906b-5d5f-49c2-8185-2f90201b8e55 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:30.957759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9114c724-5f62-41dd-91d2-dd8abed5b714 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:30.971249 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9114c724-5f62-41dd-91d2-dd8abed5b714 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1199 microversion: 2.1 time: 0.552736 Jul 25 14:36:30.976816 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1465/2725] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:30 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1199 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:31.238693 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7da0906b-5d5f-49c2-8185-2f90201b8e55 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:31.241133 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-117a7ca8-d9f2-4f03-9590-15fe564a87d9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:31.241741 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-117a7ca8-d9f2-4f03-9590-15fe564a87d9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:31.250083 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7da0906b-5d5f-49c2-8185-2f90201b8e55 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:31.258530 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7da0906b-5d5f-49c2-8185-2f90201b8e55 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:31.270387 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7da0906b-5d5f-49c2-8185-2f90201b8e55 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1739 microversion: 2.20 time: 0.383258 Jul 25 14:36:31.273310 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1261/2726] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:36:30 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1739 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:36:31.276219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-117a7ca8-d9f2-4f03-9590-15fe564a87d9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:31.276690 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-117a7ca8-d9f2-4f03-9590-15fe564a87d9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:31.277483 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-117a7ca8-d9f2-4f03-9590-15fe564a87d9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:31.277904 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-117a7ca8-d9f2-4f03-9590-15fe564a87d9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:31.295587 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f3778051-1cc0-455d-bf57-6c74f9d9fc58 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:31.298451 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f3778051-1cc0-455d-bf57-6c74f9d9fc58 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:31.337095 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3778051-1cc0-455d-bf57-6c74f9d9fc58 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:31.342017 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3778051-1cc0-455d-bf57-6c74f9d9fc58 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:31.349414 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3778051-1cc0-455d-bf57-6c74f9d9fc58 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:31.350628 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3778051-1cc0-455d-bf57-6c74f9d9fc58 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:31.746458 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f3778051-1cc0-455d-bf57-6c74f9d9fc58 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:31.760909 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f3778051-1cc0-455d-bf57-6c74f9d9fc58 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1524 microversion: 2.1 time: 0.465323 Jul 25 14:36:31.776385 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1262/2727] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:31 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1524 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:31.877315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-117a7ca8-d9f2-4f03-9590-15fe564a87d9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:31.888652 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-117a7ca8-d9f2-4f03-9590-15fe564a87d9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1515 microversion: 2.1 time: 0.649862 Jul 25 14:36:31.899668 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1466/2728] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:31 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1515 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:36:32.003572 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6e8299b8-bce6-4356-894d-2fdd5be70eeb tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:32.004589 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6e8299b8-bce6-4356-894d-2fdd5be70eeb tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:32.022071 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:36:32.029850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e8299b8-bce6-4356-894d-2fdd5be70eeb tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:32.032794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e8299b8-bce6-4356-894d-2fdd5be70eeb tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:32.033643 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e8299b8-bce6-4356-894d-2fdd5be70eeb tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:32.034081 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e8299b8-bce6-4356-894d-2fdd5be70eeb tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:32.306322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-64df9db2-33db-43e2-b8d0-030b4a07d66b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:32.310489 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-64df9db2-33db-43e2-b8d0-030b4a07d66b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:32.337531 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-64df9db2-33db-43e2-b8d0-030b4a07d66b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:32.337984 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-64df9db2-33db-43e2-b8d0-030b4a07d66b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:32.338767 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-64df9db2-33db-43e2-b8d0-030b4a07d66b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:32.354707 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-64df9db2-33db-43e2-b8d0-030b4a07d66b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:33.251922 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6e8299b8-bce6-4356-894d-2fdd5be70eeb tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:33.267093 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6e8299b8-bce6-4356-894d-2fdd5be70eeb tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1199 microversion: 2.1 time: 1.269485 Jul 25 14:36:33.272539 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1263/2729] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:31 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1199 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:33.295610 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d2e6ae73-90fe-4b3c-879c-bb4c66bf75bf tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:33.302427 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d2e6ae73-90fe-4b3c-879c-bb4c66bf75bf tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:33.320579 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d2e6ae73-90fe-4b3c-879c-bb4c66bf75bf tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:33.322472 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d2e6ae73-90fe-4b3c-879c-bb4c66bf75bf tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:33.327588 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d2e6ae73-90fe-4b3c-879c-bb4c66bf75bf tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:33.328863 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d2e6ae73-90fe-4b3c-879c-bb4c66bf75bf tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:33.623726 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-64df9db2-33db-43e2-b8d0-030b4a07d66b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:33.644349 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-64df9db2-33db-43e2-b8d0-030b4a07d66b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:33.648802 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-64df9db2-33db-43e2-b8d0-030b4a07d66b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:33.656003 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-64df9db2-33db-43e2-b8d0-030b4a07d66b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1739 microversion: 2.20 time: 1.355853 Jul 25 14:36:33.657988 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1467/2730] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:36:32 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1739 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:36:33.911673 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d2e6ae73-90fe-4b3c-879c-bb4c66bf75bf tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:33.934546 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d2e6ae73-90fe-4b3c-879c-bb4c66bf75bf tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1524 microversion: 2.1 time: 0.658928 Jul 25 14:36:33.944052 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1264/2731] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:33 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1524 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:34.295714 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ea6c63a7-0fb7-4faf-8442-c5cfe9101f8c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:34.296404 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ea6c63a7-0fb7-4faf-8442-c5cfe9101f8c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:34.309365 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea6c63a7-0fb7-4faf-8442-c5cfe9101f8c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:34.309811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea6c63a7-0fb7-4faf-8442-c5cfe9101f8c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:34.310602 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea6c63a7-0fb7-4faf-8442-c5cfe9101f8c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:34.311036 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea6c63a7-0fb7-4faf-8442-c5cfe9101f8c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:34.688568 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c27de19f-e758-48d3-9966-bdf5547f748e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:34.689794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c27de19f-e758-48d3-9966-bdf5547f748e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:34.714116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c27de19f-e758-48d3-9966-bdf5547f748e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:34.714569 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c27de19f-e758-48d3-9966-bdf5547f748e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:34.715688 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c27de19f-e758-48d3-9966-bdf5547f748e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:34.716308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c27de19f-e758-48d3-9966-bdf5547f748e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:35.794413 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c27de19f-e758-48d3-9966-bdf5547f748e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:35.809922 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c27de19f-e758-48d3-9966-bdf5547f748e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:35.815653 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c27de19f-e758-48d3-9966-bdf5547f748e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:35.819825 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c27de19f-e758-48d3-9966-bdf5547f748e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1739 microversion: 2.20 time: 1.136797 Jul 25 14:36:35.821228 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1265/2732] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:36:34 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1739 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:36:35.833053 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1147c3c8-2583-4d98-b6ff-91d7a876b8a8 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:35.834290 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1147c3c8-2583-4d98-b6ff-91d7a876b8a8 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:35.854694 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1147c3c8-2583-4d98-b6ff-91d7a876b8a8 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:35.855165 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1147c3c8-2583-4d98-b6ff-91d7a876b8a8 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:35.862343 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1147c3c8-2583-4d98-b6ff-91d7a876b8a8 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:35.862971 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1147c3c8-2583-4d98-b6ff-91d7a876b8a8 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:35.943389 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ea6c63a7-0fb7-4faf-8442-c5cfe9101f8c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:35.982516 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ea6c63a7-0fb7-4faf-8442-c5cfe9101f8c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1199 microversion: 2.1 time: 1.673767 Jul 25 14:36:35.984029 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1468/2733] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:34 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1199 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:36.479518 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-70968d3b-215b-4629-8f8a-6e63df3cd661 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:36:36.483197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-70968d3b-215b-4629-8f8a-6e63df3cd661 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:36.500517 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1147c3c8-2583-4d98-b6ff-91d7a876b8a8 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:36.509836 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1147c3c8-2583-4d98-b6ff-91d7a876b8a8 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1524 microversion: 2.1 time: 0.684761 Jul 25 14:36:36.516324 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1266/2734] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:35 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1524 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:36.540869 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-70968d3b-215b-4629-8f8a-6e63df3cd661 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:36.541936 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-70968d3b-215b-4629-8f8a-6e63df3cd661 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:36.543000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-70968d3b-215b-4629-8f8a-6e63df3cd661 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:36.543646 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-70968d3b-215b-4629-8f8a-6e63df3cd661 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:36.614129 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-70968d3b-215b-4629-8f8a-6e63df3cd661 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lazy-loading 'flavor' on Instance uuid 9d3dd486-7c28-4d5a-a177-3f14739f3abc {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:36:36.792582 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-70968d3b-215b-4629-8f8a-6e63df3cd661 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "POST /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc/action" status: 200 len: 32 microversion: 2.1 time: 0.321761 Jul 25 14:36:36.795434 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1469/2735] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:36:36 2022] POST /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc/action => generated 32 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:36:36.805809 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4838c614-efc4-4ae6-9667-8203e7a3f855 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:36.807320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4838c614-efc4-4ae6-9667-8203e7a3f855 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:36.815648 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4838c614-efc4-4ae6-9667-8203e7a3f855 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:36.821131 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4838c614-efc4-4ae6-9667-8203e7a3f855 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:36.822284 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4838c614-efc4-4ae6-9667-8203e7a3f855 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:36.823084 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4838c614-efc4-4ae6-9667-8203e7a3f855 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:36.843884 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-908c1b50-748b-4e6e-91aa-95b31a6aee9c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:36.844856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-908c1b50-748b-4e6e-91aa-95b31a6aee9c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:36.861219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-908c1b50-748b-4e6e-91aa-95b31a6aee9c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:36.862319 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-908c1b50-748b-4e6e-91aa-95b31a6aee9c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:36.865242 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-908c1b50-748b-4e6e-91aa-95b31a6aee9c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:36.868226 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-908c1b50-748b-4e6e-91aa-95b31a6aee9c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:36.911462 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:36:36.930959 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:36:37.652511 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-908c1b50-748b-4e6e-91aa-95b31a6aee9c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:37.671353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-908c1b50-748b-4e6e-91aa-95b31a6aee9c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:37.685044 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-908c1b50-748b-4e6e-91aa-95b31a6aee9c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:37.686803 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-908c1b50-748b-4e6e-91aa-95b31a6aee9c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1739 microversion: 2.20 time: 0.847737 Jul 25 14:36:37.695888 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1470/2736] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:36:36 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1739 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:36:37.705010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cb82ed1b-4fac-4c51-965e-3332989997db tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:37.707275 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cb82ed1b-4fac-4c51-965e-3332989997db tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:37.742186 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb82ed1b-4fac-4c51-965e-3332989997db tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:37.742906 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb82ed1b-4fac-4c51-965e-3332989997db tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:37.744225 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb82ed1b-4fac-4c51-965e-3332989997db tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:37.745208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb82ed1b-4fac-4c51-965e-3332989997db tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:38.310350 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=12 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:36:38.566976 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cb82ed1b-4fac-4c51-965e-3332989997db tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:38.608108 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cb82ed1b-4fac-4c51-965e-3332989997db tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1199 microversion: 2.1 time: 0.908308 Jul 25 14:36:38.611036 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1471/2737] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:37 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1199 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:38.634786 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4407bc8a-5dbd-4d10-83c7-cadce308cd47 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:38.640074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4407bc8a-5dbd-4d10-83c7-cadce308cd47 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:38.654850 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4407bc8a-5dbd-4d10-83c7-cadce308cd47 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:38.657683 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4407bc8a-5dbd-4d10-83c7-cadce308cd47 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:38.659240 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4407bc8a-5dbd-4d10-83c7-cadce308cd47 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:38.665358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4407bc8a-5dbd-4d10-83c7-cadce308cd47 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:38.949943 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4838c614-efc4-4ae6-9667-8203e7a3f855 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:38.960469 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4838c614-efc4-4ae6-9667-8203e7a3f855 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1521 microversion: 2.1 time: 2.156971 Jul 25 14:36:38.964765 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1267/2738] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:36 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1521 bytes in 2164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:38.976681 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-27fc520c-1dba-4dc2-951d-81ea7c672194 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:38.977303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-27fc520c-1dba-4dc2-951d-81ea7c672194 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:38.988239 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27fc520c-1dba-4dc2-951d-81ea7c672194 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:38.996700 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27fc520c-1dba-4dc2-951d-81ea7c672194 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:38.997866 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27fc520c-1dba-4dc2-951d-81ea7c672194 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:38.998477 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27fc520c-1dba-4dc2-951d-81ea7c672194 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:39.414089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4407bc8a-5dbd-4d10-83c7-cadce308cd47 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:39.423677 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4407bc8a-5dbd-4d10-83c7-cadce308cd47 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1524 microversion: 2.1 time: 0.811263 Jul 25 14:36:39.448843 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1472/2739] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:38 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1524 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:39.460736 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-27fc520c-1dba-4dc2-951d-81ea7c672194 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:39.484012 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-27fc520c-1dba-4dc2-951d-81ea7c672194 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:39.494462 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-27fc520c-1dba-4dc2-951d-81ea7c672194 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:39.497307 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-27fc520c-1dba-4dc2-951d-81ea7c672194 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1739 microversion: 2.20 time: 0.531429 Jul 25 14:36:39.498784 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1268/2740] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:36:38 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1739 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:36:39.604868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-6e5bd15f-2355-4102-89e7-8fae565391e5 req-c62571c9-7ba8-4352-830d-f6df761707ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e", "name": "network-vif-plugged", "status": "completed", "tag": "53dcf2fd-d803-419e-ac77-4ff7d0c3b117"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:36:39.632783 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-424cd630-00d9-4495-919f-d1f5250ad3bc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:39.633800 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-424cd630-00d9-4495-919f-d1f5250ad3bc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:39.644261 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-424cd630-00d9-4495-919f-d1f5250ad3bc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:39.645496 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-6e5bd15f-2355-4102-89e7-8fae565391e5 req-c62571c9-7ba8-4352-830d-f6df761707ce service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:39.646195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-6e5bd15f-2355-4102-89e7-8fae565391e5 req-c62571c9-7ba8-4352-830d-f6df761707ce service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:39.648405 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-424cd630-00d9-4495-919f-d1f5250ad3bc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:39.650434 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-424cd630-00d9-4495-919f-d1f5250ad3bc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:39.652582 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-424cd630-00d9-4495-919f-d1f5250ad3bc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:39.688012 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-6e5bd15f-2355-4102-89e7-8fae565391e5 req-c62571c9-7ba8-4352-830d-f6df761707ce service nova] Creating event network-vif-plugged:53dcf2fd-d803-419e-ac77-4ff7d0c3b117 for instance 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e on n-h1-846435-14 Jul 25 14:36:39.708611 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-6e5bd15f-2355-4102-89e7-8fae565391e5 req-c62571c9-7ba8-4352-830d-f6df761707ce service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107596 Jul 25 14:36:39.713222 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1473/2741] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:36:39.997337 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-edfcffc5-e354-47cd-a316-4cf91b0a744f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:39.998631 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-edfcffc5-e354-47cd-a316-4cf91b0a744f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:40.019790 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-edfcffc5-e354-47cd-a316-4cf91b0a744f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:40.020902 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-424cd630-00d9-4495-919f-d1f5250ad3bc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:40.024696 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-edfcffc5-e354-47cd-a316-4cf91b0a744f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:40.027513 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-edfcffc5-e354-47cd-a316-4cf91b0a744f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:40.029115 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-edfcffc5-e354-47cd-a316-4cf91b0a744f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:40.035042 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-424cd630-00d9-4495-919f-d1f5250ad3bc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1199 microversion: 2.1 time: 0.407851 Jul 25 14:36:40.036668 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1269/2742] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:39 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1199 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:36:40.456319 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-81555de4-e7de-470b-94be-32eac49c02fc tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:40.457900 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-81555de4-e7de-470b-94be-32eac49c02fc tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:40.489174 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-81555de4-e7de-470b-94be-32eac49c02fc tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:40.489832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-81555de4-e7de-470b-94be-32eac49c02fc tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:40.491935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-81555de4-e7de-470b-94be-32eac49c02fc tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:40.493047 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-81555de4-e7de-470b-94be-32eac49c02fc tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:40.743473 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-edfcffc5-e354-47cd-a316-4cf91b0a744f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:40.777466 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-edfcffc5-e354-47cd-a316-4cf91b0a744f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1521 microversion: 2.1 time: 0.799358 Jul 25 14:36:40.788608 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1474/2743] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:39 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1521 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:40.797706 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9f7977f1-ea80-4625-bd97-3026783b3834 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:40.799141 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9f7977f1-ea80-4625-bd97-3026783b3834 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:40.810721 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f7977f1-ea80-4625-bd97-3026783b3834 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:40.811452 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f7977f1-ea80-4625-bd97-3026783b3834 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:40.812747 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f7977f1-ea80-4625-bd97-3026783b3834 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:40.813521 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f7977f1-ea80-4625-bd97-3026783b3834 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:41.151067 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-81555de4-e7de-470b-94be-32eac49c02fc tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:41.194488 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-81555de4-e7de-470b-94be-32eac49c02fc tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1524 microversion: 2.1 time: 0.743107 Jul 25 14:36:41.226033 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1270/2744] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:40 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1524 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:36:41.246116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c4a21a1b-c18a-4019-9a01-be8d2788f209 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:41.251666 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c4a21a1b-c18a-4019-9a01-be8d2788f209 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:41.274212 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c4a21a1b-c18a-4019-9a01-be8d2788f209 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:41.277562 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c4a21a1b-c18a-4019-9a01-be8d2788f209 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:41.288958 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c4a21a1b-c18a-4019-9a01-be8d2788f209 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:41.292227 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c4a21a1b-c18a-4019-9a01-be8d2788f209 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:41.324459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9f7977f1-ea80-4625-bd97-3026783b3834 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:41.341458 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9f7977f1-ea80-4625-bd97-3026783b3834 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:41.343652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9f7977f1-ea80-4625-bd97-3026783b3834 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:41.355846 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9f7977f1-ea80-4625-bd97-3026783b3834 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1739 microversion: 2.20 time: 0.564080 Jul 25 14:36:41.360679 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1475/2745] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:36:40 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1739 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:36:41.738873 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c4a21a1b-c18a-4019-9a01-be8d2788f209 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:41.756739 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c4a21a1b-c18a-4019-9a01-be8d2788f209 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1199 microversion: 2.1 time: 0.529102 Jul 25 14:36:41.760932 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1271/2746] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:41 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1199 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:41.809892 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-453bacad-007b-45e5-990c-0d7af65a961e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:41.810477 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-453bacad-007b-45e5-990c-0d7af65a961e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:41.830080 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-453bacad-007b-45e5-990c-0d7af65a961e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:41.835640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-453bacad-007b-45e5-990c-0d7af65a961e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:41.844401 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-453bacad-007b-45e5-990c-0d7af65a961e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:41.845128 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-453bacad-007b-45e5-990c-0d7af65a961e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:42.317392 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-453bacad-007b-45e5-990c-0d7af65a961e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:42.317589 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c22c7fad-d70c-4191-98ae-bd0ca7602924 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Action: 'create', calling method: .version_select at 0x7f46989ad8b0>, body: {"keypair": {"name": "tempest-keypair-848541643", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7OhQ+10aeDIOxOOcbN3IerjUscmxTCmZlEvC6Q26S1HiuD5dY/6uxR3jO2PCGZmzm97UZl3UGU6qLWzNuIJSGTntdtOznHbwT+/bT4ddrYQoku1JX9Zy2nDywAKskhhg=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:36:42.331717 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-453bacad-007b-45e5-990c-0d7af65a961e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1521 microversion: 2.1 time: 0.525981 Jul 25 14:36:42.334232 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1476/2747] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:41 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1521 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:42.339914 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9de731f2-2c02-43c9-9ab2-9b5c60d835d7 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:42.341114 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9de731f2-2c02-43c9-9ab2-9b5c60d835d7 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:42.359699 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9de731f2-2c02-43c9-9ab2-9b5c60d835d7 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:42.363872 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9de731f2-2c02-43c9-9ab2-9b5c60d835d7 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:42.367458 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9de731f2-2c02-43c9-9ab2-9b5c60d835d7 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:42.368659 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9de731f2-2c02-43c9-9ab2-9b5c60d835d7 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:42.376641 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-c22c7fad-d70c-4191-98ae-bd0ca7602924 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Getting quotas for project 5771bc6c546646b5a432a114f76d373d. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:36:42.396577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-c22c7fad-d70c-4191-98ae-bd0ca7602924 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Getting quotas for user a1a720adc1b3443a8062b3eb8c7df11c and project 5771bc6c546646b5a432a114f76d373d. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:36:42.477689 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c22c7fad-d70c-4191-98ae-bd0ca7602924 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.453808 Jul 25 14:36:42.481942 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1272/2748] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:36:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:36:42.487240 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-07fd42f4-ebfb-4e2b-a399-e61fc722072f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:42.495544 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-07fd42f4-ebfb-4e2b-a399-e61fc722072f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:42.515456 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-07fd42f4-ebfb-4e2b-a399-e61fc722072f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:42.516176 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-07fd42f4-ebfb-4e2b-a399-e61fc722072f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:42.517165 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-07fd42f4-ebfb-4e2b-a399-e61fc722072f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:42.517765 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-07fd42f4-ebfb-4e2b-a399-e61fc722072f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:42.794240 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9de731f2-2c02-43c9-9ab2-9b5c60d835d7 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:42.808194 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9de731f2-2c02-43c9-9ab2-9b5c60d835d7 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1524 microversion: 2.1 time: 0.470398 Jul 25 14:36:42.811798 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1477/2749] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:42 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1524 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:42.825334 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a9b20d68-6662-43d7-b0b7-fac66eaa01f5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:42.828701 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a9b20d68-6662-43d7-b0b7-fac66eaa01f5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:42.860173 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a9b20d68-6662-43d7-b0b7-fac66eaa01f5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:42.860632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a9b20d68-6662-43d7-b0b7-fac66eaa01f5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:42.863351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a9b20d68-6662-43d7-b0b7-fac66eaa01f5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:42.863795 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a9b20d68-6662-43d7-b0b7-fac66eaa01f5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:42.991574 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-07fd42f4-ebfb-4e2b-a399-e61fc722072f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:43.011417 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-07fd42f4-ebfb-4e2b-a399-e61fc722072f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:43.018755 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-07fd42f4-ebfb-4e2b-a399-e61fc722072f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:43.020552 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-07fd42f4-ebfb-4e2b-a399-e61fc722072f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1739 microversion: 2.20 time: 0.537178 Jul 25 14:36:43.023024 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1273/2750] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:36:42 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1739 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:36:43.160060 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a9b20d68-6662-43d7-b0b7-fac66eaa01f5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:43.170248 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a9b20d68-6662-43d7-b0b7-fac66eaa01f5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1381 microversion: 2.1 time: 0.355971 Jul 25 14:36:43.171429 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1478/2751] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:42 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1381 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:43.357022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f06e1be8-fbd2-4808-b4a5-089a43faaf52 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:43.357646 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f06e1be8-fbd2-4808-b4a5-089a43faaf52 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:43.389668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f06e1be8-fbd2-4808-b4a5-089a43faaf52 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:43.390345 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f06e1be8-fbd2-4808-b4a5-089a43faaf52 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:43.391240 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f06e1be8-fbd2-4808-b4a5-089a43faaf52 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:43.391682 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f06e1be8-fbd2-4808-b4a5-089a43faaf52 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:43.872948 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7365f73a-6c0d-48c3-98bf-6fc29480209e tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:43.873830 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7365f73a-6c0d-48c3-98bf-6fc29480209e tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:43.893543 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7365f73a-6c0d-48c3-98bf-6fc29480209e tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:43.896026 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7365f73a-6c0d-48c3-98bf-6fc29480209e tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:43.899513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7365f73a-6c0d-48c3-98bf-6fc29480209e tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:43.900358 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7365f73a-6c0d-48c3-98bf-6fc29480209e tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:43.921982 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f06e1be8-fbd2-4808-b4a5-089a43faaf52 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:43.947524 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f06e1be8-fbd2-4808-b4a5-089a43faaf52 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1521 microversion: 2.1 time: 0.591757 Jul 25 14:36:43.968165 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1479/2752] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:43 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1521 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:43.979156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-72695328-3ed0-4921-87b7-49bbcd99f8f2 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:43.981358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-72695328-3ed0-4921-87b7-49bbcd99f8f2 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:44.006128 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72695328-3ed0-4921-87b7-49bbcd99f8f2 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:44.012908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72695328-3ed0-4921-87b7-49bbcd99f8f2 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:44.014637 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72695328-3ed0-4921-87b7-49bbcd99f8f2 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:44.017384 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72695328-3ed0-4921-87b7-49bbcd99f8f2 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:44.277720 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7365f73a-6c0d-48c3-98bf-6fc29480209e tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1534 microversion: 2.1 time: 1.083705 Jul 25 14:36:44.285096 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1274/2753] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:43 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1534 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:44.292254 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7ddf5259-5a15-4555-9795-ab54769f038a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:44.293428 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7ddf5259-5a15-4555-9795-ab54769f038a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:44.301777 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ddf5259-5a15-4555-9795-ab54769f038a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:44.302623 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ddf5259-5a15-4555-9795-ab54769f038a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:44.303642 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ddf5259-5a15-4555-9795-ab54769f038a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:44.304451 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ddf5259-5a15-4555-9795-ab54769f038a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:44.518518 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-72695328-3ed0-4921-87b7-49bbcd99f8f2 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:44.547043 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-72695328-3ed0-4921-87b7-49bbcd99f8f2 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1524 microversion: 2.1 time: 0.575718 Jul 25 14:36:44.560939 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1480/2754] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:43 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1524 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:44.582332 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-51d0b8ca-8418-42da-b33f-462dd8d05313 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:44.584589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-51d0b8ca-8418-42da-b33f-462dd8d05313 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:44.601484 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51d0b8ca-8418-42da-b33f-462dd8d05313 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:44.602622 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51d0b8ca-8418-42da-b33f-462dd8d05313 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:44.603718 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51d0b8ca-8418-42da-b33f-462dd8d05313 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:44.605185 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51d0b8ca-8418-42da-b33f-462dd8d05313 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:44.675425 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7ddf5259-5a15-4555-9795-ab54769f038a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:44.684410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7ddf5259-5a15-4555-9795-ab54769f038a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:44.685970 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7ddf5259-5a15-4555-9795-ab54769f038a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:44.687174 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7ddf5259-5a15-4555-9795-ab54769f038a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1739 microversion: 2.20 time: 0.400279 Jul 25 14:36:44.708159 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1275/2755] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:36:44 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1739 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:36:44.984131 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b8b421c2-3f44-4317-b80a-17003f49abc1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:44.985323 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b8b421c2-3f44-4317-b80a-17003f49abc1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:45.000173 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8b421c2-3f44-4317-b80a-17003f49abc1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:45.002850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8b421c2-3f44-4317-b80a-17003f49abc1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:45.003732 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8b421c2-3f44-4317-b80a-17003f49abc1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:45.009878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8b421c2-3f44-4317-b80a-17003f49abc1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:45.070454 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-51d0b8ca-8418-42da-b33f-462dd8d05313 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1534 microversion: 2.1 time: 0.501737 Jul 25 14:36:45.071651 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1481/2756] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:44 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1534 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:45.094825 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2330db6e-8af4-44a4-94df-b2cc4cfb336e tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:45.113572 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:36:45.113572 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:36:45.119384 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2330db6e-8af4-44a4-94df-b2cc4cfb336e tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:45.129828 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2330db6e-8af4-44a4-94df-b2cc4cfb336e tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:45.131610 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2330db6e-8af4-44a4-94df-b2cc4cfb336e tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:45.132074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2330db6e-8af4-44a4-94df-b2cc4cfb336e tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:45.296331 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2330db6e-8af4-44a4-94df-b2cc4cfb336e tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.206990 Jul 25 14:36:45.300966 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1482/2757] 10.222.0.88 () {58 vars in 1176 bytes} [Mon Jul 25 14:36:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:36:45.315890 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-86d91f96-536c-4fec-b9c7-069b02ce37c2 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846435-14", "block_migration": false, "disk_over_commit": false}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:36:45.335657 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-86d91f96-536c-4fec-b9c7-069b02ce37c2 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:45.350617 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-86d91f96-536c-4fec-b9c7-069b02ce37c2 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:45.352148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-86d91f96-536c-4fec-b9c7-069b02ce37c2 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:45.353927 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-86d91f96-536c-4fec-b9c7-069b02ce37c2 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:45.354668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-86d91f96-536c-4fec-b9c7-069b02ce37c2 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:45.389333 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-86d91f96-536c-4fec-b9c7-069b02ce37c2 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lazy-loading 'flavor' on Instance uuid 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:36:45.407526 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-86d91f96-536c-4fec-b9c7-069b02ce37c2 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Going to try to live migrate instance to n-h2-846435-14 {{(pid=119304) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 14:36:45.675431 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b8b421c2-3f44-4317-b80a-17003f49abc1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:45.696373 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b8b421c2-3f44-4317-b80a-17003f49abc1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1521 microversion: 2.1 time: 0.721740 Jul 25 14:36:45.697761 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1276/2758] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:44 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1521 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:45.720839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-532412d7-fd84-4a77-8288-7fbb4efd256a tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:45.724189 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-532412d7-fd84-4a77-8288-7fbb4efd256a tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:45.745218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-532412d7-fd84-4a77-8288-7fbb4efd256a tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:45.752742 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-532412d7-fd84-4a77-8288-7fbb4efd256a tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:45.760220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-532412d7-fd84-4a77-8288-7fbb4efd256a tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:45.761087 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-532412d7-fd84-4a77-8288-7fbb4efd256a tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:46.260573 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-532412d7-fd84-4a77-8288-7fbb4efd256a tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:46.299222 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-532412d7-fd84-4a77-8288-7fbb4efd256a tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1524 microversion: 2.1 time: 0.595905 Jul 25 14:36:46.308068 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1277/2759] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:45 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1524 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:46.342570 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5ad493ef-750b-4cf1-87c2-fa5c285db885 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:46.343595 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5ad493ef-750b-4cf1-87c2-fa5c285db885 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:46.366473 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5ad493ef-750b-4cf1-87c2-fa5c285db885 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:46.368639 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5ad493ef-750b-4cf1-87c2-fa5c285db885 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:46.369958 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5ad493ef-750b-4cf1-87c2-fa5c285db885 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:46.370897 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5ad493ef-750b-4cf1-87c2-fa5c285db885 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:46.903946 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5ad493ef-750b-4cf1-87c2-fa5c285db885 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:46.923735 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5ad493ef-750b-4cf1-87c2-fa5c285db885 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:46.932494 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5ad493ef-750b-4cf1-87c2-fa5c285db885 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:46.941230 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5ad493ef-750b-4cf1-87c2-fa5c285db885 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1739 microversion: 2.20 time: 0.626052 Jul 25 14:36:46.955902 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1278/2760] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:36:46 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1739 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:36:46.978891 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a7c4be95-f350-438d-8896-67f365c9f1b9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:46.980000 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a7c4be95-f350-438d-8896-67f365c9f1b9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:47.002466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a7c4be95-f350-438d-8896-67f365c9f1b9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:47.005374 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a7c4be95-f350-438d-8896-67f365c9f1b9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:47.012735 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a7c4be95-f350-438d-8896-67f365c9f1b9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:47.013548 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a7c4be95-f350-438d-8896-67f365c9f1b9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:47.761245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a7c4be95-f350-438d-8896-67f365c9f1b9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:47.772713 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a7c4be95-f350-438d-8896-67f365c9f1b9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1521 microversion: 2.1 time: 0.813802 Jul 25 14:36:47.777100 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1279/2761] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:46 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1521 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:47.803051 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ad87375d-549a-43c5-bbdc-b4d6ae4ac40d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:47.804165 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ad87375d-549a-43c5-bbdc-b4d6ae4ac40d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:47.811157 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ad87375d-549a-43c5-bbdc-b4d6ae4ac40d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:47.811841 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ad87375d-549a-43c5-bbdc-b4d6ae4ac40d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:47.812801 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ad87375d-549a-43c5-bbdc-b4d6ae4ac40d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:47.813421 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ad87375d-549a-43c5-bbdc-b4d6ae4ac40d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:48.263464 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ad87375d-549a-43c5-bbdc-b4d6ae4ac40d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:48.272733 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ad87375d-549a-43c5-bbdc-b4d6ae4ac40d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1524 microversion: 2.1 time: 0.483351 Jul 25 14:36:48.273507 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1280/2762] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:47 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1524 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:48.311234 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-34f3f666-71a1-4ded-a3de-4059a2bd2fec tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:48.314878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-34f3f666-71a1-4ded-a3de-4059a2bd2fec tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:48.352619 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-34f3f666-71a1-4ded-a3de-4059a2bd2fec tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:48.356130 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-34f3f666-71a1-4ded-a3de-4059a2bd2fec tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:48.357667 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-34f3f666-71a1-4ded-a3de-4059a2bd2fec tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:48.359501 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-34f3f666-71a1-4ded-a3de-4059a2bd2fec tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:48.457583 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-86d91f96-536c-4fec-b9c7-069b02ce37c2 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e/action" status: 202 len: 0 microversion: 2.1 time: 3.146028 Jul 25 14:36:48.459924 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1483/2763] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:36:45 2022] POST /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e/action => generated 0 bytes in 3150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:36:48.467720 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-59730b9e-c801-4645-a88d-e29c0dfac7dd tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-42793105", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "bd1ac2fa-6cf0-462f-b14e-cb642566d402"}], "security_groups": [{"name": "tempest-securitygroup--1645813038"}], "key_name": "tempest-keypair-848541643", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:36:48.845909 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-34f3f666-71a1-4ded-a3de-4059a2bd2fec tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:48.867671 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-34f3f666-71a1-4ded-a3de-4059a2bd2fec tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:48.875677 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-34f3f666-71a1-4ded-a3de-4059a2bd2fec tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:48.878963 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-34f3f666-71a1-4ded-a3de-4059a2bd2fec tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1739 microversion: 2.20 time: 0.604525 Jul 25 14:36:48.881557 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1281/2764] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:36:48 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1739 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:36:48.894222 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f38c4023-fd32-4809-9711-0870f5ef72b0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:48.894890 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f38c4023-fd32-4809-9711-0870f5ef72b0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:48.902644 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f38c4023-fd32-4809-9711-0870f5ef72b0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:48.903137 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f38c4023-fd32-4809-9711-0870f5ef72b0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:48.904109 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f38c4023-fd32-4809-9711-0870f5ef72b0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:48.904752 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f38c4023-fd32-4809-9711-0870f5ef72b0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:50.096043 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f38c4023-fd32-4809-9711-0870f5ef72b0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:50.114722 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f38c4023-fd32-4809-9711-0870f5ef72b0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1391 microversion: 2.1 time: 1.231746 Jul 25 14:36:50.115664 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1282/2765] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:48 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1391 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:50.136457 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fa6529f3-e548-4baa-ad1d-9b134a8b483a tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:50.137389 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fa6529f3-e548-4baa-ad1d-9b134a8b483a tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:50.147687 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa6529f3-e548-4baa-ad1d-9b134a8b483a tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:50.148593 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa6529f3-e548-4baa-ad1d-9b134a8b483a tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:50.150103 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa6529f3-e548-4baa-ad1d-9b134a8b483a tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:50.150949 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa6529f3-e548-4baa-ad1d-9b134a8b483a tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:50.548475 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fa6529f3-e548-4baa-ad1d-9b134a8b483a tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:50.559853 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fa6529f3-e548-4baa-ad1d-9b134a8b483a tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1521 microversion: 2.1 time: 0.439368 Jul 25 14:36:50.560873 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1283/2766] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:50 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1521 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:50.565734 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8611d589-f6fc-4aac-b757-ebb5d7a328da tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:50.566467 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8611d589-f6fc-4aac-b757-ebb5d7a328da tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:50.573051 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8611d589-f6fc-4aac-b757-ebb5d7a328da tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:50.573650 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8611d589-f6fc-4aac-b757-ebb5d7a328da tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:50.574549 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8611d589-f6fc-4aac-b757-ebb5d7a328da tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:50.575097 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8611d589-f6fc-4aac-b757-ebb5d7a328da tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:50.818204 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8611d589-f6fc-4aac-b757-ebb5d7a328da tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:50.828314 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8611d589-f6fc-4aac-b757-ebb5d7a328da tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1524 microversion: 2.1 time: 0.266104 Jul 25 14:36:50.831220 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1284/2767] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:50 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1524 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:50.835869 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9ddd5369-0b9b-441b-8d45-3b14814ec7a5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:50.839147 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9ddd5369-0b9b-441b-8d45-3b14814ec7a5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:50.857722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9ddd5369-0b9b-441b-8d45-3b14814ec7a5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:50.858182 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9ddd5369-0b9b-441b-8d45-3b14814ec7a5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:50.858985 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9ddd5369-0b9b-441b-8d45-3b14814ec7a5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:50.859425 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9ddd5369-0b9b-441b-8d45-3b14814ec7a5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:50.865836 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:36:51.300974 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9ddd5369-0b9b-441b-8d45-3b14814ec7a5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:51.311013 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9ddd5369-0b9b-441b-8d45-3b14814ec7a5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:51.315547 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9ddd5369-0b9b-441b-8d45-3b14814ec7a5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:51.319962 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9ddd5369-0b9b-441b-8d45-3b14814ec7a5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1739 microversion: 2.20 time: 0.487967 Jul 25 14:36:51.339028 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1285/2768] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:36:50 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1739 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:36:51.349111 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c03a0421-ab14-404c-a070-b709d7871f8a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:51.356953 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c03a0421-ab14-404c-a070-b709d7871f8a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:51.370002 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c03a0421-ab14-404c-a070-b709d7871f8a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:51.370743 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c03a0421-ab14-404c-a070-b709d7871f8a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:51.371723 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c03a0421-ab14-404c-a070-b709d7871f8a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:51.372341 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c03a0421-ab14-404c-a070-b709d7871f8a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:51.694950 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c03a0421-ab14-404c-a070-b709d7871f8a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:51.705181 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c03a0421-ab14-404c-a070-b709d7871f8a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1391 microversion: 2.1 time: 0.364700 Jul 25 14:36:51.708194 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1286/2769] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:51 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1391 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:51.721670 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4118844e-c2e9-44f6-9633-d30bed12e2eb tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:51.722591 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4118844e-c2e9-44f6-9633-d30bed12e2eb tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:51.743518 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4118844e-c2e9-44f6-9633-d30bed12e2eb tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:51.744067 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4118844e-c2e9-44f6-9633-d30bed12e2eb tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:51.744854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4118844e-c2e9-44f6-9633-d30bed12e2eb tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:51.745293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4118844e-c2e9-44f6-9633-d30bed12e2eb tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:51.999413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-59730b9e-c801-4645-a88d-e29c0dfac7dd tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] validate_networks() for [('bd1ac2fa-6cf0-462f-b14e-cb642566d402', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:36:52.405318 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4118844e-c2e9-44f6-9633-d30bed12e2eb tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:52.423015 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4118844e-c2e9-44f6-9633-d30bed12e2eb tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1521 microversion: 2.1 time: 0.708380 Jul 25 14:36:52.428773 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1287/2770] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:51 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1521 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:52.445524 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9969a8a8-451e-4ad4-8790-8af276697878 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:52.452138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9969a8a8-451e-4ad4-8790-8af276697878 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:52.464701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:36:52.470004 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9969a8a8-451e-4ad4-8790-8af276697878 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:52.472772 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9969a8a8-451e-4ad4-8790-8af276697878 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:52.473928 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9969a8a8-451e-4ad4-8790-8af276697878 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:52.474551 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9969a8a8-451e-4ad4-8790-8af276697878 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:53.068383 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9969a8a8-451e-4ad4-8790-8af276697878 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:53.083253 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9969a8a8-451e-4ad4-8790-8af276697878 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1524 microversion: 2.1 time: 0.648823 Jul 25 14:36:53.084341 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1288/2771] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:52 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1524 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:53.091941 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6863facc-a10a-44cc-9c12-307c7cb52c4d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:53.096443 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6863facc-a10a-44cc-9c12-307c7cb52c4d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:53.112740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6863facc-a10a-44cc-9c12-307c7cb52c4d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:53.115135 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6863facc-a10a-44cc-9c12-307c7cb52c4d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:53.117081 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6863facc-a10a-44cc-9c12-307c7cb52c4d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:53.120002 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6863facc-a10a-44cc-9c12-307c7cb52c4d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:53.133830 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-59730b9e-c801-4645-a88d-e29c0dfac7dd tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:36:53.134465 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-59730b9e-c801-4645-a88d-e29c0dfac7dd tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:36:53.134756 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-59730b9e-c801-4645-a88d-e29c0dfac7dd tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:36:53.135163 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-59730b9e-c801-4645-a88d-e29c0dfac7dd tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:36:53.135641 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-59730b9e-c801-4645-a88d-e29c0dfac7dd tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:36:53.153299 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59730b9e-c801-4645-a88d-e29c0dfac7dd tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:53.157100 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59730b9e-c801-4645-a88d-e29c0dfac7dd tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:53.159031 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59730b9e-c801-4645-a88d-e29c0dfac7dd tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:53.159641 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59730b9e-c801-4645-a88d-e29c0dfac7dd tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:53.208117 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-59730b9e-c801-4645-a88d-e29c0dfac7dd tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Getting quotas for project 5771bc6c546646b5a432a114f76d373d. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:36:53.234823 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-59730b9e-c801-4645-a88d-e29c0dfac7dd tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Getting quotas for user a1a720adc1b3443a8062b3eb8c7df11c and project 5771bc6c546646b5a432a114f76d373d. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:36:53.271272 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-59730b9e-c801-4645-a88d-e29c0dfac7dd tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:36:53.276737 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-59730b9e-c801-4645-a88d-e29c0dfac7dd tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:36:53.397534 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-59730b9e-c801-4645-a88d-e29c0dfac7dd tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.936241 Jul 25 14:36:53.398791 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1484/2772] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:36:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 4938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:36:53.417483 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-925ca14f-8363-4b31-81fd-aa060ae5f25f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:53.420336 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-925ca14f-8363-4b31-81fd-aa060ae5f25f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:53.438300 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-925ca14f-8363-4b31-81fd-aa060ae5f25f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:53.443110 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-925ca14f-8363-4b31-81fd-aa060ae5f25f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:53.446795 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-925ca14f-8363-4b31-81fd-aa060ae5f25f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:53.447357 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-925ca14f-8363-4b31-81fd-aa060ae5f25f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:53.738395 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-925ca14f-8363-4b31-81fd-aa060ae5f25f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:53.752932 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-925ca14f-8363-4b31-81fd-aa060ae5f25f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1391 microversion: 2.1 time: 0.342749 Jul 25 14:36:53.754146 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1485/2773] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:53 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1391 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:53.766482 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f753f77a-eb1c-4e5a-8aa9-19c1da4836be tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:53.768248 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f753f77a-eb1c-4e5a-8aa9-19c1da4836be tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:53.942489 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6863facc-a10a-44cc-9c12-307c7cb52c4d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:53.964444 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6863facc-a10a-44cc-9c12-307c7cb52c4d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:53.973412 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6863facc-a10a-44cc-9c12-307c7cb52c4d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:53.982481 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6863facc-a10a-44cc-9c12-307c7cb52c4d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1739 microversion: 2.20 time: 0.891293 Jul 25 14:36:53.983527 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1289/2774] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:36:53 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1739 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:36:54.007205 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2fde081a-e0a5-4bcd-9445-f2fb94b8595d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:54.008117 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2fde081a-e0a5-4bcd-9445-f2fb94b8595d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:54.032328 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2fde081a-e0a5-4bcd-9445-f2fb94b8595d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:54.033545 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2fde081a-e0a5-4bcd-9445-f2fb94b8595d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:54.035155 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2fde081a-e0a5-4bcd-9445-f2fb94b8595d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:54.036562 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2fde081a-e0a5-4bcd-9445-f2fb94b8595d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:54.216652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f753f77a-eb1c-4e5a-8aa9-19c1da4836be tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a720adc1b3443a8062b3eb8c7df11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5771bc6c546646b5a432a114f76d373d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:54.234414 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f753f77a-eb1c-4e5a-8aa9-19c1da4836be tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653" status: 200 len: 1239 microversion: 2.1 time: 0.475163 Jul 25 14:36:54.256365 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1486/2775] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:53 2022] GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653 => generated 1239 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:54.273045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b50ab994-98f7-4baa-bd1f-2ba4d25fb08d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:54.273673 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b50ab994-98f7-4baa-bd1f-2ba4d25fb08d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:54.290661 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b50ab994-98f7-4baa-bd1f-2ba4d25fb08d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:54.295834 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b50ab994-98f7-4baa-bd1f-2ba4d25fb08d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:54.297019 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b50ab994-98f7-4baa-bd1f-2ba4d25fb08d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:54.297613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b50ab994-98f7-4baa-bd1f-2ba4d25fb08d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:54.419346 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2fde081a-e0a5-4bcd-9445-f2fb94b8595d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:54.448976 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2fde081a-e0a5-4bcd-9445-f2fb94b8595d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1521 microversion: 2.1 time: 0.461305 Jul 25 14:36:54.449622 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1290/2776] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:53 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1521 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:54.690327 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b50ab994-98f7-4baa-bd1f-2ba4d25fb08d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:54.699577 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b50ab994-98f7-4baa-bd1f-2ba4d25fb08d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1524 microversion: 2.1 time: 0.441961 Jul 25 14:36:54.703433 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1487/2777] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:54 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1524 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:54.781652 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3f816c19-46e5-43ca-adfd-c178e2752d9f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:54.782290 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3f816c19-46e5-43ca-adfd-c178e2752d9f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:54.802541 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3f816c19-46e5-43ca-adfd-c178e2752d9f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:54.804741 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3f816c19-46e5-43ca-adfd-c178e2752d9f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:54.807808 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3f816c19-46e5-43ca-adfd-c178e2752d9f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:54.816842 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3f816c19-46e5-43ca-adfd-c178e2752d9f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:55.013732 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4837595c-8f90-4645-8d96-1cc8e5ad785e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:55.015425 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4837595c-8f90-4645-8d96-1cc8e5ad785e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:55.033980 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4837595c-8f90-4645-8d96-1cc8e5ad785e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:55.034454 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4837595c-8f90-4645-8d96-1cc8e5ad785e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:55.035297 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4837595c-8f90-4645-8d96-1cc8e5ad785e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:55.036125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4837595c-8f90-4645-8d96-1cc8e5ad785e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:55.101192 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:36:55.114545 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3f816c19-46e5-43ca-adfd-c178e2752d9f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:55.130313 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3f816c19-46e5-43ca-adfd-c178e2752d9f tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1391 microversion: 2.1 time: 0.353327 Jul 25 14:36:55.131198 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1291/2778] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:54 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1391 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:55.269396 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cb5fe7e6-d495-4bc5-b7c1-75b97e2b71a2 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:55.270045 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cb5fe7e6-d495-4bc5-b7c1-75b97e2b71a2 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:55.279443 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cb5fe7e6-d495-4bc5-b7c1-75b97e2b71a2 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:55.279905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cb5fe7e6-d495-4bc5-b7c1-75b97e2b71a2 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:55.280740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cb5fe7e6-d495-4bc5-b7c1-75b97e2b71a2 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:55.281182 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cb5fe7e6-d495-4bc5-b7c1-75b97e2b71a2 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:55.427839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cb5fe7e6-d495-4bc5-b7c1-75b97e2b71a2 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a720adc1b3443a8062b3eb8c7df11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5771bc6c546646b5a432a114f76d373d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:55.459001 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cb5fe7e6-d495-4bc5-b7c1-75b97e2b71a2 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653" status: 200 len: 1243 microversion: 2.1 time: 0.207917 Jul 25 14:36:55.472760 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1292/2779] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:55 2022] GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653 => generated 1243 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:55.481473 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8fba850d-0239-4c5c-9c2e-d69b7213234d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:55.482109 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8fba850d-0239-4c5c-9c2e-d69b7213234d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:55.499580 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8fba850d-0239-4c5c-9c2e-d69b7213234d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:55.500063 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8fba850d-0239-4c5c-9c2e-d69b7213234d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:55.500875 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8fba850d-0239-4c5c-9c2e-d69b7213234d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:55.501439 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8fba850d-0239-4c5c-9c2e-d69b7213234d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:55.729686 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8fba850d-0239-4c5c-9c2e-d69b7213234d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:55.738726 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8fba850d-0239-4c5c-9c2e-d69b7213234d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1521 microversion: 2.1 time: 0.264801 Jul 25 14:36:55.739530 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1293/2780] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:55 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:55.744919 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fb2deeed-8401-4c37-9728-8c2b9acb778b tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:55.745599 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fb2deeed-8401-4c37-9728-8c2b9acb778b tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:55.757961 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fb2deeed-8401-4c37-9728-8c2b9acb778b tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:55.758508 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fb2deeed-8401-4c37-9728-8c2b9acb778b tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:55.759434 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fb2deeed-8401-4c37-9728-8c2b9acb778b tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:55.771874 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fb2deeed-8401-4c37-9728-8c2b9acb778b tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:56.047704 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4837595c-8f90-4645-8d96-1cc8e5ad785e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:56.073774 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4837595c-8f90-4645-8d96-1cc8e5ad785e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:56.091851 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4837595c-8f90-4645-8d96-1cc8e5ad785e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:56.093488 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4837595c-8f90-4645-8d96-1cc8e5ad785e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1739 microversion: 2.20 time: 1.083892 Jul 25 14:36:56.103446 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1488/2781] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:36:55 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1739 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:36:56.161600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-be7b829c-7670-4378-b89d-9a9c8acbd309 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:56.162564 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-be7b829c-7670-4378-b89d-9a9c8acbd309 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:56.174946 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:36:56.177084 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be7b829c-7670-4378-b89d-9a9c8acbd309 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:56.177783 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be7b829c-7670-4378-b89d-9a9c8acbd309 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:56.178803 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be7b829c-7670-4378-b89d-9a9c8acbd309 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:56.179958 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be7b829c-7670-4378-b89d-9a9c8acbd309 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:56.332466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fb2deeed-8401-4c37-9728-8c2b9acb778b tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:56.347498 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fb2deeed-8401-4c37-9728-8c2b9acb778b tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1524 microversion: 2.1 time: 0.606957 Jul 25 14:36:56.352831 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1294/2782] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:55 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1524 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:56.447648 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-be7b829c-7670-4378-b89d-9a9c8acbd309 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:56.462954 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-be7b829c-7670-4378-b89d-9a9c8acbd309 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1391 microversion: 2.1 time: 0.302161 Jul 25 14:36:56.484670 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1489/2783] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:56 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1391 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:56.488409 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bda9c69f-4cc8-4097-90b0-6c1cda2d3a41 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:56.489912 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bda9c69f-4cc8-4097-90b0-6c1cda2d3a41 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:56.523376 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bda9c69f-4cc8-4097-90b0-6c1cda2d3a41 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:56.529531 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bda9c69f-4cc8-4097-90b0-6c1cda2d3a41 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:56.535245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bda9c69f-4cc8-4097-90b0-6c1cda2d3a41 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:56.537297 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bda9c69f-4cc8-4097-90b0-6c1cda2d3a41 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:56.703472 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bda9c69f-4cc8-4097-90b0-6c1cda2d3a41 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a720adc1b3443a8062b3eb8c7df11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5771bc6c546646b5a432a114f76d373d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:56.713739 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bda9c69f-4cc8-4097-90b0-6c1cda2d3a41 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653" status: 200 len: 1291 microversion: 2.1 time: 0.231784 Jul 25 14:36:56.721831 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1295/2784] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:56 2022] GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653 => generated 1291 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:36:56.766650 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-77cbe013-830c-4cbd-a3a1-680b00b38f26 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:56.767267 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-77cbe013-830c-4cbd-a3a1-680b00b38f26 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:56.782271 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-77cbe013-830c-4cbd-a3a1-680b00b38f26 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:56.782721 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-77cbe013-830c-4cbd-a3a1-680b00b38f26 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:56.783529 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-77cbe013-830c-4cbd-a3a1-680b00b38f26 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:56.783948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-77cbe013-830c-4cbd-a3a1-680b00b38f26 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:57.128013 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9d6bda59-5156-4959-ba04-eccb643013cf tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:57.129035 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9d6bda59-5156-4959-ba04-eccb643013cf tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:57.142340 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d6bda59-5156-4959-ba04-eccb643013cf tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:57.147597 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d6bda59-5156-4959-ba04-eccb643013cf tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:57.148966 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d6bda59-5156-4959-ba04-eccb643013cf tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:57.151112 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d6bda59-5156-4959-ba04-eccb643013cf tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:57.240408 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-77cbe013-830c-4cbd-a3a1-680b00b38f26 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:57.264372 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-77cbe013-830c-4cbd-a3a1-680b00b38f26 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1521 microversion: 2.1 time: 0.501674 Jul 25 14:36:57.279935 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1490/2785] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:56 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1521 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:36:57.383368 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-91669fbc-d19b-4106-8989-56cfb6887796 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:57.383368 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-91669fbc-d19b-4106-8989-56cfb6887796 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:57.444258 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-91669fbc-d19b-4106-8989-56cfb6887796 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:57.444710 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-91669fbc-d19b-4106-8989-56cfb6887796 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:57.445659 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-91669fbc-d19b-4106-8989-56cfb6887796 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:57.446171 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-91669fbc-d19b-4106-8989-56cfb6887796 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:57.871450 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-91669fbc-d19b-4106-8989-56cfb6887796 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:57.880346 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-91669fbc-d19b-4106-8989-56cfb6887796 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1524 microversion: 2.1 time: 0.502452 Jul 25 14:36:57.884227 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1491/2786] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:57 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1524 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:57.892373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-224fa68f-30cd-4886-8491-07b53f027bec tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:57.896950 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-224fa68f-30cd-4886-8491-07b53f027bec tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:57.913754 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-224fa68f-30cd-4886-8491-07b53f027bec tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:57.914600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-224fa68f-30cd-4886-8491-07b53f027bec tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:57.915659 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-224fa68f-30cd-4886-8491-07b53f027bec tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:57.916356 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-224fa68f-30cd-4886-8491-07b53f027bec tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:58.179483 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-224fa68f-30cd-4886-8491-07b53f027bec tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:58.197162 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-224fa68f-30cd-4886-8491-07b53f027bec tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1391 microversion: 2.1 time: 0.309825 Jul 25 14:36:58.202867 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1492/2787] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:57 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1391 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:58.224856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-661904df-f8c3-49c6-b990-91fd8999810e tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:58.229144 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-661904df-f8c3-49c6-b990-91fd8999810e tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:58.258834 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-661904df-f8c3-49c6-b990-91fd8999810e tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:58.260048 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-661904df-f8c3-49c6-b990-91fd8999810e tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:58.262178 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-661904df-f8c3-49c6-b990-91fd8999810e tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:58.265148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-661904df-f8c3-49c6-b990-91fd8999810e tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:58.531987 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-661904df-f8c3-49c6-b990-91fd8999810e tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a720adc1b3443a8062b3eb8c7df11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5771bc6c546646b5a432a114f76d373d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:58.548590 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-661904df-f8c3-49c6-b990-91fd8999810e tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653" status: 200 len: 1297 microversion: 2.1 time: 0.344501 Jul 25 14:36:58.556503 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1493/2788] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:58 2022] GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653 => generated 1297 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:58.587796 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2f9de2f4-8ec8-4d1a-93b1-6d771f887bba tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:58.591687 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2f9de2f4-8ec8-4d1a-93b1-6d771f887bba tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:58.606870 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2f9de2f4-8ec8-4d1a-93b1-6d771f887bba tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:58.607318 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2f9de2f4-8ec8-4d1a-93b1-6d771f887bba tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:58.608927 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2f9de2f4-8ec8-4d1a-93b1-6d771f887bba tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:58.609437 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2f9de2f4-8ec8-4d1a-93b1-6d771f887bba tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:58.937173 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2f9de2f4-8ec8-4d1a-93b1-6d771f887bba tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:58.966493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9d6bda59-5156-4959-ba04-eccb643013cf tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:58.996140 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2f9de2f4-8ec8-4d1a-93b1-6d771f887bba tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1521 microversion: 2.1 time: 0.387032 Jul 25 14:36:59.009824 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1494/2789] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:58 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1521 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:59.011906 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9d6bda59-5156-4959-ba04-eccb643013cf tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:59.013113 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9d6bda59-5156-4959-ba04-eccb643013cf tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:59.014357 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9d6bda59-5156-4959-ba04-eccb643013cf tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1739 microversion: 2.20 time: 1.891041 Jul 25 14:36:59.040520 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1296/2790] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:36:57 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1739 bytes in 1917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:36:59.042451 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-33d7b8b1-52ad-415c-b08d-5930cea27623 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:59.044911 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-33d7b8b1-52ad-415c-b08d-5930cea27623 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:59.055533 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-33d7b8b1-52ad-415c-b08d-5930cea27623 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:59.056708 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-33d7b8b1-52ad-415c-b08d-5930cea27623 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:59.058070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-33d7b8b1-52ad-415c-b08d-5930cea27623 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:59.059201 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-33d7b8b1-52ad-415c-b08d-5930cea27623 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:59.224769 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a7ad11dd-5435-4436-95d3-627eee072e32 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:59.225722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a7ad11dd-5435-4436-95d3-627eee072e32 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:59.251763 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a7ad11dd-5435-4436-95d3-627eee072e32 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:59.253202 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a7ad11dd-5435-4436-95d3-627eee072e32 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:59.254282 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a7ad11dd-5435-4436-95d3-627eee072e32 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:59.254888 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a7ad11dd-5435-4436-95d3-627eee072e32 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:59.934138 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-33d7b8b1-52ad-415c-b08d-5930cea27623 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:36:59.944716 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-33d7b8b1-52ad-415c-b08d-5930cea27623 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1504 microversion: 2.1 time: 0.934071 Jul 25 14:36:59.960905 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1495/2791] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:58 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1504 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:36:59.971969 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5a19d80f-b02b-4f58-a373-ed6f270f44ca tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:36:59.975380 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5a19d80f-b02b-4f58-a373-ed6f270f44ca tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:36:59.986276 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5a19d80f-b02b-4f58-a373-ed6f270f44ca tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:59.991957 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5a19d80f-b02b-4f58-a373-ed6f270f44ca tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:36:59.994069 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5a19d80f-b02b-4f58-a373-ed6f270f44ca tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:36:59.994712 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5a19d80f-b02b-4f58-a373-ed6f270f44ca tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:00.293929 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5a19d80f-b02b-4f58-a373-ed6f270f44ca tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a720adc1b3443a8062b3eb8c7df11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5771bc6c546646b5a432a114f76d373d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:00.303519 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5a19d80f-b02b-4f58-a373-ed6f270f44ca tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653" status: 200 len: 1365 microversion: 2.1 time: 0.341104 Jul 25 14:37:00.304705 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1496/2792] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:59 2022] GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653 => generated 1365 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:00.317399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e53cb0f6-2de3-4669-ad71-f3131603a162 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Action: 'create', calling method: .version_select at 0x7f46864ebb80>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-515514362", "description": "tempest-description-1918752083"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:00.682766 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e53cb0f6-2de3-4669-ad71-f3131603a162 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.376442 Jul 25 14:37:00.684111 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1497/2793] 10.222.0.88 () {60 vars in 1180 bytes} [Mon Jul 25 14:37:00 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:00.689986 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-82fa3f11-f07e-40a2-8fea-3fc2be65c96c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:00.690843 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-82fa3f11-f07e-40a2-8fea-3fc2be65c96c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:00.707824 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-82fa3f11-f07e-40a2-8fea-3fc2be65c96c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:00.708335 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-82fa3f11-f07e-40a2-8fea-3fc2be65c96c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:00.709288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-82fa3f11-f07e-40a2-8fea-3fc2be65c96c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:00.715443 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-82fa3f11-f07e-40a2-8fea-3fc2be65c96c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:00.966027 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-82fa3f11-f07e-40a2-8fea-3fc2be65c96c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:01.025641 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-82fa3f11-f07e-40a2-8fea-3fc2be65c96c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1521 microversion: 2.1 time: 0.336550 Jul 25 14:37:01.039239 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1498/2794] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:00 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:01.065307 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8bbb83dd-9f0f-4976-802e-42334c053e86 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:01.068909 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8bbb83dd-9f0f-4976-802e-42334c053e86 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:01.089307 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8bbb83dd-9f0f-4976-802e-42334c053e86 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:01.101113 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8bbb83dd-9f0f-4976-802e-42334c053e86 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:01.106173 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8bbb83dd-9f0f-4976-802e-42334c053e86 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:01.108055 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8bbb83dd-9f0f-4976-802e-42334c053e86 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:01.350908 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a7ad11dd-5435-4436-95d3-627eee072e32 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:01.367492 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a7ad11dd-5435-4436-95d3-627eee072e32 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1391 microversion: 2.1 time: 2.145143 Jul 25 14:37:01.383302 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1297/2795] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:36:59 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1391 bytes in 2165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:37:01.423006 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8bbb83dd-9f0f-4976-802e-42334c053e86 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:01.446606 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8bbb83dd-9f0f-4976-802e-42334c053e86 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:01.448548 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8bbb83dd-9f0f-4976-802e-42334c053e86 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:01.450139 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8bbb83dd-9f0f-4976-802e-42334c053e86 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1739 microversion: 2.20 time: 0.420847 Jul 25 14:37:01.457931 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1499/2796] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:01 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1739 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:01.471306 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e597086f-0f89-420c-82d3-f85f9f0089e6 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-515514362"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:01.472280 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e597086f-0f89-420c-82d3-f85f9f0089e6 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:01.489952 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e597086f-0f89-420c-82d3-f85f9f0089e6 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:01.490847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e597086f-0f89-420c-82d3-f85f9f0089e6 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:01.491891 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e597086f-0f89-420c-82d3-f85f9f0089e6 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:01.493635 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e597086f-0f89-420c-82d3-f85f9f0089e6 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:01.773170 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0648f63f-12c1-4ff6-9d9c-2a952f4c9c43 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Action: 'create', calling method: .version_select at 0x7f46874ec700>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1501696096", "policies": ["affinity"]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:01.804927 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.network.security_group_api [None req-e597086f-0f89-420c-82d3-f85f9f0089e6 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Adding security group ecefe9a6-d08d-46e0-ae03-c326bdb96218 to port 6fdb0b84-35b3-4673-9dfe-8ceebbbd3e3d Jul 25 14:37:01.842896 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-0648f63f-12c1-4ff6-9d9c-2a952f4c9c43 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Getting quotas for project 9560d1222b9b47ca8d8fff3c6a7b634f. Resources: {'server_groups'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:37:01.853790 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-0648f63f-12c1-4ff6-9d9c-2a952f4c9c43 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Getting quotas for user 73b42088e9f64e4bb596ea18ea062f07 and project 9560d1222b9b47ca8d8fff3c6a7b634f. Resources: {'server_groups'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:37:01.974410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-0648f63f-12c1-4ff6-9d9c-2a952f4c9c43 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Getting quotas for project 9560d1222b9b47ca8d8fff3c6a7b634f. Resources: {'server_groups'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:37:01.986781 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:37:02.008971 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-0648f63f-12c1-4ff6-9d9c-2a952f4c9c43 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Getting quotas for user 73b42088e9f64e4bb596ea18ea062f07 and project 9560d1222b9b47ca8d8fff3c6a7b634f. Resources: {'server_groups'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:37:02.070720 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0648f63f-12c1-4ff6-9d9c-2a952f4c9c43 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.681591 Jul 25 14:37:02.074640 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1298/2797] 10.222.0.88 () {60 vars in 1174 bytes} [Mon Jul 25 14:37:01 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:02.089329 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-51d7042d-da6f-4368-9f94-8cdaa8f65e36 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:02.090850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-51d7042d-da6f-4368-9f94-8cdaa8f65e36 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:02.113549 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-51d7042d-da6f-4368-9f94-8cdaa8f65e36 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:02.114177 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-51d7042d-da6f-4368-9f94-8cdaa8f65e36 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:02.115353 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-51d7042d-da6f-4368-9f94-8cdaa8f65e36 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:02.116115 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-51d7042d-da6f-4368-9f94-8cdaa8f65e36 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:02.714900 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e597086f-0f89-420c-82d3-f85f9f0089e6 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "POST /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e/action" status: 202 len: 0 microversion: 2.1 time: 1.254096 Jul 25 14:37:02.716146 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1500/2798] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:37:01 2022] POST /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e/action => generated 0 bytes in 1256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:37:02.721658 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-32ec1ff9-002d-4203-9ecc-a1e4dcc7417b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:02.722627 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-32ec1ff9-002d-4203-9ecc-a1e4dcc7417b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:02.741977 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-32ec1ff9-002d-4203-9ecc-a1e4dcc7417b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:02.743468 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-32ec1ff9-002d-4203-9ecc-a1e4dcc7417b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:02.744556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-32ec1ff9-002d-4203-9ecc-a1e4dcc7417b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:02.745830 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-32ec1ff9-002d-4203-9ecc-a1e4dcc7417b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:02.768328 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-51d7042d-da6f-4368-9f94-8cdaa8f65e36 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a720adc1b3443a8062b3eb8c7df11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5771bc6c546646b5a432a114f76d373d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:02.785020 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-51d7042d-da6f-4368-9f94-8cdaa8f65e36 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653" status: 200 len: 1365 microversion: 2.1 time: 0.704949 Jul 25 14:37:02.786314 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1299/2799] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:02 2022] GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653 => generated 1365 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:02.797511 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9d37979f-7294-4927-8acd-26addecb4894 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Action: 'create', calling method: .version_select at 0x7f468763eca0>, body: {"server_group": {"name": "tempest-server-group-1142487365", "policies": ["affinity"]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:02.889879 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-9d37979f-7294-4927-8acd-26addecb4894 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Getting quotas for project 9560d1222b9b47ca8d8fff3c6a7b634f. Resources: {'server_groups'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:37:02.908240 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-9d37979f-7294-4927-8acd-26addecb4894 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Getting quotas for user 73b42088e9f64e4bb596ea18ea062f07 and project 9560d1222b9b47ca8d8fff3c6a7b634f. Resources: {'server_groups'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:37:03.088391 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-9d37979f-7294-4927-8acd-26addecb4894 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Getting quotas for project 9560d1222b9b47ca8d8fff3c6a7b634f. Resources: {'server_groups'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:37:03.106481 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-9d37979f-7294-4927-8acd-26addecb4894 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Getting quotas for user 73b42088e9f64e4bb596ea18ea062f07 and project 9560d1222b9b47ca8d8fff3c6a7b634f. Resources: {'server_groups'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:37:03.177603 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=4 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:37:03.182967 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9d37979f-7294-4927-8acd-26addecb4894 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.374459 Jul 25 14:37:03.199906 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1300/2800] 10.222.0.88 () {60 vars in 1173 bytes} [Mon Jul 25 14:37:02 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:03.261692 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-32ec1ff9-002d-4203-9ecc-a1e4dcc7417b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:03.269726 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-879021bb-d749-4a64-b2ce-6b3c595d21ca req-0257349e-52fd-4512-9f36-638729f37baa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e1fbfa4-195c-46bb-9a93-9ffd88ecf653", "tag": "51baeba0-6ad9-4e68-ba06-613e8d367ad9"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:03.276343 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-32ec1ff9-002d-4203-9ecc-a1e4dcc7417b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1521 microversion: 2.1 time: 0.554956 Jul 25 14:37:03.284221 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1501/2801] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:02 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1521 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:03.290062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-69e4b705-5e6b-4e1b-9268-bda19553e9d0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:03.290994 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-69e4b705-5e6b-4e1b-9268-bda19553e9d0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:03.308022 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-879021bb-d749-4a64-b2ce-6b3c595d21ca req-0257349e-52fd-4512-9f36-638729f37baa service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:03.308809 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-879021bb-d749-4a64-b2ce-6b3c595d21ca req-0257349e-52fd-4512-9f36-638729f37baa service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:03.309645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69e4b705-5e6b-4e1b-9268-bda19553e9d0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:03.310213 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69e4b705-5e6b-4e1b-9268-bda19553e9d0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:03.313001 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69e4b705-5e6b-4e1b-9268-bda19553e9d0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:03.313668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69e4b705-5e6b-4e1b-9268-bda19553e9d0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:03.336882 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-879021bb-d749-4a64-b2ce-6b3c595d21ca req-0257349e-52fd-4512-9f36-638729f37baa service nova] Creating event network-changed:51baeba0-6ad9-4e68-ba06-613e8d367ad9 for instance 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653 on n-h2-846435-14 Jul 25 14:37:03.378689 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-879021bb-d749-4a64-b2ce-6b3c595d21ca req-0257349e-52fd-4512-9f36-638729f37baa service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176327 Jul 25 14:37:03.380180 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1301/2802] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:03.410865 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-880b846b-85b0-43c1-a132-fbd3a1146de9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:03.419288 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-880b846b-85b0-43c1-a132-fbd3a1146de9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:03.430709 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-880b846b-85b0-43c1-a132-fbd3a1146de9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:03.431179 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-880b846b-85b0-43c1-a132-fbd3a1146de9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:03.433073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-880b846b-85b0-43c1-a132-fbd3a1146de9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:03.438661 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-880b846b-85b0-43c1-a132-fbd3a1146de9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:03.584659 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-69e4b705-5e6b-4e1b-9268-bda19553e9d0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:03.598498 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-69e4b705-5e6b-4e1b-9268-bda19553e9d0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1391 microversion: 2.1 time: 0.312044 Jul 25 14:37:03.599790 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1502/2803] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:03 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1391 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:03.607510 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-69920307-7dba-4ecb-8181-35f29f63e845 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-515514362"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:03.609543 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-69920307-7dba-4ecb-8181-35f29f63e845 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:03.624121 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69920307-7dba-4ecb-8181-35f29f63e845 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:03.625336 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69920307-7dba-4ecb-8181-35f29f63e845 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:03.626476 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69920307-7dba-4ecb-8181-35f29f63e845 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:03.627232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69920307-7dba-4ecb-8181-35f29f63e845 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:03.891339 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.network.security_group_api [None req-69920307-7dba-4ecb-8181-35f29f63e845 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Removing security group ecefe9a6-d08d-46e0-ae03-c326bdb96218 from port 6fdb0b84-35b3-4673-9dfe-8ceebbbd3e3d Jul 25 14:37:04.170611 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-880b846b-85b0-43c1-a132-fbd3a1146de9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:04.187368 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-880b846b-85b0-43c1-a132-fbd3a1146de9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:04.189359 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-880b846b-85b0-43c1-a132-fbd3a1146de9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:04.190904 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-880b846b-85b0-43c1-a132-fbd3a1146de9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1721 microversion: 2.20 time: 0.804684 Jul 25 14:37:04.192142 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1302/2804] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:03 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1721 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:04.230610 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=8 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:37:04.320516 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-b493823c-b268-4f0b-ac1a-647aea9c4eb1 req-628568d0-4b15-443f-ab34-b03beca6186e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "756ffb6d-8123-4743-97b5-e3153a7fc28e", "tag": "6fdb0b84-35b3-4673-9dfe-8ceebbbd3e3d"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:04.335247 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b493823c-b268-4f0b-ac1a-647aea9c4eb1 req-628568d0-4b15-443f-ab34-b03beca6186e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:04.336082 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b493823c-b268-4f0b-ac1a-647aea9c4eb1 req-628568d0-4b15-443f-ab34-b03beca6186e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:04.358685 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-b493823c-b268-4f0b-ac1a-647aea9c4eb1 req-628568d0-4b15-443f-ab34-b03beca6186e service nova] Creating event network-changed:6fdb0b84-35b3-4673-9dfe-8ceebbbd3e3d for instance 756ffb6d-8123-4743-97b5-e3153a7fc28e on n-h2-846435-14 Jul 25 14:37:04.364970 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-b493823c-b268-4f0b-ac1a-647aea9c4eb1 req-628568d0-4b15-443f-ab34-b03beca6186e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171259 Jul 25 14:37:04.365620 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1303/2805] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:04.372912 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-20938b7a-03ff-4f2c-b36d-01f4d20c10f4 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Action: 'create', calling method: .version_select at 0x7f46874f14c0>, body: {"server_group": {"name": "tempest-server-group-1142487365", "policies": ["affinity"]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:04.401445 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-20938b7a-03ff-4f2c-b36d-01f4d20c10f4 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Getting quotas for project 9560d1222b9b47ca8d8fff3c6a7b634f. Resources: {'server_groups'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:37:04.412375 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-20938b7a-03ff-4f2c-b36d-01f4d20c10f4 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Getting quotas for user 73b42088e9f64e4bb596ea18ea062f07 and project 9560d1222b9b47ca8d8fff3c6a7b634f. Resources: {'server_groups'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:37:04.503036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-20938b7a-03ff-4f2c-b36d-01f4d20c10f4 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Getting quotas for project 9560d1222b9b47ca8d8fff3c6a7b634f. Resources: {'server_groups'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:37:04.522029 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-20938b7a-03ff-4f2c-b36d-01f4d20c10f4 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Getting quotas for user 73b42088e9f64e4bb596ea18ea062f07 and project 9560d1222b9b47ca8d8fff3c6a7b634f. Resources: {'server_groups'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:37:04.546491 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-69920307-7dba-4ecb-8181-35f29f63e845 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "POST /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e/action" status: 202 len: 0 microversion: 2.1 time: 0.944826 Jul 25 14:37:04.548413 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1503/2806] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:37:03 2022] POST /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e/action => generated 0 bytes in 948 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:37:04.557563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3c8ae59b-7a1f-44d0-b420-013609fcf919 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:04.558649 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3c8ae59b-7a1f-44d0-b420-013609fcf919 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:04.564199 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-20938b7a-03ff-4f2c-b36d-01f4d20c10f4 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.196762 Jul 25 14:37:04.567877 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1304/2807] 10.222.0.88 () {60 vars in 1173 bytes} [Mon Jul 25 14:37:04 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:04.569498 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c8ae59b-7a1f-44d0-b420-013609fcf919 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:04.570288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c8ae59b-7a1f-44d0-b420-013609fcf919 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:04.571593 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c8ae59b-7a1f-44d0-b420-013609fcf919 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:04.572412 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c8ae59b-7a1f-44d0-b420-013609fcf919 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:04.590901 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-78bacf1e-4e9a-467a-b375-17de90b87049 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:04.594752 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-78bacf1e-4e9a-467a-b375-17de90b87049 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:04.614466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-78bacf1e-4e9a-467a-b375-17de90b87049 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:04.614921 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-78bacf1e-4e9a-467a-b375-17de90b87049 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:04.615906 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-78bacf1e-4e9a-467a-b375-17de90b87049 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:04.616386 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-78bacf1e-4e9a-467a-b375-17de90b87049 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:04.762804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3c8ae59b-7a1f-44d0-b420-013609fcf919 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a720adc1b3443a8062b3eb8c7df11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5771bc6c546646b5a432a114f76d373d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:04.775826 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3c8ae59b-7a1f-44d0-b420-013609fcf919 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653" status: 200 len: 1365 microversion: 2.1 time: 0.226044 Jul 25 14:37:04.778941 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1504/2808] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:04 2022] GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653 => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:04.790008 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f2a60e0f-fbdf-45d0-85b9-6d4894b43eee tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Action: 'create', calling method: .version_select at 0x7f46864d0940>, body: {"pool": null} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:04.847617 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-78bacf1e-4e9a-467a-b375-17de90b87049 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:04.857767 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-78bacf1e-4e9a-467a-b375-17de90b87049 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1521 microversion: 2.1 time: 0.276843 Jul 25 14:37:04.871676 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1305/2809] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:04 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:04.873778 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-03b1bc1b-d1ab-4bd8-980d-2493fd05620d tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:04.951329 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-03b1bc1b-d1ab-4bd8-980d-2493fd05620d tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "DELETE /compute/v2.1/os-server-groups/12af84ec-5d38-4a14-a869-43bfd3de5cee" status: 204 len: 0 microversion: 2.1 time: 0.091834 Jul 25 14:37:04.952161 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1306/2810] 10.222.0.88 () {58 vars in 1266 bytes} [Mon Jul 25 14:37:04 2022] DELETE /compute/v2.1/os-server-groups/12af84ec-5d38-4a14-a869-43bfd3de5cee => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:37:04.977628 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8ecf2f69-7eb0-41c7-a71b-5cdc3beacf08 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:04.979226 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8ecf2f69-7eb0-41c7-a71b-5cdc3beacf08 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:05.005938 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ecf2f69-7eb0-41c7-a71b-5cdc3beacf08 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:05.006400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ecf2f69-7eb0-41c7-a71b-5cdc3beacf08 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:05.007756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ecf2f69-7eb0-41c7-a71b-5cdc3beacf08 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:05.008437 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ecf2f69-7eb0-41c7-a71b-5cdc3beacf08 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:05.022425 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:37:05.287867 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8ecf2f69-7eb0-41c7-a71b-5cdc3beacf08 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:05.302758 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8ecf2f69-7eb0-41c7-a71b-5cdc3beacf08 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1391 microversion: 2.1 time: 0.347985 Jul 25 14:37:05.304050 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1307/2811] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:04 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1391 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:05.310992 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cb039ae4-e86a-4b2b-9b7a-bd84ec0c3648 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:05.336088 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cb039ae4-e86a-4b2b-9b7a-bd84ec0c3648 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.030470 Jul 25 14:37:05.343846 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1308/2812] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jul 25 14:37:05 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:05.352008 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-76f389aa-3562-4338-b1a6-ddd9e6bc8cd8 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:05.352008 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-76f389aa-3562-4338-b1a6-ddd9e6bc8cd8 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:05.357777 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-76f389aa-3562-4338-b1a6-ddd9e6bc8cd8 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:05.358336 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-76f389aa-3562-4338-b1a6-ddd9e6bc8cd8 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:05.359355 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-76f389aa-3562-4338-b1a6-ddd9e6bc8cd8 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:05.360583 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-76f389aa-3562-4338-b1a6-ddd9e6bc8cd8 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:05.522679 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-76f389aa-3562-4338-b1a6-ddd9e6bc8cd8 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:05.535146 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-76f389aa-3562-4338-b1a6-ddd9e6bc8cd8 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:05.538196 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-76f389aa-3562-4338-b1a6-ddd9e6bc8cd8 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:05.540058 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-76f389aa-3562-4338-b1a6-ddd9e6bc8cd8 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1721 microversion: 2.20 time: 0.194921 Jul 25 14:37:05.541182 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1309/2813] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:05 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:05.548094 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5690db38-8abf-4d98-9798-d07e56a67c92 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:05.576400 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5690db38-8abf-4d98-9798-d07e56a67c92 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "DELETE /compute/v2.1/os-server-groups/366f80ed-f905-4cec-a6bf-2c6c8b0fb8b8" status: 204 len: 0 microversion: 2.1 time: 0.033771 Jul 25 14:37:05.577267 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1310/2814] 10.222.0.88 () {58 vars in 1266 bytes} [Mon Jul 25 14:37:05 2022] DELETE /compute/v2.1/os-server-groups/366f80ed-f905-4cec-a6bf-2c6c8b0fb8b8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:37:05.584984 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e0de278c-7b18-461d-b41a-fb6d7334895c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:05.601270 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e0de278c-7b18-461d-b41a-fb6d7334895c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.019961 Jul 25 14:37:05.602224 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1311/2815] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jul 25 14:37:05 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:37:05.615172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-79e57433-7f60-463a-b7b6-b9e5826a6519 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Action: 'create', calling method: .version_select at 0x7f4687408160>, body: {"server_group": {"name": "tempest-server-group-1389266893", "policies": ["affinity"]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:05.634380 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-79e57433-7f60-463a-b7b6-b9e5826a6519 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Getting quotas for project 9560d1222b9b47ca8d8fff3c6a7b634f. Resources: {'server_groups'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:37:05.636710 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:37:05.644066 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-79e57433-7f60-463a-b7b6-b9e5826a6519 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Getting quotas for user 73b42088e9f64e4bb596ea18ea062f07 and project 9560d1222b9b47ca8d8fff3c6a7b634f. Resources: {'server_groups'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:37:05.688005 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-79e57433-7f60-463a-b7b6-b9e5826a6519 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Getting quotas for project 9560d1222b9b47ca8d8fff3c6a7b634f. Resources: {'server_groups'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:37:05.693459 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-79e57433-7f60-463a-b7b6-b9e5826a6519 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Getting quotas for user 73b42088e9f64e4bb596ea18ea062f07 and project 9560d1222b9b47ca8d8fff3c6a7b634f. Resources: {'server_groups'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:37:05.706541 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-79e57433-7f60-463a-b7b6-b9e5826a6519 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.095141 Jul 25 14:37:05.707226 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1312/2816] 10.222.0.88 () {60 vars in 1173 bytes} [Mon Jul 25 14:37:05 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:37:05.714170 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6f7fbfb8-6703-445e-8a65-32a0a1c27822 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-888789006", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "375e8262-82d0-40d9-924d-b09f589f186e"}], "security_groups": [{"name": "tempest-securitygroup--1125462600"}], "key_name": "tempest-keypair-93697299", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "b2181d72-77a5-4489-bb2b-6cf259cea504", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:05.852072 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-6f7fbfb8-6703-445e-8a65-32a0a1c27822 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] validate_networks() for [('375e8262-82d0-40d9-924d-b09f589f186e', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:37:06.146156 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f2a60e0f-fbdf-45d0-85b9-6d4894b43eee tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.363388 Jul 25 14:37:06.154130 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1505/2817] 10.222.0.88 () {60 vars in 1170 bytes} [Mon Jul 25 14:37:04 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:06.154130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-21895bfb-981b-4376-962a-9bf81585fd50 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:06.178912 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-21895bfb-981b-4376-962a-9bf81585fd50 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "DELETE /compute/v2.1/os-server-groups/f90548b4-b443-4c13-a04f-cbb495d1d5a0" status: 204 len: 0 microversion: 2.1 time: 0.030887 Jul 25 14:37:06.180116 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1506/2818] 10.222.0.88 () {58 vars in 1266 bytes} [Mon Jul 25 14:37:06 2022] DELETE /compute/v2.1/os-server-groups/f90548b4-b443-4c13-a04f-cbb495d1d5a0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:37:06.184240 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f83ed700-326a-4a29-a9a1-a4f94d046c96 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:06.185259 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f83ed700-326a-4a29-a9a1-a4f94d046c96 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:06.190988 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f83ed700-326a-4a29-a9a1-a4f94d046c96 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:06.191495 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f83ed700-326a-4a29-a9a1-a4f94d046c96 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:06.192254 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f83ed700-326a-4a29-a9a1-a4f94d046c96 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:06.192868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f83ed700-326a-4a29-a9a1-a4f94d046c96 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:06.330072 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-6f7fbfb8-6703-445e-8a65-32a0a1c27822 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Getting quotas for project f07edb35c2dd48ef9ea6583468a9b46f. Resources: dict_keys(['metadata_items']) {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:37:06.333991 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f83ed700-326a-4a29-a9a1-a4f94d046c96 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a720adc1b3443a8062b3eb8c7df11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5771bc6c546646b5a432a114f76d373d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:06.335990 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-6f7fbfb8-6703-445e-8a65-32a0a1c27822 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Getting quotas for user eb708222f6ee4225b1fe18848fb6a1f8 and project f07edb35c2dd48ef9ea6583468a9b46f. Resources: dict_keys(['metadata_items']) {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:37:06.342603 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f83ed700-326a-4a29-a9a1-a4f94d046c96 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653" status: 200 len: 1365 microversion: 2.1 time: 0.162070 Jul 25 14:37:06.343276 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1507/2819] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:06 2022] GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:06.348056 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4ecbe21a-9401-41a3-a39f-ad27041d9a89 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:06.349165 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4ecbe21a-9401-41a3-a39f-ad27041d9a89 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:06.349283 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-6f7fbfb8-6703-445e-8a65-32a0a1c27822 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:37:06.349749 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-6f7fbfb8-6703-445e-8a65-32a0a1c27822 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:37:06.350279 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-6f7fbfb8-6703-445e-8a65-32a0a1c27822 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:37:06.350778 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-6f7fbfb8-6703-445e-8a65-32a0a1c27822 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:37:06.351241 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-6f7fbfb8-6703-445e-8a65-32a0a1c27822 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:37:06.356966 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4ecbe21a-9401-41a3-a39f-ad27041d9a89 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:06.357699 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4ecbe21a-9401-41a3-a39f-ad27041d9a89 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:06.358537 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4ecbe21a-9401-41a3-a39f-ad27041d9a89 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:06.359037 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4ecbe21a-9401-41a3-a39f-ad27041d9a89 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:06.360247 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6f7fbfb8-6703-445e-8a65-32a0a1c27822 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:06.360703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6f7fbfb8-6703-445e-8a65-32a0a1c27822 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:06.361498 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6f7fbfb8-6703-445e-8a65-32a0a1c27822 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:06.362097 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6f7fbfb8-6703-445e-8a65-32a0a1c27822 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:06.375041 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:37:06.379075 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-6f7fbfb8-6703-445e-8a65-32a0a1c27822 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Getting quotas for project f07edb35c2dd48ef9ea6583468a9b46f. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:37:06.385114 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-6f7fbfb8-6703-445e-8a65-32a0a1c27822 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Getting quotas for user eb708222f6ee4225b1fe18848fb6a1f8 and project f07edb35c2dd48ef9ea6583468a9b46f. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:37:06.446633 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6f7fbfb8-6703-445e-8a65-32a0a1c27822 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:37:06.449188 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6f7fbfb8-6703-445e-8a65-32a0a1c27822 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b2181d72-77a5-4489-bb2b-6cf259cea504',volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:37:06.506327 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4ecbe21a-9401-41a3-a39f-ad27041d9a89 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:06.514898 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4ecbe21a-9401-41a3-a39f-ad27041d9a89 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1521 microversion: 2.1 time: 0.170377 Jul 25 14:37:06.515688 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1508/2820] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:06 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:06.520018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-82c10745-3cb7-4459-b563-23eb7e1aa0d5 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.127"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:06.522497 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-82c10745-3cb7-4459-b563-23eb7e1aa0d5 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:06.528435 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-82c10745-3cb7-4459-b563-23eb7e1aa0d5 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:06.529080 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-82c10745-3cb7-4459-b563-23eb7e1aa0d5 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:06.529848 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-82c10745-3cb7-4459-b563-23eb7e1aa0d5 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:06.530278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-82c10745-3cb7-4459-b563-23eb7e1aa0d5 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:06.558859 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-82c10745-3cb7-4459-b563-23eb7e1aa0d5 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Acquired lock "refresh_cache-756ffb6d-8123-4743-97b5-e3153a7fc28e" {{(pid=119304) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 14:37:06.600784 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6f7fbfb8-6703-445e-8a65-32a0a1c27822 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.892008 Jul 25 14:37:06.607633 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1313/2821] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:37:05 2022] POST /compute/v2.1/servers => generated 407 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:37:06.607633 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f33f8f6d-1ef9-4506-bd5f-c1f7e8e7bb31 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:06.619203 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f33f8f6d-1ef9-4506-bd5f-c1f7e8e7bb31 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.016144 Jul 25 14:37:06.626905 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1314/2822] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jul 25 14:37:06 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:06.632158 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-da626e98-7c35-446e-a7e9-fcbe5ad43f48 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:06.632979 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-da626e98-7c35-446e-a7e9-fcbe5ad43f48 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:06.641578 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da626e98-7c35-446e-a7e9-fcbe5ad43f48 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:06.642254 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da626e98-7c35-446e-a7e9-fcbe5ad43f48 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:06.643218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da626e98-7c35-446e-a7e9-fcbe5ad43f48 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:06.643696 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da626e98-7c35-446e-a7e9-fcbe5ad43f48 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:06.827486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-da626e98-7c35-446e-a7e9-fcbe5ad43f48 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:06.841863 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-da626e98-7c35-446e-a7e9-fcbe5ad43f48 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1391 microversion: 2.1 time: 0.219528 Jul 25 14:37:06.852001 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1315/2823] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:06 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1391 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:06.858315 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-7ce2c9f9-9044-4afd-8f42-4a77c59c5bf6 req-b6ee15be-f8c3-41ca-ad24-83bdc2430732 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "756ffb6d-8123-4743-97b5-e3153a7fc28e", "tag": "6fdb0b84-35b3-4673-9dfe-8ceebbbd3e3d"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:06.878251 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-7ce2c9f9-9044-4afd-8f42-4a77c59c5bf6 req-b6ee15be-f8c3-41ca-ad24-83bdc2430732 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:06.880407 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-7ce2c9f9-9044-4afd-8f42-4a77c59c5bf6 req-b6ee15be-f8c3-41ca-ad24-83bdc2430732 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:06.895289 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-7ce2c9f9-9044-4afd-8f42-4a77c59c5bf6 req-b6ee15be-f8c3-41ca-ad24-83bdc2430732 service nova] Creating event network-changed:6fdb0b84-35b3-4673-9dfe-8ceebbbd3e3d for instance 756ffb6d-8123-4743-97b5-e3153a7fc28e on n-h2-846435-14 Jul 25 14:37:06.902835 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-7ce2c9f9-9044-4afd-8f42-4a77c59c5bf6 req-b6ee15be-f8c3-41ca-ad24-83bdc2430732 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057950 Jul 25 14:37:06.903677 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1316/2824] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:06.909571 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-73b3e4d9-fa87-4d9f-a7e9-6e5c902ba4cc tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:06.910697 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-73b3e4d9-fa87-4d9f-a7e9-6e5c902ba4cc tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:06.918269 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-73b3e4d9-fa87-4d9f-a7e9-6e5c902ba4cc tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:06.918712 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-73b3e4d9-fa87-4d9f-a7e9-6e5c902ba4cc tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:06.919524 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-73b3e4d9-fa87-4d9f-a7e9-6e5c902ba4cc tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:06.919961 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-73b3e4d9-fa87-4d9f-a7e9-6e5c902ba4cc tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:07.086055 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-73b3e4d9-fa87-4d9f-a7e9-6e5c902ba4cc tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:07.095387 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-73b3e4d9-fa87-4d9f-a7e9-6e5c902ba4cc tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:07.097507 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-73b3e4d9-fa87-4d9f-a7e9-6e5c902ba4cc tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:07.098867 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-73b3e4d9-fa87-4d9f-a7e9-6e5c902ba4cc tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1721 microversion: 2.20 time: 0.194107 Jul 25 14:37:07.099935 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1317/2825] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:06 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:07.104508 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-06dcecaa-0ecc-4495-aa81-e49c6642bab1 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:07.105116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-06dcecaa-0ecc-4495-aa81-e49c6642bab1 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:07.172432 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-06dcecaa-0ecc-4495-aa81-e49c6642bab1 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb708222f6ee4225b1fe18848fb6a1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:07.183782 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-06dcecaa-0ecc-4495-aa81-e49c6642bab1 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3" status: 200 len: 1119 microversion: 2.1 time: 0.082706 Jul 25 14:37:07.184702 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1318/2826] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:07 2022] GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 => generated 1119 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:07.189470 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-20333f60-514e-4d22-ac7e-115b378fd02c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Action: 'create', calling method: .version_select at 0x7f4687216040>, body: {"server_group": {"name": "tempest-server-group-426296751", "policies": ["anti-affinity"]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:07.213127 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-20333f60-514e-4d22-ac7e-115b378fd02c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Getting quotas for project 9560d1222b9b47ca8d8fff3c6a7b634f. Resources: {'server_groups'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:37:07.219243 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-20333f60-514e-4d22-ac7e-115b378fd02c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Getting quotas for user 73b42088e9f64e4bb596ea18ea062f07 and project 9560d1222b9b47ca8d8fff3c6a7b634f. Resources: {'server_groups'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:37:07.278606 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-20333f60-514e-4d22-ac7e-115b378fd02c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Getting quotas for project 9560d1222b9b47ca8d8fff3c6a7b634f. Resources: {'server_groups'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:37:07.285604 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-20333f60-514e-4d22-ac7e-115b378fd02c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Getting quotas for user 73b42088e9f64e4bb596ea18ea062f07 and project 9560d1222b9b47ca8d8fff3c6a7b634f. Resources: {'server_groups'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:37:07.301071 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-20333f60-514e-4d22-ac7e-115b378fd02c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.115458 Jul 25 14:37:07.301700 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1319/2827] 10.222.0.88 () {60 vars in 1173 bytes} [Mon Jul 25 14:37:07 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:07.306900 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-8c3a9ff7-940e-45a5-a387-9f8fd2554ce8 req-74ea7448-31e0-43a5-9669-4cb684a3e570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1009be4-53ff-4893-836c-ba96f07a0d60", "name": "network-vif-unplugged", "status": "completed", "tag": "a70f2535-e346-4125-80e5-abda9464ab7e"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:07.318521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-8c3a9ff7-940e-45a5-a387-9f8fd2554ce8 req-74ea7448-31e0-43a5-9669-4cb684a3e570 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:07.318972 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-8c3a9ff7-940e-45a5-a387-9f8fd2554ce8 req-74ea7448-31e0-43a5-9669-4cb684a3e570 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:07.333068 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-8c3a9ff7-940e-45a5-a387-9f8fd2554ce8 req-74ea7448-31e0-43a5-9669-4cb684a3e570 service nova] Creating event network-vif-unplugged:a70f2535-e346-4125-80e5-abda9464ab7e for instance f1009be4-53ff-4893-836c-ba96f07a0d60 on n-h2-846435-14 Jul 25 14:37:07.338602 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-8c3a9ff7-940e-45a5-a387-9f8fd2554ce8 req-74ea7448-31e0-43a5-9669-4cb684a3e570 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035587 Jul 25 14:37:07.339303 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1320/2828] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:07.344644 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-200f9141-1088-4686-8912-4fd8cf755840 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:07.374365 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-200f9141-1088-4686-8912-4fd8cf755840 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "DELETE /compute/v2.1/os-server-groups/7bc8f044-f1f9-4d7e-ac1d-17030ee7f0dc" status: 204 len: 0 microversion: 2.1 time: 0.033758 Jul 25 14:37:07.375090 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1321/2829] 10.222.0.88 () {58 vars in 1266 bytes} [Mon Jul 25 14:37:07 2022] DELETE /compute/v2.1/os-server-groups/7bc8f044-f1f9-4d7e-ac1d-17030ee7f0dc => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:37:07.380789 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ee0f2c98-6699-489a-8595-113ec53bf3b8 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:07.381672 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ee0f2c98-6699-489a-8595-113ec53bf3b8 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:07.390250 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee0f2c98-6699-489a-8595-113ec53bf3b8 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:07.390627 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee0f2c98-6699-489a-8595-113ec53bf3b8 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:07.391627 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee0f2c98-6699-489a-8595-113ec53bf3b8 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:07.392152 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee0f2c98-6699-489a-8595-113ec53bf3b8 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:07.547119 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ee0f2c98-6699-489a-8595-113ec53bf3b8 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a720adc1b3443a8062b3eb8c7df11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5771bc6c546646b5a432a114f76d373d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:07.555550 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ee0f2c98-6699-489a-8595-113ec53bf3b8 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653" status: 200 len: 1365 microversion: 2.1 time: 0.179240 Jul 25 14:37:07.556196 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1322/2830] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:07 2022] GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:07.561099 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-212f93b0-0250-45cb-b88a-c514f3bc31cc tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:07.577150 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-212f93b0-0250-45cb-b88a-c514f3bc31cc tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.019858 Jul 25 14:37:07.577984 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1323/2831] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jul 25 14:37:07 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:07.583057 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3867c22b-4b4a-4d2f-9601-b00aad1b09f6 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:07.584012 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3867c22b-4b4a-4d2f-9601-b00aad1b09f6 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:07.585910 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:37:07.595556 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3867c22b-4b4a-4d2f-9601-b00aad1b09f6 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:07.595556 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3867c22b-4b4a-4d2f-9601-b00aad1b09f6 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:07.596434 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3867c22b-4b4a-4d2f-9601-b00aad1b09f6 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:07.596987 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3867c22b-4b4a-4d2f-9601-b00aad1b09f6 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:07.797149 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3867c22b-4b4a-4d2f-9601-b00aad1b09f6 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:07.805458 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3867c22b-4b4a-4d2f-9601-b00aad1b09f6 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1521 microversion: 2.1 time: 0.226448 Jul 25 14:37:07.806238 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1324/2832] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:07 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:07.811474 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2cc3941f-a7d0-45f0-bac4-b53d3275fb1c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-838464031", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "000a17af-7e66-44c6-962c-03630aa7b99a"}]}, "os:scheduler_hints": {"group": "d1b25a11-6a66-4490-b6f0-cf6692572970"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:07.868158 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-2cc3941f-a7d0-45f0-bac4-b53d3275fb1c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] validate_networks() for [('000a17af-7e66-44c6-962c-03630aa7b99a', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:37:08.297447 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-82c10745-3cb7-4459-b563-23eb7e1aa0d5 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Building network info cache for instance {{(pid=119304) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 14:37:08.387755 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-2cc3941f-a7d0-45f0-bac4-b53d3275fb1c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:37:08.388423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-2cc3941f-a7d0-45f0-bac4-b53d3275fb1c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:37:08.388824 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-2cc3941f-a7d0-45f0-bac4-b53d3275fb1c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:37:08.389282 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-2cc3941f-a7d0-45f0-bac4-b53d3275fb1c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:37:08.389696 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-2cc3941f-a7d0-45f0-bac4-b53d3275fb1c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:37:08.420886 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2cc3941f-a7d0-45f0-bac4-b53d3275fb1c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:08.422061 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2cc3941f-a7d0-45f0-bac4-b53d3275fb1c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:08.424675 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2cc3941f-a7d0-45f0-bac4-b53d3275fb1c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:08.425765 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2cc3941f-a7d0-45f0-bac4-b53d3275fb1c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:08.465427 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-2cc3941f-a7d0-45f0-bac4-b53d3275fb1c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Getting quotas for project 9560d1222b9b47ca8d8fff3c6a7b634f. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:37:08.475561 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-2cc3941f-a7d0-45f0-bac4-b53d3275fb1c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Getting quotas for user 73b42088e9f64e4bb596ea18ea062f07 and project 9560d1222b9b47ca8d8fff3c6a7b634f. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:37:08.509430 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2cc3941f-a7d0-45f0-bac4-b53d3275fb1c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:37:08.516722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2cc3941f-a7d0-45f0-bac4-b53d3275fb1c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] [instance: 94a61a8f-6d71-42d5-8a25-2dd93b221cc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:37:08.616571 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-2cc3941f-a7d0-45f0-bac4-b53d3275fb1c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Getting quotas for project 9560d1222b9b47ca8d8fff3c6a7b634f. Resources: {'server_group_members'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:37:08.624878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-2cc3941f-a7d0-45f0-bac4-b53d3275fb1c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Getting quotas for user 73b42088e9f64e4bb596ea18ea062f07 and project 9560d1222b9b47ca8d8fff3c6a7b634f. Resources: {'server_group_members'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:37:08.678481 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-2cc3941f-a7d0-45f0-bac4-b53d3275fb1c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Getting quotas for project 9560d1222b9b47ca8d8fff3c6a7b634f. Resources: {'server_group_members'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:37:08.705083 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-2cc3941f-a7d0-45f0-bac4-b53d3275fb1c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Getting quotas for user 73b42088e9f64e4bb596ea18ea062f07 and project 9560d1222b9b47ca8d8fff3c6a7b634f. Resources: {'server_group_members'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:37:08.799770 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2cc3941f-a7d0-45f0-bac4-b53d3275fb1c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.992349 Jul 25 14:37:08.800567 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1325/2833] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:37:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:37:08.830985 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-829950db-91bc-462f-ac6d-bb90606c6d6d tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:08.831581 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-829950db-91bc-462f-ac6d-bb90606c6d6d tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:08.851797 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-829950db-91bc-462f-ac6d-bb90606c6d6d tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:08.852340 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-829950db-91bc-462f-ac6d-bb90606c6d6d tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:08.853120 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-829950db-91bc-462f-ac6d-bb90606c6d6d tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:08.853557 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-829950db-91bc-462f-ac6d-bb90606c6d6d tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:09.046678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-829950db-91bc-462f-ac6d-bb90606c6d6d tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:09.055398 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-829950db-91bc-462f-ac6d-bb90606c6d6d tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1391 microversion: 2.1 time: 0.242386 Jul 25 14:37:09.056061 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1326/2834] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:08 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1391 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:09.062730 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c38508c7-7c17-4193-8f4b-8a56bdd95122 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:09.063388 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c38508c7-7c17-4193-8f4b-8a56bdd95122 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:09.074385 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c38508c7-7c17-4193-8f4b-8a56bdd95122 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:09.074994 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c38508c7-7c17-4193-8f4b-8a56bdd95122 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:09.076071 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c38508c7-7c17-4193-8f4b-8a56bdd95122 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:09.076890 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c38508c7-7c17-4193-8f4b-8a56bdd95122 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:09.120432 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-82c10745-3cb7-4459-b563-23eb7e1aa0d5 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Updating instance_info_cache with network_info: [{"id": "6fdb0b84-35b3-4673-9dfe-8ceebbbd3e3d", "address": "fa:16:3e:99:1b:c4", "network": {"id": "f0d31963-aa19-4478-8a48-db619b3cf3f9", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-407647780-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3cc39cb570d842d59580e2075f74d50d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6fdb0b84-35", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119304) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 14:37:09.140122 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-82c10745-3cb7-4459-b563-23eb7e1aa0d5 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Releasing lock "refresh_cache-756ffb6d-8123-4743-97b5-e3153a7fc28e" {{(pid=119304) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 14:37:09.141333 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-82c10745-3cb7-4459-b563-23eb7e1aa0d5 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "POST /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e/action" status: 202 len: 0 microversion: 2.1 time: 2.624848 Jul 25 14:37:09.142846 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1509/2835] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:37:06 2022] POST /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e/action => generated 0 bytes in 2627 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 14:37:09.149913 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5d43f0fe-2d6a-472f-9c24-18ef6e3a20de tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:09.150756 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5d43f0fe-2d6a-472f-9c24-18ef6e3a20de tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:09.177469 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d43f0fe-2d6a-472f-9c24-18ef6e3a20de tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:09.178218 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d43f0fe-2d6a-472f-9c24-18ef6e3a20de tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:09.179173 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d43f0fe-2d6a-472f-9c24-18ef6e3a20de tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:09.179767 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d43f0fe-2d6a-472f-9c24-18ef6e3a20de tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:09.311062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5d43f0fe-2d6a-472f-9c24-18ef6e3a20de tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb708222f6ee4225b1fe18848fb6a1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:09.321769 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5d43f0fe-2d6a-472f-9c24-18ef6e3a20de tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3" status: 200 len: 1217 microversion: 2.1 time: 0.177351 Jul 25 14:37:09.322445 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1510/2836] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:09 2022] GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 => generated 1217 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:09.328383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0c02121d-c7f2-4fd7-9c2d-39bc9cb61725 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:09.329367 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0c02121d-c7f2-4fd7-9c2d-39bc9cb61725 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:09.337627 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c02121d-c7f2-4fd7-9c2d-39bc9cb61725 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:09.338384 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c02121d-c7f2-4fd7-9c2d-39bc9cb61725 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:09.339376 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c02121d-c7f2-4fd7-9c2d-39bc9cb61725 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:09.340075 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c02121d-c7f2-4fd7-9c2d-39bc9cb61725 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:09.549787 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0c02121d-c7f2-4fd7-9c2d-39bc9cb61725 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a720adc1b3443a8062b3eb8c7df11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5771bc6c546646b5a432a114f76d373d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:09.560445 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0c02121d-c7f2-4fd7-9c2d-39bc9cb61725 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653" status: 200 len: 1365 microversion: 2.1 time: 0.236398 Jul 25 14:37:09.561477 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1511/2837] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:09 2022] GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653 => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:09.567393 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-931d0329-5ad6-479c-8331-147e1f8e158f tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:09.568433 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-931d0329-5ad6-479c-8331-147e1f8e158f tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] [instance: 94a61a8f-6d71-42d5-8a25-2dd93b221cc2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:09.583893 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-931d0329-5ad6-479c-8331-147e1f8e158f tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:09.584850 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-931d0329-5ad6-479c-8331-147e1f8e158f tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:09.585832 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-931d0329-5ad6-479c-8331-147e1f8e158f tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:09.586517 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-931d0329-5ad6-479c-8331-147e1f8e158f tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:09.709876 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-931d0329-5ad6-479c-8331-147e1f8e158f tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b42088e9f64e4bb596ea18ea062f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9560d1222b9b47ca8d8fff3c6a7b634f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:09.727511 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-931d0329-5ad6-479c-8331-147e1f8e158f tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2" status: 200 len: 1216 microversion: 2.1 time: 0.164396 Jul 25 14:37:09.734733 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1512/2838] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:09 2022] GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2 => generated 1216 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:09.743027 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4cb1442c-fbb4-4fef-82d9-6ce1e184810f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:09.743697 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4cb1442c-fbb4-4fef-82d9-6ce1e184810f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:09.788668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4cb1442c-fbb4-4fef-82d9-6ce1e184810f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:09.789412 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4cb1442c-fbb4-4fef-82d9-6ce1e184810f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:09.790368 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4cb1442c-fbb4-4fef-82d9-6ce1e184810f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:09.790809 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4cb1442c-fbb4-4fef-82d9-6ce1e184810f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:09.845071 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c38508c7-7c17-4193-8f4b-8a56bdd95122 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:09.856957 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c38508c7-7c17-4193-8f4b-8a56bdd95122 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:09.858733 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c38508c7-7c17-4193-8f4b-8a56bdd95122 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:09.860094 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c38508c7-7c17-4193-8f4b-8a56bdd95122 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1664 microversion: 2.20 time: 0.803007 Jul 25 14:37:09.860695 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1327/2839] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:09 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1664 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:09.870384 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-10d6aec5-ece7-4047-8dfc-91ac982cfdbd req-2868edfe-c1e3-458c-b7bb-a5f861c383d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "756ffb6d-8123-4743-97b5-e3153a7fc28e", "tag": "6fdb0b84-35b3-4673-9dfe-8ceebbbd3e3d"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:09.885826 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-10d6aec5-ece7-4047-8dfc-91ac982cfdbd req-2868edfe-c1e3-458c-b7bb-a5f861c383d7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:09.886274 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-10d6aec5-ece7-4047-8dfc-91ac982cfdbd req-2868edfe-c1e3-458c-b7bb-a5f861c383d7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:09.906699 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-10d6aec5-ece7-4047-8dfc-91ac982cfdbd req-2868edfe-c1e3-458c-b7bb-a5f861c383d7 service nova] Creating event network-changed:6fdb0b84-35b3-4673-9dfe-8ceebbbd3e3d for instance 756ffb6d-8123-4743-97b5-e3153a7fc28e on n-h2-846435-14 Jul 25 14:37:09.923552 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-10d6aec5-ece7-4047-8dfc-91ac982cfdbd req-2868edfe-c1e3-458c-b7bb-a5f861c383d7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061398 Jul 25 14:37:09.925002 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1328/2840] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:09.929850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d18e1230-e636-43d1-abf7-a3e364e9c58d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.127"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:10.097850 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4cb1442c-fbb4-4fef-82d9-6ce1e184810f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:10.105805 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4cb1442c-fbb4-4fef-82d9-6ce1e184810f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1521 microversion: 2.1 time: 0.369308 Jul 25 14:37:10.108974 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1513/2841] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:09 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:10.115392 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6c4aa188-0c94-474a-a329-59937fea70e3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e666a0de-19e5-43bb-a164-8505bb01e92e"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:10.118409 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6c4aa188-0c94-474a-a329-59937fea70e3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:10.131474 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6c4aa188-0c94-474a-a329-59937fea70e3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:10.132126 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6c4aa188-0c94-474a-a329-59937fea70e3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:10.133125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6c4aa188-0c94-474a-a329-59937fea70e3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:10.133603 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6c4aa188-0c94-474a-a329-59937fea70e3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:10.489106 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d18e1230-e636-43d1-abf7-a3e364e9c58d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:10.507848 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d18e1230-e636-43d1-abf7-a3e364e9c58d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:10.508612 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d18e1230-e636-43d1-abf7-a3e364e9c58d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:10.509501 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d18e1230-e636-43d1-abf7-a3e364e9c58d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:10.509947 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d18e1230-e636-43d1-abf7-a3e364e9c58d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:10.609335 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6c4aa188-0c94-474a-a329-59937fea70e3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "POST /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.498961 Jul 25 14:37:10.617138 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1514/2842] 10.222.0.88 () {62 vars in 1364 bytes} [Mon Jul 25 14:37:10 2022] POST /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60/os-volume_attachments => generated 188 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:37:10.623507 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6eaee4d5-7751-42b1-bf6b-2e8fd1500ddc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:10.624615 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6eaee4d5-7751-42b1-bf6b-2e8fd1500ddc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:10.631996 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6eaee4d5-7751-42b1-bf6b-2e8fd1500ddc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:10.633373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6eaee4d5-7751-42b1-bf6b-2e8fd1500ddc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:10.634351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6eaee4d5-7751-42b1-bf6b-2e8fd1500ddc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:10.634978 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6eaee4d5-7751-42b1-bf6b-2e8fd1500ddc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:10.999240 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d18e1230-e636-43d1-abf7-a3e364e9c58d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Acquired lock "refresh_cache-756ffb6d-8123-4743-97b5-e3153a7fc28e" {{(pid=119303) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 14:37:11.278797 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6eaee4d5-7751-42b1-bf6b-2e8fd1500ddc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:11.292387 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6eaee4d5-7751-42b1-bf6b-2e8fd1500ddc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1391 microversion: 2.1 time: 0.673203 Jul 25 14:37:11.293610 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1515/2843] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:10 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1391 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:11.305476 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2a815223-c1af-48c0-8b9e-908ae885635d tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:11.308169 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2a815223-c1af-48c0-8b9e-908ae885635d tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:11.329864 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2a815223-c1af-48c0-8b9e-908ae885635d tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:11.331502 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2a815223-c1af-48c0-8b9e-908ae885635d tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:11.334149 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2a815223-c1af-48c0-8b9e-908ae885635d tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:11.336562 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2a815223-c1af-48c0-8b9e-908ae885635d tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:11.480902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2a815223-c1af-48c0-8b9e-908ae885635d tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb708222f6ee4225b1fe18848fb6a1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:11.489303 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2a815223-c1af-48c0-8b9e-908ae885635d tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3" status: 200 len: 1235 microversion: 2.1 time: 0.193697 Jul 25 14:37:11.490530 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1516/2844] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:11 2022] GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 => generated 1235 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:11.495471 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-becc28b1-cbfa-42c1-9e2d-dd4ae08079de tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:11.496378 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-becc28b1-cbfa-42c1-9e2d-dd4ae08079de tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:11.505490 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-becc28b1-cbfa-42c1-9e2d-dd4ae08079de tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:11.506492 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-becc28b1-cbfa-42c1-9e2d-dd4ae08079de tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:11.508883 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-becc28b1-cbfa-42c1-9e2d-dd4ae08079de tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:11.541583 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-becc28b1-cbfa-42c1-9e2d-dd4ae08079de tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:12.132758 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-becc28b1-cbfa-42c1-9e2d-dd4ae08079de tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a720adc1b3443a8062b3eb8c7df11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5771bc6c546646b5a432a114f76d373d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:12.144635 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-becc28b1-cbfa-42c1-9e2d-dd4ae08079de tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653" status: 200 len: 1365 microversion: 2.1 time: 0.652108 Jul 25 14:37:12.145268 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1517/2845] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:11 2022] GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653 => generated 1365 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:12.172547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-11d98aaa-0feb-4da0-88c4-979de51dc40b tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:12.173382 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-11d98aaa-0feb-4da0-88c4-979de51dc40b tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] [instance: 94a61a8f-6d71-42d5-8a25-2dd93b221cc2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:12.182873 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11d98aaa-0feb-4da0-88c4-979de51dc40b tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:12.183523 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11d98aaa-0feb-4da0-88c4-979de51dc40b tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:12.184405 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11d98aaa-0feb-4da0-88c4-979de51dc40b tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:12.185085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11d98aaa-0feb-4da0-88c4-979de51dc40b tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:12.363734 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-d18e1230-e636-43d1-abf7-a3e364e9c58d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Building network info cache for instance {{(pid=119303) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 14:37:12.481247 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-11d98aaa-0feb-4da0-88c4-979de51dc40b tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b42088e9f64e4bb596ea18ea062f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9560d1222b9b47ca8d8fff3c6a7b634f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:12.513887 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-11d98aaa-0feb-4da0-88c4-979de51dc40b tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2" status: 200 len: 1270 microversion: 2.1 time: 0.350755 Jul 25 14:37:12.517578 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1518/2846] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:12 2022] GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2 => generated 1270 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:12.534619 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3a9d7bc8-c6f2-41a4-9a48-1e1e09634db3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:12.537943 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3a9d7bc8-c6f2-41a4-9a48-1e1e09634db3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:12.556570 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a9d7bc8-c6f2-41a4-9a48-1e1e09634db3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:12.557837 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a9d7bc8-c6f2-41a4-9a48-1e1e09634db3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:12.559007 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a9d7bc8-c6f2-41a4-9a48-1e1e09634db3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:12.559740 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a9d7bc8-c6f2-41a4-9a48-1e1e09634db3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:12.766069 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3a9d7bc8-c6f2-41a4-9a48-1e1e09634db3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "POST /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60/action" status: 202 len: 0 microversion: 2.20 time: 0.246382 Jul 25 14:37:12.769779 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1519/2847] 10.222.0.88 () {62 vars in 1319 bytes} [Mon Jul 25 14:37:12 2022] POST /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:37:12.776451 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-20a5d1ad-f53f-48ff-9f68-91250c797ec9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:12.777098 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-20a5d1ad-f53f-48ff-9f68-91250c797ec9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:12.797242 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-20a5d1ad-f53f-48ff-9f68-91250c797ec9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:12.797691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-20a5d1ad-f53f-48ff-9f68-91250c797ec9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:12.798480 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-20a5d1ad-f53f-48ff-9f68-91250c797ec9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:12.798906 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-20a5d1ad-f53f-48ff-9f68-91250c797ec9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:12.911936 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=6,nova_cell1:RELEASE=1,nova_cell1:INSERT=4 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:37:13.505088 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-20a5d1ad-f53f-48ff-9f68-91250c797ec9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:13.525732 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-20a5d1ad-f53f-48ff-9f68-91250c797ec9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1521 microversion: 2.1 time: 0.749043 Jul 25 14:37:13.526941 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1520/2848] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:12 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1521 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:13.545304 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-1d35638d-b45d-47bc-8844-d1008acaad40 req-93189da6-8378-4afa-9eda-b015ad669bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e", "name": "network-vif-unplugged", "status": "completed", "tag": "53dcf2fd-d803-419e-ac77-4ff7d0c3b117"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:13.581139 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-1d35638d-b45d-47bc-8844-d1008acaad40 req-93189da6-8378-4afa-9eda-b015ad669bb7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:13.582435 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-1d35638d-b45d-47bc-8844-d1008acaad40 req-93189da6-8378-4afa-9eda-b015ad669bb7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:13.632907 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-1d35638d-b45d-47bc-8844-d1008acaad40 req-93189da6-8378-4afa-9eda-b015ad669bb7 service nova] Creating event network-vif-unplugged:53dcf2fd-d803-419e-ac77-4ff7d0c3b117 for instance 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e on n-h1-846435-14 Jul 25 14:37:13.647902 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-1d35638d-b45d-47bc-8844-d1008acaad40 req-93189da6-8378-4afa-9eda-b015ad669bb7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117752 Jul 25 14:37:13.650679 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1521/2849] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:13.665429 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b4304958-8491-47bd-8ea1-2601c6d5d110 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:13.667488 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b4304958-8491-47bd-8ea1-2601c6d5d110 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:13.687637 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b4304958-8491-47bd-8ea1-2601c6d5d110 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:13.690218 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b4304958-8491-47bd-8ea1-2601c6d5d110 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:13.692534 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b4304958-8491-47bd-8ea1-2601c6d5d110 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:13.695310 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b4304958-8491-47bd-8ea1-2601c6d5d110 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:14.468183 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-d18e1230-e636-43d1-abf7-a3e364e9c58d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Updating instance_info_cache with network_info: [{"id": "6fdb0b84-35b3-4673-9dfe-8ceebbbd3e3d", "address": "fa:16:3e:99:1b:c4", "network": {"id": "f0d31963-aa19-4478-8a48-db619b3cf3f9", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-407647780-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3cc39cb570d842d59580e2075f74d50d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6fdb0b84-35", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119303) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 14:37:14.500518 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d18e1230-e636-43d1-abf7-a3e364e9c58d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Releasing lock "refresh_cache-756ffb6d-8123-4743-97b5-e3153a7fc28e" {{(pid=119303) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 14:37:14.503443 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d18e1230-e636-43d1-abf7-a3e364e9c58d tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "POST /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e/action" status: 202 len: 0 microversion: 2.1 time: 4.577728 Jul 25 14:37:14.507429 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1329/2850] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:37:09 2022] POST /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e/action => generated 0 bytes in 4579 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 14:37:14.514664 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-600b5a3f-a64c-4630-9e3e-57dc3f7bbaa8 req-952cf213-b909-4c03-9b86-9487f41b707b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "756ffb6d-8123-4743-97b5-e3153a7fc28e", "tag": "6fdb0b84-35b3-4673-9dfe-8ceebbbd3e3d"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:14.527650 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-600b5a3f-a64c-4630-9e3e-57dc3f7bbaa8 req-952cf213-b909-4c03-9b86-9487f41b707b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:14.528472 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-600b5a3f-a64c-4630-9e3e-57dc3f7bbaa8 req-952cf213-b909-4c03-9b86-9487f41b707b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:14.544866 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-600b5a3f-a64c-4630-9e3e-57dc3f7bbaa8 req-952cf213-b909-4c03-9b86-9487f41b707b service nova] Creating event network-changed:6fdb0b84-35b3-4673-9dfe-8ceebbbd3e3d for instance 756ffb6d-8123-4743-97b5-e3153a7fc28e on n-h2-846435-14 Jul 25 14:37:14.553011 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-600b5a3f-a64c-4630-9e3e-57dc3f7bbaa8 req-952cf213-b909-4c03-9b86-9487f41b707b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042876 Jul 25 14:37:14.554539 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1330/2851] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:14.580072 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a7d32f84-7e6b-480f-b82f-0ffba7cd5675 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:14.581104 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a7d32f84-7e6b-480f-b82f-0ffba7cd5675 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:14.592233 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a7d32f84-7e6b-480f-b82f-0ffba7cd5675 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:14.593553 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a7d32f84-7e6b-480f-b82f-0ffba7cd5675 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:14.595734 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a7d32f84-7e6b-480f-b82f-0ffba7cd5675 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:14.596464 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a7d32f84-7e6b-480f-b82f-0ffba7cd5675 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:14.692321 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b4304958-8491-47bd-8ea1-2601c6d5d110 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:14.703463 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b4304958-8491-47bd-8ea1-2601c6d5d110 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1391 microversion: 2.1 time: 1.050986 Jul 25 14:37:14.723098 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1522/2852] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:13 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1391 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:14.730706 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-620c43c0-f653-441f-a74b-2b38409654eb tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:14.731429 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-620c43c0-f653-441f-a74b-2b38409654eb tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:14.764444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-620c43c0-f653-441f-a74b-2b38409654eb tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:14.765235 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-620c43c0-f653-441f-a74b-2b38409654eb tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:14.766190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-620c43c0-f653-441f-a74b-2b38409654eb tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:14.766781 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-620c43c0-f653-441f-a74b-2b38409654eb tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:15.045096 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a7d32f84-7e6b-480f-b82f-0ffba7cd5675 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb708222f6ee4225b1fe18848fb6a1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:15.074666 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a7d32f84-7e6b-480f-b82f-0ffba7cd5675 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3" status: 200 len: 1303 microversion: 2.1 time: 0.517989 Jul 25 14:37:15.075808 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1331/2853] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:14 2022] GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 => generated 1303 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:15.117098 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4e9622de-3aad-4911-8920-cd24195f0d03 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:15.117748 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4e9622de-3aad-4911-8920-cd24195f0d03 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:15.153818 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4e9622de-3aad-4911-8920-cd24195f0d03 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:15.154567 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4e9622de-3aad-4911-8920-cd24195f0d03 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:15.163645 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4e9622de-3aad-4911-8920-cd24195f0d03 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:15.164606 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4e9622de-3aad-4911-8920-cd24195f0d03 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:15.496686 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-620c43c0-f653-441f-a74b-2b38409654eb tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:15.511752 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-620c43c0-f653-441f-a74b-2b38409654eb tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:15.518471 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-620c43c0-f653-441f-a74b-2b38409654eb tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:15.520455 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-620c43c0-f653-441f-a74b-2b38409654eb tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1750 microversion: 2.20 time: 0.795801 Jul 25 14:37:15.522173 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1523/2854] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:14 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1750 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:15.536760 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9bf43188-4e75-43bd-b277-d1a74bea0a06 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:15.537765 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9bf43188-4e75-43bd-b277-d1a74bea0a06 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] [instance: 94a61a8f-6d71-42d5-8a25-2dd93b221cc2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:15.553946 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9bf43188-4e75-43bd-b277-d1a74bea0a06 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:15.556519 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9bf43188-4e75-43bd-b277-d1a74bea0a06 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:15.557635 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9bf43188-4e75-43bd-b277-d1a74bea0a06 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:15.559419 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9bf43188-4e75-43bd-b277-d1a74bea0a06 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:15.841152 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4e9622de-3aad-4911-8920-cd24195f0d03 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a720adc1b3443a8062b3eb8c7df11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5771bc6c546646b5a432a114f76d373d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:15.853384 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4e9622de-3aad-4911-8920-cd24195f0d03 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653" status: 200 len: 1365 microversion: 2.1 time: 0.776547 Jul 25 14:37:15.860326 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1332/2855] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:15 2022] GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653 => generated 1365 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:16.119157 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-74e2e3b3-627f-49da-aa6e-faacde68dab2 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:16.119908 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-74e2e3b3-627f-49da-aa6e-faacde68dab2 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:16.126509 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-74e2e3b3-627f-49da-aa6e-faacde68dab2 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:16.130681 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-74e2e3b3-627f-49da-aa6e-faacde68dab2 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:16.135815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-74e2e3b3-627f-49da-aa6e-faacde68dab2 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:16.137191 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-74e2e3b3-627f-49da-aa6e-faacde68dab2 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:16.140132 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9bf43188-4e75-43bd-b277-d1a74bea0a06 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b42088e9f64e4bb596ea18ea062f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9560d1222b9b47ca8d8fff3c6a7b634f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:16.152881 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9bf43188-4e75-43bd-b277-d1a74bea0a06 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2" status: 200 len: 1312 microversion: 2.1 time: 0.625064 Jul 25 14:37:16.158392 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1524/2856] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:15 2022] GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2 => generated 1312 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:16.171341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-4be2623f-18d2-4606-abe4-2de1fe18db76 req-c1fcb617-f89f-4d0c-8eb6-7ae045bed802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e1fbfa4-195c-46bb-9a93-9ffd88ecf653", "name": "network-vif-plugged", "status": "completed", "tag": "51baeba0-6ad9-4e68-ba06-613e8d367ad9"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:16.197298 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-4be2623f-18d2-4606-abe4-2de1fe18db76 req-c1fcb617-f89f-4d0c-8eb6-7ae045bed802 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:16.198221 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-4be2623f-18d2-4606-abe4-2de1fe18db76 req-c1fcb617-f89f-4d0c-8eb6-7ae045bed802 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:16.201357 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-74e2e3b3-627f-49da-aa6e-faacde68dab2 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:37:16.228871 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-4be2623f-18d2-4606-abe4-2de1fe18db76 req-c1fcb617-f89f-4d0c-8eb6-7ae045bed802 service nova] Creating event network-vif-plugged:51baeba0-6ad9-4e68-ba06-613e8d367ad9 for instance 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653 on n-h2-846435-14 Jul 25 14:37:16.234558 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-4be2623f-18d2-4606-abe4-2de1fe18db76 req-c1fcb617-f89f-4d0c-8eb6-7ae045bed802 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074441 Jul 25 14:37:16.235407 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1525/2857] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:16.255022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-87c2022d-fa63-41c8-9c43-6f0f586c50de tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '.version_select at 0x7f46864d0820>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:16.439852 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-74e2e3b3-627f-49da-aa6e-faacde68dab2 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "DELETE /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 204 len: 0 microversion: 2.42 time: 0.577700 Jul 25 14:37:16.447543 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1333/2858] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Jul 25 14:37:15 2022] DELETE /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 14:37:16.469689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ef7f0429-8292-4076-a299-9fdc2c437da9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:16.470411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ef7f0429-8292-4076-a299-9fdc2c437da9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:16.477386 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ef7f0429-8292-4076-a299-9fdc2c437da9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:16.477851 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ef7f0429-8292-4076-a299-9fdc2c437da9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:16.478787 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ef7f0429-8292-4076-a299-9fdc2c437da9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:16.479233 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ef7f0429-8292-4076-a299-9fdc2c437da9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:16.484826 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:37:16.729217 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ef7f0429-8292-4076-a299-9fdc2c437da9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:16.764202 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ef7f0429-8292-4076-a299-9fdc2c437da9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1521 microversion: 2.1 time: 0.315014 Jul 25 14:37:16.769052 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1334/2859] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:16 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:16.783308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-a6a67b6d-3a1d-4b53-ab55-2d9baed675e9 req-0346b344-923c-4bf2-8595-5d379bfc3edb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e", "tag": "53dcf2fd-d803-419e-ac77-4ff7d0c3b117"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:16.804530 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-a6a67b6d-3a1d-4b53-ab55-2d9baed675e9 req-0346b344-923c-4bf2-8595-5d379bfc3edb service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:16.805855 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-a6a67b6d-3a1d-4b53-ab55-2d9baed675e9 req-0346b344-923c-4bf2-8595-5d379bfc3edb service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:16.833511 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-a6a67b6d-3a1d-4b53-ab55-2d9baed675e9 req-0346b344-923c-4bf2-8595-5d379bfc3edb service nova] Creating event network-changed:53dcf2fd-d803-419e-ac77-4ff7d0c3b117 for instance 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e on n-h1-846435-14 Jul 25 14:37:16.839506 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-a6a67b6d-3a1d-4b53-ab55-2d9baed675e9 req-0346b344-923c-4bf2-8595-5d379bfc3edb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069218 Jul 25 14:37:16.841273 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1335/2860] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:16.848675 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6376c7a5-fdaf-4a3d-843c-0c98c1c657be tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:16.849839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6376c7a5-fdaf-4a3d-843c-0c98c1c657be tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:16.880808 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6376c7a5-fdaf-4a3d-843c-0c98c1c657be tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:16.881742 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6376c7a5-fdaf-4a3d-843c-0c98c1c657be tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:16.883651 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6376c7a5-fdaf-4a3d-843c-0c98c1c657be tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:16.886598 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6376c7a5-fdaf-4a3d-843c-0c98c1c657be tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:17.158953 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6376c7a5-fdaf-4a3d-843c-0c98c1c657be tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:17.169066 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6376c7a5-fdaf-4a3d-843c-0c98c1c657be tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1391 microversion: 2.1 time: 0.324910 Jul 25 14:37:17.170852 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1336/2861] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:16 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1391 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:17.176231 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ed77111c-429c-4f12-b0fd-285fd772d2c7 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:17.177163 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ed77111c-429c-4f12-b0fd-285fd772d2c7 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:17.187190 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ed77111c-429c-4f12-b0fd-285fd772d2c7 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:17.188534 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ed77111c-429c-4f12-b0fd-285fd772d2c7 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:17.189727 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ed77111c-429c-4f12-b0fd-285fd772d2c7 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:17.190825 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ed77111c-429c-4f12-b0fd-285fd772d2c7 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:17.416369 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ed77111c-429c-4f12-b0fd-285fd772d2c7 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb708222f6ee4225b1fe18848fb6a1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:17.425023 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ed77111c-429c-4f12-b0fd-285fd772d2c7 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3" status: 200 len: 1303 microversion: 2.1 time: 0.252652 Jul 25 14:37:17.425547 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1337/2862] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:17 2022] GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 => generated 1303 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:17.430696 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c9c95a07-8ced-4f35-9e0f-71f64a3a221e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:17.431512 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c9c95a07-8ced-4f35-9e0f-71f64a3a221e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:17.443833 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c9c95a07-8ced-4f35-9e0f-71f64a3a221e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:17.444561 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c9c95a07-8ced-4f35-9e0f-71f64a3a221e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:17.445498 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c9c95a07-8ced-4f35-9e0f-71f64a3a221e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:17.446194 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c9c95a07-8ced-4f35-9e0f-71f64a3a221e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:17.674014 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c9c95a07-8ced-4f35-9e0f-71f64a3a221e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:17.687650 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c9c95a07-8ced-4f35-9e0f-71f64a3a221e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:17.689914 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c9c95a07-8ced-4f35-9e0f-71f64a3a221e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:17.692219 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c9c95a07-8ced-4f35-9e0f-71f64a3a221e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 2955 microversion: 2.42 time: 0.265243 Jul 25 14:37:17.693346 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1338/2863] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:17 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 2955 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:17.700128 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-694e4b19-835f-4be1-9cc7-c188fb1aa1c0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:17.701107 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-694e4b19-835f-4be1-9cc7-c188fb1aa1c0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:17.709014 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-694e4b19-835f-4be1-9cc7-c188fb1aa1c0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:17.709935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-694e4b19-835f-4be1-9cc7-c188fb1aa1c0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:17.710988 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-694e4b19-835f-4be1-9cc7-c188fb1aa1c0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:17.711949 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-694e4b19-835f-4be1-9cc7-c188fb1aa1c0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:17.834418 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-87c2022d-fa63-41c8-9c43-6f0f586c50de tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "DELETE /compute/v2.1/os-floating-ips/9663a854-fd6f-46b3-9a16-3d1215a209f4" status: 202 len: 0 microversion: 2.1 time: 1.597436 Jul 25 14:37:17.835381 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1526/2864] 10.222.0.88 () {58 vars in 1263 bytes} [Mon Jul 25 14:37:16 2022] DELETE /compute/v2.1/os-floating-ips/9663a854-fd6f-46b3-9a16-3d1215a209f4 => generated 0 bytes in 1599 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:37:17.840833 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-82507f29-e673-47b0-8eb0-e31dd6295676 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:17.841442 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-82507f29-e673-47b0-8eb0-e31dd6295676 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:17.862273 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-82507f29-e673-47b0-8eb0-e31dd6295676 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:17.862965 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-82507f29-e673-47b0-8eb0-e31dd6295676 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:17.864079 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-82507f29-e673-47b0-8eb0-e31dd6295676 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:17.864528 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-82507f29-e673-47b0-8eb0-e31dd6295676 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:17.923450 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-694e4b19-835f-4be1-9cc7-c188fb1aa1c0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:17.936686 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-694e4b19-835f-4be1-9cc7-c188fb1aa1c0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:17.938677 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-694e4b19-835f-4be1-9cc7-c188fb1aa1c0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:17.940265 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-694e4b19-835f-4be1-9cc7-c188fb1aa1c0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1752 microversion: 2.20 time: 0.245467 Jul 25 14:37:17.952321 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1339/2865] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:17 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1752 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:17.952321 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6f7a7a97-0b29-4329-b05a-4fb29b4ba334 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:17.952321 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6f7a7a97-0b29-4329-b05a-4fb29b4ba334 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] [instance: 94a61a8f-6d71-42d5-8a25-2dd93b221cc2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:17.962254 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6f7a7a97-0b29-4329-b05a-4fb29b4ba334 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:17.962925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6f7a7a97-0b29-4329-b05a-4fb29b4ba334 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:17.964720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6f7a7a97-0b29-4329-b05a-4fb29b4ba334 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:17.965376 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6f7a7a97-0b29-4329-b05a-4fb29b4ba334 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:18.152274 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-82507f29-e673-47b0-8eb0-e31dd6295676 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a720adc1b3443a8062b3eb8c7df11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5771bc6c546646b5a432a114f76d373d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:18.163524 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6f7a7a97-0b29-4329-b05a-4fb29b4ba334 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b42088e9f64e4bb596ea18ea062f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9560d1222b9b47ca8d8fff3c6a7b634f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:18.164783 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-82507f29-e673-47b0-8eb0-e31dd6295676 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653" status: 200 len: 1365 microversion: 2.1 time: 0.328156 Jul 25 14:37:18.167182 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1527/2866] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:17 2022] GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653 => generated 1365 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:18.191759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6620826a-266c-4e50-8f13-eb36882a24ff tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:18.195887 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6f7a7a97-0b29-4329-b05a-4fb29b4ba334 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2" status: 200 len: 1312 microversion: 2.1 time: 0.249091 Jul 25 14:37:18.196605 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1340/2867] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:17 2022] GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2 => generated 1312 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:18.209200 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6620826a-266c-4e50-8f13-eb36882a24ff tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:18.209200 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6620826a-266c-4e50-8f13-eb36882a24ff tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:18.209200 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6620826a-266c-4e50-8f13-eb36882a24ff tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:18.209200 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6620826a-266c-4e50-8f13-eb36882a24ff tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:18.209200 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6620826a-266c-4e50-8f13-eb36882a24ff tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:18.222623 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-67a3c173-4591-4bc6-b440-4bd8eb84d307 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '.version_select at 0x7f4686bae280>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:18.454399 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:37:18.476258 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6620826a-266c-4e50-8f13-eb36882a24ff tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:18.485391 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6620826a-266c-4e50-8f13-eb36882a24ff tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1521 microversion: 2.1 time: 0.316805 Jul 25 14:37:18.488295 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1528/2868] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:18 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:18.494868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cf734aa6-412e-4361-ba17-ede52e1f49c9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:18.495495 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cf734aa6-412e-4361-ba17-ede52e1f49c9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:18.523793 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cf734aa6-412e-4361-ba17-ede52e1f49c9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:18.524413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cf734aa6-412e-4361-ba17-ede52e1f49c9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:18.525201 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cf734aa6-412e-4361-ba17-ede52e1f49c9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:18.525624 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cf734aa6-412e-4361-ba17-ede52e1f49c9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:18.621177 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-67a3c173-4591-4bc6-b440-4bd8eb84d307 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/ecefe9a6-d08d-46e0-ae03-c326bdb96218" status: 202 len: 0 microversion: 2.1 time: 0.408662 Jul 25 14:37:18.624690 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1341/2869] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:37:18 2022] DELETE /compute/v2.1/os-security-groups/ecefe9a6-d08d-46e0-ae03-c326bdb96218 => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:37:18.627304 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-25b3e824-036f-41ec-83c5-85e8222033db tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:18.628157 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-25b3e824-036f-41ec-83c5-85e8222033db tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:18.636921 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-25b3e824-036f-41ec-83c5-85e8222033db tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:18.637508 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-25b3e824-036f-41ec-83c5-85e8222033db tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:18.638564 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-25b3e824-036f-41ec-83c5-85e8222033db tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:18.639290 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-25b3e824-036f-41ec-83c5-85e8222033db tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:18.728523 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=66 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:37:18.793950 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cf734aa6-412e-4361-ba17-ede52e1f49c9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:18.804683 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cf734aa6-412e-4361-ba17-ede52e1f49c9 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1391 microversion: 2.1 time: 0.315262 Jul 25 14:37:18.820990 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1529/2870] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:18 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1391 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:18.826792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6bebb463-046b-43b1-9c82-c61d151ea7cd tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:18.827466 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6bebb463-046b-43b1-9c82-c61d151ea7cd tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:18.835667 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6bebb463-046b-43b1-9c82-c61d151ea7cd tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:18.836524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6bebb463-046b-43b1-9c82-c61d151ea7cd tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:18.837236 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6bebb463-046b-43b1-9c82-c61d151ea7cd tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:18.837771 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6bebb463-046b-43b1-9c82-c61d151ea7cd tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:18.878104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6bebb463-046b-43b1-9c82-c61d151ea7cd tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:37:18.983676 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6bebb463-046b-43b1-9c82-c61d151ea7cd tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "DELETE /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 204 len: 0 microversion: 2.1 time: 0.159877 Jul 25 14:37:18.987623 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1530/2871] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:37:18 2022] DELETE /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:37:18.993612 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6536d438-9109-4c66-bf3c-30438281edfe tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:18.994372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6536d438-9109-4c66-bf3c-30438281edfe tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:19.003967 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6536d438-9109-4c66-bf3c-30438281edfe tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:19.004586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6536d438-9109-4c66-bf3c-30438281edfe tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:19.006230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6536d438-9109-4c66-bf3c-30438281edfe tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:19.006694 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6536d438-9109-4c66-bf3c-30438281edfe tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:19.056187 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-25b3e824-036f-41ec-83c5-85e8222033db tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb708222f6ee4225b1fe18848fb6a1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:19.066843 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-25b3e824-036f-41ec-83c5-85e8222033db tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3" status: 200 len: 1291 microversion: 2.1 time: 0.442431 Jul 25 14:37:19.080213 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1342/2872] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:18 2022] GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 => generated 1291 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:19.080213 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-363e3945-e464-44cc-814b-651ea56ac2b4 req-9b2e4420-7ee3-46e2-ae02-98f8159a6df0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3", "tag": "24058dbf-0bb6-4f6e-8912-6077d722be00"}, {"name": "network-changed", "server_uuid": "94a61a8f-6d71-42d5-8a25-2dd93b221cc2", "tag": "230e08ff-39b2-44ef-a97c-cc8937af2ad1"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:19.085260 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-363e3945-e464-44cc-814b-651ea56ac2b4 req-9b2e4420-7ee3-46e2-ae02-98f8159a6df0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:19.085708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-363e3945-e464-44cc-814b-651ea56ac2b4 req-9b2e4420-7ee3-46e2-ae02-98f8159a6df0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:19.098749 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-363e3945-e464-44cc-814b-651ea56ac2b4 req-9b2e4420-7ee3-46e2-ae02-98f8159a6df0 service nova] Creating event network-changed:24058dbf-0bb6-4f6e-8912-6077d722be00 for instance fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 on n-h2-846435-14 Jul 25 14:37:19.099303 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-363e3945-e464-44cc-814b-651ea56ac2b4 req-9b2e4420-7ee3-46e2-ae02-98f8159a6df0 service nova] Creating event network-changed:230e08ff-39b2-44ef-a97c-cc8937af2ad1 for instance 94a61a8f-6d71-42d5-8a25-2dd93b221cc2 on n-h1-846435-14 Jul 25 14:37:19.107451 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-363e3945-e464-44cc-814b-651ea56ac2b4 req-9b2e4420-7ee3-46e2-ae02-98f8159a6df0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038477 Jul 25 14:37:19.108245 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1343/2873] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:19.113255 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e330ab2d-c264-45e4-9647-2703bf366096 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:19.113905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e330ab2d-c264-45e4-9647-2703bf366096 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:19.120269 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e330ab2d-c264-45e4-9647-2703bf366096 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:19.120723 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e330ab2d-c264-45e4-9647-2703bf366096 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:19.121619 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e330ab2d-c264-45e4-9647-2703bf366096 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:19.122059 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e330ab2d-c264-45e4-9647-2703bf366096 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:19.224713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6536d438-9109-4c66-bf3c-30438281edfe tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:19.236497 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6536d438-9109-4c66-bf3c-30438281edfe tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:19.238137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6536d438-9109-4c66-bf3c-30438281edfe tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:19.239558 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6536d438-9109-4c66-bf3c-30438281edfe tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 2955 microversion: 2.42 time: 0.253000 Jul 25 14:37:19.252290 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1531/2874] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:18 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 2955 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:19.252290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a2eb123f-3c74-4057-9f37-cd7844c4b9ae tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:19.252290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a2eb123f-3c74-4057-9f37-cd7844c4b9ae tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:19.258563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a2eb123f-3c74-4057-9f37-cd7844c4b9ae tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:19.259184 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a2eb123f-3c74-4057-9f37-cd7844c4b9ae tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:19.260761 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a2eb123f-3c74-4057-9f37-cd7844c4b9ae tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:19.261330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a2eb123f-3c74-4057-9f37-cd7844c4b9ae tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:19.394225 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e330ab2d-c264-45e4-9647-2703bf366096 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:19.410076 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e330ab2d-c264-45e4-9647-2703bf366096 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:19.412966 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a2eb123f-3c74-4057-9f37-cd7844c4b9ae tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:19.413571 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e330ab2d-c264-45e4-9647-2703bf366096 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:19.415900 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e330ab2d-c264-45e4-9647-2703bf366096 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1752 microversion: 2.20 time: 0.306029 Jul 25 14:37:19.417393 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1344/2875] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:19 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1752 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:19.423504 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f7261bd4-3b93-4b0b-b976-57336cdfe4be tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:19.424345 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a2eb123f-3c74-4057-9f37-cd7844c4b9ae tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1510 microversion: 2.1 time: 0.182445 Jul 25 14:37:19.424696 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f7261bd4-3b93-4b0b-b976-57336cdfe4be tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:19.425574 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1532/2876] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:19 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1510 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:19.434852 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f7261bd4-3b93-4b0b-b976-57336cdfe4be tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:19.435762 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f7261bd4-3b93-4b0b-b976-57336cdfe4be tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:19.436745 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f7261bd4-3b93-4b0b-b976-57336cdfe4be tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:19.437751 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f7261bd4-3b93-4b0b-b976-57336cdfe4be tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:19.445421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8e352cb8-1595-4a21-9e4b-8838f8cdefc7 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:19.452825 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8e352cb8-1595-4a21-9e4b-8838f8cdefc7 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] [instance: 94a61a8f-6d71-42d5-8a25-2dd93b221cc2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:19.460148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e352cb8-1595-4a21-9e4b-8838f8cdefc7 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:19.460704 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e352cb8-1595-4a21-9e4b-8838f8cdefc7 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:19.461594 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e352cb8-1595-4a21-9e4b-8838f8cdefc7 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:19.462093 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e352cb8-1595-4a21-9e4b-8838f8cdefc7 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:19.591232 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f7261bd4-3b93-4b0b-b976-57336cdfe4be tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a720adc1b3443a8062b3eb8c7df11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5771bc6c546646b5a432a114f76d373d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:19.600116 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f7261bd4-3b93-4b0b-b976-57336cdfe4be tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653" status: 200 len: 1555 microversion: 2.1 time: 0.181393 Jul 25 14:37:19.612005 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1345/2877] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:19 2022] GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653 => generated 1555 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:19.612358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8e352cb8-1595-4a21-9e4b-8838f8cdefc7 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b42088e9f64e4bb596ea18ea062f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9560d1222b9b47ca8d8fff3c6a7b634f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:19.612477 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-305ef252-554c-4f81-a2b9-a3e7263c06a1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:19.612477 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-305ef252-554c-4f81-a2b9-a3e7263c06a1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:19.612647 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8e352cb8-1595-4a21-9e4b-8838f8cdefc7 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2" status: 200 len: 1312 microversion: 2.1 time: 0.185192 Jul 25 14:37:19.612742 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1533/2878] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:19 2022] GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2 => generated 1312 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:19.621057 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-305ef252-554c-4f81-a2b9-a3e7263c06a1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:19.621676 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-305ef252-554c-4f81-a2b9-a3e7263c06a1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:19.622462 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-305ef252-554c-4f81-a2b9-a3e7263c06a1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:19.622898 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-305ef252-554c-4f81-a2b9-a3e7263c06a1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:19.632424 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-00c152dd-2cba-44ac-a440-92ac66d5b554 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:19.632923 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-00c152dd-2cba-44ac-a440-92ac66d5b554 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:19.639461 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-00c152dd-2cba-44ac-a440-92ac66d5b554 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:19.639907 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-00c152dd-2cba-44ac-a440-92ac66d5b554 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:19.640708 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-00c152dd-2cba-44ac-a440-92ac66d5b554 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:19.641144 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-00c152dd-2cba-44ac-a440-92ac66d5b554 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:19.729816 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-00c152dd-2cba-44ac-a440-92ac66d5b554 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101459 Jul 25 14:37:19.730421 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1534/2879] 10.222.0.88 () {58 vars in 1275 bytes} [Mon Jul 25 14:37:19 2022] GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:19.787087 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-305ef252-554c-4f81-a2b9-a3e7263c06a1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:19.798645 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-305ef252-554c-4f81-a2b9-a3e7263c06a1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1521 microversion: 2.1 time: 0.196521 Jul 25 14:37:19.800334 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1346/2880] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:19 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:19.826557 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4e4219cd-f076-43cf-8745-9b7c3b925325 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:19.827177 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4e4219cd-f076-43cf-8745-9b7c3b925325 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:19.829337 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:37:19.835045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e4219cd-f076-43cf-8745-9b7c3b925325 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:19.835501 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e4219cd-f076-43cf-8745-9b7c3b925325 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:19.836306 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e4219cd-f076-43cf-8745-9b7c3b925325 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:19.836922 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e4219cd-f076-43cf-8745-9b7c3b925325 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:20.088851 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-57991675-e499-4ce2-b2ff-9f08d5f84e4a tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:20.090098 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-57991675-e499-4ce2-b2ff-9f08d5f84e4a tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:20.096821 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57991675-e499-4ce2-b2ff-9f08d5f84e4a tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:20.097725 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57991675-e499-4ce2-b2ff-9f08d5f84e4a tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:20.098081 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57991675-e499-4ce2-b2ff-9f08d5f84e4a tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:20.098712 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57991675-e499-4ce2-b2ff-9f08d5f84e4a tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:20.131928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4e4219cd-f076-43cf-8745-9b7c3b925325 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:20.156545 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4e4219cd-f076-43cf-8745-9b7c3b925325 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1391 microversion: 2.1 time: 0.333793 Jul 25 14:37:20.161738 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1535/2881] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:19 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1391 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:20.259321 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-57991675-e499-4ce2-b2ff-9f08d5f84e4a tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb708222f6ee4225b1fe18848fb6a1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:20.265770 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7c18c1e3-ef60-4ef1-a6fa-e522a1541946 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:20.266402 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7c18c1e3-ef60-4ef1-a6fa-e522a1541946 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:20.272488 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-57991675-e499-4ce2-b2ff-9f08d5f84e4a tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3" status: 200 len: 1291 microversion: 2.1 time: 0.188193 Jul 25 14:37:20.272810 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7c18c1e3-ef60-4ef1-a6fa-e522a1541946 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:20.273573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7c18c1e3-ef60-4ef1-a6fa-e522a1541946 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:20.274054 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7c18c1e3-ef60-4ef1-a6fa-e522a1541946 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:20.274493 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7c18c1e3-ef60-4ef1-a6fa-e522a1541946 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:20.275758 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1347/2882] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:20 2022] GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 => generated 1291 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:20.450811 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6bb5aecd-4ab0-4558-939d-ae4d61c52484 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:20.451400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6bb5aecd-4ab0-4558-939d-ae4d61c52484 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:20.465649 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6bb5aecd-4ab0-4558-939d-ae4d61c52484 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:20.466465 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6bb5aecd-4ab0-4558-939d-ae4d61c52484 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:20.467823 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6bb5aecd-4ab0-4558-939d-ae4d61c52484 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:20.468495 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6bb5aecd-4ab0-4558-939d-ae4d61c52484 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:20.573133 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7c18c1e3-ef60-4ef1-a6fa-e522a1541946 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:20.582945 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7c18c1e3-ef60-4ef1-a6fa-e522a1541946 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:20.584136 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7c18c1e3-ef60-4ef1-a6fa-e522a1541946 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:20.585425 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7c18c1e3-ef60-4ef1-a6fa-e522a1541946 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 2955 microversion: 2.42 time: 0.323831 Jul 25 14:37:20.600413 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1536/2883] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:20 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 2955 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:20.607902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-20f7c222-483b-408c-a64e-6b76bfe8550a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:20.610220 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-20f7c222-483b-408c-a64e-6b76bfe8550a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:20.616104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-20f7c222-483b-408c-a64e-6b76bfe8550a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:20.616557 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-20f7c222-483b-408c-a64e-6b76bfe8550a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:20.617329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-20f7c222-483b-408c-a64e-6b76bfe8550a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:20.617837 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-20f7c222-483b-408c-a64e-6b76bfe8550a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:20.736343 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6bb5aecd-4ab0-4558-939d-ae4d61c52484 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:20.746936 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6bb5aecd-4ab0-4558-939d-ae4d61c52484 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1510 microversion: 2.1 time: 0.300625 Jul 25 14:37:20.763542 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1348/2884] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:20 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1510 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:20.774086 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7e8108d5-7301-498b-99d2-17c02b53a70e tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:20.775480 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7e8108d5-7301-498b-99d2-17c02b53a70e tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] [instance: 94a61a8f-6d71-42d5-8a25-2dd93b221cc2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:20.785667 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7e8108d5-7301-498b-99d2-17c02b53a70e tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:20.786937 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7e8108d5-7301-498b-99d2-17c02b53a70e tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:20.788001 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7e8108d5-7301-498b-99d2-17c02b53a70e tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:20.789319 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7e8108d5-7301-498b-99d2-17c02b53a70e tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:21.127017 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7e8108d5-7301-498b-99d2-17c02b53a70e tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b42088e9f64e4bb596ea18ea062f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9560d1222b9b47ca8d8fff3c6a7b634f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:21.141807 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7e8108d5-7301-498b-99d2-17c02b53a70e tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2" status: 200 len: 1312 microversion: 2.1 time: 0.376253 Jul 25 14:37:21.142659 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1349/2885] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:20 2022] GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2 => generated 1312 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:21.159746 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d9a641ac-1000-45c3-b2c9-e66e91a70ebe tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:21.160906 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d9a641ac-1000-45c3-b2c9-e66e91a70ebe tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:21.168002 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d9a641ac-1000-45c3-b2c9-e66e91a70ebe tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:21.168459 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d9a641ac-1000-45c3-b2c9-e66e91a70ebe tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:21.178348 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d9a641ac-1000-45c3-b2c9-e66e91a70ebe tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:21.178826 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d9a641ac-1000-45c3-b2c9-e66e91a70ebe tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:21.270341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-20f7c222-483b-408c-a64e-6b76bfe8550a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:21.283594 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-20f7c222-483b-408c-a64e-6b76bfe8550a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:21.288046 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-20f7c222-483b-408c-a64e-6b76bfe8550a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:21.293478 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-20f7c222-483b-408c-a64e-6b76bfe8550a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1752 microversion: 2.20 time: 0.691900 Jul 25 14:37:21.296991 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1537/2886] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:20 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1752 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:21.307215 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-868062f8-69a7-43e9-b468-8ddc8fb09454 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:21.312752 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-868062f8-69a7-43e9-b468-8ddc8fb09454 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:21.321441 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-868062f8-69a7-43e9-b468-8ddc8fb09454 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:21.322376 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-868062f8-69a7-43e9-b468-8ddc8fb09454 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:21.323375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-868062f8-69a7-43e9-b468-8ddc8fb09454 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:21.324036 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-868062f8-69a7-43e9-b468-8ddc8fb09454 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:21.336646 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:37:21.608724 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-868062f8-69a7-43e9-b468-8ddc8fb09454 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:21.620969 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-868062f8-69a7-43e9-b468-8ddc8fb09454 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1391 microversion: 2.1 time: 0.322564 Jul 25 14:37:21.632078 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1538/2887] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:21 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1391 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:21.632078 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-575bf928-5a3d-4fb6-b695-83370337a6d2 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:21.632381 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-575bf928-5a3d-4fb6-b695-83370337a6d2 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:21.665740 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-575bf928-5a3d-4fb6-b695-83370337a6d2 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:21.665740 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-575bf928-5a3d-4fb6-b695-83370337a6d2 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:21.666162 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-575bf928-5a3d-4fb6-b695-83370337a6d2 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:21.666590 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-575bf928-5a3d-4fb6-b695-83370337a6d2 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:21.882582 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-575bf928-5a3d-4fb6-b695-83370337a6d2 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb708222f6ee4225b1fe18848fb6a1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:21.891370 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-575bf928-5a3d-4fb6-b695-83370337a6d2 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3" status: 200 len: 1291 microversion: 2.1 time: 0.263431 Jul 25 14:37:21.896500 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1539/2888] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:21 2022] GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 => generated 1291 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:21.912871 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f420b01b-5477-407d-86d9-1cd5e579effe tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:21.914623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f420b01b-5477-407d-86d9-1cd5e579effe tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:21.923260 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f420b01b-5477-407d-86d9-1cd5e579effe tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:21.924306 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f420b01b-5477-407d-86d9-1cd5e579effe tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:21.925366 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f420b01b-5477-407d-86d9-1cd5e579effe tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:21.925999 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f420b01b-5477-407d-86d9-1cd5e579effe tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:22.056491 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d9a641ac-1000-45c3-b2c9-e66e91a70ebe tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:22.064206 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d9a641ac-1000-45c3-b2c9-e66e91a70ebe tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1501 microversion: 2.1 time: 0.917654 Jul 25 14:37:22.064783 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1350/2889] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:21 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1501 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:22.069328 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ab42c671-a477-4ae9-a88f-a184d2bbf24a tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:22.069932 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ab42c671-a477-4ae9-a88f-a184d2bbf24a tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:22.089176 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab42c671-a477-4ae9-a88f-a184d2bbf24a tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:22.089619 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab42c671-a477-4ae9-a88f-a184d2bbf24a tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:22.090410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab42c671-a477-4ae9-a88f-a184d2bbf24a tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:22.090834 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab42c671-a477-4ae9-a88f-a184d2bbf24a tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:22.148022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f420b01b-5477-407d-86d9-1cd5e579effe tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:22.167379 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f420b01b-5477-407d-86d9-1cd5e579effe tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:22.172759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f420b01b-5477-407d-86d9-1cd5e579effe tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:22.174569 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f420b01b-5477-407d-86d9-1cd5e579effe tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 2934 microversion: 2.42 time: 0.276448 Jul 25 14:37:22.177432 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1540/2890] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:21 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 2934 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:22.183779 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-2b30d130-028d-47d2-9414-5cadf9dd5f86 req-6200a62b-dde6-4796-8659-d40957c50304 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e1fbfa4-195c-46bb-9a93-9ffd88ecf653", "tag": "51baeba0-6ad9-4e68-ba06-613e8d367ad9"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:22.196004 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-2b30d130-028d-47d2-9414-5cadf9dd5f86 req-6200a62b-dde6-4796-8659-d40957c50304 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:22.196901 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-2b30d130-028d-47d2-9414-5cadf9dd5f86 req-6200a62b-dde6-4796-8659-d40957c50304 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:22.216473 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-2b30d130-028d-47d2-9414-5cadf9dd5f86 req-6200a62b-dde6-4796-8659-d40957c50304 service nova] Creating event network-changed:51baeba0-6ad9-4e68-ba06-613e8d367ad9 for instance 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653 on n-h2-846435-14 Jul 25 14:37:22.226168 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-2b30d130-028d-47d2-9414-5cadf9dd5f86 req-6200a62b-dde6-4796-8659-d40957c50304 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047106 Jul 25 14:37:22.233066 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1541/2891] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:22.240342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-b8006433-dbb5-45df-a407-e7832d524976 req-0ed404af-615a-422e-ad98-313f9b63ba66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a6128a-580f-4184-ba11-6511d5021242", "name": "network-vif-unplugged", "status": "completed", "tag": "117e3c70-2257-4ddb-af6d-4e75db8fcb77"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:22.255517 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-b8006433-dbb5-45df-a407-e7832d524976 req-0ed404af-615a-422e-ad98-313f9b63ba66 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:22.256439 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-b8006433-dbb5-45df-a407-e7832d524976 req-0ed404af-615a-422e-ad98-313f9b63ba66 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:22.280798 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-b8006433-dbb5-45df-a407-e7832d524976 req-0ed404af-615a-422e-ad98-313f9b63ba66 service nova] Creating event network-vif-unplugged:117e3c70-2257-4ddb-af6d-4e75db8fcb77 for instance 33a6128a-580f-4184-ba11-6511d5021242 on n-h1-846435-14 Jul 25 14:37:22.299158 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-b8006433-dbb5-45df-a407-e7832d524976 req-0ed404af-615a-422e-ad98-313f9b63ba66 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063503 Jul 25 14:37:22.300697 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1542/2892] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:22.307841 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cee4fa8d-86ee-45ec-afef-653f6f3e5a75 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "599b6539-ea93-44de-a3bf-3738e029d04f"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:22.311327 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cee4fa8d-86ee-45ec-afef-653f6f3e5a75 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:22.321998 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cee4fa8d-86ee-45ec-afef-653f6f3e5a75 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:22.322821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cee4fa8d-86ee-45ec-afef-653f6f3e5a75 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:22.325569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cee4fa8d-86ee-45ec-afef-653f6f3e5a75 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:22.326266 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cee4fa8d-86ee-45ec-afef-653f6f3e5a75 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:22.356962 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-cee4fa8d-86ee-45ec-afef-653f6f3e5a75 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] HTTP exception thrown: Cannot 'attach_volume' instance 9d3dd486-7c28-4d5a-a177-3f14739f3abc while it is in vm_state rescued Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cee4fa8d-86ee-45ec-afef-653f6f3e5a75 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Request method failure captured: Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc/os-volume_attachments HTTP/1.1 Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 74 Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qojWgWRzNqcoFtbKX69HP8TMfJcvgq5mROxrtiAbTRQQhODI65548klI2mwspV0aDgelkydSdF0jDfbt9K1MKvAqBkxkDKwdPBnneXznLL8230WZKLHZUg-qMlSHwLMR2RP6Be2wdwzhEY6xsA-ygO39xLQI8y2VkgTqIORhZUeWIM Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 2f1bd935e917484799f31ad643eafb2a Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-756792154 Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2f1bd935e917484799f31ad643eafb2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2f1bd935e917484799f31ad643eafb2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2f1bd935e917484799f31ad643eafb2a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2f1bd935e917484799f31ad643eafb2a"}]}] Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerRescueNegativeTestJSON-756792154 Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 2f1bd935e917484799f31ad643eafb2a Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-756792154 Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerRescueNegativeTestJSON-756792154-project Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 9f2ddec1bc6244739e9ac3a40c064b53 Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerRescueNegativeTestJSON-756792154-project Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: {"volumeAttachment": {"volumeId": "599b6539-ea93-44de-a3bf-3738e029d04f"}} Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: exception: Cannot 'attach_volume' instance 9d3dd486-7c28-4d5a-a177-3f14739f3abc while it is in vm_state rescued Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'server_id': '9d3dd486-7c28-4d5a-a177-3f14739f3abc', 'body': {'volumeAttachment': {'volumeId': '599b6539-ea93-44de-a3bf-3738e029d04f'}}} Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9d3dd486-7c28-4d5a-a177-3f14739f3abc in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 25 14:37:22.372019 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 14:37:22.379894 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 14:37:22.379894 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 14:37:22.379894 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 9d3dd486-7c28-4d5a-a177-3f14739f3abc while it is in vm_state rescued Jul 25 14:37:22.379894 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:37:22.379894 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:37:22.379894 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:37:22.379894 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:37:22.379894 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:37:22.379894 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:37:22.379894 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:37:22.379894 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:37:22.379894 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 9d3dd486-7c28-4d5a-a177-3f14739f3abc while it is in vm_state rescued Jul 25 14:37:22.379894 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:37:22.379894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cee4fa8d-86ee-45ec-afef-653f6f3e5a75 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Returning 409 to user: Cannot 'attach_volume' instance 9d3dd486-7c28-4d5a-a177-3f14739f3abc while it is in vm_state rescued {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:37:22.379894 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cee4fa8d-86ee-45ec-afef-653f6f3e5a75 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "POST /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.072042 Jul 25 14:37:22.379894 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1543/2893] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Jul 25 14:37:22 2022] POST /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc/os-volume_attachments => generated 152 bytes in 73 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:37:22.381158 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-65e58b86-c10c-425a-aac0-1c1df7c81503 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:22.381550 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-65e58b86-c10c-425a-aac0-1c1df7c81503 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] [instance: 94a61a8f-6d71-42d5-8a25-2dd93b221cc2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:22.399129 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-65e58b86-c10c-425a-aac0-1c1df7c81503 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:22.399589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-65e58b86-c10c-425a-aac0-1c1df7c81503 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:22.400415 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-65e58b86-c10c-425a-aac0-1c1df7c81503 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:22.400847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-65e58b86-c10c-425a-aac0-1c1df7c81503 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:22.413489 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ab42c671-a477-4ae9-a88f-a184d2bbf24a tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:22.424014 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ab42c671-a477-4ae9-a88f-a184d2bbf24a tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1510 microversion: 2.1 time: 0.358157 Jul 25 14:37:22.428755 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1351/2894] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:22 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1510 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:22.438832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-66de6d42-27d1-4624-8742-defb813fc135 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:22.440948 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-66de6d42-27d1-4624-8742-defb813fc135 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:22.462408 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:37:22.478040 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-66de6d42-27d1-4624-8742-defb813fc135 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:22.483729 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-66de6d42-27d1-4624-8742-defb813fc135 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:22.484806 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-66de6d42-27d1-4624-8742-defb813fc135 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:22.486345 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-66de6d42-27d1-4624-8742-defb813fc135 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:22.610126 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-65e58b86-c10c-425a-aac0-1c1df7c81503 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b42088e9f64e4bb596ea18ea062f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9560d1222b9b47ca8d8fff3c6a7b634f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:22.620697 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-65e58b86-c10c-425a-aac0-1c1df7c81503 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2" status: 200 len: 1312 microversion: 2.1 time: 0.244445 Jul 25 14:37:22.622066 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1544/2895] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:22 2022] GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2 => generated 1312 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:22.627551 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d68ba4be-e840-4e18-85bb-1e804da448de tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:22.628218 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d68ba4be-e840-4e18-85bb-1e804da448de tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:22.636249 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d68ba4be-e840-4e18-85bb-1e804da448de tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:22.636469 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d68ba4be-e840-4e18-85bb-1e804da448de tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:22.638233 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d68ba4be-e840-4e18-85bb-1e804da448de tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:22.640655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d68ba4be-e840-4e18-85bb-1e804da448de tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:22.721849 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d68ba4be-e840-4e18-85bb-1e804da448de tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "POST /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc/action" status: 202 len: 0 microversion: 2.1 time: 0.098027 Jul 25 14:37:22.723108 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1545/2896] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:37:22 2022] POST /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:37:22.733714 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6633f985-12f4-4205-aaf3-067045070b38 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:22.734839 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6633f985-12f4-4205-aaf3-067045070b38 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:22.753131 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6633f985-12f4-4205-aaf3-067045070b38 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:22.755156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6633f985-12f4-4205-aaf3-067045070b38 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:22.757163 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6633f985-12f4-4205-aaf3-067045070b38 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:22.758011 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6633f985-12f4-4205-aaf3-067045070b38 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:23.178880 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6633f985-12f4-4205-aaf3-067045070b38 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:23.192144 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6633f985-12f4-4205-aaf3-067045070b38 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1391 microversion: 2.1 time: 0.467016 Jul 25 14:37:23.193811 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1546/2897] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:22 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1391 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:23.209052 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4b631a03-280a-4a7c-8d4a-2fcd64dca61e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:23.214083 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4b631a03-280a-4a7c-8d4a-2fcd64dca61e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:23.238197 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-66de6d42-27d1-4624-8742-defb813fc135 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:23.242641 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4b631a03-280a-4a7c-8d4a-2fcd64dca61e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:23.243278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4b631a03-280a-4a7c-8d4a-2fcd64dca61e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:23.244108 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4b631a03-280a-4a7c-8d4a-2fcd64dca61e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:23.244541 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4b631a03-280a-4a7c-8d4a-2fcd64dca61e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:23.250170 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-66de6d42-27d1-4624-8742-defb813fc135 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:23.252276 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-66de6d42-27d1-4624-8742-defb813fc135 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:23.254109 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-66de6d42-27d1-4624-8742-defb813fc135 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1752 microversion: 2.20 time: 0.823896 Jul 25 14:37:23.256836 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1352/2898] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:22 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1752 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:23.262141 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ba669196-ea55-45ac-92b3-01104acf6e38 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:23.263058 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ba669196-ea55-45ac-92b3-01104acf6e38 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:23.276472 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ba669196-ea55-45ac-92b3-01104acf6e38 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:23.277550 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ba669196-ea55-45ac-92b3-01104acf6e38 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:23.278577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ba669196-ea55-45ac-92b3-01104acf6e38 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:23.279231 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ba669196-ea55-45ac-92b3-01104acf6e38 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:23.284413 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:37:23.690191 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4b631a03-280a-4a7c-8d4a-2fcd64dca61e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:23.703529 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4b631a03-280a-4a7c-8d4a-2fcd64dca61e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1509 microversion: 2.1 time: 0.505128 Jul 25 14:37:23.704360 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1547/2899] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:23 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1509 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:23.716464 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5cd6c77e-d27f-4d78-9d6c-d90dd4a9aedf tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:23.719661 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5cd6c77e-d27f-4d78-9d6c-d90dd4a9aedf tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:23.735682 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5cd6c77e-d27f-4d78-9d6c-d90dd4a9aedf tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:23.736348 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5cd6c77e-d27f-4d78-9d6c-d90dd4a9aedf tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:23.740552 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5cd6c77e-d27f-4d78-9d6c-d90dd4a9aedf tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:23.741244 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5cd6c77e-d27f-4d78-9d6c-d90dd4a9aedf tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:23.831238 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ba669196-ea55-45ac-92b3-01104acf6e38 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb708222f6ee4225b1fe18848fb6a1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:23.840373 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ba669196-ea55-45ac-92b3-01104acf6e38 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3" status: 200 len: 1291 microversion: 2.1 time: 0.582035 Jul 25 14:37:23.854359 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1353/2900] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:23 2022] GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 => generated 1291 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:23.860211 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-44a5e0f9-b45f-4a60-b7de-7a0320ecb20c tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:23.861086 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-44a5e0f9-b45f-4a60-b7de-7a0320ecb20c tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:23.869067 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-44a5e0f9-b45f-4a60-b7de-7a0320ecb20c tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:23.869989 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-44a5e0f9-b45f-4a60-b7de-7a0320ecb20c tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:23.871149 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-44a5e0f9-b45f-4a60-b7de-7a0320ecb20c tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:23.871820 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-44a5e0f9-b45f-4a60-b7de-7a0320ecb20c tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:24.555546 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5cd6c77e-d27f-4d78-9d6c-d90dd4a9aedf tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:24.566038 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5cd6c77e-d27f-4d78-9d6c-d90dd4a9aedf tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:24.580668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5cd6c77e-d27f-4d78-9d6c-d90dd4a9aedf tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:24.582432 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5cd6c77e-d27f-4d78-9d6c-d90dd4a9aedf tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 2913 microversion: 2.42 time: 0.875498 Jul 25 14:37:24.583288 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1548/2901] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:23 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 2913 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:24.605358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a0b4e4ba-a263-4f48-aa74-0d11a26275da tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:24.606287 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a0b4e4ba-a263-4f48-aa74-0d11a26275da tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] [instance: 94a61a8f-6d71-42d5-8a25-2dd93b221cc2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:24.613393 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a0b4e4ba-a263-4f48-aa74-0d11a26275da tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:24.614245 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a0b4e4ba-a263-4f48-aa74-0d11a26275da tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:24.615196 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a0b4e4ba-a263-4f48-aa74-0d11a26275da tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:24.615796 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a0b4e4ba-a263-4f48-aa74-0d11a26275da tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:24.988548 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a0b4e4ba-a263-4f48-aa74-0d11a26275da tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b42088e9f64e4bb596ea18ea062f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9560d1222b9b47ca8d8fff3c6a7b634f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:24.997964 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a0b4e4ba-a263-4f48-aa74-0d11a26275da tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2" status: 200 len: 1312 microversion: 2.1 time: 0.413275 Jul 25 14:37:25.012137 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1549/2902] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:24 2022] GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2 => generated 1312 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:25.024690 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6cf0e7da-2a34-4ed7-a7ec-ed5e75f61941 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:25.033007 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6cf0e7da-2a34-4ed7-a7ec-ed5e75f61941 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:25.040444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6cf0e7da-2a34-4ed7-a7ec-ed5e75f61941 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:25.050880 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6cf0e7da-2a34-4ed7-a7ec-ed5e75f61941 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:25.051946 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6cf0e7da-2a34-4ed7-a7ec-ed5e75f61941 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:25.052564 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6cf0e7da-2a34-4ed7-a7ec-ed5e75f61941 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:25.221004 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-44a5e0f9-b45f-4a60-b7de-7a0320ecb20c tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:25.240455 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-44a5e0f9-b45f-4a60-b7de-7a0320ecb20c tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1510 microversion: 2.1 time: 1.381822 Jul 25 14:37:25.244038 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1354/2903] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:23 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1510 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:25.255434 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c03ab8de-160b-43cc-af38-a7d805a77d53 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:25.258767 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c03ab8de-160b-43cc-af38-a7d805a77d53 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:25.279163 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c03ab8de-160b-43cc-af38-a7d805a77d53 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:25.284789 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c03ab8de-160b-43cc-af38-a7d805a77d53 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:25.286194 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c03ab8de-160b-43cc-af38-a7d805a77d53 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:25.286808 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c03ab8de-160b-43cc-af38-a7d805a77d53 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:25.351300 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6cf0e7da-2a34-4ed7-a7ec-ed5e75f61941 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:25.362340 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6cf0e7da-2a34-4ed7-a7ec-ed5e75f61941 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1391 microversion: 2.1 time: 0.348739 Jul 25 14:37:25.377225 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1550/2904] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:25 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1391 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:25.389533 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-82fd268d-2233-4fad-a915-7fcd94cd1c46 req-35e3e579-d8c8-4c77-bc35-3d23559116d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a6128a-580f-4184-ba11-6511d5021242", "name": "network-vif-unplugged", "status": "completed", "tag": "87364f5a-d3ef-46c2-92c5-1fafec0f79e8"}, {"server_uuid": "33a6128a-580f-4184-ba11-6511d5021242", "name": "network-vif-unplugged", "status": "completed", "tag": "a5ecb61b-38f2-4d26-8fa4-777375045f83"}, {"server_uuid": "33a6128a-580f-4184-ba11-6511d5021242", "name": "network-vif-unplugged", "status": "completed", "tag": "47a20d0d-9969-4add-9f4c-b4a79d222111"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:25.420653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-82fd268d-2233-4fad-a915-7fcd94cd1c46 req-35e3e579-d8c8-4c77-bc35-3d23559116d0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:25.421092 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-82fd268d-2233-4fad-a915-7fcd94cd1c46 req-35e3e579-d8c8-4c77-bc35-3d23559116d0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:25.458373 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-82fd268d-2233-4fad-a915-7fcd94cd1c46 req-35e3e579-d8c8-4c77-bc35-3d23559116d0 service nova] Creating event network-vif-unplugged:87364f5a-d3ef-46c2-92c5-1fafec0f79e8 for instance 33a6128a-580f-4184-ba11-6511d5021242 on n-h1-846435-14 Jul 25 14:37:25.458639 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-82fd268d-2233-4fad-a915-7fcd94cd1c46 req-35e3e579-d8c8-4c77-bc35-3d23559116d0 service nova] Creating event network-vif-unplugged:a5ecb61b-38f2-4d26-8fa4-777375045f83 for instance 33a6128a-580f-4184-ba11-6511d5021242 on n-h1-846435-14 Jul 25 14:37:25.459040 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-82fd268d-2233-4fad-a915-7fcd94cd1c46 req-35e3e579-d8c8-4c77-bc35-3d23559116d0 service nova] Creating event network-vif-unplugged:47a20d0d-9969-4add-9f4c-b4a79d222111 for instance 33a6128a-580f-4184-ba11-6511d5021242 on n-h1-846435-14 Jul 25 14:37:25.475749 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-82fd268d-2233-4fad-a915-7fcd94cd1c46 req-35e3e579-d8c8-4c77-bc35-3d23559116d0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.092895 Jul 25 14:37:25.478949 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1551/2905] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:25.486366 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9f11e48d-6bc8-421d-b61c-db7dd80dddd2 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:25.498801 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9f11e48d-6bc8-421d-b61c-db7dd80dddd2 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:25.521008 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f11e48d-6bc8-421d-b61c-db7dd80dddd2 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:25.521775 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f11e48d-6bc8-421d-b61c-db7dd80dddd2 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:25.522762 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f11e48d-6bc8-421d-b61c-db7dd80dddd2 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:25.523357 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f11e48d-6bc8-421d-b61c-db7dd80dddd2 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:25.752018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9f11e48d-6bc8-421d-b61c-db7dd80dddd2 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:25.768842 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9f11e48d-6bc8-421d-b61c-db7dd80dddd2 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1509 microversion: 2.1 time: 0.285457 Jul 25 14:37:25.772494 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1552/2906] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:25 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1509 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:25.801401 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-cbce0444-738a-4772-911e-a843a757b9ad req-9e62426c-b45a-4f55-b40b-ced4de923e36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a6128a-580f-4184-ba11-6511d5021242", "name": "network-vif-deleted", "tag": "a5ecb61b-38f2-4d26-8fa4-777375045f83"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:25.836620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-cbce0444-738a-4772-911e-a843a757b9ad req-9e62426c-b45a-4f55-b40b-ced4de923e36 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:25.837309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-cbce0444-738a-4772-911e-a843a757b9ad req-9e62426c-b45a-4f55-b40b-ced4de923e36 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:25.906094 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-cbce0444-738a-4772-911e-a843a757b9ad req-9e62426c-b45a-4f55-b40b-ced4de923e36 service nova] Creating event network-vif-deleted:a5ecb61b-38f2-4d26-8fa4-777375045f83 for instance 33a6128a-580f-4184-ba11-6511d5021242 on n-h1-846435-14 Jul 25 14:37:25.918623 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-cbce0444-738a-4772-911e-a843a757b9ad req-9e62426c-b45a-4f55-b40b-ced4de923e36 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130321 Jul 25 14:37:25.919269 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1553/2907] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:25.929193 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-04f76d49-185a-4027-acb7-89a4d53e9b43 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:25.930298 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-04f76d49-185a-4027-acb7-89a4d53e9b43 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:25.947857 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-04f76d49-185a-4027-acb7-89a4d53e9b43 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:25.949324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-04f76d49-185a-4027-acb7-89a4d53e9b43 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:25.952762 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-04f76d49-185a-4027-acb7-89a4d53e9b43 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:25.953517 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-04f76d49-185a-4027-acb7-89a4d53e9b43 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:26.107834 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c03ab8de-160b-43cc-af38-a7d805a77d53 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:26.116969 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c03ab8de-160b-43cc-af38-a7d805a77d53 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:26.118897 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c03ab8de-160b-43cc-af38-a7d805a77d53 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:26.119234 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-04f76d49-185a-4027-acb7-89a4d53e9b43 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb708222f6ee4225b1fe18848fb6a1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:26.120879 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c03ab8de-160b-43cc-af38-a7d805a77d53 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1752 microversion: 2.20 time: 0.874580 Jul 25 14:37:26.122113 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1355/2908] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:25 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1752 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:26.126744 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-769038d6-c1bc-49d1-b7f9-1c7222c9824b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:26.127591 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-769038d6-c1bc-49d1-b7f9-1c7222c9824b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:26.134296 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-769038d6-c1bc-49d1-b7f9-1c7222c9824b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:26.135081 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-769038d6-c1bc-49d1-b7f9-1c7222c9824b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:26.136146 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-769038d6-c1bc-49d1-b7f9-1c7222c9824b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:26.136794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-769038d6-c1bc-49d1-b7f9-1c7222c9824b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:26.140466 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-04f76d49-185a-4027-acb7-89a4d53e9b43 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3" status: 200 len: 1291 microversion: 2.1 time: 0.216685 Jul 25 14:37:26.148010 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1554/2909] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:25 2022] GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 => generated 1291 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:26.148010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-9c0211fe-b0e7-4e04-8777-54573b4a2d73 req-f3287596-9286-46bb-95f0-555344097e5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "756ffb6d-8123-4743-97b5-e3153a7fc28e", "name": "network-vif-deleted", "tag": "6fdb0b84-35b3-4673-9dfe-8ceebbbd3e3d"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:26.156822 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-9c0211fe-b0e7-4e04-8777-54573b4a2d73 req-f3287596-9286-46bb-95f0-555344097e5a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:26.156822 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-9c0211fe-b0e7-4e04-8777-54573b4a2d73 req-f3287596-9286-46bb-95f0-555344097e5a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:26.168692 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-9c0211fe-b0e7-4e04-8777-54573b4a2d73 req-f3287596-9286-46bb-95f0-555344097e5a service nova] Creating event network-vif-deleted:6fdb0b84-35b3-4673-9dfe-8ceebbbd3e3d for instance 756ffb6d-8123-4743-97b5-e3153a7fc28e on n-h2-846435-14 Jul 25 14:37:26.175027 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-9c0211fe-b0e7-4e04-8777-54573b4a2d73 req-f3287596-9286-46bb-95f0-555344097e5a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032064 Jul 25 14:37:26.178199 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1555/2910] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:26.183561 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dcbc0a37-e2ec-47b2-826b-33b681574388 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:26.184300 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dcbc0a37-e2ec-47b2-826b-33b681574388 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] [instance: 94a61a8f-6d71-42d5-8a25-2dd93b221cc2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:26.190652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dcbc0a37-e2ec-47b2-826b-33b681574388 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:26.191105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dcbc0a37-e2ec-47b2-826b-33b681574388 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:26.191892 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dcbc0a37-e2ec-47b2-826b-33b681574388 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:26.192363 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dcbc0a37-e2ec-47b2-826b-33b681574388 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:26.356706 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dcbc0a37-e2ec-47b2-826b-33b681574388 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b42088e9f64e4bb596ea18ea062f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9560d1222b9b47ca8d8fff3c6a7b634f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:26.374014 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dcbc0a37-e2ec-47b2-826b-33b681574388 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2" status: 200 len: 1312 microversion: 2.1 time: 0.194379 Jul 25 14:37:26.398079 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1556/2911] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:26 2022] GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2 => generated 1312 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:26.417035 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-35888ec6-fb89-4e16-b4d9-c336bf269d02 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:26.417823 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-35888ec6-fb89-4e16-b4d9-c336bf269d02 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:26.438196 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35888ec6-fb89-4e16-b4d9-c336bf269d02 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:26.438417 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35888ec6-fb89-4e16-b4d9-c336bf269d02 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:26.442461 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35888ec6-fb89-4e16-b4d9-c336bf269d02 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:26.444637 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35888ec6-fb89-4e16-b4d9-c336bf269d02 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:26.489879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:37:26.504809 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35888ec6-fb89-4e16-b4d9-c336bf269d02 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:26.505066 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35888ec6-fb89-4e16-b4d9-c336bf269d02 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:26.505468 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-35888ec6-fb89-4e16-b4d9-c336bf269d02 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lazy-loading 'fault' on Instance uuid 756ffb6d-8123-4743-97b5-e3153a7fc28e {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:37:26.577831 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-35888ec6-fb89-4e16-b4d9-c336bf269d02 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1148d8d49bb94eb497e0c3d867004c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cc39cb570d842d59580e2075f74d50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:26.581605 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-769038d6-c1bc-49d1-b7f9-1c7222c9824b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:26.587592 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-35888ec6-fb89-4e16-b4d9-c336bf269d02 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 200 len: 1313 microversion: 2.1 time: 0.187717 Jul 25 14:37:26.588573 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1557/2912] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:26 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:26.594432 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8f33b27e-bd92-4ba1-af4b-97aed1f2c494 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:26.594846 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8f33b27e-bd92-4ba1-af4b-97aed1f2c494 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:26.608020 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-769038d6-c1bc-49d1-b7f9-1c7222c9824b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:26.610563 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-769038d6-c1bc-49d1-b7f9-1c7222c9824b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:26.612354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f33b27e-bd92-4ba1-af4b-97aed1f2c494 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:26.612825 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f33b27e-bd92-4ba1-af4b-97aed1f2c494 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:26.613624 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f33b27e-bd92-4ba1-af4b-97aed1f2c494 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:26.614062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f33b27e-bd92-4ba1-af4b-97aed1f2c494 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:26.614191 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-769038d6-c1bc-49d1-b7f9-1c7222c9824b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 2867 microversion: 2.42 time: 0.489037 Jul 25 14:37:26.632991 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1356/2913] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:26 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 2867 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:26.800781 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7b8c77a2-4f4d-4d9b-a51e-6de30e803d46 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:26.801513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7b8c77a2-4f4d-4d9b-a51e-6de30e803d46 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:26.812118 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8f33b27e-bd92-4ba1-af4b-97aed1f2c494 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:26.823754 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b8c77a2-4f4d-4d9b-a51e-6de30e803d46 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:26.824267 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b8c77a2-4f4d-4d9b-a51e-6de30e803d46 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:26.827341 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b8c77a2-4f4d-4d9b-a51e-6de30e803d46 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:26.828308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b8c77a2-4f4d-4d9b-a51e-6de30e803d46 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:26.836229 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8f33b27e-bd92-4ba1-af4b-97aed1f2c494 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1391 microversion: 2.1 time: 0.246472 Jul 25 14:37:26.849561 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1558/2914] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:26 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1391 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:27.145901 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-57165345-dc86-4a72-886b-c5a47837498c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:27.147278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-57165345-dc86-4a72-886b-c5a47837498c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:27.155144 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-57165345-dc86-4a72-886b-c5a47837498c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:27.155770 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-57165345-dc86-4a72-886b-c5a47837498c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:27.156725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-57165345-dc86-4a72-886b-c5a47837498c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:27.157319 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-57165345-dc86-4a72-886b-c5a47837498c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:27.402195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-57165345-dc86-4a72-886b-c5a47837498c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:27.412265 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-57165345-dc86-4a72-886b-c5a47837498c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:27.413822 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-57165345-dc86-4a72-886b-c5a47837498c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:27.415447 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-57165345-dc86-4a72-886b-c5a47837498c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1808 microversion: 2.20 time: 0.273455 Jul 25 14:37:27.426834 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7b8c77a2-4f4d-4d9b-a51e-6de30e803d46 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:27.428228 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1559/2915] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:27 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1808 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:37:27.438696 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7b8c77a2-4f4d-4d9b-a51e-6de30e803d46 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1509 microversion: 2.1 time: 0.644092 Jul 25 14:37:27.441030 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-506115be-e549-4d8f-b0a8-e326850783e3 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:27.441845 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-506115be-e549-4d8f-b0a8-e326850783e3 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:27.477706 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1357/2916] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:26 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1509 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:27.484982 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-506115be-e549-4d8f-b0a8-e326850783e3 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:27.485669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-506115be-e549-4d8f-b0a8-e326850783e3 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:27.486448 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-506115be-e549-4d8f-b0a8-e326850783e3 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:27.486875 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-506115be-e549-4d8f-b0a8-e326850783e3 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:27.488235 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-53542a66-6084-478b-b0fc-88be57ee51f1 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:27.488869 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-53542a66-6084-478b-b0fc-88be57ee51f1 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] [instance: 94a61a8f-6d71-42d5-8a25-2dd93b221cc2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:27.506068 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-53542a66-6084-478b-b0fc-88be57ee51f1 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:27.506812 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-53542a66-6084-478b-b0fc-88be57ee51f1 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:27.507821 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-53542a66-6084-478b-b0fc-88be57ee51f1 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:27.508320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-53542a66-6084-478b-b0fc-88be57ee51f1 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:27.717747 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-506115be-e549-4d8f-b0a8-e326850783e3 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb708222f6ee4225b1fe18848fb6a1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:27.727220 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-506115be-e549-4d8f-b0a8-e326850783e3 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3" status: 200 len: 1291 microversion: 2.1 time: 0.291219 Jul 25 14:37:27.736607 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1560/2917] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:27 2022] GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 => generated 1291 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:27.742375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-39048e54-bc7a-443e-b55d-12b098cc03ea req-a42debd9-1287-487a-9fc8-a3c31abd3b8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a6128a-580f-4184-ba11-6511d5021242", "name": "network-vif-unplugged", "status": "completed", "tag": "66751fc0-fec5-4bc6-859a-9a0368452b30"}, {"server_uuid": "9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e", "name": "network-vif-unplugged", "status": "completed", "tag": "53dcf2fd-d803-419e-ac77-4ff7d0c3b117"}, {"server_uuid": "94a61a8f-6d71-42d5-8a25-2dd93b221cc2", "name": "network-vif-plugged", "status": "completed", "tag": "230e08ff-39b2-44ef-a97c-cc8937af2ad1"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:27.760111 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-39048e54-bc7a-443e-b55d-12b098cc03ea req-a42debd9-1287-487a-9fc8-a3c31abd3b8a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:27.760569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-39048e54-bc7a-443e-b55d-12b098cc03ea req-a42debd9-1287-487a-9fc8-a3c31abd3b8a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:27.778216 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-39048e54-bc7a-443e-b55d-12b098cc03ea req-a42debd9-1287-487a-9fc8-a3c31abd3b8a service nova] Creating event network-vif-unplugged:66751fc0-fec5-4bc6-859a-9a0368452b30 for instance 33a6128a-580f-4184-ba11-6511d5021242 on n-h1-846435-14 Jul 25 14:37:27.778819 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-39048e54-bc7a-443e-b55d-12b098cc03ea req-a42debd9-1287-487a-9fc8-a3c31abd3b8a service nova] Creating event network-vif-unplugged:53dcf2fd-d803-419e-ac77-4ff7d0c3b117 for instance 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e on n-h1-846435-14 Jul 25 14:37:27.779455 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-39048e54-bc7a-443e-b55d-12b098cc03ea req-a42debd9-1287-487a-9fc8-a3c31abd3b8a service nova] Creating event network-vif-plugged:230e08ff-39b2-44ef-a97c-cc8937af2ad1 for instance 94a61a8f-6d71-42d5-8a25-2dd93b221cc2 on n-h1-846435-14 Jul 25 14:37:27.789457 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-39048e54-bc7a-443e-b55d-12b098cc03ea req-a42debd9-1287-487a-9fc8-a3c31abd3b8a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 529 microversion: 2.1 time: 0.051407 Jul 25 14:37:27.790188 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1561/2918] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 529 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:27.800406 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-08a3a764-debf-4307-a4bc-1b3b4775aaa4 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:27.801200 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-08a3a764-debf-4307-a4bc-1b3b4775aaa4 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] [instance: 756ffb6d-8123-4743-97b5-e3153a7fc28e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:27.809180 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-08a3a764-debf-4307-a4bc-1b3b4775aaa4 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:27.809646 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-08a3a764-debf-4307-a4bc-1b3b4775aaa4 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:27.810434 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-08a3a764-debf-4307-a4bc-1b3b4775aaa4 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:27.810867 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-08a3a764-debf-4307-a4bc-1b3b4775aaa4 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:27.827202 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-08a3a764-debf-4307-a4bc-1b3b4775aaa4 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] HTTP exception thrown: Instance 756ffb6d-8123-4743-97b5-e3153a7fc28e could not be found. Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-08a3a764-debf-4307-a4bc-1b3b4775aaa4 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Request method failure captured: Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e HTTP/1.1 Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qpOhOs9Z0_3cI2bcGzZrVfK0OXFxKl2qZwAVoPtmpw5yJoKaCMEV_le5F6WcGuuyUAXgtpDXRfQJVdDAy3LrIW1c8i1tSB4laGJTrAjWuSxvsHLwgNyyVCfwbPVzEVuPzQcBFScsYYBwBPMtZ7kciro3BEH_Y1ebIV7jeE2af3AYHQ Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 3cc39cb570d842d59580e2075f74d50d Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-852358764 Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3cc39cb570d842d59580e2075f74d50d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3cc39cb570d842d59580e2075f74d50d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3cc39cb570d842d59580e2075f74d50d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3cc39cb570d842d59580e2075f74d50d"}]}] Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-852358764 Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 3cc39cb570d842d59580e2075f74d50d Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-852358764 Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerRescueTestJSONUnderV235-852358764-project Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 1148d8d49bb94eb497e0c3d867004c33 Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-852358764-project Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 756ffb6d-8123-4743-97b5-e3153a7fc28e could not be found. Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '756ffb6d-8123-4743-97b5-e3153a7fc28e'} Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 756ffb6d-8123-4743-97b5-e3153a7fc28e could not be found. Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 756ffb6d-8123-4743-97b5-e3153a7fc28e could not be found. Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:37:27.829158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:37:27.834238 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:37:27.834238 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:37:27.834238 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:37:27.834238 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:37:27.834238 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:37:27.834238 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:37:27.834238 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 756ffb6d-8123-4743-97b5-e3153a7fc28e could not be found. Jul 25 14:37:27.834238 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:37:27.834238 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-08a3a764-debf-4307-a4bc-1b3b4775aaa4 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] Returning 404 to user: Instance 756ffb6d-8123-4743-97b5-e3153a7fc28e could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:37:27.834238 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-08a3a764-debf-4307-a4bc-1b3b4775aaa4 tempest-ServerRescueTestJSONUnderV235-852358764 tempest-ServerRescueTestJSONUnderV235-852358764-project] 10.222.0.88 "GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e" status: 404 len: 111 microversion: 2.1 time: 0.034792 Jul 25 14:37:27.834238 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1562/2919] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:27 2022] GET /compute/v2.1/servers/756ffb6d-8123-4743-97b5-e3153a7fc28e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:37:27.836277 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8ba7b129-5ece-46b1-8dde-084dc6b94ddf tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:27.837084 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8ba7b129-5ece-46b1-8dde-084dc6b94ddf tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:27.843697 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8ba7b129-5ece-46b1-8dde-084dc6b94ddf tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:27.844183 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8ba7b129-5ece-46b1-8dde-084dc6b94ddf tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:27.844975 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8ba7b129-5ece-46b1-8dde-084dc6b94ddf tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:27.845412 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8ba7b129-5ece-46b1-8dde-084dc6b94ddf tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:27.865163 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-53542a66-6084-478b-b0fc-88be57ee51f1 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b42088e9f64e4bb596ea18ea062f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9560d1222b9b47ca8d8fff3c6a7b634f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:27.882217 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-53542a66-6084-478b-b0fc-88be57ee51f1 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2" status: 200 len: 1312 microversion: 2.1 time: 0.402503 Jul 25 14:37:27.897399 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1358/2920] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:27 2022] GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2 => generated 1312 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:27.903305 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0b283937-a85c-460e-b323-1f0b312fcf8a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:27.904212 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0b283937-a85c-460e-b323-1f0b312fcf8a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:27.911339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b283937-a85c-460e-b323-1f0b312fcf8a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:27.912050 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b283937-a85c-460e-b323-1f0b312fcf8a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:27.913024 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b283937-a85c-460e-b323-1f0b312fcf8a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:27.913632 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b283937-a85c-460e-b323-1f0b312fcf8a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:28.161067 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8ba7b129-5ece-46b1-8dde-084dc6b94ddf tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:28.176284 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8ba7b129-5ece-46b1-8dde-084dc6b94ddf tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:28.178853 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8ba7b129-5ece-46b1-8dde-084dc6b94ddf tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:28.180511 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8ba7b129-5ece-46b1-8dde-084dc6b94ddf tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 2707 microversion: 2.42 time: 0.348052 Jul 25 14:37:28.181818 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1563/2921] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:27 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 2707 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:28.187146 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-895e4c8c-10a8-4ca3-b746-b7b9fe99efc0 req-bde20f43-48d0-47c8-b799-fd7402cf2f60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e", "name": "network-vif-unplugged", "status": "completed", "tag": "53dcf2fd-d803-419e-ac77-4ff7d0c3b117"}, {"server_uuid": "33a6128a-580f-4184-ba11-6511d5021242", "name": "network-vif-deleted", "tag": "87364f5a-d3ef-46c2-92c5-1fafec0f79e8"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:28.200012 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-895e4c8c-10a8-4ca3-b746-b7b9fe99efc0 req-bde20f43-48d0-47c8-b799-fd7402cf2f60 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:28.201628 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-895e4c8c-10a8-4ca3-b746-b7b9fe99efc0 req-bde20f43-48d0-47c8-b799-fd7402cf2f60 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:28.222404 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-895e4c8c-10a8-4ca3-b746-b7b9fe99efc0 req-bde20f43-48d0-47c8-b799-fd7402cf2f60 service nova] Creating event network-vif-unplugged:53dcf2fd-d803-419e-ac77-4ff7d0c3b117 for instance 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e on n-h1-846435-14 Jul 25 14:37:28.223263 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-895e4c8c-10a8-4ca3-b746-b7b9fe99efc0 req-bde20f43-48d0-47c8-b799-fd7402cf2f60 service nova] Creating event network-vif-deleted:87364f5a-d3ef-46c2-92c5-1fafec0f79e8 for instance 33a6128a-580f-4184-ba11-6511d5021242 on n-h1-846435-14 Jul 25 14:37:28.243564 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-895e4c8c-10a8-4ca3-b746-b7b9fe99efc0 req-bde20f43-48d0-47c8-b799-fd7402cf2f60 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.060223 Jul 25 14:37:28.246957 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1564/2922] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:28.412315 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0b283937-a85c-460e-b323-1f0b312fcf8a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:28.437554 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0b283937-a85c-460e-b323-1f0b312fcf8a tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1391 microversion: 2.1 time: 0.538517 Jul 25 14:37:28.438602 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1359/2923] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:27 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1391 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:28.445736 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0423d59b-5080-4164-8869-6b819da9e150 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:28.446576 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0423d59b-5080-4164-8869-6b819da9e150 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:28.462486 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0423d59b-5080-4164-8869-6b819da9e150 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:28.462970 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0423d59b-5080-4164-8869-6b819da9e150 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:28.463767 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0423d59b-5080-4164-8869-6b819da9e150 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:28.464230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0423d59b-5080-4164-8869-6b819da9e150 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:28.491526 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6c780149-c2bb-4900-a866-6c85c3154e97 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:28.492178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6c780149-c2bb-4900-a866-6c85c3154e97 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:28.503053 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6c780149-c2bb-4900-a866-6c85c3154e97 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:28.503514 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6c780149-c2bb-4900-a866-6c85c3154e97 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:28.504329 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6c780149-c2bb-4900-a866-6c85c3154e97 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:28.510170 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6c780149-c2bb-4900-a866-6c85c3154e97 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:28.679289 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0423d59b-5080-4164-8869-6b819da9e150 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:28.692756 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0423d59b-5080-4164-8869-6b819da9e150 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:28.694173 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0423d59b-5080-4164-8869-6b819da9e150 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:28.695369 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0423d59b-5080-4164-8869-6b819da9e150 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1808 microversion: 2.20 time: 0.254503 Jul 25 14:37:28.709380 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1565/2924] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:28 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1808 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:28.758602 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0f437782-f7f3-48b1-91bf-8bd1a77c1a24 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:28.764130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0f437782-f7f3-48b1-91bf-8bd1a77c1a24 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:28.772687 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0f437782-f7f3-48b1-91bf-8bd1a77c1a24 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:28.773486 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0f437782-f7f3-48b1-91bf-8bd1a77c1a24 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:28.775341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0f437782-f7f3-48b1-91bf-8bd1a77c1a24 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:28.776039 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0f437782-f7f3-48b1-91bf-8bd1a77c1a24 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:28.870180 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6c780149-c2bb-4900-a866-6c85c3154e97 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:28.881600 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6c780149-c2bb-4900-a866-6c85c3154e97 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1515 microversion: 2.1 time: 0.394386 Jul 25 14:37:28.882393 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1360/2925] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:28 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1515 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:28.910922 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ee14ddc6-a9dc-435c-90e7-6c7353934b24 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:28.911550 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ee14ddc6-a9dc-435c-90e7-6c7353934b24 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] [instance: 94a61a8f-6d71-42d5-8a25-2dd93b221cc2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:28.918230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee14ddc6-a9dc-435c-90e7-6c7353934b24 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:28.918905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee14ddc6-a9dc-435c-90e7-6c7353934b24 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:28.920133 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee14ddc6-a9dc-435c-90e7-6c7353934b24 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:28.920645 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee14ddc6-a9dc-435c-90e7-6c7353934b24 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:29.627633 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0f437782-f7f3-48b1-91bf-8bd1a77c1a24 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb708222f6ee4225b1fe18848fb6a1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:29.637364 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0f437782-f7f3-48b1-91bf-8bd1a77c1a24 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3" status: 200 len: 1291 microversion: 2.1 time: 0.882916 Jul 25 14:37:29.657818 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1566/2926] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:28 2022] GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 => generated 1291 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:37:29.672799 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-85609efa-6d25-4e12-a983-38d4e9cb6613 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:29.674571 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-85609efa-6d25-4e12-a983-38d4e9cb6613 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:29.684483 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-85609efa-6d25-4e12-a983-38d4e9cb6613 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:29.688588 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-85609efa-6d25-4e12-a983-38d4e9cb6613 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:29.689828 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-85609efa-6d25-4e12-a983-38d4e9cb6613 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:29.690517 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-85609efa-6d25-4e12-a983-38d4e9cb6613 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:29.708316 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ee14ddc6-a9dc-435c-90e7-6c7353934b24 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b42088e9f64e4bb596ea18ea062f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9560d1222b9b47ca8d8fff3c6a7b634f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:29.730869 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ee14ddc6-a9dc-435c-90e7-6c7353934b24 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2" status: 200 len: 1312 microversion: 2.1 time: 0.822831 Jul 25 14:37:29.746219 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1361/2927] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:28 2022] GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2 => generated 1312 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:29.760222 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6bd8c8aa-8fbb-4ff6-85b1-497994b92362 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:29.765614 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6bd8c8aa-8fbb-4ff6-85b1-497994b92362 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:29.781936 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6bd8c8aa-8fbb-4ff6-85b1-497994b92362 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:29.783779 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6bd8c8aa-8fbb-4ff6-85b1-497994b92362 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:29.784854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6bd8c8aa-8fbb-4ff6-85b1-497994b92362 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:29.789104 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6bd8c8aa-8fbb-4ff6-85b1-497994b92362 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:29.983719 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-85609efa-6d25-4e12-a983-38d4e9cb6613 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:29.996848 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-85609efa-6d25-4e12-a983-38d4e9cb6613 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:30.001856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-85609efa-6d25-4e12-a983-38d4e9cb6613 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:30.005438 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-85609efa-6d25-4e12-a983-38d4e9cb6613 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 2547 microversion: 2.42 time: 0.346273 Jul 25 14:37:30.006907 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1567/2928] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:29 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 2547 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:30.016034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cce35e27-7fd3-4dae-a3a8-521d49ea3a9d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:30.016921 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cce35e27-7fd3-4dae-a3a8-521d49ea3a9d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:30.026643 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cce35e27-7fd3-4dae-a3a8-521d49ea3a9d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:30.028996 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cce35e27-7fd3-4dae-a3a8-521d49ea3a9d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:30.029846 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cce35e27-7fd3-4dae-a3a8-521d49ea3a9d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:30.044661 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cce35e27-7fd3-4dae-a3a8-521d49ea3a9d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:30.052102 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6bd8c8aa-8fbb-4ff6-85b1-497994b92362 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:30.060412 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6bd8c8aa-8fbb-4ff6-85b1-497994b92362 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1381 microversion: 2.1 time: 0.307966 Jul 25 14:37:30.077740 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1362/2929] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:29 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1381 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:30.089075 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-66f32238-f725-4a0a-ada4-896123f6209a req-9848ddaf-2f5e-47fe-a840-b4ca3f601942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3", "name": "network-vif-plugged", "status": "completed", "tag": "24058dbf-0bb6-4f6e-8912-6077d722be00"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:30.115375 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-66f32238-f725-4a0a-ada4-896123f6209a req-9848ddaf-2f5e-47fe-a840-b4ca3f601942 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:30.115819 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-66f32238-f725-4a0a-ada4-896123f6209a req-9848ddaf-2f5e-47fe-a840-b4ca3f601942 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:30.146064 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-66f32238-f725-4a0a-ada4-896123f6209a req-9848ddaf-2f5e-47fe-a840-b4ca3f601942 service nova] Creating event network-vif-plugged:24058dbf-0bb6-4f6e-8912-6077d722be00 for instance fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 on n-h2-846435-14 Jul 25 14:37:30.156997 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-66f32238-f725-4a0a-ada4-896123f6209a req-9848ddaf-2f5e-47fe-a840-b4ca3f601942 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077820 Jul 25 14:37:30.169237 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1363/2930] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:30.175899 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ec674553-a866-401d-9d5d-74cb1ba97ade tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Calling method '.version_select at 0x7f4686ba7d30>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:30.188075 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec674553-a866-401d-9d5d-74cb1ba97ade tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:30.189205 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec674553-a866-401d-9d5d-74cb1ba97ade tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:30.203101 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ec674553-a866-401d-9d5d-74cb1ba97ade tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] 10.222.0.88 "GET /compute/v2.1/os-migrations" status: 200 len: 1568 microversion: 2.1 time: 0.032168 Jul 25 14:37:30.212935 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1364/2931] 10.222.0.88 () {58 vars in 1143 bytes} [Mon Jul 25 14:37:30 2022] GET /compute/v2.1/os-migrations => generated 1568 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:30.227249 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-35010f6f-60ee-40e7-af90-f1c708a1c755 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:30.228467 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-35010f6f-60ee-40e7-af90-f1c708a1c755 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:30.240096 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-35010f6f-60ee-40e7-af90-f1c708a1c755 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:30.244624 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-35010f6f-60ee-40e7-af90-f1c708a1c755 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:30.245819 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-35010f6f-60ee-40e7-af90-f1c708a1c755 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:30.246477 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-35010f6f-60ee-40e7-af90-f1c708a1c755 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:30.562869 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cce35e27-7fd3-4dae-a3a8-521d49ea3a9d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:30.577412 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cce35e27-7fd3-4dae-a3a8-521d49ea3a9d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:30.578941 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cce35e27-7fd3-4dae-a3a8-521d49ea3a9d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:30.584384 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cce35e27-7fd3-4dae-a3a8-521d49ea3a9d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1808 microversion: 2.20 time: 0.572191 Jul 25 14:37:30.585310 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1568/2932] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:30 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1808 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:30.594905 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-81544d1e-8920-4eb1-bdda-455cbe3ca7f3 req-ba81c832-5d30-421f-a1fa-76589999ae5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a6128a-580f-4184-ba11-6511d5021242", "name": "network-vif-deleted", "tag": "47a20d0d-9969-4add-9f4c-b4a79d222111"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:30.615560 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-81544d1e-8920-4eb1-bdda-455cbe3ca7f3 req-ba81c832-5d30-421f-a1fa-76589999ae5b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:30.623805 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-81544d1e-8920-4eb1-bdda-455cbe3ca7f3 req-ba81c832-5d30-421f-a1fa-76589999ae5b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:30.648587 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-81544d1e-8920-4eb1-bdda-455cbe3ca7f3 req-ba81c832-5d30-421f-a1fa-76589999ae5b service nova] Creating event network-vif-deleted:47a20d0d-9969-4add-9f4c-b4a79d222111 for instance 33a6128a-580f-4184-ba11-6511d5021242 on n-h1-846435-14 Jul 25 14:37:30.657329 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-81544d1e-8920-4eb1-bdda-455cbe3ca7f3 req-ba81c832-5d30-421f-a1fa-76589999ae5b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070640 Jul 25 14:37:30.659002 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1569/2933] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:30.665882 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-be20beee-07d6-43e4-8f44-2cbcb0842137 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:30.667049 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-be20beee-07d6-43e4-8f44-2cbcb0842137 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:30.674598 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be20beee-07d6-43e4-8f44-2cbcb0842137 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:30.675592 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be20beee-07d6-43e4-8f44-2cbcb0842137 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:30.676902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be20beee-07d6-43e4-8f44-2cbcb0842137 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:30.677539 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be20beee-07d6-43e4-8f44-2cbcb0842137 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:30.757746 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-35010f6f-60ee-40e7-af90-f1c708a1c755 tempest-LiveMigrationTest-1181434821 tempest-LiveMigrationTest-1181434821-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1534 microversion: 2.1 time: 0.526438 Jul 25 14:37:30.773064 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1365/2934] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:30 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1534 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:37:30.790082 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0ec86f9f-df7c-456e-ab90-65fa337fce51 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:30.794025 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0ec86f9f-df7c-456e-ab90-65fa337fce51 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] [instance: 94a61a8f-6d71-42d5-8a25-2dd93b221cc2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:30.818089 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0ec86f9f-df7c-456e-ab90-65fa337fce51 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:30.819515 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0ec86f9f-df7c-456e-ab90-65fa337fce51 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:30.821523 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0ec86f9f-df7c-456e-ab90-65fa337fce51 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:30.827087 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0ec86f9f-df7c-456e-ab90-65fa337fce51 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:31.394041 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-be20beee-07d6-43e4-8f44-2cbcb0842137 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb708222f6ee4225b1fe18848fb6a1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:31.416483 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0ec86f9f-df7c-456e-ab90-65fa337fce51 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b42088e9f64e4bb596ea18ea062f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9560d1222b9b47ca8d8fff3c6a7b634f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:31.427419 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0ec86f9f-df7c-456e-ab90-65fa337fce51 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2" status: 200 len: 1498 microversion: 2.1 time: 0.652626 Jul 25 14:37:31.442676 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-be20beee-07d6-43e4-8f44-2cbcb0842137 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3" status: 200 len: 1291 microversion: 2.1 time: 0.777191 Jul 25 14:37:31.446404 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1570/2935] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:30 2022] GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 => generated 1291 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:31.450857 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1366/2936] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:30 2022] GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2 => generated 1498 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:31.469106 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4813c335-ff5b-4411-9aa0-f3ff9d8f1568 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:31.470264 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4813c335-ff5b-4411-9aa0-f3ff9d8f1568 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:31.471321 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-75e7c18e-9bc2-4e74-9581-90b60481f249 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:31.472196 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-75e7c18e-9bc2-4e74-9581-90b60481f249 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:31.484574 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4813c335-ff5b-4411-9aa0-f3ff9d8f1568 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:31.487954 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4813c335-ff5b-4411-9aa0-f3ff9d8f1568 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:31.491495 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4813c335-ff5b-4411-9aa0-f3ff9d8f1568 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:31.492186 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4813c335-ff5b-4411-9aa0-f3ff9d8f1568 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:31.505143 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75e7c18e-9bc2-4e74-9581-90b60481f249 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:31.505599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75e7c18e-9bc2-4e74-9581-90b60481f249 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:31.506381 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75e7c18e-9bc2-4e74-9581-90b60481f249 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:31.506810 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75e7c18e-9bc2-4e74-9581-90b60481f249 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:31.577824 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-75e7c18e-9bc2-4e74-9581-90b60481f249 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:37:31.772034 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-75e7c18e-9bc2-4e74-9581-90b60481f249 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "DELETE /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 204 len: 0 microversion: 2.1 time: 0.323918 Jul 25 14:37:31.776735 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1571/2937] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:37:31 2022] DELETE /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:37:31.793554 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-933c04b3-a2b5-4326-8412-b3de845eb18e tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:31.837521 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.compute.server_groups [None req-933c04b3-a2b5-4326-8412-b3de845eb18e tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Querying cell cadb07ed-5464-41eb-afb8-bf9dd92401b6(cell1) for 1 instances {{(pid=119304) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 25 14:37:31.838156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-933c04b3-a2b5-4326-8412-b3de845eb18e tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:31.852389 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-933c04b3-a2b5-4326-8412-b3de845eb18e tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:31.893340 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-933c04b3-a2b5-4326-8412-b3de845eb18e tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "GET /compute/v2.1/os-server-groups/d1b25a11-6a66-4490-b6f0-cf6692572970" status: 200 len: 222 microversion: 2.1 time: 0.113012 Jul 25 14:37:31.905013 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1572/2938] 10.222.0.88 () {58 vars in 1263 bytes} [Mon Jul 25 14:37:31 2022] GET /compute/v2.1/os-server-groups/d1b25a11-6a66-4490-b6f0-cf6692572970 => generated 222 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:31.923505 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c6d9c3cd-ea87-4872-beaa-bfbcc75a3a0c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Action: 'create', calling method: .version_select at 0x7f468657b940>, body: {"keypair": {"name": "tempest-keypair-792019371", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSJtpuJ3oMEeJ7XwbIzi7rHYEcmaaNOgw/m3Uok965LJ19aze80uDAMmPdyCi6emCWDY50ZonFbqTSGwQXhDEXqCvE0/KsLDAbV6Hhl3P9gAKZdGwP2VrPHhtdW0KpjPQ=="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:31.973894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-c6d9c3cd-ea87-4872-beaa-bfbcc75a3a0c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Getting quotas for project 2f1bd935e917484799f31ad643eafb2a. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:37:31.989632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-c6d9c3cd-ea87-4872-beaa-bfbcc75a3a0c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Getting quotas for user 9f2ddec1bc6244739e9ac3a40c064b53 and project 2f1bd935e917484799f31ad643eafb2a. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:37:32.057307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4813c335-ff5b-4411-9aa0-f3ff9d8f1568 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:32.074795 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c6d9c3cd-ea87-4872-beaa-bfbcc75a3a0c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.168238 Jul 25 14:37:32.085160 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1573/2939] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:37:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:32.087201 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4813c335-ff5b-4411-9aa0-f3ff9d8f1568 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:32.092150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8f435973-5a3d-4cd4-80fb-06b61a7adc86 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:32.093163 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8f435973-5a3d-4cd4-80fb-06b61a7adc86 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:32.095475 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4813c335-ff5b-4411-9aa0-f3ff9d8f1568 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:32.099303 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4813c335-ff5b-4411-9aa0-f3ff9d8f1568 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 2388 microversion: 2.42 time: 0.647098 Jul 25 14:37:32.099880 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1367/2940] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:31 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 2388 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:32.101413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f435973-5a3d-4cd4-80fb-06b61a7adc86 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:32.102587 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f435973-5a3d-4cd4-80fb-06b61a7adc86 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:32.104022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f435973-5a3d-4cd4-80fb-06b61a7adc86 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:32.104675 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f435973-5a3d-4cd4-80fb-06b61a7adc86 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:32.105569 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c28e458a-bbd6-43d2-ae00-ed35ca698a4b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:32.106233 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c28e458a-bbd6-43d2-ae00-ed35ca698a4b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:32.138064 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c28e458a-bbd6-43d2-ae00-ed35ca698a4b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:32.145658 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c28e458a-bbd6-43d2-ae00-ed35ca698a4b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:32.150325 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c28e458a-bbd6-43d2-ae00-ed35ca698a4b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:32.150988 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c28e458a-bbd6-43d2-ae00-ed35ca698a4b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:32.466749 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8f435973-5a3d-4cd4-80fb-06b61a7adc86 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:32.492104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8f435973-5a3d-4cd4-80fb-06b61a7adc86 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:32.494979 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8f435973-5a3d-4cd4-80fb-06b61a7adc86 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:32.496549 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8f435973-5a3d-4cd4-80fb-06b61a7adc86 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1808 microversion: 2.20 time: 0.408958 Jul 25 14:37:32.500392 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1574/2941] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:32 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1808 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:32.511079 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2ff8979d-27e4-446a-9564-537c9cfc57f1 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:32.511622 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2ff8979d-27e4-446a-9564-537c9cfc57f1 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] [instance: 94a61a8f-6d71-42d5-8a25-2dd93b221cc2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:32.528869 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:37:32.538983 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2ff8979d-27e4-446a-9564-537c9cfc57f1 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:32.542715 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2ff8979d-27e4-446a-9564-537c9cfc57f1 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:32.546022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2ff8979d-27e4-446a-9564-537c9cfc57f1 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:32.548428 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2ff8979d-27e4-446a-9564-537c9cfc57f1 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:32.624556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2ff8979d-27e4-446a-9564-537c9cfc57f1 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] [instance: 94a61a8f-6d71-42d5-8a25-2dd93b221cc2] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:37:32.680600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:37:32.870377 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c28e458a-bbd6-43d2-ae00-ed35ca698a4b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:32.881644 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2ff8979d-27e4-446a-9564-537c9cfc57f1 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "DELETE /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2" status: 204 len: 0 microversion: 2.1 time: 0.378375 Jul 25 14:37:32.894299 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1575/2942] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:37:32 2022] DELETE /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:37:32.900736 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c28e458a-bbd6-43d2-ae00-ed35ca698a4b tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1387 microversion: 2.1 time: 0.797860 Jul 25 14:37:32.902204 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1368/2943] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:32 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1387 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:32.917082 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-7af7f2f2-391c-42d3-9287-ff66ad227fb8 req-9a4f7b17-aea6-42c2-9a12-1f0a8498c7d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a6128a-580f-4184-ba11-6511d5021242", "name": "network-vif-deleted", "tag": "117e3c70-2257-4ddb-af6d-4e75db8fcb77"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:32.928838 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c9124b2d-0cac-4bdd-b7c2-be202aa1bca3 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:32.930271 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c9124b2d-0cac-4bdd-b7c2-be202aa1bca3 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:32.944021 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-7af7f2f2-391c-42d3-9287-ff66ad227fb8 req-9a4f7b17-aea6-42c2-9a12-1f0a8498c7d8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:32.948508 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-7af7f2f2-391c-42d3-9287-ff66ad227fb8 req-9a4f7b17-aea6-42c2-9a12-1f0a8498c7d8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:32.956556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c9124b2d-0cac-4bdd-b7c2-be202aa1bca3 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:32.957387 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c9124b2d-0cac-4bdd-b7c2-be202aa1bca3 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:32.958490 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c9124b2d-0cac-4bdd-b7c2-be202aa1bca3 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:32.959109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c9124b2d-0cac-4bdd-b7c2-be202aa1bca3 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:32.987671 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-7af7f2f2-391c-42d3-9287-ff66ad227fb8 req-9a4f7b17-aea6-42c2-9a12-1f0a8498c7d8 service nova] Creating event network-vif-deleted:117e3c70-2257-4ddb-af6d-4e75db8fcb77 for instance 33a6128a-580f-4184-ba11-6511d5021242 on n-h1-846435-14 Jul 25 14:37:32.999005 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-7af7f2f2-391c-42d3-9287-ff66ad227fb8 req-9a4f7b17-aea6-42c2-9a12-1f0a8498c7d8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094097 Jul 25 14:37:33.002588 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1369/2944] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:33.018623 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8c950f7a-a298-41c4-acb1-219c8f6138b7 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:33.021495 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8c950f7a-a298-41c4-acb1-219c8f6138b7 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] [instance: 94a61a8f-6d71-42d5-8a25-2dd93b221cc2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:33.036762 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8c950f7a-a298-41c4-acb1-219c8f6138b7 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:33.038672 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8c950f7a-a298-41c4-acb1-219c8f6138b7 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:33.042131 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8c950f7a-a298-41c4-acb1-219c8f6138b7 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:33.042782 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8c950f7a-a298-41c4-acb1-219c8f6138b7 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:33.404642 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c9124b2d-0cac-4bdd-b7c2-be202aa1bca3 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb708222f6ee4225b1fe18848fb6a1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:33.430874 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c9124b2d-0cac-4bdd-b7c2-be202aa1bca3 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3" status: 200 len: 1291 microversion: 2.1 time: 0.533077 Jul 25 14:37:33.432551 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1576/2945] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:32 2022] GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 => generated 1291 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:33.456224 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-60acb6fd-817a-424b-83fb-a6e5971c334b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:33.457127 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-60acb6fd-817a-424b-83fb-a6e5971c334b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:33.473500 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60acb6fd-817a-424b-83fb-a6e5971c334b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:33.478693 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60acb6fd-817a-424b-83fb-a6e5971c334b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:33.479757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60acb6fd-817a-424b-83fb-a6e5971c334b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:33.482852 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60acb6fd-817a-424b-83fb-a6e5971c334b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:33.675320 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-60acb6fd-817a-424b-83fb-a6e5971c334b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:33.696388 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-60acb6fd-817a-424b-83fb-a6e5971c334b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:33.707074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-60acb6fd-817a-424b-83fb-a6e5971c334b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:33.708989 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-60acb6fd-817a-424b-83fb-a6e5971c334b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 2321 microversion: 2.42 time: 0.269291 Jul 25 14:37:33.710000 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1577/2946] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:33 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 2321 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:33.715491 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-315ff406-cb57-4ec2-89b8-08928a8e2e17 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:33.720705 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-315ff406-cb57-4ec2-89b8-08928a8e2e17 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:33.740606 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-315ff406-cb57-4ec2-89b8-08928a8e2e17 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:33.741372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-315ff406-cb57-4ec2-89b8-08928a8e2e17 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:33.744735 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-315ff406-cb57-4ec2-89b8-08928a8e2e17 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:33.745416 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-315ff406-cb57-4ec2-89b8-08928a8e2e17 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:33.791784 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8c950f7a-a298-41c4-acb1-219c8f6138b7 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b42088e9f64e4bb596ea18ea062f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9560d1222b9b47ca8d8fff3c6a7b634f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:33.834343 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8c950f7a-a298-41c4-acb1-219c8f6138b7 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2" status: 200 len: 1504 microversion: 2.1 time: 0.827563 Jul 25 14:37:33.834891 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1370/2947] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:33 2022] GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2 => generated 1504 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:33.923287 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-beac3f33-e7b2-46db-8c2b-10a2fa3c4506 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:33.924045 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-beac3f33-e7b2-46db-8c2b-10a2fa3c4506 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:33.935295 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-beac3f33-e7b2-46db-8c2b-10a2fa3c4506 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:33.935756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-beac3f33-e7b2-46db-8c2b-10a2fa3c4506 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:33.936587 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-beac3f33-e7b2-46db-8c2b-10a2fa3c4506 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:33.937023 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-beac3f33-e7b2-46db-8c2b-10a2fa3c4506 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:34.204661 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-315ff406-cb57-4ec2-89b8-08928a8e2e17 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:34.242595 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-315ff406-cb57-4ec2-89b8-08928a8e2e17 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:34.244647 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-315ff406-cb57-4ec2-89b8-08928a8e2e17 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:34.247784 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-315ff406-cb57-4ec2-89b8-08928a8e2e17 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1808 microversion: 2.20 time: 0.536648 Jul 25 14:37:34.260685 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1578/2948] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:33 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1808 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:34.292671 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-beac3f33-e7b2-46db-8c2b-10a2fa3c4506 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:34.303000 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:37:34.307079 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-beac3f33-e7b2-46db-8c2b-10a2fa3c4506 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1387 microversion: 2.1 time: 0.387705 Jul 25 14:37:34.307963 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1371/2949] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:33 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1387 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:37:34.461539 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e22880cf-6323-4d1d-942f-bef76c3667b7 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:34.462251 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e22880cf-6323-4d1d-942f-bef76c3667b7 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:34.472059 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e22880cf-6323-4d1d-942f-bef76c3667b7 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:34.472690 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e22880cf-6323-4d1d-942f-bef76c3667b7 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:34.475274 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e22880cf-6323-4d1d-942f-bef76c3667b7 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:34.475854 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e22880cf-6323-4d1d-942f-bef76c3667b7 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:34.739424 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e67c36c5-dc34-459a-883e-6351e1b30f0d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:34.740714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e67c36c5-dc34-459a-883e-6351e1b30f0d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:34.752923 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e67c36c5-dc34-459a-883e-6351e1b30f0d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:34.753865 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e67c36c5-dc34-459a-883e-6351e1b30f0d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:34.755457 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e67c36c5-dc34-459a-883e-6351e1b30f0d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:34.756580 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e67c36c5-dc34-459a-883e-6351e1b30f0d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:34.871241 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e22880cf-6323-4d1d-942f-bef76c3667b7 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb708222f6ee4225b1fe18848fb6a1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:34.879611 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e22880cf-6323-4d1d-942f-bef76c3667b7 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3" status: 200 len: 1291 microversion: 2.1 time: 0.428941 Jul 25 14:37:34.884597 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1579/2950] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:34 2022] GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 => generated 1291 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:34.901408 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8d338701-496a-4235-a5d5-eb607076b508 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:34.902321 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8d338701-496a-4235-a5d5-eb607076b508 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] [instance: 94a61a8f-6d71-42d5-8a25-2dd93b221cc2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:34.917873 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d338701-496a-4235-a5d5-eb607076b508 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:34.920533 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d338701-496a-4235-a5d5-eb607076b508 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:34.924151 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d338701-496a-4235-a5d5-eb607076b508 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:34.930508 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d338701-496a-4235-a5d5-eb607076b508 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:34.930644 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e67c36c5-dc34-459a-883e-6351e1b30f0d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:34.948418 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e67c36c5-dc34-459a-883e-6351e1b30f0d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:34.950368 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e67c36c5-dc34-459a-883e-6351e1b30f0d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:34.958316 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e67c36c5-dc34-459a-883e-6351e1b30f0d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1604 microversion: 2.42 time: 0.223443 Jul 25 14:37:34.972575 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1372/2951] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:34 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1604 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:37:35.096418 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-71c235ed-dc81-44ed-b887-3408b56a1d38 req-b7c71c41-6056-4a4c-b6b8-089982396861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a6128a-580f-4184-ba11-6511d5021242", "name": "network-vif-deleted", "tag": "66751fc0-fec5-4bc6-859a-9a0368452b30"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:35.114338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-71c235ed-dc81-44ed-b887-3408b56a1d38 req-b7c71c41-6056-4a4c-b6b8-089982396861 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:35.114798 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-71c235ed-dc81-44ed-b887-3408b56a1d38 req-b7c71c41-6056-4a4c-b6b8-089982396861 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:35.154992 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-71c235ed-dc81-44ed-b887-3408b56a1d38 req-b7c71c41-6056-4a4c-b6b8-089982396861 service nova] Creating event network-vif-deleted:66751fc0-fec5-4bc6-859a-9a0368452b30 for instance 33a6128a-580f-4184-ba11-6511d5021242 on n-h1-846435-14 Jul 25 14:37:35.160858 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-71c235ed-dc81-44ed-b887-3408b56a1d38 req-b7c71c41-6056-4a4c-b6b8-089982396861 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068327 Jul 25 14:37:35.162127 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1373/2952] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:37:35.275752 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c6e67a19-8d18-4593-9d37-7053291f6363 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:35.276844 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c6e67a19-8d18-4593-9d37-7053291f6363 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:35.279330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8d338701-496a-4235-a5d5-eb607076b508 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b42088e9f64e4bb596ea18ea062f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9560d1222b9b47ca8d8fff3c6a7b634f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:35.288867 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8d338701-496a-4235-a5d5-eb607076b508 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2" status: 200 len: 1504 microversion: 2.1 time: 0.402835 Jul 25 14:37:35.290349 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c6e67a19-8d18-4593-9d37-7053291f6363 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:35.293039 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1580/2953] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:34 2022] GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2 => generated 1504 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:35.304819 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c6e67a19-8d18-4593-9d37-7053291f6363 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:35.306384 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c6e67a19-8d18-4593-9d37-7053291f6363 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:35.310614 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c6e67a19-8d18-4593-9d37-7053291f6363 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:35.342740 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b212ecaf-3a1e-40ec-8f9c-b52747a53fbc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:35.343925 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b212ecaf-3a1e-40ec-8f9c-b52747a53fbc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:35.357427 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b212ecaf-3a1e-40ec-8f9c-b52747a53fbc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:35.364682 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b212ecaf-3a1e-40ec-8f9c-b52747a53fbc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:35.365691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b212ecaf-3a1e-40ec-8f9c-b52747a53fbc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:35.366139 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b212ecaf-3a1e-40ec-8f9c-b52747a53fbc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:35.867363 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c6e67a19-8d18-4593-9d37-7053291f6363 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:35.879132 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c6e67a19-8d18-4593-9d37-7053291f6363 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:35.884775 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c6e67a19-8d18-4593-9d37-7053291f6363 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:35.889266 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c6e67a19-8d18-4593-9d37-7053291f6363 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1808 microversion: 2.20 time: 0.618850 Jul 25 14:37:35.893176 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1374/2954] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:35 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1808 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:35.915662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ff70974b-d22a-4569-9413-1e86a6550fb9 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:35.916632 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ff70974b-d22a-4569-9413-1e86a6550fb9 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:35.924095 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ff70974b-d22a-4569-9413-1e86a6550fb9 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:35.924836 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ff70974b-d22a-4569-9413-1e86a6550fb9 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:35.925970 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ff70974b-d22a-4569-9413-1e86a6550fb9 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:35.928170 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ff70974b-d22a-4569-9413-1e86a6550fb9 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:36.004593 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b212ecaf-3a1e-40ec-8f9c-b52747a53fbc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:36.038013 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b212ecaf-3a1e-40ec-8f9c-b52747a53fbc tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1387 microversion: 2.1 time: 0.709616 Jul 25 14:37:36.045015 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1581/2955] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:35 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1387 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:36.071517 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-62a78553-ee91-4033-a988-0565a5601b96 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:36.075105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-62a78553-ee91-4033-a988-0565a5601b96 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:36.092967 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-62a78553-ee91-4033-a988-0565a5601b96 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:36.093887 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-62a78553-ee91-4033-a988-0565a5601b96 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:36.095806 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-62a78553-ee91-4033-a988-0565a5601b96 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:36.097244 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-62a78553-ee91-4033-a988-0565a5601b96 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:36.220182 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ff70974b-d22a-4569-9413-1e86a6550fb9 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb708222f6ee4225b1fe18848fb6a1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:36.239480 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ff70974b-d22a-4569-9413-1e86a6550fb9 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3" status: 200 len: 1291 microversion: 2.1 time: 0.329941 Jul 25 14:37:36.240406 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1375/2956] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:35 2022] GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 => generated 1291 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:36.323263 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9e601425-4ff0-418d-baeb-b59f9fa0798d tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:36.324231 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9e601425-4ff0-418d-baeb-b59f9fa0798d tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] [instance: 94a61a8f-6d71-42d5-8a25-2dd93b221cc2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:36.327946 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-62a78553-ee91-4033-a988-0565a5601b96 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:36.335040 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9e601425-4ff0-418d-baeb-b59f9fa0798d tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:36.336841 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9e601425-4ff0-418d-baeb-b59f9fa0798d tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:36.338141 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9e601425-4ff0-418d-baeb-b59f9fa0798d tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:36.338814 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9e601425-4ff0-418d-baeb-b59f9fa0798d tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:36.344400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-62a78553-ee91-4033-a988-0565a5601b96 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:36.346376 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-62a78553-ee91-4033-a988-0565a5601b96 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:36.354113 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-62a78553-ee91-4033-a988-0565a5601b96 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1604 microversion: 2.42 time: 0.306156 Jul 25 14:37:36.354931 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1582/2957] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:36 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1604 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:36.399596 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9e601425-4ff0-418d-baeb-b59f9fa0798d tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:36.400623 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9e601425-4ff0-418d-baeb-b59f9fa0798d tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:36.401357 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-9e601425-4ff0-418d-baeb-b59f9fa0798d tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lazy-loading 'fault' on Instance uuid 94a61a8f-6d71-42d5-8a25-2dd93b221cc2 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:37:36.647376 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9e601425-4ff0-418d-baeb-b59f9fa0798d tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73b42088e9f64e4bb596ea18ea062f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9560d1222b9b47ca8d8fff3c6a7b634f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:36.657560 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9e601425-4ff0-418d-baeb-b59f9fa0798d tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2" status: 200 len: 1302 microversion: 2.1 time: 0.345036 Jul 25 14:37:36.663181 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1376/2958] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:36 2022] GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2 => generated 1302 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:36.920017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1e84252d-e367-4252-9a11-6ddbdab9652a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:36.920789 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1e84252d-e367-4252-9a11-6ddbdab9652a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:36.927459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1e84252d-e367-4252-9a11-6ddbdab9652a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:36.931902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1e84252d-e367-4252-9a11-6ddbdab9652a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:36.933806 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1e84252d-e367-4252-9a11-6ddbdab9652a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:36.934267 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1e84252d-e367-4252-9a11-6ddbdab9652a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:37.066325 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6491ee07-afe5-4b8f-a687-858ad60e66e2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:37.068147 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6491ee07-afe5-4b8f-a687-858ad60e66e2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:37.080456 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6491ee07-afe5-4b8f-a687-858ad60e66e2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:37.082791 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6491ee07-afe5-4b8f-a687-858ad60e66e2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:37.083813 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6491ee07-afe5-4b8f-a687-858ad60e66e2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:37.091821 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6491ee07-afe5-4b8f-a687-858ad60e66e2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:37.171678 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1e84252d-e367-4252-9a11-6ddbdab9652a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:37.186580 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1e84252d-e367-4252-9a11-6ddbdab9652a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:37.196034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1e84252d-e367-4252-9a11-6ddbdab9652a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:37.197728 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1e84252d-e367-4252-9a11-6ddbdab9652a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1808 microversion: 2.20 time: 0.282475 Jul 25 14:37:37.198817 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1583/2959] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:36 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1808 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:37.229417 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-c8c7c4eb-07b5-418f-885f-7c168540be5e req-e06ad914-8ddb-4e31-8933-b01626d7489d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94a61a8f-6d71-42d5-8a25-2dd93b221cc2", "name": "network-vif-deleted", "tag": "230e08ff-39b2-44ef-a97c-cc8937af2ad1"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:37.248125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c8c7c4eb-07b5-418f-885f-7c168540be5e req-e06ad914-8ddb-4e31-8933-b01626d7489d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:37.249147 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c8c7c4eb-07b5-418f-885f-7c168540be5e req-e06ad914-8ddb-4e31-8933-b01626d7489d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:37.283319 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-c8c7c4eb-07b5-418f-885f-7c168540be5e req-e06ad914-8ddb-4e31-8933-b01626d7489d service nova] Creating event network-vif-deleted:230e08ff-39b2-44ef-a97c-cc8937af2ad1 for instance 94a61a8f-6d71-42d5-8a25-2dd93b221cc2 on n-h1-846435-14 Jul 25 14:37:37.294363 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-c8c7c4eb-07b5-418f-885f-7c168540be5e req-e06ad914-8ddb-4e31-8933-b01626d7489d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069005 Jul 25 14:37:37.296948 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1584/2960] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:37:37.307601 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b908cc02-aaad-4403-8a00-19dc4ff70ec6 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:37.313538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b908cc02-aaad-4403-8a00-19dc4ff70ec6 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:37.329279 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b908cc02-aaad-4403-8a00-19dc4ff70ec6 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:37.330721 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b908cc02-aaad-4403-8a00-19dc4ff70ec6 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:37.331776 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b908cc02-aaad-4403-8a00-19dc4ff70ec6 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:37.333665 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b908cc02-aaad-4403-8a00-19dc4ff70ec6 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:37.576865 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6491ee07-afe5-4b8f-a687-858ad60e66e2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:37.585270 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6491ee07-afe5-4b8f-a687-858ad60e66e2 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1387 microversion: 2.1 time: 0.522832 Jul 25 14:37:37.603820 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1377/2961] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:37 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1387 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:37:37.609794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3661dbab-4277-4eb7-b14b-74827217f74f tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:37.613558 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3661dbab-4277-4eb7-b14b-74827217f74f tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:37.630313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3661dbab-4277-4eb7-b14b-74827217f74f tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:37.634424 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3661dbab-4277-4eb7-b14b-74827217f74f tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:37.639246 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3661dbab-4277-4eb7-b14b-74827217f74f tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:37.640068 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3661dbab-4277-4eb7-b14b-74827217f74f tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:37.667865 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b908cc02-aaad-4403-8a00-19dc4ff70ec6 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb708222f6ee4225b1fe18848fb6a1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:37.678582 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b908cc02-aaad-4403-8a00-19dc4ff70ec6 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3" status: 200 len: 1291 microversion: 2.1 time: 0.375818 Jul 25 14:37:37.691942 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1585/2962] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:37 2022] GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 => generated 1291 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:37.693099 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-69d61f4d-6854-4d66-9ef0-cd1d738dc6eb tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:37.694226 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-69d61f4d-6854-4d66-9ef0-cd1d738dc6eb tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] [instance: 94a61a8f-6d71-42d5-8a25-2dd93b221cc2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:37.715223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69d61f4d-6854-4d66-9ef0-cd1d738dc6eb tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:37.715680 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69d61f4d-6854-4d66-9ef0-cd1d738dc6eb tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:37.719774 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69d61f4d-6854-4d66-9ef0-cd1d738dc6eb tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:37.720253 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69d61f4d-6854-4d66-9ef0-cd1d738dc6eb tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:37.777166 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-69d61f4d-6854-4d66-9ef0-cd1d738dc6eb tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] HTTP exception thrown: Instance 94a61a8f-6d71-42d5-8a25-2dd93b221cc2 could not be found. Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-69d61f4d-6854-4d66-9ef0-cd1d738dc6eb tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Request method failure captured: Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2 HTTP/1.1 Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qqMimzbldVBLQBJnGTBDCGKPIj3mzf9wLhI5PNTimIxNjpFrSvDuljhMjPGhPcINZOpC6uCuDKXAwFKSFXA-dm9R5i9ZE88l7Ead5i3x3KnbZjqjsyNZqtWSkVRgXNYxa6E0l6ShfDIDEjKKXtR4UObW5omvrrpZspac3C-ZHfcBdM Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 9560d1222b9b47ca8d8fff3c6a7b634f Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerGroupTestJSON-1199006312 Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9560d1222b9b47ca8d8fff3c6a7b634f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9560d1222b9b47ca8d8fff3c6a7b634f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9560d1222b9b47ca8d8fff3c6a7b634f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9560d1222b9b47ca8d8fff3c6a7b634f"}]}] Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerGroupTestJSON-1199006312 Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 9560d1222b9b47ca8d8fff3c6a7b634f Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerGroupTestJSON-1199006312 Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerGroupTestJSON-1199006312-project Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 73b42088e9f64e4bb596ea18ea062f07 Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerGroupTestJSON-1199006312-project Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 94a61a8f-6d71-42d5-8a25-2dd93b221cc2 could not be found. Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '94a61a8f-6d71-42d5-8a25-2dd93b221cc2'} Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94a61a8f-6d71-42d5-8a25-2dd93b221cc2 could not be found. Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94a61a8f-6d71-42d5-8a25-2dd93b221cc2 could not be found. Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:37:37.779001 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:37:37.784416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:37:37.784416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:37:37.784416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:37:37.784416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:37:37.784416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:37:37.784416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94a61a8f-6d71-42d5-8a25-2dd93b221cc2 could not be found. Jul 25 14:37:37.784416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:37:37.784416 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-69d61f4d-6854-4d66-9ef0-cd1d738dc6eb tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Returning 404 to user: Instance 94a61a8f-6d71-42d5-8a25-2dd93b221cc2 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:37:37.784416 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-69d61f4d-6854-4d66-9ef0-cd1d738dc6eb tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2" status: 404 len: 111 microversion: 2.1 time: 0.100318 Jul 25 14:37:37.784416 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1586/2963] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:37 2022] GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:37:37.788661 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3661dbab-4277-4eb7-b14b-74827217f74f tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:37.800444 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3661dbab-4277-4eb7-b14b-74827217f74f tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:37.801659 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-36555602-3d6e-46cd-a7cf-388359a8ef8e tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:37.803104 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3661dbab-4277-4eb7-b14b-74827217f74f tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:37.804884 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3661dbab-4277-4eb7-b14b-74827217f74f tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1604 microversion: 2.42 time: 0.199462 Jul 25 14:37:37.823161 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1378/2964] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:37 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1604 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:37.846919 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.compute.server_groups [None req-36555602-3d6e-46cd-a7cf-388359a8ef8e tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Querying cell cadb07ed-5464-41eb-afb8-bf9dd92401b6(cell1) for 1 instances {{(pid=119304) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 25 14:37:37.848430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-36555602-3d6e-46cd-a7cf-388359a8ef8e tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:37.849112 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-36555602-3d6e-46cd-a7cf-388359a8ef8e tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:37.862043 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-36555602-3d6e-46cd-a7cf-388359a8ef8e tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.073438 Jul 25 14:37:37.864671 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1587/2965] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jul 25 14:37:37 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:37:37.880917 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b4175177-fde6-4818-ada8-00caa7573416 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:37.922041 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-afe79c1b-9b76-48b3-a48e-eda1b78e2509 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-785885369", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1b27c74-63b3-49c6-ab52-66b439d1a6ff"}], "security_groups": [{"name": "tempest-securitygroup--1727897622"}], "key_name": "tempest-keypair-792019371", "user_data": "}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:37.927317 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.compute.server_groups [None req-b4175177-fde6-4818-ada8-00caa7573416 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Querying cell cadb07ed-5464-41eb-afb8-bf9dd92401b6(cell1) for 1 instances {{(pid=119303) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 25 14:37:37.933317 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b4175177-fde6-4818-ada8-00caa7573416 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:37.934858 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b4175177-fde6-4818-ada8-00caa7573416 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:37.960984 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b4175177-fde6-4818-ada8-00caa7573416 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "GET /compute/v2.1/os-server-groups/d1b25a11-6a66-4490-b6f0-cf6692572970" status: 200 len: 184 microversion: 2.1 time: 0.085062 Jul 25 14:37:37.962647 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1379/2966] 10.222.0.88 () {58 vars in 1263 bytes} [Mon Jul 25 14:37:37 2022] GET /compute/v2.1/os-server-groups/d1b25a11-6a66-4490-b6f0-cf6692572970 => generated 184 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:37.979033 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9dfb0bc2-74cb-4b99-aef0-50e92c14e421 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:37.979692 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9dfb0bc2-74cb-4b99-aef0-50e92c14e421 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] [instance: 94a61a8f-6d71-42d5-8a25-2dd93b221cc2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:37.987221 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9dfb0bc2-74cb-4b99-aef0-50e92c14e421 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:37.988150 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9dfb0bc2-74cb-4b99-aef0-50e92c14e421 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:37.989241 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9dfb0bc2-74cb-4b99-aef0-50e92c14e421 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:37.990073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9dfb0bc2-74cb-4b99-aef0-50e92c14e421 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:38.019195 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-9dfb0bc2-74cb-4b99-aef0-50e92c14e421 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] HTTP exception thrown: Instance 94a61a8f-6d71-42d5-8a25-2dd93b221cc2 could not be found. Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9dfb0bc2-74cb-4b99-aef0-50e92c14e421 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Request method failure captured: Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2 HTTP/1.1 Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qqMimzbldVBLQBJnGTBDCGKPIj3mzf9wLhI5PNTimIxNjpFrSvDuljhMjPGhPcINZOpC6uCuDKXAwFKSFXA-dm9R5i9ZE88l7Ead5i3x3KnbZjqjsyNZqtWSkVRgXNYxa6E0l6ShfDIDEjKKXtR4UObW5omvrrpZspac3C-ZHfcBdM Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 9560d1222b9b47ca8d8fff3c6a7b634f Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServerGroupTestJSON-1199006312 Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9560d1222b9b47ca8d8fff3c6a7b634f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9560d1222b9b47ca8d8fff3c6a7b634f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9560d1222b9b47ca8d8fff3c6a7b634f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9560d1222b9b47ca8d8fff3c6a7b634f"}]}] Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServerGroupTestJSON-1199006312 Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 9560d1222b9b47ca8d8fff3c6a7b634f Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServerGroupTestJSON-1199006312 Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServerGroupTestJSON-1199006312-project Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 73b42088e9f64e4bb596ea18ea062f07 Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServerGroupTestJSON-1199006312-project Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 94a61a8f-6d71-42d5-8a25-2dd93b221cc2 could not be found. Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '94a61a8f-6d71-42d5-8a25-2dd93b221cc2'} Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94a61a8f-6d71-42d5-8a25-2dd93b221cc2 could not be found. Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:37:38.022169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:37:38.025919 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94a61a8f-6d71-42d5-8a25-2dd93b221cc2 could not be found. Jul 25 14:37:38.025919 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:38.025919 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:37:38.025919 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:38.025919 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:37:38.025919 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:37:38.025919 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:37:38.025919 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:37:38.025919 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:37:38.025919 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94a61a8f-6d71-42d5-8a25-2dd93b221cc2 could not be found. Jul 25 14:37:38.025919 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:38.025919 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9dfb0bc2-74cb-4b99-aef0-50e92c14e421 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Returning 404 to user: Instance 94a61a8f-6d71-42d5-8a25-2dd93b221cc2 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:37:38.025919 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9dfb0bc2-74cb-4b99-aef0-50e92c14e421 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "DELETE /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2" status: 404 len: 111 microversion: 2.1 time: 0.053037 Jul 25 14:37:38.027783 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1380/2967] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:37:37 2022] DELETE /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:37:38.032807 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-549979dd-9005-4a25-b467-1e58910f346c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:38.033426 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-549979dd-9005-4a25-b467-1e58910f346c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] [instance: 94a61a8f-6d71-42d5-8a25-2dd93b221cc2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:38.040698 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-549979dd-9005-4a25-b467-1e58910f346c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:38.041252 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-549979dd-9005-4a25-b467-1e58910f346c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:38.042039 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-549979dd-9005-4a25-b467-1e58910f346c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:38.042579 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-549979dd-9005-4a25-b467-1e58910f346c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:38.060471 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-549979dd-9005-4a25-b467-1e58910f346c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] HTTP exception thrown: Instance 94a61a8f-6d71-42d5-8a25-2dd93b221cc2 could not be found. Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-549979dd-9005-4a25-b467-1e58910f346c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Request method failure captured: Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2 HTTP/1.1 Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qqMimzbldVBLQBJnGTBDCGKPIj3mzf9wLhI5PNTimIxNjpFrSvDuljhMjPGhPcINZOpC6uCuDKXAwFKSFXA-dm9R5i9ZE88l7Ead5i3x3KnbZjqjsyNZqtWSkVRgXNYxa6E0l6ShfDIDEjKKXtR4UObW5omvrrpZspac3C-ZHfcBdM Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 9560d1222b9b47ca8d8fff3c6a7b634f Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServerGroupTestJSON-1199006312 Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9560d1222b9b47ca8d8fff3c6a7b634f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9560d1222b9b47ca8d8fff3c6a7b634f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9560d1222b9b47ca8d8fff3c6a7b634f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9560d1222b9b47ca8d8fff3c6a7b634f"}]}] Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServerGroupTestJSON-1199006312 Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 9560d1222b9b47ca8d8fff3c6a7b634f Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServerGroupTestJSON-1199006312 Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServerGroupTestJSON-1199006312-project Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 73b42088e9f64e4bb596ea18ea062f07 Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServerGroupTestJSON-1199006312-project Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 94a61a8f-6d71-42d5-8a25-2dd93b221cc2 could not be found. Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '94a61a8f-6d71-42d5-8a25-2dd93b221cc2'} Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94a61a8f-6d71-42d5-8a25-2dd93b221cc2 could not be found. Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94a61a8f-6d71-42d5-8a25-2dd93b221cc2 could not be found. Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:37:38.062588 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:38.071852 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:37:38.071852 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:37:38.071852 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:37:38.071852 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:37:38.071852 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:37:38.071852 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94a61a8f-6d71-42d5-8a25-2dd93b221cc2 could not be found. Jul 25 14:37:38.071852 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:38.071852 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-549979dd-9005-4a25-b467-1e58910f346c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Returning 404 to user: Instance 94a61a8f-6d71-42d5-8a25-2dd93b221cc2 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:37:38.071852 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-549979dd-9005-4a25-b467-1e58910f346c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2" status: 404 len: 111 microversion: 2.1 time: 0.036499 Jul 25 14:37:38.071852 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1381/2968] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:38 2022] GET /compute/v2.1/servers/94a61a8f-6d71-42d5-8a25-2dd93b221cc2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:37:38.079540 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5707f600-3f11-4238-bd4b-b1d236d3b99c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:38.094567 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-5707f600-3f11-4238-bd4b-b1d236d3b99c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] HTTP exception thrown: Instance group 7bc8f044-f1f9-4d7e-ac1d-17030ee7f0dc could not be found. Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5707f600-3f11-4238-bd4b-b1d236d3b99c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Request method failure captured: Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/os-server-groups/7bc8f044-f1f9-4d7e-ac1d-17030ee7f0dc HTTP/1.1 Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qqMimzbldVBLQBJnGTBDCGKPIj3mzf9wLhI5PNTimIxNjpFrSvDuljhMjPGhPcINZOpC6uCuDKXAwFKSFXA-dm9R5i9ZE88l7Ead5i3x3KnbZjqjsyNZqtWSkVRgXNYxa6E0l6ShfDIDEjKKXtR4UObW5omvrrpZspac3C-ZHfcBdM Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 9560d1222b9b47ca8d8fff3c6a7b634f Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServerGroupTestJSON-1199006312 Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9560d1222b9b47ca8d8fff3c6a7b634f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9560d1222b9b47ca8d8fff3c6a7b634f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9560d1222b9b47ca8d8fff3c6a7b634f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9560d1222b9b47ca8d8fff3c6a7b634f"}]}] Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServerGroupTestJSON-1199006312 Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 9560d1222b9b47ca8d8fff3c6a7b634f Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServerGroupTestJSON-1199006312 Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServerGroupTestJSON-1199006312-project Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 73b42088e9f64e4bb596ea18ea062f07 Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServerGroupTestJSON-1199006312-project Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance group 7bc8f044-f1f9-4d7e-ac1d-17030ee7f0dc could not be found. Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '7bc8f044-f1f9-4d7e-ac1d-17030ee7f0dc'} Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 7bc8f044-f1f9-4d7e-ac1d-17030ee7f0dc could not be found. Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 7bc8f044-f1f9-4d7e-ac1d-17030ee7f0dc could not be found. Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:38.098617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:37:38.103779 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:37:38.103779 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:37:38.103779 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:37:38.103779 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:37:38.103779 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 7bc8f044-f1f9-4d7e-ac1d-17030ee7f0dc could not be found. Jul 25 14:37:38.103779 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:38.103779 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5707f600-3f11-4238-bd4b-b1d236d3b99c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Returning 404 to user: Instance group 7bc8f044-f1f9-4d7e-ac1d-17030ee7f0dc could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:37:38.103779 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5707f600-3f11-4238-bd4b-b1d236d3b99c tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "DELETE /compute/v2.1/os-server-groups/7bc8f044-f1f9-4d7e-ac1d-17030ee7f0dc" status: 404 len: 117 microversion: 2.1 time: 0.024802 Jul 25 14:37:38.103779 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1382/2969] 10.222.0.88 () {58 vars in 1266 bytes} [Mon Jul 25 14:37:38 2022] DELETE /compute/v2.1/os-server-groups/7bc8f044-f1f9-4d7e-ac1d-17030ee7f0dc => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:37:38.114921 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-318a3089-d5c5-400c-a096-dfab233c2be5 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:38.132408 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-318a3089-d5c5-400c-a096-dfab233c2be5 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] HTTP exception thrown: Instance group f90548b4-b443-4c13-a04f-cbb495d1d5a0 could not be found. Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-318a3089-d5c5-400c-a096-dfab233c2be5 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Request method failure captured: Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/os-server-groups/f90548b4-b443-4c13-a04f-cbb495d1d5a0 HTTP/1.1 Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qqMimzbldVBLQBJnGTBDCGKPIj3mzf9wLhI5PNTimIxNjpFrSvDuljhMjPGhPcINZOpC6uCuDKXAwFKSFXA-dm9R5i9ZE88l7Ead5i3x3KnbZjqjsyNZqtWSkVRgXNYxa6E0l6ShfDIDEjKKXtR4UObW5omvrrpZspac3C-ZHfcBdM Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 9560d1222b9b47ca8d8fff3c6a7b634f Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServerGroupTestJSON-1199006312 Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9560d1222b9b47ca8d8fff3c6a7b634f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9560d1222b9b47ca8d8fff3c6a7b634f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9560d1222b9b47ca8d8fff3c6a7b634f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9560d1222b9b47ca8d8fff3c6a7b634f"}]}] Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServerGroupTestJSON-1199006312 Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 9560d1222b9b47ca8d8fff3c6a7b634f Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServerGroupTestJSON-1199006312 Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServerGroupTestJSON-1199006312-project Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 73b42088e9f64e4bb596ea18ea062f07 Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServerGroupTestJSON-1199006312-project Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance group f90548b4-b443-4c13-a04f-cbb495d1d5a0 could not be found. Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'f90548b4-b443-4c13-a04f-cbb495d1d5a0'} Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f90548b4-b443-4c13-a04f-cbb495d1d5a0 could not be found. Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f90548b4-b443-4c13-a04f-cbb495d1d5a0 could not be found. Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:38.134048 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:37:38.138641 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:37:38.138641 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:37:38.138641 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:37:38.138641 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:37:38.138641 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f90548b4-b443-4c13-a04f-cbb495d1d5a0 could not be found. Jul 25 14:37:38.138641 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:38.138641 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-318a3089-d5c5-400c-a096-dfab233c2be5 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Returning 404 to user: Instance group f90548b4-b443-4c13-a04f-cbb495d1d5a0 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:37:38.138641 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-318a3089-d5c5-400c-a096-dfab233c2be5 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "DELETE /compute/v2.1/os-server-groups/f90548b4-b443-4c13-a04f-cbb495d1d5a0" status: 404 len: 117 microversion: 2.1 time: 0.030219 Jul 25 14:37:38.139315 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1383/2970] 10.222.0.88 () {58 vars in 1266 bytes} [Mon Jul 25 14:37:38 2022] DELETE /compute/v2.1/os-server-groups/f90548b4-b443-4c13-a04f-cbb495d1d5a0 => generated 117 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:37:38.149609 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-815b9c4f-9d21-4261-b2c5-4e3f189f303e tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:38.167271 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-815b9c4f-9d21-4261-b2c5-4e3f189f303e tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] HTTP exception thrown: Instance group 366f80ed-f905-4cec-a6bf-2c6c8b0fb8b8 could not be found. Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-815b9c4f-9d21-4261-b2c5-4e3f189f303e tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Request method failure captured: Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/os-server-groups/366f80ed-f905-4cec-a6bf-2c6c8b0fb8b8 HTTP/1.1 Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qqMimzbldVBLQBJnGTBDCGKPIj3mzf9wLhI5PNTimIxNjpFrSvDuljhMjPGhPcINZOpC6uCuDKXAwFKSFXA-dm9R5i9ZE88l7Ead5i3x3KnbZjqjsyNZqtWSkVRgXNYxa6E0l6ShfDIDEjKKXtR4UObW5omvrrpZspac3C-ZHfcBdM Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 9560d1222b9b47ca8d8fff3c6a7b634f Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServerGroupTestJSON-1199006312 Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9560d1222b9b47ca8d8fff3c6a7b634f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9560d1222b9b47ca8d8fff3c6a7b634f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9560d1222b9b47ca8d8fff3c6a7b634f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9560d1222b9b47ca8d8fff3c6a7b634f"}]}] Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServerGroupTestJSON-1199006312 Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 9560d1222b9b47ca8d8fff3c6a7b634f Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServerGroupTestJSON-1199006312 Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServerGroupTestJSON-1199006312-project Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 73b42088e9f64e4bb596ea18ea062f07 Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServerGroupTestJSON-1199006312-project Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance group 366f80ed-f905-4cec-a6bf-2c6c8b0fb8b8 could not be found. Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '366f80ed-f905-4cec-a6bf-2c6c8b0fb8b8'} Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 366f80ed-f905-4cec-a6bf-2c6c8b0fb8b8 could not be found. Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 366f80ed-f905-4cec-a6bf-2c6c8b0fb8b8 could not be found. Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:38.168941 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:37:38.173983 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:37:38.173983 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:37:38.173983 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:37:38.173983 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:37:38.173983 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 366f80ed-f905-4cec-a6bf-2c6c8b0fb8b8 could not be found. Jul 25 14:37:38.173983 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:38.173983 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-815b9c4f-9d21-4261-b2c5-4e3f189f303e tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Returning 404 to user: Instance group 366f80ed-f905-4cec-a6bf-2c6c8b0fb8b8 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:37:38.173983 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-815b9c4f-9d21-4261-b2c5-4e3f189f303e tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "DELETE /compute/v2.1/os-server-groups/366f80ed-f905-4cec-a6bf-2c6c8b0fb8b8" status: 404 len: 117 microversion: 2.1 time: 0.027601 Jul 25 14:37:38.173983 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1384/2971] 10.222.0.88 () {58 vars in 1266 bytes} [Mon Jul 25 14:37:38 2022] DELETE /compute/v2.1/os-server-groups/366f80ed-f905-4cec-a6bf-2c6c8b0fb8b8 => generated 117 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:37:38.177217 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-afe79c1b-9b76-48b3-a48e-eda1b78e2509 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] validate_networks() for [('c1b27c74-63b3-49c6-ab52-66b439d1a6ff', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:37:38.181339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f4d36f60-53cf-45fb-a4bd-1a63da9764e0 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:38.201996 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-f4d36f60-53cf-45fb-a4bd-1a63da9764e0 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] HTTP exception thrown: Instance group 12af84ec-5d38-4a14-a869-43bfd3de5cee could not be found. Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f4d36f60-53cf-45fb-a4bd-1a63da9764e0 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Request method failure captured: Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/os-server-groups/12af84ec-5d38-4a14-a869-43bfd3de5cee HTTP/1.1 Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qqMimzbldVBLQBJnGTBDCGKPIj3mzf9wLhI5PNTimIxNjpFrSvDuljhMjPGhPcINZOpC6uCuDKXAwFKSFXA-dm9R5i9ZE88l7Ead5i3x3KnbZjqjsyNZqtWSkVRgXNYxa6E0l6ShfDIDEjKKXtR4UObW5omvrrpZspac3C-ZHfcBdM Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 9560d1222b9b47ca8d8fff3c6a7b634f Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServerGroupTestJSON-1199006312 Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9560d1222b9b47ca8d8fff3c6a7b634f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9560d1222b9b47ca8d8fff3c6a7b634f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9560d1222b9b47ca8d8fff3c6a7b634f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9560d1222b9b47ca8d8fff3c6a7b634f"}]}] Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServerGroupTestJSON-1199006312 Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 9560d1222b9b47ca8d8fff3c6a7b634f Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServerGroupTestJSON-1199006312 Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServerGroupTestJSON-1199006312-project Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 73b42088e9f64e4bb596ea18ea062f07 Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServerGroupTestJSON-1199006312-project Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance group 12af84ec-5d38-4a14-a869-43bfd3de5cee could not be found. Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '12af84ec-5d38-4a14-a869-43bfd3de5cee'} Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 12af84ec-5d38-4a14-a869-43bfd3de5cee could not be found. Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 12af84ec-5d38-4a14-a869-43bfd3de5cee could not be found. Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:38.210095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:37:38.214921 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:37:38.214921 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:37:38.214921 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:37:38.214921 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:37:38.214921 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 12af84ec-5d38-4a14-a869-43bfd3de5cee could not be found. Jul 25 14:37:38.214921 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:38.216932 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f4d36f60-53cf-45fb-a4bd-1a63da9764e0 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Returning 404 to user: Instance group 12af84ec-5d38-4a14-a869-43bfd3de5cee could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:37:38.219946 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f4d36f60-53cf-45fb-a4bd-1a63da9764e0 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "DELETE /compute/v2.1/os-server-groups/12af84ec-5d38-4a14-a869-43bfd3de5cee" status: 404 len: 117 microversion: 2.1 time: 0.044371 Jul 25 14:37:38.224619 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1385/2972] 10.222.0.88 () {58 vars in 1266 bytes} [Mon Jul 25 14:37:38 2022] DELETE /compute/v2.1/os-server-groups/12af84ec-5d38-4a14-a869-43bfd3de5cee => generated 117 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:37:38.231662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-66367ebe-1048-4c95-a447-5792892eb5d3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:38.232543 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-66367ebe-1048-4c95-a447-5792892eb5d3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:38.241189 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-66367ebe-1048-4c95-a447-5792892eb5d3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:38.241942 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-66367ebe-1048-4c95-a447-5792892eb5d3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:38.244236 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-66367ebe-1048-4c95-a447-5792892eb5d3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:38.245030 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-66367ebe-1048-4c95-a447-5792892eb5d3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:38.571120 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-66367ebe-1048-4c95-a447-5792892eb5d3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:38.620269 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-66367ebe-1048-4c95-a447-5792892eb5d3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:38.623169 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-66367ebe-1048-4c95-a447-5792892eb5d3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:38.625006 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-66367ebe-1048-4c95-a447-5792892eb5d3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1808 microversion: 2.20 time: 0.399188 Jul 25 14:37:38.626374 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1386/2973] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:38 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1808 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:38.632679 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-609e7a55-26b7-4e6a-9fac-5f7dd4663c42 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:38.679941 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-609e7a55-26b7-4e6a-9fac-5f7dd4663c42 tempest-ServerGroupTestJSON-1199006312 tempest-ServerGroupTestJSON-1199006312-project] 10.222.0.88 "DELETE /compute/v2.1/os-server-groups/d1b25a11-6a66-4490-b6f0-cf6692572970" status: 204 len: 0 microversion: 2.1 time: 0.051899 Jul 25 14:37:38.680574 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1387/2974] 10.222.0.88 () {58 vars in 1266 bytes} [Mon Jul 25 14:37:38 2022] DELETE /compute/v2.1/os-server-groups/d1b25a11-6a66-4490-b6f0-cf6692572970 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:37:38.822179 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0b8d69cb-6ecd-4fec-85b4-477ecee7858f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1489182785", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": "none"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:38.905401 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-0b8d69cb-6ecd-4fec-85b4-477ecee7858f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:37:38.905833 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-0b8d69cb-6ecd-4fec-85b4-477ecee7858f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:37:38.906312 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-0b8d69cb-6ecd-4fec-85b4-477ecee7858f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:37:38.906728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-0b8d69cb-6ecd-4fec-85b4-477ecee7858f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:37:38.907144 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-0b8d69cb-6ecd-4fec-85b4-477ecee7858f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:37:38.921556 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b8d69cb-6ecd-4fec-85b4-477ecee7858f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:38.922643 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b8d69cb-6ecd-4fec-85b4-477ecee7858f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:38.923502 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b8d69cb-6ecd-4fec-85b4-477ecee7858f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:38.923960 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b8d69cb-6ecd-4fec-85b4-477ecee7858f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:38.974449 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-0b8d69cb-6ecd-4fec-85b4-477ecee7858f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Getting quotas for project 97521c9f77b14e77adfeece6c536e3cb. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:37:38.987608 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-0b8d69cb-6ecd-4fec-85b4-477ecee7858f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Getting quotas for user 334d40ea432149cc9f438cd869bf9aee and project 97521c9f77b14e77adfeece6c536e3cb. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:37:39.028539 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0b8d69cb-6ecd-4fec-85b4-477ecee7858f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:37:39.034480 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0b8d69cb-6ecd-4fec-85b4-477ecee7858f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:37:39.108406 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0b8d69cb-6ecd-4fec-85b4-477ecee7858f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.424788 Jul 25 14:37:39.112406 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1388/2975] 10.222.0.88 () {62 vars in 1188 bytes} [Mon Jul 25 14:37:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 431 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 14:37:39.127004 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b7e85e7a-8ce2-49eb-a401-135ace1a0d1c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:39.127654 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b7e85e7a-8ce2-49eb-a401-135ace1a0d1c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:39.149265 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b7e85e7a-8ce2-49eb-a401-135ace1a0d1c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:39.149809 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b7e85e7a-8ce2-49eb-a401-135ace1a0d1c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:39.153269 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b7e85e7a-8ce2-49eb-a401-135ace1a0d1c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:39.153800 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b7e85e7a-8ce2-49eb-a401-135ace1a0d1c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:39.257602 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-afe79c1b-9b76-48b3-a48e-eda1b78e2509 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:37:39.258148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-afe79c1b-9b76-48b3-a48e-eda1b78e2509 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:37:39.258509 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-afe79c1b-9b76-48b3-a48e-eda1b78e2509 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:37:39.258917 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-afe79c1b-9b76-48b3-a48e-eda1b78e2509 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:37:39.259322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-afe79c1b-9b76-48b3-a48e-eda1b78e2509 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:37:39.269908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-afe79c1b-9b76-48b3-a48e-eda1b78e2509 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:39.270362 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-afe79c1b-9b76-48b3-a48e-eda1b78e2509 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:39.271364 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-afe79c1b-9b76-48b3-a48e-eda1b78e2509 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:39.271969 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-afe79c1b-9b76-48b3-a48e-eda1b78e2509 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:39.297168 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-afe79c1b-9b76-48b3-a48e-eda1b78e2509 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Getting quotas for project 2f1bd935e917484799f31ad643eafb2a. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:37:39.303570 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-afe79c1b-9b76-48b3-a48e-eda1b78e2509 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Getting quotas for user 9f2ddec1bc6244739e9ac3a40c064b53 and project 2f1bd935e917484799f31ad643eafb2a. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:37:39.319358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-afe79c1b-9b76-48b3-a48e-eda1b78e2509 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:37:39.322724 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-afe79c1b-9b76-48b3-a48e-eda1b78e2509 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:37:39.400200 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-afe79c1b-9b76-48b3-a48e-eda1b78e2509 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.481798 Jul 25 14:37:39.404541 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1588/2976] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:37:37 2022] POST /compute/v2.1/servers => generated 409 bytes in 1487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:37:39.421873 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d9059849-cfa6-428c-849a-0b84c901c554 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:39.422756 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d9059849-cfa6-428c-849a-0b84c901c554 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:39.451791 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d9059849-cfa6-428c-849a-0b84c901c554 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:39.452556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d9059849-cfa6-428c-849a-0b84c901c554 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:39.453518 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d9059849-cfa6-428c-849a-0b84c901c554 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:39.454104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d9059849-cfa6-428c-849a-0b84c901c554 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:39.513124 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b7e85e7a-8ce2-49eb-a401-135ace1a0d1c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:39.528944 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b7e85e7a-8ce2-49eb-a401-135ace1a0d1c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1387 microversion: 2.1 time: 0.414410 Jul 25 14:37:39.533092 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1389/2977] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:39 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1387 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:39.541617 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fe48b532-8fe0-4519-aebd-9e5e210a59bd tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:39.542612 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fe48b532-8fe0-4519-aebd-9e5e210a59bd tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:39.564848 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fe48b532-8fe0-4519-aebd-9e5e210a59bd tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:39.567887 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fe48b532-8fe0-4519-aebd-9e5e210a59bd tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:39.569637 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fe48b532-8fe0-4519-aebd-9e5e210a59bd tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:39.576289 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fe48b532-8fe0-4519-aebd-9e5e210a59bd tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:39.758098 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fe48b532-8fe0-4519-aebd-9e5e210a59bd tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:39.758933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d9059849-cfa6-428c-849a-0b84c901c554 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb708222f6ee4225b1fe18848fb6a1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:39.771912 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d9059849-cfa6-428c-849a-0b84c901c554 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3" status: 200 len: 1482 microversion: 2.1 time: 0.364398 Jul 25 14:37:39.773412 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1589/2978] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:39 2022] GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 => generated 1482 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:39.777576 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fe48b532-8fe0-4519-aebd-9e5e210a59bd tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:39.779239 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fe48b532-8fe0-4519-aebd-9e5e210a59bd tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:39.780736 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fe48b532-8fe0-4519-aebd-9e5e210a59bd tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1604 microversion: 2.42 time: 0.246194 Jul 25 14:37:39.789171 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-db8b4de1-edf0-4dc7-9769-fb8119547140 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:39.790077 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-db8b4de1-edf0-4dc7-9769-fb8119547140 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:39.822406 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1390/2979] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:39 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1604 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:39.838526 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d0237693-ff4c-43b4-99ef-761f020b0076 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:39.840557 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d0237693-ff4c-43b4-99ef-761f020b0076 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:39.855291 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:37:39.938104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-db8b4de1-edf0-4dc7-9769-fb8119547140 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:39.956850 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-db8b4de1-edf0-4dc7-9769-fb8119547140 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:39.968032 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-db8b4de1-edf0-4dc7-9769-fb8119547140 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:39.974622 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-db8b4de1-edf0-4dc7-9769-fb8119547140 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1278 microversion: 2.54 time: 0.198767 Jul 25 14:37:39.980201 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1590/2980] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:39 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1278 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:39.994610 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3b051b45-3827-4ef2-b791-d5ef98f815d4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:39.996984 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3b051b45-3827-4ef2-b791-d5ef98f815d4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:40.010390 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b051b45-3827-4ef2-b791-d5ef98f815d4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:40.013359 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b051b45-3827-4ef2-b791-d5ef98f815d4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:40.019559 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b051b45-3827-4ef2-b791-d5ef98f815d4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:40.020093 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b051b45-3827-4ef2-b791-d5ef98f815d4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:40.090914 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d0237693-ff4c-43b4-99ef-761f020b0076 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:40.102159 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d0237693-ff4c-43b4-99ef-761f020b0076 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1244 microversion: 2.1 time: 0.277913 Jul 25 14:37:40.121937 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1391/2981] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:39 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1244 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:40.145976 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1d738f7e-a003-4ec8-8655-d618e030ba61 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:40.151575 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1d738f7e-a003-4ec8-8655-d618e030ba61 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:40.178304 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d738f7e-a003-4ec8-8655-d618e030ba61 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:40.179503 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d738f7e-a003-4ec8-8655-d618e030ba61 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:40.182308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d738f7e-a003-4ec8-8655-d618e030ba61 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:40.183546 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d738f7e-a003-4ec8-8655-d618e030ba61 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:40.361107 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1d738f7e-a003-4ec8-8655-d618e030ba61 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.237567 Jul 25 14:37:40.369503 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1392/2982] 10.222.0.88 () {58 vars in 1275 bytes} [Mon Jul 25 14:37:40 2022] GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3/os-interface => generated 285 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:40.395429 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3b051b45-3827-4ef2-b791-d5ef98f815d4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:40.432158 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3b051b45-3827-4ef2-b791-d5ef98f815d4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:40.453137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3b051b45-3827-4ef2-b791-d5ef98f815d4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:40.455102 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3b051b45-3827-4ef2-b791-d5ef98f815d4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1808 microversion: 2.20 time: 0.471488 Jul 25 14:37:40.456202 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1591/2983] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:39 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1808 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:40.556792 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1e3d27d9-6fcb-48f3-8e32-cd38c1e8b57e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:40.557823 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1e3d27d9-6fcb-48f3-8e32-cd38c1e8b57e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:40.572012 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e3d27d9-6fcb-48f3-8e32-cd38c1e8b57e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:40.572850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e3d27d9-6fcb-48f3-8e32-cd38c1e8b57e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:40.573898 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e3d27d9-6fcb-48f3-8e32-cd38c1e8b57e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:40.574579 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e3d27d9-6fcb-48f3-8e32-cd38c1e8b57e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:40.815102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8565f0de-91bb-4cb2-bef3-258315171f22 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:40.816122 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8565f0de-91bb-4cb2-bef3-258315171f22 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:40.828344 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8565f0de-91bb-4cb2-bef3-258315171f22 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:40.828915 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8565f0de-91bb-4cb2-bef3-258315171f22 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:40.830444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8565f0de-91bb-4cb2-bef3-258315171f22 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:40.832186 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8565f0de-91bb-4cb2-bef3-258315171f22 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:41.016308 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8565f0de-91bb-4cb2-bef3-258315171f22 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:41.030353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8565f0de-91bb-4cb2-bef3-258315171f22 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:41.037673 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8565f0de-91bb-4cb2-bef3-258315171f22 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:41.039035 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8565f0de-91bb-4cb2-bef3-258315171f22 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1604 microversion: 2.42 time: 0.228729 Jul 25 14:37:41.056296 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1592/2984] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:40 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1604 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:37:41.068483 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6d430f9a-4b46-46f0-a26d-6649f20c960c tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:41.069222 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6d430f9a-4b46-46f0-a26d-6649f20c960c tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:41.084317 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d430f9a-4b46-46f0-a26d-6649f20c960c tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:41.084859 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d430f9a-4b46-46f0-a26d-6649f20c960c tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:41.089347 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d430f9a-4b46-46f0-a26d-6649f20c960c tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:41.089885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d430f9a-4b46-46f0-a26d-6649f20c960c tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:41.227153 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6d430f9a-4b46-46f0-a26d-6649f20c960c tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:41.237463 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6d430f9a-4b46-46f0-a26d-6649f20c960c tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:41.242014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6d430f9a-4b46-46f0-a26d-6649f20c960c tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:41.243791 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6d430f9a-4b46-46f0-a26d-6649f20c960c tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1330 microversion: 2.54 time: 0.179481 Jul 25 14:37:41.260003 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1593/2985] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:41 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1330 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:41.268868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-602d828c-3533-4f8d-80ab-d95e20a1d81f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:41.269539 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-602d828c-3533-4f8d-80ab-d95e20a1d81f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:41.301301 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-602d828c-3533-4f8d-80ab-d95e20a1d81f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:41.302127 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-602d828c-3533-4f8d-80ab-d95e20a1d81f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:41.304370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-602d828c-3533-4f8d-80ab-d95e20a1d81f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:41.307296 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-602d828c-3533-4f8d-80ab-d95e20a1d81f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:41.712072 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1e3d27d9-6fcb-48f3-8e32-cd38c1e8b57e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:41.725357 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1e3d27d9-6fcb-48f3-8e32-cd38c1e8b57e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1387 microversion: 2.1 time: 1.172189 Jul 25 14:37:41.727707 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1393/2986] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:40 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1387 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:37:41.738303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-063eabe4-a4b8-455a-a930-357b563d5c4e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:41.740360 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-063eabe4-a4b8-455a-a930-357b563d5c4e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:41.748345 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-063eabe4-a4b8-455a-a930-357b563d5c4e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:41.749223 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-063eabe4-a4b8-455a-a930-357b563d5c4e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:41.751056 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-063eabe4-a4b8-455a-a930-357b563d5c4e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:41.751734 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-063eabe4-a4b8-455a-a930-357b563d5c4e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:41.937209 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-602d828c-3533-4f8d-80ab-d95e20a1d81f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:41.940874 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:37:41.947422 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-602d828c-3533-4f8d-80ab-d95e20a1d81f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1296 microversion: 2.1 time: 0.692015 Jul 25 14:37:41.948042 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1594/2987] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:41 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1296 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:42.063156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d1c3209a-548b-48a7-acc0-25bfd186ed4a tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:42.064132 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d1c3209a-548b-48a7-acc0-25bfd186ed4a tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:42.071044 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1c3209a-548b-48a7-acc0-25bfd186ed4a tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:42.071815 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1c3209a-548b-48a7-acc0-25bfd186ed4a tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:42.072804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1c3209a-548b-48a7-acc0-25bfd186ed4a tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:42.073391 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1c3209a-548b-48a7-acc0-25bfd186ed4a tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:42.152454 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d1c3209a-548b-48a7-acc0-25bfd186ed4a tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:42.163157 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d1c3209a-548b-48a7-acc0-25bfd186ed4a tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:42.164962 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d1c3209a-548b-48a7-acc0-25bfd186ed4a tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:42.166316 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d1c3209a-548b-48a7-acc0-25bfd186ed4a tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1604 microversion: 2.42 time: 0.107614 Jul 25 14:37:42.180303 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1595/2988] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:42 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1604 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:42.202676 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-063eabe4-a4b8-455a-a930-357b563d5c4e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:42.211722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-063eabe4-a4b8-455a-a930-357b563d5c4e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:42.213340 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-063eabe4-a4b8-455a-a930-357b563d5c4e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:42.214571 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-063eabe4-a4b8-455a-a930-357b563d5c4e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1808 microversion: 2.20 time: 0.485366 Jul 25 14:37:42.215191 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1394/2989] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:41 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1808 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:42.269414 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-596dd61d-944c-45a0-a8b8-6f27e6fd8bb5 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:42.270000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-596dd61d-944c-45a0-a8b8-6f27e6fd8bb5 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:42.277336 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-596dd61d-944c-45a0-a8b8-6f27e6fd8bb5 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:42.277776 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-596dd61d-944c-45a0-a8b8-6f27e6fd8bb5 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:42.278534 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-596dd61d-944c-45a0-a8b8-6f27e6fd8bb5 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:42.278959 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-596dd61d-944c-45a0-a8b8-6f27e6fd8bb5 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:42.347173 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-596dd61d-944c-45a0-a8b8-6f27e6fd8bb5 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:42.355379 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-596dd61d-944c-45a0-a8b8-6f27e6fd8bb5 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:42.357150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-596dd61d-944c-45a0-a8b8-6f27e6fd8bb5 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:42.358264 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-596dd61d-944c-45a0-a8b8-6f27e6fd8bb5 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1336 microversion: 2.54 time: 0.092925 Jul 25 14:37:42.358916 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1596/2990] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:42 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1336 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:42.748331 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2841d14a-7f79-43e2-9cc3-4892b56e2d7e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:42.748965 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2841d14a-7f79-43e2-9cc3-4892b56e2d7e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:42.756443 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2841d14a-7f79-43e2-9cc3-4892b56e2d7e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:42.756877 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2841d14a-7f79-43e2-9cc3-4892b56e2d7e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:42.757799 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2841d14a-7f79-43e2-9cc3-4892b56e2d7e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:42.758320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2841d14a-7f79-43e2-9cc3-4892b56e2d7e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:42.972534 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1e9ac001-dc20-4ef3-807d-1fdf757fe6f7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:42.973901 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1e9ac001-dc20-4ef3-807d-1fdf757fe6f7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:42.989920 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1e9ac001-dc20-4ef3-807d-1fdf757fe6f7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:42.990361 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1e9ac001-dc20-4ef3-807d-1fdf757fe6f7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:42.991328 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1e9ac001-dc20-4ef3-807d-1fdf757fe6f7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:42.991769 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1e9ac001-dc20-4ef3-807d-1fdf757fe6f7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:43.066223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1e9ac001-dc20-4ef3-807d-1fdf757fe6f7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:43.074636 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1e9ac001-dc20-4ef3-807d-1fdf757fe6f7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1302 microversion: 2.1 time: 0.109742 Jul 25 14:37:43.075373 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1597/2991] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:42 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1302 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:37:43.187817 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2841d14a-7f79-43e2-9cc3-4892b56e2d7e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:43.193688 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6c1210cc-2536-439f-84bf-79f1cdb2b0a1 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:43.195386 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6c1210cc-2536-439f-84bf-79f1cdb2b0a1 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:43.199220 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2841d14a-7f79-43e2-9cc3-4892b56e2d7e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1387 microversion: 2.1 time: 0.454910 Jul 25 14:37:43.202484 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6c1210cc-2536-439f-84bf-79f1cdb2b0a1 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:43.203194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6c1210cc-2536-439f-84bf-79f1cdb2b0a1 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:43.204558 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6c1210cc-2536-439f-84bf-79f1cdb2b0a1 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:43.205298 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6c1210cc-2536-439f-84bf-79f1cdb2b0a1 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:43.210845 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1395/2992] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:42 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1387 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:43.238087 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f301f895-123a-4343-ba6a-768e9b34f0c9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:43.239240 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f301f895-123a-4343-ba6a-768e9b34f0c9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:43.246384 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f301f895-123a-4343-ba6a-768e9b34f0c9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:43.247244 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f301f895-123a-4343-ba6a-768e9b34f0c9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:43.248253 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f301f895-123a-4343-ba6a-768e9b34f0c9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:43.248850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f301f895-123a-4343-ba6a-768e9b34f0c9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:43.284675 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6c1210cc-2536-439f-84bf-79f1cdb2b0a1 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:43.295477 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6c1210cc-2536-439f-84bf-79f1cdb2b0a1 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:43.297343 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6c1210cc-2536-439f-84bf-79f1cdb2b0a1 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:43.298755 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6c1210cc-2536-439f-84bf-79f1cdb2b0a1 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1604 microversion: 2.42 time: 0.111135 Jul 25 14:37:43.299495 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1598/2993] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:43 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1604 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:37:43.385073 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-27697e75-4168-4aff-ac7f-ff9557014bfc tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:43.386085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-27697e75-4168-4aff-ac7f-ff9557014bfc tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:43.394884 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-27697e75-4168-4aff-ac7f-ff9557014bfc tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:43.395368 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-27697e75-4168-4aff-ac7f-ff9557014bfc tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:43.396608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-27697e75-4168-4aff-ac7f-ff9557014bfc tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:43.397043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-27697e75-4168-4aff-ac7f-ff9557014bfc tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:43.485892 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-27697e75-4168-4aff-ac7f-ff9557014bfc tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:43.496071 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-27697e75-4168-4aff-ac7f-ff9557014bfc tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:43.498210 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-27697e75-4168-4aff-ac7f-ff9557014bfc tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:43.499408 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-27697e75-4168-4aff-ac7f-ff9557014bfc tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1336 microversion: 2.54 time: 0.120177 Jul 25 14:37:43.500039 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1599/2994] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:43 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1336 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:37:43.798283 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9fe7c223-59ee-4ac2-801e-69b5771c3da8 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:43.799157 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9fe7c223-59ee-4ac2-801e-69b5771c3da8 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:43.806208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9fe7c223-59ee-4ac2-801e-69b5771c3da8 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:43.807171 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9fe7c223-59ee-4ac2-801e-69b5771c3da8 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:43.808170 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9fe7c223-59ee-4ac2-801e-69b5771c3da8 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:43.808798 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9fe7c223-59ee-4ac2-801e-69b5771c3da8 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:43.851264 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f301f895-123a-4343-ba6a-768e9b34f0c9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:43.875820 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f301f895-123a-4343-ba6a-768e9b34f0c9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:43.878540 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f301f895-123a-4343-ba6a-768e9b34f0c9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:43.890315 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f301f895-123a-4343-ba6a-768e9b34f0c9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1808 microversion: 2.20 time: 0.656230 Jul 25 14:37:43.904466 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1396/2995] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:43 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1808 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:43.913937 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-b20bfdb6-cdaa-40c6-862c-bd689ecfa93f req-ae683d9b-9108-4750-985b-26509e246036 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3", "tag": "24058dbf-0bb6-4f6e-8912-6077d722be00"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:43.936583 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b20bfdb6-cdaa-40c6-862c-bd689ecfa93f req-ae683d9b-9108-4750-985b-26509e246036 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:43.940510 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b20bfdb6-cdaa-40c6-862c-bd689ecfa93f req-ae683d9b-9108-4750-985b-26509e246036 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:43.967090 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-b20bfdb6-cdaa-40c6-862c-bd689ecfa93f req-ae683d9b-9108-4750-985b-26509e246036 service nova] Creating event network-changed:24058dbf-0bb6-4f6e-8912-6077d722be00 for instance fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 on n-h2-846435-14 Jul 25 14:37:43.979120 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-b20bfdb6-cdaa-40c6-862c-bd689ecfa93f req-ae683d9b-9108-4750-985b-26509e246036 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072923 Jul 25 14:37:43.981282 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1397/2996] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:44.031130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9fe7c223-59ee-4ac2-801e-69b5771c3da8 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb708222f6ee4225b1fe18848fb6a1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:44.040001 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9fe7c223-59ee-4ac2-801e-69b5771c3da8 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3" status: 200 len: 1482 microversion: 2.1 time: 0.245758 Jul 25 14:37:44.069126 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1600/2997] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:43 2022] GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 => generated 1482 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:44.097937 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-16b9048c-c584-4f14-b740-47b91406fe11 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:44.098698 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-16b9048c-c584-4f14-b740-47b91406fe11 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:44.110619 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-16b9048c-c584-4f14-b740-47b91406fe11 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:44.111113 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-16b9048c-c584-4f14-b740-47b91406fe11 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:44.117815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-16b9048c-c584-4f14-b740-47b91406fe11 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:44.118606 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-16b9048c-c584-4f14-b740-47b91406fe11 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:44.190018 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:37:44.220269 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a89cf170-292e-4acb-be45-747e31325a1c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:44.220889 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a89cf170-292e-4acb-be45-747e31325a1c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:44.240844 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a89cf170-292e-4acb-be45-747e31325a1c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:44.241289 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a89cf170-292e-4acb-be45-747e31325a1c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:44.242079 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a89cf170-292e-4acb-be45-747e31325a1c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:44.242641 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a89cf170-292e-4acb-be45-747e31325a1c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:44.312769 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-16b9048c-c584-4f14-b740-47b91406fe11 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:44.324552 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-16b9048c-c584-4f14-b740-47b91406fe11 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1302 microversion: 2.1 time: 0.231198 Jul 25 14:37:44.337418 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1398/2998] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:44 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1302 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:44.345590 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-76002ab8-3187-4a86-8a6a-b08839d9cb31 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:44.346242 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-76002ab8-3187-4a86-8a6a-b08839d9cb31 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:44.353627 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-76002ab8-3187-4a86-8a6a-b08839d9cb31 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:44.354086 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-76002ab8-3187-4a86-8a6a-b08839d9cb31 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:44.355463 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-76002ab8-3187-4a86-8a6a-b08839d9cb31 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:44.355915 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-76002ab8-3187-4a86-8a6a-b08839d9cb31 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:44.481088 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-76002ab8-3187-4a86-8a6a-b08839d9cb31 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:44.493474 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-76002ab8-3187-4a86-8a6a-b08839d9cb31 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:44.495676 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-76002ab8-3187-4a86-8a6a-b08839d9cb31 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:44.496992 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-76002ab8-3187-4a86-8a6a-b08839d9cb31 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1604 microversion: 2.42 time: 0.158457 Jul 25 14:37:44.516344 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1399/2999] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:44 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1604 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:44.528362 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4dd2bf1d-9139-4aca-9408-574fa879b642 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:44.528986 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4dd2bf1d-9139-4aca-9408-574fa879b642 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:44.546627 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4dd2bf1d-9139-4aca-9408-574fa879b642 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:44.547099 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4dd2bf1d-9139-4aca-9408-574fa879b642 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:44.547920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4dd2bf1d-9139-4aca-9408-574fa879b642 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:44.548385 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4dd2bf1d-9139-4aca-9408-574fa879b642 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:44.615048 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a89cf170-292e-4acb-be45-747e31325a1c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:44.628447 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a89cf170-292e-4acb-be45-747e31325a1c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1387 microversion: 2.1 time: 0.411999 Jul 25 14:37:44.631527 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1601/3000] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:44 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1387 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:37:44.702903 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4dd2bf1d-9139-4aca-9408-574fa879b642 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:44.714915 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4dd2bf1d-9139-4aca-9408-574fa879b642 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:44.716658 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4dd2bf1d-9139-4aca-9408-574fa879b642 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:44.718786 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4dd2bf1d-9139-4aca-9408-574fa879b642 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1357 microversion: 2.54 time: 0.194809 Jul 25 14:37:44.719900 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1400/3001] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:44 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1357 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:44.748586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-38e86ff6-8f8f-4701-9dc9-6c2666142c2c tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Action: 'create', calling method: .version_select at 0x7f46864fbca0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-890967624", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB49hL9ITT1eaepKIjJvTfkU6JAIIxVYFb+fZitMBXZ+YFxVMU6orGWkLvDslFqC8t4vBP+Bg2Z1nhP6b3xTavsIrT9F11QxJfDpAlAHuf8JLAbkAmZUcX42VH5WlcafXg=="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:44.794434 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-38e86ff6-8f8f-4701-9dc9-6c2666142c2c tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Getting quotas for project 97521c9f77b14e77adfeece6c536e3cb. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:37:44.811040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-38e86ff6-8f8f-4701-9dc9-6c2666142c2c tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Getting quotas for user 334d40ea432149cc9f438cd869bf9aee and project 97521c9f77b14e77adfeece6c536e3cb. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:37:44.875254 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-38e86ff6-8f8f-4701-9dc9-6c2666142c2c tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.131078 Jul 25 14:37:44.884167 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1602/3002] 10.222.0.88 () {62 vars in 1200 bytes} [Mon Jul 25 14:37:44 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 141 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 14:37:44.892497 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-14c890f6-84b0-4d0b-aeb7-9993166dbd58 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-890967624", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:44.903047 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-14c890f6-84b0-4d0b-aeb7-9993166dbd58 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:44.919062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-75da6c16-0e16-4f1b-9f62-4bcb46cbf114 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:44.919664 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-75da6c16-0e16-4f1b-9f62-4bcb46cbf114 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:44.924018 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14c890f6-84b0-4d0b-aeb7-9993166dbd58 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:44.925171 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14c890f6-84b0-4d0b-aeb7-9993166dbd58 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:44.928362 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14c890f6-84b0-4d0b-aeb7-9993166dbd58 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:44.929457 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14c890f6-84b0-4d0b-aeb7-9993166dbd58 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:44.936104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75da6c16-0e16-4f1b-9f62-4bcb46cbf114 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:44.936583 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75da6c16-0e16-4f1b-9f62-4bcb46cbf114 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:44.937363 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75da6c16-0e16-4f1b-9f62-4bcb46cbf114 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:44.937793 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75da6c16-0e16-4f1b-9f62-4bcb46cbf114 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:45.107341 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-14c890f6-84b0-4d0b-aeb7-9993166dbd58 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:37:45.107748 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-14c890f6-84b0-4d0b-aeb7-9993166dbd58 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:37:45.108249 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-14c890f6-84b0-4d0b-aeb7-9993166dbd58 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:37:45.108936 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-14c890f6-84b0-4d0b-aeb7-9993166dbd58 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:37:45.109346 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-14c890f6-84b0-4d0b-aeb7-9993166dbd58 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:37:45.313008 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-14c890f6-84b0-4d0b-aeb7-9993166dbd58 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:45.320095 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14c890f6-84b0-4d0b-aeb7-9993166dbd58 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:45.320584 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14c890f6-84b0-4d0b-aeb7-9993166dbd58 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:45.321411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14c890f6-84b0-4d0b-aeb7-9993166dbd58 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:45.321897 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14c890f6-84b0-4d0b-aeb7-9993166dbd58 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:45.370974 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-14c890f6-84b0-4d0b-aeb7-9993166dbd58 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "POST /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01/action" status: 202 len: 1139 microversion: 2.54 time: 0.485034 Jul 25 14:37:45.372591 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1401/3003] 10.222.0.88 () {62 vars in 1320 bytes} [Mon Jul 25 14:37:44 2022] POST /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01/action => generated 1139 bytes in 488 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Jul 25 14:37:45.385005 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-941e7bb2-51cf-4287-9776-6018b7c478d3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:45.387644 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-75da6c16-0e16-4f1b-9f62-4bcb46cbf114 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:45.388169 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-941e7bb2-51cf-4287-9776-6018b7c478d3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:45.399583 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-75da6c16-0e16-4f1b-9f62-4bcb46cbf114 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:45.402075 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-75da6c16-0e16-4f1b-9f62-4bcb46cbf114 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:45.403596 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-941e7bb2-51cf-4287-9776-6018b7c478d3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:45.404100 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-941e7bb2-51cf-4287-9776-6018b7c478d3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:45.406801 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-75da6c16-0e16-4f1b-9f62-4bcb46cbf114 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1808 microversion: 2.20 time: 0.491791 Jul 25 14:37:45.407925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-941e7bb2-51cf-4287-9776-6018b7c478d3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:45.408430 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-941e7bb2-51cf-4287-9776-6018b7c478d3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:45.409431 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1603/3004] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:44 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1808 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:45.433101 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e5e02085-5b2d-4501-8956-cb419701e2f3 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:45.433725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e5e02085-5b2d-4501-8956-cb419701e2f3 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:45.450844 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e5e02085-5b2d-4501-8956-cb419701e2f3 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:45.451296 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e5e02085-5b2d-4501-8956-cb419701e2f3 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:45.452186 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e5e02085-5b2d-4501-8956-cb419701e2f3 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:45.452615 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e5e02085-5b2d-4501-8956-cb419701e2f3 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:45.832680 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-941e7bb2-51cf-4287-9776-6018b7c478d3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:45.851962 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e5e02085-5b2d-4501-8956-cb419701e2f3 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:45.864898 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-941e7bb2-51cf-4287-9776-6018b7c478d3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1370 microversion: 2.1 time: 0.488969 Jul 25 14:37:45.866645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e5e02085-5b2d-4501-8956-cb419701e2f3 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:45.868136 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1402/3005] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:45 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1370 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:45.868895 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e5e02085-5b2d-4501-8956-cb419701e2f3 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:45.881550 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e5e02085-5b2d-4501-8956-cb419701e2f3 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1408 microversion: 2.54 time: 0.470426 Jul 25 14:37:45.882391 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1604/3006] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:45 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1408 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:45.887141 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-71ae100c-8868-43d2-ac50-b013664eb19e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:45.887933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-71ae100c-8868-43d2-ac50-b013664eb19e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:45.888286 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-308579db-612b-4157-ad33-c4f814fe7122 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:45.889256 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-308579db-612b-4157-ad33-c4f814fe7122 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:45.897072 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71ae100c-8868-43d2-ac50-b013664eb19e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:45.906724 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71ae100c-8868-43d2-ac50-b013664eb19e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:45.907786 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71ae100c-8868-43d2-ac50-b013664eb19e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:45.908435 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71ae100c-8868-43d2-ac50-b013664eb19e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:45.913178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-308579db-612b-4157-ad33-c4f814fe7122 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:45.913689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-308579db-612b-4157-ad33-c4f814fe7122 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:45.915775 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-308579db-612b-4157-ad33-c4f814fe7122 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:45.915775 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-308579db-612b-4157-ad33-c4f814fe7122 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:46.056994 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-308579db-612b-4157-ad33-c4f814fe7122 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:46.070077 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-308579db-612b-4157-ad33-c4f814fe7122 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:46.072615 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-308579db-612b-4157-ad33-c4f814fe7122 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:46.074040 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-308579db-612b-4157-ad33-c4f814fe7122 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1604 microversion: 2.42 time: 0.203646 Jul 25 14:37:46.075264 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1403/3007] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:45 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1604 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:46.274694 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-71ae100c-8868-43d2-ac50-b013664eb19e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:46.292164 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-71ae100c-8868-43d2-ac50-b013664eb19e tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1387 microversion: 2.1 time: 0.404855 Jul 25 14:37:46.293564 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1605/3008] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:45 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1387 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:46.433229 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8bbbf78d-38eb-4627-8caf-278bc91f9340 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:46.433718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8bbbf78d-38eb-4627-8caf-278bc91f9340 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:46.446654 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8bbbf78d-38eb-4627-8caf-278bc91f9340 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:46.450687 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8bbbf78d-38eb-4627-8caf-278bc91f9340 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:46.460413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-32a83c3b-bc9c-4485-8904-6cf28b3a96df req-42529e4c-a7f9-4d56-b921-dc99d02d1eac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fac258f1-785d-4dd9-bc68-0ee713c9149a", "tag": "f04995f2-50af-408b-81f1-cda226840583"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:46.461753 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8bbbf78d-38eb-4627-8caf-278bc91f9340 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:46.466916 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8bbbf78d-38eb-4627-8caf-278bc91f9340 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:46.484144 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-32a83c3b-bc9c-4485-8904-6cf28b3a96df req-42529e4c-a7f9-4d56-b921-dc99d02d1eac service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:46.488212 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-32a83c3b-bc9c-4485-8904-6cf28b3a96df req-42529e4c-a7f9-4d56-b921-dc99d02d1eac service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:46.520754 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-32a83c3b-bc9c-4485-8904-6cf28b3a96df req-42529e4c-a7f9-4d56-b921-dc99d02d1eac service nova] Creating event network-changed:f04995f2-50af-408b-81f1-cda226840583 for instance fac258f1-785d-4dd9-bc68-0ee713c9149a on n-h1-846435-14 Jul 25 14:37:46.547084 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-32a83c3b-bc9c-4485-8904-6cf28b3a96df req-42529e4c-a7f9-4d56-b921-dc99d02d1eac service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086938 Jul 25 14:37:46.550975 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1606/3009] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:37:46.856384 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8bbbf78d-38eb-4627-8caf-278bc91f9340 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:46.865656 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8bbbf78d-38eb-4627-8caf-278bc91f9340 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:46.867556 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8bbbf78d-38eb-4627-8caf-278bc91f9340 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:46.872358 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8bbbf78d-38eb-4627-8caf-278bc91f9340 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1808 microversion: 2.20 time: 0.444822 Jul 25 14:37:46.876381 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1404/3010] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:46 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1808 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:46.891840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6b4f7db2-9692-478e-b8a8-b28cb10e0185 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:46.892593 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6b4f7db2-9692-478e-b8a8-b28cb10e0185 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:46.908488 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-09a9faf8-caab-44b5-adf9-506111cc7f9e tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:46.909128 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-09a9faf8-caab-44b5-adf9-506111cc7f9e tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:46.926004 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-09a9faf8-caab-44b5-adf9-506111cc7f9e tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:46.926648 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-09a9faf8-caab-44b5-adf9-506111cc7f9e tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:46.927321 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-09a9faf8-caab-44b5-adf9-506111cc7f9e tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:46.930253 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-09a9faf8-caab-44b5-adf9-506111cc7f9e tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:46.931917 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:37:46.936858 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6b4f7db2-9692-478e-b8a8-b28cb10e0185 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:46.937710 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6b4f7db2-9692-478e-b8a8-b28cb10e0185 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:46.941506 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6b4f7db2-9692-478e-b8a8-b28cb10e0185 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:46.942475 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6b4f7db2-9692-478e-b8a8-b28cb10e0185 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:47.069317 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-09a9faf8-caab-44b5-adf9-506111cc7f9e tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:47.080036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-09a9faf8-caab-44b5-adf9-506111cc7f9e tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:47.082153 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-09a9faf8-caab-44b5-adf9-506111cc7f9e tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:47.094517 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-09a9faf8-caab-44b5-adf9-506111cc7f9e tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1408 microversion: 2.54 time: 0.189767 Jul 25 14:37:47.095611 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1405/3011] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:46 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1408 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:47.100984 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8727318b-5af1-478b-b9de-3afe7b34b866 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:47.101913 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8727318b-5af1-478b-b9de-3afe7b34b866 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:47.115631 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8727318b-5af1-478b-b9de-3afe7b34b866 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:47.116460 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8727318b-5af1-478b-b9de-3afe7b34b866 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:47.117452 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8727318b-5af1-478b-b9de-3afe7b34b866 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:47.118543 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8727318b-5af1-478b-b9de-3afe7b34b866 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:47.343123 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8727318b-5af1-478b-b9de-3afe7b34b866 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:47.356416 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8727318b-5af1-478b-b9de-3afe7b34b866 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:47.359249 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8727318b-5af1-478b-b9de-3afe7b34b866 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:47.361495 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8727318b-5af1-478b-b9de-3afe7b34b866 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1604 microversion: 2.42 time: 0.264043 Jul 25 14:37:47.362611 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1406/3012] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:47 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1604 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:47.367828 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0bc6d77c-20e6-4d99-b828-da9d6c8684f1 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:47.368722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0bc6d77c-20e6-4d99-b828-da9d6c8684f1 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:47.375551 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0bc6d77c-20e6-4d99-b828-da9d6c8684f1 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:47.376305 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0bc6d77c-20e6-4d99-b828-da9d6c8684f1 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:47.377264 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0bc6d77c-20e6-4d99-b828-da9d6c8684f1 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:47.377854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0bc6d77c-20e6-4d99-b828-da9d6c8684f1 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:47.469104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6b4f7db2-9692-478e-b8a8-b28cb10e0185 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:47.484590 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6b4f7db2-9692-478e-b8a8-b28cb10e0185 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1370 microversion: 2.1 time: 0.592762 Jul 25 14:37:47.497830 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1607/3013] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:46 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1370 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:47.818949 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0bc6d77c-20e6-4d99-b828-da9d6c8684f1 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:47.836256 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0bc6d77c-20e6-4d99-b828-da9d6c8684f1 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1387 microversion: 2.1 time: 0.472200 Jul 25 14:37:47.837090 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1407/3014] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:47 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1387 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:47.898777 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ff5d64aa-3f60-4aa4-a187-e2585b130637 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:47.899322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ff5d64aa-3f60-4aa4-a187-e2585b130637 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:47.906630 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff5d64aa-3f60-4aa4-a187-e2585b130637 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:47.907312 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff5d64aa-3f60-4aa4-a187-e2585b130637 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:47.908282 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff5d64aa-3f60-4aa4-a187-e2585b130637 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:47.908862 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff5d64aa-3f60-4aa4-a187-e2585b130637 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:48.123318 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9c6b3600-9a07-4955-a962-a1fd0de60114 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:48.124568 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9c6b3600-9a07-4955-a962-a1fd0de60114 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:48.131433 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9c6b3600-9a07-4955-a962-a1fd0de60114 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:48.132142 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9c6b3600-9a07-4955-a962-a1fd0de60114 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:48.133117 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9c6b3600-9a07-4955-a962-a1fd0de60114 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:48.133703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9c6b3600-9a07-4955-a962-a1fd0de60114 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:48.229845 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9c6b3600-9a07-4955-a962-a1fd0de60114 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:48.245119 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ff5d64aa-3f60-4aa4-a187-e2585b130637 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:48.246365 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9c6b3600-9a07-4955-a962-a1fd0de60114 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:48.247932 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9c6b3600-9a07-4955-a962-a1fd0de60114 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:48.249157 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9c6b3600-9a07-4955-a962-a1fd0de60114 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1408 microversion: 2.54 time: 0.129800 Jul 25 14:37:48.249728 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1408/3015] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:48 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1408 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:48.256460 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ff5d64aa-3f60-4aa4-a187-e2585b130637 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:48.258169 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ff5d64aa-3f60-4aa4-a187-e2585b130637 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:48.259420 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ff5d64aa-3f60-4aa4-a187-e2585b130637 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1808 microversion: 2.20 time: 0.364830 Jul 25 14:37:48.260484 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1608/3016] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:47 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1808 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:48.385778 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-df1e1f55-8dd3-41f0-8c9f-8ff4892d7881 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:48.386755 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-df1e1f55-8dd3-41f0-8c9f-8ff4892d7881 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:48.397433 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-df1e1f55-8dd3-41f0-8c9f-8ff4892d7881 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:48.398171 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-df1e1f55-8dd3-41f0-8c9f-8ff4892d7881 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:48.399171 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-df1e1f55-8dd3-41f0-8c9f-8ff4892d7881 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:48.400335 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-df1e1f55-8dd3-41f0-8c9f-8ff4892d7881 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:48.504014 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-df1e1f55-8dd3-41f0-8c9f-8ff4892d7881 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:48.506214 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-24d295b5-e38f-4045-acba-adf5cb4ca6fb tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:48.507138 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-24d295b5-e38f-4045-acba-adf5cb4ca6fb tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:48.516331 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-df1e1f55-8dd3-41f0-8c9f-8ff4892d7881 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:48.518162 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-df1e1f55-8dd3-41f0-8c9f-8ff4892d7881 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:48.519705 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-df1e1f55-8dd3-41f0-8c9f-8ff4892d7881 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1604 microversion: 2.42 time: 0.137803 Jul 25 14:37:48.520393 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1409/3017] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:48 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1604 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:48.526181 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-24d295b5-e38f-4045-acba-adf5cb4ca6fb tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:48.528436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-24d295b5-e38f-4045-acba-adf5cb4ca6fb tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:48.529427 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-24d295b5-e38f-4045-acba-adf5cb4ca6fb tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:48.530017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-24d295b5-e38f-4045-acba-adf5cb4ca6fb tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:48.578138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-b4a77a9a-74f0-4dc4-82b9-ec72da8c7e94 req-4ca6ef89-3ee0-40c1-889a-396d509184ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e", "name": "network-vif-deleted", "tag": "53dcf2fd-d803-419e-ac77-4ff7d0c3b117"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:48.589115 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b4a77a9a-74f0-4dc4-82b9-ec72da8c7e94 req-4ca6ef89-3ee0-40c1-889a-396d509184ed service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:48.589475 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b4a77a9a-74f0-4dc4-82b9-ec72da8c7e94 req-4ca6ef89-3ee0-40c1-889a-396d509184ed service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:48.608584 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-b4a77a9a-74f0-4dc4-82b9-ec72da8c7e94 req-4ca6ef89-3ee0-40c1-889a-396d509184ed service nova] Creating event network-vif-deleted:53dcf2fd-d803-419e-ac77-4ff7d0c3b117 for instance 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e on n-h2-846435-14 Jul 25 14:37:48.614650 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-b4a77a9a-74f0-4dc4-82b9-ec72da8c7e94 req-4ca6ef89-3ee0-40c1-889a-396d509184ed service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040094 Jul 25 14:37:48.615853 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1410/3018] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:37:48.715945 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-24d295b5-e38f-4045-acba-adf5cb4ca6fb tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:48.727285 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-24d295b5-e38f-4045-acba-adf5cb4ca6fb tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1370 microversion: 2.1 time: 0.225580 Jul 25 14:37:48.728236 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1609/3019] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:48 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1370 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:37:48.858010 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-23efb811-3bd5-4f1b-8a72-ebe491508bc4 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:48.858683 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-23efb811-3bd5-4f1b-8a72-ebe491508bc4 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:48.866360 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-23efb811-3bd5-4f1b-8a72-ebe491508bc4 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:48.867069 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-23efb811-3bd5-4f1b-8a72-ebe491508bc4 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:48.868157 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-23efb811-3bd5-4f1b-8a72-ebe491508bc4 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:48.868639 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-23efb811-3bd5-4f1b-8a72-ebe491508bc4 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:48.938550 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:37:48.997509 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-23efb811-3bd5-4f1b-8a72-ebe491508bc4 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:49.010090 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-23efb811-3bd5-4f1b-8a72-ebe491508bc4 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1184 microversion: 2.1 time: 0.156362 Jul 25 14:37:49.011689 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1411/3020] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:48 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1184 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:49.273715 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5c0adc35-7649-49df-bf4b-3daa746a167d tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:49.274690 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5c0adc35-7649-49df-bf4b-3daa746a167d tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:49.285888 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6768dde1-f289-4b4a-836b-d4186921c411 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:49.287182 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6768dde1-f289-4b4a-836b-d4186921c411 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:49.294336 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:37:49.296070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c0adc35-7649-49df-bf4b-3daa746a167d tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:49.296585 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c0adc35-7649-49df-bf4b-3daa746a167d tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:49.296976 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6768dde1-f289-4b4a-836b-d4186921c411 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:49.297397 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c0adc35-7649-49df-bf4b-3daa746a167d tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:49.297855 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c0adc35-7649-49df-bf4b-3daa746a167d tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:49.298470 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6768dde1-f289-4b4a-836b-d4186921c411 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:49.299956 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6768dde1-f289-4b4a-836b-d4186921c411 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:49.300929 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6768dde1-f289-4b4a-836b-d4186921c411 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:49.415755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5c0adc35-7649-49df-bf4b-3daa746a167d tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:49.433254 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5c0adc35-7649-49df-bf4b-3daa746a167d tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:49.435790 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5c0adc35-7649-49df-bf4b-3daa746a167d tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:49.441605 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5c0adc35-7649-49df-bf4b-3daa746a167d tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1408 microversion: 2.54 time: 0.172764 Jul 25 14:37:49.443168 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1610/3021] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:49 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:49.550288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7114b5e9-6496-4335-817b-f49a99fc83db tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:49.552372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7114b5e9-6496-4335-817b-f49a99fc83db tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:49.577248 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7114b5e9-6496-4335-817b-f49a99fc83db tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:49.578558 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7114b5e9-6496-4335-817b-f49a99fc83db tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:49.580128 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7114b5e9-6496-4335-817b-f49a99fc83db tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:49.580657 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7114b5e9-6496-4335-817b-f49a99fc83db tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:49.638161 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6768dde1-f289-4b4a-836b-d4186921c411 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:49.651673 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6768dde1-f289-4b4a-836b-d4186921c411 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:49.653759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6768dde1-f289-4b4a-836b-d4186921c411 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:49.655152 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6768dde1-f289-4b4a-836b-d4186921c411 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1808 microversion: 2.20 time: 0.376063 Jul 25 14:37:49.656030 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1412/3022] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:49 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1808 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:49.687655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7114b5e9-6496-4335-817b-f49a99fc83db tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:49.698309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7114b5e9-6496-4335-817b-f49a99fc83db tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:49.700384 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7114b5e9-6496-4335-817b-f49a99fc83db tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:49.702139 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7114b5e9-6496-4335-817b-f49a99fc83db tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1604 microversion: 2.42 time: 0.159516 Jul 25 14:37:49.703048 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1611/3023] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:49 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1604 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:37:49.750077 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bd187038-2a1d-4e59-890d-0d45e97d6c7c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:49.751303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bd187038-2a1d-4e59-890d-0d45e97d6c7c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:49.758687 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd187038-2a1d-4e59-890d-0d45e97d6c7c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:49.759462 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd187038-2a1d-4e59-890d-0d45e97d6c7c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:49.760793 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd187038-2a1d-4e59-890d-0d45e97d6c7c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:49.761603 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd187038-2a1d-4e59-890d-0d45e97d6c7c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:49.783230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:37:49.944729 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bd187038-2a1d-4e59-890d-0d45e97d6c7c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:49.953545 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bd187038-2a1d-4e59-890d-0d45e97d6c7c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1370 microversion: 2.1 time: 0.207578 Jul 25 14:37:49.954140 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1413/3024] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:49 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1370 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:50.038418 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e07c8d97-194c-4464-8d72-b1046f166d0c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:50.039165 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e07c8d97-194c-4464-8d72-b1046f166d0c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:50.046349 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e07c8d97-194c-4464-8d72-b1046f166d0c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:50.046791 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e07c8d97-194c-4464-8d72-b1046f166d0c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:50.047867 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e07c8d97-194c-4464-8d72-b1046f166d0c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:50.048371 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e07c8d97-194c-4464-8d72-b1046f166d0c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:50.139710 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e07c8d97-194c-4464-8d72-b1046f166d0c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:50.149314 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e07c8d97-194c-4464-8d72-b1046f166d0c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1184 microversion: 2.1 time: 0.115428 Jul 25 14:37:50.149919 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1612/3025] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:50 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1184 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:50.466057 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4cef58e9-87f8-40e8-b5e0-e50a69c85d3c tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:50.467463 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4cef58e9-87f8-40e8-b5e0-e50a69c85d3c tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:50.473673 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=8 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:37:50.476840 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4cef58e9-87f8-40e8-b5e0-e50a69c85d3c tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:50.477632 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4cef58e9-87f8-40e8-b5e0-e50a69c85d3c tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:50.478793 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4cef58e9-87f8-40e8-b5e0-e50a69c85d3c tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:50.479472 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4cef58e9-87f8-40e8-b5e0-e50a69c85d3c tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:50.570683 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4cef58e9-87f8-40e8-b5e0-e50a69c85d3c tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:50.579219 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4cef58e9-87f8-40e8-b5e0-e50a69c85d3c tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:50.581338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4cef58e9-87f8-40e8-b5e0-e50a69c85d3c tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:50.582697 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4cef58e9-87f8-40e8-b5e0-e50a69c85d3c tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1408 microversion: 2.54 time: 0.120781 Jul 25 14:37:50.583679 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1414/3026] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:50 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1408 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:50.684507 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0ed61c16-7c21-4082-ae0e-c54068e05102 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:50.685715 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0ed61c16-7c21-4082-ae0e-c54068e05102 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:50.696292 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0ed61c16-7c21-4082-ae0e-c54068e05102 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:50.696975 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0ed61c16-7c21-4082-ae0e-c54068e05102 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:50.697752 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0ed61c16-7c21-4082-ae0e-c54068e05102 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:50.698538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0ed61c16-7c21-4082-ae0e-c54068e05102 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:50.704550 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:37:50.745521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-538be38b-6fcc-48cc-be5f-73dcc86ddcee tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:50.748333 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-538be38b-6fcc-48cc-be5f-73dcc86ddcee tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:50.761551 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-538be38b-6fcc-48cc-be5f-73dcc86ddcee tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:50.762365 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-538be38b-6fcc-48cc-be5f-73dcc86ddcee tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:50.762956 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-538be38b-6fcc-48cc-be5f-73dcc86ddcee tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:50.763595 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-538be38b-6fcc-48cc-be5f-73dcc86ddcee tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:50.881415 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-538be38b-6fcc-48cc-be5f-73dcc86ddcee tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:50.907772 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-538be38b-6fcc-48cc-be5f-73dcc86ddcee tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:50.911999 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-538be38b-6fcc-48cc-be5f-73dcc86ddcee tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:50.914841 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-538be38b-6fcc-48cc-be5f-73dcc86ddcee tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1604 microversion: 2.42 time: 0.187078 Jul 25 14:37:50.916977 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1415/3027] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:50 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1604 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:50.929654 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0ed61c16-7c21-4082-ae0e-c54068e05102 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:50.949812 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0ed61c16-7c21-4082-ae0e-c54068e05102 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:50.952385 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0ed61c16-7c21-4082-ae0e-c54068e05102 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:50.954807 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0ed61c16-7c21-4082-ae0e-c54068e05102 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1808 microversion: 2.20 time: 0.275543 Jul 25 14:37:50.971295 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1613/3028] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:50 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1808 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:50.976016 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b8af32be-a625-423f-9c8e-7a84e6a3dfd5 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:50.976231 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b8af32be-a625-423f-9c8e-7a84e6a3dfd5 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:50.982730 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8af32be-a625-423f-9c8e-7a84e6a3dfd5 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:50.983252 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8af32be-a625-423f-9c8e-7a84e6a3dfd5 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:50.984211 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8af32be-a625-423f-9c8e-7a84e6a3dfd5 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:50.984871 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8af32be-a625-423f-9c8e-7a84e6a3dfd5 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:51.172472 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3d8bcb46-3751-45af-a4fd-d77af742db40 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:51.173443 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3d8bcb46-3751-45af-a4fd-d77af742db40 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:51.180662 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3d8bcb46-3751-45af-a4fd-d77af742db40 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:51.181407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3d8bcb46-3751-45af-a4fd-d77af742db40 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:51.182436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3d8bcb46-3751-45af-a4fd-d77af742db40 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:51.183062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3d8bcb46-3751-45af-a4fd-d77af742db40 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:51.230859 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b8af32be-a625-423f-9c8e-7a84e6a3dfd5 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:51.240387 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b8af32be-a625-423f-9c8e-7a84e6a3dfd5 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1370 microversion: 2.1 time: 0.269288 Jul 25 14:37:51.243923 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1416/3029] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:50 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1370 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:51.270598 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3d8bcb46-3751-45af-a4fd-d77af742db40 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:51.279542 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3d8bcb46-3751-45af-a4fd-d77af742db40 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1184 microversion: 2.1 time: 0.111152 Jul 25 14:37:51.293293 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1614/3030] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:51 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1184 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:51.608731 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-aba09414-f729-4ea0-8360-fbfae19b1b6b tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:51.610234 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-aba09414-f729-4ea0-8360-fbfae19b1b6b tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:51.626023 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aba09414-f729-4ea0-8360-fbfae19b1b6b tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:51.626924 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aba09414-f729-4ea0-8360-fbfae19b1b6b tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:51.628826 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aba09414-f729-4ea0-8360-fbfae19b1b6b tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:51.629806 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aba09414-f729-4ea0-8360-fbfae19b1b6b tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:51.939908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fcf626bc-6739-47b8-8403-b453bbc1c8e8 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:51.940573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fcf626bc-6739-47b8-8403-b453bbc1c8e8 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:51.947586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fcf626bc-6739-47b8-8403-b453bbc1c8e8 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:51.948068 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fcf626bc-6739-47b8-8403-b453bbc1c8e8 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:51.949012 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fcf626bc-6739-47b8-8403-b453bbc1c8e8 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:51.949631 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fcf626bc-6739-47b8-8403-b453bbc1c8e8 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:52.029365 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-aba09414-f729-4ea0-8360-fbfae19b1b6b tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:52.038431 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-aba09414-f729-4ea0-8360-fbfae19b1b6b tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:52.051757 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-aba09414-f729-4ea0-8360-fbfae19b1b6b tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:52.053339 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-aba09414-f729-4ea0-8360-fbfae19b1b6b tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1408 microversion: 2.54 time: 0.450909 Jul 25 14:37:52.059408 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fcf626bc-6739-47b8-8403-b453bbc1c8e8 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:52.069071 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1417/3031] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:51 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1408 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:52.073015 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fcf626bc-6739-47b8-8403-b453bbc1c8e8 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:52.074807 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fcf626bc-6739-47b8-8403-b453bbc1c8e8 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:52.076826 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fcf626bc-6739-47b8-8403-b453bbc1c8e8 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1604 microversion: 2.42 time: 0.141222 Jul 25 14:37:52.082285 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f80c64ca-e8bd-48e7-9aed-44b9c05bd1ce tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:52.083117 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f80c64ca-e8bd-48e7-9aed-44b9c05bd1ce tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:52.089326 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1615/3032] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:51 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1604 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:52.105526 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f80c64ca-e8bd-48e7-9aed-44b9c05bd1ce tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:52.113972 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f80c64ca-e8bd-48e7-9aed-44b9c05bd1ce tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:52.115230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f80c64ca-e8bd-48e7-9aed-44b9c05bd1ce tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:52.115895 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f80c64ca-e8bd-48e7-9aed-44b9c05bd1ce tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:52.262755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2e727614-1790-4c61-9ff8-15c133623b66 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:52.263674 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2e727614-1790-4c61-9ff8-15c133623b66 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:52.271772 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2e727614-1790-4c61-9ff8-15c133623b66 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:52.275853 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2e727614-1790-4c61-9ff8-15c133623b66 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:52.276894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2e727614-1790-4c61-9ff8-15c133623b66 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:52.277351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2e727614-1790-4c61-9ff8-15c133623b66 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:52.451309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2e727614-1790-4c61-9ff8-15c133623b66 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:52.460141 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2e727614-1790-4c61-9ff8-15c133623b66 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1370 microversion: 2.1 time: 0.202224 Jul 25 14:37:52.463264 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1616/3033] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:52 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1370 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:37:52.469316 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dff79d53-9a2f-4aed-97fb-e824a1f845f0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:52.470290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dff79d53-9a2f-4aed-97fb-e824a1f845f0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:52.483264 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f80c64ca-e8bd-48e7-9aed-44b9c05bd1ce tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:52.490919 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dff79d53-9a2f-4aed-97fb-e824a1f845f0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:52.491862 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dff79d53-9a2f-4aed-97fb-e824a1f845f0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:52.494054 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dff79d53-9a2f-4aed-97fb-e824a1f845f0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:52.496088 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dff79d53-9a2f-4aed-97fb-e824a1f845f0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:52.496287 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f80c64ca-e8bd-48e7-9aed-44b9c05bd1ce tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:52.497765 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f80c64ca-e8bd-48e7-9aed-44b9c05bd1ce tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:52.498954 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f80c64ca-e8bd-48e7-9aed-44b9c05bd1ce tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1808 microversion: 2.20 time: 0.428814 Jul 25 14:37:52.512315 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1418/3034] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:52 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1808 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:52.577171 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dff79d53-9a2f-4aed-97fb-e824a1f845f0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:52.585247 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dff79d53-9a2f-4aed-97fb-e824a1f845f0 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1184 microversion: 2.1 time: 0.120861 Jul 25 14:37:52.586115 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1617/3035] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:52 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1184 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:53.081524 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a01595d5-4488-4172-afad-aed6f0d17a07 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:53.082143 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a01595d5-4488-4172-afad-aed6f0d17a07 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:53.097952 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a01595d5-4488-4172-afad-aed6f0d17a07 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:53.098677 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a01595d5-4488-4172-afad-aed6f0d17a07 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:53.099763 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a01595d5-4488-4172-afad-aed6f0d17a07 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:53.100403 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a01595d5-4488-4172-afad-aed6f0d17a07 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:53.103280 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-90d9527c-7a98-4f8e-89fe-e7f526195d4b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:53.104121 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-90d9527c-7a98-4f8e-89fe-e7f526195d4b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:53.123206 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-90d9527c-7a98-4f8e-89fe-e7f526195d4b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:53.124104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-90d9527c-7a98-4f8e-89fe-e7f526195d4b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:53.126930 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-90d9527c-7a98-4f8e-89fe-e7f526195d4b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:53.127438 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-90d9527c-7a98-4f8e-89fe-e7f526195d4b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:53.203335 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a01595d5-4488-4172-afad-aed6f0d17a07 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:53.218900 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a01595d5-4488-4172-afad-aed6f0d17a07 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:53.220933 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a01595d5-4488-4172-afad-aed6f0d17a07 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:53.222379 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a01595d5-4488-4172-afad-aed6f0d17a07 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1408 microversion: 2.54 time: 0.145440 Jul 25 14:37:53.223523 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1419/3036] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:53 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1408 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:53.271521 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-90d9527c-7a98-4f8e-89fe-e7f526195d4b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:53.286102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-90d9527c-7a98-4f8e-89fe-e7f526195d4b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:53.288290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-90d9527c-7a98-4f8e-89fe-e7f526195d4b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:53.289774 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-90d9527c-7a98-4f8e-89fe-e7f526195d4b tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1604 microversion: 2.42 time: 0.190806 Jul 25 14:37:53.290637 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1618/3037] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:53 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1604 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:53.481758 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-73f3d139-45ae-4131-aad4-ea3faba20903 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:53.482387 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-73f3d139-45ae-4131-aad4-ea3faba20903 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:53.491257 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-73f3d139-45ae-4131-aad4-ea3faba20903 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:53.491879 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-73f3d139-45ae-4131-aad4-ea3faba20903 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:53.492811 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-73f3d139-45ae-4131-aad4-ea3faba20903 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:53.493416 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-73f3d139-45ae-4131-aad4-ea3faba20903 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:53.526681 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-52afbe0e-fb11-4b03-8a39-c8cd10f56744 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:53.528657 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-52afbe0e-fb11-4b03-8a39-c8cd10f56744 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:53.541372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52afbe0e-fb11-4b03-8a39-c8cd10f56744 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:53.548971 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52afbe0e-fb11-4b03-8a39-c8cd10f56744 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:53.556756 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52afbe0e-fb11-4b03-8a39-c8cd10f56744 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:53.560203 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52afbe0e-fb11-4b03-8a39-c8cd10f56744 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:53.759375 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-73f3d139-45ae-4131-aad4-ea3faba20903 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:53.772740 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-73f3d139-45ae-4131-aad4-ea3faba20903 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1370 microversion: 2.1 time: 0.294710 Jul 25 14:37:53.774220 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1420/3038] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:53 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1370 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:53.793780 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-857f2806-a825-4b5a-b77d-b919cd193d2c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:53.794629 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-857f2806-a825-4b5a-b77d-b919cd193d2c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:53.819129 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-857f2806-a825-4b5a-b77d-b919cd193d2c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:53.820138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-857f2806-a825-4b5a-b77d-b919cd193d2c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:53.821129 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-857f2806-a825-4b5a-b77d-b919cd193d2c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:53.821566 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-857f2806-a825-4b5a-b77d-b919cd193d2c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:53.900831 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-857f2806-a825-4b5a-b77d-b919cd193d2c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:53.901307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-857f2806-a825-4b5a-b77d-b919cd193d2c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:53.902955 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-857f2806-a825-4b5a-b77d-b919cd193d2c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lazy-loading 'fault' on Instance uuid 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:37:53.973075 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-857f2806-a825-4b5a-b77d-b919cd193d2c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:53.984523 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-857f2806-a825-4b5a-b77d-b919cd193d2c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 200 len: 1143 microversion: 2.1 time: 0.207732 Jul 25 14:37:53.997559 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1421/3039] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:53 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 1143 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:54.091854 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-52afbe0e-fb11-4b03-8a39-c8cd10f56744 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:54.100702 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-52afbe0e-fb11-4b03-8a39-c8cd10f56744 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:54.102061 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-52afbe0e-fb11-4b03-8a39-c8cd10f56744 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:54.103552 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-52afbe0e-fb11-4b03-8a39-c8cd10f56744 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1808 microversion: 2.20 time: 0.584276 Jul 25 14:37:54.104865 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1619/3040] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:53 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1808 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:37:54.120591 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-f15ab317-bc3c-4867-9738-a157eef93e4e req-480fe2d5-e8b5-4ead-a836-4110ef07a999 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fac258f1-785d-4dd9-bc68-0ee713c9149a", "name": "network-vif-plugged", "status": "completed", "tag": "f04995f2-50af-408b-81f1-cda226840583"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:54.125697 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f15ab317-bc3c-4867-9738-a157eef93e4e req-480fe2d5-e8b5-4ead-a836-4110ef07a999 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:54.126151 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f15ab317-bc3c-4867-9738-a157eef93e4e req-480fe2d5-e8b5-4ead-a836-4110ef07a999 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:54.139355 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-f15ab317-bc3c-4867-9738-a157eef93e4e req-480fe2d5-e8b5-4ead-a836-4110ef07a999 service nova] Creating event network-vif-plugged:f04995f2-50af-408b-81f1-cda226840583 for instance fac258f1-785d-4dd9-bc68-0ee713c9149a on n-h1-846435-14 Jul 25 14:37:54.145815 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-f15ab317-bc3c-4867-9738-a157eef93e4e req-480fe2d5-e8b5-4ead-a836-4110ef07a999 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035742 Jul 25 14:37:54.146779 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1422/3041] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:54.246695 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-93e51beb-0c8d-4e22-9d05-faed13bafb8a tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:54.247243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-93e51beb-0c8d-4e22-9d05-faed13bafb8a tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:54.261369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-93e51beb-0c8d-4e22-9d05-faed13bafb8a tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:54.261823 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-93e51beb-0c8d-4e22-9d05-faed13bafb8a tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:54.262619 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-93e51beb-0c8d-4e22-9d05-faed13bafb8a tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:54.263052 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-93e51beb-0c8d-4e22-9d05-faed13bafb8a tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:54.316391 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-20c829ab-69c8-4e3b-b0fb-9fe08dfc655c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:54.317446 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-20c829ab-69c8-4e3b-b0fb-9fe08dfc655c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:54.325551 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-20c829ab-69c8-4e3b-b0fb-9fe08dfc655c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:54.326433 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-20c829ab-69c8-4e3b-b0fb-9fe08dfc655c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:54.327822 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-20c829ab-69c8-4e3b-b0fb-9fe08dfc655c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:54.328905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-20c829ab-69c8-4e3b-b0fb-9fe08dfc655c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:54.369978 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-93e51beb-0c8d-4e22-9d05-faed13bafb8a tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:54.381841 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-93e51beb-0c8d-4e22-9d05-faed13bafb8a tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:54.383448 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-93e51beb-0c8d-4e22-9d05-faed13bafb8a tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:54.384714 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-93e51beb-0c8d-4e22-9d05-faed13bafb8a tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1408 microversion: 2.54 time: 0.142222 Jul 25 14:37:54.388824 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1620/3042] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:54 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1408 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:54.457305 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-20c829ab-69c8-4e3b-b0fb-9fe08dfc655c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:54.469408 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-20c829ab-69c8-4e3b-b0fb-9fe08dfc655c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:54.472674 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-20c829ab-69c8-4e3b-b0fb-9fe08dfc655c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:54.473856 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-20c829ab-69c8-4e3b-b0fb-9fe08dfc655c tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1604 microversion: 2.42 time: 0.163437 Jul 25 14:37:54.474778 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1423/3043] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:54 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1604 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:54.794082 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bc2418ee-430e-4ba3-91bd-52d3746c116e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:54.794763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bc2418ee-430e-4ba3-91bd-52d3746c116e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:54.801314 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bc2418ee-430e-4ba3-91bd-52d3746c116e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:54.801761 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bc2418ee-430e-4ba3-91bd-52d3746c116e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:54.802529 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bc2418ee-430e-4ba3-91bd-52d3746c116e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:54.809189 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bc2418ee-430e-4ba3-91bd-52d3746c116e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:54.848651 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=16 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:37:55.008679 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ce98a7e2-3d2e-4942-9a37-fa7b75c405e5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:55.009225 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ce98a7e2-3d2e-4942-9a37-fa7b75c405e5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:55.016564 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ce98a7e2-3d2e-4942-9a37-fa7b75c405e5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:55.016794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ce98a7e2-3d2e-4942-9a37-fa7b75c405e5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:55.017797 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ce98a7e2-3d2e-4942-9a37-fa7b75c405e5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:55.018448 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ce98a7e2-3d2e-4942-9a37-fa7b75c405e5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:55.044247 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-ce98a7e2-3d2e-4942-9a37-fa7b75c405e5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] HTTP exception thrown: Instance 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e could not be found. Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ce98a7e2-3d2e-4942-9a37-fa7b75c405e5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Request method failure captured: Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e HTTP/1.1 Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qj7qGPct9b6C-uL3HbJd-QfzuzhSMgcQq60rAmLf4omKe0e-YflewTadRMLO-QcFD0lbvZaMv23hN_u3lrPF6ypkGfUy6kSr42d07ldMTgv9Be8O_z4PIw3ikjNbHHM9Htwnk6fHnsGS0qStvlssGykbQn_HCa6zv_OMCTCaQuVLpM Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: ceaa4430d1864bc2bf9afdec9cd0cf64 Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-LiveMigrationTest-1104846204 Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ceaa4430d1864bc2bf9afdec9cd0cf64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ceaa4430d1864bc2bf9afdec9cd0cf64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ceaa4430d1864bc2bf9afdec9cd0cf64", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ceaa4430d1864bc2bf9afdec9cd0cf64"}]}] Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-LiveMigrationTest-1104846204 Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: ceaa4430d1864bc2bf9afdec9cd0cf64 Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-LiveMigrationTest-1104846204 Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-LiveMigrationTest-1104846204-project Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 3da7c9a3c01f4dbca93d5e7aa688fc70 Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-LiveMigrationTest-1104846204-project Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e could not be found. Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e'} Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e could not be found. Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e could not be found. Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:37:55.046931 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:55.051905 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:37:55.051905 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:37:55.051905 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:37:55.051905 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:37:55.051905 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:37:55.051905 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e could not be found. Jul 25 14:37:55.051905 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:37:55.053988 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ce98a7e2-3d2e-4942-9a37-fa7b75c405e5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Returning 404 to user: Instance 9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:37:55.055379 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ce98a7e2-3d2e-4942-9a37-fa7b75c405e5 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e" status: 404 len: 111 microversion: 2.1 time: 0.050595 Jul 25 14:37:55.056945 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1424/3044] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:55 2022] GET /compute/v2.1/servers/9dae4e3c-e5f2-4f73-9d89-d8e94be2b55e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:37:55.131528 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2c8b37ff-dfae-4503-b712-8f3c5a4bcf7c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:55.133156 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2c8b37ff-dfae-4503-b712-8f3c5a4bcf7c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:55.165703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c8b37ff-dfae-4503-b712-8f3c5a4bcf7c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:55.166511 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c8b37ff-dfae-4503-b712-8f3c5a4bcf7c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:55.169295 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c8b37ff-dfae-4503-b712-8f3c5a4bcf7c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:55.171051 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c8b37ff-dfae-4503-b712-8f3c5a4bcf7c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:55.225940 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bc2418ee-430e-4ba3-91bd-52d3746c116e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:55.236372 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bc2418ee-430e-4ba3-91bd-52d3746c116e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1370 microversion: 2.1 time: 0.446142 Jul 25 14:37:55.240195 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1621/3045] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:54 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1370 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:55.386654 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2c8b37ff-dfae-4503-b712-8f3c5a4bcf7c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:55.398547 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2c8b37ff-dfae-4503-b712-8f3c5a4bcf7c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:55.400404 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2c8b37ff-dfae-4503-b712-8f3c5a4bcf7c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:55.401675 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2c8b37ff-dfae-4503-b712-8f3c5a4bcf7c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1808 microversion: 2.20 time: 0.276499 Jul 25 14:37:55.422763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2f487cf3-2eb3-443c-b447-1196e024ccc6 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:55.423630 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2f487cf3-2eb3-443c-b447-1196e024ccc6 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:55.428378 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1425/3046] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:55 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1808 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:55.432487 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2f487cf3-2eb3-443c-b447-1196e024ccc6 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:55.433071 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2f487cf3-2eb3-443c-b447-1196e024ccc6 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:55.433981 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2f487cf3-2eb3-443c-b447-1196e024ccc6 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:55.435363 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2f487cf3-2eb3-443c-b447-1196e024ccc6 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:55.501917 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-19cf4ffd-07b2-4a4a-ad81-9b7091c9c45e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:55.502798 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-19cf4ffd-07b2-4a4a-ad81-9b7091c9c45e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:55.522028 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-19cf4ffd-07b2-4a4a-ad81-9b7091c9c45e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:55.523624 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-19cf4ffd-07b2-4a4a-ad81-9b7091c9c45e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:55.524843 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-19cf4ffd-07b2-4a4a-ad81-9b7091c9c45e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:55.525530 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-19cf4ffd-07b2-4a4a-ad81-9b7091c9c45e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:55.606891 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-19cf4ffd-07b2-4a4a-ad81-9b7091c9c45e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:55.617032 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-19cf4ffd-07b2-4a4a-ad81-9b7091c9c45e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:55.618712 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-19cf4ffd-07b2-4a4a-ad81-9b7091c9c45e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:55.620043 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-19cf4ffd-07b2-4a4a-ad81-9b7091c9c45e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1604 microversion: 2.42 time: 0.124923 Jul 25 14:37:55.620951 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1426/3047] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:55 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1604 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:55.772241 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2f487cf3-2eb3-443c-b447-1196e024ccc6 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:55.781895 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2f487cf3-2eb3-443c-b447-1196e024ccc6 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:55.783703 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2f487cf3-2eb3-443c-b447-1196e024ccc6 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:55.785657 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2f487cf3-2eb3-443c-b447-1196e024ccc6 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1408 microversion: 2.54 time: 0.367293 Jul 25 14:37:55.786419 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1622/3048] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:55 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1408 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:56.264782 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-94584575-ae21-4e0a-9910-24d481e47828 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:56.266003 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-94584575-ae21-4e0a-9910-24d481e47828 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:56.276351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-94584575-ae21-4e0a-9910-24d481e47828 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:56.277102 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-94584575-ae21-4e0a-9910-24d481e47828 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:56.278051 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-94584575-ae21-4e0a-9910-24d481e47828 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:56.278690 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-94584575-ae21-4e0a-9910-24d481e47828 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:56.481940 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-94584575-ae21-4e0a-9910-24d481e47828 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:56.493643 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-94584575-ae21-4e0a-9910-24d481e47828 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1564 microversion: 2.1 time: 0.234631 Jul 25 14:37:56.494779 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1427/3049] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:56 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1564 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:56.518714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d4913eb7-9a03-487e-894b-70ef48607b8f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:56.521420 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d4913eb7-9a03-487e-894b-70ef48607b8f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:56.533950 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d4913eb7-9a03-487e-894b-70ef48607b8f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:56.537163 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d4913eb7-9a03-487e-894b-70ef48607b8f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:56.539095 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d4913eb7-9a03-487e-894b-70ef48607b8f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:56.541473 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d4913eb7-9a03-487e-894b-70ef48607b8f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:56.633765 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-73156f1e-ec65-4e69-9149-67055a1b0389 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-126413376", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "4c176170-2f7d-43a7-8c89-c74c022eb418"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:56.726471 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-73156f1e-ec65-4e69-9149-67055a1b0389 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] validate_networks() for [('4c176170-2f7d-43a7-8c89-c74c022eb418', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:37:56.750464 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d4913eb7-9a03-487e-894b-70ef48607b8f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:56.764955 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d4913eb7-9a03-487e-894b-70ef48607b8f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:56.767083 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d4913eb7-9a03-487e-894b-70ef48607b8f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:56.769047 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d4913eb7-9a03-487e-894b-70ef48607b8f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1808 microversion: 2.20 time: 0.272801 Jul 25 14:37:56.769839 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1428/3050] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:56 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1808 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:56.776445 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6819fde7-0b02-4438-9628-cded16c1847b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:56.777171 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6819fde7-0b02-4438-9628-cded16c1847b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:56.785485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6819fde7-0b02-4438-9628-cded16c1847b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:56.786664 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6819fde7-0b02-4438-9628-cded16c1847b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:56.787836 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6819fde7-0b02-4438-9628-cded16c1847b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:56.789412 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6819fde7-0b02-4438-9628-cded16c1847b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:56.900419 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6819fde7-0b02-4438-9628-cded16c1847b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.128219 Jul 25 14:37:56.901688 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1429/3051] 10.222.0.88 () {58 vars in 1275 bytes} [Mon Jul 25 14:37:56 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:56.906605 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8a74dc3d-c7c9-436c-8428-3da8df681d4e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:56.907362 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8a74dc3d-c7c9-436c-8428-3da8df681d4e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:56.927128 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8a74dc3d-c7c9-436c-8428-3da8df681d4e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:56.929460 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8a74dc3d-c7c9-436c-8428-3da8df681d4e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:56.931227 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8a74dc3d-c7c9-436c-8428-3da8df681d4e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:56.933394 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8a74dc3d-c7c9-436c-8428-3da8df681d4e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:57.117056 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8a74dc3d-c7c9-436c-8428-3da8df681d4e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:57.131181 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8a74dc3d-c7c9-436c-8428-3da8df681d4e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:57.140363 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8a74dc3d-c7c9-436c-8428-3da8df681d4e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:57.142154 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8a74dc3d-c7c9-436c-8428-3da8df681d4e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1604 microversion: 2.42 time: 0.239238 Jul 25 14:37:57.143347 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1430/3052] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:56 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1604 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:57.148633 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-83c4b251-0355-434a-b022-aba8f3e05999 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:57.153673 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-83c4b251-0355-434a-b022-aba8f3e05999 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:57.174063 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-83c4b251-0355-434a-b022-aba8f3e05999 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:57.174790 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-83c4b251-0355-434a-b022-aba8f3e05999 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:57.175765 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-83c4b251-0355-434a-b022-aba8f3e05999 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:57.177046 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-83c4b251-0355-434a-b022-aba8f3e05999 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:57.211931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:37:57.311753 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-83c4b251-0355-434a-b022-aba8f3e05999 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:57.342815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-83c4b251-0355-434a-b022-aba8f3e05999 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:57.344881 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-83c4b251-0355-434a-b022-aba8f3e05999 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:57.346804 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-83c4b251-0355-434a-b022-aba8f3e05999 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1408 microversion: 2.54 time: 0.201916 Jul 25 14:37:57.348075 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1431/3053] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:57 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1408 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:57.413194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-73156f1e-ec65-4e69-9149-67055a1b0389 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:37:57.413701 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-73156f1e-ec65-4e69-9149-67055a1b0389 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:37:57.414395 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-73156f1e-ec65-4e69-9149-67055a1b0389 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:37:57.414930 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-73156f1e-ec65-4e69-9149-67055a1b0389 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:37:57.415467 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-73156f1e-ec65-4e69-9149-67055a1b0389 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:37:57.440098 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-73156f1e-ec65-4e69-9149-67055a1b0389 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:57.450181 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-73156f1e-ec65-4e69-9149-67055a1b0389 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:57.450636 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-73156f1e-ec65-4e69-9149-67055a1b0389 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:57.451086 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-73156f1e-ec65-4e69-9149-67055a1b0389 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:57.515061 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-73156f1e-ec65-4e69-9149-67055a1b0389 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Getting quotas for project e77732af189e48feab3752ddb28208d3. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:37:57.523338 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-73156f1e-ec65-4e69-9149-67055a1b0389 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Getting quotas for user e45ffe0956ae4ba9b1577875f312af06 and project e77732af189e48feab3752ddb28208d3. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:37:57.543168 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-73156f1e-ec65-4e69-9149-67055a1b0389 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:37:57.546129 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-73156f1e-ec65-4e69-9149-67055a1b0389 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: e58c1cf0-5e50-42a9-a430-7a6ef7933743] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:37:57.620577 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-73156f1e-ec65-4e69-9149-67055a1b0389 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.214316 Jul 25 14:37:57.621434 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1623/3054] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:37:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1216 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 14:37:57.633653 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9aaed7da-574b-43de-9365-e3bd9e94b610 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:57.634618 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9aaed7da-574b-43de-9365-e3bd9e94b610 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: e58c1cf0-5e50-42a9-a430-7a6ef7933743] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:57.797589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-23148401-cbc8-4395-a6ae-d06014e446a0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:57.798501 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-23148401-cbc8-4395-a6ae-d06014e446a0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:57.806566 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9aaed7da-574b-43de-9365-e3bd9e94b610 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:57.808422 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23148401-cbc8-4395-a6ae-d06014e446a0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:57.809412 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23148401-cbc8-4395-a6ae-d06014e446a0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:57.812962 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23148401-cbc8-4395-a6ae-d06014e446a0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:57.813408 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23148401-cbc8-4395-a6ae-d06014e446a0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:57.817041 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9aaed7da-574b-43de-9365-e3bd9e94b610 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743" status: 200 len: 1192 microversion: 2.1 time: 0.188252 Jul 25 14:37:57.831820 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1432/3055] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:57 2022] GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743 => generated 1192 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:57.866653 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-bfdadcaf-058c-494f-914f-df07fbbc7223 req-729fe160-2b48-4ffc-9a1e-3768b12b3fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1009be4-53ff-4893-836c-ba96f07a0d60", "name": "network-vif-plugged", "status": "completed", "tag": "a70f2535-e346-4125-80e5-abda9464ab7e"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:57.930817 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-bfdadcaf-058c-494f-914f-df07fbbc7223 req-729fe160-2b48-4ffc-9a1e-3768b12b3fd9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:57.932087 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-bfdadcaf-058c-494f-914f-df07fbbc7223 req-729fe160-2b48-4ffc-9a1e-3768b12b3fd9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:57.952093 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-bfdadcaf-058c-494f-914f-df07fbbc7223 req-729fe160-2b48-4ffc-9a1e-3768b12b3fd9 service nova] Creating event network-vif-plugged:a70f2535-e346-4125-80e5-abda9464ab7e for instance f1009be4-53ff-4893-836c-ba96f07a0d60 on n-h2-846435-14 Jul 25 14:37:57.961440 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-bfdadcaf-058c-494f-914f-df07fbbc7223 req-729fe160-2b48-4ffc-9a1e-3768b12b3fd9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098050 Jul 25 14:37:57.962185 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1433/3056] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:58.065820 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-23148401-cbc8-4395-a6ae-d06014e446a0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:58.079738 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-23148401-cbc8-4395-a6ae-d06014e446a0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:58.082732 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-23148401-cbc8-4395-a6ae-d06014e446a0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:58.087800 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-23148401-cbc8-4395-a6ae-d06014e446a0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1808 microversion: 2.20 time: 0.294645 Jul 25 14:37:58.091017 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1624/3057] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:57 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1808 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:58.171394 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-05f8a8d6-ae87-43ce-b7b9-4a8b41446844 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:58.172431 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-05f8a8d6-ae87-43ce-b7b9-4a8b41446844 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:58.188327 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-05f8a8d6-ae87-43ce-b7b9-4a8b41446844 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:58.188817 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-05f8a8d6-ae87-43ce-b7b9-4a8b41446844 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:58.189632 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-05f8a8d6-ae87-43ce-b7b9-4a8b41446844 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:58.190078 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-05f8a8d6-ae87-43ce-b7b9-4a8b41446844 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:58.370423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-05f8a8d6-ae87-43ce-b7b9-4a8b41446844 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:58.371668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8bc5ecda-f88a-431b-ac26-0655111f9e45 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:58.372425 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8bc5ecda-f88a-431b-ac26-0655111f9e45 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:58.379913 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8bc5ecda-f88a-431b-ac26-0655111f9e45 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:58.380525 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8bc5ecda-f88a-431b-ac26-0655111f9e45 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:58.381393 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8bc5ecda-f88a-431b-ac26-0655111f9e45 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:58.381966 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8bc5ecda-f88a-431b-ac26-0655111f9e45 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:58.385128 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-05f8a8d6-ae87-43ce-b7b9-4a8b41446844 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:58.387105 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-05f8a8d6-ae87-43ce-b7b9-4a8b41446844 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:58.388486 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-05f8a8d6-ae87-43ce-b7b9-4a8b41446844 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1604 microversion: 2.42 time: 0.222133 Jul 25 14:37:58.389255 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1434/3058] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:58 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1604 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:58.475416 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8bc5ecda-f88a-431b-ac26-0655111f9e45 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:58.490470 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8bc5ecda-f88a-431b-ac26-0655111f9e45 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:58.492764 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8bc5ecda-f88a-431b-ac26-0655111f9e45 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:58.493996 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8bc5ecda-f88a-431b-ac26-0655111f9e45 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1408 microversion: 2.54 time: 0.127607 Jul 25 14:37:58.504879 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1625/3059] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:58 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1408 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:37:58.666610 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-cb95a844-9bbd-435f-b1f1-481416f9d8a0 req-b8a8beae-4bd3-401c-b66f-34e3afd98f01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fac258f1-785d-4dd9-bc68-0ee713c9149a", "tag": "f04995f2-50af-408b-81f1-cda226840583"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:37:58.676982 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:37:58.680845 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-cb95a844-9bbd-435f-b1f1-481416f9d8a0 req-b8a8beae-4bd3-401c-b66f-34e3afd98f01 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:58.681304 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-cb95a844-9bbd-435f-b1f1-481416f9d8a0 req-b8a8beae-4bd3-401c-b66f-34e3afd98f01 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:58.697243 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-cb95a844-9bbd-435f-b1f1-481416f9d8a0 req-b8a8beae-4bd3-401c-b66f-34e3afd98f01 service nova] Creating event network-changed:f04995f2-50af-408b-81f1-cda226840583 for instance fac258f1-785d-4dd9-bc68-0ee713c9149a on n-h1-846435-14 Jul 25 14:37:58.703388 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-cb95a844-9bbd-435f-b1f1-481416f9d8a0 req-b8a8beae-4bd3-401c-b66f-34e3afd98f01 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042013 Jul 25 14:37:58.704924 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1435/3060] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:37:58.837702 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3a9ebaee-53b0-4cbc-986e-14ffebf50a71 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:58.839026 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3a9ebaee-53b0-4cbc-986e-14ffebf50a71 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: e58c1cf0-5e50-42a9-a430-7a6ef7933743] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:58.849894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a9ebaee-53b0-4cbc-986e-14ffebf50a71 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:58.850984 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a9ebaee-53b0-4cbc-986e-14ffebf50a71 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:58.852668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a9ebaee-53b0-4cbc-986e-14ffebf50a71 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:58.855093 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a9ebaee-53b0-4cbc-986e-14ffebf50a71 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:58.960940 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3a9ebaee-53b0-4cbc-986e-14ffebf50a71 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:58.971629 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3a9ebaee-53b0-4cbc-986e-14ffebf50a71 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743" status: 200 len: 1244 microversion: 2.1 time: 0.137797 Jul 25 14:37:58.973823 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1626/3061] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:58 2022] GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743 => generated 1244 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:37:59.115364 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-31c1809e-486c-486a-898f-1792094f4ebe tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:59.116407 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-31c1809e-486c-486a-898f-1792094f4ebe tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:59.127502 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-31c1809e-486c-486a-898f-1792094f4ebe tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:59.129232 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-31c1809e-486c-486a-898f-1792094f4ebe tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:59.131848 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-31c1809e-486c-486a-898f-1792094f4ebe tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:59.132440 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-31c1809e-486c-486a-898f-1792094f4ebe tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:59.414059 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5ba3e6c9-e548-4a05-b5cc-dccdefe30eb9 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:59.414913 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5ba3e6c9-e548-4a05-b5cc-dccdefe30eb9 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:59.428630 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ba3e6c9-e548-4a05-b5cc-dccdefe30eb9 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:59.436810 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ba3e6c9-e548-4a05-b5cc-dccdefe30eb9 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:59.437961 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ba3e6c9-e548-4a05-b5cc-dccdefe30eb9 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:59.438563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ba3e6c9-e548-4a05-b5cc-dccdefe30eb9 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:59.504761 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ba3e6c9-e548-4a05-b5cc-dccdefe30eb9 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:59.507731 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ba3e6c9-e548-4a05-b5cc-dccdefe30eb9 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:59.509465 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-5ba3e6c9-e548-4a05-b5cc-dccdefe30eb9 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lazy-loading 'fault' on Instance uuid 33a6128a-580f-4184-ba11-6511d5021242 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:37:59.521405 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-31c1809e-486c-486a-898f-1792094f4ebe tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:59.544891 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-31c1809e-486c-486a-898f-1792094f4ebe tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:59.551325 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-31c1809e-486c-486a-898f-1792094f4ebe tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:59.553013 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-31c1809e-486c-486a-898f-1792094f4ebe tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1808 microversion: 2.20 time: 0.441856 Jul 25 14:37:59.553541 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1436/3062] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:59 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1808 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:59.563007 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3b0f6f7d-8103-4594-a90f-d7f1690eea71 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:37:59.563635 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3b0f6f7d-8103-4594-a90f-d7f1690eea71 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:37:59.586697 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b0f6f7d-8103-4594-a90f-d7f1690eea71 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:59.587151 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b0f6f7d-8103-4594-a90f-d7f1690eea71 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:59.587950 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b0f6f7d-8103-4594-a90f-d7f1690eea71 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:37:59.588478 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b0f6f7d-8103-4594-a90f-d7f1690eea71 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:37:59.602178 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5ba3e6c9-e548-4a05-b5cc-dccdefe30eb9 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:59.635822 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5ba3e6c9-e548-4a05-b5cc-dccdefe30eb9 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:59.641502 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5ba3e6c9-e548-4a05-b5cc-dccdefe30eb9 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da715e4c9f0f4d9ba4c964417088fa9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '884d6897a35e49699a1ce44c2905dc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:59.674268 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5ba3e6c9-e548-4a05-b5cc-dccdefe30eb9 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 200 len: 1609 microversion: 2.42 time: 0.264698 Jul 25 14:37:59.703043 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1627/3063] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:59 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 1609 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:37:59.845455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3b0f6f7d-8103-4594-a90f-d7f1690eea71 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:59.859643 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3b0f6f7d-8103-4594-a90f-d7f1690eea71 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:59.870175 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3b0f6f7d-8103-4594-a90f-d7f1690eea71 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:37:59.878216 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3b0f6f7d-8103-4594-a90f-d7f1690eea71 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1408 microversion: 2.54 time: 0.318984 Jul 25 14:37:59.885093 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1437/3064] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:37:59 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1408 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:38:00.004185 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8eb25b8f-bc6d-472d-9c13-cae248964e69 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:00.005514 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8eb25b8f-bc6d-472d-9c13-cae248964e69 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: e58c1cf0-5e50-42a9-a430-7a6ef7933743] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:00.014947 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8eb25b8f-bc6d-472d-9c13-cae248964e69 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:00.015661 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8eb25b8f-bc6d-472d-9c13-cae248964e69 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:00.016801 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8eb25b8f-bc6d-472d-9c13-cae248964e69 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:00.017812 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8eb25b8f-bc6d-472d-9c13-cae248964e69 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:00.165575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8eb25b8f-bc6d-472d-9c13-cae248964e69 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:00.182154 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8eb25b8f-bc6d-472d-9c13-cae248964e69 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743" status: 200 len: 1252 microversion: 2.1 time: 0.187926 Jul 25 14:38:00.185307 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1628/3065] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:37:59 2022] GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743 => generated 1252 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:00.578996 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-93f9c094-91ca-49de-beea-d7af78b2266c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:00.579613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-93f9c094-91ca-49de-beea-d7af78b2266c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:00.588480 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93f9c094-91ca-49de-beea-d7af78b2266c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:00.588996 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93f9c094-91ca-49de-beea-d7af78b2266c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:00.590029 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93f9c094-91ca-49de-beea-d7af78b2266c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:00.590657 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93f9c094-91ca-49de-beea-d7af78b2266c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:00.707071 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ecdbef87-d5f3-42b2-9188-26776e10f56d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:00.707824 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ecdbef87-d5f3-42b2-9188-26776e10f56d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:00.732267 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ecdbef87-d5f3-42b2-9188-26776e10f56d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:00.735800 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ecdbef87-d5f3-42b2-9188-26776e10f56d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:00.739958 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ecdbef87-d5f3-42b2-9188-26776e10f56d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:00.746464 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ecdbef87-d5f3-42b2-9188-26776e10f56d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:00.781992 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-ecdbef87-d5f3-42b2-9188-26776e10f56d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] HTTP exception thrown: Instance 33a6128a-580f-4184-ba11-6511d5021242 could not be found. Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ecdbef87-d5f3-42b2-9188-26776e10f56d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Request method failure captured: Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 HTTP/1.1 Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qhhpWVgerHINLgrnkEMCHVe5twQVELwpCuksOR81KJpchDFDGtqMnjRNp-YospOiuvC94GI6_LYP6Ylc3fJkK8AmESWjQXeVtvRiHsrxBy428PwWUJSPngNu-VcBxXaqIKGB_qCRxpBoKtyulSzIc6OFSMfFX9ZJ7PlDSru9K2t4TI Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: X-Openstack-Nova-Api-Version: 2.42 Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 884d6897a35e49699a1ce44c2905dc23 Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-606580803 Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/884d6897a35e49699a1ce44c2905dc23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/884d6897a35e49699a1ce44c2905dc23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_884d6897a35e49699a1ce44c2905dc23", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/884d6897a35e49699a1ce44c2905dc23"}]}] Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-TaggedBootDevicesTest_v242-606580803 Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 884d6897a35e49699a1ce44c2905dc23 Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-606580803 Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-TaggedBootDevicesTest_v242-606580803-project Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: da715e4c9f0f4d9ba4c964417088fa9d Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-TaggedBootDevicesTest_v242-606580803-project Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 33a6128a-580f-4184-ba11-6511d5021242 could not be found. Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '33a6128a-580f-4184-ba11-6511d5021242'} Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33a6128a-580f-4184-ba11-6511d5021242 could not be found. Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33a6128a-580f-4184-ba11-6511d5021242 could not be found. Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:00.787539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:00.791729 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:00.791729 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:00.791729 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:00.791729 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:00.791729 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:38:00.791729 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:38:00.791729 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33a6128a-580f-4184-ba11-6511d5021242 could not be found. Jul 25 14:38:00.791729 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:00.796085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ecdbef87-d5f3-42b2-9188-26776e10f56d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Returning 404 to user: Instance 33a6128a-580f-4184-ba11-6511d5021242 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:38:00.798313 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ecdbef87-d5f3-42b2-9188-26776e10f56d tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 404 len: 111 microversion: 2.42 time: 0.096535 Jul 25 14:38:00.800189 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1629/3066] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:38:00 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:38:00.808878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-455e97a1-814c-495b-89be-b0d9ef989a0e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '.version_select at 0x7f46863d80d0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:00.857947 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-455e97a1-814c-495b-89be-b0d9ef989a0e tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-395562048" status: 204 len: 0 microversion: 2.42 time: 0.053637 Jul 25 14:38:00.861533 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1630/3067] 10.222.0.88 () {60 vars in 1259 bytes} [Mon Jul 25 14:38:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-395562048 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 14:38:00.910866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7afd548c-3577-4b93-898b-92b8bc3142a3 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:00.911686 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7afd548c-3577-4b93-898b-92b8bc3142a3 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:00.921430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7afd548c-3577-4b93-898b-92b8bc3142a3 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:00.921876 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7afd548c-3577-4b93-898b-92b8bc3142a3 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:00.922664 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7afd548c-3577-4b93-898b-92b8bc3142a3 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:00.923089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7afd548c-3577-4b93-898b-92b8bc3142a3 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:00.943633 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-93f9c094-91ca-49de-beea-d7af78b2266c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:00.971519 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-93f9c094-91ca-49de-beea-d7af78b2266c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:00.974871 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-93f9c094-91ca-49de-beea-d7af78b2266c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:00.979190 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-93f9c094-91ca-49de-beea-d7af78b2266c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1808 microversion: 2.20 time: 0.403967 Jul 25 14:38:00.984906 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1438/3068] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:38:00 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1808 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:38:01.107751 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7afd548c-3577-4b93-898b-92b8bc3142a3 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:01.113568 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:38:01.134475 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7afd548c-3577-4b93-898b-92b8bc3142a3 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:01.137863 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7afd548c-3577-4b93-898b-92b8bc3142a3 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:01.141241 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7afd548c-3577-4b93-898b-92b8bc3142a3 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1408 microversion: 2.54 time: 0.234930 Jul 25 14:38:01.160349 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1631/3069] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:38:00 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1408 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:38:01.211241 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3c262589-125c-41e8-ac3e-9fd6e6406e1f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:01.214837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3c262589-125c-41e8-ac3e-9fd6e6406e1f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: e58c1cf0-5e50-42a9-a430-7a6ef7933743] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:01.249855 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c262589-125c-41e8-ac3e-9fd6e6406e1f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:01.250548 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c262589-125c-41e8-ac3e-9fd6e6406e1f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:01.256665 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c262589-125c-41e8-ac3e-9fd6e6406e1f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:01.258037 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c262589-125c-41e8-ac3e-9fd6e6406e1f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:01.525990 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3c262589-125c-41e8-ac3e-9fd6e6406e1f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:01.540523 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3c262589-125c-41e8-ac3e-9fd6e6406e1f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743" status: 200 len: 1250 microversion: 2.1 time: 0.334481 Jul 25 14:38:01.541180 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1439/3070] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:01 2022] GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743 => generated 1250 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:02.013455 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fa4767d5-3783-4ce7-8653-164e9cbeabcd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:02.014111 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fa4767d5-3783-4ce7-8653-164e9cbeabcd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:02.024628 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fa4767d5-3783-4ce7-8653-164e9cbeabcd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:02.026198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fa4767d5-3783-4ce7-8653-164e9cbeabcd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:02.027331 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fa4767d5-3783-4ce7-8653-164e9cbeabcd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:02.028349 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fa4767d5-3783-4ce7-8653-164e9cbeabcd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:02.181872 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8dac6ac9-4058-49e1-8689-24f01a19dc6f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:02.183324 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8dac6ac9-4058-49e1-8689-24f01a19dc6f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:02.202577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8dac6ac9-4058-49e1-8689-24f01a19dc6f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:02.203628 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8dac6ac9-4058-49e1-8689-24f01a19dc6f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:02.205241 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8dac6ac9-4058-49e1-8689-24f01a19dc6f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:02.205892 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8dac6ac9-4058-49e1-8689-24f01a19dc6f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:02.477776 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fa4767d5-3783-4ce7-8653-164e9cbeabcd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:02.509756 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fa4767d5-3783-4ce7-8653-164e9cbeabcd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:02.517905 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fa4767d5-3783-4ce7-8653-164e9cbeabcd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:02.519366 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fa4767d5-3783-4ce7-8653-164e9cbeabcd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1795 microversion: 2.20 time: 0.512350 Jul 25 14:38:02.522567 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1632/3071] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:38:02 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1795 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:38:02.568198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-90665bef-adfa-4251-a025-5f53fc7b8f35 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:02.569165 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-90665bef-adfa-4251-a025-5f53fc7b8f35 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: e58c1cf0-5e50-42a9-a430-7a6ef7933743] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:02.584524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-90665bef-adfa-4251-a025-5f53fc7b8f35 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:02.585020 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-90665bef-adfa-4251-a025-5f53fc7b8f35 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:02.587518 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-90665bef-adfa-4251-a025-5f53fc7b8f35 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:02.588778 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-90665bef-adfa-4251-a025-5f53fc7b8f35 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:02.623847 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8dac6ac9-4058-49e1-8689-24f01a19dc6f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:02.634560 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8dac6ac9-4058-49e1-8689-24f01a19dc6f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:02.656891 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8dac6ac9-4058-49e1-8689-24f01a19dc6f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:02.658332 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8dac6ac9-4058-49e1-8689-24f01a19dc6f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1408 microversion: 2.54 time: 0.487839 Jul 25 14:38:02.658966 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1440/3072] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:38:02 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1408 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:38:03.328107 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-90665bef-adfa-4251-a025-5f53fc7b8f35 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:03.336439 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-90665bef-adfa-4251-a025-5f53fc7b8f35 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743" status: 200 len: 1292 microversion: 2.1 time: 0.775490 Jul 25 14:38:03.337030 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1633/3073] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:02 2022] GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743 => generated 1292 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:38:03.690907 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-07e0e677-aa5c-4808-a76c-1155e51b1acb tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:03.691642 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-07e0e677-aa5c-4808-a76c-1155e51b1acb tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:03.708527 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-07e0e677-aa5c-4808-a76c-1155e51b1acb tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:03.708924 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-07e0e677-aa5c-4808-a76c-1155e51b1acb tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:03.709824 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-07e0e677-aa5c-4808-a76c-1155e51b1acb tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:03.715614 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-07e0e677-aa5c-4808-a76c-1155e51b1acb tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:03.886501 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-07e0e677-aa5c-4808-a76c-1155e51b1acb tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:03.896561 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-07e0e677-aa5c-4808-a76c-1155e51b1acb tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:03.898223 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-07e0e677-aa5c-4808-a76c-1155e51b1acb tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:03.903247 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-07e0e677-aa5c-4808-a76c-1155e51b1acb tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1408 microversion: 2.54 time: 0.219695 Jul 25 14:38:03.910606 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1441/3074] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:38:03 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1408 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:38:04.112431 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-e912629c-f092-4d8a-8d28-3369543bb847 req-d34bd38e-2135-4f17-8004-9bf1c16448d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e58c1cf0-5e50-42a9-a430-7a6ef7933743", "tag": "3ec76678-4c3e-4b85-b561-36b5c6e2241a"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:04.151757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-e912629c-f092-4d8a-8d28-3369543bb847 req-d34bd38e-2135-4f17-8004-9bf1c16448d8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:04.152312 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-e912629c-f092-4d8a-8d28-3369543bb847 req-d34bd38e-2135-4f17-8004-9bf1c16448d8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:04.186375 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-e912629c-f092-4d8a-8d28-3369543bb847 req-d34bd38e-2135-4f17-8004-9bf1c16448d8 service nova] Creating event network-changed:3ec76678-4c3e-4b85-b561-36b5c6e2241a for instance e58c1cf0-5e50-42a9-a430-7a6ef7933743 on n-h2-846435-14 Jul 25 14:38:04.210335 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-e912629c-f092-4d8a-8d28-3369543bb847 req-d34bd38e-2135-4f17-8004-9bf1c16448d8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102124 Jul 25 14:38:04.217322 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1634/3075] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:38:04.364308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6a97e972-1bb0-4af2-8d8a-2e0a53ecd8ac tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:04.365487 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6a97e972-1bb0-4af2-8d8a-2e0a53ecd8ac tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: e58c1cf0-5e50-42a9-a430-7a6ef7933743] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:04.380731 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6a97e972-1bb0-4af2-8d8a-2e0a53ecd8ac tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:04.383371 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6a97e972-1bb0-4af2-8d8a-2e0a53ecd8ac tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:04.388457 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6a97e972-1bb0-4af2-8d8a-2e0a53ecd8ac tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:04.389610 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6a97e972-1bb0-4af2-8d8a-2e0a53ecd8ac tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:04.809703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6a97e972-1bb0-4af2-8d8a-2e0a53ecd8ac tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:04.818759 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6a97e972-1bb0-4af2-8d8a-2e0a53ecd8ac tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743" status: 200 len: 1292 microversion: 2.1 time: 0.460203 Jul 25 14:38:04.837215 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1442/3076] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:04 2022] GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743 => generated 1292 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:04.943462 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d206097f-c4d2-42c5-98fb-d2b625f96009 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:04.945131 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d206097f-c4d2-42c5-98fb-d2b625f96009 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:04.959298 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d206097f-c4d2-42c5-98fb-d2b625f96009 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:04.960211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d206097f-c4d2-42c5-98fb-d2b625f96009 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:04.961365 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d206097f-c4d2-42c5-98fb-d2b625f96009 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:04.963280 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d206097f-c4d2-42c5-98fb-d2b625f96009 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:05.103334 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d206097f-c4d2-42c5-98fb-d2b625f96009 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:05.128347 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d206097f-c4d2-42c5-98fb-d2b625f96009 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:05.138081 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d206097f-c4d2-42c5-98fb-d2b625f96009 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:05.139924 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d206097f-c4d2-42c5-98fb-d2b625f96009 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1408 microversion: 2.54 time: 0.203615 Jul 25 14:38:05.141116 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1635/3077] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:38:04 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:38:05.215050 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-656f9189-7011-475c-a8f3-df5a91055a17 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:05.215717 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-656f9189-7011-475c-a8f3-df5a91055a17 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:05.229870 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-656f9189-7011-475c-a8f3-df5a91055a17 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:05.230985 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-656f9189-7011-475c-a8f3-df5a91055a17 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:05.232020 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-656f9189-7011-475c-a8f3-df5a91055a17 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:05.232547 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-656f9189-7011-475c-a8f3-df5a91055a17 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:05.301264 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-656f9189-7011-475c-a8f3-df5a91055a17 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:38:05.467791 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-656f9189-7011-475c-a8f3-df5a91055a17 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 204 len: 0 microversion: 2.1 time: 0.256351 Jul 25 14:38:05.469057 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1443/3078] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:38:05 2022] DELETE /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:38:05.478092 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-496a3e64-eedc-4582-a6d3-4398301f439c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:05.479281 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-496a3e64-eedc-4582-a6d3-4398301f439c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:05.488415 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-496a3e64-eedc-4582-a6d3-4398301f439c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:05.489242 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-496a3e64-eedc-4582-a6d3-4398301f439c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:05.490083 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-496a3e64-eedc-4582-a6d3-4398301f439c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:05.490625 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-496a3e64-eedc-4582-a6d3-4398301f439c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:05.756100 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-496a3e64-eedc-4582-a6d3-4398301f439c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:05.765028 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-496a3e64-eedc-4582-a6d3-4398301f439c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1668 microversion: 2.1 time: 0.291287 Jul 25 14:38:05.766418 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1636/3079] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:05 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1668 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:05.845269 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e9546c15-cbac-4cc4-976d-c2d9d87ed21d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:05.846886 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e9546c15-cbac-4cc4-976d-c2d9d87ed21d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: e58c1cf0-5e50-42a9-a430-7a6ef7933743] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:05.859885 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e9546c15-cbac-4cc4-976d-c2d9d87ed21d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:05.860619 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e9546c15-cbac-4cc4-976d-c2d9d87ed21d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:05.861469 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e9546c15-cbac-4cc4-976d-c2d9d87ed21d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:05.861905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e9546c15-cbac-4cc4-976d-c2d9d87ed21d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:06.151425 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e9546c15-cbac-4cc4-976d-c2d9d87ed21d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:06.163515 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e9546c15-cbac-4cc4-976d-c2d9d87ed21d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743" status: 200 len: 1292 microversion: 2.1 time: 0.322474 Jul 25 14:38:06.167686 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7efb1756-9494-47a0-8c9b-a8875e03de13 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:06.169014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7efb1756-9494-47a0-8c9b-a8875e03de13 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:06.175053 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1444/3080] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:05 2022] GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743 => generated 1292 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:06.183266 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7efb1756-9494-47a0-8c9b-a8875e03de13 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:06.184391 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7efb1756-9494-47a0-8c9b-a8875e03de13 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:06.186424 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7efb1756-9494-47a0-8c9b-a8875e03de13 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:06.187646 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7efb1756-9494-47a0-8c9b-a8875e03de13 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:06.396063 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7efb1756-9494-47a0-8c9b-a8875e03de13 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:06.410218 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7efb1756-9494-47a0-8c9b-a8875e03de13 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:06.416045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7efb1756-9494-47a0-8c9b-a8875e03de13 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:06.420578 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7efb1756-9494-47a0-8c9b-a8875e03de13 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1408 microversion: 2.54 time: 0.257934 Jul 25 14:38:06.424541 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1637/3081] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:38:06 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1408 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:38:06.787756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a16b5ef2-afff-4674-9227-a1e9a283131c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:06.788408 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a16b5ef2-afff-4674-9227-a1e9a283131c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:06.796377 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a16b5ef2-afff-4674-9227-a1e9a283131c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:06.797045 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a16b5ef2-afff-4674-9227-a1e9a283131c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:06.798007 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a16b5ef2-afff-4674-9227-a1e9a283131c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:06.798621 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a16b5ef2-afff-4674-9227-a1e9a283131c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:07.022731 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a16b5ef2-afff-4674-9227-a1e9a283131c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:07.040683 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a16b5ef2-afff-4674-9227-a1e9a283131c tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1668 microversion: 2.1 time: 0.257115 Jul 25 14:38:07.041294 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1445/3082] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:06 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1668 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:07.179009 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fc2fbc79-a303-40e0-a04f-4c943560e5ff tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:07.179654 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fc2fbc79-a303-40e0-a04f-4c943560e5ff tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:07.187938 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fc2fbc79-a303-40e0-a04f-4c943560e5ff tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:07.188653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fc2fbc79-a303-40e0-a04f-4c943560e5ff tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:07.189987 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fc2fbc79-a303-40e0-a04f-4c943560e5ff tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:07.190574 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fc2fbc79-a303-40e0-a04f-4c943560e5ff tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:07.199286 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9530ef09-4bd2-4f77-bf30-58839a61b6e2 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:07.200153 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9530ef09-4bd2-4f77-bf30-58839a61b6e2 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: e58c1cf0-5e50-42a9-a430-7a6ef7933743] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:07.206199 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-fc2fbc79-a303-40e0-a04f-4c943560e5ff tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] HTTP exception thrown: Instance 33a6128a-580f-4184-ba11-6511d5021242 could not be found. Jul 25 14:38:07.207217 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9530ef09-4bd2-4f77-bf30-58839a61b6e2 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:07.207870 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9530ef09-4bd2-4f77-bf30-58839a61b6e2 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fc2fbc79-a303-40e0-a04f-4c943560e5ff tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Request method failure captured: Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 HTTP/1.1 Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qhhpWVgerHINLgrnkEMCHVe5twQVELwpCuksOR81KJpchDFDGtqMnjRNp-YospOiuvC94GI6_LYP6Ylc3fJkK8AmESWjQXeVtvRiHsrxBy428PwWUJSPngNu-VcBxXaqIKGB_qCRxpBoKtyulSzIc6OFSMfFX9ZJ7PlDSru9K2t4TI Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: X-Openstack-Nova-Api-Version: 2.42 Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 884d6897a35e49699a1ce44c2905dc23 Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-606580803 Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/884d6897a35e49699a1ce44c2905dc23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/884d6897a35e49699a1ce44c2905dc23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_884d6897a35e49699a1ce44c2905dc23", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/884d6897a35e49699a1ce44c2905dc23"}]}] Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-TaggedBootDevicesTest_v242-606580803 Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 884d6897a35e49699a1ce44c2905dc23 Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-606580803 Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-TaggedBootDevicesTest_v242-606580803-project Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: da715e4c9f0f4d9ba4c964417088fa9d Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-TaggedBootDevicesTest_v242-606580803-project Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 33a6128a-580f-4184-ba11-6511d5021242 could not be found. Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '33a6128a-580f-4184-ba11-6511d5021242'} Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33a6128a-580f-4184-ba11-6511d5021242 could not be found. Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:38:07.208054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:38:07.212471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33a6128a-580f-4184-ba11-6511d5021242 could not be found. Jul 25 14:38:07.212471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:07.212471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:07.212471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:07.212471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:07.212471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:07.212471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:07.212471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:38:07.212471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:38:07.212471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33a6128a-580f-4184-ba11-6511d5021242 could not be found. Jul 25 14:38:07.212471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:07.212471 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fc2fbc79-a303-40e0-a04f-4c943560e5ff tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Returning 404 to user: Instance 33a6128a-580f-4184-ba11-6511d5021242 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:38:07.212471 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fc2fbc79-a303-40e0-a04f-4c943560e5ff tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "DELETE /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 404 len: 111 microversion: 2.42 time: 0.034287 Jul 25 14:38:07.212471 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1638/3083] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Jul 25 14:38:07 2022] DELETE /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:38:07.215353 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9530ef09-4bd2-4f77-bf30-58839a61b6e2 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:07.215804 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9530ef09-4bd2-4f77-bf30-58839a61b6e2 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:07.218569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-28c38b16-811b-48a4-8d6a-c577f4c5eea3 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:07.220067 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-28c38b16-811b-48a4-8d6a-c577f4c5eea3 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] [instance: 33a6128a-580f-4184-ba11-6511d5021242] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:07.229147 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28c38b16-811b-48a4-8d6a-c577f4c5eea3 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:07.229598 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28c38b16-811b-48a4-8d6a-c577f4c5eea3 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:07.230396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28c38b16-811b-48a4-8d6a-c577f4c5eea3 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:07.230821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28c38b16-811b-48a4-8d6a-c577f4c5eea3 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:07.245446 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-28c38b16-811b-48a4-8d6a-c577f4c5eea3 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] HTTP exception thrown: Instance 33a6128a-580f-4184-ba11-6511d5021242 could not be found. Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-28c38b16-811b-48a4-8d6a-c577f4c5eea3 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Request method failure captured: Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 HTTP/1.1 Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qhhpWVgerHINLgrnkEMCHVe5twQVELwpCuksOR81KJpchDFDGtqMnjRNp-YospOiuvC94GI6_LYP6Ylc3fJkK8AmESWjQXeVtvRiHsrxBy428PwWUJSPngNu-VcBxXaqIKGB_qCRxpBoKtyulSzIc6OFSMfFX9ZJ7PlDSru9K2t4TI Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: X-Openstack-Nova-Api-Version: 2.42 Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 884d6897a35e49699a1ce44c2905dc23 Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-606580803 Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/884d6897a35e49699a1ce44c2905dc23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/884d6897a35e49699a1ce44c2905dc23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_884d6897a35e49699a1ce44c2905dc23", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/884d6897a35e49699a1ce44c2905dc23"}]}] Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-TaggedBootDevicesTest_v242-606580803 Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 884d6897a35e49699a1ce44c2905dc23 Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-606580803 Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-TaggedBootDevicesTest_v242-606580803-project Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: da715e4c9f0f4d9ba4c964417088fa9d Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-TaggedBootDevicesTest_v242-606580803-project Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 33a6128a-580f-4184-ba11-6511d5021242 could not be found. Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '33a6128a-580f-4184-ba11-6511d5021242'} Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33a6128a-580f-4184-ba11-6511d5021242 could not be found. Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33a6128a-580f-4184-ba11-6511d5021242 could not be found. Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:07.247278 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:07.254156 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:07.254156 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:07.254156 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:07.254156 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:07.254156 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:38:07.254156 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:38:07.254156 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33a6128a-580f-4184-ba11-6511d5021242 could not be found. Jul 25 14:38:07.254156 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:07.254156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-28c38b16-811b-48a4-8d6a-c577f4c5eea3 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] Returning 404 to user: Instance 33a6128a-580f-4184-ba11-6511d5021242 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:38:07.254156 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-28c38b16-811b-48a4-8d6a-c577f4c5eea3 tempest-TaggedBootDevicesTest_v242-606580803 tempest-TaggedBootDevicesTest_v242-606580803-project] 10.222.0.88 "GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242" status: 404 len: 111 microversion: 2.42 time: 0.034401 Jul 25 14:38:07.254156 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1639/3084] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:38:07 2022] GET /compute/v2.1/servers/33a6128a-580f-4184-ba11-6511d5021242 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 25 14:38:07.456422 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-27882cea-72ab-46d3-b200-6cdaab8e4312 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:07.458882 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-27882cea-72ab-46d3-b200-6cdaab8e4312 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:07.469753 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:38:07.472567 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-27882cea-72ab-46d3-b200-6cdaab8e4312 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:07.473296 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-27882cea-72ab-46d3-b200-6cdaab8e4312 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:07.474329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-27882cea-72ab-46d3-b200-6cdaab8e4312 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:07.475287 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-27882cea-72ab-46d3-b200-6cdaab8e4312 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:07.527827 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9530ef09-4bd2-4f77-bf30-58839a61b6e2 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:07.537432 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9530ef09-4bd2-4f77-bf30-58839a61b6e2 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743" status: 200 len: 1292 microversion: 2.1 time: 0.344974 Jul 25 14:38:07.538039 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1446/3085] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:07 2022] GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743 => generated 1292 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:07.540747 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:38:07.561510 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-d52b3208-6b51-4f6a-9943-f207fc18848e req-ebc155af-f0bd-4ee8-8d24-4074062672e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a85a57f0-715f-47cd-ae19-463dfc5e7aca", "name": "network-vif-deleted", "tag": "b6bbf444-a731-43c2-bb7a-c5a47d378689"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:07.586794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-d52b3208-6b51-4f6a-9943-f207fc18848e req-ebc155af-f0bd-4ee8-8d24-4074062672e4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:07.589147 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-d52b3208-6b51-4f6a-9943-f207fc18848e req-ebc155af-f0bd-4ee8-8d24-4074062672e4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:07.621033 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-d52b3208-6b51-4f6a-9943-f207fc18848e req-ebc155af-f0bd-4ee8-8d24-4074062672e4 service nova] Creating event network-vif-deleted:b6bbf444-a731-43c2-bb7a-c5a47d378689 for instance a85a57f0-715f-47cd-ae19-463dfc5e7aca on n-h1-846435-14 Jul 25 14:38:07.633500 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-d52b3208-6b51-4f6a-9943-f207fc18848e req-ebc155af-f0bd-4ee8-8d24-4074062672e4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085708 Jul 25 14:38:07.635628 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1447/3086] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:38:07.718356 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-27882cea-72ab-46d3-b200-6cdaab8e4312 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:07.729479 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-27882cea-72ab-46d3-b200-6cdaab8e4312 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:07.736008 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-27882cea-72ab-46d3-b200-6cdaab8e4312 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:07.737267 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-27882cea-72ab-46d3-b200-6cdaab8e4312 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1408 microversion: 2.54 time: 0.287937 Jul 25 14:38:07.737915 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1640/3087] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:38:07 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1408 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:38:08.071275 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9c9ad0ae-14d8-4a36-b140-f1704c3eb0ba tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:08.073126 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9c9ad0ae-14d8-4a36-b140-f1704c3eb0ba tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:08.080154 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:38:08.094106 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9c9ad0ae-14d8-4a36-b140-f1704c3eb0ba tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:08.094843 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9c9ad0ae-14d8-4a36-b140-f1704c3eb0ba tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:08.097204 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9c9ad0ae-14d8-4a36-b140-f1704c3eb0ba tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:08.098986 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9c9ad0ae-14d8-4a36-b140-f1704c3eb0ba tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:08.164561 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9c9ad0ae-14d8-4a36-b140-f1704c3eb0ba tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:08.169803 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9c9ad0ae-14d8-4a36-b140-f1704c3eb0ba tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:08.170980 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-9c9ad0ae-14d8-4a36-b140-f1704c3eb0ba tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lazy-loading 'fault' on Instance uuid a85a57f0-715f-47cd-ae19-463dfc5e7aca {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:38:08.247552 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9c9ad0ae-14d8-4a36-b140-f1704c3eb0ba tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:08.258352 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9c9ad0ae-14d8-4a36-b140-f1704c3eb0ba tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 200 len: 1325 microversion: 2.1 time: 0.194953 Jul 25 14:38:08.259480 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1448/3088] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:08 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 1325 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:08.559736 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0acc9728-748e-46af-8db8-0c34a41f4efa tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:08.561180 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0acc9728-748e-46af-8db8-0c34a41f4efa tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: e58c1cf0-5e50-42a9-a430-7a6ef7933743] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:08.569625 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0acc9728-748e-46af-8db8-0c34a41f4efa tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:08.570397 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0acc9728-748e-46af-8db8-0c34a41f4efa tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:08.571400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0acc9728-748e-46af-8db8-0c34a41f4efa tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:08.572248 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0acc9728-748e-46af-8db8-0c34a41f4efa tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:08.765890 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0acc9728-748e-46af-8db8-0c34a41f4efa tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:08.767000 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-66082ccf-a9d3-4b7d-8221-c5df76e551bd tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:08.767845 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-66082ccf-a9d3-4b7d-8221-c5df76e551bd tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:08.775815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-66082ccf-a9d3-4b7d-8221-c5df76e551bd tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:08.776135 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0acc9728-748e-46af-8db8-0c34a41f4efa tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743" status: 200 len: 1292 microversion: 2.1 time: 0.220894 Jul 25 14:38:08.776474 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1641/3089] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:08 2022] GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743 => generated 1292 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:08.776652 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-66082ccf-a9d3-4b7d-8221-c5df76e551bd tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:08.777795 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-66082ccf-a9d3-4b7d-8221-c5df76e551bd tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:08.778531 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-66082ccf-a9d3-4b7d-8221-c5df76e551bd tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:08.783995 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:38:08.861877 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-66082ccf-a9d3-4b7d-8221-c5df76e551bd tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:08.872553 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-66082ccf-a9d3-4b7d-8221-c5df76e551bd tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:08.874517 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-66082ccf-a9d3-4b7d-8221-c5df76e551bd tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:08.877006 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-66082ccf-a9d3-4b7d-8221-c5df76e551bd tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1408 microversion: 2.54 time: 0.115608 Jul 25 14:38:08.877698 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1449/3090] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:38:08 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1408 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:38:09.281422 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e4da1e58-4042-4721-9783-8038bd934824 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:09.281879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e4da1e58-4042-4721-9783-8038bd934824 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: a85a57f0-715f-47cd-ae19-463dfc5e7aca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:09.289405 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e4da1e58-4042-4721-9783-8038bd934824 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:09.289852 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e4da1e58-4042-4721-9783-8038bd934824 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:09.290691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e4da1e58-4042-4721-9783-8038bd934824 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:09.291093 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e4da1e58-4042-4721-9783-8038bd934824 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:09.305986 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-e4da1e58-4042-4721-9783-8038bd934824 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] HTTP exception thrown: Instance a85a57f0-715f-47cd-ae19-463dfc5e7aca could not be found. Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e4da1e58-4042-4721-9783-8038bd934824 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Request method failure captured: Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca HTTP/1.1 Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qj7qGPct9b6C-uL3HbJd-QfzuzhSMgcQq60rAmLf4omKe0e-YflewTadRMLO-QcFD0lbvZaMv23hN_u3lrPF6ypkGfUy6kSr42d07ldMTgv9Be8O_z4PIw3ikjNbHHM9Htwnk6fHnsGS0qStvlssGykbQn_HCa6zv_OMCTCaQuVLpM Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: ceaa4430d1864bc2bf9afdec9cd0cf64 Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-LiveMigrationTest-1104846204 Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ceaa4430d1864bc2bf9afdec9cd0cf64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ceaa4430d1864bc2bf9afdec9cd0cf64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ceaa4430d1864bc2bf9afdec9cd0cf64", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ceaa4430d1864bc2bf9afdec9cd0cf64"}]}] Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-LiveMigrationTest-1104846204 Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: ceaa4430d1864bc2bf9afdec9cd0cf64 Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-LiveMigrationTest-1104846204 Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-LiveMigrationTest-1104846204-project Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 3da7c9a3c01f4dbca93d5e7aa688fc70 Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-LiveMigrationTest-1104846204-project Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance a85a57f0-715f-47cd-ae19-463dfc5e7aca could not be found. Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'a85a57f0-715f-47cd-ae19-463dfc5e7aca'} Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a85a57f0-715f-47cd-ae19-463dfc5e7aca could not be found. Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a85a57f0-715f-47cd-ae19-463dfc5e7aca could not be found. Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:09.307699 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:09.312493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:09.312493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:09.312493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:09.312493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:38:09.312493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:38:09.312493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a85a57f0-715f-47cd-ae19-463dfc5e7aca could not be found. Jul 25 14:38:09.312493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:09.312493 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e4da1e58-4042-4721-9783-8038bd934824 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Returning 404 to user: Instance a85a57f0-715f-47cd-ae19-463dfc5e7aca could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:38:09.312493 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e4da1e58-4042-4721-9783-8038bd934824 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca" status: 404 len: 111 microversion: 2.1 time: 0.032178 Jul 25 14:38:09.312493 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1642/3091] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:09 2022] GET /compute/v2.1/servers/a85a57f0-715f-47cd-ae19-463dfc5e7aca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:38:09.320026 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c9e2cecb-c833-459d-b29f-f855bc85b166 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '.version_select at 0x7f4686ad8160>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:09.342937 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c9e2cecb-c833-459d-b29f-f855bc85b166 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1446891271" status: 202 len: 0 microversion: 2.1 time: 0.027951 Jul 25 14:38:09.343633 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1450/3092] 10.222.0.88 () {58 vars in 1221 bytes} [Mon Jul 25 14:38:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1446891271 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:38:09.798399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8dd1548f-e294-426c-a53f-82746be3c4c6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:09.799625 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8dd1548f-e294-426c-a53f-82746be3c4c6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: e58c1cf0-5e50-42a9-a430-7a6ef7933743] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:09.813987 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8dd1548f-e294-426c-a53f-82746be3c4c6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:09.814751 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8dd1548f-e294-426c-a53f-82746be3c4c6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:09.815924 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8dd1548f-e294-426c-a53f-82746be3c4c6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:09.816485 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8dd1548f-e294-426c-a53f-82746be3c4c6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:09.904755 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b7549c57-adbf-4103-95e8-31cd354403ce tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:09.905754 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b7549c57-adbf-4103-95e8-31cd354403ce tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:09.922116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b7549c57-adbf-4103-95e8-31cd354403ce tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:09.923150 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b7549c57-adbf-4103-95e8-31cd354403ce tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:09.924137 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b7549c57-adbf-4103-95e8-31cd354403ce tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:09.924765 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b7549c57-adbf-4103-95e8-31cd354403ce tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:10.074522 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b7549c57-adbf-4103-95e8-31cd354403ce tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:10.078874 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8dd1548f-e294-426c-a53f-82746be3c4c6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:10.088408 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b7549c57-adbf-4103-95e8-31cd354403ce tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:10.089596 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8dd1548f-e294-426c-a53f-82746be3c4c6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743" status: 200 len: 1292 microversion: 2.1 time: 0.295268 Jul 25 14:38:10.090925 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1643/3093] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:09 2022] GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743 => generated 1292 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:10.092311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b7549c57-adbf-4103-95e8-31cd354403ce tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:10.094547 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b7549c57-adbf-4103-95e8-31cd354403ce tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1408 microversion: 2.54 time: 0.196818 Jul 25 14:38:10.095860 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1451/3094] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:38:09 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:38:10.107365 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-797609cb-b8b6-4e14-9198-b98df0e9464d tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:10.108054 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-797609cb-b8b6-4e14-9198-b98df0e9464d tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:10.115042 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-797609cb-b8b6-4e14-9198-b98df0e9464d tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:10.115604 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-797609cb-b8b6-4e14-9198-b98df0e9464d tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:10.116591 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-797609cb-b8b6-4e14-9198-b98df0e9464d tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:10.117346 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-797609cb-b8b6-4e14-9198-b98df0e9464d tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:10.144349 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-797609cb-b8b6-4e14-9198-b98df0e9464d tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:38:10.237162 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-797609cb-b8b6-4e14-9198-b98df0e9464d tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "DELETE /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e" status: 204 len: 0 microversion: 2.1 time: 0.134272 Jul 25 14:38:10.238254 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1644/3095] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:38:10 2022] DELETE /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 14:38:10.247083 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b0e4e207-e178-45db-814b-cea65544ea21 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:10.248118 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b0e4e207-e178-45db-814b-cea65544ea21 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:10.261119 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b0e4e207-e178-45db-814b-cea65544ea21 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:10.261576 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b0e4e207-e178-45db-814b-cea65544ea21 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:10.262391 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b0e4e207-e178-45db-814b-cea65544ea21 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:10.262806 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b0e4e207-e178-45db-814b-cea65544ea21 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:10.443814 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b0e4e207-e178-45db-814b-cea65544ea21 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:10.455324 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b0e4e207-e178-45db-814b-cea65544ea21 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e" status: 200 len: 1484 microversion: 2.1 time: 0.212617 Jul 25 14:38:10.456597 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1452/3096] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:10 2022] GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e => generated 1484 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:11.119827 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-645087d0-3005-464b-ab89-b2cc376d7a9e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:11.122197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-645087d0-3005-464b-ab89-b2cc376d7a9e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: e58c1cf0-5e50-42a9-a430-7a6ef7933743] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:11.127362 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2ba8d517-66e2-4874-86a0-608cd5206add tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:11.128232 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2ba8d517-66e2-4874-86a0-608cd5206add tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:11.133656 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:38:11.136760 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ba8d517-66e2-4874-86a0-608cd5206add tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:11.139082 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ba8d517-66e2-4874-86a0-608cd5206add tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:11.141206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ba8d517-66e2-4874-86a0-608cd5206add tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:11.144513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ba8d517-66e2-4874-86a0-608cd5206add tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:11.149674 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-645087d0-3005-464b-ab89-b2cc376d7a9e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:11.150199 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-645087d0-3005-464b-ab89-b2cc376d7a9e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:11.151681 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-645087d0-3005-464b-ab89-b2cc376d7a9e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:11.152360 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-645087d0-3005-464b-ab89-b2cc376d7a9e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:11.309474 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2ba8d517-66e2-4874-86a0-608cd5206add tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:11.333147 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2ba8d517-66e2-4874-86a0-608cd5206add tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:11.335362 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2ba8d517-66e2-4874-86a0-608cd5206add tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:11.337062 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2ba8d517-66e2-4874-86a0-608cd5206add tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1408 microversion: 2.54 time: 0.213660 Jul 25 14:38:11.352634 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1453/3097] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:38:11 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1408 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:38:11.363819 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-0e412172-0b3e-4108-af52-318095b5a81b req-6e247325-fa3f-444b-bace-7095089a7bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48341efc-a4b6-4532-8a2b-ac8d8f50a26e", "name": "network-vif-deleted", "tag": "2b310f15-4cbb-46d3-87df-2b7fb95774aa"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:11.376983 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-0e412172-0b3e-4108-af52-318095b5a81b req-6e247325-fa3f-444b-bace-7095089a7bd0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:11.377576 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-0e412172-0b3e-4108-af52-318095b5a81b req-6e247325-fa3f-444b-bace-7095089a7bd0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:11.394890 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-0e412172-0b3e-4108-af52-318095b5a81b req-6e247325-fa3f-444b-bace-7095089a7bd0 service nova] Creating event network-vif-deleted:2b310f15-4cbb-46d3-87df-2b7fb95774aa for instance 48341efc-a4b6-4532-8a2b-ac8d8f50a26e on n-h1-846435-14 Jul 25 14:38:11.403626 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-0e412172-0b3e-4108-af52-318095b5a81b req-6e247325-fa3f-444b-bace-7095089a7bd0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048728 Jul 25 14:38:11.405164 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1454/3098] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:38:11.481398 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a60c6613-d964-433e-be19-c4c97fce5568 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:11.482151 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-645087d0-3005-464b-ab89-b2cc376d7a9e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:11.483762 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a60c6613-d964-433e-be19-c4c97fce5568 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:11.492145 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-645087d0-3005-464b-ab89-b2cc376d7a9e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743" status: 200 len: 1292 microversion: 2.1 time: 0.375990 Jul 25 14:38:11.495482 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1645/3099] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:11 2022] GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743 => generated 1292 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:11.495956 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a60c6613-d964-433e-be19-c4c97fce5568 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:11.496657 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a60c6613-d964-433e-be19-c4c97fce5568 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:11.497697 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a60c6613-d964-433e-be19-c4c97fce5568 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:11.498133 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a60c6613-d964-433e-be19-c4c97fce5568 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:11.534125 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a60c6613-d964-433e-be19-c4c97fce5568 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:11.534573 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a60c6613-d964-433e-be19-c4c97fce5568 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:11.535592 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-a60c6613-d964-433e-be19-c4c97fce5568 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lazy-loading 'fault' on Instance uuid 48341efc-a4b6-4532-8a2b-ac8d8f50a26e {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:38:11.585257 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a60c6613-d964-433e-be19-c4c97fce5568 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:11.606744 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a60c6613-d964-433e-be19-c4c97fce5568 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e" status: 200 len: 1300 microversion: 2.1 time: 0.133115 Jul 25 14:38:11.608660 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1455/3100] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:11 2022] GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e => generated 1300 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:11.787091 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-58c26efd-8cc0-46e4-904f-9665ff04e4f5 req-8cf45794-317b-4631-8f33-57241445f0a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e58c1cf0-5e50-42a9-a430-7a6ef7933743", "name": "network-vif-plugged", "status": "completed", "tag": "3ec76678-4c3e-4b85-b561-36b5c6e2241a"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:11.800912 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-58c26efd-8cc0-46e4-904f-9665ff04e4f5 req-8cf45794-317b-4631-8f33-57241445f0a3 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:11.801589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-58c26efd-8cc0-46e4-904f-9665ff04e4f5 req-8cf45794-317b-4631-8f33-57241445f0a3 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:11.835881 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-58c26efd-8cc0-46e4-904f-9665ff04e4f5 req-8cf45794-317b-4631-8f33-57241445f0a3 service nova] Creating event network-vif-plugged:3ec76678-4c3e-4b85-b561-36b5c6e2241a for instance e58c1cf0-5e50-42a9-a430-7a6ef7933743 on n-h2-846435-14 Jul 25 14:38:11.849962 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-58c26efd-8cc0-46e4-904f-9665ff04e4f5 req-8cf45794-317b-4631-8f33-57241445f0a3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071816 Jul 25 14:38:11.850782 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1646/3101] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:38:12.368007 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7ba93119-ac30-41b3-abf2-cc84ac8baa39 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:12.368653 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7ba93119-ac30-41b3-abf2-cc84ac8baa39 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:12.376464 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ba93119-ac30-41b3-abf2-cc84ac8baa39 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:12.376464 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ba93119-ac30-41b3-abf2-cc84ac8baa39 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:12.377184 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ba93119-ac30-41b3-abf2-cc84ac8baa39 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:12.377625 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ba93119-ac30-41b3-abf2-cc84ac8baa39 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:12.448789 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7ba93119-ac30-41b3-abf2-cc84ac8baa39 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:12.457808 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7ba93119-ac30-41b3-abf2-cc84ac8baa39 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:12.459355 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7ba93119-ac30-41b3-abf2-cc84ac8baa39 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:12.460538 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7ba93119-ac30-41b3-abf2-cc84ac8baa39 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1408 microversion: 2.54 time: 0.096778 Jul 25 14:38:12.464070 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1456/3102] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:38:12 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1408 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:38:12.519826 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3b63f046-ecb5-413a-b807-32024ffae8c9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:12.520558 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3b63f046-ecb5-413a-b807-32024ffae8c9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: e58c1cf0-5e50-42a9-a430-7a6ef7933743] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:12.527432 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b63f046-ecb5-413a-b807-32024ffae8c9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:12.527945 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b63f046-ecb5-413a-b807-32024ffae8c9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:12.528827 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b63f046-ecb5-413a-b807-32024ffae8c9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:12.529324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b63f046-ecb5-413a-b807-32024ffae8c9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:12.628638 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-24eecaee-f2b9-4a17-b273-c50dc21a6795 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:12.629334 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-24eecaee-f2b9-4a17-b273-c50dc21a6795 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 48341efc-a4b6-4532-8a2b-ac8d8f50a26e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:12.635954 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-24eecaee-f2b9-4a17-b273-c50dc21a6795 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:12.636706 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-24eecaee-f2b9-4a17-b273-c50dc21a6795 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:12.637541 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-24eecaee-f2b9-4a17-b273-c50dc21a6795 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:12.638213 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-24eecaee-f2b9-4a17-b273-c50dc21a6795 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:12.652490 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-24eecaee-f2b9-4a17-b273-c50dc21a6795 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] HTTP exception thrown: Instance 48341efc-a4b6-4532-8a2b-ac8d8f50a26e could not be found. Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-24eecaee-f2b9-4a17-b273-c50dc21a6795 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Request method failure captured: Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e HTTP/1.1 Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qj7qGPct9b6C-uL3HbJd-QfzuzhSMgcQq60rAmLf4omKe0e-YflewTadRMLO-QcFD0lbvZaMv23hN_u3lrPF6ypkGfUy6kSr42d07ldMTgv9Be8O_z4PIw3ikjNbHHM9Htwnk6fHnsGS0qStvlssGykbQn_HCa6zv_OMCTCaQuVLpM Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: ceaa4430d1864bc2bf9afdec9cd0cf64 Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-LiveMigrationTest-1104846204 Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ceaa4430d1864bc2bf9afdec9cd0cf64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ceaa4430d1864bc2bf9afdec9cd0cf64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ceaa4430d1864bc2bf9afdec9cd0cf64", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ceaa4430d1864bc2bf9afdec9cd0cf64"}]}] Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-LiveMigrationTest-1104846204 Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: ceaa4430d1864bc2bf9afdec9cd0cf64 Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-LiveMigrationTest-1104846204 Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-LiveMigrationTest-1104846204-project Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 3da7c9a3c01f4dbca93d5e7aa688fc70 Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-LiveMigrationTest-1104846204-project Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 48341efc-a4b6-4532-8a2b-ac8d8f50a26e could not be found. Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '48341efc-a4b6-4532-8a2b-ac8d8f50a26e'} Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48341efc-a4b6-4532-8a2b-ac8d8f50a26e could not be found. Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48341efc-a4b6-4532-8a2b-ac8d8f50a26e could not be found. Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:12.654454 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:12.662737 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:12.662737 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:12.662737 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:12.662737 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:38:12.662737 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:38:12.662737 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48341efc-a4b6-4532-8a2b-ac8d8f50a26e could not be found. Jul 25 14:38:12.662737 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:12.662737 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-24eecaee-f2b9-4a17-b273-c50dc21a6795 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Returning 404 to user: Instance 48341efc-a4b6-4532-8a2b-ac8d8f50a26e could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:38:12.662737 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-24eecaee-f2b9-4a17-b273-c50dc21a6795 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e" status: 404 len: 111 microversion: 2.1 time: 0.031214 Jul 25 14:38:12.662737 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1457/3103] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:12 2022] GET /compute/v2.1/servers/48341efc-a4b6-4532-8a2b-ac8d8f50a26e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:38:12.665870 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-00a24288-14dc-4fe4-be2d-e708a2a90a94 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:12.666366 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-00a24288-14dc-4fe4-be2d-e708a2a90a94 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:12.672633 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00a24288-14dc-4fe4-be2d-e708a2a90a94 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:12.673220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00a24288-14dc-4fe4-be2d-e708a2a90a94 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:12.673852 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00a24288-14dc-4fe4-be2d-e708a2a90a94 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:12.674289 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00a24288-14dc-4fe4-be2d-e708a2a90a94 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:12.682551 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3b63f046-ecb5-413a-b807-32024ffae8c9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:12.690153 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3b63f046-ecb5-413a-b807-32024ffae8c9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743" status: 200 len: 1292 microversion: 2.1 time: 0.176829 Jul 25 14:38:12.690722 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1647/3104] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:12 2022] GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743 => generated 1292 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:12.701401 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-00a24288-14dc-4fe4-be2d-e708a2a90a94 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:38:12.783446 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-00a24288-14dc-4fe4-be2d-e708a2a90a94 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "DELETE /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd" status: 204 len: 0 microversion: 2.1 time: 0.121815 Jul 25 14:38:12.784109 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1458/3105] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:38:12 2022] DELETE /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:38:12.792832 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8f556440-2571-430c-b422-da6e4400060d tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:12.793445 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8f556440-2571-430c-b422-da6e4400060d tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:12.799515 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f556440-2571-430c-b422-da6e4400060d tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:12.800076 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f556440-2571-430c-b422-da6e4400060d tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:12.800821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f556440-2571-430c-b422-da6e4400060d tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:12.801247 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f556440-2571-430c-b422-da6e4400060d tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:13.203563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8f556440-2571-430c-b422-da6e4400060d tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:13.211809 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8f556440-2571-430c-b422-da6e4400060d tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd" status: 200 len: 1499 microversion: 2.1 time: 0.422963 Jul 25 14:38:13.212403 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1648/3106] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:12 2022] GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd => generated 1499 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:13.486519 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8239d7ac-fae3-4b76-979c-53811b295f62 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:13.487257 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8239d7ac-fae3-4b76-979c-53811b295f62 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:13.496016 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8239d7ac-fae3-4b76-979c-53811b295f62 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:13.496472 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8239d7ac-fae3-4b76-979c-53811b295f62 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:13.497231 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8239d7ac-fae3-4b76-979c-53811b295f62 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:13.497895 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8239d7ac-fae3-4b76-979c-53811b295f62 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:13.595638 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8239d7ac-fae3-4b76-979c-53811b295f62 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:13.607166 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8239d7ac-fae3-4b76-979c-53811b295f62 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:13.610078 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8239d7ac-fae3-4b76-979c-53811b295f62 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:13.611962 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8239d7ac-fae3-4b76-979c-53811b295f62 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1408 microversion: 2.54 time: 0.130418 Jul 25 14:38:13.612859 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1459/3107] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:38:13 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1408 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:38:13.711285 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e46f3fad-905a-405a-a608-a6c2d690d3d6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:13.711899 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e46f3fad-905a-405a-a608-a6c2d690d3d6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: e58c1cf0-5e50-42a9-a430-7a6ef7933743] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:13.732404 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e46f3fad-905a-405a-a608-a6c2d690d3d6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:13.735849 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e46f3fad-905a-405a-a608-a6c2d690d3d6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:13.737619 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e46f3fad-905a-405a-a608-a6c2d690d3d6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:13.738399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e46f3fad-905a-405a-a608-a6c2d690d3d6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:13.756263 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-ab80512e-97f6-472d-89b1-500784e95f7e req-8b7ea182-3a0c-4c30-8260-fe427942aa92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5694bd9c-d7e8-4f20-8404-fc5e747c93cd", "name": "network-vif-deleted", "tag": "972e03f2-20ce-491f-a29a-2936da24a706"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:13.770550 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ab80512e-97f6-472d-89b1-500784e95f7e req-8b7ea182-3a0c-4c30-8260-fe427942aa92 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:13.772195 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ab80512e-97f6-472d-89b1-500784e95f7e req-8b7ea182-3a0c-4c30-8260-fe427942aa92 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:13.791835 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-ab80512e-97f6-472d-89b1-500784e95f7e req-8b7ea182-3a0c-4c30-8260-fe427942aa92 service nova] Creating event network-vif-deleted:972e03f2-20ce-491f-a29a-2936da24a706 for instance 5694bd9c-d7e8-4f20-8404-fc5e747c93cd on n-h1-846435-14 Jul 25 14:38:13.801442 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-ab80512e-97f6-472d-89b1-500784e95f7e req-8b7ea182-3a0c-4c30-8260-fe427942aa92 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047342 Jul 25 14:38:13.801442 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1460/3108] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:38:13.908171 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e46f3fad-905a-405a-a608-a6c2d690d3d6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:13.917863 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e46f3fad-905a-405a-a608-a6c2d690d3d6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743" status: 200 len: 1473 microversion: 2.1 time: 0.210790 Jul 25 14:38:13.928913 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1649/3109] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:13 2022] GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743 => generated 1473 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:38:13.987125 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2dbbabaa-c195-4c05-aeec-010c51371a91 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1696045299", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:14.043677 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-2dbbabaa-c195-4c05-aeec-010c51371a91 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] validate_networks() for [('4c176170-2f7d-43a7-8c89-c74c022eb418', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:38:14.235104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-519d020a-1820-49cb-b175-c49e812dc993 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:14.236514 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-519d020a-1820-49cb-b175-c49e812dc993 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:14.244491 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-519d020a-1820-49cb-b175-c49e812dc993 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:14.245296 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-519d020a-1820-49cb-b175-c49e812dc993 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:14.246330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-519d020a-1820-49cb-b175-c49e812dc993 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:14.246974 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-519d020a-1820-49cb-b175-c49e812dc993 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:14.259732 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:38:14.334363 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-519d020a-1820-49cb-b175-c49e812dc993 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:14.335204 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-519d020a-1820-49cb-b175-c49e812dc993 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:14.336176 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-519d020a-1820-49cb-b175-c49e812dc993 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lazy-loading 'fault' on Instance uuid 5694bd9c-d7e8-4f20-8404-fc5e747c93cd {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:38:14.410776 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-519d020a-1820-49cb-b175-c49e812dc993 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da7c9a3c01f4dbca93d5e7aa688fc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceaa4430d1864bc2bf9afdec9cd0cf64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:14.418076 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-519d020a-1820-49cb-b175-c49e812dc993 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd" status: 200 len: 1301 microversion: 2.1 time: 0.187823 Jul 25 14:38:14.419335 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1650/3110] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:14 2022] GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd => generated 1301 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:14.620339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-2dbbabaa-c195-4c05-aeec-010c51371a91 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:38:14.620768 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-2dbbabaa-c195-4c05-aeec-010c51371a91 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:38:14.621239 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-2dbbabaa-c195-4c05-aeec-010c51371a91 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:38:14.621871 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-2dbbabaa-c195-4c05-aeec-010c51371a91 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:38:14.622291 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-2dbbabaa-c195-4c05-aeec-010c51371a91 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:38:14.637075 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e67f54e4-2697-44d2-9ada-ca66b3309fa0 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:14.638163 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e67f54e4-2697-44d2-9ada-ca66b3309fa0 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:14.642717 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2dbbabaa-c195-4c05-aeec-010c51371a91 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:14.643185 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2dbbabaa-c195-4c05-aeec-010c51371a91 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:14.644014 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2dbbabaa-c195-4c05-aeec-010c51371a91 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:14.644467 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2dbbabaa-c195-4c05-aeec-010c51371a91 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:14.647306 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e67f54e4-2697-44d2-9ada-ca66b3309fa0 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:14.648149 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e67f54e4-2697-44d2-9ada-ca66b3309fa0 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:14.649615 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e67f54e4-2697-44d2-9ada-ca66b3309fa0 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:14.650570 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e67f54e4-2697-44d2-9ada-ca66b3309fa0 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:14.672150 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-2dbbabaa-c195-4c05-aeec-010c51371a91 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Getting quotas for project e77732af189e48feab3752ddb28208d3. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:38:14.678785 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-2dbbabaa-c195-4c05-aeec-010c51371a91 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Getting quotas for user e45ffe0956ae4ba9b1577875f312af06 and project e77732af189e48feab3752ddb28208d3. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:38:14.692890 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2dbbabaa-c195-4c05-aeec-010c51371a91 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:38:14.695810 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2dbbabaa-c195-4c05-aeec-010c51371a91 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: bc636abb-0ba9-4071-a5fc-4d05dd3c174e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:38:14.754237 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e67f54e4-2697-44d2-9ada-ca66b3309fa0 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:14.765215 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e67f54e4-2697-44d2-9ada-ca66b3309fa0 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:14.767107 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e67f54e4-2697-44d2-9ada-ca66b3309fa0 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:14.768611 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e67f54e4-2697-44d2-9ada-ca66b3309fa0 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1408 microversion: 2.54 time: 0.136283 Jul 25 14:38:14.780050 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2dbbabaa-c195-4c05-aeec-010c51371a91 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.790673 Jul 25 14:38:14.780050 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1461/3111] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:38:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:38:14.782118 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1651/3112] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:38:14 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:38:14.797358 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-21a0c943-ab88-46e4-964f-3b984a90112e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:14.797893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-21a0c943-ab88-46e4-964f-3b984a90112e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: bc636abb-0ba9-4071-a5fc-4d05dd3c174e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:14.815949 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-21a0c943-ab88-46e4-964f-3b984a90112e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: bc636abb-0ba9-4071-a5fc-4d05dd3c174e] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:38:15.298275 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.scheduler.client.report [None req-21a0c943-ab88-46e4-964f-3b984a90112e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Deleted allocations for instance bc636abb-0ba9-4071-a5fc-4d05dd3c174e Jul 25 14:38:15.317416 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.compute.api [None req-21a0c943-ab88-46e4-964f-3b984a90112e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: bc636abb-0ba9-4071-a5fc-4d05dd3c174e] Instance Mapping does not exist while attempting local delete cleanup. Jul 25 14:38:15.319183 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-21a0c943-ab88-46e4-964f-3b984a90112e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "DELETE /compute/v2.1/servers/bc636abb-0ba9-4071-a5fc-4d05dd3c174e" status: 204 len: 0 microversion: 2.1 time: 0.527273 Jul 25 14:38:15.320830 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1462/3113] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:38:14 2022] DELETE /compute/v2.1/servers/bc636abb-0ba9-4071-a5fc-4d05dd3c174e => generated 0 bytes in 530 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:38:15.332025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4474834a-162b-4156-b3a7-90a640fa491d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:15.334067 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4474834a-162b-4156-b3a7-90a640fa491d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: bc636abb-0ba9-4071-a5fc-4d05dd3c174e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:15.343192 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-4474834a-162b-4156-b3a7-90a640fa491d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] HTTP exception thrown: Instance bc636abb-0ba9-4071-a5fc-4d05dd3c174e could not be found. Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4474834a-162b-4156-b3a7-90a640fa491d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Request method failure captured: Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/bc636abb-0ba9-4071-a5fc-4d05dd3c174e HTTP/1.1 Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qrEzscNKkpLEv-dO5KC3kdeJJY02nOIPLRIxGcrQR-Na_rLZBnVMM8MjTz-RtprnQR45AAorrNLLV4PDOD1PCa-gGNHdgbGOQfAGQYPzZpu9aSUEO6v7jEn8m2OVF51pdW16QE7pCXmLdRnFRt172yMaxqytlLvEMs-sUVBeXNXrcQ Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e77732af189e48feab3752ddb28208d3", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e77732af189e48feab3752ddb28208d3"}]}] Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersTestJSON-1827246574 Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersTestJSON-1827246574-project Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: e45ffe0956ae4ba9b1577875f312af06 Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersTestJSON-1827246574-project Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance bc636abb-0ba9-4071-a5fc-4d05dd3c174e could not be found. Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'bc636abb-0ba9-4071-a5fc-4d05dd3c174e'} Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc636abb-0ba9-4071-a5fc-4d05dd3c174e could not be found. Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc636abb-0ba9-4071-a5fc-4d05dd3c174e could not be found. Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:15.345900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:15.350211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:38:15.350211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:38:15.350211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc636abb-0ba9-4071-a5fc-4d05dd3c174e could not be found. Jul 25 14:38:15.350211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:15.353070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4474834a-162b-4156-b3a7-90a640fa491d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Returning 404 to user: Instance bc636abb-0ba9-4071-a5fc-4d05dd3c174e could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:38:15.354366 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4474834a-162b-4156-b3a7-90a640fa491d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/bc636abb-0ba9-4071-a5fc-4d05dd3c174e" status: 404 len: 111 microversion: 2.1 time: 0.028717 Jul 25 14:38:15.354947 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1652/3114] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:15 2022] GET /compute/v2.1/servers/bc636abb-0ba9-4071-a5fc-4d05dd3c174e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:38:15.406546 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f6693011-7a02-43c7-b769-647cf109bacf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1247477671", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "4c176170-2f7d-43a7-8c89-c74c022eb418"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:15.448079 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-21225578-c314-4e39-b388-cd80f6ddbd43 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:15.448859 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-21225578-c314-4e39-b388-cd80f6ddbd43 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] [instance: 5694bd9c-d7e8-4f20-8404-fc5e747c93cd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:15.458166 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-21225578-c314-4e39-b388-cd80f6ddbd43 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:15.458750 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-21225578-c314-4e39-b388-cd80f6ddbd43 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:15.459894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-21225578-c314-4e39-b388-cd80f6ddbd43 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:15.460560 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-21225578-c314-4e39-b388-cd80f6ddbd43 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:15.479497 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-f6693011-7a02-43c7-b769-647cf109bacf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] validate_networks() for [('4c176170-2f7d-43a7-8c89-c74c022eb418', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:38:15.483330 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-21225578-c314-4e39-b388-cd80f6ddbd43 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] HTTP exception thrown: Instance 5694bd9c-d7e8-4f20-8404-fc5e747c93cd could not be found. Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-21225578-c314-4e39-b388-cd80f6ddbd43 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Request method failure captured: Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd HTTP/1.1 Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qj7qGPct9b6C-uL3HbJd-QfzuzhSMgcQq60rAmLf4omKe0e-YflewTadRMLO-QcFD0lbvZaMv23hN_u3lrPF6ypkGfUy6kSr42d07ldMTgv9Be8O_z4PIw3ikjNbHHM9Htwnk6fHnsGS0qStvlssGykbQn_HCa6zv_OMCTCaQuVLpM Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: ceaa4430d1864bc2bf9afdec9cd0cf64 Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-LiveMigrationTest-1104846204 Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ceaa4430d1864bc2bf9afdec9cd0cf64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ceaa4430d1864bc2bf9afdec9cd0cf64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ceaa4430d1864bc2bf9afdec9cd0cf64", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ceaa4430d1864bc2bf9afdec9cd0cf64"}]}] Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-LiveMigrationTest-1104846204 Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: ceaa4430d1864bc2bf9afdec9cd0cf64 Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-LiveMigrationTest-1104846204 Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-LiveMigrationTest-1104846204-project Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 3da7c9a3c01f4dbca93d5e7aa688fc70 Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-LiveMigrationTest-1104846204-project Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 5694bd9c-d7e8-4f20-8404-fc5e747c93cd could not be found. Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '5694bd9c-d7e8-4f20-8404-fc5e747c93cd'} Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5694bd9c-d7e8-4f20-8404-fc5e747c93cd could not be found. Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5694bd9c-d7e8-4f20-8404-fc5e747c93cd could not be found. Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:15.485346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:15.490257 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:15.490257 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:15.490257 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:15.490257 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:38:15.490257 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:38:15.490257 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5694bd9c-d7e8-4f20-8404-fc5e747c93cd could not be found. Jul 25 14:38:15.490257 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:15.492765 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-21225578-c314-4e39-b388-cd80f6ddbd43 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] Returning 404 to user: Instance 5694bd9c-d7e8-4f20-8404-fc5e747c93cd could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:38:15.493882 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-21225578-c314-4e39-b388-cd80f6ddbd43 tempest-LiveMigrationTest-1104846204 tempest-LiveMigrationTest-1104846204-project] 10.222.0.88 "GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd" status: 404 len: 111 microversion: 2.1 time: 0.056832 Jul 25 14:38:15.495015 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1653/3115] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:15 2022] GET /compute/v2.1/servers/5694bd9c-d7e8-4f20-8404-fc5e747c93cd => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:38:15.795530 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f81d1444-ba53-4e3b-b4a3-b3354f29d422 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:15.796900 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f81d1444-ba53-4e3b-b4a3-b3354f29d422 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:15.815723 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f81d1444-ba53-4e3b-b4a3-b3354f29d422 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:15.816204 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f81d1444-ba53-4e3b-b4a3-b3354f29d422 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:15.816989 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f81d1444-ba53-4e3b-b4a3-b3354f29d422 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:15.817896 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f81d1444-ba53-4e3b-b4a3-b3354f29d422 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:15.901891 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-f6693011-7a02-43c7-b769-647cf109bacf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:38:15.902474 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-f6693011-7a02-43c7-b769-647cf109bacf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:38:15.902946 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-f6693011-7a02-43c7-b769-647cf109bacf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:38:15.903348 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-f6693011-7a02-43c7-b769-647cf109bacf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:38:15.903802 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-f6693011-7a02-43c7-b769-647cf109bacf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:38:15.906430 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:38:15.915595 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f81d1444-ba53-4e3b-b4a3-b3354f29d422 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:15.928917 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f81d1444-ba53-4e3b-b4a3-b3354f29d422 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:15.930805 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f81d1444-ba53-4e3b-b4a3-b3354f29d422 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:15.934788 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f6693011-7a02-43c7-b769-647cf109bacf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:15.935359 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f6693011-7a02-43c7-b769-647cf109bacf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:15.936337 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f6693011-7a02-43c7-b769-647cf109bacf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:15.936774 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f6693011-7a02-43c7-b769-647cf109bacf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:15.940189 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f81d1444-ba53-4e3b-b4a3-b3354f29d422 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1408 microversion: 2.54 time: 0.140938 Jul 25 14:38:15.940844 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1654/3116] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:38:15 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:38:15.968531 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-f6693011-7a02-43c7-b769-647cf109bacf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Getting quotas for project e77732af189e48feab3752ddb28208d3. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:38:15.973863 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-f6693011-7a02-43c7-b769-647cf109bacf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Getting quotas for user e45ffe0956ae4ba9b1577875f312af06 and project e77732af189e48feab3752ddb28208d3. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:38:15.986671 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f6693011-7a02-43c7-b769-647cf109bacf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:38:15.989404 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f6693011-7a02-43c7-b769-647cf109bacf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: ae539e1e-57e2-47ef-88b5-af8189cc7758] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:38:16.037133 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f6693011-7a02-43c7-b769-647cf109bacf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.635347 Jul 25 14:38:16.043690 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1463/3117] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:38:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:38:16.049724 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e3f3808f-8cc1-4de4-91a6-ca7e229a3e88 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:16.050602 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e3f3808f-8cc1-4de4-91a6-ca7e229a3e88 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: ae539e1e-57e2-47ef-88b5-af8189cc7758] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:16.154132 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e3f3808f-8cc1-4de4-91a6-ca7e229a3e88 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:16.168535 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e3f3808f-8cc1-4de4-91a6-ca7e229a3e88 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758" status: 200 len: 1221 microversion: 2.1 time: 0.122458 Jul 25 14:38:16.169825 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1655/3118] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:16 2022] GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758 => generated 1221 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:16.967447 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3b6c577c-3a8b-4219-8de5-3ad0c7a3da1b tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:16.968514 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3b6c577c-3a8b-4219-8de5-3ad0c7a3da1b tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:16.977242 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b6c577c-3a8b-4219-8de5-3ad0c7a3da1b tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:16.977920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b6c577c-3a8b-4219-8de5-3ad0c7a3da1b tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:16.978740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b6c577c-3a8b-4219-8de5-3ad0c7a3da1b tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:16.979354 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b6c577c-3a8b-4219-8de5-3ad0c7a3da1b tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:17.069086 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3b6c577c-3a8b-4219-8de5-3ad0c7a3da1b tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:17.081265 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3b6c577c-3a8b-4219-8de5-3ad0c7a3da1b tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:17.083407 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3b6c577c-3a8b-4219-8de5-3ad0c7a3da1b tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:17.086399 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3b6c577c-3a8b-4219-8de5-3ad0c7a3da1b tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1408 microversion: 2.54 time: 0.122537 Jul 25 14:38:17.087597 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1464/3119] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:38:16 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1408 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:38:17.200627 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fcf23a34-0084-4a9e-bf28-0cc9a14b7fc1 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:17.201280 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fcf23a34-0084-4a9e-bf28-0cc9a14b7fc1 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: ae539e1e-57e2-47ef-88b5-af8189cc7758] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:17.223877 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fcf23a34-0084-4a9e-bf28-0cc9a14b7fc1 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:17.224386 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fcf23a34-0084-4a9e-bf28-0cc9a14b7fc1 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:17.225833 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fcf23a34-0084-4a9e-bf28-0cc9a14b7fc1 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:17.226470 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fcf23a34-0084-4a9e-bf28-0cc9a14b7fc1 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:17.342059 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fcf23a34-0084-4a9e-bf28-0cc9a14b7fc1 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:17.351860 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fcf23a34-0084-4a9e-bf28-0cc9a14b7fc1 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758" status: 200 len: 1225 microversion: 2.1 time: 0.153576 Jul 25 14:38:17.369432 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1656/3120] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:17 2022] GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758 => generated 1225 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:18.114501 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a448022e-fa6d-45e6-a248-84285b822485 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:18.117136 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a448022e-fa6d-45e6-a248-84285b822485 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:18.126367 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a448022e-fa6d-45e6-a248-84285b822485 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:18.127127 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a448022e-fa6d-45e6-a248-84285b822485 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:18.128234 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a448022e-fa6d-45e6-a248-84285b822485 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:18.128850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a448022e-fa6d-45e6-a248-84285b822485 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:18.375285 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e75f19c8-0a2e-4a98-99c8-b097f8c0b12f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:18.376621 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e75f19c8-0a2e-4a98-99c8-b097f8c0b12f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: ae539e1e-57e2-47ef-88b5-af8189cc7758] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:18.384919 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e75f19c8-0a2e-4a98-99c8-b097f8c0b12f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:18.385668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e75f19c8-0a2e-4a98-99c8-b097f8c0b12f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:18.386633 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e75f19c8-0a2e-4a98-99c8-b097f8c0b12f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:18.387219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e75f19c8-0a2e-4a98-99c8-b097f8c0b12f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:18.456416 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a448022e-fa6d-45e6-a248-84285b822485 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:18.466070 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a448022e-fa6d-45e6-a248-84285b822485 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:18.467858 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a448022e-fa6d-45e6-a248-84285b822485 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:18.469553 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a448022e-fa6d-45e6-a248-84285b822485 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1414 microversion: 2.54 time: 0.360148 Jul 25 14:38:18.470142 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1465/3121] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:38:18 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1414 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:38:18.547316 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e75f19c8-0a2e-4a98-99c8-b097f8c0b12f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:18.556428 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e75f19c8-0a2e-4a98-99c8-b097f8c0b12f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758" status: 200 len: 1273 microversion: 2.1 time: 0.185162 Jul 25 14:38:18.560367 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1657/3122] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:18 2022] GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758 => generated 1273 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:19.497886 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-eea22546-d81d-4ef0-9518-be0b75cdad6a tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:19.498671 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-eea22546-d81d-4ef0-9518-be0b75cdad6a tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:19.507013 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eea22546-d81d-4ef0-9518-be0b75cdad6a tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:19.507692 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eea22546-d81d-4ef0-9518-be0b75cdad6a tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:19.508688 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eea22546-d81d-4ef0-9518-be0b75cdad6a tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:19.509133 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eea22546-d81d-4ef0-9518-be0b75cdad6a tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:19.582451 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2edc783e-366f-45c1-ad6f-c62d9bc771e8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:19.583075 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2edc783e-366f-45c1-ad6f-c62d9bc771e8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: ae539e1e-57e2-47ef-88b5-af8189cc7758] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:19.601547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2edc783e-366f-45c1-ad6f-c62d9bc771e8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:19.603773 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2edc783e-366f-45c1-ad6f-c62d9bc771e8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:19.605368 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2edc783e-366f-45c1-ad6f-c62d9bc771e8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:19.606001 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2edc783e-366f-45c1-ad6f-c62d9bc771e8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:19.609320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-eea22546-d81d-4ef0-9518-be0b75cdad6a tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:19.642578 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-eea22546-d81d-4ef0-9518-be0b75cdad6a tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:19.645743 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-eea22546-d81d-4ef0-9518-be0b75cdad6a tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:19.648026 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-eea22546-d81d-4ef0-9518-be0b75cdad6a tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1414 microversion: 2.54 time: 0.156256 Jul 25 14:38:19.667391 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1466/3123] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:38:19 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1414 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:38:19.764375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2edc783e-366f-45c1-ad6f-c62d9bc771e8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:19.776277 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2edc783e-366f-45c1-ad6f-c62d9bc771e8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758" status: 200 len: 1279 microversion: 2.1 time: 0.201023 Jul 25 14:38:19.794013 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1658/3124] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:19 2022] GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758 => generated 1279 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:38:20.676309 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8f93ed79-6cce-4211-ace0-89d8714a1a0f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:20.677118 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8f93ed79-6cce-4211-ace0-89d8714a1a0f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:20.686923 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f93ed79-6cce-4211-ace0-89d8714a1a0f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:20.687504 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f93ed79-6cce-4211-ace0-89d8714a1a0f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:20.688977 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f93ed79-6cce-4211-ace0-89d8714a1a0f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:20.689736 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f93ed79-6cce-4211-ace0-89d8714a1a0f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:20.799537 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ef696071-e67e-41db-87eb-45ef8f82952f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:20.800190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ef696071-e67e-41db-87eb-45ef8f82952f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: ae539e1e-57e2-47ef-88b5-af8189cc7758] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:20.810829 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ef696071-e67e-41db-87eb-45ef8f82952f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:20.812883 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ef696071-e67e-41db-87eb-45ef8f82952f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:20.814078 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ef696071-e67e-41db-87eb-45ef8f82952f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:20.815225 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ef696071-e67e-41db-87eb-45ef8f82952f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:20.833086 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8f93ed79-6cce-4211-ace0-89d8714a1a0f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:20.846560 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8f93ed79-6cce-4211-ace0-89d8714a1a0f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:20.857498 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8f93ed79-6cce-4211-ace0-89d8714a1a0f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:20.860007 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8f93ed79-6cce-4211-ace0-89d8714a1a0f tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1399 microversion: 2.54 time: 0.189861 Jul 25 14:38:20.880865 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1467/3125] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:38:20 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1399 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:38:20.895965 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4204d610-72a7-499c-b3db-bd19ac9b800d tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '.version_select at 0x7f4686ad8310>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:20.926617 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4204d610-72a7-499c-b3db-bd19ac9b800d tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-890967624" status: 204 len: 0 microversion: 2.54 time: 0.040072 Jul 25 14:38:20.927341 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1468/3126] 10.222.0.88 () {60 vars in 1316 bytes} [Mon Jul 25 14:38:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-890967624 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 14:38:20.943915 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-84525f3b-9cd2-4173-ad46-fde371865548 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:20.944698 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-84525f3b-9cd2-4173-ad46-fde371865548 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:20.952357 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-84525f3b-9cd2-4173-ad46-fde371865548 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:20.953058 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-84525f3b-9cd2-4173-ad46-fde371865548 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:20.954216 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-84525f3b-9cd2-4173-ad46-fde371865548 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:20.954883 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-84525f3b-9cd2-4173-ad46-fde371865548 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:20.982055 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-84525f3b-9cd2-4173-ad46-fde371865548 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:38:20.997731 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:38:21.074534 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ef696071-e67e-41db-87eb-45ef8f82952f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:21.087250 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ef696071-e67e-41db-87eb-45ef8f82952f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758" status: 200 len: 1321 microversion: 2.1 time: 0.292112 Jul 25 14:38:21.091313 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1659/3127] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:20 2022] GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758 => generated 1321 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:21.105565 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-84525f3b-9cd2-4173-ad46-fde371865548 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "DELETE /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 204 len: 0 microversion: 2.54 time: 0.165797 Jul 25 14:38:21.109505 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1469/3128] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Jul 25 14:38:20 2022] DELETE /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 14:38:21.123856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-005b2d5f-561f-40dd-962e-c7f51fa427ea tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:21.124800 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-005b2d5f-561f-40dd-962e-c7f51fa427ea tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:21.131510 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-005b2d5f-561f-40dd-962e-c7f51fa427ea tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:21.132405 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-005b2d5f-561f-40dd-962e-c7f51fa427ea tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:21.133925 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-005b2d5f-561f-40dd-962e-c7f51fa427ea tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:21.134472 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-005b2d5f-561f-40dd-962e-c7f51fa427ea tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:21.221417 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-005b2d5f-561f-40dd-962e-c7f51fa427ea tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:21.232315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-005b2d5f-561f-40dd-962e-c7f51fa427ea tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:21.236061 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-005b2d5f-561f-40dd-962e-c7f51fa427ea tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:21.237302 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-005b2d5f-561f-40dd-962e-c7f51fa427ea tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1405 microversion: 2.54 time: 0.118993 Jul 25 14:38:21.240690 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1660/3129] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:38:21 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1405 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:38:21.702409 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8df25691-dc1d-4038-87be-98e70a43771f tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:21.710089 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8df25691-dc1d-4038-87be-98e70a43771f tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eb708222f6ee4225b1fe18848fb6a1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:21.711031 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8df25691-dc1d-4038-87be-98e70a43771f tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Searching by: {'deleted': False, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f'} {{(pid=119303) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:38:21.734099 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8df25691-dc1d-4038-87be-98e70a43771f tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:21.734914 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8df25691-dc1d-4038-87be-98e70a43771f tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:21.735913 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8df25691-dc1d-4038-87be-98e70a43771f tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:21.736699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8df25691-dc1d-4038-87be-98e70a43771f tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:21.845010 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.multi_cell_list [None req-8df25691-dc1d-4038-87be-98e70a43771f tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119303) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:38:21.920573 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8df25691-dc1d-4038-87be-98e70a43771f tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.227415 Jul 25 14:38:21.932967 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1470/3130] 10.222.0.88 () {58 vars in 1125 bytes} [Mon Jul 25 14:38:21 2022] GET /compute/v2.1/servers => generated 343 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:38:21.941537 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6dc2af7f-5a9d-4450-926f-33ad9d7e32e8 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:21.949831 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6dc2af7f-5a9d-4450-926f-33ad9d7e32e8 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eb708222f6ee4225b1fe18848fb6a1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:21.951956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6dc2af7f-5a9d-4450-926f-33ad9d7e32e8 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Searching by: {'deleted': False, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:38:21.967801 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6dc2af7f-5a9d-4450-926f-33ad9d7e32e8 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:21.968814 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6dc2af7f-5a9d-4450-926f-33ad9d7e32e8 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:21.970257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6dc2af7f-5a9d-4450-926f-33ad9d7e32e8 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:21.970862 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6dc2af7f-5a9d-4450-926f-33ad9d7e32e8 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:22.001693 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.multi_cell_list [None req-6dc2af7f-5a9d-4450-926f-33ad9d7e32e8 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119304) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:38:22.059548 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6dc2af7f-5a9d-4450-926f-33ad9d7e32e8 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb708222f6ee4225b1fe18848fb6a1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:22.066256 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6dc2af7f-5a9d-4450-926f-33ad9d7e32e8 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:22.066702 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6dc2af7f-5a9d-4450-926f-33ad9d7e32e8 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:22.113068 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b943dbf6-a427-4f17-bc2e-28cabc1979b4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:22.114345 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b943dbf6-a427-4f17-bc2e-28cabc1979b4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: ae539e1e-57e2-47ef-88b5-af8189cc7758] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:22.126860 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b943dbf6-a427-4f17-bc2e-28cabc1979b4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:22.128392 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b943dbf6-a427-4f17-bc2e-28cabc1979b4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:22.129575 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b943dbf6-a427-4f17-bc2e-28cabc1979b4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:22.131736 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b943dbf6-a427-4f17-bc2e-28cabc1979b4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:22.330551 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6dc2af7f-5a9d-4450-926f-33ad9d7e32e8 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 0.396335 Jul 25 14:38:22.338626 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1661/3131] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:38:21 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:22.352425 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-da3df3d8-3a5a-4181-b605-8b8ddac199c9 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:22.353246 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-da3df3d8-3a5a-4181-b605-8b8ddac199c9 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:22.361089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-da3df3d8-3a5a-4181-b605-8b8ddac199c9 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:22.362089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-da3df3d8-3a5a-4181-b605-8b8ddac199c9 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:22.363035 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-da3df3d8-3a5a-4181-b605-8b8ddac199c9 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:22.363606 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-da3df3d8-3a5a-4181-b605-8b8ddac199c9 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:22.924992 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-da3df3d8-3a5a-4181-b605-8b8ddac199c9 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:22.951348 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-da3df3d8-3a5a-4181-b605-8b8ddac199c9 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:22.955282 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-da3df3d8-3a5a-4181-b605-8b8ddac199c9 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '334d40ea432149cc9f438cd869bf9aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97521c9f77b14e77adfeece6c536e3cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:22.956872 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-da3df3d8-3a5a-4181-b605-8b8ddac199c9 tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 200 len: 1405 microversion: 2.54 time: 0.614624 Jul 25 14:38:22.979552 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1662/3132] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:38:22 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 1405 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:38:22.990481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e7960d1f-dcd2-43d8-9f6d-d6f803723761 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:23.009489 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e7960d1f-dcd2-43d8-9f6d-d6f803723761 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028634 Jul 25 14:38:23.010093 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1663/3133] 10.222.0.88 () {58 vars in 1137 bytes} [Mon Jul 25 14:38:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:38:23.010718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b943dbf6-a427-4f17-bc2e-28cabc1979b4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:23.021705 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b943dbf6-a427-4f17-bc2e-28cabc1979b4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758" status: 200 len: 1321 microversion: 2.1 time: 0.914244 Jul 25 14:38:23.024185 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-bf37b462-e6f0-4ecb-aa47-f6916c91975f req-88751fca-2d46-4fba-a864-46006df5dc9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae539e1e-57e2-47ef-88b5-af8189cc7758", "tag": "45c80fc4-a680-42c4-80db-28a0cfdc0b9e"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:23.030963 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1471/3134] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:22 2022] GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758 => generated 1321 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:38:23.042077 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-bf37b462-e6f0-4ecb-aa47-f6916c91975f req-88751fca-2d46-4fba-a864-46006df5dc9b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:23.042768 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-bf37b462-e6f0-4ecb-aa47-f6916c91975f req-88751fca-2d46-4fba-a864-46006df5dc9b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:23.062846 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-bf37b462-e6f0-4ecb-aa47-f6916c91975f req-88751fca-2d46-4fba-a864-46006df5dc9b service nova] Creating event network-changed:45c80fc4-a680-42c4-80db-28a0cfdc0b9e for instance ae539e1e-57e2-47ef-88b5-af8189cc7758 on n-h1-846435-14 Jul 25 14:38:23.078118 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-bf37b462-e6f0-4ecb-aa47-f6916c91975f req-88751fca-2d46-4fba-a864-46006df5dc9b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058017 Jul 25 14:38:23.078775 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1664/3135] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:38:23.386922 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4c49d929-63dd-4ffb-8c4a-aae6463fb2a4 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:23.387423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4c49d929-63dd-4ffb-8c4a-aae6463fb2a4 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:23.393990 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c49d929-63dd-4ffb-8c4a-aae6463fb2a4 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:23.394642 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c49d929-63dd-4ffb-8c4a-aae6463fb2a4 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:23.395652 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c49d929-63dd-4ffb-8c4a-aae6463fb2a4 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:23.396275 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c49d929-63dd-4ffb-8c4a-aae6463fb2a4 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:23.428139 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4c49d929-63dd-4ffb-8c4a-aae6463fb2a4 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:38:23.578453 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4c49d929-63dd-4ffb-8c4a-aae6463fb2a4 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "DELETE /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3" status: 204 len: 0 microversion: 2.1 time: 0.194327 Jul 25 14:38:23.580354 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1472/3136] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:38:23 2022] DELETE /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:38:23.591379 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-81708583-5bc0-4c63-9f3a-7b473d8855bd tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:23.592372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-81708583-5bc0-4c63-9f3a-7b473d8855bd tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:23.604036 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-81708583-5bc0-4c63-9f3a-7b473d8855bd tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:23.604788 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-81708583-5bc0-4c63-9f3a-7b473d8855bd tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:23.605928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-81708583-5bc0-4c63-9f3a-7b473d8855bd tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:23.606537 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-81708583-5bc0-4c63-9f3a-7b473d8855bd tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:23.923600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-81708583-5bc0-4c63-9f3a-7b473d8855bd tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb708222f6ee4225b1fe18848fb6a1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:23.933044 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-81708583-5bc0-4c63-9f3a-7b473d8855bd tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3" status: 200 len: 1607 microversion: 2.1 time: 0.348192 Jul 25 14:38:23.935889 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1665/3137] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:23 2022] GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 => generated 1607 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:23.989646 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cca8d6dd-a49f-42cf-aa11-eb6d52d4316d tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:23.990628 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cca8d6dd-a49f-42cf-aa11-eb6d52d4316d tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] [instance: ba0f2518-215c-41ee-a362-b86413b13b01] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:23.998428 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cca8d6dd-a49f-42cf-aa11-eb6d52d4316d tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:23.998821 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cca8d6dd-a49f-42cf-aa11-eb6d52d4316d tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:23.999629 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cca8d6dd-a49f-42cf-aa11-eb6d52d4316d tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:24.000025 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cca8d6dd-a49f-42cf-aa11-eb6d52d4316d tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:24.015113 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-cca8d6dd-a49f-42cf-aa11-eb6d52d4316d tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] HTTP exception thrown: Instance ba0f2518-215c-41ee-a362-b86413b13b01 could not be found. Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cca8d6dd-a49f-42cf-aa11-eb6d52d4316d tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Request method failure captured: Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 HTTP/1.1 Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qqyKetRxQ4GS5GV01j9D_b-BqBcAFVohB87wHzTaEH3U_jc1CVkJd4QMFpufPHxouDSmd9GGjKPRPtEwgkErsx6ow6BOmq3oH-t6_4-dyy63ykfhYmsnCJUmOGS43VrFw0OAAqdtLqEREAi2qGnDBgaG7i7M2xdrBIBb6LMoZVw2bE Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: X-Openstack-Nova-Api-Version: 2.54 Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 97521c9f77b14e77adfeece6c536e3cb Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServerShowV254Test-1551928715 Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/97521c9f77b14e77adfeece6c536e3cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/97521c9f77b14e77adfeece6c536e3cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_97521c9f77b14e77adfeece6c536e3cb", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/97521c9f77b14e77adfeece6c536e3cb"}]}] Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServerShowV254Test-1551928715 Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 97521c9f77b14e77adfeece6c536e3cb Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServerShowV254Test-1551928715 Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServerShowV254Test-1551928715-project Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 334d40ea432149cc9f438cd869bf9aee Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServerShowV254Test-1551928715-project Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance ba0f2518-215c-41ee-a362-b86413b13b01 could not be found. Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'ba0f2518-215c-41ee-a362-b86413b13b01'} Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba0f2518-215c-41ee-a362-b86413b13b01 could not be found. Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba0f2518-215c-41ee-a362-b86413b13b01 could not be found. Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:24.017732 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:24.022122 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:24.022122 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:24.022122 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:24.022122 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:38:24.022122 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:38:24.022122 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba0f2518-215c-41ee-a362-b86413b13b01 could not be found. Jul 25 14:38:24.022122 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:24.022122 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cca8d6dd-a49f-42cf-aa11-eb6d52d4316d tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] Returning 404 to user: Instance ba0f2518-215c-41ee-a362-b86413b13b01 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:38:24.022122 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cca8d6dd-a49f-42cf-aa11-eb6d52d4316d tempest-ServerShowV254Test-1551928715 tempest-ServerShowV254Test-1551928715-project] 10.222.0.88 "GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01" status: 404 len: 111 microversion: 2.54 time: 0.033809 Jul 25 14:38:24.022122 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1473/3138] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:38:23 2022] GET /compute/v2.1/servers/ba0f2518-215c-41ee-a362-b86413b13b01 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:38:24.048732 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ccfc5d59-528c-4a54-b7ca-35d9a4903f0b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:24.049343 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ccfc5d59-528c-4a54-b7ca-35d9a4903f0b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: ae539e1e-57e2-47ef-88b5-af8189cc7758] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:24.061654 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ccfc5d59-528c-4a54-b7ca-35d9a4903f0b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:24.062301 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ccfc5d59-528c-4a54-b7ca-35d9a4903f0b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:24.064108 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ccfc5d59-528c-4a54-b7ca-35d9a4903f0b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:24.064703 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ccfc5d59-528c-4a54-b7ca-35d9a4903f0b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:24.261889 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ccfc5d59-528c-4a54-b7ca-35d9a4903f0b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:24.270872 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ccfc5d59-528c-4a54-b7ca-35d9a4903f0b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758" status: 200 len: 1321 microversion: 2.1 time: 0.226633 Jul 25 14:38:24.285235 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1666/3139] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:24 2022] GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758 => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:24.961114 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f4a40011-34f6-41f5-bc41-284a135c3d6c tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:24.962308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f4a40011-34f6-41f5-bc41-284a135c3d6c tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:24.974337 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f4a40011-34f6-41f5-bc41-284a135c3d6c tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:24.975843 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f4a40011-34f6-41f5-bc41-284a135c3d6c tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:24.980590 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f4a40011-34f6-41f5-bc41-284a135c3d6c tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:24.982698 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f4a40011-34f6-41f5-bc41-284a135c3d6c tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:25.297229 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9bc5827b-3347-4c2f-a268-2d3ed4dd50f8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:25.298100 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9bc5827b-3347-4c2f-a268-2d3ed4dd50f8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: ae539e1e-57e2-47ef-88b5-af8189cc7758] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:25.307161 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9bc5827b-3347-4c2f-a268-2d3ed4dd50f8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:25.308111 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9bc5827b-3347-4c2f-a268-2d3ed4dd50f8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:25.309102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9bc5827b-3347-4c2f-a268-2d3ed4dd50f8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:25.309686 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9bc5827b-3347-4c2f-a268-2d3ed4dd50f8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:25.394007 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f4a40011-34f6-41f5-bc41-284a135c3d6c tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb708222f6ee4225b1fe18848fb6a1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:25.405002 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f4a40011-34f6-41f5-bc41-284a135c3d6c tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3" status: 200 len: 1607 microversion: 2.1 time: 0.447140 Jul 25 14:38:25.416970 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1474/3140] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:24 2022] GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 => generated 1607 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:25.609542 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9bc5827b-3347-4c2f-a268-2d3ed4dd50f8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:25.621063 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9bc5827b-3347-4c2f-a268-2d3ed4dd50f8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758" status: 200 len: 1321 microversion: 2.1 time: 0.331159 Jul 25 14:38:25.622158 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1667/3141] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:25 2022] GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758 => generated 1321 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:25.989251 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=14 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:38:26.159922 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2a57c968-c00a-4c33-a439-aba51d51c667 tempest-QuotasTestJSON-678481516 tempest-QuotasTestJSON-678481516-project] Calling method '.version_select at 0x7f46869f79d0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:26.257865 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2a57c968-c00a-4c33-a439-aba51d51c667 tempest-QuotasTestJSON-678481516 tempest-QuotasTestJSON-678481516-project] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/8f3ba77368c449b7bab0de955a6124c5/defaults" status: 200 len: 371 microversion: 2.1 time: 0.274245 Jul 25 14:38:26.259601 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1475/3142] 10.222.0.88 () {58 vars in 1269 bytes} [Mon Jul 25 14:38:25 2022] GET /compute/v2.1/os-quota-sets/8f3ba77368c449b7bab0de955a6124c5/defaults => generated 371 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:38:26.273544 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-abbfaf35-7637-43bb-9f22-a4c5a6b758ef tempest-QuotasTestJSON-678481516 tempest-QuotasTestJSON-678481516-project] Calling method '.version_select at 0x7f46864eb3a0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:26.371345 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-abbfaf35-7637-43bb-9f22-a4c5a6b758ef tempest-QuotasTestJSON-678481516 tempest-QuotasTestJSON-678481516-project] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/8f3ba77368c449b7bab0de955a6124c5" status: 200 len: 371 microversion: 2.1 time: 0.103689 Jul 25 14:38:26.373581 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1668/3143] 10.222.0.88 () {58 vars in 1242 bytes} [Mon Jul 25 14:38:26 2022] GET /compute/v2.1/os-quota-sets/8f3ba77368c449b7bab0de955a6124c5 => generated 371 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:38:26.388508 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5f17c76c-77d9-4870-844f-9e137cd8edc1 tempest-QuotasTestJSON-678481516 tempest-QuotasTestJSON-678481516-project] Calling method '.version_select at 0x7f46873329d0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:26.452035 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0ad471ad-e8ab-4f20-8923-79f7590f96fb tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:26.452595 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0ad471ad-e8ab-4f20-8923-79f7590f96fb tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:26.459440 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0ad471ad-e8ab-4f20-8923-79f7590f96fb tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:26.459886 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0ad471ad-e8ab-4f20-8923-79f7590f96fb tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:26.460812 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0ad471ad-e8ab-4f20-8923-79f7590f96fb tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:26.461243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0ad471ad-e8ab-4f20-8923-79f7590f96fb tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:26.499141 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5f17c76c-77d9-4870-844f-9e137cd8edc1 tempest-QuotasTestJSON-678481516 tempest-QuotasTestJSON-678481516-project] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/8f3ba77368c449b7bab0de955a6124c5/defaults" status: 200 len: 371 microversion: 2.1 time: 0.116050 Jul 25 14:38:26.500074 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1476/3144] 10.222.0.88 () {58 vars in 1269 bytes} [Mon Jul 25 14:38:26 2022] GET /compute/v2.1/os-quota-sets/8f3ba77368c449b7bab0de955a6124c5/defaults => generated 371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:38:26.514877 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-def92863-3482-4de7-a0dc-1f9a14d68642 tempest-QuotasTestJSON-678481516 tempest-QuotasTestJSON-678481516-project] Calling method '.version_select at 0x7f4686b2c9d0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:26.606530 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-def92863-3482-4de7-a0dc-1f9a14d68642 tempest-QuotasTestJSON-678481516 tempest-QuotasTestJSON-678481516-project] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/8f3ba77368c449b7bab0de955a6124c5" status: 200 len: 371 microversion: 2.1 time: 0.095586 Jul 25 14:38:26.613671 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1477/3145] 10.222.0.88 () {58 vars in 1242 bytes} [Mon Jul 25 14:38:26 2022] GET /compute/v2.1/os-quota-sets/8f3ba77368c449b7bab0de955a6124c5 => generated 371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:38:26.619818 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-96a45b20-3bff-4b7a-a479-6bd8cf2a8a88 tempest-QuotasTestJSON-678481516 tempest-QuotasTestJSON-678481516-project] Calling method '.version_select at 0x7f4686992b80>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:26.675156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0ad471ad-e8ab-4f20-8923-79f7590f96fb tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb708222f6ee4225b1fe18848fb6a1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:26.691064 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0ad471ad-e8ab-4f20-8923-79f7590f96fb tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3" status: 200 len: 1539 microversion: 2.1 time: 0.262180 Jul 25 14:38:26.693697 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1669/3146] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:26 2022] GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 => generated 1539 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:26.700599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-96bea9cc-12ad-4258-8d10-8225d9089ad8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:26.703501 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-96bea9cc-12ad-4258-8d10-8225d9089ad8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: ae539e1e-57e2-47ef-88b5-af8189cc7758] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:26.714103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-96bea9cc-12ad-4258-8d10-8225d9089ad8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:26.714890 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-96bea9cc-12ad-4258-8d10-8225d9089ad8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:26.715866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-96bea9cc-12ad-4258-8d10-8225d9089ad8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:26.716532 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-96bea9cc-12ad-4258-8d10-8225d9089ad8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:26.726940 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-96a45b20-3bff-4b7a-a479-6bd8cf2a8a88 tempest-QuotasTestJSON-678481516 tempest-QuotasTestJSON-678481516-project] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/8f3ba77368c449b7bab0de955a6124c5?user_id=d7ff8acac99940acbeab839a209c542f" status: 200 len: 371 microversion: 2.1 time: 0.111889 Jul 25 14:38:26.736012 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1478/3147] 10.222.0.88 () {58 vars in 1323 bytes} [Mon Jul 25 14:38:26 2022] GET /compute/v2.1/os-quota-sets/8f3ba77368c449b7bab0de955a6124c5?user_id=d7ff8acac99940acbeab839a209c542f => generated 371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:38:27.002331 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-96bea9cc-12ad-4258-8d10-8225d9089ad8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:27.012030 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-96bea9cc-12ad-4258-8d10-8225d9089ad8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758" status: 200 len: 1321 microversion: 2.1 time: 0.316653 Jul 25 14:38:27.012519 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1670/3148] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:26 2022] GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758 => generated 1321 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:27.049124 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-7452a100-96b3-45a8-ba46-cb92abfc23e7 req-f4bfad31-96d5-447e-8b0d-9ab44cafd9ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3", "name": "network-vif-deleted", "tag": "24058dbf-0bb6-4f6e-8912-6077d722be00"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:27.077554 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-7452a100-96b3-45a8-ba46-cb92abfc23e7 req-f4bfad31-96d5-447e-8b0d-9ab44cafd9ef service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:27.078282 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-7452a100-96b3-45a8-ba46-cb92abfc23e7 req-f4bfad31-96d5-447e-8b0d-9ab44cafd9ef service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:27.107725 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-7452a100-96b3-45a8-ba46-cb92abfc23e7 req-f4bfad31-96d5-447e-8b0d-9ab44cafd9ef service nova] Creating event network-vif-deleted:24058dbf-0bb6-4f6e-8912-6077d722be00 for instance fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 on n-h2-846435-14 Jul 25 14:38:27.120643 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-7452a100-96b3-45a8-ba46-cb92abfc23e7 req-f4bfad31-96d5-447e-8b0d-9ab44cafd9ef service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072370 Jul 25 14:38:27.140395 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1479/3149] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:38:27.714257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9607303a-1d3f-48fd-80c5-d4fab871872b tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:27.715633 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9607303a-1d3f-48fd-80c5-d4fab871872b tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:27.726622 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9607303a-1d3f-48fd-80c5-d4fab871872b tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:27.729297 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9607303a-1d3f-48fd-80c5-d4fab871872b tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:27.731618 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9607303a-1d3f-48fd-80c5-d4fab871872b tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:27.732320 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9607303a-1d3f-48fd-80c5-d4fab871872b tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:27.793145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:38:27.926762 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9607303a-1d3f-48fd-80c5-d4fab871872b tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb708222f6ee4225b1fe18848fb6a1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:27.943774 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9607303a-1d3f-48fd-80c5-d4fab871872b tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3" status: 200 len: 1250 microversion: 2.1 time: 0.234463 Jul 25 14:38:27.944568 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1671/3150] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:27 2022] GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 => generated 1250 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:28.039923 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-009c03b8-2222-43ce-af28-9e3116da6e23 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:28.041978 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-009c03b8-2222-43ce-af28-9e3116da6e23 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: ae539e1e-57e2-47ef-88b5-af8189cc7758] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:28.068289 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-009c03b8-2222-43ce-af28-9e3116da6e23 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:28.068776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-009c03b8-2222-43ce-af28-9e3116da6e23 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:28.069602 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-009c03b8-2222-43ce-af28-9e3116da6e23 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:28.070091 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-009c03b8-2222-43ce-af28-9e3116da6e23 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:28.677282 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-009c03b8-2222-43ce-af28-9e3116da6e23 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:28.707657 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-009c03b8-2222-43ce-af28-9e3116da6e23 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758" status: 200 len: 1321 microversion: 2.1 time: 0.678030 Jul 25 14:38:28.715594 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1480/3151] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:28 2022] GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758 => generated 1321 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:28.970778 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bf185e31-c809-418f-98ab-e21c7eace4c6 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:28.972162 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bf185e31-c809-418f-98ab-e21c7eace4c6 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:28.989077 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bf185e31-c809-418f-98ab-e21c7eace4c6 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:28.989952 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bf185e31-c809-418f-98ab-e21c7eace4c6 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:28.992732 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bf185e31-c809-418f-98ab-e21c7eace4c6 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:28.993385 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bf185e31-c809-418f-98ab-e21c7eace4c6 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:29.205044 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bf185e31-c809-418f-98ab-e21c7eace4c6 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb708222f6ee4225b1fe18848fb6a1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:29.215209 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bf185e31-c809-418f-98ab-e21c7eace4c6 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3" status: 200 len: 1250 microversion: 2.1 time: 0.250129 Jul 25 14:38:29.230508 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1672/3152] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:28 2022] GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 => generated 1250 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:29.736798 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b05b981b-3bc6-446b-bfc2-b8b197987279 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:29.737397 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b05b981b-3bc6-446b-bfc2-b8b197987279 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: ae539e1e-57e2-47ef-88b5-af8189cc7758] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:29.744690 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b05b981b-3bc6-446b-bfc2-b8b197987279 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:29.756842 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b05b981b-3bc6-446b-bfc2-b8b197987279 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:29.758021 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b05b981b-3bc6-446b-bfc2-b8b197987279 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:29.758628 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b05b981b-3bc6-446b-bfc2-b8b197987279 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:30.013609 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b05b981b-3bc6-446b-bfc2-b8b197987279 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:30.022265 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b05b981b-3bc6-446b-bfc2-b8b197987279 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758" status: 200 len: 1321 microversion: 2.1 time: 0.289279 Jul 25 14:38:30.028105 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1481/3153] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:29 2022] GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758 => generated 1321 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:30.176982 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-1d09b93d-2e68-47e7-907b-cda7eaf884ac req-c1bab0f6-6274-4536-afc6-d728a25fa4b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae539e1e-57e2-47ef-88b5-af8189cc7758", "name": "network-vif-plugged", "status": "completed", "tag": "45c80fc4-a680-42c4-80db-28a0cfdc0b9e"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:30.202363 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-1d09b93d-2e68-47e7-907b-cda7eaf884ac req-c1bab0f6-6274-4536-afc6-d728a25fa4b5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:30.203312 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-1d09b93d-2e68-47e7-907b-cda7eaf884ac req-c1bab0f6-6274-4536-afc6-d728a25fa4b5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:30.243599 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a9b4b441-e952-4457-b7c1-9798fdd89756 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:30.244443 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a9b4b441-e952-4457-b7c1-9798fdd89756 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:30.263180 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a9b4b441-e952-4457-b7c1-9798fdd89756 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:30.266897 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a9b4b441-e952-4457-b7c1-9798fdd89756 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:30.269102 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-1d09b93d-2e68-47e7-907b-cda7eaf884ac req-c1bab0f6-6274-4536-afc6-d728a25fa4b5 service nova] Creating event network-vif-plugged:45c80fc4-a680-42c4-80db-28a0cfdc0b9e for instance ae539e1e-57e2-47ef-88b5-af8189cc7758 on n-h1-846435-14 Jul 25 14:38:30.270153 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a9b4b441-e952-4457-b7c1-9798fdd89756 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:30.274381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a9b4b441-e952-4457-b7c1-9798fdd89756 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:30.297007 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-1d09b93d-2e68-47e7-907b-cda7eaf884ac req-c1bab0f6-6274-4536-afc6-d728a25fa4b5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133245 Jul 25 14:38:30.300779 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1673/3154] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:38:30.426206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a9b4b441-e952-4457-b7c1-9798fdd89756 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb708222f6ee4225b1fe18848fb6a1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:30.444599 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a9b4b441-e952-4457-b7c1-9798fdd89756 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3" status: 200 len: 1250 microversion: 2.1 time: 0.205598 Jul 25 14:38:30.445236 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1482/3155] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:30 2022] GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 => generated 1250 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:38:31.046181 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e7e27834-4f53-4dc6-b7f3-625a50670ffa tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:31.047498 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e7e27834-4f53-4dc6-b7f3-625a50670ffa tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: ae539e1e-57e2-47ef-88b5-af8189cc7758] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:31.057654 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e7e27834-4f53-4dc6-b7f3-625a50670ffa tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:31.076960 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e7e27834-4f53-4dc6-b7f3-625a50670ffa tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:31.078427 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e7e27834-4f53-4dc6-b7f3-625a50670ffa tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:31.079163 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e7e27834-4f53-4dc6-b7f3-625a50670ffa tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:31.303034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a830155e-3534-40e2-94b8-2dbe5fafe368 tempest-ComputeTenantNetworksTest-1211262352 tempest-ComputeTenantNetworksTest-1211262352-project] Calling method '.version_select at 0x7f468652e820>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:31.327653 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e7e27834-4f53-4dc6-b7f3-625a50670ffa tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:31.336797 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e7e27834-4f53-4dc6-b7f3-625a50670ffa tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758" status: 200 len: 1321 microversion: 2.1 time: 0.294701 Jul 25 14:38:31.338404 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1483/3156] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:31 2022] GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758 => generated 1321 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:31.468423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-79958ee4-ee50-4d77-b875-9cd20f8ab994 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:31.469043 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-79958ee4-ee50-4d77-b875-9cd20f8ab994 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:31.494439 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-79958ee4-ee50-4d77-b875-9cd20f8ab994 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:31.494901 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-79958ee4-ee50-4d77-b875-9cd20f8ab994 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:31.501301 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-79958ee4-ee50-4d77-b875-9cd20f8ab994 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:31.503190 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-79958ee4-ee50-4d77-b875-9cd20f8ab994 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:31.660529 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a830155e-3534-40e2-94b8-2dbe5fafe368 tempest-ComputeTenantNetworksTest-1211262352 tempest-ComputeTenantNetworksTest-1211262352-project] 10.222.0.88 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.850169 Jul 25 14:38:31.660529 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1674/3157] 10.222.0.88 () {58 vars in 1158 bytes} [Mon Jul 25 14:38:30 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:38:31.668990 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e4cf0180-84e5-4cef-942e-e453442b8b8f tempest-ComputeTenantNetworksTest-1211262352 tempest-ComputeTenantNetworksTest-1211262352-project] Calling method '.version_select at 0x7f46863bb0d0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:31.677057 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-79958ee4-ee50-4d77-b875-9cd20f8ab994 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb708222f6ee4225b1fe18848fb6a1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:31.687008 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-79958ee4-ee50-4d77-b875-9cd20f8ab994 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3" status: 200 len: 1250 microversion: 2.1 time: 0.222337 Jul 25 14:38:31.689236 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1484/3158] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:31 2022] GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 => generated 1250 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:38:31.838817 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e4cf0180-84e5-4cef-942e-e453442b8b8f tempest-ComputeTenantNetworksTest-1211262352 tempest-ComputeTenantNetworksTest-1211262352-project] 10.222.0.88 "GET /compute/v2.1/os-tenant-networks/e22f4f9d-75a0-4e72-a923-6f3e57ba97e6" status: 200 len: 140 microversion: 2.1 time: 0.175944 Jul 25 14:38:31.852504 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1675/3159] 10.222.0.88 () {58 vars in 1269 bytes} [Mon Jul 25 14:38:31 2022] GET /compute/v2.1/os-tenant-networks/e22f4f9d-75a0-4e72-a923-6f3e57ba97e6 => generated 140 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:38:31.860156 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:38:32.036278 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-507aeef7-3cca-4d61-9a1a-b35dfef2278c tempest-QuotaClassesAdmin257Test-287164040 tempest-QuotaClassesAdmin257Test-287164040-project-admin] Calling method '.version_select at 0x7f4686992ee0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:32.037488 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:38:32.037488 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:38:32.058245 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-507aeef7-3cca-4d61-9a1a-b35dfef2278c tempest-QuotaClassesAdmin257Test-287164040 tempest-QuotaClassesAdmin257Test-287164040-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.204373 Jul 25 14:38:32.073919 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c91218dd-36d4-42a7-a2a6-997cade444fa tempest-QuotaClassesAdmin257Test-287164040 tempest-QuotaClassesAdmin257Test-287164040-project-admin] Action: 'update', calling method: .version_select at 0x7f46863bb940>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:32.081957 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1485/3160] 10.222.0.88 () {60 vars in 1226 bytes} [Mon Jul 25 14:38:31 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:38:32.082697 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:38:32.082697 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:38:32.100503 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:38:32.292321 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c91218dd-36d4-42a7-a2a6-997cade444fa tempest-QuotaClassesAdmin257Test-287164040 tempest-QuotaClassesAdmin257Test-287164040-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.222884 Jul 25 14:38:32.293277 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1676/3161] 10.222.0.88 () {62 vars in 1247 bytes} [Mon Jul 25 14:38:32 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:38:32.303829 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1be313b1-f69a-43c5-9a0c-781e477e9d7f tempest-QuotaClassesAdmin257Test-287164040 tempest-QuotaClassesAdmin257Test-287164040-project-admin] Calling method '.version_select at 0x7f4686992dc0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:32.320485 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1be313b1-f69a-43c5-9a0c-781e477e9d7f tempest-QuotaClassesAdmin257Test-287164040 tempest-QuotaClassesAdmin257Test-287164040-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.020417 Jul 25 14:38:32.332048 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1486/3162] 10.222.0.88 () {60 vars in 1226 bytes} [Mon Jul 25 14:38:32 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:38:32.333465 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0651bd59-6794-4c2d-83fe-6f2e0bc5377e tempest-QuotaClassesAdmin257Test-287164040 tempest-QuotaClassesAdmin257Test-287164040-project-admin] Action: 'update', calling method: .version_select at 0x7f4686530040>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:32.359073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fdcf824f-e1e1-4a0f-98fd-e43a7910c9c3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:32.360061 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fdcf824f-e1e1-4a0f-98fd-e43a7910c9c3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: ae539e1e-57e2-47ef-88b5-af8189cc7758] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:32.368042 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fdcf824f-e1e1-4a0f-98fd-e43a7910c9c3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:32.373791 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fdcf824f-e1e1-4a0f-98fd-e43a7910c9c3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:32.375103 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fdcf824f-e1e1-4a0f-98fd-e43a7910c9c3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:32.375755 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fdcf824f-e1e1-4a0f-98fd-e43a7910c9c3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:32.419589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=13,nova_api:INSERT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:38:32.453785 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0651bd59-6794-4c2d-83fe-6f2e0bc5377e tempest-QuotaClassesAdmin257Test-287164040 tempest-QuotaClassesAdmin257Test-287164040-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.123997 Jul 25 14:38:32.464090 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1677/3163] 10.222.0.88 () {62 vars in 1247 bytes} [Mon Jul 25 14:38:32 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 14:38:32.608709 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fdcf824f-e1e1-4a0f-98fd-e43a7910c9c3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:32.620998 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fdcf824f-e1e1-4a0f-98fd-e43a7910c9c3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758" status: 200 len: 1502 microversion: 2.1 time: 0.266908 Jul 25 14:38:32.630494 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1487/3164] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:32 2022] GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758 => generated 1502 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:38:32.651218 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-27a79d8f-01c6-47dd-9c2e-9a1d16fa910b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:32.651896 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-27a79d8f-01c6-47dd-9c2e-9a1d16fa910b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: ae539e1e-57e2-47ef-88b5-af8189cc7758] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:32.670385 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-27a79d8f-01c6-47dd-9c2e-9a1d16fa910b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:32.670908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-27a79d8f-01c6-47dd-9c2e-9a1d16fa910b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:32.673481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-27a79d8f-01c6-47dd-9c2e-9a1d16fa910b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:32.673929 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-27a79d8f-01c6-47dd-9c2e-9a1d16fa910b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:32.707368 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2475ba1e-04bb-4bfc-b19b-b2f3746c6fa7 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:32.708046 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2475ba1e-04bb-4bfc-b19b-b2f3746c6fa7 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:32.716957 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2475ba1e-04bb-4bfc-b19b-b2f3746c6fa7 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:32.717890 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2475ba1e-04bb-4bfc-b19b-b2f3746c6fa7 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:32.720775 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2475ba1e-04bb-4bfc-b19b-b2f3746c6fa7 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:32.722477 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2475ba1e-04bb-4bfc-b19b-b2f3746c6fa7 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:32.842849 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2475ba1e-04bb-4bfc-b19b-b2f3746c6fa7 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb708222f6ee4225b1fe18848fb6a1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:32.852062 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2475ba1e-04bb-4bfc-b19b-b2f3746c6fa7 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3" status: 200 len: 1250 microversion: 2.1 time: 0.148463 Jul 25 14:38:32.866361 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1488/3165] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:32 2022] GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 => generated 1250 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:32.895617 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-27a79d8f-01c6-47dd-9c2e-9a1d16fa910b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:32.904660 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-27a79d8f-01c6-47dd-9c2e-9a1d16fa910b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758" status: 200 len: 1502 microversion: 2.1 time: 0.257593 Jul 25 14:38:32.905809 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1678/3166] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:32 2022] GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758 => generated 1502 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:32.926351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b9aed28e-6cba-4dc0-826f-35786e48ee9e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:32.927346 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b9aed28e-6cba-4dc0-826f-35786e48ee9e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: ae539e1e-57e2-47ef-88b5-af8189cc7758] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:32.942553 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b9aed28e-6cba-4dc0-826f-35786e48ee9e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:32.943802 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b9aed28e-6cba-4dc0-826f-35786e48ee9e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:32.944793 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b9aed28e-6cba-4dc0-826f-35786e48ee9e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:32.947485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b9aed28e-6cba-4dc0-826f-35786e48ee9e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:33.015172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b9aed28e-6cba-4dc0-826f-35786e48ee9e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: ae539e1e-57e2-47ef-88b5-af8189cc7758] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:38:33.063478 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:38:33.211355 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b9aed28e-6cba-4dc0-826f-35786e48ee9e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "DELETE /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758" status: 204 len: 0 microversion: 2.1 time: 0.288809 Jul 25 14:38:33.212252 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1489/3167] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:38:32 2022] DELETE /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:38:33.220547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a3edec37-9570-4840-8075-dbcad3b5831f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:33.221149 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a3edec37-9570-4840-8075-dbcad3b5831f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: ae539e1e-57e2-47ef-88b5-af8189cc7758] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:33.237987 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3edec37-9570-4840-8075-dbcad3b5831f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:33.238438 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3edec37-9570-4840-8075-dbcad3b5831f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:33.239226 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3edec37-9570-4840-8075-dbcad3b5831f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:33.239664 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3edec37-9570-4840-8075-dbcad3b5831f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:33.455558 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a3edec37-9570-4840-8075-dbcad3b5831f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:33.464001 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a3edec37-9570-4840-8075-dbcad3b5831f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758" status: 200 len: 1508 microversion: 2.1 time: 0.247251 Jul 25 14:38:33.468017 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1679/3168] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:33 2022] GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758 => generated 1508 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:33.716311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dd34f213-c43d-437a-b2d3-ac14a9ceeb1b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "803b5356-ea4b-4fa8-a48e-011c23bc3031"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:33.746512 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-dd34f213-c43d-437a-b2d3-ac14a9ceeb1b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:33.783022 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dd34f213-c43d-437a-b2d3-ac14a9ceeb1b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:33.785249 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dd34f213-c43d-437a-b2d3-ac14a9ceeb1b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:33.788075 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dd34f213-c43d-437a-b2d3-ac14a9ceeb1b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:33.790701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dd34f213-c43d-437a-b2d3-ac14a9ceeb1b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:33.875483 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7eccf364-8130-47bb-91c6-0188187d8408 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:33.877316 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7eccf364-8130-47bb-91c6-0188187d8408 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:33.906088 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7eccf364-8130-47bb-91c6-0188187d8408 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:33.911750 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7eccf364-8130-47bb-91c6-0188187d8408 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:33.916326 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7eccf364-8130-47bb-91c6-0188187d8408 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:33.918425 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7eccf364-8130-47bb-91c6-0188187d8408 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:34.047719 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7eccf364-8130-47bb-91c6-0188187d8408 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb708222f6ee4225b1fe18848fb6a1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:34.059031 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7eccf364-8130-47bb-91c6-0188187d8408 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3" status: 200 len: 1250 microversion: 2.1 time: 0.188723 Jul 25 14:38:34.059948 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1680/3169] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:33 2022] GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 => generated 1250 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:34.486097 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6f10cdfb-bb7b-4f2c-bbd2-90b60a61b69f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:34.486703 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6f10cdfb-bb7b-4f2c-bbd2-90b60a61b69f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: ae539e1e-57e2-47ef-88b5-af8189cc7758] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:34.498662 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f10cdfb-bb7b-4f2c-bbd2-90b60a61b69f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:34.499104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f10cdfb-bb7b-4f2c-bbd2-90b60a61b69f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:34.501017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f10cdfb-bb7b-4f2c-bbd2-90b60a61b69f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:34.501660 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f10cdfb-bb7b-4f2c-bbd2-90b60a61b69f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:34.634151 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dd34f213-c43d-437a-b2d3-ac14a9ceeb1b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "POST /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.927833 Jul 25 14:38:34.639112 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1490/3170] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Jul 25 14:38:33 2022] POST /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a/os-volume_attachments => generated 194 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:38:35.088940 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e52e4a39-897b-4eca-93c7-172308aa6af0 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:35.090242 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e52e4a39-897b-4eca-93c7-172308aa6af0 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:35.133636 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e52e4a39-897b-4eca-93c7-172308aa6af0 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:35.137406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e52e4a39-897b-4eca-93c7-172308aa6af0 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:35.141193 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6f10cdfb-bb7b-4f2c-bbd2-90b60a61b69f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:35.145994 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e52e4a39-897b-4eca-93c7-172308aa6af0 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:35.146980 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e52e4a39-897b-4eca-93c7-172308aa6af0 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:35.150203 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6f10cdfb-bb7b-4f2c-bbd2-90b60a61b69f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758" status: 200 len: 1508 microversion: 2.1 time: 0.669026 Jul 25 14:38:35.150831 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1681/3171] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:34 2022] GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758 => generated 1508 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:38:35.271907 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e52e4a39-897b-4eca-93c7-172308aa6af0 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:35.274521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e52e4a39-897b-4eca-93c7-172308aa6af0 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:35.275172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-e52e4a39-897b-4eca-93c7-172308aa6af0 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lazy-loading 'fault' on Instance uuid fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:38:35.361666 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e52e4a39-897b-4eca-93c7-172308aa6af0 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb708222f6ee4225b1fe18848fb6a1f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07edb35c2dd48ef9ea6583468a9b46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:35.375934 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e52e4a39-897b-4eca-93c7-172308aa6af0 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3" status: 200 len: 1209 microversion: 2.1 time: 0.295228 Jul 25 14:38:35.392727 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1491/3172] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:35 2022] GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 => generated 1209 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:38:35.728896 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7bbc4d74-a18c-45dd-866a-e07b1aa6bb07 tempest-VolumesNegativeTest-316646013 tempest-VolumesNegativeTest-316646013-project] Action: 'create', calling method: .version_select at 0x7f46987c50d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1048700942", "metadata": {"Type": "work"}}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7bbc4d74-a18c-45dd-866a-e07b1aa6bb07 tempest-VolumesNegativeTest-316646013 tempest-VolumesNegativeTest-316646013-project] Request method failure captured: Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 122 Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qrr2TzJvFSuzp2hlRdyPpf5VwR7GVu0pAJlN7K63vDeThVPIQiXvVNuE-mOrJtMxhnMtMeMMZeNVsg6ZalOhhL_ny6L7JXxZkJEWmUVPgi-uePkyPtrt3lbjQqKHPsGy86qBLJpS7Yf04gZ9xB90IWkCpLDy3B6IP1tu-GR7dHMp8U Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: c85b352a3c6f4c38b26b061704e77462 Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-VolumesNegativeTest-316646013 Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c85b352a3c6f4c38b26b061704e77462"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c85b352a3c6f4c38b26b061704e77462"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c85b352a3c6f4c38b26b061704e77462", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c85b352a3c6f4c38b26b061704e77462"}]}] Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-VolumesNegativeTest-316646013 Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: c85b352a3c6f4c38b26b061704e77462 Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-VolumesNegativeTest-316646013 Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-VolumesNegativeTest-316646013-project Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: a2f0d6b22de44fcb80f91fa197bc22fe Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-VolumesNegativeTest-316646013-project Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1048700942", "metadata": {"Type": "work"}}} Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1048700942', 'metadata': {'Type': 'work'}}}} Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi '#$%' Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:38:35.733700 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:38:35.737916 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 14:38:35.737916 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:35.737916 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:35.737916 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:35.737916 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:35.737916 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:35.737916 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:35.737916 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:38:35.737916 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:38:35.737916 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 14:38:35.737916 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:35.737916 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7bbc4d74-a18c-45dd-866a-e07b1aa6bb07 tempest-VolumesNegativeTest-316646013 tempest-VolumesNegativeTest-316646013-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:38:35.739012 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7bbc4d74-a18c-45dd-866a-e07b1aa6bb07 tempest-VolumesNegativeTest-316646013 tempest-VolumesNegativeTest-316646013-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.239244 Jul 25 14:38:35.740132 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1682/3173] 10.222.0.88 () {60 vars in 1156 bytes} [Mon Jul 25 14:38:35 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 241 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:38:35.749786 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f8173a17-7e1d-4da3-9818-04d13886b5a2 tempest-VolumesNegativeTest-316646013 tempest-VolumesNegativeTest-316646013-project] Action: 'create', calling method: .version_select at 0x7f46869a94c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1962018602", "metadata": {"Type": "work"}}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f8173a17-7e1d-4da3-9818-04d13886b5a2 tempest-VolumesNegativeTest-316646013 tempest-VolumesNegativeTest-316646013-project] Request method failure captured: Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 120 Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qrr2TzJvFSuzp2hlRdyPpf5VwR7GVu0pAJlN7K63vDeThVPIQiXvVNuE-mOrJtMxhnMtMeMMZeNVsg6ZalOhhL_ny6L7JXxZkJEWmUVPgi-uePkyPtrt3lbjQqKHPsGy86qBLJpS7Yf04gZ9xB90IWkCpLDy3B6IP1tu-GR7dHMp8U Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: c85b352a3c6f4c38b26b061704e77462 Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-VolumesNegativeTest-316646013 Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c85b352a3c6f4c38b26b061704e77462"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c85b352a3c6f4c38b26b061704e77462"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c85b352a3c6f4c38b26b061704e77462", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c85b352a3c6f4c38b26b061704e77462"}]}] Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-VolumesNegativeTest-316646013 Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: c85b352a3c6f4c38b26b061704e77462 Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-VolumesNegativeTest-316646013 Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-VolumesNegativeTest-316646013-project Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: a2f0d6b22de44fcb80f91fa197bc22fe Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-VolumesNegativeTest-316646013-project Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1962018602", "metadata": {"Type": "work"}}} Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1962018602', 'metadata': {'Type': 'work'}}}} Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi '0' Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:38:35.755014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:38:35.759604 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 14:38:35.759604 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:35.759604 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:35.759604 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:35.759604 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:35.759604 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:35.759604 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:35.759604 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:38:35.759604 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:38:35.759604 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 14:38:35.759604 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:35.759604 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f8173a17-7e1d-4da3-9818-04d13886b5a2 tempest-VolumesNegativeTest-316646013 tempest-VolumesNegativeTest-316646013-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:38:35.759604 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f8173a17-7e1d-4da3-9818-04d13886b5a2 tempest-VolumesNegativeTest-316646013 tempest-VolumesNegativeTest-316646013-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010895 Jul 25 14:38:35.766434 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-79e30924-d438-47b6-bdda-1a0511d78083 tempest-VolumesNegativeTest-316646013 tempest-VolumesNegativeTest-316646013-project] Action: 'create', calling method: .version_select at 0x7f4687532310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2062530070", "metadata": {"Type": "work"}}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:35.768393 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1492/3174] 10.222.0.88 () {60 vars in 1156 bytes} [Mon Jul 25 14:38:35 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-79e30924-d438-47b6-bdda-1a0511d78083 tempest-VolumesNegativeTest-316646013 tempest-VolumesNegativeTest-316646013-project] Request method failure captured: Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 119 Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qrr2TzJvFSuzp2hlRdyPpf5VwR7GVu0pAJlN7K63vDeThVPIQiXvVNuE-mOrJtMxhnMtMeMMZeNVsg6ZalOhhL_ny6L7JXxZkJEWmUVPgi-uePkyPtrt3lbjQqKHPsGy86qBLJpS7Yf04gZ9xB90IWkCpLDy3B6IP1tu-GR7dHMp8U Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: c85b352a3c6f4c38b26b061704e77462 Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-VolumesNegativeTest-316646013 Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c85b352a3c6f4c38b26b061704e77462"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c85b352a3c6f4c38b26b061704e77462"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c85b352a3c6f4c38b26b061704e77462", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c85b352a3c6f4c38b26b061704e77462"}]}] Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-VolumesNegativeTest-316646013 Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: c85b352a3c6f4c38b26b061704e77462 Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-VolumesNegativeTest-316646013 Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-VolumesNegativeTest-316646013-project Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: a2f0d6b22de44fcb80f91fa197bc22fe Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-VolumesNegativeTest-316646013-project Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2062530070", "metadata": {"Type": "work"}}} Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2062530070', 'metadata': {'Type': 'work'}}}} Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi '' Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:38:35.786981 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:38:35.791954 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 14:38:35.791954 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:35.791954 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:35.791954 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:35.791954 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:35.791954 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:35.791954 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:35.791954 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:38:35.791954 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:38:35.791954 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 14:38:35.791954 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:35.791954 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-79e30924-d438-47b6-bdda-1a0511d78083 tempest-VolumesNegativeTest-316646013 tempest-VolumesNegativeTest-316646013-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:38:35.791954 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-79e30924-d438-47b6-bdda-1a0511d78083 tempest-VolumesNegativeTest-316646013 tempest-VolumesNegativeTest-316646013-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.026054 Jul 25 14:38:35.805716 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1683/3175] 10.222.0.88 () {60 vars in 1156 bytes} [Mon Jul 25 14:38:35 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 14:38:35.815099 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a1c1421f-0e70-49a1-8853-5cdb1d30d367 tempest-VolumesNegativeTest-316646013 tempest-VolumesNegativeTest-316646013-project] Calling method '.version_select at 0x7f4686956d30>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:35.995603 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-a1c1421f-0e70-49a1-8853-5cdb1d30d367 tempest-VolumesNegativeTest-316646013 tempest-VolumesNegativeTest-316646013-project] HTTP exception thrown: Volume tempest-invalid-971127292 could not be found. Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a1c1421f-0e70-49a1-8853-5cdb1d30d367 tempest-VolumesNegativeTest-316646013 tempest-VolumesNegativeTest-316646013-project] Request method failure captured: Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-971127292 HTTP/1.1 Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qrr2TzJvFSuzp2hlRdyPpf5VwR7GVu0pAJlN7K63vDeThVPIQiXvVNuE-mOrJtMxhnMtMeMMZeNVsg6ZalOhhL_ny6L7JXxZkJEWmUVPgi-uePkyPtrt3lbjQqKHPsGy86qBLJpS7Yf04gZ9xB90IWkCpLDy3B6IP1tu-GR7dHMp8U Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: c85b352a3c6f4c38b26b061704e77462 Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-VolumesNegativeTest-316646013 Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c85b352a3c6f4c38b26b061704e77462"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c85b352a3c6f4c38b26b061704e77462"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c85b352a3c6f4c38b26b061704e77462", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c85b352a3c6f4c38b26b061704e77462"}]}] Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-VolumesNegativeTest-316646013 Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: c85b352a3c6f4c38b26b061704e77462 Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-VolumesNegativeTest-316646013 Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-VolumesNegativeTest-316646013-project Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: a2f0d6b22de44fcb80f91fa197bc22fe Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-VolumesNegativeTest-316646013-project Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: exception: Volume tempest-invalid-971127292 could not be found. Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'tempest-invalid-971127292'} Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-971127292 could not be found. (HTTP 404) (Request-ID: req-28b4966a-a6b7-4076-8ac2-52aacda0c59e) Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 14:38:36.025896 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-971127292 could not be found. Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-971127292 could not be found. Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-971127292 could not be found. Jul 25 14:38:36.031066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:36.035656 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a1c1421f-0e70-49a1-8853-5cdb1d30d367 tempest-VolumesNegativeTest-316646013 tempest-VolumesNegativeTest-316646013-project] Returning 404 to user: Volume tempest-invalid-971127292 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:38:36.036881 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a1c1421f-0e70-49a1-8853-5cdb1d30d367 tempest-VolumesNegativeTest-316646013 tempest-VolumesNegativeTest-316646013-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/tempest-invalid-971127292" status: 404 len: 98 microversion: 2.1 time: 0.225718 Jul 25 14:38:36.038263 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1493/3176] 10.222.0.88 () {58 vars in 1215 bytes} [Mon Jul 25 14:38:35 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-971127292 => generated 98 bytes in 228 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:38:36.049907 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f6c7845d-f45f-4f65-8206-5ecbae6c8f5e tempest-VolumesNegativeTest-316646013 tempest-VolumesNegativeTest-316646013-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006341 Jul 25 14:38:36.051448 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1684/3177] 10.222.0.88 () {58 vars in 1140 bytes} [Mon Jul 25 14:38:36 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 14:38:36.063198 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-347a0753-0683-4bd3-981d-96eeb21bf835 tempest-VolumesNegativeTest-316646013 tempest-VolumesNegativeTest-316646013-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005310 Jul 25 14:38:36.064916 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1494/3178] 10.222.0.88 () {58 vars in 1137 bytes} [Mon Jul 25 14:38:36 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 14:38:36.074901 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a2e5ec26-42a3-49fe-a2b9-def9976c1ef7 tempest-VolumesNegativeTest-316646013 tempest-VolumesNegativeTest-316646013-project] Calling method '.version_select at 0x7f46987c5700>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:36.126652 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-a2e5ec26-42a3-49fe-a2b9-def9976c1ef7 tempest-VolumesNegativeTest-316646013 tempest-VolumesNegativeTest-316646013-project] HTTP exception thrown: Volume 8342e14f-f906-43ba-94e8-d3ee8ea6ab6f could not be found. Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a2e5ec26-42a3-49fe-a2b9-def9976c1ef7 tempest-VolumesNegativeTest-316646013 tempest-VolumesNegativeTest-316646013-project] Request method failure captured: Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/os-volumes/8342e14f-f906-43ba-94e8-d3ee8ea6ab6f HTTP/1.1 Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qrr2TzJvFSuzp2hlRdyPpf5VwR7GVu0pAJlN7K63vDeThVPIQiXvVNuE-mOrJtMxhnMtMeMMZeNVsg6ZalOhhL_ny6L7JXxZkJEWmUVPgi-uePkyPtrt3lbjQqKHPsGy86qBLJpS7Yf04gZ9xB90IWkCpLDy3B6IP1tu-GR7dHMp8U Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: c85b352a3c6f4c38b26b061704e77462 Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-VolumesNegativeTest-316646013 Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c85b352a3c6f4c38b26b061704e77462"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c85b352a3c6f4c38b26b061704e77462"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c85b352a3c6f4c38b26b061704e77462", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c85b352a3c6f4c38b26b061704e77462"}]}] Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-VolumesNegativeTest-316646013 Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: c85b352a3c6f4c38b26b061704e77462 Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-VolumesNegativeTest-316646013 Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-VolumesNegativeTest-316646013-project Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: a2f0d6b22de44fcb80f91fa197bc22fe Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-VolumesNegativeTest-316646013-project Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: exception: Volume 8342e14f-f906-43ba-94e8-d3ee8ea6ab6f could not be found. Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '8342e14f-f906-43ba-94e8-d3ee8ea6ab6f'} Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8342e14f-f906-43ba-94e8-d3ee8ea6ab6f could not be found. (HTTP 404) (Request-ID: req-39c8c0f2-f562-4df2-9445-efe725c58406) Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 14:38:36.141744 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8342e14f-f906-43ba-94e8-d3ee8ea6ab6f could not be found. Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8342e14f-f906-43ba-94e8-d3ee8ea6ab6f could not be found. Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8342e14f-f906-43ba-94e8-d3ee8ea6ab6f could not be found. Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a2e5ec26-42a3-49fe-a2b9-def9976c1ef7 tempest-VolumesNegativeTest-316646013 tempest-VolumesNegativeTest-316646013-project] Returning 404 to user: Volume 8342e14f-f906-43ba-94e8-d3ee8ea6ab6f could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:38:36.145570 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a2e5ec26-42a3-49fe-a2b9-def9976c1ef7 tempest-VolumesNegativeTest-316646013 tempest-VolumesNegativeTest-316646013-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/8342e14f-f906-43ba-94e8-d3ee8ea6ab6f" status: 404 len: 109 microversion: 2.1 time: 0.073477 Jul 25 14:38:36.154991 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1685/3179] 10.222.0.88 () {58 vars in 1248 bytes} [Mon Jul 25 14:38:36 2022] DELETE /compute/v2.1/os-volumes/8342e14f-f906-43ba-94e8-d3ee8ea6ab6f => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:38:36.166219 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6cd5129b-4424-4ec2-b057-553bb7db317f tempest-VolumesNegativeTest-316646013 tempest-VolumesNegativeTest-316646013-project] Calling method '.version_select at 0x7f46869579d0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:36.187830 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3030fd9f-2148-4745-925b-5251a1bbcb68 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:36.189143 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3030fd9f-2148-4745-925b-5251a1bbcb68 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: ae539e1e-57e2-47ef-88b5-af8189cc7758] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:36.210089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3030fd9f-2148-4745-925b-5251a1bbcb68 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:36.212387 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3030fd9f-2148-4745-925b-5251a1bbcb68 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:36.216248 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3030fd9f-2148-4745-925b-5251a1bbcb68 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:36.218903 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3030fd9f-2148-4745-925b-5251a1bbcb68 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:36.268600 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-6cd5129b-4424-4ec2-b057-553bb7db317f tempest-VolumesNegativeTest-316646013 tempest-VolumesNegativeTest-316646013-project] HTTP exception thrown: Volume e785e24f-6556-417a-982a-f28e57a35301 could not be found. Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6cd5129b-4424-4ec2-b057-553bb7db317f tempest-VolumesNegativeTest-316646013 tempest-VolumesNegativeTest-316646013-project] Request method failure captured: Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/os-volumes/e785e24f-6556-417a-982a-f28e57a35301 HTTP/1.1 Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qrr2TzJvFSuzp2hlRdyPpf5VwR7GVu0pAJlN7K63vDeThVPIQiXvVNuE-mOrJtMxhnMtMeMMZeNVsg6ZalOhhL_ny6L7JXxZkJEWmUVPgi-uePkyPtrt3lbjQqKHPsGy86qBLJpS7Yf04gZ9xB90IWkCpLDy3B6IP1tu-GR7dHMp8U Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: c85b352a3c6f4c38b26b061704e77462 Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-VolumesNegativeTest-316646013 Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c85b352a3c6f4c38b26b061704e77462"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c85b352a3c6f4c38b26b061704e77462"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c85b352a3c6f4c38b26b061704e77462", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c85b352a3c6f4c38b26b061704e77462"}]}] Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-VolumesNegativeTest-316646013 Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: c85b352a3c6f4c38b26b061704e77462 Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-VolumesNegativeTest-316646013 Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-VolumesNegativeTest-316646013-project Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: a2f0d6b22de44fcb80f91fa197bc22fe Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-VolumesNegativeTest-316646013-project Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: exception: Volume e785e24f-6556-417a-982a-f28e57a35301 could not be found. Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'e785e24f-6556-417a-982a-f28e57a35301'} Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e785e24f-6556-417a-982a-f28e57a35301 could not be found. (HTTP 404) (Request-ID: req-2be14e4a-c5d4-481c-a823-4da81b9fa556) Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 14:38:36.270818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e785e24f-6556-417a-982a-f28e57a35301 could not be found. Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e785e24f-6556-417a-982a-f28e57a35301 could not be found. Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e785e24f-6556-417a-982a-f28e57a35301 could not be found. Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6cd5129b-4424-4ec2-b057-553bb7db317f tempest-VolumesNegativeTest-316646013 tempest-VolumesNegativeTest-316646013-project] Returning 404 to user: Volume e785e24f-6556-417a-982a-f28e57a35301 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:38:36.276132 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6cd5129b-4424-4ec2-b057-553bb7db317f tempest-VolumesNegativeTest-316646013 tempest-VolumesNegativeTest-316646013-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/e785e24f-6556-417a-982a-f28e57a35301" status: 404 len: 109 microversion: 2.1 time: 0.113925 Jul 25 14:38:36.282404 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1495/3180] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Jul 25 14:38:36 2022] GET /compute/v2.1/os-volumes/e785e24f-6556-417a-982a-f28e57a35301 => generated 109 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:38:36.288799 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-2064a073-7eda-40db-9ad4-ddcf7f538441 req-189afbcd-11f3-471e-8b03-a14ae6aa43e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae539e1e-57e2-47ef-88b5-af8189cc7758", "name": "network-vif-deleted", "tag": "45c80fc4-a680-42c4-80db-28a0cfdc0b9e"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:36.325887 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-2064a073-7eda-40db-9ad4-ddcf7f538441 req-189afbcd-11f3-471e-8b03-a14ae6aa43e5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:36.329605 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-2064a073-7eda-40db-9ad4-ddcf7f538441 req-189afbcd-11f3-471e-8b03-a14ae6aa43e5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:36.366246 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-2064a073-7eda-40db-9ad4-ddcf7f538441 req-189afbcd-11f3-471e-8b03-a14ae6aa43e5 service nova] Creating event network-vif-deleted:45c80fc4-a680-42c4-80db-28a0cfdc0b9e for instance ae539e1e-57e2-47ef-88b5-af8189cc7758 on n-h1-846435-14 Jul 25 14:38:36.393420 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-2064a073-7eda-40db-9ad4-ddcf7f538441 req-189afbcd-11f3-471e-8b03-a14ae6aa43e5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113508 Jul 25 14:38:36.399130 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1496/3181] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:38:36.423086 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f8c1572d-60de-476a-8aab-746ed8b16379 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:36.429479 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f8c1572d-60de-476a-8aab-746ed8b16379 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] [instance: fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:36.449470 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:38:36.452855 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8c1572d-60de-476a-8aab-746ed8b16379 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:36.453513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8c1572d-60de-476a-8aab-746ed8b16379 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:36.454473 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8c1572d-60de-476a-8aab-746ed8b16379 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:36.456473 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8c1572d-60de-476a-8aab-746ed8b16379 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:36.467893 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3030fd9f-2148-4745-925b-5251a1bbcb68 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:36.487855 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3030fd9f-2148-4745-925b-5251a1bbcb68 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758" status: 200 len: 1466 microversion: 2.1 time: 0.315275 Jul 25 14:38:36.490670 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1686/3182] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:36 2022] GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758 => generated 1466 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:36.512296 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-f8c1572d-60de-476a-8aab-746ed8b16379 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] HTTP exception thrown: Instance fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 could not be found. Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f8c1572d-60de-476a-8aab-746ed8b16379 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Request method failure captured: Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 HTTP/1.1 Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qpizYi9SoPq9L_jEuxFes-muSAhWczb6QlVQIG4fAvflUpv2VNJNhyGdJ-Migdfb0_Ak7wRb6HbSoKVDi7SaLTE4qV9PGz5cYpMp_bJdOlHjcpfsUbRO0BQ8BNXZ0Z7TdmMjUWxdaWgRCMKZmy-Z8b_JbUy_bMh76mozRanQtrfAkc Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: f07edb35c2dd48ef9ea6583468a9b46f Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersTestBootFromVolume-44819576 Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f07edb35c2dd48ef9ea6583468a9b46f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f07edb35c2dd48ef9ea6583468a9b46f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f07edb35c2dd48ef9ea6583468a9b46f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f07edb35c2dd48ef9ea6583468a9b46f"}]}] Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersTestBootFromVolume-44819576 Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: f07edb35c2dd48ef9ea6583468a9b46f Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersTestBootFromVolume-44819576 Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersTestBootFromVolume-44819576-project Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: eb708222f6ee4225b1fe18848fb6a1f8 Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersTestBootFromVolume-44819576-project Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 could not be found. Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3'} Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 could not be found. Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 could not be found. Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:36.516526 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:36.521327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:36.521327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:36.521327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:36.521327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:38:36.521327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:38:36.521327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 could not be found. Jul 25 14:38:36.521327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:36.521327 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f8c1572d-60de-476a-8aab-746ed8b16379 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Returning 404 to user: Instance fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:38:36.523901 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f8c1572d-60de-476a-8aab-746ed8b16379 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3" status: 404 len: 111 microversion: 2.1 time: 0.118061 Jul 25 14:38:36.526573 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1497/3183] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:36 2022] GET /compute/v2.1/servers/fd0ffffc-0e63-4bf7-85e4-9fce85e8b8b3 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:38:36.536623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3cc16f2e-a81f-4f7f-a759-098f02b93fb0 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] Calling method '.version_select at 0x7f468791c280>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:36.601865 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3cc16f2e-a81f-4f7f-a759-098f02b93fb0 tempest-ServersTestBootFromVolume-44819576 tempest-ServersTestBootFromVolume-44819576-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-93697299" status: 202 len: 0 microversion: 2.1 time: 0.070560 Jul 25 14:38:36.603388 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1687/3184] 10.222.0.88 () {58 vars in 1215 bytes} [Mon Jul 25 14:38:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-93697299 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 14:38:37.512153 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5e3d63a5-bb74-40c7-9f10-e928b18d7563 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:37.512975 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5e3d63a5-bb74-40c7-9f10-e928b18d7563 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: ae539e1e-57e2-47ef-88b5-af8189cc7758] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:37.522748 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5e3d63a5-bb74-40c7-9f10-e928b18d7563 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:37.523303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5e3d63a5-bb74-40c7-9f10-e928b18d7563 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:37.527139 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5e3d63a5-bb74-40c7-9f10-e928b18d7563 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:37.527596 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5e3d63a5-bb74-40c7-9f10-e928b18d7563 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:37.571796 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-5e3d63a5-bb74-40c7-9f10-e928b18d7563 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] HTTP exception thrown: Instance ae539e1e-57e2-47ef-88b5-af8189cc7758 could not be found. Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5e3d63a5-bb74-40c7-9f10-e928b18d7563 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Request method failure captured: Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758 HTTP/1.1 Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qrEzscNKkpLEv-dO5KC3kdeJJY02nOIPLRIxGcrQR-Na_rLZBnVMM8MjTz-RtprnQR45AAorrNLLV4PDOD1PCa-gGNHdgbGOQfAGQYPzZpu9aSUEO6v7jEn8m2OVF51pdW16QE7pCXmLdRnFRt172yMaxqytlLvEMs-sUVBeXNXrcQ Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e77732af189e48feab3752ddb28208d3", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e77732af189e48feab3752ddb28208d3"}]}] Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersTestJSON-1827246574 Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersTestJSON-1827246574-project Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: e45ffe0956ae4ba9b1577875f312af06 Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersTestJSON-1827246574-project Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance ae539e1e-57e2-47ef-88b5-af8189cc7758 could not be found. Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'ae539e1e-57e2-47ef-88b5-af8189cc7758'} Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae539e1e-57e2-47ef-88b5-af8189cc7758 could not be found. Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae539e1e-57e2-47ef-88b5-af8189cc7758 could not be found. Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:37.577733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:37.581879 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:37.581879 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:37.581879 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:38:37.581879 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:38:37.581879 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae539e1e-57e2-47ef-88b5-af8189cc7758 could not be found. Jul 25 14:38:37.581879 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:37.581879 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5e3d63a5-bb74-40c7-9f10-e928b18d7563 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Returning 404 to user: Instance ae539e1e-57e2-47ef-88b5-af8189cc7758 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:38:37.581879 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5e3d63a5-bb74-40c7-9f10-e928b18d7563 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758" status: 404 len: 111 microversion: 2.1 time: 0.072332 Jul 25 14:38:37.584311 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1498/3185] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:37 2022] GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:38:37.594100 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e9ea1a99-8cde-4f55-9e84-7504a2e42e44 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Action: 'create', calling method: .version_select at 0x7f46988788b0>, body: {"keypair": {"name": "tempest-key-283655674", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqSD2vbsn9HXlug1ZwTvPkSiZPCMDSzEe7/MWTndMmngAMFi8T0FgPMtimklYm9EO7w9HTBRDe5m5kD3dDuBKf2ZgNfl++XIJMClGg5tWyCQE3Nvo2LRjL86icTzFevIw=="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:37.657156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=17,nova_cell0:UPDATE=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:38:37.658294 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-e9ea1a99-8cde-4f55-9e84-7504a2e42e44 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Getting quotas for project e77732af189e48feab3752ddb28208d3. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:38:37.669804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-e9ea1a99-8cde-4f55-9e84-7504a2e42e44 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Getting quotas for user e45ffe0956ae4ba9b1577875f312af06 and project e77732af189e48feab3752ddb28208d3. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:38:37.701522 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e9ea1a99-8cde-4f55-9e84-7504a2e42e44 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.112829 Jul 25 14:38:37.703046 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1688/3186] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:38:37 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:38:37.714078 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8d2060e8-a976-4bc6-b2eb-27ab2fa03fc9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '.version_select at 0x7f46869573a0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:37.718185 n-d-846435-14 devstack@n-api.service[119303]: WARNING oslo_db.sqlalchemy.utils [None req-8d2060e8-a976-4bc6-b2eb-27ab2fa03fc9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 25 14:38:37.729316 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8d2060e8-a976-4bc6-b2eb-27ab2fa03fc9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.019878 Jul 25 14:38:37.733015 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1499/3187] 10.222.0.88 () {58 vars in 1137 bytes} [Mon Jul 25 14:38:37 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:38:37.871764 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8810546f-af50-4527-96f0-7439684750c3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-353117640", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "key_name": "tempest-key-283655674", "networks": [{"uuid": "4c176170-2f7d-43a7-8c89-c74c022eb418"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:37.975776 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-8810546f-af50-4527-96f0-7439684750c3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] validate_networks() for [('4c176170-2f7d-43a7-8c89-c74c022eb418', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:38:38.728063 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-8810546f-af50-4527-96f0-7439684750c3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:38:38.728622 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-8810546f-af50-4527-96f0-7439684750c3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:38:38.728945 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-8810546f-af50-4527-96f0-7439684750c3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:38:38.729577 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-8810546f-af50-4527-96f0-7439684750c3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:38:38.730178 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-8810546f-af50-4527-96f0-7439684750c3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:38:38.749814 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8810546f-af50-4527-96f0-7439684750c3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:38.751194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8810546f-af50-4527-96f0-7439684750c3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:38.752383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8810546f-af50-4527-96f0-7439684750c3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:38.753983 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8810546f-af50-4527-96f0-7439684750c3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:38.813500 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-8810546f-af50-4527-96f0-7439684750c3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Getting quotas for project e77732af189e48feab3752ddb28208d3. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:38:38.839514 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-8810546f-af50-4527-96f0-7439684750c3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Getting quotas for user e45ffe0956ae4ba9b1577875f312af06 and project e77732af189e48feab3752ddb28208d3. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:38:38.878027 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8810546f-af50-4527-96f0-7439684750c3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:38:38.883354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8810546f-af50-4527-96f0-7439684750c3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 9bc0439b-4dfb-4a50-959d-0c80042f09fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:38:39.069074 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8810546f-af50-4527-96f0-7439684750c3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.200557 Jul 25 14:38:39.074179 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1689/3188] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:38:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:38:39.090764 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1d4dff63-f4f2-4ed4-a21c-4c571c04aad3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:39.095593 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1d4dff63-f4f2-4ed4-a21c-4c571c04aad3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 9bc0439b-4dfb-4a50-959d-0c80042f09fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:39.637123 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1d4dff63-f4f2-4ed4-a21c-4c571c04aad3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:39.660764 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1d4dff63-f4f2-4ed4-a21c-4c571c04aad3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb" status: 200 len: 1227 microversion: 2.1 time: 0.577559 Jul 25 14:38:39.666177 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1690/3189] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:39 2022] GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb => generated 1227 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:39.750577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b56b9537-79a0-442f-8b1a-29913fb9fcd2 tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Calling method '.version_select at 0x7f4686943f70>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:40.258477 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b56b9537-79a0-442f-8b1a-29913fb9fcd2 tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/6eacbdb3f5f54d9484ff63274c912715" status: 200 len: 371 microversion: 2.1 time: 1.184390 Jul 25 14:38:40.259176 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1500/3190] 10.222.0.88 () {58 vars in 1242 bytes} [Mon Jul 25 14:38:39 2022] GET /compute/v2.1/os-quota-sets/6eacbdb3f5f54d9484ff63274c912715 => generated 371 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:38:40.271581 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7d752198-a0b9-4a60-b306-122daecdc232 tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Action: 'update', calling method: .version_select at 0x7f46987cf040>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:40.674756 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d752198-a0b9-4a60-b306-122daecdc232 tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:40.675209 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d752198-a0b9-4a60-b306-122daecdc232 tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:40.676044 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d752198-a0b9-4a60-b306-122daecdc232 tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:40.676487 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d752198-a0b9-4a60-b306-122daecdc232 tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:40.686394 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-30b6f11e-0874-46e9-8bbc-de8cf4ba2bc8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:40.687294 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-30b6f11e-0874-46e9-8bbc-de8cf4ba2bc8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 9bc0439b-4dfb-4a50-959d-0c80042f09fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:40.702834 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-30b6f11e-0874-46e9-8bbc-de8cf4ba2bc8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:40.710618 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-30b6f11e-0874-46e9-8bbc-de8cf4ba2bc8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:40.711743 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-30b6f11e-0874-46e9-8bbc-de8cf4ba2bc8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:40.718155 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-30b6f11e-0874-46e9-8bbc-de8cf4ba2bc8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:40.866580 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-30b6f11e-0874-46e9-8bbc-de8cf4ba2bc8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:40.872486 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7d752198-a0b9-4a60-b306-122daecdc232 tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-sets/6eacbdb3f5f54d9484ff63274c912715" status: 200 len: 328 microversion: 2.1 time: 0.604983 Jul 25 14:38:40.879474 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-30b6f11e-0874-46e9-8bbc-de8cf4ba2bc8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb" status: 200 len: 1279 microversion: 2.1 time: 0.194288 Jul 25 14:38:40.880080 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1691/3191] 10.222.0.88 () {60 vars in 1262 bytes} [Mon Jul 25 14:38:40 2022] PUT /compute/v2.1/os-quota-sets/6eacbdb3f5f54d9484ff63274c912715 => generated 328 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:38:40.893794 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1501/3192] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:40 2022] GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb => generated 1279 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:38:41.711273 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b1edd0db-7c10-401a-941f-958d980e6720 tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-779460287", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:41.801709 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-b1edd0db-7c10-401a-941f-958d980e6720 tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] validate_networks() for None {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:38:41.903008 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1fdb6511-1634-4c63-9e2d-38adb713e96c tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:41.904891 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1fdb6511-1634-4c63-9e2d-38adb713e96c tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 9bc0439b-4dfb-4a50-959d-0c80042f09fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:41.920694 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1fdb6511-1634-4c63-9e2d-38adb713e96c tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:41.921149 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1fdb6511-1634-4c63-9e2d-38adb713e96c tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:41.921949 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1fdb6511-1634-4c63-9e2d-38adb713e96c tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:41.922385 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1fdb6511-1634-4c63-9e2d-38adb713e96c tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:42.152782 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1fdb6511-1634-4c63-9e2d-38adb713e96c tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:42.165546 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1fdb6511-1634-4c63-9e2d-38adb713e96c tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb" status: 200 len: 1285 microversion: 2.1 time: 0.266191 Jul 25 14:38:42.167119 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1502/3193] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:41 2022] GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb => generated 1285 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:38:43.188843 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6d4f6625-f617-4fad-ac4a-6f0870f079a1 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:43.189600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6d4f6625-f617-4fad-ac4a-6f0870f079a1 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 9bc0439b-4dfb-4a50-959d-0c80042f09fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:43.211229 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6d4f6625-f617-4fad-ac4a-6f0870f079a1 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:43.212017 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6d4f6625-f617-4fad-ac4a-6f0870f079a1 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:43.213282 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6d4f6625-f617-4fad-ac4a-6f0870f079a1 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:43.236163 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6d4f6625-f617-4fad-ac4a-6f0870f079a1 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:43.389268 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6d4f6625-f617-4fad-ac4a-6f0870f079a1 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:43.400412 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6d4f6625-f617-4fad-ac4a-6f0870f079a1 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb" status: 200 len: 1285 microversion: 2.1 time: 0.217527 Jul 25 14:38:43.401329 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1503/3194] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:43 2022] GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb => generated 1285 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:38:43.453334 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-b1edd0db-7c10-401a-941f-958d980e6720 tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:38:43.453855 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-b1edd0db-7c10-401a-941f-958d980e6720 tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:38:43.454600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-b1edd0db-7c10-401a-941f-958d980e6720 tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:38:43.455263 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-b1edd0db-7c10-401a-941f-958d980e6720 tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:38:43.455900 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-b1edd0db-7c10-401a-941f-958d980e6720 tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:38:43.471227 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b1edd0db-7c10-401a-941f-958d980e6720 tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:43.474821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b1edd0db-7c10-401a-941f-958d980e6720 tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:43.476163 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b1edd0db-7c10-401a-941f-958d980e6720 tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:43.476965 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b1edd0db-7c10-401a-941f-958d980e6720 tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:43.542363 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-b1edd0db-7c10-401a-941f-958d980e6720 tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Getting quotas for project 6eacbdb3f5f54d9484ff63274c912715. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:38:43.555703 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-b1edd0db-7c10-401a-941f-958d980e6720 tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Getting quotas for user 99af88cb3dda4a5c82ea6b0118826b76 and project 6eacbdb3f5f54d9484ff63274c912715. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:38:43.574688 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.utils [None req-b1edd0db-7c10-401a-941f-958d980e6720 tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] cores quota exceeded for 6eacbdb3f5f54d9484ff63274c912715, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119304) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 25 14:38:43.576150 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-b1edd0db-7c10-401a-941f-958d980e6720 tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b1edd0db-7c10-401a-941f-958d980e6720 tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Request method failure captured: Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 144 Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qrtCxQ2o9UD4ZayGhqfOI3M4kCS95b4LktF-rGPk-qAWB2_LtWMyl3ZSJYjZeg_ACvMCNTinqkDJNmYU-5rfBF_BZ2Rf-wOYMbZRTy0mwZqMU70SBOJPr6Y_8sMKIFt1wGrJ7xuEPRgLu6mOC7OvRDOpByi9fSq_w1Oqgpxx08O4rw Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 6eacbdb3f5f54d9484ff63274c912715 Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-QuotasAdminNegativeTest-237682485 Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6eacbdb3f5f54d9484ff63274c912715"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6eacbdb3f5f54d9484ff63274c912715"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6eacbdb3f5f54d9484ff63274c912715", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6eacbdb3f5f54d9484ff63274c912715"}]}] Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-QuotasAdminNegativeTest-237682485 Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 6eacbdb3f5f54d9484ff63274c912715 Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-237682485 Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-QuotasAdminNegativeTest-237682485-project Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 99af88cb3dda4a5c82ea6b0118826b76 Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-QuotasAdminNegativeTest-237682485-project Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-779460287", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452"}} Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-779460287', 'imageRef': 'a7b14aba-1848-4a00-a3e7-b66eb3e97925', 'flavorRef': '452'}}} Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 25 14:38:43.602011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:43.607485 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b1edd0db-7c10-401a-941f-958d980e6720 tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:38:43.610434 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b1edd0db-7c10-401a-941f-958d980e6720 tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 2.483773 Jul 25 14:38:43.611493 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1692/3195] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:38:41 2022] POST /compute/v2.1/servers => generated 111 bytes in 2491 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:38:43.619837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c054167c-ff52-442e-b4b3-3af82915327f tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Action: 'update', calling method: .version_select at 0x7f468693fa60>, body: {"quota_set": {"cores": 20}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:44.196447 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c054167c-ff52-442e-b4b3-3af82915327f tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:44.197116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c054167c-ff52-442e-b4b3-3af82915327f tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:44.205594 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c054167c-ff52-442e-b4b3-3af82915327f tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:44.206340 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c054167c-ff52-442e-b4b3-3af82915327f tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:44.375703 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c054167c-ff52-442e-b4b3-3af82915327f tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-sets/6eacbdb3f5f54d9484ff63274c912715" status: 200 len: 329 microversion: 2.1 time: 0.757519 Jul 25 14:38:44.376811 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1504/3196] 10.222.0.88 () {60 vars in 1262 bytes} [Mon Jul 25 14:38:43 2022] PUT /compute/v2.1/os-quota-sets/6eacbdb3f5f54d9484ff63274c912715 => generated 329 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:38:44.391240 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-af79b60d-a7c9-4f09-b541-ac0ffed9ef52 tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Calling method '.version_select at 0x7f4698940430>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:44.423775 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b288004d-5dd2-4757-a3b1-cbb8ad10caac tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:44.425192 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b288004d-5dd2-4757-a3b1-cbb8ad10caac tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 9bc0439b-4dfb-4a50-959d-0c80042f09fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:44.441529 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b288004d-5dd2-4757-a3b1-cbb8ad10caac tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:44.444740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b288004d-5dd2-4757-a3b1-cbb8ad10caac tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:44.446030 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b288004d-5dd2-4757-a3b1-cbb8ad10caac tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:44.449637 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b288004d-5dd2-4757-a3b1-cbb8ad10caac tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:44.660994 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-af79b60d-a7c9-4f09-b541-ac0ffed9ef52 tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/6eacbdb3f5f54d9484ff63274c912715" status: 200 len: 371 microversion: 2.1 time: 0.274493 Jul 25 14:38:44.667718 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1693/3197] 10.222.0.88 () {58 vars in 1242 bytes} [Mon Jul 25 14:38:44 2022] GET /compute/v2.1/os-quota-sets/6eacbdb3f5f54d9484ff63274c912715 => generated 371 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:38:44.676395 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dd4ecd13-8d61-4221-93c3-5aef51415bec tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Action: 'update', calling method: .version_select at 0x7f468758a670>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:44.792631 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd4ecd13-8d61-4221-93c3-5aef51415bec tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:44.793818 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd4ecd13-8d61-4221-93c3-5aef51415bec tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:44.796520 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd4ecd13-8d61-4221-93c3-5aef51415bec tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:44.797084 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd4ecd13-8d61-4221-93c3-5aef51415bec tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:44.929756 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dd4ecd13-8d61-4221-93c3-5aef51415bec tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-sets/6eacbdb3f5f54d9484ff63274c912715" status: 200 len: 328 microversion: 2.1 time: 0.258225 Jul 25 14:38:44.932188 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1694/3198] 10.222.0.88 () {60 vars in 1262 bytes} [Mon Jul 25 14:38:44 2022] PUT /compute/v2.1/os-quota-sets/6eacbdb3f5f54d9484ff63274c912715 => generated 328 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:38:45.087036 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-266cc1e5-f4e4-47f5-b3d2-1dcf32c4356f tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-824314597", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:45.187273 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-266cc1e5-f4e4-47f5-b3d2-1dcf32c4356f tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] validate_networks() for None {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:38:45.334285 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b288004d-5dd2-4757-a3b1-cbb8ad10caac tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:45.344921 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b288004d-5dd2-4757-a3b1-cbb8ad10caac tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb" status: 200 len: 1327 microversion: 2.1 time: 0.925912 Jul 25 14:38:45.360042 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1505/3199] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:44 2022] GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb => generated 1327 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:45.722757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-266cc1e5-f4e4-47f5-b3d2-1dcf32c4356f tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:38:45.723312 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-266cc1e5-f4e4-47f5-b3d2-1dcf32c4356f tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:38:45.723646 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-266cc1e5-f4e4-47f5-b3d2-1dcf32c4356f tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:38:45.724787 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-266cc1e5-f4e4-47f5-b3d2-1dcf32c4356f tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:38:45.725235 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-266cc1e5-f4e4-47f5-b3d2-1dcf32c4356f tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:38:45.741746 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-266cc1e5-f4e4-47f5-b3d2-1dcf32c4356f tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:45.742757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-266cc1e5-f4e4-47f5-b3d2-1dcf32c4356f tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:45.743640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-266cc1e5-f4e4-47f5-b3d2-1dcf32c4356f tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:45.744126 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-266cc1e5-f4e4-47f5-b3d2-1dcf32c4356f tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:45.761151 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:38:45.778896 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-266cc1e5-f4e4-47f5-b3d2-1dcf32c4356f tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Getting quotas for project 6eacbdb3f5f54d9484ff63274c912715. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:38:45.788664 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-266cc1e5-f4e4-47f5-b3d2-1dcf32c4356f tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Getting quotas for user 99af88cb3dda4a5c82ea6b0118826b76 and project 6eacbdb3f5f54d9484ff63274c912715. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:38:45.814965 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.utils [None req-266cc1e5-f4e4-47f5-b3d2-1dcf32c4356f tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] instances quota exceeded for 6eacbdb3f5f54d9484ff63274c912715, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119304) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 25 14:38:45.815812 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-266cc1e5-f4e4-47f5-b3d2-1dcf32c4356f tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-266cc1e5-f4e4-47f5-b3d2-1dcf32c4356f tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Request method failure captured: Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 144 Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qrtCxQ2o9UD4ZayGhqfOI3M4kCS95b4LktF-rGPk-qAWB2_LtWMyl3ZSJYjZeg_ACvMCNTinqkDJNmYU-5rfBF_BZ2Rf-wOYMbZRTy0mwZqMU70SBOJPr6Y_8sMKIFt1wGrJ7xuEPRgLu6mOC7OvRDOpByi9fSq_w1Oqgpxx08O4rw Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 6eacbdb3f5f54d9484ff63274c912715 Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-QuotasAdminNegativeTest-237682485 Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6eacbdb3f5f54d9484ff63274c912715"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6eacbdb3f5f54d9484ff63274c912715"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6eacbdb3f5f54d9484ff63274c912715", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6eacbdb3f5f54d9484ff63274c912715"}]}] Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-QuotasAdminNegativeTest-237682485 Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 6eacbdb3f5f54d9484ff63274c912715 Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-237682485 Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-QuotasAdminNegativeTest-237682485-project Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 99af88cb3dda4a5c82ea6b0118826b76 Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-QuotasAdminNegativeTest-237682485-project Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-824314597", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452"}} Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-824314597', 'imageRef': 'a7b14aba-1848-4a00-a3e7-b66eb3e97925', 'flavorRef': '452'}}} Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 25 14:38:45.817995 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 25 14:38:45.822637 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:45.826867 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-266cc1e5-f4e4-47f5-b3d2-1dcf32c4356f tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:38:45.828600 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-266cc1e5-f4e4-47f5-b3d2-1dcf32c4356f tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.745244 Jul 25 14:38:45.834014 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1695/3200] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:38:45 2022] POST /compute/v2.1/servers => generated 119 bytes in 751 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:38:45.843053 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-266b0731-65eb-4bba-8949-1672478cf333 tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Action: 'update', calling method: .version_select at 0x7f4686992670>, body: {"quota_set": {"instances": 10}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:45.941190 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-266b0731-65eb-4bba-8949-1672478cf333 tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:45.941991 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-266b0731-65eb-4bba-8949-1672478cf333 tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:45.943006 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-266b0731-65eb-4bba-8949-1672478cf333 tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:45.943633 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-266b0731-65eb-4bba-8949-1672478cf333 tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:46.057285 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-266b0731-65eb-4bba-8949-1672478cf333 tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-sets/6eacbdb3f5f54d9484ff63274c912715" status: 200 len: 329 microversion: 2.1 time: 0.216929 Jul 25 14:38:46.058978 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1506/3201] 10.222.0.88 () {60 vars in 1262 bytes} [Mon Jul 25 14:38:45 2022] PUT /compute/v2.1/os-quota-sets/6eacbdb3f5f54d9484ff63274c912715 => generated 329 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:38:46.078980 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cb60fcb1-4b25-499b-9f0b-36e2d3637e93 tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Calling method '.version_select at 0x7f4698940dc0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:46.233322 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cb60fcb1-4b25-499b-9f0b-36e2d3637e93 tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/6eacbdb3f5f54d9484ff63274c912715" status: 200 len: 371 microversion: 2.1 time: 0.164621 Jul 25 14:38:46.233933 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1696/3202] 10.222.0.88 () {58 vars in 1242 bytes} [Mon Jul 25 14:38:46 2022] GET /compute/v2.1/os-quota-sets/6eacbdb3f5f54d9484ff63274c912715 => generated 371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:38:46.245721 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7f82f049-03e4-4909-a42e-e2bab5a54122 tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Action: 'update', calling method: .version_select at 0x7f46868cddc0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:46.372860 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c8e84b69-300f-4386-b4dc-0d1f368be937 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:46.374199 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c8e84b69-300f-4386-b4dc-0d1f368be937 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 9bc0439b-4dfb-4a50-959d-0c80042f09fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:46.388724 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c8e84b69-300f-4386-b4dc-0d1f368be937 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:46.389188 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c8e84b69-300f-4386-b4dc-0d1f368be937 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:46.399999 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c8e84b69-300f-4386-b4dc-0d1f368be937 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:46.402169 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c8e84b69-300f-4386-b4dc-0d1f368be937 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:46.434390 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7f82f049-03e4-4909-a42e-e2bab5a54122 tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:46.435039 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7f82f049-03e4-4909-a42e-e2bab5a54122 tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:46.435663 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7f82f049-03e4-4909-a42e-e2bab5a54122 tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:46.436143 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7f82f049-03e4-4909-a42e-e2bab5a54122 tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:46.650648 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7f82f049-03e4-4909-a42e-e2bab5a54122 tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-sets/6eacbdb3f5f54d9484ff63274c912715" status: 200 len: 325 microversion: 2.1 time: 0.408909 Jul 25 14:38:46.652246 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1507/3203] 10.222.0.88 () {60 vars in 1262 bytes} [Mon Jul 25 14:38:46 2022] PUT /compute/v2.1/os-quota-sets/6eacbdb3f5f54d9484ff63274c912715 => generated 325 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:38:46.787363 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-6f87f7c7-3ce3-4f15-9a6b-7ee46f9b66e6 req-0bbe1c47-e55a-4bd3-8d59-e79bb8386d99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bc0439b-4dfb-4a50-959d-0c80042f09fb", "tag": "3c879ee7-f97f-47f9-8acd-acda51c5221a"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:46.809578 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-6f87f7c7-3ce3-4f15-9a6b-7ee46f9b66e6 req-0bbe1c47-e55a-4bd3-8d59-e79bb8386d99 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:46.810241 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-6f87f7c7-3ce3-4f15-9a6b-7ee46f9b66e6 req-0bbe1c47-e55a-4bd3-8d59-e79bb8386d99 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:46.861863 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-6f87f7c7-3ce3-4f15-9a6b-7ee46f9b66e6 req-0bbe1c47-e55a-4bd3-8d59-e79bb8386d99 service nova] Creating event network-changed:3c879ee7-f97f-47f9-8acd-acda51c5221a for instance 9bc0439b-4dfb-4a50-959d-0c80042f09fb on n-h1-846435-14 Jul 25 14:38:46.869702 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-6f87f7c7-3ce3-4f15-9a6b-7ee46f9b66e6 req-0bbe1c47-e55a-4bd3-8d59-e79bb8386d99 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087111 Jul 25 14:38:46.873121 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1508/3204] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:38:46.888587 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ee32cb17-9556-4046-8b1a-8fefc7b8f7ea tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1208243613", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:46.973883 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c8e84b69-300f-4386-b4dc-0d1f368be937 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:46.990441 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c8e84b69-300f-4386-b4dc-0d1f368be937 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb" status: 200 len: 1327 microversion: 2.1 time: 0.622153 Jul 25 14:38:46.994177 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1697/3205] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:46 2022] GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb => generated 1327 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:47.014340 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-ee32cb17-9556-4046-8b1a-8fefc7b8f7ea tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] validate_networks() for None {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:38:47.805869 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-ee32cb17-9556-4046-8b1a-8fefc7b8f7ea tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:38:47.806496 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-ee32cb17-9556-4046-8b1a-8fefc7b8f7ea tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:38:47.806762 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-ee32cb17-9556-4046-8b1a-8fefc7b8f7ea tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:38:47.807234 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-ee32cb17-9556-4046-8b1a-8fefc7b8f7ea tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:38:47.807653 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-ee32cb17-9556-4046-8b1a-8fefc7b8f7ea tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:38:47.817307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee32cb17-9556-4046-8b1a-8fefc7b8f7ea tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:47.818008 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee32cb17-9556-4046-8b1a-8fefc7b8f7ea tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:47.818811 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee32cb17-9556-4046-8b1a-8fefc7b8f7ea tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:47.819246 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee32cb17-9556-4046-8b1a-8fefc7b8f7ea tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:47.857221 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-ee32cb17-9556-4046-8b1a-8fefc7b8f7ea tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Getting quotas for project 6eacbdb3f5f54d9484ff63274c912715. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:38:47.864272 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-ee32cb17-9556-4046-8b1a-8fefc7b8f7ea tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Getting quotas for user 99af88cb3dda4a5c82ea6b0118826b76 and project 6eacbdb3f5f54d9484ff63274c912715. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:38:47.890307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.utils [None req-ee32cb17-9556-4046-8b1a-8fefc7b8f7ea tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] ram quota exceeded for 6eacbdb3f5f54d9484ff63274c912715, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119303) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 25 14:38:47.891099 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-ee32cb17-9556-4046-8b1a-8fefc7b8f7ea tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ee32cb17-9556-4046-8b1a-8fefc7b8f7ea tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Request method failure captured: Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 145 Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qrtCxQ2o9UD4ZayGhqfOI3M4kCS95b4LktF-rGPk-qAWB2_LtWMyl3ZSJYjZeg_ACvMCNTinqkDJNmYU-5rfBF_BZ2Rf-wOYMbZRTy0mwZqMU70SBOJPr6Y_8sMKIFt1wGrJ7xuEPRgLu6mOC7OvRDOpByi9fSq_w1Oqgpxx08O4rw Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 6eacbdb3f5f54d9484ff63274c912715 Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-QuotasAdminNegativeTest-237682485 Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6eacbdb3f5f54d9484ff63274c912715"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6eacbdb3f5f54d9484ff63274c912715"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6eacbdb3f5f54d9484ff63274c912715", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6eacbdb3f5f54d9484ff63274c912715"}]}] Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-QuotasAdminNegativeTest-237682485 Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 6eacbdb3f5f54d9484ff63274c912715 Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-237682485 Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-QuotasAdminNegativeTest-237682485-project Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 99af88cb3dda4a5c82ea6b0118826b76 Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-QuotasAdminNegativeTest-237682485-project Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1208243613", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452"}} Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1208243613', 'imageRef': 'a7b14aba-1848-4a00-a3e7-b66eb3e97925', 'flavorRef': '452'}}} Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 25 14:38:47.896968 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:38:47.902952 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ee32cb17-9556-4046-8b1a-8fefc7b8f7ea tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:38:47.917540 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ee32cb17-9556-4046-8b1a-8fefc7b8f7ea tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.023481 Jul 25 14:38:47.917540 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1509/3206] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:38:46 2022] POST /compute/v2.1/servers => generated 110 bytes in 1028 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:38:47.917810 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-103e1a38-dd38-4c7f-b7f3-32e30da37f59 tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Action: 'update', calling method: .version_select at 0x7f46988c5a60>, body: {"quota_set": {"ram": 51200}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:48.010933 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d8237c5f-cd32-43b7-913b-3ec7cfbe2adb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:48.011692 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d8237c5f-cd32-43b7-913b-3ec7cfbe2adb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 9bc0439b-4dfb-4a50-959d-0c80042f09fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:48.024921 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8237c5f-cd32-43b7-913b-3ec7cfbe2adb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:48.025466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8237c5f-cd32-43b7-913b-3ec7cfbe2adb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:48.027244 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8237c5f-cd32-43b7-913b-3ec7cfbe2adb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:48.027915 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8237c5f-cd32-43b7-913b-3ec7cfbe2adb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:48.236896 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-103e1a38-dd38-4c7f-b7f3-32e30da37f59 tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:48.237493 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-103e1a38-dd38-4c7f-b7f3-32e30da37f59 tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:48.238127 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-103e1a38-dd38-4c7f-b7f3-32e30da37f59 tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:48.239098 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-103e1a38-dd38-4c7f-b7f3-32e30da37f59 tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:48.261367 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d8237c5f-cd32-43b7-913b-3ec7cfbe2adb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:48.289749 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d8237c5f-cd32-43b7-913b-3ec7cfbe2adb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb" status: 200 len: 1327 microversion: 2.1 time: 0.277798 Jul 25 14:38:48.303833 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1510/3207] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:48 2022] GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb => generated 1327 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:38:48.371234 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-103e1a38-dd38-4c7f-b7f3-32e30da37f59 tempest-QuotasAdminNegativeTest-1940513098 tempest-QuotasAdminNegativeTest-1940513098-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-quota-sets/6eacbdb3f5f54d9484ff63274c912715" status: 200 len: 329 microversion: 2.1 time: 0.462278 Jul 25 14:38:48.371827 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1698/3208] 10.222.0.88 () {60 vars in 1262 bytes} [Mon Jul 25 14:38:47 2022] PUT /compute/v2.1/os-quota-sets/6eacbdb3f5f54d9484ff63274c912715 => generated 329 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:38:48.386830 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-36082fff-d5b6-4789-8c9e-7a8338545bb1 tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Action: 'update', calling method: .version_select at 0x7f46988c50d0>, body: {"quota_set": {"ram": 0}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:48.394453 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-36082fff-d5b6-4789-8c9e-7a8338545bb1 tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '99af88cb3dda4a5c82ea6b0118826b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eacbdb3f5f54d9484ff63274c912715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-36082fff-d5b6-4789-8c9e-7a8338545bb1 tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Request method failure captured: Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: request: PUT /compute/v2.1/os-quota-sets/6eacbdb3f5f54d9484ff63274c912715 HTTP/1.1 Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 25 Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qrtCxQ2o9UD4ZayGhqfOI3M4kCS95b4LktF-rGPk-qAWB2_LtWMyl3ZSJYjZeg_ACvMCNTinqkDJNmYU-5rfBF_BZ2Rf-wOYMbZRTy0mwZqMU70SBOJPr6Y_8sMKIFt1wGrJ7xuEPRgLu6mOC7OvRDOpByi9fSq_w1Oqgpxx08O4rw Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 6eacbdb3f5f54d9484ff63274c912715 Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-QuotasAdminNegativeTest-237682485 Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6eacbdb3f5f54d9484ff63274c912715"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6eacbdb3f5f54d9484ff63274c912715"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6eacbdb3f5f54d9484ff63274c912715", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6eacbdb3f5f54d9484ff63274c912715"}]}] Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-QuotasAdminNegativeTest-237682485 Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 6eacbdb3f5f54d9484ff63274c912715 Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-237682485 Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-QuotasAdminNegativeTest-237682485-project Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 99af88cb3dda4a5c82ea6b0118826b76 Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-QuotasAdminNegativeTest-237682485-project Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: {"quota_set": {"ram": 0}} Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '6eacbdb3f5f54d9484ff63274c912715', 'body': {'quota_set': {'ram': 0}}} Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 14:38:48.404124 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 14:38:48.408392 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 14:38:48.408392 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 14:38:48.408392 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 14:38:48.408392 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 14:38:48.408392 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 25 14:38:48.408392 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:48.408392 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:38:48.408392 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:48.408392 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:38:48.408392 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:38:48.408392 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:38:48.408392 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 14:38:48.408392 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 14:38:48.408392 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 25 14:38:48.408392 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:38:48.413421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-36082fff-d5b6-4789-8c9e-7a8338545bb1 tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:38:48.414413 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-36082fff-d5b6-4789-8c9e-7a8338545bb1 tempest-QuotasAdminNegativeTest-237682485 tempest-QuotasAdminNegativeTest-237682485-project] 10.222.0.88 "PUT /compute/v2.1/os-quota-sets/6eacbdb3f5f54d9484ff63274c912715" status: 403 len: 116 microversion: 2.1 time: 0.033547 Jul 25 14:38:48.415054 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1699/3209] 10.222.0.88 () {60 vars in 1262 bytes} [Mon Jul 25 14:38:48 2022] PUT /compute/v2.1/os-quota-sets/6eacbdb3f5f54d9484ff63274c912715 => generated 116 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:38:48.604355 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-aac9b954-e477-487f-8a71-0cf013cb0807 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-482723102", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "cc95d1fa-9d95-4f93-a2b9-2c12a2eab5ad"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:48.706159 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-aac9b954-e477-487f-8a71-0cf013cb0807 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] validate_networks() for [('cc95d1fa-9d95-4f93-a2b9-2c12a2eab5ad', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:38:49.311814 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1337b974-85e4-42c6-b91a-24ef32d0ef3e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:49.313578 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1337b974-85e4-42c6-b91a-24ef32d0ef3e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 9bc0439b-4dfb-4a50-959d-0c80042f09fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:49.335144 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1337b974-85e4-42c6-b91a-24ef32d0ef3e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:49.335644 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1337b974-85e4-42c6-b91a-24ef32d0ef3e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:49.336508 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1337b974-85e4-42c6-b91a-24ef32d0ef3e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:49.336949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1337b974-85e4-42c6-b91a-24ef32d0ef3e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:49.338293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-aac9b954-e477-487f-8a71-0cf013cb0807 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:38:49.339506 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-aac9b954-e477-487f-8a71-0cf013cb0807 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:38:49.340245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-aac9b954-e477-487f-8a71-0cf013cb0807 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:38:49.340901 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-aac9b954-e477-487f-8a71-0cf013cb0807 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:38:49.342469 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-aac9b954-e477-487f-8a71-0cf013cb0807 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:38:49.366690 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aac9b954-e477-487f-8a71-0cf013cb0807 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:49.367427 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aac9b954-e477-487f-8a71-0cf013cb0807 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:49.368776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aac9b954-e477-487f-8a71-0cf013cb0807 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:49.369485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aac9b954-e477-487f-8a71-0cf013cb0807 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:49.394572 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-aac9b954-e477-487f-8a71-0cf013cb0807 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Getting quotas for project 68dee301e8c24a98abef98fc0617bc96. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:38:49.401236 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-aac9b954-e477-487f-8a71-0cf013cb0807 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Getting quotas for user 1cfa029cfa58426da97a2d0857dabf78 and project 68dee301e8c24a98abef98fc0617bc96. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:38:49.419718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-aac9b954-e477-487f-8a71-0cf013cb0807 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Going to run 3 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:38:49.439441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-aac9b954-e477-487f-8a71-0cf013cb0807 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: bb07cf02-962c-4ea4-899c-507ace1ee7e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:38:49.527961 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-aac9b954-e477-487f-8a71-0cf013cb0807 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: 6b535085-b43d-4a2b-84c3-b5768569def2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=bb07cf02-962c-4ea4-899c-507ace1ee7e9,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:38:49.621265 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-aac9b954-e477-487f-8a71-0cf013cb0807 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: 88b6bb55-179d-42a2-aab1-53aefc8e536d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=6b535085-b43d-4a2b-84c3-b5768569def2,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:38:49.701971 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:38:49.798008 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-aac9b954-e477-487f-8a71-0cf013cb0807 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.491615 Jul 25 14:38:49.800993 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1511/3210] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:38:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:38:49.815604 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-783852f2-3148-4822-96dc-0d43b9c32f02 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:49.830092 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-783852f2-3148-4822-96dc-0d43b9c32f02 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:49.836804 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-783852f2-3148-4822-96dc-0d43b9c32f02 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Searching by: {'deleted': False, 'project_id': '68dee301e8c24a98abef98fc0617bc96'} {{(pid=119303) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:38:49.913879 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-783852f2-3148-4822-96dc-0d43b9c32f02 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:49.914428 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-783852f2-3148-4822-96dc-0d43b9c32f02 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:49.915244 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-783852f2-3148-4822-96dc-0d43b9c32f02 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:49.915682 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-783852f2-3148-4822-96dc-0d43b9c32f02 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:49.947158 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1337b974-85e4-42c6-b91a-24ef32d0ef3e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:49.958471 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1337b974-85e4-42c6-b91a-24ef32d0ef3e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb" status: 200 len: 1327 microversion: 2.1 time: 0.651293 Jul 25 14:38:49.976829 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1700/3211] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:49 2022] GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb => generated 1327 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:49.978775 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-783852f2-3148-4822-96dc-0d43b9c32f02 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.168915 Jul 25 14:38:49.980684 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1512/3212] 10.222.0.88 () {58 vars in 1125 bytes} [Mon Jul 25 14:38:49 2022] GET /compute/v2.1/servers => generated 1015 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:49.994329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-848a3152-bba8-4852-a761-e8c007c2039b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:49.994964 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-848a3152-bba8-4852-a761-e8c007c2039b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: 88b6bb55-179d-42a2-aab1-53aefc8e536d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:50.151589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-848a3152-bba8-4852-a761-e8c007c2039b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:50.162263 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-848a3152-bba8-4852-a761-e8c007c2039b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d" status: 200 len: 1222 microversion: 2.1 time: 0.173645 Jul 25 14:38:50.162862 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1701/3213] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:49 2022] GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d => generated 1222 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:38:50.979389 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f10acea2-fc85-4e91-8a4a-54de64b4e4d6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:50.980757 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f10acea2-fc85-4e91-8a4a-54de64b4e4d6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 9bc0439b-4dfb-4a50-959d-0c80042f09fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:51.001136 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f10acea2-fc85-4e91-8a4a-54de64b4e4d6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:51.003199 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f10acea2-fc85-4e91-8a4a-54de64b4e4d6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:51.004310 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f10acea2-fc85-4e91-8a4a-54de64b4e4d6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:51.006223 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f10acea2-fc85-4e91-8a4a-54de64b4e4d6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:51.183200 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f68db9e7-2e80-4635-9f5c-48d26c2f932a tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:51.183869 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f68db9e7-2e80-4635-9f5c-48d26c2f932a tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: 88b6bb55-179d-42a2-aab1-53aefc8e536d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:51.328049 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f68db9e7-2e80-4635-9f5c-48d26c2f932a tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:51.342210 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f68db9e7-2e80-4635-9f5c-48d26c2f932a tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d" status: 200 len: 1222 microversion: 2.1 time: 0.156886 Jul 25 14:38:51.343311 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1702/3214] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:51 2022] GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d => generated 1222 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:38:51.376789 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f10acea2-fc85-4e91-8a4a-54de64b4e4d6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:51.386122 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f10acea2-fc85-4e91-8a4a-54de64b4e4d6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb" status: 200 len: 1327 microversion: 2.1 time: 0.411157 Jul 25 14:38:51.405486 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1513/3215] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:50 2022] GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb => generated 1327 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:52.366989 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-63dfd7ad-4f6e-476a-baae-29f5396e565a tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:52.367965 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-63dfd7ad-4f6e-476a-baae-29f5396e565a tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: 88b6bb55-179d-42a2-aab1-53aefc8e536d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:52.376857 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63dfd7ad-4f6e-476a-baae-29f5396e565a tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:52.377308 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63dfd7ad-4f6e-476a-baae-29f5396e565a tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:52.378100 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63dfd7ad-4f6e-476a-baae-29f5396e565a tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:52.396291 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63dfd7ad-4f6e-476a-baae-29f5396e565a tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:52.413011 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-56547365-97df-4216-bf0e-c0dd92701f93 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:52.413735 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-56547365-97df-4216-bf0e-c0dd92701f93 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 9bc0439b-4dfb-4a50-959d-0c80042f09fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:52.423630 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56547365-97df-4216-bf0e-c0dd92701f93 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:52.424108 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56547365-97df-4216-bf0e-c0dd92701f93 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:52.430468 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56547365-97df-4216-bf0e-c0dd92701f93 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:52.434532 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56547365-97df-4216-bf0e-c0dd92701f93 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:52.552397 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-63dfd7ad-4f6e-476a-baae-29f5396e565a tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:52.560310 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-63dfd7ad-4f6e-476a-baae-29f5396e565a tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d" status: 200 len: 1274 microversion: 2.1 time: 0.197820 Jul 25 14:38:52.561192 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1703/3216] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:52 2022] GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d => generated 1274 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:38:53.076460 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8a34e306-f4e2-452f-a840-52f478041e4c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:53.079223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8a34e306-f4e2-452f-a840-52f478041e4c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:53.092870 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-56547365-97df-4216-bf0e-c0dd92701f93 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:53.107246 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-56547365-97df-4216-bf0e-c0dd92701f93 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb" status: 200 len: 1327 microversion: 2.1 time: 0.693907 Jul 25 14:38:53.108631 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1514/3217] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:52 2022] GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb => generated 1327 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:38:53.112116 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8a34e306-f4e2-452f-a840-52f478041e4c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:53.113181 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8a34e306-f4e2-452f-a840-52f478041e4c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:53.115428 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8a34e306-f4e2-452f-a840-52f478041e4c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:53.117350 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8a34e306-f4e2-452f-a840-52f478041e4c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:53.211535 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-8a34e306-f4e2-452f-a840-52f478041e4c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lazy-loading 'flavor' on Instance uuid fac258f1-785d-4dd9-bc68-0ee713c9149a {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:38:53.584445 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-de8d341c-7b1f-4272-a77b-3e840bb6a238 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:53.585290 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-de8d341c-7b1f-4272-a77b-3e840bb6a238 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: 88b6bb55-179d-42a2-aab1-53aefc8e536d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:53.609203 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-de8d341c-7b1f-4272-a77b-3e840bb6a238 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:53.612164 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-de8d341c-7b1f-4272-a77b-3e840bb6a238 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:53.616875 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-de8d341c-7b1f-4272-a77b-3e840bb6a238 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:53.619613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-de8d341c-7b1f-4272-a77b-3e840bb6a238 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:53.628054 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8a34e306-f4e2-452f-a840-52f478041e4c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "POST /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a/action" status: 200 len: 32 microversion: 2.1 time: 0.555792 Jul 25 14:38:53.632212 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1704/3218] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:38:53 2022] POST /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a/action => generated 32 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 14:38:53.657492 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3dd7c064-b148-4b78-966a-731701b145ae tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:53.662868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3dd7c064-b148-4b78-966a-731701b145ae tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:53.693319 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3dd7c064-b148-4b78-966a-731701b145ae tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:53.694295 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3dd7c064-b148-4b78-966a-731701b145ae tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:53.695359 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3dd7c064-b148-4b78-966a-731701b145ae tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:53.697987 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3dd7c064-b148-4b78-966a-731701b145ae tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:53.760063 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-de8d341c-7b1f-4272-a77b-3e840bb6a238 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:53.772255 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-de8d341c-7b1f-4272-a77b-3e840bb6a238 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d" status: 200 len: 1280 microversion: 2.1 time: 0.192188 Jul 25 14:38:53.774365 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1515/3219] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:53 2022] GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d => generated 1280 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:53.780943 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6aaf3379-8093-485d-975e-8bee323fb730 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d80c68f-699c-477e-8b74-d3c4d9812f4d"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:53.784673 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6aaf3379-8093-485d-975e-8bee323fb730 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:53.815533 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6aaf3379-8093-485d-975e-8bee323fb730 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:53.820337 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6aaf3379-8093-485d-975e-8bee323fb730 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:53.821530 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6aaf3379-8093-485d-975e-8bee323fb730 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:53.823117 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6aaf3379-8093-485d-975e-8bee323fb730 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:53.880317 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:38:54.313956 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6aaf3379-8093-485d-975e-8bee323fb730 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "POST /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.536662 Jul 25 14:38:54.319856 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1516/3220] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Jul 25 14:38:53 2022] POST /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653/os-volume_attachments => generated 194 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:38:54.361865 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0b31bab9-0715-49c1-a179-32e56a8931b4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:54.362810 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0b31bab9-0715-49c1-a179-32e56a8931b4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 9bc0439b-4dfb-4a50-959d-0c80042f09fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:54.379444 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b31bab9-0715-49c1-a179-32e56a8931b4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:54.380003 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b31bab9-0715-49c1-a179-32e56a8931b4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:54.380832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b31bab9-0715-49c1-a179-32e56a8931b4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:54.381266 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b31bab9-0715-49c1-a179-32e56a8931b4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:54.425687 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3dd7c064-b148-4b78-966a-731701b145ae tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:54.438927 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3dd7c064-b148-4b78-966a-731701b145ae tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1734 microversion: 2.1 time: 0.795303 Jul 25 14:38:54.438927 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1705/3221] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:53 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1734 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:54.799387 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5a7c8c3f-3272-4f60-8cf5-9f3366efea97 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:54.800304 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5a7c8c3f-3272-4f60-8cf5-9f3366efea97 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: 88b6bb55-179d-42a2-aab1-53aefc8e536d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:54.811725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5a7c8c3f-3272-4f60-8cf5-9f3366efea97 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:54.813248 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5a7c8c3f-3272-4f60-8cf5-9f3366efea97 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:54.817567 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5a7c8c3f-3272-4f60-8cf5-9f3366efea97 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:54.818399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5a7c8c3f-3272-4f60-8cf5-9f3366efea97 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:54.870759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:38:54.879040 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0b31bab9-0715-49c1-a179-32e56a8931b4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:54.902961 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0b31bab9-0715-49c1-a179-32e56a8931b4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb" status: 200 len: 1327 microversion: 2.1 time: 0.586484 Jul 25 14:38:54.908352 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1517/3222] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:54 2022] GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb => generated 1327 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:54.986076 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5a7c8c3f-3272-4f60-8cf5-9f3366efea97 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:55.000906 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5a7c8c3f-3272-4f60-8cf5-9f3366efea97 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d" status: 200 len: 1280 microversion: 2.1 time: 0.204932 Jul 25 14:38:55.014625 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1706/3223] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:54 2022] GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d => generated 1280 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:55.456346 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3c0d73cd-d23e-417f-8853-32ad6b509bee tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:55.460731 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3c0d73cd-d23e-417f-8853-32ad6b509bee tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:55.474596 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c0d73cd-d23e-417f-8853-32ad6b509bee tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:55.475673 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c0d73cd-d23e-417f-8853-32ad6b509bee tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:55.480864 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c0d73cd-d23e-417f-8853-32ad6b509bee tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:55.481600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c0d73cd-d23e-417f-8853-32ad6b509bee tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:56.034558 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3c0d73cd-d23e-417f-8853-32ad6b509bee tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:56.050472 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3c0d73cd-d23e-417f-8853-32ad6b509bee tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1734 microversion: 2.1 time: 0.598972 Jul 25 14:38:56.054059 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1518/3224] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:55 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1734 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:56.060934 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-dd5abc3d-b805-431a-81e3-38077b47d542 req-c956b036-f2d0-4473-9471-72e7164a846a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bc0439b-4dfb-4a50-959d-0c80042f09fb", "name": "network-vif-plugged", "status": "completed", "tag": "3c879ee7-f97f-47f9-8acd-acda51c5221a"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:56.095320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-dd5abc3d-b805-431a-81e3-38077b47d542 req-c956b036-f2d0-4473-9471-72e7164a846a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:56.097193 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-dd5abc3d-b805-431a-81e3-38077b47d542 req-c956b036-f2d0-4473-9471-72e7164a846a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:56.117923 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-dd5abc3d-b805-431a-81e3-38077b47d542 req-c956b036-f2d0-4473-9471-72e7164a846a service nova] Creating event network-vif-plugged:3c879ee7-f97f-47f9-8acd-acda51c5221a for instance 9bc0439b-4dfb-4a50-959d-0c80042f09fb on n-h1-846435-14 Jul 25 14:38:56.124128 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-dd5abc3d-b805-431a-81e3-38077b47d542 req-c956b036-f2d0-4473-9471-72e7164a846a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068366 Jul 25 14:38:56.124854 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1519/3225] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:38:56.125069 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3995990a-c564-4913-b920-d33a0d9cf674 tempest-SecurityGroupsTestAdminJSON-1478850954 tempest-SecurityGroupsTestAdminJSON-1478850954-project] Action: 'create', calling method: .version_select at 0x7f4698878d30>, body: {"security_group": {"name": "tempest-securitygroup-273157981", "description": "tempest-description-281686547"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:56.134779 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-92e8705b-2840-4ac8-9666-fa9de1c7c319 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:56.135787 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-92e8705b-2840-4ac8-9666-fa9de1c7c319 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 9bc0439b-4dfb-4a50-959d-0c80042f09fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:56.145657 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-92e8705b-2840-4ac8-9666-fa9de1c7c319 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:56.146361 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-92e8705b-2840-4ac8-9666-fa9de1c7c319 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:56.147379 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-92e8705b-2840-4ac8-9666-fa9de1c7c319 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:56.148591 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-92e8705b-2840-4ac8-9666-fa9de1c7c319 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:56.550434 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-92e8705b-2840-4ac8-9666-fa9de1c7c319 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:56.562110 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-92e8705b-2840-4ac8-9666-fa9de1c7c319 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb" status: 200 len: 1327 microversion: 2.1 time: 0.430014 Jul 25 14:38:56.564089 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1520/3226] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:56 2022] GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb => generated 1327 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:56.587009 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f0869005-ae31-4dbe-9e39-b6326de1234f tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:56.588041 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f0869005-ae31-4dbe-9e39-b6326de1234f tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: 88b6bb55-179d-42a2-aab1-53aefc8e536d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:56.606042 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f0869005-ae31-4dbe-9e39-b6326de1234f tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:56.606901 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f0869005-ae31-4dbe-9e39-b6326de1234f tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:56.610737 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f0869005-ae31-4dbe-9e39-b6326de1234f tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:56.611523 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f0869005-ae31-4dbe-9e39-b6326de1234f tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:56.801569 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f0869005-ae31-4dbe-9e39-b6326de1234f tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:56.812204 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f0869005-ae31-4dbe-9e39-b6326de1234f tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d" status: 200 len: 1322 microversion: 2.1 time: 0.246137 Jul 25 14:38:56.812799 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1521/3227] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:56 2022] GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:57.080991 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a72c456e-cf92-49cb-9bd8-bb2611d073eb tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:57.081721 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a72c456e-cf92-49cb-9bd8-bb2611d073eb tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:57.088587 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a72c456e-cf92-49cb-9bd8-bb2611d073eb tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:57.089316 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a72c456e-cf92-49cb-9bd8-bb2611d073eb tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:57.090255 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a72c456e-cf92-49cb-9bd8-bb2611d073eb tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:57.090883 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a72c456e-cf92-49cb-9bd8-bb2611d073eb tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:57.288837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a72c456e-cf92-49cb-9bd8-bb2611d073eb tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:57.299622 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a72c456e-cf92-49cb-9bd8-bb2611d073eb tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1734 microversion: 2.1 time: 0.222481 Jul 25 14:38:57.300462 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1522/3228] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:57 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1734 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:38:57.583019 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cdb34c2c-9336-4437-927f-f1eeaade9371 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:57.584624 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cdb34c2c-9336-4437-927f-f1eeaade9371 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 9bc0439b-4dfb-4a50-959d-0c80042f09fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:57.615143 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cdb34c2c-9336-4437-927f-f1eeaade9371 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:57.616168 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cdb34c2c-9336-4437-927f-f1eeaade9371 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:57.617285 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cdb34c2c-9336-4437-927f-f1eeaade9371 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:57.618917 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cdb34c2c-9336-4437-927f-f1eeaade9371 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:57.790030 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3995990a-c564-4913-b920-d33a0d9cf674 tempest-SecurityGroupsTestAdminJSON-1478850954 tempest-SecurityGroupsTestAdminJSON-1478850954-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 2.158946 Jul 25 14:38:57.791611 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1707/3229] 10.222.0.88 () {60 vars in 1180 bytes} [Mon Jul 25 14:38:55 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 2161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:38:57.804160 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5eafdcab-6e76-4858-ab20-ad076294e20a tempest-SecurityGroupsTestAdminJSON-1478850954 tempest-SecurityGroupsTestAdminJSON-1478850954-project] Action: 'create', calling method: .version_select at 0x7f46988c5a60>, body: {"security_group": {"name": "tempest-securitygroup-1262592793", "description": "tempest-description-939711516"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:58.107880 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cdb34c2c-9336-4437-927f-f1eeaade9371 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:58.117884 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cdb34c2c-9336-4437-927f-f1eeaade9371 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb" status: 200 len: 1509 microversion: 2.1 time: 0.538791 Jul 25 14:38:58.121249 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1523/3230] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:57 2022] GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb => generated 1509 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:38:58.148214 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8f262458-12e5-4f70-8e77-25d01932af26 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:58.148862 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8f262458-12e5-4f70-8e77-25d01932af26 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: 88b6bb55-179d-42a2-aab1-53aefc8e536d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:58.169232 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f262458-12e5-4f70-8e77-25d01932af26 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:58.173858 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f262458-12e5-4f70-8e77-25d01932af26 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:58.177312 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f262458-12e5-4f70-8e77-25d01932af26 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:58.186974 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f262458-12e5-4f70-8e77-25d01932af26 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:58.271589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=12 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:38:58.545713 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5eafdcab-6e76-4858-ab20-ad076294e20a tempest-SecurityGroupsTestAdminJSON-1478850954 tempest-SecurityGroupsTestAdminJSON-1478850954-project] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.745912 Jul 25 14:38:58.554346 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1708/3231] 10.222.0.88 () {60 vars in 1180 bytes} [Mon Jul 25 14:38:57 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:38:58.554346 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cc3ad8e4-6738-4b04-a505-93b1cd56d737 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:58.554346 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cc3ad8e4-6738-4b04-a505-93b1cd56d737 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 9bc0439b-4dfb-4a50-959d-0c80042f09fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:58.580696 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cc3ad8e4-6738-4b04-a505-93b1cd56d737 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:58.584204 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cc3ad8e4-6738-4b04-a505-93b1cd56d737 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:58.594257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cc3ad8e4-6738-4b04-a505-93b1cd56d737 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:58.594899 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cc3ad8e4-6738-4b04-a505-93b1cd56d737 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:58.858247 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8f262458-12e5-4f70-8e77-25d01932af26 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:58.872527 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8f262458-12e5-4f70-8e77-25d01932af26 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d" status: 200 len: 1322 microversion: 2.1 time: 0.749065 Jul 25 14:38:58.874365 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1524/3232] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:58 2022] GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d => generated 1322 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:58.903370 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-78da8ba7-3135-40b2-a824-cfd1a0e3ced1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:38:58.904287 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-78da8ba7-3135-40b2-a824-cfd1a0e3ced1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:38:58.916049 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-78da8ba7-3135-40b2-a824-cfd1a0e3ced1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:58.917497 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-78da8ba7-3135-40b2-a824-cfd1a0e3ced1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:58.918399 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-78da8ba7-3135-40b2-a824-cfd1a0e3ced1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:38:58.924888 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-78da8ba7-3135-40b2-a824-cfd1a0e3ced1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:38:59.123112 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cc3ad8e4-6738-4b04-a505-93b1cd56d737 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:38:59.134485 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cc3ad8e4-6738-4b04-a505-93b1cd56d737 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb" status: 200 len: 1509 microversion: 2.1 time: 0.586752 Jul 25 14:38:59.137855 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1709/3233] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:58 2022] GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb => generated 1509 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:38:59.410239 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=48 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:38:59.727385 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-33381a2e-bf57-4fd6-a46d-cd4cdc4027d6 tempest-SecurityGroupsTestAdminJSON-1757536811 tempest-SecurityGroupsTestAdminJSON-1757536811-project-admin] Action: 'create', calling method: .version_select at 0x7f4698903f70>, body: {"security_group": {"name": "tempest-securitygroup-1743916856", "description": "tempest-description-1906033690"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:38:59.958002 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=12 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:39:00.452875 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-78da8ba7-3135-40b2-a824-cfd1a0e3ced1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:00.486425 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-78da8ba7-3135-40b2-a824-cfd1a0e3ced1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1734 microversion: 2.1 time: 1.595608 Jul 25 14:39:00.489364 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1525/3234] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:38:58 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1734 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:00.528012 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-171c6338-ca4d-4ae3-91cb-416987b80937 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:00.529688 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-171c6338-ca4d-4ae3-91cb-416987b80937 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 9bc0439b-4dfb-4a50-959d-0c80042f09fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:00.562413 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-171c6338-ca4d-4ae3-91cb-416987b80937 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:00.585044 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-171c6338-ca4d-4ae3-91cb-416987b80937 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:00.588794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-171c6338-ca4d-4ae3-91cb-416987b80937 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:00.589548 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-171c6338-ca4d-4ae3-91cb-416987b80937 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:00.655819 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-171c6338-ca4d-4ae3-91cb-416987b80937 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 9bc0439b-4dfb-4a50-959d-0c80042f09fb] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:39:00.811842 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-171c6338-ca4d-4ae3-91cb-416987b80937 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "DELETE /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb" status: 204 len: 0 microversion: 2.1 time: 0.320479 Jul 25 14:39:00.818283 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1526/3235] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:39:00 2022] DELETE /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:39:00.825818 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0cc623dd-ce9e-4ec4-97aa-e11b735c9416 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:00.841403 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0cc623dd-ce9e-4ec4-97aa-e11b735c9416 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: 88b6bb55-179d-42a2-aab1-53aefc8e536d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:00.857529 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0cc623dd-ce9e-4ec4-97aa-e11b735c9416 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:00.859757 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0cc623dd-ce9e-4ec4-97aa-e11b735c9416 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:00.861653 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0cc623dd-ce9e-4ec4-97aa-e11b735c9416 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:00.862986 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0cc623dd-ce9e-4ec4-97aa-e11b735c9416 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:01.166423 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-33381a2e-bf57-4fd6-a46d-cd4cdc4027d6 tempest-SecurityGroupsTestAdminJSON-1757536811 tempest-SecurityGroupsTestAdminJSON-1757536811-project-admin] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 2.026906 Jul 25 14:39:01.167019 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1710/3236] 10.222.0.88 () {60 vars in 1180 bytes} [Mon Jul 25 14:38:59 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 2028 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:01.178469 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-1883a90e-1e96-4ebc-bb1c-f0b37d8c511d req-8406fe8b-0449-4d59-b0f9-76d32ddfd74d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88b6bb55-179d-42a2-aab1-53aefc8e536d", "tag": "c9b223ac-704e-4be8-9d23-c8e08c833408"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:01.209464 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-1883a90e-1e96-4ebc-bb1c-f0b37d8c511d req-8406fe8b-0449-4d59-b0f9-76d32ddfd74d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:01.209938 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-1883a90e-1e96-4ebc-bb1c-f0b37d8c511d req-8406fe8b-0449-4d59-b0f9-76d32ddfd74d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:01.236975 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-1883a90e-1e96-4ebc-bb1c-f0b37d8c511d req-8406fe8b-0449-4d59-b0f9-76d32ddfd74d service nova] Creating event network-changed:c9b223ac-704e-4be8-9d23-c8e08c833408 for instance 88b6bb55-179d-42a2-aab1-53aefc8e536d on n-h2-846435-14 Jul 25 14:39:01.249332 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-1883a90e-1e96-4ebc-bb1c-f0b37d8c511d req-8406fe8b-0449-4d59-b0f9-76d32ddfd74d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074230 Jul 25 14:39:01.253859 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1711/3237] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:01.266871 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-59243bee-d963-411e-976d-d15dcfa20684 req-b2f601b2-3849-4a71-bc68-03fc101ea84b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb07cf02-962c-4ea4-899c-507ace1ee7e9", "tag": "b9759118-aad4-4af3-a510-268d572bfde7"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:01.295683 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-59243bee-d963-411e-976d-d15dcfa20684 req-b2f601b2-3849-4a71-bc68-03fc101ea84b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:01.296601 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-59243bee-d963-411e-976d-d15dcfa20684 req-b2f601b2-3849-4a71-bc68-03fc101ea84b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:01.326982 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-59243bee-d963-411e-976d-d15dcfa20684 req-b2f601b2-3849-4a71-bc68-03fc101ea84b service nova] Creating event network-changed:b9759118-aad4-4af3-a510-268d572bfde7 for instance bb07cf02-962c-4ea4-899c-507ace1ee7e9 on n-h2-846435-14 Jul 25 14:39:01.339236 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-59243bee-d963-411e-976d-d15dcfa20684 req-b2f601b2-3849-4a71-bc68-03fc101ea84b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081951 Jul 25 14:39:01.342035 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1712/3238] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:01.356675 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9c8f2b6d-89a3-4938-8acc-b7717f86d47f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:01.357524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9c8f2b6d-89a3-4938-8acc-b7717f86d47f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 9bc0439b-4dfb-4a50-959d-0c80042f09fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:01.362399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=55 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:39:01.381995 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9c8f2b6d-89a3-4938-8acc-b7717f86d47f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:01.382912 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9c8f2b6d-89a3-4938-8acc-b7717f86d47f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:01.386121 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9c8f2b6d-89a3-4938-8acc-b7717f86d47f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:01.386748 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9c8f2b6d-89a3-4938-8acc-b7717f86d47f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:01.591431 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0cc623dd-ce9e-4ec4-97aa-e11b735c9416 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:01.605707 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0cc623dd-ce9e-4ec4-97aa-e11b735c9416 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d" status: 200 len: 1322 microversion: 2.1 time: 0.779993 Jul 25 14:39:01.606399 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1527/3239] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:00 2022] GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d => generated 1322 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:01.623897 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-667fe1de-c659-4277-b2d9-acc5a78d323f tempest-SecurityGroupsTestAdminJSON-1757536811 tempest-SecurityGroupsTestAdminJSON-1757536811-project-admin] Action: 'create', calling method: .version_select at 0x7f46868c3dc0>, body: {"security_group": {"name": "tempest-securitygroup-744410548", "description": "tempest-description-1152722707"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:01.967232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9c8f2b6d-89a3-4938-8acc-b7717f86d47f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:01.980898 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9c8f2b6d-89a3-4938-8acc-b7717f86d47f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb" status: 200 len: 1515 microversion: 2.1 time: 0.635555 Jul 25 14:39:01.983602 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1713/3240] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:01 2022] GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb => generated 1515 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:02.004757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-570a61b7-aaea-419c-854e-87fd98fde88c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:02.011902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-570a61b7-aaea-419c-854e-87fd98fde88c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:02.023660 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-570a61b7-aaea-419c-854e-87fd98fde88c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:02.025209 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-570a61b7-aaea-419c-854e-87fd98fde88c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:02.026744 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-570a61b7-aaea-419c-854e-87fd98fde88c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:02.027358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-570a61b7-aaea-419c-854e-87fd98fde88c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:02.471688 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-570a61b7-aaea-419c-854e-87fd98fde88c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:02.489242 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-570a61b7-aaea-419c-854e-87fd98fde88c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1734 microversion: 2.1 time: 0.487391 Jul 25 14:39:02.501136 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1714/3241] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:01 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1734 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:02.627743 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-005e5b19-71dc-4b57-b986-98b092f972ff tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:02.628638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-005e5b19-71dc-4b57-b986-98b092f972ff tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: 88b6bb55-179d-42a2-aab1-53aefc8e536d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:02.639638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-005e5b19-71dc-4b57-b986-98b092f972ff tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:02.640988 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-005e5b19-71dc-4b57-b986-98b092f972ff tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:02.641954 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-005e5b19-71dc-4b57-b986-98b092f972ff tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:02.644187 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-005e5b19-71dc-4b57-b986-98b092f972ff tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:02.778682 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-667fe1de-c659-4277-b2d9-acc5a78d323f tempest-SecurityGroupsTestAdminJSON-1757536811 tempest-SecurityGroupsTestAdminJSON-1757536811-project-admin] 10.222.0.88 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.170420 Jul 25 14:39:02.779655 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1528/3242] 10.222.0.88 () {60 vars in 1180 bytes} [Mon Jul 25 14:39:01 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:02.791909 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f0d10a73-1e59-43ed-ba29-61941e602bd5 tempest-SecurityGroupsTestAdminJSON-1757536811 tempest-SecurityGroupsTestAdminJSON-1757536811-project-admin] Calling method '.version_select at 0x7f468693db80>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:02.987698 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-005e5b19-71dc-4b57-b986-98b092f972ff tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:03.000726 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-005e5b19-71dc-4b57-b986-98b092f972ff tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d" status: 200 len: 1322 microversion: 2.1 time: 0.376277 Jul 25 14:39:03.000726 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1715/3243] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:02 2022] GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d => generated 1322 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:39:03.022008 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c96fe682-c886-472e-aae2-decc078dfc72 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:03.024321 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c96fe682-c886-472e-aae2-decc078dfc72 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 9bc0439b-4dfb-4a50-959d-0c80042f09fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:03.038528 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c96fe682-c886-472e-aae2-decc078dfc72 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:03.039764 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c96fe682-c886-472e-aae2-decc078dfc72 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:03.042901 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c96fe682-c886-472e-aae2-decc078dfc72 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:03.043519 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c96fe682-c886-472e-aae2-decc078dfc72 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:03.249383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c96fe682-c886-472e-aae2-decc078dfc72 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:03.267284 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c96fe682-c886-472e-aae2-decc078dfc72 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb" status: 200 len: 1515 microversion: 2.1 time: 0.261575 Jul 25 14:39:03.286449 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1716/3244] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:03 2022] GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb => generated 1515 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:39:03.384304 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-e5a283ea-c7c6-4516-b96f-405577efddf6 req-4db5bd9f-56b5-4d21-ac9c-fade70c41cdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b535085-b43d-4a2b-84c3-b5768569def2", "tag": "0847c32d-0c3b-4bc3-9180-684c88504a3c"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:03.408173 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-e5a283ea-c7c6-4516-b96f-405577efddf6 req-4db5bd9f-56b5-4d21-ac9c-fade70c41cdd service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:03.410056 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-e5a283ea-c7c6-4516-b96f-405577efddf6 req-4db5bd9f-56b5-4d21-ac9c-fade70c41cdd service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:03.446991 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-e5a283ea-c7c6-4516-b96f-405577efddf6 req-4db5bd9f-56b5-4d21-ac9c-fade70c41cdd service nova] Creating event network-changed:0847c32d-0c3b-4bc3-9180-684c88504a3c for instance 6b535085-b43d-4a2b-84c3-b5768569def2 on n-h1-846435-14 Jul 25 14:39:03.459676 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-e5a283ea-c7c6-4516-b96f-405577efddf6 req-4db5bd9f-56b5-4d21-ac9c-fade70c41cdd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079356 Jul 25 14:39:03.462809 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1717/3245] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:39:03.518274 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-acb3d20d-c15d-4b2d-a28d-a0a3d1e87046 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:03.518978 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-acb3d20d-c15d-4b2d-a28d-a0a3d1e87046 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:03.548581 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-acb3d20d-c15d-4b2d-a28d-a0a3d1e87046 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:03.552027 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-acb3d20d-c15d-4b2d-a28d-a0a3d1e87046 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:03.554517 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-acb3d20d-c15d-4b2d-a28d-a0a3d1e87046 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:03.557037 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-acb3d20d-c15d-4b2d-a28d-a0a3d1e87046 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:03.819064 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-acb3d20d-c15d-4b2d-a28d-a0a3d1e87046 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:03.843561 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-acb3d20d-c15d-4b2d-a28d-a0a3d1e87046 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1734 microversion: 2.1 time: 0.331566 Jul 25 14:39:03.844504 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1718/3246] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:03 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1734 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:03.852401 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-fe7e39e5-bb2e-4a0f-9e48-6ed17f7b15aa req-85c5f6ba-f0c6-4679-93dd-8e8f5fa98e80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bc0439b-4dfb-4a50-959d-0c80042f09fb", "name": "network-vif-deleted", "tag": "3c879ee7-f97f-47f9-8acd-acda51c5221a"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:03.866797 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-fe7e39e5-bb2e-4a0f-9e48-6ed17f7b15aa req-85c5f6ba-f0c6-4679-93dd-8e8f5fa98e80 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:03.868162 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-fe7e39e5-bb2e-4a0f-9e48-6ed17f7b15aa req-85c5f6ba-f0c6-4679-93dd-8e8f5fa98e80 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:03.886291 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-fe7e39e5-bb2e-4a0f-9e48-6ed17f7b15aa req-85c5f6ba-f0c6-4679-93dd-8e8f5fa98e80 service nova] Creating event network-vif-deleted:3c879ee7-f97f-47f9-8acd-acda51c5221a for instance 9bc0439b-4dfb-4a50-959d-0c80042f09fb on n-h1-846435-14 Jul 25 14:39:03.892580 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-fe7e39e5-bb2e-4a0f-9e48-6ed17f7b15aa req-85c5f6ba-f0c6-4679-93dd-8e8f5fa98e80 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045705 Jul 25 14:39:03.894010 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1719/3247] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:04.020803 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-937a30bb-1858-4def-87ac-18c7657eb2e5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:04.021526 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-937a30bb-1858-4def-87ac-18c7657eb2e5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: 88b6bb55-179d-42a2-aab1-53aefc8e536d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:04.029158 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-937a30bb-1858-4def-87ac-18c7657eb2e5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:04.029610 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-937a30bb-1858-4def-87ac-18c7657eb2e5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:04.030392 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-937a30bb-1858-4def-87ac-18c7657eb2e5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:04.030831 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-937a30bb-1858-4def-87ac-18c7657eb2e5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:04.207183 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-937a30bb-1858-4def-87ac-18c7657eb2e5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:04.217874 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-937a30bb-1858-4def-87ac-18c7657eb2e5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d" status: 200 len: 1322 microversion: 2.1 time: 0.200768 Jul 25 14:39:04.230548 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1720/3248] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:04 2022] GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:39:04.294641 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5e05a4aa-fb64-4297-87cf-48cd84e86bd9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:04.295802 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5e05a4aa-fb64-4297-87cf-48cd84e86bd9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 9bc0439b-4dfb-4a50-959d-0c80042f09fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:04.303516 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5e05a4aa-fb64-4297-87cf-48cd84e86bd9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:04.304429 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5e05a4aa-fb64-4297-87cf-48cd84e86bd9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:04.305467 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5e05a4aa-fb64-4297-87cf-48cd84e86bd9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:04.306123 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5e05a4aa-fb64-4297-87cf-48cd84e86bd9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:04.352711 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5e05a4aa-fb64-4297-87cf-48cd84e86bd9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:04.353732 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5e05a4aa-fb64-4297-87cf-48cd84e86bd9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:04.354395 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-5e05a4aa-fb64-4297-87cf-48cd84e86bd9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lazy-loading 'fault' on Instance uuid 9bc0439b-4dfb-4a50-959d-0c80042f09fb {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:39:04.416169 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5e05a4aa-fb64-4297-87cf-48cd84e86bd9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:04.425263 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5e05a4aa-fb64-4297-87cf-48cd84e86bd9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb" status: 200 len: 1317 microversion: 2.1 time: 0.138139 Jul 25 14:39:04.439542 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1721/3249] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:04 2022] GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:04.869061 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9ff0e1ed-12af-47e8-aebe-84696fb3e5ce tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:04.869782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9ff0e1ed-12af-47e8-aebe-84696fb3e5ce tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:04.883660 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ff0e1ed-12af-47e8-aebe-84696fb3e5ce tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:04.883660 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ff0e1ed-12af-47e8-aebe-84696fb3e5ce tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:04.888629 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ff0e1ed-12af-47e8-aebe-84696fb3e5ce tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:04.889093 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ff0e1ed-12af-47e8-aebe-84696fb3e5ce tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:05.128138 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9ff0e1ed-12af-47e8-aebe-84696fb3e5ce tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:05.146703 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9ff0e1ed-12af-47e8-aebe-84696fb3e5ce tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1734 microversion: 2.1 time: 0.283186 Jul 25 14:39:05.147937 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1722/3250] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:04 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1734 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:39:05.238609 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3f1adfd4-05fa-43f7-82f6-29ae4de6dcb5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:05.239221 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3f1adfd4-05fa-43f7-82f6-29ae4de6dcb5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: 88b6bb55-179d-42a2-aab1-53aefc8e536d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:05.257708 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f1adfd4-05fa-43f7-82f6-29ae4de6dcb5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:05.259263 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f1adfd4-05fa-43f7-82f6-29ae4de6dcb5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:05.260511 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f1adfd4-05fa-43f7-82f6-29ae4de6dcb5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:05.262011 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f1adfd4-05fa-43f7-82f6-29ae4de6dcb5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:05.518722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3f1adfd4-05fa-43f7-82f6-29ae4de6dcb5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:05.533329 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3f1adfd4-05fa-43f7-82f6-29ae4de6dcb5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d" status: 200 len: 1322 microversion: 2.1 time: 0.298633 Jul 25 14:39:05.536213 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1723/3251] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:05 2022] GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d => generated 1322 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:39:05.543796 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-db1916ef-17ee-463d-bff2-3ded67a37bf9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:05.544847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-db1916ef-17ee-463d-bff2-3ded67a37bf9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 9bc0439b-4dfb-4a50-959d-0c80042f09fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:05.574195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db1916ef-17ee-463d-bff2-3ded67a37bf9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:05.574755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db1916ef-17ee-463d-bff2-3ded67a37bf9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:05.578476 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db1916ef-17ee-463d-bff2-3ded67a37bf9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:05.579699 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db1916ef-17ee-463d-bff2-3ded67a37bf9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:05.609140 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-db1916ef-17ee-463d-bff2-3ded67a37bf9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] HTTP exception thrown: Instance 9bc0439b-4dfb-4a50-959d-0c80042f09fb could not be found. Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-db1916ef-17ee-463d-bff2-3ded67a37bf9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Request method failure captured: Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb HTTP/1.1 Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qrEzscNKkpLEv-dO5KC3kdeJJY02nOIPLRIxGcrQR-Na_rLZBnVMM8MjTz-RtprnQR45AAorrNLLV4PDOD1PCa-gGNHdgbGOQfAGQYPzZpu9aSUEO6v7jEn8m2OVF51pdW16QE7pCXmLdRnFRt172yMaxqytlLvEMs-sUVBeXNXrcQ Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e77732af189e48feab3752ddb28208d3", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e77732af189e48feab3752ddb28208d3"}]}] Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersTestJSON-1827246574 Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersTestJSON-1827246574-project Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: e45ffe0956ae4ba9b1577875f312af06 Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersTestJSON-1827246574-project Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 9bc0439b-4dfb-4a50-959d-0c80042f09fb could not be found. Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '9bc0439b-4dfb-4a50-959d-0c80042f09fb'} Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bc0439b-4dfb-4a50-959d-0c80042f09fb could not be found. Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bc0439b-4dfb-4a50-959d-0c80042f09fb could not be found. Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:05.611158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:05.615525 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:05.615525 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:05.615525 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:39:05.615525 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:39:05.615525 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bc0439b-4dfb-4a50-959d-0c80042f09fb could not be found. Jul 25 14:39:05.615525 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:05.619068 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-db1916ef-17ee-463d-bff2-3ded67a37bf9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Returning 404 to user: Instance 9bc0439b-4dfb-4a50-959d-0c80042f09fb could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:39:05.619967 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-db1916ef-17ee-463d-bff2-3ded67a37bf9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb" status: 404 len: 111 microversion: 2.1 time: 0.081657 Jul 25 14:39:05.620964 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1724/3252] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:05 2022] GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:39:05.630897 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-be036946-2c27-4d9a-a9dc-107be165da96 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '.version_select at 0x7f46988c5040>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:05.665788 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-be036946-2c27-4d9a-a9dc-107be165da96 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-key-283655674" status: 202 len: 0 microversion: 2.1 time: 0.037813 Jul 25 14:39:05.668764 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1725/3253] 10.222.0.88 () {58 vars in 1206 bytes} [Mon Jul 25 14:39:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-283655674 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:39:05.850223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-481ae5f4-fffc-45ad-87fd-1c10aa0ddfb6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-977035244", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "4c176170-2f7d-43a7-8c89-c74c022eb418"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:05.938892 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-481ae5f4-fffc-45ad-87fd-1c10aa0ddfb6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] validate_networks() for [('4c176170-2f7d-43a7-8c89-c74c022eb418', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:39:06.362122 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f0d10a73-1e59-43ed-ba29-61941e602bd5 tempest-SecurityGroupsTestAdminJSON-1757536811 tempest-SecurityGroupsTestAdminJSON-1757536811-project-admin] 10.222.0.88 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10925 microversion: 2.1 time: 3.574034 Jul 25 14:39:06.363864 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1529/3254] 10.222.0.88 () {58 vars in 1191 bytes} [Mon Jul 25 14:39:02 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10925 bytes in 3576 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:39:06.369767 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-24f6c9dd-f054-4be1-9aed-f4285cf30c24 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:06.370621 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-24f6c9dd-f054-4be1-9aed-f4285cf30c24 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:06.391885 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-24f6c9dd-f054-4be1-9aed-f4285cf30c24 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:06.392659 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-24f6c9dd-f054-4be1-9aed-f4285cf30c24 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:06.401265 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-24f6c9dd-f054-4be1-9aed-f4285cf30c24 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:06.402370 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-24f6c9dd-f054-4be1-9aed-f4285cf30c24 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:06.694850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-24f6c9dd-f054-4be1-9aed-f4285cf30c24 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:06.703890 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-24f6c9dd-f054-4be1-9aed-f4285cf30c24 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1734 microversion: 2.1 time: 0.338615 Jul 25 14:39:06.704492 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1530/3255] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:06 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1734 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:06.717062 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c356f841-beae-4640-a9d0-0aa45140388e tempest-SecurityGroupsTestAdminJSON-1478850954 tempest-SecurityGroupsTestAdminJSON-1478850954-project] Calling method '.version_select at 0x7f4686848a60>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:06.967062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-481ae5f4-fffc-45ad-87fd-1c10aa0ddfb6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:39:06.968456 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-481ae5f4-fffc-45ad-87fd-1c10aa0ddfb6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:39:06.968456 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-481ae5f4-fffc-45ad-87fd-1c10aa0ddfb6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:39:06.968456 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-481ae5f4-fffc-45ad-87fd-1c10aa0ddfb6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:39:06.968792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-481ae5f4-fffc-45ad-87fd-1c10aa0ddfb6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:39:06.995276 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-481ae5f4-fffc-45ad-87fd-1c10aa0ddfb6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:06.996043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-481ae5f4-fffc-45ad-87fd-1c10aa0ddfb6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:06.998417 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-481ae5f4-fffc-45ad-87fd-1c10aa0ddfb6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:06.999742 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-481ae5f4-fffc-45ad-87fd-1c10aa0ddfb6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:07.059480 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-481ae5f4-fffc-45ad-87fd-1c10aa0ddfb6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Getting quotas for project e77732af189e48feab3752ddb28208d3. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:39:07.064423 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c356f841-beae-4640-a9d0-0aa45140388e tempest-SecurityGroupsTestAdminJSON-1478850954 tempest-SecurityGroupsTestAdminJSON-1478850954-project] 10.222.0.88 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.351108 Jul 25 14:39:07.065330 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1531/3256] 10.222.0.88 () {58 vars in 1191 bytes} [Mon Jul 25 14:39:06 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:07.070937 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cd511bf8-f1bc-41d9-8a2f-c9e65fbf182b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:07.071778 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cd511bf8-f1bc-41d9-8a2f-c9e65fbf182b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: 88b6bb55-179d-42a2-aab1-53aefc8e536d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:07.087258 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-481ae5f4-fffc-45ad-87fd-1c10aa0ddfb6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Getting quotas for user e45ffe0956ae4ba9b1577875f312af06 and project e77732af189e48feab3752ddb28208d3. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:39:07.089975 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cd511bf8-f1bc-41d9-8a2f-c9e65fbf182b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:07.090593 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cd511bf8-f1bc-41d9-8a2f-c9e65fbf182b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:07.092548 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cd511bf8-f1bc-41d9-8a2f-c9e65fbf182b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:07.093519 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cd511bf8-f1bc-41d9-8a2f-c9e65fbf182b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:07.108684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-481ae5f4-fffc-45ad-87fd-1c10aa0ddfb6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:39:07.111474 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-481ae5f4-fffc-45ad-87fd-1c10aa0ddfb6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 31135b90-13f0-431a-994f-8af08fbd3248] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:39:07.267553 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-481ae5f4-fffc-45ad-87fd-1c10aa0ddfb6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.421379 Jul 25 14:39:07.272273 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1726/3257] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:39:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:39:07.287938 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f565cb1e-418f-4274-a05d-8014b94ee38b tempest-SecurityGroupsTestAdminJSON-1757536811 tempest-SecurityGroupsTestAdminJSON-1757536811-project-admin] Calling method '.version_select at 0x7f46988c5a60>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:07.378038 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cd511bf8-f1bc-41d9-8a2f-c9e65fbf182b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:07.399224 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cd511bf8-f1bc-41d9-8a2f-c9e65fbf182b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d" status: 200 len: 1322 microversion: 2.1 time: 0.332138 Jul 25 14:39:07.402475 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1532/3258] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:07 2022] GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:07.409352 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-24085593-6ab8-42ac-a194-1cd5bbb7d68d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:07.411106 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-24085593-6ab8-42ac-a194-1cd5bbb7d68d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 31135b90-13f0-431a-994f-8af08fbd3248] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:07.522248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-24085593-6ab8-42ac-a194-1cd5bbb7d68d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:07.532703 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-24085593-6ab8-42ac-a194-1cd5bbb7d68d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248" status: 200 len: 1208 microversion: 2.1 time: 0.128359 Jul 25 14:39:07.549085 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1533/3259] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:07 2022] GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248 => generated 1208 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:07.726438 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6f059378-93ac-48d1-81e7-239b4152554b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:07.727424 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6f059378-93ac-48d1-81e7-239b4152554b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:07.741675 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6f059378-93ac-48d1-81e7-239b4152554b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:07.742192 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6f059378-93ac-48d1-81e7-239b4152554b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:07.743522 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6f059378-93ac-48d1-81e7-239b4152554b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:07.744545 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6f059378-93ac-48d1-81e7-239b4152554b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:08.134153 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6f059378-93ac-48d1-81e7-239b4152554b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:08.138231 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:39:08.143949 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6f059378-93ac-48d1-81e7-239b4152554b tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1734 microversion: 2.1 time: 0.422008 Jul 25 14:39:08.160452 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1534/3260] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:07 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1734 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:08.169066 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-9abd84e9-63b7-4962-890d-314937028130 req-5a3fb1fa-cbf0-4cfd-ab36-3ea05fcc8af8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b535085-b43d-4a2b-84c3-b5768569def2", "name": "network-vif-plugged", "status": "completed", "tag": "0847c32d-0c3b-4bc3-9180-684c88504a3c"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:08.190245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-9abd84e9-63b7-4962-890d-314937028130 req-5a3fb1fa-cbf0-4cfd-ab36-3ea05fcc8af8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:08.194111 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-9abd84e9-63b7-4962-890d-314937028130 req-5a3fb1fa-cbf0-4cfd-ab36-3ea05fcc8af8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:08.222119 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-9abd84e9-63b7-4962-890d-314937028130 req-5a3fb1fa-cbf0-4cfd-ab36-3ea05fcc8af8 service nova] Creating event network-vif-plugged:0847c32d-0c3b-4bc3-9180-684c88504a3c for instance 6b535085-b43d-4a2b-84c3-b5768569def2 on n-h1-846435-14 Jul 25 14:39:08.240117 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-9abd84e9-63b7-4962-890d-314937028130 req-5a3fb1fa-cbf0-4cfd-ab36-3ea05fcc8af8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076068 Jul 25 14:39:08.242996 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1535/3261] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:08.424096 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e84f11d1-93de-4c1e-906a-952b5e6e564f tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:08.425732 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e84f11d1-93de-4c1e-906a-952b5e6e564f tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: 88b6bb55-179d-42a2-aab1-53aefc8e536d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:08.440507 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e84f11d1-93de-4c1e-906a-952b5e6e564f tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:08.441268 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e84f11d1-93de-4c1e-906a-952b5e6e564f tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:08.442439 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e84f11d1-93de-4c1e-906a-952b5e6e564f tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:08.443040 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e84f11d1-93de-4c1e-906a-952b5e6e564f tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:08.734575 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e84f11d1-93de-4c1e-906a-952b5e6e564f tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:08.742999 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e84f11d1-93de-4c1e-906a-952b5e6e564f tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d" status: 200 len: 1322 microversion: 2.1 time: 0.323207 Jul 25 14:39:08.743877 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1536/3262] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:08 2022] GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:39:08.748692 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-643e59df-ae17-4b30-9ec5-c3ff7514bdc5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:08.749308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-643e59df-ae17-4b30-9ec5-c3ff7514bdc5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 31135b90-13f0-431a-994f-8af08fbd3248] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:08.757005 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-643e59df-ae17-4b30-9ec5-c3ff7514bdc5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:08.757648 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-643e59df-ae17-4b30-9ec5-c3ff7514bdc5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:08.759087 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-643e59df-ae17-4b30-9ec5-c3ff7514bdc5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:08.759689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-643e59df-ae17-4b30-9ec5-c3ff7514bdc5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:08.800799 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f565cb1e-418f-4274-a05d-8014b94ee38b tempest-SecurityGroupsTestAdminJSON-1757536811 tempest-SecurityGroupsTestAdminJSON-1757536811-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/263b71af-0e96-4a10-843b-8a09c611d456" status: 202 len: 0 microversion: 2.1 time: 1.525120 Jul 25 14:39:08.802144 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1727/3263] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:39:07 2022] DELETE /compute/v2.1/os-security-groups/263b71af-0e96-4a10-843b-8a09c611d456 => generated 0 bytes in 1529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:39:08.810580 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ae7ef3c3-df49-45bd-afb0-238a31666e5a tempest-SecurityGroupsTestAdminJSON-1757536811 tempest-SecurityGroupsTestAdminJSON-1757536811-project-admin] Calling method '.version_select at 0x7f46988c5af0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:08.867486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-643e59df-ae17-4b30-9ec5-c3ff7514bdc5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:08.878413 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-643e59df-ae17-4b30-9ec5-c3ff7514bdc5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248" status: 200 len: 1260 microversion: 2.1 time: 0.133041 Jul 25 14:39:08.879623 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1537/3264] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:08 2022] GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248 => generated 1260 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:09.311615 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ae7ef3c3-df49-45bd-afb0-238a31666e5a tempest-SecurityGroupsTestAdminJSON-1757536811 tempest-SecurityGroupsTestAdminJSON-1757536811-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/8d2e0dc2-33eb-48fa-bb79-619f2d8258ca" status: 202 len: 0 microversion: 2.1 time: 0.504282 Jul 25 14:39:09.313106 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1728/3265] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:39:08 2022] DELETE /compute/v2.1/os-security-groups/8d2e0dc2-33eb-48fa-bb79-619f2d8258ca => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:39:09.322224 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6a0a517e-5a44-4510-90ff-5f590e75565f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:09.322945 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6a0a517e-5a44-4510-90ff-5f590e75565f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:09.351373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:39:09.359693 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6a0a517e-5a44-4510-90ff-5f590e75565f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:09.360220 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6a0a517e-5a44-4510-90ff-5f590e75565f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:09.362025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6a0a517e-5a44-4510-90ff-5f590e75565f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:09.362488 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6a0a517e-5a44-4510-90ff-5f590e75565f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:09.385019 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f4023d01-3e5c-40d4-a497-c080bb4c1163 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Action: 'create', calling method: .version_select at 0x7f46868c3ee0>, body: {"keypair": {"name": "tempest-keypair-1072562794", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsoQSwzgAGr5aNfX1Z8u9jHfeVzjEwv1YG1Hx6K4k35sBIDX9Jdjxt3qGd4hc7uGZR0cPHGU/IiMrkwAba7SZpprGPMS5lNW5AFIc1GDQczsi3C7ms0fFsc/Ks4WJNF4w=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:09.426238 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-f4023d01-3e5c-40d4-a497-c080bb4c1163 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Getting quotas for project 14292758eb5e482d97001c3ddce034ee. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:39:09.441351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-f4023d01-3e5c-40d4-a497-c080bb4c1163 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Getting quotas for user 1b0dcc68e92f4917ad5335e4325b7065 and project 14292758eb5e482d97001c3ddce034ee. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:39:09.542946 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f4023d01-3e5c-40d4-a497-c080bb4c1163 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.444244 Jul 25 14:39:09.544523 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1538/3266] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:39:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:39:09.561295 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-057bbe62-568e-44f2-bb8d-8ddf6dce96d5 tempest-SecurityGroupsTestAdminJSON-1478850954 tempest-SecurityGroupsTestAdminJSON-1478850954-project] Calling method '.version_select at 0x7f46868b2040>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:09.798139 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6a0a517e-5a44-4510-90ff-5f590e75565f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:09.814937 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6a0a517e-5a44-4510-90ff-5f590e75565f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1734 microversion: 2.1 time: 0.500452 Jul 25 14:39:09.831413 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1729/3267] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:09 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1734 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:09.838558 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-11710658-71f4-49c8-89c0-a19fbeadc830 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:09.840490 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-11710658-71f4-49c8-89c0-a19fbeadc830 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: 88b6bb55-179d-42a2-aab1-53aefc8e536d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:09.849935 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11710658-71f4-49c8-89c0-a19fbeadc830 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:09.851883 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11710658-71f4-49c8-89c0-a19fbeadc830 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:09.853134 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11710658-71f4-49c8-89c0-a19fbeadc830 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:09.853596 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11710658-71f4-49c8-89c0-a19fbeadc830 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:10.066630 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-057bbe62-568e-44f2-bb8d-8ddf6dce96d5 tempest-SecurityGroupsTestAdminJSON-1478850954 tempest-SecurityGroupsTestAdminJSON-1478850954-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/256c7cd2-7e4f-4852-bbec-e4d55bb5ef15" status: 202 len: 0 microversion: 2.1 time: 0.520469 Jul 25 14:39:10.072634 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1539/3268] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:39:09 2022] DELETE /compute/v2.1/os-security-groups/256c7cd2-7e4f-4852-bbec-e4d55bb5ef15 => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:39:10.086327 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-12d4b5a6-6e75-4df6-9900-90c75204b9d9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:10.086327 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-12d4b5a6-6e75-4df6-9900-90c75204b9d9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 31135b90-13f0-431a-994f-8af08fbd3248] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:10.107515 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-12d4b5a6-6e75-4df6-9900-90c75204b9d9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:10.109054 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-12d4b5a6-6e75-4df6-9900-90c75204b9d9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:10.111100 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-12d4b5a6-6e75-4df6-9900-90c75204b9d9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:10.113595 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-12d4b5a6-6e75-4df6-9900-90c75204b9d9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:10.210158 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-11710658-71f4-49c8-89c0-a19fbeadc830 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:10.231389 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-11710658-71f4-49c8-89c0-a19fbeadc830 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d" status: 200 len: 1322 microversion: 2.1 time: 0.398356 Jul 25 14:39:10.236362 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1730/3269] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:09 2022] GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d => generated 1322 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:10.237581 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-12d4b5a6-6e75-4df6-9900-90c75204b9d9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:10.242728 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5708cb61-1eea-4d71-a22d-20ab333bd60a tempest-SecurityGroupsTestAdminJSON-1478850954 tempest-SecurityGroupsTestAdminJSON-1478850954-project] Calling method '.version_select at 0x7f4698888280>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:10.251018 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-12d4b5a6-6e75-4df6-9900-90c75204b9d9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248" status: 200 len: 1266 microversion: 2.1 time: 0.177108 Jul 25 14:39:10.251849 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1540/3270] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:10 2022] GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:10.304597 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-3af27db0-a4d5-418c-a894-86de7aebb2f3 req-d0b67fe6-946c-40b6-9b52-a5e518e5800a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b6bb55-179d-42a2-aab1-53aefc8e536d", "name": "network-vif-plugged", "status": "completed", "tag": "c9b223ac-704e-4be8-9d23-c8e08c833408"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:10.319484 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-3af27db0-a4d5-418c-a894-86de7aebb2f3 req-d0b67fe6-946c-40b6-9b52-a5e518e5800a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:10.320125 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-3af27db0-a4d5-418c-a894-86de7aebb2f3 req-d0b67fe6-946c-40b6-9b52-a5e518e5800a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:10.335865 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-3af27db0-a4d5-418c-a894-86de7aebb2f3 req-d0b67fe6-946c-40b6-9b52-a5e518e5800a service nova] Creating event network-vif-plugged:c9b223ac-704e-4be8-9d23-c8e08c833408 for instance 88b6bb55-179d-42a2-aab1-53aefc8e536d on n-h2-846435-14 Jul 25 14:39:10.345093 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-3af27db0-a4d5-418c-a894-86de7aebb2f3 req-d0b67fe6-946c-40b6-9b52-a5e518e5800a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046457 Jul 25 14:39:10.347159 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1541/3271] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:39:10.488864 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5708cb61-1eea-4d71-a22d-20ab333bd60a tempest-SecurityGroupsTestAdminJSON-1478850954 tempest-SecurityGroupsTestAdminJSON-1478850954-project] 10.222.0.88 "DELETE /compute/v2.1/os-security-groups/689766a4-2d16-4bd1-8452-f8a0d2eb6404" status: 202 len: 0 microversion: 2.1 time: 0.251108 Jul 25 14:39:10.489918 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1731/3272] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:39:10 2022] DELETE /compute/v2.1/os-security-groups/689766a4-2d16-4bd1-8452-f8a0d2eb6404 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:39:10.852297 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-164f37d4-e16e-465d-b960-5ecd47027084 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:10.856383 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-164f37d4-e16e-465d-b960-5ecd47027084 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:10.875043 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-164f37d4-e16e-465d-b960-5ecd47027084 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:10.877156 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-164f37d4-e16e-465d-b960-5ecd47027084 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:10.878202 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-164f37d4-e16e-465d-b960-5ecd47027084 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:10.881257 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-164f37d4-e16e-465d-b960-5ecd47027084 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:11.153925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-164f37d4-e16e-465d-b960-5ecd47027084 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:11.164570 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-164f37d4-e16e-465d-b960-5ecd47027084 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1734 microversion: 2.1 time: 0.326865 Jul 25 14:39:11.165188 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1542/3273] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:10 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1734 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:11.255340 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4b859c0b-af02-4bad-9e31-73999fabe308 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:11.256810 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4b859c0b-af02-4bad-9e31-73999fabe308 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: 88b6bb55-179d-42a2-aab1-53aefc8e536d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:11.270261 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4b859c0b-af02-4bad-9e31-73999fabe308 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:11.271419 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4b859c0b-af02-4bad-9e31-73999fabe308 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:11.272933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4b859c0b-af02-4bad-9e31-73999fabe308 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:11.273277 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-773a8bdb-71d7-46aa-a08b-ca567f7a94f3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:11.273909 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-773a8bdb-71d7-46aa-a08b-ca567f7a94f3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 31135b90-13f0-431a-994f-8af08fbd3248] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:11.274315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4b859c0b-af02-4bad-9e31-73999fabe308 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:11.291437 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-773a8bdb-71d7-46aa-a08b-ca567f7a94f3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:11.292017 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-773a8bdb-71d7-46aa-a08b-ca567f7a94f3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:11.293594 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-773a8bdb-71d7-46aa-a08b-ca567f7a94f3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:11.294244 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-773a8bdb-71d7-46aa-a08b-ca567f7a94f3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:11.718278 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-773a8bdb-71d7-46aa-a08b-ca567f7a94f3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:11.735197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4b859c0b-af02-4bad-9e31-73999fabe308 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:11.735390 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-773a8bdb-71d7-46aa-a08b-ca567f7a94f3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248" status: 200 len: 1308 microversion: 2.1 time: 0.461712 Jul 25 14:39:11.736439 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1543/3274] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:11 2022] GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248 => generated 1308 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:39:11.745399 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4b859c0b-af02-4bad-9e31-73999fabe308 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d" status: 200 len: 1322 microversion: 2.1 time: 0.496739 Jul 25 14:39:11.754659 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1732/3275] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:11 2022] GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d => generated 1322 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:12.071892 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2c9f9ea4-f7ac-4718-96be-6d88f31416c6 tempest-VolumesAdminNegativeTest-1903855567 tempest-VolumesAdminNegativeTest-1903855567-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "bfcfd0fe-8361-48fa-8aca-36738fd802a6"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:12.075280 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2c9f9ea4-f7ac-4718-96be-6d88f31416c6 tempest-VolumesAdminNegativeTest-1903855567 tempest-VolumesAdminNegativeTest-1903855567-project-admin] [instance: 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:12.099089 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c9f9ea4-f7ac-4718-96be-6d88f31416c6 tempest-VolumesAdminNegativeTest-1903855567 tempest-VolumesAdminNegativeTest-1903855567-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:12.100031 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c9f9ea4-f7ac-4718-96be-6d88f31416c6 tempest-VolumesAdminNegativeTest-1903855567 tempest-VolumesAdminNegativeTest-1903855567-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:12.104703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c9f9ea4-f7ac-4718-96be-6d88f31416c6 tempest-VolumesAdminNegativeTest-1903855567 tempest-VolumesAdminNegativeTest-1903855567-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:12.105997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c9f9ea4-f7ac-4718-96be-6d88f31416c6 tempest-VolumesAdminNegativeTest-1903855567 tempest-VolumesAdminNegativeTest-1903855567-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:12.187357 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-021df372-0d77-432b-9cbc-0bf71ea2cf77 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:12.188049 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-021df372-0d77-432b-9cbc-0bf71ea2cf77 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:12.198457 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-021df372-0d77-432b-9cbc-0bf71ea2cf77 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:12.201770 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-021df372-0d77-432b-9cbc-0bf71ea2cf77 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:12.206154 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-021df372-0d77-432b-9cbc-0bf71ea2cf77 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:12.206933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-021df372-0d77-432b-9cbc-0bf71ea2cf77 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:12.340163 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-2c9f9ea4-f7ac-4718-96be-6d88f31416c6 tempest-VolumesAdminNegativeTest-1903855567 tempest-VolumesAdminNegativeTest-1903855567-project-admin] HTTP exception thrown: Volume bfcfd0fe-8361-48fa-8aca-36738fd802a6 could not be found. Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2c9f9ea4-f7ac-4718-96be-6d88f31416c6 tempest-VolumesAdminNegativeTest-1903855567 tempest-VolumesAdminNegativeTest-1903855567-project-admin] Request method failure captured: Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: request: PUT /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653/os-volume_attachments/7d80c68f-699c-477e-8b74-d3c4d9812f4d HTTP/1.1 Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 74 Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qp5vnAPE5O5zKmZlCs-_i_x-IlgB-KASgVnnqIZwGcwhTBh54TrmbPYNw7J_lBJ8X0rH0GCfCHWoQHQht-NvETVPsBGpjTVAKhwLrGcsirIAAI5MqHCxFUMEjmYKH0JnGXqmhd055jj_OoR2VRjNFp30AybCUYDK7x1wbmcAmVEugU Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 5eee55df5b3747e3ae585348b0640b3b Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-VolumesAdminNegativeTest-1903855567 Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: X-Role: admin,reader,member Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: admin,reader,member Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5eee55df5b3747e3ae585348b0640b3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5eee55df5b3747e3ae585348b0640b3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_5eee55df5b3747e3ae585348b0640b3b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/5eee55df5b3747e3ae585348b0640b3b"}]}] Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-VolumesAdminNegativeTest-1903855567 Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 5eee55df5b3747e3ae585348b0640b3b Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1903855567 Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-VolumesAdminNegativeTest-1903855567-project-admin Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 982d412c6a3048d48feca4a6928d1d00 Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-VolumesAdminNegativeTest-1903855567-project-admin Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: {"volumeAttachment": {"volumeId": "bfcfd0fe-8361-48fa-8aca-36738fd802a6"}} Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: exception: Volume bfcfd0fe-8361-48fa-8aca-36738fd802a6 could not be found. Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'server_id': '5e1fbfa4-195c-46bb-9a93-9ffd88ecf653', 'id': '7d80c68f-699c-477e-8b74-d3c4d9812f4d', 'body': {'volumeAttachment': {'volumeId': 'bfcfd0fe-8361-48fa-8aca-36738fd802a6'}}} Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bfcfd0fe-8361-48fa-8aca-36738fd802a6 could not be found. (HTTP 404) (Request-ID: req-a1b3b0ea-8f64-45d3-90d3-3674600eddaa) Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 14:39:12.342444 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bfcfd0fe-8361-48fa-8aca-36738fd802a6 could not be found. Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume bfcfd0fe-8361-48fa-8aca-36738fd802a6 could not be found. Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bfcfd0fe-8361-48fa-8aca-36738fd802a6 could not be found. Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:12.347166 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2c9f9ea4-f7ac-4718-96be-6d88f31416c6 tempest-VolumesAdminNegativeTest-1903855567 tempest-VolumesAdminNegativeTest-1903855567-project-admin] Returning 400 to user: Volume bfcfd0fe-8361-48fa-8aca-36738fd802a6 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:39:12.352643 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2c9f9ea4-f7ac-4718-96be-6d88f31416c6 tempest-VolumesAdminNegativeTest-1903855567 tempest-VolumesAdminNegativeTest-1903855567-project-admin] 10.222.0.88 "PUT /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653/os-volume_attachments/7d80c68f-699c-477e-8b74-d3c4d9812f4d" status: 400 len: 107 microversion: 2.1 time: 0.612830 Jul 25 14:39:12.359180 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1544/3276] 10.222.0.88 () {60 vars in 1433 bytes} [Mon Jul 25 14:39:11 2022] PUT /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653/os-volume_attachments/7d80c68f-699c-477e-8b74-d3c4d9812f4d => generated 107 bytes in 619 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:39:12.461494 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-85f98fce-f0d4-4d1e-8479-6f3aa550fed1 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:12.462392 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-85f98fce-f0d4-4d1e-8479-6f3aa550fed1 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:12.470329 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-85f98fce-f0d4-4d1e-8479-6f3aa550fed1 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:12.471135 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-85f98fce-f0d4-4d1e-8479-6f3aa550fed1 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:12.472957 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-85f98fce-f0d4-4d1e-8479-6f3aa550fed1 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:12.473857 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-85f98fce-f0d4-4d1e-8479-6f3aa550fed1 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:12.502375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-021df372-0d77-432b-9cbc-0bf71ea2cf77 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:12.506251 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:39:12.521508 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-021df372-0d77-432b-9cbc-0bf71ea2cf77 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1734 microversion: 2.1 time: 0.337861 Jul 25 14:39:12.525477 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1733/3277] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:12 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1734 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:12.715819 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-85f98fce-f0d4-4d1e-8479-6f3aa550fed1 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lazy-loading 'services' on Instance uuid 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:39:12.757453 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-14a700ec-76c3-4b5c-a050-5bee90199535 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:12.758085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-14a700ec-76c3-4b5c-a050-5bee90199535 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 31135b90-13f0-431a-994f-8af08fbd3248] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:12.765177 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-14a700ec-76c3-4b5c-a050-5bee90199535 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:12.765651 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-14a700ec-76c3-4b5c-a050-5bee90199535 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:12.766699 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-14a700ec-76c3-4b5c-a050-5bee90199535 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:12.767138 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-14a700ec-76c3-4b5c-a050-5bee90199535 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:12.908913 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-85f98fce-f0d4-4d1e-8479-6f3aa550fed1 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "DELETE /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653/os-volume_attachments/7d80c68f-699c-477e-8b74-d3c4d9812f4d" status: 202 len: 0 microversion: 2.1 time: 0.452983 Jul 25 14:39:12.912059 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1545/3278] 10.222.0.88 () {58 vars in 1416 bytes} [Mon Jul 25 14:39:12 2022] DELETE /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653/os-volume_attachments/7d80c68f-699c-477e-8b74-d3c4d9812f4d => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:39:12.931050 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d4139c6c-2a51-4e47-81d4-3e99ce123e32 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:12.932143 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d4139c6c-2a51-4e47-81d4-3e99ce123e32 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: 88b6bb55-179d-42a2-aab1-53aefc8e536d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:12.951311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d4139c6c-2a51-4e47-81d4-3e99ce123e32 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:12.952646 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d4139c6c-2a51-4e47-81d4-3e99ce123e32 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:12.953931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d4139c6c-2a51-4e47-81d4-3e99ce123e32 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:12.957103 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d4139c6c-2a51-4e47-81d4-3e99ce123e32 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:13.249824 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-14a700ec-76c3-4b5c-a050-5bee90199535 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:13.262764 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-14a700ec-76c3-4b5c-a050-5bee90199535 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248" status: 200 len: 1308 microversion: 2.1 time: 0.508634 Jul 25 14:39:13.269067 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1734/3279] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:12 2022] GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248 => generated 1308 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:39:13.275008 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5dc56908-7440-4694-8ea5-210008fbbaa0 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:13.287759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5dc56908-7440-4694-8ea5-210008fbbaa0 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:13.314346 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5dc56908-7440-4694-8ea5-210008fbbaa0 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:13.314951 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5dc56908-7440-4694-8ea5-210008fbbaa0 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:13.315815 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5dc56908-7440-4694-8ea5-210008fbbaa0 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:13.316363 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5dc56908-7440-4694-8ea5-210008fbbaa0 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:13.385046 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5dc56908-7440-4694-8ea5-210008fbbaa0 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114181 Jul 25 14:39:13.394278 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1735/3280] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:39:13 2022] GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:13.543853 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-876335be-35a3-489f-89d2-d36e944799af tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:13.544540 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-876335be-35a3-489f-89d2-d36e944799af tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:13.558092 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-876335be-35a3-489f-89d2-d36e944799af tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:13.558546 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-876335be-35a3-489f-89d2-d36e944799af tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:13.559374 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-876335be-35a3-489f-89d2-d36e944799af tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:13.559799 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-876335be-35a3-489f-89d2-d36e944799af tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:13.900212 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-876335be-35a3-489f-89d2-d36e944799af tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:13.913721 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-876335be-35a3-489f-89d2-d36e944799af tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1734 microversion: 2.1 time: 0.374239 Jul 25 14:39:13.925362 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1736/3281] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:13 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1734 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:14.288825 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5d74482f-9c9e-4f0a-9ccc-e7277c1490e5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:14.289889 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5d74482f-9c9e-4f0a-9ccc-e7277c1490e5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 31135b90-13f0-431a-994f-8af08fbd3248] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:14.299619 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d74482f-9c9e-4f0a-9ccc-e7277c1490e5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:14.304350 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d74482f-9c9e-4f0a-9ccc-e7277c1490e5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:14.305383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d74482f-9c9e-4f0a-9ccc-e7277c1490e5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:14.310686 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d4139c6c-2a51-4e47-81d4-3e99ce123e32 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:14.320450 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d4139c6c-2a51-4e47-81d4-3e99ce123e32 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d" status: 200 len: 1516 microversion: 2.1 time: 1.404090 Jul 25 14:39:14.325757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d74482f-9c9e-4f0a-9ccc-e7277c1490e5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:14.329784 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1546/3282] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:12 2022] GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d => generated 1516 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:14.345285 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-6d29f390-3619-4e6a-a222-8ed251044952 req-c77fc514-43fa-46f9-8a57-87b67e5db537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb07cf02-962c-4ea4-899c-507ace1ee7e9", "name": "network-vif-plugged", "status": "completed", "tag": "b9759118-aad4-4af3-a510-268d572bfde7"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:14.403241 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-6d29f390-3619-4e6a-a222-8ed251044952 req-c77fc514-43fa-46f9-8a57-87b67e5db537 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:14.403604 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-6d29f390-3619-4e6a-a222-8ed251044952 req-c77fc514-43fa-46f9-8a57-87b67e5db537 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:14.462963 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-6d29f390-3619-4e6a-a222-8ed251044952 req-c77fc514-43fa-46f9-8a57-87b67e5db537 service nova] Creating event network-vif-plugged:b9759118-aad4-4af3-a510-268d572bfde7 for instance bb07cf02-962c-4ea4-899c-507ace1ee7e9 on n-h2-846435-14 Jul 25 14:39:14.489329 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-6d29f390-3619-4e6a-a222-8ed251044952 req-c77fc514-43fa-46f9-8a57-87b67e5db537 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144735 Jul 25 14:39:14.495636 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1547/3283] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:14.516943 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6d776bb8-13ee-45d3-8d7c-3c5d047bc2d8 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:14.518289 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6d776bb8-13ee-45d3-8d7c-3c5d047bc2d8 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: 6b535085-b43d-4a2b-84c3-b5768569def2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:14.526782 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6d776bb8-13ee-45d3-8d7c-3c5d047bc2d8 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:14.527766 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6d776bb8-13ee-45d3-8d7c-3c5d047bc2d8 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:14.528836 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6d776bb8-13ee-45d3-8d7c-3c5d047bc2d8 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:14.529423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6d776bb8-13ee-45d3-8d7c-3c5d047bc2d8 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:14.814243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5d74482f-9c9e-4f0a-9ccc-e7277c1490e5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:14.837122 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5d74482f-9c9e-4f0a-9ccc-e7277c1490e5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248" status: 200 len: 1308 microversion: 2.1 time: 0.556073 Jul 25 14:39:14.837743 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1737/3284] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:14 2022] GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248 => generated 1308 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:14.874061 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0906da0e-22c8-4dc7-b0de-c32b5b1373a1 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:14.879273 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0906da0e-22c8-4dc7-b0de-c32b5b1373a1 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:14.889050 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0906da0e-22c8-4dc7-b0de-c32b5b1373a1 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:14.890135 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0906da0e-22c8-4dc7-b0de-c32b5b1373a1 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:14.891294 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0906da0e-22c8-4dc7-b0de-c32b5b1373a1 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:14.891919 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0906da0e-22c8-4dc7-b0de-c32b5b1373a1 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:14.940788 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0906da0e-22c8-4dc7-b0de-c32b5b1373a1 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070923 Jul 25 14:39:14.960566 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1738/3285] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:39:14 2022] GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:14.960566 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1c036448-9aac-4cb6-9937-fb4c53f22fee tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:14.960566 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1c036448-9aac-4cb6-9937-fb4c53f22fee tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:14.981946 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1c036448-9aac-4cb6-9937-fb4c53f22fee tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:14.982398 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1c036448-9aac-4cb6-9937-fb4c53f22fee tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:14.983170 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1c036448-9aac-4cb6-9937-fb4c53f22fee tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:14.983599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1c036448-9aac-4cb6-9937-fb4c53f22fee tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:15.040883 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6d776bb8-13ee-45d3-8d7c-3c5d047bc2d8 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:15.072747 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6d776bb8-13ee-45d3-8d7c-3c5d047bc2d8 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers/6b535085-b43d-4a2b-84c3-b5768569def2" status: 200 len: 1515 microversion: 2.1 time: 0.565346 Jul 25 14:39:15.088931 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1548/3286] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:14 2022] GET /compute/v2.1/servers/6b535085-b43d-4a2b-84c3-b5768569def2 => generated 1515 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:15.101019 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6a1112a6-0e9c-4420-ad0f-49dfc59d67f5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:15.101936 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6a1112a6-0e9c-4420-ad0f-49dfc59d67f5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: bb07cf02-962c-4ea4-899c-507ace1ee7e9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:15.133741 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6a1112a6-0e9c-4420-ad0f-49dfc59d67f5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:15.136580 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6a1112a6-0e9c-4420-ad0f-49dfc59d67f5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:15.137734 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6a1112a6-0e9c-4420-ad0f-49dfc59d67f5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:15.151825 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6a1112a6-0e9c-4420-ad0f-49dfc59d67f5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:15.361284 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1c036448-9aac-4cb6-9937-fb4c53f22fee tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:15.370967 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1c036448-9aac-4cb6-9937-fb4c53f22fee tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1734 microversion: 2.1 time: 0.418475 Jul 25 14:39:15.373192 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1739/3287] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:14 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1734 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:15.381948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-839bbbae-67fd-44bd-9be3-5386b6c110e8 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-940415416", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "8c027b9b-1ec6-4198-802d-00beb5a19ffb"}], "security_groups": [{"name": "tempest-securitygroup--175115209"}], "key_name": "tempest-keypair-1072562794", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:15.595983 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-839bbbae-67fd-44bd-9be3-5386b6c110e8 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] validate_networks() for [('8c027b9b-1ec6-4198-802d-00beb5a19ffb', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:39:15.687439 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6a1112a6-0e9c-4420-ad0f-49dfc59d67f5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:15.698346 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6a1112a6-0e9c-4420-ad0f-49dfc59d67f5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers/bb07cf02-962c-4ea4-899c-507ace1ee7e9" status: 200 len: 1322 microversion: 2.1 time: 0.603856 Jul 25 14:39:15.698959 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1549/3288] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:15 2022] GET /compute/v2.1/servers/bb07cf02-962c-4ea4-899c-507ace1ee7e9 => generated 1322 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:15.724400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-1bea0a18-0a22-4d05-8897-5dd63fff2a93 req-8ac7d0ba-2dc4-43b4-b826-d184568ff966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31135b90-13f0-431a-994f-8af08fbd3248", "tag": "649aaa46-4125-4b47-9e2c-1583d94132a2"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:15.741598 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-1bea0a18-0a22-4d05-8897-5dd63fff2a93 req-8ac7d0ba-2dc4-43b4-b826-d184568ff966 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:15.742065 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-1bea0a18-0a22-4d05-8897-5dd63fff2a93 req-8ac7d0ba-2dc4-43b4-b826-d184568ff966 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:15.768029 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-1bea0a18-0a22-4d05-8897-5dd63fff2a93 req-8ac7d0ba-2dc4-43b4-b826-d184568ff966 service nova] Creating event network-changed:649aaa46-4125-4b47-9e2c-1583d94132a2 for instance 31135b90-13f0-431a-994f-8af08fbd3248 on n-h1-846435-14 Jul 25 14:39:15.775438 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-1bea0a18-0a22-4d05-8897-5dd63fff2a93 req-8ac7d0ba-2dc4-43b4-b826-d184568ff966 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075223 Jul 25 14:39:15.778251 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1550/3289] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:15.863428 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-72d12934-1efe-4648-8491-7316b00ee0c3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:15.864316 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-72d12934-1efe-4648-8491-7316b00ee0c3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 31135b90-13f0-431a-994f-8af08fbd3248] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:15.882995 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-72d12934-1efe-4648-8491-7316b00ee0c3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:15.884463 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-72d12934-1efe-4648-8491-7316b00ee0c3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:15.886248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-72d12934-1efe-4648-8491-7316b00ee0c3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:15.889655 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-72d12934-1efe-4648-8491-7316b00ee0c3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:16.214077 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-72d12934-1efe-4648-8491-7316b00ee0c3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:16.228508 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-72d12934-1efe-4648-8491-7316b00ee0c3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248" status: 200 len: 1308 microversion: 2.1 time: 0.370583 Jul 25 14:39:16.243904 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1551/3290] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:15 2022] GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248 => generated 1308 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:39:16.254994 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b34487d2-04b8-4fa2-a4b0-afacd9329e98 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:16.260698 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b34487d2-04b8-4fa2-a4b0-afacd9329e98 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:16.279281 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b34487d2-04b8-4fa2-a4b0-afacd9329e98 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:16.281251 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b34487d2-04b8-4fa2-a4b0-afacd9329e98 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:16.283266 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b34487d2-04b8-4fa2-a4b0-afacd9329e98 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:16.284986 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b34487d2-04b8-4fa2-a4b0-afacd9329e98 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:16.321289 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-839bbbae-67fd-44bd-9be3-5386b6c110e8 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Getting quotas for project 14292758eb5e482d97001c3ddce034ee. Resources: dict_keys(['metadata_items']) {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:39:16.327153 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-839bbbae-67fd-44bd-9be3-5386b6c110e8 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Getting quotas for user 1b0dcc68e92f4917ad5335e4325b7065 and project 14292758eb5e482d97001c3ddce034ee. Resources: dict_keys(['metadata_items']) {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:39:16.343355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-839bbbae-67fd-44bd-9be3-5386b6c110e8 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:39:16.344125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-839bbbae-67fd-44bd-9be3-5386b6c110e8 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:39:16.344750 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-839bbbae-67fd-44bd-9be3-5386b6c110e8 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:39:16.345327 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-839bbbae-67fd-44bd-9be3-5386b6c110e8 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:39:16.346009 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-839bbbae-67fd-44bd-9be3-5386b6c110e8 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:39:16.357146 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-839bbbae-67fd-44bd-9be3-5386b6c110e8 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:16.357966 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-839bbbae-67fd-44bd-9be3-5386b6c110e8 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:16.359393 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-839bbbae-67fd-44bd-9be3-5386b6c110e8 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:16.360047 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-839bbbae-67fd-44bd-9be3-5386b6c110e8 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:16.386369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-839bbbae-67fd-44bd-9be3-5386b6c110e8 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Getting quotas for project 14292758eb5e482d97001c3ddce034ee. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:39:16.396175 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-839bbbae-67fd-44bd-9be3-5386b6c110e8 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Getting quotas for user 1b0dcc68e92f4917ad5335e4325b7065 and project 14292758eb5e482d97001c3ddce034ee. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:39:16.416462 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-839bbbae-67fd-44bd-9be3-5386b6c110e8 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:39:16.419213 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-839bbbae-67fd-44bd-9be3-5386b6c110e8 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] [instance: c2d5ca5f-5c52-45f7-8d1c-f42144fe8108] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:39:16.480133 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-839bbbae-67fd-44bd-9be3-5386b6c110e8 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.105102 Jul 25 14:39:16.489730 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1740/3291] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:39:15 2022] POST /compute/v2.1/servers => generated 408 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:39:16.736694 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b34487d2-04b8-4fa2-a4b0-afacd9329e98 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.491241 Jul 25 14:39:16.738005 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1552/3292] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:39:16 2022] GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653/os-volume_attachments => generated 197 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:16.742564 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8b606c16-2ad4-4bf7-a531-3a5dcf05fd16 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:16.743314 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8b606c16-2ad4-4bf7-a531-3a5dcf05fd16 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:16.763725 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b606c16-2ad4-4bf7-a531-3a5dcf05fd16 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:16.764230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b606c16-2ad4-4bf7-a531-3a5dcf05fd16 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:16.765069 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b606c16-2ad4-4bf7-a531-3a5dcf05fd16 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:16.765546 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b606c16-2ad4-4bf7-a531-3a5dcf05fd16 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:16.978327 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-89dbe503-2d9f-4d00-bae6-ed74d5a577fc tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1952600476", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:17.063509 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8b606c16-2ad4-4bf7-a531-3a5dcf05fd16 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:17.073861 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8b606c16-2ad4-4bf7-a531-3a5dcf05fd16 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1734 microversion: 2.1 time: 0.335093 Jul 25 14:39:17.074499 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-89dbe503-2d9f-4d00-bae6-ed74d5a577fc tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] validate_networks() for None {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:39:17.075620 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1553/3293] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:16 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1734 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:17.080819 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-979d3800-32fb-4018-a361-4879fd16b2b0 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:17.081712 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-979d3800-32fb-4018-a361-4879fd16b2b0 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] [instance: c2d5ca5f-5c52-45f7-8d1c-f42144fe8108] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:17.092536 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:39:17.196122 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-979d3800-32fb-4018-a361-4879fd16b2b0 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0dcc68e92f4917ad5335e4325b7065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14292758eb5e482d97001c3ddce034ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:17.207720 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-979d3800-32fb-4018-a361-4879fd16b2b0 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] 10.222.0.88 "GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108" status: 200 len: 1277 microversion: 2.1 time: 0.129527 Jul 25 14:39:17.209486 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1554/3294] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:17 2022] GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108 => generated 1277 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:17.229826 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b1e1375a-72a7-4172-929b-abbb6c87449f tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:17.230720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b1e1375a-72a7-4172-929b-abbb6c87449f tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: bb07cf02-962c-4ea4-899c-507ace1ee7e9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:17.243627 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b1e1375a-72a7-4172-929b-abbb6c87449f tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:17.244751 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b1e1375a-72a7-4172-929b-abbb6c87449f tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:17.245854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b1e1375a-72a7-4172-929b-abbb6c87449f tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:17.247539 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b1e1375a-72a7-4172-929b-abbb6c87449f tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:17.391589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-89dbe503-2d9f-4d00-bae6-ed74d5a577fc tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:39:17.392752 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-89dbe503-2d9f-4d00-bae6-ed74d5a577fc tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:39:17.393577 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-89dbe503-2d9f-4d00-bae6-ed74d5a577fc tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:39:17.394245 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-89dbe503-2d9f-4d00-bae6-ed74d5a577fc tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:39:17.394932 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-89dbe503-2d9f-4d00-bae6-ed74d5a577fc tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:39:17.404817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-89dbe503-2d9f-4d00-bae6-ed74d5a577fc tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:17.405455 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-89dbe503-2d9f-4d00-bae6-ed74d5a577fc tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:17.406431 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-89dbe503-2d9f-4d00-bae6-ed74d5a577fc tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:17.407041 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-89dbe503-2d9f-4d00-bae6-ed74d5a577fc tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:17.430776 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-89dbe503-2d9f-4d00-bae6-ed74d5a577fc tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Getting quotas for project a9bf5a16e97944d9861d93405209cc37. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:39:17.441342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-89dbe503-2d9f-4d00-bae6-ed74d5a577fc tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Getting quotas for user 7416803295914693a3e077649db2b47b and project a9bf5a16e97944d9861d93405209cc37. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:39:17.459549 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-89dbe503-2d9f-4d00-bae6-ed74d5a577fc tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:39:17.465647 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-89dbe503-2d9f-4d00-bae6-ed74d5a577fc tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] [instance: a398b318-1a36-4299-9be1-40a69485198b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:39:17.525019 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b1e1375a-72a7-4172-929b-abbb6c87449f tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:17.537327 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b1e1375a-72a7-4172-929b-abbb6c87449f tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers/bb07cf02-962c-4ea4-899c-507ace1ee7e9" status: 200 len: 1516 microversion: 2.1 time: 0.326094 Jul 25 14:39:17.539499 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1555/3295] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:17 2022] GET /compute/v2.1/servers/bb07cf02-962c-4ea4-899c-507ace1ee7e9 => generated 1516 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:17.551180 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-19f5de83-f4b8-40aa-94e4-1685e648aec3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:17.552870 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-19f5de83-f4b8-40aa-94e4-1685e648aec3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 31135b90-13f0-431a-994f-8af08fbd3248] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:17.561949 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-19f5de83-f4b8-40aa-94e4-1685e648aec3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:17.562965 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-19f5de83-f4b8-40aa-94e4-1685e648aec3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:17.564630 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-19f5de83-f4b8-40aa-94e4-1685e648aec3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:17.566060 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-19f5de83-f4b8-40aa-94e4-1685e648aec3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:17.566341 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-89dbe503-2d9f-4d00-bae6-ed74d5a577fc tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.067127 Jul 25 14:39:17.567398 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1741/3296] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:39:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:39:17.596590 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-11775011-255f-4e8a-9960-846b35846412 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:17.597406 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-11775011-255f-4e8a-9960-846b35846412 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: bb07cf02-962c-4ea4-899c-507ace1ee7e9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:17.621983 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11775011-255f-4e8a-9960-846b35846412 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:17.622439 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11775011-255f-4e8a-9960-846b35846412 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:17.623225 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11775011-255f-4e8a-9960-846b35846412 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:17.623656 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11775011-255f-4e8a-9960-846b35846412 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:17.659352 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-11775011-255f-4e8a-9960-846b35846412 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: bb07cf02-962c-4ea4-899c-507ace1ee7e9] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:39:17.839526 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-11775011-255f-4e8a-9960-846b35846412 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "DELETE /compute/v2.1/servers/bb07cf02-962c-4ea4-899c-507ace1ee7e9" status: 204 len: 0 microversion: 2.1 time: 0.261685 Jul 25 14:39:17.840817 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1742/3297] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:39:17 2022] DELETE /compute/v2.1/servers/bb07cf02-962c-4ea4-899c-507ace1ee7e9 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:39:17.856558 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-682e427e-4541-4ea6-bd0e-9549a69098fd tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:17.858655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-682e427e-4541-4ea6-bd0e-9549a69098fd tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] [instance: a398b318-1a36-4299-9be1-40a69485198b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:17.949041 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-19f5de83-f4b8-40aa-94e4-1685e648aec3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:17.972634 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:39:17.984311 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-19f5de83-f4b8-40aa-94e4-1685e648aec3 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248" status: 200 len: 1308 microversion: 2.1 time: 0.439123 Jul 25 14:39:17.985568 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1556/3298] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:17 2022] GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248 => generated 1308 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:18.001450 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-efc48993-f1ec-476c-98cb-4ce61c71e6eb tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:18.006781 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-efc48993-f1ec-476c-98cb-4ce61c71e6eb tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:18.021771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-efc48993-f1ec-476c-98cb-4ce61c71e6eb tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:18.022231 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-efc48993-f1ec-476c-98cb-4ce61c71e6eb tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:18.023090 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-efc48993-f1ec-476c-98cb-4ce61c71e6eb tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:18.023614 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-682e427e-4541-4ea6-bd0e-9549a69098fd tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7416803295914693a3e077649db2b47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf5a16e97944d9861d93405209cc37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:18.026616 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-efc48993-f1ec-476c-98cb-4ce61c71e6eb tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:18.041984 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-682e427e-4541-4ea6-bd0e-9549a69098fd tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] 10.222.0.88 "GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b" status: 200 len: 1223 microversion: 2.1 time: 0.195809 Jul 25 14:39:18.044575 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1743/3299] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:17 2022] GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b => generated 1223 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:18.065374 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e7c13ac4-a082-48ef-8b99-7ca22ca9011b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:18.067404 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e7c13ac4-a082-48ef-8b99-7ca22ca9011b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: bb07cf02-962c-4ea4-899c-507ace1ee7e9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:18.090643 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e7c13ac4-a082-48ef-8b99-7ca22ca9011b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:18.092957 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e7c13ac4-a082-48ef-8b99-7ca22ca9011b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:18.095885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e7c13ac4-a082-48ef-8b99-7ca22ca9011b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:18.098247 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e7c13ac4-a082-48ef-8b99-7ca22ca9011b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:18.125023 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-efc48993-f1ec-476c-98cb-4ce61c71e6eb tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137356 Jul 25 14:39:18.125930 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1557/3300] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:39:17 2022] GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:18.142616 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fd3433af-ba4d-4bbf-82cf-98f06f4b1ff0 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:18.143256 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fd3433af-ba4d-4bbf-82cf-98f06f4b1ff0 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:18.165811 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fd3433af-ba4d-4bbf-82cf-98f06f4b1ff0 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:18.166729 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fd3433af-ba4d-4bbf-82cf-98f06f4b1ff0 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:18.168618 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fd3433af-ba4d-4bbf-82cf-98f06f4b1ff0 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:18.171186 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fd3433af-ba4d-4bbf-82cf-98f06f4b1ff0 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:18.547837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fd3433af-ba4d-4bbf-82cf-98f06f4b1ff0 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:18.559717 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fd3433af-ba4d-4bbf-82cf-98f06f4b1ff0 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1734 microversion: 2.1 time: 0.428729 Jul 25 14:39:18.560958 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1558/3301] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:18 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1734 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:18.566454 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c85e3fff-9f38-4b76-a3aa-43a5f80cb435 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:18.567350 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c85e3fff-9f38-4b76-a3aa-43a5f80cb435 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] [instance: c2d5ca5f-5c52-45f7-8d1c-f42144fe8108] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:18.575829 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c85e3fff-9f38-4b76-a3aa-43a5f80cb435 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:18.576640 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c85e3fff-9f38-4b76-a3aa-43a5f80cb435 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:18.577669 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c85e3fff-9f38-4b76-a3aa-43a5f80cb435 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:18.579714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c85e3fff-9f38-4b76-a3aa-43a5f80cb435 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:18.631036 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e7c13ac4-a082-48ef-8b99-7ca22ca9011b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:18.643486 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e7c13ac4-a082-48ef-8b99-7ca22ca9011b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers/bb07cf02-962c-4ea4-899c-507ace1ee7e9" status: 200 len: 1522 microversion: 2.1 time: 0.596859 Jul 25 14:39:18.652389 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1744/3302] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:18 2022] GET /compute/v2.1/servers/bb07cf02-962c-4ea4-899c-507ace1ee7e9 => generated 1522 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:18.671029 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c85e3fff-9f38-4b76-a3aa-43a5f80cb435 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0dcc68e92f4917ad5335e4325b7065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14292758eb5e482d97001c3ddce034ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:18.683601 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c85e3fff-9f38-4b76-a3aa-43a5f80cb435 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] 10.222.0.88 "GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108" status: 200 len: 1335 microversion: 2.1 time: 0.121258 Jul 25 14:39:18.684361 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1559/3303] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:18 2022] GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108 => generated 1335 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:19.007032 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-91b93107-c6c0-4eb9-b208-4b82d6ca808f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:19.007860 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-91b93107-c6c0-4eb9-b208-4b82d6ca808f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 31135b90-13f0-431a-994f-8af08fbd3248] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:19.014345 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-91b93107-c6c0-4eb9-b208-4b82d6ca808f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:19.014913 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-91b93107-c6c0-4eb9-b208-4b82d6ca808f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:19.015731 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-91b93107-c6c0-4eb9-b208-4b82d6ca808f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:19.017061 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-91b93107-c6c0-4eb9-b208-4b82d6ca808f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:19.065383 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8b57a213-3baa-4502-9603-b8364c635574 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:19.066519 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8b57a213-3baa-4502-9603-b8364c635574 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] [instance: a398b318-1a36-4299-9be1-40a69485198b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:19.074537 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b57a213-3baa-4502-9603-b8364c635574 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:19.088203 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b57a213-3baa-4502-9603-b8364c635574 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:19.089530 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b57a213-3baa-4502-9603-b8364c635574 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:19.090143 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b57a213-3baa-4502-9603-b8364c635574 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:19.220524 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8b57a213-3baa-4502-9603-b8364c635574 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7416803295914693a3e077649db2b47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf5a16e97944d9861d93405209cc37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:19.237916 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8b57a213-3baa-4502-9603-b8364c635574 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] 10.222.0.88 "GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b" status: 200 len: 1219 microversion: 2.1 time: 0.174165 Jul 25 14:39:19.252017 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1560/3304] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:19 2022] GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b => generated 1219 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:39:19.252017 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-20970b1f-390e-4cb8-92c5-86c58d73f969 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:19.260779 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-20970b1f-390e-4cb8-92c5-86c58d73f969 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:19.276252 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-20970b1f-390e-4cb8-92c5-86c58d73f969 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:19.277307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-20970b1f-390e-4cb8-92c5-86c58d73f969 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:19.277954 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-20970b1f-390e-4cb8-92c5-86c58d73f969 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:19.280134 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-20970b1f-390e-4cb8-92c5-86c58d73f969 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:19.342977 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-20970b1f-390e-4cb8-92c5-86c58d73f969 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101990 Jul 25 14:39:19.344517 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1561/3305] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:39:19 2022] GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:19.491279 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-91b93107-c6c0-4eb9-b208-4b82d6ca808f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:19.509683 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-91b93107-c6c0-4eb9-b208-4b82d6ca808f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248" status: 200 len: 1308 microversion: 2.1 time: 0.506071 Jul 25 14:39:19.512254 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1745/3306] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:19 2022] GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248 => generated 1308 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:19.581645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7fd381df-2ef4-41bc-88a7-97e935b1251d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:19.582910 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7fd381df-2ef4-41bc-88a7-97e935b1251d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:19.594009 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7fd381df-2ef4-41bc-88a7-97e935b1251d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:19.599290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7fd381df-2ef4-41bc-88a7-97e935b1251d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:19.600980 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7fd381df-2ef4-41bc-88a7-97e935b1251d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:19.605197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7fd381df-2ef4-41bc-88a7-97e935b1251d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:19.962174 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ffa67d43-a1d6-4e8f-abb4-9759cfef83bd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:19.962919 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ffa67d43-a1d6-4e8f-abb4-9759cfef83bd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:20.002379 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ffa67d43-a1d6-4e8f-abb4-9759cfef83bd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:20.005217 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ffa67d43-a1d6-4e8f-abb4-9759cfef83bd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:20.007258 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ffa67d43-a1d6-4e8f-abb4-9759cfef83bd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:20.020208 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ffa67d43-a1d6-4e8f-abb4-9759cfef83bd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:20.076856 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ffa67d43-a1d6-4e8f-abb4-9759cfef83bd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60/os-volume_attachments/e666a0de-19e5-43bb-a164-8505bb01e92e" status: 200 len: 194 microversion: 2.20 time: 0.511941 Jul 25 14:39:20.080379 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1562/3307] 10.222.0.88 () {60 vars in 1454 bytes} [Mon Jul 25 14:39:19 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60/os-volume_attachments/e666a0de-19e5-43bb-a164-8505bb01e92e => generated 194 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:39:20.087507 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-68a8542e-f6a1-4238-8725-4ce840d1b2b9 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:20.088166 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-68a8542e-f6a1-4238-8725-4ce840d1b2b9 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: bb07cf02-962c-4ea4-899c-507ace1ee7e9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:20.096381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-68a8542e-f6a1-4238-8725-4ce840d1b2b9 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:20.097229 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-68a8542e-f6a1-4238-8725-4ce840d1b2b9 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:20.098798 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-68a8542e-f6a1-4238-8725-4ce840d1b2b9 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:20.099541 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-68a8542e-f6a1-4238-8725-4ce840d1b2b9 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:20.224567 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7fd381df-2ef4-41bc-88a7-97e935b1251d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:20.237797 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7fd381df-2ef4-41bc-88a7-97e935b1251d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1734 microversion: 2.1 time: 0.660255 Jul 25 14:39:20.277968 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1746/3308] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:19 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1734 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:39:20.288773 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2a850ddd-2c91-4ba8-88a2-76a421a7f214 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:20.292967 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2a850ddd-2c91-4ba8-88a2-76a421a7f214 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] [instance: c2d5ca5f-5c52-45f7-8d1c-f42144fe8108] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:20.309162 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2a850ddd-2c91-4ba8-88a2-76a421a7f214 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:20.310132 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2a850ddd-2c91-4ba8-88a2-76a421a7f214 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:20.311311 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2a850ddd-2c91-4ba8-88a2-76a421a7f214 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:20.312020 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2a850ddd-2c91-4ba8-88a2-76a421a7f214 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:20.443388 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-68a8542e-f6a1-4238-8725-4ce840d1b2b9 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:20.453029 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-68a8542e-f6a1-4238-8725-4ce840d1b2b9 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers/bb07cf02-962c-4ea4-899c-507ace1ee7e9" status: 200 len: 1522 microversion: 2.1 time: 0.371529 Jul 25 14:39:20.458614 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1563/3309] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:20 2022] GET /compute/v2.1/servers/bb07cf02-962c-4ea4-899c-507ace1ee7e9 => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:20.466596 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-75ab070e-bb7b-48bb-ab8c-46a946be4337 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:20.467327 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-75ab070e-bb7b-48bb-ab8c-46a946be4337 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:20.479944 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-75ab070e-bb7b-48bb-ab8c-46a946be4337 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:20.481340 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-75ab070e-bb7b-48bb-ab8c-46a946be4337 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:20.491409 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-75ab070e-bb7b-48bb-ab8c-46a946be4337 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:20.492248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-75ab070e-bb7b-48bb-ab8c-46a946be4337 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:20.688021 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-75ab070e-bb7b-48bb-ab8c-46a946be4337 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lazy-loading 'services' on Instance uuid f1009be4-53ff-4893-836c-ba96f07a0d60 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:39:20.744012 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2a850ddd-2c91-4ba8-88a2-76a421a7f214 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0dcc68e92f4917ad5335e4325b7065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14292758eb5e482d97001c3ddce034ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:20.752967 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2a850ddd-2c91-4ba8-88a2-76a421a7f214 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] 10.222.0.88 "GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108" status: 200 len: 1402 microversion: 2.1 time: 0.473565 Jul 25 14:39:20.756833 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1747/3310] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:20 2022] GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108 => generated 1402 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:20.777017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b84bb4e8-97fc-4c9e-b28b-e2c4cbfe03f9 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:20.777840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b84bb4e8-97fc-4c9e-b28b-e2c4cbfe03f9 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] [instance: a398b318-1a36-4299-9be1-40a69485198b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:20.792877 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b84bb4e8-97fc-4c9e-b28b-e2c4cbfe03f9 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:20.793331 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b84bb4e8-97fc-4c9e-b28b-e2c4cbfe03f9 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:20.794103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b84bb4e8-97fc-4c9e-b28b-e2c4cbfe03f9 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:20.794546 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b84bb4e8-97fc-4c9e-b28b-e2c4cbfe03f9 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:20.924061 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-75ab070e-bb7b-48bb-ab8c-46a946be4337 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "DELETE /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60/os-volume_attachments/e666a0de-19e5-43bb-a164-8505bb01e92e" status: 202 len: 0 microversion: 2.20 time: 0.455665 Jul 25 14:39:20.928773 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1564/3311] 10.222.0.88 () {60 vars in 1457 bytes} [Mon Jul 25 14:39:20 2022] DELETE /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60/os-volume_attachments/e666a0de-19e5-43bb-a164-8505bb01e92e => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:39:20.942280 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-24e1e0e8-4419-4835-b41a-9145aee51b44 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:20.942280 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-24e1e0e8-4419-4835-b41a-9145aee51b44 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:20.964358 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-24e1e0e8-4419-4835-b41a-9145aee51b44 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:20.969797 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-24e1e0e8-4419-4835-b41a-9145aee51b44 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:20.973859 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-24e1e0e8-4419-4835-b41a-9145aee51b44 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:20.975058 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-24e1e0e8-4419-4835-b41a-9145aee51b44 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:21.081760 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-24e1e0e8-4419-4835-b41a-9145aee51b44 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.151475 Jul 25 14:39:21.082721 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1565/3312] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:39:20 2022] GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653/os-volume_attachments => generated 25 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:39:21.093001 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-75003365-4137-4561-abba-e36ab31ca655 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:21.093704 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-75003365-4137-4561-abba-e36ab31ca655 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 31135b90-13f0-431a-994f-8af08fbd3248] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:21.099308 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b84bb4e8-97fc-4c9e-b28b-e2c4cbfe03f9 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7416803295914693a3e077649db2b47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf5a16e97944d9861d93405209cc37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:21.113011 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b84bb4e8-97fc-4c9e-b28b-e2c4cbfe03f9 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] 10.222.0.88 "GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b" status: 200 len: 1281 microversion: 2.1 time: 0.353819 Jul 25 14:39:21.113679 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1748/3313] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:20 2022] GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b => generated 1281 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:21.127100 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-405e3c3e-d60d-4e90-becb-9757b7c0ebe9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:21.128393 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-75003365-4137-4561-abba-e36ab31ca655 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:21.128895 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-75003365-4137-4561-abba-e36ab31ca655 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:21.129753 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-75003365-4137-4561-abba-e36ab31ca655 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:21.130246 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-75003365-4137-4561-abba-e36ab31ca655 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:21.145526 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-405e3c3e-d60d-4e90-becb-9757b7c0ebe9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:21.178109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-405e3c3e-d60d-4e90-becb-9757b7c0ebe9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:21.178624 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-405e3c3e-d60d-4e90-becb-9757b7c0ebe9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:21.179450 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-405e3c3e-d60d-4e90-becb-9757b7c0ebe9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:21.179881 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-405e3c3e-d60d-4e90-becb-9757b7c0ebe9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:21.298605 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-405e3c3e-d60d-4e90-becb-9757b7c0ebe9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.183670 Jul 25 14:39:21.304488 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1749/3314] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Jul 25 14:39:21 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:39:21.314513 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-d0ea65f2-d117-49d4-8d3c-f4f6df7c4540 req-0604cab2-7ea2-4a5a-81ae-2d602b703f2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb07cf02-962c-4ea4-899c-507ace1ee7e9", "name": "network-vif-deleted", "tag": "b9759118-aad4-4af3-a510-268d572bfde7"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:21.339738 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-d0ea65f2-d117-49d4-8d3c-f4f6df7c4540 req-0604cab2-7ea2-4a5a-81ae-2d602b703f2b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:21.340136 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-d0ea65f2-d117-49d4-8d3c-f4f6df7c4540 req-0604cab2-7ea2-4a5a-81ae-2d602b703f2b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:21.370664 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-d0ea65f2-d117-49d4-8d3c-f4f6df7c4540 req-0604cab2-7ea2-4a5a-81ae-2d602b703f2b service nova] Creating event network-vif-deleted:b9759118-aad4-4af3-a510-268d572bfde7 for instance bb07cf02-962c-4ea4-899c-507ace1ee7e9 on n-h2-846435-14 Jul 25 14:39:21.383541 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-d0ea65f2-d117-49d4-8d3c-f4f6df7c4540 req-0604cab2-7ea2-4a5a-81ae-2d602b703f2b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077677 Jul 25 14:39:21.391899 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1750/3315] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:21.404336 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fa661f73-baec-4360-ab09-e01d054acced tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:21.405016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fa661f73-baec-4360-ab09-e01d054acced tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:21.434086 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fa661f73-baec-4360-ab09-e01d054acced tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:21.434540 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fa661f73-baec-4360-ab09-e01d054acced tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:21.440234 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fa661f73-baec-4360-ab09-e01d054acced tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:21.440875 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fa661f73-baec-4360-ab09-e01d054acced tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:21.656406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-75003365-4137-4561-abba-e36ab31ca655 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:21.665063 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-75003365-4137-4561-abba-e36ab31ca655 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248" status: 200 len: 1308 microversion: 2.1 time: 0.576330 Jul 25 14:39:21.666614 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1566/3316] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:21 2022] GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248 => generated 1308 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:21.690269 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9f33ee5f-ba89-4cc0-9267-6d4afff0cdd3 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1505942263", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "bd1ac2fa-6cf0-462f-b14e-cb642566d402"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:21.716424 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fa661f73-baec-4360-ab09-e01d054acced tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:21.720753 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:39:21.741552 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fa661f73-baec-4360-ab09-e01d054acced tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1734 microversion: 2.1 time: 0.347972 Jul 25 14:39:21.743471 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1751/3317] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:21 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1734 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:21.756076 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3d0ff65b-bbe2-4955-b811-ce914f8ecd72 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:21.756795 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3d0ff65b-bbe2-4955-b811-ce914f8ecd72 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: bb07cf02-962c-4ea4-899c-507ace1ee7e9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:21.779138 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3d0ff65b-bbe2-4955-b811-ce914f8ecd72 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:21.779596 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3d0ff65b-bbe2-4955-b811-ce914f8ecd72 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:21.780426 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3d0ff65b-bbe2-4955-b811-ce914f8ecd72 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:21.780877 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3d0ff65b-bbe2-4955-b811-ce914f8ecd72 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:21.791816 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-9f33ee5f-ba89-4cc0-9267-6d4afff0cdd3 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] validate_networks() for [('bd1ac2fa-6cf0-462f-b14e-cb642566d402', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:39:21.903574 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3d0ff65b-bbe2-4955-b811-ce914f8ecd72 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:21.904603 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3d0ff65b-bbe2-4955-b811-ce914f8ecd72 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:21.905609 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-3d0ff65b-bbe2-4955-b811-ce914f8ecd72 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lazy-loading 'fault' on Instance uuid bb07cf02-962c-4ea4-899c-507ace1ee7e9 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:39:22.030726 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3d0ff65b-bbe2-4955-b811-ce914f8ecd72 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:22.048002 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3d0ff65b-bbe2-4955-b811-ce914f8ecd72 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers/bb07cf02-962c-4ea4-899c-507ace1ee7e9" status: 200 len: 1312 microversion: 2.1 time: 0.303313 Jul 25 14:39:22.068962 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1752/3318] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:21 2022] GET /compute/v2.1/servers/bb07cf02-962c-4ea4-899c-507ace1ee7e9 => generated 1312 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:22.083429 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-31b58300-682b-4647-9346-a4a96faec1a9 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:22.085741 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-31b58300-682b-4647-9346-a4a96faec1a9 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] [instance: c2d5ca5f-5c52-45f7-8d1c-f42144fe8108] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:22.099641 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-31b58300-682b-4647-9346-a4a96faec1a9 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:22.100614 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-31b58300-682b-4647-9346-a4a96faec1a9 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:22.102874 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-31b58300-682b-4647-9346-a4a96faec1a9 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:22.103878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-31b58300-682b-4647-9346-a4a96faec1a9 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:22.530610 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-31b58300-682b-4647-9346-a4a96faec1a9 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0dcc68e92f4917ad5335e4325b7065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14292758eb5e482d97001c3ddce034ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:22.543647 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-31b58300-682b-4647-9346-a4a96faec1a9 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] 10.222.0.88 "GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108" status: 200 len: 1402 microversion: 2.1 time: 0.472406 Jul 25 14:39:22.563850 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1753/3319] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:22 2022] GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108 => generated 1402 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:22.573001 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fd16ca5c-812b-4b4a-8e70-c0ff15446566 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:22.573655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fd16ca5c-812b-4b4a-8e70-c0ff15446566 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] [instance: a398b318-1a36-4299-9be1-40a69485198b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:22.591157 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fd16ca5c-812b-4b4a-8e70-c0ff15446566 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:22.591647 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fd16ca5c-812b-4b4a-8e70-c0ff15446566 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:22.592516 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fd16ca5c-812b-4b4a-8e70-c0ff15446566 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:22.592958 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fd16ca5c-812b-4b4a-8e70-c0ff15446566 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:22.986673 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-9f33ee5f-ba89-4cc0-9267-6d4afff0cdd3 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:39:22.987218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-9f33ee5f-ba89-4cc0-9267-6d4afff0cdd3 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:39:22.989266 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-9f33ee5f-ba89-4cc0-9267-6d4afff0cdd3 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:39:22.989638 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-9f33ee5f-ba89-4cc0-9267-6d4afff0cdd3 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:39:22.990081 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-9f33ee5f-ba89-4cc0-9267-6d4afff0cdd3 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:39:23.006180 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f33ee5f-ba89-4cc0-9267-6d4afff0cdd3 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:23.007504 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f33ee5f-ba89-4cc0-9267-6d4afff0cdd3 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:23.008757 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f33ee5f-ba89-4cc0-9267-6d4afff0cdd3 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:23.011352 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f33ee5f-ba89-4cc0-9267-6d4afff0cdd3 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:23.036879 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-9f33ee5f-ba89-4cc0-9267-6d4afff0cdd3 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Getting quotas for project 5771bc6c546646b5a432a114f76d373d. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:39:23.046069 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-9f33ee5f-ba89-4cc0-9267-6d4afff0cdd3 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Getting quotas for user a1a720adc1b3443a8062b3eb8c7df11c and project 5771bc6c546646b5a432a114f76d373d. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:39:23.066963 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9f33ee5f-ba89-4cc0-9267-6d4afff0cdd3 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:39:23.071988 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9f33ee5f-ba89-4cc0-9267-6d4afff0cdd3 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: d31c05d7-3525-4ad4-9eb0-5ed163707f58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:39:23.152681 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9f33ee5f-ba89-4cc0-9267-6d4afff0cdd3 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.473539 Jul 25 14:39:23.160084 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1567/3320] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:39:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:39:23.177779 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-db06f4e5-b50c-4f66-a9de-552b337ce9d1 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:23.191835 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-db06f4e5-b50c-4f66-a9de-552b337ce9d1 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:23.210466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-db06f4e5-b50c-4f66-a9de-552b337ce9d1 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:23.211269 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-db06f4e5-b50c-4f66-a9de-552b337ce9d1 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:23.212724 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-db06f4e5-b50c-4f66-a9de-552b337ce9d1 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:23.213444 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-db06f4e5-b50c-4f66-a9de-552b337ce9d1 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:23.331453 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-db06f4e5-b50c-4f66-a9de-552b337ce9d1 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.167110 Jul 25 14:39:23.334081 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1568/3321] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Jul 25 14:39:23 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:39:23.341507 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-1a5519a4-dd8c-47a4-b457-e761ea5dce6c req-7c55104b-e12d-4730-b505-b6ac47a2830a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31135b90-13f0-431a-994f-8af08fbd3248", "name": "network-vif-plugged", "status": "completed", "tag": "649aaa46-4125-4b47-9e2c-1583d94132a2"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:23.371320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-1a5519a4-dd8c-47a4-b457-e761ea5dce6c req-7c55104b-e12d-4730-b505-b6ac47a2830a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:23.373202 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-1a5519a4-dd8c-47a4-b457-e761ea5dce6c req-7c55104b-e12d-4730-b505-b6ac47a2830a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:23.391329 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-1a5519a4-dd8c-47a4-b457-e761ea5dce6c req-7c55104b-e12d-4730-b505-b6ac47a2830a service nova] Creating event network-vif-plugged:649aaa46-4125-4b47-9e2c-1583d94132a2 for instance 31135b90-13f0-431a-994f-8af08fbd3248 on n-h1-846435-14 Jul 25 14:39:23.400431 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-1a5519a4-dd8c-47a4-b457-e761ea5dce6c req-7c55104b-e12d-4730-b505-b6ac47a2830a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063951 Jul 25 14:39:23.401543 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1569/3322] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:23.417575 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b9131345-793c-4c85-9858-62e00baf5f72 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:23.420648 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b9131345-793c-4c85-9858-62e00baf5f72 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 31135b90-13f0-431a-994f-8af08fbd3248] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:23.443393 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b9131345-793c-4c85-9858-62e00baf5f72 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:23.448345 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fd16ca5c-812b-4b4a-8e70-c0ff15446566 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7416803295914693a3e077649db2b47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf5a16e97944d9861d93405209cc37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:23.453890 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b9131345-793c-4c85-9858-62e00baf5f72 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:23.454997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b9131345-793c-4c85-9858-62e00baf5f72 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:23.455551 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b9131345-793c-4c85-9858-62e00baf5f72 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:23.461365 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fd16ca5c-812b-4b4a-8e70-c0ff15446566 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] 10.222.0.88 "GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b" status: 200 len: 1323 microversion: 2.1 time: 0.896100 Jul 25 14:39:23.466241 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1754/3323] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:22 2022] GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b => generated 1323 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:23.471508 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-78c6f255-5c18-48be-ba90-87f5f08bbe1e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:23.472156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-78c6f255-5c18-48be-ba90-87f5f08bbe1e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:23.507779 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-78c6f255-5c18-48be-ba90-87f5f08bbe1e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:23.508526 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-78c6f255-5c18-48be-ba90-87f5f08bbe1e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:23.509461 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-78c6f255-5c18-48be-ba90-87f5f08bbe1e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:23.509915 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-78c6f255-5c18-48be-ba90-87f5f08bbe1e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:23.970671 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-78c6f255-5c18-48be-ba90-87f5f08bbe1e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:24.002836 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-78c6f255-5c18-48be-ba90-87f5f08bbe1e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1734 microversion: 2.1 time: 0.535039 Jul 25 14:39:24.016147 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1755/3324] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:23 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1734 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:24.026635 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fa78d8d1-086a-4d6a-8a84-1f4276924ab0 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:24.027261 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fa78d8d1-086a-4d6a-8a84-1f4276924ab0 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: bb07cf02-962c-4ea4-899c-507ace1ee7e9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:24.034704 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:39:24.037270 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fa78d8d1-086a-4d6a-8a84-1f4276924ab0 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:24.037976 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fa78d8d1-086a-4d6a-8a84-1f4276924ab0 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:24.039176 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fa78d8d1-086a-4d6a-8a84-1f4276924ab0 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:24.039820 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fa78d8d1-086a-4d6a-8a84-1f4276924ab0 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:24.058442 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-fa78d8d1-086a-4d6a-8a84-1f4276924ab0 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] HTTP exception thrown: Instance bb07cf02-962c-4ea4-899c-507ace1ee7e9 could not be found. Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fa78d8d1-086a-4d6a-8a84-1f4276924ab0 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Request method failure captured: Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/bb07cf02-962c-4ea4-899c-507ace1ee7e9 HTTP/1.1 Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qr3b99SUhrrqSW3L1qFyB1tMv30VatZZSlc903gsEkYjhIZrUJnWbb_jQ9ggeaRuCB77ytz9bfQvNo4TjPG5KMX9JNTxRo2kuoAX9f8ysNoiHZYAZ6rTbf6AsbQxYhkeqvmyiYofGeyQXkDQ4mXmPZsWZDv3TPE3NhY7_lEGt8BP90 Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 68dee301e8c24a98abef98fc0617bc96 Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ListServersNegativeTestJSON-1989822960 Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/68dee301e8c24a98abef98fc0617bc96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/68dee301e8c24a98abef98fc0617bc96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_68dee301e8c24a98abef98fc0617bc96", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/68dee301e8c24a98abef98fc0617bc96"}]}] Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ListServersNegativeTestJSON-1989822960 Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 68dee301e8c24a98abef98fc0617bc96 Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1989822960 Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ListServersNegativeTestJSON-1989822960-project Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 1cfa029cfa58426da97a2d0857dabf78 Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ListServersNegativeTestJSON-1989822960-project Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance bb07cf02-962c-4ea4-899c-507ace1ee7e9 could not be found. Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'bb07cf02-962c-4ea4-899c-507ace1ee7e9'} Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb07cf02-962c-4ea4-899c-507ace1ee7e9 could not be found. Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb07cf02-962c-4ea4-899c-507ace1ee7e9 could not be found. Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:24.060587 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:24.067701 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:24.067701 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:24.067701 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:24.067701 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:39:24.067701 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:39:24.067701 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb07cf02-962c-4ea4-899c-507ace1ee7e9 could not be found. Jul 25 14:39:24.067701 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:24.067701 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fa78d8d1-086a-4d6a-8a84-1f4276924ab0 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Returning 404 to user: Instance bb07cf02-962c-4ea4-899c-507ace1ee7e9 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:39:24.067701 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fa78d8d1-086a-4d6a-8a84-1f4276924ab0 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers/bb07cf02-962c-4ea4-899c-507ace1ee7e9" status: 404 len: 111 microversion: 2.1 time: 0.044603 Jul 25 14:39:24.067701 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1756/3325] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:24 2022] GET /compute/v2.1/servers/bb07cf02-962c-4ea4-899c-507ace1ee7e9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:39:24.080417 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b59dac13-6976-485f-90cf-2a2b4f3c5212 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:24.082896 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b59dac13-6976-485f-90cf-2a2b4f3c5212 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: d31c05d7-3525-4ad4-9eb0-5ed163707f58] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:24.186304 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b59dac13-6976-485f-90cf-2a2b4f3c5212 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a720adc1b3443a8062b3eb8c7df11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5771bc6c546646b5a432a114f76d373d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:24.196004 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b59dac13-6976-485f-90cf-2a2b4f3c5212 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58" status: 200 len: 1218 microversion: 2.1 time: 0.132401 Jul 25 14:39:24.197758 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1757/3326] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:24 2022] GET /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58 => generated 1218 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:24.209428 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-def1927c-9304-47f7-9abd-cca0dac2bbec req-dfd46f27-cfcc-46a0-a2ed-ed8aca412464 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2d5ca5f-5c52-45f7-8d1c-f42144fe8108", "tag": "8e610f6f-b342-4a2d-9ea5-5330f97c6fbb"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:24.236554 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-def1927c-9304-47f7-9abd-cca0dac2bbec req-dfd46f27-cfcc-46a0-a2ed-ed8aca412464 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:24.240157 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-def1927c-9304-47f7-9abd-cca0dac2bbec req-dfd46f27-cfcc-46a0-a2ed-ed8aca412464 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:24.266211 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-def1927c-9304-47f7-9abd-cca0dac2bbec req-dfd46f27-cfcc-46a0-a2ed-ed8aca412464 service nova] Creating event network-changed:8e610f6f-b342-4a2d-9ea5-5330f97c6fbb for instance c2d5ca5f-5c52-45f7-8d1c-f42144fe8108 on n-h1-846435-14 Jul 25 14:39:24.274323 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-def1927c-9304-47f7-9abd-cca0dac2bbec req-dfd46f27-cfcc-46a0-a2ed-ed8aca412464 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074112 Jul 25 14:39:24.275498 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1758/3327] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:24.282096 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-68e45aaf-8c14-40e2-95f3-571adbad3d13 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:24.282997 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-68e45aaf-8c14-40e2-95f3-571adbad3d13 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] [instance: c2d5ca5f-5c52-45f7-8d1c-f42144fe8108] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:24.300225 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68e45aaf-8c14-40e2-95f3-571adbad3d13 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:24.300727 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68e45aaf-8c14-40e2-95f3-571adbad3d13 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:24.301684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68e45aaf-8c14-40e2-95f3-571adbad3d13 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:24.302119 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68e45aaf-8c14-40e2-95f3-571adbad3d13 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:24.537167 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b9131345-793c-4c85-9858-62e00baf5f72 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:24.546859 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b9131345-793c-4c85-9858-62e00baf5f72 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248" status: 200 len: 1308 microversion: 2.1 time: 1.136477 Jul 25 14:39:24.550954 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1570/3328] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:23 2022] GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248 => generated 1308 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:24.559215 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1725b264-b9a3-412a-8eab-74c830b876e7 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:24.562886 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-68e45aaf-8c14-40e2-95f3-571adbad3d13 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0dcc68e92f4917ad5335e4325b7065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14292758eb5e482d97001c3ddce034ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:24.570446 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1725b264-b9a3-412a-8eab-74c830b876e7 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:24.572007 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1725b264-b9a3-412a-8eab-74c830b876e7 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '68dee301e8c24a98abef98fc0617bc96'} {{(pid=119303) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:39:24.579047 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1725b264-b9a3-412a-8eab-74c830b876e7 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:24.579994 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1725b264-b9a3-412a-8eab-74c830b876e7 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:24.581006 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1725b264-b9a3-412a-8eab-74c830b876e7 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:24.581573 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-68e45aaf-8c14-40e2-95f3-571adbad3d13 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] 10.222.0.88 "GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108" status: 200 len: 1402 microversion: 2.1 time: 0.299150 Jul 25 14:39:24.581896 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1725b264-b9a3-412a-8eab-74c830b876e7 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:24.582319 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1759/3329] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:24 2022] GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108 => generated 1402 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:24.604765 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3ef3b818-514f-4f9b-a17d-f120ad0cc9a9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:24.607050 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3ef3b818-514f-4f9b-a17d-f120ad0cc9a9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:24.626362 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3ef3b818-514f-4f9b-a17d-f120ad0cc9a9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:24.626817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3ef3b818-514f-4f9b-a17d-f120ad0cc9a9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:24.627606 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3ef3b818-514f-4f9b-a17d-f120ad0cc9a9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:24.628158 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3ef3b818-514f-4f9b-a17d-f120ad0cc9a9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:24.671171 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1725b264-b9a3-412a-8eab-74c830b876e7 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.118897 Jul 25 14:39:24.672334 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1571/3330] 10.222.0.88 () {58 vars in 1230 bytes} [Mon Jul 25 14:39:24 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:39:24.677250 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1dee46d3-be08-41bb-bed7-aba994ca82b1 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:24.679987 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1dee46d3-be08-41bb-bed7-aba994ca82b1 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] [instance: a398b318-1a36-4299-9be1-40a69485198b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:24.686634 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1dee46d3-be08-41bb-bed7-aba994ca82b1 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:24.687405 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1dee46d3-be08-41bb-bed7-aba994ca82b1 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:24.688456 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1dee46d3-be08-41bb-bed7-aba994ca82b1 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:24.689126 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1dee46d3-be08-41bb-bed7-aba994ca82b1 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:24.727891 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3ef3b818-514f-4f9b-a17d-f120ad0cc9a9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.133134 Jul 25 14:39:24.733627 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1760/3331] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Jul 25 14:39:24 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:39:24.738733 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-06fddf82-9d2c-4dea-9867-09f10ada1f99 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-06fddf82-9d2c-4dea-9867-09f10ada1f99 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Request method failure captured: Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qr3b99SUhrrqSW3L1qFyB1tMv30VatZZSlc903gsEkYjhIZrUJnWbb_jQ9ggeaRuCB77ytz9bfQvNo4TjPG5KMX9JNTxRo2kuoAX9f8ysNoiHZYAZ6rTbf6AsbQxYhkeqvmyiYofGeyQXkDQ4mXmPZsWZDv3TPE3NhY7_lEGt8BP90 Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 68dee301e8c24a98abef98fc0617bc96 Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ListServersNegativeTestJSON-1989822960 Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/68dee301e8c24a98abef98fc0617bc96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/68dee301e8c24a98abef98fc0617bc96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_68dee301e8c24a98abef98fc0617bc96", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/68dee301e8c24a98abef98fc0617bc96"}]}] Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ListServersNegativeTestJSON-1989822960 Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 68dee301e8c24a98abef98fc0617bc96 Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1989822960 Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ListServersNegativeTestJSON-1989822960-project Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 1cfa029cfa58426da97a2d0857dabf78 Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ListServersNegativeTestJSON-1989822960-project Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: action_args: {} Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi '2011/01/01' Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 25 14:39:24.743627 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:39:24.748969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:39:24.748969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:39:24.748969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:39:24.748969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 25 14:39:24.748969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:24.748969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:24.748969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:24.748969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:24.748969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:24.748969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:24.748969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:39:24.748969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:39:24.748969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 25 14:39:24.748969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:24.748969 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-06fddf82-9d2c-4dea-9867-09f10ada1f99 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:39:24.748969 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-06fddf82-9d2c-4dea-9867-09f10ada1f99 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.010483 Jul 25 14:39:24.748969 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1761/3332] 10.222.0.88 () {58 vars in 1182 bytes} [Mon Jul 25 14:39:24 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:39:24.760465 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-63c9de2f-3cfc-4f7f-a49b-58d0c70defea tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:24.773793 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-63c9de2f-3cfc-4f7f-a49b-58d0c70defea tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:24.776277 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-63c9de2f-3cfc-4f7f-a49b-58d0c70defea tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Searching by: {'deleted': False, 'project_id': '68dee301e8c24a98abef98fc0617bc96'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:39:24.792836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63c9de2f-3cfc-4f7f-a49b-58d0c70defea tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:24.795392 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63c9de2f-3cfc-4f7f-a49b-58d0c70defea tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:24.800413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63c9de2f-3cfc-4f7f-a49b-58d0c70defea tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:24.801377 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63c9de2f-3cfc-4f7f-a49b-58d0c70defea tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:24.853365 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.multi_cell_list [None req-63c9de2f-3cfc-4f7f-a49b-58d0c70defea tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119304) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:39:24.969369 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-63c9de2f-3cfc-4f7f-a49b-58d0c70defea tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.214592 Jul 25 14:39:24.975908 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1762/3333] 10.222.0.88 () {58 vars in 1125 bytes} [Mon Jul 25 14:39:24 2022] GET /compute/v2.1/servers => generated 681 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:24.992241 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-b0c87513-c74a-4ef2-a5f3-075531615aea req-c12d1e5a-87d7-4287-8f2c-a70c7cda1e80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a398b318-1a36-4299-9be1-40a69485198b", "tag": "4fc7b16c-5223-4535-aa7b-5931230ade6f"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:25.004401 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-b0c87513-c74a-4ef2-a5f3-075531615aea req-c12d1e5a-87d7-4287-8f2c-a70c7cda1e80 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:25.005100 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-b0c87513-c74a-4ef2-a5f3-075531615aea req-c12d1e5a-87d7-4287-8f2c-a70c7cda1e80 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:25.021425 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-b0c87513-c74a-4ef2-a5f3-075531615aea req-c12d1e5a-87d7-4287-8f2c-a70c7cda1e80 service nova] Creating event network-changed:4fc7b16c-5223-4535-aa7b-5931230ade6f for instance a398b318-1a36-4299-9be1-40a69485198b on n-h2-846435-14 Jul 25 14:39:25.027849 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-b0c87513-c74a-4ef2-a5f3-075531615aea req-c12d1e5a-87d7-4287-8f2c-a70c7cda1e80 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049946 Jul 25 14:39:25.029147 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1763/3334] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:25.035190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-db70b420-6b31-49f7-a13d-aa0bc2777a83 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:25.040795 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-db70b420-6b31-49f7-a13d-aa0bc2777a83 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:25.042311 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.compute.servers [None req-db70b420-6b31-49f7-a13d-aa0bc2777a83 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Removing options 'limit' from query {{(pid=119304) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 25 14:39:25.043359 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-db70b420-6b31-49f7-a13d-aa0bc2777a83 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Searching by: {'deleted': False, 'project_id': '68dee301e8c24a98abef98fc0617bc96'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:39:25.052385 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db70b420-6b31-49f7-a13d-aa0bc2777a83 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:25.053113 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db70b420-6b31-49f7-a13d-aa0bc2777a83 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:25.054184 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db70b420-6b31-49f7-a13d-aa0bc2777a83 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:25.055131 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db70b420-6b31-49f7-a13d-aa0bc2777a83 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:25.120324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.multi_cell_list [None req-db70b420-6b31-49f7-a13d-aa0bc2777a83 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=119304) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:39:25.156495 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-db70b420-6b31-49f7-a13d-aa0bc2777a83 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.125742 Jul 25 14:39:25.157485 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1764/3335] 10.222.0.88 () {58 vars in 1144 bytes} [Mon Jul 25 14:39:25 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:25.169265 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1dee46d3-be08-41bb-bed7-aba994ca82b1 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7416803295914693a3e077649db2b47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf5a16e97944d9861d93405209cc37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:25.173123 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-47286f64-7ab6-4d14-8d9f-81dc5b3aa6d8 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:25.174094 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-47286f64-7ab6-4d14-8d9f-81dc5b3aa6d8 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:25.182009 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-47286f64-7ab6-4d14-8d9f-81dc5b3aa6d8 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:25.182878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-47286f64-7ab6-4d14-8d9f-81dc5b3aa6d8 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:25.183843 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-47286f64-7ab6-4d14-8d9f-81dc5b3aa6d8 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:25.183999 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1dee46d3-be08-41bb-bed7-aba994ca82b1 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] 10.222.0.88 "GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b" status: 200 len: 1323 microversion: 2.1 time: 0.508950 Jul 25 14:39:25.184601 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-47286f64-7ab6-4d14-8d9f-81dc5b3aa6d8 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:25.186276 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1572/3336] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:24 2022] GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b => generated 1323 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:25.203400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0e95c281-94cf-4dd5-a827-32e6a13cc1e8 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0e95c281-94cf-4dd5-a827-32e6a13cc1e8 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Request method failure captured: Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qr3b99SUhrrqSW3L1qFyB1tMv30VatZZSlc903gsEkYjhIZrUJnWbb_jQ9ggeaRuCB77ytz9bfQvNo4TjPG5KMX9JNTxRo2kuoAX9f8ysNoiHZYAZ6rTbf6AsbQxYhkeqvmyiYofGeyQXkDQ4mXmPZsWZDv3TPE3NhY7_lEGt8BP90 Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 68dee301e8c24a98abef98fc0617bc96 Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ListServersNegativeTestJSON-1989822960 Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/68dee301e8c24a98abef98fc0617bc96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/68dee301e8c24a98abef98fc0617bc96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_68dee301e8c24a98abef98fc0617bc96", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/68dee301e8c24a98abef98fc0617bc96"}]}] Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ListServersNegativeTestJSON-1989822960 Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 68dee301e8c24a98abef98fc0617bc96 Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1989822960 Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ListServersNegativeTestJSON-1989822960-project Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 1cfa029cfa58426da97a2d0857dabf78 Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ListServersNegativeTestJSON-1989822960-project Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: action_args: {} Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi '-1' Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 25 14:39:25.208266 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 25 14:39:25.212866 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:39:25.212866 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:39:25.212866 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:39:25.212866 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:39:25.212866 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 25 14:39:25.212866 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:25.212866 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:25.212866 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:25.212866 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:25.212866 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:25.212866 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:25.212866 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:39:25.212866 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:39:25.212866 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 25 14:39:25.212866 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:25.220890 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0e95c281-94cf-4dd5-a827-32e6a13cc1e8 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:39:25.222635 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0e95c281-94cf-4dd5-a827-32e6a13cc1e8 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.035333 Jul 25 14:39:25.225743 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1573/3337] 10.222.0.88 () {58 vars in 1142 bytes} [Mon Jul 25 14:39:25 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:39:25.239220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2397e8fb-1a94-4c6a-9ec5-d428b4ad9799 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:25.242248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2397e8fb-1a94-4c6a-9ec5-d428b4ad9799 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: d31c05d7-3525-4ad4-9eb0-5ed163707f58] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:25.268999 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2397e8fb-1a94-4c6a-9ec5-d428b4ad9799 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:25.273996 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2397e8fb-1a94-4c6a-9ec5-d428b4ad9799 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:25.275107 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2397e8fb-1a94-4c6a-9ec5-d428b4ad9799 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:25.275938 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2397e8fb-1a94-4c6a-9ec5-d428b4ad9799 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:25.425446 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2397e8fb-1a94-4c6a-9ec5-d428b4ad9799 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a720adc1b3443a8062b3eb8c7df11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5771bc6c546646b5a432a114f76d373d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:25.445397 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2397e8fb-1a94-4c6a-9ec5-d428b4ad9799 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58" status: 200 len: 1276 microversion: 2.1 time: 0.218210 Jul 25 14:39:25.452764 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1574/3338] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:25 2022] GET /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58 => generated 1276 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:25.458155 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-00457ae0-0720-45ea-9a6b-27474c55bb55 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-00457ae0-0720-45ea-9a6b-27474c55bb55 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Request method failure captured: Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qr3b99SUhrrqSW3L1qFyB1tMv30VatZZSlc903gsEkYjhIZrUJnWbb_jQ9ggeaRuCB77ytz9bfQvNo4TjPG5KMX9JNTxRo2kuoAX9f8ysNoiHZYAZ6rTbf6AsbQxYhkeqvmyiYofGeyQXkDQ4mXmPZsWZDv3TPE3NhY7_lEGt8BP90 Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 68dee301e8c24a98abef98fc0617bc96 Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ListServersNegativeTestJSON-1989822960 Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/68dee301e8c24a98abef98fc0617bc96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/68dee301e8c24a98abef98fc0617bc96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_68dee301e8c24a98abef98fc0617bc96", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/68dee301e8c24a98abef98fc0617bc96"}]}] Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ListServersNegativeTestJSON-1989822960 Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 68dee301e8c24a98abef98fc0617bc96 Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1989822960 Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ListServersNegativeTestJSON-1989822960-project Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 1cfa029cfa58426da97a2d0857dabf78 Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ListServersNegativeTestJSON-1989822960-project Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: action_args: {} Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'testing' Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 25 14:39:25.462561 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 25 14:39:25.467049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:39:25.467049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:39:25.467049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:39:25.467049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:39:25.467049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 25 14:39:25.467049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:25.467049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:25.467049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:25.467049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:25.467049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:25.467049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:25.467049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:39:25.467049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:39:25.467049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 25 14:39:25.467049 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:25.469879 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-00457ae0-0720-45ea-9a6b-27474c55bb55 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:39:25.470987 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-00457ae0-0720-45ea-9a6b-27474c55bb55 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.016935 Jul 25 14:39:25.476477 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1575/3339] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jul 25 14:39:25 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:39:25.482879 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-657eac03-76e7-4f16-99b7-4406a73a2a89 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:25.489432 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-657eac03-76e7-4f16-99b7-4406a73a2a89 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:25.490500 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-657eac03-76e7-4f16-99b7-4406a73a2a89 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '68dee301e8c24a98abef98fc0617bc96'} {{(pid=119303) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:39:25.501353 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.compute.servers [None req-657eac03-76e7-4f16-99b7-4406a73a2a89 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Flavor 'non_existing_flavor' could not be found {{(pid=119303) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jul 25 14:39:25.502942 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-657eac03-76e7-4f16-99b7-4406a73a2a89 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.024434 Jul 25 14:39:25.512479 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1576/3340] 10.222.0.88 () {58 vars in 1178 bytes} [Mon Jul 25 14:39:25 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:39:25.518946 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e12cd1d8-ee5d-471c-83cc-db47dab08679 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:25.541753 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e12cd1d8-ee5d-471c-83cc-db47dab08679 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:25.542808 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e12cd1d8-ee5d-471c-83cc-db47dab08679 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '68dee301e8c24a98abef98fc0617bc96'} {{(pid=119303) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:39:25.557047 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e12cd1d8-ee5d-471c-83cc-db47dab08679 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:25.557716 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e12cd1d8-ee5d-471c-83cc-db47dab08679 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:25.560142 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e12cd1d8-ee5d-471c-83cc-db47dab08679 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:25.560600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e12cd1d8-ee5d-471c-83cc-db47dab08679 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:25.575352 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-47286f64-7ab6-4d14-8d9f-81dc5b3aa6d8 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:25.587952 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-47286f64-7ab6-4d14-8d9f-81dc5b3aa6d8 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1734 microversion: 2.1 time: 0.420704 Jul 25 14:39:25.588707 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1765/3341] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:25 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1734 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:25.601999 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d5574d27-a1ee-462b-b6bd-91208476d7eb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:25.605754 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d5574d27-a1ee-462b-b6bd-91208476d7eb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 31135b90-13f0-431a-994f-8af08fbd3248] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:25.623298 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5574d27-a1ee-462b-b6bd-91208476d7eb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:25.624198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5574d27-a1ee-462b-b6bd-91208476d7eb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:25.627913 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5574d27-a1ee-462b-b6bd-91208476d7eb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:25.628730 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5574d27-a1ee-462b-b6bd-91208476d7eb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:25.711788 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e12cd1d8-ee5d-471c-83cc-db47dab08679 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.197888 Jul 25 14:39:25.713677 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1577/3342] 10.222.0.88 () {58 vars in 1174 bytes} [Mon Jul 25 14:39:25 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:39:25.719060 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cc633f82-72ed-4e67-8781-960c2a640055 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:25.719994 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cc633f82-72ed-4e67-8781-960c2a640055 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] [instance: c2d5ca5f-5c52-45f7-8d1c-f42144fe8108] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:25.729257 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cc633f82-72ed-4e67-8781-960c2a640055 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:25.729957 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cc633f82-72ed-4e67-8781-960c2a640055 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:25.731068 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cc633f82-72ed-4e67-8781-960c2a640055 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:25.731665 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cc633f82-72ed-4e67-8781-960c2a640055 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:25.757705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:39:25.979529 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d5574d27-a1ee-462b-b6bd-91208476d7eb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:25.993405 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d5574d27-a1ee-462b-b6bd-91208476d7eb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248" status: 200 len: 1308 microversion: 2.1 time: 0.397099 Jul 25 14:39:26.005444 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1766/3343] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:25 2022] GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248 => generated 1308 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:26.022795 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5ebcc981-4837-4c94-ba8b-3019d435014e tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:26.029928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5ebcc981-4837-4c94-ba8b-3019d435014e tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:26.030912 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5ebcc981-4837-4c94-ba8b-3019d435014e tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '68dee301e8c24a98abef98fc0617bc96'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:39:26.036905 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ebcc981-4837-4c94-ba8b-3019d435014e tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:26.037752 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ebcc981-4837-4c94-ba8b-3019d435014e tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:26.039159 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ebcc981-4837-4c94-ba8b-3019d435014e tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:26.039768 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ebcc981-4837-4c94-ba8b-3019d435014e tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:26.087785 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cc633f82-72ed-4e67-8781-960c2a640055 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0dcc68e92f4917ad5335e4325b7065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14292758eb5e482d97001c3ddce034ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:26.100605 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cc633f82-72ed-4e67-8781-960c2a640055 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] 10.222.0.88 "GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108" status: 200 len: 1402 microversion: 2.1 time: 0.384906 Jul 25 14:39:26.104193 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1578/3344] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:25 2022] GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108 => generated 1402 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:26.110100 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a202ec47-b79f-4602-bafe-8ac728758643 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:26.112515 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a202ec47-b79f-4602-bafe-8ac728758643 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:26.120041 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a202ec47-b79f-4602-bafe-8ac728758643 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:26.120633 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a202ec47-b79f-4602-bafe-8ac728758643 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:26.121518 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a202ec47-b79f-4602-bafe-8ac728758643 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:26.122080 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a202ec47-b79f-4602-bafe-8ac728758643 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:26.135141 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5ebcc981-4837-4c94-ba8b-3019d435014e tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.121500 Jul 25 14:39:26.136317 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1767/3345] 10.222.0.88 () {58 vars in 1184 bytes} [Mon Jul 25 14:39:26 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:39:26.148345 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-980a892b-980f-4b30-b021-61a71e3c4b60 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:26.153760 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-980a892b-980f-4b30-b021-61a71e3c4b60 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:26.154731 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-980a892b-980f-4b30-b021-61a71e3c4b60 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Searching by: {'deleted': False, 'project_id': '68dee301e8c24a98abef98fc0617bc96'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:39:26.160782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-980a892b-980f-4b30-b021-61a71e3c4b60 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:26.161467 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-980a892b-980f-4b30-b021-61a71e3c4b60 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:26.161718 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a202ec47-b79f-4602-bafe-8ac728758643 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056322 Jul 25 14:39:26.162572 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-980a892b-980f-4b30-b021-61a71e3c4b60 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:26.163622 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-980a892b-980f-4b30-b021-61a71e3c4b60 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:26.167004 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1579/3346] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Jul 25 14:39:26 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:39:26.195277 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.multi_cell_list [None req-980a892b-980f-4b30-b021-61a71e3c4b60 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119304) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:39:26.209165 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-917471b5-6ec8-4072-aa87-01a066aa8244 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:26.210152 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-917471b5-6ec8-4072-aa87-01a066aa8244 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] [instance: a398b318-1a36-4299-9be1-40a69485198b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:26.230627 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-917471b5-6ec8-4072-aa87-01a066aa8244 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:26.231212 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-917471b5-6ec8-4072-aa87-01a066aa8244 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:26.232080 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-917471b5-6ec8-4072-aa87-01a066aa8244 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:26.232528 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-917471b5-6ec8-4072-aa87-01a066aa8244 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:26.238122 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-980a892b-980f-4b30-b021-61a71e3c4b60 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:26.247073 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-980a892b-980f-4b30-b021-61a71e3c4b60 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:26.247212 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-980a892b-980f-4b30-b021-61a71e3c4b60 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:26.445926 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-917471b5-6ec8-4072-aa87-01a066aa8244 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7416803295914693a3e077649db2b47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf5a16e97944d9861d93405209cc37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:26.457284 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-917471b5-6ec8-4072-aa87-01a066aa8244 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] 10.222.0.88 "GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b" status: 200 len: 1323 microversion: 2.1 time: 0.254692 Jul 25 14:39:26.458251 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1580/3347] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:26 2022] GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b => generated 1323 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:39:26.477718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a65ff1fc-65bf-42fc-aafd-0c679e1bcd54 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:26.478790 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a65ff1fc-65bf-42fc-aafd-0c679e1bcd54 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: d31c05d7-3525-4ad4-9eb0-5ed163707f58] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:26.487911 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a65ff1fc-65bf-42fc-aafd-0c679e1bcd54 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:26.488873 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a65ff1fc-65bf-42fc-aafd-0c679e1bcd54 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:26.489984 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a65ff1fc-65bf-42fc-aafd-0c679e1bcd54 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:26.490658 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a65ff1fc-65bf-42fc-aafd-0c679e1bcd54 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:26.563517 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-980a892b-980f-4b30-b021-61a71e3c4b60 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 0.419518 Jul 25 14:39:26.567508 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1768/3348] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:39:26 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:26.593078 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1b647d63-3fed-4b61-af50-c3f91e12d431 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:26.598643 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1b647d63-3fed-4b61-af50-c3f91e12d431 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:26.600038 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1b647d63-3fed-4b61-af50-c3f91e12d431 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.010895 Jul 25 14:39:26.601184 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1769/3349] 10.222.0.88 () {58 vars in 1178 bytes} [Mon Jul 25 14:39:26 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:39:26.614825 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9518e02b-2951-430b-8a0d-a6c2304969f8 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:26.623994 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9518e02b-2951-430b-8a0d-a6c2304969f8 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:26.623994 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9518e02b-2951-430b-8a0d-a6c2304969f8 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Searching by: {'deleted': False, 'project_id': '68dee301e8c24a98abef98fc0617bc96'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:39:26.627415 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9518e02b-2951-430b-8a0d-a6c2304969f8 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:26.627884 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9518e02b-2951-430b-8a0d-a6c2304969f8 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:26.628750 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9518e02b-2951-430b-8a0d-a6c2304969f8 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:26.629184 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9518e02b-2951-430b-8a0d-a6c2304969f8 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:26.672223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.multi_cell_list [None req-9518e02b-2951-430b-8a0d-a6c2304969f8 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119304) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:39:26.706424 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9518e02b-2951-430b-8a0d-a6c2304969f8 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.095443 Jul 25 14:39:26.707200 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1770/3350] 10.222.0.88 () {58 vars in 1125 bytes} [Mon Jul 25 14:39:26 2022] GET /compute/v2.1/servers => generated 681 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:26.716537 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-870eedf3-82d0-4e43-9d5b-cc5643f83294 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:26.716537 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-870eedf3-82d0-4e43-9d5b-cc5643f83294 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:26.724161 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-870eedf3-82d0-4e43-9d5b-cc5643f83294 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:26.724630 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-870eedf3-82d0-4e43-9d5b-cc5643f83294 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:26.725656 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-870eedf3-82d0-4e43-9d5b-cc5643f83294 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:26.726873 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-870eedf3-82d0-4e43-9d5b-cc5643f83294 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:26.753935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a65ff1fc-65bf-42fc-aafd-0c679e1bcd54 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a720adc1b3443a8062b3eb8c7df11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5771bc6c546646b5a432a114f76d373d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:26.764808 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a65ff1fc-65bf-42fc-aafd-0c679e1bcd54 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58" status: 200 len: 1318 microversion: 2.1 time: 0.295390 Jul 25 14:39:26.765886 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1581/3351] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:26 2022] GET /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:26.782704 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-40fca7a7-611a-4f2b-b0e4-42c8c372a16b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:26.783275 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-40fca7a7-611a-4f2b-b0e4-42c8c372a16b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: bb07cf02-962c-4ea4-899c-507ace1ee7e9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:26.793365 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-40fca7a7-611a-4f2b-b0e4-42c8c372a16b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:26.794466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-40fca7a7-611a-4f2b-b0e4-42c8c372a16b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:26.795361 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-40fca7a7-611a-4f2b-b0e4-42c8c372a16b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:26.795895 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-40fca7a7-611a-4f2b-b0e4-42c8c372a16b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-40fca7a7-611a-4f2b-b0e4-42c8c372a16b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] HTTP exception thrown: Instance bb07cf02-962c-4ea4-899c-507ace1ee7e9 could not be found. Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-40fca7a7-611a-4f2b-b0e4-42c8c372a16b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Request method failure captured: Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/bb07cf02-962c-4ea4-899c-507ace1ee7e9 HTTP/1.1 Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qr3b99SUhrrqSW3L1qFyB1tMv30VatZZSlc903gsEkYjhIZrUJnWbb_jQ9ggeaRuCB77ytz9bfQvNo4TjPG5KMX9JNTxRo2kuoAX9f8ysNoiHZYAZ6rTbf6AsbQxYhkeqvmyiYofGeyQXkDQ4mXmPZsWZDv3TPE3NhY7_lEGt8BP90 Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 68dee301e8c24a98abef98fc0617bc96 Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ListServersNegativeTestJSON-1989822960 Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/68dee301e8c24a98abef98fc0617bc96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/68dee301e8c24a98abef98fc0617bc96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_68dee301e8c24a98abef98fc0617bc96", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/68dee301e8c24a98abef98fc0617bc96"}]}] Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ListServersNegativeTestJSON-1989822960 Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 68dee301e8c24a98abef98fc0617bc96 Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1989822960 Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ListServersNegativeTestJSON-1989822960-project Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 1cfa029cfa58426da97a2d0857dabf78 Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ListServersNegativeTestJSON-1989822960-project Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance bb07cf02-962c-4ea4-899c-507ace1ee7e9 could not be found. Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'bb07cf02-962c-4ea4-899c-507ace1ee7e9'} Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb07cf02-962c-4ea4-899c-507ace1ee7e9 could not be found. Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:39:26.819381 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:39:26.824249 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:39:26.824249 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:39:26.824249 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:39:26.824249 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb07cf02-962c-4ea4-899c-507ace1ee7e9 could not be found. Jul 25 14:39:26.824249 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:26.824249 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:26.824249 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:26.824249 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:26.824249 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:26.824249 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:26.824249 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:39:26.824249 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:39:26.824249 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb07cf02-962c-4ea4-899c-507ace1ee7e9 could not be found. Jul 25 14:39:26.824249 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:26.824249 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-40fca7a7-611a-4f2b-b0e4-42c8c372a16b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Returning 404 to user: Instance bb07cf02-962c-4ea4-899c-507ace1ee7e9 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:39:26.824249 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-40fca7a7-611a-4f2b-b0e4-42c8c372a16b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "DELETE /compute/v2.1/servers/bb07cf02-962c-4ea4-899c-507ace1ee7e9" status: 404 len: 111 microversion: 2.1 time: 0.052379 Jul 25 14:39:26.824249 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1582/3352] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:39:26 2022] DELETE /compute/v2.1/servers/bb07cf02-962c-4ea4-899c-507ace1ee7e9 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:39:26.830561 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6636c0a2-643d-43d5-9f7d-88eeb34bbeb7 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:26.841246 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6636c0a2-643d-43d5-9f7d-88eeb34bbeb7 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: 6b535085-b43d-4a2b-84c3-b5768569def2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:26.863819 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6636c0a2-643d-43d5-9f7d-88eeb34bbeb7 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:26.864973 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6636c0a2-643d-43d5-9f7d-88eeb34bbeb7 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:26.865771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6636c0a2-643d-43d5-9f7d-88eeb34bbeb7 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:26.866300 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6636c0a2-643d-43d5-9f7d-88eeb34bbeb7 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:26.904203 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6636c0a2-643d-43d5-9f7d-88eeb34bbeb7 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: 6b535085-b43d-4a2b-84c3-b5768569def2] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:39:26.929847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-870eedf3-82d0-4e43-9d5b-cc5643f83294 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:26.939822 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-870eedf3-82d0-4e43-9d5b-cc5643f83294 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1734 microversion: 2.1 time: 0.230638 Jul 25 14:39:26.940933 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1771/3353] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:26 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1734 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:27.024741 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-567a3152-f55e-4a4d-bfae-05cb69035ada tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:27.026687 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-567a3152-f55e-4a4d-bfae-05cb69035ada tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 31135b90-13f0-431a-994f-8af08fbd3248] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:27.059015 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-567a3152-f55e-4a4d-bfae-05cb69035ada tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:27.062203 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-567a3152-f55e-4a4d-bfae-05cb69035ada tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:27.063290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-567a3152-f55e-4a4d-bfae-05cb69035ada tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:27.069052 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-567a3152-f55e-4a4d-bfae-05cb69035ada tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:27.072484 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6636c0a2-643d-43d5-9f7d-88eeb34bbeb7 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "DELETE /compute/v2.1/servers/6b535085-b43d-4a2b-84c3-b5768569def2" status: 204 len: 0 microversion: 2.1 time: 0.243924 Jul 25 14:39:27.077327 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1583/3354] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:39:26 2022] DELETE /compute/v2.1/servers/6b535085-b43d-4a2b-84c3-b5768569def2 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:39:27.079087 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:39:27.090160 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-db0dce58-0c4a-4e04-b265-b894d09ac201 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:27.092164 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-db0dce58-0c4a-4e04-b265-b894d09ac201 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: 88b6bb55-179d-42a2-aab1-53aefc8e536d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:27.110268 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-db0dce58-0c4a-4e04-b265-b894d09ac201 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:27.111137 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-db0dce58-0c4a-4e04-b265-b894d09ac201 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:27.114116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-db0dce58-0c4a-4e04-b265-b894d09ac201 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:27.114802 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-db0dce58-0c4a-4e04-b265-b894d09ac201 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:27.174511 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-db0dce58-0c4a-4e04-b265-b894d09ac201 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: 88b6bb55-179d-42a2-aab1-53aefc8e536d] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:39:27.296355 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-db0dce58-0c4a-4e04-b265-b894d09ac201 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "DELETE /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d" status: 204 len: 0 microversion: 2.1 time: 0.215588 Jul 25 14:39:27.297847 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1584/3355] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:39:27 2022] DELETE /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:39:27.305853 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e33169ad-c56f-453d-bdb2-45dca58237ba tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:27.307265 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e33169ad-c56f-453d-bdb2-45dca58237ba tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] [instance: c2d5ca5f-5c52-45f7-8d1c-f42144fe8108] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:27.317427 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e33169ad-c56f-453d-bdb2-45dca58237ba tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:27.318276 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e33169ad-c56f-453d-bdb2-45dca58237ba tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:27.319895 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e33169ad-c56f-453d-bdb2-45dca58237ba tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:27.321169 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e33169ad-c56f-453d-bdb2-45dca58237ba tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:27.340384 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-567a3152-f55e-4a4d-bfae-05cb69035ada tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:27.349879 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-567a3152-f55e-4a4d-bfae-05cb69035ada tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248" status: 200 len: 1308 microversion: 2.1 time: 0.329242 Jul 25 14:39:27.351378 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1772/3356] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:27 2022] GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248 => generated 1308 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:27.357194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6acea1d2-64f4-4b0e-9c2b-79d2e62e7696 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:27.359760 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6acea1d2-64f4-4b0e-9c2b-79d2e62e7696 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:27.367272 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6acea1d2-64f4-4b0e-9c2b-79d2e62e7696 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:27.367826 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6acea1d2-64f4-4b0e-9c2b-79d2e62e7696 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:27.368709 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6acea1d2-64f4-4b0e-9c2b-79d2e62e7696 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:27.369211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6acea1d2-64f4-4b0e-9c2b-79d2e62e7696 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:27.408690 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6acea1d2-64f4-4b0e-9c2b-79d2e62e7696 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055959 Jul 25 14:39:27.410102 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1773/3357] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Jul 25 14:39:27 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:39:27.415393 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c20c2934-5105-4761-87de-465a55d31cf5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:27.417123 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c20c2934-5105-4761-87de-465a55d31cf5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: bb07cf02-962c-4ea4-899c-507ace1ee7e9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:27.424771 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c20c2934-5105-4761-87de-465a55d31cf5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:27.425510 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c20c2934-5105-4761-87de-465a55d31cf5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:27.426312 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c20c2934-5105-4761-87de-465a55d31cf5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:27.426753 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c20c2934-5105-4761-87de-465a55d31cf5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:27.446955 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-c20c2934-5105-4761-87de-465a55d31cf5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] HTTP exception thrown: Instance bb07cf02-962c-4ea4-899c-507ace1ee7e9 could not be found. Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c20c2934-5105-4761-87de-465a55d31cf5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Request method failure captured: Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/bb07cf02-962c-4ea4-899c-507ace1ee7e9 HTTP/1.1 Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qr3b99SUhrrqSW3L1qFyB1tMv30VatZZSlc903gsEkYjhIZrUJnWbb_jQ9ggeaRuCB77ytz9bfQvNo4TjPG5KMX9JNTxRo2kuoAX9f8ysNoiHZYAZ6rTbf6AsbQxYhkeqvmyiYofGeyQXkDQ4mXmPZsWZDv3TPE3NhY7_lEGt8BP90 Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 68dee301e8c24a98abef98fc0617bc96 Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ListServersNegativeTestJSON-1989822960 Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/68dee301e8c24a98abef98fc0617bc96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/68dee301e8c24a98abef98fc0617bc96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_68dee301e8c24a98abef98fc0617bc96", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/68dee301e8c24a98abef98fc0617bc96"}]}] Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ListServersNegativeTestJSON-1989822960 Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 68dee301e8c24a98abef98fc0617bc96 Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1989822960 Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ListServersNegativeTestJSON-1989822960-project Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 1cfa029cfa58426da97a2d0857dabf78 Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ListServersNegativeTestJSON-1989822960-project Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance bb07cf02-962c-4ea4-899c-507ace1ee7e9 could not be found. Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'bb07cf02-962c-4ea4-899c-507ace1ee7e9'} Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb07cf02-962c-4ea4-899c-507ace1ee7e9 could not be found. Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb07cf02-962c-4ea4-899c-507ace1ee7e9 could not be found. Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:27.448849 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:27.452855 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:27.452855 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:27.452855 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:27.452855 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:39:27.452855 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:39:27.452855 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb07cf02-962c-4ea4-899c-507ace1ee7e9 could not be found. Jul 25 14:39:27.452855 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:27.452855 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c20c2934-5105-4761-87de-465a55d31cf5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Returning 404 to user: Instance bb07cf02-962c-4ea4-899c-507ace1ee7e9 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:39:27.452855 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c20c2934-5105-4761-87de-465a55d31cf5 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers/bb07cf02-962c-4ea4-899c-507ace1ee7e9" status: 404 len: 111 microversion: 2.1 time: 0.039116 Jul 25 14:39:27.452855 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1774/3358] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:27 2022] GET /compute/v2.1/servers/bb07cf02-962c-4ea4-899c-507ace1ee7e9 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:39:27.462504 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1b18f8d3-fec7-418a-bff1-1e29df833a85 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:27.464205 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1b18f8d3-fec7-418a-bff1-1e29df833a85 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: 6b535085-b43d-4a2b-84c3-b5768569def2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:27.474998 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1b18f8d3-fec7-418a-bff1-1e29df833a85 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:27.478675 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1b18f8d3-fec7-418a-bff1-1e29df833a85 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:27.479505 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1b18f8d3-fec7-418a-bff1-1e29df833a85 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:27.479947 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1b18f8d3-fec7-418a-bff1-1e29df833a85 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:27.546601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e33169ad-c56f-453d-bdb2-45dca58237ba tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0dcc68e92f4917ad5335e4325b7065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14292758eb5e482d97001c3ddce034ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:27.557204 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e33169ad-c56f-453d-bdb2-45dca58237ba tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] 10.222.0.88 "GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108" status: 200 len: 1402 microversion: 2.1 time: 0.256596 Jul 25 14:39:27.558023 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1585/3359] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:27 2022] GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108 => generated 1402 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:27.566391 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-01f4a6af-08da-4b44-8f26-b258ae3e9b0a tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:27.567018 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-01f4a6af-08da-4b44-8f26-b258ae3e9b0a tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] [instance: a398b318-1a36-4299-9be1-40a69485198b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:27.576430 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-01f4a6af-08da-4b44-8f26-b258ae3e9b0a tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:27.577240 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-01f4a6af-08da-4b44-8f26-b258ae3e9b0a tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:27.578227 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-01f4a6af-08da-4b44-8f26-b258ae3e9b0a tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:27.578926 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-01f4a6af-08da-4b44-8f26-b258ae3e9b0a tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:27.643443 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1b18f8d3-fec7-418a-bff1-1e29df833a85 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:27.653836 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1b18f8d3-fec7-418a-bff1-1e29df833a85 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers/6b535085-b43d-4a2b-84c3-b5768569def2" status: 200 len: 1521 microversion: 2.1 time: 0.196660 Jul 25 14:39:27.668503 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1775/3360] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:27 2022] GET /compute/v2.1/servers/6b535085-b43d-4a2b-84c3-b5768569def2 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:27.743247 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-01f4a6af-08da-4b44-8f26-b258ae3e9b0a tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7416803295914693a3e077649db2b47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf5a16e97944d9861d93405209cc37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:27.751957 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-01f4a6af-08da-4b44-8f26-b258ae3e9b0a tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] 10.222.0.88 "GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b" status: 200 len: 1323 microversion: 2.1 time: 0.191724 Jul 25 14:39:27.752554 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1586/3361] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:27 2022] GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b => generated 1323 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:27.788904 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-deb03dc7-14bb-4340-9fb8-a69149590614 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:27.789450 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-deb03dc7-14bb-4340-9fb8-a69149590614 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: d31c05d7-3525-4ad4-9eb0-5ed163707f58] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:27.797704 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-deb03dc7-14bb-4340-9fb8-a69149590614 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:27.798210 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-deb03dc7-14bb-4340-9fb8-a69149590614 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:27.807507 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-deb03dc7-14bb-4340-9fb8-a69149590614 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:27.807507 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-deb03dc7-14bb-4340-9fb8-a69149590614 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:27.961751 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6337c9b5-7f83-43b8-b74b-3bc993f36068 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:27.962759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6337c9b5-7f83-43b8-b74b-3bc993f36068 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:27.972969 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-deb03dc7-14bb-4340-9fb8-a69149590614 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a720adc1b3443a8062b3eb8c7df11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5771bc6c546646b5a432a114f76d373d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:27.974410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6337c9b5-7f83-43b8-b74b-3bc993f36068 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:27.974875 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6337c9b5-7f83-43b8-b74b-3bc993f36068 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:27.977862 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6337c9b5-7f83-43b8-b74b-3bc993f36068 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:27.978322 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6337c9b5-7f83-43b8-b74b-3bc993f36068 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:27.982386 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-deb03dc7-14bb-4340-9fb8-a69149590614 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58" status: 200 len: 1318 microversion: 2.1 time: 0.200200 Jul 25 14:39:27.984081 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1776/3362] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:27 2022] GET /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:28.254214 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6337c9b5-7f83-43b8-b74b-3bc993f36068 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:28.263135 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6337c9b5-7f83-43b8-b74b-3bc993f36068 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1734 microversion: 2.1 time: 0.305608 Jul 25 14:39:28.263941 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1587/3363] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:27 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1734 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:39:28.371217 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-358452c0-8cfe-49c1-8114-05ec948777a6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:28.372562 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-358452c0-8cfe-49c1-8114-05ec948777a6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 31135b90-13f0-431a-994f-8af08fbd3248] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:28.380037 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-358452c0-8cfe-49c1-8114-05ec948777a6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:28.381019 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-358452c0-8cfe-49c1-8114-05ec948777a6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:28.382675 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-358452c0-8cfe-49c1-8114-05ec948777a6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:28.383355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-358452c0-8cfe-49c1-8114-05ec948777a6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:28.423375 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0ece3de2-2486-43f9-8628-e4539627721d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:28.426155 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0ece3de2-2486-43f9-8628-e4539627721d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:28.442926 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0ece3de2-2486-43f9-8628-e4539627721d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:28.446207 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0ece3de2-2486-43f9-8628-e4539627721d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:28.447433 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0ece3de2-2486-43f9-8628-e4539627721d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:28.448147 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0ece3de2-2486-43f9-8628-e4539627721d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:28.514177 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0ece3de2-2486-43f9-8628-e4539627721d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.096072 Jul 25 14:39:28.524532 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1588/3364] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Jul 25 14:39:28 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:39:28.583177 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ce393d48-bd30-4285-a1de-6fe77ee3dac2 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:28.584227 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ce393d48-bd30-4285-a1de-6fe77ee3dac2 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] [instance: c2d5ca5f-5c52-45f7-8d1c-f42144fe8108] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:28.591548 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ce393d48-bd30-4285-a1de-6fe77ee3dac2 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:28.592369 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ce393d48-bd30-4285-a1de-6fe77ee3dac2 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:28.593525 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ce393d48-bd30-4285-a1de-6fe77ee3dac2 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:28.594185 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ce393d48-bd30-4285-a1de-6fe77ee3dac2 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:28.774202 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-358452c0-8cfe-49c1-8114-05ec948777a6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:28.787256 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-358452c0-8cfe-49c1-8114-05ec948777a6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248" status: 200 len: 1489 microversion: 2.1 time: 0.420003 Jul 25 14:39:28.788286 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1777/3365] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:28 2022] GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248 => generated 1489 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:28.793235 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f50d5327-4d53-48e4-810b-3ff2f6b617ca tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:28.794122 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f50d5327-4d53-48e4-810b-3ff2f6b617ca tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: 6b535085-b43d-4a2b-84c3-b5768569def2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:28.835243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f50d5327-4d53-48e4-810b-3ff2f6b617ca tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:28.835804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f50d5327-4d53-48e4-810b-3ff2f6b617ca tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:28.838059 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f50d5327-4d53-48e4-810b-3ff2f6b617ca tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:28.838577 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f50d5327-4d53-48e4-810b-3ff2f6b617ca tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:28.909335 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ce393d48-bd30-4285-a1de-6fe77ee3dac2 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0dcc68e92f4917ad5335e4325b7065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14292758eb5e482d97001c3ddce034ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:28.918898 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ce393d48-bd30-4285-a1de-6fe77ee3dac2 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] 10.222.0.88 "GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108" status: 200 len: 1402 microversion: 2.1 time: 0.340495 Jul 25 14:39:28.920399 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1589/3366] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:28 2022] GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108 => generated 1402 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:39:28.925210 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fff9803f-db73-414f-9637-137eb2a0c2b3 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:28.926097 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fff9803f-db73-414f-9637-137eb2a0c2b3 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] [instance: a398b318-1a36-4299-9be1-40a69485198b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:28.939541 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fff9803f-db73-414f-9637-137eb2a0c2b3 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:28.940954 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fff9803f-db73-414f-9637-137eb2a0c2b3 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:28.942837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fff9803f-db73-414f-9637-137eb2a0c2b3 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:28.943485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fff9803f-db73-414f-9637-137eb2a0c2b3 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:29.118643 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f50d5327-4d53-48e4-810b-3ff2f6b617ca tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:29.133765 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f50d5327-4d53-48e4-810b-3ff2f6b617ca tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers/6b535085-b43d-4a2b-84c3-b5768569def2" status: 200 len: 1521 microversion: 2.1 time: 0.344159 Jul 25 14:39:29.136561 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1778/3367] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:28 2022] GET /compute/v2.1/servers/6b535085-b43d-4a2b-84c3-b5768569def2 => generated 1521 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:29.142779 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-51a9cf4f-ef99-4a71-8fba-a016307e49c5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-977035244", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "4c176170-2f7d-43a7-8c89-c74c022eb418"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:29.270511 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-51a9cf4f-ef99-4a71-8fba-a016307e49c5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] validate_networks() for [('4c176170-2f7d-43a7-8c89-c74c022eb418', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:39:29.567802 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fff9803f-db73-414f-9637-137eb2a0c2b3 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7416803295914693a3e077649db2b47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf5a16e97944d9861d93405209cc37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:29.580447 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fff9803f-db73-414f-9637-137eb2a0c2b3 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] 10.222.0.88 "GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b" status: 200 len: 1323 microversion: 2.1 time: 0.658744 Jul 25 14:39:29.595444 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1590/3368] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:28 2022] GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b => generated 1323 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:29.604525 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-14e8e235-1752-40a0-a1f8-aed10f7256d9 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:29.605657 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-14e8e235-1752-40a0-a1f8-aed10f7256d9 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: d31c05d7-3525-4ad4-9eb0-5ed163707f58] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:29.612189 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14e8e235-1752-40a0-a1f8-aed10f7256d9 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:29.612943 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14e8e235-1752-40a0-a1f8-aed10f7256d9 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:29.613796 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14e8e235-1752-40a0-a1f8-aed10f7256d9 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:29.614429 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14e8e235-1752-40a0-a1f8-aed10f7256d9 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:30.289588 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-51a9cf4f-ef99-4a71-8fba-a016307e49c5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:39:30.290655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-51a9cf4f-ef99-4a71-8fba-a016307e49c5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:39:30.294208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-51a9cf4f-ef99-4a71-8fba-a016307e49c5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:39:30.296233 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-51a9cf4f-ef99-4a71-8fba-a016307e49c5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:39:30.297281 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-51a9cf4f-ef99-4a71-8fba-a016307e49c5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:39:30.316828 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51a9cf4f-ef99-4a71-8fba-a016307e49c5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:30.318321 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51a9cf4f-ef99-4a71-8fba-a016307e49c5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:30.319891 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51a9cf4f-ef99-4a71-8fba-a016307e49c5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:30.321016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51a9cf4f-ef99-4a71-8fba-a016307e49c5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:30.341440 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=17 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:39:30.364130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-51a9cf4f-ef99-4a71-8fba-a016307e49c5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Getting quotas for project e77732af189e48feab3752ddb28208d3. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:39:30.372860 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-51a9cf4f-ef99-4a71-8fba-a016307e49c5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Getting quotas for user e45ffe0956ae4ba9b1577875f312af06 and project e77732af189e48feab3752ddb28208d3. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:39:30.393506 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-51a9cf4f-ef99-4a71-8fba-a016307e49c5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:39:30.397516 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-51a9cf4f-ef99-4a71-8fba-a016307e49c5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 0a5407b3-d293-4f14-9379-b64b57b4a94b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:39:30.483313 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-51a9cf4f-ef99-4a71-8fba-a016307e49c5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.345012 Jul 25 14:39:30.486506 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1779/3369] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:39:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:39:30.494971 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-2cf15464-218b-417e-a632-54f6a5c4f4a2 req-d7cbd86e-6547-44e2-be6e-84056cff97f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d31c05d7-3525-4ad4-9eb0-5ed163707f58", "tag": "f4bf25dd-db33-4ccd-ba81-d3aa81754334"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:30.519540 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-2cf15464-218b-417e-a632-54f6a5c4f4a2 req-d7cbd86e-6547-44e2-be6e-84056cff97f2 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:30.520540 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-2cf15464-218b-417e-a632-54f6a5c4f4a2 req-d7cbd86e-6547-44e2-be6e-84056cff97f2 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:30.526733 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-14e8e235-1752-40a0-a1f8-aed10f7256d9 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a720adc1b3443a8062b3eb8c7df11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5771bc6c546646b5a432a114f76d373d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:30.538781 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-14e8e235-1752-40a0-a1f8-aed10f7256d9 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58" status: 200 len: 1318 microversion: 2.1 time: 0.940605 Jul 25 14:39:30.539846 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1591/3370] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:29 2022] GET /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58 => generated 1318 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:30.546007 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8c856662-6825-4928-94d3-b60d66a18dc3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:30.546936 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8c856662-6825-4928-94d3-b60d66a18dc3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:30.555290 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8c856662-6825-4928-94d3-b60d66a18dc3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:30.556454 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8c856662-6825-4928-94d3-b60d66a18dc3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:30.557544 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8c856662-6825-4928-94d3-b60d66a18dc3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:30.558198 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8c856662-6825-4928-94d3-b60d66a18dc3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:30.565427 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-2cf15464-218b-417e-a632-54f6a5c4f4a2 req-d7cbd86e-6547-44e2-be6e-84056cff97f2 service nova] Creating event network-changed:f4bf25dd-db33-4ccd-ba81-d3aa81754334 for instance d31c05d7-3525-4ad4-9eb0-5ed163707f58 on n-h2-846435-14 Jul 25 14:39:30.579546 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-2cf15464-218b-417e-a632-54f6a5c4f4a2 req-d7cbd86e-6547-44e2-be6e-84056cff97f2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087357 Jul 25 14:39:30.580293 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1780/3371] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:30.588433 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:39:30.589006 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e454a3e7-6e02-4956-8a77-43ddd8806025 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:30.592691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e454a3e7-6e02-4956-8a77-43ddd8806025 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:30.611924 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e454a3e7-6e02-4956-8a77-43ddd8806025 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:30.612404 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e454a3e7-6e02-4956-8a77-43ddd8806025 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:30.618323 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e454a3e7-6e02-4956-8a77-43ddd8806025 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:30.618608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e454a3e7-6e02-4956-8a77-43ddd8806025 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:30.662479 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e454a3e7-6e02-4956-8a77-43ddd8806025 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.080855 Jul 25 14:39:30.663804 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1781/3372] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Jul 25 14:39:30 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:30.668906 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a2cc3dd5-d5dc-4846-b9dc-cc80304cce56 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:30.669805 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a2cc3dd5-d5dc-4846-b9dc-cc80304cce56 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] [instance: c2d5ca5f-5c52-45f7-8d1c-f42144fe8108] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:30.682150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a2cc3dd5-d5dc-4846-b9dc-cc80304cce56 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:30.685677 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a2cc3dd5-d5dc-4846-b9dc-cc80304cce56 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:30.685677 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a2cc3dd5-d5dc-4846-b9dc-cc80304cce56 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:30.686235 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a2cc3dd5-d5dc-4846-b9dc-cc80304cce56 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:30.880958 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8c856662-6825-4928-94d3-b60d66a18dc3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:30.892511 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8c856662-6825-4928-94d3-b60d66a18dc3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1714 microversion: 2.1 time: 0.350625 Jul 25 14:39:30.893362 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1592/3373] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:30 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1714 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:30.899139 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-cf1fcb07-c461-4aa2-86cf-fe938fc7b7c2 req-884cf5c2-4613-4f46-947a-bc85f163ae0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2d5ca5f-5c52-45f7-8d1c-f42144fe8108", "name": "network-vif-plugged", "status": "completed", "tag": "8e610f6f-b342-4a2d-9ea5-5330f97c6fbb"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:30.906054 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:39:30.911426 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-cf1fcb07-c461-4aa2-86cf-fe938fc7b7c2 req-884cf5c2-4613-4f46-947a-bc85f163ae0e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:30.918068 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-cf1fcb07-c461-4aa2-86cf-fe938fc7b7c2 req-884cf5c2-4613-4f46-947a-bc85f163ae0e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:30.934776 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-cf1fcb07-c461-4aa2-86cf-fe938fc7b7c2 req-884cf5c2-4613-4f46-947a-bc85f163ae0e service nova] Creating event network-vif-plugged:8e610f6f-b342-4a2d-9ea5-5330f97c6fbb for instance c2d5ca5f-5c52-45f7-8d1c-f42144fe8108 on n-h1-846435-14 Jul 25 14:39:30.945759 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-cf1fcb07-c461-4aa2-86cf-fe938fc7b7c2 req-884cf5c2-4613-4f46-947a-bc85f163ae0e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050730 Jul 25 14:39:30.952622 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1593/3374] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:30.977367 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-03e7e4ea-8512-42f6-bca7-8c46f776103f tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:30.978497 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-03e7e4ea-8512-42f6-bca7-8c46f776103f tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: 6b535085-b43d-4a2b-84c3-b5768569def2] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:31.002407 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03e7e4ea-8512-42f6-bca7-8c46f776103f tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:31.009773 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03e7e4ea-8512-42f6-bca7-8c46f776103f tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:31.011084 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03e7e4ea-8512-42f6-bca7-8c46f776103f tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:31.011692 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03e7e4ea-8512-42f6-bca7-8c46f776103f tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:31.141349 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-03e7e4ea-8512-42f6-bca7-8c46f776103f tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:31.174950 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-03e7e4ea-8512-42f6-bca7-8c46f776103f tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers/6b535085-b43d-4a2b-84c3-b5768569def2" status: 200 len: 1479 microversion: 2.1 time: 0.219189 Jul 25 14:39:31.182301 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a2cc3dd5-d5dc-4846-b9dc-cc80304cce56 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0dcc68e92f4917ad5335e4325b7065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14292758eb5e482d97001c3ddce034ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:31.190485 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1594/3375] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:30 2022] GET /compute/v2.1/servers/6b535085-b43d-4a2b-84c3-b5768569def2 => generated 1479 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:31.199460 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a2cc3dd5-d5dc-4846-b9dc-cc80304cce56 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] 10.222.0.88 "GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108" status: 200 len: 1402 microversion: 2.1 time: 0.525705 Jul 25 14:39:31.212004 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1782/3376] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:30 2022] GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108 => generated 1402 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:31.212385 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dc3545ff-0b4e-43af-bc05-bdb8893ce0b2 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:31.212385 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-dc3545ff-0b4e-43af-bc05-bdb8893ce0b2 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 0a5407b3-d293-4f14-9379-b64b57b4a94b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:31.212996 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fb86685f-f7ce-4fcf-8085-72653a445433 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:31.220121 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fb86685f-f7ce-4fcf-8085-72653a445433 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] [instance: a398b318-1a36-4299-9be1-40a69485198b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:31.236346 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fb86685f-f7ce-4fcf-8085-72653a445433 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:31.238906 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fb86685f-f7ce-4fcf-8085-72653a445433 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:31.240357 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fb86685f-f7ce-4fcf-8085-72653a445433 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:31.240801 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fb86685f-f7ce-4fcf-8085-72653a445433 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:31.320920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-dc3545ff-0b4e-43af-bc05-bdb8893ce0b2 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:31.327815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=15 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:39:31.331317 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dc3545ff-0b4e-43af-bc05-bdb8893ce0b2 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b" status: 200 len: 1208 microversion: 2.1 time: 0.139344 Jul 25 14:39:31.337164 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1595/3377] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:31 2022] GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b => generated 1208 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:31.343720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7b6564c1-73ae-4948-ad9f-a324947a2fb0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:31.344394 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7b6564c1-73ae-4948-ad9f-a324947a2fb0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:31.350884 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b6564c1-73ae-4948-ad9f-a324947a2fb0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:31.351662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b6564c1-73ae-4948-ad9f-a324947a2fb0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:31.353310 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b6564c1-73ae-4948-ad9f-a324947a2fb0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:31.353970 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b6564c1-73ae-4948-ad9f-a324947a2fb0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:31.389076 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7b6564c1-73ae-4948-ad9f-a324947a2fb0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:39:31.495576 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7b6564c1-73ae-4948-ad9f-a324947a2fb0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "DELETE /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 204 len: 0 microversion: 2.20 time: 0.156749 Jul 25 14:39:31.496606 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1596/3378] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Jul 25 14:39:31 2022] DELETE /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 14:39:31.505366 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-72a94b5d-b4a9-4d5b-8343-3504bc799b51 req-95825d19-64a8-42cc-99ee-d596123c87e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b535085-b43d-4a2b-84c3-b5768569def2", "name": "network-vif-deleted", "tag": "0847c32d-0c3b-4bc3-9180-684c88504a3c"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:31.517156 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-72a94b5d-b4a9-4d5b-8343-3504bc799b51 req-95825d19-64a8-42cc-99ee-d596123c87e1 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:31.517504 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-72a94b5d-b4a9-4d5b-8343-3504bc799b51 req-95825d19-64a8-42cc-99ee-d596123c87e1 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:31.529734 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-72a94b5d-b4a9-4d5b-8343-3504bc799b51 req-95825d19-64a8-42cc-99ee-d596123c87e1 service nova] Creating event network-vif-deleted:0847c32d-0c3b-4bc3-9180-684c88504a3c for instance 6b535085-b43d-4a2b-84c3-b5768569def2 on n-h1-846435-14 Jul 25 14:39:31.535130 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-72a94b5d-b4a9-4d5b-8343-3504bc799b51 req-95825d19-64a8-42cc-99ee-d596123c87e1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036081 Jul 25 14:39:31.535743 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1597/3379] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:31.541171 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2e0f6c87-852d-468f-adf9-9674e714ce01 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:31.541774 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2e0f6c87-852d-468f-adf9-9674e714ce01 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:31.548533 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2e0f6c87-852d-468f-adf9-9674e714ce01 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:31.548981 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2e0f6c87-852d-468f-adf9-9674e714ce01 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:31.549791 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2e0f6c87-852d-468f-adf9-9674e714ce01 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:31.550206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2e0f6c87-852d-468f-adf9-9674e714ce01 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:31.637796 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-2e0f6c87-852d-468f-adf9-9674e714ce01 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] HTTP exception thrown: Cannot 'detach_volume' instance fac258f1-785d-4dd9-bc68-0ee713c9149a while it is in vm_state rescued Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2e0f6c87-852d-468f-adf9-9674e714ce01 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Request method failure captured: Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a/os-volume_attachments/803b5356-ea4b-4fa8-a48e-011c23bc3031 HTTP/1.1 Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qojWgWRzNqcoFtbKX69HP8TMfJcvgq5mROxrtiAbTRQQhODI65548klI2mwspV0aDgelkydSdF0jDfbt9K1MKvAqBkxkDKwdPBnneXznLL8230WZKLHZUg-qMlSHwLMR2RP6Be2wdwzhEY6xsA-ygO39xLQI8y2VkgTqIORhZUeWIM Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 2f1bd935e917484799f31ad643eafb2a Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-756792154 Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2f1bd935e917484799f31ad643eafb2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2f1bd935e917484799f31ad643eafb2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2f1bd935e917484799f31ad643eafb2a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2f1bd935e917484799f31ad643eafb2a"}]}] Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServerRescueNegativeTestJSON-756792154 Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 2f1bd935e917484799f31ad643eafb2a Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-756792154 Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServerRescueNegativeTestJSON-756792154-project Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 9f2ddec1bc6244739e9ac3a40c064b53 Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServerRescueNegativeTestJSON-756792154-project Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: exception: Cannot 'detach_volume' instance fac258f1-785d-4dd9-bc68-0ee713c9149a while it is in vm_state rescued Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'server_id': 'fac258f1-785d-4dd9-bc68-0ee713c9149a', 'id': '803b5356-ea4b-4fa8-a48e-011c23bc3031'} Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fac258f1-785d-4dd9-bc68-0ee713c9149a in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance fac258f1-785d-4dd9-bc68-0ee713c9149a while it is in vm_state rescued Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:31.639462 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:31.643674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:31.643674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:31.643674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:39:31.643674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:39:31.643674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance fac258f1-785d-4dd9-bc68-0ee713c9149a while it is in vm_state rescued Jul 25 14:39:31.643674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:31.643674 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2e0f6c87-852d-468f-adf9-9674e714ce01 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Returning 409 to user: Cannot 'detach_volume' instance fac258f1-785d-4dd9-bc68-0ee713c9149a while it is in vm_state rescued {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:39:31.643674 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2e0f6c87-852d-468f-adf9-9674e714ce01 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "DELETE /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a/os-volume_attachments/803b5356-ea4b-4fa8-a48e-011c23bc3031" status: 409 len: 152 microversion: 2.1 time: 0.103976 Jul 25 14:39:31.643674 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1598/3380] 10.222.0.88 () {58 vars in 1416 bytes} [Mon Jul 25 14:39:31 2022] DELETE /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a/os-volume_attachments/803b5356-ea4b-4fa8-a48e-011c23bc3031 => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:39:31.646520 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8cde1aba-7f11-4568-a702-6e20df581107 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:31.647157 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8cde1aba-7f11-4568-a702-6e20df581107 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:31.654231 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8cde1aba-7f11-4568-a702-6e20df581107 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:31.654691 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8cde1aba-7f11-4568-a702-6e20df581107 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:31.655476 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8cde1aba-7f11-4568-a702-6e20df581107 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:31.655919 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8cde1aba-7f11-4568-a702-6e20df581107 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:31.808543 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fb86685f-f7ce-4fcf-8085-72653a445433 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7416803295914693a3e077649db2b47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf5a16e97944d9861d93405209cc37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:31.819508 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fb86685f-f7ce-4fcf-8085-72653a445433 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] 10.222.0.88 "GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b" status: 200 len: 1323 microversion: 2.1 time: 0.617219 Jul 25 14:39:31.820475 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1783/3381] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:31 2022] GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b => generated 1323 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:31.827061 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a33cf075-fa09-49a4-8af4-db176288de44 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:31.827887 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a33cf075-fa09-49a4-8af4-db176288de44 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: d31c05d7-3525-4ad4-9eb0-5ed163707f58] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:31.835572 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a33cf075-fa09-49a4-8af4-db176288de44 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:31.837120 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a33cf075-fa09-49a4-8af4-db176288de44 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:31.838146 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a33cf075-fa09-49a4-8af4-db176288de44 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:31.838945 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a33cf075-fa09-49a4-8af4-db176288de44 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:31.863268 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8cde1aba-7f11-4568-a702-6e20df581107 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:31.881014 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8cde1aba-7f11-4568-a702-6e20df581107 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:31.882729 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8cde1aba-7f11-4568-a702-6e20df581107 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:31.887020 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8cde1aba-7f11-4568-a702-6e20df581107 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1723 microversion: 2.20 time: 0.241767 Jul 25 14:39:31.889107 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1599/3382] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:39:31 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:39:31.899919 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-797c0522-00cf-4560-b2e5-33953d2579cb tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:31.900718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-797c0522-00cf-4560-b2e5-33953d2579cb tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:31.922930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-797c0522-00cf-4560-b2e5-33953d2579cb tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:31.923407 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-797c0522-00cf-4560-b2e5-33953d2579cb tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:31.924938 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-797c0522-00cf-4560-b2e5-33953d2579cb tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:31.925082 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-797c0522-00cf-4560-b2e5-33953d2579cb tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:32.034205 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-797c0522-00cf-4560-b2e5-33953d2579cb tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "POST /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a/action" status: 202 len: 0 microversion: 2.1 time: 0.142837 Jul 25 14:39:32.035262 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1600/3383] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:39:31 2022] POST /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:39:32.039295 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a33cf075-fa09-49a4-8af4-db176288de44 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a720adc1b3443a8062b3eb8c7df11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5771bc6c546646b5a432a114f76d373d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:32.045387 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e22b655e-28cc-4e4c-934e-b0393dd06c29 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:32.047119 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e22b655e-28cc-4e4c-934e-b0393dd06c29 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:32.048282 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a33cf075-fa09-49a4-8af4-db176288de44 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58" status: 200 len: 1318 microversion: 2.1 time: 0.226019 Jul 25 14:39:32.049090 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1784/3384] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:31 2022] GET /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:32.058593 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e22b655e-28cc-4e4c-934e-b0393dd06c29 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:32.059274 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e22b655e-28cc-4e4c-934e-b0393dd06c29 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:32.060538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e22b655e-28cc-4e4c-934e-b0393dd06c29 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:32.061484 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e22b655e-28cc-4e4c-934e-b0393dd06c29 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:32.201841 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-677e560e-242f-4484-8f4a-1e3237f29010 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:32.202886 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-677e560e-242f-4484-8f4a-1e3237f29010 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: 6b535085-b43d-4a2b-84c3-b5768569def2] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:32.212370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-677e560e-242f-4484-8f4a-1e3237f29010 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:32.213913 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-677e560e-242f-4484-8f4a-1e3237f29010 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:32.215285 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-677e560e-242f-4484-8f4a-1e3237f29010 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:32.215997 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-677e560e-242f-4484-8f4a-1e3237f29010 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:32.228748 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e22b655e-28cc-4e4c-934e-b0393dd06c29 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:32.237335 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-677e560e-242f-4484-8f4a-1e3237f29010 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] HTTP exception thrown: Instance 6b535085-b43d-4a2b-84c3-b5768569def2 could not be found. Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-677e560e-242f-4484-8f4a-1e3237f29010 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Request method failure captured: Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/6b535085-b43d-4a2b-84c3-b5768569def2 HTTP/1.1 Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qr3b99SUhrrqSW3L1qFyB1tMv30VatZZSlc903gsEkYjhIZrUJnWbb_jQ9ggeaRuCB77ytz9bfQvNo4TjPG5KMX9JNTxRo2kuoAX9f8ysNoiHZYAZ6rTbf6AsbQxYhkeqvmyiYofGeyQXkDQ4mXmPZsWZDv3TPE3NhY7_lEGt8BP90 Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 68dee301e8c24a98abef98fc0617bc96 Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ListServersNegativeTestJSON-1989822960 Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/68dee301e8c24a98abef98fc0617bc96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/68dee301e8c24a98abef98fc0617bc96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_68dee301e8c24a98abef98fc0617bc96", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/68dee301e8c24a98abef98fc0617bc96"}]}] Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ListServersNegativeTestJSON-1989822960 Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 68dee301e8c24a98abef98fc0617bc96 Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1989822960 Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ListServersNegativeTestJSON-1989822960-project Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 1cfa029cfa58426da97a2d0857dabf78 Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ListServersNegativeTestJSON-1989822960-project Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 6b535085-b43d-4a2b-84c3-b5768569def2 could not be found. Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '6b535085-b43d-4a2b-84c3-b5768569def2'} Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b535085-b43d-4a2b-84c3-b5768569def2 could not be found. Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b535085-b43d-4a2b-84c3-b5768569def2 could not be found. Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:32.239435 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:32.258246 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:32.258246 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:32.258246 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:32.258246 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:39:32.258246 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:39:32.258246 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b535085-b43d-4a2b-84c3-b5768569def2 could not be found. Jul 25 14:39:32.258246 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:32.259878 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e22b655e-28cc-4e4c-934e-b0393dd06c29 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1722 microversion: 2.1 time: 0.199915 Jul 25 14:39:32.259878 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1601/3385] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:32 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:32.259878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4be77b26-0e85-444c-b310-bf837f23a6da tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:32.259878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4be77b26-0e85-444c-b310-bf837f23a6da tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] [instance: c2d5ca5f-5c52-45f7-8d1c-f42144fe8108] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:32.259878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4be77b26-0e85-444c-b310-bf837f23a6da tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:32.259878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4be77b26-0e85-444c-b310-bf837f23a6da tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:32.259878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4be77b26-0e85-444c-b310-bf837f23a6da tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:32.259878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4be77b26-0e85-444c-b310-bf837f23a6da tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:32.263269 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-677e560e-242f-4484-8f4a-1e3237f29010 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Returning 404 to user: Instance 6b535085-b43d-4a2b-84c3-b5768569def2 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:39:32.264386 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-677e560e-242f-4484-8f4a-1e3237f29010 tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers/6b535085-b43d-4a2b-84c3-b5768569def2" status: 404 len: 111 microversion: 2.1 time: 0.067843 Jul 25 14:39:32.268610 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1785/3386] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:32 2022] GET /compute/v2.1/servers/6b535085-b43d-4a2b-84c3-b5768569def2 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:39:32.274649 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fe843bde-ff77-4b77-a462-ad0f5e06e8be tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:32.275389 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fe843bde-ff77-4b77-a462-ad0f5e06e8be tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: 88b6bb55-179d-42a2-aab1-53aefc8e536d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:32.282102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fe843bde-ff77-4b77-a462-ad0f5e06e8be tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:32.282638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fe843bde-ff77-4b77-a462-ad0f5e06e8be tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:32.283527 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fe843bde-ff77-4b77-a462-ad0f5e06e8be tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:32.284369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fe843bde-ff77-4b77-a462-ad0f5e06e8be tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:32.383952 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fe843bde-ff77-4b77-a462-ad0f5e06e8be tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:32.394075 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fe843bde-ff77-4b77-a462-ad0f5e06e8be tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d" status: 200 len: 1480 microversion: 2.1 time: 0.124290 Jul 25 14:39:32.399858 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1786/3387] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:32 2022] GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d => generated 1480 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:32.405041 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-45557927-b1b3-4606-b6b3-5105054018ab tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:32.405834 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-45557927-b1b3-4606-b6b3-5105054018ab tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 0a5407b3-d293-4f14-9379-b64b57b4a94b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:32.413493 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45557927-b1b3-4606-b6b3-5105054018ab tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:32.414218 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45557927-b1b3-4606-b6b3-5105054018ab tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:32.415218 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45557927-b1b3-4606-b6b3-5105054018ab tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:32.415823 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45557927-b1b3-4606-b6b3-5105054018ab tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:32.432705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4be77b26-0e85-444c-b310-bf837f23a6da tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0dcc68e92f4917ad5335e4325b7065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14292758eb5e482d97001c3ddce034ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:32.442599 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4be77b26-0e85-444c-b310-bf837f23a6da tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] 10.222.0.88 "GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108" status: 200 len: 1402 microversion: 2.1 time: 0.199057 Jul 25 14:39:32.443772 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1602/3388] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:32 2022] GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108 => generated 1402 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:32.546371 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-45557927-b1b3-4606-b6b3-5105054018ab tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:32.556510 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-45557927-b1b3-4606-b6b3-5105054018ab tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b" status: 200 len: 1204 microversion: 2.1 time: 0.155123 Jul 25 14:39:32.559089 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1787/3389] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:32 2022] GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b => generated 1204 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:32.638929 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-84d7f5e5-cace-4618-9933-5fc24dfc8819 req-6093f900-63c3-4c85-8c54-2b7d6317283a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b6bb55-179d-42a2-aab1-53aefc8e536d", "name": "network-vif-deleted", "tag": "c9b223ac-704e-4be8-9d23-c8e08c833408"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:32.665681 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-84d7f5e5-cace-4618-9933-5fc24dfc8819 req-6093f900-63c3-4c85-8c54-2b7d6317283a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:32.666480 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-84d7f5e5-cace-4618-9933-5fc24dfc8819 req-6093f900-63c3-4c85-8c54-2b7d6317283a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:32.680689 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-84d7f5e5-cace-4618-9933-5fc24dfc8819 req-6093f900-63c3-4c85-8c54-2b7d6317283a service nova] Creating event network-vif-deleted:c9b223ac-704e-4be8-9d23-c8e08c833408 for instance 88b6bb55-179d-42a2-aab1-53aefc8e536d on n-h2-846435-14 Jul 25 14:39:32.687627 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-84d7f5e5-cace-4618-9933-5fc24dfc8819 req-6093f900-63c3-4c85-8c54-2b7d6317283a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054204 Jul 25 14:39:32.694380 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1603/3390] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:39:32.843473 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-497e70fb-6f74-4914-8210-5d888426a841 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:32.844815 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-497e70fb-6f74-4914-8210-5d888426a841 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] [instance: a398b318-1a36-4299-9be1-40a69485198b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:32.853757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-497e70fb-6f74-4914-8210-5d888426a841 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:32.854215 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-497e70fb-6f74-4914-8210-5d888426a841 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:32.855126 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-497e70fb-6f74-4914-8210-5d888426a841 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:32.855561 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-497e70fb-6f74-4914-8210-5d888426a841 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:32.917387 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-915c0a7c-a129-4b66-94e6-6ae59bc665bf tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:32.919457 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-915c0a7c-a129-4b66-94e6-6ae59bc665bf tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:32.950061 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-915c0a7c-a129-4b66-94e6-6ae59bc665bf tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:32.951567 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-915c0a7c-a129-4b66-94e6-6ae59bc665bf tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:32.953784 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-915c0a7c-a129-4b66-94e6-6ae59bc665bf tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:32.954288 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-915c0a7c-a129-4b66-94e6-6ae59bc665bf tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:33.129005 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-497e70fb-6f74-4914-8210-5d888426a841 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7416803295914693a3e077649db2b47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf5a16e97944d9861d93405209cc37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:33.144498 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-497e70fb-6f74-4914-8210-5d888426a841 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] 10.222.0.88 "GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b" status: 200 len: 1323 microversion: 2.1 time: 0.302847 Jul 25 14:39:33.158505 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1788/3391] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:32 2022] GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b => generated 1323 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:33.173089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-71b55dd9-1bac-4aa7-ae5b-be30e7418c0d req-5784bee8-b448-4543-8087-c13be9973d27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a398b318-1a36-4299-9be1-40a69485198b", "name": "network-vif-plugged", "status": "completed", "tag": "4fc7b16c-5223-4535-aa7b-5931230ade6f"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:33.199914 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-71b55dd9-1bac-4aa7-ae5b-be30e7418c0d req-5784bee8-b448-4543-8087-c13be9973d27 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:33.201940 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-71b55dd9-1bac-4aa7-ae5b-be30e7418c0d req-5784bee8-b448-4543-8087-c13be9973d27 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:33.220456 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-71b55dd9-1bac-4aa7-ae5b-be30e7418c0d req-5784bee8-b448-4543-8087-c13be9973d27 service nova] Creating event network-vif-plugged:4fc7b16c-5223-4535-aa7b-5931230ade6f for instance a398b318-1a36-4299-9be1-40a69485198b on n-h2-846435-14 Jul 25 14:39:33.227227 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-71b55dd9-1bac-4aa7-ae5b-be30e7418c0d req-5784bee8-b448-4543-8087-c13be9973d27 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064517 Jul 25 14:39:33.228865 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1789/3392] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:33.236931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bb086944-13b2-4704-84a8-a17117c6954e tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:33.237731 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bb086944-13b2-4704-84a8-a17117c6954e tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: d31c05d7-3525-4ad4-9eb0-5ed163707f58] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:33.245915 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bb086944-13b2-4704-84a8-a17117c6954e tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:33.246560 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bb086944-13b2-4704-84a8-a17117c6954e tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:33.247549 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bb086944-13b2-4704-84a8-a17117c6954e tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:33.248533 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bb086944-13b2-4704-84a8-a17117c6954e tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:33.471517 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bb086944-13b2-4704-84a8-a17117c6954e tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a720adc1b3443a8062b3eb8c7df11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5771bc6c546646b5a432a114f76d373d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:33.482870 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bb086944-13b2-4704-84a8-a17117c6954e tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58" status: 200 len: 1318 microversion: 2.1 time: 0.249979 Jul 25 14:39:33.484170 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1790/3393] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:33 2022] GET /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:33.492791 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9015fe6e-0b42-4ccd-b2f0-afd230869a53 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:33.493762 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9015fe6e-0b42-4ccd-b2f0-afd230869a53 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:33.504202 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9015fe6e-0b42-4ccd-b2f0-afd230869a53 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:33.504854 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9015fe6e-0b42-4ccd-b2f0-afd230869a53 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:33.505827 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9015fe6e-0b42-4ccd-b2f0-afd230869a53 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:33.506444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9015fe6e-0b42-4ccd-b2f0-afd230869a53 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:33.551951 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-915c0a7c-a129-4b66-94e6-6ae59bc665bf tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:33.560775 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-915c0a7c-a129-4b66-94e6-6ae59bc665bf tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:33.562571 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-915c0a7c-a129-4b66-94e6-6ae59bc665bf tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:33.564013 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-915c0a7c-a129-4b66-94e6-6ae59bc665bf tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1723 microversion: 2.20 time: 0.652617 Jul 25 14:39:33.564855 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1604/3394] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:39:32 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1723 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:39:33.569899 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d9002e67-62af-4333-aa98-de4e528d745e tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:33.570771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d9002e67-62af-4333-aa98-de4e528d745e tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: 88b6bb55-179d-42a2-aab1-53aefc8e536d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:33.577467 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d9002e67-62af-4333-aa98-de4e528d745e tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:33.578167 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d9002e67-62af-4333-aa98-de4e528d745e tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:33.579199 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d9002e67-62af-4333-aa98-de4e528d745e tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:33.579848 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d9002e67-62af-4333-aa98-de4e528d745e tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:33.614106 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d9002e67-62af-4333-aa98-de4e528d745e tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:33.614815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d9002e67-62af-4333-aa98-de4e528d745e tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:33.615539 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-d9002e67-62af-4333-aa98-de4e528d745e tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lazy-loading 'fault' on Instance uuid 88b6bb55-179d-42a2-aab1-53aefc8e536d {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:39:33.676166 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9015fe6e-0b42-4ccd-b2f0-afd230869a53 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:33.686774 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9015fe6e-0b42-4ccd-b2f0-afd230869a53 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1722 microversion: 2.1 time: 0.201324 Jul 25 14:39:33.687938 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1791/3395] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:33 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:33.692794 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a100749f-f280-497a-861d-c3c9b03b36c2 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:33.693410 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a100749f-f280-497a-861d-c3c9b03b36c2 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] [instance: c2d5ca5f-5c52-45f7-8d1c-f42144fe8108] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:33.699668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a100749f-f280-497a-861d-c3c9b03b36c2 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:33.700318 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a100749f-f280-497a-861d-c3c9b03b36c2 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:33.701270 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a100749f-f280-497a-861d-c3c9b03b36c2 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:33.701697 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a100749f-f280-497a-861d-c3c9b03b36c2 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:33.706073 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:39:33.736432 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d9002e67-62af-4333-aa98-de4e528d745e tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfa029cfa58426da97a2d0857dabf78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dee301e8c24a98abef98fc0617bc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:33.745287 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d9002e67-62af-4333-aa98-de4e528d745e tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d" status: 200 len: 1312 microversion: 2.1 time: 0.179153 Jul 25 14:39:33.745982 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1605/3396] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:33 2022] GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d => generated 1312 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:33.750794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f829a5d4-92ed-4129-bc7c-b7b2ca42cee5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:33.751814 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f829a5d4-92ed-4129-bc7c-b7b2ca42cee5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 0a5407b3-d293-4f14-9379-b64b57b4a94b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:33.758502 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f829a5d4-92ed-4129-bc7c-b7b2ca42cee5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:33.759235 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f829a5d4-92ed-4129-bc7c-b7b2ca42cee5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:33.760535 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f829a5d4-92ed-4129-bc7c-b7b2ca42cee5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:33.761193 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f829a5d4-92ed-4129-bc7c-b7b2ca42cee5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:33.886071 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a100749f-f280-497a-861d-c3c9b03b36c2 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0dcc68e92f4917ad5335e4325b7065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14292758eb5e482d97001c3ddce034ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:33.894493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f829a5d4-92ed-4129-bc7c-b7b2ca42cee5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:33.898061 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a100749f-f280-497a-861d-c3c9b03b36c2 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] 10.222.0.88 "GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108" status: 200 len: 1590 microversion: 2.1 time: 0.208394 Jul 25 14:39:33.898765 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1792/3397] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:33 2022] GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108 => generated 1590 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:33.918463 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f829a5d4-92ed-4129-bc7c-b7b2ca42cee5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b" status: 200 len: 1266 microversion: 2.1 time: 0.171143 Jul 25 14:39:33.925606 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1606/3398] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:33 2022] GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:34.004466 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2bcf60f9-230a-466e-871c-fff0f7922039 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:34.005400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2bcf60f9-230a-466e-871c-fff0f7922039 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] [instance: c2d5ca5f-5c52-45f7-8d1c-f42144fe8108] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:34.012503 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2bcf60f9-230a-466e-871c-fff0f7922039 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:34.013090 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2bcf60f9-230a-466e-871c-fff0f7922039 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:34.014015 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2bcf60f9-230a-466e-871c-fff0f7922039 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:34.014555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2bcf60f9-230a-466e-871c-fff0f7922039 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:34.107052 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2bcf60f9-230a-466e-871c-fff0f7922039 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] 10.222.0.88 "GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107582 Jul 25 14:39:34.113874 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1793/3399] 10.222.0.88 () {58 vars in 1275 bytes} [Mon Jul 25 14:39:33 2022] GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:34.174388 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dbb17107-1df3-4cc5-b1f1-a2014aaa6680 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:34.175074 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-dbb17107-1df3-4cc5-b1f1-a2014aaa6680 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] [instance: a398b318-1a36-4299-9be1-40a69485198b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:34.182948 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dbb17107-1df3-4cc5-b1f1-a2014aaa6680 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:34.183962 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dbb17107-1df3-4cc5-b1f1-a2014aaa6680 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:34.185596 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dbb17107-1df3-4cc5-b1f1-a2014aaa6680 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:34.186277 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dbb17107-1df3-4cc5-b1f1-a2014aaa6680 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:34.509376 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-94050ba6-a459-46c6-a5b2-5ba072e3a22d tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:34.510305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-94050ba6-a459-46c6-a5b2-5ba072e3a22d tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: d31c05d7-3525-4ad4-9eb0-5ed163707f58] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:34.522691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94050ba6-a459-46c6-a5b2-5ba072e3a22d tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:34.523592 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94050ba6-a459-46c6-a5b2-5ba072e3a22d tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:34.524565 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94050ba6-a459-46c6-a5b2-5ba072e3a22d tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:34.525353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94050ba6-a459-46c6-a5b2-5ba072e3a22d tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:34.547301 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-dbb17107-1df3-4cc5-b1f1-a2014aaa6680 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7416803295914693a3e077649db2b47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf5a16e97944d9861d93405209cc37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:34.559642 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dbb17107-1df3-4cc5-b1f1-a2014aaa6680 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] 10.222.0.88 "GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b" status: 200 len: 1323 microversion: 2.1 time: 0.387329 Jul 25 14:39:34.573248 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1607/3400] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:34 2022] GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b => generated 1323 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:34.587001 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c66f47b0-d77f-4b13-bef8-addebba6d2ff tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:34.587567 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c66f47b0-d77f-4b13-bef8-addebba6d2ff tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:34.599899 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c66f47b0-d77f-4b13-bef8-addebba6d2ff tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:34.600519 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c66f47b0-d77f-4b13-bef8-addebba6d2ff tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:34.601306 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c66f47b0-d77f-4b13-bef8-addebba6d2ff tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:34.601838 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c66f47b0-d77f-4b13-bef8-addebba6d2ff tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:35.054018 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c66f47b0-d77f-4b13-bef8-addebba6d2ff tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:35.065575 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c66f47b0-d77f-4b13-bef8-addebba6d2ff tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:35.067750 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c66f47b0-d77f-4b13-bef8-addebba6d2ff tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:35.069126 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c66f47b0-d77f-4b13-bef8-addebba6d2ff tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1723 microversion: 2.20 time: 0.486293 Jul 25 14:39:35.070038 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1608/3401] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:39:34 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1723 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:39:35.076478 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3e079697-e59f-4bd5-9bbd-0f63c38c80e7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:35.077259 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3e079697-e59f-4bd5-9bbd-0f63c38c80e7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:35.085331 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3e079697-e59f-4bd5-9bbd-0f63c38c80e7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:35.086590 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3e079697-e59f-4bd5-9bbd-0f63c38c80e7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:35.087557 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3e079697-e59f-4bd5-9bbd-0f63c38c80e7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:35.088090 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3e079697-e59f-4bd5-9bbd-0f63c38c80e7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:35.094823 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:39:35.366208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-94050ba6-a459-46c6-a5b2-5ba072e3a22d tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a720adc1b3443a8062b3eb8c7df11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5771bc6c546646b5a432a114f76d373d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:35.388624 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-94050ba6-a459-46c6-a5b2-5ba072e3a22d tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58" status: 200 len: 1318 microversion: 2.1 time: 0.872547 Jul 25 14:39:35.402021 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1794/3402] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:34 2022] GET /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58 => generated 1318 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:39:35.402021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8d82156e-7281-4bc2-9362-7858e92a401b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:35.402021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8d82156e-7281-4bc2-9362-7858e92a401b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] [instance: 88b6bb55-179d-42a2-aab1-53aefc8e536d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:35.418366 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d82156e-7281-4bc2-9362-7858e92a401b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:35.418722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d82156e-7281-4bc2-9362-7858e92a401b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:35.419505 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d82156e-7281-4bc2-9362-7858e92a401b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:35.419946 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d82156e-7281-4bc2-9362-7858e92a401b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:35.459219 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-8d82156e-7281-4bc2-9362-7858e92a401b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] HTTP exception thrown: Instance 88b6bb55-179d-42a2-aab1-53aefc8e536d could not be found. Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8d82156e-7281-4bc2-9362-7858e92a401b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Request method failure captured: Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d HTTP/1.1 Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qr3b99SUhrrqSW3L1qFyB1tMv30VatZZSlc903gsEkYjhIZrUJnWbb_jQ9ggeaRuCB77ytz9bfQvNo4TjPG5KMX9JNTxRo2kuoAX9f8ysNoiHZYAZ6rTbf6AsbQxYhkeqvmyiYofGeyQXkDQ4mXmPZsWZDv3TPE3NhY7_lEGt8BP90 Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 68dee301e8c24a98abef98fc0617bc96 Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ListServersNegativeTestJSON-1989822960 Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/68dee301e8c24a98abef98fc0617bc96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/68dee301e8c24a98abef98fc0617bc96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_68dee301e8c24a98abef98fc0617bc96", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/68dee301e8c24a98abef98fc0617bc96"}]}] Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ListServersNegativeTestJSON-1989822960 Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 68dee301e8c24a98abef98fc0617bc96 Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1989822960 Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ListServersNegativeTestJSON-1989822960-project Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 1cfa029cfa58426da97a2d0857dabf78 Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ListServersNegativeTestJSON-1989822960-project Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 88b6bb55-179d-42a2-aab1-53aefc8e536d could not be found. Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '88b6bb55-179d-42a2-aab1-53aefc8e536d'} Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88b6bb55-179d-42a2-aab1-53aefc8e536d could not be found. Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88b6bb55-179d-42a2-aab1-53aefc8e536d could not be found. Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:35.461471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:35.469386 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:35.469386 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:35.469386 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:35.469386 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:39:35.469386 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:39:35.469386 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88b6bb55-179d-42a2-aab1-53aefc8e536d could not be found. Jul 25 14:39:35.469386 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:35.469386 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8d82156e-7281-4bc2-9362-7858e92a401b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] Returning 404 to user: Instance 88b6bb55-179d-42a2-aab1-53aefc8e536d could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:39:35.469386 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8d82156e-7281-4bc2-9362-7858e92a401b tempest-ListServersNegativeTestJSON-1989822960 tempest-ListServersNegativeTestJSON-1989822960-project] 10.222.0.88 "GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d" status: 404 len: 111 microversion: 2.1 time: 0.070082 Jul 25 14:39:35.474649 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1795/3403] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:35 2022] GET /compute/v2.1/servers/88b6bb55-179d-42a2-aab1-53aefc8e536d => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:39:35.482910 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3fab071a-74ed-4078-a372-123a60b75b6f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:35.491037 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3fab071a-74ed-4078-a372-123a60b75b6f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 0a5407b3-d293-4f14-9379-b64b57b4a94b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:35.507115 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3fab071a-74ed-4078-a372-123a60b75b6f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:35.508170 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3fab071a-74ed-4078-a372-123a60b75b6f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:35.510782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3fab071a-74ed-4078-a372-123a60b75b6f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:35.511545 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3fab071a-74ed-4078-a372-123a60b75b6f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:35.617262 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:39:35.722374 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3e079697-e59f-4bd5-9bbd-0f63c38c80e7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:35.739419 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3e079697-e59f-4bd5-9bbd-0f63c38c80e7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1722 microversion: 2.1 time: 0.667657 Jul 25 14:39:35.740907 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1609/3404] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:35 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1722 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:35.759842 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c742e65c-c8b7-43db-ab47-8f8ca73032cc tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:35.760507 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c742e65c-c8b7-43db-ab47-8f8ca73032cc tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] [instance: a398b318-1a36-4299-9be1-40a69485198b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:35.792380 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c742e65c-c8b7-43db-ab47-8f8ca73032cc tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:35.795994 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c742e65c-c8b7-43db-ab47-8f8ca73032cc tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:35.799009 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c742e65c-c8b7-43db-ab47-8f8ca73032cc tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:35.799676 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c742e65c-c8b7-43db-ab47-8f8ca73032cc tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:36.015605 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3fab071a-74ed-4078-a372-123a60b75b6f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:36.028697 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3fab071a-74ed-4078-a372-123a60b75b6f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b" status: 200 len: 1308 microversion: 2.1 time: 0.551513 Jul 25 14:39:36.030859 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1796/3405] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:35 2022] GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b => generated 1308 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:36.097830 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4c834f15-9474-409a-a09d-97f196eb4769 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:36.099401 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4c834f15-9474-409a-a09d-97f196eb4769 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:36.108004 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4c834f15-9474-409a-a09d-97f196eb4769 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:36.108704 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4c834f15-9474-409a-a09d-97f196eb4769 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:36.110373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4c834f15-9474-409a-a09d-97f196eb4769 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:36.110979 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4c834f15-9474-409a-a09d-97f196eb4769 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:36.505902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4c834f15-9474-409a-a09d-97f196eb4769 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:36.535384 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4c834f15-9474-409a-a09d-97f196eb4769 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:36.537530 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4c834f15-9474-409a-a09d-97f196eb4769 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:36.539089 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4c834f15-9474-409a-a09d-97f196eb4769 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1723 microversion: 2.20 time: 0.447098 Jul 25 14:39:36.552244 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1797/3406] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:39:36 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1723 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:39:36.552244 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c0961f1e-0d9d-4b84-8874-fabddada0732 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:36.552244 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c0961f1e-0d9d-4b84-8874-fabddada0732 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: d31c05d7-3525-4ad4-9eb0-5ed163707f58] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:36.573669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c0961f1e-0d9d-4b84-8874-fabddada0732 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:36.577557 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c0961f1e-0d9d-4b84-8874-fabddada0732 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:36.580803 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c0961f1e-0d9d-4b84-8874-fabddada0732 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:36.581413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c0961f1e-0d9d-4b84-8874-fabddada0732 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:36.592652 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c742e65c-c8b7-43db-ab47-8f8ca73032cc tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7416803295914693a3e077649db2b47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf5a16e97944d9861d93405209cc37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:36.608421 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c742e65c-c8b7-43db-ab47-8f8ca73032cc tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] 10.222.0.88 "GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b" status: 200 len: 1323 microversion: 2.1 time: 0.860268 Jul 25 14:39:36.609527 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1610/3407] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:35 2022] GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b => generated 1323 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:36.771596 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8905d373-3bf4-49b5-99e0-34913258e77f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:36.772877 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8905d373-3bf4-49b5-99e0-34913258e77f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:36.781241 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8905d373-3bf4-49b5-99e0-34913258e77f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:36.782251 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8905d373-3bf4-49b5-99e0-34913258e77f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:36.784581 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8905d373-3bf4-49b5-99e0-34913258e77f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:36.786972 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8905d373-3bf4-49b5-99e0-34913258e77f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:37.577471 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c0961f1e-0d9d-4b84-8874-fabddada0732 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a720adc1b3443a8062b3eb8c7df11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5771bc6c546646b5a432a114f76d373d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:37.586797 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c0961f1e-0d9d-4b84-8874-fabddada0732 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58" status: 200 len: 1318 microversion: 2.1 time: 1.040995 Jul 25 14:39:37.587717 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1798/3408] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:36 2022] GET /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58 => generated 1318 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:37.593190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-4941ca26-ed6d-4d64-9cfe-e750b9258857 req-1466414b-615f-4886-ae11-7c62789b9145 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d31c05d7-3525-4ad4-9eb0-5ed163707f58", "name": "network-vif-plugged", "status": "completed", "tag": "f4bf25dd-db33-4ccd-ba81-d3aa81754334"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:37.596923 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8905d373-3bf4-49b5-99e0-34913258e77f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:37.610415 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8905d373-3bf4-49b5-99e0-34913258e77f tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1728 microversion: 2.1 time: 0.843708 Jul 25 14:39:37.615823 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1611/3409] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:36 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1728 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:37.622573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:39:37.626763 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-97759bed-4593-4b6c-8a5c-56b7cd682c26 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:37.627605 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-97759bed-4593-4b6c-8a5c-56b7cd682c26 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 0a5407b3-d293-4f14-9379-b64b57b4a94b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:37.648311 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-4941ca26-ed6d-4d64-9cfe-e750b9258857 req-1466414b-615f-4886-ae11-7c62789b9145 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:37.649231 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-4941ca26-ed6d-4d64-9cfe-e750b9258857 req-1466414b-615f-4886-ae11-7c62789b9145 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:37.653775 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-97759bed-4593-4b6c-8a5c-56b7cd682c26 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:37.654587 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-97759bed-4593-4b6c-8a5c-56b7cd682c26 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:37.655058 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-97759bed-4593-4b6c-8a5c-56b7cd682c26 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:37.655855 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-97759bed-4593-4b6c-8a5c-56b7cd682c26 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:37.685825 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-4941ca26-ed6d-4d64-9cfe-e750b9258857 req-1466414b-615f-4886-ae11-7c62789b9145 service nova] Creating event network-vif-plugged:f4bf25dd-db33-4ccd-ba81-d3aa81754334 for instance d31c05d7-3525-4ad4-9eb0-5ed163707f58 on n-h2-846435-14 Jul 25 14:39:37.713069 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-4941ca26-ed6d-4d64-9cfe-e750b9258857 req-1466414b-615f-4886-ae11-7c62789b9145 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123913 Jul 25 14:39:37.713931 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1799/3410] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:37.726261 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-39f3b343-96f2-4169-b188-34be865fcf5c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:37.736364 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-39f3b343-96f2-4169-b188-34be865fcf5c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:37.751566 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-39f3b343-96f2-4169-b188-34be865fcf5c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:37.755767 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-39f3b343-96f2-4169-b188-34be865fcf5c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:37.758044 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-39f3b343-96f2-4169-b188-34be865fcf5c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:37.759692 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-39f3b343-96f2-4169-b188-34be865fcf5c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:37.892112 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-39f3b343-96f2-4169-b188-34be865fcf5c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:37.901737 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-39f3b343-96f2-4169-b188-34be865fcf5c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:37.903730 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-39f3b343-96f2-4169-b188-34be865fcf5c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:37.905116 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-39f3b343-96f2-4169-b188-34be865fcf5c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1655 microversion: 2.20 time: 0.189327 Jul 25 14:39:37.907009 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1800/3411] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:39:37 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1655 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:39:37.912165 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0851d179-e4a5-4c8a-98cd-42b2eed0136e tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:37.913033 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0851d179-e4a5-4c8a-98cd-42b2eed0136e tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] [instance: a398b318-1a36-4299-9be1-40a69485198b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:37.919629 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0851d179-e4a5-4c8a-98cd-42b2eed0136e tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:37.920392 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0851d179-e4a5-4c8a-98cd-42b2eed0136e tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:37.921328 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0851d179-e4a5-4c8a-98cd-42b2eed0136e tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:37.921927 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0851d179-e4a5-4c8a-98cd-42b2eed0136e tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:38.237727 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-97759bed-4593-4b6c-8a5c-56b7cd682c26 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:38.260600 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-97759bed-4593-4b6c-8a5c-56b7cd682c26 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b" status: 200 len: 1308 microversion: 2.1 time: 0.643224 Jul 25 14:39:38.262490 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1612/3412] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:37 2022] GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b => generated 1308 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:38.285849 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-360f4da2-e093-4818-9f32-28468221073e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:38.286915 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-360f4da2-e093-4818-9f32-28468221073e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:38.296756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-360f4da2-e093-4818-9f32-28468221073e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:38.297628 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-360f4da2-e093-4818-9f32-28468221073e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:38.300321 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0851d179-e4a5-4c8a-98cd-42b2eed0136e tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7416803295914693a3e077649db2b47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf5a16e97944d9861d93405209cc37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:38.302175 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-360f4da2-e093-4818-9f32-28468221073e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:38.302819 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-360f4da2-e093-4818-9f32-28468221073e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:38.312533 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0851d179-e4a5-4c8a-98cd-42b2eed0136e tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] 10.222.0.88 "GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b" status: 200 len: 1472 microversion: 2.1 time: 0.402133 Jul 25 14:39:38.313176 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1801/3413] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:37 2022] GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b => generated 1472 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:38.328449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4df476b4-df41-483f-8f1a-3547344211f8 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:38.328449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4df476b4-df41-483f-8f1a-3547344211f8 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] [instance: c2d5ca5f-5c52-45f7-8d1c-f42144fe8108] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:38.340604 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4df476b4-df41-483f-8f1a-3547344211f8 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:38.344390 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4df476b4-df41-483f-8f1a-3547344211f8 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:38.345323 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4df476b4-df41-483f-8f1a-3547344211f8 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:38.345812 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4df476b4-df41-483f-8f1a-3547344211f8 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:38.554168 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-360f4da2-e093-4818-9f32-28468221073e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.289908 Jul 25 14:39:38.555285 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1613/3414] 10.222.0.88 () {58 vars in 1275 bytes} [Mon Jul 25 14:39:38 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a/os-interface => generated 284 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:38.563560 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-df6a33c0-7a36-4c5c-af64-1b49614e76cd req-0595fa36-0a53-4d92-a0b7-9d88f6b779bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2d5ca5f-5c52-45f7-8d1c-f42144fe8108", "tag": "8e610f6f-b342-4a2d-9ea5-5330f97c6fbb"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:38.589502 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-df6a33c0-7a36-4c5c-af64-1b49614e76cd req-0595fa36-0a53-4d92-a0b7-9d88f6b779bc service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:38.590116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-df6a33c0-7a36-4c5c-af64-1b49614e76cd req-0595fa36-0a53-4d92-a0b7-9d88f6b779bc service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:38.623528 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-df6a33c0-7a36-4c5c-af64-1b49614e76cd req-0595fa36-0a53-4d92-a0b7-9d88f6b779bc service nova] Creating event network-changed:8e610f6f-b342-4a2d-9ea5-5330f97c6fbb for instance c2d5ca5f-5c52-45f7-8d1c-f42144fe8108 on n-h1-846435-14 Jul 25 14:39:38.630390 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-df6a33c0-7a36-4c5c-af64-1b49614e76cd req-0595fa36-0a53-4d92-a0b7-9d88f6b779bc service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072713 Jul 25 14:39:38.631159 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1614/3415] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:38.637123 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-d37145fc-af47-49fa-be2f-58513661196c req-5de5d63d-3e06-4e25-b8e7-1bf94fd30af8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1009be4-53ff-4893-836c-ba96f07a0d60", "name": "network-vif-deleted", "tag": "a70f2535-e346-4125-80e5-abda9464ab7e"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:38.667554 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-d37145fc-af47-49fa-be2f-58513661196c req-5de5d63d-3e06-4e25-b8e7-1bf94fd30af8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:38.667554 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-d37145fc-af47-49fa-be2f-58513661196c req-5de5d63d-3e06-4e25-b8e7-1bf94fd30af8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:38.700033 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-d37145fc-af47-49fa-be2f-58513661196c req-5de5d63d-3e06-4e25-b8e7-1bf94fd30af8 service nova] Creating event network-vif-deleted:a70f2535-e346-4125-80e5-abda9464ab7e for instance f1009be4-53ff-4893-836c-ba96f07a0d60 on n-h2-846435-14 Jul 25 14:39:38.709990 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-d37145fc-af47-49fa-be2f-58513661196c req-5de5d63d-3e06-4e25-b8e7-1bf94fd30af8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074913 Jul 25 14:39:38.712493 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1615/3416] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:38.725798 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-332736fd-a443-43a9-bc85-44b1425a20a9 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:38.729777 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-332736fd-a443-43a9-bc85-44b1425a20a9 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] [instance: a398b318-1a36-4299-9be1-40a69485198b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:38.749419 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-332736fd-a443-43a9-bc85-44b1425a20a9 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:38.749891 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-332736fd-a443-43a9-bc85-44b1425a20a9 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:38.750702 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-332736fd-a443-43a9-bc85-44b1425a20a9 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:38.751145 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-332736fd-a443-43a9-bc85-44b1425a20a9 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:38.824587 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-332736fd-a443-43a9-bc85-44b1425a20a9 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '7416803295914693a3e077649db2b47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf5a16e97944d9861d93405209cc37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-332736fd-a443-43a9-bc85-44b1425a20a9 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Request method failure captured: Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b/diagnostics HTTP/1.1 Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qsSTxjT_2HdDh7Ls0VNZC0DVq-_RX22fGOxF7zXeE83E6QGHWp4Lcs0_2sXduKR9-rzVD82kpHMM8iEpm9-CAjjILgmxZsxIXve1Vjoe1Im7ajPsH-QkPV-eyo50W5HHtNTuG4yp6ab30KzkUTV8J15HTy2Emb-47VHc81sTz9H0hI Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: a9bf5a16e97944d9861d93405209cc37 Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-2109696294 Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a9bf5a16e97944d9861d93405209cc37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a9bf5a16e97944d9861d93405209cc37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a9bf5a16e97944d9861d93405209cc37", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a9bf5a16e97944d9861d93405209cc37"}]}] Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-2109696294 Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: a9bf5a16e97944d9861d93405209cc37 Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-2109696294 Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServerDiagnosticsNegativeTest-2109696294-project Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 7416803295914693a3e077649db2b47b Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-2109696294-project Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'server_id': 'a398b318-1a36-4299-9be1-40a69485198b'} Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:38.832629 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:38.843685 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:38.843685 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:38.843685 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 14:39:38.843685 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 14:39:38.843685 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 25 14:39:38.843685 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:38.843685 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-332736fd-a443-43a9-bc85-44b1425a20a9 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:39:38.843685 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-332736fd-a443-43a9-bc85-44b1425a20a9 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] 10.222.0.88 "GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.119869 Jul 25 14:39:38.843685 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1616/3417] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 14:39:38 2022] GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b/diagnostics => generated 117 bytes in 125 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:39:38.853213 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ed06f596-e677-449c-b686-547ffeb839d6 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:38.854025 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ed06f596-e677-449c-b686-547ffeb839d6 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: d31c05d7-3525-4ad4-9eb0-5ed163707f58] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:38.871038 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ed06f596-e677-449c-b686-547ffeb839d6 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:38.874170 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ed06f596-e677-449c-b686-547ffeb839d6 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:38.875211 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ed06f596-e677-449c-b686-547ffeb839d6 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:38.876650 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ed06f596-e677-449c-b686-547ffeb839d6 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:38.905159 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4df476b4-df41-483f-8f1a-3547344211f8 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0dcc68e92f4917ad5335e4325b7065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14292758eb5e482d97001c3ddce034ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:38.920261 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4df476b4-df41-483f-8f1a-3547344211f8 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] 10.222.0.88 "GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108" status: 200 len: 1590 microversion: 2.1 time: 0.604129 Jul 25 14:39:38.921338 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1802/3418] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:38 2022] GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108 => generated 1590 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:38.952328 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5ae6e271-93b4-466a-802e-ed8d2a041c32 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:38.953460 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5ae6e271-93b4-466a-802e-ed8d2a041c32 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] [instance: a398b318-1a36-4299-9be1-40a69485198b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:38.969774 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ae6e271-93b4-466a-802e-ed8d2a041c32 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:38.970710 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ae6e271-93b4-466a-802e-ed8d2a041c32 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:38.971702 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ae6e271-93b4-466a-802e-ed8d2a041c32 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:38.972335 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ae6e271-93b4-466a-802e-ed8d2a041c32 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:39.011269 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5ae6e271-93b4-466a-802e-ed8d2a041c32 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] [instance: a398b318-1a36-4299-9be1-40a69485198b] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:39:39.222290 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5ae6e271-93b4-466a-802e-ed8d2a041c32 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b" status: 204 len: 0 microversion: 2.1 time: 0.279903 Jul 25 14:39:39.226064 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1803/3419] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:39:38 2022] DELETE /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:39:39.229959 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ece356e0-6f22-4da5-bdac-e12b7eb99522 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:39.230985 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ece356e0-6f22-4da5-bdac-e12b7eb99522 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:39.240186 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ece356e0-6f22-4da5-bdac-e12b7eb99522 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:39.240688 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ece356e0-6f22-4da5-bdac-e12b7eb99522 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:39.242122 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ece356e0-6f22-4da5-bdac-e12b7eb99522 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:39.242122 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ece356e0-6f22-4da5-bdac-e12b7eb99522 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:39.284662 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ece356e0-6f22-4da5-bdac-e12b7eb99522 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:39.286125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ece356e0-6f22-4da5-bdac-e12b7eb99522 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:39.286125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-ece356e0-6f22-4da5-bdac-e12b7eb99522 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lazy-loading 'fault' on Instance uuid f1009be4-53ff-4893-836c-ba96f07a0d60 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:39:39.349018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ece356e0-6f22-4da5-bdac-e12b7eb99522 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:39.361383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ece356e0-6f22-4da5-bdac-e12b7eb99522 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:39.363190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ece356e0-6f22-4da5-bdac-e12b7eb99522 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:39.364452 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ece356e0-6f22-4da5-bdac-e12b7eb99522 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1371 microversion: 2.20 time: 0.140170 Jul 25 14:39:39.379462 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1804/3420] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:39:39 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1371 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:39:39.379462 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4dc5b915-b685-47f2-828f-a4de57fd33c0 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:39.379462 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4dc5b915-b685-47f2-828f-a4de57fd33c0 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] [instance: a398b318-1a36-4299-9be1-40a69485198b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:39.384939 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4dc5b915-b685-47f2-828f-a4de57fd33c0 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:39.385403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4dc5b915-b685-47f2-828f-a4de57fd33c0 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:39.386230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4dc5b915-b685-47f2-828f-a4de57fd33c0 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:39.387044 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4dc5b915-b685-47f2-828f-a4de57fd33c0 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:39.538812 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ed06f596-e677-449c-b686-547ffeb839d6 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a720adc1b3443a8062b3eb8c7df11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5771bc6c546646b5a432a114f76d373d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:39.549562 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ed06f596-e677-449c-b686-547ffeb839d6 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58" status: 200 len: 1318 microversion: 2.1 time: 0.711161 Jul 25 14:39:39.550190 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1617/3421] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:38 2022] GET /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58 => generated 1318 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:39.567269 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-00ac7a53-87c9-43db-b811-882cb5e3ef63 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:39.568138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-00ac7a53-87c9-43db-b811-882cb5e3ef63 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 0a5407b3-d293-4f14-9379-b64b57b4a94b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:39.575051 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00ac7a53-87c9-43db-b811-882cb5e3ef63 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:39.575881 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00ac7a53-87c9-43db-b811-882cb5e3ef63 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:39.576786 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00ac7a53-87c9-43db-b811-882cb5e3ef63 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:39.577304 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00ac7a53-87c9-43db-b811-882cb5e3ef63 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:39.703866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4dc5b915-b685-47f2-828f-a4de57fd33c0 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7416803295914693a3e077649db2b47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf5a16e97944d9861d93405209cc37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:39.713375 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4dc5b915-b685-47f2-828f-a4de57fd33c0 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] 10.222.0.88 "GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b" status: 200 len: 1478 microversion: 2.1 time: 0.345457 Jul 25 14:39:39.726147 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1805/3422] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:39 2022] GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b => generated 1478 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:40.004782 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-00ac7a53-87c9-43db-b811-882cb5e3ef63 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:40.015171 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-00ac7a53-87c9-43db-b811-882cb5e3ef63 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b" status: 200 len: 1308 microversion: 2.1 time: 0.453820 Jul 25 14:39:40.032256 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1618/3423] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:39 2022] GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b => generated 1308 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:40.387156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ea9cb9eb-f7b0-4988-a5a7-78e04c43f446 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:40.387771 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ea9cb9eb-f7b0-4988-a5a7-78e04c43f446 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:40.390504 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:39:40.391194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=34 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:39:40.403425 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea9cb9eb-f7b0-4988-a5a7-78e04c43f446 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:40.404398 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea9cb9eb-f7b0-4988-a5a7-78e04c43f446 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:40.405500 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea9cb9eb-f7b0-4988-a5a7-78e04c43f446 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:40.406828 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea9cb9eb-f7b0-4988-a5a7-78e04c43f446 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:40.500371 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea9cb9eb-f7b0-4988-a5a7-78e04c43f446 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:40.501292 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea9cb9eb-f7b0-4988-a5a7-78e04c43f446 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:40.501932 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-ea9cb9eb-f7b0-4988-a5a7-78e04c43f446 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lazy-loading 'fault' on Instance uuid f1009be4-53ff-4893-836c-ba96f07a0d60 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:39:40.572912 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-06a5bbf1-c155-4706-ab77-70b27111af4d tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:40.574056 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-06a5bbf1-c155-4706-ab77-70b27111af4d tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: d31c05d7-3525-4ad4-9eb0-5ed163707f58] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:40.583316 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-06a5bbf1-c155-4706-ab77-70b27111af4d tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:40.584277 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-06a5bbf1-c155-4706-ab77-70b27111af4d tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:40.585397 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-06a5bbf1-c155-4706-ab77-70b27111af4d tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:40.586103 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-06a5bbf1-c155-4706-ab77-70b27111af4d tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:40.656386 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ea9cb9eb-f7b0-4988-a5a7-78e04c43f446 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:40.678122 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ea9cb9eb-f7b0-4988-a5a7-78e04c43f446 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:40.682076 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ea9cb9eb-f7b0-4988-a5a7-78e04c43f446 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:40.686526 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ea9cb9eb-f7b0-4988-a5a7-78e04c43f446 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 200 len: 1371 microversion: 2.20 time: 0.303009 Jul 25 14:39:40.703256 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1806/3424] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:39:40 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 1371 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:39:40.738647 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-06c46bf0-a594-40e0-925c-74bfc65ad15c tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:40.741862 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-06c46bf0-a594-40e0-925c-74bfc65ad15c tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] [instance: a398b318-1a36-4299-9be1-40a69485198b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:40.760531 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-06c46bf0-a594-40e0-925c-74bfc65ad15c tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:40.761202 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-06c46bf0-a594-40e0-925c-74bfc65ad15c tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:40.762053 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-06c46bf0-a594-40e0-925c-74bfc65ad15c tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:40.762494 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-06c46bf0-a594-40e0-925c-74bfc65ad15c tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:41.064496 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-06c46bf0-a594-40e0-925c-74bfc65ad15c tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7416803295914693a3e077649db2b47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf5a16e97944d9861d93405209cc37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:41.075361 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-06c46bf0-a594-40e0-925c-74bfc65ad15c tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] 10.222.0.88 "GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b" status: 200 len: 1478 microversion: 2.1 time: 0.344315 Jul 25 14:39:41.076285 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1807/3425] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:40 2022] GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b => generated 1478 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:39:41.081231 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-28092f14-bf3d-4fbd-9289-3f0064e54807 req-39c18d6c-d5dc-4b93-b4c1-ce3ca674c898 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a5407b3-d293-4f14-9379-b64b57b4a94b", "tag": "70626436-8a3d-45db-9c32-c7681a62b0dd"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:41.127671 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-28092f14-bf3d-4fbd-9289-3f0064e54807 req-39c18d6c-d5dc-4b93-b4c1-ce3ca674c898 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:41.128473 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-28092f14-bf3d-4fbd-9289-3f0064e54807 req-39c18d6c-d5dc-4b93-b4c1-ce3ca674c898 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:41.133264 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:39:41.159486 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-28092f14-bf3d-4fbd-9289-3f0064e54807 req-39c18d6c-d5dc-4b93-b4c1-ce3ca674c898 service nova] Creating event network-changed:70626436-8a3d-45db-9c32-c7681a62b0dd for instance 0a5407b3-d293-4f14-9379-b64b57b4a94b on n-h1-846435-14 Jul 25 14:39:41.186787 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-28092f14-bf3d-4fbd-9289-3f0064e54807 req-39c18d6c-d5dc-4b93-b4c1-ce3ca674c898 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109174 Jul 25 14:39:41.190905 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1808/3426] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:41.204172 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8584c677-4ba3-4918-99b9-104b9bd34a23 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:41.204899 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8584c677-4ba3-4918-99b9-104b9bd34a23 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 0a5407b3-d293-4f14-9379-b64b57b4a94b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:41.221124 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8584c677-4ba3-4918-99b9-104b9bd34a23 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:41.221577 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8584c677-4ba3-4918-99b9-104b9bd34a23 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:41.222361 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8584c677-4ba3-4918-99b9-104b9bd34a23 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:41.222793 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8584c677-4ba3-4918-99b9-104b9bd34a23 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:41.289689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-06a5bbf1-c155-4706-ab77-70b27111af4d tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a720adc1b3443a8062b3eb8c7df11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5771bc6c546646b5a432a114f76d373d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:41.300179 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-06a5bbf1-c155-4706-ab77-70b27111af4d tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58" status: 200 len: 1508 microversion: 2.1 time: 0.732131 Jul 25 14:39:41.320747 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1619/3427] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:40 2022] GET /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58 => generated 1508 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:41.527781 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8584c677-4ba3-4918-99b9-104b9bd34a23 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:41.547398 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8584c677-4ba3-4918-99b9-104b9bd34a23 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b" status: 200 len: 1308 microversion: 2.1 time: 0.355156 Jul 25 14:39:41.548727 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1809/3428] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:41 2022] GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b => generated 1308 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:41.718639 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0c61af40-82e5-4b6c-9992-046edf181690 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:41.720308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0c61af40-82e5-4b6c-9992-046edf181690 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:41.736578 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:39:41.738601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0c61af40-82e5-4b6c-9992-046edf181690 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:41.747467 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0c61af40-82e5-4b6c-9992-046edf181690 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:41.756615 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0c61af40-82e5-4b6c-9992-046edf181690 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:41.758348 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0c61af40-82e5-4b6c-9992-046edf181690 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:41.840398 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-0c61af40-82e5-4b6c-9992-046edf181690 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] HTTP exception thrown: Instance f1009be4-53ff-4893-836c-ba96f07a0d60 could not be found. Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0c61af40-82e5-4b6c-9992-046edf181690 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Request method failure captured: Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 HTTP/1.1 Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qnnsDwhiwclvLICZx25tvED9QBDR-PsslOWQbR9ercqYi2_4zddmdpuO0rjlUxGuCqoA2Di75m-DhjzNBp3pvZkajTQM1yFPHjYWZ9QDGXdTcW8DZc1mWndfRuL2FmMJYbW-ooe1Vc0n6xMI3jfgRxeT8g7we_MenM44yhkdC3Ly6g Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 973384a032e54cd5bee455a1c6f39725 Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-767538 Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/973384a032e54cd5bee455a1c6f39725"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/973384a032e54cd5bee455a1c6f39725"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_973384a032e54cd5bee455a1c6f39725", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/973384a032e54cd5bee455a1c6f39725"}]}] Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-AttachVolumeShelveTestJSON-767538 Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 973384a032e54cd5bee455a1c6f39725 Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-767538 Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-AttachVolumeShelveTestJSON-767538-project Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 060523597bbb409193f8814648fb40fc Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-AttachVolumeShelveTestJSON-767538-project Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance f1009be4-53ff-4893-836c-ba96f07a0d60 could not be found. Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'f1009be4-53ff-4893-836c-ba96f07a0d60'} Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1009be4-53ff-4893-836c-ba96f07a0d60 could not be found. Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1009be4-53ff-4893-836c-ba96f07a0d60 could not be found. Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:41.844797 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:41.851194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:41.851194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:41.851194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:41.851194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:39:41.851194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:39:41.851194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1009be4-53ff-4893-836c-ba96f07a0d60 could not be found. Jul 25 14:39:41.851194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:41.851194 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0c61af40-82e5-4b6c-9992-046edf181690 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Returning 404 to user: Instance f1009be4-53ff-4893-836c-ba96f07a0d60 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:39:41.851194 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0c61af40-82e5-4b6c-9992-046edf181690 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 404 len: 111 microversion: 2.20 time: 0.138002 Jul 25 14:39:41.853313 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1620/3429] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:39:41 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:39:41.861591 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-456ea042-c74e-4f5c-b899-ef6d1a749cef tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '.version_select at 0x7f4687389160>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:41.893044 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-456ea042-c74e-4f5c-b899-ef6d1a749cef tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1596996577" status: 204 len: 0 microversion: 2.20 time: 0.035435 Jul 25 14:39:41.895669 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1810/3430] 10.222.0.88 () {60 vars in 1262 bytes} [Mon Jul 25 14:39:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1596996577 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 14:39:42.098294 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ddc62ef8-0968-4887-ad2c-7cc87f571c03 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:42.099217 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ddc62ef8-0968-4887-ad2c-7cc87f571c03 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] [instance: a398b318-1a36-4299-9be1-40a69485198b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:42.116012 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ddc62ef8-0968-4887-ad2c-7cc87f571c03 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:42.119915 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ddc62ef8-0968-4887-ad2c-7cc87f571c03 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:42.120784 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ddc62ef8-0968-4887-ad2c-7cc87f571c03 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:42.121228 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ddc62ef8-0968-4887-ad2c-7cc87f571c03 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:42.575879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6de6ba8e-3f3c-408a-955b-0078895678b7 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:42.577160 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6de6ba8e-3f3c-408a-955b-0078895678b7 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 0a5407b3-d293-4f14-9379-b64b57b4a94b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:42.609380 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6de6ba8e-3f3c-408a-955b-0078895678b7 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:42.610327 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6de6ba8e-3f3c-408a-955b-0078895678b7 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:42.613972 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6de6ba8e-3f3c-408a-955b-0078895678b7 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:42.614637 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6de6ba8e-3f3c-408a-955b-0078895678b7 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:43.022940 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ddc62ef8-0968-4887-ad2c-7cc87f571c03 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7416803295914693a3e077649db2b47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf5a16e97944d9861d93405209cc37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:43.041082 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ddc62ef8-0968-4887-ad2c-7cc87f571c03 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] 10.222.0.88 "GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b" status: 200 len: 1478 microversion: 2.1 time: 0.947181 Jul 25 14:39:43.044355 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1621/3431] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:42 2022] GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b => generated 1478 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:43.348336 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-9112916d-5aaa-4b67-871d-80c1ea39de5b req-96c51940-03ba-4085-8121-ba6abc074913 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fac258f1-785d-4dd9-bc68-0ee713c9149a", "tag": "f04995f2-50af-408b-81f1-cda226840583"}, {"name": "network-changed", "server_uuid": "fac258f1-785d-4dd9-bc68-0ee713c9149a", "tag": "f04995f2-50af-408b-81f1-cda226840583"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:43.375720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-9112916d-5aaa-4b67-871d-80c1ea39de5b req-96c51940-03ba-4085-8121-ba6abc074913 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:43.377076 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-9112916d-5aaa-4b67-871d-80c1ea39de5b req-96c51940-03ba-4085-8121-ba6abc074913 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:43.404757 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-9112916d-5aaa-4b67-871d-80c1ea39de5b req-96c51940-03ba-4085-8121-ba6abc074913 service nova] Creating event network-changed:f04995f2-50af-408b-81f1-cda226840583 for instance fac258f1-785d-4dd9-bc68-0ee713c9149a on n-h1-846435-14 Jul 25 14:39:43.405347 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-9112916d-5aaa-4b67-871d-80c1ea39de5b req-96c51940-03ba-4085-8121-ba6abc074913 service nova] Creating event network-changed:f04995f2-50af-408b-81f1-cda226840583 for instance fac258f1-785d-4dd9-bc68-0ee713c9149a on n-h1-846435-14 Jul 25 14:39:43.424214 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-9112916d-5aaa-4b67-871d-80c1ea39de5b req-96c51940-03ba-4085-8121-ba6abc074913 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.079391 Jul 25 14:39:43.427371 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1622/3432] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:43.683638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6de6ba8e-3f3c-408a-955b-0078895678b7 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:43.694682 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6de6ba8e-3f3c-408a-955b-0078895678b7 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b" status: 200 len: 1308 microversion: 2.1 time: 1.127472 Jul 25 14:39:43.695407 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1811/3433] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:42 2022] GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b => generated 1308 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:39:43.911550 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e84b1977-490c-42a6-a5e1-165f9570cc5a tempest-VolumesAdminNegativeTest-1903855567 tempest-VolumesAdminNegativeTest-1903855567-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "4c6a4c94-2306-41f6-89f7-5b8f73a3f892"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:43.918950 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e84b1977-490c-42a6-a5e1-165f9570cc5a tempest-VolumesAdminNegativeTest-1903855567 tempest-VolumesAdminNegativeTest-1903855567-project-admin] [instance: d31c05d7-3525-4ad4-9eb0-5ed163707f58] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:43.937035 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e84b1977-490c-42a6-a5e1-165f9570cc5a tempest-VolumesAdminNegativeTest-1903855567 tempest-VolumesAdminNegativeTest-1903855567-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:43.937991 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e84b1977-490c-42a6-a5e1-165f9570cc5a tempest-VolumesAdminNegativeTest-1903855567 tempest-VolumesAdminNegativeTest-1903855567-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:43.940008 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e84b1977-490c-42a6-a5e1-165f9570cc5a tempest-VolumesAdminNegativeTest-1903855567 tempest-VolumesAdminNegativeTest-1903855567-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:43.940701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e84b1977-490c-42a6-a5e1-165f9570cc5a tempest-VolumesAdminNegativeTest-1903855567 tempest-VolumesAdminNegativeTest-1903855567-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:44.058491 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-e84b1977-490c-42a6-a5e1-165f9570cc5a tempest-VolumesAdminNegativeTest-1903855567 tempest-VolumesAdminNegativeTest-1903855567-project-admin] HTTP exception thrown: Volume 1ebd0cff-b152-4396-aa4c-0c2ffc93ae94 could not be found. Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e84b1977-490c-42a6-a5e1-165f9570cc5a tempest-VolumesAdminNegativeTest-1903855567 tempest-VolumesAdminNegativeTest-1903855567-project-admin] Request method failure captured: Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: request: PUT /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58/os-volume_attachments/1ebd0cff-b152-4396-aa4c-0c2ffc93ae94 HTTP/1.1 Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 74 Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qp5vnAPE5O5zKmZlCs-_i_x-IlgB-KASgVnnqIZwGcwhTBh54TrmbPYNw7J_lBJ8X0rH0GCfCHWoQHQht-NvETVPsBGpjTVAKhwLrGcsirIAAI5MqHCxFUMEjmYKH0JnGXqmhd055jj_OoR2VRjNFp30AybCUYDK7x1wbmcAmVEugU Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 5eee55df5b3747e3ae585348b0640b3b Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-VolumesAdminNegativeTest-1903855567 Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: X-Role: admin,reader,member Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: admin,reader,member Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5eee55df5b3747e3ae585348b0640b3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5eee55df5b3747e3ae585348b0640b3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_5eee55df5b3747e3ae585348b0640b3b", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/5eee55df5b3747e3ae585348b0640b3b"}]}] Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-VolumesAdminNegativeTest-1903855567 Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 5eee55df5b3747e3ae585348b0640b3b Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1903855567 Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-VolumesAdminNegativeTest-1903855567-project-admin Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 982d412c6a3048d48feca4a6928d1d00 Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-VolumesAdminNegativeTest-1903855567-project-admin Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: {"volumeAttachment": {"volumeId": "4c6a4c94-2306-41f6-89f7-5b8f73a3f892"}} Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: exception: Volume 1ebd0cff-b152-4396-aa4c-0c2ffc93ae94 could not be found. Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'server_id': 'd31c05d7-3525-4ad4-9eb0-5ed163707f58', 'id': '1ebd0cff-b152-4396-aa4c-0c2ffc93ae94', 'body': {'volumeAttachment': {'volumeId': '4c6a4c94-2306-41f6-89f7-5b8f73a3f892'}}} Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1ebd0cff-b152-4396-aa4c-0c2ffc93ae94 could not be found. (HTTP 404) (Request-ID: req-bb17a7ec-448d-4899-afa9-7321ac78cf17) Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 14:39:44.061966 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1ebd0cff-b152-4396-aa4c-0c2ffc93ae94 could not be found. Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1ebd0cff-b152-4396-aa4c-0c2ffc93ae94 could not be found. Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1ebd0cff-b152-4396-aa4c-0c2ffc93ae94 could not be found. Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e84b1977-490c-42a6-a5e1-165f9570cc5a tempest-VolumesAdminNegativeTest-1903855567 tempest-VolumesAdminNegativeTest-1903855567-project-admin] Returning 404 to user: Volume 1ebd0cff-b152-4396-aa4c-0c2ffc93ae94 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:39:44.066830 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e84b1977-490c-42a6-a5e1-165f9570cc5a tempest-VolumesAdminNegativeTest-1903855567 tempest-VolumesAdminNegativeTest-1903855567-project-admin] 10.222.0.88 "PUT /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58/os-volume_attachments/1ebd0cff-b152-4396-aa4c-0c2ffc93ae94" status: 404 len: 109 microversion: 2.1 time: 0.159205 Jul 25 14:39:44.074837 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1623/3434] 10.222.0.88 () {60 vars in 1433 bytes} [Mon Jul 25 14:39:43 2022] PUT /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58/os-volume_attachments/1ebd0cff-b152-4396-aa4c-0c2ffc93ae94 => generated 109 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:39:44.075650 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4d6712e7-746e-47fe-9153-95a161fc2782 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:44.076371 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4d6712e7-746e-47fe-9153-95a161fc2782 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] [instance: a398b318-1a36-4299-9be1-40a69485198b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:44.090358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4d6712e7-746e-47fe-9153-95a161fc2782 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:44.096300 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4d6712e7-746e-47fe-9153-95a161fc2782 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:44.097363 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4d6712e7-746e-47fe-9153-95a161fc2782 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:44.098338 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4d6712e7-746e-47fe-9153-95a161fc2782 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:44.131118 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-4d6712e7-746e-47fe-9153-95a161fc2782 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] HTTP exception thrown: Instance a398b318-1a36-4299-9be1-40a69485198b could not be found. Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4d6712e7-746e-47fe-9153-95a161fc2782 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Request method failure captured: Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b HTTP/1.1 Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qsSTxjT_2HdDh7Ls0VNZC0DVq-_RX22fGOxF7zXeE83E6QGHWp4Lcs0_2sXduKR9-rzVD82kpHMM8iEpm9-CAjjILgmxZsxIXve1Vjoe1Im7ajPsH-QkPV-eyo50W5HHtNTuG4yp6ab30KzkUTV8J15HTy2Emb-47VHc81sTz9H0hI Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: a9bf5a16e97944d9861d93405209cc37 Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-2109696294 Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a9bf5a16e97944d9861d93405209cc37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a9bf5a16e97944d9861d93405209cc37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a9bf5a16e97944d9861d93405209cc37", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a9bf5a16e97944d9861d93405209cc37"}]}] Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-2109696294 Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: a9bf5a16e97944d9861d93405209cc37 Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-2109696294 Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerDiagnosticsNegativeTest-2109696294-project Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 7416803295914693a3e077649db2b47b Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-2109696294-project Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance a398b318-1a36-4299-9be1-40a69485198b could not be found. Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'a398b318-1a36-4299-9be1-40a69485198b'} Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a398b318-1a36-4299-9be1-40a69485198b could not be found. Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a398b318-1a36-4299-9be1-40a69485198b could not be found. Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:44.132949 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:44.139096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:44.139096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:44.139096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:44.139096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:44.139096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:39:44.139096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:39:44.139096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a398b318-1a36-4299-9be1-40a69485198b could not be found. Jul 25 14:39:44.139096 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:44.139096 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4d6712e7-746e-47fe-9153-95a161fc2782 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] Returning 404 to user: Instance a398b318-1a36-4299-9be1-40a69485198b could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:39:44.139096 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4d6712e7-746e-47fe-9153-95a161fc2782 tempest-ServerDiagnosticsNegativeTest-2109696294 tempest-ServerDiagnosticsNegativeTest-2109696294-project] 10.222.0.88 "GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b" status: 404 len: 111 microversion: 2.1 time: 0.071706 Jul 25 14:39:44.156675 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1812/3435] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:44 2022] GET /compute/v2.1/servers/a398b318-1a36-4299-9be1-40a69485198b => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:39:44.718656 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0f5ac0b0-cd74-4925-8754-b375a4c301d5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:44.719325 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0f5ac0b0-cd74-4925-8754-b375a4c301d5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 0a5407b3-d293-4f14-9379-b64b57b4a94b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:44.737458 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f5ac0b0-cd74-4925-8754-b375a4c301d5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:44.750125 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f5ac0b0-cd74-4925-8754-b375a4c301d5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:44.751008 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f5ac0b0-cd74-4925-8754-b375a4c301d5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:44.751463 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f5ac0b0-cd74-4925-8754-b375a4c301d5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:44.857298 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-187c84e3-973b-4cef-bdb0-150cbaae3594 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Action: 'create', calling method: .version_select at 0x7f46989e3a60>, body: {"keypair": {"name": "tempest-keypair-1366923407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSpr7X+mSHvWR3cndpiQl6wRQHzVdzXj6dx/lXes8Bs5M3EkmPm5XKYt+vK772qn08YDqU2NXqYJTB+bd5LHuAW10G6HtLR24LCWXRN/Ey41tg/MGCx9PnePVn2bsBm4g=="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:44.933620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-187c84e3-973b-4cef-bdb0-150cbaae3594 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Getting quotas for project 973384a032e54cd5bee455a1c6f39725. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:39:44.952995 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-187c84e3-973b-4cef-bdb0-150cbaae3594 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Getting quotas for user 060523597bbb409193f8814648fb40fc and project 973384a032e54cd5bee455a1c6f39725. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:39:45.028434 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-187c84e3-973b-4cef-bdb0-150cbaae3594 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.167185 Jul 25 14:39:45.029131 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1813/3436] 10.222.0.88 () {62 vars in 1200 bytes} [Mon Jul 25 14:39:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 180 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 14:39:45.197627 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0f5ac0b0-cd74-4925-8754-b375a4c301d5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:45.211481 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0f5ac0b0-cd74-4925-8754-b375a4c301d5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b" status: 200 len: 1308 microversion: 2.1 time: 0.496189 Jul 25 14:39:45.211751 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1624/3437] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:44 2022] GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b => generated 1308 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:45.465549 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-691900ff-575e-42a8-8d47-d704b3cd7e2b req-fc28c2c3-cffe-47ad-a6f7-1601b9e08874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a398b318-1a36-4299-9be1-40a69485198b", "name": "network-vif-deleted", "tag": "4fc7b16c-5223-4535-aa7b-5931230ade6f"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:45.493858 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-691900ff-575e-42a8-8d47-d704b3cd7e2b req-fc28c2c3-cffe-47ad-a6f7-1601b9e08874 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:45.494838 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-691900ff-575e-42a8-8d47-d704b3cd7e2b req-fc28c2c3-cffe-47ad-a6f7-1601b9e08874 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:45.508320 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-691900ff-575e-42a8-8d47-d704b3cd7e2b req-fc28c2c3-cffe-47ad-a6f7-1601b9e08874 service nova] Creating event network-vif-deleted:4fc7b16c-5223-4535-aa7b-5931230ade6f for instance a398b318-1a36-4299-9be1-40a69485198b on n-h2-846435-14 Jul 25 14:39:45.513817 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-691900ff-575e-42a8-8d47-d704b3cd7e2b req-fc28c2c3-cffe-47ad-a6f7-1601b9e08874 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060334 Jul 25 14:39:45.514891 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1814/3438] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:46.198549 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-b763310f-c1b8-446c-a8cf-e206d9e521c9 req-0d7002bc-f336-4127-ad63-fc9a4291ce96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a5407b3-d293-4f14-9379-b64b57b4a94b", "name": "network-vif-plugged", "status": "completed", "tag": "70626436-8a3d-45db-9c32-c7681a62b0dd"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:46.221669 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b763310f-c1b8-446c-a8cf-e206d9e521c9 req-0d7002bc-f336-4127-ad63-fc9a4291ce96 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:46.222091 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b763310f-c1b8-446c-a8cf-e206d9e521c9 req-0d7002bc-f336-4127-ad63-fc9a4291ce96 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:46.236280 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a0d4ae7f-49f7-445d-850d-99583b970b18 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:46.237170 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a0d4ae7f-49f7-445d-850d-99583b970b18 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 0a5407b3-d293-4f14-9379-b64b57b4a94b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:46.261750 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a0d4ae7f-49f7-445d-850d-99583b970b18 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:46.264563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a0d4ae7f-49f7-445d-850d-99583b970b18 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:46.266949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a0d4ae7f-49f7-445d-850d-99583b970b18 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:46.267401 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a0d4ae7f-49f7-445d-850d-99583b970b18 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:46.288641 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-b763310f-c1b8-446c-a8cf-e206d9e521c9 req-0d7002bc-f336-4127-ad63-fc9a4291ce96 service nova] Creating event network-vif-plugged:70626436-8a3d-45db-9c32-c7681a62b0dd for instance 0a5407b3-d293-4f14-9379-b64b57b4a94b on n-h1-846435-14 Jul 25 14:39:46.315491 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-b763310f-c1b8-446c-a8cf-e206d9e521c9 req-0d7002bc-f336-4127-ad63-fc9a4291ce96 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116147 Jul 25 14:39:46.316764 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1625/3439] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:46.679759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a0d4ae7f-49f7-445d-850d-99583b970b18 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:46.691405 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a0d4ae7f-49f7-445d-850d-99583b970b18 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b" status: 200 len: 1308 microversion: 2.1 time: 0.460169 Jul 25 14:39:46.694977 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1815/3440] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:46 2022] GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b => generated 1308 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:39:47.652422 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0e269a3b-6113-46e3-8b85-dc5ddd75e0d1 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:47.653035 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0e269a3b-6113-46e3-8b85-dc5ddd75e0d1 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: d31c05d7-3525-4ad4-9eb0-5ed163707f58] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:47.686699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e269a3b-6113-46e3-8b85-dc5ddd75e0d1 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:47.689093 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e269a3b-6113-46e3-8b85-dc5ddd75e0d1 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:47.690735 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e269a3b-6113-46e3-8b85-dc5ddd75e0d1 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:47.691192 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e269a3b-6113-46e3-8b85-dc5ddd75e0d1 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:47.716498 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bddb184a-7a49-4fc3-a0ca-3c4b37670fb8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:47.718222 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bddb184a-7a49-4fc3-a0ca-3c4b37670fb8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 0a5407b3-d293-4f14-9379-b64b57b4a94b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:47.757194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bddb184a-7a49-4fc3-a0ca-3c4b37670fb8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:47.759308 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bddb184a-7a49-4fc3-a0ca-3c4b37670fb8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:47.760297 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bddb184a-7a49-4fc3-a0ca-3c4b37670fb8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:47.764220 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bddb184a-7a49-4fc3-a0ca-3c4b37670fb8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:47.818199 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0e269a3b-6113-46e3-8b85-dc5ddd75e0d1 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: d31c05d7-3525-4ad4-9eb0-5ed163707f58] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:39:47.996241 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0e269a3b-6113-46e3-8b85-dc5ddd75e0d1 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "DELETE /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58" status: 204 len: 0 microversion: 2.1 time: 0.350952 Jul 25 14:39:47.996794 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1626/3441] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:39:47 2022] DELETE /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:39:48.023436 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3a433c5c-ceb9-46d9-88f9-07ee1866781b tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:48.024208 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3a433c5c-ceb9-46d9-88f9-07ee1866781b tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: d31c05d7-3525-4ad4-9eb0-5ed163707f58] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:48.028577 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bddb184a-7a49-4fc3-a0ca-3c4b37670fb8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:48.038518 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bddb184a-7a49-4fc3-a0ca-3c4b37670fb8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b" status: 200 len: 1308 microversion: 2.1 time: 0.329754 Jul 25 14:39:48.052371 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1816/3442] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:47 2022] GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b => generated 1308 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:48.053458 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3a433c5c-ceb9-46d9-88f9-07ee1866781b tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:48.053924 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3a433c5c-ceb9-46d9-88f9-07ee1866781b tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:48.054727 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3a433c5c-ceb9-46d9-88f9-07ee1866781b tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:48.055183 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3a433c5c-ceb9-46d9-88f9-07ee1866781b tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:48.650728 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f4cb974d-e188-442c-851d-778272d8c2aa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1935429856", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b891963-4f5c-4f60-ba03-a7025ea9318f"}], "security_groups": [{"name": "tempest-securitygroup--1155314152"}], "key_name": "tempest-keypair-1366923407", "user_data": "}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:48.692665 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3a433c5c-ceb9-46d9-88f9-07ee1866781b tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a720adc1b3443a8062b3eb8c7df11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5771bc6c546646b5a432a114f76d373d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:48.715189 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3a433c5c-ceb9-46d9-88f9-07ee1866781b tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58" status: 200 len: 1514 microversion: 2.1 time: 0.704734 Jul 25 14:39:48.723103 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1627/3443] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:48 2022] GET /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58 => generated 1514 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:48.970610 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-f4cb974d-e188-442c-851d-778272d8c2aa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] validate_networks() for [('7b891963-4f5c-4f60-ba03-a7025ea9318f', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:39:49.061270 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8d2b9b5c-e07c-4ccf-b77e-80f205e70dc8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:49.062110 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8d2b9b5c-e07c-4ccf-b77e-80f205e70dc8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 0a5407b3-d293-4f14-9379-b64b57b4a94b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:49.070877 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8d2b9b5c-e07c-4ccf-b77e-80f205e70dc8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:49.071487 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8d2b9b5c-e07c-4ccf-b77e-80f205e70dc8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:49.072459 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8d2b9b5c-e07c-4ccf-b77e-80f205e70dc8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:49.073034 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8d2b9b5c-e07c-4ccf-b77e-80f205e70dc8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:49.094897 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:39:49.392230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8d2b9b5c-e07c-4ccf-b77e-80f205e70dc8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:49.405491 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8d2b9b5c-e07c-4ccf-b77e-80f205e70dc8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b" status: 200 len: 1490 microversion: 2.1 time: 0.349476 Jul 25 14:39:49.406873 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1628/3444] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:49 2022] GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b => generated 1490 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:39:49.428908 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cfb7827c-040a-4e5e-9041-3427c586aa8f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:49.429924 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cfb7827c-040a-4e5e-9041-3427c586aa8f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 31135b90-13f0-431a-994f-8af08fbd3248] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:49.436814 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cfb7827c-040a-4e5e-9041-3427c586aa8f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:49.437522 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cfb7827c-040a-4e5e-9041-3427c586aa8f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:49.438556 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cfb7827c-040a-4e5e-9041-3427c586aa8f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:49.439155 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cfb7827c-040a-4e5e-9041-3427c586aa8f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:49.809834 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f4cb974d-e188-442c-851d-778272d8c2aa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:39:49.810547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f4cb974d-e188-442c-851d-778272d8c2aa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:39:49.815459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f4cb974d-e188-442c-851d-778272d8c2aa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:39:49.816318 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f4cb974d-e188-442c-851d-778272d8c2aa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:39:49.817056 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f4cb974d-e188-442c-851d-778272d8c2aa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:39:49.835042 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f4cb974d-e188-442c-851d-778272d8c2aa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:49.836023 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f4cb974d-e188-442c-851d-778272d8c2aa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:49.837357 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f4cb974d-e188-442c-851d-778272d8c2aa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:49.838020 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f4cb974d-e188-442c-851d-778272d8c2aa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:49.861963 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-f4cb974d-e188-442c-851d-778272d8c2aa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Getting quotas for project 973384a032e54cd5bee455a1c6f39725. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:39:49.869792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-f4cb974d-e188-442c-851d-778272d8c2aa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Getting quotas for user 060523597bbb409193f8814648fb40fc and project 973384a032e54cd5bee455a1c6f39725. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:39:49.902447 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f4cb974d-e188-442c-851d-778272d8c2aa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:39:49.905825 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f4cb974d-e188-442c-851d-778272d8c2aa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:39:50.076489 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f4cb974d-e188-442c-851d-778272d8c2aa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.432832 Jul 25 14:39:50.086162 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1817/3445] 10.222.0.88 () {62 vars in 1188 bytes} [Mon Jul 25 14:39:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 1443 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 14:39:50.091371 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-323c57ff-892c-40bb-b2a3-e22180344178 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:50.095352 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-323c57ff-892c-40bb-b2a3-e22180344178 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: d31c05d7-3525-4ad4-9eb0-5ed163707f58] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:50.103063 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-323c57ff-892c-40bb-b2a3-e22180344178 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:50.103812 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-323c57ff-892c-40bb-b2a3-e22180344178 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:50.104816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-323c57ff-892c-40bb-b2a3-e22180344178 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:50.105411 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-323c57ff-892c-40bb-b2a3-e22180344178 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:50.179404 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cfb7827c-040a-4e5e-9041-3427c586aa8f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:50.187807 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cfb7827c-040a-4e5e-9041-3427c586aa8f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248" status: 200 len: 1489 microversion: 2.1 time: 0.764646 Jul 25 14:39:50.205467 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1629/3446] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:49 2022] GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248 => generated 1489 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:50.211910 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d4522816-4046-4223-8b9e-e2bce815263d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:50.215637 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d4522816-4046-4223-8b9e-e2bce815263d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:50.391708 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-323c57ff-892c-40bb-b2a3-e22180344178 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a720adc1b3443a8062b3eb8c7df11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5771bc6c546646b5a432a114f76d373d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:50.401185 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-323c57ff-892c-40bb-b2a3-e22180344178 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58" status: 200 len: 1514 microversion: 2.1 time: 0.313486 Jul 25 14:39:50.403524 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1818/3447] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:50 2022] GET /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58 => generated 1514 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:50.410580 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d4522816-4046-4223-8b9e-e2bce815263d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:50.420216 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6aca753c-1499-4b67-9760-f539b20ed546 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:50.428452 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d4522816-4046-4223-8b9e-e2bce815263d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:50.435419 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6aca753c-1499-4b67-9760-f539b20ed546 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 0a5407b3-d293-4f14-9379-b64b57b4a94b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:50.437346 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d4522816-4046-4223-8b9e-e2bce815263d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:50.442060 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d4522816-4046-4223-8b9e-e2bce815263d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1282 microversion: 2.20 time: 0.234629 Jul 25 14:39:50.448597 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1630/3448] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:39:50 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1282 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:39:50.466265 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6aca753c-1499-4b67-9760-f539b20ed546 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:50.468221 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6aca753c-1499-4b67-9760-f539b20ed546 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:50.470910 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6aca753c-1499-4b67-9760-f539b20ed546 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:50.471482 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6aca753c-1499-4b67-9760-f539b20ed546 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:50.859893 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6aca753c-1499-4b67-9760-f539b20ed546 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:50.881248 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6aca753c-1499-4b67-9760-f539b20ed546 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b" status: 200 len: 1490 microversion: 2.1 time: 0.475543 Jul 25 14:39:50.882961 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1819/3449] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:50 2022] GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b => generated 1490 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:50.906399 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b07d65ac-28e6-476e-81e7-47baa8a3ec75 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:50.907176 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b07d65ac-28e6-476e-81e7-47baa8a3ec75 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 0a5407b3-d293-4f14-9379-b64b57b4a94b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:50.915928 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b07d65ac-28e6-476e-81e7-47baa8a3ec75 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:50.916518 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b07d65ac-28e6-476e-81e7-47baa8a3ec75 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:50.917345 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b07d65ac-28e6-476e-81e7-47baa8a3ec75 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:50.917780 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b07d65ac-28e6-476e-81e7-47baa8a3ec75 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:50.968761 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b07d65ac-28e6-476e-81e7-47baa8a3ec75 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 0a5407b3-d293-4f14-9379-b64b57b4a94b] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:39:51.092751 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:39:51.106387 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b07d65ac-28e6-476e-81e7-47baa8a3ec75 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "DELETE /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b" status: 204 len: 0 microversion: 2.1 time: 0.203631 Jul 25 14:39:51.108399 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1631/3450] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:39:50 2022] DELETE /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 14:39:51.118209 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d24744b8-3173-487d-b722-1c7b2bb437cb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:51.120229 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d24744b8-3173-487d-b722-1c7b2bb437cb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 0a5407b3-d293-4f14-9379-b64b57b4a94b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:51.136623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d24744b8-3173-487d-b722-1c7b2bb437cb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:51.137748 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d24744b8-3173-487d-b722-1c7b2bb437cb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:51.138806 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d24744b8-3173-487d-b722-1c7b2bb437cb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:51.141397 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d24744b8-3173-487d-b722-1c7b2bb437cb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:51.439793 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-21dc6093-539d-43ba-a445-4c3fb169065e tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:51.441353 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-21dc6093-539d-43ba-a445-4c3fb169065e tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: d31c05d7-3525-4ad4-9eb0-5ed163707f58] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:51.458078 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-21dc6093-539d-43ba-a445-4c3fb169065e tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:51.458532 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-21dc6093-539d-43ba-a445-4c3fb169065e tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:51.461966 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-21dc6093-539d-43ba-a445-4c3fb169065e tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:51.464833 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-21dc6093-539d-43ba-a445-4c3fb169065e tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:51.900443 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d24744b8-3173-487d-b722-1c7b2bb437cb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:51.914782 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d24744b8-3173-487d-b722-1c7b2bb437cb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b" status: 200 len: 1496 microversion: 2.1 time: 0.802113 Jul 25 14:39:51.915828 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1820/3451] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:51 2022] GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b => generated 1496 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:51.921058 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0b0771e2-2e19-4fea-9f90-59d11df6cc4d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:51.930674 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0b0771e2-2e19-4fea-9f90-59d11df6cc4d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:51.947654 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b0771e2-2e19-4fea-9f90-59d11df6cc4d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:51.948252 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b0771e2-2e19-4fea-9f90-59d11df6cc4d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:51.949175 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b0771e2-2e19-4fea-9f90-59d11df6cc4d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:51.949764 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b0771e2-2e19-4fea-9f90-59d11df6cc4d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:52.066953 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0b0771e2-2e19-4fea-9f90-59d11df6cc4d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:52.086727 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0b0771e2-2e19-4fea-9f90-59d11df6cc4d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:52.088681 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0b0771e2-2e19-4fea-9f90-59d11df6cc4d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:52.089966 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0b0771e2-2e19-4fea-9f90-59d11df6cc4d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1340 microversion: 2.20 time: 0.172879 Jul 25 14:39:52.090654 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1821/3452] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:39:51 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1340 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:39:52.114166 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-f495cd70-519b-45f4-bbf2-61f4e5759c1b req-c3afa1b6-ae49-4d7e-b74d-7e0e1f9b21e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d31c05d7-3525-4ad4-9eb0-5ed163707f58", "name": "network-vif-deleted", "tag": "f4bf25dd-db33-4ccd-ba81-d3aa81754334"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:52.138611 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-f495cd70-519b-45f4-bbf2-61f4e5759c1b req-c3afa1b6-ae49-4d7e-b74d-7e0e1f9b21e6 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:52.139313 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-f495cd70-519b-45f4-bbf2-61f4e5759c1b req-c3afa1b6-ae49-4d7e-b74d-7e0e1f9b21e6 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:52.175234 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-f495cd70-519b-45f4-bbf2-61f4e5759c1b req-c3afa1b6-ae49-4d7e-b74d-7e0e1f9b21e6 service nova] Creating event network-vif-deleted:f4bf25dd-db33-4ccd-ba81-d3aa81754334 for instance d31c05d7-3525-4ad4-9eb0-5ed163707f58 on n-h2-846435-14 Jul 25 14:39:52.184283 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-f495cd70-519b-45f4-bbf2-61f4e5759c1b req-c3afa1b6-ae49-4d7e-b74d-7e0e1f9b21e6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077411 Jul 25 14:39:52.185768 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1822/3453] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:52.216912 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-21dc6093-539d-43ba-a445-4c3fb169065e tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a720adc1b3443a8062b3eb8c7df11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5771bc6c546646b5a432a114f76d373d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:52.228842 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-21dc6093-539d-43ba-a445-4c3fb169065e tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58" status: 200 len: 1472 microversion: 2.1 time: 0.804182 Jul 25 14:39:52.246099 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1632/3454] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:51 2022] GET /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58 => generated 1472 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:39:52.938510 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7a3d8907-413d-4311-b45b-b97379ef3150 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:52.939208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7a3d8907-413d-4311-b45b-b97379ef3150 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 0a5407b3-d293-4f14-9379-b64b57b4a94b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:52.947150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a3d8907-413d-4311-b45b-b97379ef3150 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:52.947855 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a3d8907-413d-4311-b45b-b97379ef3150 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:52.949208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a3d8907-413d-4311-b45b-b97379ef3150 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:52.950061 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a3d8907-413d-4311-b45b-b97379ef3150 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:53.117610 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5aadb2ca-f5a8-4084-8394-32a8f75f36a7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:53.118211 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5aadb2ca-f5a8-4084-8394-32a8f75f36a7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:53.125945 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5aadb2ca-f5a8-4084-8394-32a8f75f36a7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:53.126856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5aadb2ca-f5a8-4084-8394-32a8f75f36a7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:53.138997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5aadb2ca-f5a8-4084-8394-32a8f75f36a7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:53.141490 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5aadb2ca-f5a8-4084-8394-32a8f75f36a7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:53.347770 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5aadb2ca-f5a8-4084-8394-32a8f75f36a7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:53.368426 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5aadb2ca-f5a8-4084-8394-32a8f75f36a7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:53.372066 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5aadb2ca-f5a8-4084-8394-32a8f75f36a7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:53.375222 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5aadb2ca-f5a8-4084-8394-32a8f75f36a7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1340 microversion: 2.20 time: 0.262030 Jul 25 14:39:53.380307 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1633/3455] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:39:53 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1340 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:39:53.401759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a0e8175c-9bfe-46b6-949e-282d204365a4 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:53.402884 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a0e8175c-9bfe-46b6-949e-282d204365a4 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: d31c05d7-3525-4ad4-9eb0-5ed163707f58] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:53.415575 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a0e8175c-9bfe-46b6-949e-282d204365a4 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:53.416199 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a0e8175c-9bfe-46b6-949e-282d204365a4 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:53.417298 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a0e8175c-9bfe-46b6-949e-282d204365a4 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:53.419098 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7a3d8907-413d-4311-b45b-b97379ef3150 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:53.419924 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a0e8175c-9bfe-46b6-949e-282d204365a4 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:53.446727 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-a0e8175c-9bfe-46b6-949e-282d204365a4 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] HTTP exception thrown: Instance d31c05d7-3525-4ad4-9eb0-5ed163707f58 could not be found. Jul 25 14:39:53.451486 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7a3d8907-413d-4311-b45b-b97379ef3150 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b" status: 200 len: 1496 microversion: 2.1 time: 0.507646 Jul 25 14:39:53.452204 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1823/3456] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:52 2022] GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b => generated 1496 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a0e8175c-9bfe-46b6-949e-282d204365a4 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Request method failure captured: Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58 HTTP/1.1 Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qpn06Xi0KaNgrmUCHgzEgQ96AGBkB1Y86kjlyHQprl6Lj_E8wC5bUe7Os2QLuGPqDRl43HHCdK3pHn44XyjTm7dXXZa_N98zpMvI5VrlpvyJx598JA0FS3NGPOp5oO43G69eF1mMaKnz0NywirRemkY-x8Xh8dfFFGZ0olHSeZ4Qmo Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 5771bc6c546646b5a432a114f76d373d Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-VolumesAdminNegativeTest-213034458 Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5771bc6c546646b5a432a114f76d373d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5771bc6c546646b5a432a114f76d373d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_5771bc6c546646b5a432a114f76d373d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/5771bc6c546646b5a432a114f76d373d"}]}] Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-VolumesAdminNegativeTest-213034458 Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 5771bc6c546646b5a432a114f76d373d Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-213034458 Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-VolumesAdminNegativeTest-213034458-project Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: a1a720adc1b3443a8062b3eb8c7df11c Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-VolumesAdminNegativeTest-213034458-project Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance d31c05d7-3525-4ad4-9eb0-5ed163707f58 could not be found. Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'd31c05d7-3525-4ad4-9eb0-5ed163707f58'} Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d31c05d7-3525-4ad4-9eb0-5ed163707f58 could not be found. Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d31c05d7-3525-4ad4-9eb0-5ed163707f58 could not be found. Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:53.466789 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:53.472964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:53.472964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:53.472964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:53.472964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:39:53.472964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:39:53.472964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d31c05d7-3525-4ad4-9eb0-5ed163707f58 could not be found. Jul 25 14:39:53.472964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:39:53.472964 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a0e8175c-9bfe-46b6-949e-282d204365a4 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Returning 404 to user: Instance d31c05d7-3525-4ad4-9eb0-5ed163707f58 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:39:53.472964 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a0e8175c-9bfe-46b6-949e-282d204365a4 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58" status: 404 len: 111 microversion: 2.1 time: 0.085313 Jul 25 14:39:53.472964 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1634/3457] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:53 2022] GET /compute/v2.1/servers/d31c05d7-3525-4ad4-9eb0-5ed163707f58 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:39:54.405173 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a7a1f7ec-efda-43e6-b791-ddb5b00fdfa1 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:54.406057 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a7a1f7ec-efda-43e6-b791-ddb5b00fdfa1 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:54.417294 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a7a1f7ec-efda-43e6-b791-ddb5b00fdfa1 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:54.417757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a7a1f7ec-efda-43e6-b791-ddb5b00fdfa1 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:54.420591 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a7a1f7ec-efda-43e6-b791-ddb5b00fdfa1 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:54.420591 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a7a1f7ec-efda-43e6-b791-ddb5b00fdfa1 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:54.474018 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2e080143-d59f-481c-bf4e-6f9be8388d94 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:54.475742 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2e080143-d59f-481c-bf4e-6f9be8388d94 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 0a5407b3-d293-4f14-9379-b64b57b4a94b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:54.495246 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2e080143-d59f-481c-bf4e-6f9be8388d94 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:54.496380 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2e080143-d59f-481c-bf4e-6f9be8388d94 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:54.498913 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2e080143-d59f-481c-bf4e-6f9be8388d94 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:54.505049 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2e080143-d59f-481c-bf4e-6f9be8388d94 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:54.855599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a7a1f7ec-efda-43e6-b791-ddb5b00fdfa1 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:54.865899 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a7a1f7ec-efda-43e6-b791-ddb5b00fdfa1 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:54.873335 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a7a1f7ec-efda-43e6-b791-ddb5b00fdfa1 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:54.874549 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a7a1f7ec-efda-43e6-b791-ddb5b00fdfa1 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1340 microversion: 2.20 time: 0.475092 Jul 25 14:39:54.875136 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1824/3458] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:39:54 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1340 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:39:54.953921 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2e080143-d59f-481c-bf4e-6f9be8388d94 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:54.967372 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2e080143-d59f-481c-bf4e-6f9be8388d94 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b" status: 200 len: 1454 microversion: 2.1 time: 0.496356 Jul 25 14:39:54.971253 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1635/3459] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:54 2022] GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b => generated 1454 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:54.978207 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-5eeb1ee9-e535-4fca-9c32-c33662f2e7ab req-44fb92c0-10d6-4cee-a8c6-042839493176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a5407b3-d293-4f14-9379-b64b57b4a94b", "name": "network-vif-deleted", "tag": "70626436-8a3d-45db-9c32-c7681a62b0dd"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:55.000857 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-5eeb1ee9-e535-4fca-9c32-c33662f2e7ab req-44fb92c0-10d6-4cee-a8c6-042839493176 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:55.001695 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-5eeb1ee9-e535-4fca-9c32-c33662f2e7ab req-44fb92c0-10d6-4cee-a8c6-042839493176 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:55.024134 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-5eeb1ee9-e535-4fca-9c32-c33662f2e7ab req-44fb92c0-10d6-4cee-a8c6-042839493176 service nova] Creating event network-vif-deleted:70626436-8a3d-45db-9c32-c7681a62b0dd for instance 0a5407b3-d293-4f14-9379-b64b57b4a94b on n-h1-846435-14 Jul 25 14:39:55.040471 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-5eeb1ee9-e535-4fca-9c32-c33662f2e7ab req-44fb92c0-10d6-4cee-a8c6-042839493176 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065366 Jul 25 14:39:55.043302 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1825/3460] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:55.905084 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-29bcd100-15c6-4a58-98d2-5fa7c9066bc7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:55.905680 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-29bcd100-15c6-4a58-98d2-5fa7c9066bc7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:55.928596 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-29bcd100-15c6-4a58-98d2-5fa7c9066bc7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:55.929053 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-29bcd100-15c6-4a58-98d2-5fa7c9066bc7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:55.929839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-29bcd100-15c6-4a58-98d2-5fa7c9066bc7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:55.930413 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-29bcd100-15c6-4a58-98d2-5fa7c9066bc7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:55.995316 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b5f71f46-6150-4ced-837a-087b569753f9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:55.997112 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b5f71f46-6150-4ced-837a-087b569753f9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 0a5407b3-d293-4f14-9379-b64b57b4a94b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:56.010530 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b5f71f46-6150-4ced-837a-087b569753f9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:56.011251 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b5f71f46-6150-4ced-837a-087b569753f9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:56.013710 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b5f71f46-6150-4ced-837a-087b569753f9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:56.014982 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b5f71f46-6150-4ced-837a-087b569753f9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:56.052454 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-b5f71f46-6150-4ced-837a-087b569753f9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] HTTP exception thrown: Instance 0a5407b3-d293-4f14-9379-b64b57b4a94b could not be found. Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b5f71f46-6150-4ced-837a-087b569753f9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Request method failure captured: Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b HTTP/1.1 Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qrEzscNKkpLEv-dO5KC3kdeJJY02nOIPLRIxGcrQR-Na_rLZBnVMM8MjTz-RtprnQR45AAorrNLLV4PDOD1PCa-gGNHdgbGOQfAGQYPzZpu9aSUEO6v7jEn8m2OVF51pdW16QE7pCXmLdRnFRt172yMaxqytlLvEMs-sUVBeXNXrcQ Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e77732af189e48feab3752ddb28208d3", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e77732af189e48feab3752ddb28208d3"}]}] Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersTestJSON-1827246574 Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersTestJSON-1827246574-project Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: e45ffe0956ae4ba9b1577875f312af06 Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersTestJSON-1827246574-project Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 0a5407b3-d293-4f14-9379-b64b57b4a94b could not be found. Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '0a5407b3-d293-4f14-9379-b64b57b4a94b'} Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a5407b3-d293-4f14-9379-b64b57b4a94b could not be found. Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a5407b3-d293-4f14-9379-b64b57b4a94b could not be found. Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:56.059162 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:39:56.063516 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:39:56.063516 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:39:56.063516 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:39:56.063516 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:39:56.063516 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a5407b3-d293-4f14-9379-b64b57b4a94b could not be found. Jul 25 14:39:56.063516 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:39:56.066675 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b5f71f46-6150-4ced-837a-087b569753f9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Returning 404 to user: Instance 0a5407b3-d293-4f14-9379-b64b57b4a94b could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:39:56.067740 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b5f71f46-6150-4ced-837a-087b569753f9 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b" status: 404 len: 111 microversion: 2.1 time: 0.079615 Jul 25 14:39:56.070686 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1826/3461] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:55 2022] GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:39:56.079792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cd25ad32-0aa0-4271-8144-ab5d959ac136 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:56.083565 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cd25ad32-0aa0-4271-8144-ab5d959ac136 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 31135b90-13f0-431a-994f-8af08fbd3248] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:56.094273 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cd25ad32-0aa0-4271-8144-ab5d959ac136 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:56.094930 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cd25ad32-0aa0-4271-8144-ab5d959ac136 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:56.095878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cd25ad32-0aa0-4271-8144-ab5d959ac136 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:56.096870 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cd25ad32-0aa0-4271-8144-ab5d959ac136 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:56.141141 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cd25ad32-0aa0-4271-8144-ab5d959ac136 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 31135b90-13f0-431a-994f-8af08fbd3248] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:39:56.257443 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:39:56.267159 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cd25ad32-0aa0-4271-8144-ab5d959ac136 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "DELETE /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248" status: 204 len: 0 microversion: 2.1 time: 0.190371 Jul 25 14:39:56.273728 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1827/3462] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:39:56 2022] DELETE /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:39:56.295541 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ef0c6ced-78b0-4f14-89e1-7bd93dbd0080 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:56.296338 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ef0c6ced-78b0-4f14-89e1-7bd93dbd0080 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 31135b90-13f0-431a-994f-8af08fbd3248] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:56.317896 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-29bcd100-15c6-4a58-98d2-5fa7c9066bc7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:56.342628 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ef0c6ced-78b0-4f14-89e1-7bd93dbd0080 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:56.343143 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-29bcd100-15c6-4a58-98d2-5fa7c9066bc7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:56.347872 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-29bcd100-15c6-4a58-98d2-5fa7c9066bc7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:56.348694 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ef0c6ced-78b0-4f14-89e1-7bd93dbd0080 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:56.349545 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-29bcd100-15c6-4a58-98d2-5fa7c9066bc7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1408 microversion: 2.20 time: 0.450403 Jul 25 14:39:56.349678 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ef0c6ced-78b0-4f14-89e1-7bd93dbd0080 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:56.350180 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ef0c6ced-78b0-4f14-89e1-7bd93dbd0080 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:56.353389 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1636/3463] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:39:55 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1408 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:39:56.786050 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ef0c6ced-78b0-4f14-89e1-7bd93dbd0080 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:56.803799 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ef0c6ced-78b0-4f14-89e1-7bd93dbd0080 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248" status: 200 len: 1495 microversion: 2.1 time: 0.525645 Jul 25 14:39:56.805170 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1828/3464] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:56 2022] GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248 => generated 1495 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:39:57.069937 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-a830dbb7-f4fd-4085-b9bf-860c07059c28 req-a59eaaeb-5c92-42e2-b719-686dab40e46f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "034e5d63-63a1-4883-b7f8-fe84ec541914", "tag": "350ec399-ee42-4e58-9f27-5bd9094cb8e1"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:39:57.091721 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-a830dbb7-f4fd-4085-b9bf-860c07059c28 req-a59eaaeb-5c92-42e2-b719-686dab40e46f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:57.092558 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-a830dbb7-f4fd-4085-b9bf-860c07059c28 req-a59eaaeb-5c92-42e2-b719-686dab40e46f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:57.113811 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-a830dbb7-f4fd-4085-b9bf-860c07059c28 req-a59eaaeb-5c92-42e2-b719-686dab40e46f service nova] Creating event network-changed:350ec399-ee42-4e58-9f27-5bd9094cb8e1 for instance 034e5d63-63a1-4883-b7f8-fe84ec541914 on n-h2-846435-14 Jul 25 14:39:57.137472 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-a830dbb7-f4fd-4085-b9bf-860c07059c28 req-a59eaaeb-5c92-42e2-b719-686dab40e46f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073712 Jul 25 14:39:57.139421 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1637/3465] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:39:57.375324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-205e2a38-9686-4602-bc78-5ab8b999f1fc tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:57.375940 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-205e2a38-9686-4602-bc78-5ab8b999f1fc tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:57.388877 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-205e2a38-9686-4602-bc78-5ab8b999f1fc tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:57.389666 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-205e2a38-9686-4602-bc78-5ab8b999f1fc tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:57.390664 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-205e2a38-9686-4602-bc78-5ab8b999f1fc tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:57.391340 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-205e2a38-9686-4602-bc78-5ab8b999f1fc tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:57.834314 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-79399710-ac37-4f9b-8197-32e63ffac3a4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:57.834924 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-79399710-ac37-4f9b-8197-32e63ffac3a4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 31135b90-13f0-431a-994f-8af08fbd3248] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:57.853183 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-79399710-ac37-4f9b-8197-32e63ffac3a4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:57.854216 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-79399710-ac37-4f9b-8197-32e63ffac3a4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:57.855251 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-79399710-ac37-4f9b-8197-32e63ffac3a4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:57.855899 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-79399710-ac37-4f9b-8197-32e63ffac3a4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:58.031562 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-205e2a38-9686-4602-bc78-5ab8b999f1fc tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:58.037042 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:39:58.055314 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-205e2a38-9686-4602-bc78-5ab8b999f1fc tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:58.069434 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-205e2a38-9686-4602-bc78-5ab8b999f1fc tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:58.077374 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-205e2a38-9686-4602-bc78-5ab8b999f1fc tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1408 microversion: 2.20 time: 0.706314 Jul 25 14:39:58.082384 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1829/3466] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:39:57 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1408 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:39:58.946843 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-79399710-ac37-4f9b-8197-32e63ffac3a4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:39:58.961847 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-79399710-ac37-4f9b-8197-32e63ffac3a4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248" status: 200 len: 1495 microversion: 2.1 time: 1.135042 Jul 25 14:39:58.972610 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1638/3467] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:57 2022] GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248 => generated 1495 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:39:59.112884 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ed5c5c73-50c9-40db-86c0-9ecacbc04c44 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:59.114661 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ed5c5c73-50c9-40db-86c0-9ecacbc04c44 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:59.141873 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed5c5c73-50c9-40db-86c0-9ecacbc04c44 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:59.142324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed5c5c73-50c9-40db-86c0-9ecacbc04c44 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:59.143118 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed5c5c73-50c9-40db-86c0-9ecacbc04c44 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:59.158222 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed5c5c73-50c9-40db-86c0-9ecacbc04c44 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:59.216821 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-84be5e4a-9034-4528-9269-f6fe48e688d2 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:59.217586 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-84be5e4a-9034-4528-9269-f6fe48e688d2 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:59.234241 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-84be5e4a-9034-4528-9269-f6fe48e688d2 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:59.234710 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-84be5e4a-9034-4528-9269-f6fe48e688d2 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:59.235506 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-84be5e4a-9034-4528-9269-f6fe48e688d2 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:59.235950 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-84be5e4a-9034-4528-9269-f6fe48e688d2 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:59.313073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-84be5e4a-9034-4528-9269-f6fe48e688d2 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:39:59.535838 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-84be5e4a-9034-4528-9269-f6fe48e688d2 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "DELETE /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653" status: 204 len: 0 microversion: 2.1 time: 0.323990 Jul 25 14:39:59.536473 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1639/3468] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:39:59 2022] DELETE /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:39:59.555374 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5d003511-cfaf-4020-8716-7825625e4b0b tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:39:59.556509 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5d003511-cfaf-4020-8716-7825625e4b0b tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:39:59.576094 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5d003511-cfaf-4020-8716-7825625e4b0b tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:59.576827 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5d003511-cfaf-4020-8716-7825625e4b0b tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:59.577778 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5d003511-cfaf-4020-8716-7825625e4b0b tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:39:59.582080 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5d003511-cfaf-4020-8716-7825625e4b0b tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:39:59.847207 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:39:59.880526 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=10 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:40:00.034781 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5d003511-cfaf-4020-8716-7825625e4b0b tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a720adc1b3443a8062b3eb8c7df11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5771bc6c546646b5a432a114f76d373d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:00.052708 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5d003511-cfaf-4020-8716-7825625e4b0b tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653" status: 200 len: 1680 microversion: 2.1 time: 0.511460 Jul 25 14:40:00.054019 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1640/3469] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:39:59 2022] GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653 => generated 1680 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:40:00.069068 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f3c4aa3d-1045-4262-82f0-4d83f8cec629 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:00.069789 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f3c4aa3d-1045-4262-82f0-4d83f8cec629 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 31135b90-13f0-431a-994f-8af08fbd3248] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:00.100993 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3c4aa3d-1045-4262-82f0-4d83f8cec629 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:00.101571 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3c4aa3d-1045-4262-82f0-4d83f8cec629 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:00.105777 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3c4aa3d-1045-4262-82f0-4d83f8cec629 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:00.109621 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3c4aa3d-1045-4262-82f0-4d83f8cec629 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:00.278734 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f3c4aa3d-1045-4262-82f0-4d83f8cec629 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:00.298763 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f3c4aa3d-1045-4262-82f0-4d83f8cec629 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248" status: 200 len: 1293 microversion: 2.1 time: 0.244019 Jul 25 14:40:00.299356 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1641/3470] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:00 2022] GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248 => generated 1293 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:00.310141 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-8e6fe061-27d1-45ba-9b48-dea90c744f19 req-a1663caa-f497-40b0-91c1-45c39d6f8e38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31135b90-13f0-431a-994f-8af08fbd3248", "name": "network-vif-deleted", "tag": "649aaa46-4125-4b47-9e2c-1583d94132a2"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:40:00.341747 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-8e6fe061-27d1-45ba-9b48-dea90c744f19 req-a1663caa-f497-40b0-91c1-45c39d6f8e38 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:00.342203 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-8e6fe061-27d1-45ba-9b48-dea90c744f19 req-a1663caa-f497-40b0-91c1-45c39d6f8e38 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:00.370371 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-8e6fe061-27d1-45ba-9b48-dea90c744f19 req-a1663caa-f497-40b0-91c1-45c39d6f8e38 service nova] Creating event network-vif-deleted:649aaa46-4125-4b47-9e2c-1583d94132a2 for instance 31135b90-13f0-431a-994f-8af08fbd3248 on n-h1-846435-14 Jul 25 14:40:00.371184 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ed5c5c73-50c9-40db-86c0-9ecacbc04c44 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:00.381094 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ed5c5c73-50c9-40db-86c0-9ecacbc04c44 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:00.382038 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-8e6fe061-27d1-45ba-9b48-dea90c744f19 req-a1663caa-f497-40b0-91c1-45c39d6f8e38 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080167 Jul 25 14:40:00.385801 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1642/3471] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:40:00.387076 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ed5c5c73-50c9-40db-86c0-9ecacbc04c44 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:00.391948 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ed5c5c73-50c9-40db-86c0-9ecacbc04c44 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1408 microversion: 2.20 time: 1.289283 Jul 25 14:40:00.393221 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1830/3472] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:39:59 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1408 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:40:01.072236 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:40:01.082014 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b1689542-3802-41f5-b82d-7eaa00b76323 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:01.083655 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b1689542-3802-41f5-b82d-7eaa00b76323 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:01.120647 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b1689542-3802-41f5-b82d-7eaa00b76323 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:01.122666 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b1689542-3802-41f5-b82d-7eaa00b76323 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:01.123622 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b1689542-3802-41f5-b82d-7eaa00b76323 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:01.129223 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b1689542-3802-41f5-b82d-7eaa00b76323 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:01.323397 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-efdcba5c-3aad-4d7c-9ad8-4626de6de059 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:01.325389 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-efdcba5c-3aad-4d7c-9ad8-4626de6de059 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 31135b90-13f0-431a-994f-8af08fbd3248] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:01.339823 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-efdcba5c-3aad-4d7c-9ad8-4626de6de059 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:01.340559 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-efdcba5c-3aad-4d7c-9ad8-4626de6de059 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:01.342458 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-efdcba5c-3aad-4d7c-9ad8-4626de6de059 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:01.344586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-efdcba5c-3aad-4d7c-9ad8-4626de6de059 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:01.381880 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-efdcba5c-3aad-4d7c-9ad8-4626de6de059 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] HTTP exception thrown: Instance 31135b90-13f0-431a-994f-8af08fbd3248 could not be found. Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-efdcba5c-3aad-4d7c-9ad8-4626de6de059 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Request method failure captured: Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248 HTTP/1.1 Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qrEzscNKkpLEv-dO5KC3kdeJJY02nOIPLRIxGcrQR-Na_rLZBnVMM8MjTz-RtprnQR45AAorrNLLV4PDOD1PCa-gGNHdgbGOQfAGQYPzZpu9aSUEO6v7jEn8m2OVF51pdW16QE7pCXmLdRnFRt172yMaxqytlLvEMs-sUVBeXNXrcQ Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e77732af189e48feab3752ddb28208d3", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e77732af189e48feab3752ddb28208d3"}]}] Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersTestJSON-1827246574 Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersTestJSON-1827246574-project Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: e45ffe0956ae4ba9b1577875f312af06 Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersTestJSON-1827246574-project Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 31135b90-13f0-431a-994f-8af08fbd3248 could not be found. Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '31135b90-13f0-431a-994f-8af08fbd3248'} Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31135b90-13f0-431a-994f-8af08fbd3248 could not be found. Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31135b90-13f0-431a-994f-8af08fbd3248 could not be found. Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:01.397143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:40:01.403043 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:40:01.403043 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:40:01.403043 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:40:01.403043 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:40:01.403043 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31135b90-13f0-431a-994f-8af08fbd3248 could not be found. Jul 25 14:40:01.403043 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:01.403043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-efdcba5c-3aad-4d7c-9ad8-4626de6de059 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Returning 404 to user: Instance 31135b90-13f0-431a-994f-8af08fbd3248 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:40:01.404628 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-efdcba5c-3aad-4d7c-9ad8-4626de6de059 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248" status: 404 len: 111 microversion: 2.1 time: 0.088193 Jul 25 14:40:01.407919 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1831/3473] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:01 2022] GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:40:01.437103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cbc2c2d3-2e42-48e7-9292-7cdbd70d149f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:01.437888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cbc2c2d3-2e42-48e7-9292-7cdbd70d149f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:01.455293 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cbc2c2d3-2e42-48e7-9292-7cdbd70d149f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:01.456062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cbc2c2d3-2e42-48e7-9292-7cdbd70d149f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:01.456990 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cbc2c2d3-2e42-48e7-9292-7cdbd70d149f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:01.460801 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cbc2c2d3-2e42-48e7-9292-7cdbd70d149f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:01.792875 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b1689542-3802-41f5-b82d-7eaa00b76323 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a720adc1b3443a8062b3eb8c7df11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5771bc6c546646b5a432a114f76d373d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:01.805058 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b1689542-3802-41f5-b82d-7eaa00b76323 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653" status: 200 len: 1680 microversion: 2.1 time: 0.733048 Jul 25 14:40:01.806127 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1643/3474] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:01 2022] GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653 => generated 1680 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:01.812585 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bec2b129-82de-4412-bc23-bcdd20318781 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1710296718", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "4c176170-2f7d-43a7-8c89-c74c022eb418"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:40:01.847127 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cbc2c2d3-2e42-48e7-9292-7cdbd70d149f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:01.866016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cbc2c2d3-2e42-48e7-9292-7cdbd70d149f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:01.867855 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cbc2c2d3-2e42-48e7-9292-7cdbd70d149f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:01.869182 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cbc2c2d3-2e42-48e7-9292-7cdbd70d149f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1408 microversion: 2.20 time: 0.446958 Jul 25 14:40:01.870410 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1832/3475] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:40:01 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1408 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:40:01.906178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-bec2b129-82de-4412-bc23-bcdd20318781 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] validate_networks() for [('4c176170-2f7d-43a7-8c89-c74c022eb418', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:40:02.872538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-84636b3c-720e-4df3-a881-d630a3fc2953 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-314005283", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "91144ddd-9d56-47d4-a1ba-fdd31dc14a1c"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:40:03.017270 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-84636b3c-720e-4df3-a881-d630a3fc2953 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] validate_networks() for [('91144ddd-9d56-47d4-a1ba-fdd31dc14a1c', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:40:03.450741 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-bec2b129-82de-4412-bc23-bcdd20318781 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:40:03.451730 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-bec2b129-82de-4412-bc23-bcdd20318781 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:40:03.452403 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-bec2b129-82de-4412-bc23-bcdd20318781 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:40:03.453003 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-bec2b129-82de-4412-bc23-bcdd20318781 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:40:03.453583 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-bec2b129-82de-4412-bc23-bcdd20318781 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:40:03.477297 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bec2b129-82de-4412-bc23-bcdd20318781 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:03.477752 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bec2b129-82de-4412-bc23-bcdd20318781 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:03.485868 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bec2b129-82de-4412-bc23-bcdd20318781 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:03.486998 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bec2b129-82de-4412-bc23-bcdd20318781 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:03.581224 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-bec2b129-82de-4412-bc23-bcdd20318781 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Getting quotas for project e77732af189e48feab3752ddb28208d3. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:40:03.601479 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-bec2b129-82de-4412-bc23-bcdd20318781 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Getting quotas for user e45ffe0956ae4ba9b1577875f312af06 and project e77732af189e48feab3752ddb28208d3. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:40:03.619679 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bec2b129-82de-4412-bc23-bcdd20318781 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:40:03.623803 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bec2b129-82de-4412-bc23-bcdd20318781 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: bd38057a-c422-40f2-9bc0-cb454cbe96c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:40:03.741295 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bec2b129-82de-4412-bc23-bcdd20318781 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.933660 Jul 25 14:40:03.748414 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1644/3476] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:40:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:40:03.775811 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2568e742-18b5-488a-8c96-ee9128aefa04 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:03.778998 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2568e742-18b5-488a-8c96-ee9128aefa04 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:03.791500 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2568e742-18b5-488a-8c96-ee9128aefa04 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:03.792424 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2568e742-18b5-488a-8c96-ee9128aefa04 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:03.793441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2568e742-18b5-488a-8c96-ee9128aefa04 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:03.794141 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2568e742-18b5-488a-8c96-ee9128aefa04 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:03.846256 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:40:03.981949 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2568e742-18b5-488a-8c96-ee9128aefa04 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1a720adc1b3443a8062b3eb8c7df11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5771bc6c546646b5a432a114f76d373d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:03.997247 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2568e742-18b5-488a-8c96-ee9128aefa04 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653" status: 200 len: 1612 microversion: 2.1 time: 0.246086 Jul 25 14:40:03.998643 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1645/3477] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:03 2022] GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653 => generated 1612 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:04.017280 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5f68847a-5c3e-4884-bb81-88b8de163b2d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:04.017961 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5f68847a-5c3e-4884-bb81-88b8de163b2d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:04.026863 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f68847a-5c3e-4884-bb81-88b8de163b2d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:04.028441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f68847a-5c3e-4884-bb81-88b8de163b2d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:04.030975 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f68847a-5c3e-4884-bb81-88b8de163b2d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:04.033005 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f68847a-5c3e-4884-bb81-88b8de163b2d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:04.304511 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-84636b3c-720e-4df3-a881-d630a3fc2953 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:40:04.305226 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-84636b3c-720e-4df3-a881-d630a3fc2953 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:40:04.306048 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-84636b3c-720e-4df3-a881-d630a3fc2953 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:40:04.306784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-84636b3c-720e-4df3-a881-d630a3fc2953 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:40:04.307434 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-84636b3c-720e-4df3-a881-d630a3fc2953 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:40:04.372153 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-84636b3c-720e-4df3-a881-d630a3fc2953 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:04.372852 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-84636b3c-720e-4df3-a881-d630a3fc2953 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:04.383491 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-84636b3c-720e-4df3-a881-d630a3fc2953 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:04.386911 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-84636b3c-720e-4df3-a881-d630a3fc2953 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:04.427753 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-84636b3c-720e-4df3-a881-d630a3fc2953 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Getting quotas for project 3d8f99ef076f4f16b763db443da0dfb9. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:40:04.446333 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-84636b3c-720e-4df3-a881-d630a3fc2953 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Getting quotas for user 12d3ce8c9c8e46e2b4ea2f0ef9254fdf and project 3d8f99ef076f4f16b763db443da0dfb9. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:40:04.487285 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-84636b3c-720e-4df3-a881-d630a3fc2953 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:40:04.492450 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-84636b3c-720e-4df3-a881-d630a3fc2953 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] [instance: af17aed7-103f-49f3-84e7-c04b418e1201] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:40:04.629066 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-84636b3c-720e-4df3-a881-d630a3fc2953 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.275779 Jul 25 14:40:04.632825 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1833/3478] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:40:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:40:04.636168 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5f68847a-5c3e-4884-bb81-88b8de163b2d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:04.645405 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5f68847a-5c3e-4884-bb81-88b8de163b2d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:04.648410 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5e24a9c4-db2f-4a82-9d6f-e5162685c163 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:04.649476 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5e24a9c4-db2f-4a82-9d6f-e5162685c163 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: bd38057a-c422-40f2-9bc0-cb454cbe96c3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:04.660234 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5f68847a-5c3e-4884-bb81-88b8de163b2d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:04.661907 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5f68847a-5c3e-4884-bb81-88b8de163b2d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1408 microversion: 2.20 time: 0.661925 Jul 25 14:40:04.662200 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1646/3479] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:40:03 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1408 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:40:04.673810 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-b42b92c4-4bc5-4218-9f01-a0201c73a0fc req-5db2581a-34e9-46b1-a190-e81605834abb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e1fbfa4-195c-46bb-9a93-9ffd88ecf653", "name": "network-vif-deleted", "tag": "51baeba0-6ad9-4e68-ba06-613e8d367ad9"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:40:04.724070 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b42b92c4-4bc5-4218-9f01-a0201c73a0fc req-5db2581a-34e9-46b1-a190-e81605834abb service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:04.724567 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b42b92c4-4bc5-4218-9f01-a0201c73a0fc req-5db2581a-34e9-46b1-a190-e81605834abb service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:04.773169 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-b42b92c4-4bc5-4218-9f01-a0201c73a0fc req-5db2581a-34e9-46b1-a190-e81605834abb service nova] Creating event network-vif-deleted:51baeba0-6ad9-4e68-ba06-613e8d367ad9 for instance 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653 on n-h2-846435-14 Jul 25 14:40:04.809034 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-b42b92c4-4bc5-4218-9f01-a0201c73a0fc req-5db2581a-34e9-46b1-a190-e81605834abb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145372 Jul 25 14:40:04.817615 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1647/3480] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:40:04.846039 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2cd5b38b-36c5-48ed-ac6c-bbf08bc5be82 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:04.846770 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2cd5b38b-36c5-48ed-ac6c-bbf08bc5be82 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] [instance: af17aed7-103f-49f3-84e7-c04b418e1201] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:04.879144 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5e24a9c4-db2f-4a82-9d6f-e5162685c163 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:04.887750 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5e24a9c4-db2f-4a82-9d6f-e5162685c163 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3" status: 200 len: 1209 microversion: 2.1 time: 0.252913 Jul 25 14:40:04.891825 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1834/3481] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:04 2022] GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3 => generated 1209 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:05.026164 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d6f67f81-123c-4f2b-adae-58e8d27a4073 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:05.026999 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d6f67f81-123c-4f2b-adae-58e8d27a4073 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] [instance: 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:05.065137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d6f67f81-123c-4f2b-adae-58e8d27a4073 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:05.065588 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d6f67f81-123c-4f2b-adae-58e8d27a4073 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:05.066388 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d6f67f81-123c-4f2b-adae-58e8d27a4073 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:05.066814 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d6f67f81-123c-4f2b-adae-58e8d27a4073 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:05.153238 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-d6f67f81-123c-4f2b-adae-58e8d27a4073 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] HTTP exception thrown: Instance 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653 could not be found. Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d6f67f81-123c-4f2b-adae-58e8d27a4073 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Request method failure captured: Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653 HTTP/1.1 Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qpn06Xi0KaNgrmUCHgzEgQ96AGBkB1Y86kjlyHQprl6Lj_E8wC5bUe7Os2QLuGPqDRl43HHCdK3pHn44XyjTm7dXXZa_N98zpMvI5VrlpvyJx598JA0FS3NGPOp5oO43G69eF1mMaKnz0NywirRemkY-x8Xh8dfFFGZ0olHSeZ4Qmo Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 5771bc6c546646b5a432a114f76d373d Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-VolumesAdminNegativeTest-213034458 Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5771bc6c546646b5a432a114f76d373d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/5771bc6c546646b5a432a114f76d373d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_5771bc6c546646b5a432a114f76d373d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/5771bc6c546646b5a432a114f76d373d"}]}] Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-VolumesAdminNegativeTest-213034458 Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 5771bc6c546646b5a432a114f76d373d Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-213034458 Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-VolumesAdminNegativeTest-213034458-project Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: a1a720adc1b3443a8062b3eb8c7df11c Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-VolumesAdminNegativeTest-213034458-project Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653 could not be found. Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '5e1fbfa4-195c-46bb-9a93-9ffd88ecf653'} Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653 could not be found. Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653 could not be found. Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:40:05.155476 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:05.161030 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:40:05.161030 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:40:05.161030 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:40:05.161030 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:40:05.161030 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:40:05.161030 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653 could not be found. Jul 25 14:40:05.161030 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:05.162875 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d6f67f81-123c-4f2b-adae-58e8d27a4073 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Returning 404 to user: Instance 5e1fbfa4-195c-46bb-9a93-9ffd88ecf653 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:40:05.165032 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d6f67f81-123c-4f2b-adae-58e8d27a4073 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653" status: 404 len: 111 microversion: 2.1 time: 0.144117 Jul 25 14:40:05.171156 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1835/3482] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:05 2022] GET /compute/v2.1/servers/5e1fbfa4-195c-46bb-9a93-9ffd88ecf653 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:40:05.184375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0eda9990-cf96-4ab5-b876-2a23f458d748 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] Calling method '.version_select at 0x7f46878f1670>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:05.250251 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0eda9990-cf96-4ab5-b876-2a23f458d748 tempest-VolumesAdminNegativeTest-213034458 tempest-VolumesAdminNegativeTest-213034458-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-848541643" status: 202 len: 0 microversion: 2.1 time: 0.075835 Jul 25 14:40:05.253596 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1836/3483] 10.222.0.88 () {58 vars in 1218 bytes} [Mon Jul 25 14:40:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-848541643 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:40:05.276145 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2cd5b38b-36c5-48ed-ac6c-bbf08bc5be82 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3ce8c9c8e46e2b4ea2f0ef9254fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8f99ef076f4f16b763db443da0dfb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:05.287086 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2cd5b38b-36c5-48ed-ac6c-bbf08bc5be82 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] 10.222.0.88 "GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201" status: 200 len: 1216 microversion: 2.1 time: 0.462225 Jul 25 14:40:05.287735 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1648/3484] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:04 2022] GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201 => generated 1216 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:05.690423 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-badc07c0-c51f-4c75-b5b4-f60255de2f2e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:05.691429 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-badc07c0-c51f-4c75-b5b4-f60255de2f2e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:05.743043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-badc07c0-c51f-4c75-b5b4-f60255de2f2e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:05.744029 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-badc07c0-c51f-4c75-b5b4-f60255de2f2e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:05.745199 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-badc07c0-c51f-4c75-b5b4-f60255de2f2e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:05.746025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-badc07c0-c51f-4c75-b5b4-f60255de2f2e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:05.912976 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e4c04d2b-f66f-40ab-907a-b7d9c85d216c tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:05.914392 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e4c04d2b-f66f-40ab-907a-b7d9c85d216c tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: bd38057a-c422-40f2-9bc0-cb454cbe96c3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:05.929403 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e4c04d2b-f66f-40ab-907a-b7d9c85d216c tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:05.929868 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e4c04d2b-f66f-40ab-907a-b7d9c85d216c tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:05.930672 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e4c04d2b-f66f-40ab-907a-b7d9c85d216c tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:05.931121 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e4c04d2b-f66f-40ab-907a-b7d9c85d216c tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:06.097089 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e4c04d2b-f66f-40ab-907a-b7d9c85d216c tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:06.106258 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e4c04d2b-f66f-40ab-907a-b7d9c85d216c tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3" status: 200 len: 1279 microversion: 2.1 time: 0.197724 Jul 25 14:40:06.106921 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1649/3485] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:05 2022] GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3 => generated 1279 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:06.314180 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b7dcdb5b-bdd9-450a-b678-20606a0b14ef tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:06.314826 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b7dcdb5b-bdd9-450a-b678-20606a0b14ef tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] [instance: af17aed7-103f-49f3-84e7-c04b418e1201] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:06.330606 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b7dcdb5b-bdd9-450a-b678-20606a0b14ef tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:06.335263 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b7dcdb5b-bdd9-450a-b678-20606a0b14ef tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:06.337619 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b7dcdb5b-bdd9-450a-b678-20606a0b14ef tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:06.338095 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b7dcdb5b-bdd9-450a-b678-20606a0b14ef tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:06.434886 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-badc07c0-c51f-4c75-b5b4-f60255de2f2e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:06.451600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-badc07c0-c51f-4c75-b5b4-f60255de2f2e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:06.456434 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-badc07c0-c51f-4c75-b5b4-f60255de2f2e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:06.467594 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-badc07c0-c51f-4c75-b5b4-f60255de2f2e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1408 microversion: 2.20 time: 0.779531 Jul 25 14:40:06.494846 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1837/3486] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:40:05 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1408 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:40:06.590762 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b7dcdb5b-bdd9-450a-b678-20606a0b14ef tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3ce8c9c8e46e2b4ea2f0ef9254fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8f99ef076f4f16b763db443da0dfb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:06.609574 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b7dcdb5b-bdd9-450a-b678-20606a0b14ef tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] 10.222.0.88 "GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201" status: 200 len: 1268 microversion: 2.1 time: 0.300135 Jul 25 14:40:06.611085 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1650/3487] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:06 2022] GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201 => generated 1268 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:07.131288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-495ddea2-9569-4f74-96a8-dc8bb2efa680 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:07.132127 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-495ddea2-9569-4f74-96a8-dc8bb2efa680 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: bd38057a-c422-40f2-9bc0-cb454cbe96c3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:07.149288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-495ddea2-9569-4f74-96a8-dc8bb2efa680 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:07.150294 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-495ddea2-9569-4f74-96a8-dc8bb2efa680 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:07.152748 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-495ddea2-9569-4f74-96a8-dc8bb2efa680 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:07.155010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-495ddea2-9569-4f74-96a8-dc8bb2efa680 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:07.463245 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-495ddea2-9569-4f74-96a8-dc8bb2efa680 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:07.472689 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-495ddea2-9569-4f74-96a8-dc8bb2efa680 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3" status: 200 len: 1267 microversion: 2.1 time: 0.346098 Jul 25 14:40:07.484633 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1838/3488] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:07 2022] GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3 => generated 1267 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:07.511447 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-17f07a08-4e11-46de-b09b-0829bb72ca12 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:07.512963 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-17f07a08-4e11-46de-b09b-0829bb72ca12 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:07.527884 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-17f07a08-4e11-46de-b09b-0829bb72ca12 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:07.529577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-17f07a08-4e11-46de-b09b-0829bb72ca12 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:07.531102 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-17f07a08-4e11-46de-b09b-0829bb72ca12 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:07.531835 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-17f07a08-4e11-46de-b09b-0829bb72ca12 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:07.631931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-181e0033-41e0-407c-af8e-8b2580234149 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:07.632684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-181e0033-41e0-407c-af8e-8b2580234149 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] [instance: af17aed7-103f-49f3-84e7-c04b418e1201] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:07.645723 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-181e0033-41e0-407c-af8e-8b2580234149 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:07.646182 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-181e0033-41e0-407c-af8e-8b2580234149 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:07.656216 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-181e0033-41e0-407c-af8e-8b2580234149 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:07.656705 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-181e0033-41e0-407c-af8e-8b2580234149 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:07.818176 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-181e0033-41e0-407c-af8e-8b2580234149 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3ce8c9c8e46e2b4ea2f0ef9254fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8f99ef076f4f16b763db443da0dfb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:07.829166 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-181e0033-41e0-407c-af8e-8b2580234149 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] 10.222.0.88 "GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201" status: 200 len: 1274 microversion: 2.1 time: 0.201383 Jul 25 14:40:07.830113 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1839/3489] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:07 2022] GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201 => generated 1274 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:40:08.139001 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-17f07a08-4e11-46de-b09b-0829bb72ca12 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:08.156253 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-17f07a08-4e11-46de-b09b-0829bb72ca12 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:08.162723 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-17f07a08-4e11-46de-b09b-0829bb72ca12 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:08.164839 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-17f07a08-4e11-46de-b09b-0829bb72ca12 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1408 microversion: 2.20 time: 0.660058 Jul 25 14:40:08.178861 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1651/3490] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:40:07 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1408 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:40:08.301903 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-b5de8722-e026-4993-9c04-00f83afec1f3 req-eb8d21b3-4dc7-449d-a616-0e059a177f98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "034e5d63-63a1-4883-b7f8-fe84ec541914", "name": "network-vif-plugged", "status": "completed", "tag": "350ec399-ee42-4e58-9f27-5bd9094cb8e1"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:40:08.332997 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-b5de8722-e026-4993-9c04-00f83afec1f3 req-eb8d21b3-4dc7-449d-a616-0e059a177f98 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:08.333547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-b5de8722-e026-4993-9c04-00f83afec1f3 req-eb8d21b3-4dc7-449d-a616-0e059a177f98 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:08.361253 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-b5de8722-e026-4993-9c04-00f83afec1f3 req-eb8d21b3-4dc7-449d-a616-0e059a177f98 service nova] Creating event network-vif-plugged:350ec399-ee42-4e58-9f27-5bd9094cb8e1 for instance 034e5d63-63a1-4883-b7f8-fe84ec541914 on n-h2-846435-14 Jul 25 14:40:08.370893 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-b5de8722-e026-4993-9c04-00f83afec1f3 req-eb8d21b3-4dc7-449d-a616-0e059a177f98 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074049 Jul 25 14:40:08.371873 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1840/3491] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:40:08.509095 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3dd03779-3dae-4ecb-8b49-a88e8d6c998c tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:08.509776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3dd03779-3dae-4ecb-8b49-a88e8d6c998c tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: bd38057a-c422-40f2-9bc0-cb454cbe96c3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:08.542616 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3dd03779-3dae-4ecb-8b49-a88e8d6c998c tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:08.545919 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3dd03779-3dae-4ecb-8b49-a88e8d6c998c tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:08.548864 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3dd03779-3dae-4ecb-8b49-a88e8d6c998c tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:08.549351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3dd03779-3dae-4ecb-8b49-a88e8d6c998c tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:08.852061 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0cfd453b-2fb4-49d6-9f73-c0913b6c1375 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:08.852933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0cfd453b-2fb4-49d6-9f73-c0913b6c1375 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] [instance: af17aed7-103f-49f3-84e7-c04b418e1201] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:08.864650 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0cfd453b-2fb4-49d6-9f73-c0913b6c1375 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:08.865500 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0cfd453b-2fb4-49d6-9f73-c0913b6c1375 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:08.866778 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0cfd453b-2fb4-49d6-9f73-c0913b6c1375 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:08.867374 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0cfd453b-2fb4-49d6-9f73-c0913b6c1375 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:08.975724 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3dd03779-3dae-4ecb-8b49-a88e8d6c998c tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:08.999604 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3dd03779-3dae-4ecb-8b49-a88e8d6c998c tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3" status: 200 len: 1309 microversion: 2.1 time: 0.497912 Jul 25 14:40:09.004641 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1652/3492] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:08 2022] GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3 => generated 1309 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:09.164334 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0cfd453b-2fb4-49d6-9f73-c0913b6c1375 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3ce8c9c8e46e2b4ea2f0ef9254fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8f99ef076f4f16b763db443da0dfb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:09.176447 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0cfd453b-2fb4-49d6-9f73-c0913b6c1375 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] 10.222.0.88 "GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201" status: 200 len: 1274 microversion: 2.1 time: 0.327647 Jul 25 14:40:09.180194 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1841/3493] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:08 2022] GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201 => generated 1274 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:40:09.202263 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bbb91a88-3dec-474b-97ba-09b4e9b20358 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:09.203526 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bbb91a88-3dec-474b-97ba-09b4e9b20358 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:09.215080 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bbb91a88-3dec-474b-97ba-09b4e9b20358 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:09.217888 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bbb91a88-3dec-474b-97ba-09b4e9b20358 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:09.219743 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bbb91a88-3dec-474b-97ba-09b4e9b20358 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:09.221103 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bbb91a88-3dec-474b-97ba-09b4e9b20358 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:10.022871 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8f6a5383-6a3b-4c29-97b7-9f3a8e055b61 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:10.023687 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8f6a5383-6a3b-4c29-97b7-9f3a8e055b61 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: bd38057a-c422-40f2-9bc0-cb454cbe96c3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:10.041342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f6a5383-6a3b-4c29-97b7-9f3a8e055b61 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:10.041812 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f6a5383-6a3b-4c29-97b7-9f3a8e055b61 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:10.042622 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f6a5383-6a3b-4c29-97b7-9f3a8e055b61 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:10.043056 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f6a5383-6a3b-4c29-97b7-9f3a8e055b61 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:10.377850 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8f6a5383-6a3b-4c29-97b7-9f3a8e055b61 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:10.385953 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8f6a5383-6a3b-4c29-97b7-9f3a8e055b61 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3" status: 200 len: 1309 microversion: 2.1 time: 0.367578 Jul 25 14:40:10.386792 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1842/3494] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:10 2022] GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3 => generated 1309 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:10.391562 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-97144fd2-0614-463f-b590-defed96b75d7 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:10.392394 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-97144fd2-0614-463f-b590-defed96b75d7 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] [instance: af17aed7-103f-49f3-84e7-c04b418e1201] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:10.397987 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bbb91a88-3dec-474b-97ba-09b4e9b20358 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:10.402085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-97144fd2-0614-463f-b590-defed96b75d7 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:10.402748 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-97144fd2-0614-463f-b590-defed96b75d7 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:10.403600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-97144fd2-0614-463f-b590-defed96b75d7 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:10.404326 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-97144fd2-0614-463f-b590-defed96b75d7 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:10.409728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bbb91a88-3dec-474b-97ba-09b4e9b20358 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:10.411435 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bbb91a88-3dec-474b-97ba-09b4e9b20358 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:10.413457 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bbb91a88-3dec-474b-97ba-09b4e9b20358 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1408 microversion: 2.20 time: 1.215755 Jul 25 14:40:10.414242 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1653/3495] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:40:09 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1408 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:40:10.635659 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-97144fd2-0614-463f-b590-defed96b75d7 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3ce8c9c8e46e2b4ea2f0ef9254fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8f99ef076f4f16b763db443da0dfb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:10.649553 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-97144fd2-0614-463f-b590-defed96b75d7 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] 10.222.0.88 "GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201" status: 200 len: 1316 microversion: 2.1 time: 0.261475 Jul 25 14:40:10.656581 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1843/3496] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:10 2022] GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201 => generated 1316 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:11.419706 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bac6c400-224e-4d90-9300-f2cb8f506769 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:11.420451 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bac6c400-224e-4d90-9300-f2cb8f506769 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: bd38057a-c422-40f2-9bc0-cb454cbe96c3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:11.446916 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bac6c400-224e-4d90-9300-f2cb8f506769 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:11.447529 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bac6c400-224e-4d90-9300-f2cb8f506769 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:11.448401 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bac6c400-224e-4d90-9300-f2cb8f506769 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:11.448841 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bac6c400-224e-4d90-9300-f2cb8f506769 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:11.453418 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bc359684-960b-4c32-8a0b-a003645d6559 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:11.454051 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bc359684-960b-4c32-8a0b-a003645d6559 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:11.467564 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bc359684-960b-4c32-8a0b-a003645d6559 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:11.477748 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bc359684-960b-4c32-8a0b-a003645d6559 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:11.483619 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bc359684-960b-4c32-8a0b-a003645d6559 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:11.484308 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bc359684-960b-4c32-8a0b-a003645d6559 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:12.164686 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bac6c400-224e-4d90-9300-f2cb8f506769 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:12.192589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bc359684-960b-4c32-8a0b-a003645d6559 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:12.198475 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bac6c400-224e-4d90-9300-f2cb8f506769 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3" status: 200 len: 1309 microversion: 2.1 time: 0.793128 Jul 25 14:40:12.205601 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1654/3497] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:11 2022] GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3 => generated 1309 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:12.216955 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b2efe13f-840a-45d3-b342-20d3f3c702bf tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:12.218243 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b2efe13f-840a-45d3-b342-20d3f3c702bf tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] [instance: af17aed7-103f-49f3-84e7-c04b418e1201] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:12.222347 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bc359684-960b-4c32-8a0b-a003645d6559 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:12.227745 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bc359684-960b-4c32-8a0b-a003645d6559 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:12.229035 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bc359684-960b-4c32-8a0b-a003645d6559 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1601 microversion: 2.20 time: 0.789907 Jul 25 14:40:12.229610 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1844/3498] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:40:11 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1601 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:40:12.233364 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b2efe13f-840a-45d3-b342-20d3f3c702bf tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:12.234095 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b2efe13f-840a-45d3-b342-20d3f3c702bf tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:12.235221 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b2efe13f-840a-45d3-b342-20d3f3c702bf tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:12.235817 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b2efe13f-840a-45d3-b342-20d3f3c702bf tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:12.245157 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-a3621c8d-6b38-4f1f-ba90-a69863bb2984 req-4551f9c8-a490-4762-b487-33922e7f4b5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd38057a-c422-40f2-9bc0-cb454cbe96c3", "tag": "d0cd3a3a-3031-4753-ae68-c4ea89fd3d62"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:40:12.267382 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a3621c8d-6b38-4f1f-ba90-a69863bb2984 req-4551f9c8-a490-4762-b487-33922e7f4b5f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:12.277823 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a3621c8d-6b38-4f1f-ba90-a69863bb2984 req-4551f9c8-a490-4762-b487-33922e7f4b5f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:12.310175 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-a3621c8d-6b38-4f1f-ba90-a69863bb2984 req-4551f9c8-a490-4762-b487-33922e7f4b5f service nova] Creating event network-changed:d0cd3a3a-3031-4753-ae68-c4ea89fd3d62 for instance bd38057a-c422-40f2-9bc0-cb454cbe96c3 on n-h2-846435-14 Jul 25 14:40:12.315765 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-a3621c8d-6b38-4f1f-ba90-a69863bb2984 req-4551f9c8-a490-4762-b487-33922e7f4b5f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078066 Jul 25 14:40:12.316755 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1845/3499] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:40:12.334546 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dc7cc029-8bd3-4ae5-8371-746c3300e13c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:12.335444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dc7cc029-8bd3-4ae5-8371-746c3300e13c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:12.345315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dc7cc029-8bd3-4ae5-8371-746c3300e13c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:12.348622 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dc7cc029-8bd3-4ae5-8371-746c3300e13c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:12.349696 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dc7cc029-8bd3-4ae5-8371-746c3300e13c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:12.350389 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dc7cc029-8bd3-4ae5-8371-746c3300e13c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:12.586738 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dc7cc029-8bd3-4ae5-8371-746c3300e13c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.268528 Jul 25 14:40:12.591968 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1846/3500] 10.222.0.88 () {60 vars in 1316 bytes} [Mon Jul 25 14:40:12 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914/os-interface => generated 285 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:40:13.225881 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e8591f40-0a1b-4af7-9ec7-d88639111e4e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:13.226439 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e8591f40-0a1b-4af7-9ec7-d88639111e4e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: bd38057a-c422-40f2-9bc0-cb454cbe96c3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:13.238094 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e8591f40-0a1b-4af7-9ec7-d88639111e4e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:13.238562 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e8591f40-0a1b-4af7-9ec7-d88639111e4e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:13.239354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e8591f40-0a1b-4af7-9ec7-d88639111e4e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:13.239794 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e8591f40-0a1b-4af7-9ec7-d88639111e4e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:13.375206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b2efe13f-840a-45d3-b342-20d3f3c702bf tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3ce8c9c8e46e2b4ea2f0ef9254fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8f99ef076f4f16b763db443da0dfb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:13.386409 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b2efe13f-840a-45d3-b342-20d3f3c702bf tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] 10.222.0.88 "GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201" status: 200 len: 1316 microversion: 2.1 time: 1.178076 Jul 25 14:40:13.387260 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1655/3501] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:12 2022] GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201 => generated 1316 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:14.412050 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:40:14.414856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c7350f05-1af5-48d4-9971-6f24594c3eb9 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:14.417698 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c7350f05-1af5-48d4-9971-6f24594c3eb9 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] [instance: af17aed7-103f-49f3-84e7-c04b418e1201] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:14.434257 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:40:14.436836 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c7350f05-1af5-48d4-9971-6f24594c3eb9 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:14.438675 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c7350f05-1af5-48d4-9971-6f24594c3eb9 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:14.441544 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c7350f05-1af5-48d4-9971-6f24594c3eb9 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:14.442323 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c7350f05-1af5-48d4-9971-6f24594c3eb9 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:14.584914 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e8591f40-0a1b-4af7-9ec7-d88639111e4e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:14.602331 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e8591f40-0a1b-4af7-9ec7-d88639111e4e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3" status: 200 len: 1309 microversion: 2.1 time: 1.380061 Jul 25 14:40:14.604941 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1847/3502] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:13 2022] GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3 => generated 1309 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:14.613515 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-907bfe3a-25e4-4534-b063-95228364ef65 req-74610cd2-e677-4782-a7cb-cc155a4182b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af17aed7-103f-49f3-84e7-c04b418e1201", "tag": "f24e7225-57db-4463-9b9c-24d67598af77"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:40:14.630853 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-907bfe3a-25e4-4534-b063-95228364ef65 req-74610cd2-e677-4782-a7cb-cc155a4182b1 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:14.634150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-907bfe3a-25e4-4534-b063-95228364ef65 req-74610cd2-e677-4782-a7cb-cc155a4182b1 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:14.651367 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-907bfe3a-25e4-4534-b063-95228364ef65 req-74610cd2-e677-4782-a7cb-cc155a4182b1 service nova] Creating event network-changed:f24e7225-57db-4463-9b9c-24d67598af77 for instance af17aed7-103f-49f3-84e7-c04b418e1201 on n-h2-846435-14 Jul 25 14:40:14.657281 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-907bfe3a-25e4-4534-b063-95228364ef65 req-74610cd2-e677-4782-a7cb-cc155a4182b1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050147 Jul 25 14:40:14.659460 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1848/3503] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:40:14.672568 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c7350f05-1af5-48d4-9971-6f24594c3eb9 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3ce8c9c8e46e2b4ea2f0ef9254fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8f99ef076f4f16b763db443da0dfb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:14.681360 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c7350f05-1af5-48d4-9971-6f24594c3eb9 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] 10.222.0.88 "GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201" status: 200 len: 1316 microversion: 2.1 time: 0.276224 Jul 25 14:40:14.681970 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1656/3504] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:14 2022] GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201 => generated 1316 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:40:15.332142 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-247a307f-910e-4241-bb0b-b9f03651b360 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:15.340076 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8ffe163c-4b87-4693-a078-8a382a1ba5d7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:15.340680 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8ffe163c-4b87-4693-a078-8a382a1ba5d7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:15.347741 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-247a307f-910e-4241-bb0b-b9f03651b360 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1b0dcc68e92f4917ad5335e4325b7065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14292758eb5e482d97001c3ddce034ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:15.348552 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-247a307f-910e-4241-bb0b-b9f03651b360 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Searching by: {'deleted': False, 'project_id': '14292758eb5e482d97001c3ddce034ee'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:40:15.350628 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=8 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:40:15.354777 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=8 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:40:15.356561 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ffe163c-4b87-4693-a078-8a382a1ba5d7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:15.357016 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ffe163c-4b87-4693-a078-8a382a1ba5d7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:15.357816 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ffe163c-4b87-4693-a078-8a382a1ba5d7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:15.358445 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ffe163c-4b87-4693-a078-8a382a1ba5d7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:15.373023 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-247a307f-910e-4241-bb0b-b9f03651b360 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:15.381179 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-247a307f-910e-4241-bb0b-b9f03651b360 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:15.382624 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-247a307f-910e-4241-bb0b-b9f03651b360 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:15.386321 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-247a307f-910e-4241-bb0b-b9f03651b360 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:15.434155 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.multi_cell_list [None req-247a307f-910e-4241-bb0b-b9f03651b360 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119304) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:40:15.492332 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-247a307f-910e-4241-bb0b-b9f03651b360 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] 10.222.0.88 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.174874 Jul 25 14:40:15.498412 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1849/3505] 10.222.0.88 () {58 vars in 1125 bytes} [Mon Jul 25 14:40:15 2022] GET /compute/v2.1/servers => generated 339 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:40:15.517657 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-99b3b05c-7261-466c-8a52-032b8c9fa98d tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:15.523868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-99b3b05c-7261-466c-8a52-032b8c9fa98d tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1b0dcc68e92f4917ad5335e4325b7065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14292758eb5e482d97001c3ddce034ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:15.525024 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-99b3b05c-7261-466c-8a52-032b8c9fa98d tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Searching by: {'deleted': False, 'project_id': '14292758eb5e482d97001c3ddce034ee'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:40:15.534022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-99b3b05c-7261-466c-8a52-032b8c9fa98d tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:15.534889 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-99b3b05c-7261-466c-8a52-032b8c9fa98d tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:15.535863 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-99b3b05c-7261-466c-8a52-032b8c9fa98d tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:15.536549 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-99b3b05c-7261-466c-8a52-032b8c9fa98d tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:15.587825 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.multi_cell_list [None req-99b3b05c-7261-466c-8a52-032b8c9fa98d tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119304) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:40:15.659075 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-99b3b05c-7261-466c-8a52-032b8c9fa98d tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0dcc68e92f4917ad5335e4325b7065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14292758eb5e482d97001c3ddce034ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:15.666573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-99b3b05c-7261-466c-8a52-032b8c9fa98d tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:15.667235 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-99b3b05c-7261-466c-8a52-032b8c9fa98d tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:15.861684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-8ffe163c-4b87-4693-a078-8a382a1ba5d7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lazy-loading 'services' on Instance uuid fac258f1-785d-4dd9-bc68-0ee713c9149a {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:40:15.962838 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8ffe163c-4b87-4693-a078-8a382a1ba5d7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "DELETE /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a/os-volume_attachments/803b5356-ea4b-4fa8-a48e-011c23bc3031" status: 202 len: 0 microversion: 2.1 time: 0.625157 Jul 25 14:40:15.966877 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1657/3506] 10.222.0.88 () {58 vars in 1416 bytes} [Mon Jul 25 14:40:15 2022] DELETE /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a/os-volume_attachments/803b5356-ea4b-4fa8-a48e-011c23bc3031 => generated 0 bytes in 631 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 14:40:15.976535 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4ff9a11a-d68a-4326-870f-4e3e594464ac tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:15.977920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4ff9a11a-d68a-4326-870f-4e3e594464ac tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: bd38057a-c422-40f2-9bc0-cb454cbe96c3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:15.995705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4ff9a11a-d68a-4326-870f-4e3e594464ac tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:15.996597 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4ff9a11a-d68a-4326-870f-4e3e594464ac tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:16.000751 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4ff9a11a-d68a-4326-870f-4e3e594464ac tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:16.002443 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4ff9a11a-d68a-4326-870f-4e3e594464ac tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:16.104801 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-99b3b05c-7261-466c-8a52-032b8c9fa98d tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] 10.222.0.88 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.599017 Jul 25 14:40:16.109377 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1850/3507] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:40:15 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:16.120014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-489b7eb7-8912-4ccd-84fa-af728e3d9463 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:16.121107 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-489b7eb7-8912-4ccd-84fa-af728e3d9463 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] [instance: af17aed7-103f-49f3-84e7-c04b418e1201] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:16.160434 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-489b7eb7-8912-4ccd-84fa-af728e3d9463 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:16.161106 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-489b7eb7-8912-4ccd-84fa-af728e3d9463 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:16.162058 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-489b7eb7-8912-4ccd-84fa-af728e3d9463 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:16.162654 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-489b7eb7-8912-4ccd-84fa-af728e3d9463 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:16.667732 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-489b7eb7-8912-4ccd-84fa-af728e3d9463 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3ce8c9c8e46e2b4ea2f0ef9254fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8f99ef076f4f16b763db443da0dfb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:16.676915 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:40:16.718764 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-489b7eb7-8912-4ccd-84fa-af728e3d9463 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] 10.222.0.88 "GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201" status: 200 len: 1316 microversion: 2.1 time: 0.606495 Jul 25 14:40:16.731933 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1851/3508] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:16 2022] GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201 => generated 1316 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:16.749941 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dcbc614e-a3aa-4735-a0a8-8b2160d858f1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:16.763342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dcbc614e-a3aa-4735-a0a8-8b2160d858f1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:16.777958 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dcbc614e-a3aa-4735-a0a8-8b2160d858f1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:16.788676 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dcbc614e-a3aa-4735-a0a8-8b2160d858f1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:16.789842 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dcbc614e-a3aa-4735-a0a8-8b2160d858f1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:16.798614 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dcbc614e-a3aa-4735-a0a8-8b2160d858f1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:16.924958 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dcbc614e-a3aa-4735-a0a8-8b2160d858f1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.195246 Jul 25 14:40:16.929282 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1852/3509] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:40:16 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:40:16.942963 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-95f1ca7a-0c9e-4d79-8b95-00a92fe1200b tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:16.969208 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-95f1ca7a-0c9e-4d79-8b95-00a92fe1200b tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] 10.222.0.88 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.038404 Jul 25 14:40:16.977651 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1853/3510] 10.222.0.88 () {58 vars in 1137 bytes} [Mon Jul 25 14:40:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:40:16.984562 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-c956997d-3544-4c84-b403-3cf359071ae0 req-2c4caa27-7b8a-4a19-aadf-d9cf0dcb0377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "034e5d63-63a1-4883-b7f8-fe84ec541914", "tag": "350ec399-ee42-4e58-9f27-5bd9094cb8e1"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:40:17.020369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c956997d-3544-4c84-b403-3cf359071ae0 req-2c4caa27-7b8a-4a19-aadf-d9cf0dcb0377 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:17.023254 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c956997d-3544-4c84-b403-3cf359071ae0 req-2c4caa27-7b8a-4a19-aadf-d9cf0dcb0377 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:17.066492 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-c956997d-3544-4c84-b403-3cf359071ae0 req-2c4caa27-7b8a-4a19-aadf-d9cf0dcb0377 service nova] Creating event network-changed:350ec399-ee42-4e58-9f27-5bd9094cb8e1 for instance 034e5d63-63a1-4883-b7f8-fe84ec541914 on n-h2-846435-14 Jul 25 14:40:17.076811 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-c956997d-3544-4c84-b403-3cf359071ae0 req-2c4caa27-7b8a-4a19-aadf-d9cf0dcb0377 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095770 Jul 25 14:40:17.088871 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1854/3511] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:40:17.365389 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a70246f0-3de0-4d62-8d34-6901d0ffd885 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:17.366143 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a70246f0-3de0-4d62-8d34-6901d0ffd885 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] [instance: c2d5ca5f-5c52-45f7-8d1c-f42144fe8108] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:17.390782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a70246f0-3de0-4d62-8d34-6901d0ffd885 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:17.391618 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a70246f0-3de0-4d62-8d34-6901d0ffd885 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:17.401213 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a70246f0-3de0-4d62-8d34-6901d0ffd885 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:17.404177 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a70246f0-3de0-4d62-8d34-6901d0ffd885 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:17.546617 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a70246f0-3de0-4d62-8d34-6901d0ffd885 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] [instance: c2d5ca5f-5c52-45f7-8d1c-f42144fe8108] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:40:17.594551 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4ff9a11a-d68a-4326-870f-4e3e594464ac tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:17.619600 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4ff9a11a-d68a-4326-870f-4e3e594464ac tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3" status: 200 len: 1309 microversion: 2.1 time: 1.649101 Jul 25 14:40:17.633923 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1658/3512] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:15 2022] GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3 => generated 1309 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:17.746394 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bd4b3065-0722-42b6-98a2-b080050a5de3 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:17.747282 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bd4b3065-0722-42b6-98a2-b080050a5de3 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] [instance: af17aed7-103f-49f3-84e7-c04b418e1201] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:17.766494 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd4b3065-0722-42b6-98a2-b080050a5de3 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:17.770704 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd4b3065-0722-42b6-98a2-b080050a5de3 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:17.776672 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd4b3065-0722-42b6-98a2-b080050a5de3 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:17.780532 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd4b3065-0722-42b6-98a2-b080050a5de3 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:17.837431 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a70246f0-3de0-4d62-8d34-6901d0ffd885 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108" status: 204 len: 0 microversion: 2.1 time: 0.476752 Jul 25 14:40:17.838555 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1855/3513] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:40:17 2022] DELETE /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 14:40:17.847074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-22e8206f-61e6-4eea-9f95-2db50e307095 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:17.853021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-22e8206f-61e6-4eea-9f95-2db50e307095 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] [instance: c2d5ca5f-5c52-45f7-8d1c-f42144fe8108] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:17.873563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-22e8206f-61e6-4eea-9f95-2db50e307095 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:17.877072 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-22e8206f-61e6-4eea-9f95-2db50e307095 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:17.885138 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-22e8206f-61e6-4eea-9f95-2db50e307095 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:17.888847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-22e8206f-61e6-4eea-9f95-2db50e307095 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:19.782025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-22e8206f-61e6-4eea-9f95-2db50e307095 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0dcc68e92f4917ad5335e4325b7065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14292758eb5e482d97001c3ddce034ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:19.796210 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-22e8206f-61e6-4eea-9f95-2db50e307095 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] 10.222.0.88 "GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108" status: 200 len: 1715 microversion: 2.1 time: 1.953189 Jul 25 14:40:19.812286 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1856/3514] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:17 2022] GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108 => generated 1715 bytes in 1970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:40:19.838643 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cf577572-6000-4195-83b5-bc3e8c72019e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:19.845325 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cf577572-6000-4195-83b5-bc3e8c72019e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:19.860066 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cf577572-6000-4195-83b5-bc3e8c72019e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:19.860810 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cf577572-6000-4195-83b5-bc3e8c72019e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:19.861778 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cf577572-6000-4195-83b5-bc3e8c72019e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:19.863249 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cf577572-6000-4195-83b5-bc3e8c72019e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:19.899296 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cf577572-6000-4195-83b5-bc3e8c72019e tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085439 Jul 25 14:40:19.900295 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1857/3515] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:40:19 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:40:19.905243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6d4f0fcc-1e16-4cc7-a95d-99b3bb1fcaa6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:19.906145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6d4f0fcc-1e16-4cc7-a95d-99b3bb1fcaa6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: bd38057a-c422-40f2-9bc0-cb454cbe96c3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:19.913265 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d4f0fcc-1e16-4cc7-a95d-99b3bb1fcaa6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:19.914019 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d4f0fcc-1e16-4cc7-a95d-99b3bb1fcaa6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:19.915017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d4f0fcc-1e16-4cc7-a95d-99b3bb1fcaa6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:19.915643 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d4f0fcc-1e16-4cc7-a95d-99b3bb1fcaa6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:20.009389 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bd4b3065-0722-42b6-98a2-b080050a5de3 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3ce8c9c8e46e2b4ea2f0ef9254fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8f99ef076f4f16b763db443da0dfb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:20.020451 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bd4b3065-0722-42b6-98a2-b080050a5de3 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] 10.222.0.88 "GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201" status: 200 len: 1316 microversion: 2.1 time: 2.278492 Jul 25 14:40:20.036272 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1659/3516] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:17 2022] GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201 => generated 1316 bytes in 2295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:40:20.188870 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6d4f0fcc-1e16-4cc7-a95d-99b3bb1fcaa6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:20.199830 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6d4f0fcc-1e16-4cc7-a95d-99b3bb1fcaa6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3" status: 200 len: 1309 microversion: 2.1 time: 0.298126 Jul 25 14:40:20.203427 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1858/3517] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:19 2022] GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3 => generated 1309 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:20.831523 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-22da0c95-a655-41d3-bbab-5b315ef064fc tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:20.832204 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-22da0c95-a655-41d3-bbab-5b315ef064fc tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] [instance: c2d5ca5f-5c52-45f7-8d1c-f42144fe8108] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:20.844723 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-22da0c95-a655-41d3-bbab-5b315ef064fc tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:20.847851 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-22da0c95-a655-41d3-bbab-5b315ef064fc tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:20.850365 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-22da0c95-a655-41d3-bbab-5b315ef064fc tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:20.852965 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-22da0c95-a655-41d3-bbab-5b315ef064fc tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:20.913256 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-18a6e785-6bc0-4f54-8471-b1f0fe8f57fe tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:20.917009 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-18a6e785-6bc0-4f54-8471-b1f0fe8f57fe tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:20.936875 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-18a6e785-6bc0-4f54-8471-b1f0fe8f57fe tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:20.937999 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-18a6e785-6bc0-4f54-8471-b1f0fe8f57fe tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:20.940929 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-18a6e785-6bc0-4f54-8471-b1f0fe8f57fe tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:20.942140 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-18a6e785-6bc0-4f54-8471-b1f0fe8f57fe tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:21.028894 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-18a6e785-6bc0-4f54-8471-b1f0fe8f57fe tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121228 Jul 25 14:40:21.037705 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1859/3518] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:40:20 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:40:21.059317 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-306425ef-77cc-4092-8129-bcea9511ba5b tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:21.060287 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-306425ef-77cc-4092-8129-bcea9511ba5b tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] [instance: af17aed7-103f-49f3-84e7-c04b418e1201] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:21.071440 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-306425ef-77cc-4092-8129-bcea9511ba5b tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:21.074324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-306425ef-77cc-4092-8129-bcea9511ba5b tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:21.076396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-306425ef-77cc-4092-8129-bcea9511ba5b tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:21.077519 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-306425ef-77cc-4092-8129-bcea9511ba5b tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:21.347114 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-306425ef-77cc-4092-8129-bcea9511ba5b tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3ce8c9c8e46e2b4ea2f0ef9254fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8f99ef076f4f16b763db443da0dfb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:21.358032 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-306425ef-77cc-4092-8129-bcea9511ba5b tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] 10.222.0.88 "GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201" status: 200 len: 1316 microversion: 2.1 time: 0.302824 Jul 25 14:40:21.360184 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1860/3519] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:21 2022] GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201 => generated 1316 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:40:21.370111 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-932ae464-9266-44fe-97ce-6a173dda0a17 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:21.375212 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-932ae464-9266-44fe-97ce-6a173dda0a17 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: bd38057a-c422-40f2-9bc0-cb454cbe96c3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:21.385760 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-22da0c95-a655-41d3-bbab-5b315ef064fc tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0dcc68e92f4917ad5335e4325b7065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14292758eb5e482d97001c3ddce034ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:21.394800 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-22da0c95-a655-41d3-bbab-5b315ef064fc tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] 10.222.0.88 "GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108" status: 200 len: 1715 microversion: 2.1 time: 0.567162 Jul 25 14:40:21.412527 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-932ae464-9266-44fe-97ce-6a173dda0a17 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:21.413651 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-932ae464-9266-44fe-97ce-6a173dda0a17 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:21.414781 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1660/3520] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:20 2022] GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108 => generated 1715 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:21.415875 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-932ae464-9266-44fe-97ce-6a173dda0a17 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:21.416539 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-932ae464-9266-44fe-97ce-6a173dda0a17 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:22.046093 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-32aaaec9-8571-4a7c-88ff-8ad4f84b7c00 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:22.048714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-32aaaec9-8571-4a7c-88ff-8ad4f84b7c00 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:22.054541 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:40:22.075618 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-32aaaec9-8571-4a7c-88ff-8ad4f84b7c00 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:22.092040 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-32aaaec9-8571-4a7c-88ff-8ad4f84b7c00 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:22.101483 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-32aaaec9-8571-4a7c-88ff-8ad4f84b7c00 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:22.102506 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-32aaaec9-8571-4a7c-88ff-8ad4f84b7c00 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:22.214383 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-32aaaec9-8571-4a7c-88ff-8ad4f84b7c00 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172974 Jul 25 14:40:22.221954 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1661/3521] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:40:22 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:40:22.248524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-932ae464-9266-44fe-97ce-6a173dda0a17 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:22.257077 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-932ae464-9266-44fe-97ce-6a173dda0a17 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3" status: 200 len: 1309 microversion: 2.1 time: 0.895655 Jul 25 14:40:22.268558 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1861/3522] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:21 2022] GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3 => generated 1309 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:22.396958 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-62ca5699-b021-44e3-9d45-4cda26e76a85 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:22.397836 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-62ca5699-b021-44e3-9d45-4cda26e76a85 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] [instance: af17aed7-103f-49f3-84e7-c04b418e1201] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:22.410400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-62ca5699-b021-44e3-9d45-4cda26e76a85 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:22.411832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-62ca5699-b021-44e3-9d45-4cda26e76a85 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:22.418505 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-62ca5699-b021-44e3-9d45-4cda26e76a85 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:22.423461 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-62ca5699-b021-44e3-9d45-4cda26e76a85 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:22.442398 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1b7af12c-8182-4bb3-98f6-9237d9d77409 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:22.444303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1b7af12c-8182-4bb3-98f6-9237d9d77409 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] [instance: c2d5ca5f-5c52-45f7-8d1c-f42144fe8108] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:22.460551 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1b7af12c-8182-4bb3-98f6-9237d9d77409 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:22.467243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1b7af12c-8182-4bb3-98f6-9237d9d77409 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:22.468422 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1b7af12c-8182-4bb3-98f6-9237d9d77409 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:22.471493 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1b7af12c-8182-4bb3-98f6-9237d9d77409 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:22.611230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1b7af12c-8182-4bb3-98f6-9237d9d77409 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0dcc68e92f4917ad5335e4325b7065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14292758eb5e482d97001c3ddce034ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:22.621180 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1b7af12c-8182-4bb3-98f6-9237d9d77409 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] 10.222.0.88 "GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108" status: 200 len: 1648 microversion: 2.1 time: 0.185416 Jul 25 14:40:22.641626 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1862/3523] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:22 2022] GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108 => generated 1648 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:23.103129 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-b6e929c3-1d01-4ba3-b7b0-81366c7ed53c req-71554263-4c6c-491e-8db7-adeeda6b5e9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd38057a-c422-40f2-9bc0-cb454cbe96c3", "name": "network-vif-plugged", "status": "completed", "tag": "d0cd3a3a-3031-4753-ae68-c4ea89fd3d62"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:40:23.125834 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-b6e929c3-1d01-4ba3-b7b0-81366c7ed53c req-71554263-4c6c-491e-8db7-adeeda6b5e9d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:23.132017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-b6e929c3-1d01-4ba3-b7b0-81366c7ed53c req-71554263-4c6c-491e-8db7-adeeda6b5e9d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:23.167582 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-b6e929c3-1d01-4ba3-b7b0-81366c7ed53c req-71554263-4c6c-491e-8db7-adeeda6b5e9d service nova] Creating event network-vif-plugged:d0cd3a3a-3031-4753-ae68-c4ea89fd3d62 for instance bd38057a-c422-40f2-9bc0-cb454cbe96c3 on n-h2-846435-14 Jul 25 14:40:23.181309 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-b6e929c3-1d01-4ba3-b7b0-81366c7ed53c req-71554263-4c6c-491e-8db7-adeeda6b5e9d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083501 Jul 25 14:40:23.182613 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1863/3524] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:40:23.231089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ea839747-52b0-4880-a350-5fb44b39ff19 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:23.233863 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ea839747-52b0-4880-a350-5fb44b39ff19 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:23.248701 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:40:23.254558 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea839747-52b0-4880-a350-5fb44b39ff19 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:23.256506 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea839747-52b0-4880-a350-5fb44b39ff19 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:23.259616 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea839747-52b0-4880-a350-5fb44b39ff19 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:23.260269 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea839747-52b0-4880-a350-5fb44b39ff19 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:23.389105 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ea839747-52b0-4880-a350-5fb44b39ff19 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162524 Jul 25 14:40:23.394575 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1864/3525] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:40:23 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:40:23.411739 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-64d2c5bb-1e98-4dff-aa7d-6a589cfa8167 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:23.412686 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-64d2c5bb-1e98-4dff-aa7d-6a589cfa8167 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: bd38057a-c422-40f2-9bc0-cb454cbe96c3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:23.458715 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-64d2c5bb-1e98-4dff-aa7d-6a589cfa8167 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:23.460719 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-64d2c5bb-1e98-4dff-aa7d-6a589cfa8167 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:23.466379 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-64d2c5bb-1e98-4dff-aa7d-6a589cfa8167 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:23.466871 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-64d2c5bb-1e98-4dff-aa7d-6a589cfa8167 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:24.327458 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-62ca5699-b021-44e3-9d45-4cda26e76a85 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3ce8c9c8e46e2b4ea2f0ef9254fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8f99ef076f4f16b763db443da0dfb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:24.341471 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-62ca5699-b021-44e3-9d45-4cda26e76a85 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] 10.222.0.88 "GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201" status: 200 len: 1316 microversion: 2.1 time: 1.949133 Jul 25 14:40:24.353414 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1662/3526] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:22 2022] GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201 => generated 1316 bytes in 1971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:24.398253 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-da184f29-e98d-463e-a953-6ee1fc375030 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:24.400836 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-da184f29-e98d-463e-a953-6ee1fc375030 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] [instance: c2d5ca5f-5c52-45f7-8d1c-f42144fe8108] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:24.402455 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-64d2c5bb-1e98-4dff-aa7d-6a589cfa8167 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:24.415554 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-64d2c5bb-1e98-4dff-aa7d-6a589cfa8167 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3" status: 200 len: 1309 microversion: 2.1 time: 1.017589 Jul 25 14:40:24.417546 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1865/3527] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:23 2022] GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3 => generated 1309 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:24.427558 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da184f29-e98d-463e-a953-6ee1fc375030 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:24.429739 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-29422279-24ee-4007-8f44-2702c16bf6c3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:24.432388 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-29422279-24ee-4007-8f44-2702c16bf6c3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:24.453043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-29422279-24ee-4007-8f44-2702c16bf6c3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:24.453775 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-29422279-24ee-4007-8f44-2702c16bf6c3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:24.454763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-29422279-24ee-4007-8f44-2702c16bf6c3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:24.455358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-29422279-24ee-4007-8f44-2702c16bf6c3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:24.468380 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da184f29-e98d-463e-a953-6ee1fc375030 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:24.469689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da184f29-e98d-463e-a953-6ee1fc375030 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:24.471565 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da184f29-e98d-463e-a953-6ee1fc375030 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:24.530368 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-29422279-24ee-4007-8f44-2702c16bf6c3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111459 Jul 25 14:40:24.530981 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1866/3528] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:40:24 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:40:24.536050 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:40:25.375812 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-be304f8c-f4d2-4092-831e-0da655161438 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:25.377068 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-be304f8c-f4d2-4092-831e-0da655161438 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] [instance: af17aed7-103f-49f3-84e7-c04b418e1201] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:25.398427 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be304f8c-f4d2-4092-831e-0da655161438 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:25.398877 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be304f8c-f4d2-4092-831e-0da655161438 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:25.407487 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be304f8c-f4d2-4092-831e-0da655161438 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:25.411399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be304f8c-f4d2-4092-831e-0da655161438 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:25.442136 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-da184f29-e98d-463e-a953-6ee1fc375030 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0dcc68e92f4917ad5335e4325b7065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14292758eb5e482d97001c3ddce034ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:25.458157 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-da184f29-e98d-463e-a953-6ee1fc375030 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] 10.222.0.88 "GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108" status: 200 len: 1648 microversion: 2.1 time: 1.103128 Jul 25 14:40:25.462157 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1663/3529] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:24 2022] GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108 => generated 1648 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:25.470774 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f5a250a1-5f22-4536-8ecd-92a50bcbd1d4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:25.472413 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f5a250a1-5f22-4536-8ecd-92a50bcbd1d4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: bd38057a-c422-40f2-9bc0-cb454cbe96c3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:25.535858 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f5a250a1-5f22-4536-8ecd-92a50bcbd1d4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:25.542878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f5a250a1-5f22-4536-8ecd-92a50bcbd1d4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:25.543090 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=4 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:40:25.547056 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f5a250a1-5f22-4536-8ecd-92a50bcbd1d4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:25.550984 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f5a250a1-5f22-4536-8ecd-92a50bcbd1d4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:25.657151 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:40:26.363219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-be304f8c-f4d2-4092-831e-0da655161438 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3ce8c9c8e46e2b4ea2f0ef9254fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8f99ef076f4f16b763db443da0dfb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:26.372185 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-be304f8c-f4d2-4092-831e-0da655161438 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] 10.222.0.88 "GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201" status: 200 len: 1316 microversion: 2.1 time: 1.001699 Jul 25 14:40:26.388421 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1867/3530] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:25 2022] GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201 => generated 1316 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:40:26.399780 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b0e28236-e465-4988-a550-c4c561255333 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:26.402445 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b0e28236-e465-4988-a550-c4c561255333 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:26.418594 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0e28236-e465-4988-a550-c4c561255333 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:26.421860 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0e28236-e465-4988-a550-c4c561255333 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:26.422855 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0e28236-e465-4988-a550-c4c561255333 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:26.424492 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0e28236-e465-4988-a550-c4c561255333 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:26.521836 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b0e28236-e465-4988-a550-c4c561255333 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131225 Jul 25 14:40:26.525861 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1868/3531] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:40:26 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:40:26.537732 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-72618fe3-37f3-49e5-8ddb-1e64b46a9629 req-df1ed64f-318e-47fc-88ba-e33c96781b05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2d5ca5f-5c52-45f7-8d1c-f42144fe8108", "name": "network-vif-deleted", "tag": "8e610f6f-b342-4a2d-9ea5-5330f97c6fbb"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:40:26.562035 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-72618fe3-37f3-49e5-8ddb-1e64b46a9629 req-df1ed64f-318e-47fc-88ba-e33c96781b05 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:26.566336 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-72618fe3-37f3-49e5-8ddb-1e64b46a9629 req-df1ed64f-318e-47fc-88ba-e33c96781b05 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:26.578333 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:40:26.624925 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-72618fe3-37f3-49e5-8ddb-1e64b46a9629 req-df1ed64f-318e-47fc-88ba-e33c96781b05 service nova] Creating event network-vif-deleted:8e610f6f-b342-4a2d-9ea5-5330f97c6fbb for instance c2d5ca5f-5c52-45f7-8d1c-f42144fe8108 on n-h1-846435-14 Jul 25 14:40:26.662514 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-72618fe3-37f3-49e5-8ddb-1e64b46a9629 req-df1ed64f-318e-47fc-88ba-e33c96781b05 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130861 Jul 25 14:40:26.666729 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1869/3532] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:40:26.675369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ee914d67-5d44-45b9-aabf-e6dc8604fcda tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:26.677453 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ee914d67-5d44-45b9-aabf-e6dc8604fcda tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] [instance: c2d5ca5f-5c52-45f7-8d1c-f42144fe8108] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:26.693993 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee914d67-5d44-45b9-aabf-e6dc8604fcda tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:26.695288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee914d67-5d44-45b9-aabf-e6dc8604fcda tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:26.696814 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee914d67-5d44-45b9-aabf-e6dc8604fcda tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:26.697619 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee914d67-5d44-45b9-aabf-e6dc8604fcda tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:26.721468 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-ee914d67-5d44-45b9-aabf-e6dc8604fcda tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] HTTP exception thrown: Instance c2d5ca5f-5c52-45f7-8d1c-f42144fe8108 could not be found. Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ee914d67-5d44-45b9-aabf-e6dc8604fcda tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Request method failure captured: Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108 HTTP/1.1 Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qsMwo2UOOLzpk51jT9vA2Ja2CFdrCnVn9IazN1D8oNrN41Q0WDzFZHotoe-AHYf2hdacmjuW2mIFUx6thHLpEORMIvuV_3ZnyGD-Sxw5In4ezMBKYG-vc18QHiMGKiW2w-0iZsOFDln2Wyv3Zb5xkTXggnfbY5TOnz9nHJ96Y6HUZQ Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 14292758eb5e482d97001c3ddce034ee Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersTestManualDisk-1760377015 Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/14292758eb5e482d97001c3ddce034ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/14292758eb5e482d97001c3ddce034ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_14292758eb5e482d97001c3ddce034ee", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/14292758eb5e482d97001c3ddce034ee"}]}] Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersTestManualDisk-1760377015 Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 14292758eb5e482d97001c3ddce034ee Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersTestManualDisk-1760377015 Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersTestManualDisk-1760377015-project Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 1b0dcc68e92f4917ad5335e4325b7065 Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersTestManualDisk-1760377015-project Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance c2d5ca5f-5c52-45f7-8d1c-f42144fe8108 could not be found. Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'c2d5ca5f-5c52-45f7-8d1c-f42144fe8108'} Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2d5ca5f-5c52-45f7-8d1c-f42144fe8108 could not be found. Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2d5ca5f-5c52-45f7-8d1c-f42144fe8108 could not be found. Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:40:26.737429 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:26.742223 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:40:26.742223 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:40:26.742223 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:40:26.742223 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:40:26.742223 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:40:26.742223 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2d5ca5f-5c52-45f7-8d1c-f42144fe8108 could not be found. Jul 25 14:40:26.742223 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:26.748892 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ee914d67-5d44-45b9-aabf-e6dc8604fcda tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Returning 404 to user: Instance c2d5ca5f-5c52-45f7-8d1c-f42144fe8108 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:40:26.750057 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ee914d67-5d44-45b9-aabf-e6dc8604fcda tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] 10.222.0.88 "GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108" status: 404 len: 111 microversion: 2.1 time: 0.081626 Jul 25 14:40:26.751042 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1870/3533] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:26 2022] GET /compute/v2.1/servers/c2d5ca5f-5c52-45f7-8d1c-f42144fe8108 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:40:26.768080 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8000b816-4df2-4851-936f-2ac208fdabb4 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] Calling method '.version_select at 0x7f46876244c0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:26.848326 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8000b816-4df2-4851-936f-2ac208fdabb4 tempest-ServersTestManualDisk-1760377015 tempest-ServersTestManualDisk-1760377015-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1072562794" status: 202 len: 0 microversion: 2.1 time: 0.088676 Jul 25 14:40:26.852406 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1871/3534] 10.222.0.88 () {58 vars in 1221 bytes} [Mon Jul 25 14:40:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1072562794 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:40:27.002780 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f5a250a1-5f22-4536-8ecd-92a50bcbd1d4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:27.018909 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f5a250a1-5f22-4536-8ecd-92a50bcbd1d4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3" status: 200 len: 1309 microversion: 2.1 time: 1.552896 Jul 25 14:40:27.020490 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1664/3535] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:25 2022] GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3 => generated 1309 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:27.404900 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d5a0759e-6a04-4a88-9060-50ad233981aa tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:27.406156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d5a0759e-6a04-4a88-9060-50ad233981aa tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] [instance: af17aed7-103f-49f3-84e7-c04b418e1201] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:27.421261 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5a0759e-6a04-4a88-9060-50ad233981aa tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:27.422630 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5a0759e-6a04-4a88-9060-50ad233981aa tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:27.426359 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5a0759e-6a04-4a88-9060-50ad233981aa tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:27.427094 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5a0759e-6a04-4a88-9060-50ad233981aa tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:27.495433 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-00100c6e-2bf9-4b78-9137-6deed4fab268 req-d1213a44-e707-4c74-b05e-7ef1b196b9c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af17aed7-103f-49f3-84e7-c04b418e1201", "name": "network-vif-plugged", "status": "completed", "tag": "f24e7225-57db-4463-9b9c-24d67598af77"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:40:27.523210 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-00100c6e-2bf9-4b78-9137-6deed4fab268 req-d1213a44-e707-4c74-b05e-7ef1b196b9c5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:27.525700 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-00100c6e-2bf9-4b78-9137-6deed4fab268 req-d1213a44-e707-4c74-b05e-7ef1b196b9c5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:27.548191 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-00100c6e-2bf9-4b78-9137-6deed4fab268 req-d1213a44-e707-4c74-b05e-7ef1b196b9c5 service nova] Creating event network-vif-plugged:f24e7225-57db-4463-9b9c-24d67598af77 for instance af17aed7-103f-49f3-84e7-c04b418e1201 on n-h2-846435-14 Jul 25 14:40:27.576860 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-00100c6e-2bf9-4b78-9137-6deed4fab268 req-d1213a44-e707-4c74-b05e-7ef1b196b9c5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085244 Jul 25 14:40:27.578333 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1665/3536] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:40:27.585301 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2b89793c-544d-43c9-842e-70bbb33f9cd7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:27.604995 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2b89793c-544d-43c9-842e-70bbb33f9cd7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:27.628847 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2b89793c-544d-43c9-842e-70bbb33f9cd7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:27.628847 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2b89793c-544d-43c9-842e-70bbb33f9cd7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:27.628847 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2b89793c-544d-43c9-842e-70bbb33f9cd7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:27.631058 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2b89793c-544d-43c9-842e-70bbb33f9cd7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:27.758355 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2b89793c-544d-43c9-842e-70bbb33f9cd7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.178411 Jul 25 14:40:27.768015 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1666/3537] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:40:27 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a/os-volume_attachments => generated 25 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:40:27.917016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d5a0759e-6a04-4a88-9060-50ad233981aa tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3ce8c9c8e46e2b4ea2f0ef9254fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8f99ef076f4f16b763db443da0dfb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:27.930398 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d5a0759e-6a04-4a88-9060-50ad233981aa tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] 10.222.0.88 "GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201" status: 200 len: 1316 microversion: 2.1 time: 0.529469 Jul 25 14:40:27.931718 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1872/3538] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:27 2022] GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201 => generated 1316 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:27.940353 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1176931e-15d8-4290-8a4f-eded4da604af tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:40:27.947818 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1176931e-15d8-4290-8a4f-eded4da604af tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:27.955347 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1176931e-15d8-4290-8a4f-eded4da604af tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:27.956170 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1176931e-15d8-4290-8a4f-eded4da604af tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:27.957136 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1176931e-15d8-4290-8a4f-eded4da604af tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:27.957732 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1176931e-15d8-4290-8a4f-eded4da604af tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:27.988776 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-1176931e-15d8-4290-8a4f-eded4da604af tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] HTTP exception thrown: Cannot 'reboot' instance 5aa9ee0e-2d03-42a5-af94-51275e754256 while it is in vm_state rescued Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1176931e-15d8-4290-8a4f-eded4da604af tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Request method failure captured: Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256/action HTTP/1.1 Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 28 Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qojWgWRzNqcoFtbKX69HP8TMfJcvgq5mROxrtiAbTRQQhODI65548klI2mwspV0aDgelkydSdF0jDfbt9K1MKvAqBkxkDKwdPBnneXznLL8230WZKLHZUg-qMlSHwLMR2RP6Be2wdwzhEY6xsA-ygO39xLQI8y2VkgTqIORhZUeWIM Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 2f1bd935e917484799f31ad643eafb2a Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-756792154 Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2f1bd935e917484799f31ad643eafb2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2f1bd935e917484799f31ad643eafb2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2f1bd935e917484799f31ad643eafb2a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2f1bd935e917484799f31ad643eafb2a"}]}] Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServerRescueNegativeTestJSON-756792154 Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 2f1bd935e917484799f31ad643eafb2a Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-756792154 Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServerRescueNegativeTestJSON-756792154-project Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 9f2ddec1bc6244739e9ac3a40c064b53 Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServerRescueNegativeTestJSON-756792154-project Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: {"reboot": {"type": "HARD"}} Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: exception: Cannot 'reboot' instance 5aa9ee0e-2d03-42a5-af94-51275e754256 while it is in vm_state rescued Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '5aa9ee0e-2d03-42a5-af94-51275e754256', 'body': {'reboot': {'type': 'HARD'}}} Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5aa9ee0e-2d03-42a5-af94-51275e754256 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 14:40:27.990950 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 14:40:27.996116 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 5aa9ee0e-2d03-42a5-af94-51275e754256 while it is in vm_state rescued Jul 25 14:40:27.996116 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:40:27.996116 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:40:27.996116 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:40:27.996116 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:40:27.996116 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:40:27.996116 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:40:27.996116 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:40:27.996116 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:40:27.996116 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 5aa9ee0e-2d03-42a5-af94-51275e754256 while it is in vm_state rescued Jul 25 14:40:27.996116 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:40:27.998091 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1176931e-15d8-4290-8a4f-eded4da604af tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Returning 409 to user: Cannot 'reboot' instance 5aa9ee0e-2d03-42a5-af94-51275e754256 while it is in vm_state rescued {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:40:27.999183 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1176931e-15d8-4290-8a4f-eded4da604af tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "POST /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256/action" status: 409 len: 145 microversion: 2.1 time: 0.071902 Jul 25 14:40:28.006036 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1667/3539] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:40:27 2022] POST /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256/action => generated 145 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (3 switches on core 0) Jul 25 14:40:28.013970 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-62f6d75f-95a5-4a5f-8902-284cca0033f3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:40:28.018452 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-62f6d75f-95a5-4a5f-8902-284cca0033f3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:28.031484 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-62f6d75f-95a5-4a5f-8902-284cca0033f3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:28.032676 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-62f6d75f-95a5-4a5f-8902-284cca0033f3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:28.033849 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-62f6d75f-95a5-4a5f-8902-284cca0033f3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:28.035638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-62f6d75f-95a5-4a5f-8902-284cca0033f3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:28.055196 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dd475b26-a051-4001-8a61-146f8efd8867 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:28.056700 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-dd475b26-a051-4001-8a61-146f8efd8867 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: bd38057a-c422-40f2-9bc0-cb454cbe96c3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:28.076410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dd475b26-a051-4001-8a61-146f8efd8867 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:28.077131 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dd475b26-a051-4001-8a61-146f8efd8867 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:28.078145 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dd475b26-a051-4001-8a61-146f8efd8867 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:28.082898 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dd475b26-a051-4001-8a61-146f8efd8867 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:28.107415 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-62f6d75f-95a5-4a5f-8902-284cca0033f3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] HTTP exception thrown: Cannot 'rebuild' instance 5aa9ee0e-2d03-42a5-af94-51275e754256 while it is in vm_state rescued Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-62f6d75f-95a5-4a5f-8902-284cca0033f3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Request method failure captured: Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256/action HTTP/1.1 Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 65 Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qojWgWRzNqcoFtbKX69HP8TMfJcvgq5mROxrtiAbTRQQhODI65548klI2mwspV0aDgelkydSdF0jDfbt9K1MKvAqBkxkDKwdPBnneXznLL8230WZKLHZUg-qMlSHwLMR2RP6Be2wdwzhEY6xsA-ygO39xLQI8y2VkgTqIORhZUeWIM Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 2f1bd935e917484799f31ad643eafb2a Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-756792154 Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2f1bd935e917484799f31ad643eafb2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2f1bd935e917484799f31ad643eafb2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2f1bd935e917484799f31ad643eafb2a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2f1bd935e917484799f31ad643eafb2a"}]}] Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerRescueNegativeTestJSON-756792154 Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 2f1bd935e917484799f31ad643eafb2a Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-756792154 Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerRescueNegativeTestJSON-756792154-project Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 9f2ddec1bc6244739e9ac3a40c064b53 Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerRescueNegativeTestJSON-756792154-project Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: {"rebuild": {"imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925"}} Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: exception: Cannot 'rebuild' instance 5aa9ee0e-2d03-42a5-af94-51275e754256 while it is in vm_state rescued Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '5aa9ee0e-2d03-42a5-af94-51275e754256', 'body': {'rebuild': {'imageRef': 'a7b14aba-1848-4a00-a3e7-b66eb3e97925'}}} Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5aa9ee0e-2d03-42a5-af94-51275e754256 in vm_state rescued. Cannot rebuild while the instance is in this state. Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:40:28.110923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:40:28.116690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:40:28.116690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 25 14:40:28.116690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Jul 25 14:40:28.116690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 14:40:28.116690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 14:40:28.116690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 14:40:28.116690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 5aa9ee0e-2d03-42a5-af94-51275e754256 while it is in vm_state rescued Jul 25 14:40:28.116690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:28.116690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:40:28.116690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:28.116690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:40:28.116690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:40:28.116690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:40:28.116690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:40:28.116690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:40:28.116690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 5aa9ee0e-2d03-42a5-af94-51275e754256 while it is in vm_state rescued Jul 25 14:40:28.116690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:28.145588 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-62f6d75f-95a5-4a5f-8902-284cca0033f3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Returning 409 to user: Cannot 'rebuild' instance 5aa9ee0e-2d03-42a5-af94-51275e754256 while it is in vm_state rescued {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:40:28.163631 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-62f6d75f-95a5-4a5f-8902-284cca0033f3 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "POST /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256/action" status: 409 len: 146 microversion: 2.1 time: 0.157105 Jul 25 14:40:28.164962 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1873/3540] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:40:28 2022] POST /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256/action => generated 146 bytes in 159 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 25 14:40:28.216607 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-37c70b51-c344-43b4-a9c0-af0816b54ea2 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:28.217617 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-37c70b51-c344-43b4-a9c0-af0816b54ea2 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:28.226968 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37c70b51-c344-43b4-a9c0-af0816b54ea2 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:28.227833 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37c70b51-c344-43b4-a9c0-af0816b54ea2 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:28.228950 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37c70b51-c344-43b4-a9c0-af0816b54ea2 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:28.229617 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37c70b51-c344-43b4-a9c0-af0816b54ea2 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:28.273512 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-37c70b51-c344-43b4-a9c0-af0816b54ea2 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:40:28.363183 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-dd475b26-a051-4001-8a61-146f8efd8867 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:28.385597 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dd475b26-a051-4001-8a61-146f8efd8867 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3" status: 200 len: 1491 microversion: 2.1 time: 0.336136 Jul 25 14:40:28.386192 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1668/3541] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:28 2022] GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3 => generated 1491 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:28.413175 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-69ef773a-1b09-46ed-bf41-fdce57a68fd1 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:40:28.418378 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-69ef773a-1b09-46ed-bf41-fdce57a68fd1 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: bd38057a-c422-40f2-9bc0-cb454cbe96c3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:28.470022 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-69ef773a-1b09-46ed-bf41-fdce57a68fd1 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:28.476481 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-69ef773a-1b09-46ed-bf41-fdce57a68fd1 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:28.477914 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-69ef773a-1b09-46ed-bf41-fdce57a68fd1 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:28.478576 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-69ef773a-1b09-46ed-bf41-fdce57a68fd1 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:28.484586 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-37c70b51-c344-43b4-a9c0-af0816b54ea2 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "DELETE /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 204 len: 0 microversion: 2.1 time: 0.289129 Jul 25 14:40:28.489304 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1874/3542] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:40:28 2022] DELETE /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:40:28.504070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-537a6354-7eb9-4b13-9bd4-9207e9a89d82 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:28.505025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-537a6354-7eb9-4b13-9bd4-9207e9a89d82 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:28.536931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-537a6354-7eb9-4b13-9bd4-9207e9a89d82 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:28.540085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-537a6354-7eb9-4b13-9bd4-9207e9a89d82 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:28.541245 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-537a6354-7eb9-4b13-9bd4-9207e9a89d82 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:28.542009 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-537a6354-7eb9-4b13-9bd4-9207e9a89d82 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:28.681258 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-69ef773a-1b09-46ed-bf41-fdce57a68fd1 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "PUT /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3" status: 200 len: 1086 microversion: 2.1 time: 0.270910 Jul 25 14:40:28.685920 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1669/3543] 10.222.0.88 () {60 vars in 1256 bytes} [Mon Jul 25 14:40:28 2022] PUT /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3 => generated 1086 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:40:28.707233 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0665ef92-c1fe-460b-b9b4-09dcc681ddde tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:28.708197 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0665ef92-c1fe-460b-b9b4-09dcc681ddde tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: bd38057a-c422-40f2-9bc0-cb454cbe96c3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:28.729010 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0665ef92-c1fe-460b-b9b4-09dcc681ddde tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:28.729998 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0665ef92-c1fe-460b-b9b4-09dcc681ddde tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:28.731412 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0665ef92-c1fe-460b-b9b4-09dcc681ddde tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:28.733790 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0665ef92-c1fe-460b-b9b4-09dcc681ddde tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:29.047804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-537a6354-7eb9-4b13-9bd4-9207e9a89d82 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:29.060713 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-537a6354-7eb9-4b13-9bd4-9207e9a89d82 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1688 microversion: 2.1 time: 0.565444 Jul 25 14:40:29.061314 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1875/3544] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:28 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1688 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:40:29.081128 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d5f5bb31-0f9f-4906-aa21-0a3ad3361f7f tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:29.082259 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d5f5bb31-0f9f-4906-aa21-0a3ad3361f7f tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] [instance: af17aed7-103f-49f3-84e7-c04b418e1201] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:29.094463 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5f5bb31-0f9f-4906-aa21-0a3ad3361f7f tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:29.097373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5f5bb31-0f9f-4906-aa21-0a3ad3361f7f tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:29.098414 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5f5bb31-0f9f-4906-aa21-0a3ad3361f7f tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:29.099010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5f5bb31-0f9f-4906-aa21-0a3ad3361f7f tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:29.125958 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0665ef92-c1fe-460b-b9b4-09dcc681ddde tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:29.137802 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0665ef92-c1fe-460b-b9b4-09dcc681ddde tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3" status: 200 len: 1512 microversion: 2.1 time: 0.434861 Jul 25 14:40:29.148013 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1670/3545] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:28 2022] GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3 => generated 1512 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:40:29.163788 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-10be4c62-c66a-4aa0-8f4a-754bcb5090fa tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:29.164541 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-10be4c62-c66a-4aa0-8f4a-754bcb5090fa tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: bd38057a-c422-40f2-9bc0-cb454cbe96c3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:29.184108 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-10be4c62-c66a-4aa0-8f4a-754bcb5090fa tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:29.184567 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-10be4c62-c66a-4aa0-8f4a-754bcb5090fa tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:29.185428 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-10be4c62-c66a-4aa0-8f4a-754bcb5090fa tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:29.185935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-10be4c62-c66a-4aa0-8f4a-754bcb5090fa tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:29.587910 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-10be4c62-c66a-4aa0-8f4a-754bcb5090fa tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:29.598212 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-10be4c62-c66a-4aa0-8f4a-754bcb5090fa tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3" status: 200 len: 1512 microversion: 2.1 time: 0.440821 Jul 25 14:40:29.602129 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d5f5bb31-0f9f-4906-aa21-0a3ad3361f7f tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3ce8c9c8e46e2b4ea2f0ef9254fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8f99ef076f4f16b763db443da0dfb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:29.613500 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1671/3546] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:29 2022] GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3 => generated 1512 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:29.619958 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d5f5bb31-0f9f-4906-aa21-0a3ad3361f7f tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] 10.222.0.88 "GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201" status: 200 len: 1316 microversion: 2.1 time: 0.542462 Jul 25 14:40:29.625190 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-42770e2b-cf2e-4144-a460-418b46a550be tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:29.625795 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-42770e2b-cf2e-4144-a460-418b46a550be tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: bd38057a-c422-40f2-9bc0-cb454cbe96c3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:29.636569 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1876/3547] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:29 2022] GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201 => generated 1316 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:29.637486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42770e2b-cf2e-4144-a460-418b46a550be tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:29.639662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42770e2b-cf2e-4144-a460-418b46a550be tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:29.640625 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42770e2b-cf2e-4144-a460-418b46a550be tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:29.641874 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42770e2b-cf2e-4144-a460-418b46a550be tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:29.702525 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-42770e2b-cf2e-4144-a460-418b46a550be tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: bd38057a-c422-40f2-9bc0-cb454cbe96c3] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:40:29.871115 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-42770e2b-cf2e-4144-a460-418b46a550be tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "DELETE /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3" status: 204 len: 0 microversion: 2.1 time: 0.249428 Jul 25 14:40:29.875051 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1672/3548] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:40:29 2022] DELETE /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:40:29.889357 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3e06825a-68e7-49fd-81e2-d12af112a8a4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:29.895187 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3e06825a-68e7-49fd-81e2-d12af112a8a4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: bd38057a-c422-40f2-9bc0-cb454cbe96c3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:29.914519 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e06825a-68e7-49fd-81e2-d12af112a8a4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:29.916003 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e06825a-68e7-49fd-81e2-d12af112a8a4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:29.917827 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e06825a-68e7-49fd-81e2-d12af112a8a4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:29.918260 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e06825a-68e7-49fd-81e2-d12af112a8a4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:30.089838 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-77646dd2-c4c5-40cf-b5a1-251d98512207 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:30.090554 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-77646dd2-c4c5-40cf-b5a1-251d98512207 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:30.102950 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77646dd2-c4c5-40cf-b5a1-251d98512207 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:30.102950 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77646dd2-c4c5-40cf-b5a1-251d98512207 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:30.103570 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77646dd2-c4c5-40cf-b5a1-251d98512207 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:30.108185 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77646dd2-c4c5-40cf-b5a1-251d98512207 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:30.381152 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-77646dd2-c4c5-40cf-b5a1-251d98512207 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:30.392342 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-77646dd2-c4c5-40cf-b5a1-251d98512207 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1688 microversion: 2.1 time: 0.306832 Jul 25 14:40:30.408928 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1673/3549] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:30 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1688 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:40:30.523956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3e06825a-68e7-49fd-81e2-d12af112a8a4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:30.532723 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3e06825a-68e7-49fd-81e2-d12af112a8a4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3" status: 200 len: 1518 microversion: 2.1 time: 0.652891 Jul 25 14:40:30.543929 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1877/3550] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:29 2022] GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3 => generated 1518 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:30.643386 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f4ea1e09-9881-4de0-bc5e-72c392204fd3 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:30.644682 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f4ea1e09-9881-4de0-bc5e-72c392204fd3 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] [instance: af17aed7-103f-49f3-84e7-c04b418e1201] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:30.661428 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f4ea1e09-9881-4de0-bc5e-72c392204fd3 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:30.661895 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f4ea1e09-9881-4de0-bc5e-72c392204fd3 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:30.664076 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f4ea1e09-9881-4de0-bc5e-72c392204fd3 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:30.664564 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f4ea1e09-9881-4de0-bc5e-72c392204fd3 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:30.947118 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f4ea1e09-9881-4de0-bc5e-72c392204fd3 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3ce8c9c8e46e2b4ea2f0ef9254fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8f99ef076f4f16b763db443da0dfb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:30.956571 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f4ea1e09-9881-4de0-bc5e-72c392204fd3 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] 10.222.0.88 "GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201" status: 200 len: 1505 microversion: 2.1 time: 0.317363 Jul 25 14:40:30.977406 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1674/3551] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:30 2022] GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201 => generated 1505 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:30.982339 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9325f3bd-13c6-40e8-817c-659571b542c6 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:30.982919 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9325f3bd-13c6-40e8-817c-659571b542c6 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] [instance: af17aed7-103f-49f3-84e7-c04b418e1201] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:30.990540 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9325f3bd-13c6-40e8-817c-659571b542c6 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:30.990984 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9325f3bd-13c6-40e8-817c-659571b542c6 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:30.995490 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9325f3bd-13c6-40e8-817c-659571b542c6 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:30.996666 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9325f3bd-13c6-40e8-817c-659571b542c6 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:31.035089 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9325f3bd-13c6-40e8-817c-659571b542c6 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] 10.222.0.88 "GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201/ips" status: 200 len: 109 microversion: 2.1 time: 0.056919 Jul 25 14:40:31.049111 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1040b65e-002a-4704-bb39-9aced6f358c3 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:31.049619 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1040b65e-002a-4704-bb39-9aced6f358c3 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] [instance: af17aed7-103f-49f3-84e7-c04b418e1201] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:31.056921 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1040b65e-002a-4704-bb39-9aced6f358c3 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:31.057378 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1040b65e-002a-4704-bb39-9aced6f358c3 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:31.058168 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1040b65e-002a-4704-bb39-9aced6f358c3 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:31.058603 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1040b65e-002a-4704-bb39-9aced6f358c3 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:31.059597 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1878/3552] 10.222.0.88 () {58 vars in 1248 bytes} [Mon Jul 25 14:40:30 2022] GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201/ips => generated 109 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:40:31.120691 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1040b65e-002a-4704-bb39-9aced6f358c3 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] 10.222.0.88 "GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201/ips" status: 200 len: 109 microversion: 2.1 time: 0.075652 Jul 25 14:40:31.127272 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1675/3553] 10.222.0.88 () {58 vars in 1248 bytes} [Mon Jul 25 14:40:31 2022] GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201/ips => generated 109 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:40:31.136348 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-52321928-ad47-42fa-9535-ced253e1c541 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:31.137454 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-52321928-ad47-42fa-9535-ced253e1c541 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] [instance: af17aed7-103f-49f3-84e7-c04b418e1201] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:31.150355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52321928-ad47-42fa-9535-ced253e1c541 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:31.151098 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52321928-ad47-42fa-9535-ced253e1c541 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:31.157134 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52321928-ad47-42fa-9535-ced253e1c541 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:31.158710 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52321928-ad47-42fa-9535-ced253e1c541 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:31.198218 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-52321928-ad47-42fa-9535-ced253e1c541 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] 10.222.0.88 "GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201/ips/tempest-ServerAddressesTestJSON-2104567562-network" status: 200 len: 94 microversion: 2.1 time: 0.068945 Jul 25 14:40:31.206439 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1879/3554] 10.222.0.88 () {58 vars in 1401 bytes} [Mon Jul 25 14:40:31 2022] GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201/ips/tempest-ServerAddressesTestJSON-2104567562-network => generated 94 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:40:31.211612 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2f1d39d8-bb20-43b8-863e-279221fff361 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:31.212407 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2f1d39d8-bb20-43b8-863e-279221fff361 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] [instance: af17aed7-103f-49f3-84e7-c04b418e1201] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:31.219812 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f1d39d8-bb20-43b8-863e-279221fff361 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:31.220558 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f1d39d8-bb20-43b8-863e-279221fff361 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:31.221454 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f1d39d8-bb20-43b8-863e-279221fff361 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:31.221994 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f1d39d8-bb20-43b8-863e-279221fff361 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:31.264071 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2f1d39d8-bb20-43b8-863e-279221fff361 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] [instance: af17aed7-103f-49f3-84e7-c04b418e1201] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:40:31.415251 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-94ba9289-79ca-4aaf-ad9a-b5e2ac71eb02 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:31.416438 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-94ba9289-79ca-4aaf-ad9a-b5e2ac71eb02 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:31.426097 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94ba9289-79ca-4aaf-ad9a-b5e2ac71eb02 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:31.449062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94ba9289-79ca-4aaf-ad9a-b5e2ac71eb02 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:31.452116 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94ba9289-79ca-4aaf-ad9a-b5e2ac71eb02 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:31.453491 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94ba9289-79ca-4aaf-ad9a-b5e2ac71eb02 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:31.454943 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2f1d39d8-bb20-43b8-863e-279221fff361 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] 10.222.0.88 "DELETE /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201" status: 204 len: 0 microversion: 2.1 time: 0.247237 Jul 25 14:40:31.465071 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1676/3555] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:40:31 2022] DELETE /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 14:40:31.483441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-93f578c0-4bcf-41d0-ba13-b865b4bf1543 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:31.496474 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-93f578c0-4bcf-41d0-ba13-b865b4bf1543 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] [instance: af17aed7-103f-49f3-84e7-c04b418e1201] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:31.507859 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93f578c0-4bcf-41d0-ba13-b865b4bf1543 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:31.508728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93f578c0-4bcf-41d0-ba13-b865b4bf1543 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:31.510201 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93f578c0-4bcf-41d0-ba13-b865b4bf1543 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:31.515324 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93f578c0-4bcf-41d0-ba13-b865b4bf1543 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:31.529340 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:40:31.983815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-93f578c0-4bcf-41d0-ba13-b865b4bf1543 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3ce8c9c8e46e2b4ea2f0ef9254fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8f99ef076f4f16b763db443da0dfb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:31.998072 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-93f578c0-4bcf-41d0-ba13-b865b4bf1543 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] 10.222.0.88 "GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201" status: 200 len: 1511 microversion: 2.1 time: 0.530686 Jul 25 14:40:32.013090 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1677/3556] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:31 2022] GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201 => generated 1511 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:32.028287 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ce01685e-a0f6-4c8b-be32-03c9196f4778 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:32.032737 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ce01685e-a0f6-4c8b-be32-03c9196f4778 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: bd38057a-c422-40f2-9bc0-cb454cbe96c3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:32.046851 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ce01685e-a0f6-4c8b-be32-03c9196f4778 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:32.048514 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ce01685e-a0f6-4c8b-be32-03c9196f4778 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:32.052401 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-94ba9289-79ca-4aaf-ad9a-b5e2ac71eb02 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:32.066740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ce01685e-a0f6-4c8b-be32-03c9196f4778 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:32.067710 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ce01685e-a0f6-4c8b-be32-03c9196f4778 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:32.073487 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-94ba9289-79ca-4aaf-ad9a-b5e2ac71eb02 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1688 microversion: 2.1 time: 0.657966 Jul 25 14:40:32.075204 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1880/3557] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:31 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1688 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:32.731139 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ce01685e-a0f6-4c8b-be32-03c9196f4778 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:32.740281 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ce01685e-a0f6-4c8b-be32-03c9196f4778 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3" status: 200 len: 1518 microversion: 2.1 time: 0.720571 Jul 25 14:40:32.744741 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1678/3558] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:32 2022] GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3 => generated 1518 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:33.018840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-26eea00c-8e38-465c-b17f-2df40734775f tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:33.019457 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-26eea00c-8e38-465c-b17f-2df40734775f tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] [instance: af17aed7-103f-49f3-84e7-c04b418e1201] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:33.031923 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26eea00c-8e38-465c-b17f-2df40734775f tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:33.032383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26eea00c-8e38-465c-b17f-2df40734775f tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:33.033544 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26eea00c-8e38-465c-b17f-2df40734775f tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:33.033977 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26eea00c-8e38-465c-b17f-2df40734775f tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:33.100230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1ae9ee2d-4a2e-4f78-819f-b79dd5f8b497 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:33.100862 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1ae9ee2d-4a2e-4f78-819f-b79dd5f8b497 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:33.115279 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ae9ee2d-4a2e-4f78-819f-b79dd5f8b497 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:33.122508 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ae9ee2d-4a2e-4f78-819f-b79dd5f8b497 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:33.123599 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ae9ee2d-4a2e-4f78-819f-b79dd5f8b497 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:33.135011 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ae9ee2d-4a2e-4f78-819f-b79dd5f8b497 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:33.536808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-26eea00c-8e38-465c-b17f-2df40734775f tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3ce8c9c8e46e2b4ea2f0ef9254fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8f99ef076f4f16b763db443da0dfb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:33.554449 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-26eea00c-8e38-465c-b17f-2df40734775f tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] 10.222.0.88 "GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201" status: 200 len: 1511 microversion: 2.1 time: 0.539420 Jul 25 14:40:33.572135 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1881/3559] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:33 2022] GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201 => generated 1511 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:33.589838 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1ae9ee2d-4a2e-4f78-819f-b79dd5f8b497 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:33.600305 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1ae9ee2d-4a2e-4f78-819f-b79dd5f8b497 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1688 microversion: 2.1 time: 0.503959 Jul 25 14:40:33.600855 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1679/3560] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:33 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1688 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:40:33.771724 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dc794f08-a3bb-42ae-93df-6ea2a252e355 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:33.772521 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dc794f08-a3bb-42ae-93df-6ea2a252e355 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: bd38057a-c422-40f2-9bc0-cb454cbe96c3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:33.779168 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dc794f08-a3bb-42ae-93df-6ea2a252e355 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:33.787585 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dc794f08-a3bb-42ae-93df-6ea2a252e355 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:33.794012 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dc794f08-a3bb-42ae-93df-6ea2a252e355 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:33.794724 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dc794f08-a3bb-42ae-93df-6ea2a252e355 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:34.069591 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dc794f08-a3bb-42ae-93df-6ea2a252e355 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:34.082914 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dc794f08-a3bb-42ae-93df-6ea2a252e355 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3" status: 200 len: 1476 microversion: 2.1 time: 0.315821 Jul 25 14:40:34.086937 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1882/3561] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:33 2022] GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3 => generated 1476 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:34.470768 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-b43e336b-0b30-449e-b85c-7c250de10823 req-8e0fbed5-7be9-4572-b252-205e8e4cf330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd38057a-c422-40f2-9bc0-cb454cbe96c3", "name": "network-vif-deleted", "tag": "d0cd3a3a-3031-4753-ae68-c4ea89fd3d62"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:40:34.493835 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b43e336b-0b30-449e-b85c-7c250de10823 req-8e0fbed5-7be9-4572-b252-205e8e4cf330 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:34.494586 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b43e336b-0b30-449e-b85c-7c250de10823 req-8e0fbed5-7be9-4572-b252-205e8e4cf330 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:34.512781 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-b43e336b-0b30-449e-b85c-7c250de10823 req-8e0fbed5-7be9-4572-b252-205e8e4cf330 service nova] Creating event network-vif-deleted:d0cd3a3a-3031-4753-ae68-c4ea89fd3d62 for instance bd38057a-c422-40f2-9bc0-cb454cbe96c3 on n-h2-846435-14 Jul 25 14:40:34.520377 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-b43e336b-0b30-449e-b85c-7c250de10823 req-8e0fbed5-7be9-4572-b252-205e8e4cf330 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053477 Jul 25 14:40:34.521023 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1680/3562] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:40:34.578937 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7e35282e-40f2-40b9-903a-61f79d1dd9ff tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:34.580166 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7e35282e-40f2-40b9-903a-61f79d1dd9ff tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] [instance: af17aed7-103f-49f3-84e7-c04b418e1201] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:34.587262 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7e35282e-40f2-40b9-903a-61f79d1dd9ff tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:34.588075 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7e35282e-40f2-40b9-903a-61f79d1dd9ff tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:34.589729 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7e35282e-40f2-40b9-903a-61f79d1dd9ff tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:34.590413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7e35282e-40f2-40b9-903a-61f79d1dd9ff tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:34.622127 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3c32a8b3-12bc-451d-8639-c219dd472fca tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:34.623707 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3c32a8b3-12bc-451d-8639-c219dd472fca tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:34.632546 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c32a8b3-12bc-451d-8639-c219dd472fca tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:34.632985 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c32a8b3-12bc-451d-8639-c219dd472fca tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:34.633952 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c32a8b3-12bc-451d-8639-c219dd472fca tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:34.634547 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c32a8b3-12bc-451d-8639-c219dd472fca tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:35.128084 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7e35282e-40f2-40b9-903a-61f79d1dd9ff tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3ce8c9c8e46e2b4ea2f0ef9254fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8f99ef076f4f16b763db443da0dfb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:35.141638 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7e35282e-40f2-40b9-903a-61f79d1dd9ff tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] 10.222.0.88 "GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201" status: 200 len: 1511 microversion: 2.1 time: 0.566566 Jul 25 14:40:35.144143 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1883/3563] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:34 2022] GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201 => generated 1511 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:35.157669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1c07823e-193a-4ac0-b055-d62c9e62b658 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:35.159217 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1c07823e-193a-4ac0-b055-d62c9e62b658 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: bd38057a-c422-40f2-9bc0-cb454cbe96c3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:35.175321 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1c07823e-193a-4ac0-b055-d62c9e62b658 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:35.182592 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1c07823e-193a-4ac0-b055-d62c9e62b658 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:35.185709 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1c07823e-193a-4ac0-b055-d62c9e62b658 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:35.189532 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1c07823e-193a-4ac0-b055-d62c9e62b658 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:35.237215 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-1c07823e-193a-4ac0-b055-d62c9e62b658 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] HTTP exception thrown: Instance bd38057a-c422-40f2-9bc0-cb454cbe96c3 could not be found. Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1c07823e-193a-4ac0-b055-d62c9e62b658 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Request method failure captured: Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3 HTTP/1.1 Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qrEzscNKkpLEv-dO5KC3kdeJJY02nOIPLRIxGcrQR-Na_rLZBnVMM8MjTz-RtprnQR45AAorrNLLV4PDOD1PCa-gGNHdgbGOQfAGQYPzZpu9aSUEO6v7jEn8m2OVF51pdW16QE7pCXmLdRnFRt172yMaxqytlLvEMs-sUVBeXNXrcQ Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e77732af189e48feab3752ddb28208d3", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e77732af189e48feab3752ddb28208d3"}]}] Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersTestJSON-1827246574 Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersTestJSON-1827246574-project Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: e45ffe0956ae4ba9b1577875f312af06 Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersTestJSON-1827246574-project Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance bd38057a-c422-40f2-9bc0-cb454cbe96c3 could not be found. Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'bd38057a-c422-40f2-9bc0-cb454cbe96c3'} Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd38057a-c422-40f2-9bc0-cb454cbe96c3 could not be found. Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd38057a-c422-40f2-9bc0-cb454cbe96c3 could not be found. Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:35.243493 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:40:35.249582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:40:35.249582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:40:35.249582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:40:35.249582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:40:35.249582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd38057a-c422-40f2-9bc0-cb454cbe96c3 could not be found. Jul 25 14:40:35.249582 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:35.255147 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1c07823e-193a-4ac0-b055-d62c9e62b658 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Returning 404 to user: Instance bd38057a-c422-40f2-9bc0-cb454cbe96c3 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:40:35.256498 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1c07823e-193a-4ac0-b055-d62c9e62b658 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3" status: 404 len: 111 microversion: 2.1 time: 0.111042 Jul 25 14:40:35.261830 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1884/3564] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:35 2022] GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:40:35.516332 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3c32a8b3-12bc-451d-8639-c219dd472fca tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:35.536007 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3c32a8b3-12bc-451d-8639-c219dd472fca tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1688 microversion: 2.1 time: 0.910285 Jul 25 14:40:35.541630 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1681/3565] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:34 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1688 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:35.667183 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-50df85eb-02c3-4c75-892a-65284b9fce21 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-509133834", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "4c176170-2f7d-43a7-8c89-c74c022eb418"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:40:35.740801 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-8ed6b747-f73e-4ab9-9e82-a0b7fb25721e req-0f17d8ff-e315-41af-a6db-13b38d1a00a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af17aed7-103f-49f3-84e7-c04b418e1201", "name": "network-vif-unplugged", "status": "completed", "tag": "f24e7225-57db-4463-9b9c-24d67598af77"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:40:35.786987 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-8ed6b747-f73e-4ab9-9e82-a0b7fb25721e req-0f17d8ff-e315-41af-a6db-13b38d1a00a2 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:35.787773 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-8ed6b747-f73e-4ab9-9e82-a0b7fb25721e req-0f17d8ff-e315-41af-a6db-13b38d1a00a2 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:35.825646 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-8ed6b747-f73e-4ab9-9e82-a0b7fb25721e req-0f17d8ff-e315-41af-a6db-13b38d1a00a2 service nova] Creating event network-vif-unplugged:f24e7225-57db-4463-9b9c-24d67598af77 for instance af17aed7-103f-49f3-84e7-c04b418e1201 on n-h2-846435-14 Jul 25 14:40:35.834227 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-50df85eb-02c3-4c75-892a-65284b9fce21 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] validate_networks() for [('4c176170-2f7d-43a7-8c89-c74c022eb418', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:40:35.867895 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-8ed6b747-f73e-4ab9-9e82-a0b7fb25721e req-0f17d8ff-e315-41af-a6db-13b38d1a00a2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.134534 Jul 25 14:40:35.870883 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1682/3566] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:40:36.165547 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c5c216d6-190c-45fd-beaa-15a335504ef3 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:36.166260 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c5c216d6-190c-45fd-beaa-15a335504ef3 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] [instance: af17aed7-103f-49f3-84e7-c04b418e1201] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:36.173234 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c5c216d6-190c-45fd-beaa-15a335504ef3 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:36.174314 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c5c216d6-190c-45fd-beaa-15a335504ef3 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:36.181536 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c5c216d6-190c-45fd-beaa-15a335504ef3 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:36.182261 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c5c216d6-190c-45fd-beaa-15a335504ef3 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:36.417098 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c5c216d6-190c-45fd-beaa-15a335504ef3 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3ce8c9c8e46e2b4ea2f0ef9254fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8f99ef076f4f16b763db443da0dfb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:36.437587 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c5c216d6-190c-45fd-beaa-15a335504ef3 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] 10.222.0.88 "GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201" status: 200 len: 1469 microversion: 2.1 time: 0.275811 Jul 25 14:40:36.458285 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1683/3567] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:36 2022] GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201 => generated 1469 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:40:36.465794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-9ceb19ab-7a38-4092-8d7f-e2c1718ddf99 req-0139057b-f70e-4357-832a-7886770a5969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af17aed7-103f-49f3-84e7-c04b418e1201", "name": "network-vif-deleted", "tag": "f24e7225-57db-4463-9b9c-24d67598af77"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:40:36.498078 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-9ceb19ab-7a38-4092-8d7f-e2c1718ddf99 req-0139057b-f70e-4357-832a-7886770a5969 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:36.501411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-9ceb19ab-7a38-4092-8d7f-e2c1718ddf99 req-0139057b-f70e-4357-832a-7886770a5969 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:36.519332 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-9ceb19ab-7a38-4092-8d7f-e2c1718ddf99 req-0139057b-f70e-4357-832a-7886770a5969 service nova] Creating event network-vif-deleted:f24e7225-57db-4463-9b9c-24d67598af77 for instance af17aed7-103f-49f3-84e7-c04b418e1201 on n-h2-846435-14 Jul 25 14:40:36.590186 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-9ceb19ab-7a38-4092-8d7f-e2c1718ddf99 req-0139057b-f70e-4357-832a-7886770a5969 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116189 Jul 25 14:40:36.591310 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1684/3568] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:40:36.599099 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7825d625-0db0-4f09-9f02-e4b6232bab75 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:36.608209 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7825d625-0db0-4f09-9f02-e4b6232bab75 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:36.619763 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7825d625-0db0-4f09-9f02-e4b6232bab75 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:36.620294 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7825d625-0db0-4f09-9f02-e4b6232bab75 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:36.621839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7825d625-0db0-4f09-9f02-e4b6232bab75 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:36.622648 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7825d625-0db0-4f09-9f02-e4b6232bab75 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:36.763319 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7825d625-0db0-4f09-9f02-e4b6232bab75 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:36.810085 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7825d625-0db0-4f09-9f02-e4b6232bab75 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 200 len: 1620 microversion: 2.1 time: 0.217300 Jul 25 14:40:36.823730 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1685/3569] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:36 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 1620 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:37.114737 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-50df85eb-02c3-4c75-892a-65284b9fce21 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:40:37.115262 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-50df85eb-02c3-4c75-892a-65284b9fce21 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:40:37.115667 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-50df85eb-02c3-4c75-892a-65284b9fce21 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:40:37.116202 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-50df85eb-02c3-4c75-892a-65284b9fce21 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:40:37.116518 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-50df85eb-02c3-4c75-892a-65284b9fce21 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:40:37.137615 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50df85eb-02c3-4c75-892a-65284b9fce21 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:37.143301 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50df85eb-02c3-4c75-892a-65284b9fce21 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:37.144383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50df85eb-02c3-4c75-892a-65284b9fce21 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:37.144838 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50df85eb-02c3-4c75-892a-65284b9fce21 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:37.229585 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-50df85eb-02c3-4c75-892a-65284b9fce21 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Getting quotas for project e77732af189e48feab3752ddb28208d3. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:40:37.257319 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-50df85eb-02c3-4c75-892a-65284b9fce21 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Getting quotas for user e45ffe0956ae4ba9b1577875f312af06 and project e77732af189e48feab3752ddb28208d3. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:40:37.328334 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-50df85eb-02c3-4c75-892a-65284b9fce21 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:40:37.330625 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-50df85eb-02c3-4c75-892a-65284b9fce21 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:40:37.422921 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-50df85eb-02c3-4c75-892a-65284b9fce21 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.759567 Jul 25 14:40:37.424225 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1885/3570] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:40:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:40:37.449878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e11a0d73-34a7-457a-a430-46d379de6df1 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:37.450764 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e11a0d73-34a7-457a-a430-46d379de6df1 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:37.459037 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c2bd78d8-0910-4f13-b3ed-aebd68383148 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:37.459809 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c2bd78d8-0910-4f13-b3ed-aebd68383148 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] [instance: af17aed7-103f-49f3-84e7-c04b418e1201] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:37.492281 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c2bd78d8-0910-4f13-b3ed-aebd68383148 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:37.496941 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c2bd78d8-0910-4f13-b3ed-aebd68383148 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:37.504615 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c2bd78d8-0910-4f13-b3ed-aebd68383148 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:37.508565 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c2bd78d8-0910-4f13-b3ed-aebd68383148 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:37.573819 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-c2bd78d8-0910-4f13-b3ed-aebd68383148 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] HTTP exception thrown: Instance af17aed7-103f-49f3-84e7-c04b418e1201 could not be found. Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c2bd78d8-0910-4f13-b3ed-aebd68383148 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Request method failure captured: Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201 HTTP/1.1 Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qtC4z_43H55GEevojELTo_ZvfEcXFz45gay6Rw2xV-p8JXYTBc87jOswiyGEIwiYuLslN8Zm0BVozSYuRg_19Bvq69XTPhllO4P-mghSCWs33K4iFEIRzR9oiODWGlDtgUrxJX1VRxm97FOu5A_XdbFGxjL6U6QNuXNggNcklisxT8 Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 3d8f99ef076f4f16b763db443da0dfb9 Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerAddressesTestJSON-1847065780 Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d8f99ef076f4f16b763db443da0dfb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3d8f99ef076f4f16b763db443da0dfb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3d8f99ef076f4f16b763db443da0dfb9", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3d8f99ef076f4f16b763db443da0dfb9"}]}] Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerAddressesTestJSON-1847065780 Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 3d8f99ef076f4f16b763db443da0dfb9 Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1847065780 Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerAddressesTestJSON-1847065780-project Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 12d3ce8c9c8e46e2b4ea2f0ef9254fdf Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerAddressesTestJSON-1847065780-project Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance af17aed7-103f-49f3-84e7-c04b418e1201 could not be found. Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'af17aed7-103f-49f3-84e7-c04b418e1201'} Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af17aed7-103f-49f3-84e7-c04b418e1201 could not be found. Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af17aed7-103f-49f3-84e7-c04b418e1201 could not be found. Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:40:37.580416 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:37.586473 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:40:37.586473 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:40:37.586473 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:40:37.586473 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:40:37.586473 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:40:37.586473 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af17aed7-103f-49f3-84e7-c04b418e1201 could not be found. Jul 25 14:40:37.586473 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:37.591669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c2bd78d8-0910-4f13-b3ed-aebd68383148 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] Returning 404 to user: Instance af17aed7-103f-49f3-84e7-c04b418e1201 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:40:37.594989 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c2bd78d8-0910-4f13-b3ed-aebd68383148 tempest-ServerAddressesTestJSON-1847065780 tempest-ServerAddressesTestJSON-1847065780-project] 10.222.0.88 "GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201" status: 404 len: 111 microversion: 2.1 time: 0.140153 Jul 25 14:40:37.599683 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1886/3571] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:37 2022] GET /compute/v2.1/servers/af17aed7-103f-49f3-84e7-c04b418e1201 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:40:37.845282 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-26586431-8ca0-4fae-98d4-13a14ee650b9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:37.846715 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-26586431-8ca0-4fae-98d4-13a14ee650b9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: fac258f1-785d-4dd9-bc68-0ee713c9149a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:37.855085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26586431-8ca0-4fae-98d4-13a14ee650b9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:37.868701 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26586431-8ca0-4fae-98d4-13a14ee650b9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:37.875096 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26586431-8ca0-4fae-98d4-13a14ee650b9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:37.878063 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26586431-8ca0-4fae-98d4-13a14ee650b9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:37.934503 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-26586431-8ca0-4fae-98d4-13a14ee650b9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] HTTP exception thrown: Instance fac258f1-785d-4dd9-bc68-0ee713c9149a could not be found. Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-26586431-8ca0-4fae-98d4-13a14ee650b9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Request method failure captured: Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a HTTP/1.1 Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qojWgWRzNqcoFtbKX69HP8TMfJcvgq5mROxrtiAbTRQQhODI65548klI2mwspV0aDgelkydSdF0jDfbt9K1MKvAqBkxkDKwdPBnneXznLL8230WZKLHZUg-qMlSHwLMR2RP6Be2wdwzhEY6xsA-ygO39xLQI8y2VkgTqIORhZUeWIM Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 2f1bd935e917484799f31ad643eafb2a Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-756792154 Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2f1bd935e917484799f31ad643eafb2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2f1bd935e917484799f31ad643eafb2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2f1bd935e917484799f31ad643eafb2a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2f1bd935e917484799f31ad643eafb2a"}]}] Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerRescueNegativeTestJSON-756792154 Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 2f1bd935e917484799f31ad643eafb2a Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-756792154 Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerRescueNegativeTestJSON-756792154-project Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 9f2ddec1bc6244739e9ac3a40c064b53 Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerRescueNegativeTestJSON-756792154-project Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance fac258f1-785d-4dd9-bc68-0ee713c9149a could not be found. Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'fac258f1-785d-4dd9-bc68-0ee713c9149a'} Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fac258f1-785d-4dd9-bc68-0ee713c9149a could not be found. Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fac258f1-785d-4dd9-bc68-0ee713c9149a could not be found. Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:40:37.961907 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:37.967290 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:40:37.967290 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:40:37.967290 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:40:37.967290 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:40:37.967290 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:40:37.967290 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fac258f1-785d-4dd9-bc68-0ee713c9149a could not be found. Jul 25 14:40:37.967290 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:37.972466 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-26586431-8ca0-4fae-98d4-13a14ee650b9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Returning 404 to user: Instance fac258f1-785d-4dd9-bc68-0ee713c9149a could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:40:37.981800 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-26586431-8ca0-4fae-98d4-13a14ee650b9 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a" status: 404 len: 111 microversion: 2.1 time: 0.144276 Jul 25 14:40:37.987645 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1887/3572] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:37 2022] GET /compute/v2.1/servers/fac258f1-785d-4dd9-bc68-0ee713c9149a => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:40:38.001983 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dd210563-541e-439b-8426-929ea56f919a tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '.version_select at 0x7f46989dd1f0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:38.097274 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dd210563-541e-439b-8426-929ea56f919a tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-792019371" status: 202 len: 0 microversion: 2.1 time: 0.107066 Jul 25 14:40:38.102008 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1888/3573] 10.222.0.88 () {58 vars in 1218 bytes} [Mon Jul 25 14:40:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-792019371 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:40:38.554058 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e11a0d73-34a7-457a-a430-46d379de6df1 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:38.563193 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e11a0d73-34a7-457a-a430-46d379de6df1 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1208 microversion: 2.1 time: 1.126213 Jul 25 14:40:38.571262 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1686/3574] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:37 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1208 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:38.622962 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-849b81e6-5364-4e26-a21b-7f274d4aeae6 req-bc84e464-5396-43c6-9a94-27b9c55237df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fac258f1-785d-4dd9-bc68-0ee713c9149a", "name": "network-vif-deleted", "tag": "f04995f2-50af-408b-81f1-cda226840583"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:40:38.648332 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-849b81e6-5364-4e26-a21b-7f274d4aeae6 req-bc84e464-5396-43c6-9a94-27b9c55237df service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:38.649038 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-849b81e6-5364-4e26-a21b-7f274d4aeae6 req-bc84e464-5396-43c6-9a94-27b9c55237df service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:38.671738 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-849b81e6-5364-4e26-a21b-7f274d4aeae6 req-bc84e464-5396-43c6-9a94-27b9c55237df service nova] Creating event network-vif-deleted:f04995f2-50af-408b-81f1-cda226840583 for instance fac258f1-785d-4dd9-bc68-0ee713c9149a on n-h1-846435-14 Jul 25 14:40:38.683068 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-849b81e6-5364-4e26-a21b-7f274d4aeae6 req-bc84e464-5396-43c6-9a94-27b9c55237df service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062628 Jul 25 14:40:38.684913 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1889/3575] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:40:39.586223 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a6f7e42b-21f0-4e7d-a2f7-f1e4593ec710 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:39.588764 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a6f7e42b-21f0-4e7d-a2f7-f1e4593ec710 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:39.601463 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a6f7e42b-21f0-4e7d-a2f7-f1e4593ec710 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:39.601920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a6f7e42b-21f0-4e7d-a2f7-f1e4593ec710 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:39.602713 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a6f7e42b-21f0-4e7d-a2f7-f1e4593ec710 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:39.603159 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a6f7e42b-21f0-4e7d-a2f7-f1e4593ec710 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:39.934772 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a6f7e42b-21f0-4e7d-a2f7-f1e4593ec710 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:39.947996 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a6f7e42b-21f0-4e7d-a2f7-f1e4593ec710 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1266 microversion: 2.1 time: 0.364910 Jul 25 14:40:39.962805 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1687/3576] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:39 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1266 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:40.975218 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-27154ce7-8361-4d76-a099-cf0d8faea04b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:40.975942 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-27154ce7-8361-4d76-a099-cf0d8faea04b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:41.004089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-27154ce7-8361-4d76-a099-cf0d8faea04b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:41.004544 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-27154ce7-8361-4d76-a099-cf0d8faea04b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:41.005336 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-27154ce7-8361-4d76-a099-cf0d8faea04b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:41.005810 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-27154ce7-8361-4d76-a099-cf0d8faea04b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:41.341866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-27154ce7-8361-4d76-a099-cf0d8faea04b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:41.354643 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-27154ce7-8361-4d76-a099-cf0d8faea04b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1266 microversion: 2.1 time: 0.387948 Jul 25 14:40:41.357372 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1890/3577] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:40 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1266 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:42.381563 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5ce67e8c-0e4a-44fa-8ece-2dfbfcfcfc54 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:42.382869 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5ce67e8c-0e4a-44fa-8ece-2dfbfcfcfc54 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:42.402886 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5ce67e8c-0e4a-44fa-8ece-2dfbfcfcfc54 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:42.403803 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5ce67e8c-0e4a-44fa-8ece-2dfbfcfcfc54 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:42.404853 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5ce67e8c-0e4a-44fa-8ece-2dfbfcfcfc54 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:42.412996 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5ce67e8c-0e4a-44fa-8ece-2dfbfcfcfc54 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:42.777173 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5ce67e8c-0e4a-44fa-8ece-2dfbfcfcfc54 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:42.791230 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5ce67e8c-0e4a-44fa-8ece-2dfbfcfcfc54 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1308 microversion: 2.1 time: 0.415350 Jul 25 14:40:42.793052 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1688/3578] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:42 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1308 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:43.814367 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-af99afef-e46a-4304-925f-5d644566dec7 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:43.816025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-af99afef-e46a-4304-925f-5d644566dec7 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:43.827101 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af99afef-e46a-4304-925f-5d644566dec7 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:43.828783 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af99afef-e46a-4304-925f-5d644566dec7 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:43.829807 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af99afef-e46a-4304-925f-5d644566dec7 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:43.830599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af99afef-e46a-4304-925f-5d644566dec7 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:44.714107 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a62181d4-7b2c-41db-8a19-03597762276d tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f4698783040>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:44.809448 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a62181d4-7b2c-41db-8a19-03597762276d tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/28aebcaa-7161-4787-aa7c-243ee9edc710" status: 200 len: 662 microversion: 2.1 time: 0.099332 Jul 25 14:40:44.810048 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1689/3579] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:40:44 2022] GET /compute/v2.1/images/28aebcaa-7161-4787-aa7c-243ee9edc710 => generated 662 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:40:44.833951 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3dd9502f-8154-454f-aea2-60fcdabdf223 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f468763e310>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:44.929971 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3dd9502f-8154-454f-aea2-60fcdabdf223 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/28aebcaa-7161-4787-aa7c-243ee9edc710" status: 200 len: 662 microversion: 2.1 time: 0.110137 Jul 25 14:40:44.931557 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1690/3580] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:40:44 2022] GET /compute/v2.1/images/28aebcaa-7161-4787-aa7c-243ee9edc710 => generated 662 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:40:44.984000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-af99afef-e46a-4304-925f-5d644566dec7 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:44.988949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:40:44.996797 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-af99afef-e46a-4304-925f-5d644566dec7 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1308 microversion: 2.1 time: 1.188420 Jul 25 14:40:44.997428 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1891/3581] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:43 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1308 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:45.521230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-db92f40e-3605-44b3-85d9-2863fb38c88e req-48030790-16de-43dd-9456-325e29e2a89b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87914b9f-7d35-4be7-9880-893985843c38", "tag": "58624c25-2a67-47d5-81dc-a87d7c8e6851"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:40:45.552133 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-db92f40e-3605-44b3-85d9-2863fb38c88e req-48030790-16de-43dd-9456-325e29e2a89b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:45.552700 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-db92f40e-3605-44b3-85d9-2863fb38c88e req-48030790-16de-43dd-9456-325e29e2a89b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:45.593555 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-db92f40e-3605-44b3-85d9-2863fb38c88e req-48030790-16de-43dd-9456-325e29e2a89b service nova] Creating event network-changed:58624c25-2a67-47d5-81dc-a87d7c8e6851 for instance 87914b9f-7d35-4be7-9880-893985843c38 on n-h1-846435-14 Jul 25 14:40:45.615289 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-db92f40e-3605-44b3-85d9-2863fb38c88e req-48030790-16de-43dd-9456-325e29e2a89b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093672 Jul 25 14:40:45.616660 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1691/3582] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:40:46.022730 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0085950c-6f3d-4bc6-bdfb-79ad7d7d6091 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:46.023349 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0085950c-6f3d-4bc6-bdfb-79ad7d7d6091 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:46.040966 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0085950c-6f3d-4bc6-bdfb-79ad7d7d6091 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:46.044540 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0085950c-6f3d-4bc6-bdfb-79ad7d7d6091 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:46.045524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0085950c-6f3d-4bc6-bdfb-79ad7d7d6091 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:46.046117 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0085950c-6f3d-4bc6-bdfb-79ad7d7d6091 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:46.473676 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0085950c-6f3d-4bc6-bdfb-79ad7d7d6091 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:46.488543 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0085950c-6f3d-4bc6-bdfb-79ad7d7d6091 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1308 microversion: 2.1 time: 0.465007 Jul 25 14:40:46.489211 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1892/3583] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:46 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1308 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:40:46.780728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7df579e4-f409-40d3-a209-e54eacf84a22 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f4698783430>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:46.863280 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7df579e4-f409-40d3-a209-e54eacf84a22 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/9e65d858-6577-40dc-b561-9cf8bd4dbb81" status: 200 len: 662 microversion: 2.1 time: 0.089148 Jul 25 14:40:46.873198 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1692/3584] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:40:46 2022] GET /compute/v2.1/images/9e65d858-6577-40dc-b561-9cf8bd4dbb81 => generated 662 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:40:46.879496 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6ebb8f9f-2bd4-490a-ad22-d31c7abe4828 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46876caf70>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:46.946397 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6ebb8f9f-2bd4-490a-ad22-d31c7abe4828 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/9e65d858-6577-40dc-b561-9cf8bd4dbb81" status: 200 len: 662 microversion: 2.1 time: 0.070860 Jul 25 14:40:46.948364 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1893/3585] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:40:46 2022] GET /compute/v2.1/images/9e65d858-6577-40dc-b561-9cf8bd4dbb81 => generated 662 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:40:47.511690 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1e45dbe6-2e80-48f3-b891-edb30efaf883 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:47.512513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1e45dbe6-2e80-48f3-b891-edb30efaf883 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:47.533381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e45dbe6-2e80-48f3-b891-edb30efaf883 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:47.534052 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e45dbe6-2e80-48f3-b891-edb30efaf883 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:47.537343 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e45dbe6-2e80-48f3-b891-edb30efaf883 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:47.538662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e45dbe6-2e80-48f3-b891-edb30efaf883 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:48.558682 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:40:49.200406 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:40:49.202005 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:40:49.206865 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9079d6b3-d1fd-427c-87fb-2b1332550236 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f4687f90280>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:49.249121 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1e45dbe6-2e80-48f3-b891-edb30efaf883 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:49.257116 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1e45dbe6-2e80-48f3-b891-edb30efaf883 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1308 microversion: 2.1 time: 1.751370 Jul 25 14:40:49.264094 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1693/3586] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:47 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1308 bytes in 1759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:49.302024 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9079d6b3-d1fd-427c-87fb-2b1332550236 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/0e296b13-5377-4aaf-893e-bcda62adbf25" status: 200 len: 662 microversion: 2.1 time: 0.103018 Jul 25 14:40:49.314614 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1894/3587] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:40:49 2022] GET /compute/v2.1/images/0e296b13-5377-4aaf-893e-bcda62adbf25 => generated 662 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:40:49.318913 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e0a5a2e6-624c-49c5-b746-57135403d573 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46878f3ee0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:49.424576 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e0a5a2e6-624c-49c5-b746-57135403d573 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/0e296b13-5377-4aaf-893e-bcda62adbf25" status: 200 len: 662 microversion: 2.1 time: 0.109603 Jul 25 14:40:49.425262 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1694/3588] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:40:49 2022] GET /compute/v2.1/images/0e296b13-5377-4aaf-893e-bcda62adbf25 => generated 662 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:40:49.623914 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-00f17113-f6d8-4fb3-99ce-6c563e3ced01 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1468385915", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:40:49.713265 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-00f17113-f6d8-4fb3-99ce-6c563e3ced01 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] validate_networks() for None {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:40:50.276745 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-00f17113-f6d8-4fb3-99ce-6c563e3ced01 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:40:50.277409 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-00f17113-f6d8-4fb3-99ce-6c563e3ced01 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:40:50.277631 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-00f17113-f6d8-4fb3-99ce-6c563e3ced01 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:40:50.278040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-00f17113-f6d8-4fb3-99ce-6c563e3ced01 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:40:50.278444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-00f17113-f6d8-4fb3-99ce-6c563e3ced01 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:40:50.279696 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-39a8bd79-fcc1-44ba-97b6-63def9e9f0dd tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:50.280348 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-39a8bd79-fcc1-44ba-97b6-63def9e9f0dd tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:50.299961 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-39a8bd79-fcc1-44ba-97b6-63def9e9f0dd tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:50.301609 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-39a8bd79-fcc1-44ba-97b6-63def9e9f0dd tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:50.302507 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-39a8bd79-fcc1-44ba-97b6-63def9e9f0dd tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:50.302971 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-39a8bd79-fcc1-44ba-97b6-63def9e9f0dd tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:50.303322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-00f17113-f6d8-4fb3-99ce-6c563e3ced01 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:50.310001 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-00f17113-f6d8-4fb3-99ce-6c563e3ced01 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:50.311483 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-00f17113-f6d8-4fb3-99ce-6c563e3ced01 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:50.313398 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-00f17113-f6d8-4fb3-99ce-6c563e3ced01 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:50.383707 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-00f17113-f6d8-4fb3-99ce-6c563e3ced01 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Getting quotas for project b260148f473e420bad9c21f295722f44. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:40:50.410982 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-00f17113-f6d8-4fb3-99ce-6c563e3ced01 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Getting quotas for user f005d58a261b440893daa752858b1ab1 and project b260148f473e420bad9c21f295722f44. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:40:50.471249 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-00f17113-f6d8-4fb3-99ce-6c563e3ced01 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:40:50.493017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-00f17113-f6d8-4fb3-99ce-6c563e3ced01 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: dfb8c05d-0ccc-4b4d-a920-d8238e56f0de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:40:50.752385 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-00f17113-f6d8-4fb3-99ce-6c563e3ced01 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.132432 Jul 25 14:40:50.755087 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1895/3589] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:40:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:40:50.839781 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-da22367a-9b00-4b2e-a405-b87fcd06e8cf tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-886199783", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:40:50.930405 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-da22367a-9b00-4b2e-a405-b87fcd06e8cf tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] validate_networks() for None {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:40:51.026368 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-39a8bd79-fcc1-44ba-97b6-63def9e9f0dd tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:51.035392 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-39a8bd79-fcc1-44ba-97b6-63def9e9f0dd tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1308 microversion: 2.1 time: 0.760479 Jul 25 14:40:51.053644 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1695/3590] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:50 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1308 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:52.059880 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1aebcb52-3652-49dd-9e14-506629dabaa6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:52.063186 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1aebcb52-3652-49dd-9e14-506629dabaa6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:52.083033 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1aebcb52-3652-49dd-9e14-506629dabaa6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:52.086383 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1aebcb52-3652-49dd-9e14-506629dabaa6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:52.087472 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1aebcb52-3652-49dd-9e14-506629dabaa6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:52.088190 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1aebcb52-3652-49dd-9e14-506629dabaa6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:52.257001 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-da22367a-9b00-4b2e-a405-b87fcd06e8cf tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:40:52.258031 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-da22367a-9b00-4b2e-a405-b87fcd06e8cf tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:40:52.258680 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-da22367a-9b00-4b2e-a405-b87fcd06e8cf tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:40:52.259257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-da22367a-9b00-4b2e-a405-b87fcd06e8cf tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:40:52.259915 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-da22367a-9b00-4b2e-a405-b87fcd06e8cf tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:40:52.265643 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:40:52.278751 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-da22367a-9b00-4b2e-a405-b87fcd06e8cf tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:52.279651 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-da22367a-9b00-4b2e-a405-b87fcd06e8cf tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:52.282375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-da22367a-9b00-4b2e-a405-b87fcd06e8cf tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:52.283442 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-da22367a-9b00-4b2e-a405-b87fcd06e8cf tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:52.321137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-da22367a-9b00-4b2e-a405-b87fcd06e8cf tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Getting quotas for project b260148f473e420bad9c21f295722f44. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:40:52.342308 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-da22367a-9b00-4b2e-a405-b87fcd06e8cf tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Getting quotas for user f005d58a261b440893daa752858b1ab1 and project b260148f473e420bad9c21f295722f44. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:40:52.393621 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-da22367a-9b00-4b2e-a405-b87fcd06e8cf tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:40:52.399569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-da22367a-9b00-4b2e-a405-b87fcd06e8cf tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: 794b7eaa-2e72-4ffc-aced-1dfb494e3554] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:40:52.557165 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-da22367a-9b00-4b2e-a405-b87fcd06e8cf tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.719871 Jul 25 14:40:52.559397 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1896/3591] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:40:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:40:52.587295 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a56c6ac5-809e-4077-9a16-53881028f1c1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:52.591063 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a56c6ac5-809e-4077-9a16-53881028f1c1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:52.603995 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a56c6ac5-809e-4077-9a16-53881028f1c1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:52.628863 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a56c6ac5-809e-4077-9a16-53881028f1c1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:52.630301 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a56c6ac5-809e-4077-9a16-53881028f1c1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:52.631822 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a56c6ac5-809e-4077-9a16-53881028f1c1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:52.764260 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a56c6ac5-809e-4077-9a16-53881028f1c1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:40:53.094100 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a56c6ac5-809e-4077-9a16-53881028f1c1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "DELETE /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 204 len: 0 microversion: 2.1 time: 0.522029 Jul 25 14:40:53.100646 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1897/3592] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:40:52 2022] DELETE /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:40:53.145404 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ffb43605-f7dc-45c0-ad8c-2c17206984aa tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:53.148121 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ffb43605-f7dc-45c0-ad8c-2c17206984aa tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: 794b7eaa-2e72-4ffc-aced-1dfb494e3554] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:53.162490 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1aebcb52-3652-49dd-9e14-506629dabaa6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:53.174889 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1aebcb52-3652-49dd-9e14-506629dabaa6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1308 microversion: 2.1 time: 1.119042 Jul 25 14:40:53.178118 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1696/3593] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:52 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1308 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:53.225551 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f58dbd03-8ebd-482e-8fb3-d5f178148d73 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:53.237714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f58dbd03-8ebd-482e-8fb3-d5f178148d73 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:53.267183 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:40:53.281692 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f58dbd03-8ebd-482e-8fb3-d5f178148d73 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:53.285588 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f58dbd03-8ebd-482e-8fb3-d5f178148d73 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:53.286826 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f58dbd03-8ebd-482e-8fb3-d5f178148d73 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:53.287759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f58dbd03-8ebd-482e-8fb3-d5f178148d73 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:53.444736 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ffb43605-f7dc-45c0-ad8c-2c17206984aa tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:53.470331 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ffb43605-f7dc-45c0-ad8c-2c17206984aa tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554" status: 200 len: 1217 microversion: 2.1 time: 0.365176 Jul 25 14:40:53.471295 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1898/3594] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:53 2022] GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554 => generated 1217 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:54.202197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cca26fc0-2205-4f28-a095-5ab11ba0104f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:54.202822 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cca26fc0-2205-4f28-a095-5ab11ba0104f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:54.210198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cca26fc0-2205-4f28-a095-5ab11ba0104f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:54.210649 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cca26fc0-2205-4f28-a095-5ab11ba0104f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:54.211456 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cca26fc0-2205-4f28-a095-5ab11ba0104f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:54.211879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cca26fc0-2205-4f28-a095-5ab11ba0104f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:54.391963 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f58dbd03-8ebd-482e-8fb3-d5f178148d73 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:54.407960 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f58dbd03-8ebd-482e-8fb3-d5f178148d73 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1507 microversion: 2.1 time: 1.211306 Jul 25 14:40:54.408983 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1697/3595] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:53 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1507 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:54.490880 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3f86ba3c-230d-4204-a45d-144b6e2650b0 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:54.492789 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3f86ba3c-230d-4204-a45d-144b6e2650b0 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: 794b7eaa-2e72-4ffc-aced-1dfb494e3554] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:54.503533 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3f86ba3c-230d-4204-a45d-144b6e2650b0 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:54.505586 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3f86ba3c-230d-4204-a45d-144b6e2650b0 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:54.509581 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3f86ba3c-230d-4204-a45d-144b6e2650b0 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:54.510976 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3f86ba3c-230d-4204-a45d-144b6e2650b0 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:54.738012 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3f86ba3c-230d-4204-a45d-144b6e2650b0 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:54.761558 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cca26fc0-2205-4f28-a095-5ab11ba0104f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:54.773625 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cca26fc0-2205-4f28-a095-5ab11ba0104f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1308 microversion: 2.1 time: 0.571848 Jul 25 14:40:54.773952 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3f86ba3c-230d-4204-a45d-144b6e2650b0 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554" status: 200 len: 1277 microversion: 2.1 time: 0.286856 Jul 25 14:40:54.776611 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1698/3596] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:54 2022] GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554 => generated 1277 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:40:54.791379 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1899/3597] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:54 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1308 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:54.798025 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-dcd28671-1531-4ca9-a42b-4dcb004ebee7 req-8ff4aede-40d5-4e17-919e-0cd034af9b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87914b9f-7d35-4be7-9880-893985843c38", "name": "network-vif-plugged", "status": "completed", "tag": "58624c25-2a67-47d5-81dc-a87d7c8e6851"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:40:54.824779 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-dcd28671-1531-4ca9-a42b-4dcb004ebee7 req-8ff4aede-40d5-4e17-919e-0cd034af9b13 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:54.826360 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-dcd28671-1531-4ca9-a42b-4dcb004ebee7 req-8ff4aede-40d5-4e17-919e-0cd034af9b13 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:54.849832 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-dcd28671-1531-4ca9-a42b-4dcb004ebee7 req-8ff4aede-40d5-4e17-919e-0cd034af9b13 service nova] Creating event network-vif-plugged:58624c25-2a67-47d5-81dc-a87d7c8e6851 for instance 87914b9f-7d35-4be7-9880-893985843c38 on n-h1-846435-14 Jul 25 14:40:54.862796 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-dcd28671-1531-4ca9-a42b-4dcb004ebee7 req-8ff4aede-40d5-4e17-919e-0cd034af9b13 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083943 Jul 25 14:40:54.865699 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1699/3598] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:40:55.430294 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7016c9b0-fae8-492f-bb65-9f733452b25d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:55.431499 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7016c9b0-fae8-492f-bb65-9f733452b25d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:55.455352 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7016c9b0-fae8-492f-bb65-9f733452b25d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:55.459110 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7016c9b0-fae8-492f-bb65-9f733452b25d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:55.465230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7016c9b0-fae8-492f-bb65-9f733452b25d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:55.466112 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7016c9b0-fae8-492f-bb65-9f733452b25d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:55.977050 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7016c9b0-fae8-492f-bb65-9f733452b25d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:55.990239 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7016c9b0-fae8-492f-bb65-9f733452b25d tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1507 microversion: 2.1 time: 0.564006 Jul 25 14:40:55.993236 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1900/3599] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:55 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1507 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:56.003603 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5da12bb9-78a8-4e3a-815c-dd601c973073 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:56.005226 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5da12bb9-78a8-4e3a-815c-dd601c973073 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: 794b7eaa-2e72-4ffc-aced-1dfb494e3554] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:56.021548 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6b5318b9-45b4-45c5-8316-243d742ad75b tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Action: 'create', calling method: .version_select at 0x7f4698912820>, body: {"keypair": {"name": "tempest-keypair-1670415063", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBuiPX6rk4oPUe/ypAJz44aimFKt0DZeeupVcuNoFbJ8tfrPxM42JXy5/IXHrMuXLl3Uu5CDoJUJGtoyKRn00NokDRE4vqaBzvrNdT+XT4pj8QjZ2YAuJw/KXcaqzkhxrg=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:40:56.022924 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5da12bb9-78a8-4e3a-815c-dd601c973073 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:56.023112 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5da12bb9-78a8-4e3a-815c-dd601c973073 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:56.027356 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5da12bb9-78a8-4e3a-815c-dd601c973073 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:56.027942 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5da12bb9-78a8-4e3a-815c-dd601c973073 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:56.044568 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-6b5318b9-45b4-45c5-8316-243d742ad75b tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Getting quotas for project 26ee3d3418544f2ea0558abb27b1c796. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:40:56.051609 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-6b5318b9-45b4-45c5-8316-243d742ad75b tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Getting quotas for user c6af371df8364e5b8362add7335ec4f1 and project 26ee3d3418544f2ea0558abb27b1c796. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:40:56.080539 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6b5318b9-45b4-45c5-8316-243d742ad75b tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.345056 Jul 25 14:40:56.082476 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1700/3600] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:40:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:40:56.091283 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-acdb87fa-1260-4d24-bfd6-ff4d63778d40 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:56.096330 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-acdb87fa-1260-4d24-bfd6-ff4d63778d40 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:56.110043 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-acdb87fa-1260-4d24-bfd6-ff4d63778d40 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:56.112693 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-acdb87fa-1260-4d24-bfd6-ff4d63778d40 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:56.113710 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-acdb87fa-1260-4d24-bfd6-ff4d63778d40 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:56.116537 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-acdb87fa-1260-4d24-bfd6-ff4d63778d40 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:56.202080 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5da12bb9-78a8-4e3a-815c-dd601c973073 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:56.217731 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5da12bb9-78a8-4e3a-815c-dd601c973073 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554" status: 200 len: 1275 microversion: 2.1 time: 0.222416 Jul 25 14:40:56.235949 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1901/3601] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:55 2022] GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554 => generated 1275 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:57.019135 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3bb2546f-dc57-4cbc-bdf1-a192394a8fa7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:57.024641 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3bb2546f-dc57-4cbc-bdf1-a192394a8fa7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:57.055368 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3bb2546f-dc57-4cbc-bdf1-a192394a8fa7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:57.056341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3bb2546f-dc57-4cbc-bdf1-a192394a8fa7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:57.057796 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3bb2546f-dc57-4cbc-bdf1-a192394a8fa7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:57.065247 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3bb2546f-dc57-4cbc-bdf1-a192394a8fa7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:57.437606 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3bb2546f-dc57-4cbc-bdf1-a192394a8fa7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:57.449126 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3bb2546f-dc57-4cbc-bdf1-a192394a8fa7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1507 microversion: 2.1 time: 0.438252 Jul 25 14:40:57.449521 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1902/3602] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:57 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1507 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:57.462585 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f13514f8-6762-45e6-8ad0-5e569bc54795 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:57.463261 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f13514f8-6762-45e6-8ad0-5e569bc54795 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: 794b7eaa-2e72-4ffc-aced-1dfb494e3554] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:57.484211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f13514f8-6762-45e6-8ad0-5e569bc54795 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:57.484942 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f13514f8-6762-45e6-8ad0-5e569bc54795 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:57.485747 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f13514f8-6762-45e6-8ad0-5e569bc54795 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:57.486182 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f13514f8-6762-45e6-8ad0-5e569bc54795 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:57.639531 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-acdb87fa-1260-4d24-bfd6-ff4d63778d40 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:57.642653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f13514f8-6762-45e6-8ad0-5e569bc54795 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:57.666976 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-acdb87fa-1260-4d24-bfd6-ff4d63778d40 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1308 microversion: 2.1 time: 1.581831 Jul 25 14:40:57.667422 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f13514f8-6762-45e6-8ad0-5e569bc54795 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554" status: 200 len: 1275 microversion: 2.1 time: 0.216111 Jul 25 14:40:57.670038 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1701/3603] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:56 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1308 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:57.673231 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1903/3604] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:57 2022] GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554 => generated 1275 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:57.691549 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-847f7641-ee19-4add-965e-463381d810ef req-c507582e-28e1-4237-b3ea-a435af86df3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aa9ee0e-2d03-42a5-af94-51275e754256", "name": "network-vif-unplugged", "status": "completed", "tag": "668fe7f1-2c75-49ac-8a6c-9a1ca635424e"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:40:57.702807 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-847f7641-ee19-4add-965e-463381d810ef req-c507582e-28e1-4237-b3ea-a435af86df3b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:57.703577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-847f7641-ee19-4add-965e-463381d810ef req-c507582e-28e1-4237-b3ea-a435af86df3b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:57.722475 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-847f7641-ee19-4add-965e-463381d810ef req-c507582e-28e1-4237-b3ea-a435af86df3b service nova] Creating event network-vif-unplugged:668fe7f1-2c75-49ac-8a6c-9a1ca635424e for instance 5aa9ee0e-2d03-42a5-af94-51275e754256 on n-h2-846435-14 Jul 25 14:40:57.728103 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-847f7641-ee19-4add-965e-463381d810ef req-c507582e-28e1-4237-b3ea-a435af86df3b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041038 Jul 25 14:40:57.733588 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1702/3605] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:40:58.470349 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2cb08b9b-b7a3-432f-9806-be720587d36c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:58.471641 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2cb08b9b-b7a3-432f-9806-be720587d36c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:58.492289 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2cb08b9b-b7a3-432f-9806-be720587d36c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:58.492747 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2cb08b9b-b7a3-432f-9806-be720587d36c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:58.496073 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2cb08b9b-b7a3-432f-9806-be720587d36c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:58.497821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2cb08b9b-b7a3-432f-9806-be720587d36c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:58.630870 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2cb08b9b-b7a3-432f-9806-be720587d36c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:58.646688 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2cb08b9b-b7a3-432f-9806-be720587d36c tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 200 len: 1465 microversion: 2.1 time: 0.180223 Jul 25 14:40:58.650531 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1904/3606] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:58 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 1465 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:40:58.692952 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ec0e7162-dbb6-48ba-9254-1350fe5ac29e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:58.693674 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ec0e7162-dbb6-48ba-9254-1350fe5ac29e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:58.694023 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9fd0d4ca-3460-4af5-a20e-ee0bbaa62851 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:58.694644 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9fd0d4ca-3460-4af5-a20e-ee0bbaa62851 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: 794b7eaa-2e72-4ffc-aced-1dfb494e3554] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:58.703641 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9fd0d4ca-3460-4af5-a20e-ee0bbaa62851 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:58.708569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9fd0d4ca-3460-4af5-a20e-ee0bbaa62851 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:58.709429 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9fd0d4ca-3460-4af5-a20e-ee0bbaa62851 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:58.709878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9fd0d4ca-3460-4af5-a20e-ee0bbaa62851 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:58.710687 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec0e7162-dbb6-48ba-9254-1350fe5ac29e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:58.711147 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec0e7162-dbb6-48ba-9254-1350fe5ac29e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:58.711955 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec0e7162-dbb6-48ba-9254-1350fe5ac29e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:58.712414 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec0e7162-dbb6-48ba-9254-1350fe5ac29e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:58.834181 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9fd0d4ca-3460-4af5-a20e-ee0bbaa62851 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:58.848848 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9fd0d4ca-3460-4af5-a20e-ee0bbaa62851 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554" status: 200 len: 1275 microversion: 2.1 time: 0.154837 Jul 25 14:40:58.850330 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1905/3607] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:58 2022] GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554 => generated 1275 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:40:58.941140 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-a4e64f06-9ab5-490c-a4ef-0861988e705a req-a7db9fce-38dd-40f3-838a-a4530e3cf9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aa9ee0e-2d03-42a5-af94-51275e754256", "name": "network-vif-deleted", "tag": "668fe7f1-2c75-49ac-8a6c-9a1ca635424e"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:40:58.969448 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a4e64f06-9ab5-490c-a4ef-0861988e705a req-a7db9fce-38dd-40f3-838a-a4530e3cf9c9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:58.970153 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a4e64f06-9ab5-490c-a4ef-0861988e705a req-a7db9fce-38dd-40f3-838a-a4530e3cf9c9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:59.001079 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-a4e64f06-9ab5-490c-a4ef-0861988e705a req-a7db9fce-38dd-40f3-838a-a4530e3cf9c9 service nova] Creating event network-vif-deleted:668fe7f1-2c75-49ac-8a6c-9a1ca635424e for instance 5aa9ee0e-2d03-42a5-af94-51275e754256 on n-h2-846435-14 Jul 25 14:40:59.013138 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-a4e64f06-9ab5-490c-a4ef-0861988e705a req-a7db9fce-38dd-40f3-838a-a4530e3cf9c9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077119 Jul 25 14:40:59.014417 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1906/3608] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:40:59.669959 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ec0e7162-dbb6-48ba-9254-1350fe5ac29e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:40:59.674102 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:40:59.680451 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ec0e7162-dbb6-48ba-9254-1350fe5ac29e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1489 microversion: 2.1 time: 0.991800 Jul 25 14:40:59.680976 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8eb73999-e8b5-4aea-bc24-98d65c0c1998 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:59.681702 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8eb73999-e8b5-4aea-bc24-98d65c0c1998 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 5aa9ee0e-2d03-42a5-af94-51275e754256] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:59.681894 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1703/3609] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:58 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1489 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:40:59.702924 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b712814f-abf9-42bc-a5c9-c6c6eb16a58b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-247986223"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:40:59.704092 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8eb73999-e8b5-4aea-bc24-98d65c0c1998 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:59.705394 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8eb73999-e8b5-4aea-bc24-98d65c0c1998 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:59.705995 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b712814f-abf9-42bc-a5c9-c6c6eb16a58b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:59.706971 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8eb73999-e8b5-4aea-bc24-98d65c0c1998 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:59.709410 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8eb73999-e8b5-4aea-bc24-98d65c0c1998 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:59.715519 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b712814f-abf9-42bc-a5c9-c6c6eb16a58b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:59.716074 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b712814f-abf9-42bc-a5c9-c6c6eb16a58b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:59.717481 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b712814f-abf9-42bc-a5c9-c6c6eb16a58b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:59.717862 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b712814f-abf9-42bc-a5c9-c6c6eb16a58b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:59.756146 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-8eb73999-e8b5-4aea-bc24-98d65c0c1998 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] HTTP exception thrown: Instance 5aa9ee0e-2d03-42a5-af94-51275e754256 could not be found. Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8eb73999-e8b5-4aea-bc24-98d65c0c1998 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Request method failure captured: Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 HTTP/1.1 Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qojWgWRzNqcoFtbKX69HP8TMfJcvgq5mROxrtiAbTRQQhODI65548klI2mwspV0aDgelkydSdF0jDfbt9K1MKvAqBkxkDKwdPBnneXznLL8230WZKLHZUg-qMlSHwLMR2RP6Be2wdwzhEY6xsA-ygO39xLQI8y2VkgTqIORhZUeWIM Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 2f1bd935e917484799f31ad643eafb2a Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-756792154 Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2f1bd935e917484799f31ad643eafb2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2f1bd935e917484799f31ad643eafb2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2f1bd935e917484799f31ad643eafb2a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2f1bd935e917484799f31ad643eafb2a"}]}] Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerRescueNegativeTestJSON-756792154 Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 2f1bd935e917484799f31ad643eafb2a Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-756792154 Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerRescueNegativeTestJSON-756792154-project Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 9f2ddec1bc6244739e9ac3a40c064b53 Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerRescueNegativeTestJSON-756792154-project Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 5aa9ee0e-2d03-42a5-af94-51275e754256 could not be found. Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '5aa9ee0e-2d03-42a5-af94-51275e754256'} Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5aa9ee0e-2d03-42a5-af94-51275e754256 could not be found. Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5aa9ee0e-2d03-42a5-af94-51275e754256 could not be found. Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:40:59.758319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:59.763954 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:40:59.763954 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:40:59.763954 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:40:59.763954 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:40:59.763954 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:40:59.763954 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5aa9ee0e-2d03-42a5-af94-51275e754256 could not be found. Jul 25 14:40:59.763954 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:40:59.763954 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8eb73999-e8b5-4aea-bc24-98d65c0c1998 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Returning 404 to user: Instance 5aa9ee0e-2d03-42a5-af94-51275e754256 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:40:59.774403 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8eb73999-e8b5-4aea-bc24-98d65c0c1998 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256" status: 404 len: 111 microversion: 2.1 time: 0.089977 Jul 25 14:40:59.776574 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1907/3610] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:59 2022] GET /compute/v2.1/servers/5aa9ee0e-2d03-42a5-af94-51275e754256 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:40:59.789037 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-eb67b807-779c-4b0e-84df-fff7873dfae6 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:59.789772 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-eb67b807-779c-4b0e-84df-fff7873dfae6 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:59.802411 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eb67b807-779c-4b0e-84df-fff7873dfae6 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:59.803194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eb67b807-779c-4b0e-84df-fff7873dfae6 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:59.804327 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eb67b807-779c-4b0e-84df-fff7873dfae6 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:59.804947 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eb67b807-779c-4b0e-84df-fff7873dfae6 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:59.852053 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-eb67b807-779c-4b0e-84df-fff7873dfae6 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:40:59.870566 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b712814f-abf9-42bc-a5c9-c6c6eb16a58b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "PUT /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1074 microversion: 2.1 time: 0.173064 Jul 25 14:40:59.872377 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1704/3611] 10.222.0.88 () {60 vars in 1256 bytes} [Mon Jul 25 14:40:59 2022] PUT /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1074 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:40:59.889261 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c9b344d5-425d-4fe1-bcd2-e329954f33c1 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:59.890659 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c9b344d5-425d-4fe1-bcd2-e329954f33c1 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: 794b7eaa-2e72-4ffc-aced-1dfb494e3554] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:59.900110 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c9b344d5-425d-4fe1-bcd2-e329954f33c1 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:59.900670 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c9b344d5-425d-4fe1-bcd2-e329954f33c1 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:59.901563 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c9b344d5-425d-4fe1-bcd2-e329954f33c1 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:59.902091 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c9b344d5-425d-4fe1-bcd2-e329954f33c1 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:59.976982 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-eb67b807-779c-4b0e-84df-fff7873dfae6 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "DELETE /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 204 len: 0 microversion: 2.1 time: 0.193564 Jul 25 14:40:59.977702 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1908/3612] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:40:59 2022] DELETE /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:40:59.986458 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a0ecab1c-607d-4c17-aec5-d316ade581f2 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:40:59.987417 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a0ecab1c-607d-4c17-aec5-d316ade581f2 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:40:59.997066 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a0ecab1c-607d-4c17-aec5-d316ade581f2 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:59.997585 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a0ecab1c-607d-4c17-aec5-d316ade581f2 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:40:59.998311 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a0ecab1c-607d-4c17-aec5-d316ade581f2 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:40:59.998807 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a0ecab1c-607d-4c17-aec5-d316ade581f2 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:00.296236 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a0ecab1c-607d-4c17-aec5-d316ade581f2 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:00.308361 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a0ecab1c-607d-4c17-aec5-d316ade581f2 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1500 microversion: 2.1 time: 0.328100 Jul 25 14:41:00.313118 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1909/3613] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:59 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1500 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:00.318684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8c5abea8-4d3d-4599-bad6-096a8e588062 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:00.319306 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8c5abea8-4d3d-4599-bad6-096a8e588062 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:00.327919 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8c5abea8-4d3d-4599-bad6-096a8e588062 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:00.328527 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8c5abea8-4d3d-4599-bad6-096a8e588062 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:00.329181 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8c5abea8-4d3d-4599-bad6-096a8e588062 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:00.329649 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8c5abea8-4d3d-4599-bad6-096a8e588062 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:00.488443 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c9b344d5-425d-4fe1-bcd2-e329954f33c1 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:00.504344 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c9b344d5-425d-4fe1-bcd2-e329954f33c1 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554" status: 200 len: 1275 microversion: 2.1 time: 0.628763 Jul 25 14:41:00.506231 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1705/3614] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:40:59 2022] GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554 => generated 1275 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:00.531623 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-caa65f68-cd03-457a-b1d1-a5d081ce6579 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:00.533124 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-caa65f68-cd03-457a-b1d1-a5d081ce6579 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:00.544188 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-caa65f68-cd03-457a-b1d1-a5d081ce6579 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:00.545053 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-caa65f68-cd03-457a-b1d1-a5d081ce6579 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:00.549519 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-caa65f68-cd03-457a-b1d1-a5d081ce6579 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:00.550251 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-caa65f68-cd03-457a-b1d1-a5d081ce6579 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:00.609279 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8c5abea8-4d3d-4599-bad6-096a8e588062 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:00.619421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:41:00.623793 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8c5abea8-4d3d-4599-bad6-096a8e588062 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1521 microversion: 2.1 time: 0.309008 Jul 25 14:41:00.625011 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1910/3615] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:00 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:01.313702 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-caa65f68-cd03-457a-b1d1-a5d081ce6579 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:01.328614 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-caa65f68-cd03-457a-b1d1-a5d081ce6579 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1500 microversion: 2.1 time: 0.819603 Jul 25 14:41:01.329529 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1706/3616] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:00 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1500 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:01.355566 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-99897c53-e562-41df-b27f-6042e1099487 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:01.371871 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-99897c53-e562-41df-b27f-6042e1099487 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:01.372622 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-99897c53-e562-41df-b27f-6042e1099487 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:01.428354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-99897c53-e562-41df-b27f-6042e1099487 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Going to try to stop instance {{(pid=119304) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 14:41:01.522750 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-99897c53-e562-41df-b27f-6042e1099487 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "POST /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38/action" status: 202 len: 0 microversion: 2.1 time: 0.172112 Jul 25 14:41:01.523816 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1911/3617] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:41:01 2022] POST /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:41:01.530095 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cf42ba59-4c03-44c5-a9c1-bde29362dbe6 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:01.531086 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cf42ba59-4c03-44c5-a9c1-bde29362dbe6 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: 794b7eaa-2e72-4ffc-aced-1dfb494e3554] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:01.531844 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-26cfc6a9-b956-4ccd-a68b-7b3036f661d5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:01.535336 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-26cfc6a9-b956-4ccd-a68b-7b3036f661d5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:01.546177 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf42ba59-4c03-44c5-a9c1-bde29362dbe6 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:01.548487 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf42ba59-4c03-44c5-a9c1-bde29362dbe6 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:01.549700 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf42ba59-4c03-44c5-a9c1-bde29362dbe6 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:01.550066 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26cfc6a9-b956-4ccd-a68b-7b3036f661d5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:01.550487 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26cfc6a9-b956-4ccd-a68b-7b3036f661d5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:01.551248 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26cfc6a9-b956-4ccd-a68b-7b3036f661d5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:01.553413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26cfc6a9-b956-4ccd-a68b-7b3036f661d5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:01.554235 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf42ba59-4c03-44c5-a9c1-bde29362dbe6 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:02.296449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-26cfc6a9-b956-4ccd-a68b-7b3036f661d5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:02.300504 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=4 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:41:02.312314 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-26cfc6a9-b956-4ccd-a68b-7b3036f661d5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1510 microversion: 2.1 time: 0.784370 Jul 25 14:41:02.313871 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1912/3618] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:01 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1510 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:41:02.330451 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7d514aff-3792-4809-a058-3902cfe879d1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:02.331325 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7d514aff-3792-4809-a058-3902cfe879d1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:02.351847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d514aff-3792-4809-a058-3902cfe879d1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:02.353932 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d514aff-3792-4809-a058-3902cfe879d1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:02.364714 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d514aff-3792-4809-a058-3902cfe879d1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:02.372755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d514aff-3792-4809-a058-3902cfe879d1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:02.623616 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cf42ba59-4c03-44c5-a9c1-bde29362dbe6 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:02.634186 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cf42ba59-4c03-44c5-a9c1-bde29362dbe6 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554" status: 200 len: 1317 microversion: 2.1 time: 1.108449 Jul 25 14:41:02.638523 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1707/3619] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:01 2022] GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554 => generated 1317 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:02.942463 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7d514aff-3792-4809-a058-3902cfe879d1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:02.956026 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7d514aff-3792-4809-a058-3902cfe879d1 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1521 microversion: 2.1 time: 0.639900 Jul 25 14:41:02.956906 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1913/3620] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:02 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1521 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:03.334069 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2993ff1f-2da7-4076-a7c9-e9efcc963b5d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:03.334979 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2993ff1f-2da7-4076-a7c9-e9efcc963b5d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:03.351228 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2993ff1f-2da7-4076-a7c9-e9efcc963b5d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:03.355925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2993ff1f-2da7-4076-a7c9-e9efcc963b5d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:03.357392 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2993ff1f-2da7-4076-a7c9-e9efcc963b5d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:03.358018 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2993ff1f-2da7-4076-a7c9-e9efcc963b5d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:03.657914 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bfae7c79-a10b-4c03-881f-5d98fa339235 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:03.658541 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bfae7c79-a10b-4c03-881f-5d98fa339235 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: 794b7eaa-2e72-4ffc-aced-1dfb494e3554] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:03.662536 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=14 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:41:03.666455 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bfae7c79-a10b-4c03-881f-5d98fa339235 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:03.666934 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bfae7c79-a10b-4c03-881f-5d98fa339235 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:03.667711 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bfae7c79-a10b-4c03-881f-5d98fa339235 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:03.668203 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bfae7c79-a10b-4c03-881f-5d98fa339235 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:03.898783 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bfae7c79-a10b-4c03-881f-5d98fa339235 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:03.907017 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bfae7c79-a10b-4c03-881f-5d98fa339235 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554" status: 200 len: 1317 microversion: 2.1 time: 0.253211 Jul 25 14:41:03.913219 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1914/3621] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:03 2022] GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554 => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:03.977475 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-09d246c7-a5c4-4bfb-a35c-1cb1e2732817 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:03.978427 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-09d246c7-a5c4-4bfb-a35c-1cb1e2732817 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:03.988132 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09d246c7-a5c4-4bfb-a35c-1cb1e2732817 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:03.989676 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09d246c7-a5c4-4bfb-a35c-1cb1e2732817 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:03.992116 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09d246c7-a5c4-4bfb-a35c-1cb1e2732817 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:03.994249 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09d246c7-a5c4-4bfb-a35c-1cb1e2732817 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:04.280554 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-09d246c7-a5c4-4bfb-a35c-1cb1e2732817 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:04.294159 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-09d246c7-a5c4-4bfb-a35c-1cb1e2732817 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1521 microversion: 2.1 time: 0.320602 Jul 25 14:41:04.296251 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1915/3622] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:03 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:04.871436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-23ef5fdc-5fdf-49c1-bf3e-5f36a625b441 req-4359dbb9-9bf4-4fb5-9916-caacda65c98e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfb8c05d-0ccc-4b4d-a920-d8238e56f0de", "tag": "78158429-4b1a-4039-9efe-77450874ee04"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:04.908197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-23ef5fdc-5fdf-49c1-bf3e-5f36a625b441 req-4359dbb9-9bf4-4fb5-9916-caacda65c98e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:04.908933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-23ef5fdc-5fdf-49c1-bf3e-5f36a625b441 req-4359dbb9-9bf4-4fb5-9916-caacda65c98e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:04.924739 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-23ef5fdc-5fdf-49c1-bf3e-5f36a625b441 req-4359dbb9-9bf4-4fb5-9916-caacda65c98e service nova] Creating event network-changed:78158429-4b1a-4039-9efe-77450874ee04 for instance dfb8c05d-0ccc-4b4d-a920-d8238e56f0de on n-h2-846435-14 Jul 25 14:41:04.940293 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-23ef5fdc-5fdf-49c1-bf3e-5f36a625b441 req-4359dbb9-9bf4-4fb5-9916-caacda65c98e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078979 Jul 25 14:41:04.943099 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1916/3623] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:41:04.957744 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1567a8de-3ff4-43a7-8566-d6648401cb09 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:04.958813 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1567a8de-3ff4-43a7-8566-d6648401cb09 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: 794b7eaa-2e72-4ffc-aced-1dfb494e3554] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:04.972596 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1567a8de-3ff4-43a7-8566-d6648401cb09 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:04.973378 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1567a8de-3ff4-43a7-8566-d6648401cb09 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:04.974467 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1567a8de-3ff4-43a7-8566-d6648401cb09 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:04.975106 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1567a8de-3ff4-43a7-8566-d6648401cb09 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:05.267036 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1567a8de-3ff4-43a7-8566-d6648401cb09 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:05.285114 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1567a8de-3ff4-43a7-8566-d6648401cb09 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554" status: 200 len: 1317 microversion: 2.1 time: 0.340425 Jul 25 14:41:05.285722 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1917/3624] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:04 2022] GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554 => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:05.321736 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2ac4260c-4d77-4faf-b4c9-7ba78e733f05 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:05.322647 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2ac4260c-4d77-4faf-b4c9-7ba78e733f05 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:05.331607 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2ac4260c-4d77-4faf-b4c9-7ba78e733f05 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:05.333417 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2ac4260c-4d77-4faf-b4c9-7ba78e733f05 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:05.335873 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2ac4260c-4d77-4faf-b4c9-7ba78e733f05 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:05.338416 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2ac4260c-4d77-4faf-b4c9-7ba78e733f05 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:05.534513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2993ff1f-2da7-4076-a7c9-e9efcc963b5d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:05.554210 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2993ff1f-2da7-4076-a7c9-e9efcc963b5d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1510 microversion: 2.1 time: 2.224679 Jul 25 14:41:05.559444 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1708/3625] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:03 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1510 bytes in 2230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:05.608377 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2ac4260c-4d77-4faf-b4c9-7ba78e733f05 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:05.617390 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2ac4260c-4d77-4faf-b4c9-7ba78e733f05 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1521 microversion: 2.1 time: 0.300029 Jul 25 14:41:05.619683 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1918/3626] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:05 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:06.234002 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cf6ded6c-8ef9-4942-a44d-0be09f0cf77e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1587106524", "imageRef": "88dfd0c0-cf4f-47a9-822d-69524f8d9e6c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "2809b163-5bb0-4401-8938-46ba6dee5997"}], "security_groups": [{"name": "tempest-securitygroup--1143163988"}], "key_name": "tempest-keypair-1670415063", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:06.250329 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:41:06.307621 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a7626945-7951-402a-9dac-283fe11199a8 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:06.308259 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a7626945-7951-402a-9dac-283fe11199a8 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: 794b7eaa-2e72-4ffc-aced-1dfb494e3554] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:06.327035 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a7626945-7951-402a-9dac-283fe11199a8 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:06.327454 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a7626945-7951-402a-9dac-283fe11199a8 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:06.328273 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a7626945-7951-402a-9dac-283fe11199a8 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:06.328708 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a7626945-7951-402a-9dac-283fe11199a8 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:06.633269 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a7626945-7951-402a-9dac-283fe11199a8 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:06.649685 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a7626945-7951-402a-9dac-283fe11199a8 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554" status: 200 len: 1317 microversion: 2.1 time: 0.345847 Jul 25 14:41:06.666684 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1919/3627] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:06 2022] GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554 => generated 1317 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:06.672714 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e38ceb62-afe5-410d-8357-24adfcbcaae8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:06.673714 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e38ceb62-afe5-410d-8357-24adfcbcaae8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:06.682832 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e38ceb62-afe5-410d-8357-24adfcbcaae8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:06.684185 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e38ceb62-afe5-410d-8357-24adfcbcaae8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:06.686045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e38ceb62-afe5-410d-8357-24adfcbcaae8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:06.687229 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e38ceb62-afe5-410d-8357-24adfcbcaae8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:06.924201 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e38ceb62-afe5-410d-8357-24adfcbcaae8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:06.935722 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e38ceb62-afe5-410d-8357-24adfcbcaae8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1510 microversion: 2.1 time: 0.267420 Jul 25 14:41:06.936622 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1920/3628] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:06 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1510 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:06.955658 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1f3beca7-8aee-4d44-b86d-cd0c794146b7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:06.958506 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1f3beca7-8aee-4d44-b86d-cd0c794146b7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:06.986779 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1f3beca7-8aee-4d44-b86d-cd0c794146b7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:06.987323 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1f3beca7-8aee-4d44-b86d-cd0c794146b7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:06.988795 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1f3beca7-8aee-4d44-b86d-cd0c794146b7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:06.989405 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1f3beca7-8aee-4d44-b86d-cd0c794146b7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:07.150739 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1f3beca7-8aee-4d44-b86d-cd0c794146b7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2ddec1bc6244739e9ac3a40c064b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1bd935e917484799f31ad643eafb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:07.164728 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1f3beca7-8aee-4d44-b86d-cd0c794146b7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 200 len: 1479 microversion: 2.1 time: 0.218028 Jul 25 14:41:07.167845 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1921/3629] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:06 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 1479 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:07.177934 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-7f3d1b00-1019-4e8b-95fc-7ebc8d4563e8 req-a2b26d3f-9440-4379-9869-aa8d2eb9787b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d3dd486-7c28-4d5a-a177-3f14739f3abc", "name": "network-vif-deleted", "tag": "7ffa8887-a294-4e02-abb3-6f1ef72307ba"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:07.189837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-cf6ded6c-8ef9-4942-a44d-0be09f0cf77e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] validate_networks() for [('2809b163-5bb0-4401-8938-46ba6dee5997', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:41:07.206536 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-7f3d1b00-1019-4e8b-95fc-7ebc8d4563e8 req-a2b26d3f-9440-4379-9869-aa8d2eb9787b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:07.208057 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-7f3d1b00-1019-4e8b-95fc-7ebc8d4563e8 req-a2b26d3f-9440-4379-9869-aa8d2eb9787b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:07.238447 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-7f3d1b00-1019-4e8b-95fc-7ebc8d4563e8 req-a2b26d3f-9440-4379-9869-aa8d2eb9787b service nova] Creating event network-vif-deleted:7ffa8887-a294-4e02-abb3-6f1ef72307ba for instance 9d3dd486-7c28-4d5a-a177-3f14739f3abc on n-h1-846435-14 Jul 25 14:41:07.245241 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-7f3d1b00-1019-4e8b-95fc-7ebc8d4563e8 req-a2b26d3f-9440-4379-9869-aa8d2eb9787b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074465 Jul 25 14:41:07.247200 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1922/3630] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:41:07.673958 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cc1ec92e-3a95-4a81-bcf5-c0042453463c tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:07.675609 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cc1ec92e-3a95-4a81-bcf5-c0042453463c tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: 794b7eaa-2e72-4ffc-aced-1dfb494e3554] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:07.720768 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cc1ec92e-3a95-4a81-bcf5-c0042453463c tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:07.721660 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cc1ec92e-3a95-4a81-bcf5-c0042453463c tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:07.723305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cc1ec92e-3a95-4a81-bcf5-c0042453463c tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:07.725788 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cc1ec92e-3a95-4a81-bcf5-c0042453463c tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:08.101619 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cc1ec92e-3a95-4a81-bcf5-c0042453463c tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:08.113307 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cc1ec92e-3a95-4a81-bcf5-c0042453463c tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554" status: 200 len: 1317 microversion: 2.1 time: 0.445783 Jul 25 14:41:08.114115 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1923/3631] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:07 2022] GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554 => generated 1317 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:41:08.249194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b68cf2d5-e507-44b4-8858-36af257223c0 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-738172290", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "277c0bed-634f-4653-a9c9-14be12bc4b14"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:08.322842 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-b68cf2d5-e507-44b4-8858-36af257223c0 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] validate_networks() for [('277c0bed-634f-4653-a9c9-14be12bc4b14', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:41:08.655963 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-cf6ded6c-8ef9-4942-a44d-0be09f0cf77e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:41:08.656533 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-cf6ded6c-8ef9-4942-a44d-0be09f0cf77e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:41:08.657242 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-cf6ded6c-8ef9-4942-a44d-0be09f0cf77e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:41:08.657982 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-cf6ded6c-8ef9-4942-a44d-0be09f0cf77e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:41:08.658402 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-cf6ded6c-8ef9-4942-a44d-0be09f0cf77e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:41:08.681850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf6ded6c-8ef9-4942-a44d-0be09f0cf77e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:08.684532 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf6ded6c-8ef9-4942-a44d-0be09f0cf77e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:08.686558 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf6ded6c-8ef9-4942-a44d-0be09f0cf77e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:08.687023 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf6ded6c-8ef9-4942-a44d-0be09f0cf77e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:08.720795 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-cf6ded6c-8ef9-4942-a44d-0be09f0cf77e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Getting quotas for project 26ee3d3418544f2ea0558abb27b1c796. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:41:08.729435 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-cf6ded6c-8ef9-4942-a44d-0be09f0cf77e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Getting quotas for user c6af371df8364e5b8362add7335ec4f1 and project 26ee3d3418544f2ea0558abb27b1c796. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:41:08.761758 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cf6ded6c-8ef9-4942-a44d-0be09f0cf77e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:41:08.765715 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cf6ded6c-8ef9-4942-a44d-0be09f0cf77e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88dfd0c0-cf4f-47a9-822d-69524f8d9e6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:41:08.838798 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cf6ded6c-8ef9-4942-a44d-0be09f0cf77e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.614104 Jul 25 14:41:08.840038 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1709/3632] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:41:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 2617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:41:08.844804 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-330216e8-f3d6-4be6-ba36-26943ef1fafe tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:08.845492 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-330216e8-f3d6-4be6-ba36-26943ef1fafe tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:08.855394 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-330216e8-f3d6-4be6-ba36-26943ef1fafe tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:08.856741 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-330216e8-f3d6-4be6-ba36-26943ef1fafe tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:08.858016 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-330216e8-f3d6-4be6-ba36-26943ef1fafe tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:08.858723 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-330216e8-f3d6-4be6-ba36-26943ef1fafe tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:09.027997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-330216e8-f3d6-4be6-ba36-26943ef1fafe tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:09.037124 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-330216e8-f3d6-4be6-ba36-26943ef1fafe tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1510 microversion: 2.1 time: 0.195953 Jul 25 14:41:09.038652 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1710/3633] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:08 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1510 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:09.044320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5b99c4d1-aeff-403c-a7ff-b59da6a29df7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:09.045320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5b99c4d1-aeff-403c-a7ff-b59da6a29df7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] [instance: 9d3dd486-7c28-4d5a-a177-3f14739f3abc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:09.052872 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5b99c4d1-aeff-403c-a7ff-b59da6a29df7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:09.053748 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5b99c4d1-aeff-403c-a7ff-b59da6a29df7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:09.054777 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5b99c4d1-aeff-403c-a7ff-b59da6a29df7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:09.055289 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5b99c4d1-aeff-403c-a7ff-b59da6a29df7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:09.071146 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-5b99c4d1-aeff-403c-a7ff-b59da6a29df7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] HTTP exception thrown: Instance 9d3dd486-7c28-4d5a-a177-3f14739f3abc could not be found. Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5b99c4d1-aeff-403c-a7ff-b59da6a29df7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Request method failure captured: Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc HTTP/1.1 Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qojWgWRzNqcoFtbKX69HP8TMfJcvgq5mROxrtiAbTRQQhODI65548klI2mwspV0aDgelkydSdF0jDfbt9K1MKvAqBkxkDKwdPBnneXznLL8230WZKLHZUg-qMlSHwLMR2RP6Be2wdwzhEY6xsA-ygO39xLQI8y2VkgTqIORhZUeWIM Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 2f1bd935e917484799f31ad643eafb2a Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-756792154 Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2f1bd935e917484799f31ad643eafb2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/2f1bd935e917484799f31ad643eafb2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_2f1bd935e917484799f31ad643eafb2a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/2f1bd935e917484799f31ad643eafb2a"}]}] Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServerRescueNegativeTestJSON-756792154 Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 2f1bd935e917484799f31ad643eafb2a Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-756792154 Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServerRescueNegativeTestJSON-756792154-project Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 9f2ddec1bc6244739e9ac3a40c064b53 Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServerRescueNegativeTestJSON-756792154-project Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 9d3dd486-7c28-4d5a-a177-3f14739f3abc could not be found. Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '9d3dd486-7c28-4d5a-a177-3f14739f3abc'} Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d3dd486-7c28-4d5a-a177-3f14739f3abc could not be found. Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d3dd486-7c28-4d5a-a177-3f14739f3abc could not be found. Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:09.073299 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:41:09.078863 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:09.078863 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:09.078863 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:09.078863 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:41:09.078863 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:41:09.078863 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d3dd486-7c28-4d5a-a177-3f14739f3abc could not be found. Jul 25 14:41:09.078863 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:41:09.081418 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5b99c4d1-aeff-403c-a7ff-b59da6a29df7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] Returning 404 to user: Instance 9d3dd486-7c28-4d5a-a177-3f14739f3abc could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:41:09.082587 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5b99c4d1-aeff-403c-a7ff-b59da6a29df7 tempest-ServerRescueNegativeTestJSON-756792154 tempest-ServerRescueNegativeTestJSON-756792154-project] 10.222.0.88 "GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc" status: 404 len: 111 microversion: 2.1 time: 0.042756 Jul 25 14:41:09.083799 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1711/3634] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:09 2022] GET /compute/v2.1/servers/9d3dd486-7c28-4d5a-a177-3f14739f3abc => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:41:09.185409 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c0e706d3-c2bd-47e0-90c3-5e90665d3565 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1854017697", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "e81cd55f-4951-41ed-b82a-173584e324cb"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:09.253807 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-c0e706d3-c2bd-47e0-90c3-5e90665d3565 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] validate_networks() for [('e81cd55f-4951-41ed-b82a-173584e324cb', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:41:09.424775 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-b68cf2d5-e507-44b4-8858-36af257223c0 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:41:09.425840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-b68cf2d5-e507-44b4-8858-36af257223c0 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:41:09.426488 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-b68cf2d5-e507-44b4-8858-36af257223c0 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:41:09.427095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-b68cf2d5-e507-44b4-8858-36af257223c0 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:41:09.427671 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-b68cf2d5-e507-44b4-8858-36af257223c0 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:41:09.457708 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b68cf2d5-e507-44b4-8858-36af257223c0 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:09.458125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b68cf2d5-e507-44b4-8858-36af257223c0 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:09.459056 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b68cf2d5-e507-44b4-8858-36af257223c0 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:09.459554 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b68cf2d5-e507-44b4-8858-36af257223c0 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:09.513133 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-b68cf2d5-e507-44b4-8858-36af257223c0 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Getting quotas for project 0b5a1b4a12604e58b538b2b27dc63894. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:41:09.523587 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-b68cf2d5-e507-44b4-8858-36af257223c0 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Getting quotas for user d7c9b242dbcd4d169f8c1d5349f207cc and project 0b5a1b4a12604e58b538b2b27dc63894. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:41:09.541677 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b68cf2d5-e507-44b4-8858-36af257223c0 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:41:09.558956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b68cf2d5-e507-44b4-8858-36af257223c0 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] [instance: cf91c15b-9ab5-4155-a405-e74dc6536168] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:41:09.643474 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b68cf2d5-e507-44b4-8858-36af257223c0 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.527970 Jul 25 14:41:09.653149 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1924/3635] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:41:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:41:09.658690 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1bcbc341-b883-4bb4-8c15-61398b0bdc8e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:09.667137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1bcbc341-b883-4bb4-8c15-61398b0bdc8e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:09.722808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:41:09.874419 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1bcbc341-b883-4bb4-8c15-61398b0bdc8e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6af371df8364e5b8362add7335ec4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee3d3418544f2ea0558abb27b1c796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:09.881664 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1bcbc341-b883-4bb4-8c15-61398b0bdc8e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da" status: 200 len: 1246 microversion: 2.1 time: 0.227089 Jul 25 14:41:09.882258 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1925/3636] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:09 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da => generated 1246 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:09.895447 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-659d3433-140e-4bce-a2ed-eeea67bc3204 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:09.908718 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-659d3433-140e-4bce-a2ed-eeea67bc3204 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: 794b7eaa-2e72-4ffc-aced-1dfb494e3554] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:09.944466 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-659d3433-140e-4bce-a2ed-eeea67bc3204 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:09.945057 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-659d3433-140e-4bce-a2ed-eeea67bc3204 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:09.945903 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-659d3433-140e-4bce-a2ed-eeea67bc3204 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:09.946342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-659d3433-140e-4bce-a2ed-eeea67bc3204 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:10.331190 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-c0e706d3-c2bd-47e0-90c3-5e90665d3565 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:41:10.332919 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-c0e706d3-c2bd-47e0-90c3-5e90665d3565 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:41:10.333604 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-c0e706d3-c2bd-47e0-90c3-5e90665d3565 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:41:10.334561 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-c0e706d3-c2bd-47e0-90c3-5e90665d3565 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:41:10.335410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-c0e706d3-c2bd-47e0-90c3-5e90665d3565 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:41:10.357142 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-659d3433-140e-4bce-a2ed-eeea67bc3204 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:10.359099 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c0e706d3-c2bd-47e0-90c3-5e90665d3565 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:10.361697 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c0e706d3-c2bd-47e0-90c3-5e90665d3565 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:10.365223 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c0e706d3-c2bd-47e0-90c3-5e90665d3565 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:10.367131 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c0e706d3-c2bd-47e0-90c3-5e90665d3565 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:10.397181 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-659d3433-140e-4bce-a2ed-eeea67bc3204 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554" status: 200 len: 1317 microversion: 2.1 time: 0.507440 Jul 25 14:41:10.399722 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1926/3637] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:09 2022] GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554 => generated 1317 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:10.470274 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-c0e706d3-c2bd-47e0-90c3-5e90665d3565 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Getting quotas for project b9b1c620d0b14a3a9471515cf47d6944. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:41:10.494182 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-c0e706d3-c2bd-47e0-90c3-5e90665d3565 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Getting quotas for user 33f992249063495c8bf12954afd9e8b7 and project b9b1c620d0b14a3a9471515cf47d6944. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:41:10.541392 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c0e706d3-c2bd-47e0-90c3-5e90665d3565 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:41:10.554056 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c0e706d3-c2bd-47e0-90c3-5e90665d3565 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 86d15cd4-fd8d-43ac-a471-6c7c19f778f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:41:10.592862 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-b5a08f1f-9e18-42ee-9c8f-627c3adf2297 req-5d577340-af15-46fc-8a0e-f3f7f5fdb5eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "794b7eaa-2e72-4ffc-aced-1dfb494e3554", "tag": "ee5f6577-aca1-4c54-8d5b-962c392fa674"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:10.615835 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-b5a08f1f-9e18-42ee-9c8f-627c3adf2297 req-5d577340-af15-46fc-8a0e-f3f7f5fdb5eb service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:10.631199 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-b5a08f1f-9e18-42ee-9c8f-627c3adf2297 req-5d577340-af15-46fc-8a0e-f3f7f5fdb5eb service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:10.672033 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c0e706d3-c2bd-47e0-90c3-5e90665d3565 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.586807 Jul 25 14:41:10.673453 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1712/3638] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:41:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:41:10.678694 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c011f3ad-583d-4fcc-a219-d1a4f4919961 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:10.682107 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-b5a08f1f-9e18-42ee-9c8f-627c3adf2297 req-5d577340-af15-46fc-8a0e-f3f7f5fdb5eb service nova] Creating event network-changed:ee5f6577-aca1-4c54-8d5b-962c392fa674 for instance 794b7eaa-2e72-4ffc-aced-1dfb494e3554 on n-h1-846435-14 Jul 25 14:41:10.683380 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c011f3ad-583d-4fcc-a219-d1a4f4919961 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] [instance: cf91c15b-9ab5-4155-a405-e74dc6536168] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:10.706697 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-b5a08f1f-9e18-42ee-9c8f-627c3adf2297 req-5d577340-af15-46fc-8a0e-f3f7f5fdb5eb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.301504 Jul 25 14:41:10.708099 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1927/3639] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:41:10.759885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bb7f7f44-010e-4579-a879-eab7b1eb0878 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:10.761762 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bb7f7f44-010e-4579-a879-eab7b1eb0878 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:10.779797 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bb7f7f44-010e-4579-a879-eab7b1eb0878 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:10.780562 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bb7f7f44-010e-4579-a879-eab7b1eb0878 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:10.781884 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bb7f7f44-010e-4579-a879-eab7b1eb0878 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:10.786902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bb7f7f44-010e-4579-a879-eab7b1eb0878 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:11.021876 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c011f3ad-583d-4fcc-a219-d1a4f4919961 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9b242dbcd4d169f8c1d5349f207cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5a1b4a12604e58b538b2b27dc63894', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:11.029881 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c011f3ad-583d-4fcc-a219-d1a4f4919961 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] 10.222.0.88 "GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168" status: 200 len: 1227 microversion: 2.1 time: 0.354408 Jul 25 14:41:11.045926 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1713/3640] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:10 2022] GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168 => generated 1227 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:11.054056 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f96ac0af-8aa2-4511-9a6b-996a71d62672 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:11.054795 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f96ac0af-8aa2-4511-9a6b-996a71d62672 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 86d15cd4-fd8d-43ac-a471-6c7c19f778f3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:11.216121 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bb7f7f44-010e-4579-a879-eab7b1eb0878 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:11.231585 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bb7f7f44-010e-4579-a879-eab7b1eb0878 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1510 microversion: 2.1 time: 0.521132 Jul 25 14:41:11.235103 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1928/3641] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:10 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1510 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:11.254150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-30a35260-df93-4054-8b02-07f85e60fb9e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:11.260815 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-30a35260-df93-4054-8b02-07f85e60fb9e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:11.272047 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-30a35260-df93-4054-8b02-07f85e60fb9e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:11.288877 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-30a35260-df93-4054-8b02-07f85e60fb9e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:11.290107 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-30a35260-df93-4054-8b02-07f85e60fb9e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:11.290762 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-30a35260-df93-4054-8b02-07f85e60fb9e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:11.569542 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-30a35260-df93-4054-8b02-07f85e60fb9e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6af371df8364e5b8362add7335ec4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee3d3418544f2ea0558abb27b1c796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:11.578664 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-30a35260-df93-4054-8b02-07f85e60fb9e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da" status: 200 len: 1306 microversion: 2.1 time: 0.341765 Jul 25 14:41:11.582527 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1929/3642] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:11 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da => generated 1306 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:11.597060 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c4eddd35-4a97-4f2d-acbe-7e1ae871c06c tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:11.601214 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c4eddd35-4a97-4f2d-acbe-7e1ae871c06c tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: 794b7eaa-2e72-4ffc-aced-1dfb494e3554] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:11.617944 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c4eddd35-4a97-4f2d-acbe-7e1ae871c06c tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:11.619285 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c4eddd35-4a97-4f2d-acbe-7e1ae871c06c tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:11.620653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c4eddd35-4a97-4f2d-acbe-7e1ae871c06c tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:11.621449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c4eddd35-4a97-4f2d-acbe-7e1ae871c06c tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:11.627399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:41:12.206617 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c4eddd35-4a97-4f2d-acbe-7e1ae871c06c tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:12.219384 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c4eddd35-4a97-4f2d-acbe-7e1ae871c06c tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554" status: 200 len: 1317 microversion: 2.1 time: 0.635057 Jul 25 14:41:12.220723 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1930/3643] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:11 2022] GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554 => generated 1317 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:12.231137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4ca6567d-249c-45a1-902b-b9ac296a6817 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:12.232016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4ca6567d-249c-45a1-902b-b9ac296a6817 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] [instance: cf91c15b-9ab5-4155-a405-e74dc6536168] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:12.262674 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4ca6567d-249c-45a1-902b-b9ac296a6817 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:12.264230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4ca6567d-249c-45a1-902b-b9ac296a6817 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:12.265676 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4ca6567d-249c-45a1-902b-b9ac296a6817 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:12.266309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4ca6567d-249c-45a1-902b-b9ac296a6817 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:12.304766 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f96ac0af-8aa2-4511-9a6b-996a71d62672 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:12.316728 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f96ac0af-8aa2-4511-9a6b-996a71d62672 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3" status: 200 len: 1215 microversion: 2.1 time: 1.268731 Jul 25 14:41:12.317337 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1714/3644] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:11 2022] GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3 => generated 1215 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:12.330978 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-78c316c6-8d4d-4eb0-b2c0-0e2426e3ea4f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:12.331865 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-78c316c6-8d4d-4eb0-b2c0-0e2426e3ea4f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:12.372398 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-78c316c6-8d4d-4eb0-b2c0-0e2426e3ea4f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:12.375565 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-78c316c6-8d4d-4eb0-b2c0-0e2426e3ea4f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:12.377771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-78c316c6-8d4d-4eb0-b2c0-0e2426e3ea4f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:12.378866 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-78c316c6-8d4d-4eb0-b2c0-0e2426e3ea4f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:12.776926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4ca6567d-249c-45a1-902b-b9ac296a6817 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9b242dbcd4d169f8c1d5349f207cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5a1b4a12604e58b538b2b27dc63894', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:12.793164 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4ca6567d-249c-45a1-902b-b9ac296a6817 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] 10.222.0.88 "GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168" status: 200 len: 1285 microversion: 2.1 time: 0.570895 Jul 25 14:41:12.819796 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1931/3645] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:12 2022] GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168 => generated 1285 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:12.836787 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-855fbea2-8a26-41c0-aa1b-fd4c7ca3981f tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:12.838082 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-855fbea2-8a26-41c0-aa1b-fd4c7ca3981f tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:12.859714 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-855fbea2-8a26-41c0-aa1b-fd4c7ca3981f tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:12.866164 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-855fbea2-8a26-41c0-aa1b-fd4c7ca3981f tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:12.867242 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-855fbea2-8a26-41c0-aa1b-fd4c7ca3981f tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:12.867682 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-855fbea2-8a26-41c0-aa1b-fd4c7ca3981f tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:13.132168 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-855fbea2-8a26-41c0-aa1b-fd4c7ca3981f tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6af371df8364e5b8362add7335ec4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee3d3418544f2ea0558abb27b1c796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:13.148462 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-855fbea2-8a26-41c0-aa1b-fd4c7ca3981f tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da" status: 200 len: 1304 microversion: 2.1 time: 0.326368 Jul 25 14:41:13.149345 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1932/3646] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:12 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da => generated 1304 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:13.240855 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2e40f39a-3991-48c7-ba73-99b15836be6b tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:13.241954 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2e40f39a-3991-48c7-ba73-99b15836be6b tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: 794b7eaa-2e72-4ffc-aced-1dfb494e3554] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:13.255056 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2e40f39a-3991-48c7-ba73-99b15836be6b tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:13.255928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2e40f39a-3991-48c7-ba73-99b15836be6b tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:13.263704 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2e40f39a-3991-48c7-ba73-99b15836be6b tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:13.264454 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2e40f39a-3991-48c7-ba73-99b15836be6b tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:13.692724 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2e40f39a-3991-48c7-ba73-99b15836be6b tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:13.715327 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2e40f39a-3991-48c7-ba73-99b15836be6b tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554" status: 200 len: 1317 microversion: 2.1 time: 0.477731 Jul 25 14:41:13.737994 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1933/3647] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:13 2022] GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554 => generated 1317 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:13.743554 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d8944155-071f-4d39-928d-bbaf13219aa5 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:13.751868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d8944155-071f-4d39-928d-bbaf13219aa5 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 86d15cd4-fd8d-43ac-a471-6c7c19f778f3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:13.759582 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d8944155-071f-4d39-928d-bbaf13219aa5 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:13.761578 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d8944155-071f-4d39-928d-bbaf13219aa5 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:13.767917 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d8944155-071f-4d39-928d-bbaf13219aa5 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:13.768621 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d8944155-071f-4d39-928d-bbaf13219aa5 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:13.805303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-78c316c6-8d4d-4eb0-b2c0-0e2426e3ea4f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:13.813455 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-78c316c6-8d4d-4eb0-b2c0-0e2426e3ea4f tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1510 microversion: 2.1 time: 1.492733 Jul 25 14:41:13.816618 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1715/3648] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:12 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1510 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:13.847368 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c975f124-fb0e-44bd-bb02-54fa8d25539a tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:13.848046 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c975f124-fb0e-44bd-bb02-54fa8d25539a tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] [instance: cf91c15b-9ab5-4155-a405-e74dc6536168] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:13.862986 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c975f124-fb0e-44bd-bb02-54fa8d25539a tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:13.863475 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c975f124-fb0e-44bd-bb02-54fa8d25539a tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:13.867565 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c975f124-fb0e-44bd-bb02-54fa8d25539a tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:13.869138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c975f124-fb0e-44bd-bb02-54fa8d25539a tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:14.082346 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d8944155-071f-4d39-928d-bbaf13219aa5 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:14.101814 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d8944155-071f-4d39-928d-bbaf13219aa5 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3" status: 200 len: 1273 microversion: 2.1 time: 0.362406 Jul 25 14:41:14.102640 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1934/3649] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:13 2022] GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3 => generated 1273 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:14.193483 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5f3bc31d-fddc-4b6f-accb-6f379de5c7e6 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:14.209125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5f3bc31d-fddc-4b6f-accb-6f379de5c7e6 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:14.228029 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5f3bc31d-fddc-4b6f-accb-6f379de5c7e6 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:14.229232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5f3bc31d-fddc-4b6f-accb-6f379de5c7e6 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:14.230964 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5f3bc31d-fddc-4b6f-accb-6f379de5c7e6 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:14.231899 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5f3bc31d-fddc-4b6f-accb-6f379de5c7e6 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:14.378519 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c975f124-fb0e-44bd-bb02-54fa8d25539a tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9b242dbcd4d169f8c1d5349f207cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5a1b4a12604e58b538b2b27dc63894', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:14.388428 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c975f124-fb0e-44bd-bb02-54fa8d25539a tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] 10.222.0.88 "GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168" status: 200 len: 1285 microversion: 2.1 time: 0.552652 Jul 25 14:41:14.393468 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1716/3650] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:13 2022] GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168 => generated 1285 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:14.642114 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5f3bc31d-fddc-4b6f-accb-6f379de5c7e6 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6af371df8364e5b8362add7335ec4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee3d3418544f2ea0558abb27b1c796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:14.673224 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5f3bc31d-fddc-4b6f-accb-6f379de5c7e6 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da" status: 200 len: 1304 microversion: 2.1 time: 0.500956 Jul 25 14:41:14.674700 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1935/3651] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:14 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da => generated 1304 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:14.743677 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c17f471f-82fc-4311-a8ac-2ca0267bcd68 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:14.749289 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c17f471f-82fc-4311-a8ac-2ca0267bcd68 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: 794b7eaa-2e72-4ffc-aced-1dfb494e3554] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:14.764010 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c17f471f-82fc-4311-a8ac-2ca0267bcd68 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:14.765665 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c17f471f-82fc-4311-a8ac-2ca0267bcd68 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:14.767819 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c17f471f-82fc-4311-a8ac-2ca0267bcd68 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:14.769517 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c17f471f-82fc-4311-a8ac-2ca0267bcd68 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:14.841211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fd8f8577-16d6-4607-b7ff-8eea40ff3c59 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:14.842301 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fd8f8577-16d6-4607-b7ff-8eea40ff3c59 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:14.869947 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fd8f8577-16d6-4607-b7ff-8eea40ff3c59 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:14.870411 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fd8f8577-16d6-4607-b7ff-8eea40ff3c59 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:14.871205 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fd8f8577-16d6-4607-b7ff-8eea40ff3c59 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:14.871641 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fd8f8577-16d6-4607-b7ff-8eea40ff3c59 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:15.691349 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fd8f8577-16d6-4607-b7ff-8eea40ff3c59 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:15.707772 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fd8f8577-16d6-4607-b7ff-8eea40ff3c59 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1510 microversion: 2.1 time: 0.868789 Jul 25 14:41:15.709957 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1936/3652] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:14 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1510 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:41:15.721710 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d844987d-da65-4b52-aa58-814f28024af9 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:15.727330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d844987d-da65-4b52-aa58-814f28024af9 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 86d15cd4-fd8d-43ac-a471-6c7c19f778f3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:15.745241 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d844987d-da65-4b52-aa58-814f28024af9 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:15.745694 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d844987d-da65-4b52-aa58-814f28024af9 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:15.746482 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d844987d-da65-4b52-aa58-814f28024af9 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:15.746921 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d844987d-da65-4b52-aa58-814f28024af9 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:15.951371 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d844987d-da65-4b52-aa58-814f28024af9 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:15.961248 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d844987d-da65-4b52-aa58-814f28024af9 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3" status: 200 len: 1273 microversion: 2.1 time: 0.249598 Jul 25 14:41:15.967839 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1937/3653] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:15 2022] GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3 => generated 1273 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:15.996706 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c9ab2ac4-511b-4ec0-b547-56fc04b5bccb tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:15.998001 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c9ab2ac4-511b-4ec0-b547-56fc04b5bccb tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] [instance: cf91c15b-9ab5-4155-a405-e74dc6536168] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:16.020199 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c9ab2ac4-511b-4ec0-b547-56fc04b5bccb tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:16.024929 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c9ab2ac4-511b-4ec0-b547-56fc04b5bccb tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:16.026036 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c9ab2ac4-511b-4ec0-b547-56fc04b5bccb tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:16.030853 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c9ab2ac4-511b-4ec0-b547-56fc04b5bccb tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:16.611326 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c17f471f-82fc-4311-a8ac-2ca0267bcd68 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:16.628373 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c17f471f-82fc-4311-a8ac-2ca0267bcd68 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554" status: 200 len: 1317 microversion: 2.1 time: 1.893171 Jul 25 14:41:16.631903 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1717/3654] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:14 2022] GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554 => generated 1317 bytes in 1897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:16.651825 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4b49f886-7f6b-4a81-b066-a07b11d7f2a5 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:16.653614 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4b49f886-7f6b-4a81-b066-a07b11d7f2a5 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:16.691517 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4b49f886-7f6b-4a81-b066-a07b11d7f2a5 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:16.692039 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4b49f886-7f6b-4a81-b066-a07b11d7f2a5 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:16.692945 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4b49f886-7f6b-4a81-b066-a07b11d7f2a5 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:16.693395 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4b49f886-7f6b-4a81-b066-a07b11d7f2a5 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:17.584558 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c9ab2ac4-511b-4ec0-b547-56fc04b5bccb tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9b242dbcd4d169f8c1d5349f207cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5a1b4a12604e58b538b2b27dc63894', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:17.603054 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c9ab2ac4-511b-4ec0-b547-56fc04b5bccb tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] 10.222.0.88 "GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168" status: 200 len: 1327 microversion: 2.1 time: 1.633730 Jul 25 14:41:17.608090 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1938/3655] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:15 2022] GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168 => generated 1327 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:17.613520 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-73a00532-4af0-4212-b88c-5500cf0d928d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:17.628146 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-73a00532-4af0-4212-b88c-5500cf0d928d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:17.653501 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-73a00532-4af0-4212-b88c-5500cf0d928d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:17.654281 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-73a00532-4af0-4212-b88c-5500cf0d928d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:17.655383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-73a00532-4af0-4212-b88c-5500cf0d928d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:17.658324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-73a00532-4af0-4212-b88c-5500cf0d928d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:18.346159 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-73a00532-4af0-4212-b88c-5500cf0d928d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:18.357470 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-73a00532-4af0-4212-b88c-5500cf0d928d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1510 microversion: 2.1 time: 0.747581 Jul 25 14:41:18.358184 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1939/3656] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:17 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1510 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:18.364376 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-83498ed3-41a7-4780-b772-b17e135b9c66 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:18.365328 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-83498ed3-41a7-4780-b772-b17e135b9c66 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 86d15cd4-fd8d-43ac-a471-6c7c19f778f3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:18.386946 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83498ed3-41a7-4780-b772-b17e135b9c66 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:18.387796 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83498ed3-41a7-4780-b772-b17e135b9c66 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:18.389036 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83498ed3-41a7-4780-b772-b17e135b9c66 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:18.389637 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83498ed3-41a7-4780-b772-b17e135b9c66 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:18.468415 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4b49f886-7f6b-4a81-b066-a07b11d7f2a5 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6af371df8364e5b8362add7335ec4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee3d3418544f2ea0558abb27b1c796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:18.482270 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4b49f886-7f6b-4a81-b066-a07b11d7f2a5 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da" status: 200 len: 1372 microversion: 2.1 time: 1.848084 Jul 25 14:41:18.483367 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1718/3657] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:16 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da => generated 1372 bytes in 1851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:18.500263 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-a184d992-6076-43d1-9300-a148aba1e956 req-0768513a-7433-4e3a-8540-88bc2adbee18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "794b7eaa-2e72-4ffc-aced-1dfb494e3554", "name": "network-vif-plugged", "status": "completed", "tag": "ee5f6577-aca1-4c54-8d5b-962c392fa674"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:18.531055 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-a184d992-6076-43d1-9300-a148aba1e956 req-0768513a-7433-4e3a-8540-88bc2adbee18 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:18.531528 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-a184d992-6076-43d1-9300-a148aba1e956 req-0768513a-7433-4e3a-8540-88bc2adbee18 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:18.550581 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-a184d992-6076-43d1-9300-a148aba1e956 req-0768513a-7433-4e3a-8540-88bc2adbee18 service nova] Creating event network-vif-plugged:ee5f6577-aca1-4c54-8d5b-962c392fa674 for instance 794b7eaa-2e72-4ffc-aced-1dfb494e3554 on n-h1-846435-14 Jul 25 14:41:18.560457 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-a184d992-6076-43d1-9300-a148aba1e956 req-0768513a-7433-4e3a-8540-88bc2adbee18 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073817 Jul 25 14:41:18.561219 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1719/3658] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:41:18.580466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-38b93578-9550-407e-aace-840cdc9f337b tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:18.581521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-38b93578-9550-407e-aace-840cdc9f337b tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: 794b7eaa-2e72-4ffc-aced-1dfb494e3554] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:18.597207 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-38b93578-9550-407e-aace-840cdc9f337b tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:18.598107 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-38b93578-9550-407e-aace-840cdc9f337b tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:18.599367 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-38b93578-9550-407e-aace-840cdc9f337b tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:18.600199 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-38b93578-9550-407e-aace-840cdc9f337b tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:18.829232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-83498ed3-41a7-4780-b772-b17e135b9c66 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:18.846386 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-83498ed3-41a7-4780-b772-b17e135b9c66 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3" status: 200 len: 1273 microversion: 2.1 time: 0.484246 Jul 25 14:41:18.849077 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1940/3659] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:18 2022] GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3 => generated 1273 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:18.865277 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4a8f6c8a-0cb1-4022-9499-816740373c68 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:18.867224 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4a8f6c8a-0cb1-4022-9499-816740373c68 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] [instance: cf91c15b-9ab5-4155-a405-e74dc6536168] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:18.886927 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4a8f6c8a-0cb1-4022-9499-816740373c68 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:18.892406 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4a8f6c8a-0cb1-4022-9499-816740373c68 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:18.893377 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4a8f6c8a-0cb1-4022-9499-816740373c68 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:18.893906 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4a8f6c8a-0cb1-4022-9499-816740373c68 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:19.293147 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-38b93578-9550-407e-aace-840cdc9f337b tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:19.308516 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-38b93578-9550-407e-aace-840cdc9f337b tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554" status: 200 len: 1317 microversion: 2.1 time: 0.745687 Jul 25 14:41:19.332021 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1720/3660] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:18 2022] GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554 => generated 1317 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:19.379327 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0aa14cfd-0e63-45bd-9a5e-0b062556135d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:19.379566 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0aa14cfd-0e63-45bd-9a5e-0b062556135d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:19.392079 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0aa14cfd-0e63-45bd-9a5e-0b062556135d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:19.392673 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4a8f6c8a-0cb1-4022-9499-816740373c68 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9b242dbcd4d169f8c1d5349f207cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5a1b4a12604e58b538b2b27dc63894', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:19.400799 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0aa14cfd-0e63-45bd-9a5e-0b062556135d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:19.401702 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0aa14cfd-0e63-45bd-9a5e-0b062556135d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:19.402085 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0aa14cfd-0e63-45bd-9a5e-0b062556135d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:19.404240 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4a8f6c8a-0cb1-4022-9499-816740373c68 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] 10.222.0.88 "GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168" status: 200 len: 1327 microversion: 2.1 time: 0.550054 Jul 25 14:41:19.418112 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1941/3661] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:18 2022] GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168 => generated 1327 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:19.502724 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-053e6138-fcd3-4384-ae02-2d243bf21680 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:19.503708 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-053e6138-fcd3-4384-ae02-2d243bf21680 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:19.506969 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:41:19.517307 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-053e6138-fcd3-4384-ae02-2d243bf21680 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:19.518309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-053e6138-fcd3-4384-ae02-2d243bf21680 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:19.519404 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-053e6138-fcd3-4384-ae02-2d243bf21680 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:19.520098 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-053e6138-fcd3-4384-ae02-2d243bf21680 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:19.881385 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=8 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:41:20.396298 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:41:20.515167 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-053e6138-fcd3-4384-ae02-2d243bf21680 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6af371df8364e5b8362add7335ec4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee3d3418544f2ea0558abb27b1c796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:20.524996 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-053e6138-fcd3-4384-ae02-2d243bf21680 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da" status: 200 len: 1372 microversion: 2.1 time: 1.025926 Jul 25 14:41:20.525594 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1942/3662] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:19 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da => generated 1372 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:41:20.532702 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-c8c522a0-1624-44f4-8ff2-28703cae34ad req-ea43ddca-83e0-4271-8438-98396551ff18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf91c15b-9ab5-4155-a405-e74dc6536168", "tag": "71e35f1c-c56f-4975-9638-7a9ac203cf4d"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:20.544260 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c8c522a0-1624-44f4-8ff2-28703cae34ad req-ea43ddca-83e0-4271-8438-98396551ff18 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:20.545939 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c8c522a0-1624-44f4-8ff2-28703cae34ad req-ea43ddca-83e0-4271-8438-98396551ff18 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:20.590914 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-c8c522a0-1624-44f4-8ff2-28703cae34ad req-ea43ddca-83e0-4271-8438-98396551ff18 service nova] Creating event network-changed:71e35f1c-c56f-4975-9638-7a9ac203cf4d for instance cf91c15b-9ab5-4155-a405-e74dc6536168 on n-h2-846435-14 Jul 25 14:41:20.597974 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-c8c522a0-1624-44f4-8ff2-28703cae34ad req-ea43ddca-83e0-4271-8438-98396551ff18 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068947 Jul 25 14:41:20.599588 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1943/3663] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:41:20.607030 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7b7b7a1c-5f94-4fa4-a36d-1604dcadedad tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:20.609207 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0aa14cfd-0e63-45bd-9a5e-0b062556135d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:20.609559 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7b7b7a1c-5f94-4fa4-a36d-1604dcadedad tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 86d15cd4-fd8d-43ac-a471-6c7c19f778f3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:20.617748 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7b7b7a1c-5f94-4fa4-a36d-1604dcadedad tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:20.618516 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7b7b7a1c-5f94-4fa4-a36d-1604dcadedad tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:20.619560 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7b7b7a1c-5f94-4fa4-a36d-1604dcadedad tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:20.620712 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7b7b7a1c-5f94-4fa4-a36d-1604dcadedad tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:20.624714 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0aa14cfd-0e63-45bd-9a5e-0b062556135d tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1510 microversion: 2.1 time: 1.250004 Jul 25 14:41:20.625621 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1721/3664] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:19 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1510 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:20.642559 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ebc58856-61b2-4e55-bd2d-ba348cce9887 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:20.643493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ebc58856-61b2-4e55-bd2d-ba348cce9887 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: 794b7eaa-2e72-4ffc-aced-1dfb494e3554] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:20.669440 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ebc58856-61b2-4e55-bd2d-ba348cce9887 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:20.671015 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ebc58856-61b2-4e55-bd2d-ba348cce9887 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:20.674759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ebc58856-61b2-4e55-bd2d-ba348cce9887 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:20.676624 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ebc58856-61b2-4e55-bd2d-ba348cce9887 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:21.550249 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ebc58856-61b2-4e55-bd2d-ba348cce9887 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:21.563779 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7b7b7a1c-5f94-4fa4-a36d-1604dcadedad tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:21.569853 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ebc58856-61b2-4e55-bd2d-ba348cce9887 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554" status: 200 len: 1467 microversion: 2.1 time: 0.943103 Jul 25 14:41:21.574517 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7b7b7a1c-5f94-4fa4-a36d-1604dcadedad tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3" status: 200 len: 1315 microversion: 2.1 time: 0.973218 Jul 25 14:41:21.574902 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1722/3665] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:20 2022] GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554 => generated 1467 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:21.592389 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1944/3666] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:20 2022] GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3 => generated 1315 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:21.628756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9f700569-0846-41e7-8c01-3b1719acec5b tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:21.629452 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9f700569-0846-41e7-8c01-3b1719acec5b tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] [instance: cf91c15b-9ab5-4155-a405-e74dc6536168] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:21.647273 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f700569-0846-41e7-8c01-3b1719acec5b tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:21.647749 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f700569-0846-41e7-8c01-3b1719acec5b tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:21.651732 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f700569-0846-41e7-8c01-3b1719acec5b tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:21.653234 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f700569-0846-41e7-8c01-3b1719acec5b tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:21.733569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-d06bd638-66f8-471c-82fc-0121e4d16134 req-6cde2694-1cde-4bee-9e2d-4e3c386a1fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfb8c05d-0ccc-4b4d-a920-d8238e56f0de", "name": "network-vif-plugged", "status": "completed", "tag": "78158429-4b1a-4039-9efe-77450874ee04"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:21.756718 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-d06bd638-66f8-471c-82fc-0121e4d16134 req-6cde2694-1cde-4bee-9e2d-4e3c386a1fa0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:21.757430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-d06bd638-66f8-471c-82fc-0121e4d16134 req-6cde2694-1cde-4bee-9e2d-4e3c386a1fa0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:21.770266 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-d06bd638-66f8-471c-82fc-0121e4d16134 req-6cde2694-1cde-4bee-9e2d-4e3c386a1fa0 service nova] Creating event network-vif-plugged:78158429-4b1a-4039-9efe-77450874ee04 for instance dfb8c05d-0ccc-4b4d-a920-d8238e56f0de on n-h2-846435-14 Jul 25 14:41:21.790813 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-d06bd638-66f8-471c-82fc-0121e4d16134 req-6cde2694-1cde-4bee-9e2d-4e3c386a1fa0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196670 Jul 25 14:41:21.798291 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1945/3667] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:41:21.817588 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0cfff0a8-e84d-41c0-9dbf-28a09aee6a92 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:21.818570 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0cfff0a8-e84d-41c0-9dbf-28a09aee6a92 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:21.832800 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0cfff0a8-e84d-41c0-9dbf-28a09aee6a92 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:21.844374 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0cfff0a8-e84d-41c0-9dbf-28a09aee6a92 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:21.845576 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0cfff0a8-e84d-41c0-9dbf-28a09aee6a92 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:21.846872 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0cfff0a8-e84d-41c0-9dbf-28a09aee6a92 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:22.309902 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=16 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:41:22.803852 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0cfff0a8-e84d-41c0-9dbf-28a09aee6a92 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6af371df8364e5b8362add7335ec4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee3d3418544f2ea0558abb27b1c796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:22.814637 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0cfff0a8-e84d-41c0-9dbf-28a09aee6a92 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da" status: 200 len: 1372 microversion: 2.1 time: 1.014007 Jul 25 14:41:22.870948 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1946/3668] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:21 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da => generated 1372 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:22.897596 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-06709209-50c7-4db8-aa94-37e9842e0e0a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:22.900013 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-06709209-50c7-4db8-aa94-37e9842e0e0a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: dfb8c05d-0ccc-4b4d-a920-d8238e56f0de] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:22.925125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-06709209-50c7-4db8-aa94-37e9842e0e0a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:22.926683 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-06709209-50c7-4db8-aa94-37e9842e0e0a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:22.937019 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-06709209-50c7-4db8-aa94-37e9842e0e0a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:22.937874 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-06709209-50c7-4db8-aa94-37e9842e0e0a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:23.081542 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9f700569-0846-41e7-8c01-3b1719acec5b tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9b242dbcd4d169f8c1d5349f207cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5a1b4a12604e58b538b2b27dc63894', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:23.094179 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9f700569-0846-41e7-8c01-3b1719acec5b tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] 10.222.0.88 "GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168" status: 200 len: 1327 microversion: 2.1 time: 1.517886 Jul 25 14:41:23.096573 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1723/3669] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:21 2022] GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168 => generated 1327 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:23.106898 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6ce351dd-0f87-4f34-9fe2-e537005a6e04 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:23.107515 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6ce351dd-0f87-4f34-9fe2-e537005a6e04 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:23.122748 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ce351dd-0f87-4f34-9fe2-e537005a6e04 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:23.123172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ce351dd-0f87-4f34-9fe2-e537005a6e04 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:23.133346 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ce351dd-0f87-4f34-9fe2-e537005a6e04 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:23.133997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ce351dd-0f87-4f34-9fe2-e537005a6e04 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:23.186322 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:41:23.390623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-06709209-50c7-4db8-aa94-37e9842e0e0a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:23.404236 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-06709209-50c7-4db8-aa94-37e9842e0e0a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de" status: 200 len: 1318 microversion: 2.1 time: 0.530438 Jul 25 14:41:23.407714 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1947/3670] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:22 2022] GET /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de => generated 1318 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:23.418450 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-ad0cdebe-f89f-465c-9b38-3049c696008d req-2ce01fd9-dc94-432e-b809-52fbfa5e6e47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e128c68-5e95-4535-ab8f-451b2d7ec5da", "tag": "c80cc8b1-d5ac-4df0-b29c-4321c060d4cf"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:23.448880 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ad0cdebe-f89f-465c-9b38-3049c696008d req-2ce01fd9-dc94-432e-b809-52fbfa5e6e47 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:23.454067 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ad0cdebe-f89f-465c-9b38-3049c696008d req-2ce01fd9-dc94-432e-b809-52fbfa5e6e47 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:23.462023 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:41:23.491119 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-ad0cdebe-f89f-465c-9b38-3049c696008d req-2ce01fd9-dc94-432e-b809-52fbfa5e6e47 service nova] Creating event network-changed:c80cc8b1-d5ac-4df0-b29c-4321c060d4cf for instance 0e128c68-5e95-4535-ab8f-451b2d7ec5da on n-h2-846435-14 Jul 25 14:41:23.501762 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-ad0cdebe-f89f-465c-9b38-3049c696008d req-2ce01fd9-dc94-432e-b809-52fbfa5e6e47 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092752 Jul 25 14:41:23.503815 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1948/3671] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:41:23.530375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fbaedcb5-f2f7-44d6-88c0-cf4a563e9b00 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:23.531911 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fbaedcb5-f2f7-44d6-88c0-cf4a563e9b00 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 86d15cd4-fd8d-43ac-a471-6c7c19f778f3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:23.558809 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fbaedcb5-f2f7-44d6-88c0-cf4a563e9b00 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:23.559383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fbaedcb5-f2f7-44d6-88c0-cf4a563e9b00 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:23.560422 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fbaedcb5-f2f7-44d6-88c0-cf4a563e9b00 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:23.560926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fbaedcb5-f2f7-44d6-88c0-cf4a563e9b00 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:23.953948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fbaedcb5-f2f7-44d6-88c0-cf4a563e9b00 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:23.966488 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fbaedcb5-f2f7-44d6-88c0-cf4a563e9b00 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3" status: 200 len: 1315 microversion: 2.1 time: 0.456284 Jul 25 14:41:23.983213 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1949/3672] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:23 2022] GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3 => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:23.983213 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2f516932-a67b-49db-9cf2-a52375377ef5 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:23.983213 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2f516932-a67b-49db-9cf2-a52375377ef5 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:23.993239 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2f516932-a67b-49db-9cf2-a52375377ef5 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:23.993788 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2f516932-a67b-49db-9cf2-a52375377ef5 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:23.995181 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2f516932-a67b-49db-9cf2-a52375377ef5 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:23.996308 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2f516932-a67b-49db-9cf2-a52375377ef5 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:24.011285 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6ce351dd-0f87-4f34-9fe2-e537005a6e04 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:24.028608 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6ce351dd-0f87-4f34-9fe2-e537005a6e04 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1510 microversion: 2.1 time: 0.926889 Jul 25 14:41:24.043339 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1724/3673] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:23 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1510 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:24.117530 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2733f021-65b5-40a0-9c1c-47f627a0bf72 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:24.118990 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2733f021-65b5-40a0-9c1c-47f627a0bf72 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] [instance: cf91c15b-9ab5-4155-a405-e74dc6536168] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:24.126273 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:41:24.128759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2733f021-65b5-40a0-9c1c-47f627a0bf72 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:24.129283 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2733f021-65b5-40a0-9c1c-47f627a0bf72 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:24.130293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2733f021-65b5-40a0-9c1c-47f627a0bf72 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:24.130953 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2733f021-65b5-40a0-9c1c-47f627a0bf72 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:24.218821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2f516932-a67b-49db-9cf2-a52375377ef5 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6af371df8364e5b8362add7335ec4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee3d3418544f2ea0558abb27b1c796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:24.227691 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2f516932-a67b-49db-9cf2-a52375377ef5 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da" status: 200 len: 1372 microversion: 2.1 time: 0.255700 Jul 25 14:41:24.228325 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1950/3674] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:23 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da => generated 1372 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:24.427407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9b3b7bb9-b926-4769-90e8-eaedbb609a77 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:24.428097 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9b3b7bb9-b926-4769-90e8-eaedbb609a77 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: dfb8c05d-0ccc-4b4d-a920-d8238e56f0de] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:24.436138 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9b3b7bb9-b926-4769-90e8-eaedbb609a77 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:24.437039 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9b3b7bb9-b926-4769-90e8-eaedbb609a77 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:24.441046 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9b3b7bb9-b926-4769-90e8-eaedbb609a77 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:24.442684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9b3b7bb9-b926-4769-90e8-eaedbb609a77 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:24.451887 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2733f021-65b5-40a0-9c1c-47f627a0bf72 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9b242dbcd4d169f8c1d5349f207cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5a1b4a12604e58b538b2b27dc63894', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:24.463782 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2733f021-65b5-40a0-9c1c-47f627a0bf72 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] 10.222.0.88 "GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168" status: 200 len: 1327 microversion: 2.1 time: 0.350861 Jul 25 14:41:24.465365 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1725/3675] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:24 2022] GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168 => generated 1327 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:24.697851 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9b3b7bb9-b926-4769-90e8-eaedbb609a77 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:24.706160 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9b3b7bb9-b926-4769-90e8-eaedbb609a77 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de" status: 200 len: 1318 microversion: 2.1 time: 0.284694 Jul 25 14:41:24.707078 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1951/3676] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:24 2022] GET /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:24.991610 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5d2d4640-b45c-43e5-a586-0ba340c3e0db tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:24.992463 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5d2d4640-b45c-43e5-a586-0ba340c3e0db tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 86d15cd4-fd8d-43ac-a471-6c7c19f778f3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:24.999141 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5d2d4640-b45c-43e5-a586-0ba340c3e0db tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:24.999603 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5d2d4640-b45c-43e5-a586-0ba340c3e0db tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:25.000430 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5d2d4640-b45c-43e5-a586-0ba340c3e0db tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:25.000863 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5d2d4640-b45c-43e5-a586-0ba340c3e0db tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:25.050641 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c74c56b5-892d-4dc5-be91-1a1b62ef2e52 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:25.051466 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c74c56b5-892d-4dc5-be91-1a1b62ef2e52 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:25.059772 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c74c56b5-892d-4dc5-be91-1a1b62ef2e52 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:25.060251 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c74c56b5-892d-4dc5-be91-1a1b62ef2e52 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:25.061039 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c74c56b5-892d-4dc5-be91-1a1b62ef2e52 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:25.061600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c74c56b5-892d-4dc5-be91-1a1b62ef2e52 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:25.220084 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c74c56b5-892d-4dc5-be91-1a1b62ef2e52 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:25.229257 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c74c56b5-892d-4dc5-be91-1a1b62ef2e52 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1510 microversion: 2.1 time: 0.182693 Jul 25 14:41:25.230159 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1952/3677] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:25 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1510 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:41:25.249847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ebc0b465-7c43-46cd-9382-8a4083018792 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:25.250830 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ebc0b465-7c43-46cd-9382-8a4083018792 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:25.258974 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ebc0b465-7c43-46cd-9382-8a4083018792 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:25.259431 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ebc0b465-7c43-46cd-9382-8a4083018792 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:25.260240 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ebc0b465-7c43-46cd-9382-8a4083018792 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:25.260681 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ebc0b465-7c43-46cd-9382-8a4083018792 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:25.348088 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5d2d4640-b45c-43e5-a586-0ba340c3e0db tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:25.358251 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5d2d4640-b45c-43e5-a586-0ba340c3e0db tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3" status: 200 len: 1315 microversion: 2.1 time: 0.371389 Jul 25 14:41:25.359302 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1726/3678] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:24 2022] GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3 => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:25.419084 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ebc0b465-7c43-46cd-9382-8a4083018792 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6af371df8364e5b8362add7335ec4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee3d3418544f2ea0558abb27b1c796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:25.428398 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ebc0b465-7c43-46cd-9382-8a4083018792 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da" status: 200 len: 1372 microversion: 2.1 time: 0.181931 Jul 25 14:41:25.428915 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1953/3679] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:25 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da => generated 1372 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:25.486731 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d3f3fbb8-b9b1-4022-8088-e9fba65b07ef tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:25.487357 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d3f3fbb8-b9b1-4022-8088-e9fba65b07ef tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] [instance: cf91c15b-9ab5-4155-a405-e74dc6536168] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:25.494798 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d3f3fbb8-b9b1-4022-8088-e9fba65b07ef tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:25.495263 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d3f3fbb8-b9b1-4022-8088-e9fba65b07ef tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:25.496076 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d3f3fbb8-b9b1-4022-8088-e9fba65b07ef tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:25.496520 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d3f3fbb8-b9b1-4022-8088-e9fba65b07ef tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:25.721832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d3f3fbb8-b9b1-4022-8088-e9fba65b07ef tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9b242dbcd4d169f8c1d5349f207cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5a1b4a12604e58b538b2b27dc63894', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:25.730031 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d3f3fbb8-b9b1-4022-8088-e9fba65b07ef tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] 10.222.0.88 "GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168" status: 200 len: 1327 microversion: 2.1 time: 0.247208 Jul 25 14:41:25.741812 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1727/3680] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:25 2022] GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168 => generated 1327 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:25.750385 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-98dd4032-4334-4407-91c2-0038218c8946 req-c078ffb1-917f-4393-8447-c30edd0d9366 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86d15cd4-fd8d-43ac-a471-6c7c19f778f3", "tag": "49211c83-89f7-4354-a36e-803f5c21cfab"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:25.761304 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-98dd4032-4334-4407-91c2-0038218c8946 req-c078ffb1-917f-4393-8447-c30edd0d9366 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:25.761748 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-98dd4032-4334-4407-91c2-0038218c8946 req-c078ffb1-917f-4393-8447-c30edd0d9366 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:25.776254 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-98dd4032-4334-4407-91c2-0038218c8946 req-c078ffb1-917f-4393-8447-c30edd0d9366 service nova] Creating event network-changed:49211c83-89f7-4354-a36e-803f5c21cfab for instance 86d15cd4-fd8d-43ac-a471-6c7c19f778f3 on n-h1-846435-14 Jul 25 14:41:25.781266 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-98dd4032-4334-4407-91c2-0038218c8946 req-c078ffb1-917f-4393-8447-c30edd0d9366 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049117 Jul 25 14:41:25.781914 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1728/3681] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:41:25.788541 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dd538ca8-1ddf-4919-a805-82e79aa7b821 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:25.789596 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-dd538ca8-1ddf-4919-a805-82e79aa7b821 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: dfb8c05d-0ccc-4b4d-a920-d8238e56f0de] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:25.794774 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-14c9e3f2-8097-4b32-af81-528ba9aea1be tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-570941207", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": "none"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:25.796847 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dd538ca8-1ddf-4919-a805-82e79aa7b821 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:25.797293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dd538ca8-1ddf-4919-a805-82e79aa7b821 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:25.799010 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dd538ca8-1ddf-4919-a805-82e79aa7b821 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:25.799450 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dd538ca8-1ddf-4919-a805-82e79aa7b821 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:25.851625 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-14c9e3f2-8097-4b32-af81-528ba9aea1be tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:41:25.853569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-14c9e3f2-8097-4b32-af81-528ba9aea1be tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:41:25.853569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-14c9e3f2-8097-4b32-af81-528ba9aea1be tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:41:25.853569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-14c9e3f2-8097-4b32-af81-528ba9aea1be tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:41:25.853569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-14c9e3f2-8097-4b32-af81-528ba9aea1be tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:41:25.865021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-14c9e3f2-8097-4b32-af81-528ba9aea1be tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:25.865472 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-14c9e3f2-8097-4b32-af81-528ba9aea1be tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:25.866266 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-14c9e3f2-8097-4b32-af81-528ba9aea1be tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:25.866702 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-14c9e3f2-8097-4b32-af81-528ba9aea1be tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:25.885265 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-14c9e3f2-8097-4b32-af81-528ba9aea1be tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Getting quotas for project 79f00a92563647618eeb7aa9b0109830. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:41:25.891553 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-14c9e3f2-8097-4b32-af81-528ba9aea1be tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Getting quotas for user 3624b9087f984bfe9c718e258a716647 and project 79f00a92563647618eeb7aa9b0109830. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:41:25.905198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-14c9e3f2-8097-4b32-af81-528ba9aea1be tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:41:25.908384 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-14c9e3f2-8097-4b32-af81-528ba9aea1be tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fd40fd97-1164-451c-84c9-a0f5c3cc3009] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:41:25.945466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-dd538ca8-1ddf-4919-a805-82e79aa7b821 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:25.954091 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dd538ca8-1ddf-4919-a805-82e79aa7b821 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de" status: 200 len: 1318 microversion: 2.1 time: 0.170291 Jul 25 14:41:25.954813 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1729/3682] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:25 2022] GET /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:25.959486 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-14c9e3f2-8097-4b32-af81-528ba9aea1be tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.303299 Jul 25 14:41:25.960500 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1954/3683] 10.222.0.88 () {62 vars in 1188 bytes} [Mon Jul 25 14:41:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 305 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 14:41:25.979235 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f3403cc6-3bef-478e-8a63-f0c42f0857c8 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:25.979871 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f3403cc6-3bef-478e-8a63-f0c42f0857c8 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fd40fd97-1164-451c-84c9-a0f5c3cc3009] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:26.038481 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f3403cc6-3bef-478e-8a63-f0c42f0857c8 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:26.050794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f3403cc6-3bef-478e-8a63-f0c42f0857c8 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:26.053677 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f3403cc6-3bef-478e-8a63-f0c42f0857c8 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:26.053866 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f3403cc6-3bef-478e-8a63-f0c42f0857c8 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fd40fd97-1164-451c-84c9-a0f5c3cc3009" status: 200 len: 1277 microversion: 2.47 time: 0.079194 Jul 25 14:41:26.055138 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1730/3684] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:25 2022] GET /compute/v2.1/servers/fd40fd97-1164-451c-84c9-a0f5c3cc3009 => generated 1277 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:41:26.124041 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-967f71cd-0a34-4048-9d11-bae504233d2c tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-42346953", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": "none"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:26.181156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-967f71cd-0a34-4048-9d11-bae504233d2c tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:41:26.181844 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-967f71cd-0a34-4048-9d11-bae504233d2c tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:41:26.182596 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-967f71cd-0a34-4048-9d11-bae504233d2c tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:41:26.183095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-967f71cd-0a34-4048-9d11-bae504233d2c tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:41:26.183547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-967f71cd-0a34-4048-9d11-bae504233d2c tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:41:26.193754 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-967f71cd-0a34-4048-9d11-bae504233d2c tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:26.194752 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-967f71cd-0a34-4048-9d11-bae504233d2c tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:26.195547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-967f71cd-0a34-4048-9d11-bae504233d2c tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:26.196042 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-967f71cd-0a34-4048-9d11-bae504233d2c tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:26.214632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-967f71cd-0a34-4048-9d11-bae504233d2c tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Getting quotas for project 79f00a92563647618eeb7aa9b0109830. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:41:26.220094 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-967f71cd-0a34-4048-9d11-bae504233d2c tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Getting quotas for user 3624b9087f984bfe9c718e258a716647 and project 79f00a92563647618eeb7aa9b0109830. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:41:26.233617 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-967f71cd-0a34-4048-9d11-bae504233d2c tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:41:26.236289 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-967f71cd-0a34-4048-9d11-bae504233d2c tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:41:26.255800 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c2d2af05-a080-4632-902a-8d643c29481e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:26.262164 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c2d2af05-a080-4632-902a-8d643c29481e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:26.288943 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c2d2af05-a080-4632-902a-8d643c29481e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:26.289679 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c2d2af05-a080-4632-902a-8d643c29481e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:26.291361 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c2d2af05-a080-4632-902a-8d643c29481e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:26.292243 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-967f71cd-0a34-4048-9d11-bae504233d2c tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.172829 Jul 25 14:41:26.293175 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1955/3685] 10.222.0.88 () {62 vars in 1188 bytes} [Mon Jul 25 14:41:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 175 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 14:41:26.294911 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c2d2af05-a080-4632-902a-8d643c29481e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:26.318113 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-00164b7b-2b73-4b22-bbd2-85628028bd01 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:26.328170 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-00164b7b-2b73-4b22-bbd2-85628028bd01 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:26.386395 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-00164b7b-2b73-4b22-bbd2-85628028bd01 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "PUT /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 200 len: 990 microversion: 2.47 time: 0.076390 Jul 25 14:41:26.387333 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1956/3686] 10.222.0.88 () {62 vars in 1297 bytes} [Mon Jul 25 14:41:26 2022] PUT /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 990 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:41:26.396290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9703e11f-3434-462f-946e-68f15002559d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:26.397239 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9703e11f-3434-462f-946e-68f15002559d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 86d15cd4-fd8d-43ac-a471-6c7c19f778f3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:26.416000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9703e11f-3434-462f-946e-68f15002559d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:26.416409 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9703e11f-3434-462f-946e-68f15002559d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:26.417387 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9703e11f-3434-462f-946e-68f15002559d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:26.417892 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9703e11f-3434-462f-946e-68f15002559d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:26.700287 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c2d2af05-a080-4632-902a-8d643c29481e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:26.708978 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c2d2af05-a080-4632-902a-8d643c29481e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1510 microversion: 2.1 time: 0.462155 Jul 25 14:41:26.710175 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1731/3687] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:26 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1510 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:41:26.715206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6da49e55-4bb6-44f6-9b02-122cd76f22a9 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:26.716796 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6da49e55-4bb6-44f6-9b02-122cd76f22a9 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:26.727329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9703e11f-3434-462f-946e-68f15002559d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:26.748057 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9703e11f-3434-462f-946e-68f15002559d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3" status: 200 len: 1315 microversion: 2.1 time: 0.353313 Jul 25 14:41:26.748817 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1957/3688] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:26 2022] GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3 => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:26.773683 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6fab47c2-5e18-4c3d-834d-099b18604350 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:26.785438 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6fab47c2-5e18-4c3d-834d-099b18604350 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:26.788599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:41:26.815213 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6da49e55-4bb6-44f6-9b02-122cd76f22a9 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:26.826593 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6da49e55-4bb6-44f6-9b02-122cd76f22a9 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:26.828590 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6fab47c2-5e18-4c3d-834d-099b18604350 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:26.829462 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6da49e55-4bb6-44f6-9b02-122cd76f22a9 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:26.829639 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6fab47c2-5e18-4c3d-834d-099b18604350 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:26.830665 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6da49e55-4bb6-44f6-9b02-122cd76f22a9 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 200 len: 1276 microversion: 2.47 time: 0.119292 Jul 25 14:41:26.830801 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6fab47c2-5e18-4c3d-834d-099b18604350 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:26.831411 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6fab47c2-5e18-4c3d-834d-099b18604350 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:26.844173 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1732/3689] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:26 2022] GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 1276 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:41:26.853000 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-818c32b7-c6ff-4df9-b704-3dad9e055069 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:26.854010 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-818c32b7-c6ff-4df9-b704-3dad9e055069 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] [instance: cf91c15b-9ab5-4155-a405-e74dc6536168] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:26.861411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-818c32b7-c6ff-4df9-b704-3dad9e055069 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:26.861871 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-818c32b7-c6ff-4df9-b704-3dad9e055069 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:26.862714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-818c32b7-c6ff-4df9-b704-3dad9e055069 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:26.863710 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-818c32b7-c6ff-4df9-b704-3dad9e055069 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:27.114415 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-818c32b7-c6ff-4df9-b704-3dad9e055069 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9b242dbcd4d169f8c1d5349f207cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5a1b4a12604e58b538b2b27dc63894', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:27.124781 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-818c32b7-c6ff-4df9-b704-3dad9e055069 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] 10.222.0.88 "GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168" status: 200 len: 1327 microversion: 2.1 time: 0.279011 Jul 25 14:41:27.125822 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1733/3690] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:26 2022] GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168 => generated 1327 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:27.131395 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-554d2102-ccc7-4e32-a57d-3ec015d4e821 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:27.132190 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-554d2102-ccc7-4e32-a57d-3ec015d4e821 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: dfb8c05d-0ccc-4b4d-a920-d8238e56f0de] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:27.138892 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-554d2102-ccc7-4e32-a57d-3ec015d4e821 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:27.139474 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-554d2102-ccc7-4e32-a57d-3ec015d4e821 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:27.140384 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-554d2102-ccc7-4e32-a57d-3ec015d4e821 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:27.141120 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-554d2102-ccc7-4e32-a57d-3ec015d4e821 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:27.153978 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6fab47c2-5e18-4c3d-834d-099b18604350 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6af371df8364e5b8362add7335ec4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee3d3418544f2ea0558abb27b1c796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:27.163811 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6fab47c2-5e18-4c3d-834d-099b18604350 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da" status: 200 len: 1372 microversion: 2.1 time: 0.412643 Jul 25 14:41:27.164668 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1958/3691] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:26 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da => generated 1372 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:27.300092 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-554d2102-ccc7-4e32-a57d-3ec015d4e821 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:27.308616 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-554d2102-ccc7-4e32-a57d-3ec015d4e821 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de" status: 200 len: 1318 microversion: 2.1 time: 0.181374 Jul 25 14:41:27.323216 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1734/3692] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:27 2022] GET /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:27.733718 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6d315b1d-6533-48b8-b198-1ed89206cde0 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:27.734326 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6d315b1d-6533-48b8-b198-1ed89206cde0 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:27.742193 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d315b1d-6533-48b8-b198-1ed89206cde0 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:27.742655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d315b1d-6533-48b8-b198-1ed89206cde0 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:27.743426 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d315b1d-6533-48b8-b198-1ed89206cde0 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:27.743853 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d315b1d-6533-48b8-b198-1ed89206cde0 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:27.773935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cc2e8165-ae4d-4188-adb0-07e09ccaa955 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:27.774616 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cc2e8165-ae4d-4188-adb0-07e09ccaa955 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 86d15cd4-fd8d-43ac-a471-6c7c19f778f3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:27.781733 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cc2e8165-ae4d-4188-adb0-07e09ccaa955 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:27.782527 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cc2e8165-ae4d-4188-adb0-07e09ccaa955 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:27.783559 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cc2e8165-ae4d-4188-adb0-07e09ccaa955 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:27.784175 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cc2e8165-ae4d-4188-adb0-07e09ccaa955 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:28.018496 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6d315b1d-6533-48b8-b198-1ed89206cde0 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:28.024820 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cc2e8165-ae4d-4188-adb0-07e09ccaa955 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:28.028613 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6d315b1d-6533-48b8-b198-1ed89206cde0 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1510 microversion: 2.1 time: 0.299628 Jul 25 14:41:28.030011 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1959/3693] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:27 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1510 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:28.037180 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-32523475-7e3c-4bc2-9f55-db3473f32cee tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:28.037808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-32523475-7e3c-4bc2-9f55-db3473f32cee tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:28.044690 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-32523475-7e3c-4bc2-9f55-db3473f32cee tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:28.045339 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-32523475-7e3c-4bc2-9f55-db3473f32cee tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:28.046288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-32523475-7e3c-4bc2-9f55-db3473f32cee tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:28.046549 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cc2e8165-ae4d-4188-adb0-07e09ccaa955 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3" status: 200 len: 1315 microversion: 2.1 time: 0.276543 Jul 25 14:41:28.047033 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1735/3694] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:27 2022] GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:28.048043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-32523475-7e3c-4bc2-9f55-db3473f32cee tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:28.129488 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-32523475-7e3c-4bc2-9f55-db3473f32cee tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:28.139145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-32523475-7e3c-4bc2-9f55-db3473f32cee tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:28.140707 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-32523475-7e3c-4bc2-9f55-db3473f32cee tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:28.141854 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-32523475-7e3c-4bc2-9f55-db3473f32cee tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 200 len: 1336 microversion: 2.47 time: 0.110846 Jul 25 14:41:28.142442 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1960/3695] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:28 2022] GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 1336 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:41:28.161731 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6461932a-17fd-4e94-b9b4-dafffc074f24 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:28.162351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6461932a-17fd-4e94-b9b4-dafffc074f24 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] [instance: cf91c15b-9ab5-4155-a405-e74dc6536168] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:28.168840 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6461932a-17fd-4e94-b9b4-dafffc074f24 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:28.169313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6461932a-17fd-4e94-b9b4-dafffc074f24 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:28.170075 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6461932a-17fd-4e94-b9b4-dafffc074f24 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:28.170511 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6461932a-17fd-4e94-b9b4-dafffc074f24 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:28.184970 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fd7e7196-aae1-4bfb-baca-12e6e757200c tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:28.185693 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fd7e7196-aae1-4bfb-baca-12e6e757200c tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:28.193818 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fd7e7196-aae1-4bfb-baca-12e6e757200c tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:28.194253 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fd7e7196-aae1-4bfb-baca-12e6e757200c tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:28.195004 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fd7e7196-aae1-4bfb-baca-12e6e757200c tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:28.195457 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fd7e7196-aae1-4bfb-baca-12e6e757200c tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:28.445258 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6461932a-17fd-4e94-b9b4-dafffc074f24 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9b242dbcd4d169f8c1d5349f207cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5a1b4a12604e58b538b2b27dc63894', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:28.460330 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6461932a-17fd-4e94-b9b4-dafffc074f24 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] 10.222.0.88 "GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168" status: 200 len: 1327 microversion: 2.1 time: 0.302828 Jul 25 14:41:28.472948 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1736/3696] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:28 2022] GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168 => generated 1327 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:28.484486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-35c83c92-b293-4c46-9371-c2034f333378 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:28.485158 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-35c83c92-b293-4c46-9371-c2034f333378 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: dfb8c05d-0ccc-4b4d-a920-d8238e56f0de] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:28.492773 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-35c83c92-b293-4c46-9371-c2034f333378 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:28.493229 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-35c83c92-b293-4c46-9371-c2034f333378 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:28.494303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-35c83c92-b293-4c46-9371-c2034f333378 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:28.494869 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-35c83c92-b293-4c46-9371-c2034f333378 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:28.609856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fd7e7196-aae1-4bfb-baca-12e6e757200c tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6af371df8364e5b8362add7335ec4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee3d3418544f2ea0558abb27b1c796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:28.619354 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fd7e7196-aae1-4bfb-baca-12e6e757200c tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da" status: 200 len: 1372 microversion: 2.1 time: 0.438182 Jul 25 14:41:28.620307 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1961/3697] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:28 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da => generated 1372 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:41:28.654213 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-35c83c92-b293-4c46-9371-c2034f333378 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:28.662979 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-35c83c92-b293-4c46-9371-c2034f333378 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de" status: 200 len: 1318 microversion: 2.1 time: 0.188222 Jul 25 14:41:28.663570 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1737/3698] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:28 2022] GET /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:29.051444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ed13a669-fe0c-4a05-943d-5d340611fa17 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:29.052281 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ed13a669-fe0c-4a05-943d-5d340611fa17 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:29.059109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed13a669-fe0c-4a05-943d-5d340611fa17 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:29.059563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed13a669-fe0c-4a05-943d-5d340611fa17 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:29.060416 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed13a669-fe0c-4a05-943d-5d340611fa17 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:29.060852 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed13a669-fe0c-4a05-943d-5d340611fa17 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:29.067006 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-18dc1114-b727-400c-97b6-355de99e309e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:29.067558 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-18dc1114-b727-400c-97b6-355de99e309e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 86d15cd4-fd8d-43ac-a471-6c7c19f778f3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:29.073905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-18dc1114-b727-400c-97b6-355de99e309e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:29.074352 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-18dc1114-b727-400c-97b6-355de99e309e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:29.075136 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-18dc1114-b727-400c-97b6-355de99e309e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:29.075575 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-18dc1114-b727-400c-97b6-355de99e309e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:29.208733 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-18dc1114-b727-400c-97b6-355de99e309e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:29.216414 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-18dc1114-b727-400c-97b6-355de99e309e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3" status: 200 len: 1315 microversion: 2.1 time: 0.153582 Jul 25 14:41:29.216982 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1738/3699] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:29 2022] GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:29.221550 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-301917b0-9984-4d86-9ca5-c568446f7deb tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:29.222172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-301917b0-9984-4d86-9ca5-c568446f7deb tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:29.228201 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-301917b0-9984-4d86-9ca5-c568446f7deb tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:29.228652 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-301917b0-9984-4d86-9ca5-c568446f7deb tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:29.229413 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-301917b0-9984-4d86-9ca5-c568446f7deb tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:29.229844 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-301917b0-9984-4d86-9ca5-c568446f7deb tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:29.281148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ed13a669-fe0c-4a05-943d-5d340611fa17 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:29.290068 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ed13a669-fe0c-4a05-943d-5d340611fa17 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1510 microversion: 2.1 time: 0.242744 Jul 25 14:41:29.294327 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-301917b0-9984-4d86-9ca5-c568446f7deb tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:29.300448 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1962/3700] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:29 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1510 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:29.303395 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-301917b0-9984-4d86-9ca5-c568446f7deb tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:29.305070 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-301917b0-9984-4d86-9ca5-c568446f7deb tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:29.306220 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-301917b0-9984-4d86-9ca5-c568446f7deb tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 200 len: 1334 microversion: 2.47 time: 0.088343 Jul 25 14:41:29.306777 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1739/3701] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:29 2022] GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 1334 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:41:29.485599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7675823a-eb18-480d-8a36-bfab6b8b661e tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:29.486228 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7675823a-eb18-480d-8a36-bfab6b8b661e tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] [instance: cf91c15b-9ab5-4155-a405-e74dc6536168] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:29.492873 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7675823a-eb18-480d-8a36-bfab6b8b661e tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:29.493355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7675823a-eb18-480d-8a36-bfab6b8b661e tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:29.494116 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7675823a-eb18-480d-8a36-bfab6b8b661e tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:29.494548 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7675823a-eb18-480d-8a36-bfab6b8b661e tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:29.646488 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cb26eaa1-e098-48cd-9831-bd13394abb97 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:29.647438 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cb26eaa1-e098-48cd-9831-bd13394abb97 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:29.654367 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cb26eaa1-e098-48cd-9831-bd13394abb97 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:29.655172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cb26eaa1-e098-48cd-9831-bd13394abb97 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:29.656242 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cb26eaa1-e098-48cd-9831-bd13394abb97 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:29.656982 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cb26eaa1-e098-48cd-9831-bd13394abb97 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:29.794203 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7675823a-eb18-480d-8a36-bfab6b8b661e tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9b242dbcd4d169f8c1d5349f207cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5a1b4a12604e58b538b2b27dc63894', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:29.804968 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7675823a-eb18-480d-8a36-bfab6b8b661e tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] 10.222.0.88 "GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168" status: 200 len: 1327 microversion: 2.1 time: 0.323200 Jul 25 14:41:29.822965 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1963/3702] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:29 2022] GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168 => generated 1327 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:29.831755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-01a8d175-16a7-42c3-a62e-4c8224fbf36a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:29.833742 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-01a8d175-16a7-42c3-a62e-4c8224fbf36a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: dfb8c05d-0ccc-4b4d-a920-d8238e56f0de] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:29.842446 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01a8d175-16a7-42c3-a62e-4c8224fbf36a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:29.843685 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01a8d175-16a7-42c3-a62e-4c8224fbf36a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:29.844872 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01a8d175-16a7-42c3-a62e-4c8224fbf36a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:29.845535 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01a8d175-16a7-42c3-a62e-4c8224fbf36a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:29.868289 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cb26eaa1-e098-48cd-9831-bd13394abb97 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6af371df8364e5b8362add7335ec4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee3d3418544f2ea0558abb27b1c796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:29.876613 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cb26eaa1-e098-48cd-9831-bd13394abb97 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da" status: 200 len: 1372 microversion: 2.1 time: 0.234013 Jul 25 14:41:29.877895 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1740/3703] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:29 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da => generated 1372 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:41:30.172081 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-01a8d175-16a7-42c3-a62e-4c8224fbf36a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:30.180347 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-01a8d175-16a7-42c3-a62e-4c8224fbf36a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de" status: 200 len: 1318 microversion: 2.1 time: 0.354424 Jul 25 14:41:30.181059 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1964/3704] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:29 2022] GET /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:30.237277 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-392f2672-ca09-4806-9772-5924adbf1667 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:30.238533 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-392f2672-ca09-4806-9772-5924adbf1667 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 86d15cd4-fd8d-43ac-a471-6c7c19f778f3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:30.246021 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-392f2672-ca09-4806-9772-5924adbf1667 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:30.246580 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-392f2672-ca09-4806-9772-5924adbf1667 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:30.247442 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-392f2672-ca09-4806-9772-5924adbf1667 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:30.247950 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-392f2672-ca09-4806-9772-5924adbf1667 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:30.311720 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b91e3cc4-fce6-44e2-a2f1-c130f32af50e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:30.313212 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b91e3cc4-fce6-44e2-a2f1-c130f32af50e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:30.326922 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b91e3cc4-fce6-44e2-a2f1-c130f32af50e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:30.328891 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b91e3cc4-fce6-44e2-a2f1-c130f32af50e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:30.330101 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b91e3cc4-fce6-44e2-a2f1-c130f32af50e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:30.331337 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b91e3cc4-fce6-44e2-a2f1-c130f32af50e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:30.448543 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-392f2672-ca09-4806-9772-5924adbf1667 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:30.456854 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-392f2672-ca09-4806-9772-5924adbf1667 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3" status: 200 len: 1315 microversion: 2.1 time: 0.223472 Jul 25 14:41:30.457459 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1741/3705] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:30 2022] GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:30.462803 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ab0ec59c-8aa7-4371-a05d-188509d4c1d7 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:30.463719 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ab0ec59c-8aa7-4371-a05d-188509d4c1d7 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:30.470290 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab0ec59c-8aa7-4371-a05d-188509d4c1d7 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:30.470742 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab0ec59c-8aa7-4371-a05d-188509d4c1d7 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:30.471541 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab0ec59c-8aa7-4371-a05d-188509d4c1d7 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:30.472006 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab0ec59c-8aa7-4371-a05d-188509d4c1d7 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:30.549677 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ab0ec59c-8aa7-4371-a05d-188509d4c1d7 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:30.558305 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ab0ec59c-8aa7-4371-a05d-188509d4c1d7 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:30.559880 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ab0ec59c-8aa7-4371-a05d-188509d4c1d7 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:30.561465 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ab0ec59c-8aa7-4371-a05d-188509d4c1d7 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 200 len: 1334 microversion: 2.47 time: 0.102819 Jul 25 14:41:30.562673 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1742/3706] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:30 2022] GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 1334 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:41:30.568439 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-7732ef43-5756-4c99-8a31-1043d45f708e req-9b760e82-0c2c-4b1d-9ec8-9fdbf2643889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86d15cd4-fd8d-43ac-a471-6c7c19f778f3", "name": "network-vif-plugged", "status": "completed", "tag": "49211c83-89f7-4354-a36e-803f5c21cfab"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:30.580659 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-7732ef43-5756-4c99-8a31-1043d45f708e req-9b760e82-0c2c-4b1d-9ec8-9fdbf2643889 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:30.581406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-7732ef43-5756-4c99-8a31-1043d45f708e req-9b760e82-0c2c-4b1d-9ec8-9fdbf2643889 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:30.593463 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-7732ef43-5756-4c99-8a31-1043d45f708e req-9b760e82-0c2c-4b1d-9ec8-9fdbf2643889 service nova] Creating event network-vif-plugged:49211c83-89f7-4354-a36e-803f5c21cfab for instance 86d15cd4-fd8d-43ac-a471-6c7c19f778f3 on n-h1-846435-14 Jul 25 14:41:30.599762 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-7732ef43-5756-4c99-8a31-1043d45f708e req-9b760e82-0c2c-4b1d-9ec8-9fdbf2643889 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035760 Jul 25 14:41:30.600935 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1743/3707] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:41:30.606865 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1cccc8f8-6a56-4234-84f6-597ea4b5a7d3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:30.607589 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1cccc8f8-6a56-4234-84f6-597ea4b5a7d3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:30.614326 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1cccc8f8-6a56-4234-84f6-597ea4b5a7d3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:30.615053 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1cccc8f8-6a56-4234-84f6-597ea4b5a7d3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:30.615847 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1cccc8f8-6a56-4234-84f6-597ea4b5a7d3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:30.616341 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1cccc8f8-6a56-4234-84f6-597ea4b5a7d3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:30.634770 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:41:30.644181 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1cccc8f8-6a56-4234-84f6-597ea4b5a7d3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914/ips" status: 200 len: 153 microversion: 2.20 time: 0.041581 Jul 25 14:41:30.644822 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1744/3708] 10.222.0.88 () {60 vars in 1289 bytes} [Mon Jul 25 14:41:30 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914/ips => generated 153 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:41:30.827505 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b15e6871-6395-42b9-ba21-ab90a6f90a7e tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:30.828469 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b15e6871-6395-42b9-ba21-ab90a6f90a7e tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] [instance: cf91c15b-9ab5-4155-a405-e74dc6536168] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:30.833405 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b91e3cc4-fce6-44e2-a2f1-c130f32af50e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:30.838439 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b15e6871-6395-42b9-ba21-ab90a6f90a7e tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:30.839112 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b15e6871-6395-42b9-ba21-ab90a6f90a7e tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:30.840158 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b15e6871-6395-42b9-ba21-ab90a6f90a7e tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:30.840875 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b15e6871-6395-42b9-ba21-ab90a6f90a7e tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:30.845301 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b91e3cc4-fce6-44e2-a2f1-c130f32af50e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1510 microversion: 2.1 time: 0.537863 Jul 25 14:41:30.862473 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1965/3709] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:30 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1510 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:41:30.904022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9052fae7-051e-49b9-a431-0f795331bf44 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:30.905284 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9052fae7-051e-49b9-a431-0f795331bf44 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:30.913557 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9052fae7-051e-49b9-a431-0f795331bf44 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:30.914369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9052fae7-051e-49b9-a431-0f795331bf44 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:30.916565 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9052fae7-051e-49b9-a431-0f795331bf44 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:30.917041 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9052fae7-051e-49b9-a431-0f795331bf44 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:31.056845 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b15e6871-6395-42b9-ba21-ab90a6f90a7e tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9b242dbcd4d169f8c1d5349f207cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5a1b4a12604e58b538b2b27dc63894', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:31.065281 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b15e6871-6395-42b9-ba21-ab90a6f90a7e tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] 10.222.0.88 "GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168" status: 200 len: 1327 microversion: 2.1 time: 0.242393 Jul 25 14:41:31.065997 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1745/3710] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:30 2022] GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168 => generated 1327 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:41:31.186723 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9052fae7-051e-49b9-a431-0f795331bf44 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6af371df8364e5b8362add7335ec4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee3d3418544f2ea0558abb27b1c796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:31.195173 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9052fae7-051e-49b9-a431-0f795331bf44 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da" status: 200 len: 1372 microversion: 2.1 time: 0.298600 Jul 25 14:41:31.195745 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1966/3711] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:30 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da => generated 1372 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:31.207763 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3dcd04a6-c269-46aa-a683-fc51d53b7ea2 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:31.208695 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3dcd04a6-c269-46aa-a683-fc51d53b7ea2 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: dfb8c05d-0ccc-4b4d-a920-d8238e56f0de] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:31.217966 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3dcd04a6-c269-46aa-a683-fc51d53b7ea2 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:31.219728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3dcd04a6-c269-46aa-a683-fc51d53b7ea2 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:31.220563 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3dcd04a6-c269-46aa-a683-fc51d53b7ea2 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:31.221020 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3dcd04a6-c269-46aa-a683-fc51d53b7ea2 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:31.402033 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3dcd04a6-c269-46aa-a683-fc51d53b7ea2 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:31.411832 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3dcd04a6-c269-46aa-a683-fc51d53b7ea2 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de" status: 200 len: 1468 microversion: 2.1 time: 0.210017 Jul 25 14:41:31.413144 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1746/3712] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:31 2022] GET /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de => generated 1468 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:31.436629 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9260ed6d-8494-4553-893c-81e341d95690 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1010540259"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:31.439244 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9260ed6d-8494-4553-893c-81e341d95690 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: dfb8c05d-0ccc-4b4d-a920-d8238e56f0de] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:31.452866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9260ed6d-8494-4553-893c-81e341d95690 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:31.453565 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9260ed6d-8494-4553-893c-81e341d95690 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:31.454506 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9260ed6d-8494-4553-893c-81e341d95690 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:31.455105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9260ed6d-8494-4553-893c-81e341d95690 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:31.482409 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-881da991-09f3-4e28-828e-3a99a6bac9cc tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:31.483319 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-881da991-09f3-4e28-828e-3a99a6bac9cc tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 86d15cd4-fd8d-43ac-a471-6c7c19f778f3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:31.489605 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:41:31.491661 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-881da991-09f3-4e28-828e-3a99a6bac9cc tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:31.492334 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-881da991-09f3-4e28-828e-3a99a6bac9cc tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:31.493293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-881da991-09f3-4e28-828e-3a99a6bac9cc tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:31.494146 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-881da991-09f3-4e28-828e-3a99a6bac9cc tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:31.689102 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9260ed6d-8494-4553-893c-81e341d95690 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "POST /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de/action" status: 202 len: 0 microversion: 2.1 time: 0.258772 Jul 25 14:41:31.690407 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1967/3713] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:41:31 2022] POST /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 14:41:31.695741 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d5913a57-68de-4e5a-b13f-44f29d2a8dfd tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:31.696826 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d5913a57-68de-4e5a-b13f-44f29d2a8dfd tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:31.706370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5913a57-68de-4e5a-b13f-44f29d2a8dfd tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:31.706803 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5913a57-68de-4e5a-b13f-44f29d2a8dfd tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:31.707580 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5913a57-68de-4e5a-b13f-44f29d2a8dfd tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:31.708082 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5913a57-68de-4e5a-b13f-44f29d2a8dfd tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:31.745873 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-881da991-09f3-4e28-828e-3a99a6bac9cc tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:31.758781 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-881da991-09f3-4e28-828e-3a99a6bac9cc tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3" status: 200 len: 1315 microversion: 2.1 time: 0.280250 Jul 25 14:41:31.765625 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1747/3714] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:31 2022] GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:41:31.770637 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-73d2733e-0ab2-408d-a47f-76f673ce45fb tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46988adb80>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:31.781205 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d5913a57-68de-4e5a-b13f-44f29d2a8dfd tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:31.791367 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d5913a57-68de-4e5a-b13f-44f29d2a8dfd tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:31.793055 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d5913a57-68de-4e5a-b13f-44f29d2a8dfd tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:31.794353 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d5913a57-68de-4e5a-b13f-44f29d2a8dfd tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 200 len: 1355 microversion: 2.47 time: 0.102586 Jul 25 14:41:31.795250 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1968/3715] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:31 2022] GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 1355 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:41:31.818034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a110acef-4aec-4285-8181-b99024e070f0 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:31.821334 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a110acef-4aec-4285-8181-b99024e070f0 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:31.826646 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-73d2733e-0ab2-408d-a47f-76f673ce45fb tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc" status: 200 len: 1455 microversion: 2.1 time: 0.059691 Jul 25 14:41:31.827507 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1748/3716] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:41:31 2022] GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc => generated 1455 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:31.827845 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a110acef-4aec-4285-8181-b99024e070f0 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:31.828489 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a110acef-4aec-4285-8181-b99024e070f0 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:31.829415 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a110acef-4aec-4285-8181-b99024e070f0 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:31.830055 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a110acef-4aec-4285-8181-b99024e070f0 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:31.866804 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c1f70b5c-5adf-4fe2-8917-8cfeff4c6d55 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:31.867711 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c1f70b5c-5adf-4fe2-8917-8cfeff4c6d55 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:31.874366 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c1f70b5c-5adf-4fe2-8917-8cfeff4c6d55 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:31.875035 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c1f70b5c-5adf-4fe2-8917-8cfeff4c6d55 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:31.876014 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c1f70b5c-5adf-4fe2-8917-8cfeff4c6d55 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:31.876631 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c1f70b5c-5adf-4fe2-8917-8cfeff4c6d55 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:31.945034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-a110acef-4aec-4285-8181-b99024e070f0 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:41:31.950022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-a110acef-4aec-4285-8181-b99024e070f0 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:41:31.950231 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-a110acef-4aec-4285-8181-b99024e070f0 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:41:31.950828 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-a110acef-4aec-4285-8181-b99024e070f0 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:41:31.952155 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-a110acef-4aec-4285-8181-b99024e070f0 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:41:32.104034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a110acef-4aec-4285-8181-b99024e070f0 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:32.122566 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a110acef-4aec-4285-8181-b99024e070f0 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:32.131470 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a110acef-4aec-4285-8181-b99024e070f0 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:32.138322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a110acef-4aec-4285-8181-b99024e070f0 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:32.139003 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a110acef-4aec-4285-8181-b99024e070f0 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:32.219216 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a110acef-4aec-4285-8181-b99024e070f0 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "POST /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481/action" status: 202 len: 1077 microversion: 2.47 time: 0.405729 Jul 25 14:41:32.240359 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1969/3717] 10.222.0.88 () {62 vars in 1319 bytes} [Mon Jul 25 14:41:31 2022] POST /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481/action => generated 1077 bytes in 427 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 25 14:41:32.246811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7c9a879a-4189-4965-a401-29d5607cbd2d tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:32.246811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7c9a879a-4189-4965-a401-29d5607cbd2d tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] [instance: cf91c15b-9ab5-4155-a405-e74dc6536168] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:32.253335 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7c9a879a-4189-4965-a401-29d5607cbd2d tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:32.253925 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7c9a879a-4189-4965-a401-29d5607cbd2d tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:32.254934 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7c9a879a-4189-4965-a401-29d5607cbd2d tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:32.255615 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7c9a879a-4189-4965-a401-29d5607cbd2d tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:32.467017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7c9a879a-4189-4965-a401-29d5607cbd2d tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9b242dbcd4d169f8c1d5349f207cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5a1b4a12604e58b538b2b27dc63894', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:32.475265 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7c9a879a-4189-4965-a401-29d5607cbd2d tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] 10.222.0.88 "GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168" status: 200 len: 1327 microversion: 2.1 time: 0.233475 Jul 25 14:41:32.492080 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1970/3718] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:32 2022] GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168 => generated 1327 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:32.497309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e1d03320-9efe-46fb-88d9-e1e1bcdda709 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:32.498185 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e1d03320-9efe-46fb-88d9-e1e1bcdda709 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:32.504956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e1d03320-9efe-46fb-88d9-e1e1bcdda709 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:32.505525 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e1d03320-9efe-46fb-88d9-e1e1bcdda709 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:32.509416 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e1d03320-9efe-46fb-88d9-e1e1bcdda709 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:32.509943 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e1d03320-9efe-46fb-88d9-e1e1bcdda709 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:32.583043 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c1f70b5c-5adf-4fe2-8917-8cfeff4c6d55 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:32.595662 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c1f70b5c-5adf-4fe2-8917-8cfeff4c6d55 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1510 microversion: 2.1 time: 0.732107 Jul 25 14:41:32.596583 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1749/3719] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:31 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1510 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:41:32.604883 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-990e8a0c-c346-4015-906a-8075347747d2 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:32.616498 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-990e8a0c-c346-4015-906a-8075347747d2 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:32.623765 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-990e8a0c-c346-4015-906a-8075347747d2 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:32.635744 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-990e8a0c-c346-4015-906a-8075347747d2 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:32.637024 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-990e8a0c-c346-4015-906a-8075347747d2 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:32.639846 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-990e8a0c-c346-4015-906a-8075347747d2 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:32.743322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e1d03320-9efe-46fb-88d9-e1e1bcdda709 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6af371df8364e5b8362add7335ec4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee3d3418544f2ea0558abb27b1c796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:32.753974 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e1d03320-9efe-46fb-88d9-e1e1bcdda709 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da" status: 200 len: 1372 microversion: 2.1 time: 0.260444 Jul 25 14:41:32.754911 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1971/3720] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:32 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da => generated 1372 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:32.775703 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-521b0bae-7e91-4f66-bf9e-cbeabf2d3986 req-f50aa19a-b4ab-4389-917a-60a22cf954b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf91c15b-9ab5-4155-a405-e74dc6536168", "name": "network-vif-plugged", "status": "completed", "tag": "71e35f1c-c56f-4975-9638-7a9ac203cf4d"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:32.780680 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-990e8a0c-c346-4015-906a-8075347747d2 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:32.791714 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-521b0bae-7e91-4f66-bf9e-cbeabf2d3986 req-f50aa19a-b4ab-4389-917a-60a22cf954b5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:32.792329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-521b0bae-7e91-4f66-bf9e-cbeabf2d3986 req-f50aa19a-b4ab-4389-917a-60a22cf954b5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:32.794429 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-990e8a0c-c346-4015-906a-8075347747d2 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:32.804123 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-990e8a0c-c346-4015-906a-8075347747d2 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:32.805817 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-990e8a0c-c346-4015-906a-8075347747d2 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 200 len: 1364 microversion: 2.47 time: 0.205144 Jul 25 14:41:32.806922 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1750/3721] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:32 2022] GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 1364 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:41:32.807735 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-521b0bae-7e91-4f66-bf9e-cbeabf2d3986 req-f50aa19a-b4ab-4389-917a-60a22cf954b5 service nova] Creating event network-vif-plugged:71e35f1c-c56f-4975-9638-7a9ac203cf4d for instance cf91c15b-9ab5-4155-a405-e74dc6536168 on n-h2-846435-14 Jul 25 14:41:32.813938 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-521b0bae-7e91-4f66-bf9e-cbeabf2d3986 req-f50aa19a-b4ab-4389-917a-60a22cf954b5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043248 Jul 25 14:41:32.815016 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1972/3722] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:41:32.820919 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-64f06ee2-43d0-49cd-a110-164fe3f94ab0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:32.821744 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-64f06ee2-43d0-49cd-a110-164fe3f94ab0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 86d15cd4-fd8d-43ac-a471-6c7c19f778f3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:32.828584 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-64f06ee2-43d0-49cd-a110-164fe3f94ab0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:32.829347 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-64f06ee2-43d0-49cd-a110-164fe3f94ab0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:32.830396 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-64f06ee2-43d0-49cd-a110-164fe3f94ab0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:32.831009 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-64f06ee2-43d0-49cd-a110-164fe3f94ab0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:32.865608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c6ac1f67-d487-46c5-89a9-25a3fbc0f7eb tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f468632c160>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:32.946098 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c6ac1f67-d487-46c5-89a9-25a3fbc0f7eb tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc" status: 200 len: 1455 microversion: 2.1 time: 0.107973 Jul 25 14:41:32.948089 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1973/3723] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:41:32 2022] GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc => generated 1455 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:41:33.076250 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-64f06ee2-43d0-49cd-a110-164fe3f94ab0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:33.087776 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-64f06ee2-43d0-49cd-a110-164fe3f94ab0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3" status: 200 len: 1502 microversion: 2.1 time: 0.278838 Jul 25 14:41:33.089065 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1751/3724] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:32 2022] GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3 => generated 1502 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:33.109976 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-795f00cd-e438-4383-bb07-1cfa17d1ca29 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:33.110625 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-795f00cd-e438-4383-bb07-1cfa17d1ca29 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 86d15cd4-fd8d-43ac-a471-6c7c19f778f3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:33.120183 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-795f00cd-e438-4383-bb07-1cfa17d1ca29 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:33.120729 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-795f00cd-e438-4383-bb07-1cfa17d1ca29 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:33.121777 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-795f00cd-e438-4383-bb07-1cfa17d1ca29 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:33.122340 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-795f00cd-e438-4383-bb07-1cfa17d1ca29 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:33.152709 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-795f00cd-e438-4383-bb07-1cfa17d1ca29 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 86d15cd4-fd8d-43ac-a471-6c7c19f778f3] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:41:33.278868 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-795f00cd-e438-4383-bb07-1cfa17d1ca29 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "DELETE /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3" status: 204 len: 0 microversion: 2.1 time: 0.173711 Jul 25 14:41:33.280043 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1974/3725] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:41:33 2022] DELETE /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:41:33.292704 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f4bb6161-570c-4d45-86a5-15ed8d44ac2c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:33.293859 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f4bb6161-570c-4d45-86a5-15ed8d44ac2c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 86d15cd4-fd8d-43ac-a471-6c7c19f778f3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:33.305109 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f4bb6161-570c-4d45-86a5-15ed8d44ac2c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:33.306027 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f4bb6161-570c-4d45-86a5-15ed8d44ac2c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:33.307281 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f4bb6161-570c-4d45-86a5-15ed8d44ac2c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:33.307997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f4bb6161-570c-4d45-86a5-15ed8d44ac2c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:33.464017 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f4bb6161-570c-4d45-86a5-15ed8d44ac2c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:33.472777 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f4bb6161-570c-4d45-86a5-15ed8d44ac2c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3" status: 200 len: 1508 microversion: 2.1 time: 0.186938 Jul 25 14:41:33.473387 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1752/3726] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:33 2022] GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3 => generated 1508 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:33.497083 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4efb955b-4e26-4d2c-a847-fefd57cafa0a tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:33.497971 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4efb955b-4e26-4d2c-a847-fefd57cafa0a tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] [instance: cf91c15b-9ab5-4155-a405-e74dc6536168] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:33.504890 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4efb955b-4e26-4d2c-a847-fefd57cafa0a tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:33.505962 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4efb955b-4e26-4d2c-a847-fefd57cafa0a tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:33.506796 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4efb955b-4e26-4d2c-a847-fefd57cafa0a tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:33.507227 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4efb955b-4e26-4d2c-a847-fefd57cafa0a tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:33.617654 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-14d3aac1-1d18-4664-8724-b8c9cbe937c0 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:33.618258 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-14d3aac1-1d18-4664-8724-b8c9cbe937c0 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:33.624588 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14d3aac1-1d18-4664-8724-b8c9cbe937c0 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:33.625143 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14d3aac1-1d18-4664-8724-b8c9cbe937c0 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:33.625963 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14d3aac1-1d18-4664-8724-b8c9cbe937c0 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:33.626568 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14d3aac1-1d18-4664-8724-b8c9cbe937c0 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:33.777254 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4efb955b-4e26-4d2c-a847-fefd57cafa0a tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9b242dbcd4d169f8c1d5349f207cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5a1b4a12604e58b538b2b27dc63894', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:33.787213 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4efb955b-4e26-4d2c-a847-fefd57cafa0a tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] 10.222.0.88 "GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168" status: 200 len: 1327 microversion: 2.1 time: 0.294507 Jul 25 14:41:33.787789 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1975/3727] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:33 2022] GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168 => generated 1327 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:33.792765 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3261723b-07a4-4172-86c5-831ece611c34 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:33.793301 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3261723b-07a4-4172-86c5-831ece611c34 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:33.806697 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3261723b-07a4-4172-86c5-831ece611c34 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:33.807220 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3261723b-07a4-4172-86c5-831ece611c34 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:33.808043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3261723b-07a4-4172-86c5-831ece611c34 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:33.809058 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3261723b-07a4-4172-86c5-831ece611c34 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:33.822928 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-14d3aac1-1d18-4664-8724-b8c9cbe937c0 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:33.832263 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-3261723b-07a4-4172-86c5-831ece611c34 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lazy-loading 'flavor' on Instance uuid 034e5d63-63a1-4883-b7f8-fe84ec541914 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:41:33.833342 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-14d3aac1-1d18-4664-8724-b8c9cbe937c0 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1487 microversion: 2.1 time: 0.218860 Jul 25 14:41:33.833966 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1753/3728] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:33 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1487 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:33.838753 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1d5088f2-cb5b-4641-afc4-673f6bc2adc2 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:33.839597 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1d5088f2-cb5b-4641-afc4-673f6bc2adc2 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:33.847432 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d5088f2-cb5b-4641-afc4-673f6bc2adc2 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:33.848121 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d5088f2-cb5b-4641-afc4-673f6bc2adc2 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:33.849243 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d5088f2-cb5b-4641-afc4-673f6bc2adc2 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:33.849935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d5088f2-cb5b-4641-afc4-673f6bc2adc2 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:33.996357 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1d5088f2-cb5b-4641-afc4-673f6bc2adc2 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6af371df8364e5b8362add7335ec4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee3d3418544f2ea0558abb27b1c796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:34.004911 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1d5088f2-cb5b-4641-afc4-673f6bc2adc2 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da" status: 200 len: 1372 microversion: 2.1 time: 0.169586 Jul 25 14:41:34.012356 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1754/3729] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:33 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:34.019312 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a27d891e-e450-468e-a1b0-c24a3df373de tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:34.020126 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a27d891e-e450-468e-a1b0-c24a3df373de tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:34.027137 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a27d891e-e450-468e-a1b0-c24a3df373de tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:34.027722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a27d891e-e450-468e-a1b0-c24a3df373de tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:34.029381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a27d891e-e450-468e-a1b0-c24a3df373de tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:34.029928 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a27d891e-e450-468e-a1b0-c24a3df373de tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:34.039792 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3261723b-07a4-4172-86c5-831ece611c34 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "POST /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914/action" status: 202 len: 0 microversion: 2.20 time: 0.250751 Jul 25 14:41:34.043622 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1976/3730] 10.222.0.88 () {62 vars in 1319 bytes} [Mon Jul 25 14:41:33 2022] POST /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:41:34.045644 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f4a5156b-e049-4c4a-8660-2f41f9fc6077 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-481084587"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:34.048197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f4a5156b-e049-4c4a-8660-2f41f9fc6077 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:34.054590 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f4a5156b-e049-4c4a-8660-2f41f9fc6077 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:34.055033 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f4a5156b-e049-4c4a-8660-2f41f9fc6077 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:34.055797 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f4a5156b-e049-4c4a-8660-2f41f9fc6077 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:34.056258 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f4a5156b-e049-4c4a-8660-2f41f9fc6077 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:34.107718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a27d891e-e450-468e-a1b0-c24a3df373de tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:34.117302 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a27d891e-e450-468e-a1b0-c24a3df373de tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:34.118800 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a27d891e-e450-468e-a1b0-c24a3df373de tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:34.120009 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a27d891e-e450-468e-a1b0-c24a3df373de tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 200 len: 1364 microversion: 2.47 time: 0.106054 Jul 25 14:41:34.120787 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1755/3731] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:34 2022] GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 1364 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:41:34.125647 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3582b4a0-8ceb-4cd0-981c-f02683327a1b tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46874ec160>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:34.136954 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f4a5156b-e049-4c4a-8660-2f41f9fc6077 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "PUT /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1060 microversion: 2.1 time: 0.094363 Jul 25 14:41:34.144061 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1977/3732] 10.222.0.88 () {60 vars in 1256 bytes} [Mon Jul 25 14:41:34 2022] PUT /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1060 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:34.145254 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d5674a87-b640-4db9-a653-b0cfb390526b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:34.145909 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d5674a87-b640-4db9-a653-b0cfb390526b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:34.154254 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5674a87-b640-4db9-a653-b0cfb390526b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:34.154707 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5674a87-b640-4db9-a653-b0cfb390526b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:34.156188 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5674a87-b640-4db9-a653-b0cfb390526b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:34.156627 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5674a87-b640-4db9-a653-b0cfb390526b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:34.176918 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3582b4a0-8ceb-4cd0-981c-f02683327a1b tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc" status: 200 len: 1455 microversion: 2.1 time: 0.054643 Jul 25 14:41:34.185399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:41:34.185603 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1756/3733] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:41:34 2022] GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc => generated 1455 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:34.191630 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-157f9ce8-7093-4920-ba91-8840673bfd9e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:34.192666 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-157f9ce8-7093-4920-ba91-8840673bfd9e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:34.199912 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-157f9ce8-7093-4920-ba91-8840673bfd9e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:34.200684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-157f9ce8-7093-4920-ba91-8840673bfd9e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:34.201501 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-157f9ce8-7093-4920-ba91-8840673bfd9e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:34.201948 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-157f9ce8-7093-4920-ba91-8840673bfd9e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:34.336220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-157f9ce8-7093-4920-ba91-8840673bfd9e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:34.346254 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-157f9ce8-7093-4920-ba91-8840673bfd9e tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1487 microversion: 2.1 time: 0.160649 Jul 25 14:41:34.346861 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1757/3734] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:34 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1487 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:34.366303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ba575351-f255-49a0-b272-cc5026e7efdd tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:34.366949 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ba575351-f255-49a0-b272-cc5026e7efdd tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:34.373470 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ba575351-f255-49a0-b272-cc5026e7efdd tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:34.373927 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ba575351-f255-49a0-b272-cc5026e7efdd tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:34.374721 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ba575351-f255-49a0-b272-cc5026e7efdd tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:34.375145 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ba575351-f255-49a0-b272-cc5026e7efdd tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:34.425539 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d5674a87-b640-4db9-a653-b0cfb390526b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:34.443496 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d5674a87-b640-4db9-a653-b0cfb390526b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:34.445638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d5674a87-b640-4db9-a653-b0cfb390526b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:34.447121 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d5674a87-b640-4db9-a653-b0cfb390526b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1726 microversion: 2.20 time: 0.308014 Jul 25 14:41:34.452056 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1978/3735] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:34 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1726 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:41:34.493665 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-531bb391-3440-424e-8065-8a55b05f9b40 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:34.494439 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-531bb391-3440-424e-8065-8a55b05f9b40 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 86d15cd4-fd8d-43ac-a471-6c7c19f778f3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:34.501329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-531bb391-3440-424e-8065-8a55b05f9b40 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:34.502659 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-531bb391-3440-424e-8065-8a55b05f9b40 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:34.503694 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-531bb391-3440-424e-8065-8a55b05f9b40 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:34.504369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-531bb391-3440-424e-8065-8a55b05f9b40 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:34.609487 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ba575351-f255-49a0-b272-cc5026e7efdd tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:34.617212 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ba575351-f255-49a0-b272-cc5026e7efdd tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1487 microversion: 2.1 time: 0.254964 Jul 25 14:41:34.617795 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1758/3736] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:34 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1487 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:34.636988 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0f821dfc-d455-4c03-9fe4-d32b9ab92daf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:34.637481 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0f821dfc-d455-4c03-9fe4-d32b9ab92daf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:34.643688 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f821dfc-d455-4c03-9fe4-d32b9ab92daf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:34.644195 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f821dfc-d455-4c03-9fe4-d32b9ab92daf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:34.644965 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f821dfc-d455-4c03-9fe4-d32b9ab92daf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:34.645440 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f821dfc-d455-4c03-9fe4-d32b9ab92daf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:34.671359 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0f821dfc-d455-4c03-9fe4-d32b9ab92daf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:41:34.734855 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-531bb391-3440-424e-8065-8a55b05f9b40 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:34.742915 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-531bb391-3440-424e-8065-8a55b05f9b40 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3" status: 200 len: 1508 microversion: 2.1 time: 0.253214 Jul 25 14:41:34.743705 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1979/3737] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:34 2022] GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3 => generated 1508 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:41:34.763135 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0f821dfc-d455-4c03-9fe4-d32b9ab92daf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "DELETE /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 204 len: 0 microversion: 2.1 time: 0.129643 Jul 25 14:41:34.763742 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1759/3738] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:41:34 2022] DELETE /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 14:41:34.775539 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5c4c661a-8fff-4c4a-af6d-7eaeb32ae609 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:34.776314 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5c4c661a-8fff-4c4a-af6d-7eaeb32ae609 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:34.783985 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c4c661a-8fff-4c4a-af6d-7eaeb32ae609 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:34.784815 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c4c661a-8fff-4c4a-af6d-7eaeb32ae609 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:34.785485 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c4c661a-8fff-4c4a-af6d-7eaeb32ae609 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:34.786105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c4c661a-8fff-4c4a-af6d-7eaeb32ae609 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:34.808974 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-549e59dd-6edc-4d36-b17e-edbd5ca7c10e tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:34.809689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-549e59dd-6edc-4d36-b17e-edbd5ca7c10e tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] [instance: cf91c15b-9ab5-4155-a405-e74dc6536168] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:34.816498 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-549e59dd-6edc-4d36-b17e-edbd5ca7c10e tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:34.817244 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-549e59dd-6edc-4d36-b17e-edbd5ca7c10e tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:34.818198 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-549e59dd-6edc-4d36-b17e-edbd5ca7c10e tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:34.818825 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-549e59dd-6edc-4d36-b17e-edbd5ca7c10e tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:34.957498 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-549e59dd-6edc-4d36-b17e-edbd5ca7c10e tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9b242dbcd4d169f8c1d5349f207cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5a1b4a12604e58b538b2b27dc63894', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:34.965272 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-549e59dd-6edc-4d36-b17e-edbd5ca7c10e tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] 10.222.0.88 "GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168" status: 200 len: 1327 microversion: 2.1 time: 0.160505 Jul 25 14:41:34.965847 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1760/3739] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:34 2022] GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168 => generated 1327 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:35.011689 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5c4c661a-8fff-4c4a-af6d-7eaeb32ae609 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:35.019728 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5c4c661a-8fff-4c4a-af6d-7eaeb32ae609 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1493 microversion: 2.1 time: 0.248222 Jul 25 14:41:35.026484 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1980/3740] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:34 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1493 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:35.026844 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-19291472-2ee6-41cf-a3bd-37682fc19323 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:35.026844 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-19291472-2ee6-41cf-a3bd-37682fc19323 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:35.037373 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-19291472-2ee6-41cf-a3bd-37682fc19323 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:35.037890 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-19291472-2ee6-41cf-a3bd-37682fc19323 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:35.038729 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-19291472-2ee6-41cf-a3bd-37682fc19323 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:35.039242 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-19291472-2ee6-41cf-a3bd-37682fc19323 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:35.143304 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f6a94d7a-94fb-4d56-9798-b17963ad00ea tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:35.143917 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f6a94d7a-94fb-4d56-9798-b17963ad00ea tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:35.150766 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6a94d7a-94fb-4d56-9798-b17963ad00ea tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:35.151211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6a94d7a-94fb-4d56-9798-b17963ad00ea tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:35.151990 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6a94d7a-94fb-4d56-9798-b17963ad00ea tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:35.152605 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6a94d7a-94fb-4d56-9798-b17963ad00ea tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:35.220708 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f6a94d7a-94fb-4d56-9798-b17963ad00ea tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:35.229127 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f6a94d7a-94fb-4d56-9798-b17963ad00ea tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:35.230615 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f6a94d7a-94fb-4d56-9798-b17963ad00ea tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:35.231816 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f6a94d7a-94fb-4d56-9798-b17963ad00ea tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 200 len: 1364 microversion: 2.47 time: 0.092557 Jul 25 14:41:35.232694 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1981/3741] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:35 2022] GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 1364 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:41:35.237394 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-16c39739-b3b0-4d2d-a41e-f0ec0ba48462 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f468631a820>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:35.261660 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-19291472-2ee6-41cf-a3bd-37682fc19323 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6af371df8364e5b8362add7335ec4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee3d3418544f2ea0558abb27b1c796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:35.265697 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:41:35.273940 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-19291472-2ee6-41cf-a3bd-37682fc19323 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da" status: 200 len: 1372 microversion: 2.1 time: 0.252215 Jul 25 14:41:35.274615 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1761/3742] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:35 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da => generated 1372 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:41:35.283732 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-16c39739-b3b0-4d2d-a41e-f0ec0ba48462 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc" status: 200 len: 1455 microversion: 2.1 time: 0.050207 Jul 25 14:41:35.284385 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1982/3743] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:41:35 2022] GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc => generated 1455 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:35.473482 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-50cffba7-94e7-4627-8494-554e2aec1e2f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:35.474211 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-50cffba7-94e7-4627-8494-554e2aec1e2f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:35.483076 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-50cffba7-94e7-4627-8494-554e2aec1e2f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:35.483762 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-50cffba7-94e7-4627-8494-554e2aec1e2f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:35.484815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-50cffba7-94e7-4627-8494-554e2aec1e2f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:35.485489 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-50cffba7-94e7-4627-8494-554e2aec1e2f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:35.698220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-50cffba7-94e7-4627-8494-554e2aec1e2f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:35.707896 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-50cffba7-94e7-4627-8494-554e2aec1e2f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:35.709504 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-50cffba7-94e7-4627-8494-554e2aec1e2f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:35.710727 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-50cffba7-94e7-4627-8494-554e2aec1e2f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1726 microversion: 2.20 time: 0.242579 Jul 25 14:41:35.711290 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1762/3744] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:35 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1726 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:41:35.765413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5e6beaa3-b109-4a1a-a5b8-2a89906f53ca tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:35.766157 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5e6beaa3-b109-4a1a-a5b8-2a89906f53ca tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 86d15cd4-fd8d-43ac-a471-6c7c19f778f3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:35.772530 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5e6beaa3-b109-4a1a-a5b8-2a89906f53ca tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:35.773045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5e6beaa3-b109-4a1a-a5b8-2a89906f53ca tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:35.773881 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5e6beaa3-b109-4a1a-a5b8-2a89906f53ca tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:35.774376 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5e6beaa3-b109-4a1a-a5b8-2a89906f53ca tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:35.944516 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5e6beaa3-b109-4a1a-a5b8-2a89906f53ca tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:35.953785 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5e6beaa3-b109-4a1a-a5b8-2a89906f53ca tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3" status: 200 len: 1508 microversion: 2.1 time: 0.192288 Jul 25 14:41:35.968241 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1983/3745] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:35 2022] GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3 => generated 1508 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:35.988082 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4f425120-446c-438d-9012-f62ef62fd3d0 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:35.988804 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4f425120-446c-438d-9012-f62ef62fd3d0 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] [instance: cf91c15b-9ab5-4155-a405-e74dc6536168] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:35.995874 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4f425120-446c-438d-9012-f62ef62fd3d0 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:35.996546 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4f425120-446c-438d-9012-f62ef62fd3d0 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:35.998173 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4f425120-446c-438d-9012-f62ef62fd3d0 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:35.998674 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4f425120-446c-438d-9012-f62ef62fd3d0 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:36.043713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fb1bdbbe-3ab6-49ec-8540-685a945f1291 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:36.044629 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fb1bdbbe-3ab6-49ec-8540-685a945f1291 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:36.055657 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fb1bdbbe-3ab6-49ec-8540-685a945f1291 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:36.059806 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fb1bdbbe-3ab6-49ec-8540-685a945f1291 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:36.060671 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fb1bdbbe-3ab6-49ec-8540-685a945f1291 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:36.061108 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fb1bdbbe-3ab6-49ec-8540-685a945f1291 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:36.205331 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=4 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:41:36.227647 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=12 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:41:36.398487 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4f425120-446c-438d-9012-f62ef62fd3d0 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9b242dbcd4d169f8c1d5349f207cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5a1b4a12604e58b538b2b27dc63894', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:36.414723 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4f425120-446c-438d-9012-f62ef62fd3d0 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] 10.222.0.88 "GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168" status: 200 len: 1528 microversion: 2.1 time: 0.430355 Jul 25 14:41:36.416921 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1763/3746] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:35 2022] GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168 => generated 1528 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:36.425745 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d8f470d7-d6b6-42c9-991a-665d04d9849d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:36.427174 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d8f470d7-d6b6-42c9-991a-665d04d9849d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:36.437077 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8f470d7-d6b6-42c9-991a-665d04d9849d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:36.437893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8f470d7-d6b6-42c9-991a-665d04d9849d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:36.440060 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8f470d7-d6b6-42c9-991a-665d04d9849d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:36.440776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8f470d7-d6b6-42c9-991a-665d04d9849d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:36.603335 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d8f470d7-d6b6-42c9-991a-665d04d9849d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:36.619601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d8f470d7-d6b6-42c9-991a-665d04d9849d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:36.624437 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d8f470d7-d6b6-42c9-991a-665d04d9849d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:36.627895 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d8f470d7-d6b6-42c9-991a-665d04d9849d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 200 len: 1364 microversion: 2.47 time: 0.207310 Jul 25 14:41:36.631200 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1764/3747] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:36 2022] GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 1364 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:41:36.644895 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fa53b63f-6dcf-469d-b032-0222c9ef3a1d tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:36.645929 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fa53b63f-6dcf-469d-b032-0222c9ef3a1d tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:36.656453 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa53b63f-6dcf-469d-b032-0222c9ef3a1d tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:36.658518 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa53b63f-6dcf-469d-b032-0222c9ef3a1d tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:36.659694 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa53b63f-6dcf-469d-b032-0222c9ef3a1d tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:36.661022 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa53b63f-6dcf-469d-b032-0222c9ef3a1d tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:36.661421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fb1bdbbe-3ab6-49ec-8540-685a945f1291 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:36.675705 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fb1bdbbe-3ab6-49ec-8540-685a945f1291 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1493 microversion: 2.1 time: 0.636066 Jul 25 14:41:36.680030 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1984/3748] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:36 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1493 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:41:36.685293 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-efd5d34e-72fd-4c80-b7ec-1ad791e29c8f tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f468630dd30>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:36.751086 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-efd5d34e-72fd-4c80-b7ec-1ad791e29c8f tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc" status: 200 len: 1455 microversion: 2.1 time: 0.073469 Jul 25 14:41:36.751903 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1985/3749] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:41:36 2022] GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc => generated 1455 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:36.764931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-01a78124-738a-412d-9e3d-df2e306a6774 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:36.765555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-01a78124-738a-412d-9e3d-df2e306a6774 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] [instance: cf91c15b-9ab5-4155-a405-e74dc6536168] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:36.771827 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01a78124-738a-412d-9e3d-df2e306a6774 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:36.772322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01a78124-738a-412d-9e3d-df2e306a6774 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:36.773311 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01a78124-738a-412d-9e3d-df2e306a6774 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:36.773914 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01a78124-738a-412d-9e3d-df2e306a6774 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:36.823969 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:41:36.890404 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fa53b63f-6dcf-469d-b032-0222c9ef3a1d tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6af371df8364e5b8362add7335ec4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee3d3418544f2ea0558abb27b1c796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:36.904596 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fa53b63f-6dcf-469d-b032-0222c9ef3a1d tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da" status: 200 len: 1372 microversion: 2.1 time: 0.270484 Jul 25 14:41:36.906318 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1765/3750] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:36 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da => generated 1372 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:36.913551 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-902b08cc-f2c5-4639-b0af-14e9f0ca612d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:36.915264 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-902b08cc-f2c5-4639-b0af-14e9f0ca612d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:36.925121 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-902b08cc-f2c5-4639-b0af-14e9f0ca612d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:36.926881 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-902b08cc-f2c5-4639-b0af-14e9f0ca612d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:36.930039 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-902b08cc-f2c5-4639-b0af-14e9f0ca612d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:36.931460 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-902b08cc-f2c5-4639-b0af-14e9f0ca612d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:37.108559 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-01a78124-738a-412d-9e3d-df2e306a6774 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9b242dbcd4d169f8c1d5349f207cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5a1b4a12604e58b538b2b27dc63894', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:37.122367 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-01a78124-738a-412d-9e3d-df2e306a6774 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] 10.222.0.88 "GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168" status: 200 len: 1528 microversion: 2.1 time: 0.362671 Jul 25 14:41:37.144177 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1986/3751] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:36 2022] GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168 => generated 1528 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:37.153290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b6c45246-fb85-4233-92d2-4b6f8f9e378f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:37.154159 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b6c45246-fb85-4233-92d2-4b6f8f9e378f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 86d15cd4-fd8d-43ac-a471-6c7c19f778f3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:37.161890 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b6c45246-fb85-4233-92d2-4b6f8f9e378f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:37.162342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b6c45246-fb85-4233-92d2-4b6f8f9e378f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:37.163118 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b6c45246-fb85-4233-92d2-4b6f8f9e378f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:37.163566 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b6c45246-fb85-4233-92d2-4b6f8f9e378f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:37.284702 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b6c45246-fb85-4233-92d2-4b6f8f9e378f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:37.296764 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b6c45246-fb85-4233-92d2-4b6f8f9e378f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3" status: 200 len: 1466 microversion: 2.1 time: 0.149827 Jul 25 14:41:37.313103 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1987/3752] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:37 2022] GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3 => generated 1466 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:37.374741 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-902b08cc-f2c5-4639-b0af-14e9f0ca612d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:37.388622 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-902b08cc-f2c5-4639-b0af-14e9f0ca612d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:37.390164 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-902b08cc-f2c5-4639-b0af-14e9f0ca612d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:37.391374 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-902b08cc-f2c5-4639-b0af-14e9f0ca612d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1726 microversion: 2.20 time: 0.483297 Jul 25 14:41:37.403834 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1766/3753] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:36 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1726 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:41:37.418898 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-848baed0-84bf-4b5f-869c-65a8b0bd5a39 req-116924e8-71b9-4868-9eba-8941b28b71ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86d15cd4-fd8d-43ac-a471-6c7c19f778f3", "name": "network-vif-deleted", "tag": "49211c83-89f7-4354-a36e-803f5c21cfab"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:37.449535 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-848baed0-84bf-4b5f-869c-65a8b0bd5a39 req-116924e8-71b9-4868-9eba-8941b28b71ce service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:37.450170 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-848baed0-84bf-4b5f-869c-65a8b0bd5a39 req-116924e8-71b9-4868-9eba-8941b28b71ce service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:37.495691 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-848baed0-84bf-4b5f-869c-65a8b0bd5a39 req-116924e8-71b9-4868-9eba-8941b28b71ce service nova] Creating event network-vif-deleted:49211c83-89f7-4354-a36e-803f5c21cfab for instance 86d15cd4-fd8d-43ac-a471-6c7c19f778f3 on n-h1-846435-14 Jul 25 14:41:37.512552 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-848baed0-84bf-4b5f-869c-65a8b0bd5a39 req-116924e8-71b9-4868-9eba-8941b28b71ce service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099947 Jul 25 14:41:37.513639 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1767/3754] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:41:37.547857 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-03f5b4b8-bc64-4338-bae7-b87150ef07e2 tempest-ServersNegativeTestMultiTenantJSON-355331280 tempest-ServersNegativeTestMultiTenantJSON-355331280-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:37.557651 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-03f5b4b8-bc64-4338-bae7-b87150ef07e2 tempest-ServersNegativeTestMultiTenantJSON-355331280 tempest-ServersNegativeTestMultiTenantJSON-355331280-project] [instance: cf91c15b-9ab5-4155-a405-e74dc6536168] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:37.575201 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-03f5b4b8-bc64-4338-bae7-b87150ef07e2 tempest-ServersNegativeTestMultiTenantJSON-355331280 tempest-ServersNegativeTestMultiTenantJSON-355331280-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:37.578772 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-03f5b4b8-bc64-4338-bae7-b87150ef07e2 tempest-ServersNegativeTestMultiTenantJSON-355331280 tempest-ServersNegativeTestMultiTenantJSON-355331280-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:37.580296 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-03f5b4b8-bc64-4338-bae7-b87150ef07e2 tempest-ServersNegativeTestMultiTenantJSON-355331280 tempest-ServersNegativeTestMultiTenantJSON-355331280-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:37.581168 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-03f5b4b8-bc64-4338-bae7-b87150ef07e2 tempest-ServersNegativeTestMultiTenantJSON-355331280 tempest-ServersNegativeTestMultiTenantJSON-355331280-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:37.636820 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-03f5b4b8-bc64-4338-bae7-b87150ef07e2 tempest-ServersNegativeTestMultiTenantJSON-355331280 tempest-ServersNegativeTestMultiTenantJSON-355331280-project] HTTP exception thrown: Instance cf91c15b-9ab5-4155-a405-e74dc6536168 could not be found. Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-03f5b4b8-bc64-4338-bae7-b87150ef07e2 tempest-ServersNegativeTestMultiTenantJSON-355331280 tempest-ServersNegativeTestMultiTenantJSON-355331280-project] Request method failure captured: Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168 HTTP/1.1 Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3quDYQcE7qCMbwEWQ3SheuPQ2FJanv7lSiKlioJw-401HF6l_ZQ5dIQ_I6zdL70b1eekDOx007aJLg2eYbA_I4yRy-zCity2BZQmkfhUF8xvs9KqfJCrqeP7dNDhysllx_8c91adWV7y5o77HkwwCKW1iwpd49lgA94SDhVzKkFUVbY Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: ccdb57e1a5424c90bd3774f4c51e6287 Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-355331280 Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ccdb57e1a5424c90bd3774f4c51e6287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ccdb57e1a5424c90bd3774f4c51e6287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ccdb57e1a5424c90bd3774f4c51e6287", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ccdb57e1a5424c90bd3774f4c51e6287"}]}] Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-355331280 Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: ccdb57e1a5424c90bd3774f4c51e6287 Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-355331280 Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersNegativeTestMultiTenantJSON-355331280-project Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: fc5c1d5023c44f9b848d941e8a1319a0 Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-355331280-project Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance cf91c15b-9ab5-4155-a405-e74dc6536168 could not be found. Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'cf91c15b-9ab5-4155-a405-e74dc6536168'} Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf91c15b-9ab5-4155-a405-e74dc6536168 could not be found. Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:41:37.639666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:41:37.646515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf91c15b-9ab5-4155-a405-e74dc6536168 could not be found. Jul 25 14:41:37.646515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:37.646515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:37.646515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:37.646515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:37.646515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:37.646515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:37.646515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:41:37.646515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:41:37.646515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf91c15b-9ab5-4155-a405-e74dc6536168 could not be found. Jul 25 14:41:37.646515 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:37.646515 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-03f5b4b8-bc64-4338-bae7-b87150ef07e2 tempest-ServersNegativeTestMultiTenantJSON-355331280 tempest-ServersNegativeTestMultiTenantJSON-355331280-project] Returning 404 to user: Instance cf91c15b-9ab5-4155-a405-e74dc6536168 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:41:37.648971 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-03f5b4b8-bc64-4338-bae7-b87150ef07e2 tempest-ServersNegativeTestMultiTenantJSON-355331280 tempest-ServersNegativeTestMultiTenantJSON-355331280-project] 10.222.0.88 "DELETE /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168" status: 404 len: 111 microversion: 2.1 time: 0.325456 Jul 25 14:41:37.655722 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1988/3755] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:41:37 2022] DELETE /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168 => generated 111 bytes in 336 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:41:37.662323 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ff52bb12-a5b4-4d12-b831-c1e8725d7a4d tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:37.663341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ff52bb12-a5b4-4d12-b831-c1e8725d7a4d tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] [instance: cf91c15b-9ab5-4155-a405-e74dc6536168] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:37.666206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-34f9e38c-2e33-45ec-b716-b7baca9ac198 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:37.670703 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff52bb12-a5b4-4d12-b831-c1e8725d7a4d tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:37.671380 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff52bb12-a5b4-4d12-b831-c1e8725d7a4d tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:37.672217 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff52bb12-a5b4-4d12-b831-c1e8725d7a4d tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:37.672724 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff52bb12-a5b4-4d12-b831-c1e8725d7a4d tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:37.673858 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-34f9e38c-2e33-45ec-b716-b7baca9ac198 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:37.694304 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-34f9e38c-2e33-45ec-b716-b7baca9ac198 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:37.695079 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-34f9e38c-2e33-45ec-b716-b7baca9ac198 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:37.696116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-34f9e38c-2e33-45ec-b716-b7baca9ac198 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:37.697129 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-34f9e38c-2e33-45ec-b716-b7baca9ac198 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:37.804681 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-34f9e38c-2e33-45ec-b716-b7baca9ac198 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:37.815802 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-34f9e38c-2e33-45ec-b716-b7baca9ac198 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:37.817757 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-34f9e38c-2e33-45ec-b716-b7baca9ac198 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:37.819340 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-34f9e38c-2e33-45ec-b716-b7baca9ac198 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 200 len: 1364 microversion: 2.47 time: 0.161992 Jul 25 14:41:37.820157 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1768/3756] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:37 2022] GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:41:37.830070 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8f0ae15a-1455-4a77-a59c-abfaad1825d8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:37.831501 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8f0ae15a-1455-4a77-a59c-abfaad1825d8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:37.841054 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f0ae15a-1455-4a77-a59c-abfaad1825d8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:37.841831 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f0ae15a-1455-4a77-a59c-abfaad1825d8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:37.842906 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f0ae15a-1455-4a77-a59c-abfaad1825d8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:37.843519 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f0ae15a-1455-4a77-a59c-abfaad1825d8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:37.899624 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f0ae15a-1455-4a77-a59c-abfaad1825d8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:37.900170 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f0ae15a-1455-4a77-a59c-abfaad1825d8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:37.900927 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-8f0ae15a-1455-4a77-a59c-abfaad1825d8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lazy-loading 'fault' on Instance uuid 87914b9f-7d35-4be7-9880-893985843c38 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:41:37.965897 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ff52bb12-a5b4-4d12-b831-c1e8725d7a4d tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9b242dbcd4d169f8c1d5349f207cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5a1b4a12604e58b538b2b27dc63894', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:37.966469 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8f0ae15a-1455-4a77-a59c-abfaad1825d8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:37.975235 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8f0ae15a-1455-4a77-a59c-abfaad1825d8 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 200 len: 1309 microversion: 2.1 time: 0.149863 Jul 25 14:41:37.976635 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1769/3757] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:37 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 1309 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:37.981847 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ff52bb12-a5b4-4d12-b831-c1e8725d7a4d tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] 10.222.0.88 "GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168" status: 200 len: 1528 microversion: 2.1 time: 0.322110 Jul 25 14:41:37.982660 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1989/3758] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:37 2022] GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168 => generated 1528 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:37.992691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-23e6e7bc-1d2b-4f63-a5e3-f4fe7e12a5e3 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:37.992691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-23e6e7bc-1d2b-4f63-a5e3-f4fe7e12a5e3 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:38.002338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d7a99e24-a11d-4098-a9b5-437d743d0580 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f4686ad2310>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:38.003093 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23e6e7bc-1d2b-4f63-a5e3-f4fe7e12a5e3 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:38.004191 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23e6e7bc-1d2b-4f63-a5e3-f4fe7e12a5e3 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:38.005523 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23e6e7bc-1d2b-4f63-a5e3-f4fe7e12a5e3 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:38.007259 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23e6e7bc-1d2b-4f63-a5e3-f4fe7e12a5e3 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:38.092292 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d7a99e24-a11d-4098-a9b5-437d743d0580 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc" status: 200 len: 1455 microversion: 2.1 time: 0.114210 Jul 25 14:41:38.096940 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1770/3759] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:41:37 2022] GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc => generated 1455 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:38.109326 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8fce314d-eea2-432d-a292-3720e552e501 tempest-ServersNegativeTestMultiTenantJSON-355331280 tempest-ServersNegativeTestMultiTenantJSON-355331280-project] Action: 'update', calling method: >, body: {"server": {"name": "cf91c15b-9ab5-4155-a405-e74dc6536168_new"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:38.112344 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8fce314d-eea2-432d-a292-3720e552e501 tempest-ServersNegativeTestMultiTenantJSON-355331280 tempest-ServersNegativeTestMultiTenantJSON-355331280-project] [instance: cf91c15b-9ab5-4155-a405-e74dc6536168] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:38.121041 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8fce314d-eea2-432d-a292-3720e552e501 tempest-ServersNegativeTestMultiTenantJSON-355331280 tempest-ServersNegativeTestMultiTenantJSON-355331280-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:38.121502 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8fce314d-eea2-432d-a292-3720e552e501 tempest-ServersNegativeTestMultiTenantJSON-355331280 tempest-ServersNegativeTestMultiTenantJSON-355331280-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:38.122302 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8fce314d-eea2-432d-a292-3720e552e501 tempest-ServersNegativeTestMultiTenantJSON-355331280 tempest-ServersNegativeTestMultiTenantJSON-355331280-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:38.122746 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8fce314d-eea2-432d-a292-3720e552e501 tempest-ServersNegativeTestMultiTenantJSON-355331280 tempest-ServersNegativeTestMultiTenantJSON-355331280-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:38.140078 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-8fce314d-eea2-432d-a292-3720e552e501 tempest-ServersNegativeTestMultiTenantJSON-355331280 tempest-ServersNegativeTestMultiTenantJSON-355331280-project] HTTP exception thrown: Instance cf91c15b-9ab5-4155-a405-e74dc6536168 could not be found. Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8fce314d-eea2-432d-a292-3720e552e501 tempest-ServersNegativeTestMultiTenantJSON-355331280 tempest-ServersNegativeTestMultiTenantJSON-355331280-project] Request method failure captured: Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: request: PUT /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168 HTTP/1.1 Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 64 Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3quDYQcE7qCMbwEWQ3SheuPQ2FJanv7lSiKlioJw-401HF6l_ZQ5dIQ_I6zdL70b1eekDOx007aJLg2eYbA_I4yRy-zCity2BZQmkfhUF8xvs9KqfJCrqeP7dNDhysllx_8c91adWV7y5o77HkwwCKW1iwpd49lgA94SDhVzKkFUVbY Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: ccdb57e1a5424c90bd3774f4c51e6287 Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-355331280 Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ccdb57e1a5424c90bd3774f4c51e6287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ccdb57e1a5424c90bd3774f4c51e6287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ccdb57e1a5424c90bd3774f4c51e6287", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ccdb57e1a5424c90bd3774f4c51e6287"}]}] Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-355331280 Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: ccdb57e1a5424c90bd3774f4c51e6287 Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-355331280 Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersNegativeTestMultiTenantJSON-355331280-project Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: fc5c1d5023c44f9b848d941e8a1319a0 Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-355331280-project Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: {"server": {"name": "cf91c15b-9ab5-4155-a405-e74dc6536168_new"}} Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance cf91c15b-9ab5-4155-a405-e74dc6536168 could not be found. Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'cf91c15b-9ab5-4155-a405-e74dc6536168', 'body': {'server': {'name': 'cf91c15b-9ab5-4155-a405-e74dc6536168_new'}}} Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf91c15b-9ab5-4155-a405-e74dc6536168 could not be found. Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 25 14:41:38.141888 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 25 14:41:38.147449 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 25 14:41:38.147449 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:41:38.147449 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:41:38.147449 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:41:38.147449 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:41:38.147449 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf91c15b-9ab5-4155-a405-e74dc6536168 could not be found. Jul 25 14:41:38.147449 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:41:38.147449 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:38.147449 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:41:38.147449 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:38.147449 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:38.147449 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:38.147449 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:41:38.147449 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:41:38.147449 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf91c15b-9ab5-4155-a405-e74dc6536168 could not be found. Jul 25 14:41:38.147449 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:41:38.150414 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8fce314d-eea2-432d-a292-3720e552e501 tempest-ServersNegativeTestMultiTenantJSON-355331280 tempest-ServersNegativeTestMultiTenantJSON-355331280-project] Returning 404 to user: Instance cf91c15b-9ab5-4155-a405-e74dc6536168 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:41:38.151509 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8fce314d-eea2-432d-a292-3720e552e501 tempest-ServersNegativeTestMultiTenantJSON-355331280 tempest-ServersNegativeTestMultiTenantJSON-355331280-project] 10.222.0.88 "PUT /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168" status: 404 len: 111 microversion: 2.1 time: 0.053144 Jul 25 14:41:38.152132 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1771/3760] 10.222.0.88 () {60 vars in 1256 bytes} [Mon Jul 25 14:41:38 2022] PUT /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:41:38.162282 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-048e874a-e8c7-47df-a4a3-b948abeb40aa tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:38.162768 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-048e874a-e8c7-47df-a4a3-b948abeb40aa tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] [instance: cf91c15b-9ab5-4155-a405-e74dc6536168] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:38.164914 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:41:38.174590 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-048e874a-e8c7-47df-a4a3-b948abeb40aa tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:38.174970 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-048e874a-e8c7-47df-a4a3-b948abeb40aa tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:38.175759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-048e874a-e8c7-47df-a4a3-b948abeb40aa tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:38.181874 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-048e874a-e8c7-47df-a4a3-b948abeb40aa tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:38.261302 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-048e874a-e8c7-47df-a4a3-b948abeb40aa tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] [instance: cf91c15b-9ab5-4155-a405-e74dc6536168] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:41:38.401832 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-23e6e7bc-1d2b-4f63-a5e3-f4fe7e12a5e3 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6af371df8364e5b8362add7335ec4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee3d3418544f2ea0558abb27b1c796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:38.413590 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-23e6e7bc-1d2b-4f63-a5e3-f4fe7e12a5e3 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da" status: 200 len: 1372 microversion: 2.1 time: 0.429812 Jul 25 14:41:38.414192 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1990/3761] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:37 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da => generated 1372 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:38.425953 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f6a0e636-06e5-4e55-bbac-3e24aa961168 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:38.426866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f6a0e636-06e5-4e55-bbac-3e24aa961168 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 86d15cd4-fd8d-43ac-a471-6c7c19f778f3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:38.438179 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-048e874a-e8c7-47df-a4a3-b948abeb40aa tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] 10.222.0.88 "DELETE /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168" status: 204 len: 0 microversion: 2.1 time: 0.279791 Jul 25 14:41:38.440002 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1772/3762] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:41:38 2022] DELETE /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 14:41:38.443241 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6a0e636-06e5-4e55-bbac-3e24aa961168 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:38.444021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6a0e636-06e5-4e55-bbac-3e24aa961168 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:38.444987 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6a0e636-06e5-4e55-bbac-3e24aa961168 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:38.447477 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6a0e636-06e5-4e55-bbac-3e24aa961168 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:38.450510 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-92291ce6-ded3-47d3-8418-a68a872251e7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:38.457075 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-92291ce6-ded3-47d3-8418-a68a872251e7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:38.469787 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-f6a0e636-06e5-4e55-bbac-3e24aa961168 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] HTTP exception thrown: Instance 86d15cd4-fd8d-43ac-a471-6c7c19f778f3 could not be found. Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f6a0e636-06e5-4e55-bbac-3e24aa961168 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Request method failure captured: Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3 HTTP/1.1 Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3quERREaOs3Kc7iY1Vh9GKraPJ63kqwGO_-k7wXB_J3XVEfBf3LNTXeHb07R82UwUNgvRdojb21TsSuL636LebhCUID5TJuapIn-Sgeh4nT2_p48qkoLx6k1MrIDkEY7ueSXXEfRqNxtsyFtJzfjwKFOLGr5sudf0H8jELBV5u89FK0 Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b9b1c620d0b14a3a9471515cf47d6944", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b9b1c620d0b14a3a9471515cf47d6944"}]}] Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 33f992249063495c8bf12954afd9e8b7 Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 86d15cd4-fd8d-43ac-a471-6c7c19f778f3 could not be found. Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '86d15cd4-fd8d-43ac-a471-6c7c19f778f3'} Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86d15cd4-fd8d-43ac-a471-6c7c19f778f3 could not be found. Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86d15cd4-fd8d-43ac-a471-6c7c19f778f3 could not be found. Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:38.471368 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:38.479366 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:38.479366 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:38.479366 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:38.479366 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:41:38.479366 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:41:38.479366 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86d15cd4-fd8d-43ac-a471-6c7c19f778f3 could not be found. Jul 25 14:41:38.479366 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:38.479366 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f6a0e636-06e5-4e55-bbac-3e24aa961168 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Returning 404 to user: Instance 86d15cd4-fd8d-43ac-a471-6c7c19f778f3 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:41:38.483461 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-92291ce6-ded3-47d3-8418-a68a872251e7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:38.483461 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-92291ce6-ded3-47d3-8418-a68a872251e7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:38.483461 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-92291ce6-ded3-47d3-8418-a68a872251e7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:38.483461 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-92291ce6-ded3-47d3-8418-a68a872251e7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:38.485140 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f6a0e636-06e5-4e55-bbac-3e24aa961168 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3" status: 404 len: 111 microversion: 2.1 time: 0.064774 Jul 25 14:41:38.485740 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1991/3763] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:38 2022] GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:41:38.510326 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e619c8c8-79c7-4750-8708-cc29c7cb995e tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:38.510948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e619c8c8-79c7-4750-8708-cc29c7cb995e tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] [instance: cf91c15b-9ab5-4155-a405-e74dc6536168] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:38.531260 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e619c8c8-79c7-4750-8708-cc29c7cb995e tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:38.531722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e619c8c8-79c7-4750-8708-cc29c7cb995e tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:38.532897 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e619c8c8-79c7-4750-8708-cc29c7cb995e tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:38.533335 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e619c8c8-79c7-4750-8708-cc29c7cb995e tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:38.681327 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-92291ce6-ded3-47d3-8418-a68a872251e7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:38.691580 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-92291ce6-ded3-47d3-8418-a68a872251e7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:38.694875 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-92291ce6-ded3-47d3-8418-a68a872251e7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:38.695871 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-92291ce6-ded3-47d3-8418-a68a872251e7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1726 microversion: 2.20 time: 0.253761 Jul 25 14:41:38.696808 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1773/3764] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:38 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1726 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:41:38.701026 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5acc6159-6079-41a0-b86e-4abf67b355d7 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-728681978", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "e81cd55f-4951-41ed-b82a-173584e324cb"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:38.713346 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e619c8c8-79c7-4750-8708-cc29c7cb995e tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9b242dbcd4d169f8c1d5349f207cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5a1b4a12604e58b538b2b27dc63894', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:38.721460 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e619c8c8-79c7-4750-8708-cc29c7cb995e tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] 10.222.0.88 "GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168" status: 200 len: 1534 microversion: 2.1 time: 0.234194 Jul 25 14:41:38.734925 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1992/3765] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:38 2022] GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168 => generated 1534 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:38.765307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-5acc6159-6079-41a0-b86e-4abf67b355d7 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] validate_networks() for [('e81cd55f-4951-41ed-b82a-173584e324cb', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:41:38.843011 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d5d0e067-c6cd-49c7-ba2b-60526eb03200 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:38.843940 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d5d0e067-c6cd-49c7-ba2b-60526eb03200 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:38.851341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5d0e067-c6cd-49c7-ba2b-60526eb03200 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:38.852008 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5d0e067-c6cd-49c7-ba2b-60526eb03200 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:38.852980 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5d0e067-c6cd-49c7-ba2b-60526eb03200 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:38.853580 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5d0e067-c6cd-49c7-ba2b-60526eb03200 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:38.971486 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d5d0e067-c6cd-49c7-ba2b-60526eb03200 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:38.993769 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d5d0e067-c6cd-49c7-ba2b-60526eb03200 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:38.996613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d5d0e067-c6cd-49c7-ba2b-60526eb03200 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:38.998873 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d5d0e067-c6cd-49c7-ba2b-60526eb03200 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 200 len: 1364 microversion: 2.47 time: 0.159935 Jul 25 14:41:39.000081 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1993/3766] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:38 2022] GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:41:39.006635 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6f993eb5-406a-4b39-a999-b25a0c6bcf17 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:39.007453 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6f993eb5-406a-4b39-a999-b25a0c6bcf17 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:39.019050 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f993eb5-406a-4b39-a999-b25a0c6bcf17 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:39.020869 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f993eb5-406a-4b39-a999-b25a0c6bcf17 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:39.022425 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f993eb5-406a-4b39-a999-b25a0c6bcf17 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:39.023589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f993eb5-406a-4b39-a999-b25a0c6bcf17 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:39.042848 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-6f993eb5-406a-4b39-a999-b25a0c6bcf17 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] HTTP exception thrown: Instance 87914b9f-7d35-4be7-9880-893985843c38 could not be found. Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6f993eb5-406a-4b39-a999-b25a0c6bcf17 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Request method failure captured: Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 HTTP/1.1 Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qrEzscNKkpLEv-dO5KC3kdeJJY02nOIPLRIxGcrQR-Na_rLZBnVMM8MjTz-RtprnQR45AAorrNLLV4PDOD1PCa-gGNHdgbGOQfAGQYPzZpu9aSUEO6v7jEn8m2OVF51pdW16QE7pCXmLdRnFRt172yMaxqytlLvEMs-sUVBeXNXrcQ Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e77732af189e48feab3752ddb28208d3", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e77732af189e48feab3752ddb28208d3"}]}] Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersTestJSON-1827246574 Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersTestJSON-1827246574-project Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: e45ffe0956ae4ba9b1577875f312af06 Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersTestJSON-1827246574-project Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 87914b9f-7d35-4be7-9880-893985843c38 could not be found. Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '87914b9f-7d35-4be7-9880-893985843c38'} Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87914b9f-7d35-4be7-9880-893985843c38 could not be found. Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87914b9f-7d35-4be7-9880-893985843c38 could not be found. Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.045747 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:39.051427 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:39.051427 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:39.051427 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:41:39.051427 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:41:39.051427 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87914b9f-7d35-4be7-9880-893985843c38 could not be found. Jul 25 14:41:39.051427 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.053936 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6f993eb5-406a-4b39-a999-b25a0c6bcf17 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Returning 404 to user: Instance 87914b9f-7d35-4be7-9880-893985843c38 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:41:39.056144 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6f993eb5-406a-4b39-a999-b25a0c6bcf17 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 404 len: 111 microversion: 2.1 time: 0.054807 Jul 25 14:41:39.057194 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1994/3767] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:39 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:41:39.069500 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ac070d3f-9dfe-4a16-a346-301aca47cc67 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:39.070366 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ac070d3f-9dfe-4a16-a346-301aca47cc67 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:39.077347 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac070d3f-9dfe-4a16-a346-301aca47cc67 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:39.078054 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac070d3f-9dfe-4a16-a346-301aca47cc67 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:39.079048 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac070d3f-9dfe-4a16-a346-301aca47cc67 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:39.079650 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac070d3f-9dfe-4a16-a346-301aca47cc67 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:39.096831 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-ac070d3f-9dfe-4a16-a346-301aca47cc67 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] HTTP exception thrown: Instance 87914b9f-7d35-4be7-9880-893985843c38 could not be found. Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ac070d3f-9dfe-4a16-a346-301aca47cc67 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Request method failure captured: Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 HTTP/1.1 Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qrEzscNKkpLEv-dO5KC3kdeJJY02nOIPLRIxGcrQR-Na_rLZBnVMM8MjTz-RtprnQR45AAorrNLLV4PDOD1PCa-gGNHdgbGOQfAGQYPzZpu9aSUEO6v7jEn8m2OVF51pdW16QE7pCXmLdRnFRt172yMaxqytlLvEMs-sUVBeXNXrcQ Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e77732af189e48feab3752ddb28208d3", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e77732af189e48feab3752ddb28208d3"}]}] Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersTestJSON-1827246574 Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersTestJSON-1827246574-project Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: e45ffe0956ae4ba9b1577875f312af06 Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersTestJSON-1827246574-project Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 87914b9f-7d35-4be7-9880-893985843c38 could not be found. Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '87914b9f-7d35-4be7-9880-893985843c38'} Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87914b9f-7d35-4be7-9880-893985843c38 could not be found. Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:41:39.098817 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87914b9f-7d35-4be7-9880-893985843c38 could not be found. Jul 25 14:41:39.103941 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.103941 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:39.103941 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.103941 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:39.103941 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:39.103941 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:39.103941 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:41:39.103941 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:41:39.103941 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87914b9f-7d35-4be7-9880-893985843c38 could not be found. Jul 25 14:41:39.103941 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.106115 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ac070d3f-9dfe-4a16-a346-301aca47cc67 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Returning 404 to user: Instance 87914b9f-7d35-4be7-9880-893985843c38 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:41:39.107550 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ac070d3f-9dfe-4a16-a346-301aca47cc67 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "DELETE /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 404 len: 111 microversion: 2.1 time: 0.042218 Jul 25 14:41:39.108605 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1995/3768] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:41:39 2022] DELETE /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:41:39.113620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5fcff229-16f9-4735-85cc-bad17cdc8bf7 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46863353a0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:39.174877 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5fcff229-16f9-4735-85cc-bad17cdc8bf7 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc" status: 200 len: 1455 microversion: 2.1 time: 0.064928 Jul 25 14:41:39.175466 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1996/3769] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:41:39 2022] GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc => generated 1455 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:39.182867 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e3ddfa73-0f25-454d-8a82-294b5b3009d4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:39.182867 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e3ddfa73-0f25-454d-8a82-294b5b3009d4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 87914b9f-7d35-4be7-9880-893985843c38] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:39.188516 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3ddfa73-0f25-454d-8a82-294b5b3009d4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:39.189029 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3ddfa73-0f25-454d-8a82-294b5b3009d4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:39.189806 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3ddfa73-0f25-454d-8a82-294b5b3009d4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:39.190430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3ddfa73-0f25-454d-8a82-294b5b3009d4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:39.206677 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-e3ddfa73-0f25-454d-8a82-294b5b3009d4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] HTTP exception thrown: Instance 87914b9f-7d35-4be7-9880-893985843c38 could not be found. Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e3ddfa73-0f25-454d-8a82-294b5b3009d4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Request method failure captured: Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 HTTP/1.1 Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qrEzscNKkpLEv-dO5KC3kdeJJY02nOIPLRIxGcrQR-Na_rLZBnVMM8MjTz-RtprnQR45AAorrNLLV4PDOD1PCa-gGNHdgbGOQfAGQYPzZpu9aSUEO6v7jEn8m2OVF51pdW16QE7pCXmLdRnFRt172yMaxqytlLvEMs-sUVBeXNXrcQ Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e77732af189e48feab3752ddb28208d3", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e77732af189e48feab3752ddb28208d3"}]}] Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersTestJSON-1827246574 Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersTestJSON-1827246574-project Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: e45ffe0956ae4ba9b1577875f312af06 Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersTestJSON-1827246574-project Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 87914b9f-7d35-4be7-9880-893985843c38 could not be found. Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '87914b9f-7d35-4be7-9880-893985843c38'} Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87914b9f-7d35-4be7-9880-893985843c38 could not be found. Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87914b9f-7d35-4be7-9880-893985843c38 could not be found. Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.209211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:39.214645 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:39.214645 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:39.214645 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:41:39.214645 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:41:39.214645 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87914b9f-7d35-4be7-9880-893985843c38 could not be found. Jul 25 14:41:39.214645 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.216308 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e3ddfa73-0f25-454d-8a82-294b5b3009d4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Returning 404 to user: Instance 87914b9f-7d35-4be7-9880-893985843c38 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:41:39.217361 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e3ddfa73-0f25-454d-8a82-294b5b3009d4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38" status: 404 len: 111 microversion: 2.1 time: 0.040948 Jul 25 14:41:39.218181 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1997/3770] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:39 2022] GET /compute/v2.1/servers/87914b9f-7d35-4be7-9880-893985843c38 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:41:39.227831 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5f40ac63-f864-491c-83f4-45e0dfb15ceb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:39.228990 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5f40ac63-f864-491c-83f4-45e0dfb15ceb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: bd38057a-c422-40f2-9bc0-cb454cbe96c3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:39.236457 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5f40ac63-f864-491c-83f4-45e0dfb15ceb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:39.236949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5f40ac63-f864-491c-83f4-45e0dfb15ceb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:39.237888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5f40ac63-f864-491c-83f4-45e0dfb15ceb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:39.238270 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5f40ac63-f864-491c-83f4-45e0dfb15ceb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:39.257239 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-5f40ac63-f864-491c-83f4-45e0dfb15ceb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] HTTP exception thrown: Instance bd38057a-c422-40f2-9bc0-cb454cbe96c3 could not be found. Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5f40ac63-f864-491c-83f4-45e0dfb15ceb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Request method failure captured: Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3 HTTP/1.1 Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qrEzscNKkpLEv-dO5KC3kdeJJY02nOIPLRIxGcrQR-Na_rLZBnVMM8MjTz-RtprnQR45AAorrNLLV4PDOD1PCa-gGNHdgbGOQfAGQYPzZpu9aSUEO6v7jEn8m2OVF51pdW16QE7pCXmLdRnFRt172yMaxqytlLvEMs-sUVBeXNXrcQ Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e77732af189e48feab3752ddb28208d3", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e77732af189e48feab3752ddb28208d3"}]}] Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersTestJSON-1827246574 Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersTestJSON-1827246574-project Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: e45ffe0956ae4ba9b1577875f312af06 Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersTestJSON-1827246574-project Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance bd38057a-c422-40f2-9bc0-cb454cbe96c3 could not be found. Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'bd38057a-c422-40f2-9bc0-cb454cbe96c3'} Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd38057a-c422-40f2-9bc0-cb454cbe96c3 could not be found. Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:41:39.260943 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd38057a-c422-40f2-9bc0-cb454cbe96c3 could not be found. Jul 25 14:41:39.268320 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.268320 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:39.268320 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.268320 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:39.268320 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:39.268320 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:39.268320 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:41:39.268320 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:41:39.268320 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd38057a-c422-40f2-9bc0-cb454cbe96c3 could not be found. Jul 25 14:41:39.268320 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.268320 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5f40ac63-f864-491c-83f4-45e0dfb15ceb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Returning 404 to user: Instance bd38057a-c422-40f2-9bc0-cb454cbe96c3 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:41:39.270352 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5f40ac63-f864-491c-83f4-45e0dfb15ceb tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "DELETE /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3" status: 404 len: 111 microversion: 2.1 time: 0.046120 Jul 25 14:41:39.272294 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1998/3771] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:41:39 2022] DELETE /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:41:39.280945 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-748f1ca5-e6bd-45a0-842c-897bd5182134 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:39.281642 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-748f1ca5-e6bd-45a0-842c-897bd5182134 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: bd38057a-c422-40f2-9bc0-cb454cbe96c3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:39.289479 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-748f1ca5-e6bd-45a0-842c-897bd5182134 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:39.290068 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-748f1ca5-e6bd-45a0-842c-897bd5182134 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:39.290941 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-748f1ca5-e6bd-45a0-842c-897bd5182134 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:39.292085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-748f1ca5-e6bd-45a0-842c-897bd5182134 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:39.308974 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-748f1ca5-e6bd-45a0-842c-897bd5182134 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] HTTP exception thrown: Instance bd38057a-c422-40f2-9bc0-cb454cbe96c3 could not be found. Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-748f1ca5-e6bd-45a0-842c-897bd5182134 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Request method failure captured: Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3 HTTP/1.1 Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qrEzscNKkpLEv-dO5KC3kdeJJY02nOIPLRIxGcrQR-Na_rLZBnVMM8MjTz-RtprnQR45AAorrNLLV4PDOD1PCa-gGNHdgbGOQfAGQYPzZpu9aSUEO6v7jEn8m2OVF51pdW16QE7pCXmLdRnFRt172yMaxqytlLvEMs-sUVBeXNXrcQ Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e77732af189e48feab3752ddb28208d3", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e77732af189e48feab3752ddb28208d3"}]}] Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersTestJSON-1827246574 Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersTestJSON-1827246574-project Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: e45ffe0956ae4ba9b1577875f312af06 Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersTestJSON-1827246574-project Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance bd38057a-c422-40f2-9bc0-cb454cbe96c3 could not be found. Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'bd38057a-c422-40f2-9bc0-cb454cbe96c3'} Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd38057a-c422-40f2-9bc0-cb454cbe96c3 could not be found. Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd38057a-c422-40f2-9bc0-cb454cbe96c3 could not be found. Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.311399 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:39.316021 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:39.316021 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:39.316021 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:41:39.316021 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:41:39.316021 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd38057a-c422-40f2-9bc0-cb454cbe96c3 could not be found. Jul 25 14:41:39.316021 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.317308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-5acc6159-6079-41a0-b86e-4abf67b355d7 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:41:39.317852 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-748f1ca5-e6bd-45a0-842c-897bd5182134 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Returning 404 to user: Instance bd38057a-c422-40f2-9bc0-cb454cbe96c3 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:41:39.318044 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-5acc6159-6079-41a0-b86e-4abf67b355d7 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:41:39.318208 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-748f1ca5-e6bd-45a0-842c-897bd5182134 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3" status: 404 len: 111 microversion: 2.1 time: 0.041789 Jul 25 14:41:39.318380 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-5acc6159-6079-41a0-b86e-4abf67b355d7 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:41:39.318380 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-5acc6159-6079-41a0-b86e-4abf67b355d7 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:41:39.318779 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-5acc6159-6079-41a0-b86e-4abf67b355d7 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:41:39.318997 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 1999/3772] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:39 2022] GET /compute/v2.1/servers/bd38057a-c422-40f2-9bc0-cb454cbe96c3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:41:39.326723 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-df0e32cf-c56e-49e0-8f84-da16e86dde94 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:39.327314 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-df0e32cf-c56e-49e0-8f84-da16e86dde94 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 0a5407b3-d293-4f14-9379-b64b57b4a94b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:39.329646 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5acc6159-6079-41a0-b86e-4abf67b355d7 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:39.330326 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5acc6159-6079-41a0-b86e-4abf67b355d7 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:39.331615 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5acc6159-6079-41a0-b86e-4abf67b355d7 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:39.332204 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5acc6159-6079-41a0-b86e-4abf67b355d7 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:39.334959 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-df0e32cf-c56e-49e0-8f84-da16e86dde94 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:39.335460 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-df0e32cf-c56e-49e0-8f84-da16e86dde94 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:39.336474 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-df0e32cf-c56e-49e0-8f84-da16e86dde94 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:39.336875 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-df0e32cf-c56e-49e0-8f84-da16e86dde94 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:39.353075 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-df0e32cf-c56e-49e0-8f84-da16e86dde94 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] HTTP exception thrown: Instance 0a5407b3-d293-4f14-9379-b64b57b4a94b could not be found. Jul 25 14:41:39.353347 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-5acc6159-6079-41a0-b86e-4abf67b355d7 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Getting quotas for project b9b1c620d0b14a3a9471515cf47d6944. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-df0e32cf-c56e-49e0-8f84-da16e86dde94 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Request method failure captured: Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b HTTP/1.1 Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qrEzscNKkpLEv-dO5KC3kdeJJY02nOIPLRIxGcrQR-Na_rLZBnVMM8MjTz-RtprnQR45AAorrNLLV4PDOD1PCa-gGNHdgbGOQfAGQYPzZpu9aSUEO6v7jEn8m2OVF51pdW16QE7pCXmLdRnFRt172yMaxqytlLvEMs-sUVBeXNXrcQ Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e77732af189e48feab3752ddb28208d3", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e77732af189e48feab3752ddb28208d3"}]}] Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersTestJSON-1827246574 Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersTestJSON-1827246574-project Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: e45ffe0956ae4ba9b1577875f312af06 Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersTestJSON-1827246574-project Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 0a5407b3-d293-4f14-9379-b64b57b4a94b could not be found. Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '0a5407b3-d293-4f14-9379-b64b57b4a94b'} Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a5407b3-d293-4f14-9379-b64b57b4a94b could not be found. Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:41:39.354682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a5407b3-d293-4f14-9379-b64b57b4a94b could not be found. Jul 25 14:41:39.359836 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.359836 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:39.359836 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.359836 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:39.359836 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:39.359836 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:39.359836 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:41:39.359836 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:41:39.359836 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a5407b3-d293-4f14-9379-b64b57b4a94b could not be found. Jul 25 14:41:39.359836 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.359836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-df0e32cf-c56e-49e0-8f84-da16e86dde94 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Returning 404 to user: Instance 0a5407b3-d293-4f14-9379-b64b57b4a94b could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:41:39.359836 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-df0e32cf-c56e-49e0-8f84-da16e86dde94 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "DELETE /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b" status: 404 len: 111 microversion: 2.1 time: 0.033556 Jul 25 14:41:39.360983 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2000/3773] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:41:39 2022] DELETE /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:41:39.365296 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4cabcd3e-e1b7-4f2d-be22-405fd2898537 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:39.365911 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4cabcd3e-e1b7-4f2d-be22-405fd2898537 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 0a5407b3-d293-4f14-9379-b64b57b4a94b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:39.369061 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-5acc6159-6079-41a0-b86e-4abf67b355d7 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Getting quotas for user 33f992249063495c8bf12954afd9e8b7 and project b9b1c620d0b14a3a9471515cf47d6944. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:41:39.372962 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4cabcd3e-e1b7-4f2d-be22-405fd2898537 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:39.373403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4cabcd3e-e1b7-4f2d-be22-405fd2898537 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:39.374168 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4cabcd3e-e1b7-4f2d-be22-405fd2898537 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:39.374778 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4cabcd3e-e1b7-4f2d-be22-405fd2898537 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:39.384980 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5acc6159-6079-41a0-b86e-4abf67b355d7 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:41:39.387266 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5acc6159-6079-41a0-b86e-4abf67b355d7 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:41:39.391417 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-4cabcd3e-e1b7-4f2d-be22-405fd2898537 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] HTTP exception thrown: Instance 0a5407b3-d293-4f14-9379-b64b57b4a94b could not be found. Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4cabcd3e-e1b7-4f2d-be22-405fd2898537 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Request method failure captured: Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b HTTP/1.1 Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qrEzscNKkpLEv-dO5KC3kdeJJY02nOIPLRIxGcrQR-Na_rLZBnVMM8MjTz-RtprnQR45AAorrNLLV4PDOD1PCa-gGNHdgbGOQfAGQYPzZpu9aSUEO6v7jEn8m2OVF51pdW16QE7pCXmLdRnFRt172yMaxqytlLvEMs-sUVBeXNXrcQ Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e77732af189e48feab3752ddb28208d3", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e77732af189e48feab3752ddb28208d3"}]}] Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersTestJSON-1827246574 Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersTestJSON-1827246574-project Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: e45ffe0956ae4ba9b1577875f312af06 Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersTestJSON-1827246574-project Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 0a5407b3-d293-4f14-9379-b64b57b4a94b could not be found. Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '0a5407b3-d293-4f14-9379-b64b57b4a94b'} Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a5407b3-d293-4f14-9379-b64b57b4a94b could not be found. Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a5407b3-d293-4f14-9379-b64b57b4a94b could not be found. Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.393452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:39.398660 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:39.398660 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:39.398660 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:41:39.398660 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:41:39.398660 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a5407b3-d293-4f14-9379-b64b57b4a94b could not be found. Jul 25 14:41:39.398660 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.399758 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4cabcd3e-e1b7-4f2d-be22-405fd2898537 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Returning 404 to user: Instance 0a5407b3-d293-4f14-9379-b64b57b4a94b could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:41:39.401688 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4cabcd3e-e1b7-4f2d-be22-405fd2898537 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b" status: 404 len: 111 microversion: 2.1 time: 0.039894 Jul 25 14:41:39.405830 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2001/3774] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:39 2022] GET /compute/v2.1/servers/0a5407b3-d293-4f14-9379-b64b57b4a94b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:41:39.411333 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-00efd3c1-4dff-41cc-852f-a6f6a07f5753 req-431141ef-aa6f-49e7-bb0a-240618479595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e128c68-5e95-4535-ab8f-451b2d7ec5da", "name": "network-vif-plugged", "status": "completed", "tag": "c80cc8b1-d5ac-4df0-b29c-4321c060d4cf"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:39.424506 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-00efd3c1-4dff-41cc-852f-a6f6a07f5753 req-431141ef-aa6f-49e7-bb0a-240618479595 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:39.425038 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-00efd3c1-4dff-41cc-852f-a6f6a07f5753 req-431141ef-aa6f-49e7-bb0a-240618479595 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:39.457151 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-00efd3c1-4dff-41cc-852f-a6f6a07f5753 req-431141ef-aa6f-49e7-bb0a-240618479595 service nova] Creating event network-vif-plugged:c80cc8b1-d5ac-4df0-b29c-4321c060d4cf for instance 0e128c68-5e95-4535-ab8f-451b2d7ec5da on n-h2-846435-14 Jul 25 14:41:39.461847 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-00efd3c1-4dff-41cc-852f-a6f6a07f5753 req-431141ef-aa6f-49e7-bb0a-240618479595 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054646 Jul 25 14:41:39.462950 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2002/3775] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:41:39.468222 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2f6e848e-04c6-4104-a074-437ff05b6c87 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:39.468699 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2f6e848e-04c6-4104-a074-437ff05b6c87 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 31135b90-13f0-431a-994f-8af08fbd3248] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:39.475397 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2f6e848e-04c6-4104-a074-437ff05b6c87 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:39.475844 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2f6e848e-04c6-4104-a074-437ff05b6c87 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:39.476290 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5acc6159-6079-41a0-b86e-4abf67b355d7 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.778675 Jul 25 14:41:39.476663 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2f6e848e-04c6-4104-a074-437ff05b6c87 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:39.476953 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1774/3776] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:41:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:41:39.483252 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2f6e848e-04c6-4104-a074-437ff05b6c87 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:39.491179 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c3ae0f07-857d-4890-9068-89d9ba56d697 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:39.491817 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c3ae0f07-857d-4890-9068-89d9ba56d697 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:39.500521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c3ae0f07-857d-4890-9068-89d9ba56d697 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:39.501135 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-2f6e848e-04c6-4104-a074-437ff05b6c87 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] HTTP exception thrown: Instance 31135b90-13f0-431a-994f-8af08fbd3248 could not be found. Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2f6e848e-04c6-4104-a074-437ff05b6c87 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Request method failure captured: Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248 HTTP/1.1 Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qrEzscNKkpLEv-dO5KC3kdeJJY02nOIPLRIxGcrQR-Na_rLZBnVMM8MjTz-RtprnQR45AAorrNLLV4PDOD1PCa-gGNHdgbGOQfAGQYPzZpu9aSUEO6v7jEn8m2OVF51pdW16QE7pCXmLdRnFRt172yMaxqytlLvEMs-sUVBeXNXrcQ Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e77732af189e48feab3752ddb28208d3", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e77732af189e48feab3752ddb28208d3"}]}] Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersTestJSON-1827246574 Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersTestJSON-1827246574-project Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: e45ffe0956ae4ba9b1577875f312af06 Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersTestJSON-1827246574-project Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 31135b90-13f0-431a-994f-8af08fbd3248 could not be found. Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '31135b90-13f0-431a-994f-8af08fbd3248'} Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31135b90-13f0-431a-994f-8af08fbd3248 could not be found. Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:41:39.502838 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31135b90-13f0-431a-994f-8af08fbd3248 could not be found. Jul 25 14:41:39.508219 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.508219 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:39.508219 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.508219 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:39.508219 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:39.508219 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:39.508219 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:41:39.508219 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:41:39.508219 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31135b90-13f0-431a-994f-8af08fbd3248 could not be found. Jul 25 14:41:39.508219 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.508219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2f6e848e-04c6-4104-a074-437ff05b6c87 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Returning 404 to user: Instance 31135b90-13f0-431a-994f-8af08fbd3248 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:41:39.508219 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2f6e848e-04c6-4104-a074-437ff05b6c87 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "DELETE /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248" status: 404 len: 111 microversion: 2.1 time: 0.040153 Jul 25 14:41:39.508219 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2003/3777] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:41:39 2022] DELETE /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:41:39.511284 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5b7dec5f-d7cb-442d-9aef-b9c503fcb26b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:39.512852 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5b7dec5f-d7cb-442d-9aef-b9c503fcb26b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:39.515216 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c3ae0f07-857d-4890-9068-89d9ba56d697 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:39.518085 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c3ae0f07-857d-4890-9068-89d9ba56d697 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:39.518827 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c3ae0f07-857d-4890-9068-89d9ba56d697 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:39.612622 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5b7dec5f-d7cb-442d-9aef-b9c503fcb26b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:39.620934 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5b7dec5f-d7cb-442d-9aef-b9c503fcb26b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527" status: 200 len: 1214 microversion: 2.1 time: 0.113467 Jul 25 14:41:39.621783 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2004/3778] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:39 2022] GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 => generated 1214 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:39.640315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d9747370-4782-473c-8d24-9dede0cd51f4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:39.641164 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d9747370-4782-473c-8d24-9dede0cd51f4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 31135b90-13f0-431a-994f-8af08fbd3248] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:39.653781 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d9747370-4782-473c-8d24-9dede0cd51f4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:39.654529 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d9747370-4782-473c-8d24-9dede0cd51f4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:39.655482 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d9747370-4782-473c-8d24-9dede0cd51f4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:39.656127 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d9747370-4782-473c-8d24-9dede0cd51f4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:39.674516 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-d9747370-4782-473c-8d24-9dede0cd51f4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] HTTP exception thrown: Instance 31135b90-13f0-431a-994f-8af08fbd3248 could not be found. Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d9747370-4782-473c-8d24-9dede0cd51f4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Request method failure captured: Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248 HTTP/1.1 Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qrEzscNKkpLEv-dO5KC3kdeJJY02nOIPLRIxGcrQR-Na_rLZBnVMM8MjTz-RtprnQR45AAorrNLLV4PDOD1PCa-gGNHdgbGOQfAGQYPzZpu9aSUEO6v7jEn8m2OVF51pdW16QE7pCXmLdRnFRt172yMaxqytlLvEMs-sUVBeXNXrcQ Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e77732af189e48feab3752ddb28208d3", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e77732af189e48feab3752ddb28208d3"}]}] Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersTestJSON-1827246574 Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersTestJSON-1827246574-project Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: e45ffe0956ae4ba9b1577875f312af06 Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersTestJSON-1827246574-project Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 31135b90-13f0-431a-994f-8af08fbd3248 could not be found. Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '31135b90-13f0-431a-994f-8af08fbd3248'} Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31135b90-13f0-431a-994f-8af08fbd3248 could not be found. Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31135b90-13f0-431a-994f-8af08fbd3248 could not be found. Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.676988 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:39.684639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:39.684639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:39.684639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:41:39.684639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:41:39.684639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31135b90-13f0-431a-994f-8af08fbd3248 could not be found. Jul 25 14:41:39.684639 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.686509 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d9747370-4782-473c-8d24-9dede0cd51f4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Returning 404 to user: Instance 31135b90-13f0-431a-994f-8af08fbd3248 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:41:39.687620 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d9747370-4782-473c-8d24-9dede0cd51f4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248" status: 404 len: 111 microversion: 2.1 time: 0.051157 Jul 25 14:41:39.688481 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2005/3779] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:39 2022] GET /compute/v2.1/servers/31135b90-13f0-431a-994f-8af08fbd3248 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:41:39.693749 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-d5ae7d2e-dcaa-4b49-b6d3-49bd3df494d5 req-89834496-033d-43c4-9154-babce9cec588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87914b9f-7d35-4be7-9880-893985843c38", "name": "network-vif-deleted", "tag": "58624c25-2a67-47d5-81dc-a87d7c8e6851"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:39.702052 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:41:39.707449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-d5ae7d2e-dcaa-4b49-b6d3-49bd3df494d5 req-89834496-033d-43c4-9154-babce9cec588 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:39.708345 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-d5ae7d2e-dcaa-4b49-b6d3-49bd3df494d5 req-89834496-033d-43c4-9154-babce9cec588 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:39.725030 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-d5ae7d2e-dcaa-4b49-b6d3-49bd3df494d5 req-89834496-033d-43c4-9154-babce9cec588 service nova] Creating event network-vif-deleted:58624c25-2a67-47d5-81dc-a87d7c8e6851 for instance 87914b9f-7d35-4be7-9880-893985843c38 on n-h1-846435-14 Jul 25 14:41:39.730283 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-d5ae7d2e-dcaa-4b49-b6d3-49bd3df494d5 req-89834496-033d-43c4-9154-babce9cec588 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040119 Jul 25 14:41:39.730800 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2006/3780] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:41:39.736069 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bdf1302b-5c0c-438e-8753-0ce2df54fef5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:39.736657 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bdf1302b-5c0c-438e-8753-0ce2df54fef5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 9bc0439b-4dfb-4a50-959d-0c80042f09fb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:39.743392 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bdf1302b-5c0c-438e-8753-0ce2df54fef5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:39.743838 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bdf1302b-5c0c-438e-8753-0ce2df54fef5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:39.744659 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bdf1302b-5c0c-438e-8753-0ce2df54fef5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:39.745091 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bdf1302b-5c0c-438e-8753-0ce2df54fef5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:39.761460 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-bdf1302b-5c0c-438e-8753-0ce2df54fef5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] HTTP exception thrown: Instance 9bc0439b-4dfb-4a50-959d-0c80042f09fb could not be found. Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bdf1302b-5c0c-438e-8753-0ce2df54fef5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Request method failure captured: Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb HTTP/1.1 Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qrEzscNKkpLEv-dO5KC3kdeJJY02nOIPLRIxGcrQR-Na_rLZBnVMM8MjTz-RtprnQR45AAorrNLLV4PDOD1PCa-gGNHdgbGOQfAGQYPzZpu9aSUEO6v7jEn8m2OVF51pdW16QE7pCXmLdRnFRt172yMaxqytlLvEMs-sUVBeXNXrcQ Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e77732af189e48feab3752ddb28208d3", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e77732af189e48feab3752ddb28208d3"}]}] Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersTestJSON-1827246574 Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersTestJSON-1827246574-project Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: e45ffe0956ae4ba9b1577875f312af06 Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersTestJSON-1827246574-project Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 9bc0439b-4dfb-4a50-959d-0c80042f09fb could not be found. Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '9bc0439b-4dfb-4a50-959d-0c80042f09fb'} Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bc0439b-4dfb-4a50-959d-0c80042f09fb could not be found. Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:41:39.763364 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bc0439b-4dfb-4a50-959d-0c80042f09fb could not be found. Jul 25 14:41:39.768095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.768095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:39.768095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.768095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:39.768095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:39.768095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:39.768095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:41:39.768095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:41:39.768095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bc0439b-4dfb-4a50-959d-0c80042f09fb could not be found. Jul 25 14:41:39.768095 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:39.768095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bdf1302b-5c0c-438e-8753-0ce2df54fef5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Returning 404 to user: Instance 9bc0439b-4dfb-4a50-959d-0c80042f09fb could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:41:39.768095 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bdf1302b-5c0c-438e-8753-0ce2df54fef5 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "DELETE /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb" status: 404 len: 111 microversion: 2.1 time: 0.032884 Jul 25 14:41:39.768095 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2007/3781] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:41:39 2022] DELETE /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:41:39.770628 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9788ec4e-fb49-40f4-a01a-ab980e6d2be3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:39.770845 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9788ec4e-fb49-40f4-a01a-ab980e6d2be3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:39.773759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c3ae0f07-857d-4890-9068-89d9ba56d697 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6af371df8364e5b8362add7335ec4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee3d3418544f2ea0558abb27b1c796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:39.777897 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9788ec4e-fb49-40f4-a01a-ab980e6d2be3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:39.778354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9788ec4e-fb49-40f4-a01a-ab980e6d2be3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:39.779136 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9788ec4e-fb49-40f4-a01a-ab980e6d2be3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:39.779569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9788ec4e-fb49-40f4-a01a-ab980e6d2be3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:39.781739 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c3ae0f07-857d-4890-9068-89d9ba56d697 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da" status: 200 len: 1372 microversion: 2.1 time: 0.303714 Jul 25 14:41:39.798398 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1775/3782] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:39 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da => generated 1372 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:39.803431 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4528d763-f384-465e-9654-90936215bc4b tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:39.804079 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4528d763-f384-465e-9654-90936215bc4b tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] [instance: cf91c15b-9ab5-4155-a405-e74dc6536168] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:39.809497 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:41:39.810624 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4528d763-f384-465e-9654-90936215bc4b tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:39.811075 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4528d763-f384-465e-9654-90936215bc4b tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:39.811864 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4528d763-f384-465e-9654-90936215bc4b tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:39.812331 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4528d763-f384-465e-9654-90936215bc4b tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:39.969359 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4528d763-f384-465e-9654-90936215bc4b tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9b242dbcd4d169f8c1d5349f207cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5a1b4a12604e58b538b2b27dc63894', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:39.978208 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4528d763-f384-465e-9654-90936215bc4b tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] 10.222.0.88 "GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168" status: 200 len: 1534 microversion: 2.1 time: 0.178633 Jul 25 14:41:39.992243 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1776/3783] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:39 2022] GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168 => generated 1534 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:39.997728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-14dd099d-3a56-4fd2-8504-b43fb65ad5cf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:39.998548 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-14dd099d-3a56-4fd2-8504-b43fb65ad5cf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: 9bc0439b-4dfb-4a50-959d-0c80042f09fb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:40.006093 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14dd099d-3a56-4fd2-8504-b43fb65ad5cf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:40.006753 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14dd099d-3a56-4fd2-8504-b43fb65ad5cf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:40.007543 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14dd099d-3a56-4fd2-8504-b43fb65ad5cf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:40.008005 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14dd099d-3a56-4fd2-8504-b43fb65ad5cf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:40.025738 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-14dd099d-3a56-4fd2-8504-b43fb65ad5cf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] HTTP exception thrown: Instance 9bc0439b-4dfb-4a50-959d-0c80042f09fb could not be found. Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-14dd099d-3a56-4fd2-8504-b43fb65ad5cf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Request method failure captured: Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb HTTP/1.1 Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qrEzscNKkpLEv-dO5KC3kdeJJY02nOIPLRIxGcrQR-Na_rLZBnVMM8MjTz-RtprnQR45AAorrNLLV4PDOD1PCa-gGNHdgbGOQfAGQYPzZpu9aSUEO6v7jEn8m2OVF51pdW16QE7pCXmLdRnFRt172yMaxqytlLvEMs-sUVBeXNXrcQ Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e77732af189e48feab3752ddb28208d3", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e77732af189e48feab3752ddb28208d3"}]}] Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersTestJSON-1827246574 Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersTestJSON-1827246574-project Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: e45ffe0956ae4ba9b1577875f312af06 Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersTestJSON-1827246574-project Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 9bc0439b-4dfb-4a50-959d-0c80042f09fb could not be found. Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '9bc0439b-4dfb-4a50-959d-0c80042f09fb'} Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bc0439b-4dfb-4a50-959d-0c80042f09fb could not be found. Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bc0439b-4dfb-4a50-959d-0c80042f09fb could not be found. Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:41:40.027435 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:40.032341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:40.032341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:40.032341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:41:40.032341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:41:40.032341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bc0439b-4dfb-4a50-959d-0c80042f09fb could not be found. Jul 25 14:41:40.032341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:41:40.034327 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-14dd099d-3a56-4fd2-8504-b43fb65ad5cf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Returning 404 to user: Instance 9bc0439b-4dfb-4a50-959d-0c80042f09fb could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:41:40.035424 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-14dd099d-3a56-4fd2-8504-b43fb65ad5cf tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb" status: 404 len: 111 microversion: 2.1 time: 0.041867 Jul 25 14:41:40.036539 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1777/3784] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:39 2022] GET /compute/v2.1/servers/9bc0439b-4dfb-4a50-959d-0c80042f09fb => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:41:40.042096 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4da186c8-9815-4bd9-9361-ac2d665d46ad tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:40.043030 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4da186c8-9815-4bd9-9361-ac2d665d46ad tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:40.050685 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4da186c8-9815-4bd9-9361-ac2d665d46ad tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:40.051568 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4da186c8-9815-4bd9-9361-ac2d665d46ad tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:40.052641 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4da186c8-9815-4bd9-9361-ac2d665d46ad tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:40.053293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4da186c8-9815-4bd9-9361-ac2d665d46ad tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:40.128734 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4da186c8-9815-4bd9-9361-ac2d665d46ad tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:40.138653 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4da186c8-9815-4bd9-9361-ac2d665d46ad tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:40.140346 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4da186c8-9815-4bd9-9361-ac2d665d46ad tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:40.141776 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4da186c8-9815-4bd9-9361-ac2d665d46ad tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 200 len: 1364 microversion: 2.47 time: 0.103929 Jul 25 14:41:40.142574 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1778/3785] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:40 2022] GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 1364 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:41:40.147480 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-be11a810-166a-46a2-9fc0-27e6e7f42ea6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:40.148126 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-be11a810-166a-46a2-9fc0-27e6e7f42ea6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: ae539e1e-57e2-47ef-88b5-af8189cc7758] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:40.155757 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-be11a810-166a-46a2-9fc0-27e6e7f42ea6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:40.156494 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-be11a810-166a-46a2-9fc0-27e6e7f42ea6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:40.157841 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-be11a810-166a-46a2-9fc0-27e6e7f42ea6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:40.158525 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-be11a810-166a-46a2-9fc0-27e6e7f42ea6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:40.182126 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-be11a810-166a-46a2-9fc0-27e6e7f42ea6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] HTTP exception thrown: Instance ae539e1e-57e2-47ef-88b5-af8189cc7758 could not be found. Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-be11a810-166a-46a2-9fc0-27e6e7f42ea6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Request method failure captured: Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758 HTTP/1.1 Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qrEzscNKkpLEv-dO5KC3kdeJJY02nOIPLRIxGcrQR-Na_rLZBnVMM8MjTz-RtprnQR45AAorrNLLV4PDOD1PCa-gGNHdgbGOQfAGQYPzZpu9aSUEO6v7jEn8m2OVF51pdW16QE7pCXmLdRnFRt172yMaxqytlLvEMs-sUVBeXNXrcQ Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e77732af189e48feab3752ddb28208d3", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e77732af189e48feab3752ddb28208d3"}]}] Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersTestJSON-1827246574 Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersTestJSON-1827246574-project Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: e45ffe0956ae4ba9b1577875f312af06 Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersTestJSON-1827246574-project Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance ae539e1e-57e2-47ef-88b5-af8189cc7758 could not be found. Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'ae539e1e-57e2-47ef-88b5-af8189cc7758'} Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae539e1e-57e2-47ef-88b5-af8189cc7758 could not be found. Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:41:40.184265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae539e1e-57e2-47ef-88b5-af8189cc7758 could not be found. Jul 25 14:41:40.190542 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:41:40.190542 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:40.190542 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:41:40.190542 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:40.190542 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:40.190542 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:40.190542 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:41:40.190542 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:41:40.190542 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae539e1e-57e2-47ef-88b5-af8189cc7758 could not be found. Jul 25 14:41:40.190542 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:41:40.192665 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-be11a810-166a-46a2-9fc0-27e6e7f42ea6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Returning 404 to user: Instance ae539e1e-57e2-47ef-88b5-af8189cc7758 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:41:40.193541 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-be11a810-166a-46a2-9fc0-27e6e7f42ea6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "DELETE /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758" status: 404 len: 111 microversion: 2.1 time: 0.049689 Jul 25 14:41:40.194155 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1779/3786] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:41:40 2022] DELETE /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:41:40.199195 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-75ea5ab3-0f37-440d-b631-d92f83907bdf tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46989bb670>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:40.263781 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-75ea5ab3-0f37-440d-b631-d92f83907bdf tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc" status: 200 len: 1455 microversion: 2.1 time: 0.068286 Jul 25 14:41:40.264678 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1780/3787] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:41:40 2022] GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc => generated 1455 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:40.269722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dabed18e-f0b3-4d58-a5fd-203fdd8ac209 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:40.270872 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-dabed18e-f0b3-4d58-a5fd-203fdd8ac209 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: ae539e1e-57e2-47ef-88b5-af8189cc7758] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:40.275282 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9788ec4e-fb49-40f4-a01a-ab980e6d2be3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:40.280913 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dabed18e-f0b3-4d58-a5fd-203fdd8ac209 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:40.282269 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dabed18e-f0b3-4d58-a5fd-203fdd8ac209 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:40.283739 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dabed18e-f0b3-4d58-a5fd-203fdd8ac209 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:40.284459 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dabed18e-f0b3-4d58-a5fd-203fdd8ac209 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:40.285128 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9788ec4e-fb49-40f4-a01a-ab980e6d2be3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:40.289082 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9788ec4e-fb49-40f4-a01a-ab980e6d2be3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:40.292376 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9788ec4e-fb49-40f4-a01a-ab980e6d2be3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1726 microversion: 2.20 time: 0.524194 Jul 25 14:41:40.293339 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2008/3788] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:39 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1726 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:41:40.310564 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-dabed18e-f0b3-4d58-a5fd-203fdd8ac209 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] HTTP exception thrown: Instance ae539e1e-57e2-47ef-88b5-af8189cc7758 could not be found. Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dabed18e-f0b3-4d58-a5fd-203fdd8ac209 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Request method failure captured: Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758 HTTP/1.1 Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qrEzscNKkpLEv-dO5KC3kdeJJY02nOIPLRIxGcrQR-Na_rLZBnVMM8MjTz-RtprnQR45AAorrNLLV4PDOD1PCa-gGNHdgbGOQfAGQYPzZpu9aSUEO6v7jEn8m2OVF51pdW16QE7pCXmLdRnFRt172yMaxqytlLvEMs-sUVBeXNXrcQ Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e77732af189e48feab3752ddb28208d3", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e77732af189e48feab3752ddb28208d3"}]}] Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersTestJSON-1827246574 Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersTestJSON-1827246574-project Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: e45ffe0956ae4ba9b1577875f312af06 Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersTestJSON-1827246574-project Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance ae539e1e-57e2-47ef-88b5-af8189cc7758 could not be found. Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'ae539e1e-57e2-47ef-88b5-af8189cc7758'} Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae539e1e-57e2-47ef-88b5-af8189cc7758 could not be found. Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae539e1e-57e2-47ef-88b5-af8189cc7758 could not be found. Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:41:40.313072 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:40.318129 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:40.318129 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:40.318129 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:41:40.318129 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:41:40.318129 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae539e1e-57e2-47ef-88b5-af8189cc7758 could not be found. Jul 25 14:41:40.318129 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:41:40.319705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dabed18e-f0b3-4d58-a5fd-203fdd8ac209 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Returning 404 to user: Instance ae539e1e-57e2-47ef-88b5-af8189cc7758 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:41:40.320617 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dabed18e-f0b3-4d58-a5fd-203fdd8ac209 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758" status: 404 len: 111 microversion: 2.1 time: 0.054791 Jul 25 14:41:40.321201 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1781/3789] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:40 2022] GET /compute/v2.1/servers/ae539e1e-57e2-47ef-88b5-af8189cc7758 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:41:40.329868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5442c6e4-f457-4715-8321-4efbf5e78d8b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:40.330370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5442c6e4-f457-4715-8321-4efbf5e78d8b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: bc636abb-0ba9-4071-a5fc-4d05dd3c174e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:40.336001 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-5442c6e4-f457-4715-8321-4efbf5e78d8b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] HTTP exception thrown: Instance bc636abb-0ba9-4071-a5fc-4d05dd3c174e could not be found. Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5442c6e4-f457-4715-8321-4efbf5e78d8b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Request method failure captured: Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/bc636abb-0ba9-4071-a5fc-4d05dd3c174e HTTP/1.1 Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qrEzscNKkpLEv-dO5KC3kdeJJY02nOIPLRIxGcrQR-Na_rLZBnVMM8MjTz-RtprnQR45AAorrNLLV4PDOD1PCa-gGNHdgbGOQfAGQYPzZpu9aSUEO6v7jEn8m2OVF51pdW16QE7pCXmLdRnFRt172yMaxqytlLvEMs-sUVBeXNXrcQ Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e77732af189e48feab3752ddb28208d3", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e77732af189e48feab3752ddb28208d3"}]}] Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersTestJSON-1827246574 Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersTestJSON-1827246574-project Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: e45ffe0956ae4ba9b1577875f312af06 Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersTestJSON-1827246574-project Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance bc636abb-0ba9-4071-a5fc-4d05dd3c174e could not be found. Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'bc636abb-0ba9-4071-a5fc-4d05dd3c174e'} Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc636abb-0ba9-4071-a5fc-4d05dd3c174e could not be found. Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc636abb-0ba9-4071-a5fc-4d05dd3c174e could not be found. Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:40.337529 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:40.345562 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:40.345562 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:40.345562 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:40.345562 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:41:40.345562 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:41:40.345562 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc636abb-0ba9-4071-a5fc-4d05dd3c174e could not be found. Jul 25 14:41:40.345562 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:40.345562 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5442c6e4-f457-4715-8321-4efbf5e78d8b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Returning 404 to user: Instance bc636abb-0ba9-4071-a5fc-4d05dd3c174e could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:41:40.345562 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5442c6e4-f457-4715-8321-4efbf5e78d8b tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "DELETE /compute/v2.1/servers/bc636abb-0ba9-4071-a5fc-4d05dd3c174e" status: 404 len: 111 microversion: 2.1 time: 0.014122 Jul 25 14:41:40.345562 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2009/3790] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:41:40 2022] DELETE /compute/v2.1/servers/bc636abb-0ba9-4071-a5fc-4d05dd3c174e => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:41:40.348758 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-077138ee-6b30-46cb-8f86-8b8126f568b4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:40.349377 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-077138ee-6b30-46cb-8f86-8b8126f568b4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: bc636abb-0ba9-4071-a5fc-4d05dd3c174e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:40.355777 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-077138ee-6b30-46cb-8f86-8b8126f568b4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] HTTP exception thrown: Instance bc636abb-0ba9-4071-a5fc-4d05dd3c174e could not be found. Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-077138ee-6b30-46cb-8f86-8b8126f568b4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Request method failure captured: Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/bc636abb-0ba9-4071-a5fc-4d05dd3c174e HTTP/1.1 Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qrEzscNKkpLEv-dO5KC3kdeJJY02nOIPLRIxGcrQR-Na_rLZBnVMM8MjTz-RtprnQR45AAorrNLLV4PDOD1PCa-gGNHdgbGOQfAGQYPzZpu9aSUEO6v7jEn8m2OVF51pdW16QE7pCXmLdRnFRt172yMaxqytlLvEMs-sUVBeXNXrcQ Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e77732af189e48feab3752ddb28208d3", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e77732af189e48feab3752ddb28208d3"}]}] Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersTestJSON-1827246574 Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersTestJSON-1827246574-project Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: e45ffe0956ae4ba9b1577875f312af06 Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersTestJSON-1827246574-project Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance bc636abb-0ba9-4071-a5fc-4d05dd3c174e could not be found. Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'bc636abb-0ba9-4071-a5fc-4d05dd3c174e'} Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc636abb-0ba9-4071-a5fc-4d05dd3c174e could not be found. Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc636abb-0ba9-4071-a5fc-4d05dd3c174e could not be found. Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:40.357733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:40.362389 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:41:40.362389 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:41:40.362389 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc636abb-0ba9-4071-a5fc-4d05dd3c174e could not be found. Jul 25 14:41:40.362389 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:41:40.362389 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-077138ee-6b30-46cb-8f86-8b8126f568b4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Returning 404 to user: Instance bc636abb-0ba9-4071-a5fc-4d05dd3c174e could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:41:40.362389 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-077138ee-6b30-46cb-8f86-8b8126f568b4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/bc636abb-0ba9-4071-a5fc-4d05dd3c174e" status: 404 len: 111 microversion: 2.1 time: 0.017892 Jul 25 14:41:40.366137 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1782/3791] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:40 2022] GET /compute/v2.1/servers/bc636abb-0ba9-4071-a5fc-4d05dd3c174e => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:41:40.370904 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a4c314c6-04fc-4ef0-84c3-9883b8c30081 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:40.371400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a4c314c6-04fc-4ef0-84c3-9883b8c30081 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: e58c1cf0-5e50-42a9-a430-7a6ef7933743] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:40.379830 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4c314c6-04fc-4ef0-84c3-9883b8c30081 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:40.380302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4c314c6-04fc-4ef0-84c3-9883b8c30081 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:40.381074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4c314c6-04fc-4ef0-84c3-9883b8c30081 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:40.381504 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4c314c6-04fc-4ef0-84c3-9883b8c30081 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:40.406686 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a4c314c6-04fc-4ef0-84c3-9883b8c30081 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: e58c1cf0-5e50-42a9-a430-7a6ef7933743] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:41:40.542246 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a4c314c6-04fc-4ef0-84c3-9883b8c30081 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "DELETE /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743" status: 204 len: 0 microversion: 2.1 time: 0.175047 Jul 25 14:41:40.542842 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2010/3792] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:41:40 2022] DELETE /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:41:40.550871 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4adbb208-d758-40a9-8028-57009c920972 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:40.551538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4adbb208-d758-40a9-8028-57009c920972 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: e58c1cf0-5e50-42a9-a430-7a6ef7933743] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:40.558750 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4adbb208-d758-40a9-8028-57009c920972 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:40.559205 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4adbb208-d758-40a9-8028-57009c920972 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:40.560000 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4adbb208-d758-40a9-8028-57009c920972 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:40.560450 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4adbb208-d758-40a9-8028-57009c920972 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:40.580871 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:41:40.642878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c599de7a-1164-4695-b6a1-0c58ad42ce40 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:40.643783 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c599de7a-1164-4695-b6a1-0c58ad42ce40 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:40.650891 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c599de7a-1164-4695-b6a1-0c58ad42ce40 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:40.651652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c599de7a-1164-4695-b6a1-0c58ad42ce40 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:40.652913 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c599de7a-1164-4695-b6a1-0c58ad42ce40 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:40.653457 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c599de7a-1164-4695-b6a1-0c58ad42ce40 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:40.698989 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4adbb208-d758-40a9-8028-57009c920972 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:40.706794 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4adbb208-d758-40a9-8028-57009c920972 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743" status: 200 len: 1479 microversion: 2.1 time: 0.159845 Jul 25 14:41:40.707369 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1783/3793] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:40 2022] GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743 => generated 1479 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:40.737370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c599de7a-1164-4695-b6a1-0c58ad42ce40 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:40.744954 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c599de7a-1164-4695-b6a1-0c58ad42ce40 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527" status: 200 len: 1218 microversion: 2.1 time: 0.106456 Jul 25 14:41:40.745506 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2011/3794] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:40 2022] GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:40.805609 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c6c1111d-8f8d-4cf0-a8ce-a44e9b9bad35 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:40.806338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c6c1111d-8f8d-4cf0-a8ce-a44e9b9bad35 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:40.812661 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c6c1111d-8f8d-4cf0-a8ce-a44e9b9bad35 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:40.813191 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c6c1111d-8f8d-4cf0-a8ce-a44e9b9bad35 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:40.814033 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c6c1111d-8f8d-4cf0-a8ce-a44e9b9bad35 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:40.814538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c6c1111d-8f8d-4cf0-a8ce-a44e9b9bad35 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:40.959755 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c6c1111d-8f8d-4cf0-a8ce-a44e9b9bad35 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6af371df8364e5b8362add7335ec4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee3d3418544f2ea0558abb27b1c796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:40.968980 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c6c1111d-8f8d-4cf0-a8ce-a44e9b9bad35 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da" status: 200 len: 1372 microversion: 2.1 time: 0.167339 Jul 25 14:41:40.969575 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1784/3795] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:40 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:40.999654 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4088169c-0097-44e4-899a-c04d96b783f9 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:41.000757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4088169c-0097-44e4-899a-c04d96b783f9 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] [instance: cf91c15b-9ab5-4155-a405-e74dc6536168] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:41.012841 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4088169c-0097-44e4-899a-c04d96b783f9 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:41.013592 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4088169c-0097-44e4-899a-c04d96b783f9 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:41.016809 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4088169c-0097-44e4-899a-c04d96b783f9 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:41.017485 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4088169c-0097-44e4-899a-c04d96b783f9 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:41.165764 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-11db8c7a-9d6e-4657-b1bb-2460c914c74c tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:41.166457 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-11db8c7a-9d6e-4657-b1bb-2460c914c74c tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:41.175667 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-11db8c7a-9d6e-4657-b1bb-2460c914c74c tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:41.176390 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-11db8c7a-9d6e-4657-b1bb-2460c914c74c tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:41.177643 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-11db8c7a-9d6e-4657-b1bb-2460c914c74c tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:41.178045 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-11db8c7a-9d6e-4657-b1bb-2460c914c74c tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:41.261214 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-11db8c7a-9d6e-4657-b1bb-2460c914c74c tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:41.270173 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-11db8c7a-9d6e-4657-b1bb-2460c914c74c tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:41.271928 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-11db8c7a-9d6e-4657-b1bb-2460c914c74c tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:41.274789 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-11db8c7a-9d6e-4657-b1bb-2460c914c74c tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 200 len: 1364 microversion: 2.47 time: 0.113323 Jul 25 14:41:41.275338 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1785/3796] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:41 2022] GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 1364 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:41:41.280322 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b17f0c79-0871-4c82-81f6-a427d56fcd4a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46989bb790>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:41.297824 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4088169c-0097-44e4-899a-c04d96b783f9 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9b242dbcd4d169f8c1d5349f207cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5a1b4a12604e58b538b2b27dc63894', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:41.306288 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4088169c-0097-44e4-899a-c04d96b783f9 tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] 10.222.0.88 "GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168" status: 200 len: 1534 microversion: 2.1 time: 0.310973 Jul 25 14:41:41.316596 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2012/3797] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:40 2022] GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168 => generated 1534 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:41.325712 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9ff6b210-6d7b-4c95-acde-9b560d58cc70 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:41.327320 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9ff6b210-6d7b-4c95-acde-9b560d58cc70 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:41.330030 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b17f0c79-0871-4c82-81f6-a427d56fcd4a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc" status: 200 len: 1455 microversion: 2.1 time: 0.053300 Jul 25 14:41:41.334605 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ff6b210-6d7b-4c95-acde-9b560d58cc70 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:41.335327 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ff6b210-6d7b-4c95-acde-9b560d58cc70 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:41.336377 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ff6b210-6d7b-4c95-acde-9b560d58cc70 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:41.336674 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1786/3798] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:41:41 2022] GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc => generated 1455 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:41.337391 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ff6b210-6d7b-4c95-acde-9b560d58cc70 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:41.518226 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-a4850beb-d08a-4cdd-977a-70079e1d16f1 req-0ec3f9c9-6190-4d71-8119-9646c942c38e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfb8c05d-0ccc-4b4d-a920-d8238e56f0de", "name": "network-vif-plugged", "status": "completed", "tag": "78158429-4b1a-4039-9efe-77450874ee04"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:41.528724 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-a4850beb-d08a-4cdd-977a-70079e1d16f1 req-0ec3f9c9-6190-4d71-8119-9646c942c38e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:41.529260 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-a4850beb-d08a-4cdd-977a-70079e1d16f1 req-0ec3f9c9-6190-4d71-8119-9646c942c38e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:41.541673 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-a4850beb-d08a-4cdd-977a-70079e1d16f1 req-0ec3f9c9-6190-4d71-8119-9646c942c38e service nova] Creating event network-vif-plugged:78158429-4b1a-4039-9efe-77450874ee04 for instance dfb8c05d-0ccc-4b4d-a920-d8238e56f0de on n-h2-846435-14 Jul 25 14:41:41.547618 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-a4850beb-d08a-4cdd-977a-70079e1d16f1 req-0ec3f9c9-6190-4d71-8119-9646c942c38e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033955 Jul 25 14:41:41.548361 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1787/3799] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:41:41.581802 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9ff6b210-6d7b-4c95-acde-9b560d58cc70 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:41.590377 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9ff6b210-6d7b-4c95-acde-9b560d58cc70 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:41.591883 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9ff6b210-6d7b-4c95-acde-9b560d58cc70 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:41.593221 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9ff6b210-6d7b-4c95-acde-9b560d58cc70 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1726 microversion: 2.20 time: 0.275478 Jul 25 14:41:41.593982 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2013/3800] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:41 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1726 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:41:41.729137 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-46601462-25c3-4bc0-b370-c31c1d060b86 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:41.729740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-46601462-25c3-4bc0-b370-c31c1d060b86 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: e58c1cf0-5e50-42a9-a430-7a6ef7933743] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:41.736265 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46601462-25c3-4bc0-b370-c31c1d060b86 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:41.736855 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46601462-25c3-4bc0-b370-c31c1d060b86 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:41.737908 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46601462-25c3-4bc0-b370-c31c1d060b86 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:41.738349 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46601462-25c3-4bc0-b370-c31c1d060b86 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:41.767620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ea0044e1-21f9-4cd0-bfa4-86e8a85265cd tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:41.768520 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ea0044e1-21f9-4cd0-bfa4-86e8a85265cd tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:41.775377 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea0044e1-21f9-4cd0-bfa4-86e8a85265cd tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:41.775842 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea0044e1-21f9-4cd0-bfa4-86e8a85265cd tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:41.776763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea0044e1-21f9-4cd0-bfa4-86e8a85265cd tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:41.777073 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea0044e1-21f9-4cd0-bfa4-86e8a85265cd tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:41.862968 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ea0044e1-21f9-4cd0-bfa4-86e8a85265cd tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:41.872379 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ea0044e1-21f9-4cd0-bfa4-86e8a85265cd tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527" status: 200 len: 1210 microversion: 2.1 time: 0.109758 Jul 25 14:41:41.873235 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2014/3801] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:41 2022] GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 => generated 1210 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:41.878214 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-14165ea2-e3fe-4549-b148-3dd523086cd6 req-14f70f81-177c-46aa-b8e7-88bdc537f697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf91c15b-9ab5-4155-a405-e74dc6536168", "name": "network-vif-deleted", "tag": "71e35f1c-c56f-4975-9638-7a9ac203cf4d"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:41.887390 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-46601462-25c3-4bc0-b370-c31c1d060b86 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:41.898665 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-46601462-25c3-4bc0-b370-c31c1d060b86 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743" status: 200 len: 1479 microversion: 2.1 time: 0.173849 Jul 25 14:41:41.899259 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1788/3802] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:41 2022] GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743 => generated 1479 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:41.904046 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-14165ea2-e3fe-4549-b148-3dd523086cd6 req-14f70f81-177c-46aa-b8e7-88bdc537f697 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:41.904784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-14165ea2-e3fe-4549-b148-3dd523086cd6 req-14f70f81-177c-46aa-b8e7-88bdc537f697 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:41.922222 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-14165ea2-e3fe-4549-b148-3dd523086cd6 req-14f70f81-177c-46aa-b8e7-88bdc537f697 service nova] Creating event network-vif-deleted:71e35f1c-c56f-4975-9638-7a9ac203cf4d for instance cf91c15b-9ab5-4155-a405-e74dc6536168 on n-h2-846435-14 Jul 25 14:41:41.927418 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-14165ea2-e3fe-4549-b148-3dd523086cd6 req-14f70f81-177c-46aa-b8e7-88bdc537f697 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052699 Jul 25 14:41:41.928071 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2015/3803] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:41:41.990803 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cfed270e-0243-4491-bd55-4e6b1d4d9b6e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:41.991432 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cfed270e-0243-4491-bd55-4e6b1d4d9b6e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:41.998442 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cfed270e-0243-4491-bd55-4e6b1d4d9b6e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:41.998871 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cfed270e-0243-4491-bd55-4e6b1d4d9b6e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:41.999655 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cfed270e-0243-4491-bd55-4e6b1d4d9b6e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:42.000134 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cfed270e-0243-4491-bd55-4e6b1d4d9b6e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:42.174504 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cfed270e-0243-4491-bd55-4e6b1d4d9b6e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6af371df8364e5b8362add7335ec4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee3d3418544f2ea0558abb27b1c796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:42.182052 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cfed270e-0243-4491-bd55-4e6b1d4d9b6e tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da" status: 200 len: 1372 microversion: 2.1 time: 0.195248 Jul 25 14:41:42.182628 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1789/3804] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:41 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da => generated 1372 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:42.300299 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cb42c4e9-cf53-4ad5-871e-75bf0b9f26d3 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:42.301722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cb42c4e9-cf53-4ad5-871e-75bf0b9f26d3 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:42.309954 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb42c4e9-cf53-4ad5-871e-75bf0b9f26d3 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:42.310311 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb42c4e9-cf53-4ad5-871e-75bf0b9f26d3 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:42.311301 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb42c4e9-cf53-4ad5-871e-75bf0b9f26d3 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:42.311962 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb42c4e9-cf53-4ad5-871e-75bf0b9f26d3 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:42.334439 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-76104e7e-94e1-494f-b987-010231c131af tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:42.335062 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-76104e7e-94e1-494f-b987-010231c131af tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] [instance: cf91c15b-9ab5-4155-a405-e74dc6536168] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:42.349891 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-76104e7e-94e1-494f-b987-010231c131af tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:42.351079 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-76104e7e-94e1-494f-b987-010231c131af tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:42.352487 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-76104e7e-94e1-494f-b987-010231c131af tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:42.353543 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-76104e7e-94e1-494f-b987-010231c131af tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:42.415590 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cb42c4e9-cf53-4ad5-871e-75bf0b9f26d3 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:42.424399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cb42c4e9-cf53-4ad5-871e-75bf0b9f26d3 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:42.425909 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cb42c4e9-cf53-4ad5-871e-75bf0b9f26d3 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:42.427121 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cb42c4e9-cf53-4ad5-871e-75bf0b9f26d3 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 200 len: 1364 microversion: 2.47 time: 0.131845 Jul 25 14:41:42.427710 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2016/3805] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:42 2022] GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 1364 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:41:42.433220 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-41b4aa7d-710c-41e3-9fe7-fe0b0e7777a7 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46862c4d30>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:42.450387 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-76104e7e-94e1-494f-b987-010231c131af tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9b242dbcd4d169f8c1d5349f207cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5a1b4a12604e58b538b2b27dc63894', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:42.458003 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-76104e7e-94e1-494f-b987-010231c131af tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] 10.222.0.88 "GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168" status: 200 len: 1312 microversion: 2.1 time: 0.130205 Jul 25 14:41:42.458814 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1790/3806] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:42 2022] GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168 => generated 1312 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:42.498722 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-41b4aa7d-710c-41e3-9fe7-fe0b0e7777a7 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc" status: 200 len: 1455 microversion: 2.1 time: 0.069160 Jul 25 14:41:42.500258 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2017/3807] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:41:42 2022] GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc => generated 1455 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:42.620237 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7b2331b6-650d-4f3a-9c62-ac5812f725cd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:42.621509 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7b2331b6-650d-4f3a-9c62-ac5812f725cd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:42.628711 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b2331b6-650d-4f3a-9c62-ac5812f725cd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:42.630027 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b2331b6-650d-4f3a-9c62-ac5812f725cd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:42.631055 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b2331b6-650d-4f3a-9c62-ac5812f725cd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:42.631708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b2331b6-650d-4f3a-9c62-ac5812f725cd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:42.802744 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7b2331b6-650d-4f3a-9c62-ac5812f725cd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:42.811591 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7b2331b6-650d-4f3a-9c62-ac5812f725cd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:42.813435 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7b2331b6-650d-4f3a-9c62-ac5812f725cd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:42.814643 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7b2331b6-650d-4f3a-9c62-ac5812f725cd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1726 microversion: 2.20 time: 0.200747 Jul 25 14:41:42.815708 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1791/3808] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:42 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1726 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:41:42.895134 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a5062cae-6977-4832-8871-eede869c6720 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:42.895786 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a5062cae-6977-4832-8871-eede869c6720 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:42.902609 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5062cae-6977-4832-8871-eede869c6720 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:42.903119 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5062cae-6977-4832-8871-eede869c6720 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:42.904160 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5062cae-6977-4832-8871-eede869c6720 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:42.904593 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5062cae-6977-4832-8871-eede869c6720 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:42.923512 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f7e7b77a-f95a-43ee-a077-f53b4e3a13a6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:42.924235 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f7e7b77a-f95a-43ee-a077-f53b4e3a13a6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: e58c1cf0-5e50-42a9-a430-7a6ef7933743] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:42.931584 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f7e7b77a-f95a-43ee-a077-f53b4e3a13a6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:42.932326 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f7e7b77a-f95a-43ee-a077-f53b4e3a13a6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:42.933283 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f7e7b77a-f95a-43ee-a077-f53b4e3a13a6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:42.934556 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f7e7b77a-f95a-43ee-a077-f53b4e3a13a6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:43.005630 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a5062cae-6977-4832-8871-eede869c6720 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:43.018581 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a5062cae-6977-4832-8871-eede869c6720 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527" status: 200 len: 1266 microversion: 2.1 time: 0.127171 Jul 25 14:41:43.019498 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2018/3809] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:42 2022] GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 => generated 1266 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:41:43.106682 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f7e7b77a-f95a-43ee-a077-f53b4e3a13a6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:43.114589 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f7e7b77a-f95a-43ee-a077-f53b4e3a13a6 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743" status: 200 len: 1479 microversion: 2.1 time: 0.196710 Jul 25 14:41:43.127849 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1792/3810] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:42 2022] GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743 => generated 1479 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:43.205321 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-70150cfb-d60f-4c41-87e0-f282bdb37dea tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:43.205999 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-70150cfb-d60f-4c41-87e0-f282bdb37dea tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:43.212287 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-70150cfb-d60f-4c41-87e0-f282bdb37dea tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:43.212771 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-70150cfb-d60f-4c41-87e0-f282bdb37dea tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:43.213667 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-70150cfb-d60f-4c41-87e0-f282bdb37dea tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:43.214141 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-70150cfb-d60f-4c41-87e0-f282bdb37dea tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:43.451567 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-96c1838f-1417-4987-a7de-4dc3b3298328 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:43.453176 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-96c1838f-1417-4987-a7de-4dc3b3298328 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:43.468740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-96c1838f-1417-4987-a7de-4dc3b3298328 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:43.473571 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-96c1838f-1417-4987-a7de-4dc3b3298328 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:43.474365 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-96c1838f-1417-4987-a7de-4dc3b3298328 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:43.474819 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-96c1838f-1417-4987-a7de-4dc3b3298328 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:43.934710 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-70150cfb-d60f-4c41-87e0-f282bdb37dea tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6af371df8364e5b8362add7335ec4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee3d3418544f2ea0558abb27b1c796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:43.948649 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-70150cfb-d60f-4c41-87e0-f282bdb37dea tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da" status: 200 len: 1558 microversion: 2.1 time: 0.748510 Jul 25 14:41:43.949279 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2019/3811] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:43 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da => generated 1558 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:43.954173 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-29819d54-cfa7-4814-9a46-aa628ba4af8f tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:43.958720 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-29819d54-cfa7-4814-9a46-aa628ba4af8f tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] [instance: cf91c15b-9ab5-4155-a405-e74dc6536168] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:43.979388 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-29819d54-cfa7-4814-9a46-aa628ba4af8f tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:43.980191 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-29819d54-cfa7-4814-9a46-aa628ba4af8f tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:43.981151 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-29819d54-cfa7-4814-9a46-aa628ba4af8f tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:43.981780 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-29819d54-cfa7-4814-9a46-aa628ba4af8f tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:44.006367 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-29819d54-cfa7-4814-9a46-aa628ba4af8f tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] HTTP exception thrown: Instance cf91c15b-9ab5-4155-a405-e74dc6536168 could not be found. Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-29819d54-cfa7-4814-9a46-aa628ba4af8f tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Request method failure captured: Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168 HTTP/1.1 Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qt75kqjPxdQYLJhk59a0B9GTkFytPjjEqIp9Fpp3-ydI9zbQqzLIvPZg79lQ36a6i8vUnNZP9_3wG_CytA3-FehSgMGYU7quItB00JZtKpkE5kyV0vqKImmWwFpxSjlsbSUoCeifn39m5Bb8Y1y7NUlPvdrvBhuYVTn2aI9kk3A59U Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 0b5a1b4a12604e58b538b2b27dc63894 Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1037620613 Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0b5a1b4a12604e58b538b2b27dc63894"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0b5a1b4a12604e58b538b2b27dc63894"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0b5a1b4a12604e58b538b2b27dc63894", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0b5a1b4a12604e58b538b2b27dc63894"}]}] Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1037620613 Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 0b5a1b4a12604e58b538b2b27dc63894 Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1037620613 Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1037620613-project Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: d7c9b242dbcd4d169f8c1d5349f207cc Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1037620613-project Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance cf91c15b-9ab5-4155-a405-e74dc6536168 could not be found. Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'cf91c15b-9ab5-4155-a405-e74dc6536168'} Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf91c15b-9ab5-4155-a405-e74dc6536168 could not be found. Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf91c15b-9ab5-4155-a405-e74dc6536168 could not be found. Jul 25 14:41:44.008367 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:44.013346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:44.013346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:44.013346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:44.013346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:44.013346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:44.013346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:41:44.013346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:41:44.013346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf91c15b-9ab5-4155-a405-e74dc6536168 could not be found. Jul 25 14:41:44.013346 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:44.014727 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-29819d54-cfa7-4814-9a46-aa628ba4af8f tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] Returning 404 to user: Instance cf91c15b-9ab5-4155-a405-e74dc6536168 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:41:44.016937 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-29819d54-cfa7-4814-9a46-aa628ba4af8f tempest-ServersNegativeTestMultiTenantJSON-1037620613 tempest-ServersNegativeTestMultiTenantJSON-1037620613-project] 10.222.0.88 "GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168" status: 404 len: 111 microversion: 2.1 time: 0.066394 Jul 25 14:41:44.020939 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2020/3812] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:43 2022] GET /compute/v2.1/servers/cf91c15b-9ab5-4155-a405-e74dc6536168 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:41:44.033142 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-35a0f5d8-455f-4862-a31f-bd458ec6502c tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46862ea160>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:44.033653 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-96c1838f-1417-4987-a7de-4dc3b3298328 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:44.042689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-96c1838f-1417-4987-a7de-4dc3b3298328 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:44.052594 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-96c1838f-1417-4987-a7de-4dc3b3298328 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:44.054039 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-96c1838f-1417-4987-a7de-4dc3b3298328 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 200 len: 1364 microversion: 2.47 time: 0.606998 Jul 25 14:41:44.068007 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1793/3813] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:43 2022] GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 1364 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:41:44.068007 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d7eb53fb-5d6d-423b-a679-b5185af72a1d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:44.068007 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d7eb53fb-5d6d-423b-a679-b5185af72a1d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:44.081522 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d7eb53fb-5d6d-423b-a679-b5185af72a1d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:44.081991 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d7eb53fb-5d6d-423b-a679-b5185af72a1d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:44.082903 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d7eb53fb-5d6d-423b-a679-b5185af72a1d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:44.083389 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d7eb53fb-5d6d-423b-a679-b5185af72a1d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:44.098111 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-35a0f5d8-455f-4862-a31f-bd458ec6502c tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc" status: 200 len: 1455 microversion: 2.1 time: 0.075778 Jul 25 14:41:44.099406 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2021/3814] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:41:44 2022] GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc => generated 1455 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:44.112202 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-be224f67-5c1d-41f9-8a7c-2c6932610edb tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:44.116721 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-be224f67-5c1d-41f9-8a7c-2c6932610edb tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:44.130303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be224f67-5c1d-41f9-8a7c-2c6932610edb tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:44.130760 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be224f67-5c1d-41f9-8a7c-2c6932610edb tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:44.131785 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be224f67-5c1d-41f9-8a7c-2c6932610edb tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:44.132262 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be224f67-5c1d-41f9-8a7c-2c6932610edb tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:44.339850 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-be224f67-5c1d-41f9-8a7c-2c6932610edb tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.239239 Jul 25 14:41:44.341734 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2022/3815] 10.222.0.88 () {58 vars in 1275 bytes} [Mon Jul 25 14:41:44 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da/os-interface => generated 285 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:41:44.348826 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-141cb7ca-3d1e-4759-97c8-279f7e85ef1c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:44.351371 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-141cb7ca-3d1e-4759-97c8-279f7e85ef1c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:44.371789 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-141cb7ca-3d1e-4759-97c8-279f7e85ef1c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:44.372602 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-141cb7ca-3d1e-4759-97c8-279f7e85ef1c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:44.373651 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-141cb7ca-3d1e-4759-97c8-279f7e85ef1c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:44.374531 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-141cb7ca-3d1e-4759-97c8-279f7e85ef1c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:44.568243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-141cb7ca-3d1e-4759-97c8-279f7e85ef1c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:44.584111 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-141cb7ca-3d1e-4759-97c8-279f7e85ef1c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527" status: 200 len: 1272 microversion: 2.1 time: 0.238400 Jul 25 14:41:44.584616 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d7eb53fb-5d6d-423b-a679-b5185af72a1d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:44.587648 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2023/3816] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:44 2022] GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 => generated 1272 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:44.599752 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0c476eff-848d-4dd9-8d1a-b81c06d2e5d4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:44.601815 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0c476eff-848d-4dd9-8d1a-b81c06d2e5d4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: e58c1cf0-5e50-42a9-a430-7a6ef7933743] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:44.605406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d7eb53fb-5d6d-423b-a679-b5185af72a1d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:44.607003 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d7eb53fb-5d6d-423b-a679-b5185af72a1d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:44.615400 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d7eb53fb-5d6d-423b-a679-b5185af72a1d tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1726 microversion: 2.20 time: 0.552273 Jul 25 14:41:44.616882 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1794/3817] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:44 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1726 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:41:44.624028 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c476eff-848d-4dd9-8d1a-b81c06d2e5d4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:44.624703 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c476eff-848d-4dd9-8d1a-b81c06d2e5d4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:44.627953 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c476eff-848d-4dd9-8d1a-b81c06d2e5d4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:44.628580 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c476eff-848d-4dd9-8d1a-b81c06d2e5d4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:44.863179 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0c476eff-848d-4dd9-8d1a-b81c06d2e5d4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45ffe0956ae4ba9b1577875f312af06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e77732af189e48feab3752ddb28208d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:44.874778 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0c476eff-848d-4dd9-8d1a-b81c06d2e5d4 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743" status: 200 len: 1479 microversion: 2.1 time: 0.285607 Jul 25 14:41:44.888933 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2024/3818] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:44 2022] GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743 => generated 1479 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:45.005788 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-7d15ebb0-0b11-48ea-83d2-1c539add1cf7 req-89ba19aa-fe34-462a-9eac-90a9519eabcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e58c1cf0-5e50-42a9-a430-7a6ef7933743", "name": "network-vif-deleted", "tag": "3ec76678-4c3e-4b85-b561-36b5c6e2241a"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:45.016860 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-7d15ebb0-0b11-48ea-83d2-1c539add1cf7 req-89ba19aa-fe34-462a-9eac-90a9519eabcb service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:45.017762 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-7d15ebb0-0b11-48ea-83d2-1c539add1cf7 req-89ba19aa-fe34-462a-9eac-90a9519eabcb service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:45.032449 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-7d15ebb0-0b11-48ea-83d2-1c539add1cf7 req-89ba19aa-fe34-462a-9eac-90a9519eabcb service nova] Creating event network-vif-deleted:3ec76678-4c3e-4b85-b561-36b5c6e2241a for instance e58c1cf0-5e50-42a9-a430-7a6ef7933743 on n-h2-846435-14 Jul 25 14:41:45.049607 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-7d15ebb0-0b11-48ea-83d2-1c539add1cf7 req-89ba19aa-fe34-462a-9eac-90a9519eabcb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047439 Jul 25 14:41:45.050532 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1795/3819] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:41:45.085853 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-031ff5cb-f21a-456a-965d-405f40e3b0fc tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:45.087278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-031ff5cb-f21a-456a-965d-405f40e3b0fc tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:45.107630 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-031ff5cb-f21a-456a-965d-405f40e3b0fc tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:45.109619 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-031ff5cb-f21a-456a-965d-405f40e3b0fc tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:45.116679 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bb62a319-93af-48dc-b204-f68bc9edef8d tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46868c3670>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:45.125019 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-031ff5cb-f21a-456a-965d-405f40e3b0fc tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:45.127632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-031ff5cb-f21a-456a-965d-405f40e3b0fc tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:45.198328 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bb62a319-93af-48dc-b204-f68bc9edef8d tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc" status: 200 len: 1455 microversion: 2.1 time: 0.087332 Jul 25 14:41:45.207810 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1796/3820] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:41:45 2022] GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc => generated 1455 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:41:45.414655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-031ff5cb-f21a-456a-965d-405f40e3b0fc tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:45.434051 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-031ff5cb-f21a-456a-965d-405f40e3b0fc tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:45.445041 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-031ff5cb-f21a-456a-965d-405f40e3b0fc tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:45.446559 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-031ff5cb-f21a-456a-965d-405f40e3b0fc tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 200 len: 1364 microversion: 2.47 time: 0.368097 Jul 25 14:41:45.447635 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2025/3821] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:45 2022] GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 1364 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:41:45.609747 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-71f81843-c069-4de9-bd36-d0c412573a08 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:45.611645 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-71f81843-c069-4de9-bd36-d0c412573a08 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:45.638567 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e1e516d9-4531-4116-a75b-44a367d9b022 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:45.639444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e1e516d9-4531-4116-a75b-44a367d9b022 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:45.646093 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-71f81843-c069-4de9-bd36-d0c412573a08 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:45.646546 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-71f81843-c069-4de9-bd36-d0c412573a08 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:45.648137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e1e516d9-4531-4116-a75b-44a367d9b022 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:45.648593 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e1e516d9-4531-4116-a75b-44a367d9b022 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:45.654172 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e1e516d9-4531-4116-a75b-44a367d9b022 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:45.654982 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e1e516d9-4531-4116-a75b-44a367d9b022 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:45.655676 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-71f81843-c069-4de9-bd36-d0c412573a08 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:45.656171 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-71f81843-c069-4de9-bd36-d0c412573a08 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:46.201775 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e1e516d9-4531-4116-a75b-44a367d9b022 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:46.216563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e1e516d9-4531-4116-a75b-44a367d9b022 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:46.239338 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e1e516d9-4531-4116-a75b-44a367d9b022 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:46.246236 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e1e516d9-4531-4116-a75b-44a367d9b022 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1726 microversion: 2.20 time: 0.610976 Jul 25 14:41:46.264445 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2026/3822] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:45 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1726 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:41:46.272063 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-730343de-3745-4bb4-9a34-c252c76ad9a7 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:46.273302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-730343de-3745-4bb4-9a34-c252c76ad9a7 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] [instance: e58c1cf0-5e50-42a9-a430-7a6ef7933743] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:46.283527 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-730343de-3745-4bb4-9a34-c252c76ad9a7 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:46.284345 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-730343de-3745-4bb4-9a34-c252c76ad9a7 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:46.285302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-730343de-3745-4bb4-9a34-c252c76ad9a7 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:46.286119 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-730343de-3745-4bb4-9a34-c252c76ad9a7 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:46.302080 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-730343de-3745-4bb4-9a34-c252c76ad9a7 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] HTTP exception thrown: Instance e58c1cf0-5e50-42a9-a430-7a6ef7933743 could not be found. Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-730343de-3745-4bb4-9a34-c252c76ad9a7 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Request method failure captured: Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743 HTTP/1.1 Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qrEzscNKkpLEv-dO5KC3kdeJJY02nOIPLRIxGcrQR-Na_rLZBnVMM8MjTz-RtprnQR45AAorrNLLV4PDOD1PCa-gGNHdgbGOQfAGQYPzZpu9aSUEO6v7jEn8m2OVF51pdW16QE7pCXmLdRnFRt172yMaxqytlLvEMs-sUVBeXNXrcQ Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e77732af189e48feab3752ddb28208d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e77732af189e48feab3752ddb28208d3", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e77732af189e48feab3752ddb28208d3"}]}] Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersTestJSON-1827246574 Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: e77732af189e48feab3752ddb28208d3 Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersTestJSON-1827246574 Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersTestJSON-1827246574-project Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: e45ffe0956ae4ba9b1577875f312af06 Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersTestJSON-1827246574-project Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance e58c1cf0-5e50-42a9-a430-7a6ef7933743 could not be found. Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'e58c1cf0-5e50-42a9-a430-7a6ef7933743'} Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e58c1cf0-5e50-42a9-a430-7a6ef7933743 could not be found. Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e58c1cf0-5e50-42a9-a430-7a6ef7933743 could not be found. Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:46.304266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:41:46.312716 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:41:46.312716 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:41:46.312716 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:41:46.312716 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:41:46.312716 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e58c1cf0-5e50-42a9-a430-7a6ef7933743 could not be found. Jul 25 14:41:46.312716 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:41:46.315106 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-730343de-3745-4bb4-9a34-c252c76ad9a7 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] Returning 404 to user: Instance e58c1cf0-5e50-42a9-a430-7a6ef7933743 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:41:46.316229 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-730343de-3745-4bb4-9a34-c252c76ad9a7 tempest-ServersTestJSON-1827246574 tempest-ServersTestJSON-1827246574-project] 10.222.0.88 "GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743" status: 404 len: 111 microversion: 2.1 time: 0.050642 Jul 25 14:41:46.317130 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2027/3823] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:46 2022] GET /compute/v2.1/servers/e58c1cf0-5e50-42a9-a430-7a6ef7933743 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:41:46.326864 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-04d0da5d-80de-4c75-b852-b746a9dd295c tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46862d38b0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:46.389683 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-04d0da5d-80de-4c75-b852-b746a9dd295c tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc" status: 200 len: 1455 microversion: 2.1 time: 0.067654 Jul 25 14:41:46.391189 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2028/3824] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:41:46 2022] GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc => generated 1455 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:46.473293 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bdf37e81-c232-4ca6-919c-8b07f3760e17 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:46.474241 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bdf37e81-c232-4ca6-919c-8b07f3760e17 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:46.486316 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bdf37e81-c232-4ca6-919c-8b07f3760e17 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:46.487157 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bdf37e81-c232-4ca6-919c-8b07f3760e17 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:46.488171 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bdf37e81-c232-4ca6-919c-8b07f3760e17 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:46.493425 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bdf37e81-c232-4ca6-919c-8b07f3760e17 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:46.690645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bdf37e81-c232-4ca6-919c-8b07f3760e17 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:46.700208 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-71f81843-c069-4de9-bd36-d0c412573a08 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:46.709013 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:41:46.727182 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-71f81843-c069-4de9-bd36-d0c412573a08 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527" status: 200 len: 1314 microversion: 2.1 time: 1.122685 Jul 25 14:41:46.738284 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1797/3825] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:45 2022] GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 => generated 1314 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:46.742693 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bdf37e81-c232-4ca6-919c-8b07f3760e17 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:46.745898 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bdf37e81-c232-4ca6-919c-8b07f3760e17 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:46.756857 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bdf37e81-c232-4ca6-919c-8b07f3760e17 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 200 len: 1364 microversion: 2.47 time: 0.282245 Jul 25 14:41:46.764934 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2029/3826] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:46 2022] GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 1364 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:41:47.276612 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ec89d3b9-ba6f-4cbd-a436-fc26daa0b6a1 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:47.277271 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ec89d3b9-ba6f-4cbd-a436-fc26daa0b6a1 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:47.290420 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec89d3b9-ba6f-4cbd-a436-fc26daa0b6a1 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:47.290974 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec89d3b9-ba6f-4cbd-a436-fc26daa0b6a1 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:47.291777 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec89d3b9-ba6f-4cbd-a436-fc26daa0b6a1 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:47.304782 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec89d3b9-ba6f-4cbd-a436-fc26daa0b6a1 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:47.408436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9b940acb-1dc6-4b70-a8d3-a9bc9232b942 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46862c4280>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:47.481865 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9b940acb-1dc6-4b70-a8d3-a9bc9232b942 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc" status: 200 len: 1455 microversion: 2.1 time: 0.078429 Jul 25 14:41:47.492090 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2030/3827] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:41:47 2022] GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:47.677640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-7c1bcb17-0b02-46e2-af83-1218e74401a8 req-3fea3754-4d40-4572-a117-bdde5b17800c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e128c68-5e95-4535-ab8f-451b2d7ec5da", "tag": "c80cc8b1-d5ac-4df0-b29c-4321c060d4cf"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:47.697846 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-7c1bcb17-0b02-46e2-af83-1218e74401a8 req-3fea3754-4d40-4572-a117-bdde5b17800c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:47.698629 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-7c1bcb17-0b02-46e2-af83-1218e74401a8 req-3fea3754-4d40-4572-a117-bdde5b17800c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:47.728358 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-7c1bcb17-0b02-46e2-af83-1218e74401a8 req-3fea3754-4d40-4572-a117-bdde5b17800c service nova] Creating event network-changed:c80cc8b1-d5ac-4df0-b29c-4321c060d4cf for instance 0e128c68-5e95-4535-ab8f-451b2d7ec5da on n-h2-846435-14 Jul 25 14:41:47.736664 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-7c1bcb17-0b02-46e2-af83-1218e74401a8 req-3fea3754-4d40-4572-a117-bdde5b17800c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064342 Jul 25 14:41:47.737578 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2031/3828] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:41:47.753176 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b0932e80-4c41-4589-b9fa-b9489895c601 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:47.754246 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b0932e80-4c41-4589-b9fa-b9489895c601 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:47.764462 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0932e80-4c41-4589-b9fa-b9489895c601 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:47.764902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0932e80-4c41-4589-b9fa-b9489895c601 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:47.777178 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0932e80-4c41-4589-b9fa-b9489895c601 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:47.777899 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0932e80-4c41-4589-b9fa-b9489895c601 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:47.807516 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ec89d3b9-ba6f-4cbd-a436-fc26daa0b6a1 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:47.823696 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ec89d3b9-ba6f-4cbd-a436-fc26daa0b6a1 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:47.825645 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ec89d3b9-ba6f-4cbd-a436-fc26daa0b6a1 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:47.829076 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ec89d3b9-ba6f-4cbd-a436-fc26daa0b6a1 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1747 microversion: 2.20 time: 0.556644 Jul 25 14:41:47.831367 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1798/3829] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:47 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1747 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:41:47.838679 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-077646fa-aca3-44f8-8fbb-48f2414c8ca1 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:47.839565 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-077646fa-aca3-44f8-8fbb-48f2414c8ca1 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:47.850488 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-077646fa-aca3-44f8-8fbb-48f2414c8ca1 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:47.857149 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-077646fa-aca3-44f8-8fbb-48f2414c8ca1 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:47.859607 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-077646fa-aca3-44f8-8fbb-48f2414c8ca1 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:47.879431 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-077646fa-aca3-44f8-8fbb-48f2414c8ca1 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:47.991884 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-077646fa-aca3-44f8-8fbb-48f2414c8ca1 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:48.002151 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-077646fa-aca3-44f8-8fbb-48f2414c8ca1 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:48.004348 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-077646fa-aca3-44f8-8fbb-48f2414c8ca1 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:48.006132 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-077646fa-aca3-44f8-8fbb-48f2414c8ca1 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 200 len: 1364 microversion: 2.47 time: 0.172168 Jul 25 14:41:48.007138 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1799/3830] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:47 2022] GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:41:48.480765 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b0932e80-4c41-4589-b9fa-b9489895c601 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:48.497501 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b0932e80-4c41-4589-b9fa-b9489895c601 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527" status: 200 len: 1314 microversion: 2.1 time: 0.748519 Jul 25 14:41:48.498691 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2032/3831] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:47 2022] GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 => generated 1314 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:48.499770 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a7aee56f-5e88-4806-9b67-96d2e575d108 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f468675ae50>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:48.568997 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a7aee56f-5e88-4806-9b67-96d2e575d108 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc" status: 200 len: 1455 microversion: 2.1 time: 0.073813 Jul 25 14:41:48.569730 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1800/3832] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:41:48 2022] GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc => generated 1455 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:41:48.859076 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2b4c56d4-93bf-4d1e-b868-d0516ae04bc4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:48.859762 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2b4c56d4-93bf-4d1e-b868-d0516ae04bc4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:48.877338 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b4c56d4-93bf-4d1e-b868-d0516ae04bc4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:48.877791 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b4c56d4-93bf-4d1e-b868-d0516ae04bc4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:48.890127 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b4c56d4-93bf-4d1e-b868-d0516ae04bc4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:48.892074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b4c56d4-93bf-4d1e-b868-d0516ae04bc4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:49.031561 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-92ac56b5-997a-4ec7-bb44-2337e1976f4d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:49.032737 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-92ac56b5-997a-4ec7-bb44-2337e1976f4d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:49.052268 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-92ac56b5-997a-4ec7-bb44-2337e1976f4d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:49.055424 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-92ac56b5-997a-4ec7-bb44-2337e1976f4d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:49.057765 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-92ac56b5-997a-4ec7-bb44-2337e1976f4d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:49.058582 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-92ac56b5-997a-4ec7-bb44-2337e1976f4d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:49.344166 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:41:49.378736 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:41:49.452192 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-92ac56b5-997a-4ec7-bb44-2337e1976f4d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:49.463242 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-92ac56b5-997a-4ec7-bb44-2337e1976f4d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:49.465254 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-92ac56b5-997a-4ec7-bb44-2337e1976f4d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:49.472417 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-92ac56b5-997a-4ec7-bb44-2337e1976f4d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 200 len: 1364 microversion: 2.47 time: 0.445946 Jul 25 14:41:49.473681 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1801/3833] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:49 2022] GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 1364 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:41:49.519894 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-864c6d1a-81cf-4804-9e76-cfad048e05fe tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:49.521025 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-864c6d1a-81cf-4804-9e76-cfad048e05fe tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:49.535664 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-864c6d1a-81cf-4804-9e76-cfad048e05fe tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:49.545026 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-864c6d1a-81cf-4804-9e76-cfad048e05fe tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:49.546224 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-864c6d1a-81cf-4804-9e76-cfad048e05fe tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:49.546842 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-864c6d1a-81cf-4804-9e76-cfad048e05fe tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:49.617676 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:41:49.741198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2b4c56d4-93bf-4d1e-b868-d0516ae04bc4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:49.755008 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2b4c56d4-93bf-4d1e-b868-d0516ae04bc4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:49.761159 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2b4c56d4-93bf-4d1e-b868-d0516ae04bc4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:49.763653 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2b4c56d4-93bf-4d1e-b868-d0516ae04bc4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1747 microversion: 2.20 time: 0.909227 Jul 25 14:41:49.766274 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2033/3834] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:48 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1747 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:41:49.799618 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9fcb71ad-b0ae-47ec-aac5-a3b5bdbf1909 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46862ea550>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:49.907510 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9fcb71ad-b0ae-47ec-aac5-a3b5bdbf1909 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc" status: 200 len: 1455 microversion: 2.1 time: 0.133961 Jul 25 14:41:49.908423 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2034/3835] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:41:49 2022] GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc => generated 1455 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:50.075751 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-864c6d1a-81cf-4804-9e76-cfad048e05fe tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:50.090715 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-864c6d1a-81cf-4804-9e76-cfad048e05fe tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527" status: 200 len: 1314 microversion: 2.1 time: 0.575897 Jul 25 14:41:50.091424 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1802/3836] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:49 2022] GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 => generated 1314 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:50.503358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e468640c-b453-419b-9a15-e69f9cf432bb tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:50.504012 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e468640c-b453-419b-9a15-e69f9cf432bb tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:50.524922 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e468640c-b453-419b-9a15-e69f9cf432bb tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:50.525263 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e468640c-b453-419b-9a15-e69f9cf432bb tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:50.526068 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e468640c-b453-419b-9a15-e69f9cf432bb tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:50.526506 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e468640c-b453-419b-9a15-e69f9cf432bb tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:50.576320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-0f015259-a66f-447e-aea7-469dfa057991 req-dc9dd9e0-d457-480e-9a4b-f37c1b9a0be4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "034e5d63-63a1-4883-b7f8-fe84ec541914", "name": "network-vif-plugged", "status": "completed", "tag": "350ec399-ee42-4e58-9f27-5bd9094cb8e1"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:50.597854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-0f015259-a66f-447e-aea7-469dfa057991 req-dc9dd9e0-d457-480e-9a4b-f37c1b9a0be4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:50.598555 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-0f015259-a66f-447e-aea7-469dfa057991 req-dc9dd9e0-d457-480e-9a4b-f37c1b9a0be4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:50.663132 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-0f015259-a66f-447e-aea7-469dfa057991 req-dc9dd9e0-d457-480e-9a4b-f37c1b9a0be4 service nova] Creating event network-vif-plugged:350ec399-ee42-4e58-9f27-5bd9094cb8e1 for instance 034e5d63-63a1-4883-b7f8-fe84ec541914 on n-h2-846435-14 Jul 25 14:41:50.677395 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-0f015259-a66f-447e-aea7-469dfa057991 req-dc9dd9e0-d457-480e-9a4b-f37c1b9a0be4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116651 Jul 25 14:41:50.680092 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1803/3837] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:41:50.694834 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-fe04c7f5-1563-4e35-88d7-7598965ad690 req-60b5224d-a461-435b-adc4-ba0f07163bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3d218da-f592-4489-8617-c37441df3527", "tag": "efeb5f5c-13f9-4a6a-bc96-b1c65198b352"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:50.722555 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-fe04c7f5-1563-4e35-88d7-7598965ad690 req-60b5224d-a461-435b-adc4-ba0f07163bd7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:50.726349 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-fe04c7f5-1563-4e35-88d7-7598965ad690 req-60b5224d-a461-435b-adc4-ba0f07163bd7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:50.744768 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e468640c-b453-419b-9a15-e69f9cf432bb tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:50.753256 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-fe04c7f5-1563-4e35-88d7-7598965ad690 req-60b5224d-a461-435b-adc4-ba0f07163bd7 service nova] Creating event network-changed:efeb5f5c-13f9-4a6a-bc96-b1c65198b352 for instance c3d218da-f592-4489-8617-c37441df3527 on n-h2-846435-14 Jul 25 14:41:50.754277 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e468640c-b453-419b-9a15-e69f9cf432bb tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:50.755828 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e468640c-b453-419b-9a15-e69f9cf432bb tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:50.763611 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e468640c-b453-419b-9a15-e69f9cf432bb tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 200 len: 1364 microversion: 2.47 time: 0.267173 Jul 25 14:41:50.764296 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2035/3838] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:50 2022] GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 1364 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:41:50.766851 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-fe04c7f5-1563-4e35-88d7-7598965ad690 req-60b5224d-a461-435b-adc4-ba0f07163bd7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085325 Jul 25 14:41:50.768215 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1804/3839] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:41:50.792088 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-39340df8-f907-4b25-930a-44e86f297e19 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:50.792617 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-39340df8-f907-4b25-930a-44e86f297e19 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:50.807780 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-39340df8-f907-4b25-930a-44e86f297e19 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:50.808279 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-39340df8-f907-4b25-930a-44e86f297e19 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:50.809087 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-39340df8-f907-4b25-930a-44e86f297e19 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:50.809524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-39340df8-f907-4b25-930a-44e86f297e19 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:50.927347 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-12779c31-667b-4929-8263-d5acce62c384 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46989bb040>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:51.002138 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-12779c31-667b-4929-8263-d5acce62c384 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc" status: 200 len: 1455 microversion: 2.1 time: 0.082128 Jul 25 14:41:51.002754 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1805/3840] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:41:50 2022] GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:41:51.115856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ce16988d-c356-41ff-b451-855638570861 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:51.116969 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ce16988d-c356-41ff-b451-855638570861 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:51.138759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ce16988d-c356-41ff-b451-855638570861 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:51.139240 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ce16988d-c356-41ff-b451-855638570861 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:51.140072 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ce16988d-c356-41ff-b451-855638570861 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:51.140762 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ce16988d-c356-41ff-b451-855638570861 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:51.503447 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ce16988d-c356-41ff-b451-855638570861 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:51.507098 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:41:51.522285 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ce16988d-c356-41ff-b451-855638570861 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527" status: 200 len: 1314 microversion: 2.1 time: 0.411265 Jul 25 14:41:51.522894 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1806/3841] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:51 2022] GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:51.792501 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-51829cf1-7b39-4bef-aade-7b3126ac6020 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:51.793290 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-51829cf1-7b39-4bef-aade-7b3126ac6020 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:51.812872 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-51829cf1-7b39-4bef-aade-7b3126ac6020 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:51.814617 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-51829cf1-7b39-4bef-aade-7b3126ac6020 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:51.815411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-51829cf1-7b39-4bef-aade-7b3126ac6020 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:51.819114 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-51829cf1-7b39-4bef-aade-7b3126ac6020 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:51.979049 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-51829cf1-7b39-4bef-aade-7b3126ac6020 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:51.995370 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-51829cf1-7b39-4bef-aade-7b3126ac6020 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:51.998750 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-51829cf1-7b39-4bef-aade-7b3126ac6020 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:52.006175 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-51829cf1-7b39-4bef-aade-7b3126ac6020 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 200 len: 1364 microversion: 2.47 time: 0.222446 Jul 25 14:41:52.007626 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1807/3842] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:51 2022] GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 1364 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:41:52.022715 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-64017c50-d80d-48b0-a6b8-1491626c848e tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46989a9f70>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:52.085268 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-64017c50-d80d-48b0-a6b8-1491626c848e tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc" status: 200 len: 1455 microversion: 2.1 time: 0.066828 Jul 25 14:41:52.086659 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1808/3843] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:41:52 2022] GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc => generated 1455 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:52.337749 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-39340df8-f907-4b25-930a-44e86f297e19 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:52.351519 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-39340df8-f907-4b25-930a-44e86f297e19 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:52.357089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-39340df8-f907-4b25-930a-44e86f297e19 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:52.358497 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-39340df8-f907-4b25-930a-44e86f297e19 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1747 microversion: 2.20 time: 1.570378 Jul 25 14:41:52.358880 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2036/3844] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:50 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1747 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:41:52.545629 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-37fc7c8a-524c-4e00-9f34-64a5022711cf tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:52.546903 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-37fc7c8a-524c-4e00-9f34-64a5022711cf tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:52.561082 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37fc7c8a-524c-4e00-9f34-64a5022711cf tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:52.561540 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37fc7c8a-524c-4e00-9f34-64a5022711cf tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:52.566559 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37fc7c8a-524c-4e00-9f34-64a5022711cf tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:52.567319 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37fc7c8a-524c-4e00-9f34-64a5022711cf tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:53.042115 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-860fce68-1c13-460c-bfe4-6a94d22c8a73 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:53.043187 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-860fce68-1c13-460c-bfe4-6a94d22c8a73 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:53.057522 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-860fce68-1c13-460c-bfe4-6a94d22c8a73 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:53.058302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-860fce68-1c13-460c-bfe4-6a94d22c8a73 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:53.062936 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-860fce68-1c13-460c-bfe4-6a94d22c8a73 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:53.063598 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-860fce68-1c13-460c-bfe4-6a94d22c8a73 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:53.229254 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-37fc7c8a-524c-4e00-9f34-64a5022711cf tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:53.248506 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-37fc7c8a-524c-4e00-9f34-64a5022711cf tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527" status: 200 len: 1314 microversion: 2.1 time: 0.707006 Jul 25 14:41:53.251449 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1809/3845] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:52 2022] GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 => generated 1314 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:53.263040 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b223c591-8ffa-43a7-ba1f-8b0edd510959 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46867633a0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:53.566042 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-860fce68-1c13-460c-bfe4-6a94d22c8a73 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:53.578417 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-860fce68-1c13-460c-bfe4-6a94d22c8a73 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:53.585158 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-860fce68-1c13-460c-bfe4-6a94d22c8a73 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:53.590952 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-860fce68-1c13-460c-bfe4-6a94d22c8a73 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 200 len: 1364 microversion: 2.47 time: 0.552649 Jul 25 14:41:53.592646 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2037/3846] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:53 2022] GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 1364 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:41:53.602867 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-837aa164-03b4-456e-b3cc-48bc3f8fce08 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:53.608761 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-837aa164-03b4-456e-b3cc-48bc3f8fce08 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:53.626356 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-837aa164-03b4-456e-b3cc-48bc3f8fce08 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:53.627094 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-837aa164-03b4-456e-b3cc-48bc3f8fce08 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:53.629602 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-837aa164-03b4-456e-b3cc-48bc3f8fce08 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:53.631116 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-837aa164-03b4-456e-b3cc-48bc3f8fce08 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:54.064896 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-837aa164-03b4-456e-b3cc-48bc3f8fce08 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:54.075071 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-837aa164-03b4-456e-b3cc-48bc3f8fce08 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:54.076623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-837aa164-03b4-456e-b3cc-48bc3f8fce08 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:54.077838 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-837aa164-03b4-456e-b3cc-48bc3f8fce08 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1742 microversion: 2.20 time: 0.483330 Jul 25 14:41:54.093669 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2038/3847] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:53 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1742 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:41:54.273027 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-de7d11ce-a46b-4e69-8742-c35632cbf0fa tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:54.274093 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-de7d11ce-a46b-4e69-8742-c35632cbf0fa tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:54.290016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-de7d11ce-a46b-4e69-8742-c35632cbf0fa tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:54.292792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-de7d11ce-a46b-4e69-8742-c35632cbf0fa tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:54.296203 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-de7d11ce-a46b-4e69-8742-c35632cbf0fa tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:54.296958 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-de7d11ce-a46b-4e69-8742-c35632cbf0fa tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:56.084495 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-de7d11ce-a46b-4e69-8742-c35632cbf0fa tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:56.114983 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-de7d11ce-a46b-4e69-8742-c35632cbf0fa tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527" status: 200 len: 1314 microversion: 2.1 time: 1.845608 Jul 25 14:41:56.135680 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2039/3848] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:54 2022] GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 => generated 1314 bytes in 1850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:41:56.151477 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e3dd5658-59f5-4563-9773-d2ce120c3872 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:56.154263 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e3dd5658-59f5-4563-9773-d2ce120c3872 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:56.187820 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3dd5658-59f5-4563-9773-d2ce120c3872 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:56.188295 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3dd5658-59f5-4563-9773-d2ce120c3872 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:56.189072 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3dd5658-59f5-4563-9773-d2ce120c3872 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:56.189504 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3dd5658-59f5-4563-9773-d2ce120c3872 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:56.480555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e3dd5658-59f5-4563-9773-d2ce120c3872 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:56.495564 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e3dd5658-59f5-4563-9773-d2ce120c3872 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:56.512539 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e3dd5658-59f5-4563-9773-d2ce120c3872 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:56.514462 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e3dd5658-59f5-4563-9773-d2ce120c3872 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 200 len: 1364 microversion: 2.47 time: 0.375583 Jul 25 14:41:56.532583 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2040/3849] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:56 2022] GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 1364 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:41:56.546292 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-60a2c501-5dbe-445f-9897-f52c508b5fd5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:56.552215 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-60a2c501-5dbe-445f-9897-f52c508b5fd5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:56.576339 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60a2c501-5dbe-445f-9897-f52c508b5fd5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:56.580666 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60a2c501-5dbe-445f-9897-f52c508b5fd5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:56.585679 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60a2c501-5dbe-445f-9897-f52c508b5fd5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:56.586411 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60a2c501-5dbe-445f-9897-f52c508b5fd5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:57.289497 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-60a2c501-5dbe-445f-9897-f52c508b5fd5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:57.315546 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-60a2c501-5dbe-445f-9897-f52c508b5fd5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:57.317662 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-60a2c501-5dbe-445f-9897-f52c508b5fd5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:57.319506 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-60a2c501-5dbe-445f-9897-f52c508b5fd5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1742 microversion: 2.20 time: 0.785319 Jul 25 14:41:57.321603 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2041/3850] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:56 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1742 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:41:57.329195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2b3bc7cb-cf02-4ba3-a472-43e5365d5b6b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:57.349772 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2b3bc7cb-cf02-4ba3-a472-43e5365d5b6b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:57.365759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b3bc7cb-cf02-4ba3-a472-43e5365d5b6b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:57.366600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b3bc7cb-cf02-4ba3-a472-43e5365d5b6b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:57.367565 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b3bc7cb-cf02-4ba3-a472-43e5365d5b6b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:57.369031 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b3bc7cb-cf02-4ba3-a472-43e5365d5b6b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:58.238284 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2b3bc7cb-cf02-4ba3-a472-43e5365d5b6b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:58.248286 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2b3bc7cb-cf02-4ba3-a472-43e5365d5b6b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527" status: 200 len: 1314 microversion: 2.1 time: 0.925358 Jul 25 14:41:58.253460 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2042/3851] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:57 2022] GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 => generated 1314 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:41:58.264851 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-63ea069f-7ab6-4f75-861c-573c4d36ab2d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:58.268761 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-63ea069f-7ab6-4f75-861c-573c4d36ab2d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:58.282408 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63ea069f-7ab6-4f75-861c-573c4d36ab2d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:58.283226 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63ea069f-7ab6-4f75-861c-573c4d36ab2d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:58.291368 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63ea069f-7ab6-4f75-861c-573c4d36ab2d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:58.292634 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63ea069f-7ab6-4f75-861c-573c4d36ab2d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:58.506481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-63ea069f-7ab6-4f75-861c-573c4d36ab2d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:58.527423 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-63ea069f-7ab6-4f75-861c-573c4d36ab2d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:58.534345 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-63ea069f-7ab6-4f75-861c-573c4d36ab2d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:58.536769 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-63ea069f-7ab6-4f75-861c-573c4d36ab2d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 200 len: 1364 microversion: 2.47 time: 0.275700 Jul 25 14:41:58.539321 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2043/3852] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:58 2022] GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 1364 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:41:58.563513 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5f591840-d55b-4524-9815-07f07c3dd7fa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:58.568864 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5f591840-d55b-4524-9815-07f07c3dd7fa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:58.584844 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5f591840-d55b-4524-9815-07f07c3dd7fa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:58.592793 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5f591840-d55b-4524-9815-07f07c3dd7fa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:58.593974 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5f591840-d55b-4524-9815-07f07c3dd7fa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:58.601534 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5f591840-d55b-4524-9815-07f07c3dd7fa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:59.128818 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5f591840-d55b-4524-9815-07f07c3dd7fa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:59.138921 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5f591840-d55b-4524-9815-07f07c3dd7fa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:59.145404 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5f591840-d55b-4524-9815-07f07c3dd7fa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:41:59.151119 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5f591840-d55b-4524-9815-07f07c3dd7fa tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1742 microversion: 2.20 time: 0.605665 Jul 25 14:41:59.168682 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2044/3853] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:41:58 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1742 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:41:59.270524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-40d8bf60-7a98-4342-a418-256ff6c2e041 req-a3bbe9e2-dccd-4016-a26c-d31bf4d9934f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d218da-f592-4489-8617-c37441df3527", "name": "network-vif-plugged", "status": "completed", "tag": "efeb5f5c-13f9-4a6a-bc96-b1c65198b352"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:41:59.292311 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-40d8bf60-7a98-4342-a418-256ff6c2e041 req-a3bbe9e2-dccd-4016-a26c-d31bf4d9934f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:59.296255 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-40d8bf60-7a98-4342-a418-256ff6c2e041 req-a3bbe9e2-dccd-4016-a26c-d31bf4d9934f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:59.328756 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-40d8bf60-7a98-4342-a418-256ff6c2e041 req-a3bbe9e2-dccd-4016-a26c-d31bf4d9934f service nova] Creating event network-vif-plugged:efeb5f5c-13f9-4a6a-bc96-b1c65198b352 for instance c3d218da-f592-4489-8617-c37441df3527 on n-h2-846435-14 Jul 25 14:41:59.352457 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-40d8bf60-7a98-4342-a418-256ff6c2e041 req-a3bbe9e2-dccd-4016-a26c-d31bf4d9934f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087485 Jul 25 14:41:59.356057 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2045/3854] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:41:59.375071 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f90afc69-e00f-44a2-874b-2b6744303899 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:41:59.379874 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f90afc69-e00f-44a2-874b-2b6744303899 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:41:59.408020 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f90afc69-e00f-44a2-874b-2b6744303899 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:59.408899 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f90afc69-e00f-44a2-874b-2b6744303899 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:41:59.416392 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f90afc69-e00f-44a2-874b-2b6744303899 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:41:59.420857 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f90afc69-e00f-44a2-874b-2b6744303899 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:00.976492 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f90afc69-e00f-44a2-874b-2b6744303899 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:00.984622 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f90afc69-e00f-44a2-874b-2b6744303899 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527" status: 200 len: 1314 microversion: 2.1 time: 1.622741 Jul 25 14:42:00.995546 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2046/3855] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:41:59 2022] GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 => generated 1314 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:01.012464 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e0bc9df4-a0b8-4cad-950a-c7c2cd8abe4b tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:01.022988 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e0bc9df4-a0b8-4cad-950a-c7c2cd8abe4b tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:01.050069 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e0bc9df4-a0b8-4cad-950a-c7c2cd8abe4b tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:01.056686 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e0bc9df4-a0b8-4cad-950a-c7c2cd8abe4b tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:01.057880 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e0bc9df4-a0b8-4cad-950a-c7c2cd8abe4b tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:01.058535 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e0bc9df4-a0b8-4cad-950a-c7c2cd8abe4b tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:01.222576 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e0bc9df4-a0b8-4cad-950a-c7c2cd8abe4b tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:01.247717 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e0bc9df4-a0b8-4cad-950a-c7c2cd8abe4b tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:01.250529 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e0bc9df4-a0b8-4cad-950a-c7c2cd8abe4b tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:01.253881 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e0bc9df4-a0b8-4cad-950a-c7c2cd8abe4b tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 200 len: 1364 microversion: 2.47 time: 0.256337 Jul 25 14:42:01.255565 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2047/3856] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:00 2022] GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 1364 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:42:01.265795 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-44ae889a-5523-4378-b43f-ae0707af1a15 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:01.266849 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-44ae889a-5523-4378-b43f-ae0707af1a15 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:01.279930 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-44ae889a-5523-4378-b43f-ae0707af1a15 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:01.287196 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-44ae889a-5523-4378-b43f-ae0707af1a15 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:01.288379 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-44ae889a-5523-4378-b43f-ae0707af1a15 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:01.288886 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-44ae889a-5523-4378-b43f-ae0707af1a15 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:01.802284 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-44ae889a-5523-4378-b43f-ae0707af1a15 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:01.815218 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-44ae889a-5523-4378-b43f-ae0707af1a15 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:01.825296 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-44ae889a-5523-4378-b43f-ae0707af1a15 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:01.826694 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-44ae889a-5523-4378-b43f-ae0707af1a15 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1742 microversion: 2.20 time: 0.569648 Jul 25 14:42:01.827312 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2048/3857] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:01 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1742 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:42:02.017926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d0ad3ee8-edb0-4c52-8827-7610541165e9 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:02.024705 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d0ad3ee8-edb0-4c52-8827-7610541165e9 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:02.061094 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d0ad3ee8-edb0-4c52-8827-7610541165e9 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:02.061830 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d0ad3ee8-edb0-4c52-8827-7610541165e9 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:02.073446 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d0ad3ee8-edb0-4c52-8827-7610541165e9 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:02.077768 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d0ad3ee8-edb0-4c52-8827-7610541165e9 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:02.552229 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:42:02.998780 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d0ad3ee8-edb0-4c52-8827-7610541165e9 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:03.025864 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:42:03.039573 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d0ad3ee8-edb0-4c52-8827-7610541165e9 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527" status: 200 len: 1314 microversion: 2.1 time: 1.028280 Jul 25 14:42:03.042737 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2049/3858] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:42:02 2022] GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 => generated 1314 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:03.087918 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e9754a86-0bc5-4c51-9953-c8ff018878d1 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:03.087918 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e9754a86-0bc5-4c51-9953-c8ff018878d1 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:03.107707 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e9754a86-0bc5-4c51-9953-c8ff018878d1 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:03.109029 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e9754a86-0bc5-4c51-9953-c8ff018878d1 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:03.110104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e9754a86-0bc5-4c51-9953-c8ff018878d1 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:03.110882 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e9754a86-0bc5-4c51-9953-c8ff018878d1 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:03.237485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=12 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:42:03.304003 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e9754a86-0bc5-4c51-9953-c8ff018878d1 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:03.326082 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e9754a86-0bc5-4c51-9953-c8ff018878d1 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:03.328004 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e9754a86-0bc5-4c51-9953-c8ff018878d1 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:03.332944 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e9754a86-0bc5-4c51-9953-c8ff018878d1 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 200 len: 1364 microversion: 2.47 time: 0.286992 Jul 25 14:42:03.333784 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2050/3859] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:03 2022] GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 1364 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:42:03.339915 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9800953e-767f-41a3-910d-2f324d04949f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:03.344813 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9800953e-767f-41a3-910d-2f324d04949f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:03.358767 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9800953e-767f-41a3-910d-2f324d04949f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:03.360515 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9800953e-767f-41a3-910d-2f324d04949f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:03.361604 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9800953e-767f-41a3-910d-2f324d04949f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:03.364792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9800953e-767f-41a3-910d-2f324d04949f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:03.378934 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b223c591-8ffa-43a7-ba1f-8b0edd510959 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc" status: 200 len: 1464 microversion: 2.1 time: 10.126084 Jul 25 14:42:03.380224 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1810/3860] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:41:53 2022] GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc => generated 1464 bytes in 10128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:03.381395 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b223c591-8ffa-43a7-ba1f-8b0edd510959 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:03.386869 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b223c591-8ffa-43a7-ba1f-8b0edd510959 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute//" status: 200 len: 377 microversion: - time: 0.005551 Jul 25 14:42:03.390169 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1811/3861] 10.222.0.88 () {56 vars in 886 bytes} [Mon Jul 25 14:42:03 2022] GET /compute/ => generated 377 bytes in 9 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 25 14:42:03.396952 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4690242e-9f25-439e-9d84-590e97bf9a2c tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46987d9b80>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:03.486031 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4690242e-9f25-439e-9d84-590e97bf9a2c tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc" status: 200 len: 1464 microversion: 2.1 time: 0.092818 Jul 25 14:42:03.495414 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1812/3862] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:03 2022] GET /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc => generated 1464 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:03.503853 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8bdc6cb1-4b85-4789-bf3a-b848484b62f0 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:03.504637 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8bdc6cb1-4b85-4789-bf3a-b848484b62f0 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: dfb8c05d-0ccc-4b4d-a920-d8238e56f0de] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:03.527399 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8bdc6cb1-4b85-4789-bf3a-b848484b62f0 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:03.528443 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8bdc6cb1-4b85-4789-bf3a-b848484b62f0 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:03.530784 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8bdc6cb1-4b85-4789-bf3a-b848484b62f0 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:03.534550 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8bdc6cb1-4b85-4789-bf3a-b848484b62f0 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:03.724027 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9800953e-767f-41a3-910d-2f324d04949f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:03.737150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9800953e-767f-41a3-910d-2f324d04949f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:03.741853 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9800953e-767f-41a3-910d-2f324d04949f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:03.744560 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9800953e-767f-41a3-910d-2f324d04949f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1742 microversion: 2.20 time: 0.409622 Jul 25 14:42:03.747521 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2051/3863] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:03 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1742 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:42:04.062888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d257cc26-3368-43a9-9171-8d342088e885 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:04.063604 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d257cc26-3368-43a9-9171-8d342088e885 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:04.081081 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d257cc26-3368-43a9-9171-8d342088e885 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:04.081828 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d257cc26-3368-43a9-9171-8d342088e885 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:04.083281 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d257cc26-3368-43a9-9171-8d342088e885 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:04.085147 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d257cc26-3368-43a9-9171-8d342088e885 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:04.207913 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8bdc6cb1-4b85-4789-bf3a-b848484b62f0 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:04.221539 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8bdc6cb1-4b85-4789-bf3a-b848484b62f0 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de" status: 200 len: 1481 microversion: 2.1 time: 0.719800 Jul 25 14:42:04.224577 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1813/3864] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:42:03 2022] GET /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de => generated 1481 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:04.371533 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a287e6c8-379a-4076-99fa-7a2a1b2d009e tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:04.377056 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a287e6c8-379a-4076-99fa-7a2a1b2d009e tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:04.401114 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a287e6c8-379a-4076-99fa-7a2a1b2d009e tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:04.410921 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a287e6c8-379a-4076-99fa-7a2a1b2d009e tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:04.411887 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a287e6c8-379a-4076-99fa-7a2a1b2d009e tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:04.417373 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a287e6c8-379a-4076-99fa-7a2a1b2d009e tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:04.615284 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d257cc26-3368-43a9-9171-8d342088e885 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:04.625213 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d257cc26-3368-43a9-9171-8d342088e885 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527" status: 200 len: 1501 microversion: 2.1 time: 0.566161 Jul 25 14:42:04.656350 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2052/3865] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:42:04 2022] GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 => generated 1501 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:04.675772 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a287e6c8-379a-4076-99fa-7a2a1b2d009e tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:04.697070 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a287e6c8-379a-4076-99fa-7a2a1b2d009e tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:04.699900 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a287e6c8-379a-4076-99fa-7a2a1b2d009e tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:04.704249 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a287e6c8-379a-4076-99fa-7a2a1b2d009e tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 200 len: 1382 microversion: 2.47 time: 0.340370 Jul 25 14:42:04.722889 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1814/3866] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:04 2022] GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 1382 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:42:04.770068 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f82fe5bd-c281-48ba-a694-fdef7eb1d802 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:04.778277 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f82fe5bd-c281-48ba-a694-fdef7eb1d802 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:04.790576 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f82fe5bd-c281-48ba-a694-fdef7eb1d802 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:04.791032 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f82fe5bd-c281-48ba-a694-fdef7eb1d802 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:04.791818 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f82fe5bd-c281-48ba-a694-fdef7eb1d802 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:04.792286 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f82fe5bd-c281-48ba-a694-fdef7eb1d802 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:05.246583 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bc755d26-f2ee-41e1-b5d7-efbc73588320 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:05.247250 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bc755d26-f2ee-41e1-b5d7-efbc73588320 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: dfb8c05d-0ccc-4b4d-a920-d8238e56f0de] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:05.262722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bc755d26-f2ee-41e1-b5d7-efbc73588320 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:05.266003 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bc755d26-f2ee-41e1-b5d7-efbc73588320 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:05.267038 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bc755d26-f2ee-41e1-b5d7-efbc73588320 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:05.267660 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bc755d26-f2ee-41e1-b5d7-efbc73588320 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:05.499303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f82fe5bd-c281-48ba-a694-fdef7eb1d802 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:05.522039 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f82fe5bd-c281-48ba-a694-fdef7eb1d802 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:05.523821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f82fe5bd-c281-48ba-a694-fdef7eb1d802 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:05.531126 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f82fe5bd-c281-48ba-a694-fdef7eb1d802 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1742 microversion: 2.20 time: 0.763531 Jul 25 14:42:05.551314 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2053/3867] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:04 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1742 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:42:05.597168 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bc755d26-f2ee-41e1-b5d7-efbc73588320 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:05.607030 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bc755d26-f2ee-41e1-b5d7-efbc73588320 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de" status: 200 len: 1468 microversion: 2.1 time: 0.364771 Jul 25 14:42:05.635691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-eecf7b15-160e-483b-b3a0-7219c4330f06 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1441536864"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:42:05.640407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-eecf7b15-160e-483b-b3a0-7219c4330f06 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: 794b7eaa-2e72-4ffc-aced-1dfb494e3554] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:05.643437 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1815/3868] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:42:05 2022] GET /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de => generated 1468 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:42:05.663914 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eecf7b15-160e-483b-b3a0-7219c4330f06 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:05.668424 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eecf7b15-160e-483b-b3a0-7219c4330f06 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:05.669949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eecf7b15-160e-483b-b3a0-7219c4330f06 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:05.672182 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eecf7b15-160e-483b-b3a0-7219c4330f06 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:05.733889 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-988cef2e-c997-4932-b6e2-02c7f16e43f9 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:05.734737 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-988cef2e-c997-4932-b6e2-02c7f16e43f9 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:05.747497 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-988cef2e-c997-4932-b6e2-02c7f16e43f9 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:05.760880 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-988cef2e-c997-4932-b6e2-02c7f16e43f9 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:05.767688 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-988cef2e-c997-4932-b6e2-02c7f16e43f9 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:05.772052 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-988cef2e-c997-4932-b6e2-02c7f16e43f9 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:05.985056 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-988cef2e-c997-4932-b6e2-02c7f16e43f9 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:06.008919 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-988cef2e-c997-4932-b6e2-02c7f16e43f9 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:06.014419 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-988cef2e-c997-4932-b6e2-02c7f16e43f9 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:06.017501 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-988cef2e-c997-4932-b6e2-02c7f16e43f9 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 200 len: 1370 microversion: 2.47 time: 0.287747 Jul 25 14:42:06.021722 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1816/3869] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:05 2022] GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 1370 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:42:06.115888 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-eecf7b15-160e-483b-b3a0-7219c4330f06 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "POST /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554/action" status: 202 len: 0 microversion: 2.1 time: 0.485438 Jul 25 14:42:06.126167 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2054/3870] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:42:05 2022] POST /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554/action => generated 0 bytes in 497 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 14:42:06.128075 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9ef20360-1cac-47de-8171-23956ccde65b tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f4698915e50>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:06.260743 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9ef20360-1cac-47de-8171-23956ccde65b tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf" status: 200 len: 1455 microversion: 2.1 time: 0.137507 Jul 25 14:42:06.261405 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1817/3871] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:06 2022] GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf => generated 1455 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:42:06.557014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-58d4cfd0-dd6f-429f-8c7d-a7c73dada5e0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:06.558143 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-58d4cfd0-dd6f-429f-8c7d-a7c73dada5e0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:06.576338 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-58d4cfd0-dd6f-429f-8c7d-a7c73dada5e0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:06.576791 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-58d4cfd0-dd6f-429f-8c7d-a7c73dada5e0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:06.577568 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-58d4cfd0-dd6f-429f-8c7d-a7c73dada5e0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:06.577999 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-58d4cfd0-dd6f-429f-8c7d-a7c73dada5e0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:06.983214 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-58d4cfd0-dd6f-429f-8c7d-a7c73dada5e0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:07.003936 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-58d4cfd0-dd6f-429f-8c7d-a7c73dada5e0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:07.007312 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-58d4cfd0-dd6f-429f-8c7d-a7c73dada5e0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:07.016190 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-58d4cfd0-dd6f-429f-8c7d-a7c73dada5e0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1742 microversion: 2.20 time: 0.463825 Jul 25 14:42:07.033711 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2055/3872] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:06 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1742 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:42:07.049220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-89a39911-f383-4af5-8811-496867e38f98 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:07.050222 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-89a39911-f383-4af5-8811-496867e38f98 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:07.062883 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89a39911-f383-4af5-8811-496867e38f98 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:07.066277 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89a39911-f383-4af5-8811-496867e38f98 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:07.067473 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89a39911-f383-4af5-8811-496867e38f98 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:07.070252 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89a39911-f383-4af5-8811-496867e38f98 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:07.114015 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-8c3932a0-3961-4904-9f69-ae869d7f836a req-c8b82661-2c91-4fea-9759-05314a23430a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfb8c05d-0ccc-4b4d-a920-d8238e56f0de", "name": "network-vif-unplugged", "status": "completed", "tag": "78158429-4b1a-4039-9efe-77450874ee04"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:42:07.141789 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-8c3932a0-3961-4904-9f69-ae869d7f836a req-c8b82661-2c91-4fea-9759-05314a23430a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:07.144860 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-8c3932a0-3961-4904-9f69-ae869d7f836a req-c8b82661-2c91-4fea-9759-05314a23430a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:07.186692 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-8c3932a0-3961-4904-9f69-ae869d7f836a req-c8b82661-2c91-4fea-9759-05314a23430a service nova] Creating event network-vif-unplugged:78158429-4b1a-4039-9efe-77450874ee04 for instance dfb8c05d-0ccc-4b4d-a920-d8238e56f0de on n-h2-846435-14 Jul 25 14:42:07.207102 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-8c3932a0-3961-4904-9f69-ae869d7f836a req-c8b82661-2c91-4fea-9759-05314a23430a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097086 Jul 25 14:42:07.212063 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2056/3873] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:42:07.278882 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2ac9f7c5-f419-4c97-ae9b-9be5d1685db7 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46862ee430>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:07.377371 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-89a39911-f383-4af5-8811-496867e38f98 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:07.378325 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2ac9f7c5-f419-4c97-ae9b-9be5d1685db7 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf" status: 200 len: 1455 microversion: 2.1 time: 0.105961 Jul 25 14:42:07.378910 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2057/3874] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:07 2022] GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:07.391024 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-89a39911-f383-4af5-8811-496867e38f98 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:07.395603 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-89a39911-f383-4af5-8811-496867e38f98 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:07.398602 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-89a39911-f383-4af5-8811-496867e38f98 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 200 len: 1355 microversion: 2.47 time: 0.353430 Jul 25 14:42:07.400119 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1818/3875] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:07 2022] GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 1355 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:42:07.425697 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3f2141e9-26b8-4331-b3f6-b42fb9dd75c2 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:07.431512 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3f2141e9-26b8-4331-b3f6-b42fb9dd75c2 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:07.432396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3f2141e9-26b8-4331-b3f6-b42fb9dd75c2 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Searching by: {'deleted': False, 'project_id': '79f00a92563647618eeb7aa9b0109830'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:42:07.447281 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f2141e9-26b8-4331-b3f6-b42fb9dd75c2 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:07.447723 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f2141e9-26b8-4331-b3f6-b42fb9dd75c2 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:07.448532 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f2141e9-26b8-4331-b3f6-b42fb9dd75c2 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:07.448966 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f2141e9-26b8-4331-b3f6-b42fb9dd75c2 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:07.524643 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-eb36c7c1-3a9b-4b19-beaf-a5eeaed1933f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd839dca-55e3-4e4b-a312-5e3b88b3b820"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:42:07.527389 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-eb36c7c1-3a9b-4b19-beaf-a5eeaed1933f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:07.542946 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eb36c7c1-3a9b-4b19-beaf-a5eeaed1933f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:07.543872 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eb36c7c1-3a9b-4b19-beaf-a5eeaed1933f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:07.544916 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eb36c7c1-3a9b-4b19-beaf-a5eeaed1933f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:07.545518 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eb36c7c1-3a9b-4b19-beaf-a5eeaed1933f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:07.661321 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.multi_cell_list [None req-3f2141e9-26b8-4331-b3f6-b42fb9dd75c2 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119304) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:42:07.824564 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3f2141e9-26b8-4331-b3f6-b42fb9dd75c2 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:07.831384 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:42:07.834136 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f2141e9-26b8-4331-b3f6-b42fb9dd75c2 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:07.834828 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f2141e9-26b8-4331-b3f6-b42fb9dd75c2 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:07.851883 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3f2141e9-26b8-4331-b3f6-b42fb9dd75c2 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:07.853743 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3f2141e9-26b8-4331-b3f6-b42fb9dd75c2 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:07.918660 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3f2141e9-26b8-4331-b3f6-b42fb9dd75c2 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/detail" status: 200 len: 2704 microversion: 2.47 time: 0.496959 Jul 25 14:42:07.932184 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2058/3876] 10.222.0.88 () {60 vars in 1187 bytes} [Mon Jul 25 14:42:07 2022] GET /compute/v2.1/servers/detail => generated 2704 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:42:07.961903 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-eb36c7c1-3a9b-4b19-beaf-a5eeaed1933f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "POST /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.441498 Jul 25 14:42:07.988425 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1819/3877] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Jul 25 14:42:07 2022] POST /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527/os-volume_attachments => generated 194 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:42:08.005673 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b1dc1f50-8a62-42d8-ac19-2bd6a35bfe84 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:08.013350 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b1dc1f50-8a62-42d8-ac19-2bd6a35bfe84 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:08.026680 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b1dc1f50-8a62-42d8-ac19-2bd6a35bfe84 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:08.037888 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b1dc1f50-8a62-42d8-ac19-2bd6a35bfe84 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:08.038946 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b1dc1f50-8a62-42d8-ac19-2bd6a35bfe84 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:08.041011 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b1dc1f50-8a62-42d8-ac19-2bd6a35bfe84 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:08.134073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b1dc1f50-8a62-42d8-ac19-2bd6a35bfe84 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:42:08.352380 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-db336175-59b4-46e5-8efc-c2561efc2e7d tempest-VolumesGetTestJSON-39455920 tempest-VolumesGetTestJSON-39455920-project] Action: 'create', calling method: .version_select at 0x7f46862eee50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1145551429", "metadata": {"Type": "work"}}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:42:08.365062 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b1dc1f50-8a62-42d8-ac19-2bd6a35bfe84 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "DELETE /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 204 len: 0 microversion: 2.47 time: 0.374251 Jul 25 14:42:08.365659 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1820/3878] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Jul 25 14:42:07 2022] DELETE /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 14:42:08.377915 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bd4e5492-940a-4e7b-a4dd-d3ba7a3d4162 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:08.378651 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bd4e5492-940a-4e7b-a4dd-d3ba7a3d4162 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:08.415539 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd4e5492-940a-4e7b-a4dd-d3ba7a3d4162 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:08.421158 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd4e5492-940a-4e7b-a4dd-d3ba7a3d4162 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:08.424006 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd4e5492-940a-4e7b-a4dd-d3ba7a3d4162 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:08.428800 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd4e5492-940a-4e7b-a4dd-d3ba7a3d4162 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:08.940965 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-db336175-59b4-46e5-8efc-c2561efc2e7d tempest-VolumesGetTestJSON-39455920 tempest-VolumesGetTestJSON-39455920-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.007562 Jul 25 14:42:08.949399 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2059/3879] 10.222.0.88 () {60 vars in 1156 bytes} [Mon Jul 25 14:42:07 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1009 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 25 14:42:08.949399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-490446ca-9539-4cc8-9c7c-fca6b874fc95 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:08.949399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-490446ca-9539-4cc8-9c7c-fca6b874fc95 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:08.968777 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-490446ca-9539-4cc8-9c7c-fca6b874fc95 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:08.969569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-490446ca-9539-4cc8-9c7c-fca6b874fc95 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:08.972646 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-490446ca-9539-4cc8-9c7c-fca6b874fc95 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:08.973834 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-490446ca-9539-4cc8-9c7c-fca6b874fc95 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:09.005303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bd4e5492-940a-4e7b-a4dd-d3ba7a3d4162 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:09.026991 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bd4e5492-940a-4e7b-a4dd-d3ba7a3d4162 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:09.033066 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bd4e5492-940a-4e7b-a4dd-d3ba7a3d4162 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:09.034699 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bd4e5492-940a-4e7b-a4dd-d3ba7a3d4162 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1742 microversion: 2.20 time: 0.661010 Jul 25 14:42:09.037033 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1821/3880] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:08 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1742 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:42:09.058763 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-11ea4022-49dd-46e5-b2cf-8ecf86570e00 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f468675d550>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:09.155141 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-11ea4022-49dd-46e5-b2cf-8ecf86570e00 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf" status: 200 len: 1455 microversion: 2.1 time: 0.116214 Jul 25 14:42:09.155887 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1822/3881] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:09 2022] GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:09.159825 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-490446ca-9539-4cc8-9c7c-fca6b874fc95 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:09.176471 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-75c3c0a2-d77c-42df-b8fc-e84db064c687 tempest-VolumesGetTestJSON-39455920 tempest-VolumesGetTestJSON-39455920-project] Calling method '.version_select at 0x7f46867603a0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:09.194424 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-490446ca-9539-4cc8-9c7c-fca6b874fc95 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:09.197672 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-490446ca-9539-4cc8-9c7c-fca6b874fc95 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:09.202460 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-490446ca-9539-4cc8-9c7c-fca6b874fc95 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 200 len: 1361 microversion: 2.47 time: 0.258145 Jul 25 14:42:09.203068 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2060/3882] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:08 2022] GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 1361 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:42:09.315465 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-75c3c0a2-d77c-42df-b8fc-e84db064c687 tempest-VolumesGetTestJSON-39455920 tempest-VolumesGetTestJSON-39455920-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/2c026e15-1aa8-435a-bde4-14e12943c7b9" status: 200 len: 353 microversion: 2.1 time: 0.156855 Jul 25 14:42:09.316459 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1823/3883] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Jul 25 14:42:09 2022] GET /compute/v2.1/os-volumes/2c026e15-1aa8-435a-bde4-14e12943c7b9 => generated 353 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:42:10.063965 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fee4819d-485e-46ee-9e00-25e3d93659a3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:10.064643 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fee4819d-485e-46ee-9e00-25e3d93659a3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:10.083939 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fee4819d-485e-46ee-9e00-25e3d93659a3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:10.084423 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fee4819d-485e-46ee-9e00-25e3d93659a3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:10.085227 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fee4819d-485e-46ee-9e00-25e3d93659a3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:10.085659 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fee4819d-485e-46ee-9e00-25e3d93659a3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:10.173428 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bfe05e63-3493-437e-bc32-5c4ccc0922c8 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46868c3670>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:10.271354 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bfe05e63-3493-437e-bc32-5c4ccc0922c8 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf" status: 200 len: 1455 microversion: 2.1 time: 0.104335 Jul 25 14:42:10.272629 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1824/3884] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:10 2022] GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:42:10.286306 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-11cefb15-ea0d-4087-b924-3008a0195f16 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:10.303794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-11cefb15-ea0d-4087-b924-3008a0195f16 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:10.336851 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-11cefb15-ea0d-4087-b924-3008a0195f16 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:10.338057 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-11cefb15-ea0d-4087-b924-3008a0195f16 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:10.345990 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-11cefb15-ea0d-4087-b924-3008a0195f16 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:10.348527 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-11cefb15-ea0d-4087-b924-3008a0195f16 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:10.503505 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fee4819d-485e-46ee-9e00-25e3d93659a3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:10.515113 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fee4819d-485e-46ee-9e00-25e3d93659a3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:10.517239 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fee4819d-485e-46ee-9e00-25e3d93659a3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:10.518789 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fee4819d-485e-46ee-9e00-25e3d93659a3 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1742 microversion: 2.20 time: 0.459274 Jul 25 14:42:10.547963 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2061/3885] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:10 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1742 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:42:10.567523 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-89ca28da-70e3-44f3-9333-86934d7bb3de tempest-VolumesGetTestJSON-39455920 tempest-VolumesGetTestJSON-39455920-project] Calling method '.version_select at 0x7f46862eeb80>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:10.696440 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-89ca28da-70e3-44f3-9333-86934d7bb3de tempest-VolumesGetTestJSON-39455920 tempest-VolumesGetTestJSON-39455920-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/2c026e15-1aa8-435a-bde4-14e12943c7b9" status: 200 len: 354 microversion: 2.1 time: 0.146761 Jul 25 14:42:10.702278 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2062/3886] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Jul 25 14:42:10 2022] GET /compute/v2.1/os-volumes/2c026e15-1aa8-435a-bde4-14e12943c7b9 => generated 354 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:42:10.721874 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-adba91f5-f72e-41f3-83cb-3625778ed490 tempest-VolumesGetTestJSON-39455920 tempest-VolumesGetTestJSON-39455920-project] Calling method '.version_select at 0x7f46862c4700>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:10.805031 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-11cefb15-ea0d-4087-b924-3008a0195f16 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:10.822185 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-11cefb15-ea0d-4087-b924-3008a0195f16 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:10.829903 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-11cefb15-ea0d-4087-b924-3008a0195f16 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:10.831198 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-11cefb15-ea0d-4087-b924-3008a0195f16 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 200 len: 1361 microversion: 2.47 time: 0.553838 Jul 25 14:42:10.836609 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1825/3887] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:10 2022] GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 1361 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:42:10.870779 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-adba91f5-f72e-41f3-83cb-3625778ed490 tempest-VolumesGetTestJSON-39455920 tempest-VolumesGetTestJSON-39455920-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/2c026e15-1aa8-435a-bde4-14e12943c7b9" status: 200 len: 354 microversion: 2.1 time: 0.164692 Jul 25 14:42:10.871390 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2063/3888] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Jul 25 14:42:10 2022] GET /compute/v2.1/os-volumes/2c026e15-1aa8-435a-bde4-14e12943c7b9 => generated 354 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:42:10.891942 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a086115f-77c5-4185-b8bb-1088f29d4e75 tempest-VolumesGetTestJSON-39455920 tempest-VolumesGetTestJSON-39455920-project] Calling method '.version_select at 0x7f46989a9f70>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:11.015726 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a086115f-77c5-4185-b8bb-1088f29d4e75 tempest-VolumesGetTestJSON-39455920 tempest-VolumesGetTestJSON-39455920-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/2c026e15-1aa8-435a-bde4-14e12943c7b9" status: 202 len: 0 microversion: 2.1 time: 0.129627 Jul 25 14:42:11.022086 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1826/3889] 10.222.0.88 () {58 vars in 1248 bytes} [Mon Jul 25 14:42:10 2022] DELETE /compute/v2.1/os-volumes/2c026e15-1aa8-435a-bde4-14e12943c7b9 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:42:11.030743 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-975eb341-7423-49e9-84db-b196e713ec7a tempest-VolumesGetTestJSON-39455920 tempest-VolumesGetTestJSON-39455920-project] Calling method '.version_select at 0x7f46862db3a0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:11.148339 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-975eb341-7423-49e9-84db-b196e713ec7a tempest-VolumesGetTestJSON-39455920 tempest-VolumesGetTestJSON-39455920-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/2c026e15-1aa8-435a-bde4-14e12943c7b9" status: 200 len: 353 microversion: 2.1 time: 0.122102 Jul 25 14:42:11.149056 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2064/3890] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Jul 25 14:42:11 2022] GET /compute/v2.1/os-volumes/2c026e15-1aa8-435a-bde4-14e12943c7b9 => generated 353 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:42:11.288594 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3aac4ee6-ac3b-40a0-991f-d2fcf8f29e54 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f4686760ee0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:11.543066 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-941ef0ed-5c6e-4cb1-b902-c9cc8a45ce24 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:11.543701 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-941ef0ed-5c6e-4cb1-b902-c9cc8a45ce24 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:11.563730 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-941ef0ed-5c6e-4cb1-b902-c9cc8a45ce24 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:11.564236 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-941ef0ed-5c6e-4cb1-b902-c9cc8a45ce24 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:11.565058 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-941ef0ed-5c6e-4cb1-b902-c9cc8a45ce24 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:11.565490 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-941ef0ed-5c6e-4cb1-b902-c9cc8a45ce24 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:11.905440 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-941ef0ed-5c6e-4cb1-b902-c9cc8a45ce24 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:11.915467 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-941ef0ed-5c6e-4cb1-b902-c9cc8a45ce24 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:11.917500 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-941ef0ed-5c6e-4cb1-b902-c9cc8a45ce24 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:11.919492 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-941ef0ed-5c6e-4cb1-b902-c9cc8a45ce24 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1742 microversion: 2.20 time: 0.380928 Jul 25 14:42:11.920636 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2065/3891] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:11 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1742 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:42:11.925644 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-47a98150-3939-4964-bf7f-b7a1fa97c3ea tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:11.926566 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-47a98150-3939-4964-bf7f-b7a1fa97c3ea tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fad856bd-5551-4dee-8653-750e9c893481] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:11.933399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-47a98150-3939-4964-bf7f-b7a1fa97c3ea tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:11.934059 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-47a98150-3939-4964-bf7f-b7a1fa97c3ea tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:11.935004 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-47a98150-3939-4964-bf7f-b7a1fa97c3ea tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:11.935606 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-47a98150-3939-4964-bf7f-b7a1fa97c3ea tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:11.953780 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-47a98150-3939-4964-bf7f-b7a1fa97c3ea tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] HTTP exception thrown: Instance fad856bd-5551-4dee-8653-750e9c893481 could not be found. Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-47a98150-3939-4964-bf7f-b7a1fa97c3ea tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Request method failure captured: Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 HTTP/1.1 Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3quVZ5zmPaBqzDsYj-JfcCakz7VIdmhGCH8yj37uzWHuWGoeirSXyFWdQBScen9Tt9Rw4ocrA44bXGLGCPwwxgAJyvv0QnWCbuPE1_nzLs5uk9wsXDQRa_G9hD0tBhGEdroFOVNMBei_-ZmY3PGrVJ8BZ1WTnVRPrV-ZhHa0DSd2FRQ Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: X-Openstack-Nova-Api-Version: 2.47 Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 79f00a92563647618eeb7aa9b0109830 Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerShowV247Test-2116833108 Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/79f00a92563647618eeb7aa9b0109830"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/79f00a92563647618eeb7aa9b0109830"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_79f00a92563647618eeb7aa9b0109830", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/79f00a92563647618eeb7aa9b0109830"}]}] Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerShowV247Test-2116833108 Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 79f00a92563647618eeb7aa9b0109830 Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerShowV247Test-2116833108 Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerShowV247Test-2116833108-project Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 3624b9087f984bfe9c718e258a716647 Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerShowV247Test-2116833108-project Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance fad856bd-5551-4dee-8653-750e9c893481 could not be found. Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'fad856bd-5551-4dee-8653-750e9c893481'} Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fad856bd-5551-4dee-8653-750e9c893481 could not be found. Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fad856bd-5551-4dee-8653-750e9c893481 could not be found. Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:42:11.955623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:42:11.961806 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:42:11.961806 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:42:11.961806 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:42:11.961806 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:42:11.961806 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:42:11.961806 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fad856bd-5551-4dee-8653-750e9c893481 could not be found. Jul 25 14:42:11.961806 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:42:11.963680 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-47a98150-3939-4964-bf7f-b7a1fa97c3ea tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Returning 404 to user: Instance fad856bd-5551-4dee-8653-750e9c893481 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:42:11.964808 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-47a98150-3939-4964-bf7f-b7a1fa97c3ea tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481" status: 404 len: 111 microversion: 2.47 time: 0.042970 Jul 25 14:42:11.965612 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2066/3892] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:11 2022] GET /compute/v2.1/servers/fad856bd-5551-4dee-8653-750e9c893481 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:42:11.977239 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f891dbfd-fbbc-4dc8-b189-e6e81b538d05 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:11.978072 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f891dbfd-fbbc-4dc8-b189-e6e81b538d05 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fd40fd97-1164-451c-84c9-a0f5c3cc3009] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:11.984622 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f891dbfd-fbbc-4dc8-b189-e6e81b538d05 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:11.985401 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f891dbfd-fbbc-4dc8-b189-e6e81b538d05 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:11.986391 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f891dbfd-fbbc-4dc8-b189-e6e81b538d05 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:11.987026 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f891dbfd-fbbc-4dc8-b189-e6e81b538d05 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:12.030938 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f891dbfd-fbbc-4dc8-b189-e6e81b538d05 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fd40fd97-1164-451c-84c9-a0f5c3cc3009] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:42:12.222238 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f891dbfd-fbbc-4dc8-b189-e6e81b538d05 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "DELETE /compute/v2.1/servers/fd40fd97-1164-451c-84c9-a0f5c3cc3009" status: 204 len: 0 microversion: 2.47 time: 0.248803 Jul 25 14:42:12.223053 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2067/3893] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Jul 25 14:42:11 2022] DELETE /compute/v2.1/servers/fd40fd97-1164-451c-84c9-a0f5c3cc3009 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 14:42:12.231928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-325b92ac-a599-4699-b8e7-6d930f2b3b5a tempest-VolumesGetTestJSON-39455920 tempest-VolumesGetTestJSON-39455920-project] Calling method '.version_select at 0x7f46862db280>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:12.351035 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-325b92ac-a599-4699-b8e7-6d930f2b3b5a tempest-VolumesGetTestJSON-39455920 tempest-VolumesGetTestJSON-39455920-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/2c026e15-1aa8-435a-bde4-14e12943c7b9" status: 200 len: 353 microversion: 2.1 time: 0.123312 Jul 25 14:42:12.351712 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2068/3894] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Jul 25 14:42:12 2022] GET /compute/v2.1/os-volumes/2c026e15-1aa8-435a-bde4-14e12943c7b9 => generated 353 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:42:12.358020 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7f33f961-8961-447e-b403-4f1d66a4be6d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:12.358984 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7f33f961-8961-447e-b403-4f1d66a4be6d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fd40fd97-1164-451c-84c9-a0f5c3cc3009] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:12.386644 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7f33f961-8961-447e-b403-4f1d66a4be6d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:12.388800 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7f33f961-8961-447e-b403-4f1d66a4be6d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:12.395578 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7f33f961-8961-447e-b403-4f1d66a4be6d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:12.398849 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7f33f961-8961-447e-b403-4f1d66a4be6d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:12.579183 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7f33f961-8961-447e-b403-4f1d66a4be6d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:12.592072 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7f33f961-8961-447e-b403-4f1d66a4be6d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:12.593705 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7f33f961-8961-447e-b403-4f1d66a4be6d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:12.594932 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7f33f961-8961-447e-b403-4f1d66a4be6d tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fd40fd97-1164-451c-84c9-a0f5c3cc3009" status: 200 len: 1362 microversion: 2.47 time: 0.241951 Jul 25 14:42:12.595494 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2069/3895] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:12 2022] GET /compute/v2.1/servers/fd40fd97-1164-451c-84c9-a0f5c3cc3009 => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:42:12.942262 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-605f7c16-ed53-4cad-9972-c13a79fc597c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:12.943596 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-605f7c16-ed53-4cad-9972-c13a79fc597c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:12.961513 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-605f7c16-ed53-4cad-9972-c13a79fc597c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:12.961877 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-605f7c16-ed53-4cad-9972-c13a79fc597c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:12.962677 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-605f7c16-ed53-4cad-9972-c13a79fc597c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:12.963091 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-605f7c16-ed53-4cad-9972-c13a79fc597c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:13.077322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:42:13.920494 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-605f7c16-ed53-4cad-9972-c13a79fc597c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:13.934948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-605f7c16-ed53-4cad-9972-c13a79fc597c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:13.936609 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-605f7c16-ed53-4cad-9972-c13a79fc597c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:13.965389 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-605f7c16-ed53-4cad-9972-c13a79fc597c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1742 microversion: 2.20 time: 1.027484 Jul 25 14:42:13.974133 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2070/3896] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:12 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1742 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:42:13.986472 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-6b0cd76b-2339-4298-9431-796ebf8fb5e7 req-b3b214a1-9ce0-4157-82c2-e7e9bddedc78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "794b7eaa-2e72-4ffc-aced-1dfb494e3554", "name": "network-vif-plugged", "status": "completed", "tag": "ee5f6577-aca1-4c54-8d5b-962c392fa674"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:42:14.024541 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-6b0cd76b-2339-4298-9431-796ebf8fb5e7 req-b3b214a1-9ce0-4157-82c2-e7e9bddedc78 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:14.025370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-6b0cd76b-2339-4298-9431-796ebf8fb5e7 req-b3b214a1-9ce0-4157-82c2-e7e9bddedc78 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:14.105337 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-6b0cd76b-2339-4298-9431-796ebf8fb5e7 req-b3b214a1-9ce0-4157-82c2-e7e9bddedc78 service nova] Creating event network-vif-plugged:ee5f6577-aca1-4c54-8d5b-962c392fa674 for instance 794b7eaa-2e72-4ffc-aced-1dfb494e3554 on n-h1-846435-14 Jul 25 14:42:14.128372 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-6b0cd76b-2339-4298-9431-796ebf8fb5e7 req-b3b214a1-9ce0-4157-82c2-e7e9bddedc78 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146932 Jul 25 14:42:14.136342 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2071/3897] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:42:14.142326 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c6fb5ad0-393f-4b8f-9a96-360bc91f78b3 tempest-VolumesGetTestJSON-39455920 tempest-VolumesGetTestJSON-39455920-project] Calling method '.version_select at 0x7f46862db0d0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:14.259939 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c6fb5ad0-393f-4b8f-9a96-360bc91f78b3 tempest-VolumesGetTestJSON-39455920 tempest-VolumesGetTestJSON-39455920-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/2c026e15-1aa8-435a-bde4-14e12943c7b9" status: 200 len: 353 microversion: 2.1 time: 0.122811 Jul 25 14:42:14.260544 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2072/3898] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Jul 25 14:42:14 2022] GET /compute/v2.1/os-volumes/2c026e15-1aa8-435a-bde4-14e12943c7b9 => generated 353 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:42:14.271704 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-eeb54e9e-981e-45ba-95d0-f3e9e1cfeb6e tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:14.272994 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-eeb54e9e-981e-45ba-95d0-f3e9e1cfeb6e tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fd40fd97-1164-451c-84c9-a0f5c3cc3009] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:14.304039 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eeb54e9e-981e-45ba-95d0-f3e9e1cfeb6e tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:14.304854 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eeb54e9e-981e-45ba-95d0-f3e9e1cfeb6e tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:14.311862 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eeb54e9e-981e-45ba-95d0-f3e9e1cfeb6e tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:14.313217 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eeb54e9e-981e-45ba-95d0-f3e9e1cfeb6e tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:14.414360 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eeb54e9e-981e-45ba-95d0-f3e9e1cfeb6e tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:14.415215 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eeb54e9e-981e-45ba-95d0-f3e9e1cfeb6e tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:14.416530 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-eeb54e9e-981e-45ba-95d0-f3e9e1cfeb6e tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lazy-loading 'fault' on Instance uuid fd40fd97-1164-451c-84c9-a0f5c3cc3009 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:42:14.590763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-eeb54e9e-981e-45ba-95d0-f3e9e1cfeb6e tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:14.602392 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-eeb54e9e-981e-45ba-95d0-f3e9e1cfeb6e tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:14.609685 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-eeb54e9e-981e-45ba-95d0-f3e9e1cfeb6e tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3624b9087f984bfe9c718e258a716647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f00a92563647618eeb7aa9b0109830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:14.622586 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-eeb54e9e-981e-45ba-95d0-f3e9e1cfeb6e tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fd40fd97-1164-451c-84c9-a0f5c3cc3009" status: 200 len: 1367 microversion: 2.47 time: 0.360301 Jul 25 14:42:14.645187 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2073/3899] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:14 2022] GET /compute/v2.1/servers/fd40fd97-1164-451c-84c9-a0f5c3cc3009 => generated 1367 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:42:14.996927 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a098d71e-25eb-4bc0-8eb9-8b55d60cdd9b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:14.997669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a098d71e-25eb-4bc0-8eb9-8b55d60cdd9b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:15.015684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a098d71e-25eb-4bc0-8eb9-8b55d60cdd9b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:15.019079 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a098d71e-25eb-4bc0-8eb9-8b55d60cdd9b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:15.023391 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a098d71e-25eb-4bc0-8eb9-8b55d60cdd9b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:15.025752 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a098d71e-25eb-4bc0-8eb9-8b55d60cdd9b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:15.372986 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a098d71e-25eb-4bc0-8eb9-8b55d60cdd9b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:15.389843 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a098d71e-25eb-4bc0-8eb9-8b55d60cdd9b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:15.392480 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a098d71e-25eb-4bc0-8eb9-8b55d60cdd9b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:15.396505 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a098d71e-25eb-4bc0-8eb9-8b55d60cdd9b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1742 microversion: 2.20 time: 0.403284 Jul 25 14:42:15.398415 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2074/3900] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:14 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1742 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:42:15.405210 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8b3d85c3-dd46-46d5-83b2-0975bb5e69c7 tempest-VolumesGetTestJSON-39455920 tempest-VolumesGetTestJSON-39455920-project] Calling method '.version_select at 0x7f46862dbf70>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:15.492796 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8b3d85c3-dd46-46d5-83b2-0975bb5e69c7 tempest-VolumesGetTestJSON-39455920 tempest-VolumesGetTestJSON-39455920-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/2c026e15-1aa8-435a-bde4-14e12943c7b9" status: 200 len: 353 microversion: 2.1 time: 0.092578 Jul 25 14:42:15.499159 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2075/3901] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Jul 25 14:42:15 2022] GET /compute/v2.1/os-volumes/2c026e15-1aa8-435a-bde4-14e12943c7b9 => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:42:15.563745 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3aac4ee6-ac3b-40a0-991f-d2fcf8f29e54 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf" status: 200 len: 1455 microversion: 2.1 time: 4.280393 Jul 25 14:42:15.573752 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1827/3902] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:11 2022] GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf => generated 1455 bytes in 4291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:15.653633 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c7002fa0-f052-4abc-be60-66f92e40d2f6 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:15.654663 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c7002fa0-f052-4abc-be60-66f92e40d2f6 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] [instance: fd40fd97-1164-451c-84c9-a0f5c3cc3009] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:15.667151 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c7002fa0-f052-4abc-be60-66f92e40d2f6 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:15.670137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c7002fa0-f052-4abc-be60-66f92e40d2f6 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:15.672544 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c7002fa0-f052-4abc-be60-66f92e40d2f6 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:15.673306 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c7002fa0-f052-4abc-be60-66f92e40d2f6 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:15.707601 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-c7002fa0-f052-4abc-be60-66f92e40d2f6 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] HTTP exception thrown: Instance fd40fd97-1164-451c-84c9-a0f5c3cc3009 could not be found. Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c7002fa0-f052-4abc-be60-66f92e40d2f6 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Request method failure captured: Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/fd40fd97-1164-451c-84c9-a0f5c3cc3009 HTTP/1.1 Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3quVZ5zmPaBqzDsYj-JfcCakz7VIdmhGCH8yj37uzWHuWGoeirSXyFWdQBScen9Tt9Rw4ocrA44bXGLGCPwwxgAJyvv0QnWCbuPE1_nzLs5uk9wsXDQRa_G9hD0tBhGEdroFOVNMBei_-ZmY3PGrVJ8BZ1WTnVRPrV-ZhHa0DSd2FRQ Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: X-Openstack-Nova-Api-Version: 2.47 Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 79f00a92563647618eeb7aa9b0109830 Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerShowV247Test-2116833108 Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/79f00a92563647618eeb7aa9b0109830"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/79f00a92563647618eeb7aa9b0109830"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_79f00a92563647618eeb7aa9b0109830", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/79f00a92563647618eeb7aa9b0109830"}]}] Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerShowV247Test-2116833108 Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 79f00a92563647618eeb7aa9b0109830 Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerShowV247Test-2116833108 Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerShowV247Test-2116833108-project Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 3624b9087f984bfe9c718e258a716647 Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerShowV247Test-2116833108-project Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance fd40fd97-1164-451c-84c9-a0f5c3cc3009 could not be found. Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'fd40fd97-1164-451c-84c9-a0f5c3cc3009'} Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd40fd97-1164-451c-84c9-a0f5c3cc3009 could not be found. Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd40fd97-1164-451c-84c9-a0f5c3cc3009 could not be found. Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:42:15.709856 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:42:15.715218 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:42:15.715218 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:42:15.715218 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:42:15.715218 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:42:15.715218 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:42:15.715218 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd40fd97-1164-451c-84c9-a0f5c3cc3009 could not be found. Jul 25 14:42:15.715218 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:42:15.717934 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c7002fa0-f052-4abc-be60-66f92e40d2f6 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] Returning 404 to user: Instance fd40fd97-1164-451c-84c9-a0f5c3cc3009 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:42:15.722426 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c7002fa0-f052-4abc-be60-66f92e40d2f6 tempest-ServerShowV247Test-2116833108 tempest-ServerShowV247Test-2116833108-project] 10.222.0.88 "GET /compute/v2.1/servers/fd40fd97-1164-451c-84c9-a0f5c3cc3009" status: 404 len: 111 microversion: 2.47 time: 0.073399 Jul 25 14:42:15.723763 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2076/3903] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:15 2022] GET /compute/v2.1/servers/fd40fd97-1164-451c-84c9-a0f5c3cc3009 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:42:16.432916 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-59343ab2-0468-4b4c-827f-4a14f2102e10 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:16.433961 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-59343ab2-0468-4b4c-827f-4a14f2102e10 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:16.472081 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59343ab2-0468-4b4c-827f-4a14f2102e10 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:16.473641 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59343ab2-0468-4b4c-827f-4a14f2102e10 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:16.480872 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59343ab2-0468-4b4c-827f-4a14f2102e10 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:16.481350 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59343ab2-0468-4b4c-827f-4a14f2102e10 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:16.506852 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3bf7040f-8540-4f60-b7a9-32f18a419b56 tempest-VolumesGetTestJSON-39455920 tempest-VolumesGetTestJSON-39455920-project] Calling method '.version_select at 0x7f468623dd30>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:16.571482 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-3bf7040f-8540-4f60-b7a9-32f18a419b56 tempest-VolumesGetTestJSON-39455920 tempest-VolumesGetTestJSON-39455920-project] HTTP exception thrown: Volume 2c026e15-1aa8-435a-bde4-14e12943c7b9 could not be found. Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3bf7040f-8540-4f60-b7a9-32f18a419b56 tempest-VolumesGetTestJSON-39455920 tempest-VolumesGetTestJSON-39455920-project] Request method failure captured: Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/os-volumes/2c026e15-1aa8-435a-bde4-14e12943c7b9 HTTP/1.1 Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qu_3PPrnjV19n4kbURp5oUtdKDMefNWnJjD3wPhw1J9WdaXRlsQ0qbS6TJsat89oQ5zk0PWvmuDS3geMzWw02X1uq4zfcoyJ7IIiukR1MVqiav_m80LTH6qOiIBBzv_E0HHKXORqxaO1D0H5VtNzpsGpIRvozwMYuV_0kgsNRSMRCQ Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: cf06528679da404da7676ba4daba2e4c Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-VolumesGetTestJSON-39455920 Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/cf06528679da404da7676ba4daba2e4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/cf06528679da404da7676ba4daba2e4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_cf06528679da404da7676ba4daba2e4c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/cf06528679da404da7676ba4daba2e4c"}]}] Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-VolumesGetTestJSON-39455920 Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: cf06528679da404da7676ba4daba2e4c Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-VolumesGetTestJSON-39455920 Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-VolumesGetTestJSON-39455920-project Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 0116d94be987477e9dc52e6408d3610d Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-VolumesGetTestJSON-39455920-project Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: exception: Volume 2c026e15-1aa8-435a-bde4-14e12943c7b9 could not be found. Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '2c026e15-1aa8-435a-bde4-14e12943c7b9'} Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2c026e15-1aa8-435a-bde4-14e12943c7b9 could not be found. (HTTP 404) (Request-ID: req-fd457749-d56a-491f-96c4-ba5d3b303d75) Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 14:42:16.573672 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2c026e15-1aa8-435a-bde4-14e12943c7b9 could not be found. Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2c026e15-1aa8-435a-bde4-14e12943c7b9 could not be found. Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2c026e15-1aa8-435a-bde4-14e12943c7b9 could not be found. Jul 25 14:42:16.578633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:42:16.585029 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3bf7040f-8540-4f60-b7a9-32f18a419b56 tempest-VolumesGetTestJSON-39455920 tempest-VolumesGetTestJSON-39455920-project] Returning 404 to user: Volume 2c026e15-1aa8-435a-bde4-14e12943c7b9 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:42:16.586106 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3bf7040f-8540-4f60-b7a9-32f18a419b56 tempest-VolumesGetTestJSON-39455920 tempest-VolumesGetTestJSON-39455920-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/2c026e15-1aa8-435a-bde4-14e12943c7b9" status: 404 len: 109 microversion: 2.1 time: 0.083260 Jul 25 14:42:16.587216 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2077/3904] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Jul 25 14:42:16 2022] GET /compute/v2.1/os-volumes/2c026e15-1aa8-435a-bde4-14e12943c7b9 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:42:16.604524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a3f27c0c-d215-4781-a2f4-1df153d45b37 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46862ee940>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:16.699853 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a3f27c0c-d215-4781-a2f4-1df153d45b37 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf" status: 200 len: 1455 microversion: 2.1 time: 0.110103 Jul 25 14:42:16.701397 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2078/3905] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:16 2022] GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:17.002766 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-59343ab2-0468-4b4c-827f-4a14f2102e10 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:17.028897 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-59343ab2-0468-4b4c-827f-4a14f2102e10 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:17.030612 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-59343ab2-0468-4b4c-827f-4a14f2102e10 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:17.043076 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-59343ab2-0468-4b4c-827f-4a14f2102e10 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1742 microversion: 2.20 time: 0.604329 Jul 25 14:42:17.047324 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1828/3906] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:16 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1742 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:42:17.714492 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:42:17.723202 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9b64da2c-e261-482a-83a8-42fc9db17aeb tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46861efdc0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:17.820375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:42:17.840290 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9b64da2c-e261-482a-83a8-42fc9db17aeb tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf" status: 200 len: 1455 microversion: 2.1 time: 0.127410 Jul 25 14:42:17.845477 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2079/3907] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:17 2022] GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf => generated 1455 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:18.074626 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f063eeaf-d38a-4e2a-bb86-2841922532c4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:18.078873 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f063eeaf-d38a-4e2a-bb86-2841922532c4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:18.104493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f063eeaf-d38a-4e2a-bb86-2841922532c4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:18.106607 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f063eeaf-d38a-4e2a-bb86-2841922532c4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:18.109940 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f063eeaf-d38a-4e2a-bb86-2841922532c4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:18.112477 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f063eeaf-d38a-4e2a-bb86-2841922532c4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:18.632677 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f063eeaf-d38a-4e2a-bb86-2841922532c4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:18.642404 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f063eeaf-d38a-4e2a-bb86-2841922532c4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:18.644351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f063eeaf-d38a-4e2a-bb86-2841922532c4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:18.646020 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f063eeaf-d38a-4e2a-bb86-2841922532c4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1724 microversion: 2.20 time: 0.575725 Jul 25 14:42:18.647866 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1829/3908] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:18 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1724 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:42:18.829140 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-da2d954e-f293-4312-930f-eff5f79d80a8 req-b7a765b8-9f0b-4e22-a894-15131dd62397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "034e5d63-63a1-4883-b7f8-fe84ec541914", "name": "network-vif-unplugged", "status": "completed", "tag": "350ec399-ee42-4e58-9f27-5bd9094cb8e1"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:42:18.864175 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4dac62c6-3826-4fe1-96a8-6a10b255d2b1 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46989bb550>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:18.876763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-da2d954e-f293-4312-930f-eff5f79d80a8 req-b7a765b8-9f0b-4e22-a894-15131dd62397 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:18.891358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-da2d954e-f293-4312-930f-eff5f79d80a8 req-b7a765b8-9f0b-4e22-a894-15131dd62397 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:18.977382 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-da2d954e-f293-4312-930f-eff5f79d80a8 req-b7a765b8-9f0b-4e22-a894-15131dd62397 service nova] Creating event network-vif-unplugged:350ec399-ee42-4e58-9f27-5bd9094cb8e1 for instance 034e5d63-63a1-4883-b7f8-fe84ec541914 on n-h2-846435-14 Jul 25 14:42:19.013786 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-da2d954e-f293-4312-930f-eff5f79d80a8 req-b7a765b8-9f0b-4e22-a894-15131dd62397 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.174546 Jul 25 14:42:19.017839 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2080/3909] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:42:19.019654 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4dac62c6-3826-4fe1-96a8-6a10b255d2b1 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf" status: 200 len: 1455 microversion: 2.1 time: 0.158344 Jul 25 14:42:19.035812 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1830/3910] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:18 2022] GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf => generated 1455 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:19.680749 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-35d99c8f-2627-43cc-833e-e647a47c63b2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:19.681573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-35d99c8f-2627-43cc-833e-e647a47c63b2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:19.695100 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35d99c8f-2627-43cc-833e-e647a47c63b2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:19.696111 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35d99c8f-2627-43cc-833e-e647a47c63b2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:19.697134 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35d99c8f-2627-43cc-833e-e647a47c63b2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:19.698110 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35d99c8f-2627-43cc-833e-e647a47c63b2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:20.024874 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-35d99c8f-2627-43cc-833e-e647a47c63b2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:20.043720 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-35d99c8f-2627-43cc-833e-e647a47c63b2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:20.044539 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c0d3800e-ab07-4b29-bfda-b1910a715a04 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46987d98b0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:20.068005 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-35d99c8f-2627-43cc-833e-e647a47c63b2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:20.069443 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-35d99c8f-2627-43cc-833e-e647a47c63b2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1724 microversion: 2.20 time: 0.394044 Jul 25 14:42:20.084416 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2081/3911] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:19 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1724 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:42:20.170547 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c0d3800e-ab07-4b29-bfda-b1910a715a04 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf" status: 200 len: 1455 microversion: 2.1 time: 0.131707 Jul 25 14:42:20.184647 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1831/3912] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:20 2022] GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf => generated 1455 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:42:20.922056 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-35d99c8f-2627-43cc-833e-e647a47c63b2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:20.923957 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-35d99c8f-2627-43cc-833e-e647a47c63b2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002211 Jul 25 14:42:20.935469 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c0d3800e-ab07-4b29-bfda-b1910a715a04 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:20.937539 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c0d3800e-ab07-4b29-bfda-b1910a715a04 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002709 Jul 25 14:42:20.938347 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2082/3913] 10.222.0.88 () {56 vars in 886 bytes} [Mon Jul 25 14:42:20 2022] GET /compute/ => generated 377 bytes in 17 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 25 14:42:20.938880 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1832/3914] 10.222.0.88 () {54 vars in 1035 bytes} [Mon Jul 25 14:42:20 2022] GET /compute/v2/ => generated 379 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Jul 25 14:42:20.952107 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-35d99c8f-2627-43cc-833e-e647a47c63b2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:20.953582 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-35d99c8f-2627-43cc-833e-e647a47c63b2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001956 Jul 25 14:42:20.963935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c0d3800e-ab07-4b29-bfda-b1910a715a04 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:20.965273 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c0d3800e-ab07-4b29-bfda-b1910a715a04 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001850 Jul 25 14:42:20.965933 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2083/3915] 10.222.0.88 () {54 vars in 1041 bytes} [Mon Jul 25 14:42:20 2022] GET /compute/v2.1/ => generated 388 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:42:20.977224 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1833/3916] 10.222.0.88 () {56 vars in 886 bytes} [Mon Jul 25 14:42:20 2022] GET /compute/ => generated 377 bytes in 14 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 25 14:42:21.104067 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-25fc235f-bd2f-49c8-ae55-f63074f63de0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:21.105706 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-25fc235f-bd2f-49c8-ae55-f63074f63de0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:21.126828 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25fc235f-bd2f-49c8-ae55-f63074f63de0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:21.127607 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25fc235f-bd2f-49c8-ae55-f63074f63de0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:21.129402 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25fc235f-bd2f-49c8-ae55-f63074f63de0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:21.133897 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25fc235f-bd2f-49c8-ae55-f63074f63de0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:21.194919 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e597a689-c688-42b3-8fa3-c8220e681ea7 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46868c3ee0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:21.318391 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e597a689-c688-42b3-8fa3-c8220e681ea7 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf" status: 200 len: 1455 microversion: 2.1 time: 0.130327 Jul 25 14:42:21.319173 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1834/3917] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:21 2022] GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf => generated 1455 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:42:21.454954 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-25fc235f-bd2f-49c8-ae55-f63074f63de0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:21.469574 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-25fc235f-bd2f-49c8-ae55-f63074f63de0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:21.477575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-25fc235f-bd2f-49c8-ae55-f63074f63de0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:21.480661 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-25fc235f-bd2f-49c8-ae55-f63074f63de0 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1667 microversion: 2.20 time: 0.386496 Jul 25 14:42:21.484034 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2084/3918] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:21 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1667 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:42:21.510003 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-09a208ad-99d1-45bf-92a2-b480d439447e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31d6b14d-4416-4323-a1cc-f34e252fddd1"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:42:21.512901 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-09a208ad-99d1-45bf-92a2-b480d439447e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:21.522041 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-09a208ad-99d1-45bf-92a2-b480d439447e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:21.522572 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-09a208ad-99d1-45bf-92a2-b480d439447e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:21.523633 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-09a208ad-99d1-45bf-92a2-b480d439447e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:21.524487 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-09a208ad-99d1-45bf-92a2-b480d439447e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:21.962266 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:42:22.142602 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-09a208ad-99d1-45bf-92a2-b480d439447e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "POST /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.637003 Jul 25 14:42:22.144298 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1835/3919] 10.222.0.88 () {62 vars in 1364 bytes} [Mon Jul 25 14:42:21 2022] POST /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914/os-volume_attachments => generated 188 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:42:22.335712 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b0cc3a7d-cb19-458b-8543-9dded2814fc7 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46861f3280>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:22.408111 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b0cc3a7d-cb19-458b-8543-9dded2814fc7 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf" status: 200 len: 1455 microversion: 2.1 time: 0.076735 Jul 25 14:42:22.418059 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2085/3920] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:22 2022] GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:22.474617 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7968e81b-bf32-4f84-a5b6-91b429c26a13 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:22.475403 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7968e81b-bf32-4f84-a5b6-91b429c26a13 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:22.488877 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7968e81b-bf32-4f84-a5b6-91b429c26a13 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:22.489701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7968e81b-bf32-4f84-a5b6-91b429c26a13 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:22.490479 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7968e81b-bf32-4f84-a5b6-91b429c26a13 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:22.490906 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7968e81b-bf32-4f84-a5b6-91b429c26a13 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:22.971655 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7968e81b-bf32-4f84-a5b6-91b429c26a13 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "DELETE /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914/os-volume_attachments/31d6b14d-4416-4323-a1cc-f34e252fddd1" status: 202 len: 0 microversion: 2.20 time: 0.499293 Jul 25 14:42:22.987346 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1836/3921] 10.222.0.88 () {60 vars in 1457 bytes} [Mon Jul 25 14:42:22 2022] DELETE /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914/os-volume_attachments/31d6b14d-4416-4323-a1cc-f34e252fddd1 => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:42:23.132614 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6f97ef44-70df-4d6b-8c91-62819e13d277 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:42:23.133494 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6f97ef44-70df-4d6b-8c91-62819e13d277 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:23.145818 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f97ef44-70df-4d6b-8c91-62819e13d277 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:23.146671 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f97ef44-70df-4d6b-8c91-62819e13d277 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:23.147856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f97ef44-70df-4d6b-8c91-62819e13d277 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:23.148878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f97ef44-70df-4d6b-8c91-62819e13d277 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:23.340981 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6f97ef44-70df-4d6b-8c91-62819e13d277 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "POST /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914/action" status: 202 len: 0 microversion: 2.20 time: 0.212392 Jul 25 14:42:23.346070 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2086/3922] 10.222.0.88 () {62 vars in 1319 bytes} [Mon Jul 25 14:42:23 2022] POST /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:42:23.358594 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c15bac0c-76b1-4627-a07f-db0c1470e87a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:23.359644 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c15bac0c-76b1-4627-a07f-db0c1470e87a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:23.391422 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c15bac0c-76b1-4627-a07f-db0c1470e87a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:23.392122 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c15bac0c-76b1-4627-a07f-db0c1470e87a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:23.393262 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c15bac0c-76b1-4627-a07f-db0c1470e87a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:23.393901 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c15bac0c-76b1-4627-a07f-db0c1470e87a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:23.426745 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ffd4f2b0-8247-41de-97a7-638e9ce1e118 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46861f3790>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:24.009847 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ffd4f2b0-8247-41de-97a7-638e9ce1e118 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf" status: 200 len: 1455 microversion: 2.1 time: 0.588358 Jul 25 14:42:24.015201 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2087/3923] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:23 2022] GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf => generated 1455 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:42:24.592577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c15bac0c-76b1-4627-a07f-db0c1470e87a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:24.612629 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c15bac0c-76b1-4627-a07f-db0c1470e87a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:24.616723 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c15bac0c-76b1-4627-a07f-db0c1470e87a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:24.620067 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c15bac0c-76b1-4627-a07f-db0c1470e87a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1675 microversion: 2.20 time: 1.267826 Jul 25 14:42:24.621937 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1837/3924] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:23 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1675 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:42:25.027537 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a7d188d3-2602-4884-b555-5b5eb854bef1 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46862c45e0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:25.153750 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a7d188d3-2602-4884-b555-5b5eb854bef1 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf" status: 200 len: 1455 microversion: 2.1 time: 0.130648 Jul 25 14:42:25.163099 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2088/3925] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:25 2022] GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf => generated 1455 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:25.648785 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-db9da056-94bc-4c63-b636-c5bbd8da93d6 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:25.650950 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-db9da056-94bc-4c63-b636-c5bbd8da93d6 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:25.660998 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-db9da056-94bc-4c63-b636-c5bbd8da93d6 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:25.662058 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-db9da056-94bc-4c63-b636-c5bbd8da93d6 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:25.663249 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-db9da056-94bc-4c63-b636-c5bbd8da93d6 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:25.664179 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-db9da056-94bc-4c63-b636-c5bbd8da93d6 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:26.035811 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-db9da056-94bc-4c63-b636-c5bbd8da93d6 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:26.049116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-db9da056-94bc-4c63-b636-c5bbd8da93d6 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:26.063852 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-db9da056-94bc-4c63-b636-c5bbd8da93d6 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:26.067767 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-db9da056-94bc-4c63-b636-c5bbd8da93d6 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1675 microversion: 2.20 time: 0.425375 Jul 25 14:42:26.073300 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1838/3926] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:25 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1675 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:42:26.173917 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-78818c10-d8c9-4265-9927-05cb91ebe58b tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f4687fe71f0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:26.268485 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-78818c10-d8c9-4265-9927-05cb91ebe58b tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf" status: 200 len: 1455 microversion: 2.1 time: 0.102216 Jul 25 14:42:26.281198 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2089/3927] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:26 2022] GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf => generated 1455 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:26.577101 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-aaefe7be-843a-4484-b1c1-d09574272db8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:26.577847 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-aaefe7be-843a-4484-b1c1-d09574272db8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:26.588120 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aaefe7be-843a-4484-b1c1-d09574272db8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:26.591830 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aaefe7be-843a-4484-b1c1-d09574272db8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:26.593556 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aaefe7be-843a-4484-b1c1-d09574272db8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:26.594450 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aaefe7be-843a-4484-b1c1-d09574272db8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:26.637698 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-aaefe7be-843a-4484-b1c1-d09574272db8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:42:26.839255 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-aaefe7be-843a-4484-b1c1-d09574272db8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527" status: 204 len: 0 microversion: 2.1 time: 0.270956 Jul 25 14:42:26.842856 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1839/3928] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:42:26 2022] DELETE /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:42:26.866738 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-37649c16-53da-4171-821d-bbb84d8951f7 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:26.866738 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-37649c16-53da-4171-821d-bbb84d8951f7 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:26.867086 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37649c16-53da-4171-821d-bbb84d8951f7 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:26.868324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37649c16-53da-4171-821d-bbb84d8951f7 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:26.872373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37649c16-53da-4171-821d-bbb84d8951f7 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:26.872823 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37649c16-53da-4171-821d-bbb84d8951f7 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:27.103254 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2f7ee58d-8765-4a0a-a104-cbfbb363966e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:27.104372 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2f7ee58d-8765-4a0a-a104-cbfbb363966e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:27.112264 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-37649c16-53da-4171-821d-bbb84d8951f7 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:27.117494 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f7ee58d-8765-4a0a-a104-cbfbb363966e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:27.117942 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f7ee58d-8765-4a0a-a104-cbfbb363966e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:27.118724 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f7ee58d-8765-4a0a-a104-cbfbb363966e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:27.119155 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f7ee58d-8765-4a0a-a104-cbfbb363966e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:27.122990 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-37649c16-53da-4171-821d-bbb84d8951f7 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527" status: 200 len: 1553 microversion: 2.1 time: 0.275476 Jul 25 14:42:27.125336 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2090/3929] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:42:26 2022] GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 => generated 1553 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:27.286469 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-457a03a3-730b-41c4-8889-c893fa9563ec tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f4686224c10>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:27.371853 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-457a03a3-730b-41c4-8889-c893fa9563ec tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf" status: 200 len: 1455 microversion: 2.1 time: 0.090080 Jul 25 14:42:27.372874 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2091/3930] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:27 2022] GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf => generated 1455 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:42:27.761353 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2f7ee58d-8765-4a0a-a104-cbfbb363966e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:27.769922 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2f7ee58d-8765-4a0a-a104-cbfbb363966e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:27.774554 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2f7ee58d-8765-4a0a-a104-cbfbb363966e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:27.781775 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2f7ee58d-8765-4a0a-a104-cbfbb363966e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1733 microversion: 2.20 time: 0.683998 Jul 25 14:42:27.782960 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1840/3931] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:27 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1733 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:42:28.146582 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f76b653e-96b8-4017-bc2a-b74c9dd563bc tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:28.147254 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f76b653e-96b8-4017-bc2a-b74c9dd563bc tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:28.166115 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f76b653e-96b8-4017-bc2a-b74c9dd563bc tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:28.166590 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f76b653e-96b8-4017-bc2a-b74c9dd563bc tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:28.168987 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f76b653e-96b8-4017-bc2a-b74c9dd563bc tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:28.169442 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f76b653e-96b8-4017-bc2a-b74c9dd563bc tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:28.388758 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5f2f85df-80fa-4f97-99ca-6380df2eb8a5 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f4698915e50>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:28.493326 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5f2f85df-80fa-4f97-99ca-6380df2eb8a5 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf" status: 200 len: 1455 microversion: 2.1 time: 0.108719 Jul 25 14:42:28.501518 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1841/3932] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:28 2022] GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:28.810441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3f116920-dd2e-4de2-b572-7e62c8a85665 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:28.811240 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3f116920-dd2e-4de2-b572-7e62c8a85665 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:28.828366 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3f116920-dd2e-4de2-b572-7e62c8a85665 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:28.829277 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3f116920-dd2e-4de2-b572-7e62c8a85665 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:28.831493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3f116920-dd2e-4de2-b572-7e62c8a85665 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:28.832313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3f116920-dd2e-4de2-b572-7e62c8a85665 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:29.098388 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f76b653e-96b8-4017-bc2a-b74c9dd563bc tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:29.108215 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f76b653e-96b8-4017-bc2a-b74c9dd563bc tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527" status: 200 len: 1553 microversion: 2.1 time: 0.966028 Jul 25 14:42:29.114314 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2092/3933] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:42:28 2022] GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 => generated 1553 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:29.508906 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5308b8a8-ff5b-4957-9614-e36252b15826 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46861efee0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:29.617122 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5308b8a8-ff5b-4957-9614-e36252b15826 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf" status: 200 len: 1455 microversion: 2.1 time: 0.112343 Jul 25 14:42:29.629788 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2093/3934] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:29 2022] GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf => generated 1455 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:29.911690 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3f116920-dd2e-4de2-b572-7e62c8a85665 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:29.941453 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3f116920-dd2e-4de2-b572-7e62c8a85665 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:29.950718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3f116920-dd2e-4de2-b572-7e62c8a85665 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:29.958717 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3f116920-dd2e-4de2-b572-7e62c8a85665 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1733 microversion: 2.20 time: 1.152229 Jul 25 14:42:29.979607 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1842/3935] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:28 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1733 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:42:30.148018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c30b8ee6-04d2-480d-bdb4-2e7cb0b8dc7b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:30.148915 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c30b8ee6-04d2-480d-bdb4-2e7cb0b8dc7b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:30.168220 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c30b8ee6-04d2-480d-bdb4-2e7cb0b8dc7b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:30.172602 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c30b8ee6-04d2-480d-bdb4-2e7cb0b8dc7b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:30.173804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c30b8ee6-04d2-480d-bdb4-2e7cb0b8dc7b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:30.177061 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c30b8ee6-04d2-480d-bdb4-2e7cb0b8dc7b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:30.540773 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c30b8ee6-04d2-480d-bdb4-2e7cb0b8dc7b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:30.585760 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c30b8ee6-04d2-480d-bdb4-2e7cb0b8dc7b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527" status: 200 len: 1511 microversion: 2.1 time: 0.446382 Jul 25 14:42:30.590134 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2094/3936] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:42:30 2022] GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 => generated 1511 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:30.633493 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-980dde97-73a4-4833-941a-38ddad18a539 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46862c45e0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:30.751359 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-980dde97-73a4-4833-941a-38ddad18a539 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf" status: 200 len: 1455 microversion: 2.1 time: 0.121854 Jul 25 14:42:30.782259 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2095/3937] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:30 2022] GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf => generated 1455 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:30.921451 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-d3b9c515-4e67-4646-b826-35d900209e0f req-fdaf3dc0-c054-4db2-9626-ae1440ccebc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d218da-f592-4489-8617-c37441df3527", "name": "network-vif-deleted", "tag": "efeb5f5c-13f9-4a6a-bc96-b1c65198b352"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:42:30.986721 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-831221aa-da76-47ae-8dc4-50fbe90b5eb8 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:30.987739 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-831221aa-da76-47ae-8dc4-50fbe90b5eb8 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:31.001484 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-831221aa-da76-47ae-8dc4-50fbe90b5eb8 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:31.008531 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-831221aa-da76-47ae-8dc4-50fbe90b5eb8 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:31.009407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-831221aa-da76-47ae-8dc4-50fbe90b5eb8 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:31.011216 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-d3b9c515-4e67-4646-b826-35d900209e0f req-fdaf3dc0-c054-4db2-9626-ae1440ccebc3 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:31.011667 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-d3b9c515-4e67-4646-b826-35d900209e0f req-fdaf3dc0-c054-4db2-9626-ae1440ccebc3 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:31.014296 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-831221aa-da76-47ae-8dc4-50fbe90b5eb8 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:31.073810 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-d3b9c515-4e67-4646-b826-35d900209e0f req-fdaf3dc0-c054-4db2-9626-ae1440ccebc3 service nova] Creating event network-vif-deleted:efeb5f5c-13f9-4a6a-bc96-b1c65198b352 for instance c3d218da-f592-4489-8617-c37441df3527 on n-h2-846435-14 Jul 25 14:42:31.101960 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-d3b9c515-4e67-4646-b826-35d900209e0f req-fdaf3dc0-c054-4db2-9626-ae1440ccebc3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.583183 Jul 25 14:42:31.109002 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1843/3938] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:42:31.612221 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7bca8788-463f-4612-8e70-1a749bed560c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:31.613711 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7bca8788-463f-4612-8e70-1a749bed560c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:31.626433 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7bca8788-463f-4612-8e70-1a749bed560c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:31.630378 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7bca8788-463f-4612-8e70-1a749bed560c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:31.631672 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7bca8788-463f-4612-8e70-1a749bed560c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:31.634476 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7bca8788-463f-4612-8e70-1a749bed560c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:31.701128 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-831221aa-da76-47ae-8dc4-50fbe90b5eb8 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:31.720030 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-831221aa-da76-47ae-8dc4-50fbe90b5eb8 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:31.722162 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-831221aa-da76-47ae-8dc4-50fbe90b5eb8 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:31.726929 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-831221aa-da76-47ae-8dc4-50fbe90b5eb8 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1733 microversion: 2.20 time: 0.744073 Jul 25 14:42:31.741748 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2096/3939] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:30 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1733 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:42:31.771951 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cd1d5b36-c317-4c74-988e-d3576265f6e8 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46861dd820>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:31.915782 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cd1d5b36-c317-4c74-988e-d3576265f6e8 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf" status: 200 len: 1455 microversion: 2.1 time: 0.148745 Jul 25 14:42:31.926126 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2097/3940] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:31 2022] GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf => generated 1455 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:32.072923 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7bca8788-463f-4612-8e70-1a749bed560c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:32.087841 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7bca8788-463f-4612-8e70-1a749bed560c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527" status: 200 len: 1345 microversion: 2.1 time: 0.479880 Jul 25 14:42:32.092552 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1844/3941] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:42:31 2022] GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 => generated 1345 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:32.354190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-3be8a4a5-d01d-4cec-8d34-9276eda2e8a6 req-c434f7fa-75ba-4098-a0c9-6298cc71ac92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "034e5d63-63a1-4883-b7f8-fe84ec541914", "tag": "350ec399-ee42-4e58-9f27-5bd9094cb8e1"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:42:32.382924 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-3be8a4a5-d01d-4cec-8d34-9276eda2e8a6 req-c434f7fa-75ba-4098-a0c9-6298cc71ac92 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:32.383398 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-3be8a4a5-d01d-4cec-8d34-9276eda2e8a6 req-c434f7fa-75ba-4098-a0c9-6298cc71ac92 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:32.434963 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-3be8a4a5-d01d-4cec-8d34-9276eda2e8a6 req-c434f7fa-75ba-4098-a0c9-6298cc71ac92 service nova] Creating event network-changed:350ec399-ee42-4e58-9f27-5bd9094cb8e1 for instance 034e5d63-63a1-4883-b7f8-fe84ec541914 on n-h1-846435-14 Jul 25 14:42:32.462717 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-3be8a4a5-d01d-4cec-8d34-9276eda2e8a6 req-c434f7fa-75ba-4098-a0c9-6298cc71ac92 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108859 Jul 25 14:42:32.465890 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2098/3942] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:42:32.762218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6eb851fa-797d-41f5-b9fd-8110c5116bb7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:32.762940 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6eb851fa-797d-41f5-b9fd-8110c5116bb7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:32.765265 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:42:32.798091 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6eb851fa-797d-41f5-b9fd-8110c5116bb7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:32.798930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6eb851fa-797d-41f5-b9fd-8110c5116bb7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:32.807267 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6eb851fa-797d-41f5-b9fd-8110c5116bb7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:32.808902 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6eb851fa-797d-41f5-b9fd-8110c5116bb7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:32.938509 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fad9d999-a48d-40f7-b959-712b36311763 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46861d4040>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:33.044780 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fad9d999-a48d-40f7-b959-712b36311763 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf" status: 200 len: 1455 microversion: 2.1 time: 0.110734 Jul 25 14:42:33.060480 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2099/3943] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:32 2022] GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf => generated 1455 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:33.128212 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d0e140f3-056f-4bda-a46c-ce3f29494163 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:33.129286 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d0e140f3-056f-4bda-a46c-ce3f29494163 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:33.150803 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d0e140f3-056f-4bda-a46c-ce3f29494163 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:33.156788 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d0e140f3-056f-4bda-a46c-ce3f29494163 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:33.168892 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d0e140f3-056f-4bda-a46c-ce3f29494163 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:33.168892 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d0e140f3-056f-4bda-a46c-ce3f29494163 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:33.470786 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d0e140f3-056f-4bda-a46c-ce3f29494163 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:33.486405 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d0e140f3-056f-4bda-a46c-ce3f29494163 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527" status: 200 len: 1345 microversion: 2.1 time: 0.366110 Jul 25 14:42:33.492599 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2100/3944] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:42:33 2022] GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 => generated 1345 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:34.067196 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-52de83f2-9e7a-413d-8049-e3bc1542bec8 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46862c4b80>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:34.200217 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-52de83f2-9e7a-413d-8049-e3bc1542bec8 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf" status: 200 len: 1455 microversion: 2.1 time: 0.127769 Jul 25 14:42:34.205708 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2101/3945] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:34 2022] GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf => generated 1455 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:42:34.519680 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d1ffbd47-4947-4830-8399-1858ca355924 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:34.520383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d1ffbd47-4947-4830-8399-1858ca355924 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:34.556830 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1ffbd47-4947-4830-8399-1858ca355924 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:34.557435 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1ffbd47-4947-4830-8399-1858ca355924 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:34.558266 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1ffbd47-4947-4830-8399-1858ca355924 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:34.558703 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1ffbd47-4947-4830-8399-1858ca355924 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:34.846372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d1ffbd47-4947-4830-8399-1858ca355924 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:34.859961 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d1ffbd47-4947-4830-8399-1858ca355924 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527" status: 200 len: 1345 microversion: 2.1 time: 0.344519 Jul 25 14:42:34.872932 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2102/3946] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:42:34 2022] GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 => generated 1345 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:35.093542 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6eb851fa-797d-41f5-b9fd-8110c5116bb7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:35.106933 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6eb851fa-797d-41f5-b9fd-8110c5116bb7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:35.119593 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6eb851fa-797d-41f5-b9fd-8110c5116bb7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:35.124132 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6eb851fa-797d-41f5-b9fd-8110c5116bb7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1733 microversion: 2.20 time: 2.368543 Jul 25 14:42:35.129404 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1845/3947] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:32 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1733 bytes in 2375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:42:35.221178 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b4da1d2d-aeb9-417e-a450-0877adc243ff tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46862c4040>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:35.326330 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b4da1d2d-aeb9-417e-a450-0877adc243ff tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf" status: 200 len: 1455 microversion: 2.1 time: 0.109748 Jul 25 14:42:35.326974 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2103/3948] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:35 2022] GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf => generated 1455 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:35.895543 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f8216d9c-4268-4cce-8092-cc49ab1b8beb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:35.898930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f8216d9c-4268-4cce-8092-cc49ab1b8beb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:35.931069 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8216d9c-4268-4cce-8092-cc49ab1b8beb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:35.936607 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8216d9c-4268-4cce-8092-cc49ab1b8beb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:35.938537 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8216d9c-4268-4cce-8092-cc49ab1b8beb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:35.958657 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8216d9c-4268-4cce-8092-cc49ab1b8beb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:36.157645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-76dfed08-a730-4046-be7a-a87a9f6fc164 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:36.158372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-76dfed08-a730-4046-be7a-a87a9f6fc164 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:36.169462 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-76dfed08-a730-4046-be7a-a87a9f6fc164 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:36.172022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-76dfed08-a730-4046-be7a-a87a9f6fc164 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:36.175040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-76dfed08-a730-4046-be7a-a87a9f6fc164 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:36.176353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-76dfed08-a730-4046-be7a-a87a9f6fc164 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:36.460607 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f8216d9c-4268-4cce-8092-cc49ab1b8beb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:36.472618 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f8216d9c-4268-4cce-8092-cc49ab1b8beb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527" status: 200 len: 1345 microversion: 2.1 time: 0.586839 Jul 25 14:42:36.477159 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1846/3949] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:42:35 2022] GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 => generated 1345 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:36.491404 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5cbace49-c83e-4e87-8f15-936d3c60703a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46868c3040>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:36.632846 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5cbace49-c83e-4e87-8f15-936d3c60703a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf" status: 200 len: 1455 microversion: 2.1 time: 0.154543 Jul 25 14:42:36.640349 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1847/3950] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:36 2022] GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf => generated 1455 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:37.502224 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bf5a1c64-c02b-4adc-9878-7710ec9c47a5 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:37.504325 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bf5a1c64-c02b-4adc-9878-7710ec9c47a5 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:37.527267 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bf5a1c64-c02b-4adc-9878-7710ec9c47a5 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:37.528155 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bf5a1c64-c02b-4adc-9878-7710ec9c47a5 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:37.538631 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bf5a1c64-c02b-4adc-9878-7710ec9c47a5 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:37.539688 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bf5a1c64-c02b-4adc-9878-7710ec9c47a5 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:37.820521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bf5a1c64-c02b-4adc-9878-7710ec9c47a5 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:37.834916 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bf5a1c64-c02b-4adc-9878-7710ec9c47a5 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527" status: 200 len: 1345 microversion: 2.1 time: 0.339183 Jul 25 14:42:37.835935 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1848/3951] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:42:37 2022] GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 => generated 1345 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:42:37.848665 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d9ba1701-551d-40d2-8383-3b70654b44ec tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46989bb040>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:38.319434 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-76dfed08-a730-4046-be7a-a87a9f6fc164 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:38.336602 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-76dfed08-a730-4046-be7a-a87a9f6fc164 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:38.338561 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-76dfed08-a730-4046-be7a-a87a9f6fc164 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:38.344268 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-76dfed08-a730-4046-be7a-a87a9f6fc164 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1733 microversion: 2.20 time: 2.191077 Jul 25 14:42:38.346919 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2104/3952] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:36 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1733 bytes in 2195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:42:38.856887 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c1ab5afa-074a-4f41-ab75-1e5b09393c34 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:38.857929 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c1ab5afa-074a-4f41-ab75-1e5b09393c34 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:38.860777 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:42:38.887326 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c1ab5afa-074a-4f41-ab75-1e5b09393c34 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:38.890884 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c1ab5afa-074a-4f41-ab75-1e5b09393c34 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:38.898585 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c1ab5afa-074a-4f41-ab75-1e5b09393c34 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:38.901519 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c1ab5afa-074a-4f41-ab75-1e5b09393c34 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:39.146138 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d9ba1701-551d-40d2-8383-3b70654b44ec tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf" status: 200 len: 1464 microversion: 2.1 time: 1.301957 Jul 25 14:42:39.157307 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1849/3953] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:37 2022] GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf => generated 1464 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:39.186278 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d1b4b3ae-2b6a-4705-954b-209f0b6904a4 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f4686701040>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:39.239997 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c1ab5afa-074a-4f41-ab75-1e5b09393c34 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:39.264517 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c1ab5afa-074a-4f41-ab75-1e5b09393c34 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527" status: 200 len: 1345 microversion: 2.1 time: 0.399854 Jul 25 14:42:39.266034 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d1b4b3ae-2b6a-4705-954b-209f0b6904a4 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf" status: 200 len: 1464 microversion: 2.1 time: 0.096029 Jul 25 14:42:39.279366 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2105/3954] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:42:38 2022] GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 => generated 1345 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:42:39.280347 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1850/3955] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:39 2022] GET /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf => generated 1464 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:39.285611 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4cce6ef5-ed7c-4446-8f34-6626e8a13500 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:39.292969 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4cce6ef5-ed7c-4446-8f34-6626e8a13500 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: 794b7eaa-2e72-4ffc-aced-1dfb494e3554] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:39.306120 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4cce6ef5-ed7c-4446-8f34-6626e8a13500 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:39.312215 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4cce6ef5-ed7c-4446-8f34-6626e8a13500 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:39.315742 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4cce6ef5-ed7c-4446-8f34-6626e8a13500 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:39.316599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4cce6ef5-ed7c-4446-8f34-6626e8a13500 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:39.322698 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:42:39.374637 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0fc7b392-93ec-43ce-8467-66bc3b3c0dba tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:39.375617 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0fc7b392-93ec-43ce-8467-66bc3b3c0dba tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:39.385708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0fc7b392-93ec-43ce-8467-66bc3b3c0dba tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:39.386635 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0fc7b392-93ec-43ce-8467-66bc3b3c0dba tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:39.388103 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0fc7b392-93ec-43ce-8467-66bc3b3c0dba tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:39.388778 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0fc7b392-93ec-43ce-8467-66bc3b3c0dba tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:39.884288 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0fc7b392-93ec-43ce-8467-66bc3b3c0dba tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:39.895012 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0fc7b392-93ec-43ce-8467-66bc3b3c0dba tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:39.902734 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0fc7b392-93ec-43ce-8467-66bc3b3c0dba tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:39.904092 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0fc7b392-93ec-43ce-8467-66bc3b3c0dba tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1733 microversion: 2.20 time: 0.534314 Jul 25 14:42:39.908706 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1851/3956] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:39 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1733 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:42:40.084638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4cce6ef5-ed7c-4446-8f34-6626e8a13500 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:40.104066 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4cce6ef5-ed7c-4446-8f34-6626e8a13500 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554" status: 200 len: 1480 microversion: 2.1 time: 0.823248 Jul 25 14:42:40.113166 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2106/3957] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:42:39 2022] GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554 => generated 1480 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:40.287773 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dbff4db4-c633-4e12-9475-5a435a6acc01 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:40.293160 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-dbff4db4-c633-4e12-9475-5a435a6acc01 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:40.311295 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dbff4db4-c633-4e12-9475-5a435a6acc01 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:40.311797 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dbff4db4-c633-4e12-9475-5a435a6acc01 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:40.312675 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dbff4db4-c633-4e12-9475-5a435a6acc01 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:40.313155 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dbff4db4-c633-4e12-9475-5a435a6acc01 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:40.381833 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=89,nova_cell1:UPDATE=7 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:42:40.746600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-dbff4db4-c633-4e12-9475-5a435a6acc01 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:40.762964 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dbff4db4-c633-4e12-9475-5a435a6acc01 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527" status: 200 len: 1345 microversion: 2.1 time: 0.479959 Jul 25 14:42:40.767133 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1852/3958] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:42:40 2022] GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 => generated 1345 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:40.934257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-45835f0a-5cdf-48ff-8aaf-d97b3c036ca8 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:40.936157 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-45835f0a-5cdf-48ff-8aaf-d97b3c036ca8 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:40.952204 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45835f0a-5cdf-48ff-8aaf-d97b3c036ca8 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:40.952930 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45835f0a-5cdf-48ff-8aaf-d97b3c036ca8 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:40.953878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45835f0a-5cdf-48ff-8aaf-d97b3c036ca8 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:40.954466 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45835f0a-5cdf-48ff-8aaf-d97b3c036ca8 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:41.135399 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7ff77cfd-4640-44d8-bccc-e1d3282a85d3 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:41.136414 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7ff77cfd-4640-44d8-bccc-e1d3282a85d3 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: 794b7eaa-2e72-4ffc-aced-1dfb494e3554] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:41.159188 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ff77cfd-4640-44d8-bccc-e1d3282a85d3 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:41.159969 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ff77cfd-4640-44d8-bccc-e1d3282a85d3 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:41.161010 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ff77cfd-4640-44d8-bccc-e1d3282a85d3 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:41.163010 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ff77cfd-4640-44d8-bccc-e1d3282a85d3 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:41.394717 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-45835f0a-5cdf-48ff-8aaf-d97b3c036ca8 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:41.423872 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-45835f0a-5cdf-48ff-8aaf-d97b3c036ca8 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:41.429792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-45835f0a-5cdf-48ff-8aaf-d97b3c036ca8 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:41.434525 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-45835f0a-5cdf-48ff-8aaf-d97b3c036ca8 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1733 microversion: 2.20 time: 0.503665 Jul 25 14:42:41.448448 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2107/3959] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:40 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1733 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:42:41.795520 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fbd0fab4-b7bb-4a6c-9d4d-80e94dbfe80b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:41.797753 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fbd0fab4-b7bb-4a6c-9d4d-80e94dbfe80b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:41.830783 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fbd0fab4-b7bb-4a6c-9d4d-80e94dbfe80b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:41.832291 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fbd0fab4-b7bb-4a6c-9d4d-80e94dbfe80b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:41.833651 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fbd0fab4-b7bb-4a6c-9d4d-80e94dbfe80b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:41.840476 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fbd0fab4-b7bb-4a6c-9d4d-80e94dbfe80b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:41.939212 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7ff77cfd-4640-44d8-bccc-e1d3282a85d3 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:41.960491 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7ff77cfd-4640-44d8-bccc-e1d3282a85d3 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554" status: 200 len: 1467 microversion: 2.1 time: 0.825829 Jul 25 14:42:41.972455 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1853/3960] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:42:41 2022] GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554 => generated 1467 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:41.988376 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-33aa9c38-6a30-4abf-855d-43758865c74f tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1170303366"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:42:41.995258 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-33aa9c38-6a30-4abf-855d-43758865c74f tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: dfb8c05d-0ccc-4b4d-a920-d8238e56f0de] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:42.022013 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-33aa9c38-6a30-4abf-855d-43758865c74f tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:42.023439 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-33aa9c38-6a30-4abf-855d-43758865c74f tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:42.025447 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-33aa9c38-6a30-4abf-855d-43758865c74f tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:42.026159 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-33aa9c38-6a30-4abf-855d-43758865c74f tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:42.200941 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fbd0fab4-b7bb-4a6c-9d4d-80e94dbfe80b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:42.244334 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fbd0fab4-b7bb-4a6c-9d4d-80e94dbfe80b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527" status: 200 len: 1345 microversion: 2.1 time: 0.459188 Jul 25 14:42:42.245531 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2108/3961] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:42:41 2022] GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 => generated 1345 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:42:42.461697 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f8a76376-2c05-4a59-ac03-ae9c364df0af tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:42.462968 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f8a76376-2c05-4a59-ac03-ae9c364df0af tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:42.487913 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8a76376-2c05-4a59-ac03-ae9c364df0af tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:42.492897 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8a76376-2c05-4a59-ac03-ae9c364df0af tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:42.497195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8a76376-2c05-4a59-ac03-ae9c364df0af tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:42.497792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8a76376-2c05-4a59-ac03-ae9c364df0af tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:42.665202 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-33aa9c38-6a30-4abf-855d-43758865c74f tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "POST /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de/action" status: 202 len: 0 microversion: 2.1 time: 0.685462 Jul 25 14:42:42.685790 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1854/3962] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:42:41 2022] POST /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de/action => generated 0 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 14:42:42.729181 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-544da723-f79b-45ed-82f2-7fe1c3dee0f7 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f468670edc0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:42.897942 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-544da723-f79b-45ed-82f2-7fe1c3dee0f7 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f" status: 200 len: 1455 microversion: 2.1 time: 0.204710 Jul 25 14:42:42.898412 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1855/3963] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:42 2022] GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f => generated 1455 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:43.275099 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bd99fab5-7c21-4768-b14e-115ddb6a5297 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:43.276625 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bd99fab5-7c21-4768-b14e-115ddb6a5297 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:43.318333 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd99fab5-7c21-4768-b14e-115ddb6a5297 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:43.325960 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd99fab5-7c21-4768-b14e-115ddb6a5297 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:43.326868 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd99fab5-7c21-4768-b14e-115ddb6a5297 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:43.340979 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd99fab5-7c21-4768-b14e-115ddb6a5297 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:43.933261 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bd99fab5-7c21-4768-b14e-115ddb6a5297 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:43.955414 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bd99fab5-7c21-4768-b14e-115ddb6a5297 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527" status: 200 len: 1345 microversion: 2.1 time: 0.682876 Jul 25 14:42:43.960252 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1856/3964] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:42:43 2022] GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 => generated 1345 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:42:43.977718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3dbe4966-442c-4b37-852c-2249d981c091 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46866ffee0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:44.045152 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f8a76376-2c05-4a59-ac03-ae9c364df0af tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:44.063198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f8a76376-2c05-4a59-ac03-ae9c364df0af tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:44.069849 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f8a76376-2c05-4a59-ac03-ae9c364df0af tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:44.073481 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f8a76376-2c05-4a59-ac03-ae9c364df0af tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1733 microversion: 2.20 time: 1.618242 Jul 25 14:42:44.077405 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2109/3965] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:42 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1733 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:42:44.089222 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3dbe4966-442c-4b37-852c-2249d981c091 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f" status: 200 len: 1455 microversion: 2.1 time: 0.127445 Jul 25 14:42:44.094914 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1857/3966] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:43 2022] GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f => generated 1455 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:44.217875 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-9396475b-0238-4f86-abd6-533f81354922 req-0d2fd3c7-8746-4ba4-aa1d-aad0dde0c7e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "794b7eaa-2e72-4ffc-aced-1dfb494e3554", "name": "network-vif-unplugged", "status": "completed", "tag": "ee5f6577-aca1-4c54-8d5b-962c392fa674"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:42:44.247351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-9396475b-0238-4f86-abd6-533f81354922 req-0d2fd3c7-8746-4ba4-aa1d-aad0dde0c7e6 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:44.249469 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-9396475b-0238-4f86-abd6-533f81354922 req-0d2fd3c7-8746-4ba4-aa1d-aad0dde0c7e6 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:44.300735 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-9396475b-0238-4f86-abd6-533f81354922 req-0d2fd3c7-8746-4ba4-aa1d-aad0dde0c7e6 service nova] Creating event network-vif-unplugged:ee5f6577-aca1-4c54-8d5b-962c392fa674 for instance 794b7eaa-2e72-4ffc-aced-1dfb494e3554 on n-h1-846435-14 Jul 25 14:42:44.315772 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-9396475b-0238-4f86-abd6-533f81354922 req-0d2fd3c7-8746-4ba4-aa1d-aad0dde0c7e6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103562 Jul 25 14:42:44.319232 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2110/3967] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:42:44.987121 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-67eae57b-4326-4249-abf8-307fc5c9e061 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:44.996567 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-67eae57b-4326-4249-abf8-307fc5c9e061 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:45.029525 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-67eae57b-4326-4249-abf8-307fc5c9e061 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:45.032189 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-67eae57b-4326-4249-abf8-307fc5c9e061 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:45.034340 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-67eae57b-4326-4249-abf8-307fc5c9e061 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:45.036971 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-67eae57b-4326-4249-abf8-307fc5c9e061 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:45.105918 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ff57a984-48b6-413c-ad73-46c8afc64fd2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:45.111823 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ff57a984-48b6-413c-ad73-46c8afc64fd2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:45.159105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff57a984-48b6-413c-ad73-46c8afc64fd2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:45.166415 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff57a984-48b6-413c-ad73-46c8afc64fd2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:45.167452 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff57a984-48b6-413c-ad73-46c8afc64fd2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:45.172212 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff57a984-48b6-413c-ad73-46c8afc64fd2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:45.258642 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-67eae57b-4326-4249-abf8-307fc5c9e061 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:45.262132 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-67eae57b-4326-4249-abf8-307fc5c9e061 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:45.267122 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-67eae57b-4326-4249-abf8-307fc5c9e061 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lazy-loading 'fault' on Instance uuid c3d218da-f592-4489-8617-c37441df3527 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:42:45.393259 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-67eae57b-4326-4249-abf8-307fc5c9e061 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:45.408667 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-67eae57b-4326-4249-abf8-307fc5c9e061 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527" status: 200 len: 1304 microversion: 2.1 time: 0.428656 Jul 25 14:42:45.413361 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1858/3968] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:42:44 2022] GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 => generated 1304 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:45.441996 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-17416687-694b-4c1d-80f6-e91a0d2c1267 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f4686705820>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:45.561703 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-17416687-694b-4c1d-80f6-e91a0d2c1267 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f" status: 200 len: 1455 microversion: 2.1 time: 0.145907 Jul 25 14:42:45.562431 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1859/3969] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:45 2022] GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f => generated 1455 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:45.878684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ff57a984-48b6-413c-ad73-46c8afc64fd2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:45.893464 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ff57a984-48b6-413c-ad73-46c8afc64fd2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:45.895251 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ff57a984-48b6-413c-ad73-46c8afc64fd2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:45.899086 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ff57a984-48b6-413c-ad73-46c8afc64fd2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1733 microversion: 2.20 time: 0.803388 Jul 25 14:42:45.906826 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2111/3970] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:45 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1733 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:42:46.438182 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4dddba12-83ea-4548-9731-b35e386691f1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:46.439220 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4dddba12-83ea-4548-9731-b35e386691f1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:46.455887 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4dddba12-83ea-4548-9731-b35e386691f1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:46.458688 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4dddba12-83ea-4548-9731-b35e386691f1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:46.461444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4dddba12-83ea-4548-9731-b35e386691f1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:46.461891 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4dddba12-83ea-4548-9731-b35e386691f1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:46.512295 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-4dddba12-83ea-4548-9731-b35e386691f1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] HTTP exception thrown: Instance c3d218da-f592-4489-8617-c37441df3527 could not be found. Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4dddba12-83ea-4548-9731-b35e386691f1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Request method failure captured: Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 HTTP/1.1 Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3quERREaOs3Kc7iY1Vh9GKraPJ63kqwGO_-k7wXB_J3XVEfBf3LNTXeHb07R82UwUNgvRdojb21TsSuL636LebhCUID5TJuapIn-Sgeh4nT2_p48qkoLx6k1MrIDkEY7ueSXXEfRqNxtsyFtJzfjwKFOLGr5sudf0H8jELBV5u89FK0 Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b9b1c620d0b14a3a9471515cf47d6944", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b9b1c620d0b14a3a9471515cf47d6944"}]}] Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 33f992249063495c8bf12954afd9e8b7 Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance c3d218da-f592-4489-8617-c37441df3527 could not be found. Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'c3d218da-f592-4489-8617-c37441df3527'} Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3d218da-f592-4489-8617-c37441df3527 could not be found. Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3d218da-f592-4489-8617-c37441df3527 could not be found. Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:42:46.524216 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:42:46.535799 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:42:46.535799 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:42:46.535799 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:42:46.535799 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:42:46.535799 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:42:46.535799 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3d218da-f592-4489-8617-c37441df3527 could not be found. Jul 25 14:42:46.535799 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:42:46.535799 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4dddba12-83ea-4548-9731-b35e386691f1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Returning 404 to user: Instance c3d218da-f592-4489-8617-c37441df3527 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:42:46.535799 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4dddba12-83ea-4548-9731-b35e386691f1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527" status: 404 len: 111 microversion: 2.1 time: 0.092542 Jul 25 14:42:46.564936 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2112/3971] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:42:46 2022] GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:42:46.588817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0c1225ae-af97-41bc-982a-2a796817dcb6 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46861d4f70>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:46.683946 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0c1225ae-af97-41bc-982a-2a796817dcb6 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f" status: 200 len: 1455 microversion: 2.1 time: 0.110975 Jul 25 14:42:46.693124 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2113/3972] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:46 2022] GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f => generated 1455 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:46.853868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f21fb907-fa37-4652-9d21-8067b3153bc9 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:46.856951 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f21fb907-fa37-4652-9d21-8067b3153bc9 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:46.865878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f21fb907-fa37-4652-9d21-8067b3153bc9 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:46.866757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f21fb907-fa37-4652-9d21-8067b3153bc9 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:46.867816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f21fb907-fa37-4652-9d21-8067b3153bc9 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:46.869006 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f21fb907-fa37-4652-9d21-8067b3153bc9 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:46.908342 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-f21fb907-fa37-4652-9d21-8067b3153bc9 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] HTTP exception thrown: Instance c3d218da-f592-4489-8617-c37441df3527 could not be found. Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f21fb907-fa37-4652-9d21-8067b3153bc9 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Request method failure captured: Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527/os-volume_attachments HTTP/1.1 Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3quERREaOs3Kc7iY1Vh9GKraPJ63kqwGO_-k7wXB_J3XVEfBf3LNTXeHb07R82UwUNgvRdojb21TsSuL636LebhCUID5TJuapIn-Sgeh4nT2_p48qkoLx6k1MrIDkEY7ueSXXEfRqNxtsyFtJzfjwKFOLGr5sudf0H8jELBV5u89FK0 Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b9b1c620d0b14a3a9471515cf47d6944", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b9b1c620d0b14a3a9471515cf47d6944"}]}] Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 33f992249063495c8bf12954afd9e8b7 Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance c3d218da-f592-4489-8617-c37441df3527 could not be found. Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'server_id': 'c3d218da-f592-4489-8617-c37441df3527'} Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3d218da-f592-4489-8617-c37441df3527 could not be found. Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:42:46.913666 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:42:46.918340 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3d218da-f592-4489-8617-c37441df3527 could not be found. Jul 25 14:42:46.918340 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:42:46.918340 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:42:46.918340 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:42:46.918340 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:42:46.918340 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:42:46.918340 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:42:46.918340 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:42:46.918340 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:42:46.918340 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3d218da-f592-4489-8617-c37441df3527 could not be found. Jul 25 14:42:46.918340 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:42:46.926385 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f21fb907-fa37-4652-9d21-8067b3153bc9 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Returning 404 to user: Instance c3d218da-f592-4489-8617-c37441df3527 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:42:46.929307 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f21fb907-fa37-4652-9d21-8067b3153bc9 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.086039 Jul 25 14:42:46.940728 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2114/3973] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:42:46 2022] GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527/os-volume_attachments => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:42:46.962231 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3f660730-ac58-4caa-9e16-ab20a44a92cf tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:46.963003 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3f660730-ac58-4caa-9e16-ab20a44a92cf tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:46.990802 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f660730-ac58-4caa-9e16-ab20a44a92cf tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:46.991314 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f660730-ac58-4caa-9e16-ab20a44a92cf tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:46.993034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f660730-ac58-4caa-9e16-ab20a44a92cf tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:46.993516 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f660730-ac58-4caa-9e16-ab20a44a92cf tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:47.326856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d10176e6-7808-4192-a361-3181c77201df tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Action: 'create', calling method: .version_select at 0x7f46987d91f0>, body: {"keypair": {"name": "tempest-keypair-1552429995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvbkdKQmdLHo4cFFTU+YPbm2g+HALlLZk0jD0sGPdrvaYDvvEI0sGSxRBeNt6jC1XPrNpSLW5StFq3TxmQ8boQXB08AJtsoroP28TFSvsPBZXFC2DiRdyQMU9FXxleq1A=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:42:47.378538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-d10176e6-7808-4192-a361-3181c77201df tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Getting quotas for project b80269077ccc4482a91cb9e6b1d911b5. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:42:47.401515 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-d10176e6-7808-4192-a361-3181c77201df tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Getting quotas for user 0d7e3180b05b4f9fb877d031b73b5ee2 and project b80269077ccc4482a91cb9e6b1d911b5. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:42:47.457656 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d10176e6-7808-4192-a361-3181c77201df tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.217879 Jul 25 14:42:47.459494 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1860/3974] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:42:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:42:47.568923 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-059bf0b8-3028-4cc7-ba30-4234e66bb93c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1161340654", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "e81cd55f-4951-41ed-b82a-173584e324cb"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:42:47.577560 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3f660730-ac58-4caa-9e16-ab20a44a92cf tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:47.624358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3f660730-ac58-4caa-9e16-ab20a44a92cf tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:47.627306 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3f660730-ac58-4caa-9e16-ab20a44a92cf tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:47.641605 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3f660730-ac58-4caa-9e16-ab20a44a92cf tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1733 microversion: 2.20 time: 0.697788 Jul 25 14:42:47.642234 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2115/3975] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:46 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1733 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:42:47.701223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0e09e0da-51e8-450a-8ddc-48353cb4059d tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46861d4940>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:47.827536 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-059bf0b8-3028-4cc7-ba30-4234e66bb93c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] validate_networks() for [('e81cd55f-4951-41ed-b82a-173584e324cb', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:42:47.857758 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0e09e0da-51e8-450a-8ddc-48353cb4059d tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f" status: 200 len: 1455 microversion: 2.1 time: 0.162293 Jul 25 14:42:47.858656 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2116/3976] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:47 2022] GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f => generated 1455 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:48.670871 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-98184ff0-7d9f-4046-9603-7dd67e199eb2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:48.672447 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-98184ff0-7d9f-4046-9603-7dd67e199eb2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:48.683087 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98184ff0-7d9f-4046-9603-7dd67e199eb2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:48.687508 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98184ff0-7d9f-4046-9603-7dd67e199eb2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:48.688944 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98184ff0-7d9f-4046-9603-7dd67e199eb2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:48.689578 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98184ff0-7d9f-4046-9603-7dd67e199eb2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:49.605536 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-98184ff0-7d9f-4046-9603-7dd67e199eb2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:49.617842 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-98184ff0-7d9f-4046-9603-7dd67e199eb2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:49.619286 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-98184ff0-7d9f-4046-9603-7dd67e199eb2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:49.620538 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-98184ff0-7d9f-4046-9603-7dd67e199eb2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1733 microversion: 2.20 time: 0.953706 Jul 25 14:42:49.621106 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2117/3977] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:48 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1733 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:42:49.643771 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dcb3fa05-79bb-4d0a-8f3f-c9b2ff9f784a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46862db160>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:49.735361 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dcb3fa05-79bb-4d0a-8f3f-c9b2ff9f784a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f" status: 200 len: 1455 microversion: 2.1 time: 0.113091 Jul 25 14:42:49.736867 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2118/3978] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:49 2022] GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f => generated 1455 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:49.886873 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-059bf0b8-3028-4cc7-ba30-4234e66bb93c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:42:49.887988 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-059bf0b8-3028-4cc7-ba30-4234e66bb93c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:42:49.888664 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-059bf0b8-3028-4cc7-ba30-4234e66bb93c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:42:49.889252 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-059bf0b8-3028-4cc7-ba30-4234e66bb93c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:42:49.889889 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-059bf0b8-3028-4cc7-ba30-4234e66bb93c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:42:49.908389 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-059bf0b8-3028-4cc7-ba30-4234e66bb93c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:49.909047 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-059bf0b8-3028-4cc7-ba30-4234e66bb93c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:49.911701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-059bf0b8-3028-4cc7-ba30-4234e66bb93c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:49.912415 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-059bf0b8-3028-4cc7-ba30-4234e66bb93c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:49.970195 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-059bf0b8-3028-4cc7-ba30-4234e66bb93c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Getting quotas for project b9b1c620d0b14a3a9471515cf47d6944. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:42:50.001520 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-059bf0b8-3028-4cc7-ba30-4234e66bb93c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Getting quotas for user 33f992249063495c8bf12954afd9e8b7 and project b9b1c620d0b14a3a9471515cf47d6944. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:42:50.041614 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-059bf0b8-3028-4cc7-ba30-4234e66bb93c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:42:50.050486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-059bf0b8-3028-4cc7-ba30-4234e66bb93c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: dbb92cab-8b6d-4846-a170-16b68dd959ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:42:50.167355 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-059bf0b8-3028-4cc7-ba30-4234e66bb93c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.611545 Jul 25 14:42:50.175454 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1861/3979] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:42:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 14:42:50.180871 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ec931629-0f22-49fd-84f5-5ac3125e2f77 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:50.181635 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ec931629-0f22-49fd-84f5-5ac3125e2f77 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: dbb92cab-8b6d-4846-a170-16b68dd959ca] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:50.402044 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ec931629-0f22-49fd-84f5-5ac3125e2f77 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:50.415862 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ec931629-0f22-49fd-84f5-5ac3125e2f77 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/dbb92cab-8b6d-4846-a170-16b68dd959ca" status: 200 len: 1215 microversion: 2.1 time: 0.239362 Jul 25 14:42:50.422305 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2119/3980] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:42:50 2022] GET /compute/v2.1/servers/dbb92cab-8b6d-4846-a170-16b68dd959ca => generated 1215 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:50.447513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4859ed52-4691-4bab-b6cf-61351da036d8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:50.448093 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4859ed52-4691-4bab-b6cf-61351da036d8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: dbb92cab-8b6d-4846-a170-16b68dd959ca] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:50.527694 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4859ed52-4691-4bab-b6cf-61351da036d8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: dbb92cab-8b6d-4846-a170-16b68dd959ca] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:42:50.646376 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7fbc819a-3319-410f-92e2-31b6f4ccee58 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:50.647118 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7fbc819a-3319-410f-92e2-31b6f4ccee58 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:50.667018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7fbc819a-3319-410f-92e2-31b6f4ccee58 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:50.668527 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7fbc819a-3319-410f-92e2-31b6f4ccee58 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:50.670299 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7fbc819a-3319-410f-92e2-31b6f4ccee58 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:50.672712 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7fbc819a-3319-410f-92e2-31b6f4ccee58 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:50.770896 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4859ed52-4691-4bab-b6cf-61351da036d8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "DELETE /compute/v2.1/servers/dbb92cab-8b6d-4846-a170-16b68dd959ca" status: 204 len: 0 microversion: 2.1 time: 0.328819 Jul 25 14:42:50.775760 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1862/3981] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:42:50 2022] DELETE /compute/v2.1/servers/dbb92cab-8b6d-4846-a170-16b68dd959ca => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:42:50.805477 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d589e23e-b92f-42f9-a4d7-2677ceb8eb6e tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f4698867ca0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:50.995574 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d589e23e-b92f-42f9-a4d7-2677ceb8eb6e tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f" status: 200 len: 1455 microversion: 2.1 time: 0.215848 Jul 25 14:42:50.997478 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1863/3982] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:50 2022] GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f => generated 1455 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:51.014057 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-144b5513-3e25-476c-b35b-672261c32ef4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:51.025079 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-144b5513-3e25-476c-b35b-672261c32ef4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: dbb92cab-8b6d-4846-a170-16b68dd959ca] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:51.124424 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-144b5513-3e25-476c-b35b-672261c32ef4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] HTTP exception thrown: Instance dbb92cab-8b6d-4846-a170-16b68dd959ca could not be found. Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-144b5513-3e25-476c-b35b-672261c32ef4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Request method failure captured: Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/dbb92cab-8b6d-4846-a170-16b68dd959ca HTTP/1.1 Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3quERREaOs3Kc7iY1Vh9GKraPJ63kqwGO_-k7wXB_J3XVEfBf3LNTXeHb07R82UwUNgvRdojb21TsSuL636LebhCUID5TJuapIn-Sgeh4nT2_p48qkoLx6k1MrIDkEY7ueSXXEfRqNxtsyFtJzfjwKFOLGr5sudf0H8jELBV5u89FK0 Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b9b1c620d0b14a3a9471515cf47d6944", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b9b1c620d0b14a3a9471515cf47d6944"}]}] Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 33f992249063495c8bf12954afd9e8b7 Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance dbb92cab-8b6d-4846-a170-16b68dd959ca could not be found. Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'dbb92cab-8b6d-4846-a170-16b68dd959ca'} Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2877, in _get_instance Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance dbb92cab-8b6d-4846-a170-16b68dd959ca Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2889, in _get_instance Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbb92cab-8b6d-4846-a170-16b68dd959ca could not be found. Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:42:51.141254 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:42:51.147605 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:42:51.147605 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:42:51.147605 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:42:51.147605 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:42:51.147605 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:42:51.147605 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:42:51.147605 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:42:51.147605 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:42:51.147605 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:42:51.147605 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:42:51.147605 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbb92cab-8b6d-4846-a170-16b68dd959ca could not be found. Jul 25 14:42:51.147605 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:42:51.147605 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:42:51.147605 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:42:51.147605 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:42:51.147605 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:42:51.147605 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:42:51.147605 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:42:51.147605 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:42:51.147605 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbb92cab-8b6d-4846-a170-16b68dd959ca could not be found. Jul 25 14:42:51.147605 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:42:51.152118 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-144b5513-3e25-476c-b35b-672261c32ef4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Returning 404 to user: Instance dbb92cab-8b6d-4846-a170-16b68dd959ca could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:42:51.153594 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-144b5513-3e25-476c-b35b-672261c32ef4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/dbb92cab-8b6d-4846-a170-16b68dd959ca" status: 404 len: 111 microversion: 2.1 time: 0.153190 Jul 25 14:42:51.154394 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1864/3983] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:42:50 2022] GET /compute/v2.1/servers/dbb92cab-8b6d-4846-a170-16b68dd959ca => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:42:51.803781 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7fbc819a-3319-410f-92e2-31b6f4ccee58 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:51.845560 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7fbc819a-3319-410f-92e2-31b6f4ccee58 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:51.850546 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7fbc819a-3319-410f-92e2-31b6f4ccee58 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:51.872243 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f250077c-e82b-4dd2-a1a8-b28187101444 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-547003465", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "e81cd55f-4951-41ed-b82a-173584e324cb"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:42:51.879615 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7fbc819a-3319-410f-92e2-31b6f4ccee58 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1733 microversion: 2.20 time: 1.237981 Jul 25 14:42:51.880288 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2120/3984] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:50 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1733 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:42:52.014804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-943865cf-74b2-479a-83ac-2d38d95832a9 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f4686224430>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:52.166876 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-f250077c-e82b-4dd2-a1a8-b28187101444 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] validate_networks() for [('e81cd55f-4951-41ed-b82a-173584e324cb', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:42:52.329848 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-943865cf-74b2-479a-83ac-2d38d95832a9 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f" status: 200 len: 1455 microversion: 2.1 time: 0.315793 Jul 25 14:42:52.330502 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2121/3985] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:52 2022] GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f => generated 1455 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:42:52.785350 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-4b5a53de-a6e2-44e1-941b-3708796f3959 req-d1e6f0c0-d078-46c6-a3c3-3408aa1f5407 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfb8c05d-0ccc-4b4d-a920-d8238e56f0de", "name": "network-vif-plugged", "status": "completed", "tag": "78158429-4b1a-4039-9efe-77450874ee04"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:42:52.811117 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-4b5a53de-a6e2-44e1-941b-3708796f3959 req-d1e6f0c0-d078-46c6-a3c3-3408aa1f5407 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:52.812469 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-4b5a53de-a6e2-44e1-941b-3708796f3959 req-d1e6f0c0-d078-46c6-a3c3-3408aa1f5407 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:52.834633 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-4b5a53de-a6e2-44e1-941b-3708796f3959 req-d1e6f0c0-d078-46c6-a3c3-3408aa1f5407 service nova] Creating event network-vif-plugged:78158429-4b1a-4039-9efe-77450874ee04 for instance dfb8c05d-0ccc-4b4d-a920-d8238e56f0de on n-h2-846435-14 Jul 25 14:42:52.841903 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-4b5a53de-a6e2-44e1-941b-3708796f3959 req-d1e6f0c0-d078-46c6-a3c3-3408aa1f5407 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061146 Jul 25 14:42:52.843336 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2122/3986] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:42:52.906146 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e29d4aa9-f52d-4f29-a432-d9066367dc8f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:52.906868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e29d4aa9-f52d-4f29-a432-d9066367dc8f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:52.935090 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e29d4aa9-f52d-4f29-a432-d9066367dc8f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:52.936005 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e29d4aa9-f52d-4f29-a432-d9066367dc8f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:52.938867 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e29d4aa9-f52d-4f29-a432-d9066367dc8f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:52.939661 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e29d4aa9-f52d-4f29-a432-d9066367dc8f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:54.076438 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e29d4aa9-f52d-4f29-a432-d9066367dc8f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:54.093811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e29d4aa9-f52d-4f29-a432-d9066367dc8f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:54.101194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e29d4aa9-f52d-4f29-a432-d9066367dc8f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:54.112625 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e29d4aa9-f52d-4f29-a432-d9066367dc8f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1733 microversion: 2.20 time: 1.209250 Jul 25 14:42:54.114434 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2123/3987] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:52 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1733 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:42:54.121630 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-eb317ebb-1881-40db-a760-9f90ed0b2418 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46861f3b80>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:54.812832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-f250077c-e82b-4dd2-a1a8-b28187101444 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:42:54.813548 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-f250077c-e82b-4dd2-a1a8-b28187101444 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:42:54.814144 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-f250077c-e82b-4dd2-a1a8-b28187101444 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:42:54.814661 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-f250077c-e82b-4dd2-a1a8-b28187101444 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:42:54.815263 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-f250077c-e82b-4dd2-a1a8-b28187101444 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:42:54.829455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f250077c-e82b-4dd2-a1a8-b28187101444 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:54.831343 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f250077c-e82b-4dd2-a1a8-b28187101444 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:54.832438 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f250077c-e82b-4dd2-a1a8-b28187101444 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:54.833245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f250077c-e82b-4dd2-a1a8-b28187101444 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:54.908625 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-f250077c-e82b-4dd2-a1a8-b28187101444 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Getting quotas for project b9b1c620d0b14a3a9471515cf47d6944. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:42:54.937209 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-f250077c-e82b-4dd2-a1a8-b28187101444 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Getting quotas for user 33f992249063495c8bf12954afd9e8b7 and project b9b1c620d0b14a3a9471515cf47d6944. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:42:55.004840 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f250077c-e82b-4dd2-a1a8-b28187101444 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:42:55.023023 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f250077c-e82b-4dd2-a1a8-b28187101444 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: b2758384-4e23-4c78-8c2b-d38932d2cc13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:42:55.191263 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f250077c-e82b-4dd2-a1a8-b28187101444 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.325726 Jul 25 14:42:55.216355 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1865/3988] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:42:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 3352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 14:42:55.237410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-21ab4de7-9190-47d2-a5a5-32129fc9e2e7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:55.238111 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-21ab4de7-9190-47d2-a5a5-32129fc9e2e7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:55.290785 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-21ab4de7-9190-47d2-a5a5-32129fc9e2e7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:55.291294 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-21ab4de7-9190-47d2-a5a5-32129fc9e2e7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:55.292107 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-21ab4de7-9190-47d2-a5a5-32129fc9e2e7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:55.292540 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-21ab4de7-9190-47d2-a5a5-32129fc9e2e7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:55.630469 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-eb317ebb-1881-40db-a760-9f90ed0b2418 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f" status: 200 len: 1455 microversion: 2.1 time: 1.514369 Jul 25 14:42:55.631950 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2124/3989] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:54 2022] GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f => generated 1455 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:55.637984 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-99051f1d-d671-45ab-8c12-4422ba6e827e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:55.641902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-99051f1d-d671-45ab-8c12-4422ba6e827e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: b2758384-4e23-4c78-8c2b-d38932d2cc13] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:55.746243 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-21ab4de7-9190-47d2-a5a5-32129fc9e2e7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:55.758911 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-21ab4de7-9190-47d2-a5a5-32129fc9e2e7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:55.760469 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-21ab4de7-9190-47d2-a5a5-32129fc9e2e7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:55.761704 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-21ab4de7-9190-47d2-a5a5-32129fc9e2e7 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1733 microversion: 2.20 time: 0.544065 Jul 25 14:42:55.762354 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1866/3990] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:55 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1733 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:42:56.043638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-99051f1d-d671-45ab-8c12-4422ba6e827e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:56.060757 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-99051f1d-d671-45ab-8c12-4422ba6e827e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13" status: 200 len: 1214 microversion: 2.1 time: 0.424195 Jul 25 14:42:56.066731 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2125/3991] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:42:55 2022] GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13 => generated 1214 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:56.339347 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4d830f3a-2ec9-49f9-98e1-d3aef97e9241 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1621214228", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1ada738-03c1-4bc6-a9c8-d1a2220fdb72"}], "security_groups": [{"name": "tempest-securitygroup--437846595"}], "key_name": "tempest-keypair-1552429995", "user_data": "}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:42:56.647279 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-aebc763b-03dc-4bcc-87ec-5ae18f2b4635 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46862e1c10>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:56.674970 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-4d830f3a-2ec9-49f9-98e1-d3aef97e9241 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] validate_networks() for [('c1ada738-03c1-4bc6-a9c8-d1a2220fdb72', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:42:56.800837 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-aebc763b-03dc-4bcc-87ec-5ae18f2b4635 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f" status: 200 len: 1455 microversion: 2.1 time: 0.158685 Jul 25 14:42:56.802505 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2126/3992] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:56 2022] GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f => generated 1455 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:56.814569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-af639647-cfd5-41d5-a615-ee3e06cc71d4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:56.826835 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-af639647-cfd5-41d5-a615-ee3e06cc71d4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:56.851721 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af639647-cfd5-41d5-a615-ee3e06cc71d4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:56.856850 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af639647-cfd5-41d5-a615-ee3e06cc71d4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:56.858827 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af639647-cfd5-41d5-a615-ee3e06cc71d4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:56.862111 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af639647-cfd5-41d5-a615-ee3e06cc71d4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:57.762760 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-af639647-cfd5-41d5-a615-ee3e06cc71d4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:57.776995 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-af639647-cfd5-41d5-a615-ee3e06cc71d4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:57.786632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-af639647-cfd5-41d5-a615-ee3e06cc71d4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:57.788229 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-af639647-cfd5-41d5-a615-ee3e06cc71d4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1733 microversion: 2.20 time: 0.984489 Jul 25 14:42:57.797655 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2127/3993] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:56 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1733 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:42:57.814006 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7f0dd12c-dc5f-491d-adf5-58ff62ee6150 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:57.815087 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7f0dd12c-dc5f-491d-adf5-58ff62ee6150 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: b2758384-4e23-4c78-8c2b-d38932d2cc13] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:57.835683 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7f0dd12c-dc5f-491d-adf5-58ff62ee6150 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:57.837631 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7f0dd12c-dc5f-491d-adf5-58ff62ee6150 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:57.841354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7f0dd12c-dc5f-491d-adf5-58ff62ee6150 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:57.846652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7f0dd12c-dc5f-491d-adf5-58ff62ee6150 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:58.123260 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7f0dd12c-dc5f-491d-adf5-58ff62ee6150 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:58.138315 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7f0dd12c-dc5f-491d-adf5-58ff62ee6150 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13" status: 200 len: 1284 microversion: 2.1 time: 0.336449 Jul 25 14:42:58.144761 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2128/3994] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:42:57 2022] GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13 => generated 1284 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:58.154547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e608e267-7d6b-4c69-8d9c-ceee4d7922b3 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46861a5ee0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:58.265376 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-4d830f3a-2ec9-49f9-98e1-d3aef97e9241 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:42:58.266015 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-4d830f3a-2ec9-49f9-98e1-d3aef97e9241 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:42:58.266969 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-4d830f3a-2ec9-49f9-98e1-d3aef97e9241 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:42:58.267581 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-4d830f3a-2ec9-49f9-98e1-d3aef97e9241 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:42:58.268488 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-4d830f3a-2ec9-49f9-98e1-d3aef97e9241 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:42:58.296050 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4d830f3a-2ec9-49f9-98e1-d3aef97e9241 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:58.296991 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4d830f3a-2ec9-49f9-98e1-d3aef97e9241 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:58.308193 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e608e267-7d6b-4c69-8d9c-ceee4d7922b3 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f" status: 200 len: 1455 microversion: 2.1 time: 0.161736 Jul 25 14:42:58.308783 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2129/3995] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:58 2022] GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f => generated 1455 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:58.310064 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4d830f3a-2ec9-49f9-98e1-d3aef97e9241 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:58.312593 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4d830f3a-2ec9-49f9-98e1-d3aef97e9241 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:58.397585 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-4d830f3a-2ec9-49f9-98e1-d3aef97e9241 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Getting quotas for project b80269077ccc4482a91cb9e6b1d911b5. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:42:58.416131 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-4d830f3a-2ec9-49f9-98e1-d3aef97e9241 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Getting quotas for user 0d7e3180b05b4f9fb877d031b73b5ee2 and project b80269077ccc4482a91cb9e6b1d911b5. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:42:58.469064 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:42:58.473737 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4d830f3a-2ec9-49f9-98e1-d3aef97e9241 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:42:58.482809 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4d830f3a-2ec9-49f9-98e1-d3aef97e9241 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:42:58.638311 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4d830f3a-2ec9-49f9-98e1-d3aef97e9241 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.303770 Jul 25 14:42:58.646117 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1867/3996] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:42:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 2313 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:42:58.652974 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a7641573-2f96-4220-a6f8-b5ffbefd6179 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:58.656121 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a7641573-2f96-4220-a6f8-b5ffbefd6179 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:58.766157 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a7641573-2f96-4220-a6f8-b5ffbefd6179 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:58.777514 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a7641573-2f96-4220-a6f8-b5ffbefd6179 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1238 microversion: 2.1 time: 0.130418 Jul 25 14:42:58.805371 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2130/3997] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:42:58 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1238 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:58.822912 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9562541d-a534-47f5-a378-eca981c88225 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:58.824100 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9562541d-a534-47f5-a378-eca981c88225 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:58.842477 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9562541d-a534-47f5-a378-eca981c88225 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:58.843040 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9562541d-a534-47f5-a378-eca981c88225 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:58.850625 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9562541d-a534-47f5-a378-eca981c88225 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:58.853764 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9562541d-a534-47f5-a378-eca981c88225 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:59.169474 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-180ce1c8-69c4-43a3-81c2-c8dd4c6a5d40 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:59.171645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-180ce1c8-69c4-43a3-81c2-c8dd4c6a5d40 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: b2758384-4e23-4c78-8c2b-d38932d2cc13] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:59.197975 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-180ce1c8-69c4-43a3-81c2-c8dd4c6a5d40 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:59.201529 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-180ce1c8-69c4-43a3-81c2-c8dd4c6a5d40 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:59.204041 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-180ce1c8-69c4-43a3-81c2-c8dd4c6a5d40 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:59.208521 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-180ce1c8-69c4-43a3-81c2-c8dd4c6a5d40 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:59.340236 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9562541d-a534-47f5-a378-eca981c88225 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:59.349343 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9562541d-a534-47f5-a378-eca981c88225 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:59.357184 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9562541d-a534-47f5-a378-eca981c88225 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:59.359619 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9562541d-a534-47f5-a378-eca981c88225 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1733 microversion: 2.20 time: 0.541467 Jul 25 14:42:59.360254 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1868/3998] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:42:58 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1733 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:42:59.381066 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fd3e4ada-c9f8-4efd-a54f-fe551d77b452 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46866c6550>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:59.533941 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-180ce1c8-69c4-43a3-81c2-c8dd4c6a5d40 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:42:59.539543 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fd3e4ada-c9f8-4efd-a54f-fe551d77b452 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f" status: 200 len: 1455 microversion: 2.1 time: 0.170863 Jul 25 14:42:59.540706 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1869/3999] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:42:59 2022] GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f => generated 1455 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:59.553998 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-180ce1c8-69c4-43a3-81c2-c8dd4c6a5d40 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13" status: 200 len: 1272 microversion: 2.1 time: 0.388674 Jul 25 14:42:59.555464 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2131/4000] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:42:59 2022] GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13 => generated 1272 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:42:59.819695 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6e76c007-6beb-4e0d-b6c6-8fdd07305a88 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:42:59.821997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6e76c007-6beb-4e0d-b6c6-8fdd07305a88 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:42:59.848228 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e76c007-6beb-4e0d-b6c6-8fdd07305a88 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:59.849945 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e76c007-6beb-4e0d-b6c6-8fdd07305a88 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:42:59.852848 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e76c007-6beb-4e0d-b6c6-8fdd07305a88 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:42:59.854190 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e76c007-6beb-4e0d-b6c6-8fdd07305a88 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:00.251170 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6e76c007-6beb-4e0d-b6c6-8fdd07305a88 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:00.264932 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6e76c007-6beb-4e0d-b6c6-8fdd07305a88 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1234 microversion: 2.1 time: 0.451290 Jul 25 14:43:00.276544 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1870/4001] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:42:59 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1234 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:00.383958 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f6625b73-6375-4490-b827-b7126afc3f5f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:00.385610 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f6625b73-6375-4490-b827-b7126afc3f5f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:00.401595 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6625b73-6375-4490-b827-b7126afc3f5f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:00.402446 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6625b73-6375-4490-b827-b7126afc3f5f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:00.408799 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6625b73-6375-4490-b827-b7126afc3f5f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:00.410086 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6625b73-6375-4490-b827-b7126afc3f5f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:00.556732 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2ac55a2f-aa31-465d-a5a5-53518d191457 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46866c60d0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:00.692527 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2ac55a2f-aa31-465d-a5a5-53518d191457 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f" status: 200 len: 1455 microversion: 2.1 time: 0.141454 Jul 25 14:43:00.693060 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1871/4002] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:43:00 2022] GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f => generated 1455 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:43:00.728558 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d5cb6d2b-6413-452c-b6ba-ad58fb8ae45f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:00.729445 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d5cb6d2b-6413-452c-b6ba-ad58fb8ae45f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: b2758384-4e23-4c78-8c2b-d38932d2cc13] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:00.762733 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d5cb6d2b-6413-452c-b6ba-ad58fb8ae45f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:00.763351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d5cb6d2b-6413-452c-b6ba-ad58fb8ae45f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:00.769109 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d5cb6d2b-6413-452c-b6ba-ad58fb8ae45f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:00.770259 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d5cb6d2b-6413-452c-b6ba-ad58fb8ae45f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:01.279717 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d5cb6d2b-6413-452c-b6ba-ad58fb8ae45f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:01.288245 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f6625b73-6375-4490-b827-b7126afc3f5f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:01.294538 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d5cb6d2b-6413-452c-b6ba-ad58fb8ae45f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13" status: 200 len: 1314 microversion: 2.1 time: 0.598903 Jul 25 14:43:01.296512 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1872/4003] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:00 2022] GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13 => generated 1314 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:01.307395 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-36eb3828-b45f-46b6-a460-e8dc758ba310 req-25c8977a-a319-4554-b6b9-16981b5d9d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "034e5d63-63a1-4883-b7f8-fe84ec541914", "name": "network-vif-plugged", "status": "completed", "tag": "350ec399-ee42-4e58-9f27-5bd9094cb8e1"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:43:01.307945 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f6625b73-6375-4490-b827-b7126afc3f5f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:01.318386 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f6625b73-6375-4490-b827-b7126afc3f5f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:01.321718 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f6625b73-6375-4490-b827-b7126afc3f5f tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1733 microversion: 2.20 time: 0.941776 Jul 25 14:43:01.324215 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2132/4004] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:43:00 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1733 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:43:01.342140 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-36eb3828-b45f-46b6-a460-e8dc758ba310 req-25c8977a-a319-4554-b6b9-16981b5d9d3d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:01.346497 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-36eb3828-b45f-46b6-a460-e8dc758ba310 req-25c8977a-a319-4554-b6b9-16981b5d9d3d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:01.353475 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ccdd9dd3-a17c-4c40-a154-0700b2d8e9d2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:01.355083 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ccdd9dd3-a17c-4c40-a154-0700b2d8e9d2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:01.374495 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ccdd9dd3-a17c-4c40-a154-0700b2d8e9d2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:01.375284 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ccdd9dd3-a17c-4c40-a154-0700b2d8e9d2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:01.384109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ccdd9dd3-a17c-4c40-a154-0700b2d8e9d2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:01.394408 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-36eb3828-b45f-46b6-a460-e8dc758ba310 req-25c8977a-a319-4554-b6b9-16981b5d9d3d service nova] Creating event network-vif-plugged:350ec399-ee42-4e58-9f27-5bd9094cb8e1 for instance 034e5d63-63a1-4883-b7f8-fe84ec541914 on n-h1-846435-14 Jul 25 14:43:01.399429 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ccdd9dd3-a17c-4c40-a154-0700b2d8e9d2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:01.412381 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-36eb3828-b45f-46b6-a460-e8dc758ba310 req-25c8977a-a319-4554-b6b9-16981b5d9d3d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113237 Jul 25 14:43:01.416628 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1873/4005] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:43:01.708516 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-85418712-1ad3-4336-ad8e-8f916bb0d7bf tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46866c6f70>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:01.808723 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-85418712-1ad3-4336-ad8e-8f916bb0d7bf tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f" status: 200 len: 1455 microversion: 2.1 time: 0.105166 Jul 25 14:43:01.809630 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1874/4006] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:43:01 2022] GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:01.931154 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ccdd9dd3-a17c-4c40-a154-0700b2d8e9d2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:01.939357 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ccdd9dd3-a17c-4c40-a154-0700b2d8e9d2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1296 microversion: 2.1 time: 0.613679 Jul 25 14:43:01.939948 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2133/4007] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:01 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1296 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:02.317323 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6c05159d-f5da-42fb-9299-74f3ada820fc tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:02.318047 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6c05159d-f5da-42fb-9299-74f3ada820fc tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: b2758384-4e23-4c78-8c2b-d38932d2cc13] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:02.334640 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6c05159d-f5da-42fb-9299-74f3ada820fc tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:02.335129 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6c05159d-f5da-42fb-9299-74f3ada820fc tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:02.335942 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6c05159d-f5da-42fb-9299-74f3ada820fc tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:02.336425 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6c05159d-f5da-42fb-9299-74f3ada820fc tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:02.354224 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-90aca4b0-00a9-4312-9701-d4991ccd88fd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:02.355069 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-90aca4b0-00a9-4312-9701-d4991ccd88fd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:02.364613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-90aca4b0-00a9-4312-9701-d4991ccd88fd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:02.366864 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-90aca4b0-00a9-4312-9701-d4991ccd88fd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:02.371668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-90aca4b0-00a9-4312-9701-d4991ccd88fd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:02.374156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-90aca4b0-00a9-4312-9701-d4991ccd88fd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:02.973241 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6c05159d-f5da-42fb-9299-74f3ada820fc tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:03.004417 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6c05159d-f5da-42fb-9299-74f3ada820fc tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13" status: 200 len: 1314 microversion: 2.1 time: 0.684660 Jul 25 14:43:03.009754 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1875/4008] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:02 2022] GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13 => generated 1314 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:03.035843 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-edf4f2f8-1a26-47e2-b636-1fe870003c88 req-4ac69d61-c261-4262-9028-98cc623c9d6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2758384-4e23-4c78-8c2b-d38932d2cc13", "tag": "8549fc18-204b-48a1-b760-138b17fa9d6e"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:43:03.069786 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-edf4f2f8-1a26-47e2-b636-1fe870003c88 req-4ac69d61-c261-4262-9028-98cc623c9d6f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:03.075716 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-edf4f2f8-1a26-47e2-b636-1fe870003c88 req-4ac69d61-c261-4262-9028-98cc623c9d6f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:03.099320 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-edf4f2f8-1a26-47e2-b636-1fe870003c88 req-4ac69d61-c261-4262-9028-98cc623c9d6f service nova] Creating event network-changed:8549fc18-204b-48a1-b760-138b17fa9d6e for instance b2758384-4e23-4c78-8c2b-d38932d2cc13 on n-h1-846435-14 Jul 25 14:43:03.105520 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-edf4f2f8-1a26-47e2-b636-1fe870003c88 req-4ac69d61-c261-4262-9028-98cc623c9d6f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079337 Jul 25 14:43:03.117081 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1876/4009] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:43:03.123012 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ce1c4b09-7d8d-427a-acd9-4ad3ba8c4dca tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f4686701820>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:03.522501 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-90aca4b0-00a9-4312-9701-d4991ccd88fd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:03.533107 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-90aca4b0-00a9-4312-9701-d4991ccd88fd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:03.541747 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-90aca4b0-00a9-4312-9701-d4991ccd88fd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:03.544965 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-90aca4b0-00a9-4312-9701-d4991ccd88fd tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1733 microversion: 2.20 time: 1.195037 Jul 25 14:43:03.550880 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2134/4010] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:43:02 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1733 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:43:03.559410 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-01057ce1-3a4b-4964-b034-120254806719 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:03.574567 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-01057ce1-3a4b-4964-b034-120254806719 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:03.599823 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01057ce1-3a4b-4964-b034-120254806719 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:03.600644 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01057ce1-3a4b-4964-b034-120254806719 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:03.603021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01057ce1-3a4b-4964-b034-120254806719 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:03.607311 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01057ce1-3a4b-4964-b034-120254806719 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:03.674744 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:43:04.345087 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-01057ce1-3a4b-4964-b034-120254806719 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:04.360365 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-01057ce1-3a4b-4964-b034-120254806719 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1363 microversion: 2.1 time: 0.802713 Jul 25 14:43:04.363516 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2135/4011] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:03 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1363 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:04.401373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-54c8bfe0-3651-4b27-b8a8-34de4a6aaad4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:04.402961 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-54c8bfe0-3651-4b27-b8a8-34de4a6aaad4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: b2758384-4e23-4c78-8c2b-d38932d2cc13] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:04.419389 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-54c8bfe0-3651-4b27-b8a8-34de4a6aaad4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:04.422758 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-54c8bfe0-3651-4b27-b8a8-34de4a6aaad4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:04.424361 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-54c8bfe0-3651-4b27-b8a8-34de4a6aaad4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:04.426579 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-54c8bfe0-3651-4b27-b8a8-34de4a6aaad4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:05.013637 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-54c8bfe0-3651-4b27-b8a8-34de4a6aaad4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:05.030998 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-54c8bfe0-3651-4b27-b8a8-34de4a6aaad4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13" status: 200 len: 1314 microversion: 2.1 time: 0.665683 Jul 25 14:43:05.036039 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2136/4012] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:04 2022] GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13 => generated 1314 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:05.058571 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bf0fe494-1ab9-48d9-a587-a4b35d1f3602 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:05.061836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bf0fe494-1ab9-48d9-a587-a4b35d1f3602 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:05.077872 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bf0fe494-1ab9-48d9-a587-a4b35d1f3602 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:05.084786 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bf0fe494-1ab9-48d9-a587-a4b35d1f3602 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:05.085970 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bf0fe494-1ab9-48d9-a587-a4b35d1f3602 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:05.086748 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bf0fe494-1ab9-48d9-a587-a4b35d1f3602 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:05.502972 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ce1c4b09-7d8d-427a-acd9-4ad3ba8c4dca tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f" status: 200 len: 1455 microversion: 2.1 time: 2.384415 Jul 25 14:43:05.504893 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1877/4013] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:43:03 2022] GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f => generated 1455 bytes in 2387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:05.524257 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-33f42a02-07ea-4a87-9e2e-87cd08f5e557 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:05.535795 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-33f42a02-07ea-4a87-9e2e-87cd08f5e557 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:05.572059 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-33f42a02-07ea-4a87-9e2e-87cd08f5e557 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:05.572621 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-33f42a02-07ea-4a87-9e2e-87cd08f5e557 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:05.580112 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-33f42a02-07ea-4a87-9e2e-87cd08f5e557 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:05.594703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-33f42a02-07ea-4a87-9e2e-87cd08f5e557 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:06.314068 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bf0fe494-1ab9-48d9-a587-a4b35d1f3602 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:06.340977 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bf0fe494-1ab9-48d9-a587-a4b35d1f3602 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:06.354100 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bf0fe494-1ab9-48d9-a587-a4b35d1f3602 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:06.365081 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bf0fe494-1ab9-48d9-a587-a4b35d1f3602 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1733 microversion: 2.20 time: 1.319737 Jul 25 14:43:06.367133 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2137/4014] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:43:05 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1733 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:43:06.406160 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7ffe9769-2cff-49ac-b0eb-2d74bc72c254 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:06.407430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7ffe9769-2cff-49ac-b0eb-2d74bc72c254 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: b2758384-4e23-4c78-8c2b-d38932d2cc13] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:06.434401 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7ffe9769-2cff-49ac-b0eb-2d74bc72c254 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:06.437926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7ffe9769-2cff-49ac-b0eb-2d74bc72c254 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:06.447533 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7ffe9769-2cff-49ac-b0eb-2d74bc72c254 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:06.453507 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7ffe9769-2cff-49ac-b0eb-2d74bc72c254 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:07.569802 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7ffe9769-2cff-49ac-b0eb-2d74bc72c254 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:07.579322 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7ffe9769-2cff-49ac-b0eb-2d74bc72c254 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13" status: 200 len: 1314 microversion: 2.1 time: 1.210796 Jul 25 14:43:07.585843 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2138/4015] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:06 2022] GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13 => generated 1314 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:07.593699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-33f42a02-07ea-4a87-9e2e-87cd08f5e557 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:07.604391 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-33f42a02-07ea-4a87-9e2e-87cd08f5e557 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1363 microversion: 2.1 time: 2.093312 Jul 25 14:43:07.604987 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1878/4016] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:05 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1363 bytes in 2095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:07.621013 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-83720956-a034-493c-89a9-bd94572b4c89 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f4686294430>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:07.627479 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-152dfadb-015e-4645-bd5a-4e75a41c1d6b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:07.628209 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-152dfadb-015e-4645-bd5a-4e75a41c1d6b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:07.654519 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-152dfadb-015e-4645-bd5a-4e75a41c1d6b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:07.658347 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-152dfadb-015e-4645-bd5a-4e75a41c1d6b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:07.659465 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-152dfadb-015e-4645-bd5a-4e75a41c1d6b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:07.663538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-152dfadb-015e-4645-bd5a-4e75a41c1d6b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:07.715872 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-83720956-a034-493c-89a9-bd94572b4c89 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f" status: 200 len: 1455 microversion: 2.1 time: 0.125707 Jul 25 14:43:07.716501 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2139/4017] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:43:07 2022] GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f => generated 1455 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:07.732827 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-d9e1d71c-041b-4864-ac4c-4db263c8d482 req-918a59d4-ebfa-4964-8130-b1e7afe56770 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5866023-cfeb-43b0-9788-334b6ad4b850", "tag": "3ad83701-32d5-4489-b9ac-492dd82d885c"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:43:07.762734 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-d9e1d71c-041b-4864-ac4c-4db263c8d482 req-918a59d4-ebfa-4964-8130-b1e7afe56770 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:07.764652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-d9e1d71c-041b-4864-ac4c-4db263c8d482 req-918a59d4-ebfa-4964-8130-b1e7afe56770 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:07.820889 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-d9e1d71c-041b-4864-ac4c-4db263c8d482 req-918a59d4-ebfa-4964-8130-b1e7afe56770 service nova] Creating event network-changed:3ad83701-32d5-4489-b9ac-492dd82d885c for instance e5866023-cfeb-43b0-9788-334b6ad4b850 on n-h2-846435-14 Jul 25 14:43:07.843908 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-d9e1d71c-041b-4864-ac4c-4db263c8d482 req-918a59d4-ebfa-4964-8130-b1e7afe56770 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116877 Jul 25 14:43:07.852913 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2140/4018] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:43:07.904569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cc4c4fea-aa06-4fc2-9166-6de469b8a614 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7dbc8256-742e-4524-87b3-2fa7e80a0529"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:43:07.907762 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cc4c4fea-aa06-4fc2-9166-6de469b8a614 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:07.933460 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cc4c4fea-aa06-4fc2-9166-6de469b8a614 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:07.933915 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cc4c4fea-aa06-4fc2-9166-6de469b8a614 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:07.934705 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cc4c4fea-aa06-4fc2-9166-6de469b8a614 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:07.935145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cc4c4fea-aa06-4fc2-9166-6de469b8a614 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:08.356699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:43:08.409739 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-152dfadb-015e-4645-bd5a-4e75a41c1d6b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:08.420918 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-152dfadb-015e-4645-bd5a-4e75a41c1d6b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:08.422442 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-152dfadb-015e-4645-bd5a-4e75a41c1d6b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:08.423640 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-152dfadb-015e-4645-bd5a-4e75a41c1d6b tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1720 microversion: 2.20 time: 0.811317 Jul 25 14:43:08.424259 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1879/4019] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:43:07 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1720 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:43:08.609893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-35f55990-f268-4f9d-808f-383103e73537 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:08.609893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-35f55990-f268-4f9d-808f-383103e73537 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: b2758384-4e23-4c78-8c2b-d38932d2cc13] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:08.623393 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=24 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:43:08.628668 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-35f55990-f268-4f9d-808f-383103e73537 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:08.636826 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-35f55990-f268-4f9d-808f-383103e73537 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:08.638408 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-35f55990-f268-4f9d-808f-383103e73537 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:08.645396 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-35f55990-f268-4f9d-808f-383103e73537 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:08.772036 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:43:09.052670 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-35f55990-f268-4f9d-808f-383103e73537 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:09.065341 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-35f55990-f268-4f9d-808f-383103e73537 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13" status: 200 len: 1314 microversion: 2.1 time: 0.462476 Jul 25 14:43:09.068610 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1880/4020] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:08 2022] GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13 => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:43:09.090063 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3bd361aa-cf63-4983-8cd1-93d66ed9830e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:09.090694 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3bd361aa-cf63-4983-8cd1-93d66ed9830e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:09.111575 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3bd361aa-cf63-4983-8cd1-93d66ed9830e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:09.119775 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3bd361aa-cf63-4983-8cd1-93d66ed9830e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:09.125219 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3bd361aa-cf63-4983-8cd1-93d66ed9830e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:09.125923 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3bd361aa-cf63-4983-8cd1-93d66ed9830e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:09.160899 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:43:09.366922 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3bd361aa-cf63-4983-8cd1-93d66ed9830e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:09.377207 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3bd361aa-cf63-4983-8cd1-93d66ed9830e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1363 microversion: 2.1 time: 0.304005 Jul 25 14:43:09.377895 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1881/4021] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:09 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1363 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:09.400631 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1033e13f-3577-4a16-b94f-27039154607a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f4686701310>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:09.481872 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1033e13f-3577-4a16-b94f-27039154607a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f" status: 200 len: 1455 microversion: 2.1 time: 0.099334 Jul 25 14:43:09.483308 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1882/4022] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:43:09 2022] GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:09.489287 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-8338f84e-4c5b-4622-95b9-b5e7fe618735 req-3d0b8bfc-718a-416f-afba-0c88b2daac62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2758384-4e23-4c78-8c2b-d38932d2cc13", "name": "network-vif-plugged", "status": "completed", "tag": "8549fc18-204b-48a1-b760-138b17fa9d6e"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:43:09.500267 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-8338f84e-4c5b-4622-95b9-b5e7fe618735 req-3d0b8bfc-718a-416f-afba-0c88b2daac62 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:09.500935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-8338f84e-4c5b-4622-95b9-b5e7fe618735 req-3d0b8bfc-718a-416f-afba-0c88b2daac62 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:09.513529 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-8338f84e-4c5b-4622-95b9-b5e7fe618735 req-3d0b8bfc-718a-416f-afba-0c88b2daac62 service nova] Creating event network-vif-plugged:8549fc18-204b-48a1-b760-138b17fa9d6e for instance b2758384-4e23-4c78-8c2b-d38932d2cc13 on n-h1-846435-14 Jul 25 14:43:09.520957 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-8338f84e-4c5b-4622-95b9-b5e7fe618735 req-3d0b8bfc-718a-416f-afba-0c88b2daac62 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035895 Jul 25 14:43:09.522193 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1883/4023] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:43:10.090724 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b4749cce-5124-48e7-b19b-3498ab3c907a tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:10.092239 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b4749cce-5124-48e7-b19b-3498ab3c907a tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: b2758384-4e23-4c78-8c2b-d38932d2cc13] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:10.100289 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b4749cce-5124-48e7-b19b-3498ab3c907a tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:10.101086 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b4749cce-5124-48e7-b19b-3498ab3c907a tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:10.102071 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b4749cce-5124-48e7-b19b-3498ab3c907a tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:10.102702 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b4749cce-5124-48e7-b19b-3498ab3c907a tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:10.415199 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b4749cce-5124-48e7-b19b-3498ab3c907a tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:10.426267 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b4749cce-5124-48e7-b19b-3498ab3c907a tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13" status: 200 len: 1314 microversion: 2.1 time: 0.341081 Jul 25 14:43:10.427637 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1884/4024] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:10 2022] GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:10.434577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0bc20b67-59c6-49ed-93c0-6f7d0144cdfb tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:10.453048 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0bc20b67-59c6-49ed-93c0-6f7d0144cdfb tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:10.466315 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0bc20b67-59c6-49ed-93c0-6f7d0144cdfb tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:10.466774 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0bc20b67-59c6-49ed-93c0-6f7d0144cdfb tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:10.467565 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0bc20b67-59c6-49ed-93c0-6f7d0144cdfb tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:10.468189 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0bc20b67-59c6-49ed-93c0-6f7d0144cdfb tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:10.728995 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0bc20b67-59c6-49ed-93c0-6f7d0144cdfb tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:10.744189 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0bc20b67-59c6-49ed-93c0-6f7d0144cdfb tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1363 microversion: 2.1 time: 0.313409 Jul 25 14:43:10.746371 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1885/4025] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:10 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1363 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:10.771632 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-65b22754-cff2-4d8c-a29c-74815830debc tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46872164c0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:10.867296 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cc4c4fea-aa06-4fc2-9166-6de469b8a614 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "POST /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.964752 Jul 25 14:43:10.872524 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2141/4026] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Jul 25 14:43:07 2022] POST /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da/os-volume_attachments => generated 194 bytes in 2976 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:43:10.909493 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-65b22754-cff2-4d8c-a29c-74815830debc tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f" status: 200 len: 1455 microversion: 2.1 time: 0.143291 Jul 25 14:43:10.927996 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1886/4027] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:43:10 2022] GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f => generated 1455 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:11.455714 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fc831219-56bb-4e5a-a2e5-682f0702de02 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:11.457756 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fc831219-56bb-4e5a-a2e5-682f0702de02 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: b2758384-4e23-4c78-8c2b-d38932d2cc13] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:11.471223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=64 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:43:11.478967 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fc831219-56bb-4e5a-a2e5-682f0702de02 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:11.481296 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fc831219-56bb-4e5a-a2e5-682f0702de02 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:11.485612 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fc831219-56bb-4e5a-a2e5-682f0702de02 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:11.487467 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fc831219-56bb-4e5a-a2e5-682f0702de02 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:11.769899 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c69c0e8f-6d38-4d49-a3f4-a3b7f317a4f3 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:11.770539 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c69c0e8f-6d38-4d49-a3f4-a3b7f317a4f3 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:11.801935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c69c0e8f-6d38-4d49-a3f4-a3b7f317a4f3 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:11.802404 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c69c0e8f-6d38-4d49-a3f4-a3b7f317a4f3 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:11.803216 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c69c0e8f-6d38-4d49-a3f4-a3b7f317a4f3 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:11.803637 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c69c0e8f-6d38-4d49-a3f4-a3b7f317a4f3 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:12.333504 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fc831219-56bb-4e5a-a2e5-682f0702de02 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:12.343231 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fc831219-56bb-4e5a-a2e5-682f0702de02 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13" status: 200 len: 1502 microversion: 2.1 time: 0.896191 Jul 25 14:43:12.368458 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2142/4028] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:11 2022] GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13 => generated 1502 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:12.379752 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d3c28785-2125-4164-ba87-bb01ba2ad6d5 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f4686151c10>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:12.503542 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c69c0e8f-6d38-4d49-a3f4-a3b7f317a4f3 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:12.516200 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c69c0e8f-6d38-4d49-a3f4-a3b7f317a4f3 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1363 microversion: 2.1 time: 0.749275 Jul 25 14:43:12.518246 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1887/4029] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:11 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1363 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:12.530411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b0ae4094-e780-477e-a833-c76d43261b9b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:43:12.531882 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d3c28785-2125-4164-ba87-bb01ba2ad6d5 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f" status: 200 len: 1455 microversion: 2.1 time: 0.143889 Jul 25 14:43:12.532670 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2143/4030] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:43:12 2022] GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f => generated 1455 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:12.534772 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b0ae4094-e780-477e-a833-c76d43261b9b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: b2758384-4e23-4c78-8c2b-d38932d2cc13] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:12.556644 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b0ae4094-e780-477e-a833-c76d43261b9b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:12.557612 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b0ae4094-e780-477e-a833-c76d43261b9b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:12.559139 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b0ae4094-e780-477e-a833-c76d43261b9b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:12.560662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b0ae4094-e780-477e-a833-c76d43261b9b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:12.741160 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b0ae4094-e780-477e-a833-c76d43261b9b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "POST /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13/action" status: 202 len: 0 microversion: 2.1 time: 0.220120 Jul 25 14:43:12.746697 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1888/4031] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:43:12 2022] POST /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:43:12.766398 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-466cfa36-147a-4871-a507-535b60a6b73c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:12.769535 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-466cfa36-147a-4871-a507-535b60a6b73c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: b2758384-4e23-4c78-8c2b-d38932d2cc13] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:12.791583 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-466cfa36-147a-4871-a507-535b60a6b73c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:12.792677 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-466cfa36-147a-4871-a507-535b60a6b73c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:12.793962 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-466cfa36-147a-4871-a507-535b60a6b73c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:12.794727 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-466cfa36-147a-4871-a507-535b60a6b73c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:13.295396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-466cfa36-147a-4871-a507-535b60a6b73c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:13.312449 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-466cfa36-147a-4871-a507-535b60a6b73c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13" status: 200 len: 1507 microversion: 2.1 time: 0.560307 Jul 25 14:43:13.314392 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2144/4032] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:12 2022] GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13 => generated 1507 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:13.540898 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-712c385b-2667-42c1-a772-856026b964ac tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:13.548820 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-832d9a17-2d43-4036-bd4e-f2d981e79a81 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46862db3a0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:13.557004 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-712c385b-2667-42c1-a772-856026b964ac tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:13.579465 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-712c385b-2667-42c1-a772-856026b964ac tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:13.581307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-712c385b-2667-42c1-a772-856026b964ac tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:13.585080 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-712c385b-2667-42c1-a772-856026b964ac tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:13.587118 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-712c385b-2667-42c1-a772-856026b964ac tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:13.654365 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-832d9a17-2d43-4036-bd4e-f2d981e79a81 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f" status: 200 len: 1455 microversion: 2.1 time: 0.111147 Jul 25 14:43:13.654987 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2145/4033] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:43:13 2022] GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:43:13.939346 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-712c385b-2667-42c1-a772-856026b964ac tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:13.949837 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-712c385b-2667-42c1-a772-856026b964ac tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1363 microversion: 2.1 time: 0.415640 Jul 25 14:43:13.951058 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1889/4034] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:13 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1363 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:14.337127 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-40a7e073-a086-4043-861f-5732f17b6f69 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:14.338090 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-40a7e073-a086-4043-861f-5732f17b6f69 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: b2758384-4e23-4c78-8c2b-d38932d2cc13] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:14.369264 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-40a7e073-a086-4043-861f-5732f17b6f69 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:14.369858 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-40a7e073-a086-4043-861f-5732f17b6f69 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:14.370784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-40a7e073-a086-4043-861f-5732f17b6f69 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:14.371380 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-40a7e073-a086-4043-861f-5732f17b6f69 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:14.671885 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-85cbf09d-9249-45eb-80d5-97afc3d4ce6e tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46866c6790>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:14.699759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-40a7e073-a086-4043-861f-5732f17b6f69 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:14.708931 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-40a7e073-a086-4043-861f-5732f17b6f69 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13" status: 200 len: 1487 microversion: 2.1 time: 0.377589 Jul 25 14:43:14.712368 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2146/4035] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:14 2022] GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13 => generated 1487 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:14.738303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-459e42d1-8bd8-491f-91e8-f19cf8df91ae tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:14.739606 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-459e42d1-8bd8-491f-91e8-f19cf8df91ae tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: b2758384-4e23-4c78-8c2b-d38932d2cc13] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:14.757484 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-85cbf09d-9249-45eb-80d5-97afc3d4ce6e tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f" status: 200 len: 1455 microversion: 2.1 time: 0.091200 Jul 25 14:43:14.760163 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1890/4036] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:43:14 2022] GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:43:14.766239 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-459e42d1-8bd8-491f-91e8-f19cf8df91ae tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:14.767706 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-459e42d1-8bd8-491f-91e8-f19cf8df91ae tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:14.769754 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-459e42d1-8bd8-491f-91e8-f19cf8df91ae tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:14.770897 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-459e42d1-8bd8-491f-91e8-f19cf8df91ae tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:14.814176 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-459e42d1-8bd8-491f-91e8-f19cf8df91ae tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: b2758384-4e23-4c78-8c2b-d38932d2cc13] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:43:14.939936 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-459e42d1-8bd8-491f-91e8-f19cf8df91ae tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13" status: 204 len: 0 microversion: 2.1 time: 0.209762 Jul 25 14:43:14.945489 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2147/4037] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:43:14 2022] DELETE /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:43:14.956660 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ee972248-4fb3-4139-b23e-970ecee05e6c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:14.958233 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ee972248-4fb3-4139-b23e-970ecee05e6c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: b2758384-4e23-4c78-8c2b-d38932d2cc13] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:14.978154 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-61045342-2c60-4e98-ac5c-6fcbc432ef32 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:14.980036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee972248-4fb3-4139-b23e-970ecee05e6c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:14.981490 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-61045342-2c60-4e98-ac5c-6fcbc432ef32 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:14.982167 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee972248-4fb3-4139-b23e-970ecee05e6c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:14.985066 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee972248-4fb3-4139-b23e-970ecee05e6c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:14.989759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee972248-4fb3-4139-b23e-970ecee05e6c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:15.011220 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-61045342-2c60-4e98-ac5c-6fcbc432ef32 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:15.012537 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-61045342-2c60-4e98-ac5c-6fcbc432ef32 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:15.017127 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-61045342-2c60-4e98-ac5c-6fcbc432ef32 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:15.019007 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-61045342-2c60-4e98-ac5c-6fcbc432ef32 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:15.307269 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ee972248-4fb3-4139-b23e-970ecee05e6c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:15.322914 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ee972248-4fb3-4139-b23e-970ecee05e6c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13" status: 200 len: 1493 microversion: 2.1 time: 0.372766 Jul 25 14:43:15.353767 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1891/4038] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:14 2022] GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13 => generated 1493 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:15.595478 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-7ad73345-02a5-482d-9d68-3b6174eb6433 req-8f7418f1-a191-4c7e-9825-d98e1516866c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5866023-cfeb-43b0-9788-334b6ad4b850", "name": "network-vif-plugged", "status": "completed", "tag": "3ad83701-32d5-4489-b9ac-492dd82d885c"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:43:15.611797 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-7ad73345-02a5-482d-9d68-3b6174eb6433 req-8f7418f1-a191-4c7e-9825-d98e1516866c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:15.612465 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-7ad73345-02a5-482d-9d68-3b6174eb6433 req-8f7418f1-a191-4c7e-9825-d98e1516866c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:15.643387 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-7ad73345-02a5-482d-9d68-3b6174eb6433 req-8f7418f1-a191-4c7e-9825-d98e1516866c service nova] Creating event network-vif-plugged:3ad83701-32d5-4489-b9ac-492dd82d885c for instance e5866023-cfeb-43b0-9788-334b6ad4b850 on n-h2-846435-14 Jul 25 14:43:15.690093 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-7ad73345-02a5-482d-9d68-3b6174eb6433 req-8f7418f1-a191-4c7e-9825-d98e1516866c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086081 Jul 25 14:43:15.710056 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1892/4039] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:43:15.775533 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4104a08b-9106-4631-b51c-bfac6254cea3 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f4698797af0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:15.883089 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4104a08b-9106-4631-b51c-bfac6254cea3 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f" status: 200 len: 1455 microversion: 2.1 time: 0.113011 Jul 25 14:43:15.884005 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1893/4040] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:43:15 2022] GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f => generated 1455 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:43:15.990046 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-61045342-2c60-4e98-ac5c-6fcbc432ef32 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:15.999485 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-61045342-2c60-4e98-ac5c-6fcbc432ef32 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1363 microversion: 2.1 time: 1.031754 Jul 25 14:43:16.007416 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2148/4041] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:14 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1363 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:16.348170 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1ef659a0-dbb1-4d25-a194-b9255b8730a1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:16.348995 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1ef659a0-dbb1-4d25-a194-b9255b8730a1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: b2758384-4e23-4c78-8c2b-d38932d2cc13] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:16.369473 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ef659a0-dbb1-4d25-a194-b9255b8730a1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:16.371251 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ef659a0-dbb1-4d25-a194-b9255b8730a1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:16.372229 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ef659a0-dbb1-4d25-a194-b9255b8730a1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:16.373126 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ef659a0-dbb1-4d25-a194-b9255b8730a1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:16.902335 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1ca61e1d-3f0b-4ece-bf9f-c3efc22c831a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f4686151550>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:16.985578 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1ca61e1d-3f0b-4ece-bf9f-c3efc22c831a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f" status: 200 len: 1455 microversion: 2.1 time: 0.090626 Jul 25 14:43:16.989116 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2149/4042] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:43:16 2022] GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f => generated 1455 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:17.021289 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-53340386-9417-4e65-aafe-56f975357589 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:17.022819 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-53340386-9417-4e65-aafe-56f975357589 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:17.044282 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-53340386-9417-4e65-aafe-56f975357589 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:17.045948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-53340386-9417-4e65-aafe-56f975357589 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:17.049288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-53340386-9417-4e65-aafe-56f975357589 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:17.051494 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-53340386-9417-4e65-aafe-56f975357589 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:17.061248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1ef659a0-dbb1-4d25-a194-b9255b8730a1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:17.083105 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1ef659a0-dbb1-4d25-a194-b9255b8730a1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13" status: 200 len: 1493 microversion: 2.1 time: 0.739678 Jul 25 14:43:17.083921 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1894/4043] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:16 2022] GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13 => generated 1493 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:17.317817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-53340386-9417-4e65-aafe-56f975357589 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:17.330260 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-53340386-9417-4e65-aafe-56f975357589 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1363 microversion: 2.1 time: 0.312828 Jul 25 14:43:17.331077 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2150/4044] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:17 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1363 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:43:18.002820 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-575a8204-bc70-411a-a973-475dd3378ff4 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f4686738dc0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:18.110804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-92002fcd-fc6e-4eb9-a1d4-15c4f802822a tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:18.111424 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-92002fcd-fc6e-4eb9-a1d4-15c4f802822a tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: b2758384-4e23-4c78-8c2b-d38932d2cc13] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:18.123750 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-575a8204-bc70-411a-a973-475dd3378ff4 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f" status: 200 len: 1455 microversion: 2.1 time: 0.124725 Jul 25 14:43:18.136290 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1895/4045] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:43:17 2022] GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f => generated 1455 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:43:18.139540 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-92002fcd-fc6e-4eb9-a1d4-15c4f802822a tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:18.140006 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-92002fcd-fc6e-4eb9-a1d4-15c4f802822a tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:18.140805 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-92002fcd-fc6e-4eb9-a1d4-15c4f802822a tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:18.141236 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-92002fcd-fc6e-4eb9-a1d4-15c4f802822a tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:18.353422 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b13139f5-d0b4-4cf2-b36f-f0131587b89b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:18.354042 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b13139f5-d0b4-4cf2-b36f-f0131587b89b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:18.369391 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b13139f5-d0b4-4cf2-b36f-f0131587b89b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:18.370194 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b13139f5-d0b4-4cf2-b36f-f0131587b89b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:18.371136 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b13139f5-d0b4-4cf2-b36f-f0131587b89b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:18.371717 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b13139f5-d0b4-4cf2-b36f-f0131587b89b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:18.381225 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-92002fcd-fc6e-4eb9-a1d4-15c4f802822a tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:18.393603 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-92002fcd-fc6e-4eb9-a1d4-15c4f802822a tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13" status: 200 len: 1451 microversion: 2.1 time: 0.286524 Jul 25 14:43:18.409002 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2151/4046] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:18 2022] GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13 => generated 1451 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:18.879321 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-8d59f635-23e1-4be9-b626-5825c2b42771 req-8b58d7df-fc4e-4187-bac5-8cd09c004c7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2758384-4e23-4c78-8c2b-d38932d2cc13", "name": "network-vif-deleted", "tag": "8549fc18-204b-48a1-b760-138b17fa9d6e"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:43:18.907386 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-8d59f635-23e1-4be9-b626-5825c2b42771 req-8b58d7df-fc4e-4187-bac5-8cd09c004c7b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:18.914122 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-8d59f635-23e1-4be9-b626-5825c2b42771 req-8b58d7df-fc4e-4187-bac5-8cd09c004c7b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:18.933901 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-8d59f635-23e1-4be9-b626-5825c2b42771 req-8b58d7df-fc4e-4187-bac5-8cd09c004c7b service nova] Creating event network-vif-deleted:8549fc18-204b-48a1-b760-138b17fa9d6e for instance b2758384-4e23-4c78-8c2b-d38932d2cc13 on n-h1-846435-14 Jul 25 14:43:18.967298 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-8d59f635-23e1-4be9-b626-5825c2b42771 req-8b58d7df-fc4e-4187-bac5-8cd09c004c7b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095958 Jul 25 14:43:18.989694 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2152/4047] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:43:19.086010 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b13139f5-d0b4-4cf2-b36f-f0131587b89b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:19.109407 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b13139f5-d0b4-4cf2-b36f-f0131587b89b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1549 microversion: 2.1 time: 0.758497 Jul 25 14:43:19.112379 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1896/4048] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:18 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1549 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:43:19.141198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3e852fa7-f876-4862-b6b2-8d3c141509c6 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:19.144723 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3e852fa7-f876-4862-b6b2-8d3c141509c6 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:19.157487 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7495092a-c769-4f82-89a4-9b410e05586b tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f4698783e50>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:19.206341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e852fa7-f876-4862-b6b2-8d3c141509c6 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:19.208664 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e852fa7-f876-4862-b6b2-8d3c141509c6 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:19.210120 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e852fa7-f876-4862-b6b2-8d3c141509c6 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:19.216290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e852fa7-f876-4862-b6b2-8d3c141509c6 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:19.332686 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7495092a-c769-4f82-89a4-9b410e05586b tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f" status: 200 len: 1455 microversion: 2.1 time: 0.185205 Jul 25 14:43:19.334026 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1897/4049] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:43:19 2022] GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f => generated 1455 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:19.429964 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1278a210-bc10-4dcc-b2ea-0e100c9449eb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:19.430929 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1278a210-bc10-4dcc-b2ea-0e100c9449eb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: b2758384-4e23-4c78-8c2b-d38932d2cc13] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:19.454446 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1278a210-bc10-4dcc-b2ea-0e100c9449eb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:19.455175 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1278a210-bc10-4dcc-b2ea-0e100c9449eb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:19.456439 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1278a210-bc10-4dcc-b2ea-0e100c9449eb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:19.457551 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1278a210-bc10-4dcc-b2ea-0e100c9449eb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:19.495232 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3e852fa7-f876-4862-b6b2-8d3c141509c6 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.364362 Jul 25 14:43:19.495958 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2153/4050] 10.222.0.88 () {58 vars in 1275 bytes} [Mon Jul 25 14:43:19 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850/os-interface => generated 285 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:43:19.684378 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1278a210-bc10-4dcc-b2ea-0e100c9449eb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:19.685045 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1278a210-bc10-4dcc-b2ea-0e100c9449eb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:19.690041 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-1278a210-bc10-4dcc-b2ea-0e100c9449eb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lazy-loading 'fault' on Instance uuid b2758384-4e23-4c78-8c2b-d38932d2cc13 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:43:20.036179 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1278a210-bc10-4dcc-b2ea-0e100c9449eb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:20.043857 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1278a210-bc10-4dcc-b2ea-0e100c9449eb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13" status: 200 len: 1304 microversion: 2.1 time: 0.618774 Jul 25 14:43:20.050452 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1898/4051] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:19 2022] GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13 => generated 1304 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:20.349141 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-269193b8-08cc-4ea6-bdb5-282cbabec6f1 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46862db8b0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:20.451363 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-269193b8-08cc-4ea6-bdb5-282cbabec6f1 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f" status: 200 len: 1455 microversion: 2.1 time: 0.106900 Jul 25 14:43:20.452498 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2154/4052] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:43:20 2022] GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:21.081687 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d36b1c7f-2b4c-45a5-8c7a-b24d9e0e5b90 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:21.094187 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d36b1c7f-2b4c-45a5-8c7a-b24d9e0e5b90 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: b2758384-4e23-4c78-8c2b-d38932d2cc13] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:21.171382 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d36b1c7f-2b4c-45a5-8c7a-b24d9e0e5b90 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:21.173793 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d36b1c7f-2b4c-45a5-8c7a-b24d9e0e5b90 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:21.184616 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d36b1c7f-2b4c-45a5-8c7a-b24d9e0e5b90 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:21.188178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d36b1c7f-2b4c-45a5-8c7a-b24d9e0e5b90 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:21.290329 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-d36b1c7f-2b4c-45a5-8c7a-b24d9e0e5b90 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] HTTP exception thrown: Instance b2758384-4e23-4c78-8c2b-d38932d2cc13 could not be found. Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d36b1c7f-2b4c-45a5-8c7a-b24d9e0e5b90 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Request method failure captured: Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13 HTTP/1.1 Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3quERREaOs3Kc7iY1Vh9GKraPJ63kqwGO_-k7wXB_J3XVEfBf3LNTXeHb07R82UwUNgvRdojb21TsSuL636LebhCUID5TJuapIn-Sgeh4nT2_p48qkoLx6k1MrIDkEY7ueSXXEfRqNxtsyFtJzfjwKFOLGr5sudf0H8jELBV5u89FK0 Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b9b1c620d0b14a3a9471515cf47d6944", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b9b1c620d0b14a3a9471515cf47d6944"}]}] Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 33f992249063495c8bf12954afd9e8b7 Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance b2758384-4e23-4c78-8c2b-d38932d2cc13 could not be found. Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'b2758384-4e23-4c78-8c2b-d38932d2cc13'} Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2758384-4e23-4c78-8c2b-d38932d2cc13 could not be found. Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2758384-4e23-4c78-8c2b-d38932d2cc13 could not be found. Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:43:21.306326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:21.313740 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:21.313740 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:43:21.313740 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:43:21.313740 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:43:21.313740 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:43:21.313740 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2758384-4e23-4c78-8c2b-d38932d2cc13 could not be found. Jul 25 14:43:21.313740 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:21.316606 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d36b1c7f-2b4c-45a5-8c7a-b24d9e0e5b90 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Returning 404 to user: Instance b2758384-4e23-4c78-8c2b-d38932d2cc13 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:43:21.322033 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d36b1c7f-2b4c-45a5-8c7a-b24d9e0e5b90 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13" status: 404 len: 111 microversion: 2.1 time: 0.253950 Jul 25 14:43:21.333024 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1899/4053] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:21 2022] GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13 => generated 111 bytes in 266 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:43:21.467641 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0a9ff2a4-cba6-421c-87e2-042ae04427cd tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46861dd9d0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:21.596452 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0a9ff2a4-cba6-421c-87e2-042ae04427cd tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f" status: 200 len: 1455 microversion: 2.1 time: 0.133505 Jul 25 14:43:21.598715 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2155/4054] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:43:21 2022] GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f => generated 1455 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:21.711251 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e49b36ec-7db6-4e99-8446-f425ac99671b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-748765480", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "e81cd55f-4951-41ed-b82a-173584e324cb"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:43:22.004671 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-e49b36ec-7db6-4e99-8446-f425ac99671b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] validate_networks() for [('e81cd55f-4951-41ed-b82a-173584e324cb', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:43:22.614424 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-11535155-289c-435f-8cf0-093ea54b8811 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46862db8b0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:22.720969 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-11535155-289c-435f-8cf0-093ea54b8811 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f" status: 200 len: 1464 microversion: 2.1 time: 0.113500 Jul 25 14:43:22.730048 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2156/4055] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:43:22 2022] GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f => generated 1464 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:22.735448 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-21134d21-0177-44c8-b892-8618042c211a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46861dde50>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:22.838602 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-21134d21-0177-44c8-b892-8618042c211a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f" status: 200 len: 1464 microversion: 2.1 time: 0.107070 Jul 25 14:43:22.848248 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2157/4056] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:43:22 2022] GET /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f => generated 1464 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:43:22.856418 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-10d9f369-53a9-45d9-bdbf-1c4d9a973d90 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:22.857031 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-10d9f369-53a9-45d9-bdbf-1c4d9a973d90 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: dfb8c05d-0ccc-4b4d-a920-d8238e56f0de] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:22.880225 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-10d9f369-53a9-45d9-bdbf-1c4d9a973d90 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:22.880679 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-10d9f369-53a9-45d9-bdbf-1c4d9a973d90 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:22.881477 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-10d9f369-53a9-45d9-bdbf-1c4d9a973d90 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:22.882085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-10d9f369-53a9-45d9-bdbf-1c4d9a973d90 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:23.083736 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-e49b36ec-7db6-4e99-8446-f425ac99671b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:43:23.084331 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-e49b36ec-7db6-4e99-8446-f425ac99671b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:43:23.084929 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-e49b36ec-7db6-4e99-8446-f425ac99671b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:43:23.086324 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-e49b36ec-7db6-4e99-8446-f425ac99671b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:43:23.087074 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-e49b36ec-7db6-4e99-8446-f425ac99671b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:43:23.120982 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e49b36ec-7db6-4e99-8446-f425ac99671b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:23.124462 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e49b36ec-7db6-4e99-8446-f425ac99671b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:23.126091 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e49b36ec-7db6-4e99-8446-f425ac99671b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:23.129097 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e49b36ec-7db6-4e99-8446-f425ac99671b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:23.197886 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-e49b36ec-7db6-4e99-8446-f425ac99671b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Getting quotas for project b9b1c620d0b14a3a9471515cf47d6944. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:43:23.205217 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-e49b36ec-7db6-4e99-8446-f425ac99671b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Getting quotas for user 33f992249063495c8bf12954afd9e8b7 and project b9b1c620d0b14a3a9471515cf47d6944. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:43:23.225821 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e49b36ec-7db6-4e99-8446-f425ac99671b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:43:23.231563 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e49b36ec-7db6-4e99-8446-f425ac99671b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:43:23.333124 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e49b36ec-7db6-4e99-8446-f425ac99671b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.627436 Jul 25 14:43:23.336768 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1900/4057] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:43:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:43:23.354683 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c8b3415c-830e-4830-94d8-32bbf8904ef2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:23.357629 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-10d9f369-53a9-45d9-bdbf-1c4d9a973d90 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:23.362622 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c8b3415c-830e-4830-94d8-32bbf8904ef2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:23.388365 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:43:23.395369 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-10d9f369-53a9-45d9-bdbf-1c4d9a973d90 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de" status: 200 len: 1481 microversion: 2.1 time: 0.545720 Jul 25 14:43:23.396635 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2158/4058] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:22 2022] GET /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de => generated 1481 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:23.465268 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c8b3415c-830e-4830-94d8-32bbf8904ef2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:23.479216 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c8b3415c-830e-4830-94d8-32bbf8904ef2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1214 microversion: 2.1 time: 0.135190 Jul 25 14:43:23.480670 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1901/4059] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:23 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1214 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:43:23.508048 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-84fa4a03-ed89-47f7-a9ca-e75f4362cbeb req-a67aab46-3f7d-43a6-b93c-4a1398445040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5866023-cfeb-43b0-9788-334b6ad4b850", "tag": "3ad83701-32d5-4489-b9ac-492dd82d885c"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:43:23.536940 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-84fa4a03-ed89-47f7-a9ca-e75f4362cbeb req-a67aab46-3f7d-43a6-b93c-4a1398445040 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:23.537661 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-84fa4a03-ed89-47f7-a9ca-e75f4362cbeb req-a67aab46-3f7d-43a6-b93c-4a1398445040 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:23.560600 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-84fa4a03-ed89-47f7-a9ca-e75f4362cbeb req-a67aab46-3f7d-43a6-b93c-4a1398445040 service nova] Creating event network-changed:3ad83701-32d5-4489-b9ac-492dd82d885c for instance e5866023-cfeb-43b0-9788-334b6ad4b850 on n-h2-846435-14 Jul 25 14:43:23.568821 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-84fa4a03-ed89-47f7-a9ca-e75f4362cbeb req-a67aab46-3f7d-43a6-b93c-4a1398445040 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072329 Jul 25 14:43:23.570799 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2159/4060] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:43:24.421972 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-db1b8f74-95d5-4b40-bbe6-7e50eb977ddd tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:24.422613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-db1b8f74-95d5-4b40-bbe6-7e50eb977ddd tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: dfb8c05d-0ccc-4b4d-a920-d8238e56f0de] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:24.439383 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-db1b8f74-95d5-4b40-bbe6-7e50eb977ddd tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:24.439830 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-db1b8f74-95d5-4b40-bbe6-7e50eb977ddd tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:24.440739 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-db1b8f74-95d5-4b40-bbe6-7e50eb977ddd tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:24.441230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-db1b8f74-95d5-4b40-bbe6-7e50eb977ddd tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:24.505185 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4beb5e63-9fbe-455b-b35e-fca530311880 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:24.507521 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4beb5e63-9fbe-455b-b35e-fca530311880 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:24.522072 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4beb5e63-9fbe-455b-b35e-fca530311880 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:24.522756 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4beb5e63-9fbe-455b-b35e-fca530311880 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:24.524118 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4beb5e63-9fbe-455b-b35e-fca530311880 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:24.524725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4beb5e63-9fbe-455b-b35e-fca530311880 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:24.652529 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4beb5e63-9fbe-455b-b35e-fca530311880 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:24.678969 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4beb5e63-9fbe-455b-b35e-fca530311880 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1210 microversion: 2.1 time: 0.179532 Jul 25 14:43:24.697036 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2160/4061] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:24 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1210 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:24.859340 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-db1b8f74-95d5-4b40-bbe6-7e50eb977ddd tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:24.870565 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-db1b8f74-95d5-4b40-bbe6-7e50eb977ddd tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de" status: 200 len: 1468 microversion: 2.1 time: 0.455997 Jul 25 14:43:24.871166 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1902/4062] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:24 2022] GET /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de => generated 1468 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:24.892657 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e947b32e-b242-4f6c-9ffe-2db06f05d909 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46861571f0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:25.090016 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e947b32e-b242-4f6c-9ffe-2db06f05d909 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images?changes-since=2022-07-25T14%3A40%3A47Z" status: 200 len: 2803 microversion: 2.1 time: 0.200720 Jul 25 14:43:25.092462 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2161/4063] 10.222.0.88 () {58 vars in 1199 bytes} [Mon Jul 25 14:43:24 2022] GET /compute/v2.1/images?changes-since=2022-07-25T14%3A40%3A47Z => generated 2803 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:25.108057 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6bc6b355-c8a3-4923-a28d-9108bad4c9f4 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f468671fee0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:25.257426 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6bc6b355-c8a3-4923-a28d-9108bad4c9f4 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1164243735" status: 200 len: 485 microversion: 2.1 time: 0.154565 Jul 25 14:43:25.258609 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1903/4064] 10.222.0.88 () {58 vars in 1231 bytes} [Mon Jul 25 14:43:25 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1164243735 => generated 485 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:43:25.271792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-66aa388c-d664-4689-baca-34865d2ff368 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46861dd3a0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:25.487816 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-8216fa47-2a53-4a08-b0b6-c7524068e7c6 req-85a4a0cb-d6ef-4bde-a310-86cbf485b0d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfb8c05d-0ccc-4b4d-a920-d8238e56f0de", "name": "network-vif-unplugged", "status": "completed", "tag": "78158429-4b1a-4039-9efe-77450874ee04"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:43:25.497943 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-66aa388c-d664-4689-baca-34865d2ff368 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images?server=dfb8c05d-0ccc-4b4d-a920-d8238e56f0de" status: 200 len: 958 microversion: 2.1 time: 0.229707 Jul 25 14:43:25.508952 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2162/4065] 10.222.0.88 () {58 vars in 1209 bytes} [Mon Jul 25 14:43:25 2022] GET /compute/v2.1/images?server=dfb8c05d-0ccc-4b4d-a920-d8238e56f0de => generated 958 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:43:25.528322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6e2ca19c-e812-4720-aca3-ddc36696a943 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f4687fe71f0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:25.528744 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-8216fa47-2a53-4a08-b0b6-c7524068e7c6 req-85a4a0cb-d6ef-4bde-a310-86cbf485b0d5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:25.529993 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-8216fa47-2a53-4a08-b0b6-c7524068e7c6 req-85a4a0cb-d6ef-4bde-a310-86cbf485b0d5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:25.624663 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-8216fa47-2a53-4a08-b0b6-c7524068e7c6 req-85a4a0cb-d6ef-4bde-a310-86cbf485b0d5 service nova] Creating event network-vif-unplugged:78158429-4b1a-4039-9efe-77450874ee04 for instance dfb8c05d-0ccc-4b4d-a920-d8238e56f0de on n-h2-846435-14 Jul 25 14:43:25.631153 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-8216fa47-2a53-4a08-b0b6-c7524068e7c6 req-85a4a0cb-d6ef-4bde-a310-86cbf485b0d5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.148920 Jul 25 14:43:25.632306 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1904/4066] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:43:25.689122 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6e2ca19c-e812-4720-aca3-ddc36696a943 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.88%2Fcompute%2Fv2.1%2Fservers%2F794b7eaa-2e72-4ffc-aced-1dfb494e3554" status: 200 len: 485 microversion: 2.1 time: 0.178776 Jul 25 14:43:25.704051 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6a448c9b-358d-40d4-b7c6-1a5ea89c030f tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f468671f1f0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:25.707025 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2163/4067] 10.222.0.88 () {58 vars in 1317 bytes} [Mon Jul 25 14:43:25 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.88%2Fcompute%2Fv2.1%2Fservers%2F794b7eaa-2e72-4ffc-aced-1dfb494e3554 => generated 485 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:43:25.728555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-da3a503f-fe9e-4c9b-82f9-a0e6712fe143 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:25.729194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-da3a503f-fe9e-4c9b-82f9-a0e6712fe143 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:25.748550 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-da3a503f-fe9e-4c9b-82f9-a0e6712fe143 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:25.749013 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-da3a503f-fe9e-4c9b-82f9-a0e6712fe143 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:25.750722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-da3a503f-fe9e-4c9b-82f9-a0e6712fe143 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:25.751175 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-da3a503f-fe9e-4c9b-82f9-a0e6712fe143 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:25.811024 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6a448c9b-358d-40d4-b7c6-1a5ea89c030f tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.88%2Fcompute%2Fservers%2F794b7eaa-2e72-4ffc-aced-1dfb494e3554" status: 200 len: 485 microversion: 2.1 time: 0.111629 Jul 25 14:43:25.811625 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1905/4068] 10.222.0.88 () {58 vars in 1303 bytes} [Mon Jul 25 14:43:25 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.88%2Fcompute%2Fservers%2F794b7eaa-2e72-4ffc-aced-1dfb494e3554 => generated 485 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:43:25.842314 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4c885301-5bdc-4fa9-affa-0db216af8a7f tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46987e0160>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:26.024320 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-da3a503f-fe9e-4c9b-82f9-a0e6712fe143 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:26.035220 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-da3a503f-fe9e-4c9b-82f9-a0e6712fe143 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1210 microversion: 2.1 time: 0.325616 Jul 25 14:43:26.048485 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2164/4069] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:25 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1210 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:26.101677 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4c885301-5bdc-4fa9-affa-0db216af8a7f tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3709 microversion: 2.1 time: 0.276167 Jul 25 14:43:26.103115 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1906/4070] 10.222.0.88 () {58 vars in 1149 bytes} [Mon Jul 25 14:43:25 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3709 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:26.118270 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e3d936c7-44e4-4191-b373-c5a04a1348f8 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46861dddc0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:26.250449 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e3d936c7-44e4-4191-b373-c5a04a1348f8 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1431 microversion: 2.1 time: 0.136505 Jul 25 14:43:26.252479 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2165/4071] 10.222.0.88 () {58 vars in 1149 bytes} [Mon Jul 25 14:43:26 2022] GET /compute/v2.1/images?type=snapshot => generated 1431 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:26.266967 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-459a6543-15cc-4cdb-a0d9-67300ba026bd tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f4686725ee0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:26.354256 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-459a6543-15cc-4cdb-a0d9-67300ba026bd tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.091881 Jul 25 14:43:26.355135 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1907/4072] 10.222.0.88 () {58 vars in 1137 bytes} [Mon Jul 25 14:43:26 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:43:26.367721 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2e09ec0c-4e15-46b8-b264-d280d852a2d1 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46862e73a0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:26.551893 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2e09ec0c-4e15-46b8-b264-d280d852a2d1 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/detail?changes-since=2022-07-25T14%3A40%3A43Z" status: 200 len: 7024 microversion: 2.1 time: 0.187522 Jul 25 14:43:26.554285 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2166/4073] 10.222.0.88 () {58 vars in 1220 bytes} [Mon Jul 25 14:43:26 2022] GET /compute/v2.1/images/detail?changes-since=2022-07-25T14%3A40%3A43Z => generated 7024 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:26.578304 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d1dce325-3c5f-4f37-95cf-07a52e50b428 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46866deca0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:26.686734 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d1dce325-3c5f-4f37-95cf-07a52e50b428 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1164243735" status: 200 len: 665 microversion: 2.1 time: 0.114544 Jul 25 14:43:26.687916 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1908/4074] 10.222.0.88 () {58 vars in 1252 bytes} [Mon Jul 25 14:43:26 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1164243735 => generated 665 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:43:26.718604 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3b14802a-f812-4e72-a668-857b0007f6c2 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46861ef940>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:26.799326 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3b14802a-f812-4e72-a668-857b0007f6c2 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.88%2Fcompute%2Fv2.1%2Fservers%2F794b7eaa-2e72-4ffc-aced-1dfb494e3554" status: 200 len: 1467 microversion: 2.1 time: 0.097496 Jul 25 14:43:26.800580 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2167/4075] 10.222.0.88 () {58 vars in 1338 bytes} [Mon Jul 25 14:43:26 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.88%2Fcompute%2Fv2.1%2Fservers%2F794b7eaa-2e72-4ffc-aced-1dfb494e3554 => generated 1467 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:26.817821 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bd639460-37b4-4208-9332-425864152cf4 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46867350d0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:26.876292 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bd639460-37b4-4208-9332-425864152cf4 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.88%2Fcompute%2Fservers%2F794b7eaa-2e72-4ffc-aced-1dfb494e3554" status: 200 len: 1467 microversion: 2.1 time: 0.064184 Jul 25 14:43:26.877092 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1909/4076] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Jul 25 14:43:26 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.88%2Fcompute%2Fservers%2F794b7eaa-2e72-4ffc-aced-1dfb494e3554 => generated 1467 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:43:26.893201 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4c8d1dbd-93a3-41e0-9371-529630042b52 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f4686154a60>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:27.024012 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4c8d1dbd-93a3-41e0-9371-529630042b52 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7799 microversion: 2.1 time: 0.134792 Jul 25 14:43:27.024872 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2168/4077] 10.222.0.88 () {58 vars in 1170 bytes} [Mon Jul 25 14:43:26 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7799 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:27.057160 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0ff5b320-bff4-4813-b72b-18edf342daa6 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f468671f8b0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:27.060213 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-79a30aa3-a0b3-499d-85f7-24a10a0d6095 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:27.061099 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-79a30aa3-a0b3-499d-85f7-24a10a0d6095 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:27.072793 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-79a30aa3-a0b3-499d-85f7-24a10a0d6095 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:27.074049 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-79a30aa3-a0b3-499d-85f7-24a10a0d6095 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:27.076243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-79a30aa3-a0b3-499d-85f7-24a10a0d6095 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:27.076931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-79a30aa3-a0b3-499d-85f7-24a10a0d6095 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:27.162030 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0ff5b320-bff4-4813-b72b-18edf342daa6 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4377 microversion: 2.1 time: 0.108718 Jul 25 14:43:27.162655 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1910/4078] 10.222.0.88 () {58 vars in 1170 bytes} [Mon Jul 25 14:43:27 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4377 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:27.183305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-79a30aa3-a0b3-499d-85f7-24a10a0d6095 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:27.190074 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-96652f83-184d-46e6-964f-9a195e2769db tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f468672b550>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:27.194849 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-79a30aa3-a0b3-499d-85f7-24a10a0d6095 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1272 microversion: 2.1 time: 0.138506 Jul 25 14:43:27.196107 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2169/4079] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:27 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1272 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:43:27.258145 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-96652f83-184d-46e6-964f-9a195e2769db tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/a7b14aba-1848-4a00-a3e7-b66eb3e97925" status: 200 len: 784 microversion: 2.1 time: 0.082863 Jul 25 14:43:27.259599 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1911/4080] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:43:27 2022] GET /compute/v2.1/images/a7b14aba-1848-4a00-a3e7-b66eb3e97925 => generated 784 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:43:27.286524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-34bc6add-a560-4747-9e62-3c736b73bf53 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46862e19d0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:27.390576 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-34bc6add-a560-4747-9e62-3c736b73bf53 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.115947 Jul 25 14:43:27.402153 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2170/4081] 10.222.0.88 () {58 vars in 1158 bytes} [Mon Jul 25 14:43:27 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:27.410485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c0991f8a-087d-4bf9-92e8-92de5d63fd8b tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f468671f430>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:28.223137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1e416c5f-c08d-48c6-bac1-b2eb1c58e457 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:28.225085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1e416c5f-c08d-48c6-bac1-b2eb1c58e457 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:28.240860 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1e416c5f-c08d-48c6-bac1-b2eb1c58e457 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:28.241548 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1e416c5f-c08d-48c6-bac1-b2eb1c58e457 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:28.244353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1e416c5f-c08d-48c6-bac1-b2eb1c58e457 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:28.244988 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1e416c5f-c08d-48c6-bac1-b2eb1c58e457 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:28.656217 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c0991f8a-087d-4bf9-92e8-92de5d63fd8b tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "DELETE /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f" status: 204 len: 0 microversion: 2.1 time: 1.249790 Jul 25 14:43:28.656918 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1912/4082] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:27 2022] DELETE /compute/v2.1/images/47bd3f81-ce21-42e9-8b0c-5b9502161f9f => generated 0 bytes in 1252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:43:28.665418 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-79e950dd-a2ac-4d6f-88d2-31504dd9e6aa tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f468672bdc0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:28.751404 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1e416c5f-c08d-48c6-bac1-b2eb1c58e457 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:28.762082 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1e416c5f-c08d-48c6-bac1-b2eb1c58e457 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1314 microversion: 2.1 time: 0.546131 Jul 25 14:43:28.767556 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2171/4083] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:28 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1314 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:43:29.778309 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-79e950dd-a2ac-4d6f-88d2-31504dd9e6aa tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "DELETE /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf" status: 204 len: 0 microversion: 2.1 time: 1.117098 Jul 25 14:43:29.779887 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1913/4084] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:28 2022] DELETE /compute/v2.1/images/6ec8ffc8-687f-4e32-bc00-ee532e976daf => generated 0 bytes in 1119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 14:43:29.783903 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f6ddecb5-2870-47ba-bbb1-8b216bcf3767 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:29.785608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f6ddecb5-2870-47ba-bbb1-8b216bcf3767 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:29.794799 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8a7f4a3a-f757-4fda-94bc-4de6962e6c73 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f4686730040>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:29.812769 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6ddecb5-2870-47ba-bbb1-8b216bcf3767 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:29.813256 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6ddecb5-2870-47ba-bbb1-8b216bcf3767 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:29.816030 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6ddecb5-2870-47ba-bbb1-8b216bcf3767 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:29.816481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6ddecb5-2870-47ba-bbb1-8b216bcf3767 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:30.407653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f6ddecb5-2870-47ba-bbb1-8b216bcf3767 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:30.423790 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f6ddecb5-2870-47ba-bbb1-8b216bcf3767 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1314 microversion: 2.1 time: 0.644634 Jul 25 14:43:30.425025 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2172/4085] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:29 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1314 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:43:30.429662 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-be0e7327-7ce0-4203-9215-bd7c85e4a4a4 req-3c8085ae-584f-4cac-9e57-c06215ee9d16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a8c9a71-6a5f-4464-a9a6-0a4516f099fa", "tag": "4fc0bbca-5331-40df-a5fb-7d979aaef340"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:43:30.439730 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-be0e7327-7ce0-4203-9215-bd7c85e4a4a4 req-3c8085ae-584f-4cac-9e57-c06215ee9d16 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:30.440457 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-be0e7327-7ce0-4203-9215-bd7c85e4a4a4 req-3c8085ae-584f-4cac-9e57-c06215ee9d16 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:30.464122 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-be0e7327-7ce0-4203-9215-bd7c85e4a4a4 req-3c8085ae-584f-4cac-9e57-c06215ee9d16 service nova] Creating event network-changed:4fc0bbca-5331-40df-a5fb-7d979aaef340 for instance 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa on n-h1-846435-14 Jul 25 14:43:30.471139 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-be0e7327-7ce0-4203-9215-bd7c85e4a4a4 req-3c8085ae-584f-4cac-9e57-c06215ee9d16 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044086 Jul 25 14:43:30.472083 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2173/4086] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:43:30.639034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7ab7c17d-219d-4b43-bf92-6f99dc7749d0 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:30.641941 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7ab7c17d-219d-4b43-bf92-6f99dc7749d0 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:30.656800 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7ab7c17d-219d-4b43-bf92-6f99dc7749d0 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:30.659582 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7ab7c17d-219d-4b43-bf92-6f99dc7749d0 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:30.664538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7ab7c17d-219d-4b43-bf92-6f99dc7749d0 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:30.672773 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7ab7c17d-219d-4b43-bf92-6f99dc7749d0 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:30.716670 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7ab7c17d-219d-4b43-bf92-6f99dc7749d0 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085886 Jul 25 14:43:30.717247 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2174/4087] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:43:30 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:43:30.729811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-513b692d-d16a-467d-9c6e-f6b6488c0328 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:30.730303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-513b692d-d16a-467d-9c6e-f6b6488c0328 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:30.736497 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-513b692d-d16a-467d-9c6e-f6b6488c0328 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:30.737189 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-513b692d-d16a-467d-9c6e-f6b6488c0328 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:30.738362 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-513b692d-d16a-467d-9c6e-f6b6488c0328 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:30.738926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-513b692d-d16a-467d-9c6e-f6b6488c0328 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:30.926117 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-513b692d-d16a-467d-9c6e-f6b6488c0328 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lazy-loading 'services' on Instance uuid 0e128c68-5e95-4535-ab8f-451b2d7ec5da {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:43:31.057901 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-513b692d-d16a-467d-9c6e-f6b6488c0328 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "DELETE /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da/os-volume_attachments/7dbc8256-742e-4524-87b3-2fa7e80a0529" status: 202 len: 0 microversion: 2.1 time: 0.333744 Jul 25 14:43:31.058703 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2175/4088] 10.222.0.88 () {58 vars in 1416 bytes} [Mon Jul 25 14:43:30 2022] DELETE /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da/os-volume_attachments/7dbc8256-742e-4524-87b3-2fa7e80a0529 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 14:43:31.454277 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5d5eea76-1601-4900-9825-51aa823f9136 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:31.455000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5d5eea76-1601-4900-9825-51aa823f9136 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:31.466590 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d5eea76-1601-4900-9825-51aa823f9136 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:31.469401 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d5eea76-1601-4900-9825-51aa823f9136 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:31.470204 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d5eea76-1601-4900-9825-51aa823f9136 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:31.470628 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d5eea76-1601-4900-9825-51aa823f9136 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:31.534706 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8a7f4a3a-f757-4fda-94bc-4de6962e6c73 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "DELETE /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc" status: 204 len: 0 microversion: 2.1 time: 1.749245 Jul 25 14:43:31.535397 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1914/4089] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:29 2022] DELETE /compute/v2.1/images/6dd4367d-a3c3-4b1c-b6a2-1fe077ffe3bc => generated 0 bytes in 1751 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:43:31.545362 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1fa2456d-af99-4377-91f6-96132fbd0e65 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:31.550343 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1fa2456d-af99-4377-91f6-96132fbd0e65 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: 794b7eaa-2e72-4ffc-aced-1dfb494e3554] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:31.558342 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:43:31.564762 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1fa2456d-af99-4377-91f6-96132fbd0e65 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:31.571178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1fa2456d-af99-4377-91f6-96132fbd0e65 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:31.572393 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1fa2456d-af99-4377-91f6-96132fbd0e65 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:31.573050 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1fa2456d-af99-4377-91f6-96132fbd0e65 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:31.643668 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1fa2456d-af99-4377-91f6-96132fbd0e65 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: 794b7eaa-2e72-4ffc-aced-1dfb494e3554] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:43:31.778569 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1fa2456d-af99-4377-91f6-96132fbd0e65 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "DELETE /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554" status: 204 len: 0 microversion: 2.1 time: 0.236963 Jul 25 14:43:31.779177 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1915/4090] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:43:31 2022] DELETE /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:43:31.796736 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9c8cb017-bed4-42f6-8044-69ef9bde6ad8 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:31.797515 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9c8cb017-bed4-42f6-8044-69ef9bde6ad8 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: 794b7eaa-2e72-4ffc-aced-1dfb494e3554] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:31.806949 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9c8cb017-bed4-42f6-8044-69ef9bde6ad8 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:31.811276 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9c8cb017-bed4-42f6-8044-69ef9bde6ad8 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:31.812195 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9c8cb017-bed4-42f6-8044-69ef9bde6ad8 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:31.827828 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9c8cb017-bed4-42f6-8044-69ef9bde6ad8 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:31.832004 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5d5eea76-1601-4900-9825-51aa823f9136 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:31.844999 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5d5eea76-1601-4900-9825-51aa823f9136 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1314 microversion: 2.1 time: 0.400109 Jul 25 14:43:31.853099 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2176/4091] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:31 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:31.870400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:43:32.089784 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9c8cb017-bed4-42f6-8044-69ef9bde6ad8 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:32.105677 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9c8cb017-bed4-42f6-8044-69ef9bde6ad8 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554" status: 200 len: 1473 microversion: 2.1 time: 0.315399 Jul 25 14:43:32.107141 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1916/4092] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:31 2022] GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554 => generated 1473 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:32.877074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5bd41bbe-38e4-4c65-984f-7d2d4de7ffe3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:32.878700 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5bd41bbe-38e4-4c65-984f-7d2d4de7ffe3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:32.907074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5bd41bbe-38e4-4c65-984f-7d2d4de7ffe3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:32.908183 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5bd41bbe-38e4-4c65-984f-7d2d4de7ffe3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:32.911803 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5bd41bbe-38e4-4c65-984f-7d2d4de7ffe3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:32.912462 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5bd41bbe-38e4-4c65-984f-7d2d4de7ffe3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:33.129307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cee390e4-f481-4337-993f-0a56202a0780 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:33.130469 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cee390e4-f481-4337-993f-0a56202a0780 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: 794b7eaa-2e72-4ffc-aced-1dfb494e3554] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:33.148481 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cee390e4-f481-4337-993f-0a56202a0780 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:33.160392 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cee390e4-f481-4337-993f-0a56202a0780 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:33.162466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cee390e4-f481-4337-993f-0a56202a0780 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:33.167536 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cee390e4-f481-4337-993f-0a56202a0780 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:33.171480 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:43:33.478496 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=8 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:43:33.542283 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5bd41bbe-38e4-4c65-984f-7d2d4de7ffe3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:33.555368 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5bd41bbe-38e4-4c65-984f-7d2d4de7ffe3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1314 microversion: 2.1 time: 0.682360 Jul 25 14:43:33.556043 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2177/4093] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:32 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1314 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:34.172941 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cee390e4-f481-4337-993f-0a56202a0780 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:34.184481 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cee390e4-f481-4337-993f-0a56202a0780 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554" status: 200 len: 1473 microversion: 2.1 time: 1.061062 Jul 25 14:43:34.196497 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1917/4094] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:33 2022] GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554 => generated 1473 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:34.579544 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-164a1f53-8db0-4c7b-b0ce-9a84ec751fa8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:34.580766 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-164a1f53-8db0-4c7b-b0ce-9a84ec751fa8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:34.603765 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-164a1f53-8db0-4c7b-b0ce-9a84ec751fa8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:34.604260 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-164a1f53-8db0-4c7b-b0ce-9a84ec751fa8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:34.611653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-164a1f53-8db0-4c7b-b0ce-9a84ec751fa8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:34.612135 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-164a1f53-8db0-4c7b-b0ce-9a84ec751fa8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:34.873968 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-164a1f53-8db0-4c7b-b0ce-9a84ec751fa8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:34.881688 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-164a1f53-8db0-4c7b-b0ce-9a84ec751fa8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1314 microversion: 2.1 time: 0.307485 Jul 25 14:43:34.895517 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2178/4095] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:34 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:35.216993 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c13898d9-861c-4669-b38b-1e1c976dd556 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:35.218056 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c13898d9-861c-4669-b38b-1e1c976dd556 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: 794b7eaa-2e72-4ffc-aced-1dfb494e3554] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:35.223665 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-61780aee-ff55-45e1-bfae-6048ca300d11 req-940e706a-f3fa-4e82-a101-9d253dc57a12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a8c9a71-6a5f-4464-a9a6-0a4516f099fa", "name": "network-vif-plugged", "status": "completed", "tag": "4fc0bbca-5331-40df-a5fb-7d979aaef340"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:43:35.243593 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c13898d9-861c-4669-b38b-1e1c976dd556 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:35.248137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c13898d9-861c-4669-b38b-1e1c976dd556 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:35.249185 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c13898d9-861c-4669-b38b-1e1c976dd556 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:35.252315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c13898d9-861c-4669-b38b-1e1c976dd556 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:35.257325 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-61780aee-ff55-45e1-bfae-6048ca300d11 req-940e706a-f3fa-4e82-a101-9d253dc57a12 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:35.262316 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-61780aee-ff55-45e1-bfae-6048ca300d11 req-940e706a-f3fa-4e82-a101-9d253dc57a12 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:35.319560 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-61780aee-ff55-45e1-bfae-6048ca300d11 req-940e706a-f3fa-4e82-a101-9d253dc57a12 service nova] Creating event network-vif-plugged:4fc0bbca-5331-40df-a5fb-7d979aaef340 for instance 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa on n-h1-846435-14 Jul 25 14:43:35.342226 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-61780aee-ff55-45e1-bfae-6048ca300d11 req-940e706a-f3fa-4e82-a101-9d253dc57a12 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134029 Jul 25 14:43:35.358218 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1918/4096] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:43:35.805577 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c13898d9-861c-4669-b38b-1e1c976dd556 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:35.818327 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c13898d9-861c-4669-b38b-1e1c976dd556 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554" status: 200 len: 1473 microversion: 2.1 time: 0.610278 Jul 25 14:43:35.819731 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2179/4097] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:35 2022] GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554 => generated 1473 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:35.904443 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-93fdab06-4f0f-45ac-b7d3-f2d68cf91567 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:35.905758 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-93fdab06-4f0f-45ac-b7d3-f2d68cf91567 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:35.928722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93fdab06-4f0f-45ac-b7d3-f2d68cf91567 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:35.929488 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93fdab06-4f0f-45ac-b7d3-f2d68cf91567 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:35.930518 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93fdab06-4f0f-45ac-b7d3-f2d68cf91567 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:35.930991 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93fdab06-4f0f-45ac-b7d3-f2d68cf91567 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:36.541052 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-ed0c74dd-cd41-455a-b2f6-c045c4e0395e req-63a8bc35-660e-4bd8-a59b-5807c9fe9ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "794b7eaa-2e72-4ffc-aced-1dfb494e3554", "name": "network-vif-deleted", "tag": "ee5f6577-aca1-4c54-8d5b-962c392fa674"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:43:36.567109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ed0c74dd-cd41-455a-b2f6-c045c4e0395e req-63a8bc35-660e-4bd8-a59b-5807c9fe9ee0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:36.567560 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ed0c74dd-cd41-455a-b2f6-c045c4e0395e req-63a8bc35-660e-4bd8-a59b-5807c9fe9ee0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:36.598483 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-ed0c74dd-cd41-455a-b2f6-c045c4e0395e req-63a8bc35-660e-4bd8-a59b-5807c9fe9ee0 service nova] Creating event network-vif-deleted:ee5f6577-aca1-4c54-8d5b-962c392fa674 for instance 794b7eaa-2e72-4ffc-aced-1dfb494e3554 on n-h1-846435-14 Jul 25 14:43:36.609467 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-93fdab06-4f0f-45ac-b7d3-f2d68cf91567 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:36.613144 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-ed0c74dd-cd41-455a-b2f6-c045c4e0395e req-63a8bc35-660e-4bd8-a59b-5807c9fe9ee0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076206 Jul 25 14:43:36.614370 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2180/4098] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:43:36.628300 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-93fdab06-4f0f-45ac-b7d3-f2d68cf91567 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1314 microversion: 2.1 time: 0.729002 Jul 25 14:43:36.628907 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1919/4099] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:35 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1314 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:36.843891 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8e890125-d223-4c23-a4f2-59b5332eb058 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:36.844747 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8e890125-d223-4c23-a4f2-59b5332eb058 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: 794b7eaa-2e72-4ffc-aced-1dfb494e3554] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:36.867747 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e890125-d223-4c23-a4f2-59b5332eb058 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:36.872399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e890125-d223-4c23-a4f2-59b5332eb058 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:36.873462 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e890125-d223-4c23-a4f2-59b5332eb058 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:36.874002 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e890125-d223-4c23-a4f2-59b5332eb058 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:36.992595 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e890125-d223-4c23-a4f2-59b5332eb058 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:36.993308 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e890125-d223-4c23-a4f2-59b5332eb058 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:36.994007 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-8e890125-d223-4c23-a4f2-59b5332eb058 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lazy-loading 'fault' on Instance uuid 794b7eaa-2e72-4ffc-aced-1dfb494e3554 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:43:37.105051 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8e890125-d223-4c23-a4f2-59b5332eb058 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:37.119157 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8e890125-d223-4c23-a4f2-59b5332eb058 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554" status: 200 len: 1307 microversion: 2.1 time: 0.280218 Jul 25 14:43:37.120809 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2181/4100] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:36 2022] GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554 => generated 1307 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:37.658225 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-84369be3-cd12-4cba-b62a-7ec26e3e6678 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:37.660529 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-84369be3-cd12-4cba-b62a-7ec26e3e6678 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:37.671905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-84369be3-cd12-4cba-b62a-7ec26e3e6678 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:37.673886 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-84369be3-cd12-4cba-b62a-7ec26e3e6678 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:37.676572 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-84369be3-cd12-4cba-b62a-7ec26e3e6678 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:37.679576 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-84369be3-cd12-4cba-b62a-7ec26e3e6678 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:38.027942 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-84369be3-cd12-4cba-b62a-7ec26e3e6678 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:38.048576 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-84369be3-cd12-4cba-b62a-7ec26e3e6678 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1502 microversion: 2.1 time: 0.398022 Jul 25 14:43:38.051784 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1920/4101] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:37 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1502 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:38.082204 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b0114c03-29d0-467a-866a-69f38788e3e2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:43:38.089537 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b0114c03-29d0-467a-866a-69f38788e3e2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:38.104508 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0114c03-29d0-467a-866a-69f38788e3e2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:38.106709 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0114c03-29d0-467a-866a-69f38788e3e2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:38.111028 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0114c03-29d0-467a-866a-69f38788e3e2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:38.113504 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0114c03-29d0-467a-866a-69f38788e3e2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:38.144060 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c6a3d734-65bd-4947-ba04-dbdc751e9ba9 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:38.145339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c6a3d734-65bd-4947-ba04-dbdc751e9ba9 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: 794b7eaa-2e72-4ffc-aced-1dfb494e3554] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:38.155411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c6a3d734-65bd-4947-ba04-dbdc751e9ba9 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:38.156165 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c6a3d734-65bd-4947-ba04-dbdc751e9ba9 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:38.158743 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c6a3d734-65bd-4947-ba04-dbdc751e9ba9 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:38.159479 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c6a3d734-65bd-4947-ba04-dbdc751e9ba9 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:38.169555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-b0114c03-29d0-467a-866a-69f38788e3e2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lazy-loading 'flavor' on Instance uuid 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:43:38.203309 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-c6a3d734-65bd-4947-ba04-dbdc751e9ba9 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] HTTP exception thrown: Instance 794b7eaa-2e72-4ffc-aced-1dfb494e3554 could not be found. Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c6a3d734-65bd-4947-ba04-dbdc751e9ba9 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Request method failure captured: Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554 HTTP/1.1 Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qtqTrtLRr0mhXH61lvjvrXcIbRKb2WaMlFthKLheakofuTfnRxic5fI35BLVprPCUdjSUEgZKEsNCj0C9dPv1E8Ulhs9Pkl-1dQKfM6Jlwqx06ctqnh2lf8ACsp-QPmTaoIyGtqPT9nrflo9UcgTSWCFU77Qbj7pU_tld9tCy7UCUc Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: b260148f473e420bad9c21f295722f44 Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ListImageFiltersTestJSON-1246186757 Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b260148f473e420bad9c21f295722f44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b260148f473e420bad9c21f295722f44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b260148f473e420bad9c21f295722f44", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b260148f473e420bad9c21f295722f44"}]}] Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ListImageFiltersTestJSON-1246186757 Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: b260148f473e420bad9c21f295722f44 Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1246186757 Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ListImageFiltersTestJSON-1246186757-project Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: f005d58a261b440893daa752858b1ab1 Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ListImageFiltersTestJSON-1246186757-project Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 794b7eaa-2e72-4ffc-aced-1dfb494e3554 could not be found. Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '794b7eaa-2e72-4ffc-aced-1dfb494e3554'} Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 794b7eaa-2e72-4ffc-aced-1dfb494e3554 could not be found. Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 794b7eaa-2e72-4ffc-aced-1dfb494e3554 could not be found. Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:43:38.207307 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:38.210800 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:38.210800 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:43:38.210800 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:43:38.210800 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:43:38.210800 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:43:38.210800 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 794b7eaa-2e72-4ffc-aced-1dfb494e3554 could not be found. Jul 25 14:43:38.210800 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:38.212974 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c6a3d734-65bd-4947-ba04-dbdc751e9ba9 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Returning 404 to user: Instance 794b7eaa-2e72-4ffc-aced-1dfb494e3554 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:43:38.214577 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c6a3d734-65bd-4947-ba04-dbdc751e9ba9 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554" status: 404 len: 111 microversion: 2.1 time: 0.077723 Jul 25 14:43:38.220498 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1921/4102] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:38 2022] GET /compute/v2.1/servers/794b7eaa-2e72-4ffc-aced-1dfb494e3554 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:43:38.229797 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d71aa613-7c94-4c72-a06f-ca7a07e61cf2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:38.233485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d71aa613-7c94-4c72-a06f-ca7a07e61cf2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:38.242616 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d71aa613-7c94-4c72-a06f-ca7a07e61cf2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:38.243292 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d71aa613-7c94-4c72-a06f-ca7a07e61cf2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:38.244243 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d71aa613-7c94-4c72-a06f-ca7a07e61cf2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:38.244995 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d71aa613-7c94-4c72-a06f-ca7a07e61cf2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:38.267952 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:43:38.302968 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d71aa613-7c94-4c72-a06f-ca7a07e61cf2 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.079033 Jul 25 14:43:38.310073 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1922/4103] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Jul 25 14:43:38 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:38.317838 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e9b07b30-a836-4dcc-bdc4-987af399561e tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:38.320153 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e9b07b30-a836-4dcc-bdc4-987af399561e tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: dfb8c05d-0ccc-4b4d-a920-d8238e56f0de] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:38.327960 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e9b07b30-a836-4dcc-bdc4-987af399561e tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:38.328663 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e9b07b30-a836-4dcc-bdc4-987af399561e tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:38.329777 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e9b07b30-a836-4dcc-bdc4-987af399561e tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:38.330416 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e9b07b30-a836-4dcc-bdc4-987af399561e tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:38.399926 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e9b07b30-a836-4dcc-bdc4-987af399561e tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: dfb8c05d-0ccc-4b4d-a920-d8238e56f0de] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:43:38.522668 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b0114c03-29d0-467a-866a-69f38788e3e2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "POST /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa/action" status: 202 len: 0 microversion: 2.1 time: 0.453738 Jul 25 14:43:38.526521 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2182/4104] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:43:38 2022] POST /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:43:38.535599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-756f3197-47cc-495c-98dc-91c046d49f24 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:38.536233 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-756f3197-47cc-495c-98dc-91c046d49f24 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:38.541989 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e9b07b30-a836-4dcc-bdc4-987af399561e tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "DELETE /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de" status: 204 len: 0 microversion: 2.1 time: 0.235641 Jul 25 14:43:38.543493 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1923/4105] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:43:38 2022] DELETE /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:43:38.545838 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-756f3197-47cc-495c-98dc-91c046d49f24 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:38.548573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-756f3197-47cc-495c-98dc-91c046d49f24 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:38.553626 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-96206aa3-ceb9-4340-9b4a-7aaa46b8f3c2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:38.554626 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-96206aa3-ceb9-4340-9b4a-7aaa46b8f3c2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:38.560410 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-756f3197-47cc-495c-98dc-91c046d49f24 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:38.561144 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-756f3197-47cc-495c-98dc-91c046d49f24 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:38.565850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-96206aa3-ceb9-4340-9b4a-7aaa46b8f3c2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:38.566425 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-96206aa3-ceb9-4340-9b4a-7aaa46b8f3c2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:38.568126 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-96206aa3-ceb9-4340-9b4a-7aaa46b8f3c2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:38.568973 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-96206aa3-ceb9-4340-9b4a-7aaa46b8f3c2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:38.604961 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-756f3197-47cc-495c-98dc-91c046d49f24 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:43:38.749075 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-756f3197-47cc-495c-98dc-91c046d49f24 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "DELETE /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 204 len: 0 microversion: 2.20 time: 0.223026 Jul 25 14:43:38.749739 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2183/4106] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Jul 25 14:43:38 2022] DELETE /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 14:43:38.766830 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f07fa7b4-1e16-43cd-bdea-2aac67e5c414 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:38.767782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f07fa7b4-1e16-43cd-bdea-2aac67e5c414 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: dfb8c05d-0ccc-4b4d-a920-d8238e56f0de] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:38.784172 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f07fa7b4-1e16-43cd-bdea-2aac67e5c414 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:38.785090 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f07fa7b4-1e16-43cd-bdea-2aac67e5c414 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:38.786469 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f07fa7b4-1e16-43cd-bdea-2aac67e5c414 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:38.791013 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f07fa7b4-1e16-43cd-bdea-2aac67e5c414 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:38.855116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-96206aa3-ceb9-4340-9b4a-7aaa46b8f3c2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:38.864824 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-96206aa3-ceb9-4340-9b4a-7aaa46b8f3c2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1508 microversion: 2.1 time: 0.319860 Jul 25 14:43:38.865889 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1924/4107] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:38 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1508 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:38.877242 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3d9e51e5-616d-4717-b9ab-66ba28462a6c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:38.882259 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3d9e51e5-616d-4717-b9ab-66ba28462a6c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:38.890527 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3d9e51e5-616d-4717-b9ab-66ba28462a6c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:38.892404 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3d9e51e5-616d-4717-b9ab-66ba28462a6c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:38.893430 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3d9e51e5-616d-4717-b9ab-66ba28462a6c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:38.894029 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3d9e51e5-616d-4717-b9ab-66ba28462a6c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:39.074794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3d9e51e5-616d-4717-b9ab-66ba28462a6c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:39.083798 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3d9e51e5-616d-4717-b9ab-66ba28462a6c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:39.085951 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3d9e51e5-616d-4717-b9ab-66ba28462a6c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:39.088148 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3d9e51e5-616d-4717-b9ab-66ba28462a6c tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1726 microversion: 2.20 time: 0.214736 Jul 25 14:43:39.089149 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1925/4108] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:43:38 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1726 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:43:39.154096 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-011f217b-de2a-4377-bff0-1b55feb69db3 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:39.156617 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-011f217b-de2a-4377-bff0-1b55feb69db3 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:39.163195 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-011f217b-de2a-4377-bff0-1b55feb69db3 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:39.163908 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-011f217b-de2a-4377-bff0-1b55feb69db3 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:39.165381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-011f217b-de2a-4377-bff0-1b55feb69db3 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:39.166051 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-011f217b-de2a-4377-bff0-1b55feb69db3 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:39.188321 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f07fa7b4-1e16-43cd-bdea-2aac67e5c414 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:39.199124 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f07fa7b4-1e16-43cd-bdea-2aac67e5c414 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de" status: 200 len: 1474 microversion: 2.1 time: 0.441674 Jul 25 14:43:39.201651 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2184/4109] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:38 2022] GET /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de => generated 1474 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:39.212304 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-011f217b-de2a-4377-bff0-1b55feb69db3 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059762 Jul 25 14:43:39.212304 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1926/4110] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:43:39 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:43:39.888639 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1da677b7-7aa9-47f1-aacd-8b8a5842847f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:39.889497 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1da677b7-7aa9-47f1-aacd-8b8a5842847f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:39.900660 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1da677b7-7aa9-47f1-aacd-8b8a5842847f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:39.901327 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1da677b7-7aa9-47f1-aacd-8b8a5842847f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:39.902261 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1da677b7-7aa9-47f1-aacd-8b8a5842847f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:39.902986 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1da677b7-7aa9-47f1-aacd-8b8a5842847f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:40.114563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-467bed70-83fe-4245-ac30-ba1c96884401 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:40.115472 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-467bed70-83fe-4245-ac30-ba1c96884401 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:40.125664 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-467bed70-83fe-4245-ac30-ba1c96884401 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:40.134295 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-467bed70-83fe-4245-ac30-ba1c96884401 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:40.135323 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-467bed70-83fe-4245-ac30-ba1c96884401 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:40.135904 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-467bed70-83fe-4245-ac30-ba1c96884401 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:40.383670 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1da677b7-7aa9-47f1-aacd-8b8a5842847f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:40.400422 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1da677b7-7aa9-47f1-aacd-8b8a5842847f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1508 microversion: 2.1 time: 0.518552 Jul 25 14:43:40.415461 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1927/4111] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:39 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1508 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:40.425954 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-588c806e-561c-4f93-ba44-5777c96cf885 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:40.430680 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-588c806e-561c-4f93-ba44-5777c96cf885 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:40.446367 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-588c806e-561c-4f93-ba44-5777c96cf885 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:40.448994 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-588c806e-561c-4f93-ba44-5777c96cf885 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:40.451926 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-588c806e-561c-4f93-ba44-5777c96cf885 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:40.453719 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-588c806e-561c-4f93-ba44-5777c96cf885 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:40.519183 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-467bed70-83fe-4245-ac30-ba1c96884401 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:40.531048 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-588c806e-561c-4f93-ba44-5777c96cf885 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.113561 Jul 25 14:43:40.532038 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1928/4112] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:43:40 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da/os-volume_attachments => generated 25 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:43:40.533987 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-467bed70-83fe-4245-ac30-ba1c96884401 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:40.536817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-467bed70-83fe-4245-ac30-ba1c96884401 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:40.537645 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ac260445-8bf1-4481-b2b5-ca9b0c825b98 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:40.545117 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-467bed70-83fe-4245-ac30-ba1c96884401 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1726 microversion: 2.20 time: 0.433104 Jul 25 14:43:40.545775 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2185/4113] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:43:40 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1726 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:43:40.571051 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ac260445-8bf1-4481-b2b5-ca9b0c825b98 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: dfb8c05d-0ccc-4b4d-a920-d8238e56f0de] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:40.592456 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ac260445-8bf1-4481-b2b5-ca9b0c825b98 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:40.594822 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ac260445-8bf1-4481-b2b5-ca9b0c825b98 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:40.598418 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ac260445-8bf1-4481-b2b5-ca9b0c825b98 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:40.599256 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ac260445-8bf1-4481-b2b5-ca9b0c825b98 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:40.692681 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2b4b530d-14c8-440d-bf84-a488d60bf293 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:40.695817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2b4b530d-14c8-440d-bf84-a488d60bf293 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:40.702493 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b4b530d-14c8-440d-bf84-a488d60bf293 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:40.703130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b4b530d-14c8-440d-bf84-a488d60bf293 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:40.704067 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b4b530d-14c8-440d-bf84-a488d60bf293 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:40.704636 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b4b530d-14c8-440d-bf84-a488d60bf293 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:40.752831 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2b4b530d-14c8-440d-bf84-a488d60bf293 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069434 Jul 25 14:43:40.756887 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2186/4114] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:43:40 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:43:40.955028 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6e50e67f-a761-4cf7-b427-41d453125ed0 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:40.956040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6e50e67f-a761-4cf7-b427-41d453125ed0 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:40.963102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e50e67f-a761-4cf7-b427-41d453125ed0 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:40.963867 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e50e67f-a761-4cf7-b427-41d453125ed0 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:40.965010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e50e67f-a761-4cf7-b427-41d453125ed0 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:40.965644 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e50e67f-a761-4cf7-b427-41d453125ed0 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:41.015619 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6e50e67f-a761-4cf7-b427-41d453125ed0 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:43:41.130203 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ac260445-8bf1-4481-b2b5-ca9b0c825b98 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:41.153015 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ac260445-8bf1-4481-b2b5-ca9b0c825b98 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de" status: 200 len: 1474 microversion: 2.1 time: 0.619459 Jul 25 14:43:41.169850 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1929/4115] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:40 2022] GET /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de => generated 1474 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:41.195043 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6e50e67f-a761-4cf7-b427-41d453125ed0 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "DELETE /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da" status: 204 len: 0 microversion: 2.1 time: 0.243492 Jul 25 14:43:41.195657 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2187/4116] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:43:40 2022] DELETE /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:43:41.205663 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2286a5d6-140f-4716-8200-b9b5a25ea36a tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:41.206267 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2286a5d6-140f-4716-8200-b9b5a25ea36a tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:41.215701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2286a5d6-140f-4716-8200-b9b5a25ea36a tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:41.216219 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2286a5d6-140f-4716-8200-b9b5a25ea36a tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:41.216993 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2286a5d6-140f-4716-8200-b9b5a25ea36a tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:41.217421 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2286a5d6-140f-4716-8200-b9b5a25ea36a tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:41.424728 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7be373ff-e26c-4080-b0e7-822c14756e6c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:41.425981 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7be373ff-e26c-4080-b0e7-822c14756e6c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:41.457305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7be373ff-e26c-4080-b0e7-822c14756e6c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:41.460905 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7be373ff-e26c-4080-b0e7-822c14756e6c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:41.461745 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7be373ff-e26c-4080-b0e7-822c14756e6c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:41.462191 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7be373ff-e26c-4080-b0e7-822c14756e6c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:41.640741 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2286a5d6-140f-4716-8200-b9b5a25ea36a tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6af371df8364e5b8362add7335ec4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee3d3418544f2ea0558abb27b1c796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:41.654190 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2286a5d6-140f-4716-8200-b9b5a25ea36a tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da" status: 200 len: 1682 microversion: 2.1 time: 0.452130 Jul 25 14:43:41.668010 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1930/4117] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:41 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da => generated 1682 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:41.669191 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f01e5364-fba2-46d4-a6f3-879a5adbbb9e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:41.671119 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f01e5364-fba2-46d4-a6f3-879a5adbbb9e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:41.698471 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f01e5364-fba2-46d4-a6f3-879a5adbbb9e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:41.701651 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f01e5364-fba2-46d4-a6f3-879a5adbbb9e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:41.702939 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f01e5364-fba2-46d4-a6f3-879a5adbbb9e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:41.708509 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f01e5364-fba2-46d4-a6f3-879a5adbbb9e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:41.895439 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f01e5364-fba2-46d4-a6f3-879a5adbbb9e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:41.908957 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f01e5364-fba2-46d4-a6f3-879a5adbbb9e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:41.913874 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f01e5364-fba2-46d4-a6f3-879a5adbbb9e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:41.918028 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f01e5364-fba2-46d4-a6f3-879a5adbbb9e tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1658 microversion: 2.20 time: 0.256771 Jul 25 14:43:41.920979 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1931/4118] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:43:41 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1658 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:43:42.119500 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7be373ff-e26c-4080-b0e7-822c14756e6c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:42.143393 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7be373ff-e26c-4080-b0e7-822c14756e6c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1508 microversion: 2.1 time: 0.723596 Jul 25 14:43:42.144860 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2188/4119] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:41 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1508 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:43:42.176265 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8fcebaf5-6f4a-4b4e-bc8d-7a28d25f93c5 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:42.177466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8fcebaf5-6f4a-4b4e-bc8d-7a28d25f93c5 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: dfb8c05d-0ccc-4b4d-a920-d8238e56f0de] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:42.199293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8fcebaf5-6f4a-4b4e-bc8d-7a28d25f93c5 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:42.200229 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8fcebaf5-6f4a-4b4e-bc8d-7a28d25f93c5 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:42.210741 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8fcebaf5-6f4a-4b4e-bc8d-7a28d25f93c5 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:42.211206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8fcebaf5-6f4a-4b4e-bc8d-7a28d25f93c5 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:42.273175 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-5b474a38-303a-4fe5-bfbb-2380465bf340 req-63371b75-d9ef-4fae-9217-a1b1fc9861cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "034e5d63-63a1-4883-b7f8-fe84ec541914", "name": "network-vif-deleted", "tag": "350ec399-ee42-4e58-9f27-5bd9094cb8e1"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:43:42.286468 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:43:42.301403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-5b474a38-303a-4fe5-bfbb-2380465bf340 req-63371b75-d9ef-4fae-9217-a1b1fc9861cb service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:42.302047 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-5b474a38-303a-4fe5-bfbb-2380465bf340 req-63371b75-d9ef-4fae-9217-a1b1fc9861cb service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:42.318310 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-5b474a38-303a-4fe5-bfbb-2380465bf340 req-63371b75-d9ef-4fae-9217-a1b1fc9861cb service nova] Creating event network-vif-deleted:350ec399-ee42-4e58-9f27-5bd9094cb8e1 for instance 034e5d63-63a1-4883-b7f8-fe84ec541914 on n-h1-846435-14 Jul 25 14:43:42.324951 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-5b474a38-303a-4fe5-bfbb-2380465bf340 req-63371b75-d9ef-4fae-9217-a1b1fc9861cb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057259 Jul 25 14:43:42.326035 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2189/4120] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:43:42.355352 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-4634751d-5c49-43df-92af-38330467b05b req-1a0f1a81-30c3-4875-9c58-8d34c3bd89d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfb8c05d-0ccc-4b4d-a920-d8238e56f0de", "name": "network-vif-deleted", "tag": "78158429-4b1a-4039-9efe-77450874ee04"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:43:42.385998 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-4634751d-5c49-43df-92af-38330467b05b req-1a0f1a81-30c3-4875-9c58-8d34c3bd89d0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:42.398190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-4634751d-5c49-43df-92af-38330467b05b req-1a0f1a81-30c3-4875-9c58-8d34c3bd89d0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:42.419326 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8fcebaf5-6f4a-4b4e-bc8d-7a28d25f93c5 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005d58a261b440893daa752858b1ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b260148f473e420bad9c21f295722f44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:42.421764 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:43:42.433173 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8fcebaf5-6f4a-4b4e-bc8d-7a28d25f93c5 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de" status: 200 len: 1432 microversion: 2.1 time: 0.261800 Jul 25 14:43:42.440376 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1932/4121] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:42 2022] GET /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de => generated 1432 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:42.454957 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-4634751d-5c49-43df-92af-38330467b05b req-1a0f1a81-30c3-4875-9c58-8d34c3bd89d0 service nova] Creating event network-vif-deleted:78158429-4b1a-4039-9efe-77450874ee04 for instance dfb8c05d-0ccc-4b4d-a920-d8238e56f0de on n-h2-846435-14 Jul 25 14:43:42.475504 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-4634751d-5c49-43df-92af-38330467b05b req-1a0f1a81-30c3-4875-9c58-8d34c3bd89d0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129415 Jul 25 14:43:42.476443 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2190/4122] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:43:42.682086 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-03189d29-4f9d-47ac-b2f2-b3cb51c8e0a2 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:42.682994 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-03189d29-4f9d-47ac-b2f2-b3cb51c8e0a2 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:42.694216 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03189d29-4f9d-47ac-b2f2-b3cb51c8e0a2 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:42.695118 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03189d29-4f9d-47ac-b2f2-b3cb51c8e0a2 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:42.696312 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03189d29-4f9d-47ac-b2f2-b3cb51c8e0a2 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:42.697109 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03189d29-4f9d-47ac-b2f2-b3cb51c8e0a2 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:42.929662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-03189d29-4f9d-47ac-b2f2-b3cb51c8e0a2 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6af371df8364e5b8362add7335ec4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee3d3418544f2ea0558abb27b1c796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:42.946237 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-03189d29-4f9d-47ac-b2f2-b3cb51c8e0a2 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da" status: 200 len: 1682 microversion: 2.1 time: 0.269522 Jul 25 14:43:42.946898 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1933/4123] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:42 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da => generated 1682 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:42.950286 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7a6fddb4-0dbc-43a1-8584-5fb2650bf406 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:42.951082 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7a6fddb4-0dbc-43a1-8584-5fb2650bf406 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:42.966249 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a6fddb4-0dbc-43a1-8584-5fb2650bf406 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:42.967481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a6fddb4-0dbc-43a1-8584-5fb2650bf406 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:42.974144 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a6fddb4-0dbc-43a1-8584-5fb2650bf406 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:42.974811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a6fddb4-0dbc-43a1-8584-5fb2650bf406 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:43.065726 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a6fddb4-0dbc-43a1-8584-5fb2650bf406 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:43.068353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a6fddb4-0dbc-43a1-8584-5fb2650bf406 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:43.069572 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-7a6fddb4-0dbc-43a1-8584-5fb2650bf406 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lazy-loading 'fault' on Instance uuid 034e5d63-63a1-4883-b7f8-fe84ec541914 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:43:43.173916 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7cbf6376-1123-4320-8737-6efddd5b1b2e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:43.174613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7cbf6376-1123-4320-8737-6efddd5b1b2e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:43.192301 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7cbf6376-1123-4320-8737-6efddd5b1b2e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:43.192974 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7cbf6376-1123-4320-8737-6efddd5b1b2e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:43.196563 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7cbf6376-1123-4320-8737-6efddd5b1b2e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:43.197732 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7cbf6376-1123-4320-8737-6efddd5b1b2e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:43.252839 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7a6fddb4-0dbc-43a1-8584-5fb2650bf406 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:43.270802 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7a6fddb4-0dbc-43a1-8584-5fb2650bf406 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:43.275129 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7a6fddb4-0dbc-43a1-8584-5fb2650bf406 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '060523597bbb409193f8814648fb40fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973384a032e54cd5bee455a1c6f39725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:43.280465 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7a6fddb4-0dbc-43a1-8584-5fb2650bf406 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 200 len: 1372 microversion: 2.20 time: 0.334794 Jul 25 14:43:43.298957 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2191/4124] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:43:42 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 1372 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:43:43.459877 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-53a3fa47-188e-42a0-8eac-a985af4af38a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:43.460828 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-53a3fa47-188e-42a0-8eac-a985af4af38a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] [instance: dfb8c05d-0ccc-4b4d-a920-d8238e56f0de] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:43.479945 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-53a3fa47-188e-42a0-8eac-a985af4af38a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:43.483534 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-53a3fa47-188e-42a0-8eac-a985af4af38a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:43.496224 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-53a3fa47-188e-42a0-8eac-a985af4af38a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:43.500993 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-53a3fa47-188e-42a0-8eac-a985af4af38a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:43.603117 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-53a3fa47-188e-42a0-8eac-a985af4af38a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] HTTP exception thrown: Instance dfb8c05d-0ccc-4b4d-a920-d8238e56f0de could not be found. Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-53a3fa47-188e-42a0-8eac-a985af4af38a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Request method failure captured: Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de HTTP/1.1 Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qtqTrtLRr0mhXH61lvjvrXcIbRKb2WaMlFthKLheakofuTfnRxic5fI35BLVprPCUdjSUEgZKEsNCj0C9dPv1E8Ulhs9Pkl-1dQKfM6Jlwqx06ctqnh2lf8ACsp-QPmTaoIyGtqPT9nrflo9UcgTSWCFU77Qbj7pU_tld9tCy7UCUc Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: b260148f473e420bad9c21f295722f44 Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ListImageFiltersTestJSON-1246186757 Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b260148f473e420bad9c21f295722f44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b260148f473e420bad9c21f295722f44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b260148f473e420bad9c21f295722f44", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b260148f473e420bad9c21f295722f44"}]}] Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ListImageFiltersTestJSON-1246186757 Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: b260148f473e420bad9c21f295722f44 Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1246186757 Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ListImageFiltersTestJSON-1246186757-project Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: f005d58a261b440893daa752858b1ab1 Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ListImageFiltersTestJSON-1246186757-project Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance dfb8c05d-0ccc-4b4d-a920-d8238e56f0de could not be found. Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'dfb8c05d-0ccc-4b4d-a920-d8238e56f0de'} Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfb8c05d-0ccc-4b4d-a920-d8238e56f0de could not be found. Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfb8c05d-0ccc-4b4d-a920-d8238e56f0de could not be found. Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:43:43.607328 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:43:43.610776 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:43.610776 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:43:43.610776 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:43:43.610776 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:43:43.610776 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:43:43.610776 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfb8c05d-0ccc-4b4d-a920-d8238e56f0de could not be found. Jul 25 14:43:43.610776 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:43:43.610776 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-53a3fa47-188e-42a0-8eac-a985af4af38a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Returning 404 to user: Instance dfb8c05d-0ccc-4b4d-a920-d8238e56f0de could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:43:43.620226 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-53a3fa47-188e-42a0-8eac-a985af4af38a tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "GET /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de" status: 404 len: 111 microversion: 2.1 time: 0.153577 Jul 25 14:43:43.620892 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2192/4125] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:43 2022] GET /compute/v2.1/servers/dfb8c05d-0ccc-4b4d-a920-d8238e56f0de => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:43:43.639475 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f9346de7-7694-4360-9319-0365428fb29c tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46862f25e0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:43.682801 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7cbf6376-1123-4320-8737-6efddd5b1b2e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:43.695408 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7cbf6376-1123-4320-8737-6efddd5b1b2e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1508 microversion: 2.1 time: 0.531781 Jul 25 14:43:43.713074 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1934/4126] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:43 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1508 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:43.973648 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-58e1c127-24b4-4bed-b0eb-ec4f9ab52a4a tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:43.977432 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-58e1c127-24b4-4bed-b0eb-ec4f9ab52a4a tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:43.984164 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-58e1c127-24b4-4bed-b0eb-ec4f9ab52a4a tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:43.985061 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-58e1c127-24b4-4bed-b0eb-ec4f9ab52a4a tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:43.986053 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-58e1c127-24b4-4bed-b0eb-ec4f9ab52a4a tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:43.987141 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-58e1c127-24b4-4bed-b0eb-ec4f9ab52a4a tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:44.313945 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-58e1c127-24b4-4bed-b0eb-ec4f9ab52a4a tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6af371df8364e5b8362add7335ec4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee3d3418544f2ea0558abb27b1c796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:44.324530 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-58e1c127-24b4-4bed-b0eb-ec4f9ab52a4a tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da" status: 200 len: 1682 microversion: 2.1 time: 0.359346 Jul 25 14:43:44.327316 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1935/4127] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:43 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da => generated 1682 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:44.338945 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-509410db-6d44-4892-8fa0-ad2cd624afc4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:44.344587 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-509410db-6d44-4892-8fa0-ad2cd624afc4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:44.389271 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-509410db-6d44-4892-8fa0-ad2cd624afc4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:44.389744 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-509410db-6d44-4892-8fa0-ad2cd624afc4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:44.390553 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-509410db-6d44-4892-8fa0-ad2cd624afc4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:44.390990 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-509410db-6d44-4892-8fa0-ad2cd624afc4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:44.426459 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-509410db-6d44-4892-8fa0-ad2cd624afc4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] HTTP exception thrown: Instance 034e5d63-63a1-4883-b7f8-fe84ec541914 could not be found. Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-509410db-6d44-4892-8fa0-ad2cd624afc4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Request method failure captured: Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 HTTP/1.1 Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qnnsDwhiwclvLICZx25tvED9QBDR-PsslOWQbR9ercqYi2_4zddmdpuO0rjlUxGuCqoA2Di75m-DhjzNBp3pvZkajTQM1yFPHjYWZ9QDGXdTcW8DZc1mWndfRuL2FmMJYbW-ooe1Vc0n6xMI3jfgRxeT8g7we_MenM44yhkdC3Ly6g Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 973384a032e54cd5bee455a1c6f39725 Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-767538 Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/973384a032e54cd5bee455a1c6f39725"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/973384a032e54cd5bee455a1c6f39725"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_973384a032e54cd5bee455a1c6f39725", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/973384a032e54cd5bee455a1c6f39725"}]}] Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-AttachVolumeShelveTestJSON-767538 Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 973384a032e54cd5bee455a1c6f39725 Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-767538 Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-AttachVolumeShelveTestJSON-767538-project Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 060523597bbb409193f8814648fb40fc Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-AttachVolumeShelveTestJSON-767538-project Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 034e5d63-63a1-4883-b7f8-fe84ec541914 could not be found. Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '034e5d63-63a1-4883-b7f8-fe84ec541914'} Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 034e5d63-63a1-4883-b7f8-fe84ec541914 could not be found. Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 034e5d63-63a1-4883-b7f8-fe84ec541914 could not be found. Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:43:44.438914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:44.443014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:44.443014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:43:44.443014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:43:44.443014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:43:44.443014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:43:44.443014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 034e5d63-63a1-4883-b7f8-fe84ec541914 could not be found. Jul 25 14:43:44.443014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:44.460051 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-509410db-6d44-4892-8fa0-ad2cd624afc4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Returning 404 to user: Instance 034e5d63-63a1-4883-b7f8-fe84ec541914 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:43:44.464829 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-509410db-6d44-4892-8fa0-ad2cd624afc4 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 404 len: 111 microversion: 2.20 time: 0.133692 Jul 25 14:43:44.465989 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1936/4128] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:43:44 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:43:44.479039 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b590bb13-9b50-470e-a2df-a6a184c8fbd9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '.version_select at 0x7f46866f0550>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:44.531059 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b590bb13-9b50-470e-a2df-a6a184c8fbd9 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1366923407" status: 204 len: 0 microversion: 2.20 time: 0.056638 Jul 25 14:43:44.532759 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1937/4129] 10.222.0.88 () {60 vars in 1262 bytes} [Mon Jul 25 14:43:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1366923407 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 14:43:44.718734 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f9346de7-7694-4360-9319-0365428fb29c tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "DELETE /compute/v2.1/images/0e296b13-5377-4aaf-893e-bcda62adbf25" status: 204 len: 0 microversion: 2.1 time: 1.084619 Jul 25 14:43:44.721692 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2193/4130] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:43 2022] DELETE /compute/v2.1/images/0e296b13-5377-4aaf-893e-bcda62adbf25 => generated 0 bytes in 1089 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:43:44.725617 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4989d741-b2d7-451b-9cd2-0d275e41b47d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:44.732278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e2bd3ab6-4e15-4b09-803b-b26b7eddbe2f tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46861f3430>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:44.732855 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4989d741-b2d7-451b-9cd2-0d275e41b47d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:44.755316 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4989d741-b2d7-451b-9cd2-0d275e41b47d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:44.756977 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4989d741-b2d7-451b-9cd2-0d275e41b47d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:44.758237 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4989d741-b2d7-451b-9cd2-0d275e41b47d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:44.758915 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4989d741-b2d7-451b-9cd2-0d275e41b47d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:45.265899 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4989d741-b2d7-451b-9cd2-0d275e41b47d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:45.281486 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4989d741-b2d7-451b-9cd2-0d275e41b47d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1508 microversion: 2.1 time: 0.559968 Jul 25 14:43:45.283392 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1938/4131] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:44 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1508 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:45.348970 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-12c15c60-6a38-40d8-8596-198e5f85d09f tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:45.349600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-12c15c60-6a38-40d8-8596-198e5f85d09f tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:45.361135 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-12c15c60-6a38-40d8-8596-198e5f85d09f tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:45.361593 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-12c15c60-6a38-40d8-8596-198e5f85d09f tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:45.369693 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-12c15c60-6a38-40d8-8596-198e5f85d09f tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:45.370169 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-12c15c60-6a38-40d8-8596-198e5f85d09f tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:45.527637 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-12c15c60-6a38-40d8-8596-198e5f85d09f tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6af371df8364e5b8362add7335ec4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee3d3418544f2ea0558abb27b1c796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:45.541180 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-12c15c60-6a38-40d8-8596-198e5f85d09f tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da" status: 200 len: 1614 microversion: 2.1 time: 0.196139 Jul 25 14:43:45.543430 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1939/4132] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:45 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da => generated 1614 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:43:45.838462 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e2bd3ab6-4e15-4b09-803b-b26b7eddbe2f tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "DELETE /compute/v2.1/images/9e65d858-6577-40dc-b561-9cf8bd4dbb81" status: 204 len: 0 microversion: 2.1 time: 1.111466 Jul 25 14:43:45.839060 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2194/4133] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:44 2022] DELETE /compute/v2.1/images/9e65d858-6577-40dc-b561-9cf8bd4dbb81 => generated 0 bytes in 1113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:43:45.849253 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-05939dbf-0ae5-49e3-9e5b-125ff5ec8ea0 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] Calling method '.version_select at 0x7f46866f0280>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:45.896230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-4be95ff0-85dc-4919-9d3f-e73744d335b3 req-00c117e3-7d32-46a6-9173-228292ee17fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e128c68-5e95-4535-ab8f-451b2d7ec5da", "name": "network-vif-deleted", "tag": "c80cc8b1-d5ac-4df0-b29c-4321c060d4cf"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:43:45.950893 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-4be95ff0-85dc-4919-9d3f-e73744d335b3 req-00c117e3-7d32-46a6-9173-228292ee17fb service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:45.951420 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-4be95ff0-85dc-4919-9d3f-e73744d335b3 req-00c117e3-7d32-46a6-9173-228292ee17fb service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:45.986123 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-4be95ff0-85dc-4919-9d3f-e73744d335b3 req-00c117e3-7d32-46a6-9173-228292ee17fb service nova] Creating event network-vif-deleted:c80cc8b1-d5ac-4df0-b29c-4321c060d4cf for instance 0e128c68-5e95-4535-ab8f-451b2d7ec5da on n-h2-846435-14 Jul 25 14:43:46.028675 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-4be95ff0-85dc-4919-9d3f-e73744d335b3 req-00c117e3-7d32-46a6-9173-228292ee17fb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146846 Jul 25 14:43:46.036656 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2195/4134] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:43:46.307459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-50d7d6b7-25d4-4b51-90a1-7acbd27d16b3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:46.309396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-50d7d6b7-25d4-4b51-90a1-7acbd27d16b3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:46.330510 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50d7d6b7-25d4-4b51-90a1-7acbd27d16b3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:46.331102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50d7d6b7-25d4-4b51-90a1-7acbd27d16b3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:46.339189 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50d7d6b7-25d4-4b51-90a1-7acbd27d16b3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:46.351518 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50d7d6b7-25d4-4b51-90a1-7acbd27d16b3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:46.686841 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-05939dbf-0ae5-49e3-9e5b-125ff5ec8ea0 tempest-ListImageFiltersTestJSON-1246186757 tempest-ListImageFiltersTestJSON-1246186757-project] 10.222.0.88 "DELETE /compute/v2.1/images/28aebcaa-7161-4787-aa7c-243ee9edc710" status: 204 len: 0 microversion: 2.1 time: 0.843025 Jul 25 14:43:46.691029 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1940/4135] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:45 2022] DELETE /compute/v2.1/images/28aebcaa-7161-4787-aa7c-243ee9edc710 => generated 0 bytes in 845 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:43:46.694838 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a4c77733-a0c5-4583-b2e6-2cf8f99d35d3 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:46.695662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a4c77733-a0c5-4583-b2e6-2cf8f99d35d3 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:46.709607 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a4c77733-a0c5-4583-b2e6-2cf8f99d35d3 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:46.711242 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a4c77733-a0c5-4583-b2e6-2cf8f99d35d3 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:46.724746 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a4c77733-a0c5-4583-b2e6-2cf8f99d35d3 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:46.725222 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a4c77733-a0c5-4583-b2e6-2cf8f99d35d3 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:46.754027 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-a4c77733-a0c5-4583-b2e6-2cf8f99d35d3 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] HTTP exception thrown: Instance 0e128c68-5e95-4535-ab8f-451b2d7ec5da could not be found. Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a4c77733-a0c5-4583-b2e6-2cf8f99d35d3 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Request method failure captured: Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da HTTP/1.1 Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qtCsJ2emgrUvHwkxJHCXfa63lt4wNsFJqnTkUy8nLiC-mOqN0tq68w7XrTZnQeBiX0dS_AITNvXuKX7yIj345oqbGMSYktqYnsQcFBOOEnmBiwRVck8_l8M39ZzDB3joW8YpIyZZvIQnwHlg1Vn3Ac5hsvWNk_ExS3cTyGxXEvkSbk Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 26ee3d3418544f2ea0558abb27b1c796 Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-934005073 Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/26ee3d3418544f2ea0558abb27b1c796"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/26ee3d3418544f2ea0558abb27b1c796"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_26ee3d3418544f2ea0558abb27b1c796", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/26ee3d3418544f2ea0558abb27b1c796"}]}] Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-934005073 Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 26ee3d3418544f2ea0558abb27b1c796 Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-934005073 Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-AttachSCSIVolumeTestJSON-934005073-project Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: c6af371df8364e5b8362add7335ec4f1 Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-934005073-project Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 0e128c68-5e95-4535-ab8f-451b2d7ec5da could not be found. Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '0e128c68-5e95-4535-ab8f-451b2d7ec5da'} Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e128c68-5e95-4535-ab8f-451b2d7ec5da could not be found. Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e128c68-5e95-4535-ab8f-451b2d7ec5da could not be found. Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:43:46.756811 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:46.761109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:46.761109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:43:46.761109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:43:46.761109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:43:46.761109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:43:46.761109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e128c68-5e95-4535-ab8f-451b2d7ec5da could not be found. Jul 25 14:43:46.761109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:46.763093 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a4c77733-a0c5-4583-b2e6-2cf8f99d35d3 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Returning 404 to user: Instance 0e128c68-5e95-4535-ab8f-451b2d7ec5da could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:43:46.764267 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a4c77733-a0c5-4583-b2e6-2cf8f99d35d3 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da" status: 404 len: 111 microversion: 2.1 time: 0.075045 Jul 25 14:43:46.765084 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1941/4136] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:46 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:43:46.774368 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a071f235-d828-4dd5-b7b7-958dff4de441 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '.version_select at 0x7f468671f430>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:46.804966 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a071f235-d828-4dd5-b7b7-958dff4de441 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1670415063" status: 202 len: 0 microversion: 2.1 time: 0.034933 Jul 25 14:43:46.807634 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1942/4137] 10.222.0.88 () {58 vars in 1221 bytes} [Mon Jul 25 14:43:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1670415063 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:43:46.898227 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-50d7d6b7-25d4-4b51-90a1-7acbd27d16b3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:46.914383 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-50d7d6b7-25d4-4b51-90a1-7acbd27d16b3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1508 microversion: 2.1 time: 0.615003 Jul 25 14:43:46.918401 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2196/4138] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:46 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1508 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:43:47.942098 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5475985e-a5a3-4728-9c9f-275bd931cb87 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:47.942714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5475985e-a5a3-4728-9c9f-275bd931cb87 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:47.962719 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5475985e-a5a3-4728-9c9f-275bd931cb87 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:47.963478 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5475985e-a5a3-4728-9c9f-275bd931cb87 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:47.964465 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5475985e-a5a3-4728-9c9f-275bd931cb87 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:47.965408 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5475985e-a5a3-4728-9c9f-275bd931cb87 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:48.730699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5475985e-a5a3-4728-9c9f-275bd931cb87 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:48.743199 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5475985e-a5a3-4728-9c9f-275bd931cb87 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1508 microversion: 2.1 time: 0.808327 Jul 25 14:43:48.749898 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1943/4139] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:47 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1508 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:49.773362 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b6a02cbe-4d47-48a5-8b26-8a878210968c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:49.774141 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b6a02cbe-4d47-48a5-8b26-8a878210968c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:49.788446 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b6a02cbe-4d47-48a5-8b26-8a878210968c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:49.794373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b6a02cbe-4d47-48a5-8b26-8a878210968c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:49.796885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b6a02cbe-4d47-48a5-8b26-8a878210968c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:49.797442 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b6a02cbe-4d47-48a5-8b26-8a878210968c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:50.753034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b6a02cbe-4d47-48a5-8b26-8a878210968c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:50.764616 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b6a02cbe-4d47-48a5-8b26-8a878210968c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1508 microversion: 2.1 time: 0.992502 Jul 25 14:43:50.768186 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2197/4140] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:49 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1508 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:51.531748 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-538b4268-55a2-4255-a58a-ea3091fe87c5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:51.532291 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-538b4268-55a2-4255-a58a-ea3091fe87c5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:51.544080 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-538b4268-55a2-4255-a58a-ea3091fe87c5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:51.544545 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-538b4268-55a2-4255-a58a-ea3091fe87c5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:51.545334 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-538b4268-55a2-4255-a58a-ea3091fe87c5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:51.548453 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-538b4268-55a2-4255-a58a-ea3091fe87c5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:51.584322 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-538b4268-55a2-4255-a58a-ea3091fe87c5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] HTTP exception thrown: Instance 034e5d63-63a1-4883-b7f8-fe84ec541914 could not be found. Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-538b4268-55a2-4255-a58a-ea3091fe87c5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Request method failure captured: Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 HTTP/1.1 Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qnnsDwhiwclvLICZx25tvED9QBDR-PsslOWQbR9ercqYi2_4zddmdpuO0rjlUxGuCqoA2Di75m-DhjzNBp3pvZkajTQM1yFPHjYWZ9QDGXdTcW8DZc1mWndfRuL2FmMJYbW-ooe1Vc0n6xMI3jfgRxeT8g7we_MenM44yhkdC3Ly6g Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 973384a032e54cd5bee455a1c6f39725 Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-767538 Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/973384a032e54cd5bee455a1c6f39725"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/973384a032e54cd5bee455a1c6f39725"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_973384a032e54cd5bee455a1c6f39725", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/973384a032e54cd5bee455a1c6f39725"}]}] Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-AttachVolumeShelveTestJSON-767538 Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 973384a032e54cd5bee455a1c6f39725 Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-767538 Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-AttachVolumeShelveTestJSON-767538-project Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 060523597bbb409193f8814648fb40fc Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-AttachVolumeShelveTestJSON-767538-project Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 034e5d63-63a1-4883-b7f8-fe84ec541914 could not be found. Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '034e5d63-63a1-4883-b7f8-fe84ec541914'} Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 034e5d63-63a1-4883-b7f8-fe84ec541914 could not be found. Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:43:51.590357 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:43:51.595557 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 034e5d63-63a1-4883-b7f8-fe84ec541914 could not be found. Jul 25 14:43:51.595557 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:51.595557 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:43:51.595557 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:51.595557 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:51.595557 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:43:51.595557 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:43:51.595557 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:43:51.595557 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:43:51.595557 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 034e5d63-63a1-4883-b7f8-fe84ec541914 could not be found. Jul 25 14:43:51.595557 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:51.595557 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-538b4268-55a2-4255-a58a-ea3091fe87c5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Returning 404 to user: Instance 034e5d63-63a1-4883-b7f8-fe84ec541914 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:43:51.597041 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-538b4268-55a2-4255-a58a-ea3091fe87c5 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "DELETE /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 404 len: 111 microversion: 2.20 time: 0.069456 Jul 25 14:43:51.601375 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1944/4141] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Jul 25 14:43:51 2022] DELETE /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:43:51.608195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-57aa3354-d626-47d4-86f2-e28d521d3284 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:51.609547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-57aa3354-d626-47d4-86f2-e28d521d3284 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: 034e5d63-63a1-4883-b7f8-fe84ec541914] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:51.631248 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-57aa3354-d626-47d4-86f2-e28d521d3284 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:51.632736 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-57aa3354-d626-47d4-86f2-e28d521d3284 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:51.634867 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-57aa3354-d626-47d4-86f2-e28d521d3284 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:51.636820 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-57aa3354-d626-47d4-86f2-e28d521d3284 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:51.677678 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-57aa3354-d626-47d4-86f2-e28d521d3284 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] HTTP exception thrown: Instance 034e5d63-63a1-4883-b7f8-fe84ec541914 could not be found. Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-57aa3354-d626-47d4-86f2-e28d521d3284 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Request method failure captured: Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 HTTP/1.1 Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qnnsDwhiwclvLICZx25tvED9QBDR-PsslOWQbR9ercqYi2_4zddmdpuO0rjlUxGuCqoA2Di75m-DhjzNBp3pvZkajTQM1yFPHjYWZ9QDGXdTcW8DZc1mWndfRuL2FmMJYbW-ooe1Vc0n6xMI3jfgRxeT8g7we_MenM44yhkdC3Ly6g Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 973384a032e54cd5bee455a1c6f39725 Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-767538 Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/973384a032e54cd5bee455a1c6f39725"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/973384a032e54cd5bee455a1c6f39725"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_973384a032e54cd5bee455a1c6f39725", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/973384a032e54cd5bee455a1c6f39725"}]}] Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-AttachVolumeShelveTestJSON-767538 Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 973384a032e54cd5bee455a1c6f39725 Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-767538 Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-AttachVolumeShelveTestJSON-767538-project Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 060523597bbb409193f8814648fb40fc Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-AttachVolumeShelveTestJSON-767538-project Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 034e5d63-63a1-4883-b7f8-fe84ec541914 could not be found. Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '034e5d63-63a1-4883-b7f8-fe84ec541914'} Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 034e5d63-63a1-4883-b7f8-fe84ec541914 could not be found. Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 034e5d63-63a1-4883-b7f8-fe84ec541914 could not be found. Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:43:51.684140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:43:51.688778 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:51.688778 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:43:51.688778 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:43:51.688778 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:43:51.688778 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:43:51.688778 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 034e5d63-63a1-4883-b7f8-fe84ec541914 could not be found. Jul 25 14:43:51.688778 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:43:51.688778 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-57aa3354-d626-47d4-86f2-e28d521d3284 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Returning 404 to user: Instance 034e5d63-63a1-4883-b7f8-fe84ec541914 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:43:51.688778 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-57aa3354-d626-47d4-86f2-e28d521d3284 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914" status: 404 len: 111 microversion: 2.20 time: 0.084267 Jul 25 14:43:51.689271 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2198/4142] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:43:51 2022] GET /compute/v2.1/servers/034e5d63-63a1-4883-b7f8-fe84ec541914 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:43:51.792378 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1f985079-b847-4680-b217-e2122362e3d8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:51.793479 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1f985079-b847-4680-b217-e2122362e3d8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:51.814591 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1f985079-b847-4680-b217-e2122362e3d8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:51.815950 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1f985079-b847-4680-b217-e2122362e3d8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:51.819925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1f985079-b847-4680-b217-e2122362e3d8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:51.820936 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1f985079-b847-4680-b217-e2122362e3d8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:52.340876 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1f985079-b847-4680-b217-e2122362e3d8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:52.351878 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1f985079-b847-4680-b217-e2122362e3d8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1508 microversion: 2.1 time: 0.566830 Jul 25 14:43:52.353049 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1945/4143] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:51 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1508 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:52.917618 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 14:43:52.918557 n-d-846435-14 devstack@n-api.service[119304]: Mon Jul 25 14:43:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 14:43:53.380016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ff5caad4-c91d-4afb-8968-e2f9203eebb2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:53.380875 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ff5caad4-c91d-4afb-8968-e2f9203eebb2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:53.416247 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff5caad4-c91d-4afb-8968-e2f9203eebb2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:53.416702 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff5caad4-c91d-4afb-8968-e2f9203eebb2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:53.424003 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff5caad4-c91d-4afb-8968-e2f9203eebb2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:53.424660 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff5caad4-c91d-4afb-8968-e2f9203eebb2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:54.252497 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ff5caad4-c91d-4afb-8968-e2f9203eebb2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:54.264497 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ff5caad4-c91d-4afb-8968-e2f9203eebb2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1508 microversion: 2.1 time: 0.890568 Jul 25 14:43:54.269163 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2199/4144] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:53 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1508 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:55.294131 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c69a70b7-04cb-4a17-9b01-a8021f276099 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:55.294752 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c69a70b7-04cb-4a17-9b01-a8021f276099 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:55.313779 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c69a70b7-04cb-4a17-9b01-a8021f276099 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:55.314765 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c69a70b7-04cb-4a17-9b01-a8021f276099 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:55.316130 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c69a70b7-04cb-4a17-9b01-a8021f276099 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:55.316763 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c69a70b7-04cb-4a17-9b01-a8021f276099 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:56.427497 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c69a70b7-04cb-4a17-9b01-a8021f276099 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:56.440161 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c69a70b7-04cb-4a17-9b01-a8021f276099 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1508 microversion: 2.1 time: 1.149719 Jul 25 14:43:56.457994 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1946/4145] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:55 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1508 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:56.774282 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-52c114cb-8191-4ed0-b36a-05868e257836 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:56.797103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-52c114cb-8191-4ed0-b36a-05868e257836 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:56.813921 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52c114cb-8191-4ed0-b36a-05868e257836 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:56.814390 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52c114cb-8191-4ed0-b36a-05868e257836 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:56.815278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52c114cb-8191-4ed0-b36a-05868e257836 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:56.815703 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52c114cb-8191-4ed0-b36a-05868e257836 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:56.877869 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-52c114cb-8191-4ed0-b36a-05868e257836 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] HTTP exception thrown: Instance 0e128c68-5e95-4535-ab8f-451b2d7ec5da could not be found. Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-52c114cb-8191-4ed0-b36a-05868e257836 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Request method failure captured: Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da HTTP/1.1 Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qtCsJ2emgrUvHwkxJHCXfa63lt4wNsFJqnTkUy8nLiC-mOqN0tq68w7XrTZnQeBiX0dS_AITNvXuKX7yIj345oqbGMSYktqYnsQcFBOOEnmBiwRVck8_l8M39ZzDB3joW8YpIyZZvIQnwHlg1Vn3Ac5hsvWNk_ExS3cTyGxXEvkSbk Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 26ee3d3418544f2ea0558abb27b1c796 Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-934005073 Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/26ee3d3418544f2ea0558abb27b1c796"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/26ee3d3418544f2ea0558abb27b1c796"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_26ee3d3418544f2ea0558abb27b1c796", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/26ee3d3418544f2ea0558abb27b1c796"}]}] Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-934005073 Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 26ee3d3418544f2ea0558abb27b1c796 Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-934005073 Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-AttachSCSIVolumeTestJSON-934005073-project Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: c6af371df8364e5b8362add7335ec4f1 Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-934005073-project Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 0e128c68-5e95-4535-ab8f-451b2d7ec5da could not be found. Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '0e128c68-5e95-4535-ab8f-451b2d7ec5da'} Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e128c68-5e95-4535-ab8f-451b2d7ec5da could not be found. Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:43:56.879501 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:43:56.883268 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e128c68-5e95-4535-ab8f-451b2d7ec5da could not be found. Jul 25 14:43:56.883268 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:43:56.883268 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:43:56.883268 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:43:56.883268 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:56.883268 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:43:56.883268 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:43:56.883268 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:43:56.883268 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:43:56.883268 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e128c68-5e95-4535-ab8f-451b2d7ec5da could not be found. Jul 25 14:43:56.883268 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:43:56.883268 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-52c114cb-8191-4ed0-b36a-05868e257836 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Returning 404 to user: Instance 0e128c68-5e95-4535-ab8f-451b2d7ec5da could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:43:56.883268 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-52c114cb-8191-4ed0-b36a-05868e257836 tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "DELETE /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da" status: 404 len: 111 microversion: 2.1 time: 0.110816 Jul 25 14:43:56.883268 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2200/4146] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:43:56 2022] DELETE /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:43:56.890165 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f9766569-b58b-4d7d-9739-86ae947d63eb tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:56.891230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f9766569-b58b-4d7d-9739-86ae947d63eb tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] [instance: 0e128c68-5e95-4535-ab8f-451b2d7ec5da] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:56.910088 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f9766569-b58b-4d7d-9739-86ae947d63eb tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:56.911260 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f9766569-b58b-4d7d-9739-86ae947d63eb tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:56.914521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f9766569-b58b-4d7d-9739-86ae947d63eb tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:56.914871 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f9766569-b58b-4d7d-9739-86ae947d63eb tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:56.997280 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-f9766569-b58b-4d7d-9739-86ae947d63eb tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] HTTP exception thrown: Instance 0e128c68-5e95-4535-ab8f-451b2d7ec5da could not be found. Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f9766569-b58b-4d7d-9739-86ae947d63eb tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Request method failure captured: Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da HTTP/1.1 Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qtCsJ2emgrUvHwkxJHCXfa63lt4wNsFJqnTkUy8nLiC-mOqN0tq68w7XrTZnQeBiX0dS_AITNvXuKX7yIj345oqbGMSYktqYnsQcFBOOEnmBiwRVck8_l8M39ZzDB3joW8YpIyZZvIQnwHlg1Vn3Ac5hsvWNk_ExS3cTyGxXEvkSbk Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 26ee3d3418544f2ea0558abb27b1c796 Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-934005073 Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/26ee3d3418544f2ea0558abb27b1c796"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/26ee3d3418544f2ea0558abb27b1c796"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_26ee3d3418544f2ea0558abb27b1c796", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/26ee3d3418544f2ea0558abb27b1c796"}]}] Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-934005073 Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 26ee3d3418544f2ea0558abb27b1c796 Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-934005073 Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-AttachSCSIVolumeTestJSON-934005073-project Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: c6af371df8364e5b8362add7335ec4f1 Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-934005073-project Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 0e128c68-5e95-4535-ab8f-451b2d7ec5da could not be found. Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '0e128c68-5e95-4535-ab8f-451b2d7ec5da'} Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e128c68-5e95-4535-ab8f-451b2d7ec5da could not be found. Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e128c68-5e95-4535-ab8f-451b2d7ec5da could not be found. Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:43:57.007914 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:57.011672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:57.011672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:43:57.011672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:43:57.011672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:43:57.011672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:43:57.011672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e128c68-5e95-4535-ab8f-451b2d7ec5da could not be found. Jul 25 14:43:57.011672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:57.015328 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f9766569-b58b-4d7d-9739-86ae947d63eb tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] Returning 404 to user: Instance 0e128c68-5e95-4535-ab8f-451b2d7ec5da could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:43:57.019871 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f9766569-b58b-4d7d-9739-86ae947d63eb tempest-AttachSCSIVolumeTestJSON-934005073 tempest-AttachSCSIVolumeTestJSON-934005073-project] 10.222.0.88 "GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da" status: 404 len: 111 microversion: 2.1 time: 0.131147 Jul 25 14:43:57.026247 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1947/4147] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:56 2022] GET /compute/v2.1/servers/0e128c68-5e95-4535-ab8f-451b2d7ec5da => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:43:57.462888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f64a23bc-1516-40ce-a373-39a324482343 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:57.464375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f64a23bc-1516-40ce-a373-39a324482343 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:57.477233 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f64a23bc-1516-40ce-a373-39a324482343 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:57.479667 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f64a23bc-1516-40ce-a373-39a324482343 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:57.482822 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f64a23bc-1516-40ce-a373-39a324482343 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:57.485177 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f64a23bc-1516-40ce-a373-39a324482343 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:57.556388 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:43:58.601810 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f64a23bc-1516-40ce-a373-39a324482343 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:43:58.610059 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f64a23bc-1516-40ce-a373-39a324482343 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1508 microversion: 2.1 time: 1.152598 Jul 25 14:43:58.621109 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2201/4148] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:57 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1508 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:43:58.643528 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4ab50c12-15e3-41a1-b510-95059e162090 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:58.644307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4ab50c12-15e3-41a1-b510-95059e162090 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:58.664516 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4ab50c12-15e3-41a1-b510-95059e162090 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:58.664932 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4ab50c12-15e3-41a1-b510-95059e162090 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:58.666217 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4ab50c12-15e3-41a1-b510-95059e162090 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:58.666663 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4ab50c12-15e3-41a1-b510-95059e162090 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:58.691552 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-4ab50c12-15e3-41a1-b510-95059e162090 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] HTTP exception thrown: Instance f1009be4-53ff-4893-836c-ba96f07a0d60 could not be found. Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4ab50c12-15e3-41a1-b510-95059e162090 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Request method failure captured: Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 HTTP/1.1 Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qnnsDwhiwclvLICZx25tvED9QBDR-PsslOWQbR9ercqYi2_4zddmdpuO0rjlUxGuCqoA2Di75m-DhjzNBp3pvZkajTQM1yFPHjYWZ9QDGXdTcW8DZc1mWndfRuL2FmMJYbW-ooe1Vc0n6xMI3jfgRxeT8g7we_MenM44yhkdC3Ly6g Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 973384a032e54cd5bee455a1c6f39725 Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-767538 Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/973384a032e54cd5bee455a1c6f39725"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/973384a032e54cd5bee455a1c6f39725"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_973384a032e54cd5bee455a1c6f39725", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/973384a032e54cd5bee455a1c6f39725"}]}] Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-AttachVolumeShelveTestJSON-767538 Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 973384a032e54cd5bee455a1c6f39725 Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-767538 Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-AttachVolumeShelveTestJSON-767538-project Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 060523597bbb409193f8814648fb40fc Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-AttachVolumeShelveTestJSON-767538-project Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance f1009be4-53ff-4893-836c-ba96f07a0d60 could not be found. Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'f1009be4-53ff-4893-836c-ba96f07a0d60'} Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1009be4-53ff-4893-836c-ba96f07a0d60 could not be found. Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:43:58.693186 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:43:58.696660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1009be4-53ff-4893-836c-ba96f07a0d60 could not be found. Jul 25 14:43:58.696660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:58.696660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:43:58.696660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:58.696660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:58.696660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:43:58.696660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:43:58.696660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:43:58.696660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:43:58.696660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1009be4-53ff-4893-836c-ba96f07a0d60 could not be found. Jul 25 14:43:58.696660 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:43:58.696660 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4ab50c12-15e3-41a1-b510-95059e162090 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Returning 404 to user: Instance f1009be4-53ff-4893-836c-ba96f07a0d60 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:43:58.696660 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4ab50c12-15e3-41a1-b510-95059e162090 tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "DELETE /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 404 len: 111 microversion: 2.20 time: 0.055241 Jul 25 14:43:58.704343 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1948/4149] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Jul 25 14:43:58 2022] DELETE /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:43:58.705275 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c74636f3-1b03-432a-aa30-f11aee5fa23a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:58.706361 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c74636f3-1b03-432a-aa30-f11aee5fa23a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] [instance: f1009be4-53ff-4893-836c-ba96f07a0d60] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:58.715436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c74636f3-1b03-432a-aa30-f11aee5fa23a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:58.725854 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c74636f3-1b03-432a-aa30-f11aee5fa23a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:58.727055 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c74636f3-1b03-432a-aa30-f11aee5fa23a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:58.727696 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c74636f3-1b03-432a-aa30-f11aee5fa23a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:59.321578 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-c74636f3-1b03-432a-aa30-f11aee5fa23a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] HTTP exception thrown: Instance f1009be4-53ff-4893-836c-ba96f07a0d60 could not be found. Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c74636f3-1b03-432a-aa30-f11aee5fa23a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Request method failure captured: Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 HTTP/1.1 Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qnnsDwhiwclvLICZx25tvED9QBDR-PsslOWQbR9ercqYi2_4zddmdpuO0rjlUxGuCqoA2Di75m-DhjzNBp3pvZkajTQM1yFPHjYWZ9QDGXdTcW8DZc1mWndfRuL2FmMJYbW-ooe1Vc0n6xMI3jfgRxeT8g7we_MenM44yhkdC3Ly6g Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 973384a032e54cd5bee455a1c6f39725 Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-767538 Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/973384a032e54cd5bee455a1c6f39725"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/973384a032e54cd5bee455a1c6f39725"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_973384a032e54cd5bee455a1c6f39725", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/973384a032e54cd5bee455a1c6f39725"}]}] Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-AttachVolumeShelveTestJSON-767538 Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 973384a032e54cd5bee455a1c6f39725 Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-767538 Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-AttachVolumeShelveTestJSON-767538-project Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 060523597bbb409193f8814648fb40fc Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-AttachVolumeShelveTestJSON-767538-project Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance f1009be4-53ff-4893-836c-ba96f07a0d60 could not be found. Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'f1009be4-53ff-4893-836c-ba96f07a0d60'} Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1009be4-53ff-4893-836c-ba96f07a0d60 could not be found. Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1009be4-53ff-4893-836c-ba96f07a0d60 could not be found. Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:43:59.323391 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:43:59.327471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:43:59.327471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:43:59.327471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:43:59.327471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:43:59.327471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:43:59.327471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1009be4-53ff-4893-836c-ba96f07a0d60 could not be found. Jul 25 14:43:59.327471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:43:59.329241 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c74636f3-1b03-432a-aa30-f11aee5fa23a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] Returning 404 to user: Instance f1009be4-53ff-4893-836c-ba96f07a0d60 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:43:59.330532 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c74636f3-1b03-432a-aa30-f11aee5fa23a tempest-AttachVolumeShelveTestJSON-767538 tempest-AttachVolumeShelveTestJSON-767538-project] 10.222.0.88 "GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60" status: 404 len: 111 microversion: 2.20 time: 0.629855 Jul 25 14:43:59.335225 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2202/4150] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:43:58 2022] GET /compute/v2.1/servers/f1009be4-53ff-4893-836c-ba96f07a0d60 => generated 111 bytes in 635 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:43:59.644428 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2dd70912-ebfe-4abc-9202-7a5f318abc3c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:43:59.645855 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2dd70912-ebfe-4abc-9202-7a5f318abc3c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:43:59.666296 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2dd70912-ebfe-4abc-9202-7a5f318abc3c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:59.666759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2dd70912-ebfe-4abc-9202-7a5f318abc3c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:43:59.667580 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2dd70912-ebfe-4abc-9202-7a5f318abc3c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:43:59.668208 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2dd70912-ebfe-4abc-9202-7a5f318abc3c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:00.318358 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2dd70912-ebfe-4abc-9202-7a5f318abc3c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:00.334101 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2dd70912-ebfe-4abc-9202-7a5f318abc3c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1508 microversion: 2.1 time: 0.694098 Jul 25 14:44:00.347154 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1949/4151] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:43:59 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1508 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:44:01.358367 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f8b7fe84-d452-4117-a5ac-dd49e1582eed tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:01.358951 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f8b7fe84-d452-4117-a5ac-dd49e1582eed tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:01.367730 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8b7fe84-d452-4117-a5ac-dd49e1582eed tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:01.368309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8b7fe84-d452-4117-a5ac-dd49e1582eed tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:01.369161 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8b7fe84-d452-4117-a5ac-dd49e1582eed tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:01.369830 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8b7fe84-d452-4117-a5ac-dd49e1582eed tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:01.915567 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f8b7fe84-d452-4117-a5ac-dd49e1582eed tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:01.961608 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f8b7fe84-d452-4117-a5ac-dd49e1582eed tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1508 microversion: 2.1 time: 0.601588 Jul 25 14:44:01.962539 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2203/4152] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:01 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1508 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:44:02.987400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6ff3f638-c4b8-44af-8b7f-edc0281d3203 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:02.991625 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6ff3f638-c4b8-44af-8b7f-edc0281d3203 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:03.010319 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:44:03.013069 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ff3f638-c4b8-44af-8b7f-edc0281d3203 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:03.013768 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ff3f638-c4b8-44af-8b7f-edc0281d3203 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:03.016059 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ff3f638-c4b8-44af-8b7f-edc0281d3203 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:03.016665 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ff3f638-c4b8-44af-8b7f-edc0281d3203 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:03.817359 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6ff3f638-c4b8-44af-8b7f-edc0281d3203 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:03.843042 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6ff3f638-c4b8-44af-8b7f-edc0281d3203 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1508 microversion: 2.1 time: 0.863770 Jul 25 14:44:03.846365 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1950/4153] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:02 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1508 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:44:04.868886 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4dffdda8-016a-4c71-8214-fe83d31dc3a3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:04.870309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4dffdda8-016a-4c71-8214-fe83d31dc3a3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:04.891821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4dffdda8-016a-4c71-8214-fe83d31dc3a3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:04.892753 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4dffdda8-016a-4c71-8214-fe83d31dc3a3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:04.893953 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4dffdda8-016a-4c71-8214-fe83d31dc3a3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:04.894588 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4dffdda8-016a-4c71-8214-fe83d31dc3a3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:05.543528 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4dffdda8-016a-4c71-8214-fe83d31dc3a3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:05.558251 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4dffdda8-016a-4c71-8214-fe83d31dc3a3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1529 microversion: 2.1 time: 0.693475 Jul 25 14:44:05.574079 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2204/4154] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:04 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1529 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:44:06.587087 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-39815a5c-8c6f-4a43-a3cd-92df696925c4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:06.587708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-39815a5c-8c6f-4a43-a3cd-92df696925c4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:06.606764 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-39815a5c-8c6f-4a43-a3cd-92df696925c4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:06.607476 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-39815a5c-8c6f-4a43-a3cd-92df696925c4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:06.609152 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-39815a5c-8c6f-4a43-a3cd-92df696925c4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:06.609743 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-39815a5c-8c6f-4a43-a3cd-92df696925c4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:07.091325 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-39815a5c-8c6f-4a43-a3cd-92df696925c4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:07.105627 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-39815a5c-8c6f-4a43-a3cd-92df696925c4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1524 microversion: 2.1 time: 0.527826 Jul 25 14:44:07.107658 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1951/4155] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:06 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1524 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:44:08.136157 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e79bd0ad-63cf-4006-8037-1141ddd42473 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:08.137606 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e79bd0ad-63cf-4006-8037-1141ddd42473 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:08.161591 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e79bd0ad-63cf-4006-8037-1141ddd42473 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:08.165024 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e79bd0ad-63cf-4006-8037-1141ddd42473 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:08.167193 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e79bd0ad-63cf-4006-8037-1141ddd42473 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:08.168870 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e79bd0ad-63cf-4006-8037-1141ddd42473 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:08.808824 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-17d8008d-106d-4e63-a53d-344f73e7b22b req-285c37f1-4d28-47f2-a839-810100042e88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a8c9a71-6a5f-4464-a9a6-0a4516f099fa", "name": "network-vif-plugged", "status": "completed", "tag": "4fc0bbca-5331-40df-a5fb-7d979aaef340"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:44:08.830052 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-17d8008d-106d-4e63-a53d-344f73e7b22b req-285c37f1-4d28-47f2-a839-810100042e88 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:08.842135 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-17d8008d-106d-4e63-a53d-344f73e7b22b req-285c37f1-4d28-47f2-a839-810100042e88 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:08.869797 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-17d8008d-106d-4e63-a53d-344f73e7b22b req-285c37f1-4d28-47f2-a839-810100042e88 service nova] Creating event network-vif-plugged:4fc0bbca-5331-40df-a5fb-7d979aaef340 for instance 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa on n-h1-846435-14 Jul 25 14:44:08.880594 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-17d8008d-106d-4e63-a53d-344f73e7b22b req-285c37f1-4d28-47f2-a839-810100042e88 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075226 Jul 25 14:44:08.881252 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1952/4156] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:44:09.119301 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e79bd0ad-63cf-4006-8037-1141ddd42473 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:09.129553 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e79bd0ad-63cf-4006-8037-1141ddd42473 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1524 microversion: 2.1 time: 0.999934 Jul 25 14:44:09.133414 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2205/4157] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:08 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1524 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:44:10.158839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b2dfeaf7-7358-4cd9-926f-bffc518a5f63 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:10.160474 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b2dfeaf7-7358-4cd9-926f-bffc518a5f63 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:10.179944 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b2dfeaf7-7358-4cd9-926f-bffc518a5f63 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:10.180432 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b2dfeaf7-7358-4cd9-926f-bffc518a5f63 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:10.187728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b2dfeaf7-7358-4cd9-926f-bffc518a5f63 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:10.195729 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b2dfeaf7-7358-4cd9-926f-bffc518a5f63 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:10.811888 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b2dfeaf7-7358-4cd9-926f-bffc518a5f63 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:10.829763 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b2dfeaf7-7358-4cd9-926f-bffc518a5f63 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1524 microversion: 2.1 time: 0.675851 Jul 25 14:44:10.857133 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1953/4158] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:10 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1524 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:44:11.877348 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b4fdaf1e-2373-424d-ad4a-594cdc48f420 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:11.877901 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b4fdaf1e-2373-424d-ad4a-594cdc48f420 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:11.894126 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b4fdaf1e-2373-424d-ad4a-594cdc48f420 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:11.899617 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b4fdaf1e-2373-424d-ad4a-594cdc48f420 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:11.903033 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b4fdaf1e-2373-424d-ad4a-594cdc48f420 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:11.908108 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b4fdaf1e-2373-424d-ad4a-594cdc48f420 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:13.682772 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b4fdaf1e-2373-424d-ad4a-594cdc48f420 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:13.691167 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b4fdaf1e-2373-424d-ad4a-594cdc48f420 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1524 microversion: 2.1 time: 1.818558 Jul 25 14:44:13.708202 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2206/4159] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:11 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1524 bytes in 1826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:44:14.729493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0e0a45d9-5107-4e4f-9434-b39a95bf9888 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:14.730411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0e0a45d9-5107-4e4f-9434-b39a95bf9888 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:14.761756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e0a45d9-5107-4e4f-9434-b39a95bf9888 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:14.762216 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e0a45d9-5107-4e4f-9434-b39a95bf9888 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:14.780257 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e0a45d9-5107-4e4f-9434-b39a95bf9888 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:14.781198 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e0a45d9-5107-4e4f-9434-b39a95bf9888 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:14.790952 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=86 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:44:15.526978 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0e0a45d9-5107-4e4f-9434-b39a95bf9888 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:15.548624 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0e0a45d9-5107-4e4f-9434-b39a95bf9888 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1524 microversion: 2.1 time: 0.825383 Jul 25 14:44:15.565244 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1954/4160] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:14 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1524 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:44:16.579828 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-aafd8ac7-1f98-49e0-b309-46eabf3fbb46 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:16.581645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-aafd8ac7-1f98-49e0-b309-46eabf3fbb46 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:16.595790 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=34 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:44:16.602094 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aafd8ac7-1f98-49e0-b309-46eabf3fbb46 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:16.606267 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aafd8ac7-1f98-49e0-b309-46eabf3fbb46 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:16.610594 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aafd8ac7-1f98-49e0-b309-46eabf3fbb46 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:16.613522 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aafd8ac7-1f98-49e0-b309-46eabf3fbb46 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:17.675049 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-aafd8ac7-1f98-49e0-b309-46eabf3fbb46 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:17.690518 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-aafd8ac7-1f98-49e0-b309-46eabf3fbb46 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1524 microversion: 2.1 time: 1.121677 Jul 25 14:44:17.691166 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2207/4161] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:16 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1524 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:44:18.715004 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4c0aa450-37d5-4d1a-ba6e-501e527b20f4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:18.715714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4c0aa450-37d5-4d1a-ba6e-501e527b20f4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:18.731490 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c0aa450-37d5-4d1a-ba6e-501e527b20f4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:18.731931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c0aa450-37d5-4d1a-ba6e-501e527b20f4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:18.735063 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c0aa450-37d5-4d1a-ba6e-501e527b20f4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:18.735523 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c0aa450-37d5-4d1a-ba6e-501e527b20f4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:19.984230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4c0aa450-37d5-4d1a-ba6e-501e527b20f4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:19.998265 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4c0aa450-37d5-4d1a-ba6e-501e527b20f4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1524 microversion: 2.1 time: 1.287208 Jul 25 14:44:20.017711 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1955/4162] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:18 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1524 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:44:21.025126 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6321e505-25ad-40e7-843d-255cae64dede tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:21.025853 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6321e505-25ad-40e7-843d-255cae64dede tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:21.043040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6321e505-25ad-40e7-843d-255cae64dede tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:21.043310 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6321e505-25ad-40e7-843d-255cae64dede tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:21.043905 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6321e505-25ad-40e7-843d-255cae64dede tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:21.044398 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6321e505-25ad-40e7-843d-255cae64dede tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:22.071545 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6321e505-25ad-40e7-843d-255cae64dede tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:22.081236 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6321e505-25ad-40e7-843d-255cae64dede tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1524 microversion: 2.1 time: 1.060038 Jul 25 14:44:22.101057 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2208/4163] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:21 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1524 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:44:23.116444 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-440c2aa9-ae4f-4f0d-ab50-629bf3043574 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:23.117663 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-440c2aa9-ae4f-4f0d-ab50-629bf3043574 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:23.129950 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-440c2aa9-ae4f-4f0d-ab50-629bf3043574 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:23.132561 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-440c2aa9-ae4f-4f0d-ab50-629bf3043574 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:23.133579 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-440c2aa9-ae4f-4f0d-ab50-629bf3043574 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:23.134189 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-440c2aa9-ae4f-4f0d-ab50-629bf3043574 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:23.617399 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-440c2aa9-ae4f-4f0d-ab50-629bf3043574 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:23.640908 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-440c2aa9-ae4f-4f0d-ab50-629bf3043574 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1524 microversion: 2.1 time: 0.531495 Jul 25 14:44:23.642131 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1956/4164] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:23 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1524 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:44:24.663435 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e3fcf374-d9e1-47d5-bcbb-e52ed9953901 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:24.664102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e3fcf374-d9e1-47d5-bcbb-e52ed9953901 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:24.674976 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3fcf374-d9e1-47d5-bcbb-e52ed9953901 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:24.675433 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3fcf374-d9e1-47d5-bcbb-e52ed9953901 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:24.676239 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3fcf374-d9e1-47d5-bcbb-e52ed9953901 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:24.676677 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3fcf374-d9e1-47d5-bcbb-e52ed9953901 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:26.042046 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e3fcf374-d9e1-47d5-bcbb-e52ed9953901 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:26.062028 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e3fcf374-d9e1-47d5-bcbb-e52ed9953901 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1524 microversion: 2.1 time: 1.402402 Jul 25 14:44:26.077861 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2209/4165] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:24 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1524 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:44:26.747539 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b50d106e-1b91-4566-902f-b96d7a0e9d57 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:26.749050 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b50d106e-1b91-4566-902f-b96d7a0e9d57 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:26.767575 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b50d106e-1b91-4566-902f-b96d7a0e9d57 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:26.772646 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b50d106e-1b91-4566-902f-b96d7a0e9d57 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:26.778788 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b50d106e-1b91-4566-902f-b96d7a0e9d57 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:26.781057 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b50d106e-1b91-4566-902f-b96d7a0e9d57 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:26.860914 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b50d106e-1b91-4566-902f-b96d7a0e9d57 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850/ips" status: 200 len: 145 microversion: 2.1 time: 0.118867 Jul 25 14:44:26.865347 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1957/4166] 10.222.0.88 () {58 vars in 1248 bytes} [Mon Jul 25 14:44:26 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850/ips => generated 145 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:44:27.102839 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dcb895a4-2c87-43da-9684-ab79ff9175d4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:27.105106 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dcb895a4-2c87-43da-9684-ab79ff9175d4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:27.118133 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dcb895a4-2c87-43da-9684-ab79ff9175d4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:27.124769 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dcb895a4-2c87-43da-9684-ab79ff9175d4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:27.128457 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dcb895a4-2c87-43da-9684-ab79ff9175d4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:27.131486 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dcb895a4-2c87-43da-9684-ab79ff9175d4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:28.638976 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dcb895a4-2c87-43da-9684-ab79ff9175d4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:28.641994 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=51 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:44:28.659043 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dcb895a4-2c87-43da-9684-ab79ff9175d4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1524 microversion: 2.1 time: 1.561211 Jul 25 14:44:28.681180 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2210/4167] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:27 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1524 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:44:29.692275 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-35d62fd4-e399-4bcc-9562-2a17e878136c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:29.693455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-35d62fd4-e399-4bcc-9562-2a17e878136c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:29.711896 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-35d62fd4-e399-4bcc-9562-2a17e878136c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:29.712640 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-35d62fd4-e399-4bcc-9562-2a17e878136c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:29.716559 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-35d62fd4-e399-4bcc-9562-2a17e878136c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:29.717207 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-35d62fd4-e399-4bcc-9562-2a17e878136c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:31.188961 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-35d62fd4-e399-4bcc-9562-2a17e878136c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:31.206952 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-35d62fd4-e399-4bcc-9562-2a17e878136c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1524 microversion: 2.1 time: 1.521098 Jul 25 14:44:31.220766 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1958/4168] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:29 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1524 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:44:31.303250 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7f70b3b9-0331-44b6-965f-41aa083790b8 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18f0b530-12b5-4521-ac8c-44e31e5eed17"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:44:31.305757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7f70b3b9-0331-44b6-965f-41aa083790b8 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:31.319230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7f70b3b9-0331-44b6-965f-41aa083790b8 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:31.319694 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7f70b3b9-0331-44b6-965f-41aa083790b8 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:31.320527 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7f70b3b9-0331-44b6-965f-41aa083790b8 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:31.321290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7f70b3b9-0331-44b6-965f-41aa083790b8 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:31.858010 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7f70b3b9-0331-44b6-965f-41aa083790b8 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "POST /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.559022 Jul 25 14:44:31.863449 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2211/4169] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Jul 25 14:44:31 2022] POST /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850/os-volume_attachments => generated 194 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:44:32.232904 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a233a7e6-cc5c-4ee4-94fe-3bad161879ab tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:32.234665 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a233a7e6-cc5c-4ee4-94fe-3bad161879ab tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:32.253045 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a233a7e6-cc5c-4ee4-94fe-3bad161879ab tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:32.254786 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a233a7e6-cc5c-4ee4-94fe-3bad161879ab tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:32.267750 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a233a7e6-cc5c-4ee4-94fe-3bad161879ab tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:32.268516 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a233a7e6-cc5c-4ee4-94fe-3bad161879ab tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:33.954560 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a233a7e6-cc5c-4ee4-94fe-3bad161879ab tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:33.972744 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a233a7e6-cc5c-4ee4-94fe-3bad161879ab tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1524 microversion: 2.1 time: 1.743926 Jul 25 14:44:33.976969 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1959/4170] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:32 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1524 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:44:35.005659 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cc5c835c-9f00-4374-af3a-31ccda490ab6 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:35.007767 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cc5c835c-9f00-4374-af3a-31ccda490ab6 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:35.051533 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cc5c835c-9f00-4374-af3a-31ccda490ab6 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:35.052180 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cc5c835c-9f00-4374-af3a-31ccda490ab6 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:35.053121 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cc5c835c-9f00-4374-af3a-31ccda490ab6 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:35.053708 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cc5c835c-9f00-4374-af3a-31ccda490ab6 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:36.211291 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cc5c835c-9f00-4374-af3a-31ccda490ab6 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:36.224912 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cc5c835c-9f00-4374-af3a-31ccda490ab6 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1524 microversion: 2.1 time: 1.225274 Jul 25 14:44:36.226449 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2212/4171] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:34 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1524 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:44:37.250479 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b61f37c6-cf73-4bef-9b95-48613b2cee6d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:37.251748 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b61f37c6-cf73-4bef-9b95-48613b2cee6d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:37.265610 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=20 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:44:37.270737 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b61f37c6-cf73-4bef-9b95-48613b2cee6d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:37.273748 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b61f37c6-cf73-4bef-9b95-48613b2cee6d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:37.274726 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b61f37c6-cf73-4bef-9b95-48613b2cee6d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:37.278367 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b61f37c6-cf73-4bef-9b95-48613b2cee6d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:38.347961 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bbb1f2ca-2cbf-4cae-ba1d-168dfcc0155c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Action: 'create', calling method: .version_select at 0x7f468612c5e0>, body: {"keypair": {"name": "tempest-keypair-131251117", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHF/GzEZkhM+4BKZFVVPm60NPpTaWsbwvUD0K3SKkMtujpR8Warfh2YR+5yeojOP4KwPZJz2kRuSmHN668vy3wMtmmueEVujRwVGjYfm6mJ0ws4fVwJDI5PlDpPcSTxqlQ=="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:44:38.388229 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-bbb1f2ca-2cbf-4cae-ba1d-168dfcc0155c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Getting quotas for project 325aff76e61141a985b3b0f45521444f. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:44:38.434720 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-bbb1f2ca-2cbf-4cae-ba1d-168dfcc0155c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Getting quotas for user 571a2d92d7a34f86bb3c0bfdfcabc5ff and project 325aff76e61141a985b3b0f45521444f. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:44:38.545397 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bbb1f2ca-2cbf-4cae-ba1d-168dfcc0155c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.583256 Jul 25 14:44:38.559421 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2213/4172] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:44:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:44:38.746541 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b61f37c6-cf73-4bef-9b95-48613b2cee6d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:38.776948 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b61f37c6-cf73-4bef-9b95-48613b2cee6d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1506 microversion: 2.1 time: 1.533231 Jul 25 14:44:38.781716 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1960/4173] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:37 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1506 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:44:39.819898 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0ce56149-bfa5-4993-a1e1-13bdd793f2ff tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:39.820683 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0ce56149-bfa5-4993-a1e1-13bdd793f2ff tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:39.842791 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0ce56149-bfa5-4993-a1e1-13bdd793f2ff tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:39.844056 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0ce56149-bfa5-4993-a1e1-13bdd793f2ff tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:39.847503 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0ce56149-bfa5-4993-a1e1-13bdd793f2ff tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:39.849588 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0ce56149-bfa5-4993-a1e1-13bdd793f2ff tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:41.146777 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0ce56149-bfa5-4993-a1e1-13bdd793f2ff tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:41.186706 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0ce56149-bfa5-4993-a1e1-13bdd793f2ff tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1506 microversion: 2.1 time: 1.375371 Jul 25 14:44:41.188393 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2214/4174] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:39 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1506 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:44:41.660431 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-6a08a292-9fd5-40d8-a59b-83c118a666ce req-763a282c-9bcb-4b4c-88fb-28a222eea8ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a8c9a71-6a5f-4464-a9a6-0a4516f099fa", "name": "network-vif-unplugged", "status": "completed", "tag": "4fc0bbca-5331-40df-a5fb-7d979aaef340"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:44:41.677932 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-6a08a292-9fd5-40d8-a59b-83c118a666ce req-763a282c-9bcb-4b4c-88fb-28a222eea8ca service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:41.678539 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-6a08a292-9fd5-40d8-a59b-83c118a666ce req-763a282c-9bcb-4b4c-88fb-28a222eea8ca service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:41.706898 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.compute.server_external_events [req-6a08a292-9fd5-40d8-a59b-83c118a666ce req-763a282c-9bcb-4b4c-88fb-28a222eea8ca service nova] Unable to find a host for instance 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa. Dropping event network-vif-unplugged {{(pid=119303) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 25 14:44:41.712648 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-6a08a292-9fd5-40d8-a59b-83c118a666ce req-763a282c-9bcb-4b4c-88fb-28a222eea8ca service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.059903 Jul 25 14:44:41.714010 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1961/4175] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 66 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 25 14:44:42.221436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ee231faa-1ced-4957-8968-2d7d21bc6798 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:42.222210 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ee231faa-1ced-4957-8968-2d7d21bc6798 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:42.255615 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee231faa-1ced-4957-8968-2d7d21bc6798 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:42.257209 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee231faa-1ced-4957-8968-2d7d21bc6798 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:42.258743 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee231faa-1ced-4957-8968-2d7d21bc6798 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:42.260289 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee231faa-1ced-4957-8968-2d7d21bc6798 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:43.239213 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1dab4305-f7eb-4dde-8a71-98689f5a85c1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-445502135", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b6c60dc-780d-4845-b966-40a7e9d46848"}], "security_groups": [{"name": "tempest-securitygroup--858360507"}], "key_name": "tempest-keypair-131251117", "user_data": "}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:44:43.655860 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-1dab4305-f7eb-4dde-8a71-98689f5a85c1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] validate_networks() for [('4b6c60dc-780d-4845-b966-40a7e9d46848', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:44:43.903378 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ee231faa-1ced-4957-8968-2d7d21bc6798 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:43.918626 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ee231faa-1ced-4957-8968-2d7d21bc6798 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 200 len: 1449 microversion: 2.1 time: 1.702809 Jul 25 14:44:43.919796 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2215/4176] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:42 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 1449 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:44:43.959057 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-83cda799-1169-4872-ab5e-98be24b6684f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:43.960109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-83cda799-1169-4872-ab5e-98be24b6684f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:43.978255 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83cda799-1169-4872-ab5e-98be24b6684f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:43.979095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83cda799-1169-4872-ab5e-98be24b6684f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:43.980299 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83cda799-1169-4872-ab5e-98be24b6684f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:43.980972 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83cda799-1169-4872-ab5e-98be24b6684f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:44.063790 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-83cda799-1169-4872-ab5e-98be24b6684f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:44:44.081742 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.compute.api [None req-83cda799-1169-4872-ab5e-98be24b6684f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Working on deleting snapshot 4cbf7c72-cd51-42dd-a188-bb62ed0deb39 from shelved instance... Jul 25 14:44:45.203477 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-1dab4305-f7eb-4dde-8a71-98689f5a85c1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:44:45.204485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-1dab4305-f7eb-4dde-8a71-98689f5a85c1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:44:45.205120 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-1dab4305-f7eb-4dde-8a71-98689f5a85c1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:44:45.206294 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-1dab4305-f7eb-4dde-8a71-98689f5a85c1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:44:45.207130 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-1dab4305-f7eb-4dde-8a71-98689f5a85c1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:44:45.237236 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1dab4305-f7eb-4dde-8a71-98689f5a85c1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:45.239370 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1dab4305-f7eb-4dde-8a71-98689f5a85c1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:45.241080 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1dab4305-f7eb-4dde-8a71-98689f5a85c1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:45.244772 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1dab4305-f7eb-4dde-8a71-98689f5a85c1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:45.303240 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=42 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:44:45.354483 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-1dab4305-f7eb-4dde-8a71-98689f5a85c1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Getting quotas for project 325aff76e61141a985b3b0f45521444f. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:44:45.384242 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-1dab4305-f7eb-4dde-8a71-98689f5a85c1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Getting quotas for user 571a2d92d7a34f86bb3c0bfdfcabc5ff and project 325aff76e61141a985b3b0f45521444f. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:44:45.461038 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1dab4305-f7eb-4dde-8a71-98689f5a85c1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:44:45.467131 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-83cda799-1169-4872-ab5e-98be24b6684f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Doing local delete in cell cadb07ed-5464-41eb-afb8-bf9dd92401b6(cell1) {{(pid=119304) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 25 14:44:45.468003 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83cda799-1169-4872-ab5e-98be24b6684f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:45.468467 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83cda799-1169-4872-ab5e-98be24b6684f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:45.470320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1dab4305-f7eb-4dde-8a71-98689f5a85c1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:44:45.476067 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.compute.api [None req-83cda799-1169-4872-ab5e-98be24b6684f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 25 14:44:45.486997 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-83cda799-1169-4872-ab5e-98be24b6684f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] deallocate_for_instance() {{(pid=119304) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 25 14:44:45.594508 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1dab4305-f7eb-4dde-8a71-98689f5a85c1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.360538 Jul 25 14:44:45.604522 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1962/4177] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:44:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 2371 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 14:44:45.616992 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2b187fd4-7138-4272-bd79-2dfaaa349932 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:45.622232 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2b187fd4-7138-4272-bd79-2dfaaa349932 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:45.723001 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2b187fd4-7138-4272-bd79-2dfaaa349932 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:45.735082 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2b187fd4-7138-4272-bd79-2dfaaa349932 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4" status: 200 len: 1240 microversion: 2.1 time: 0.128883 Jul 25 14:44:45.749516 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1963/4178] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:45 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4 => generated 1240 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:44:46.759134 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-27e8baf5-3414-4aa7-b781-4292fa2873d4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:46.759782 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-27e8baf5-3414-4aa7-b781-4292fa2873d4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:46.768526 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27e8baf5-3414-4aa7-b781-4292fa2873d4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:46.780890 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27e8baf5-3414-4aa7-b781-4292fa2873d4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:46.784753 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27e8baf5-3414-4aa7-b781-4292fa2873d4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:46.785218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27e8baf5-3414-4aa7-b781-4292fa2873d4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:47.168488 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-27e8baf5-3414-4aa7-b781-4292fa2873d4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:47.180786 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-27e8baf5-3414-4aa7-b781-4292fa2873d4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4" status: 200 len: 1236 microversion: 2.1 time: 0.425607 Jul 25 14:44:47.181247 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1964/4179] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:46 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4 => generated 1236 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:44:48.207906 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-767198d2-ae77-4a74-8c96-1e8b889d4978 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:48.210033 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-767198d2-ae77-4a74-8c96-1e8b889d4978 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:48.224467 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-767198d2-ae77-4a74-8c96-1e8b889d4978 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:48.225639 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-767198d2-ae77-4a74-8c96-1e8b889d4978 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:48.226748 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-767198d2-ae77-4a74-8c96-1e8b889d4978 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:48.227433 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-767198d2-ae77-4a74-8c96-1e8b889d4978 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:48.459490 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=4 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:44:48.497977 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-767198d2-ae77-4a74-8c96-1e8b889d4978 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:48.516441 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-767198d2-ae77-4a74-8c96-1e8b889d4978 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4" status: 200 len: 1298 microversion: 2.1 time: 0.314888 Jul 25 14:44:48.520136 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1965/4180] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:48 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4 => generated 1298 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:44:48.857960 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-83cda799-1169-4872-ab5e-98be24b6684f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Updating instance_info_cache with network_info: [] {{(pid=119304) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 14:44:48.862471 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-0d4da60b-faf5-416b-b43f-005d3ea9f3bb req-5c371012-ad79-4ab1-8f2e-1fae4c41e778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a8c9a71-6a5f-4464-a9a6-0a4516f099fa", "name": "network-vif-deleted", "tag": "4fc0bbca-5331-40df-a5fb-7d979aaef340"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:44:48.879888 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-0d4da60b-faf5-416b-b43f-005d3ea9f3bb req-5c371012-ad79-4ab1-8f2e-1fae4c41e778 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:48.880766 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-0d4da60b-faf5-416b-b43f-005d3ea9f3bb req-5c371012-ad79-4ab1-8f2e-1fae4c41e778 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:48.909419 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.compute.server_external_events [req-0d4da60b-faf5-416b-b43f-005d3ea9f3bb req-5c371012-ad79-4ab1-8f2e-1fae4c41e778 service nova] Unable to find a host for instance 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa. Dropping event network-vif-deleted {{(pid=119303) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 25 14:44:48.912103 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-0d4da60b-faf5-416b-b43f-005d3ea9f3bb req-5c371012-ad79-4ab1-8f2e-1fae4c41e778 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.056006 Jul 25 14:44:48.913507 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1966/4181] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 59 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 25 14:44:49.508951 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:44:49.540897 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0b030da3-ff5a-454d-9696-78faf718a4ad tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:49.542213 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0b030da3-ff5a-454d-9696-78faf718a4ad tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:49.568144 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b030da3-ff5a-454d-9696-78faf718a4ad tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:49.569796 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b030da3-ff5a-454d-9696-78faf718a4ad tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:49.575034 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b030da3-ff5a-454d-9696-78faf718a4ad tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:49.575498 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b030da3-ff5a-454d-9696-78faf718a4ad tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:49.651669 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-83cda799-1169-4872-ab5e-98be24b6684f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "DELETE /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 204 len: 0 microversion: 2.1 time: 5.696117 Jul 25 14:44:49.658772 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2216/4182] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:44:43 2022] DELETE /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 0 bytes in 5700 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:44:49.675208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3064a43c-1393-4afc-96b4-4c43db5db277 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:49.677392 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3064a43c-1393-4afc-96b4-4c43db5db277 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:49.689144 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3064a43c-1393-4afc-96b4-4c43db5db277 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:49.689784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3064a43c-1393-4afc-96b4-4c43db5db277 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:49.690654 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3064a43c-1393-4afc-96b4-4c43db5db277 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:49.691425 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3064a43c-1393-4afc-96b4-4c43db5db277 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:49.709676 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-3064a43c-1393-4afc-96b4-4c43db5db277 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] HTTP exception thrown: Instance 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa could not be found. Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3064a43c-1393-4afc-96b4-4c43db5db277 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Request method failure captured: Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa HTTP/1.1 Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3quERREaOs3Kc7iY1Vh9GKraPJ63kqwGO_-k7wXB_J3XVEfBf3LNTXeHb07R82UwUNgvRdojb21TsSuL636LebhCUID5TJuapIn-Sgeh4nT2_p48qkoLx6k1MrIDkEY7ueSXXEfRqNxtsyFtJzfjwKFOLGr5sudf0H8jELBV5u89FK0 Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b9b1c620d0b14a3a9471515cf47d6944", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b9b1c620d0b14a3a9471515cf47d6944"}]}] Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 33f992249063495c8bf12954afd9e8b7 Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa could not be found. Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '6a8c9a71-6a5f-4464-a9a6-0a4516f099fa'} Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa could not be found. Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa could not be found. Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:44:49.711858 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:44:49.716219 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:44:49.716219 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:44:49.716219 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:44:49.716219 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:44:49.716219 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:44:49.716219 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa could not be found. Jul 25 14:44:49.716219 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:44:49.716219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3064a43c-1393-4afc-96b4-4c43db5db277 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Returning 404 to user: Instance 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:44:49.716219 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3064a43c-1393-4afc-96b4-4c43db5db277 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 404 len: 111 microversion: 2.1 time: 0.053749 Jul 25 14:44:49.716219 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2217/4183] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:49 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:44:49.773364 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0b030da3-ff5a-454d-9696-78faf718a4ad tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:49.783951 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0b030da3-ff5a-454d-9696-78faf718a4ad tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4" status: 200 len: 1298 microversion: 2.1 time: 0.246835 Jul 25 14:44:49.789621 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1967/4184] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:49 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4 => generated 1298 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:44:49.934202 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7643c298-f121-4e2a-853f-b0f1e0975b4e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-188738118", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "e81cd55f-4951-41ed-b82a-173584e324cb"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:44:50.071659 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-7643c298-f121-4e2a-853f-b0f1e0975b4e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] validate_networks() for [('e81cd55f-4951-41ed-b82a-173584e324cb', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:44:50.813809 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-573d9d40-b37f-4bab-b877-fdfacde89817 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:50.815722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-573d9d40-b37f-4bab-b877-fdfacde89817 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:50.836507 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-573d9d40-b37f-4bab-b877-fdfacde89817 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:50.838379 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-573d9d40-b37f-4bab-b877-fdfacde89817 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:50.839248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-573d9d40-b37f-4bab-b877-fdfacde89817 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:50.839682 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-573d9d40-b37f-4bab-b877-fdfacde89817 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:51.487497 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-573d9d40-b37f-4bab-b877-fdfacde89817 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:51.511041 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-573d9d40-b37f-4bab-b877-fdfacde89817 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4" status: 200 len: 1365 microversion: 2.1 time: 0.702286 Jul 25 14:44:51.512320 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1968/4185] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:50 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4 => generated 1365 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:44:51.770611 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c593df0a-3d5d-41f6-8234-f355a5bf12c2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:44:51.785857 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c593df0a-3d5d-41f6-8234-f355a5bf12c2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:51.786414 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c593df0a-3d5d-41f6-8234-f355a5bf12c2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:51.868722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c593df0a-3d5d-41f6-8234-f355a5bf12c2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Going to try to stop instance {{(pid=119303) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 14:44:51.972887 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c593df0a-3d5d-41f6-8234-f355a5bf12c2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "POST /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850/action" status: 202 len: 0 microversion: 2.1 time: 0.210669 Jul 25 14:44:51.978419 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1969/4186] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:44:51 2022] POST /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 14:44:51.996995 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-370f16a4-04a1-4752-a77c-7a1429a34773 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:52.002469 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-370f16a4-04a1-4752-a77c-7a1429a34773 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:52.018731 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-370f16a4-04a1-4752-a77c-7a1429a34773 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:52.021715 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-370f16a4-04a1-4752-a77c-7a1429a34773 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:52.024339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-370f16a4-04a1-4752-a77c-7a1429a34773 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:52.025606 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-370f16a4-04a1-4752-a77c-7a1429a34773 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:52.442244 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-370f16a4-04a1-4752-a77c-7a1429a34773 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:52.459046 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-370f16a4-04a1-4752-a77c-7a1429a34773 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1723 microversion: 2.1 time: 0.477009 Jul 25 14:44:52.459654 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1970/4187] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:51 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1723 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:44:52.533738 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f347ae8f-3db1-4415-800c-8c9c27fda366 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:52.534426 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f347ae8f-3db1-4415-800c-8c9c27fda366 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:52.544925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f347ae8f-3db1-4415-800c-8c9c27fda366 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:52.547476 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f347ae8f-3db1-4415-800c-8c9c27fda366 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:52.548391 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f347ae8f-3db1-4415-800c-8c9c27fda366 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:52.548840 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f347ae8f-3db1-4415-800c-8c9c27fda366 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:53.156026 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-7643c298-f121-4e2a-853f-b0f1e0975b4e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:44:53.159703 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-7643c298-f121-4e2a-853f-b0f1e0975b4e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:44:53.160235 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-7643c298-f121-4e2a-853f-b0f1e0975b4e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:44:53.160656 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-7643c298-f121-4e2a-853f-b0f1e0975b4e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:44:53.161075 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-7643c298-f121-4e2a-853f-b0f1e0975b4e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:44:53.190653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7643c298-f121-4e2a-853f-b0f1e0975b4e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:53.191365 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7643c298-f121-4e2a-853f-b0f1e0975b4e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:53.192381 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7643c298-f121-4e2a-853f-b0f1e0975b4e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:53.194267 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7643c298-f121-4e2a-853f-b0f1e0975b4e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:53.273554 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-7643c298-f121-4e2a-853f-b0f1e0975b4e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Getting quotas for project b9b1c620d0b14a3a9471515cf47d6944. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:44:53.289696 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f347ae8f-3db1-4415-800c-8c9c27fda366 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:53.296180 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-7643c298-f121-4e2a-853f-b0f1e0975b4e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Getting quotas for user 33f992249063495c8bf12954afd9e8b7 and project b9b1c620d0b14a3a9471515cf47d6944. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:44:53.300545 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f347ae8f-3db1-4415-800c-8c9c27fda366 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4" status: 200 len: 1365 microversion: 2.1 time: 0.769809 Jul 25 14:44:53.306226 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1971/4188] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:52 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4 => generated 1365 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:44:53.311365 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-428f646d-6820-4139-9978-7c6ef7124d49 req-a3372d37-c84c-4338-9b83-9c5d8c572223 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d038cc3-67d7-4ac0-93bd-e668700cd3b4", "tag": "368a556a-b701-43a9-866d-cbb400f29ea0"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:44:53.335284 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-428f646d-6820-4139-9978-7c6ef7124d49 req-a3372d37-c84c-4338-9b83-9c5d8c572223 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:53.335284 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-428f646d-6820-4139-9978-7c6ef7124d49 req-a3372d37-c84c-4338-9b83-9c5d8c572223 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:53.347953 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7643c298-f121-4e2a-853f-b0f1e0975b4e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:44:53.360757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7643c298-f121-4e2a-853f-b0f1e0975b4e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:44:53.362291 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-428f646d-6820-4139-9978-7c6ef7124d49 req-a3372d37-c84c-4338-9b83-9c5d8c572223 service nova] Creating event network-changed:368a556a-b701-43a9-866d-cbb400f29ea0 for instance 5d038cc3-67d7-4ac0-93bd-e668700cd3b4 on n-h1-846435-14 Jul 25 14:44:53.377318 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-428f646d-6820-4139-9978-7c6ef7124d49 req-a3372d37-c84c-4338-9b83-9c5d8c572223 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069407 Jul 25 14:44:53.378382 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1972/4189] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:44:53.458296 n-d-846435-14 devstack@n-api.service[119304]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7643c298-f121-4e2a-853f-b0f1e0975b4e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [5d85163f-80e6-4395-b352-227aabfe882f] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 14:44:53.485828 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-51eb2384-ecce-4d8b-a63f-cbac9ee735ec tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:53.486604 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-51eb2384-ecce-4d8b-a63f-cbac9ee735ec tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:53.504205 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-51eb2384-ecce-4d8b-a63f-cbac9ee735ec tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:53.505705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-51eb2384-ecce-4d8b-a63f-cbac9ee735ec tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:53.506675 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-51eb2384-ecce-4d8b-a63f-cbac9ee735ec tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:53.507281 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-51eb2384-ecce-4d8b-a63f-cbac9ee735ec tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:54.116767 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-51eb2384-ecce-4d8b-a63f-cbac9ee735ec tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:54.133228 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-51eb2384-ecce-4d8b-a63f-cbac9ee735ec tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1723 microversion: 2.1 time: 0.652289 Jul 25 14:44:54.147901 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1973/4190] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:53 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1723 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:44:54.322920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fc4e2601-3827-49d2-bd94-841ff120b826 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:54.323646 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fc4e2601-3827-49d2-bd94-841ff120b826 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:54.342570 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fc4e2601-3827-49d2-bd94-841ff120b826 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:54.343284 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fc4e2601-3827-49d2-bd94-841ff120b826 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:54.344249 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fc4e2601-3827-49d2-bd94-841ff120b826 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:54.344825 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fc4e2601-3827-49d2-bd94-841ff120b826 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:54.476438 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [None req-7643c298-f121-4e2a-853f-b0f1e0975b4e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [5d85163f-80e6-4395-b352-227aabfe882f] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 34884. Jul 25 14:44:54.483059 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7643c298-f121-4e2a-853f-b0f1e0975b4e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.552992 Jul 25 14:44:54.484389 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2218/4191] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:44:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 4555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:44:54.498247 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2fe79002-faf5-4439-a9bb-65bf14cf91f1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:54.502074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2fe79002-faf5-4439-a9bb-65bf14cf91f1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:54.744370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2fe79002-faf5-4439-a9bb-65bf14cf91f1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:54.763250 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2fe79002-faf5-4439-a9bb-65bf14cf91f1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1214 microversion: 2.1 time: 0.266740 Jul 25 14:44:54.768009 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2219/4192] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:54 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1214 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:44:55.155872 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f3b9971d-8308-4489-9d2a-bd7dfb9626a3 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:55.156531 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f3b9971d-8308-4489-9d2a-bd7dfb9626a3 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:55.171760 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f3b9971d-8308-4489-9d2a-bd7dfb9626a3 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:55.172249 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f3b9971d-8308-4489-9d2a-bd7dfb9626a3 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:55.173152 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f3b9971d-8308-4489-9d2a-bd7dfb9626a3 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:55.173598 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f3b9971d-8308-4489-9d2a-bd7dfb9626a3 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:55.286915 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:44:55.332157 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fc4e2601-3827-49d2-bd94-841ff120b826 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:55.362876 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fc4e2601-3827-49d2-bd94-841ff120b826 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4" status: 200 len: 1365 microversion: 2.1 time: 1.043828 Jul 25 14:44:55.363624 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1974/4193] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:54 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4 => generated 1365 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:44:55.662375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f3b9971d-8308-4489-9d2a-bd7dfb9626a3 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:55.683310 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f3b9971d-8308-4489-9d2a-bd7dfb9626a3 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1723 microversion: 2.1 time: 0.532186 Jul 25 14:44:55.685145 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2220/4194] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:55 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1723 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:44:55.800682 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0a89bd70-e7a5-45cb-adad-b5ca6d5a3c82 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:55.801605 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0a89bd70-e7a5-45cb-adad-b5ca6d5a3c82 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:55.818055 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=8 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:44:55.829115 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0a89bd70-e7a5-45cb-adad-b5ca6d5a3c82 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:55.831093 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0a89bd70-e7a5-45cb-adad-b5ca6d5a3c82 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:55.840910 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0a89bd70-e7a5-45cb-adad-b5ca6d5a3c82 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:55.841701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0a89bd70-e7a5-45cb-adad-b5ca6d5a3c82 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:56.384510 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-750d9570-8a75-412e-a173-833b28f0cc12 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:56.385947 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-750d9570-8a75-412e-a173-833b28f0cc12 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:56.414910 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-750d9570-8a75-412e-a173-833b28f0cc12 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:56.417499 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-750d9570-8a75-412e-a173-833b28f0cc12 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:56.422549 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-750d9570-8a75-412e-a173-833b28f0cc12 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:56.423069 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-750d9570-8a75-412e-a173-833b28f0cc12 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:56.493172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0a89bd70-e7a5-45cb-adad-b5ca6d5a3c82 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:56.514004 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0a89bd70-e7a5-45cb-adad-b5ca6d5a3c82 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1210 microversion: 2.1 time: 0.723245 Jul 25 14:44:56.521044 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1975/4195] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:55 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1210 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:44:56.706267 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-00b09377-7e8a-4454-ac6b-3b6a214e0917 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:56.707778 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-00b09377-7e8a-4454-ac6b-3b6a214e0917 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:56.715419 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00b09377-7e8a-4454-ac6b-3b6a214e0917 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:56.716262 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00b09377-7e8a-4454-ac6b-3b6a214e0917 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:56.718068 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00b09377-7e8a-4454-ac6b-3b6a214e0917 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:56.719089 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00b09377-7e8a-4454-ac6b-3b6a214e0917 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:57.148359 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-750d9570-8a75-412e-a173-833b28f0cc12 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:57.161180 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-750d9570-8a75-412e-a173-833b28f0cc12 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4" status: 200 len: 1365 microversion: 2.1 time: 0.778072 Jul 25 14:44:57.172629 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2221/4196] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:56 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4 => generated 1365 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:44:57.505182 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-00b09377-7e8a-4454-ac6b-3b6a214e0917 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:57.517708 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-00b09377-7e8a-4454-ac6b-3b6a214e0917 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1723 microversion: 2.1 time: 0.815552 Jul 25 14:44:57.520523 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1976/4197] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:56 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1723 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:44:57.543077 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b8bbdc66-1b28-4889-902c-96b8580a9c06 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:57.544145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b8bbdc66-1b28-4889-902c-96b8580a9c06 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:57.562036 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8bbdc66-1b28-4889-902c-96b8580a9c06 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:57.564366 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8bbdc66-1b28-4889-902c-96b8580a9c06 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:57.567669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8bbdc66-1b28-4889-902c-96b8580a9c06 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:57.568182 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8bbdc66-1b28-4889-902c-96b8580a9c06 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:57.745276 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b8bbdc66-1b28-4889-902c-96b8580a9c06 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:57.759708 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b8bbdc66-1b28-4889-902c-96b8580a9c06 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1272 microversion: 2.1 time: 0.221381 Jul 25 14:44:57.763460 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2222/4198] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:57 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1272 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:44:58.182939 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f092dc82-2295-450a-a9c6-f265a3158ee0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:58.183579 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f092dc82-2295-450a-a9c6-f265a3158ee0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:58.199789 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f092dc82-2295-450a-a9c6-f265a3158ee0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:58.200272 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f092dc82-2295-450a-a9c6-f265a3158ee0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:58.201051 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f092dc82-2295-450a-a9c6-f265a3158ee0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:58.201482 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f092dc82-2295-450a-a9c6-f265a3158ee0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:58.543380 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-09b9bdac-9b66-423d-8056-13de3c683387 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:58.544136 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-09b9bdac-9b66-423d-8056-13de3c683387 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:58.555898 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09b9bdac-9b66-423d-8056-13de3c683387 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:58.556780 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09b9bdac-9b66-423d-8056-13de3c683387 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:58.560415 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09b9bdac-9b66-423d-8056-13de3c683387 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:58.561244 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09b9bdac-9b66-423d-8056-13de3c683387 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:58.623767 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=18,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:44:58.826796 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f092dc82-2295-450a-a9c6-f265a3158ee0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:58.841572 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f092dc82-2295-450a-a9c6-f265a3158ee0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4" status: 200 len: 1365 microversion: 2.1 time: 0.662801 Jul 25 14:44:58.844458 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1977/4199] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:58 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4 => generated 1365 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:44:58.857026 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-68613a9d-92ed-471b-984d-d3bf2971fdfa tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:58.858311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-68613a9d-92ed-471b-984d-d3bf2971fdfa tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:58.868543 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-68613a9d-92ed-471b-984d-d3bf2971fdfa tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:58.870584 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-68613a9d-92ed-471b-984d-d3bf2971fdfa tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:58.872086 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-68613a9d-92ed-471b-984d-d3bf2971fdfa tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:58.873179 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-68613a9d-92ed-471b-984d-d3bf2971fdfa tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:59.069936 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-68613a9d-92ed-471b-984d-d3bf2971fdfa tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:59.100758 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-68613a9d-92ed-471b-984d-d3bf2971fdfa tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1272 microversion: 2.1 time: 0.250262 Jul 25 14:44:59.101742 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1978/4200] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:58 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1272 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:44:59.145713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-09b9bdac-9b66-423d-8056-13de3c683387 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:44:59.155050 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-09b9bdac-9b66-423d-8056-13de3c683387 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1723 microversion: 2.1 time: 0.616057 Jul 25 14:44:59.155651 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2223/4201] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:58 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1723 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:44:59.862090 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-16cdf160-b6ca-4835-b5e4-e0e0abd54a1b req-bd1799cb-564a-4c5f-be50-8fcce9772853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d038cc3-67d7-4ac0-93bd-e668700cd3b4", "name": "network-vif-plugged", "status": "completed", "tag": "368a556a-b701-43a9-866d-cbb400f29ea0"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:44:59.872969 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-aaefea7e-f7eb-42ec-af88-2f7dfcc46250 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:44:59.874304 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-aaefea7e-f7eb-42ec-af88-2f7dfcc46250 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:44:59.903412 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aaefea7e-f7eb-42ec-af88-2f7dfcc46250 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:59.904346 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aaefea7e-f7eb-42ec-af88-2f7dfcc46250 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:59.905005 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aaefea7e-f7eb-42ec-af88-2f7dfcc46250 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:59.905433 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aaefea7e-f7eb-42ec-af88-2f7dfcc46250 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:59.930262 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-16cdf160-b6ca-4835-b5e4-e0e0abd54a1b req-bd1799cb-564a-4c5f-be50-8fcce9772853 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:44:59.930997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-16cdf160-b6ca-4835-b5e4-e0e0abd54a1b req-bd1799cb-564a-4c5f-be50-8fcce9772853 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:44:59.985741 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-16cdf160-b6ca-4835-b5e4-e0e0abd54a1b req-bd1799cb-564a-4c5f-be50-8fcce9772853 service nova] Creating event network-vif-plugged:368a556a-b701-43a9-866d-cbb400f29ea0 for instance 5d038cc3-67d7-4ac0-93bd-e668700cd3b4 on n-h1-846435-14 Jul 25 14:44:59.999075 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-16cdf160-b6ca-4835-b5e4-e0e0abd54a1b req-bd1799cb-564a-4c5f-be50-8fcce9772853 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139879 Jul 25 14:45:00.003420 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1979/4202] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:45:00.541896 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-aaefea7e-f7eb-42ec-af88-2f7dfcc46250 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:00.553638 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-aaefea7e-f7eb-42ec-af88-2f7dfcc46250 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4" status: 200 len: 1365 microversion: 2.1 time: 0.685461 Jul 25 14:45:00.554496 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2224/4203] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:44:59 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4 => generated 1365 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:45:00.567537 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e360c016-5f07-4766-b942-420ec714e347 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:00.568562 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e360c016-5f07-4766-b942-420ec714e347 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:00.584386 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e360c016-5f07-4766-b942-420ec714e347 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:00.585092 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e360c016-5f07-4766-b942-420ec714e347 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:00.586044 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e360c016-5f07-4766-b942-420ec714e347 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:00.589913 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e360c016-5f07-4766-b942-420ec714e347 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:00.684751 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-14819d89-b39d-489e-9056-910f06d20c5e tempest-FloatingIPDetailsNegativeTestJSON-1714502529 tempest-FloatingIPDetailsNegativeTestJSON-1714502529-project] Calling method '.version_select at 0x7f4686735dc0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:00.823586 n-d-846435-14 devstack@n-api.service[119303]: DEBUG neutronclient.v2_0.client [None req-14819d89-b39d-489e-9056-910f06d20c5e tempest-FloatingIPDetailsNegativeTestJSON-1714502529 tempest-FloatingIPDetailsNegativeTestJSON-1714502529-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 88bbbdd8-501a-4b4d-85e8-522e9ec4bc00 could not be found", "detail": ""}} {{(pid=119303) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 14:45:00.824720 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-14819d89-b39d-489e-9056-910f06d20c5e tempest-FloatingIPDetailsNegativeTestJSON-1714502529 tempest-FloatingIPDetailsNegativeTestJSON-1714502529-project] HTTP exception thrown: Floating IP not found for ID 88bbbdd8-501a-4b4d-85e8-522e9ec4bc00 Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-14819d89-b39d-489e-9056-910f06d20c5e tempest-FloatingIPDetailsNegativeTestJSON-1714502529 tempest-FloatingIPDetailsNegativeTestJSON-1714502529-project] Request method failure captured: Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/os-floating-ips/88bbbdd8-501a-4b4d-85e8-522e9ec4bc00 HTTP/1.1 Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qxrrmKquSmK1ARJjgiqE3sArnrh31mlg0gBLO5ZEnN0wyyD6SN0p9Sfe9Vq-tnXrAny0mRubDy42bjqJWYPOHkmYBmnV6HOEmScO9o9TS_5XfsHsLHW3_1AL15kAi_3haRnzZPIu8NIgWThzmpLLLZAP-PEs5bZkNbMgbr8MIxtawc Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 0198f57f3f7a48b3b94588f72d7a8db7 Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1714502529 Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0198f57f3f7a48b3b94588f72d7a8db7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0198f57f3f7a48b3b94588f72d7a8db7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0198f57f3f7a48b3b94588f72d7a8db7", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0198f57f3f7a48b3b94588f72d7a8db7"}]}] Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1714502529 Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 0198f57f3f7a48b3b94588f72d7a8db7 Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1714502529 Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1714502529-project Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 68545a92aa3d4243aba0d49c58b884e4 Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1714502529-project Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: exception: Floating IP not found for ID 88bbbdd8-501a-4b4d-85e8-522e9ec4bc00 Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '88bbbdd8-501a-4b4d-85e8-522e9ec4bc00'} Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 88bbbdd8-501a-4b4d-85e8-522e9ec4bc00 could not be found Jul 25 14:45:00.826946 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0f443ee-9fba-4549-b2a6-f40e599d46b5'] Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 88bbbdd8-501a-4b4d-85e8-522e9ec4bc00. Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 88bbbdd8-501a-4b4d-85e8-522e9ec4bc00 Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 88bbbdd8-501a-4b4d-85e8-522e9ec4bc00 Jul 25 14:45:00.831370 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:45:00.834925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-14819d89-b39d-489e-9056-910f06d20c5e tempest-FloatingIPDetailsNegativeTestJSON-1714502529 tempest-FloatingIPDetailsNegativeTestJSON-1714502529-project] Returning 404 to user: Floating IP not found for ID 88bbbdd8-501a-4b4d-85e8-522e9ec4bc00 {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:45:00.836145 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-14819d89-b39d-489e-9056-910f06d20c5e tempest-FloatingIPDetailsNegativeTestJSON-1714502529 tempest-FloatingIPDetailsNegativeTestJSON-1714502529-project] 10.222.0.88 "GET /compute/v2.1/os-floating-ips/88bbbdd8-501a-4b4d-85e8-522e9ec4bc00" status: 404 len: 111 microversion: 2.1 time: 0.771615 Jul 25 14:45:00.836863 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1980/4204] 10.222.0.88 () {58 vars in 1260 bytes} [Mon Jul 25 14:45:00 2022] GET /compute/v2.1/os-floating-ips/88bbbdd8-501a-4b4d-85e8-522e9ec4bc00 => generated 111 bytes in 773 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:45:00.853008 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f8ed285f-acaa-4859-8ed3-83fcec14fe9b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:00.854055 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f8ed285f-acaa-4859-8ed3-83fcec14fe9b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:00.875697 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8ed285f-acaa-4859-8ed3-83fcec14fe9b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:00.876962 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8ed285f-acaa-4859-8ed3-83fcec14fe9b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:00.878027 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8ed285f-acaa-4859-8ed3-83fcec14fe9b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:00.878632 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8ed285f-acaa-4859-8ed3-83fcec14fe9b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:01.165008 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e360c016-5f07-4766-b942-420ec714e347 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:01.181231 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e360c016-5f07-4766-b942-420ec714e347 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1314 microversion: 2.1 time: 0.624840 Jul 25 14:45:01.181852 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2225/4205] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:00 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1314 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:01.574385 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8e9d15cb-3e87-48a8-9f1d-e88cd940f542 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:01.575263 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8e9d15cb-3e87-48a8-9f1d-e88cd940f542 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:01.589014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e9d15cb-3e87-48a8-9f1d-e88cd940f542 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:01.595277 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e9d15cb-3e87-48a8-9f1d-e88cd940f542 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:01.597940 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e9d15cb-3e87-48a8-9f1d-e88cd940f542 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:01.598788 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e9d15cb-3e87-48a8-9f1d-e88cd940f542 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:01.756082 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f8ed285f-acaa-4859-8ed3-83fcec14fe9b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:01.768044 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f8ed285f-acaa-4859-8ed3-83fcec14fe9b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1723 microversion: 2.1 time: 0.925108 Jul 25 14:45:01.769065 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1981/4206] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:00 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1723 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:02.204859 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-91c2223a-bffa-4a88-8aae-bcf86d13ed83 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:02.205524 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-91c2223a-bffa-4a88-8aae-bcf86d13ed83 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:02.215992 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-91c2223a-bffa-4a88-8aae-bcf86d13ed83 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:02.231318 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-91c2223a-bffa-4a88-8aae-bcf86d13ed83 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:02.234116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-91c2223a-bffa-4a88-8aae-bcf86d13ed83 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:02.234888 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-91c2223a-bffa-4a88-8aae-bcf86d13ed83 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:02.290955 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:45:02.369795 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8e9d15cb-3e87-48a8-9f1d-e88cd940f542 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:02.388184 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8e9d15cb-3e87-48a8-9f1d-e88cd940f542 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4" status: 200 len: 1365 microversion: 2.1 time: 0.807793 Jul 25 14:45:02.388926 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2226/4207] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:01 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4 => generated 1365 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:45:02.792367 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fea4e6b4-fa51-44a8-8ed9-ecc833a12a05 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:02.793445 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fea4e6b4-fa51-44a8-8ed9-ecc833a12a05 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:02.817896 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fea4e6b4-fa51-44a8-8ed9-ecc833a12a05 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:02.819457 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fea4e6b4-fa51-44a8-8ed9-ecc833a12a05 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:02.820874 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fea4e6b4-fa51-44a8-8ed9-ecc833a12a05 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:02.824175 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fea4e6b4-fa51-44a8-8ed9-ecc833a12a05 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:03.228947 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:45:03.298329 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-91c2223a-bffa-4a88-8aae-bcf86d13ed83 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:03.313906 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-91c2223a-bffa-4a88-8aae-bcf86d13ed83 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1314 microversion: 2.1 time: 1.114688 Jul 25 14:45:03.314995 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1982/4208] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:02 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1314 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:45:03.411753 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c8731cb9-7119-487e-b4e1-39d9d7788394 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:03.412833 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c8731cb9-7119-487e-b4e1-39d9d7788394 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:03.433066 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c8731cb9-7119-487e-b4e1-39d9d7788394 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:03.433527 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c8731cb9-7119-487e-b4e1-39d9d7788394 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:03.434313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c8731cb9-7119-487e-b4e1-39d9d7788394 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:03.439591 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c8731cb9-7119-487e-b4e1-39d9d7788394 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:03.667124 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fea4e6b4-fa51-44a8-8ed9-ecc833a12a05 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:03.698407 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fea4e6b4-fa51-44a8-8ed9-ecc833a12a05 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1723 microversion: 2.1 time: 0.910924 Jul 25 14:45:03.700345 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2227/4209] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:02 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1723 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:04.229833 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-182e4c7f-b9c6-461f-8253-fbcbe9f0cd5d req-e94d8a55-5903-4764-836d-f921ed1cb91e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad236d1f-2ae4-49b3-8c93-5c0348fdb112", "tag": "666fb687-d862-4192-8e61-2e74d515522c"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:45:04.290517 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-182e4c7f-b9c6-461f-8253-fbcbe9f0cd5d req-e94d8a55-5903-4764-836d-f921ed1cb91e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:04.291365 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-182e4c7f-b9c6-461f-8253-fbcbe9f0cd5d req-e94d8a55-5903-4764-836d-f921ed1cb91e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:04.311588 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-182e4c7f-b9c6-461f-8253-fbcbe9f0cd5d req-e94d8a55-5903-4764-836d-f921ed1cb91e service nova] Creating event network-changed:666fb687-d862-4192-8e61-2e74d515522c for instance ad236d1f-2ae4-49b3-8c93-5c0348fdb112 on n-h2-846435-14 Jul 25 14:45:04.319814 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-182e4c7f-b9c6-461f-8253-fbcbe9f0cd5d req-e94d8a55-5903-4764-836d-f921ed1cb91e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119559 Jul 25 14:45:04.321236 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2228/4210] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:45:04.346160 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-88b08b87-aa38-454c-9afa-5d4254d0bab6 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:04.346882 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-88b08b87-aa38-454c-9afa-5d4254d0bab6 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:04.382229 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-88b08b87-aa38-454c-9afa-5d4254d0bab6 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:04.382699 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-88b08b87-aa38-454c-9afa-5d4254d0bab6 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:04.383501 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-88b08b87-aa38-454c-9afa-5d4254d0bab6 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:04.383945 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-88b08b87-aa38-454c-9afa-5d4254d0bab6 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:04.753858 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=8 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:45:04.848402 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c8731cb9-7119-487e-b4e1-39d9d7788394 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:04.869634 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c8731cb9-7119-487e-b4e1-39d9d7788394 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4" status: 200 len: 1555 microversion: 2.1 time: 1.457684 Jul 25 14:45:04.877947 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1983/4211] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:03 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4 => generated 1555 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:04.889843 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a7ef8d03-5d8f-422f-a648-233067f16731 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:04.912404 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a7ef8d03-5d8f-422f-a648-233067f16731 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:04.961752 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a7ef8d03-5d8f-422f-a648-233067f16731 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:04.962216 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a7ef8d03-5d8f-422f-a648-233067f16731 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:04.963019 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a7ef8d03-5d8f-422f-a648-233067f16731 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:04.963461 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a7ef8d03-5d8f-422f-a648-233067f16731 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:05.164738 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-88b08b87-aa38-454c-9afa-5d4254d0bab6 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:05.187220 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-88b08b87-aa38-454c-9afa-5d4254d0bab6 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1314 microversion: 2.1 time: 0.850073 Jul 25 14:45:05.204458 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2229/4212] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:04 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1314 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:05.216336 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0b60f761-e771-4a87-8522-28bf92d6214d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:05.216844 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0b60f761-e771-4a87-8522-28bf92d6214d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:05.231836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b60f761-e771-4a87-8522-28bf92d6214d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:05.232288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b60f761-e771-4a87-8522-28bf92d6214d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:05.232957 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b60f761-e771-4a87-8522-28bf92d6214d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:05.233406 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b60f761-e771-4a87-8522-28bf92d6214d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:05.638261 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a7ef8d03-5d8f-422f-a648-233067f16731 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:05.655534 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a7ef8d03-5d8f-422f-a648-233067f16731 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1723 microversion: 2.1 time: 0.776145 Jul 25 14:45:05.658194 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1984/4213] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:04 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1723 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:06.016035 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0b60f761-e771-4a87-8522-28bf92d6214d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.809413 Jul 25 14:45:06.024771 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2230/4214] 10.222.0.88 () {58 vars in 1275 bytes} [Mon Jul 25 14:45:05 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4/os-interface => generated 284 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:45:06.208903 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8878f279-908b-4c23-8afb-b21ee4d83603 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:06.210048 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8878f279-908b-4c23-8afb-b21ee4d83603 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:06.225804 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8878f279-908b-4c23-8afb-b21ee4d83603 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:06.226487 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8878f279-908b-4c23-8afb-b21ee4d83603 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:06.227463 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8878f279-908b-4c23-8afb-b21ee4d83603 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:06.228238 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8878f279-908b-4c23-8afb-b21ee4d83603 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:06.681190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-409519b3-3e96-4a51-9945-1bf2319092a6 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:06.681817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-409519b3-3e96-4a51-9945-1bf2319092a6 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:06.689760 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-409519b3-3e96-4a51-9945-1bf2319092a6 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:06.690212 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-409519b3-3e96-4a51-9945-1bf2319092a6 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:06.690995 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-409519b3-3e96-4a51-9945-1bf2319092a6 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:06.691434 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-409519b3-3e96-4a51-9945-1bf2319092a6 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:06.714622 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8878f279-908b-4c23-8afb-b21ee4d83603 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:06.728453 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8878f279-908b-4c23-8afb-b21ee4d83603 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1314 microversion: 2.1 time: 0.524017 Jul 25 14:45:06.747944 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1985/4215] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:06 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1314 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:07.364285 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-409519b3-3e96-4a51-9945-1bf2319092a6 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:07.376467 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-409519b3-3e96-4a51-9945-1bf2319092a6 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1723 microversion: 2.1 time: 0.702047 Jul 25 14:45:07.380046 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2231/4216] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:06 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1723 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:07.770823 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-860c60c2-5cb7-4d8f-bc63-ce534e0c98d1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:07.771524 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-860c60c2-5cb7-4d8f-bc63-ce534e0c98d1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:07.789281 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:45:07.807264 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-860c60c2-5cb7-4d8f-bc63-ce534e0c98d1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:07.807730 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-860c60c2-5cb7-4d8f-bc63-ce534e0c98d1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:07.808718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-860c60c2-5cb7-4d8f-bc63-ce534e0c98d1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:07.809006 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-860c60c2-5cb7-4d8f-bc63-ce534e0c98d1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:08.158214 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-860c60c2-5cb7-4d8f-bc63-ce534e0c98d1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:08.166790 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-860c60c2-5cb7-4d8f-bc63-ce534e0c98d1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1314 microversion: 2.1 time: 0.400219 Jul 25 14:45:08.182640 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1986/4217] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:07 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:08.408652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8c90742a-303d-4c42-b53d-92dac9a0599f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:08.409275 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8c90742a-303d-4c42-b53d-92dac9a0599f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:08.417182 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8c90742a-303d-4c42-b53d-92dac9a0599f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:08.417640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8c90742a-303d-4c42-b53d-92dac9a0599f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:08.418708 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8c90742a-303d-4c42-b53d-92dac9a0599f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:08.419133 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8c90742a-303d-4c42-b53d-92dac9a0599f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:08.987861 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8c90742a-303d-4c42-b53d-92dac9a0599f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:08.998056 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8c90742a-303d-4c42-b53d-92dac9a0599f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1723 microversion: 2.1 time: 0.593955 Jul 25 14:45:09.002801 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2232/4218] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:08 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1723 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:09.188039 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7dd9485c-fcc1-41e6-926e-c9f83360b48f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:09.189056 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7dd9485c-fcc1-41e6-926e-c9f83360b48f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:09.204689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7dd9485c-fcc1-41e6-926e-c9f83360b48f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:09.205432 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7dd9485c-fcc1-41e6-926e-c9f83360b48f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:09.207714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7dd9485c-fcc1-41e6-926e-c9f83360b48f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:09.209363 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7dd9485c-fcc1-41e6-926e-c9f83360b48f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:09.568019 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7dd9485c-fcc1-41e6-926e-c9f83360b48f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:09.577671 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7dd9485c-fcc1-41e6-926e-c9f83360b48f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1314 microversion: 2.1 time: 0.393384 Jul 25 14:45:09.578319 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1987/4219] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:09 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:09.648792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-a00310f4-94b5-4975-9502-f6daeb5f4428 req-e2bfca68-c1ed-4d32-8ea3-4a95c62a2338 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d038cc3-67d7-4ac0-93bd-e668700cd3b4", "tag": "368a556a-b701-43a9-866d-cbb400f29ea0"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:45:09.671241 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a00310f4-94b5-4975-9502-f6daeb5f4428 req-e2bfca68-c1ed-4d32-8ea3-4a95c62a2338 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:09.671907 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a00310f4-94b5-4975-9502-f6daeb5f4428 req-e2bfca68-c1ed-4d32-8ea3-4a95c62a2338 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:09.701791 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-a00310f4-94b5-4975-9502-f6daeb5f4428 req-e2bfca68-c1ed-4d32-8ea3-4a95c62a2338 service nova] Creating event network-changed:368a556a-b701-43a9-866d-cbb400f29ea0 for instance 5d038cc3-67d7-4ac0-93bd-e668700cd3b4 on n-h1-846435-14 Jul 25 14:45:09.717294 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-a00310f4-94b5-4975-9502-f6daeb5f4428 req-e2bfca68-c1ed-4d32-8ea3-4a95c62a2338 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072814 Jul 25 14:45:09.718531 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2233/4220] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:45:10.034001 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0776885b-c49d-48c0-b939-ece9e0e09e38 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:10.034639 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0776885b-c49d-48c0-b939-ece9e0e09e38 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:10.041324 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0776885b-c49d-48c0-b939-ece9e0e09e38 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:10.041788 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0776885b-c49d-48c0-b939-ece9e0e09e38 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:10.042597 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0776885b-c49d-48c0-b939-ece9e0e09e38 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:10.043036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0776885b-c49d-48c0-b939-ece9e0e09e38 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:10.473456 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0776885b-c49d-48c0-b939-ece9e0e09e38 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:10.485899 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0776885b-c49d-48c0-b939-ece9e0e09e38 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1700 microversion: 2.1 time: 0.465056 Jul 25 14:45:10.492966 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1988/4221] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:10 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1700 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:10.507122 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c55a3b12-4ab7-4fdf-9525-153e1bec5337 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:45:10.519301 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c55a3b12-4ab7-4fdf-9525-153e1bec5337 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:10.521125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c55a3b12-4ab7-4fdf-9525-153e1bec5337 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:10.576513 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c55a3b12-4ab7-4fdf-9525-153e1bec5337 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Going to try to start instance {{(pid=119304) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 14:45:10.602304 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ea3651cc-2c86-4a9f-a30b-b1bb3c0d4a91 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:10.602926 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ea3651cc-2c86-4a9f-a30b-b1bb3c0d4a91 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:10.614502 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ea3651cc-2c86-4a9f-a30b-b1bb3c0d4a91 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:10.614960 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ea3651cc-2c86-4a9f-a30b-b1bb3c0d4a91 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:10.624029 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ea3651cc-2c86-4a9f-a30b-b1bb3c0d4a91 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:10.624864 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ea3651cc-2c86-4a9f-a30b-b1bb3c0d4a91 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:10.673992 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c55a3b12-4ab7-4fdf-9525-153e1bec5337 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "POST /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850/action" status: 202 len: 0 microversion: 2.1 time: 0.170942 Jul 25 14:45:10.686458 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2234/4222] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:45:10 2022] POST /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:45:10.693729 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-09ccfcae-55c1-464b-bb16-775bca149847 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:10.694440 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-09ccfcae-55c1-464b-bb16-775bca149847 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:10.724789 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09ccfcae-55c1-464b-bb16-775bca149847 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:10.729275 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09ccfcae-55c1-464b-bb16-775bca149847 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:10.730659 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09ccfcae-55c1-464b-bb16-775bca149847 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:10.733499 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09ccfcae-55c1-464b-bb16-775bca149847 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:11.363247 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-09ccfcae-55c1-464b-bb16-775bca149847 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:11.374051 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-09ccfcae-55c1-464b-bb16-775bca149847 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1709 microversion: 2.1 time: 0.686145 Jul 25 14:45:11.375710 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2235/4223] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:10 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1709 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:12.401524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0531f59f-bc8c-4b3a-969a-27fc1cdf2271 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:12.402195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0531f59f-bc8c-4b3a-969a-27fc1cdf2271 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:12.416661 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0531f59f-bc8c-4b3a-969a-27fc1cdf2271 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:12.417127 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0531f59f-bc8c-4b3a-969a-27fc1cdf2271 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:12.420034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0531f59f-bc8c-4b3a-969a-27fc1cdf2271 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:12.423794 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0531f59f-bc8c-4b3a-969a-27fc1cdf2271 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:12.792087 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ea3651cc-2c86-4a9f-a30b-b1bb3c0d4a91 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:12.811040 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ea3651cc-2c86-4a9f-a30b-b1bb3c0d4a91 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1314 microversion: 2.1 time: 2.213431 Jul 25 14:45:12.823051 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1989/4224] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:10 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1314 bytes in 2227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:12.938819 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0531f59f-bc8c-4b3a-969a-27fc1cdf2271 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:12.953834 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0531f59f-bc8c-4b3a-969a-27fc1cdf2271 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1709 microversion: 2.1 time: 0.556697 Jul 25 14:45:12.974597 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2236/4225] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:12 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1709 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:13.845616 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c36c0141-2c89-48ec-a0c1-5cf77decabcf tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:13.846421 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c36c0141-2c89-48ec-a0c1-5cf77decabcf tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:13.865150 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c36c0141-2c89-48ec-a0c1-5cf77decabcf tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:13.867506 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c36c0141-2c89-48ec-a0c1-5cf77decabcf tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:13.871046 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c36c0141-2c89-48ec-a0c1-5cf77decabcf tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:13.871909 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c36c0141-2c89-48ec-a0c1-5cf77decabcf tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:13.980869 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3ba1b26d-a915-4dcc-845d-0b0ef5f78475 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:13.981489 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3ba1b26d-a915-4dcc-845d-0b0ef5f78475 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:13.995096 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3ba1b26d-a915-4dcc-845d-0b0ef5f78475 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:14.002866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3ba1b26d-a915-4dcc-845d-0b0ef5f78475 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:14.004207 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3ba1b26d-a915-4dcc-845d-0b0ef5f78475 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:14.004648 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3ba1b26d-a915-4dcc-845d-0b0ef5f78475 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:14.294867 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c36c0141-2c89-48ec-a0c1-5cf77decabcf tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:14.303597 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c36c0141-2c89-48ec-a0c1-5cf77decabcf tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1314 microversion: 2.1 time: 0.464505 Jul 25 14:45:14.311767 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1990/4226] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:13 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:14.385915 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3ba1b26d-a915-4dcc-845d-0b0ef5f78475 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:14.408112 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3ba1b26d-a915-4dcc-845d-0b0ef5f78475 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1709 microversion: 2.1 time: 0.431195 Jul 25 14:45:14.410388 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2237/4227] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:13 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1709 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:15.044572 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-bf3e0007-d09a-4e0d-b7e2-955b07792942 req-719fac46-3b85-4c9f-8535-1a6f5c8d35fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad236d1f-2ae4-49b3-8c93-5c0348fdb112", "name": "network-vif-plugged", "status": "completed", "tag": "666fb687-d862-4192-8e61-2e74d515522c"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:45:15.065086 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-bf3e0007-d09a-4e0d-b7e2-955b07792942 req-719fac46-3b85-4c9f-8535-1a6f5c8d35fa service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:15.066018 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-bf3e0007-d09a-4e0d-b7e2-955b07792942 req-719fac46-3b85-4c9f-8535-1a6f5c8d35fa service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:15.092339 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-bf3e0007-d09a-4e0d-b7e2-955b07792942 req-719fac46-3b85-4c9f-8535-1a6f5c8d35fa service nova] Creating event network-vif-plugged:666fb687-d862-4192-8e61-2e74d515522c for instance ad236d1f-2ae4-49b3-8c93-5c0348fdb112 on n-h2-846435-14 Jul 25 14:45:15.099367 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-bf3e0007-d09a-4e0d-b7e2-955b07792942 req-719fac46-3b85-4c9f-8535-1a6f5c8d35fa service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058508 Jul 25 14:45:15.100818 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1991/4228] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:45:15.331622 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9a3bb004-3797-42ec-a4dd-bb85e1c3e074 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:15.333448 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9a3bb004-3797-42ec-a4dd-bb85e1c3e074 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:15.353144 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9a3bb004-3797-42ec-a4dd-bb85e1c3e074 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:15.353603 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9a3bb004-3797-42ec-a4dd-bb85e1c3e074 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:15.354413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9a3bb004-3797-42ec-a4dd-bb85e1c3e074 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:15.365720 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9a3bb004-3797-42ec-a4dd-bb85e1c3e074 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:15.431595 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-54f595d3-c713-4355-8bea-1440c0c81a67 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:15.432400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-54f595d3-c713-4355-8bea-1440c0c81a67 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:15.456936 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-54f595d3-c713-4355-8bea-1440c0c81a67 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:15.458422 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-54f595d3-c713-4355-8bea-1440c0c81a67 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:15.459277 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-54f595d3-c713-4355-8bea-1440c0c81a67 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:15.459716 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-54f595d3-c713-4355-8bea-1440c0c81a67 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:15.834687 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9a3bb004-3797-42ec-a4dd-bb85e1c3e074 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:15.835839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-54f595d3-c713-4355-8bea-1440c0c81a67 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:15.850697 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9a3bb004-3797-42ec-a4dd-bb85e1c3e074 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1314 microversion: 2.1 time: 0.528689 Jul 25 14:45:15.853834 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-54f595d3-c713-4355-8bea-1440c0c81a67 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1713 microversion: 2.1 time: 0.426873 Jul 25 14:45:15.855599 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2238/4229] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:15 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1314 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:15.856333 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1992/4230] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:15 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1713 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:16.346654 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3e112d50-9d97-4268-8a56-ae8ebd829fb7 tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Calling method '.version_select at 0x7f46987a8940>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:16.443592 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3e112d50-9d97-4268-8a56-ae8ebd829fb7 tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] 10.222.0.88 "GET /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564" status: 200 len: 637 microversion: 2.1 time: 0.102188 Jul 25 14:45:16.444468 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2239/4231] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:45:16 2022] GET /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564 => generated 637 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:45:16.468677 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-515602e0-ec00-4020-8b97-2e73b5c2a81a tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Action: 'update_all', calling method: .version_select at 0x7f46867350d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:45:16.560404 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-515602e0-ec00-4020-8b97-2e73b5c2a81a tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Getting quotas for project 569e59164c8d471d8ececfd0a44628f5. Resources: dict_keys(['metadata_items']) {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:45:16.572366 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-515602e0-ec00-4020-8b97-2e73b5c2a81a tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Getting quotas for user 65e04a54f5e443b7bb473c12308d4729 and project 569e59164c8d471d8ececfd0a44628f5. Resources: dict_keys(['metadata_items']) {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:45:16.875663 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e2c8fe9a-11b3-498c-91eb-730ac8e5dcca tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:16.876675 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e2c8fe9a-11b3-498c-91eb-730ac8e5dcca tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:16.888554 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2c8fe9a-11b3-498c-91eb-730ac8e5dcca tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:16.896182 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2c8fe9a-11b3-498c-91eb-730ac8e5dcca tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:16.897232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2c8fe9a-11b3-498c-91eb-730ac8e5dcca tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:16.899353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2c8fe9a-11b3-498c-91eb-730ac8e5dcca tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:17.054984 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-515602e0-ec00-4020-8b97-2e73b5c2a81a tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] 10.222.0.88 "PUT /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564/metadata" status: 200 len: 61 microversion: 2.1 time: 0.598895 Jul 25 14:45:17.055611 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1993/4232] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Jul 25 14:45:16 2022] PUT /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564/metadata => generated 61 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 14:45:17.065693 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5e6c2a99-644b-446f-b39b-aed873d1c2c7 tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Calling method '.version_select at 0x7f468668ae50>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:17.199504 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e2c8fe9a-11b3-498c-91eb-730ac8e5dcca tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:17.207771 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e2c8fe9a-11b3-498c-91eb-730ac8e5dcca tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1314 microversion: 2.1 time: 0.336689 Jul 25 14:45:17.208589 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2240/4233] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:16 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:17.382857 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5e6c2a99-644b-446f-b39b-aed873d1c2c7 tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] 10.222.0.88 "DELETE /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.321509 Jul 25 14:45:17.386614 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1994/4234] 10.222.0.88 () {58 vars in 1296 bytes} [Mon Jul 25 14:45:17 2022] DELETE /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564/metadata/os_version => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 14:45:17.396065 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1a4ca371-e5d1-4ee4-8e6b-2c0cfef75de2 tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Calling method '.version_select at 0x7f4687d5b040>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:17.450831 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1a4ca371-e5d1-4ee4-8e6b-2c0cfef75de2 tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] 10.222.0.88 "GET /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564/metadata" status: 200 len: 37 microversion: 2.1 time: 0.059565 Jul 25 14:45:17.451431 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2241/4235] 10.222.0.88 () {58 vars in 1260 bytes} [Mon Jul 25 14:45:17 2022] GET /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564/metadata => generated 37 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:45:17.462157 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-414679b1-7d7d-4a2a-864a-4186eb82cb28 tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Action: 'update_all', calling method: .version_select at 0x7f468668ad30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:45:17.525933 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-414679b1-7d7d-4a2a-864a-4186eb82cb28 tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Getting quotas for project 569e59164c8d471d8ececfd0a44628f5. Resources: dict_keys(['metadata_items']) {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:45:17.534631 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-414679b1-7d7d-4a2a-864a-4186eb82cb28 tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Getting quotas for user 65e04a54f5e443b7bb473c12308d4729 and project 569e59164c8d471d8ececfd0a44628f5. Resources: dict_keys(['metadata_items']) {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:45:17.965554 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-414679b1-7d7d-4a2a-864a-4186eb82cb28 tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] 10.222.0.88 "PUT /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564/metadata" status: 200 len: 61 microversion: 2.1 time: 0.505275 Jul 25 14:45:17.975995 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1995/4236] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Jul 25 14:45:17 2022] PUT /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564/metadata => generated 61 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:45:17.976503 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7104d2da-dba7-469a-bec1-b12afd433379 tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Calling method '.version_select at 0x7f4686224790>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:18.025455 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7104d2da-dba7-469a-bec1-b12afd433379 tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] 10.222.0.88 "GET /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.053458 Jul 25 14:45:18.039666 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f4e3505a-8193-4e08-a476-77fb8728911f tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Action: 'update_all', calling method: .version_select at 0x7f4686699c10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:45:18.045343 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2242/4237] 10.222.0.88 () {58 vars in 1290 bytes} [Mon Jul 25 14:45:17 2022] GET /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564/metadata/os_distro => generated 33 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:45:18.117462 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-f4e3505a-8193-4e08-a476-77fb8728911f tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Getting quotas for project 569e59164c8d471d8ececfd0a44628f5. Resources: dict_keys(['metadata_items']) {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:45:18.124079 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-f4e3505a-8193-4e08-a476-77fb8728911f tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Getting quotas for user 65e04a54f5e443b7bb473c12308d4729 and project 569e59164c8d471d8ececfd0a44628f5. Resources: dict_keys(['metadata_items']) {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:45:18.239845 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d5d6edd3-ad4d-4445-9d94-e34fd1e6a180 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:18.240688 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d5d6edd3-ad4d-4445-9d94-e34fd1e6a180 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:18.264786 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5d6edd3-ad4d-4445-9d94-e34fd1e6a180 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:18.265242 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5d6edd3-ad4d-4445-9d94-e34fd1e6a180 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:18.266411 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5d6edd3-ad4d-4445-9d94-e34fd1e6a180 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:18.266851 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5d6edd3-ad4d-4445-9d94-e34fd1e6a180 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:18.324612 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:45:18.353424 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f4e3505a-8193-4e08-a476-77fb8728911f tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] 10.222.0.88 "PUT /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564/metadata" status: 200 len: 61 microversion: 2.1 time: 0.317583 Jul 25 14:45:18.354169 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1996/4238] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Jul 25 14:45:18 2022] PUT /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564/metadata => generated 61 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:45:18.364683 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-194a5da1-ffa4-4853-8423-40fb43b0039c tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Calling method '.version_select at 0x7f468668a550>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:18.423633 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-194a5da1-ffa4-4853-8423-40fb43b0039c tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] 10.222.0.88 "GET /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564/metadata" status: 200 len: 61 microversion: 2.1 time: 0.063316 Jul 25 14:45:18.424614 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1997/4239] 10.222.0.88 () {58 vars in 1260 bytes} [Mon Jul 25 14:45:18 2022] GET /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564/metadata => generated 61 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:45:18.439329 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-64be902d-3c09-4ef8-879b-279e18cf5980 tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Action: 'update_all', calling method: .version_select at 0x7f4686738f70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:45:18.549676 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-64be902d-3c09-4ef8-879b-279e18cf5980 tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Getting quotas for project 569e59164c8d471d8ececfd0a44628f5. Resources: dict_keys(['metadata_items']) {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:45:18.556916 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-64be902d-3c09-4ef8-879b-279e18cf5980 tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Getting quotas for user 65e04a54f5e443b7bb473c12308d4729 and project 569e59164c8d471d8ececfd0a44628f5. Resources: dict_keys(['metadata_items']) {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:45:18.560141 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d5d6edd3-ad4d-4445-9d94-e34fd1e6a180 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:18.574278 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d5d6edd3-ad4d-4445-9d94-e34fd1e6a180 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1501 microversion: 2.1 time: 0.349383 Jul 25 14:45:18.575271 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2243/4240] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:18 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1501 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:45:18.598459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-135db143-9262-450e-92af-91604294299f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:45:18.609086 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-135db143-9262-450e-92af-91604294299f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:18.611097 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-135db143-9262-450e-92af-91604294299f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:18.672279 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-135db143-9262-450e-92af-91604294299f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Going to try to stop instance {{(pid=119304) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 14:45:18.759154 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-135db143-9262-450e-92af-91604294299f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "POST /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112/action" status: 202 len: 0 microversion: 2.1 time: 0.165016 Jul 25 14:45:18.760087 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2244/4241] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:45:18 2022] POST /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:45:18.770283 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-64be902d-3c09-4ef8-879b-279e18cf5980 tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] 10.222.0.88 "PUT /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564/metadata" status: 200 len: 61 microversion: 2.1 time: 0.334475 Jul 25 14:45:18.770922 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1998/4242] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Jul 25 14:45:18 2022] PUT /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564/metadata => generated 61 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:45:18.776908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-22fe4c3c-5042-43c4-8610-5bc09d231bd1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:18.777942 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-22fe4c3c-5042-43c4-8610-5bc09d231bd1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:18.786782 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-41c8242b-cc04-49ec-a8b9-bf71415afd6a tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Action: 'update_all', calling method: .version_select at 0x7f4686699160>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:45:18.791082 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-22fe4c3c-5042-43c4-8610-5bc09d231bd1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:18.795950 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-22fe4c3c-5042-43c4-8610-5bc09d231bd1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:18.796938 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-22fe4c3c-5042-43c4-8610-5bc09d231bd1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:18.797444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-22fe4c3c-5042-43c4-8610-5bc09d231bd1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:18.866179 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-41c8242b-cc04-49ec-a8b9-bf71415afd6a tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Getting quotas for project 569e59164c8d471d8ececfd0a44628f5. Resources: dict_keys(['metadata_items']) {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:45:18.873514 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-41c8242b-cc04-49ec-a8b9-bf71415afd6a tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Getting quotas for user 65e04a54f5e443b7bb473c12308d4729 and project 569e59164c8d471d8ececfd0a44628f5. Resources: dict_keys(['metadata_items']) {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:45:19.123403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-22fe4c3c-5042-43c4-8610-5bc09d231bd1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:19.134219 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-22fe4c3c-5042-43c4-8610-5bc09d231bd1 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1511 microversion: 2.1 time: 0.369558 Jul 25 14:45:19.134330 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2245/4243] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:18 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1511 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:19.371924 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-41c8242b-cc04-49ec-a8b9-bf71415afd6a tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] 10.222.0.88 "PUT /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564/metadata" status: 200 len: 64 microversion: 2.1 time: 0.594733 Jul 25 14:45:19.373170 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 1999/4244] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Jul 25 14:45:18 2022] PUT /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564/metadata => generated 64 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:45:19.382747 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b1ca6718-f485-4e7f-9cbb-6aa2158510fd tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Calling method '.version_select at 0x7f469893e940>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:19.461407 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b1ca6718-f485-4e7f-9cbb-6aa2158510fd tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] 10.222.0.88 "GET /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564/metadata" status: 200 len: 64 microversion: 2.1 time: 0.081388 Jul 25 14:45:19.462795 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2246/4245] 10.222.0.88 () {58 vars in 1260 bytes} [Mon Jul 25 14:45:19 2022] GET /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564/metadata => generated 64 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:45:19.474489 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d841cce8-89e5-4001-8011-73a2ebb32214 tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Action: 'update_all', calling method: .version_select at 0x7f4686699280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:45:19.561031 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-d841cce8-89e5-4001-8011-73a2ebb32214 tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Getting quotas for project 569e59164c8d471d8ececfd0a44628f5. Resources: dict_keys(['metadata_items']) {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:45:19.574628 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-d841cce8-89e5-4001-8011-73a2ebb32214 tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Getting quotas for user 65e04a54f5e443b7bb473c12308d4729 and project 569e59164c8d471d8ececfd0a44628f5. Resources: dict_keys(['metadata_items']) {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:45:20.157099 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b6e309f4-2e16-4c66-a6fe-a2f60865ad7f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:20.158522 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b6e309f4-2e16-4c66-a6fe-a2f60865ad7f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:20.160725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:45:20.200414 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b6e309f4-2e16-4c66-a6fe-a2f60865ad7f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:20.200909 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b6e309f4-2e16-4c66-a6fe-a2f60865ad7f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:20.212364 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b6e309f4-2e16-4c66-a6fe-a2f60865ad7f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:20.213264 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b6e309f4-2e16-4c66-a6fe-a2f60865ad7f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:20.233700 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d841cce8-89e5-4001-8011-73a2ebb32214 tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] 10.222.0.88 "PUT /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564/metadata" status: 200 len: 61 microversion: 2.1 time: 0.763503 Jul 25 14:45:20.234528 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2000/4246] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Jul 25 14:45:19 2022] PUT /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564/metadata => generated 61 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:45:20.248687 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-31d01913-0f31-4161-a7c9-2228fa7e3822 tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Action: 'update', calling method: .version_select at 0x7f4686682430>, body: {"meta": {"os_version": "alt"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:45:20.346588 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-31d01913-0f31-4161-a7c9-2228fa7e3822 tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Getting quotas for project 569e59164c8d471d8ececfd0a44628f5. Resources: dict_keys(['metadata_items']) {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:45:20.364015 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-31d01913-0f31-4161-a7c9-2228fa7e3822 tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Getting quotas for user 65e04a54f5e443b7bb473c12308d4729 and project 569e59164c8d471d8ececfd0a44628f5. Resources: dict_keys(['metadata_items']) {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:45:20.691938 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b6e309f4-2e16-4c66-a6fe-a2f60865ad7f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:20.703616 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b6e309f4-2e16-4c66-a6fe-a2f60865ad7f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1511 microversion: 2.1 time: 0.549347 Jul 25 14:45:20.726531 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2247/4247] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:20 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1511 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:45:21.006022 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-31d01913-0f31-4161-a7c9-2228fa7e3822 tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] 10.222.0.88 "PUT /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.763169 Jul 25 14:45:21.007016 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2001/4248] 10.222.0.88 () {60 vars in 1313 bytes} [Mon Jul 25 14:45:20 2022] PUT /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564/metadata/os_version => generated 31 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 14:45:21.016740 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-03ada4ec-69b7-47f1-b5e5-453d134aca36 tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Calling method '.version_select at 0x7f468740aca0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:21.078303 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-03ada4ec-69b7-47f1-b5e5-453d134aca36 tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] 10.222.0.88 "GET /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564/metadata" status: 200 len: 58 microversion: 2.1 time: 0.065675 Jul 25 14:45:21.079443 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2248/4249] 10.222.0.88 () {58 vars in 1260 bytes} [Mon Jul 25 14:45:21 2022] GET /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564/metadata => generated 58 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:45:21.090755 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2df351b5-9141-409c-8055-a26b3b236ab0 tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Action: 'update_all', calling method: .version_select at 0x7f46866bb9d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:45:21.254622 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-2df351b5-9141-409c-8055-a26b3b236ab0 tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Getting quotas for project 569e59164c8d471d8ececfd0a44628f5. Resources: dict_keys(['metadata_items']) {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:45:21.273613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-2df351b5-9141-409c-8055-a26b3b236ab0 tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Getting quotas for user 65e04a54f5e443b7bb473c12308d4729 and project 569e59164c8d471d8ececfd0a44628f5. Resources: dict_keys(['metadata_items']) {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:45:21.727894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-36fb02a9-9427-4bd8-8279-6a6d6fcef47c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:21.728456 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-36fb02a9-9427-4bd8-8279-6a6d6fcef47c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:21.799407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-36fb02a9-9427-4bd8-8279-6a6d6fcef47c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:21.805411 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-36fb02a9-9427-4bd8-8279-6a6d6fcef47c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:21.810403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-36fb02a9-9427-4bd8-8279-6a6d6fcef47c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:21.813482 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-36fb02a9-9427-4bd8-8279-6a6d6fcef47c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:22.001000 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2df351b5-9141-409c-8055-a26b3b236ab0 tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] 10.222.0.88 "PUT /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564/metadata" status: 200 len: 61 microversion: 2.1 time: 0.914985 Jul 25 14:45:22.006381 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2002/4250] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Jul 25 14:45:21 2022] PUT /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564/metadata => generated 61 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:45:22.012478 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-af431562-7423-444e-b989-7ad21482a65c tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Action: 'create', calling method: .version_select at 0x7f4686661af0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:45:22.115020 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-af431562-7423-444e-b989-7ad21482a65c tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Getting quotas for project 569e59164c8d471d8ececfd0a44628f5. Resources: dict_keys(['metadata_items']) {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:45:22.137570 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-af431562-7423-444e-b989-7ad21482a65c tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Getting quotas for user 65e04a54f5e443b7bb473c12308d4729 and project 569e59164c8d471d8ececfd0a44628f5. Resources: dict_keys(['metadata_items']) {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:45:22.912831 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-36fb02a9-9427-4bd8-8279-6a6d6fcef47c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:22.922956 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-36fb02a9-9427-4bd8-8279-6a6d6fcef47c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1511 microversion: 2.1 time: 1.200784 Jul 25 14:45:22.923589 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2249/4251] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:21 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1511 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:23.196266 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-af431562-7423-444e-b989-7ad21482a65c tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] 10.222.0.88 "POST /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564/metadata" status: 200 len: 85 microversion: 2.1 time: 1.187927 Jul 25 14:45:23.197482 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2003/4252] 10.222.0.88 () {60 vars in 1281 bytes} [Mon Jul 25 14:45:22 2022] POST /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564/metadata => generated 85 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:45:23.207394 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b469b3aa-ca9a-44bb-90a8-a95adc21961d tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] Calling method '.version_select at 0x7f46878318b0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:23.293274 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b469b3aa-ca9a-44bb-90a8-a95adc21961d tempest-ImagesMetadataTestJSON-1636835568 tempest-ImagesMetadataTestJSON-1636835568-project] 10.222.0.88 "GET /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564/metadata" status: 200 len: 85 microversion: 2.1 time: 0.090258 Jul 25 14:45:23.294462 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2250/4253] 10.222.0.88 () {58 vars in 1260 bytes} [Mon Jul 25 14:45:23 2022] GET /compute/v2.1/images/9a6cc1fa-ad1a-435f-89f2-d23c19f44564/metadata => generated 85 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:45:23.957205 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c332b3ef-8e11-41b8-9620-4b32c4ee37c0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:23.958103 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c332b3ef-8e11-41b8-9620-4b32c4ee37c0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:23.978047 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c332b3ef-8e11-41b8-9620-4b32c4ee37c0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:23.978514 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c332b3ef-8e11-41b8-9620-4b32c4ee37c0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:23.979320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c332b3ef-8e11-41b8-9620-4b32c4ee37c0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:23.979754 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c332b3ef-8e11-41b8-9620-4b32c4ee37c0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:24.874898 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c332b3ef-8e11-41b8-9620-4b32c4ee37c0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:24.943935 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c332b3ef-8e11-41b8-9620-4b32c4ee37c0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1511 microversion: 2.1 time: 0.993967 Jul 25 14:45:24.944601 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2004/4254] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:23 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1511 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:25.038093 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-267b4a22-629c-488b-9c62-241527e29ba4 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Action: 'create', calling method: .version_select at 0x7f4687465f70>, body: {"keypair": {"name": "tempest-keypair-348752637", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmZsMMBOHU2ds+Hf6nnClSTdzJzMifKo+jCJeHgMCMxcqaDv7XaE2mO4DJ7xhexMhMQF70yiH3BaD3N16iSUgoxS+disFtEfEW+45WtbzEVOyAkC9mqMWSQj7IOKXFWCg=="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:45:25.126533 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-267b4a22-629c-488b-9c62-241527e29ba4 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Getting quotas for project e0b00fe1f11f472da3e053f029bd78fa. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:45:25.161440 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-267b4a22-629c-488b-9c62-241527e29ba4 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Getting quotas for user 59a44de1685b4c1f959a652432bd9c75 and project e0b00fe1f11f472da3e053f029bd78fa. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:45:25.280743 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-267b4a22-629c-488b-9c62-241527e29ba4 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.247253 Jul 25 14:45:25.283274 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2251/4255] 10.222.0.88 () {62 vars in 1200 bytes} [Mon Jul 25 14:45:25 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 250 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 14:45:25.966355 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2d0905e6-9ac7-4746-961f-e92960f4f868 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:25.970720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2d0905e6-9ac7-4746-961f-e92960f4f868 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:26.003255 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2d0905e6-9ac7-4746-961f-e92960f4f868 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:26.004666 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2d0905e6-9ac7-4746-961f-e92960f4f868 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:26.006524 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2d0905e6-9ac7-4746-961f-e92960f4f868 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:26.009288 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2d0905e6-9ac7-4746-961f-e92960f4f868 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:26.453405 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2d0905e6-9ac7-4746-961f-e92960f4f868 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:26.472327 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2d0905e6-9ac7-4746-961f-e92960f4f868 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1511 microversion: 2.1 time: 0.510091 Jul 25 14:45:26.486910 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2005/4256] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:25 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1511 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:27.495864 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c9b0b085-77b3-47a1-a521-9549ab325d04 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:27.496673 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c9b0b085-77b3-47a1-a521-9549ab325d04 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:27.517684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c9b0b085-77b3-47a1-a521-9549ab325d04 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:27.519433 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c9b0b085-77b3-47a1-a521-9549ab325d04 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:27.521220 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c9b0b085-77b3-47a1-a521-9549ab325d04 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:27.523297 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c9b0b085-77b3-47a1-a521-9549ab325d04 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:28.179303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c9b0b085-77b3-47a1-a521-9549ab325d04 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:28.192310 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c9b0b085-77b3-47a1-a521-9549ab325d04 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1511 microversion: 2.1 time: 0.701010 Jul 25 14:45:28.197032 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2252/4257] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:27 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1511 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:28.813823 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f09f0636-75dd-44e1-acd0-5d028d13472d tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-524430261", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "411c0b75-c16e-41cc-a235-40f16c902661"}, {"port": "6df9765b-58b3-4c20-a093-554ec5221862", "tag": "port-1"}, {"port": "c5db5903-5da6-4605-aa52-b7940c46fb11", "tag": "port-2"}, {"uuid": "af31c444-aa0e-47d0-a869-2c63365e5dd8", "tag": "net-1"}, {"uuid": "af31c444-aa0e-47d0-a869-2c63365e5dd8"}, {"uuid": "b5d1d38c-46a6-4fff-a9b6-83a5421d08ff", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "b5d1d38c-46a6-4fff-a9b6-83a5421d08ff", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "d91dc121-6f52-480d-b0e0-797e80266f7b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "fbc9cc99-7f2b-4ad4-afce-c4db3f5484bc", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "61b0f0ed-79b9-41f1-8a4c-3f37d45838f9", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1765429302"}], "key_name": "tempest-keypair-348752637", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:45:29.100111 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-f09f0636-75dd-44e1-acd0-5d028d13472d tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] validate_networks() for [('411c0b75-c16e-41cc-a235-40f16c902661', None, None, None, None, None), (None, None, '6df9765b-58b3-4c20-a093-554ec5221862', None, None, None), (None, None, 'c5db5903-5da6-4605-aa52-b7940c46fb11', None, None, None), ('af31c444-aa0e-47d0-a869-2c63365e5dd8', None, None, None, None, None), ('af31c444-aa0e-47d0-a869-2c63365e5dd8', None, None, None, None, None), ('b5d1d38c-46a6-4fff-a9b6-83a5421d08ff', '10.2.2.100', None, None, None, None), ('b5d1d38c-46a6-4fff-a9b6-83a5421d08ff', '10.2.2.200', None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:45:29.230183 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-304f8aa8-b026-4d5d-a095-05a7fd83f419 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:29.231659 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-304f8aa8-b026-4d5d-a095-05a7fd83f419 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:29.244103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-304f8aa8-b026-4d5d-a095-05a7fd83f419 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:29.245043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-304f8aa8-b026-4d5d-a095-05a7fd83f419 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:29.249095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-304f8aa8-b026-4d5d-a095-05a7fd83f419 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:29.249934 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-304f8aa8-b026-4d5d-a095-05a7fd83f419 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:29.652408 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-304f8aa8-b026-4d5d-a095-05a7fd83f419 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:29.664769 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-304f8aa8-b026-4d5d-a095-05a7fd83f419 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1511 microversion: 2.1 time: 0.438381 Jul 25 14:45:29.665381 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2253/4258] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:29 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1511 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:45:30.689693 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f0ef7251-92ea-42d5-b699-c92135c3581f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:30.691549 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f0ef7251-92ea-42d5-b699-c92135c3581f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:30.707278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0ef7251-92ea-42d5-b699-c92135c3581f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:30.708713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0ef7251-92ea-42d5-b699-c92135c3581f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:30.709749 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0ef7251-92ea-42d5-b699-c92135c3581f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:30.711243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0ef7251-92ea-42d5-b699-c92135c3581f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:31.026504 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f0ef7251-92ea-42d5-b699-c92135c3581f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:31.037062 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f0ef7251-92ea-42d5-b699-c92135c3581f tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1511 microversion: 2.1 time: 0.352250 Jul 25 14:45:31.038380 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2254/4259] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:30 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1511 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:45:32.108640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-90081a68-eeda-48f2-bf12-cf6c7381ed31 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:32.109337 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-90081a68-eeda-48f2-bf12-cf6c7381ed31 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:32.157038 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-90081a68-eeda-48f2-bf12-cf6c7381ed31 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:32.159410 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-90081a68-eeda-48f2-bf12-cf6c7381ed31 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:32.163783 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-90081a68-eeda-48f2-bf12-cf6c7381ed31 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:32.165117 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-90081a68-eeda-48f2-bf12-cf6c7381ed31 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:32.165684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=36 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:45:32.675145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-90081a68-eeda-48f2-bf12-cf6c7381ed31 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:32.698530 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-90081a68-eeda-48f2-bf12-cf6c7381ed31 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1511 microversion: 2.1 time: 0.614299 Jul 25 14:45:32.739329 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2255/4260] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:32 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1511 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:33.749560 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-13728347-7cbc-4f69-aba1-02c5e2288131 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:33.751108 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-13728347-7cbc-4f69-aba1-02c5e2288131 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:33.767787 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-13728347-7cbc-4f69-aba1-02c5e2288131 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:33.779720 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-13728347-7cbc-4f69-aba1-02c5e2288131 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:33.780874 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-13728347-7cbc-4f69-aba1-02c5e2288131 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:33.782205 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-13728347-7cbc-4f69-aba1-02c5e2288131 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:34.205732 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-13728347-7cbc-4f69-aba1-02c5e2288131 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:34.226308 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-13728347-7cbc-4f69-aba1-02c5e2288131 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1511 microversion: 2.1 time: 0.480891 Jul 25 14:45:34.242445 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2256/4261] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:33 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1511 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:45:34.867838 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d3e122e2-fa0f-403b-ab70-8f0f8c985a79 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:34.869340 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d3e122e2-fa0f-403b-ab70-8f0f8c985a79 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:34.880918 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d3e122e2-fa0f-403b-ab70-8f0f8c985a79 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:34.881417 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d3e122e2-fa0f-403b-ab70-8f0f8c985a79 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:34.883182 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d3e122e2-fa0f-403b-ab70-8f0f8c985a79 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:34.887179 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d3e122e2-fa0f-403b-ab70-8f0f8c985a79 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:34.963058 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d3e122e2-fa0f-403b-ab70-8f0f8c985a79 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4/ips" status: 200 len: 149 microversion: 2.1 time: 0.099146 Jul 25 14:45:34.964356 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2257/4262] 10.222.0.88 () {58 vars in 1248 bytes} [Mon Jul 25 14:45:34 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4/ips => generated 149 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:45:35.252396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-76620497-2cd1-4a73-877e-8f11b9ca2d65 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:35.253035 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-76620497-2cd1-4a73-877e-8f11b9ca2d65 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:35.261391 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=4 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:45:35.264813 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-76620497-2cd1-4a73-877e-8f11b9ca2d65 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:35.265262 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-76620497-2cd1-4a73-877e-8f11b9ca2d65 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:35.268613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-76620497-2cd1-4a73-877e-8f11b9ca2d65 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:35.270532 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-76620497-2cd1-4a73-877e-8f11b9ca2d65 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:35.701101 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-76620497-2cd1-4a73-877e-8f11b9ca2d65 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:35.712267 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-76620497-2cd1-4a73-877e-8f11b9ca2d65 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1511 microversion: 2.1 time: 0.462908 Jul 25 14:45:35.713010 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2258/4263] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:35 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1511 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:36.465977 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=71 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:45:36.738222 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f11abaf8-7fd7-4b05-aeb1-130d4dbc6875 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:36.740048 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f11abaf8-7fd7-4b05-aeb1-130d4dbc6875 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:36.752314 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f11abaf8-7fd7-4b05-aeb1-130d4dbc6875 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:36.753025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f11abaf8-7fd7-4b05-aeb1-130d4dbc6875 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:36.753972 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f11abaf8-7fd7-4b05-aeb1-130d4dbc6875 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:36.754613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f11abaf8-7fd7-4b05-aeb1-130d4dbc6875 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:37.031895 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f11abaf8-7fd7-4b05-aeb1-130d4dbc6875 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:37.043202 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f11abaf8-7fd7-4b05-aeb1-130d4dbc6875 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1511 microversion: 2.1 time: 0.308977 Jul 25 14:45:37.062428 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2259/4264] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:36 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1511 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:45:37.653840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-94dc9a17-bc03-4ac9-82cc-a271e89dd8a9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3e80da1-cc81-443e-8641-53a150fd4891"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:45:37.657890 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-94dc9a17-bc03-4ac9-82cc-a271e89dd8a9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:37.666755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94dc9a17-bc03-4ac9-82cc-a271e89dd8a9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:37.667654 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94dc9a17-bc03-4ac9-82cc-a271e89dd8a9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:37.668841 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94dc9a17-bc03-4ac9-82cc-a271e89dd8a9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:37.669543 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94dc9a17-bc03-4ac9-82cc-a271e89dd8a9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:38.165357 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-94dc9a17-bc03-4ac9-82cc-a271e89dd8a9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "POST /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.518064 Jul 25 14:45:38.169369 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2260/4265] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Jul 25 14:45:37 2022] POST /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4/os-volume_attachments => generated 194 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:45:38.210852 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1c3007a6-f93e-4015-b29b-36c17001d473 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:38.212720 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1c3007a6-f93e-4015-b29b-36c17001d473 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:38.240546 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1c3007a6-f93e-4015-b29b-36c17001d473 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:38.241492 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1c3007a6-f93e-4015-b29b-36c17001d473 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:38.243475 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1c3007a6-f93e-4015-b29b-36c17001d473 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:38.244279 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1c3007a6-f93e-4015-b29b-36c17001d473 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:38.682647 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1c3007a6-f93e-4015-b29b-36c17001d473 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:38.697481 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1c3007a6-f93e-4015-b29b-36c17001d473 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1511 microversion: 2.1 time: 0.521319 Jul 25 14:45:38.698800 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2261/4266] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:38 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1511 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:39.014313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-f09f0636-75dd-44e1-acd0-5d028d13472d tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:45:39.014810 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-f09f0636-75dd-44e1-acd0-5d028d13472d tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:45:39.015195 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-f09f0636-75dd-44e1-acd0-5d028d13472d tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:45:39.015604 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-f09f0636-75dd-44e1-acd0-5d028d13472d tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:45:39.016323 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-f09f0636-75dd-44e1-acd0-5d028d13472d tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:45:39.018581 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=94 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:45:39.048929 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f09f0636-75dd-44e1-acd0-5d028d13472d tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:39.052668 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f09f0636-75dd-44e1-acd0-5d028d13472d tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:39.053813 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f09f0636-75dd-44e1-acd0-5d028d13472d tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:39.054568 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f09f0636-75dd-44e1-acd0-5d028d13472d tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:39.113148 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-f09f0636-75dd-44e1-acd0-5d028d13472d tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Getting quotas for project e0b00fe1f11f472da3e053f029bd78fa. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:45:39.128716 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-f09f0636-75dd-44e1-acd0-5d028d13472d tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Getting quotas for user 59a44de1685b4c1f959a652432bd9c75 and project e0b00fe1f11f472da3e053f029bd78fa. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:45:39.557751 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f09f0636-75dd-44e1-acd0-5d028d13472d tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:45:39.560898 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f09f0636-75dd-44e1-acd0-5d028d13472d tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='d91dc121-6f52-480d-b0e0-797e80266f7b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='fbc9cc99-7f2b-4ad4-afce-c4db3f5484bc',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='61b0f0ed-79b9-41f1-8a4c-3f37d45838f9',volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:45:39.719245 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6769a2b9-3e9b-49c0-a8bb-1856dfaf5d77 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:39.719859 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6769a2b9-3e9b-49c0-a8bb-1856dfaf5d77 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:39.727523 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6769a2b9-3e9b-49c0-a8bb-1856dfaf5d77 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:39.727995 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6769a2b9-3e9b-49c0-a8bb-1856dfaf5d77 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:39.728782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6769a2b9-3e9b-49c0-a8bb-1856dfaf5d77 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:39.729223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6769a2b9-3e9b-49c0-a8bb-1856dfaf5d77 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:39.757525 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:45:40.177855 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6769a2b9-3e9b-49c0-a8bb-1856dfaf5d77 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:40.189154 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6769a2b9-3e9b-49c0-a8bb-1856dfaf5d77 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1511 microversion: 2.1 time: 0.473967 Jul 25 14:45:40.204305 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2262/4267] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:39 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1511 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:45:40.554920 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f09f0636-75dd-44e1-acd0-5d028d13472d tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 11.746817 Jul 25 14:45:40.555590 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2006/4268] 10.222.0.88 () {62 vars in 1189 bytes} [Mon Jul 25 14:45:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 11748 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 14:45:40.572282 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-14bce5f4-0b36-44a1-9267-1c0ed3657a2b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:40.574010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-14bce5f4-0b36-44a1-9267-1c0ed3657a2b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:40.827872 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-14bce5f4-0b36-44a1-9267-1c0ed3657a2b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:40.838369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-14bce5f4-0b36-44a1-9267-1c0ed3657a2b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:40.843709 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-14bce5f4-0b36-44a1-9267-1c0ed3657a2b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:40.849524 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-14bce5f4-0b36-44a1-9267-1c0ed3657a2b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1284 microversion: 2.32 time: 0.286675 Jul 25 14:45:40.851116 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2263/4269] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:45:40 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1284 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:45:41.211432 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-537b27d0-fc4e-49c6-b1a8-29e192f2275b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:41.217182 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-537b27d0-fc4e-49c6-b1a8-29e192f2275b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:41.266144 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-537b27d0-fc4e-49c6-b1a8-29e192f2275b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:41.270522 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-537b27d0-fc4e-49c6-b1a8-29e192f2275b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:41.272909 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-537b27d0-fc4e-49c6-b1a8-29e192f2275b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:41.273227 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-537b27d0-fc4e-49c6-b1a8-29e192f2275b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:41.885098 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-182b0cca-1852-4a15-95f2-9e055c2f1450 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:41.887172 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-182b0cca-1852-4a15-95f2-9e055c2f1450 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:42.053479 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-182b0cca-1852-4a15-95f2-9e055c2f1450 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:42.082955 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-182b0cca-1852-4a15-95f2-9e055c2f1450 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:42.084898 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-182b0cca-1852-4a15-95f2-9e055c2f1450 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:42.086686 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-182b0cca-1852-4a15-95f2-9e055c2f1450 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1284 microversion: 2.32 time: 0.213231 Jul 25 14:45:42.101422 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2264/4270] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:45:41 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1284 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:45:42.877190 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-537b27d0-fc4e-49c6-b1a8-29e192f2275b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:42.893458 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-537b27d0-fc4e-49c6-b1a8-29e192f2275b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1511 microversion: 2.1 time: 1.686821 Jul 25 14:45:42.894083 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2007/4271] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:41 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1511 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:43.115372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-330730ce-92be-42f5-bf5d-2967fb35705b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:43.116017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-330730ce-92be-42f5-bf5d-2967fb35705b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:43.132045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-330730ce-92be-42f5-bf5d-2967fb35705b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:43.132499 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-330730ce-92be-42f5-bf5d-2967fb35705b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:43.133294 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-330730ce-92be-42f5-bf5d-2967fb35705b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:43.133731 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-330730ce-92be-42f5-bf5d-2967fb35705b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:43.320907 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-330730ce-92be-42f5-bf5d-2967fb35705b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:43.334157 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-330730ce-92be-42f5-bf5d-2967fb35705b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:43.340523 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-330730ce-92be-42f5-bf5d-2967fb35705b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:43.346889 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-330730ce-92be-42f5-bf5d-2967fb35705b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1582 microversion: 2.32 time: 0.231656 Jul 25 14:45:43.348324 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2265/4272] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:45:43 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1582 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:45:43.918422 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-43273531-2b10-4e0b-ab57-a913a361a31c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:43.919050 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-43273531-2b10-4e0b-ab57-a913a361a31c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:43.941112 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43273531-2b10-4e0b-ab57-a913a361a31c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:43.948206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43273531-2b10-4e0b-ab57-a913a361a31c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:43.949376 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43273531-2b10-4e0b-ab57-a913a361a31c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:43.952086 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43273531-2b10-4e0b-ab57-a913a361a31c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:44.373818 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e1a8fccd-54a0-45fa-894e-bd5a201bbf06 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:44.375159 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e1a8fccd-54a0-45fa-894e-bd5a201bbf06 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:44.391269 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e1a8fccd-54a0-45fa-894e-bd5a201bbf06 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:44.392281 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e1a8fccd-54a0-45fa-894e-bd5a201bbf06 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:44.393330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e1a8fccd-54a0-45fa-894e-bd5a201bbf06 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:44.394002 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e1a8fccd-54a0-45fa-894e-bd5a201bbf06 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:44.657980 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e1a8fccd-54a0-45fa-894e-bd5a201bbf06 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:44.674013 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e1a8fccd-54a0-45fa-894e-bd5a201bbf06 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:44.678880 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e1a8fccd-54a0-45fa-894e-bd5a201bbf06 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:44.688949 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e1a8fccd-54a0-45fa-894e-bd5a201bbf06 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1592 microversion: 2.32 time: 0.311442 Jul 25 14:45:44.689793 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2266/4273] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:45:44 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1592 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:45:44.901208 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-43273531-2b10-4e0b-ab57-a913a361a31c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:44.915066 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-43273531-2b10-4e0b-ab57-a913a361a31c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1511 microversion: 2.1 time: 1.001132 Jul 25 14:45:44.916327 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2008/4274] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:43 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1511 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:45.716549 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-70273e05-e0bb-47ca-a651-611a7a6504d6 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:45.717816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-70273e05-e0bb-47ca-a651-611a7a6504d6 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:45.725486 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-70273e05-e0bb-47ca-a651-611a7a6504d6 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:45.726175 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-70273e05-e0bb-47ca-a651-611a7a6504d6 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:45.727131 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-70273e05-e0bb-47ca-a651-611a7a6504d6 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:45.727732 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-70273e05-e0bb-47ca-a651-611a7a6504d6 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:45.793814 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-70273e05-e0bb-47ca-a651-611a7a6504d6 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:45.803180 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-70273e05-e0bb-47ca-a651-611a7a6504d6 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:45.804710 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-70273e05-e0bb-47ca-a651-611a7a6504d6 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:45.805867 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-70273e05-e0bb-47ca-a651-611a7a6504d6 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1592 microversion: 2.32 time: 0.093422 Jul 25 14:45:45.814567 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2267/4275] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:45:45 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1592 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:45:45.944764 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-08083f89-4721-4393-a55e-598d29919b33 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:45.947636 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-08083f89-4721-4393-a55e-598d29919b33 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:45.957086 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08083f89-4721-4393-a55e-598d29919b33 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:45.957868 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08083f89-4721-4393-a55e-598d29919b33 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:45.959016 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08083f89-4721-4393-a55e-598d29919b33 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:45.959856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08083f89-4721-4393-a55e-598d29919b33 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:46.479811 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-08083f89-4721-4393-a55e-598d29919b33 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:46.494643 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-08083f89-4721-4393-a55e-598d29919b33 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1488 microversion: 2.1 time: 0.557307 Jul 25 14:45:46.497815 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2009/4276] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:45 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1488 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:46.521543 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ae83e4ba-36d2-4ecc-a5b2-6b6736a1edd7 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:46.522055 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ae83e4ba-36d2-4ecc-a5b2-6b6736a1edd7 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:46.542627 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ae83e4ba-36d2-4ecc-a5b2-6b6736a1edd7 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:46.545769 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ae83e4ba-36d2-4ecc-a5b2-6b6736a1edd7 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:46.549581 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ae83e4ba-36d2-4ecc-a5b2-6b6736a1edd7 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:46.550283 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ae83e4ba-36d2-4ecc-a5b2-6b6736a1edd7 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:46.638150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ae83e4ba-36d2-4ecc-a5b2-6b6736a1edd7 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:45:46.843544 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8745bb1a-53ca-4ca4-92ac-119176cf58c7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:46.844556 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8745bb1a-53ca-4ca4-92ac-119176cf58c7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:46.867022 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8745bb1a-53ca-4ca4-92ac-119176cf58c7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:46.869865 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8745bb1a-53ca-4ca4-92ac-119176cf58c7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:46.872114 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8745bb1a-53ca-4ca4-92ac-119176cf58c7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:46.874636 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8745bb1a-53ca-4ca4-92ac-119176cf58c7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:46.906961 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ae83e4ba-36d2-4ecc-a5b2-6b6736a1edd7 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "DELETE /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 204 len: 0 microversion: 2.1 time: 0.391057 Jul 25 14:45:46.912839 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2268/4277] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:45:46 2022] DELETE /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:45:46.934936 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a2db9187-3e68-462d-b585-bf33a1f91a4c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:46.938785 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a2db9187-3e68-462d-b585-bf33a1f91a4c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:46.965790 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a2db9187-3e68-462d-b585-bf33a1f91a4c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:46.970085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a2db9187-3e68-462d-b585-bf33a1f91a4c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:46.975128 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a2db9187-3e68-462d-b585-bf33a1f91a4c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:46.977316 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a2db9187-3e68-462d-b585-bf33a1f91a4c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:47.090348 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8745bb1a-53ca-4ca4-92ac-119176cf58c7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:47.103565 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8745bb1a-53ca-4ca4-92ac-119176cf58c7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:47.114985 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8745bb1a-53ca-4ca4-92ac-119176cf58c7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:47.125126 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8745bb1a-53ca-4ca4-92ac-119176cf58c7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1592 microversion: 2.32 time: 0.290742 Jul 25 14:45:47.127900 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2010/4278] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:45:46 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1592 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:45:47.330373 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5f1df451-1ea3-4b98-98be-afac8c602d0f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1972230995", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "87cfcadc-6ea1-4167-a535-aad1c1b10077"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:45:47.437889 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-5f1df451-1ea3-4b98-98be-afac8c602d0f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] validate_networks() for [('87cfcadc-6ea1-4167-a535-aad1c1b10077', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:45:47.456492 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a2db9187-3e68-462d-b585-bf33a1f91a4c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:47.469424 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a2db9187-3e68-462d-b585-bf33a1f91a4c tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1494 microversion: 2.1 time: 0.551110 Jul 25 14:45:47.474372 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2269/4279] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:46 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1494 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:48.153677 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f543766d-75c5-4276-89fb-7f32940b6d6b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:48.154350 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f543766d-75c5-4276-89fb-7f32940b6d6b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:48.170758 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f543766d-75c5-4276-89fb-7f32940b6d6b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:48.171229 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f543766d-75c5-4276-89fb-7f32940b6d6b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:48.173452 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f543766d-75c5-4276-89fb-7f32940b6d6b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:48.174143 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f543766d-75c5-4276-89fb-7f32940b6d6b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:48.514961 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-5f1df451-1ea3-4b98-98be-afac8c602d0f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:45:48.515406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-5f1df451-1ea3-4b98-98be-afac8c602d0f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:45:48.516665 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-5f1df451-1ea3-4b98-98be-afac8c602d0f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:45:48.517121 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-5f1df451-1ea3-4b98-98be-afac8c602d0f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:45:48.517576 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-5f1df451-1ea3-4b98-98be-afac8c602d0f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:45:48.540776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f1df451-1ea3-4b98-98be-afac8c602d0f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:48.543088 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f1df451-1ea3-4b98-98be-afac8c602d0f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:48.546746 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f1df451-1ea3-4b98-98be-afac8c602d0f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:48.547608 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f1df451-1ea3-4b98-98be-afac8c602d0f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:48.593740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-5f1df451-1ea3-4b98-98be-afac8c602d0f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Getting quotas for project 87b0942d86634ed0a2f89a0001b5a887. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:45:48.609776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-5f1df451-1ea3-4b98-98be-afac8c602d0f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Getting quotas for user 6e3de16106b3455b85f90dcd94d39ce0 and project 87b0942d86634ed0a2f89a0001b5a887. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:45:48.680722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5f1df451-1ea3-4b98-98be-afac8c602d0f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:45:48.688799 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5f1df451-1ea3-4b98-98be-afac8c602d0f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 704739ea-1723-4329-9079-fb1fe74df834] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:45:48.815942 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5f1df451-1ea3-4b98-98be-afac8c602d0f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.604393 Jul 25 14:45:48.817941 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2011/4280] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:45:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 14:45:48.827742 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7cf57e81-7e16-442a-a640-762a33167da0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:48.828493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7cf57e81-7e16-442a-a640-762a33167da0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:48.856263 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7cf57e81-7e16-442a-a640-762a33167da0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:48.858681 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7cf57e81-7e16-442a-a640-762a33167da0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:48.862863 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7cf57e81-7e16-442a-a640-762a33167da0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:48.864452 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7cf57e81-7e16-442a-a640-762a33167da0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:49.095501 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f543766d-75c5-4276-89fb-7f32940b6d6b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:49.105392 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f543766d-75c5-4276-89fb-7f32940b6d6b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:49.115995 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f543766d-75c5-4276-89fb-7f32940b6d6b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:49.120558 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f543766d-75c5-4276-89fb-7f32940b6d6b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1660 microversion: 2.32 time: 0.968712 Jul 25 14:45:49.123961 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2270/4281] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:45:48 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1660 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:45:49.133660 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b154ec0f-8327-45c7-87d2-600e3b1f519d tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:49.134295 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b154ec0f-8327-45c7-87d2-600e3b1f519d tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 704739ea-1723-4329-9079-fb1fe74df834] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:49.304574 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b154ec0f-8327-45c7-87d2-600e3b1f519d tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:49.313209 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b154ec0f-8327-45c7-87d2-600e3b1f519d tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834" status: 200 len: 1208 microversion: 2.1 time: 0.187987 Jul 25 14:45:49.316253 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2271/4282] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:49 2022] GET /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834 => generated 1208 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:49.412994 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7cf57e81-7e16-442a-a640-762a33167da0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:49.425859 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7cf57e81-7e16-442a-a640-762a33167da0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 200 len: 1452 microversion: 2.1 time: 0.606738 Jul 25 14:45:49.430539 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2012/4283] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:48 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 1452 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:49.781387 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-211e5587-dcab-4927-898e-c82fe89c5052 req-8bf40c05-a7bd-4633-ae4d-382afadf5b3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad236d1f-2ae4-49b3-8c93-5c0348fdb112", "name": "network-vif-deleted", "tag": "666fb687-d862-4192-8e61-2e74d515522c"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:45:49.814713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-211e5587-dcab-4927-898e-c82fe89c5052 req-8bf40c05-a7bd-4633-ae4d-382afadf5b3c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:49.816534 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-211e5587-dcab-4927-898e-c82fe89c5052 req-8bf40c05-a7bd-4633-ae4d-382afadf5b3c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:49.870514 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-211e5587-dcab-4927-898e-c82fe89c5052 req-8bf40c05-a7bd-4633-ae4d-382afadf5b3c service nova] Creating event network-vif-deleted:666fb687-d862-4192-8e61-2e74d515522c for instance ad236d1f-2ae4-49b3-8c93-5c0348fdb112 on n-h2-846435-14 Jul 25 14:45:49.884295 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-211e5587-dcab-4927-898e-c82fe89c5052 req-8bf40c05-a7bd-4633-ae4d-382afadf5b3c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113630 Jul 25 14:45:49.889641 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2272/4284] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:45:50.151525 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-42645a08-70e9-4f76-9cc1-de7ed7546561 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:50.153289 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-42645a08-70e9-4f76-9cc1-de7ed7546561 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:50.173262 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42645a08-70e9-4f76-9cc1-de7ed7546561 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:50.174091 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42645a08-70e9-4f76-9cc1-de7ed7546561 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:50.175109 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42645a08-70e9-4f76-9cc1-de7ed7546561 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:50.175757 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42645a08-70e9-4f76-9cc1-de7ed7546561 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:50.342918 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4798862e-287b-4377-9785-e0fa6efe54ca tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:50.343759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4798862e-287b-4377-9785-e0fa6efe54ca tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 704739ea-1723-4329-9079-fb1fe74df834] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:50.348715 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:45:50.357588 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4798862e-287b-4377-9785-e0fa6efe54ca tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:50.358323 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4798862e-287b-4377-9785-e0fa6efe54ca tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:50.359290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4798862e-287b-4377-9785-e0fa6efe54ca tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:50.360032 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4798862e-287b-4377-9785-e0fa6efe54ca tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:50.592786 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4798862e-287b-4377-9785-e0fa6efe54ca tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:50.607587 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4798862e-287b-4377-9785-e0fa6efe54ca tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834" status: 200 len: 1204 microversion: 2.1 time: 0.273894 Jul 25 14:45:50.628660 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-42645a08-70e9-4f76-9cc1-de7ed7546561 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:50.631825 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2273/4285] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:50 2022] GET /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834 => generated 1204 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:50.640519 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-95fd6750-ede9-4e53-84c7-959ac3ceef39 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:50.642790 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-42645a08-70e9-4f76-9cc1-de7ed7546561 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:50.644349 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-42645a08-70e9-4f76-9cc1-de7ed7546561 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:50.645118 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-95fd6750-ede9-4e53-84c7-959ac3ceef39 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:50.645580 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-42645a08-70e9-4f76-9cc1-de7ed7546561 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1707 microversion: 2.32 time: 0.498007 Jul 25 14:45:50.646161 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2013/4286] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:45:50 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1707 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:45:50.669024 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-95fd6750-ede9-4e53-84c7-959ac3ceef39 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:50.669878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-95fd6750-ede9-4e53-84c7-959ac3ceef39 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:50.671405 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-95fd6750-ede9-4e53-84c7-959ac3ceef39 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:50.673022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-95fd6750-ede9-4e53-84c7-959ac3ceef39 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:50.732078 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-95fd6750-ede9-4e53-84c7-959ac3ceef39 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] HTTP exception thrown: Instance ad236d1f-2ae4-49b3-8c93-5c0348fdb112 could not be found. Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-95fd6750-ede9-4e53-84c7-959ac3ceef39 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Request method failure captured: Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 HTTP/1.1 Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3quERREaOs3Kc7iY1Vh9GKraPJ63kqwGO_-k7wXB_J3XVEfBf3LNTXeHb07R82UwUNgvRdojb21TsSuL636LebhCUID5TJuapIn-Sgeh4nT2_p48qkoLx6k1MrIDkEY7ueSXXEfRqNxtsyFtJzfjwKFOLGr5sudf0H8jELBV5u89FK0 Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b9b1c620d0b14a3a9471515cf47d6944", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b9b1c620d0b14a3a9471515cf47d6944"}]}] Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 33f992249063495c8bf12954afd9e8b7 Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance ad236d1f-2ae4-49b3-8c93-5c0348fdb112 could not be found. Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'ad236d1f-2ae4-49b3-8c93-5c0348fdb112'} Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad236d1f-2ae4-49b3-8c93-5c0348fdb112 could not be found. Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad236d1f-2ae4-49b3-8c93-5c0348fdb112 could not be found. Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:45:50.737885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:45:50.742050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:45:50.742050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:45:50.742050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:45:50.742050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:45:50.742050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:45:50.742050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad236d1f-2ae4-49b3-8c93-5c0348fdb112 could not be found. Jul 25 14:45:50.742050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:45:50.742050 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-95fd6750-ede9-4e53-84c7-959ac3ceef39 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Returning 404 to user: Instance ad236d1f-2ae4-49b3-8c93-5c0348fdb112 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:45:50.745559 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-95fd6750-ede9-4e53-84c7-959ac3ceef39 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 404 len: 111 microversion: 2.1 time: 0.110462 Jul 25 14:45:50.761323 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2274/4287] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:50 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:45:50.921253 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e52dad98-7dcd-4334-a69f-492cf86b2c60 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-884417088", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "e81cd55f-4951-41ed-b82a-173584e324cb"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:45:51.000324 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-e52dad98-7dcd-4334-a69f-492cf86b2c60 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] validate_networks() for [('e81cd55f-4951-41ed-b82a-173584e324cb', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:45:51.630071 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2f358e34-9f05-4366-a739-8adad1685096 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:51.632184 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2f358e34-9f05-4366-a739-8adad1685096 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 704739ea-1723-4329-9079-fb1fe74df834] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:51.641733 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2f358e34-9f05-4366-a739-8adad1685096 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:51.642463 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2f358e34-9f05-4366-a739-8adad1685096 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:51.643640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2f358e34-9f05-4366-a739-8adad1685096 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:51.644410 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2f358e34-9f05-4366-a739-8adad1685096 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:51.805953 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2f358e34-9f05-4366-a739-8adad1685096 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:51.834129 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2f358e34-9f05-4366-a739-8adad1685096 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834" status: 200 len: 1266 microversion: 2.1 time: 0.208161 Jul 25 14:45:51.835349 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2275/4288] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:51 2022] GET /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:51.842284 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f5f01ac8-5631-4a0e-acf3-9fe2ccc1022b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:51.843551 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f5f01ac8-5631-4a0e-acf3-9fe2ccc1022b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:51.854590 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5f01ac8-5631-4a0e-acf3-9fe2ccc1022b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:51.855295 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5f01ac8-5631-4a0e-acf3-9fe2ccc1022b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:51.856320 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5f01ac8-5631-4a0e-acf3-9fe2ccc1022b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:51.856927 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5f01ac8-5631-4a0e-acf3-9fe2ccc1022b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:52.122893 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f5f01ac8-5631-4a0e-acf3-9fe2ccc1022b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:52.149350 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f5f01ac8-5631-4a0e-acf3-9fe2ccc1022b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:52.151832 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f5f01ac8-5631-4a0e-acf3-9fe2ccc1022b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:52.154934 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f5f01ac8-5631-4a0e-acf3-9fe2ccc1022b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1707 microversion: 2.32 time: 0.318290 Jul 25 14:45:52.156391 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2276/4289] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:45:51 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1707 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:45:52.863243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d66ede44-8650-472a-908e-9abf3ab140e1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:52.865117 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d66ede44-8650-472a-908e-9abf3ab140e1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 704739ea-1723-4329-9079-fb1fe74df834] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:52.866499 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-e52dad98-7dcd-4334-a69f-492cf86b2c60 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:45:52.866973 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-e52dad98-7dcd-4334-a69f-492cf86b2c60 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:45:52.867413 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-e52dad98-7dcd-4334-a69f-492cf86b2c60 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:45:52.867953 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-e52dad98-7dcd-4334-a69f-492cf86b2c60 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:45:52.868253 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-e52dad98-7dcd-4334-a69f-492cf86b2c60 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:45:52.874286 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d66ede44-8650-472a-908e-9abf3ab140e1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:52.874875 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d66ede44-8650-472a-908e-9abf3ab140e1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:52.876035 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d66ede44-8650-472a-908e-9abf3ab140e1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:52.876689 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d66ede44-8650-472a-908e-9abf3ab140e1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:52.892552 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e52dad98-7dcd-4334-a69f-492cf86b2c60 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:52.893317 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e52dad98-7dcd-4334-a69f-492cf86b2c60 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:52.895712 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e52dad98-7dcd-4334-a69f-492cf86b2c60 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:52.898038 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e52dad98-7dcd-4334-a69f-492cf86b2c60 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:52.925600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-e52dad98-7dcd-4334-a69f-492cf86b2c60 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Getting quotas for project b9b1c620d0b14a3a9471515cf47d6944. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:45:52.932933 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-e52dad98-7dcd-4334-a69f-492cf86b2c60 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Getting quotas for user 33f992249063495c8bf12954afd9e8b7 and project b9b1c620d0b14a3a9471515cf47d6944. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:45:52.956374 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e52dad98-7dcd-4334-a69f-492cf86b2c60 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:45:52.958981 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e52dad98-7dcd-4334-a69f-492cf86b2c60 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 2d780b3a-1e25-4d3f-abdb-6319880dcb51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:45:53.036653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d66ede44-8650-472a-908e-9abf3ab140e1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:53.045191 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d66ede44-8650-472a-908e-9abf3ab140e1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834" status: 200 len: 1266 microversion: 2.1 time: 0.185832 Jul 25 14:45:53.046133 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2277/4290] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:52 2022] GET /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:45:53.051245 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e52dad98-7dcd-4334-a69f-492cf86b2c60 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.133258 Jul 25 14:45:53.054950 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2014/4291] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:45:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:45:53.066939 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-777dbb58-00bc-4ce7-9acd-9883f7b54711 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:53.067614 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-777dbb58-00bc-4ce7-9acd-9883f7b54711 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 2d780b3a-1e25-4d3f-abdb-6319880dcb51] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:53.178800 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-774e7fd5-73ab-4d01-a410-75925bbf8d8f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:53.179655 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-774e7fd5-73ab-4d01-a410-75925bbf8d8f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:53.191144 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-774e7fd5-73ab-4d01-a410-75925bbf8d8f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:53.198379 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-774e7fd5-73ab-4d01-a410-75925bbf8d8f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:53.199603 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-774e7fd5-73ab-4d01-a410-75925bbf8d8f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:53.200241 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-774e7fd5-73ab-4d01-a410-75925bbf8d8f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:53.237124 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-777dbb58-00bc-4ce7-9acd-9883f7b54711 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:53.247484 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-777dbb58-00bc-4ce7-9acd-9883f7b54711 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51" status: 200 len: 1214 microversion: 2.1 time: 0.184839 Jul 25 14:45:53.248183 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2278/4292] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:53 2022] GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51 => generated 1214 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:53.591065 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-774e7fd5-73ab-4d01-a410-75925bbf8d8f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:53.609905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-774e7fd5-73ab-4d01-a410-75925bbf8d8f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:53.612576 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-774e7fd5-73ab-4d01-a410-75925bbf8d8f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:53.615072 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-774e7fd5-73ab-4d01-a410-75925bbf8d8f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1754 microversion: 2.32 time: 0.439781 Jul 25 14:45:53.616628 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2015/4293] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:45:53 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1754 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:45:54.074406 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c480b785-f1aa-4247-9893-d4ccbd88e6c1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:54.075028 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c480b785-f1aa-4247-9893-d4ccbd88e6c1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 704739ea-1723-4329-9079-fb1fe74df834] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:54.089868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c480b785-f1aa-4247-9893-d4ccbd88e6c1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:54.090327 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c480b785-f1aa-4247-9893-d4ccbd88e6c1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:54.091137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c480b785-f1aa-4247-9893-d4ccbd88e6c1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:54.095168 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c480b785-f1aa-4247-9893-d4ccbd88e6c1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:54.273906 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3aa4f344-e1d8-455d-9973-4a6c85ca318b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:54.274553 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3aa4f344-e1d8-455d-9973-4a6c85ca318b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 2d780b3a-1e25-4d3f-abdb-6319880dcb51] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:54.306208 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3aa4f344-e1d8-455d-9973-4a6c85ca318b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:54.307397 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3aa4f344-e1d8-455d-9973-4a6c85ca318b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:54.311572 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3aa4f344-e1d8-455d-9973-4a6c85ca318b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:54.314548 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3aa4f344-e1d8-455d-9973-4a6c85ca318b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:54.471840 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3aa4f344-e1d8-455d-9973-4a6c85ca318b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:54.480757 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3aa4f344-e1d8-455d-9973-4a6c85ca318b tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51" status: 200 len: 1210 microversion: 2.1 time: 0.211453 Jul 25 14:45:54.488381 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2016/4294] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:54 2022] GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51 => generated 1210 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:54.638770 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-eada85d9-bb9b-4d2e-b025-951285f5125f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:54.639386 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-eada85d9-bb9b-4d2e-b025-951285f5125f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:54.656137 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eada85d9-bb9b-4d2e-b025-951285f5125f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:54.656896 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eada85d9-bb9b-4d2e-b025-951285f5125f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:54.657852 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eada85d9-bb9b-4d2e-b025-951285f5125f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:54.658455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eada85d9-bb9b-4d2e-b025-951285f5125f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:55.023133 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c480b785-f1aa-4247-9893-d4ccbd88e6c1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:55.045152 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c480b785-f1aa-4247-9893-d4ccbd88e6c1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834" status: 200 len: 1308 microversion: 2.1 time: 0.974870 Jul 25 14:45:55.046071 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2279/4295] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:54 2022] GET /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834 => generated 1308 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:55.511201 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c557d756-0632-487f-bff0-8ce450c3aa99 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:55.519195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c557d756-0632-487f-bff0-8ce450c3aa99 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 2d780b3a-1e25-4d3f-abdb-6319880dcb51] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:55.548443 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c557d756-0632-487f-bff0-8ce450c3aa99 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:55.549327 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c557d756-0632-487f-bff0-8ce450c3aa99 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:55.550630 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c557d756-0632-487f-bff0-8ce450c3aa99 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:55.551378 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c557d756-0632-487f-bff0-8ce450c3aa99 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:55.604517 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-eada85d9-bb9b-4d2e-b025-951285f5125f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:55.617930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-eada85d9-bb9b-4d2e-b025-951285f5125f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:55.621094 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-eada85d9-bb9b-4d2e-b025-951285f5125f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:55.624242 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-eada85d9-bb9b-4d2e-b025-951285f5125f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1754 microversion: 2.32 time: 0.988678 Jul 25 14:45:55.626921 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2017/4296] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:45:54 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1754 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:45:55.666842 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c557d756-0632-487f-bff0-8ce450c3aa99 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:55.679780 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c557d756-0632-487f-bff0-8ce450c3aa99 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51" status: 200 len: 1272 microversion: 2.1 time: 0.176683 Jul 25 14:45:55.680759 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2280/4297] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:55 2022] GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51 => generated 1272 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:45:56.068567 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2b58426e-a08a-4045-8fc2-e5899646d347 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:56.069716 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2b58426e-a08a-4045-8fc2-e5899646d347 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 704739ea-1723-4329-9079-fb1fe74df834] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:56.084451 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2b58426e-a08a-4045-8fc2-e5899646d347 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:56.088880 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2b58426e-a08a-4045-8fc2-e5899646d347 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:56.090178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2b58426e-a08a-4045-8fc2-e5899646d347 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:56.092123 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2b58426e-a08a-4045-8fc2-e5899646d347 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:56.651145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ea98931f-2a62-47c8-8ea8-2e3daeb43597 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:56.652148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ea98931f-2a62-47c8-8ea8-2e3daeb43597 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:56.668754 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea98931f-2a62-47c8-8ea8-2e3daeb43597 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:56.669348 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea98931f-2a62-47c8-8ea8-2e3daeb43597 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:56.670352 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea98931f-2a62-47c8-8ea8-2e3daeb43597 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:56.671093 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea98931f-2a62-47c8-8ea8-2e3daeb43597 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:57.230412 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2b58426e-a08a-4045-8fc2-e5899646d347 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:57.239515 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2b58426e-a08a-4045-8fc2-e5899646d347 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834" status: 200 len: 1308 microversion: 2.1 time: 1.175109 Jul 25 14:45:57.243379 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2018/4298] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:56 2022] GET /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834 => generated 1308 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:57.255610 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5dde89d4-6c60-40fb-b9d0-d5f72f6fbf19 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:57.261087 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5dde89d4-6c60-40fb-b9d0-d5f72f6fbf19 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 2d780b3a-1e25-4d3f-abdb-6319880dcb51] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:57.281175 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5dde89d4-6c60-40fb-b9d0-d5f72f6fbf19 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:57.282048 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5dde89d4-6c60-40fb-b9d0-d5f72f6fbf19 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:57.285750 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5dde89d4-6c60-40fb-b9d0-d5f72f6fbf19 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:57.286313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5dde89d4-6c60-40fb-b9d0-d5f72f6fbf19 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:57.371175 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ea98931f-2a62-47c8-8ea8-2e3daeb43597 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:57.403518 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ea98931f-2a62-47c8-8ea8-2e3daeb43597 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:57.406867 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ea98931f-2a62-47c8-8ea8-2e3daeb43597 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:57.409061 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ea98931f-2a62-47c8-8ea8-2e3daeb43597 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1801 microversion: 2.32 time: 0.761952 Jul 25 14:45:57.410416 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2281/4299] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:45:56 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1801 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:45:57.432443 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5dde89d4-6c60-40fb-b9d0-d5f72f6fbf19 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:57.451228 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5dde89d4-6c60-40fb-b9d0-d5f72f6fbf19 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51" status: 200 len: 1272 microversion: 2.1 time: 0.205195 Jul 25 14:45:57.455584 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2019/4300] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:57 2022] GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51 => generated 1272 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:57.622459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-c0828233-8e7e-4ca8-b8ee-636caaf8670a req-68a0e762-e5fc-47fc-a341-fbe77f051861 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "704739ea-1723-4329-9079-fb1fe74df834", "tag": "8881ca7e-189b-4847-bbfd-77c36558c743"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:45:57.652290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c0828233-8e7e-4ca8-b8ee-636caaf8670a req-68a0e762-e5fc-47fc-a341-fbe77f051861 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:57.659424 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c0828233-8e7e-4ca8-b8ee-636caaf8670a req-68a0e762-e5fc-47fc-a341-fbe77f051861 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:57.691062 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-c0828233-8e7e-4ca8-b8ee-636caaf8670a req-68a0e762-e5fc-47fc-a341-fbe77f051861 service nova] Creating event network-changed:8881ca7e-189b-4847-bbfd-77c36558c743 for instance 704739ea-1723-4329-9079-fb1fe74df834 on n-h2-846435-14 Jul 25 14:45:57.699378 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-c0828233-8e7e-4ca8-b8ee-636caaf8670a req-68a0e762-e5fc-47fc-a341-fbe77f051861 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081349 Jul 25 14:45:57.701129 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2282/4301] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:45:58.268758 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6ad4216b-f4da-4d76-b08c-83ca85d31f48 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:58.269261 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6ad4216b-f4da-4d76-b08c-83ca85d31f48 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 704739ea-1723-4329-9079-fb1fe74df834] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:58.277531 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ad4216b-f4da-4d76-b08c-83ca85d31f48 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:58.278713 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ad4216b-f4da-4d76-b08c-83ca85d31f48 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:58.279711 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ad4216b-f4da-4d76-b08c-83ca85d31f48 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:58.280395 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ad4216b-f4da-4d76-b08c-83ca85d31f48 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:58.449100 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b79aa1b5-9dab-44da-a368-332fe0015eea tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:58.449798 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b79aa1b5-9dab-44da-a368-332fe0015eea tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:58.486750 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b79aa1b5-9dab-44da-a368-332fe0015eea tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:58.491635 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b79aa1b5-9dab-44da-a368-332fe0015eea tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:58.496650 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b79aa1b5-9dab-44da-a368-332fe0015eea tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:58.499525 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b79aa1b5-9dab-44da-a368-332fe0015eea tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:58.604268 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:45:59.047805 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b79aa1b5-9dab-44da-a368-332fe0015eea tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:59.062103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b79aa1b5-9dab-44da-a368-332fe0015eea tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:59.063656 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b79aa1b5-9dab-44da-a368-332fe0015eea tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:59.074233 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b79aa1b5-9dab-44da-a368-332fe0015eea tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1848 microversion: 2.32 time: 0.639412 Jul 25 14:45:59.093537 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2283/4302] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:45:58 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1848 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:45:59.101230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e0ad1c22-ce3d-49c5-93fa-a46af0cc586d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:45:59.102192 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e0ad1c22-ce3d-49c5-93fa-a46af0cc586d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 2d780b3a-1e25-4d3f-abdb-6319880dcb51] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:45:59.115791 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e0ad1c22-ce3d-49c5-93fa-a46af0cc586d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:59.116414 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e0ad1c22-ce3d-49c5-93fa-a46af0cc586d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:59.118108 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e0ad1c22-ce3d-49c5-93fa-a46af0cc586d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:45:59.119815 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e0ad1c22-ce3d-49c5-93fa-a46af0cc586d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:45:59.207548 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6ad4216b-f4da-4d76-b08c-83ca85d31f48 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:59.217970 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6ad4216b-f4da-4d76-b08c-83ca85d31f48 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834" status: 200 len: 1308 microversion: 2.1 time: 0.956816 Jul 25 14:45:59.219746 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2020/4303] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:58 2022] GET /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834 => generated 1308 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:59.389342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e0ad1c22-ce3d-49c5-93fa-a46af0cc586d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:45:59.399606 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e0ad1c22-ce3d-49c5-93fa-a46af0cc586d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51" status: 200 len: 1314 microversion: 2.1 time: 0.304081 Jul 25 14:45:59.400324 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2284/4304] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:45:59 2022] GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:45:59.845588 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3c71b790-ecb0-44e4-89d2-6b6554881b66 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Action: 'create', calling method: .version_select at 0x7f46866b2af0>, body: {"keypair": {"name": "tempest-keypair-2109503431", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCagLOGcQWQnA9RfuYCoOsju5aGAt/XWNVBaUBxtro2AeAlaXJGwcBTWddF+zi/ZqB7Piu1sCbI/cDhhpvYZJJM1aSGLwM/xQXkudrTwbQ2M2v/1kDQQyPnbRIQJzvZdSw=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:45:59.878753 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-3c71b790-ecb0-44e4-89d2-6b6554881b66 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Getting quotas for project 325aff76e61141a985b3b0f45521444f. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:45:59.893220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-3c71b790-ecb0-44e4-89d2-6b6554881b66 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Getting quotas for user 571a2d92d7a34f86bb3c0bfdfcabc5ff and project 325aff76e61141a985b3b0f45521444f. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:45:59.941831 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3c71b790-ecb0-44e4-89d2-6b6554881b66 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.100437 Jul 25 14:45:59.942459 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2021/4305] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:45:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:46:00.099230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a1908a82-3890-45ed-9896-5e917e2330e1 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:00.099791 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a1908a82-3890-45ed-9896-5e917e2330e1 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:00.116989 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1908a82-3890-45ed-9896-5e917e2330e1 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:00.117760 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1908a82-3890-45ed-9896-5e917e2330e1 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:00.118823 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1908a82-3890-45ed-9896-5e917e2330e1 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:00.120817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1908a82-3890-45ed-9896-5e917e2330e1 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:00.240557 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a6ec4ee0-0f9f-42c5-8e06-c09811b6dedc tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:00.241354 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a6ec4ee0-0f9f-42c5-8e06-c09811b6dedc tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 704739ea-1723-4329-9079-fb1fe74df834] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:00.257218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a6ec4ee0-0f9f-42c5-8e06-c09811b6dedc tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:00.257948 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a6ec4ee0-0f9f-42c5-8e06-c09811b6dedc tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:00.258878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a6ec4ee0-0f9f-42c5-8e06-c09811b6dedc tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:00.259491 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a6ec4ee0-0f9f-42c5-8e06-c09811b6dedc tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:00.847022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a1908a82-3890-45ed-9896-5e917e2330e1 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:00.874818 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a1908a82-3890-45ed-9896-5e917e2330e1 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:00.881899 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a1908a82-3890-45ed-9896-5e917e2330e1 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:00.884150 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a1908a82-3890-45ed-9896-5e917e2330e1 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1848 microversion: 2.32 time: 0.788833 Jul 25 14:46:00.906830 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2285/4306] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:46:00 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1848 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:46:00.926630 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a1ae5e5e-71a8-4c82-bddd-b1b5ccf25111 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:00.928069 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a1ae5e5e-71a8-4c82-bddd-b1b5ccf25111 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 2d780b3a-1e25-4d3f-abdb-6319880dcb51] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:00.944362 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1ae5e5e-71a8-4c82-bddd-b1b5ccf25111 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:00.945137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1ae5e5e-71a8-4c82-bddd-b1b5ccf25111 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:00.946496 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1ae5e5e-71a8-4c82-bddd-b1b5ccf25111 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:00.947221 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1ae5e5e-71a8-4c82-bddd-b1b5ccf25111 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:01.098703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a6ec4ee0-0f9f-42c5-8e06-c09811b6dedc tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:01.144607 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a6ec4ee0-0f9f-42c5-8e06-c09811b6dedc tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834" status: 200 len: 1308 microversion: 2.1 time: 0.895664 Jul 25 14:46:01.169392 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2022/4307] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:00 2022] GET /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834 => generated 1308 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:01.396668 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-a0902824-692e-459a-a9a0-d633eaa11b89 req-154df323-6a5d-4ceb-93c8-a0a59cd27742 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d780b3a-1e25-4d3f-abdb-6319880dcb51", "tag": "2dd900ad-9040-4334-be0e-e28a1e64fae0"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:46:01.502502 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-a0902824-692e-459a-a9a0-d633eaa11b89 req-154df323-6a5d-4ceb-93c8-a0a59cd27742 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:01.503217 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-a0902824-692e-459a-a9a0-d633eaa11b89 req-154df323-6a5d-4ceb-93c8-a0a59cd27742 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:01.561754 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-a0902824-692e-459a-a9a0-d633eaa11b89 req-154df323-6a5d-4ceb-93c8-a0a59cd27742 service nova] Creating event network-changed:2dd900ad-9040-4334-be0e-e28a1e64fae0 for instance 2d780b3a-1e25-4d3f-abdb-6319880dcb51 on n-h1-846435-14 Jul 25 14:46:01.593118 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-a0902824-692e-459a-a9a0-d633eaa11b89 req-154df323-6a5d-4ceb-93c8-a0a59cd27742 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.222227 Jul 25 14:46:01.595156 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2023/4308] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:46:01.936697 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fb7f4b8a-cec3-468c-b04f-e0e529b80a95 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:01.938684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fb7f4b8a-cec3-468c-b04f-e0e529b80a95 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:01.956208 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fb7f4b8a-cec3-468c-b04f-e0e529b80a95 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:01.957299 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fb7f4b8a-cec3-468c-b04f-e0e529b80a95 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:01.958750 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fb7f4b8a-cec3-468c-b04f-e0e529b80a95 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:01.959527 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fb7f4b8a-cec3-468c-b04f-e0e529b80a95 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:02.493189 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a1ae5e5e-71a8-4c82-bddd-b1b5ccf25111 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:02.519791 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a1ae5e5e-71a8-4c82-bddd-b1b5ccf25111 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51" status: 200 len: 1314 microversion: 2.1 time: 1.608581 Jul 25 14:46:02.532963 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2286/4309] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:00 2022] GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51 => generated 1314 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:02.557190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-84084d56-c5f2-4597-9d81-c1ca01785a91 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:02.558708 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-84084d56-c5f2-4597-9d81-c1ca01785a91 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 704739ea-1723-4329-9079-fb1fe74df834] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:02.585055 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-84084d56-c5f2-4597-9d81-c1ca01785a91 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:02.586159 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-84084d56-c5f2-4597-9d81-c1ca01785a91 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:02.589686 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-84084d56-c5f2-4597-9d81-c1ca01785a91 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:02.601105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-84084d56-c5f2-4597-9d81-c1ca01785a91 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:02.916695 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:46:02.956722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fb7f4b8a-cec3-468c-b04f-e0e529b80a95 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:03.007766 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fb7f4b8a-cec3-468c-b04f-e0e529b80a95 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:03.021143 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fb7f4b8a-cec3-468c-b04f-e0e529b80a95 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:03.026536 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fb7f4b8a-cec3-468c-b04f-e0e529b80a95 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1848 microversion: 2.32 time: 1.098972 Jul 25 14:46:03.032367 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2024/4310] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:46:01 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1848 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:46:03.241683 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=8 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:46:03.377449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-84084d56-c5f2-4597-9d81-c1ca01785a91 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:03.387919 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-84084d56-c5f2-4597-9d81-c1ca01785a91 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834" status: 200 len: 1308 microversion: 2.1 time: 0.851152 Jul 25 14:46:03.392988 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2287/4311] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:02 2022] GET /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834 => generated 1308 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:03.557209 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-711e0010-54d3-4bf6-bfda-77d0154871f2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:03.558078 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-711e0010-54d3-4bf6-bfda-77d0154871f2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 2d780b3a-1e25-4d3f-abdb-6319880dcb51] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:03.565099 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-711e0010-54d3-4bf6-bfda-77d0154871f2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:03.565801 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-711e0010-54d3-4bf6-bfda-77d0154871f2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:03.567287 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-711e0010-54d3-4bf6-bfda-77d0154871f2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:03.567895 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-711e0010-54d3-4bf6-bfda-77d0154871f2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:03.713260 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-7ef1a25b-60da-4941-b0d0-88865a265191 req-c699d5aa-f791-4953-9dc4-229230934536 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50f3696b-0e20-4fc7-9bd0-3955357f2b09", "tag": "8e48e753-58f9-4d03-a879-346119141e40"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:46:03.734423 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-7ef1a25b-60da-4941-b0d0-88865a265191 req-c699d5aa-f791-4953-9dc4-229230934536 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:03.735182 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-7ef1a25b-60da-4941-b0d0-88865a265191 req-c699d5aa-f791-4953-9dc4-229230934536 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:03.755435 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-7ef1a25b-60da-4941-b0d0-88865a265191 req-c699d5aa-f791-4953-9dc4-229230934536 service nova] Creating event network-changed:8e48e753-58f9-4d03-a879-346119141e40 for instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 on n-h1-846435-14 Jul 25 14:46:03.767905 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-7ef1a25b-60da-4941-b0d0-88865a265191 req-c699d5aa-f791-4953-9dc4-229230934536 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058954 Jul 25 14:46:03.774588 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2288/4312] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:46:04.060287 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-55e5edda-69a8-41bf-91f6-047f65fed267 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:04.060287 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-55e5edda-69a8-41bf-91f6-047f65fed267 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:04.071666 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55e5edda-69a8-41bf-91f6-047f65fed267 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:04.076699 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55e5edda-69a8-41bf-91f6-047f65fed267 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:04.079115 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55e5edda-69a8-41bf-91f6-047f65fed267 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:04.079805 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55e5edda-69a8-41bf-91f6-047f65fed267 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:04.139234 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-711e0010-54d3-4bf6-bfda-77d0154871f2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:04.148262 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-711e0010-54d3-4bf6-bfda-77d0154871f2 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51" status: 200 len: 1314 microversion: 2.1 time: 0.595338 Jul 25 14:46:04.164780 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2025/4313] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:03 2022] GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51 => generated 1314 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:04.418143 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-32260b31-15c3-45db-aefc-c3728909fe57 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:04.420663 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-32260b31-15c3-45db-aefc-c3728909fe57 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 704739ea-1723-4329-9079-fb1fe74df834] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:04.444110 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-32260b31-15c3-45db-aefc-c3728909fe57 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:04.446124 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-32260b31-15c3-45db-aefc-c3728909fe57 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:04.448507 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-32260b31-15c3-45db-aefc-c3728909fe57 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:04.453307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-32260b31-15c3-45db-aefc-c3728909fe57 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:04.553406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:46:05.069609 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-32260b31-15c3-45db-aefc-c3728909fe57 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:05.088450 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-32260b31-15c3-45db-aefc-c3728909fe57 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834" status: 200 len: 1308 microversion: 2.1 time: 0.674077 Jul 25 14:46:05.094640 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2026/4314] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:04 2022] GET /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834 => generated 1308 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:05.107595 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-e6e796bd-93e7-47ae-8ae2-8945bbf2d74b req-0546174b-ef83-42b1-aa42-0b96efb71c67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "704739ea-1723-4329-9079-fb1fe74df834", "name": "network-vif-plugged", "status": "completed", "tag": "8881ca7e-189b-4847-bbfd-77c36558c743"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:46:05.122136 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-e6e796bd-93e7-47ae-8ae2-8945bbf2d74b req-0546174b-ef83-42b1-aa42-0b96efb71c67 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:05.122797 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-e6e796bd-93e7-47ae-8ae2-8945bbf2d74b req-0546174b-ef83-42b1-aa42-0b96efb71c67 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:05.126949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-55e5edda-69a8-41bf-91f6-047f65fed267 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:05.144849 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-e6e796bd-93e7-47ae-8ae2-8945bbf2d74b req-0546174b-ef83-42b1-aa42-0b96efb71c67 service nova] Creating event network-vif-plugged:8881ca7e-189b-4847-bbfd-77c36558c743 for instance 704739ea-1723-4329-9079-fb1fe74df834 on n-h2-846435-14 Jul 25 14:46:05.154772 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-55e5edda-69a8-41bf-91f6-047f65fed267 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:05.158597 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-55e5edda-69a8-41bf-91f6-047f65fed267 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:05.162294 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-55e5edda-69a8-41bf-91f6-047f65fed267 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1869 microversion: 2.32 time: 1.107168 Jul 25 14:46:05.164460 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2289/4315] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:46:04 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1869 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:46:05.172697 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-e6e796bd-93e7-47ae-8ae2-8945bbf2d74b req-0546174b-ef83-42b1-aa42-0b96efb71c67 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076339 Jul 25 14:46:05.174100 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2027/4316] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:46:05.184335 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-98358238-caee-4748-b200-50f01bed0f0e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:05.184980 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-98358238-caee-4748-b200-50f01bed0f0e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 2d780b3a-1e25-4d3f-abdb-6319880dcb51] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:05.206034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98358238-caee-4748-b200-50f01bed0f0e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:05.206511 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98358238-caee-4748-b200-50f01bed0f0e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:05.207383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98358238-caee-4748-b200-50f01bed0f0e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:05.207884 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98358238-caee-4748-b200-50f01bed0f0e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:05.855544 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-29a70472-84fb-419f-a4f6-da0cbcfd5ec4 req-83b5c517-93b5-49ad-a846-b52bd409d9cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50f3696b-0e20-4fc7-9bd0-3955357f2b09", "tag": "6df9765b-58b3-4c20-a093-554ec5221862"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:46:05.895936 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-29a70472-84fb-419f-a4f6-da0cbcfd5ec4 req-83b5c517-93b5-49ad-a846-b52bd409d9cc service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:05.900245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-29a70472-84fb-419f-a4f6-da0cbcfd5ec4 req-83b5c517-93b5-49ad-a846-b52bd409d9cc service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:05.946789 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-29a70472-84fb-419f-a4f6-da0cbcfd5ec4 req-83b5c517-93b5-49ad-a846-b52bd409d9cc service nova] Creating event network-changed:6df9765b-58b3-4c20-a093-554ec5221862 for instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 on n-h1-846435-14 Jul 25 14:46:05.963198 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-29a70472-84fb-419f-a4f6-da0cbcfd5ec4 req-83b5c517-93b5-49ad-a846-b52bd409d9cc service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119482 Jul 25 14:46:05.976519 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2028/4317] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:46:06.103219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-98358238-caee-4748-b200-50f01bed0f0e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:06.114337 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-98358238-caee-4748-b200-50f01bed0f0e tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51" status: 200 len: 1314 microversion: 2.1 time: 0.935011 Jul 25 14:46:06.119646 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c3616976-9c49-4ccf-b800-1374235b0f82 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:06.120411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c3616976-9c49-4ccf-b800-1374235b0f82 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 704739ea-1723-4329-9079-fb1fe74df834] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:06.128764 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2290/4318] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:05 2022] GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51 => generated 1314 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:06.145661 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c3616976-9c49-4ccf-b800-1374235b0f82 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:06.148094 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c3616976-9c49-4ccf-b800-1374235b0f82 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:06.148937 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c3616976-9c49-4ccf-b800-1374235b0f82 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:06.149386 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c3616976-9c49-4ccf-b800-1374235b0f82 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:06.189384 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4ee6a44f-70c5-4844-8e8c-40c0aeb4aee3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:06.190394 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4ee6a44f-70c5-4844-8e8c-40c0aeb4aee3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:06.212574 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4ee6a44f-70c5-4844-8e8c-40c0aeb4aee3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:06.213025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4ee6a44f-70c5-4844-8e8c-40c0aeb4aee3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:06.213805 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4ee6a44f-70c5-4844-8e8c-40c0aeb4aee3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:06.214234 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4ee6a44f-70c5-4844-8e8c-40c0aeb4aee3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:06.866308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c3616976-9c49-4ccf-b800-1374235b0f82 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:06.894474 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c3616976-9c49-4ccf-b800-1374235b0f82 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834" status: 200 len: 1308 microversion: 2.1 time: 0.783440 Jul 25 14:46:06.903240 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2029/4319] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:06 2022] GET /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834 => generated 1308 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:46:07.172399 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-56387b89-f287-41fc-99df-73dac0085efa tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:07.173017 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-56387b89-f287-41fc-99df-73dac0085efa tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 2d780b3a-1e25-4d3f-abdb-6319880dcb51] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:07.197096 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56387b89-f287-41fc-99df-73dac0085efa tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:07.197831 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56387b89-f287-41fc-99df-73dac0085efa tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:07.198782 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56387b89-f287-41fc-99df-73dac0085efa tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:07.200527 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56387b89-f287-41fc-99df-73dac0085efa tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:07.590450 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-56387b89-f287-41fc-99df-73dac0085efa tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:07.602878 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-56387b89-f287-41fc-99df-73dac0085efa tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51" status: 200 len: 1314 microversion: 2.1 time: 0.441609 Jul 25 14:46:07.603845 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2030/4320] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:07 2022] GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:46:07.852950 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4ee6a44f-70c5-4844-8e8c-40c0aeb4aee3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:07.870995 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4ee6a44f-70c5-4844-8e8c-40c0aeb4aee3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:07.873217 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4ee6a44f-70c5-4844-8e8c-40c0aeb4aee3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:07.875639 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4ee6a44f-70c5-4844-8e8c-40c0aeb4aee3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1869 microversion: 2.32 time: 1.690455 Jul 25 14:46:07.879743 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2291/4321] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:46:06 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1869 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:46:07.924714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0ae0ace6-44fd-4c57-896f-3c9775330c0f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:07.925790 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0ae0ace6-44fd-4c57-896f-3c9775330c0f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 704739ea-1723-4329-9079-fb1fe74df834] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:07.928824 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:46:07.944155 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0ae0ace6-44fd-4c57-896f-3c9775330c0f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:07.951078 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0ae0ace6-44fd-4c57-896f-3c9775330c0f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:07.961434 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0ae0ace6-44fd-4c57-896f-3c9775330c0f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:07.962247 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0ae0ace6-44fd-4c57-896f-3c9775330c0f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:08.012721 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-8cb8ed49-1a55-401e-a00b-057fdafbe662 req-8366f2a2-833d-4a90-9c6e-e8cdad8e3f53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d780b3a-1e25-4d3f-abdb-6319880dcb51", "name": "network-vif-plugged", "status": "completed", "tag": "2dd900ad-9040-4334-be0e-e28a1e64fae0"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:46:08.033206 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-8cb8ed49-1a55-401e-a00b-057fdafbe662 req-8366f2a2-833d-4a90-9c6e-e8cdad8e3f53 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:08.034055 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-8cb8ed49-1a55-401e-a00b-057fdafbe662 req-8366f2a2-833d-4a90-9c6e-e8cdad8e3f53 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:08.084712 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-8cb8ed49-1a55-401e-a00b-057fdafbe662 req-8366f2a2-833d-4a90-9c6e-e8cdad8e3f53 service nova] Creating event network-vif-plugged:2dd900ad-9040-4334-be0e-e28a1e64fae0 for instance 2d780b3a-1e25-4d3f-abdb-6319880dcb51 on n-h1-846435-14 Jul 25 14:46:08.095866 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-8cb8ed49-1a55-401e-a00b-057fdafbe662 req-8366f2a2-833d-4a90-9c6e-e8cdad8e3f53 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095985 Jul 25 14:46:08.103025 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2292/4322] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 25 14:46:08.190635 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-a63e5655-382f-47e0-a102-e822988d0648 req-33c6ae36-66b0-4ee5-8978-374cbee3345b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50f3696b-0e20-4fc7-9bd0-3955357f2b09", "tag": "c5db5903-5da6-4605-aa52-b7940c46fb11"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:46:08.215636 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a63e5655-382f-47e0-a102-e822988d0648 req-33c6ae36-66b0-4ee5-8978-374cbee3345b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:08.216525 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a63e5655-382f-47e0-a102-e822988d0648 req-33c6ae36-66b0-4ee5-8978-374cbee3345b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:08.246206 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-a63e5655-382f-47e0-a102-e822988d0648 req-33c6ae36-66b0-4ee5-8978-374cbee3345b service nova] Creating event network-changed:c5db5903-5da6-4605-aa52-b7940c46fb11 for instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 on n-h1-846435-14 Jul 25 14:46:08.257437 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-a63e5655-382f-47e0-a102-e822988d0648 req-33c6ae36-66b0-4ee5-8978-374cbee3345b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071292 Jul 25 14:46:08.258970 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2293/4323] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:46:08.613108 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0ae0ace6-44fd-4c57-896f-3c9775330c0f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:08.622792 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0ae0ace6-44fd-4c57-896f-3c9775330c0f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834" status: 200 len: 1308 microversion: 2.1 time: 0.702286 Jul 25 14:46:08.625035 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-007e9a5c-8705-4cb9-8b13-4d96da0245c0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:08.627555 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2031/4324] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:07 2022] GET /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834 => generated 1308 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:08.642397 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-007e9a5c-8705-4cb9-8b13-4d96da0245c0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 2d780b3a-1e25-4d3f-abdb-6319880dcb51] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:08.671320 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-007e9a5c-8705-4cb9-8b13-4d96da0245c0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:08.677857 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-007e9a5c-8705-4cb9-8b13-4d96da0245c0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:08.678772 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-007e9a5c-8705-4cb9-8b13-4d96da0245c0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:08.679230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-007e9a5c-8705-4cb9-8b13-4d96da0245c0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:08.904137 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d1c1f903-ed9f-402a-ab81-bb11e6224591 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:08.905158 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d1c1f903-ed9f-402a-ab81-bb11e6224591 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:08.914051 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d1c1f903-ed9f-402a-ab81-bb11e6224591 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:08.914862 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d1c1f903-ed9f-402a-ab81-bb11e6224591 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:08.915942 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d1c1f903-ed9f-402a-ab81-bb11e6224591 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:08.916778 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d1c1f903-ed9f-402a-ab81-bb11e6224591 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:09.702186 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d1c1f903-ed9f-402a-ab81-bb11e6224591 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:09.734338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d1c1f903-ed9f-402a-ab81-bb11e6224591 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:09.742028 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d1c1f903-ed9f-402a-ab81-bb11e6224591 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:09.750517 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d1c1f903-ed9f-402a-ab81-bb11e6224591 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1890 microversion: 2.32 time: 0.851989 Jul 25 14:46:09.754973 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2032/4325] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:46:08 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1890 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:46:09.778239 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c45623de-85a1-4171-a442-90f26b59838f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:09.781309 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c45623de-85a1-4171-a442-90f26b59838f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 704739ea-1723-4329-9079-fb1fe74df834] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:09.809274 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c45623de-85a1-4171-a442-90f26b59838f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:09.810035 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c45623de-85a1-4171-a442-90f26b59838f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:09.813422 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c45623de-85a1-4171-a442-90f26b59838f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:09.813955 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c45623de-85a1-4171-a442-90f26b59838f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:09.904956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-007e9a5c-8705-4cb9-8b13-4d96da0245c0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:09.910504 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=22 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:46:09.933616 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-007e9a5c-8705-4cb9-8b13-4d96da0245c0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51" status: 200 len: 1314 microversion: 2.1 time: 1.311247 Jul 25 14:46:09.935785 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2294/4326] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:08 2022] GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51 => generated 1314 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:46:09.964530 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d64dad73-cd2b-4f29-8a18-7bad9d021890 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1917643900", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b6c60dc-780d-4845-b966-40a7e9d46848"}], "security_groups": [{"name": "tempest-securitygroup--1741056663"}], "key_name": "tempest-keypair-2109503431", "user_data": "}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:46:10.414015 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-d64dad73-cd2b-4f29-8a18-7bad9d021890 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] validate_networks() for [('4b6c60dc-780d-4845-b966-40a7e9d46848', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:46:10.482727 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c45623de-85a1-4171-a442-90f26b59838f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:10.490776 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c45623de-85a1-4171-a442-90f26b59838f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834" status: 200 len: 1488 microversion: 2.1 time: 0.734129 Jul 25 14:46:10.507116 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2033/4327] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:09 2022] GET /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834 => generated 1488 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:10.790471 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-cd4aae3d-c459-4ebe-b568-d77918a26e9f req-4478b9b1-649c-404d-9657-91a28de9ac31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50f3696b-0e20-4fc7-9bd0-3955357f2b09", "tag": "53062311-961a-458b-9f1e-309c2f468465"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:46:10.809341 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-cd4aae3d-c459-4ebe-b568-d77918a26e9f req-4478b9b1-649c-404d-9657-91a28de9ac31 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:10.811123 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-cd4aae3d-c459-4ebe-b568-d77918a26e9f req-4478b9b1-649c-404d-9657-91a28de9ac31 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:10.835845 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-cd4aae3d-c459-4ebe-b568-d77918a26e9f req-4478b9b1-649c-404d-9657-91a28de9ac31 service nova] Creating event network-changed:53062311-961a-458b-9f1e-309c2f468465 for instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 on n-h1-846435-14 Jul 25 14:46:10.841050 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-cd4aae3d-c459-4ebe-b568-d77918a26e9f req-4478b9b1-649c-404d-9657-91a28de9ac31 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.345244 Jul 25 14:46:10.841880 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2034/4328] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:46:10.849855 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-13173ddd-828a-4626-b937-d58fcbe961e0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:46:10.851400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-13173ddd-828a-4626-b937-d58fcbe961e0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 704739ea-1723-4329-9079-fb1fe74df834] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:10.865691 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-13173ddd-828a-4626-b937-d58fcbe961e0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:10.866791 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-13173ddd-828a-4626-b937-d58fcbe961e0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:10.868093 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-13173ddd-828a-4626-b937-d58fcbe961e0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:10.870309 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-13173ddd-828a-4626-b937-d58fcbe961e0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:11.059861 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-13173ddd-828a-4626-b937-d58fcbe961e0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "POST /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834/action" status: 202 len: 0 microversion: 2.1 time: 0.215336 Jul 25 14:46:11.061419 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2035/4329] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:46:10 2022] POST /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:46:11.071557 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d65dd687-1262-47c0-8d9c-4a0c5c167107 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:11.072911 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d65dd687-1262-47c0-8d9c-4a0c5c167107 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:11.107447 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d65dd687-1262-47c0-8d9c-4a0c5c167107 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:11.108300 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d65dd687-1262-47c0-8d9c-4a0c5c167107 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:11.110203 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d65dd687-1262-47c0-8d9c-4a0c5c167107 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:11.112828 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d65dd687-1262-47c0-8d9c-4a0c5c167107 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:11.767187 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-d64dad73-cd2b-4f29-8a18-7bad9d021890 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:46:11.769267 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-d64dad73-cd2b-4f29-8a18-7bad9d021890 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:46:11.769918 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-d64dad73-cd2b-4f29-8a18-7bad9d021890 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:46:11.770499 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-d64dad73-cd2b-4f29-8a18-7bad9d021890 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:46:11.771063 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-d64dad73-cd2b-4f29-8a18-7bad9d021890 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:46:11.788629 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d64dad73-cd2b-4f29-8a18-7bad9d021890 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:11.789821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d64dad73-cd2b-4f29-8a18-7bad9d021890 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:11.790979 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d64dad73-cd2b-4f29-8a18-7bad9d021890 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:11.791581 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d64dad73-cd2b-4f29-8a18-7bad9d021890 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:11.818421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-d64dad73-cd2b-4f29-8a18-7bad9d021890 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Getting quotas for project 325aff76e61141a985b3b0f45521444f. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:46:11.825028 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-d64dad73-cd2b-4f29-8a18-7bad9d021890 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Getting quotas for user 571a2d92d7a34f86bb3c0bfdfcabc5ff and project 325aff76e61141a985b3b0f45521444f. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:46:11.839227 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d64dad73-cd2b-4f29-8a18-7bad9d021890 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:46:11.841562 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d64dad73-cd2b-4f29-8a18-7bad9d021890 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: f5e1c62b-88b7-4ec7-a2f3-b99b1566baab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:46:11.903408 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d64dad73-cd2b-4f29-8a18-7bad9d021890 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.962767 Jul 25 14:46:11.912644 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2295/4330] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:46:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 1973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:46:11.918304 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b76dd9e2-75f4-472f-8a6a-910aa36b913d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:11.919448 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b76dd9e2-75f4-472f-8a6a-910aa36b913d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 2d780b3a-1e25-4d3f-abdb-6319880dcb51] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:11.927501 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b76dd9e2-75f4-472f-8a6a-910aa36b913d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:11.928389 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b76dd9e2-75f4-472f-8a6a-910aa36b913d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:11.929434 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b76dd9e2-75f4-472f-8a6a-910aa36b913d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:11.930136 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b76dd9e2-75f4-472f-8a6a-910aa36b913d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:12.230234 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b76dd9e2-75f4-472f-8a6a-910aa36b913d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:12.247419 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b76dd9e2-75f4-472f-8a6a-910aa36b913d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51" status: 200 len: 1502 microversion: 2.1 time: 0.333159 Jul 25 14:46:12.262656 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2296/4331] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:11 2022] GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51 => generated 1502 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:12.268472 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d65dd687-1262-47c0-8d9c-4a0c5c167107 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:12.275478 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-041b41eb-3a96-4eaf-a80f-d9f6e6819f4e tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:12.276359 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-041b41eb-3a96-4eaf-a80f-d9f6e6819f4e tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 704739ea-1723-4329-9079-fb1fe74df834] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:12.292249 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d65dd687-1262-47c0-8d9c-4a0c5c167107 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:12.293756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d65dd687-1262-47c0-8d9c-4a0c5c167107 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:12.294927 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d65dd687-1262-47c0-8d9c-4a0c5c167107 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1890 microversion: 2.32 time: 1.232091 Jul 25 14:46:12.295492 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2036/4332] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:46:11 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1890 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:46:12.299548 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-041b41eb-3a96-4eaf-a80f-d9f6e6819f4e tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:12.304704 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-041b41eb-3a96-4eaf-a80f-d9f6e6819f4e tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:12.305848 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-041b41eb-3a96-4eaf-a80f-d9f6e6819f4e tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:12.306441 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-041b41eb-3a96-4eaf-a80f-d9f6e6819f4e tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:12.341401 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-70543767-3ae9-4463-b9a4-57783c7d2dba tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:12.341905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-70543767-3ae9-4463-b9a4-57783c7d2dba tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:12.357483 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70543767-3ae9-4463-b9a4-57783c7d2dba tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:12.372171 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70543767-3ae9-4463-b9a4-57783c7d2dba tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:12.373419 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70543767-3ae9-4463-b9a4-57783c7d2dba tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:12.374070 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70543767-3ae9-4463-b9a4-57783c7d2dba tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:12.545937 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-041b41eb-3a96-4eaf-a80f-d9f6e6819f4e tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:12.555517 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-041b41eb-3a96-4eaf-a80f-d9f6e6819f4e tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834" status: 200 len: 1473 microversion: 2.1 time: 0.286461 Jul 25 14:46:12.556797 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2297/4333] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:12 2022] GET /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834 => generated 1473 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:12.563669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f7d685f9-0e5a-4af2-9c5e-d3a27fbca607 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:12.565147 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f7d685f9-0e5a-4af2-9c5e-d3a27fbca607 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: f5e1c62b-88b7-4ec7-a2f3-b99b1566baab] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:12.589104 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-70543767-3ae9-4463-b9a4-57783c7d2dba tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lazy-loading 'services' on Instance uuid e5866023-cfeb-43b0-9788-334b6ad4b850 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:46:12.677591 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f7d685f9-0e5a-4af2-9c5e-d3a27fbca607 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:12.689949 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f7d685f9-0e5a-4af2-9c5e-d3a27fbca607 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab" status: 200 len: 1242 microversion: 2.1 time: 0.131613 Jul 25 14:46:12.704077 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2298/4334] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:12 2022] GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab => generated 1242 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:12.707057 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-032d13df-6940-4e10-b473-2c6686aff61d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:46:12.710283 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-032d13df-6940-4e10-b473-2c6686aff61d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 2d780b3a-1e25-4d3f-abdb-6319880dcb51] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:12.723752 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-032d13df-6940-4e10-b473-2c6686aff61d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:12.724611 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-032d13df-6940-4e10-b473-2c6686aff61d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:12.725968 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-032d13df-6940-4e10-b473-2c6686aff61d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:12.726616 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-032d13df-6940-4e10-b473-2c6686aff61d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:12.747454 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-70543767-3ae9-4463-b9a4-57783c7d2dba tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "DELETE /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850/os-volume_attachments/18f0b530-12b5-4521-ac8c-44e31e5eed17" status: 202 len: 0 microversion: 2.1 time: 0.419126 Jul 25 14:46:12.748408 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2037/4335] 10.222.0.88 () {58 vars in 1416 bytes} [Mon Jul 25 14:46:12 2022] DELETE /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850/os-volume_attachments/18f0b530-12b5-4521-ac8c-44e31e5eed17 => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:46:12.761272 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-032d13df-6940-4e10-b473-2c6686aff61d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lazy-loading 'flavor' on Instance uuid 2d780b3a-1e25-4d3f-abdb-6319880dcb51 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:46:12.771544 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-68a61f26-2db7-4250-99ce-0f715dcfc6b6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2067744812"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:46:12.774138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-68a61f26-2db7-4250-99ce-0f715dcfc6b6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 704739ea-1723-4329-9079-fb1fe74df834] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:12.811644 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-68a61f26-2db7-4250-99ce-0f715dcfc6b6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:12.815763 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-68a61f26-2db7-4250-99ce-0f715dcfc6b6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:12.817109 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-68a61f26-2db7-4250-99ce-0f715dcfc6b6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:12.823794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-68a61f26-2db7-4250-99ce-0f715dcfc6b6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:12.892845 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-032d13df-6940-4e10-b473-2c6686aff61d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "POST /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51/action" status: 202 len: 0 microversion: 2.1 time: 0.193679 Jul 25 14:46:12.894888 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2299/4336] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:46:12 2022] POST /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:46:12.918271 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9d71a6a9-07a0-4106-954a-948c5d40dada tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:12.919885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9d71a6a9-07a0-4106-954a-948c5d40dada tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 2d780b3a-1e25-4d3f-abdb-6319880dcb51] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:12.945654 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d71a6a9-07a0-4106-954a-948c5d40dada tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:12.948158 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d71a6a9-07a0-4106-954a-948c5d40dada tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:12.949421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d71a6a9-07a0-4106-954a-948c5d40dada tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:12.951176 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d71a6a9-07a0-4106-954a-948c5d40dada tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:13.189597 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-68a61f26-2db7-4250-99ce-0f715dcfc6b6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "POST /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834/action" status: 202 len: 0 microversion: 2.1 time: 0.433041 Jul 25 14:46:13.191183 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2038/4337] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:46:12 2022] POST /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834/action => generated 0 bytes in 442 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 14:46:13.203601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-74e92937-e853-4cb3-86af-81a265a0baa3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f4686671040>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:13.262755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9d71a6a9-07a0-4106-954a-948c5d40dada tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:13.271013 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-74e92937-e853-4cb3-86af-81a265a0baa3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1412 microversion: 2.1 time: 0.072978 Jul 25 14:46:13.272954 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2039/4338] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:13 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1412 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:13.273555 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9d71a6a9-07a0-4106-954a-948c5d40dada tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51" status: 200 len: 1510 microversion: 2.1 time: 0.370982 Jul 25 14:46:13.284052 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2300/4339] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:12 2022] GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51 => generated 1510 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:13.317087 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-6d695e8d-62a3-480a-97bd-949194ddcefd req-88d5da53-86c4-4cee-97e5-e5d80561bbc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50f3696b-0e20-4fc7-9bd0-3955357f2b09", "tag": "4bc5802b-3581-47f4-b3fd-3ec9db912406"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:46:13.322462 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fef2a8c6-5ac7-4e72-b964-bc509fec68fb tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:13.325994 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fef2a8c6-5ac7-4e72-b964-bc509fec68fb tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:13.332742 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-6d695e8d-62a3-480a-97bd-949194ddcefd req-88d5da53-86c4-4cee-97e5-e5d80561bbc2 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:13.333567 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-6d695e8d-62a3-480a-97bd-949194ddcefd req-88d5da53-86c4-4cee-97e5-e5d80561bbc2 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:13.344381 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fef2a8c6-5ac7-4e72-b964-bc509fec68fb tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:13.344918 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fef2a8c6-5ac7-4e72-b964-bc509fec68fb tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:13.345760 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fef2a8c6-5ac7-4e72-b964-bc509fec68fb tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:13.346723 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fef2a8c6-5ac7-4e72-b964-bc509fec68fb tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:13.369000 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-6d695e8d-62a3-480a-97bd-949194ddcefd req-88d5da53-86c4-4cee-97e5-e5d80561bbc2 service nova] Creating event network-changed:4bc5802b-3581-47f4-b3fd-3ec9db912406 for instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 on n-h1-846435-14 Jul 25 14:46:13.379817 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-6d695e8d-62a3-480a-97bd-949194ddcefd req-88d5da53-86c4-4cee-97e5-e5d80561bbc2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105027 Jul 25 14:46:13.382518 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2040/4340] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:46:13.720303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f94127d0-72e0-4e7c-b7dd-c655962ce379 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:13.722561 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f94127d0-72e0-4e7c-b7dd-c655962ce379 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: f5e1c62b-88b7-4ec7-a2f3-b99b1566baab] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:13.740694 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f94127d0-72e0-4e7c-b7dd-c655962ce379 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:13.745701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f94127d0-72e0-4e7c-b7dd-c655962ce379 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:13.748500 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f94127d0-72e0-4e7c-b7dd-c655962ce379 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:13.750584 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f94127d0-72e0-4e7c-b7dd-c655962ce379 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:13.885070 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f94127d0-72e0-4e7c-b7dd-c655962ce379 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:13.895215 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f94127d0-72e0-4e7c-b7dd-c655962ce379 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab" status: 200 len: 1294 microversion: 2.1 time: 0.180305 Jul 25 14:46:13.907999 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2041/4341] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:13 2022] GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab => generated 1294 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:13.934548 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fef2a8c6-5ac7-4e72-b964-bc509fec68fb tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:13.937538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:46:13.952528 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fef2a8c6-5ac7-4e72-b964-bc509fec68fb tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:13.956447 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fef2a8c6-5ac7-4e72-b964-bc509fec68fb tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:13.957932 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fef2a8c6-5ac7-4e72-b964-bc509fec68fb tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1890 microversion: 2.32 time: 0.639858 Jul 25 14:46:13.962099 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2301/4342] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:46:13 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1890 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:46:14.287890 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1d63342e-2907-46ac-9ed3-b2bdbbb34be8 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f4686671160>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:14.297183 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dd1e0a50-5105-44ee-bec8-3469bdc8b3f4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:14.298312 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dd1e0a50-5105-44ee-bec8-3469bdc8b3f4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 2d780b3a-1e25-4d3f-abdb-6319880dcb51] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:14.316649 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd1e0a50-5105-44ee-bec8-3469bdc8b3f4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:14.317222 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd1e0a50-5105-44ee-bec8-3469bdc8b3f4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:14.318285 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd1e0a50-5105-44ee-bec8-3469bdc8b3f4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:14.325485 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd1e0a50-5105-44ee-bec8-3469bdc8b3f4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:14.382966 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1d63342e-2907-46ac-9ed3-b2bdbbb34be8 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1412 microversion: 2.1 time: 0.098794 Jul 25 14:46:14.383560 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2042/4343] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:14 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1412 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:14.566467 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dd1e0a50-5105-44ee-bec8-3469bdc8b3f4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:14.574873 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dd1e0a50-5105-44ee-bec8-3469bdc8b3f4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51" status: 200 len: 1493 microversion: 2.1 time: 0.282422 Jul 25 14:46:14.575825 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2302/4344] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:14 2022] GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51 => generated 1493 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:14.598243 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-69dbda07-1005-43d5-8349-9648a08d99bf tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:14.599030 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-69dbda07-1005-43d5-8349-9648a08d99bf tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 2d780b3a-1e25-4d3f-abdb-6319880dcb51] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:14.607951 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-69dbda07-1005-43d5-8349-9648a08d99bf tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:14.608708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-69dbda07-1005-43d5-8349-9648a08d99bf tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:14.609760 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-69dbda07-1005-43d5-8349-9648a08d99bf tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:14.610407 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-69dbda07-1005-43d5-8349-9648a08d99bf tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:14.641846 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-69dbda07-1005-43d5-8349-9648a08d99bf tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 2d780b3a-1e25-4d3f-abdb-6319880dcb51] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:46:14.680844 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:46:14.763687 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-69dbda07-1005-43d5-8349-9648a08d99bf tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "DELETE /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51" status: 204 len: 0 microversion: 2.1 time: 0.170371 Jul 25 14:46:14.768563 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2043/4345] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:46:14 2022] DELETE /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:46:14.777204 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2c4b5105-41da-4949-998e-8b26195ee6b0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:14.778318 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2c4b5105-41da-4949-998e-8b26195ee6b0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 2d780b3a-1e25-4d3f-abdb-6319880dcb51] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:14.796744 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2c4b5105-41da-4949-998e-8b26195ee6b0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:14.797706 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2c4b5105-41da-4949-998e-8b26195ee6b0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:14.799512 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2c4b5105-41da-4949-998e-8b26195ee6b0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:14.803651 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2c4b5105-41da-4949-998e-8b26195ee6b0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:14.922857 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5af26a40-3756-4121-8f6c-230e2bb9c2f1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:14.925465 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5af26a40-3756-4121-8f6c-230e2bb9c2f1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: f5e1c62b-88b7-4ec7-a2f3-b99b1566baab] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:14.936352 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5af26a40-3756-4121-8f6c-230e2bb9c2f1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:14.937295 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5af26a40-3756-4121-8f6c-230e2bb9c2f1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:14.938250 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5af26a40-3756-4121-8f6c-230e2bb9c2f1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:14.940427 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5af26a40-3756-4121-8f6c-230e2bb9c2f1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:15.068056 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2c4b5105-41da-4949-998e-8b26195ee6b0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:15.105993 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2c4b5105-41da-4949-998e-8b26195ee6b0 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51" status: 200 len: 1499 microversion: 2.1 time: 0.333036 Jul 25 14:46:15.107398 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2303/4346] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:14 2022] GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51 => generated 1499 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:15.112669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9de26c8d-7b9e-4bdb-a457-0b67e1440a6b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:15.113576 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9de26c8d-7b9e-4bdb-a457-0b67e1440a6b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:15.120777 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9de26c8d-7b9e-4bdb-a457-0b67e1440a6b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:15.121561 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9de26c8d-7b9e-4bdb-a457-0b67e1440a6b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:15.122608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9de26c8d-7b9e-4bdb-a457-0b67e1440a6b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:15.123302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9de26c8d-7b9e-4bdb-a457-0b67e1440a6b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:15.164586 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5af26a40-3756-4121-8f6c-230e2bb9c2f1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:15.188454 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5af26a40-3756-4121-8f6c-230e2bb9c2f1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab" status: 200 len: 1300 microversion: 2.1 time: 0.271583 Jul 25 14:46:15.189065 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2044/4347] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:14 2022] GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab => generated 1300 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:15.399828 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9c3a221a-3542-4b69-bdae-7f6da21dc8e9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f4686735700>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:15.453705 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9de26c8d-7b9e-4bdb-a457-0b67e1440a6b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:15.482341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9de26c8d-7b9e-4bdb-a457-0b67e1440a6b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:15.483702 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9c3a221a-3542-4b69-bdae-7f6da21dc8e9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1412 microversion: 2.1 time: 0.088603 Jul 25 14:46:15.484405 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2045/4348] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:15 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1412 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:15.485718 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9de26c8d-7b9e-4bdb-a457-0b67e1440a6b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:15.487149 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9de26c8d-7b9e-4bdb-a457-0b67e1440a6b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1890 microversion: 2.32 time: 0.378524 Jul 25 14:46:15.496946 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2304/4349] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:46:15 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1890 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:46:15.574644 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-936eb26a-86a8-4a25-acc2-b71b58265b8a req-5d0d2857-f8b0-473e-9e72-5f6fb5c803af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50f3696b-0e20-4fc7-9bd0-3955357f2b09", "tag": "ee179acc-1c8f-4d3d-b7a4-b3147e289771"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:46:15.597687 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-936eb26a-86a8-4a25-acc2-b71b58265b8a req-5d0d2857-f8b0-473e-9e72-5f6fb5c803af service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:15.598161 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-936eb26a-86a8-4a25-acc2-b71b58265b8a req-5d0d2857-f8b0-473e-9e72-5f6fb5c803af service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:15.618719 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-936eb26a-86a8-4a25-acc2-b71b58265b8a req-5d0d2857-f8b0-473e-9e72-5f6fb5c803af service nova] Creating event network-changed:ee179acc-1c8f-4d3d-b7a4-b3147e289771 for instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 on n-h1-846435-14 Jul 25 14:46:15.634435 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-936eb26a-86a8-4a25-acc2-b71b58265b8a req-5d0d2857-f8b0-473e-9e72-5f6fb5c803af service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063662 Jul 25 14:46:15.635058 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2046/4350] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:46:16.127939 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e2d461bf-ee77-4223-9119-13391b325ed3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:16.129215 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e2d461bf-ee77-4223-9119-13391b325ed3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 2d780b3a-1e25-4d3f-abdb-6319880dcb51] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:16.149266 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2d461bf-ee77-4223-9119-13391b325ed3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:16.151273 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2d461bf-ee77-4223-9119-13391b325ed3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:16.152360 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2d461bf-ee77-4223-9119-13391b325ed3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:16.154048 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2d461bf-ee77-4223-9119-13391b325ed3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:16.215660 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-acb830fb-4259-4c65-bf55-b7eec2bfb491 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:16.216431 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-acb830fb-4259-4c65-bf55-b7eec2bfb491 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: f5e1c62b-88b7-4ec7-a2f3-b99b1566baab] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:16.238401 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-acb830fb-4259-4c65-bf55-b7eec2bfb491 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:16.238936 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-acb830fb-4259-4c65-bf55-b7eec2bfb491 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:16.243499 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-acb830fb-4259-4c65-bf55-b7eec2bfb491 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:16.243958 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-acb830fb-4259-4c65-bf55-b7eec2bfb491 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:16.545077 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-acb830fb-4259-4c65-bf55-b7eec2bfb491 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:16.560717 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-acb830fb-4259-4c65-bf55-b7eec2bfb491 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab" status: 200 len: 1300 microversion: 2.1 time: 0.350441 Jul 25 14:46:16.561323 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2047/4351] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:16 2022] GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab => generated 1300 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:46:16.566512 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-81738fbf-20fe-4791-b98e-cd74c44bb43d tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f468662b820>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:16.651542 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-81738fbf-20fe-4791-b98e-cd74c44bb43d tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1412 microversion: 2.1 time: 0.089043 Jul 25 14:46:16.659812 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2048/4352] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:16 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1412 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:16.664988 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-25ad49ae-30aa-4daa-9838-49a7180263b7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:16.676019 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-25ad49ae-30aa-4daa-9838-49a7180263b7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:16.687049 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-25ad49ae-30aa-4daa-9838-49a7180263b7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:16.691515 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-25ad49ae-30aa-4daa-9838-49a7180263b7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:16.692714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-25ad49ae-30aa-4daa-9838-49a7180263b7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:16.693303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-25ad49ae-30aa-4daa-9838-49a7180263b7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:17.391766 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e2d461bf-ee77-4223-9119-13391b325ed3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:17.404590 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e2d461bf-ee77-4223-9119-13391b325ed3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51" status: 200 len: 1499 microversion: 2.1 time: 1.278541 Jul 25 14:46:17.405725 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2305/4353] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:16 2022] GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51 => generated 1499 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:17.577219 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-25ad49ae-30aa-4daa-9838-49a7180263b7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:17.583319 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1ab5a994-794e-42ff-8f98-9aca9c02578b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:17.583926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1ab5a994-794e-42ff-8f98-9aca9c02578b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: f5e1c62b-88b7-4ec7-a2f3-b99b1566baab] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:17.600556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1ab5a994-794e-42ff-8f98-9aca9c02578b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:17.600556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1ab5a994-794e-42ff-8f98-9aca9c02578b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:17.600556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1ab5a994-794e-42ff-8f98-9aca9c02578b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:17.600556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1ab5a994-794e-42ff-8f98-9aca9c02578b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:17.607486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-25ad49ae-30aa-4daa-9838-49a7180263b7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:17.609309 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-25ad49ae-30aa-4daa-9838-49a7180263b7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:17.614740 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-25ad49ae-30aa-4daa-9838-49a7180263b7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1878 microversion: 2.32 time: 0.949596 Jul 25 14:46:17.615868 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2049/4354] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:46:16 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1878 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:46:17.668387 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cf2a3e69-5c95-4243-bbf3-fa515c117269 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f4686669ca0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:17.755838 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cf2a3e69-5c95-4243-bbf3-fa515c117269 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1412 microversion: 2.1 time: 0.092828 Jul 25 14:46:17.757334 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2050/4355] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:17 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1412 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:46:18.169635 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1ab5a994-794e-42ff-8f98-9aca9c02578b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:18.185247 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1ab5a994-794e-42ff-8f98-9aca9c02578b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab" status: 200 len: 1368 microversion: 2.1 time: 0.603125 Jul 25 14:46:18.188260 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2306/4356] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:17 2022] GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab => generated 1368 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:18.441976 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7ef11cf8-f8d9-4a31-8a17-a17343810ef4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:18.448182 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7ef11cf8-f8d9-4a31-8a17-a17343810ef4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 2d780b3a-1e25-4d3f-abdb-6319880dcb51] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:18.500648 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ef11cf8-f8d9-4a31-8a17-a17343810ef4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:18.509094 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ef11cf8-f8d9-4a31-8a17-a17343810ef4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:18.510831 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ef11cf8-f8d9-4a31-8a17-a17343810ef4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:18.511747 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ef11cf8-f8d9-4a31-8a17-a17343810ef4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:18.644454 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-227f959a-4159-4162-8113-f67f2c3cca3b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:18.645794 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-227f959a-4159-4162-8113-f67f2c3cca3b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:18.663543 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-227f959a-4159-4162-8113-f67f2c3cca3b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:18.664959 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-227f959a-4159-4162-8113-f67f2c3cca3b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:18.671337 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-227f959a-4159-4162-8113-f67f2c3cca3b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:18.672754 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-227f959a-4159-4162-8113-f67f2c3cca3b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:18.791427 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7ef11cf8-f8d9-4a31-8a17-a17343810ef4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f992249063495c8bf12954afd9e8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b1c620d0b14a3a9471515cf47d6944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:18.801575 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7ef11cf8-f8d9-4a31-8a17-a17343810ef4 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51" status: 200 len: 1457 microversion: 2.1 time: 0.377304 Jul 25 14:46:18.809178 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2051/4357] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:18 2022] GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51 => generated 1457 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:18.816943 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d113b05e-1db8-4fb9-b5d3-2e4554a9d2b0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46987d90d0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:18.921044 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d113b05e-1db8-4fb9-b5d3-2e4554a9d2b0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1412 microversion: 2.1 time: 0.110267 Jul 25 14:46:18.924273 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2052/4358] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:18 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1412 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:18.950014 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-097fc146-4f65-4b84-9f36-67b9a1e3d46f req-b596bb5b-0fcb-4ab7-8d81-f4012ce02918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d780b3a-1e25-4d3f-abdb-6319880dcb51", "name": "network-vif-deleted", "tag": "2dd900ad-9040-4334-be0e-e28a1e64fae0"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:46:18.977726 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-097fc146-4f65-4b84-9f36-67b9a1e3d46f req-b596bb5b-0fcb-4ab7-8d81-f4012ce02918 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:18.978805 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-097fc146-4f65-4b84-9f36-67b9a1e3d46f req-b596bb5b-0fcb-4ab7-8d81-f4012ce02918 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:19.007592 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-097fc146-4f65-4b84-9f36-67b9a1e3d46f req-b596bb5b-0fcb-4ab7-8d81-f4012ce02918 service nova] Creating event network-vif-deleted:2dd900ad-9040-4334-be0e-e28a1e64fae0 for instance 2d780b3a-1e25-4d3f-abdb-6319880dcb51 on n-h1-846435-14 Jul 25 14:46:19.025155 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-097fc146-4f65-4b84-9f36-67b9a1e3d46f req-b596bb5b-0fcb-4ab7-8d81-f4012ce02918 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098801 Jul 25 14:46:19.026145 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2053/4359] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:46:19.036864 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-243f7c94-87ee-4490-b1d5-234063c7ab1e req-e42338c2-8e25-44a9-82f9-3f734b94cab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "704739ea-1723-4329-9079-fb1fe74df834", "name": "network-vif-plugged", "status": "completed", "tag": "8881ca7e-189b-4847-bbfd-77c36558c743"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:46:19.062332 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-243f7c94-87ee-4490-b1d5-234063c7ab1e req-e42338c2-8e25-44a9-82f9-3f734b94cab5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:19.063354 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-243f7c94-87ee-4490-b1d5-234063c7ab1e req-e42338c2-8e25-44a9-82f9-3f734b94cab5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:19.092614 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-243f7c94-87ee-4490-b1d5-234063c7ab1e req-e42338c2-8e25-44a9-82f9-3f734b94cab5 service nova] Creating event network-vif-plugged:8881ca7e-189b-4847-bbfd-77c36558c743 for instance 704739ea-1723-4329-9079-fb1fe74df834 on n-h2-846435-14 Jul 25 14:46:19.108115 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-243f7c94-87ee-4490-b1d5-234063c7ab1e req-e42338c2-8e25-44a9-82f9-3f734b94cab5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080250 Jul 25 14:46:19.109379 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2054/4360] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:46:19.170480 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-227f959a-4159-4162-8113-f67f2c3cca3b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:19.182050 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-227f959a-4159-4162-8113-f67f2c3cca3b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:19.196448 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-227f959a-4159-4162-8113-f67f2c3cca3b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:19.202817 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-227f959a-4159-4162-8113-f67f2c3cca3b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1878 microversion: 2.32 time: 0.559878 Jul 25 14:46:19.216110 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2307/4361] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:46:18 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1878 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:46:19.216886 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a2c1084c-1b6c-4a8b-9805-4a8b69ef8fd4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:19.217361 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a2c1084c-1b6c-4a8b-9805-4a8b69ef8fd4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: f5e1c62b-88b7-4ec7-a2f3-b99b1566baab] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:19.226217 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a2c1084c-1b6c-4a8b-9805-4a8b69ef8fd4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:19.226828 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a2c1084c-1b6c-4a8b-9805-4a8b69ef8fd4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:19.227927 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a2c1084c-1b6c-4a8b-9805-4a8b69ef8fd4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:19.228531 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a2c1084c-1b6c-4a8b-9805-4a8b69ef8fd4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:19.833398 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d19952d4-9e8c-41b3-a2b6-cbaad5e5a700 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:19.834185 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d19952d4-9e8c-41b3-a2b6-cbaad5e5a700 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 2d780b3a-1e25-4d3f-abdb-6319880dcb51] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:19.848840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d19952d4-9e8c-41b3-a2b6-cbaad5e5a700 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:19.851233 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d19952d4-9e8c-41b3-a2b6-cbaad5e5a700 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:19.853659 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d19952d4-9e8c-41b3-a2b6-cbaad5e5a700 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:19.859201 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d19952d4-9e8c-41b3-a2b6-cbaad5e5a700 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:19.926435 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-d19952d4-9e8c-41b3-a2b6-cbaad5e5a700 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] HTTP exception thrown: Instance 2d780b3a-1e25-4d3f-abdb-6319880dcb51 could not be found. Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d19952d4-9e8c-41b3-a2b6-cbaad5e5a700 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Request method failure captured: Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51 HTTP/1.1 Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3quERREaOs3Kc7iY1Vh9GKraPJ63kqwGO_-k7wXB_J3XVEfBf3LNTXeHb07R82UwUNgvRdojb21TsSuL636LebhCUID5TJuapIn-Sgeh4nT2_p48qkoLx6k1MrIDkEY7ueSXXEfRqNxtsyFtJzfjwKFOLGr5sudf0H8jELBV5u89FK0 Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b9b1c620d0b14a3a9471515cf47d6944", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b9b1c620d0b14a3a9471515cf47d6944"}]}] Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 33f992249063495c8bf12954afd9e8b7 Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 2d780b3a-1e25-4d3f-abdb-6319880dcb51 could not be found. Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '2d780b3a-1e25-4d3f-abdb-6319880dcb51'} Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d780b3a-1e25-4d3f-abdb-6319880dcb51 could not be found. Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d780b3a-1e25-4d3f-abdb-6319880dcb51 could not be found. Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:46:19.928424 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:46:19.933818 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:19.933818 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:46:19.933818 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:46:19.933818 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:46:19.933818 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:46:19.933818 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d780b3a-1e25-4d3f-abdb-6319880dcb51 could not be found. Jul 25 14:46:19.933818 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:46:19.934503 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d19952d4-9e8c-41b3-a2b6-cbaad5e5a700 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Returning 404 to user: Instance 2d780b3a-1e25-4d3f-abdb-6319880dcb51 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:46:19.939704 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d19952d4-9e8c-41b3-a2b6-cbaad5e5a700 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51" status: 404 len: 111 microversion: 2.1 time: 0.109515 Jul 25 14:46:19.941930 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2308/4362] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:19 2022] GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:46:19.956735 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9d0f88c2-f146-4c93-893d-61e1cd020c25 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46873280d0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:20.043198 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9d0f88c2-f146-4c93-893d-61e1cd020c25 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1412 microversion: 2.1 time: 0.099993 Jul 25 14:46:20.043922 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2309/4363] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:19 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1412 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:20.050184 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a2c1084c-1b6c-4a8b-9805-4a8b69ef8fd4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:20.077505 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9d110a0f-2433-4d2c-8921-c5a5f5a33589 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:20.079388 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9d110a0f-2433-4d2c-8921-c5a5f5a33589 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 2d780b3a-1e25-4d3f-abdb-6319880dcb51] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:20.079552 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a2c1084c-1b6c-4a8b-9805-4a8b69ef8fd4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab" status: 200 len: 1368 microversion: 2.1 time: 0.867387 Jul 25 14:46:20.080435 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2055/4364] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:19 2022] GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab => generated 1368 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:20.093393 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d110a0f-2433-4d2c-8921-c5a5f5a33589 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:20.096554 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d110a0f-2433-4d2c-8921-c5a5f5a33589 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:20.099258 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d110a0f-2433-4d2c-8921-c5a5f5a33589 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:20.101949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d110a0f-2433-4d2c-8921-c5a5f5a33589 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:20.140553 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-9d110a0f-2433-4d2c-8921-c5a5f5a33589 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] HTTP exception thrown: Instance 2d780b3a-1e25-4d3f-abdb-6319880dcb51 could not be found. Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9d110a0f-2433-4d2c-8921-c5a5f5a33589 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Request method failure captured: Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51 HTTP/1.1 Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3quERREaOs3Kc7iY1Vh9GKraPJ63kqwGO_-k7wXB_J3XVEfBf3LNTXeHb07R82UwUNgvRdojb21TsSuL636LebhCUID5TJuapIn-Sgeh4nT2_p48qkoLx6k1MrIDkEY7ueSXXEfRqNxtsyFtJzfjwKFOLGr5sudf0H8jELBV5u89FK0 Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b9b1c620d0b14a3a9471515cf47d6944", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b9b1c620d0b14a3a9471515cf47d6944"}]}] Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 33f992249063495c8bf12954afd9e8b7 Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 2d780b3a-1e25-4d3f-abdb-6319880dcb51 could not be found. Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '2d780b3a-1e25-4d3f-abdb-6319880dcb51'} Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d780b3a-1e25-4d3f-abdb-6319880dcb51 could not be found. Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:46:20.150762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:46:20.156919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d780b3a-1e25-4d3f-abdb-6319880dcb51 could not be found. Jul 25 14:46:20.156919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.156919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:46:20.156919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.156919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:20.156919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:46:20.156919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:46:20.156919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:46:20.156919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:46:20.156919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d780b3a-1e25-4d3f-abdb-6319880dcb51 could not be found. Jul 25 14:46:20.156919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.159963 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9d110a0f-2433-4d2c-8921-c5a5f5a33589 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Returning 404 to user: Instance 2d780b3a-1e25-4d3f-abdb-6319880dcb51 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:46:20.161275 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9d110a0f-2433-4d2c-8921-c5a5f5a33589 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "DELETE /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51" status: 404 len: 111 microversion: 2.1 time: 0.111422 Jul 25 14:46:20.162321 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2310/4365] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:46:20 2022] DELETE /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:46:20.172465 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ed4018ba-205f-434a-b286-260dab575486 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:20.173075 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ed4018ba-205f-434a-b286-260dab575486 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 2d780b3a-1e25-4d3f-abdb-6319880dcb51] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:20.199609 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ed4018ba-205f-434a-b286-260dab575486 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:20.200083 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ed4018ba-205f-434a-b286-260dab575486 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:20.200885 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ed4018ba-205f-434a-b286-260dab575486 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:20.209400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ed4018ba-205f-434a-b286-260dab575486 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:20.232289 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b5d25d40-18cc-4fea-bd77-76320fff6fec tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:20.232817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b5d25d40-18cc-4fea-bd77-76320fff6fec tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:20.245869 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b5d25d40-18cc-4fea-bd77-76320fff6fec tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:20.251745 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-ed4018ba-205f-434a-b286-260dab575486 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] HTTP exception thrown: Instance 2d780b3a-1e25-4d3f-abdb-6319880dcb51 could not be found. Jul 25 14:46:20.252127 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b5d25d40-18cc-4fea-bd77-76320fff6fec tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:20.253148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b5d25d40-18cc-4fea-bd77-76320fff6fec tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ed4018ba-205f-434a-b286-260dab575486 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Request method failure captured: Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51 HTTP/1.1 Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3quERREaOs3Kc7iY1Vh9GKraPJ63kqwGO_-k7wXB_J3XVEfBf3LNTXeHb07R82UwUNgvRdojb21TsSuL636LebhCUID5TJuapIn-Sgeh4nT2_p48qkoLx6k1MrIDkEY7ueSXXEfRqNxtsyFtJzfjwKFOLGr5sudf0H8jELBV5u89FK0 Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b9b1c620d0b14a3a9471515cf47d6944", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b9b1c620d0b14a3a9471515cf47d6944"}]}] Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 33f992249063495c8bf12954afd9e8b7 Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 2d780b3a-1e25-4d3f-abdb-6319880dcb51 could not be found. Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '2d780b3a-1e25-4d3f-abdb-6319880dcb51'} Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d780b3a-1e25-4d3f-abdb-6319880dcb51 could not be found. Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d780b3a-1e25-4d3f-abdb-6319880dcb51 could not be found. Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:46:20.253591 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.258055 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:20.258055 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:46:20.258055 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:46:20.258055 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:46:20.258055 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:46:20.258055 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d780b3a-1e25-4d3f-abdb-6319880dcb51 could not be found. Jul 25 14:46:20.258055 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.258055 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ed4018ba-205f-434a-b286-260dab575486 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Returning 404 to user: Instance 2d780b3a-1e25-4d3f-abdb-6319880dcb51 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:46:20.258055 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ed4018ba-205f-434a-b286-260dab575486 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51" status: 404 len: 111 microversion: 2.1 time: 0.089883 Jul 25 14:46:20.261140 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b5d25d40-18cc-4fea-bd77-76320fff6fec tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:20.263236 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2056/4366] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:20 2022] GET /compute/v2.1/servers/2d780b3a-1e25-4d3f-abdb-6319880dcb51 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:46:20.273697 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-367cef3b-0ca6-4f0a-a86d-d71e6f99dfbb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:20.274213 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-367cef3b-0ca6-4f0a-a86d-d71e6f99dfbb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:20.308109 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-367cef3b-0ca6-4f0a-a86d-d71e6f99dfbb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:20.308578 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-367cef3b-0ca6-4f0a-a86d-d71e6f99dfbb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:20.309388 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-367cef3b-0ca6-4f0a-a86d-d71e6f99dfbb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:20.309830 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-367cef3b-0ca6-4f0a-a86d-d71e6f99dfbb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:20.375143 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-367cef3b-0ca6-4f0a-a86d-d71e6f99dfbb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] HTTP exception thrown: Instance ad236d1f-2ae4-49b3-8c93-5c0348fdb112 could not be found. Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-367cef3b-0ca6-4f0a-a86d-d71e6f99dfbb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Request method failure captured: Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 HTTP/1.1 Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3quERREaOs3Kc7iY1Vh9GKraPJ63kqwGO_-k7wXB_J3XVEfBf3LNTXeHb07R82UwUNgvRdojb21TsSuL636LebhCUID5TJuapIn-Sgeh4nT2_p48qkoLx6k1MrIDkEY7ueSXXEfRqNxtsyFtJzfjwKFOLGr5sudf0H8jELBV5u89FK0 Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b9b1c620d0b14a3a9471515cf47d6944", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b9b1c620d0b14a3a9471515cf47d6944"}]}] Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 33f992249063495c8bf12954afd9e8b7 Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance ad236d1f-2ae4-49b3-8c93-5c0348fdb112 could not be found. Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'ad236d1f-2ae4-49b3-8c93-5c0348fdb112'} Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad236d1f-2ae4-49b3-8c93-5c0348fdb112 could not be found. Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:46:20.381227 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:46:20.385293 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad236d1f-2ae4-49b3-8c93-5c0348fdb112 could not be found. Jul 25 14:46:20.385293 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.385293 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:46:20.385293 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.385293 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:20.385293 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:46:20.385293 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:46:20.385293 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:46:20.385293 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:46:20.385293 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad236d1f-2ae4-49b3-8c93-5c0348fdb112 could not be found. Jul 25 14:46:20.385293 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.388800 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-367cef3b-0ca6-4f0a-a86d-d71e6f99dfbb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Returning 404 to user: Instance ad236d1f-2ae4-49b3-8c93-5c0348fdb112 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:46:20.389865 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-367cef3b-0ca6-4f0a-a86d-d71e6f99dfbb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "DELETE /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 404 len: 111 microversion: 2.1 time: 0.126091 Jul 25 14:46:20.390511 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2057/4367] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:46:20 2022] DELETE /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:46:20.401852 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-eaf9e8d0-f234-428e-b1c0-e05b60ebd38d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:20.402904 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-eaf9e8d0-f234-428e-b1c0-e05b60ebd38d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: ad236d1f-2ae4-49b3-8c93-5c0348fdb112] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:20.434376 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eaf9e8d0-f234-428e-b1c0-e05b60ebd38d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:20.444285 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eaf9e8d0-f234-428e-b1c0-e05b60ebd38d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:20.448644 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eaf9e8d0-f234-428e-b1c0-e05b60ebd38d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:20.449178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eaf9e8d0-f234-428e-b1c0-e05b60ebd38d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:20.479120 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-eaf9e8d0-f234-428e-b1c0-e05b60ebd38d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] HTTP exception thrown: Instance ad236d1f-2ae4-49b3-8c93-5c0348fdb112 could not be found. Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-eaf9e8d0-f234-428e-b1c0-e05b60ebd38d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Request method failure captured: Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 HTTP/1.1 Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3quERREaOs3Kc7iY1Vh9GKraPJ63kqwGO_-k7wXB_J3XVEfBf3LNTXeHb07R82UwUNgvRdojb21TsSuL636LebhCUID5TJuapIn-Sgeh4nT2_p48qkoLx6k1MrIDkEY7ueSXXEfRqNxtsyFtJzfjwKFOLGr5sudf0H8jELBV5u89FK0 Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b9b1c620d0b14a3a9471515cf47d6944", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b9b1c620d0b14a3a9471515cf47d6944"}]}] Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 33f992249063495c8bf12954afd9e8b7 Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance ad236d1f-2ae4-49b3-8c93-5c0348fdb112 could not be found. Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'ad236d1f-2ae4-49b3-8c93-5c0348fdb112'} Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad236d1f-2ae4-49b3-8c93-5c0348fdb112 could not be found. Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad236d1f-2ae4-49b3-8c93-5c0348fdb112 could not be found. Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:46:20.481406 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.485239 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:20.485239 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:46:20.485239 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:46:20.485239 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:46:20.485239 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:46:20.485239 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad236d1f-2ae4-49b3-8c93-5c0348fdb112 could not be found. Jul 25 14:46:20.485239 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.490198 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-eaf9e8d0-f234-428e-b1c0-e05b60ebd38d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Returning 404 to user: Instance ad236d1f-2ae4-49b3-8c93-5c0348fdb112 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:46:20.491862 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-eaf9e8d0-f234-428e-b1c0-e05b60ebd38d tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112" status: 404 len: 111 microversion: 2.1 time: 0.094461 Jul 25 14:46:20.493021 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2058/4368] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:20 2022] GET /compute/v2.1/servers/ad236d1f-2ae4-49b3-8c93-5c0348fdb112 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:46:20.508272 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-497c6067-d783-4447-9c40-8b5d72911194 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:20.509187 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-497c6067-d783-4447-9c40-8b5d72911194 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:20.524030 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-497c6067-d783-4447-9c40-8b5d72911194 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:20.525327 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-497c6067-d783-4447-9c40-8b5d72911194 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:20.527024 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-497c6067-d783-4447-9c40-8b5d72911194 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:20.530777 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-497c6067-d783-4447-9c40-8b5d72911194 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:20.558032 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-497c6067-d783-4447-9c40-8b5d72911194 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] HTTP exception thrown: Instance 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa could not be found. Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-497c6067-d783-4447-9c40-8b5d72911194 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Request method failure captured: Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa HTTP/1.1 Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3quERREaOs3Kc7iY1Vh9GKraPJ63kqwGO_-k7wXB_J3XVEfBf3LNTXeHb07R82UwUNgvRdojb21TsSuL636LebhCUID5TJuapIn-Sgeh4nT2_p48qkoLx6k1MrIDkEY7ueSXXEfRqNxtsyFtJzfjwKFOLGr5sudf0H8jELBV5u89FK0 Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b9b1c620d0b14a3a9471515cf47d6944", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b9b1c620d0b14a3a9471515cf47d6944"}]}] Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 33f992249063495c8bf12954afd9e8b7 Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa could not be found. Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '6a8c9a71-6a5f-4464-a9a6-0a4516f099fa'} Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa could not be found. Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:46:20.560109 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:46:20.564574 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa could not be found. Jul 25 14:46:20.564574 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.564574 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:46:20.564574 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.564574 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:20.564574 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:46:20.564574 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:46:20.564574 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:46:20.564574 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:46:20.564574 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa could not be found. Jul 25 14:46:20.564574 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.567601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-497c6067-d783-4447-9c40-8b5d72911194 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Returning 404 to user: Instance 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:46:20.568140 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-497c6067-d783-4447-9c40-8b5d72911194 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "DELETE /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 404 len: 111 microversion: 2.1 time: 0.068010 Jul 25 14:46:20.574170 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2059/4369] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:46:20 2022] DELETE /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:46:20.589814 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bba2380d-1b07-4349-97b0-80552e0adab8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:20.595364 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bba2380d-1b07-4349-97b0-80552e0adab8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:20.628157 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bba2380d-1b07-4349-97b0-80552e0adab8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:20.629860 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bba2380d-1b07-4349-97b0-80552e0adab8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:20.632742 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bba2380d-1b07-4349-97b0-80552e0adab8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:20.634043 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bba2380d-1b07-4349-97b0-80552e0adab8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:20.672726 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-bba2380d-1b07-4349-97b0-80552e0adab8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] HTTP exception thrown: Instance 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa could not be found. Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bba2380d-1b07-4349-97b0-80552e0adab8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Request method failure captured: Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa HTTP/1.1 Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3quERREaOs3Kc7iY1Vh9GKraPJ63kqwGO_-k7wXB_J3XVEfBf3LNTXeHb07R82UwUNgvRdojb21TsSuL636LebhCUID5TJuapIn-Sgeh4nT2_p48qkoLx6k1MrIDkEY7ueSXXEfRqNxtsyFtJzfjwKFOLGr5sudf0H8jELBV5u89FK0 Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b9b1c620d0b14a3a9471515cf47d6944", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b9b1c620d0b14a3a9471515cf47d6944"}]}] Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 33f992249063495c8bf12954afd9e8b7 Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa could not be found. Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '6a8c9a71-6a5f-4464-a9a6-0a4516f099fa'} Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa could not be found. Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa could not be found. Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:46:20.680791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.684513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:20.684513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:46:20.684513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:46:20.684513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:46:20.684513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:46:20.684513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa could not be found. Jul 25 14:46:20.684513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.689415 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bba2380d-1b07-4349-97b0-80552e0adab8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Returning 404 to user: Instance 6a8c9a71-6a5f-4464-a9a6-0a4516f099fa could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:46:20.690958 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bba2380d-1b07-4349-97b0-80552e0adab8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa" status: 404 len: 111 microversion: 2.1 time: 0.114661 Jul 25 14:46:20.691768 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2060/4370] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:20 2022] GET /compute/v2.1/servers/6a8c9a71-6a5f-4464-a9a6-0a4516f099fa => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:46:20.702521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f5aca6aa-4357-4bd2-812a-a66f0a493993 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:20.703634 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f5aca6aa-4357-4bd2-812a-a66f0a493993 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: b2758384-4e23-4c78-8c2b-d38932d2cc13] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:20.724678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f5aca6aa-4357-4bd2-812a-a66f0a493993 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:20.726073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f5aca6aa-4357-4bd2-812a-a66f0a493993 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:20.728446 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f5aca6aa-4357-4bd2-812a-a66f0a493993 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:20.729681 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f5aca6aa-4357-4bd2-812a-a66f0a493993 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:20.774377 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-f5aca6aa-4357-4bd2-812a-a66f0a493993 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] HTTP exception thrown: Instance b2758384-4e23-4c78-8c2b-d38932d2cc13 could not be found. Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f5aca6aa-4357-4bd2-812a-a66f0a493993 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Request method failure captured: Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13 HTTP/1.1 Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3quERREaOs3Kc7iY1Vh9GKraPJ63kqwGO_-k7wXB_J3XVEfBf3LNTXeHb07R82UwUNgvRdojb21TsSuL636LebhCUID5TJuapIn-Sgeh4nT2_p48qkoLx6k1MrIDkEY7ueSXXEfRqNxtsyFtJzfjwKFOLGr5sudf0H8jELBV5u89FK0 Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b9b1c620d0b14a3a9471515cf47d6944", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b9b1c620d0b14a3a9471515cf47d6944"}]}] Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 33f992249063495c8bf12954afd9e8b7 Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance b2758384-4e23-4c78-8c2b-d38932d2cc13 could not be found. Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'b2758384-4e23-4c78-8c2b-d38932d2cc13'} Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2758384-4e23-4c78-8c2b-d38932d2cc13 could not be found. Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:46:20.777092 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:46:20.781232 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2758384-4e23-4c78-8c2b-d38932d2cc13 could not be found. Jul 25 14:46:20.781232 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.781232 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:46:20.781232 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.781232 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:20.781232 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:46:20.781232 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:46:20.781232 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:46:20.781232 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:46:20.781232 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2758384-4e23-4c78-8c2b-d38932d2cc13 could not be found. Jul 25 14:46:20.781232 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.795856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f5aca6aa-4357-4bd2-812a-a66f0a493993 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Returning 404 to user: Instance b2758384-4e23-4c78-8c2b-d38932d2cc13 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:46:20.797329 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f5aca6aa-4357-4bd2-812a-a66f0a493993 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13" status: 404 len: 111 microversion: 2.1 time: 0.101424 Jul 25 14:46:20.798431 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2061/4371] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:46:20 2022] DELETE /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:46:20.806423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-83298704-8981-4fe3-a6b6-1b18120409b8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:20.808122 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-83298704-8981-4fe3-a6b6-1b18120409b8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: b2758384-4e23-4c78-8c2b-d38932d2cc13] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:20.817387 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-83298704-8981-4fe3-a6b6-1b18120409b8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:20.819072 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-83298704-8981-4fe3-a6b6-1b18120409b8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:20.820824 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-83298704-8981-4fe3-a6b6-1b18120409b8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:20.822519 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-83298704-8981-4fe3-a6b6-1b18120409b8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:20.891377 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-83298704-8981-4fe3-a6b6-1b18120409b8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] HTTP exception thrown: Instance b2758384-4e23-4c78-8c2b-d38932d2cc13 could not be found. Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-83298704-8981-4fe3-a6b6-1b18120409b8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Request method failure captured: Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13 HTTP/1.1 Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3quERREaOs3Kc7iY1Vh9GKraPJ63kqwGO_-k7wXB_J3XVEfBf3LNTXeHb07R82UwUNgvRdojb21TsSuL636LebhCUID5TJuapIn-Sgeh4nT2_p48qkoLx6k1MrIDkEY7ueSXXEfRqNxtsyFtJzfjwKFOLGr5sudf0H8jELBV5u89FK0 Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b9b1c620d0b14a3a9471515cf47d6944", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b9b1c620d0b14a3a9471515cf47d6944"}]}] Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 33f992249063495c8bf12954afd9e8b7 Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance b2758384-4e23-4c78-8c2b-d38932d2cc13 could not be found. Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'b2758384-4e23-4c78-8c2b-d38932d2cc13'} Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2758384-4e23-4c78-8c2b-d38932d2cc13 could not be found. Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2758384-4e23-4c78-8c2b-d38932d2cc13 could not be found. Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:46:20.895260 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.899617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:20.899617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:46:20.899617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:46:20.899617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:46:20.899617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:46:20.899617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2758384-4e23-4c78-8c2b-d38932d2cc13 could not be found. Jul 25 14:46:20.899617 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.906572 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-83298704-8981-4fe3-a6b6-1b18120409b8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Returning 404 to user: Instance b2758384-4e23-4c78-8c2b-d38932d2cc13 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:46:20.907701 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-83298704-8981-4fe3-a6b6-1b18120409b8 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13" status: 404 len: 111 microversion: 2.1 time: 0.105584 Jul 25 14:46:20.913727 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2062/4372] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:20 2022] GET /compute/v2.1/servers/b2758384-4e23-4c78-8c2b-d38932d2cc13 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:46:20.919487 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-159b9408-d4f6-4697-8d63-3aab4146e5d3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:20.920942 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-159b9408-d4f6-4697-8d63-3aab4146e5d3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: dbb92cab-8b6d-4846-a170-16b68dd959ca] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:20.935310 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-159b9408-d4f6-4697-8d63-3aab4146e5d3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] HTTP exception thrown: Instance dbb92cab-8b6d-4846-a170-16b68dd959ca could not be found. Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-159b9408-d4f6-4697-8d63-3aab4146e5d3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Request method failure captured: Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/dbb92cab-8b6d-4846-a170-16b68dd959ca HTTP/1.1 Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3quERREaOs3Kc7iY1Vh9GKraPJ63kqwGO_-k7wXB_J3XVEfBf3LNTXeHb07R82UwUNgvRdojb21TsSuL636LebhCUID5TJuapIn-Sgeh4nT2_p48qkoLx6k1MrIDkEY7ueSXXEfRqNxtsyFtJzfjwKFOLGr5sudf0H8jELBV5u89FK0 Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b9b1c620d0b14a3a9471515cf47d6944", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b9b1c620d0b14a3a9471515cf47d6944"}]}] Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 33f992249063495c8bf12954afd9e8b7 Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance dbb92cab-8b6d-4846-a170-16b68dd959ca could not be found. Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'dbb92cab-8b6d-4846-a170-16b68dd959ca'} Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbb92cab-8b6d-4846-a170-16b68dd959ca could not be found. Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbb92cab-8b6d-4846-a170-16b68dd959ca could not be found. Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:46:20.937802 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.942197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:20.942197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:46:20.942197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:46:20.942197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:46:20.942197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:46:20.942197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbb92cab-8b6d-4846-a170-16b68dd959ca could not be found. Jul 25 14:46:20.942197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.946625 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-159b9408-d4f6-4697-8d63-3aab4146e5d3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Returning 404 to user: Instance dbb92cab-8b6d-4846-a170-16b68dd959ca could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:46:20.948627 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-159b9408-d4f6-4697-8d63-3aab4146e5d3 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "DELETE /compute/v2.1/servers/dbb92cab-8b6d-4846-a170-16b68dd959ca" status: 404 len: 111 microversion: 2.1 time: 0.033703 Jul 25 14:46:20.950314 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2063/4373] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:46:20 2022] DELETE /compute/v2.1/servers/dbb92cab-8b6d-4846-a170-16b68dd959ca => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:46:20.962121 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5d25ce0c-0aac-4ab7-b8c6-255f5dd1c409 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:20.968705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5d25ce0c-0aac-4ab7-b8c6-255f5dd1c409 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: dbb92cab-8b6d-4846-a170-16b68dd959ca] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:20.992571 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-5d25ce0c-0aac-4ab7-b8c6-255f5dd1c409 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] HTTP exception thrown: Instance dbb92cab-8b6d-4846-a170-16b68dd959ca could not be found. Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5d25ce0c-0aac-4ab7-b8c6-255f5dd1c409 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Request method failure captured: Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/dbb92cab-8b6d-4846-a170-16b68dd959ca HTTP/1.1 Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3quERREaOs3Kc7iY1Vh9GKraPJ63kqwGO_-k7wXB_J3XVEfBf3LNTXeHb07R82UwUNgvRdojb21TsSuL636LebhCUID5TJuapIn-Sgeh4nT2_p48qkoLx6k1MrIDkEY7ueSXXEfRqNxtsyFtJzfjwKFOLGr5sudf0H8jELBV5u89FK0 Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b9b1c620d0b14a3a9471515cf47d6944", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b9b1c620d0b14a3a9471515cf47d6944"}]}] Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 33f992249063495c8bf12954afd9e8b7 Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance dbb92cab-8b6d-4846-a170-16b68dd959ca could not be found. Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'dbb92cab-8b6d-4846-a170-16b68dd959ca'} Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbb92cab-8b6d-4846-a170-16b68dd959ca could not be found. Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbb92cab-8b6d-4846-a170-16b68dd959ca could not be found. Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:20.995148 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:46:21.001305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:46:21.001305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:46:21.001305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:46:21.001305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbb92cab-8b6d-4846-a170-16b68dd959ca could not be found. Jul 25 14:46:21.001305 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:21.005756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5d25ce0c-0aac-4ab7-b8c6-255f5dd1c409 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Returning 404 to user: Instance dbb92cab-8b6d-4846-a170-16b68dd959ca could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:46:21.012559 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5d25ce0c-0aac-4ab7-b8c6-255f5dd1c409 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/dbb92cab-8b6d-4846-a170-16b68dd959ca" status: 404 len: 111 microversion: 2.1 time: 0.054760 Jul 25 14:46:21.014086 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2064/4374] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:20 2022] GET /compute/v2.1/servers/dbb92cab-8b6d-4846-a170-16b68dd959ca => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:46:21.062631 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a1441020-06e0-45cd-a856-d8f61bea1ce3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f4686671040>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:21.161331 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a1441020-06e0-45cd-a856-d8f61bea1ce3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1412 microversion: 2.1 time: 0.106347 Jul 25 14:46:21.166925 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2065/4375] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:21 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1412 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:21.178409 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6c1b4b2e-69f9-44d8-bd5b-f34284200ee9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:21.180919 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6c1b4b2e-69f9-44d8-bd5b-f34284200ee9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: f5e1c62b-88b7-4ec7-a2f3-b99b1566baab] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:21.202244 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6c1b4b2e-69f9-44d8-bd5b-f34284200ee9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:21.205168 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6c1b4b2e-69f9-44d8-bd5b-f34284200ee9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:21.206426 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6c1b4b2e-69f9-44d8-bd5b-f34284200ee9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:21.210657 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6c1b4b2e-69f9-44d8-bd5b-f34284200ee9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:21.468258 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b5d25d40-18cc-4fea-bd77-76320fff6fec tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:21.509672 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b5d25d40-18cc-4fea-bd77-76320fff6fec tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:21.519851 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b5d25d40-18cc-4fea-bd77-76320fff6fec tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:21.521275 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b5d25d40-18cc-4fea-bd77-76320fff6fec tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1878 microversion: 2.32 time: 1.293799 Jul 25 14:46:21.549499 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2311/4376] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:46:20 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1878 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:46:21.623582 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-e194de7f-5a3d-48d6-be63-584c0ec6444f req-685b9535-1b9c-481f-9bde-163aeba4ac24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50f3696b-0e20-4fc7-9bd0-3955357f2b09", "tag": "2faa258c-a4e9-4d6b-8205-234eebed8d96"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:46:21.649220 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:46:21.654222 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-e194de7f-5a3d-48d6-be63-584c0ec6444f req-685b9535-1b9c-481f-9bde-163aeba4ac24 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:21.655242 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-e194de7f-5a3d-48d6-be63-584c0ec6444f req-685b9535-1b9c-481f-9bde-163aeba4ac24 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:21.707862 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-e194de7f-5a3d-48d6-be63-584c0ec6444f req-685b9535-1b9c-481f-9bde-163aeba4ac24 service nova] Creating event network-changed:2faa258c-a4e9-4d6b-8205-234eebed8d96 for instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 on n-h1-846435-14 Jul 25 14:46:21.727412 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-e194de7f-5a3d-48d6-be63-584c0ec6444f req-685b9535-1b9c-481f-9bde-163aeba4ac24 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109198 Jul 25 14:46:21.729100 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2312/4377] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:46:22.034300 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6c1b4b2e-69f9-44d8-bd5b-f34284200ee9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:22.044615 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6c1b4b2e-69f9-44d8-bd5b-f34284200ee9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab" status: 200 len: 1368 microversion: 2.1 time: 0.875996 Jul 25 14:46:22.048470 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2066/4378] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:21 2022] GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab => generated 1368 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:22.179755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:46:22.186493 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fd6ff2ea-310c-441c-80c5-2dba0afd29a2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f4686224430>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:22.286001 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fd6ff2ea-310c-441c-80c5-2dba0afd29a2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1412 microversion: 2.1 time: 0.107135 Jul 25 14:46:22.288835 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2313/4379] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:22 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1412 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:22.553055 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-801dfcb3-5705-4b7c-82af-49745fdc3407 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:22.554447 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-801dfcb3-5705-4b7c-82af-49745fdc3407 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:22.580080 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-801dfcb3-5705-4b7c-82af-49745fdc3407 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:22.584822 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-801dfcb3-5705-4b7c-82af-49745fdc3407 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:22.589566 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-801dfcb3-5705-4b7c-82af-49745fdc3407 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:22.590280 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-801dfcb3-5705-4b7c-82af-49745fdc3407 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:23.068704 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=8 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:46:23.074615 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-389fbafe-6a39-491e-89f1-f83a08f8dc52 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:23.075359 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-389fbafe-6a39-491e-89f1-f83a08f8dc52 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: f5e1c62b-88b7-4ec7-a2f3-b99b1566baab] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:23.114198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-389fbafe-6a39-491e-89f1-f83a08f8dc52 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:23.114673 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-389fbafe-6a39-491e-89f1-f83a08f8dc52 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:23.115460 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-389fbafe-6a39-491e-89f1-f83a08f8dc52 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:23.115911 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-389fbafe-6a39-491e-89f1-f83a08f8dc52 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:23.678369 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-801dfcb3-5705-4b7c-82af-49745fdc3407 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:23.711396 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-801dfcb3-5705-4b7c-82af-49745fdc3407 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:23.715025 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-801dfcb3-5705-4b7c-82af-49745fdc3407 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:23.719889 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-801dfcb3-5705-4b7c-82af-49745fdc3407 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1878 microversion: 2.32 time: 1.171196 Jul 25 14:46:23.721298 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2067/4380] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:46:22 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1878 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:46:23.736671 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2be20ed1-7d73-4630-9077-c2cc3a7d42c3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46866711f0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:23.869546 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2be20ed1-7d73-4630-9077-c2cc3a7d42c3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1412 microversion: 2.1 time: 0.145979 Jul 25 14:46:23.871360 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2068/4381] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:23 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1412 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:23.899075 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-009ccdfa-aa22-4f5a-8989-ed2df1dac4d2 req-fbc2516d-56dd-4942-9532-8e44c5eec958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5e1c62b-88b7-4ec7-a2f3-b99b1566baab", "tag": "f26ef5c9-78ef-4d4e-ad54-598461e6e22e"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:46:23.939436 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-009ccdfa-aa22-4f5a-8989-ed2df1dac4d2 req-fbc2516d-56dd-4942-9532-8e44c5eec958 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:23.942637 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-009ccdfa-aa22-4f5a-8989-ed2df1dac4d2 req-fbc2516d-56dd-4942-9532-8e44c5eec958 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:23.979913 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-009ccdfa-aa22-4f5a-8989-ed2df1dac4d2 req-fbc2516d-56dd-4942-9532-8e44c5eec958 service nova] Creating event network-changed:f26ef5c9-78ef-4d4e-ad54-598461e6e22e for instance f5e1c62b-88b7-4ec7-a2f3-b99b1566baab on n-h2-846435-14 Jul 25 14:46:24.012043 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-009ccdfa-aa22-4f5a-8989-ed2df1dac4d2 req-fbc2516d-56dd-4942-9532-8e44c5eec958 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135748 Jul 25 14:46:24.017632 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2069/4382] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:46:24.037847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-389fbafe-6a39-491e-89f1-f83a08f8dc52 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:24.049103 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-389fbafe-6a39-491e-89f1-f83a08f8dc52 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab" status: 200 len: 1368 microversion: 2.1 time: 0.981217 Jul 25 14:46:24.058737 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2314/4383] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:23 2022] GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab => generated 1368 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:46:24.427835 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c132e601-f83d-49fa-aaba-e659ce56e666 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:46:24.443648 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c132e601-f83d-49fa-aaba-e659ce56e666 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:24.445466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c132e601-f83d-49fa-aaba-e659ce56e666 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:24.495710 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c132e601-f83d-49fa-aaba-e659ce56e666 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Going to try to stop instance {{(pid=119303) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 14:46:24.581593 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c132e601-f83d-49fa-aaba-e659ce56e666 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "POST /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850/action" status: 202 len: 0 microversion: 2.1 time: 0.157919 Jul 25 14:46:24.593550 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3fb19c30-9efe-412a-8727-693f029875ce tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:24.594817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3fb19c30-9efe-412a-8727-693f029875ce tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:24.600743 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2070/4384] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:46:24 2022] POST /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:46:24.609912 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3fb19c30-9efe-412a-8727-693f029875ce tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:24.612415 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3fb19c30-9efe-412a-8727-693f029875ce tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:24.614330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3fb19c30-9efe-412a-8727-693f029875ce tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:24.615102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3fb19c30-9efe-412a-8727-693f029875ce tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:24.747822 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-45cb870c-69a1-4222-b36b-24e12b5f9fd2 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:24.749270 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-45cb870c-69a1-4222-b36b-24e12b5f9fd2 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:24.760069 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-45cb870c-69a1-4222-b36b-24e12b5f9fd2 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:24.764742 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-45cb870c-69a1-4222-b36b-24e12b5f9fd2 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:24.766103 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-45cb870c-69a1-4222-b36b-24e12b5f9fd2 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:24.766817 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-45cb870c-69a1-4222-b36b-24e12b5f9fd2 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:25.199830 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-45cb870c-69a1-4222-b36b-24e12b5f9fd2 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:25.215820 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-45cb870c-69a1-4222-b36b-24e12b5f9fd2 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:25.217919 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-45cb870c-69a1-4222-b36b-24e12b5f9fd2 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:25.221317 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-45cb870c-69a1-4222-b36b-24e12b5f9fd2 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1878 microversion: 2.32 time: 0.477998 Jul 25 14:46:25.222495 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2071/4385] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:46:24 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1878 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:46:25.233979 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5c826851-e057-4111-b7f8-ca80c9e32c84 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f4686632dc0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:25.309715 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5c826851-e057-4111-b7f8-ca80c9e32c84 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1412 microversion: 2.1 time: 0.085787 Jul 25 14:46:25.310525 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2072/4386] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:25 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1412 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:25.316806 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-968dcbd3-dc34-47e0-ac50-16b194664209 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:25.344364 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-968dcbd3-dc34-47e0-ac50-16b194664209 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: f5e1c62b-88b7-4ec7-a2f3-b99b1566baab] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:25.365264 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-968dcbd3-dc34-47e0-ac50-16b194664209 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:25.365718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-968dcbd3-dc34-47e0-ac50-16b194664209 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:25.378013 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-968dcbd3-dc34-47e0-ac50-16b194664209 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:25.378546 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-968dcbd3-dc34-47e0-ac50-16b194664209 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:25.403858 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3fb19c30-9efe-412a-8727-693f029875ce tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:25.415078 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3fb19c30-9efe-412a-8727-693f029875ce tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1677 microversion: 2.1 time: 0.826671 Jul 25 14:46:25.420488 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2315/4387] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:24 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1677 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:25.944067 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-968dcbd3-dc34-47e0-ac50-16b194664209 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:25.954218 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-968dcbd3-dc34-47e0-ac50-16b194664209 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab" status: 200 len: 1368 microversion: 2.1 time: 0.641109 Jul 25 14:46:25.962440 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2073/4388] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:25 2022] GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab => generated 1368 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:26.250638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-43a65c1c-ac5f-4936-a3cd-15c0b83ea92b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:26.251282 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-43a65c1c-ac5f-4936-a3cd-15c0b83ea92b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:26.261829 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-43a65c1c-ac5f-4936-a3cd-15c0b83ea92b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:26.262287 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-43a65c1c-ac5f-4936-a3cd-15c0b83ea92b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:26.263116 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-43a65c1c-ac5f-4936-a3cd-15c0b83ea92b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:26.275702 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-43a65c1c-ac5f-4936-a3cd-15c0b83ea92b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:26.326211 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ea6a20d1-632e-4fd7-823b-4bae901216c1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46866beb80>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:26.403545 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ea6a20d1-632e-4fd7-823b-4bae901216c1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1412 microversion: 2.1 time: 0.081731 Jul 25 14:46:26.404712 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2074/4389] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:26 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1412 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:26.453127 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1a39e915-ca94-46f2-897a-05cd03987ef6 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:26.453973 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1a39e915-ca94-46f2-897a-05cd03987ef6 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:26.474303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1a39e915-ca94-46f2-897a-05cd03987ef6 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:26.475619 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1a39e915-ca94-46f2-897a-05cd03987ef6 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:26.477698 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1a39e915-ca94-46f2-897a-05cd03987ef6 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:26.479360 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1a39e915-ca94-46f2-897a-05cd03987ef6 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:27.175662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1a39e915-ca94-46f2-897a-05cd03987ef6 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:27.186629 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:46:27.200343 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1a39e915-ca94-46f2-897a-05cd03987ef6 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1677 microversion: 2.1 time: 0.750173 Jul 25 14:46:27.220639 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2075/4390] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:26 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1677 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:46:27.220639 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f0b768dc-efe4-4afa-ad0a-569f3446126b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:27.220639 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f0b768dc-efe4-4afa-ad0a-569f3446126b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: f5e1c62b-88b7-4ec7-a2f3-b99b1566baab] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:27.241676 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f0b768dc-efe4-4afa-ad0a-569f3446126b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:27.242150 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f0b768dc-efe4-4afa-ad0a-569f3446126b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:27.244488 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f0b768dc-efe4-4afa-ad0a-569f3446126b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:27.245238 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f0b768dc-efe4-4afa-ad0a-569f3446126b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:27.610084 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-43a65c1c-ac5f-4936-a3cd-15c0b83ea92b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:27.624734 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-43a65c1c-ac5f-4936-a3cd-15c0b83ea92b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:27.626614 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-43a65c1c-ac5f-4936-a3cd-15c0b83ea92b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:27.632001 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-43a65c1c-ac5f-4936-a3cd-15c0b83ea92b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1878 microversion: 2.32 time: 1.385694 Jul 25 14:46:27.637066 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2316/4391] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:46:26 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1878 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:46:27.653723 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-92b86fce-3617-4141-9948-13c2d7b118a3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46989d3700>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:27.725543 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-92b86fce-3617-4141-9948-13c2d7b118a3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1412 microversion: 2.1 time: 0.087011 Jul 25 14:46:27.734213 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2317/4392] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:27 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1412 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:28.144665 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f0b768dc-efe4-4afa-ad0a-569f3446126b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:28.176973 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f0b768dc-efe4-4afa-ad0a-569f3446126b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab" status: 200 len: 1368 microversion: 2.1 time: 0.967812 Jul 25 14:46:28.177594 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2076/4393] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:27 2022] GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab => generated 1368 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:28.230432 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-33cc02ec-7d45-4197-8229-bc594c8ad05b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:28.231048 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-33cc02ec-7d45-4197-8229-bc594c8ad05b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:28.248970 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-33cc02ec-7d45-4197-8229-bc594c8ad05b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:28.249470 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-33cc02ec-7d45-4197-8229-bc594c8ad05b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:28.250276 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-33cc02ec-7d45-4197-8229-bc594c8ad05b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:28.250715 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-33cc02ec-7d45-4197-8229-bc594c8ad05b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:28.666565 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-03f14baf-49e3-46d3-9ef2-7a03c675c70c tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:28.666961 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-03f14baf-49e3-46d3-9ef2-7a03c675c70c tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:28.682101 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-33cc02ec-7d45-4197-8229-bc594c8ad05b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:28.682683 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03f14baf-49e3-46d3-9ef2-7a03c675c70c tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:28.682683 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03f14baf-49e3-46d3-9ef2-7a03c675c70c tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:28.683347 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03f14baf-49e3-46d3-9ef2-7a03c675c70c tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:28.683795 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03f14baf-49e3-46d3-9ef2-7a03c675c70c tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:28.702534 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-33cc02ec-7d45-4197-8229-bc594c8ad05b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1677 microversion: 2.1 time: 0.477132 Jul 25 14:46:28.715966 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2318/4394] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:28 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1677 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:28.744462 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9cbdc348-12a2-4c0d-ad84-ff6a839d5ff0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46988ffca0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:28.882208 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9cbdc348-12a2-4c0d-ad84-ff6a839d5ff0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1412 microversion: 2.1 time: 0.143811 Jul 25 14:46:28.884332 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2319/4395] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:28 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1412 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:29.197966 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8c0d008c-2b18-46c8-9bc2-c9eb4402fb75 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:29.199303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8c0d008c-2b18-46c8-9bc2-c9eb4402fb75 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: f5e1c62b-88b7-4ec7-a2f3-b99b1566baab] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:29.210703 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8c0d008c-2b18-46c8-9bc2-c9eb4402fb75 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:29.211634 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8c0d008c-2b18-46c8-9bc2-c9eb4402fb75 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:29.212678 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8c0d008c-2b18-46c8-9bc2-c9eb4402fb75 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:29.215083 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8c0d008c-2b18-46c8-9bc2-c9eb4402fb75 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:29.425991 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-03f14baf-49e3-46d3-9ef2-7a03c675c70c tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:29.455887 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-03f14baf-49e3-46d3-9ef2-7a03c675c70c tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:29.457705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-03f14baf-49e3-46d3-9ef2-7a03c675c70c tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:29.459073 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-03f14baf-49e3-46d3-9ef2-7a03c675c70c tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1878 microversion: 2.32 time: 0.799136 Jul 25 14:46:29.462729 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2077/4396] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:46:28 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1878 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:46:29.734122 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d4530d1c-3998-475b-b350-69aca2c0d51a tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:29.734738 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d4530d1c-3998-475b-b350-69aca2c0d51a tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:29.743537 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d4530d1c-3998-475b-b350-69aca2c0d51a tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:29.746161 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d4530d1c-3998-475b-b350-69aca2c0d51a tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:29.754367 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d4530d1c-3998-475b-b350-69aca2c0d51a tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:29.755153 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d4530d1c-3998-475b-b350-69aca2c0d51a tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:29.875690 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8c0d008c-2b18-46c8-9bc2-c9eb4402fb75 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:29.889338 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8c0d008c-2b18-46c8-9bc2-c9eb4402fb75 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab" status: 200 len: 1368 microversion: 2.1 time: 0.695303 Jul 25 14:46:29.890534 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2320/4397] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:29 2022] GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab => generated 1368 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:46:29.916028 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bc1abdc4-d809-4621-b3bd-3567902728eb tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46878f10d0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:30.006096 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bc1abdc4-d809-4621-b3bd-3567902728eb tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1412 microversion: 2.1 time: 0.094479 Jul 25 14:46:30.006711 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2321/4398] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:29 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1412 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:30.044577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d4530d1c-3998-475b-b350-69aca2c0d51a tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:30.052908 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d4530d1c-3998-475b-b350-69aca2c0d51a tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1677 microversion: 2.1 time: 0.322702 Jul 25 14:46:30.053517 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2078/4399] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:29 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1677 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:30.490068 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-96788690-71ec-4af8-bd2c-71fcb6ca4299 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:30.490688 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-96788690-71ec-4af8-bd2c-71fcb6ca4299 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:30.543799 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-96788690-71ec-4af8-bd2c-71fcb6ca4299 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:30.543799 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-96788690-71ec-4af8-bd2c-71fcb6ca4299 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:30.543799 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-96788690-71ec-4af8-bd2c-71fcb6ca4299 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:30.543799 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-96788690-71ec-4af8-bd2c-71fcb6ca4299 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:30.758067 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-eee95a1b-b36c-4a85-ae3f-488656c04efb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:30.758598 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-eee95a1b-b36c-4a85-ae3f-488656c04efb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:30.777886 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eee95a1b-b36c-4a85-ae3f-488656c04efb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:30.778338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eee95a1b-b36c-4a85-ae3f-488656c04efb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:30.779145 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eee95a1b-b36c-4a85-ae3f-488656c04efb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:30.779583 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eee95a1b-b36c-4a85-ae3f-488656c04efb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:30.848066 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-eee95a1b-b36c-4a85-ae3f-488656c04efb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] HTTP exception thrown: Instance c3d218da-f592-4489-8617-c37441df3527 could not be found. Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-eee95a1b-b36c-4a85-ae3f-488656c04efb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Request method failure captured: Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 HTTP/1.1 Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3quERREaOs3Kc7iY1Vh9GKraPJ63kqwGO_-k7wXB_J3XVEfBf3LNTXeHb07R82UwUNgvRdojb21TsSuL636LebhCUID5TJuapIn-Sgeh4nT2_p48qkoLx6k1MrIDkEY7ueSXXEfRqNxtsyFtJzfjwKFOLGr5sudf0H8jELBV5u89FK0 Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b9b1c620d0b14a3a9471515cf47d6944", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b9b1c620d0b14a3a9471515cf47d6944"}]}] Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 33f992249063495c8bf12954afd9e8b7 Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance c3d218da-f592-4489-8617-c37441df3527 could not be found. Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'c3d218da-f592-4489-8617-c37441df3527'} Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3d218da-f592-4489-8617-c37441df3527 could not be found. Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:46:30.859084 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:46:30.863791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3d218da-f592-4489-8617-c37441df3527 could not be found. Jul 25 14:46:30.863791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:30.863791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:46:30.863791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:30.863791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:30.863791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:46:30.863791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:46:30.863791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:46:30.863791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:46:30.863791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3d218da-f592-4489-8617-c37441df3527 could not be found. Jul 25 14:46:30.863791 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:30.869177 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-eee95a1b-b36c-4a85-ae3f-488656c04efb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Returning 404 to user: Instance c3d218da-f592-4489-8617-c37441df3527 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:46:30.873199 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-eee95a1b-b36c-4a85-ae3f-488656c04efb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527" status: 404 len: 111 microversion: 2.1 time: 0.119161 Jul 25 14:46:30.873788 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2079/4400] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:46:30 2022] DELETE /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:46:30.884490 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b9d7227a-9f30-4ed3-9b57-2dab94663f22 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:30.885114 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b9d7227a-9f30-4ed3-9b57-2dab94663f22 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: c3d218da-f592-4489-8617-c37441df3527] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:30.907631 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b9d7227a-9f30-4ed3-9b57-2dab94663f22 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:30.908114 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b9d7227a-9f30-4ed3-9b57-2dab94663f22 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:30.914648 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b9d7227a-9f30-4ed3-9b57-2dab94663f22 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:30.915115 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b9d7227a-9f30-4ed3-9b57-2dab94663f22 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:30.946445 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-b9d7227a-9f30-4ed3-9b57-2dab94663f22 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] HTTP exception thrown: Instance c3d218da-f592-4489-8617-c37441df3527 could not be found. Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b9d7227a-9f30-4ed3-9b57-2dab94663f22 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Request method failure captured: Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 HTTP/1.1 Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3quERREaOs3Kc7iY1Vh9GKraPJ63kqwGO_-k7wXB_J3XVEfBf3LNTXeHb07R82UwUNgvRdojb21TsSuL636LebhCUID5TJuapIn-Sgeh4nT2_p48qkoLx6k1MrIDkEY7ueSXXEfRqNxtsyFtJzfjwKFOLGr5sudf0H8jELBV5u89FK0 Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b9b1c620d0b14a3a9471515cf47d6944", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b9b1c620d0b14a3a9471515cf47d6944"}]}] Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 33f992249063495c8bf12954afd9e8b7 Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance c3d218da-f592-4489-8617-c37441df3527 could not be found. Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'c3d218da-f592-4489-8617-c37441df3527'} Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3d218da-f592-4489-8617-c37441df3527 could not be found. Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3d218da-f592-4489-8617-c37441df3527 could not be found. Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:46:30.957195 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:30.961613 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:30.961613 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:46:30.961613 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:46:30.961613 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:46:30.961613 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:46:30.961613 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3d218da-f592-4489-8617-c37441df3527 could not be found. Jul 25 14:46:30.961613 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:30.981152 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b9d7227a-9f30-4ed3-9b57-2dab94663f22 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Returning 404 to user: Instance c3d218da-f592-4489-8617-c37441df3527 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:46:30.983024 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b9d7227a-9f30-4ed3-9b57-2dab94663f22 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527" status: 404 len: 111 microversion: 2.1 time: 0.104832 Jul 25 14:46:30.986015 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2080/4401] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:30 2022] GET /compute/v2.1/servers/c3d218da-f592-4489-8617-c37441df3527 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:46:30.997895 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-55865215-6320-4ee9-b1da-0281f25ac09c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:31.004018 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-55865215-6320-4ee9-b1da-0281f25ac09c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: f5e1c62b-88b7-4ec7-a2f3-b99b1566baab] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:31.018598 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-55865215-6320-4ee9-b1da-0281f25ac09c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:31.019369 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-55865215-6320-4ee9-b1da-0281f25ac09c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:31.020371 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-55865215-6320-4ee9-b1da-0281f25ac09c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:31.022844 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-55865215-6320-4ee9-b1da-0281f25ac09c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:31.266016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-96788690-71ec-4af8-bd2c-71fcb6ca4299 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:31.276066 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-96788690-71ec-4af8-bd2c-71fcb6ca4299 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:31.287878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-96788690-71ec-4af8-bd2c-71fcb6ca4299 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:31.294237 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-96788690-71ec-4af8-bd2c-71fcb6ca4299 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1878 microversion: 2.32 time: 0.809265 Jul 25 14:46:31.295350 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2322/4402] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:46:30 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1878 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:46:31.311440 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b78b9e49-4520-432f-91e2-b009e1d41ddb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:31.315894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b78b9e49-4520-432f-91e2-b009e1d41ddb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 86d15cd4-fd8d-43ac-a471-6c7c19f778f3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:31.341724 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b78b9e49-4520-432f-91e2-b009e1d41ddb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:31.345971 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b78b9e49-4520-432f-91e2-b009e1d41ddb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:31.349855 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b78b9e49-4520-432f-91e2-b009e1d41ddb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:31.355997 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b78b9e49-4520-432f-91e2-b009e1d41ddb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:31.442255 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-b78b9e49-4520-432f-91e2-b009e1d41ddb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] HTTP exception thrown: Instance 86d15cd4-fd8d-43ac-a471-6c7c19f778f3 could not be found. Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b78b9e49-4520-432f-91e2-b009e1d41ddb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Request method failure captured: Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3 HTTP/1.1 Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3quERREaOs3Kc7iY1Vh9GKraPJ63kqwGO_-k7wXB_J3XVEfBf3LNTXeHb07R82UwUNgvRdojb21TsSuL636LebhCUID5TJuapIn-Sgeh4nT2_p48qkoLx6k1MrIDkEY7ueSXXEfRqNxtsyFtJzfjwKFOLGr5sudf0H8jELBV5u89FK0 Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b9b1c620d0b14a3a9471515cf47d6944", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b9b1c620d0b14a3a9471515cf47d6944"}]}] Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 33f992249063495c8bf12954afd9e8b7 Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 86d15cd4-fd8d-43ac-a471-6c7c19f778f3 could not be found. Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '86d15cd4-fd8d-43ac-a471-6c7c19f778f3'} Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86d15cd4-fd8d-43ac-a471-6c7c19f778f3 could not be found. Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:46:31.444902 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:46:31.449107 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86d15cd4-fd8d-43ac-a471-6c7c19f778f3 could not be found. Jul 25 14:46:31.449107 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:46:31.449107 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:46:31.449107 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:46:31.449107 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:31.449107 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:46:31.449107 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:46:31.449107 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:46:31.449107 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:46:31.449107 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86d15cd4-fd8d-43ac-a471-6c7c19f778f3 could not be found. Jul 25 14:46:31.449107 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:46:31.478663 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b78b9e49-4520-432f-91e2-b009e1d41ddb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Returning 404 to user: Instance 86d15cd4-fd8d-43ac-a471-6c7c19f778f3 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:46:31.482802 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b78b9e49-4520-432f-91e2-b009e1d41ddb tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "DELETE /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3" status: 404 len: 111 microversion: 2.1 time: 0.181895 Jul 25 14:46:31.487407 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2323/4403] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:46:31 2022] DELETE /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3 => generated 111 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:46:31.508470 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-94d45ef5-e872-48f2-b45f-652530ef73e8 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46988c5280>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:31.642786 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-94d45ef5-e872-48f2-b45f-652530ef73e8 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1412 microversion: 2.1 time: 0.153563 Jul 25 14:46:31.650006 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2324/4404] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:31 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1412 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:31.664836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b1ced713-e725-4ade-bd43-7b117090cda0 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:31.665668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b1ced713-e725-4ade-bd43-7b117090cda0 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:31.693741 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b1ced713-e725-4ade-bd43-7b117090cda0 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:31.698070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b1ced713-e725-4ade-bd43-7b117090cda0 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:31.699441 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b1ced713-e725-4ade-bd43-7b117090cda0 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:31.700352 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b1ced713-e725-4ade-bd43-7b117090cda0 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:31.966757 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-55865215-6320-4ee9-b1da-0281f25ac09c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:31.986126 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-55865215-6320-4ee9-b1da-0281f25ac09c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab" status: 200 len: 1368 microversion: 2.1 time: 0.996548 Jul 25 14:46:32.002223 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2081/4405] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:30 2022] GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab => generated 1368 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:32.029140 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4eda0935-5c81-4d3a-9ea4-0c45cbe95425 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:32.034994 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4eda0935-5c81-4d3a-9ea4-0c45cbe95425 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] [instance: 86d15cd4-fd8d-43ac-a471-6c7c19f778f3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:32.066501 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4eda0935-5c81-4d3a-9ea4-0c45cbe95425 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:32.067714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4eda0935-5c81-4d3a-9ea4-0c45cbe95425 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:32.072014 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4eda0935-5c81-4d3a-9ea4-0c45cbe95425 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:32.074337 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4eda0935-5c81-4d3a-9ea4-0c45cbe95425 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:32.150155 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-4eda0935-5c81-4d3a-9ea4-0c45cbe95425 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] HTTP exception thrown: Instance 86d15cd4-fd8d-43ac-a471-6c7c19f778f3 could not be found. Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4eda0935-5c81-4d3a-9ea4-0c45cbe95425 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Request method failure captured: Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3 HTTP/1.1 Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3quERREaOs3Kc7iY1Vh9GKraPJ63kqwGO_-k7wXB_J3XVEfBf3LNTXeHb07R82UwUNgvRdojb21TsSuL636LebhCUID5TJuapIn-Sgeh4nT2_p48qkoLx6k1MrIDkEY7ueSXXEfRqNxtsyFtJzfjwKFOLGr5sudf0H8jELBV5u89FK0 Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b9b1c620d0b14a3a9471515cf47d6944"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b9b1c620d0b14a3a9471515cf47d6944", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b9b1c620d0b14a3a9471515cf47d6944"}]}] Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: b9b1c620d0b14a3a9471515cf47d6944 Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-DeleteServersTestJSON-2036259567 Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 33f992249063495c8bf12954afd9e8b7 Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-DeleteServersTestJSON-2036259567-project Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 86d15cd4-fd8d-43ac-a471-6c7c19f778f3 could not be found. Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '86d15cd4-fd8d-43ac-a471-6c7c19f778f3'} Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86d15cd4-fd8d-43ac-a471-6c7c19f778f3 could not be found. Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86d15cd4-fd8d-43ac-a471-6c7c19f778f3 could not be found. Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:46:32.158143 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:32.162364 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:46:32.162364 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:46:32.162364 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:46:32.162364 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:46:32.162364 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:46:32.162364 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86d15cd4-fd8d-43ac-a471-6c7c19f778f3 could not be found. Jul 25 14:46:32.162364 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:46:32.162364 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4eda0935-5c81-4d3a-9ea4-0c45cbe95425 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] Returning 404 to user: Instance 86d15cd4-fd8d-43ac-a471-6c7c19f778f3 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:46:32.167471 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4eda0935-5c81-4d3a-9ea4-0c45cbe95425 tempest-DeleteServersTestJSON-2036259567 tempest-DeleteServersTestJSON-2036259567-project] 10.222.0.88 "GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3" status: 404 len: 111 microversion: 2.1 time: 0.158449 Jul 25 14:46:32.168233 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2082/4406] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:32 2022] GET /compute/v2.1/servers/86d15cd4-fd8d-43ac-a471-6c7c19f778f3 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:46:32.303569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b1ced713-e725-4ade-bd43-7b117090cda0 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:32.312930 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b1ced713-e725-4ade-bd43-7b117090cda0 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1677 microversion: 2.1 time: 0.659244 Jul 25 14:46:32.318973 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2325/4407] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:31 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1677 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:32.325342 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cd63aed6-e543-48f3-ab54-9f0b45608f0f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:32.326547 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cd63aed6-e543-48f3-ab54-9f0b45608f0f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:32.341410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cd63aed6-e543-48f3-ab54-9f0b45608f0f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:32.341881 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cd63aed6-e543-48f3-ab54-9f0b45608f0f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:32.342688 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cd63aed6-e543-48f3-ab54-9f0b45608f0f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:32.350718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cd63aed6-e543-48f3-ab54-9f0b45608f0f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:32.666033 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8a442cc2-9d32-4e61-95be-3848f36f9475 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46873285e0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:32.769738 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8a442cc2-9d32-4e61-95be-3848f36f9475 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1412 microversion: 2.1 time: 0.111204 Jul 25 14:46:32.772829 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2326/4408] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:32 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1412 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:33.013450 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8bfc692b-c6b5-43a7-9a83-2c47349b3862 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:33.015373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8bfc692b-c6b5-43a7-9a83-2c47349b3862 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: f5e1c62b-88b7-4ec7-a2f3-b99b1566baab] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:33.052022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8bfc692b-c6b5-43a7-9a83-2c47349b3862 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:33.062443 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8bfc692b-c6b5-43a7-9a83-2c47349b3862 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:33.063747 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8bfc692b-c6b5-43a7-9a83-2c47349b3862 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:33.069176 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8bfc692b-c6b5-43a7-9a83-2c47349b3862 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:33.617422 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cd63aed6-e543-48f3-ab54-9f0b45608f0f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:33.627639 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cd63aed6-e543-48f3-ab54-9f0b45608f0f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:33.634099 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cd63aed6-e543-48f3-ab54-9f0b45608f0f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:33.639222 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cd63aed6-e543-48f3-ab54-9f0b45608f0f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1878 microversion: 2.32 time: 1.318871 Jul 25 14:46:33.644682 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2083/4409] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:46:32 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1878 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:46:34.121247 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-18731490-3bff-4a44-8e97-8e2532c5412f req-7573d8a4-55d0-4215-87fd-ee57f3986928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5e1c62b-88b7-4ec7-a2f3-b99b1566baab", "name": "network-vif-plugged", "status": "completed", "tag": "f26ef5c9-78ef-4d4e-ad54-598461e6e22e"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:46:34.158260 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-18731490-3bff-4a44-8e97-8e2532c5412f req-7573d8a4-55d0-4215-87fd-ee57f3986928 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:34.158704 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-18731490-3bff-4a44-8e97-8e2532c5412f req-7573d8a4-55d0-4215-87fd-ee57f3986928 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:34.193578 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-18731490-3bff-4a44-8e97-8e2532c5412f req-7573d8a4-55d0-4215-87fd-ee57f3986928 service nova] Creating event network-vif-plugged:f26ef5c9-78ef-4d4e-ad54-598461e6e22e for instance f5e1c62b-88b7-4ec7-a2f3-b99b1566baab on n-h2-846435-14 Jul 25 14:46:34.213873 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-18731490-3bff-4a44-8e97-8e2532c5412f req-7573d8a4-55d0-4215-87fd-ee57f3986928 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.567693 Jul 25 14:46:34.217749 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2084/4410] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:46:34.223752 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a24edc4a-061b-43b2-b531-90052aca4579 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:34.224519 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a24edc4a-061b-43b2-b531-90052aca4579 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:34.272500 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a24edc4a-061b-43b2-b531-90052aca4579 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:34.272965 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a24edc4a-061b-43b2-b531-90052aca4579 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:34.273781 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a24edc4a-061b-43b2-b531-90052aca4579 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:34.274216 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a24edc4a-061b-43b2-b531-90052aca4579 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:34.304325 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8bfc692b-c6b5-43a7-9a83-2c47349b3862 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:34.316455 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8bfc692b-c6b5-43a7-9a83-2c47349b3862 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab" status: 200 len: 1368 microversion: 2.1 time: 1.306605 Jul 25 14:46:34.319429 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2327/4411] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:33 2022] GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab => generated 1368 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:46:34.347025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6e30e1b9-2678-474b-b05e-80f7742e7907 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46988c5af0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:34.484838 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6e30e1b9-2678-474b-b05e-80f7742e7907 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1412 microversion: 2.1 time: 0.162062 Jul 25 14:46:34.488055 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2328/4412] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:34 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1412 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:34.671585 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-60a57885-e9f6-496f-961c-9dfdc04a9651 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:34.672672 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-60a57885-e9f6-496f-961c-9dfdc04a9651 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:34.686579 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60a57885-e9f6-496f-961c-9dfdc04a9651 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:34.687163 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60a57885-e9f6-496f-961c-9dfdc04a9651 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:34.687946 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60a57885-e9f6-496f-961c-9dfdc04a9651 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:34.688405 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60a57885-e9f6-496f-961c-9dfdc04a9651 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:34.748470 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:46:35.048318 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a24edc4a-061b-43b2-b531-90052aca4579 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:35.058245 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a24edc4a-061b-43b2-b531-90052aca4579 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1677 microversion: 2.1 time: 0.838929 Jul 25 14:46:35.059249 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2085/4413] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:34 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1677 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:35.339053 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-61a29d7b-e09f-4a4d-abb9-b7bc804c87d6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:35.339637 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-61a29d7b-e09f-4a4d-abb9-b7bc804c87d6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: f5e1c62b-88b7-4ec7-a2f3-b99b1566baab] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:35.352034 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-61a29d7b-e09f-4a4d-abb9-b7bc804c87d6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:35.354718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-61a29d7b-e09f-4a4d-abb9-b7bc804c87d6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:35.355851 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-61a29d7b-e09f-4a4d-abb9-b7bc804c87d6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:35.360809 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-61a29d7b-e09f-4a4d-abb9-b7bc804c87d6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:35.646368 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-60a57885-e9f6-496f-961c-9dfdc04a9651 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:35.665472 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-60a57885-e9f6-496f-961c-9dfdc04a9651 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:35.668016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-60a57885-e9f6-496f-961c-9dfdc04a9651 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:35.669861 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-60a57885-e9f6-496f-961c-9dfdc04a9651 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1878 microversion: 2.32 time: 1.003063 Jul 25 14:46:35.671204 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2329/4414] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:46:34 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1878 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:46:35.685627 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-61a29d7b-e09f-4a4d-abb9-b7bc804c87d6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:35.688111 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-be3568f8-e7df-4d3e-bc36-5e9dc70b7951 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f468758a430>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:35.693981 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-61a29d7b-e09f-4a4d-abb9-b7bc804c87d6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab" status: 200 len: 1368 microversion: 2.1 time: 0.358943 Jul 25 14:46:35.694575 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2086/4415] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:35 2022] GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab => generated 1368 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:46:35.756844 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-be3568f8-e7df-4d3e-bc36-5e9dc70b7951 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1412 microversion: 2.1 time: 0.081247 Jul 25 14:46:35.758766 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2330/4416] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:35 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1412 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:36.080870 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a6fbe4bd-971e-48fd-bc26-e708262cd51d tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:36.081503 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a6fbe4bd-971e-48fd-bc26-e708262cd51d tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:36.097228 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a6fbe4bd-971e-48fd-bc26-e708262cd51d tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:36.100481 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a6fbe4bd-971e-48fd-bc26-e708262cd51d tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:36.102069 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a6fbe4bd-971e-48fd-bc26-e708262cd51d tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:36.104506 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a6fbe4bd-971e-48fd-bc26-e708262cd51d tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:36.393117 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a6fbe4bd-971e-48fd-bc26-e708262cd51d tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:36.411422 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a6fbe4bd-971e-48fd-bc26-e708262cd51d tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1677 microversion: 2.1 time: 0.334585 Jul 25 14:46:36.453651 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2087/4417] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:36 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1677 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:36.698021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d93b2197-f52f-48d8-9ff5-5b4f48e82815 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:36.698675 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d93b2197-f52f-48d8-9ff5-5b4f48e82815 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:36.713311 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d93b2197-f52f-48d8-9ff5-5b4f48e82815 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:36.713926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d93b2197-f52f-48d8-9ff5-5b4f48e82815 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:36.714846 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d93b2197-f52f-48d8-9ff5-5b4f48e82815 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:36.715288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d93b2197-f52f-48d8-9ff5-5b4f48e82815 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:36.715660 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-68898d53-f139-4140-9649-0aa162167fab tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:36.716556 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-68898d53-f139-4140-9649-0aa162167fab tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: f5e1c62b-88b7-4ec7-a2f3-b99b1566baab] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:36.727078 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:46:36.738000 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-68898d53-f139-4140-9649-0aa162167fab tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:36.738745 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-68898d53-f139-4140-9649-0aa162167fab tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:36.739751 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-68898d53-f139-4140-9649-0aa162167fab tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:36.740385 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-68898d53-f139-4140-9649-0aa162167fab tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:36.993801 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-68898d53-f139-4140-9649-0aa162167fab tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:37.016775 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-68898d53-f139-4140-9649-0aa162167fab tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab" status: 200 len: 1558 microversion: 2.1 time: 0.305912 Jul 25 14:46:37.024195 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2088/4418] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:36 2022] GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab => generated 1558 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:46:37.024195 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ee3e4cc1-d19f-4629-8b81-8e0730009766 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46865ec430>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:37.170408 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ee3e4cc1-d19f-4629-8b81-8e0730009766 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1412 microversion: 2.1 time: 0.147351 Jul 25 14:46:37.172886 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2089/4419] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:37 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1412 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:37.189614 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cbfa95f7-2481-41b3-995d-6e29f8ff5054 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:37.195858 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cbfa95f7-2481-41b3-995d-6e29f8ff5054 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: f5e1c62b-88b7-4ec7-a2f3-b99b1566baab] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:37.212777 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cbfa95f7-2481-41b3-995d-6e29f8ff5054 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:37.213229 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cbfa95f7-2481-41b3-995d-6e29f8ff5054 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:37.214029 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cbfa95f7-2481-41b3-995d-6e29f8ff5054 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:37.219135 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cbfa95f7-2481-41b3-995d-6e29f8ff5054 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:37.315855 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d93b2197-f52f-48d8-9ff5-5b4f48e82815 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:37.329564 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d93b2197-f52f-48d8-9ff5-5b4f48e82815 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:37.334906 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d93b2197-f52f-48d8-9ff5-5b4f48e82815 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:37.339139 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d93b2197-f52f-48d8-9ff5-5b4f48e82815 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1878 microversion: 2.32 time: 0.648168 Jul 25 14:46:37.341084 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2331/4420] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:46:36 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1878 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:46:37.354628 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cbfa95f7-2481-41b3-995d-6e29f8ff5054 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.180777 Jul 25 14:46:37.355694 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2090/4421] 10.222.0.88 () {58 vars in 1275 bytes} [Mon Jul 25 14:46:37 2022] GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab/os-interface => generated 284 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:46:37.443152 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0f211a41-f187-4d24-8581-23d318cddf68 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:37.444197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0f211a41-f187-4d24-8581-23d318cddf68 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:37.458379 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0f211a41-f187-4d24-8581-23d318cddf68 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:37.459226 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0f211a41-f187-4d24-8581-23d318cddf68 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:37.460282 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0f211a41-f187-4d24-8581-23d318cddf68 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:37.460937 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0f211a41-f187-4d24-8581-23d318cddf68 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:37.714370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0f211a41-f187-4d24-8581-23d318cddf68 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:37.723277 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0f211a41-f187-4d24-8581-23d318cddf68 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1654 microversion: 2.1 time: 0.285080 Jul 25 14:46:37.723882 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2332/4422] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:37 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1654 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:37.748106 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4864343c-6fc4-40c0-9aad-396ba2781381 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:46:37.760768 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4864343c-6fc4-40c0-9aad-396ba2781381 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:37.763350 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4864343c-6fc4-40c0-9aad-396ba2781381 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:37.821997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4864343c-6fc4-40c0-9aad-396ba2781381 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Going to try to start instance {{(pid=119303) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 14:46:37.927735 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4864343c-6fc4-40c0-9aad-396ba2781381 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "POST /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850/action" status: 202 len: 0 microversion: 2.1 time: 0.183465 Jul 25 14:46:37.930584 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2091/4423] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:46:37 2022] POST /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:46:37.941354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d38df81d-fca4-4283-b3f4-bacad4860c9c tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:37.941986 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d38df81d-fca4-4283-b3f4-bacad4860c9c tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:37.952043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d38df81d-fca4-4283-b3f4-bacad4860c9c tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:37.954356 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d38df81d-fca4-4283-b3f4-bacad4860c9c tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:37.956894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d38df81d-fca4-4283-b3f4-bacad4860c9c tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:37.957542 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d38df81d-fca4-4283-b3f4-bacad4860c9c tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:38.188845 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4242a0d8-7022-4b3a-a7f9-0b76ee251d9e tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46866dec10>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:38.270244 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4242a0d8-7022-4b3a-a7f9-0b76ee251d9e tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1412 microversion: 2.1 time: 0.086794 Jul 25 14:46:38.278151 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2092/4424] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:38 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1412 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:46:38.371809 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-de4c0beb-d493-4dcb-aeef-c8e9cc846506 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:38.372842 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-de4c0beb-d493-4dcb-aeef-c8e9cc846506 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:38.399689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-de4c0beb-d493-4dcb-aeef-c8e9cc846506 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:38.400479 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-de4c0beb-d493-4dcb-aeef-c8e9cc846506 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:38.405202 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-de4c0beb-d493-4dcb-aeef-c8e9cc846506 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:38.406088 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-de4c0beb-d493-4dcb-aeef-c8e9cc846506 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:38.908913 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d38df81d-fca4-4283-b3f4-bacad4860c9c tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:38.935379 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d38df81d-fca4-4283-b3f4-bacad4860c9c tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1663 microversion: 2.1 time: 1.001980 Jul 25 14:46:38.959249 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2333/4425] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:37 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1663 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:39.289159 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ab5ce54a-2a2f-4ca3-a894-fd035c726910 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f4687328e50>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:39.375170 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ab5ce54a-2a2f-4ca3-a894-fd035c726910 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1412 microversion: 2.1 time: 0.092945 Jul 25 14:46:39.375960 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2334/4426] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:39 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1412 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:39.967193 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7e3bfa88-a3ef-40b4-bbf8-89c84efd30e1 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:39.968794 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7e3bfa88-a3ef-40b4-bbf8-89c84efd30e1 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:39.988181 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7e3bfa88-a3ef-40b4-bbf8-89c84efd30e1 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:39.996553 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7e3bfa88-a3ef-40b4-bbf8-89c84efd30e1 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:39.999086 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7e3bfa88-a3ef-40b4-bbf8-89c84efd30e1 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:40.003704 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7e3bfa88-a3ef-40b4-bbf8-89c84efd30e1 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:40.034030 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-de4c0beb-d493-4dcb-aeef-c8e9cc846506 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:40.055403 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-de4c0beb-d493-4dcb-aeef-c8e9cc846506 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:40.064049 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-de4c0beb-d493-4dcb-aeef-c8e9cc846506 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:40.070885 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-de4c0beb-d493-4dcb-aeef-c8e9cc846506 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1878 microversion: 2.32 time: 1.705252 Jul 25 14:46:40.091900 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2093/4427] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:46:38 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1878 bytes in 1727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:46:40.391280 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c825e234-15b7-45bf-aa84-5cde3538315f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46865f0ee0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:40.457611 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c825e234-15b7-45bf-aa84-5cde3538315f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1412 microversion: 2.1 time: 0.070199 Jul 25 14:46:40.459406 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2094/4428] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:40 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1412 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:46:40.729480 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7e3bfa88-a3ef-40b4-bbf8-89c84efd30e1 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:40.739882 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7e3bfa88-a3ef-40b4-bbf8-89c84efd30e1 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1663 microversion: 2.1 time: 0.780762 Jul 25 14:46:40.764267 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2335/4429] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:39 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1663 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:41.101179 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0c178178-80df-4acf-ae89-90ec02ab1445 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:41.101790 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0c178178-80df-4acf-ae89-90ec02ab1445 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:41.113056 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0c178178-80df-4acf-ae89-90ec02ab1445 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:41.119727 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0c178178-80df-4acf-ae89-90ec02ab1445 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:41.123608 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0c178178-80df-4acf-ae89-90ec02ab1445 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:41.124351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0c178178-80df-4acf-ae89-90ec02ab1445 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:41.476420 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-56fa802d-2ec6-4363-bce0-bb1ad104b014 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f4687389550>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:41.590097 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-56fa802d-2ec6-4363-bce0-bb1ad104b014 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1412 microversion: 2.1 time: 0.120237 Jul 25 14:46:41.591323 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2336/4430] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:41 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1412 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:41.773105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d0a9cda4-8dfd-472e-9b9f-7c0e444cf4ca tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:41.773741 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d0a9cda4-8dfd-472e-9b9f-7c0e444cf4ca tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:41.785746 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d0a9cda4-8dfd-472e-9b9f-7c0e444cf4ca tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:41.786668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d0a9cda4-8dfd-472e-9b9f-7c0e444cf4ca tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:41.787651 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d0a9cda4-8dfd-472e-9b9f-7c0e444cf4ca tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:41.788268 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d0a9cda4-8dfd-472e-9b9f-7c0e444cf4ca tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:41.963622 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0c178178-80df-4acf-ae89-90ec02ab1445 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:41.983776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0c178178-80df-4acf-ae89-90ec02ab1445 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:41.985553 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0c178178-80df-4acf-ae89-90ec02ab1445 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:41.986825 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0c178178-80df-4acf-ae89-90ec02ab1445 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1878 microversion: 2.32 time: 0.890710 Jul 25 14:46:41.987724 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2095/4431] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:46:41 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1878 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:46:42.179019 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d0a9cda4-8dfd-472e-9b9f-7c0e444cf4ca tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:42.193947 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d0a9cda4-8dfd-472e-9b9f-7c0e444cf4ca tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1667 microversion: 2.1 time: 0.427014 Jul 25 14:46:42.194795 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-d6c6834c-607a-46e7-af98-e3b058d833c9 req-34c51963-94e9-4467-92e7-1d9e1dc96528 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5e1c62b-88b7-4ec7-a2f3-b99b1566baab", "tag": "f26ef5c9-78ef-4d4e-ad54-598461e6e22e"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:46:42.198687 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2337/4432] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:41 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1667 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:42.223843 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-d6c6834c-607a-46e7-af98-e3b058d833c9 req-34c51963-94e9-4467-92e7-1d9e1dc96528 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:42.224349 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-d6c6834c-607a-46e7-af98-e3b058d833c9 req-34c51963-94e9-4467-92e7-1d9e1dc96528 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:42.611101 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2d3d7936-7e59-4e3e-8fe9-0480aef8368f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f4687389c10>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:42.700320 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2d3d7936-7e59-4e3e-8fe9-0480aef8368f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1412 microversion: 2.1 time: 0.097327 Jul 25 14:46:42.701296 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2338/4433] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:42 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1412 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:46:42.835501 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-d6c6834c-607a-46e7-af98-e3b058d833c9 req-34c51963-94e9-4467-92e7-1d9e1dc96528 service nova] Creating event network-changed:f26ef5c9-78ef-4d4e-ad54-598461e6e22e for instance f5e1c62b-88b7-4ec7-a2f3-b99b1566baab on n-h2-846435-14 Jul 25 14:46:42.849914 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-d6c6834c-607a-46e7-af98-e3b058d833c9 req-34c51963-94e9-4467-92e7-1d9e1dc96528 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.659447 Jul 25 14:46:42.850889 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2096/4434] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:46:43.016923 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-739a42e0-94b9-4316-bfb0-c07d3c2b2a62 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:43.017492 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-739a42e0-94b9-4316-bfb0-c07d3c2b2a62 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:43.040030 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-739a42e0-94b9-4316-bfb0-c07d3c2b2a62 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:43.040544 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-739a42e0-94b9-4316-bfb0-c07d3c2b2a62 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:43.042801 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-739a42e0-94b9-4316-bfb0-c07d3c2b2a62 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:43.044762 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-739a42e0-94b9-4316-bfb0-c07d3c2b2a62 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:43.723108 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fd829722-9905-4934-b377-89d75ec85cc6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f4686608e50>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:43.828192 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fd829722-9905-4934-b377-89d75ec85cc6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1412 microversion: 2.1 time: 0.112706 Jul 25 14:46:43.828833 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2097/4435] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:43 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1412 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:44.101913 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-739a42e0-94b9-4316-bfb0-c07d3c2b2a62 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:44.120240 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-739a42e0-94b9-4316-bfb0-c07d3c2b2a62 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:44.132271 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-739a42e0-94b9-4316-bfb0-c07d3c2b2a62 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:44.142751 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-739a42e0-94b9-4316-bfb0-c07d3c2b2a62 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1878 microversion: 2.32 time: 1.125298 Jul 25 14:46:44.160404 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2339/4436] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:46:43 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1878 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:46:44.845171 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-087c05fb-3fee-4572-88eb-c3041034f693 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46866719d0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:44.933722 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-087c05fb-3fee-4572-88eb-c3041034f693 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1412 microversion: 2.1 time: 0.093620 Jul 25 14:46:44.934875 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2098/4437] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:44 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1412 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:45.184590 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b97ebc85-26fe-42ad-beff-8a69fd124989 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:45.185734 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b97ebc85-26fe-42ad-beff-8a69fd124989 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:45.207462 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b97ebc85-26fe-42ad-beff-8a69fd124989 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:45.208468 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b97ebc85-26fe-42ad-beff-8a69fd124989 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:45.213323 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b97ebc85-26fe-42ad-beff-8a69fd124989 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:45.214012 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b97ebc85-26fe-42ad-beff-8a69fd124989 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:45.735620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b97ebc85-26fe-42ad-beff-8a69fd124989 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:45.749502 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b97ebc85-26fe-42ad-beff-8a69fd124989 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:45.763940 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b97ebc85-26fe-42ad-beff-8a69fd124989 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:45.772257 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b97ebc85-26fe-42ad-beff-8a69fd124989 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1878 microversion: 2.32 time: 0.591098 Jul 25 14:46:45.788068 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2340/4438] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:46:45 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1878 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:46:45.951677 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dec4189d-11cf-4ed2-9168-1ec43cc85afd tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f4686632a60>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:46.018333 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dec4189d-11cf-4ed2-9168-1ec43cc85afd tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1412 microversion: 2.1 time: 0.072503 Jul 25 14:46:46.019603 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2099/4439] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:45 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1412 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:46.800310 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f7226c5f-0df3-479f-83b7-56e0d823a0b3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:46.801252 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f7226c5f-0df3-479f-83b7-56e0d823a0b3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:46.815711 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f7226c5f-0df3-479f-83b7-56e0d823a0b3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:46.817180 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f7226c5f-0df3-479f-83b7-56e0d823a0b3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:46.821028 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f7226c5f-0df3-479f-83b7-56e0d823a0b3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:46.823343 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f7226c5f-0df3-479f-83b7-56e0d823a0b3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:47.033997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-df27d734-9318-497a-8ab5-25f93826d9f8 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f4687cb79d0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:47.129564 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-df27d734-9318-497a-8ab5-25f93826d9f8 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1412 microversion: 2.1 time: 0.099550 Jul 25 14:46:47.147610 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2100/4440] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:47 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1412 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:47.269065 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f7226c5f-0df3-479f-83b7-56e0d823a0b3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:47.291803 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f7226c5f-0df3-479f-83b7-56e0d823a0b3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:47.293798 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f7226c5f-0df3-479f-83b7-56e0d823a0b3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:47.297457 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f7226c5f-0df3-479f-83b7-56e0d823a0b3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1878 microversion: 2.32 time: 0.503961 Jul 25 14:46:47.300785 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2341/4441] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:46:46 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1878 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:46:48.165136 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-21cd1a11-a64f-47a2-913b-e5b6e9215ae1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f4686632700>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:48.243875 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-21cd1a11-a64f-47a2-913b-e5b6e9215ae1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1412 microversion: 2.1 time: 0.090733 Jul 25 14:46:48.245187 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2101/4442] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:48 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1412 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:48.328893 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0f91c0e5-42b3-4d90-90a5-e0c561e37c84 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:48.330684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0f91c0e5-42b3-4d90-90a5-e0c561e37c84 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:48.340949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0f91c0e5-42b3-4d90-90a5-e0c561e37c84 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:48.341376 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0f91c0e5-42b3-4d90-90a5-e0c561e37c84 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:48.348389 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0f91c0e5-42b3-4d90-90a5-e0c561e37c84 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:48.349796 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0f91c0e5-42b3-4d90-90a5-e0c561e37c84 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:48.767470 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0f91c0e5-42b3-4d90-90a5-e0c561e37c84 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:48.796305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0f91c0e5-42b3-4d90-90a5-e0c561e37c84 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:48.796305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0f91c0e5-42b3-4d90-90a5-e0c561e37c84 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:48.813950 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0f91c0e5-42b3-4d90-90a5-e0c561e37c84 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1878 microversion: 2.32 time: 0.490784 Jul 25 14:46:48.814583 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2342/4443] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:46:48 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1878 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:46:49.259538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a66197dd-b04f-43b1-a53c-d57482598301 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f4686671310>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:49.342301 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a66197dd-b04f-43b1-a53c-d57482598301 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1412 microversion: 2.1 time: 0.086872 Jul 25 14:46:49.343327 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2102/4444] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:49 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1412 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:49.850070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e47293fd-a875-4e47-b5af-1e67a102c919 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:49.851405 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e47293fd-a875-4e47-b5af-1e67a102c919 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:49.874576 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e47293fd-a875-4e47-b5af-1e67a102c919 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:49.877276 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e47293fd-a875-4e47-b5af-1e67a102c919 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:49.879146 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e47293fd-a875-4e47-b5af-1e67a102c919 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:49.880000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e47293fd-a875-4e47-b5af-1e67a102c919 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:50.359266 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-28a15299-d7b1-41de-bf9a-47f79b74c773 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f4686608310>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:50.378957 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e47293fd-a875-4e47-b5af-1e67a102c919 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:50.394154 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e47293fd-a875-4e47-b5af-1e67a102c919 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:50.395669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e47293fd-a875-4e47-b5af-1e67a102c919 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:50.404485 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e47293fd-a875-4e47-b5af-1e67a102c919 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1878 microversion: 2.32 time: 0.565598 Jul 25 14:46:50.407125 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2343/4445] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:46:49 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1878 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:46:50.459184 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-28a15299-d7b1-41de-bf9a-47f79b74c773 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1421 microversion: 2.1 time: 0.104736 Jul 25 14:46:50.460507 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2103/4446] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:50 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1421 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:50.478360 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0969e9b2-5cb0-4f98-9044-44f2cc9d49bc tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46864ec040>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:50.560070 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0969e9b2-5cb0-4f98-9044-44f2cc9d49bc tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 200 len: 1421 microversion: 2.1 time: 0.086319 Jul 25 14:46:50.562600 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2344/4447] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:46:50 2022] GET /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 1421 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:50.593948 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5a092e4f-413a-4c1b-b145-3596326e2dc3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46865f0160>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:51.454186 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-acc2af3e-b5c0-4dc4-a495-0436b5ab65bd tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:51.454809 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-acc2af3e-b5c0-4dc4-a495-0436b5ab65bd tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:51.472505 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-acc2af3e-b5c0-4dc4-a495-0436b5ab65bd tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:51.472971 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-acc2af3e-b5c0-4dc4-a495-0436b5ab65bd tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:51.476477 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-acc2af3e-b5c0-4dc4-a495-0436b5ab65bd tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:51.478331 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-acc2af3e-b5c0-4dc4-a495-0436b5ab65bd tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:51.808330 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5a092e4f-413a-4c1b-b145-3596326e2dc3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "DELETE /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 204 len: 0 microversion: 2.1 time: 1.220019 Jul 25 14:46:51.809143 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2104/4448] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:50 2022] DELETE /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 0 bytes in 1234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:46:51.818078 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fdc0aa7b-960c-4c77-9ce0-3fb173bbb4c9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:51.818861 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fdc0aa7b-960c-4c77-9ce0-3fb173bbb4c9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 704739ea-1723-4329-9079-fb1fe74df834] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:51.839759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fdc0aa7b-960c-4c77-9ce0-3fb173bbb4c9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:51.840229 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fdc0aa7b-960c-4c77-9ce0-3fb173bbb4c9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:51.841012 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fdc0aa7b-960c-4c77-9ce0-3fb173bbb4c9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:51.841449 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fdc0aa7b-960c-4c77-9ce0-3fb173bbb4c9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:51.962775 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fdc0aa7b-960c-4c77-9ce0-3fb173bbb4c9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 704739ea-1723-4329-9079-fb1fe74df834] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:46:52.085627 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-acc2af3e-b5c0-4dc4-a495-0436b5ab65bd tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:52.107301 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-acc2af3e-b5c0-4dc4-a495-0436b5ab65bd tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:52.113397 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-acc2af3e-b5c0-4dc4-a495-0436b5ab65bd tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:52.126432 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-acc2af3e-b5c0-4dc4-a495-0436b5ab65bd tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1878 microversion: 2.32 time: 0.695612 Jul 25 14:46:52.127079 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2345/4449] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:46:51 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1878 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:46:52.146818 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:46:52.280530 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fdc0aa7b-960c-4c77-9ce0-3fb173bbb4c9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "DELETE /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834" status: 204 len: 0 microversion: 2.1 time: 0.466621 Jul 25 14:46:52.283322 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2105/4450] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:46:51 2022] DELETE /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:46:52.450270 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a5ff802a-4882-4054-9910-c806e5386fae tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2015027926", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "87cfcadc-6ea1-4167-a535-aad1c1b10077"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:46:52.476292 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=44 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:46:52.565346 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-a5ff802a-4882-4054-9910-c806e5386fae tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] validate_networks() for [('87cfcadc-6ea1-4167-a535-aad1c1b10077', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:46:53.158716 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c0ac8110-20e3-46ac-974b-037b016d08b5 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:53.160132 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c0ac8110-20e3-46ac-974b-037b016d08b5 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:53.178915 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c0ac8110-20e3-46ac-974b-037b016d08b5 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:53.179638 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c0ac8110-20e3-46ac-974b-037b016d08b5 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:53.180772 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c0ac8110-20e3-46ac-974b-037b016d08b5 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:53.181387 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c0ac8110-20e3-46ac-974b-037b016d08b5 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:53.598935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c0ac8110-20e3-46ac-974b-037b016d08b5 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:53.613982 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c0ac8110-20e3-46ac-974b-037b016d08b5 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:53.617769 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c0ac8110-20e3-46ac-974b-037b016d08b5 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:53.620798 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c0ac8110-20e3-46ac-974b-037b016d08b5 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1878 microversion: 2.32 time: 0.469902 Jul 25 14:46:53.627688 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2106/4451] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:46:53 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1878 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:46:54.288408 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-ecaa0bfb-000b-4058-a840-3f218ed3d3d9 req-296c5733-b4ac-40d2-8ec9-4b219e641017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50f3696b-0e20-4fc7-9bd0-3955357f2b09", "name": "network-vif-plugged", "status": "completed", "tag": "8e48e753-58f9-4d03-a879-346119141e40"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:46:54.312929 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ecaa0bfb-000b-4058-a840-3f218ed3d3d9 req-296c5733-b4ac-40d2-8ec9-4b219e641017 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:54.313385 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ecaa0bfb-000b-4058-a840-3f218ed3d3d9 req-296c5733-b4ac-40d2-8ec9-4b219e641017 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:54.357404 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-ecaa0bfb-000b-4058-a840-3f218ed3d3d9 req-296c5733-b4ac-40d2-8ec9-4b219e641017 service nova] Creating event network-vif-plugged:8e48e753-58f9-4d03-a879-346119141e40 for instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 on n-h1-846435-14 Jul 25 14:46:54.395144 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-ecaa0bfb-000b-4058-a840-3f218ed3d3d9 req-296c5733-b4ac-40d2-8ec9-4b219e641017 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110806 Jul 25 14:46:54.401600 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2107/4452] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:46:54.481700 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-a5ff802a-4882-4054-9910-c806e5386fae tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:46:54.482897 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-a5ff802a-4882-4054-9910-c806e5386fae tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:46:54.483760 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-a5ff802a-4882-4054-9910-c806e5386fae tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:46:54.484646 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-a5ff802a-4882-4054-9910-c806e5386fae tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:46:54.485727 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-a5ff802a-4882-4054-9910-c806e5386fae tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:46:54.509919 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5ff802a-4882-4054-9910-c806e5386fae tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:54.510817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5ff802a-4882-4054-9910-c806e5386fae tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:54.511901 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5ff802a-4882-4054-9910-c806e5386fae tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:54.512632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5ff802a-4882-4054-9910-c806e5386fae tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:54.556649 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-a5ff802a-4882-4054-9910-c806e5386fae tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Getting quotas for project 87b0942d86634ed0a2f89a0001b5a887. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:46:54.574722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-a5ff802a-4882-4054-9910-c806e5386fae tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Getting quotas for user 6e3de16106b3455b85f90dcd94d39ce0 and project 87b0942d86634ed0a2f89a0001b5a887. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:46:54.599070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a5ff802a-4882-4054-9910-c806e5386fae tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:46:54.603844 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a5ff802a-4882-4054-9910-c806e5386fae tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:46:54.662081 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-52eefd4c-c98f-4bcb-8ef3-cb0752936b65 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:54.662907 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-52eefd4c-c98f-4bcb-8ef3-cb0752936b65 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:54.687530 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-52eefd4c-c98f-4bcb-8ef3-cb0752936b65 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:54.688036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-52eefd4c-c98f-4bcb-8ef3-cb0752936b65 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:54.689948 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-52eefd4c-c98f-4bcb-8ef3-cb0752936b65 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:54.690410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-52eefd4c-c98f-4bcb-8ef3-cb0752936b65 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:54.699710 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a5ff802a-4882-4054-9910-c806e5386fae tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.256669 Jul 25 14:46:54.701417 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2346/4453] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:46:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:46:54.725576 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0efbdb03-716d-4a74-b7f0-5b36f45d6021 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:54.728724 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0efbdb03-716d-4a74-b7f0-5b36f45d6021 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:55.061438 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0efbdb03-716d-4a74-b7f0-5b36f45d6021 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:55.072502 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0efbdb03-716d-4a74-b7f0-5b36f45d6021 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1208 microversion: 2.1 time: 0.360473 Jul 25 14:46:55.074763 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2347/4454] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:54 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1208 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:55.264138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-52eefd4c-c98f-4bcb-8ef3-cb0752936b65 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:55.281916 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-52eefd4c-c98f-4bcb-8ef3-cb0752936b65 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:55.290775 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-52eefd4c-c98f-4bcb-8ef3-cb0752936b65 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:55.293879 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-52eefd4c-c98f-4bcb-8ef3-cb0752936b65 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1878 microversion: 2.32 time: 0.642653 Jul 25 14:46:55.294815 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2108/4455] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:46:54 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1878 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:46:55.890045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-666184e6-6379-4b98-b58f-c9fbaea4938f req-0fa553e0-f1e5-48c3-a0cd-947c8bbdfd5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "704739ea-1723-4329-9079-fb1fe74df834", "name": "network-vif-deleted", "tag": "8881ca7e-189b-4847-bbfd-77c36558c743"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:46:55.920510 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-666184e6-6379-4b98-b58f-c9fbaea4938f req-0fa553e0-f1e5-48c3-a0cd-947c8bbdfd5f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:55.921251 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-666184e6-6379-4b98-b58f-c9fbaea4938f req-0fa553e0-f1e5-48c3-a0cd-947c8bbdfd5f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:55.941930 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-666184e6-6379-4b98-b58f-c9fbaea4938f req-0fa553e0-f1e5-48c3-a0cd-947c8bbdfd5f service nova] Creating event network-vif-deleted:8881ca7e-189b-4847-bbfd-77c36558c743 for instance 704739ea-1723-4329-9079-fb1fe74df834 on n-h2-846435-14 Jul 25 14:46:55.969095 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-666184e6-6379-4b98-b58f-c9fbaea4938f req-0fa553e0-f1e5-48c3-a0cd-947c8bbdfd5f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094203 Jul 25 14:46:55.981780 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2348/4456] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:46:56.095306 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d8aa2eea-1809-4e96-a93c-68e9741bac61 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:56.095943 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d8aa2eea-1809-4e96-a93c-68e9741bac61 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:56.118629 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8aa2eea-1809-4e96-a93c-68e9741bac61 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:56.121501 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8aa2eea-1809-4e96-a93c-68e9741bac61 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:56.124834 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8aa2eea-1809-4e96-a93c-68e9741bac61 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:56.125315 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8aa2eea-1809-4e96-a93c-68e9741bac61 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:56.257532 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d8aa2eea-1809-4e96-a93c-68e9741bac61 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:56.270051 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d8aa2eea-1809-4e96-a93c-68e9741bac61 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1260 microversion: 2.1 time: 0.178328 Jul 25 14:46:56.285665 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2109/4457] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:56 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:56.321684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0a1690ff-894c-4dcd-8300-9c6435f86e84 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:56.323069 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0a1690ff-894c-4dcd-8300-9c6435f86e84 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:56.333637 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0a1690ff-894c-4dcd-8300-9c6435f86e84 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:56.341818 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0a1690ff-894c-4dcd-8300-9c6435f86e84 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:56.343054 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0a1690ff-894c-4dcd-8300-9c6435f86e84 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:56.344575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0a1690ff-894c-4dcd-8300-9c6435f86e84 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:56.568122 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-c11a6d14-9f77-4c6a-8731-f34a70d95949 req-64b35955-d010-4ce7-bd0f-ea6554f6c71a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "704739ea-1723-4329-9079-fb1fe74df834", "name": "network-vif-unplugged", "status": "completed", "tag": "8881ca7e-189b-4847-bbfd-77c36558c743"}, {"server_uuid": "50f3696b-0e20-4fc7-9bd0-3955357f2b09", "name": "network-vif-plugged", "status": "completed", "tag": "53062311-961a-458b-9f1e-309c2f468465"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:46:56.595710 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c11a6d14-9f77-4c6a-8731-f34a70d95949 req-64b35955-d010-4ce7-bd0f-ea6554f6c71a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:56.597055 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c11a6d14-9f77-4c6a-8731-f34a70d95949 req-64b35955-d010-4ce7-bd0f-ea6554f6c71a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:56.645175 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-c11a6d14-9f77-4c6a-8731-f34a70d95949 req-64b35955-d010-4ce7-bd0f-ea6554f6c71a service nova] Creating event network-vif-unplugged:8881ca7e-189b-4847-bbfd-77c36558c743 for instance 704739ea-1723-4329-9079-fb1fe74df834 on n-h2-846435-14 Jul 25 14:46:56.645608 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-c11a6d14-9f77-4c6a-8731-f34a70d95949 req-64b35955-d010-4ce7-bd0f-ea6554f6c71a service nova] Creating event network-vif-plugged:53062311-961a-458b-9f1e-309c2f468465 for instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 on n-h1-846435-14 Jul 25 14:46:56.673451 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-c11a6d14-9f77-4c6a-8731-f34a70d95949 req-64b35955-d010-4ce7-bd0f-ea6554f6c71a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.109697 Jul 25 14:46:56.687388 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2110/4458] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:46:57.133935 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0a1690ff-894c-4dcd-8300-9c6435f86e84 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:57.175271 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0a1690ff-894c-4dcd-8300-9c6435f86e84 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:57.181376 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0a1690ff-894c-4dcd-8300-9c6435f86e84 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:57.189562 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0a1690ff-894c-4dcd-8300-9c6435f86e84 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1878 microversion: 2.32 time: 0.870391 Jul 25 14:46:57.207402 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2349/4459] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:46:56 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1878 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:46:57.307398 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7297f061-83c6-45b4-a896-93f49c528d18 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:57.309369 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7297f061-83c6-45b4-a896-93f49c528d18 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:57.332193 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7297f061-83c6-45b4-a896-93f49c528d18 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:57.333139 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7297f061-83c6-45b4-a896-93f49c528d18 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:57.336103 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7297f061-83c6-45b4-a896-93f49c528d18 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:57.339479 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7297f061-83c6-45b4-a896-93f49c528d18 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:57.504599 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7297f061-83c6-45b4-a896-93f49c528d18 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:57.513574 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7297f061-83c6-45b4-a896-93f49c528d18 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1266 microversion: 2.1 time: 0.219006 Jul 25 14:46:57.528120 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2111/4460] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:57 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:46:58.229942 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9e4418dd-adda-480d-82f1-79e223110e35 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:58.231514 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9e4418dd-adda-480d-82f1-79e223110e35 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:58.246759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9e4418dd-adda-480d-82f1-79e223110e35 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:58.247503 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9e4418dd-adda-480d-82f1-79e223110e35 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:58.248487 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9e4418dd-adda-480d-82f1-79e223110e35 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:58.249105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9e4418dd-adda-480d-82f1-79e223110e35 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:58.536229 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-388dd007-5667-42ff-a887-c949219baa39 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:58.537369 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-388dd007-5667-42ff-a887-c949219baa39 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:58.555317 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-388dd007-5667-42ff-a887-c949219baa39 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:58.557036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-388dd007-5667-42ff-a887-c949219baa39 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:58.557754 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-388dd007-5667-42ff-a887-c949219baa39 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:58.558207 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-388dd007-5667-42ff-a887-c949219baa39 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:58.710368 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9e4418dd-adda-480d-82f1-79e223110e35 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:58.747329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9e4418dd-adda-480d-82f1-79e223110e35 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:58.755048 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9e4418dd-adda-480d-82f1-79e223110e35 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:58.767442 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9e4418dd-adda-480d-82f1-79e223110e35 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1878 microversion: 2.32 time: 0.537398 Jul 25 14:46:58.781686 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2350/4461] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:46:58 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1878 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:46:58.856430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-84434ac4-9923-4805-b6e4-3d3b3fa1b292 req-ba81ce68-c7dd-4cc1-9721-aedd799e9f46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50f3696b-0e20-4fc7-9bd0-3955357f2b09", "name": "network-vif-plugged", "status": "completed", "tag": "c5db5903-5da6-4605-aa52-b7940c46fb11"}, {"server_uuid": "50f3696b-0e20-4fc7-9bd0-3955357f2b09", "name": "network-vif-plugged", "status": "completed", "tag": "6df9765b-58b3-4c20-a093-554ec5221862"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:46:58.884042 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-84434ac4-9923-4805-b6e4-3d3b3fa1b292 req-ba81ce68-c7dd-4cc1-9721-aedd799e9f46 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:58.890688 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-84434ac4-9923-4805-b6e4-3d3b3fa1b292 req-ba81ce68-c7dd-4cc1-9721-aedd799e9f46 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:58.949188 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-84434ac4-9923-4805-b6e4-3d3b3fa1b292 req-ba81ce68-c7dd-4cc1-9721-aedd799e9f46 service nova] Creating event network-vif-plugged:c5db5903-5da6-4605-aa52-b7940c46fb11 for instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 on n-h1-846435-14 Jul 25 14:46:58.951719 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-84434ac4-9923-4805-b6e4-3d3b3fa1b292 req-ba81ce68-c7dd-4cc1-9721-aedd799e9f46 service nova] Creating event network-vif-plugged:6df9765b-58b3-4c20-a093-554ec5221862 for instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 on n-h1-846435-14 Jul 25 14:46:58.968494 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-84434ac4-9923-4805-b6e4-3d3b3fa1b292 req-ba81ce68-c7dd-4cc1-9721-aedd799e9f46 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.118988 Jul 25 14:46:58.984370 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2351/4462] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:46:59.621212 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-388dd007-5667-42ff-a887-c949219baa39 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:46:59.631943 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-388dd007-5667-42ff-a887-c949219baa39 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1308 microversion: 2.1 time: 1.100633 Jul 25 14:46:59.632575 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2112/4463] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:46:58 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1308 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:46:59.808800 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b01ecb89-278a-4c53-bbe7-18bd0e5c0b5f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:46:59.809748 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b01ecb89-278a-4c53-bbe7-18bd0e5c0b5f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:46:59.851804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b01ecb89-278a-4c53-bbe7-18bd0e5c0b5f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:59.854014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b01ecb89-278a-4c53-bbe7-18bd0e5c0b5f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:46:59.856248 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b01ecb89-278a-4c53-bbe7-18bd0e5c0b5f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:46:59.861895 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b01ecb89-278a-4c53-bbe7-18bd0e5c0b5f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:00.653531 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b2f9d558-3af3-4081-9e9d-d0fca7e0feb2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:00.654375 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b2f9d558-3af3-4081-9e9d-d0fca7e0feb2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:00.678836 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b2f9d558-3af3-4081-9e9d-d0fca7e0feb2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:00.679307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b2f9d558-3af3-4081-9e9d-d0fca7e0feb2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:00.695043 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b2f9d558-3af3-4081-9e9d-d0fca7e0feb2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:00.695685 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b2f9d558-3af3-4081-9e9d-d0fca7e0feb2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:00.811035 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b01ecb89-278a-4c53-bbe7-18bd0e5c0b5f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:00.842006 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b01ecb89-278a-4c53-bbe7-18bd0e5c0b5f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:00.850205 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b01ecb89-278a-4c53-bbe7-18bd0e5c0b5f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:00.855123 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b01ecb89-278a-4c53-bbe7-18bd0e5c0b5f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1878 microversion: 2.32 time: 1.050386 Jul 25 14:47:00.868010 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2352/4464] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:46:59 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1878 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:47:01.054370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-d9248340-5f4c-41f0-81bd-b8116b158c8a req-bcee3130-baa5-47ec-84a3-5968422602a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50f3696b-0e20-4fc7-9bd0-3955357f2b09", "name": "network-vif-plugged", "status": "completed", "tag": "ee179acc-1c8f-4d3d-b7a4-b3147e289771"}, {"server_uuid": "50f3696b-0e20-4fc7-9bd0-3955357f2b09", "name": "network-vif-plugged", "status": "completed", "tag": "4bc5802b-3581-47f4-b3fd-3ec9db912406"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:47:01.087875 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-d9248340-5f4c-41f0-81bd-b8116b158c8a req-bcee3130-baa5-47ec-84a3-5968422602a1 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:01.092716 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-d9248340-5f4c-41f0-81bd-b8116b158c8a req-bcee3130-baa5-47ec-84a3-5968422602a1 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:01.130129 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-d9248340-5f4c-41f0-81bd-b8116b158c8a req-bcee3130-baa5-47ec-84a3-5968422602a1 service nova] Creating event network-vif-plugged:ee179acc-1c8f-4d3d-b7a4-b3147e289771 for instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 on n-h1-846435-14 Jul 25 14:47:01.132256 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-d9248340-5f4c-41f0-81bd-b8116b158c8a req-bcee3130-baa5-47ec-84a3-5968422602a1 service nova] Creating event network-vif-plugged:4bc5802b-3581-47f4-b3fd-3ec9db912406 for instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 on n-h1-846435-14 Jul 25 14:47:01.146935 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-d9248340-5f4c-41f0-81bd-b8116b158c8a req-bcee3130-baa5-47ec-84a3-5968422602a1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.102091 Jul 25 14:47:01.149277 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2353/4465] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:47:01.296003 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b2f9d558-3af3-4081-9e9d-d0fca7e0feb2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:01.309851 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b2f9d558-3af3-4081-9e9d-d0fca7e0feb2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1308 microversion: 2.1 time: 0.660398 Jul 25 14:47:01.310812 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2113/4466] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:00 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1308 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:01.719194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-f5b3377f-713f-4058-80f4-ef73238ff9ce req-1e7d5eef-d41e-40bf-8728-56095d7bf0bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdf119f5-416e-456f-86d6-8acff67d7c9b", "tag": "94e2f165-153f-4c22-881e-01b36ec8ec5d"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:47:01.813770 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-f5b3377f-713f-4058-80f4-ef73238ff9ce req-1e7d5eef-d41e-40bf-8728-56095d7bf0bb service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:01.820339 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-f5b3377f-713f-4058-80f4-ef73238ff9ce req-1e7d5eef-d41e-40bf-8728-56095d7bf0bb service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:01.872767 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-f5b3377f-713f-4058-80f4-ef73238ff9ce req-1e7d5eef-d41e-40bf-8728-56095d7bf0bb service nova] Creating event network-changed:94e2f165-153f-4c22-881e-01b36ec8ec5d for instance bdf119f5-416e-456f-86d6-8acff67d7c9b on n-h1-846435-14 Jul 25 14:47:01.883820 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9f8925c6-5edf-48e3-9aeb-7262b662e01a tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:01.884683 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9f8925c6-5edf-48e3-9aeb-7262b662e01a tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:01.895534 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-f5b3377f-713f-4058-80f4-ef73238ff9ce req-1e7d5eef-d41e-40bf-8728-56095d7bf0bb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199642 Jul 25 14:47:01.900941 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2354/4467] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:47:01.905498 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f8925c6-5edf-48e3-9aeb-7262b662e01a tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:01.910877 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f8925c6-5edf-48e3-9aeb-7262b662e01a tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:01.916015 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f8925c6-5edf-48e3-9aeb-7262b662e01a tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:01.919204 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f8925c6-5edf-48e3-9aeb-7262b662e01a tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:02.331993 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b8b4fbf5-2e38-49bc-9c9d-c399a512b1e4 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:02.332738 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b8b4fbf5-2e38-49bc-9c9d-c399a512b1e4 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:02.350488 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8b4fbf5-2e38-49bc-9c9d-c399a512b1e4 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:02.352175 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8b4fbf5-2e38-49bc-9c9d-c399a512b1e4 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:02.357389 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8b4fbf5-2e38-49bc-9c9d-c399a512b1e4 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:02.360495 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8b4fbf5-2e38-49bc-9c9d-c399a512b1e4 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:02.365357 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:47:02.443072 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9f8925c6-5edf-48e3-9aeb-7262b662e01a tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:02.474626 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9f8925c6-5edf-48e3-9aeb-7262b662e01a tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:02.481393 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9f8925c6-5edf-48e3-9aeb-7262b662e01a tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:02.485336 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9f8925c6-5edf-48e3-9aeb-7262b662e01a tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1878 microversion: 2.32 time: 0.605556 Jul 25 14:47:02.488008 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2114/4468] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:47:01 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1878 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:47:03.206256 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b8b4fbf5-2e38-49bc-9c9d-c399a512b1e4 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:03.221881 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b8b4fbf5-2e38-49bc-9c9d-c399a512b1e4 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1308 microversion: 2.1 time: 0.892906 Jul 25 14:47:03.223207 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2355/4469] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:02 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1308 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:47:03.288866 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-d573dd89-3cd3-4181-9136-cb4a941d687e req-f2e04d87-9fbf-4176-b8db-cf8f44639637 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50f3696b-0e20-4fc7-9bd0-3955357f2b09", "name": "network-vif-plugged", "status": "completed", "tag": "2faa258c-a4e9-4d6b-8205-234eebed8d96"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:47:03.324274 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-d573dd89-3cd3-4181-9136-cb4a941d687e req-f2e04d87-9fbf-4176-b8db-cf8f44639637 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:03.324741 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-d573dd89-3cd3-4181-9136-cb4a941d687e req-f2e04d87-9fbf-4176-b8db-cf8f44639637 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:03.356158 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-d573dd89-3cd3-4181-9136-cb4a941d687e req-f2e04d87-9fbf-4176-b8db-cf8f44639637 service nova] Creating event network-vif-plugged:2faa258c-a4e9-4d6b-8205-234eebed8d96 for instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 on n-h1-846435-14 Jul 25 14:47:03.370408 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-d573dd89-3cd3-4181-9136-cb4a941d687e req-f2e04d87-9fbf-4176-b8db-cf8f44639637 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086571 Jul 25 14:47:03.371378 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2115/4470] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:47:03.516874 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5b11faeb-d046-4f10-83d2-13e0e226465e tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:03.517750 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5b11faeb-d046-4f10-83d2-13e0e226465e tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:03.533962 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b11faeb-d046-4f10-83d2-13e0e226465e tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:03.534921 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b11faeb-d046-4f10-83d2-13e0e226465e tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:03.538344 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b11faeb-d046-4f10-83d2-13e0e226465e tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:03.539021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b11faeb-d046-4f10-83d2-13e0e226465e tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:04.155944 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5b11faeb-d046-4f10-83d2-13e0e226465e tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:04.180290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5b11faeb-d046-4f10-83d2-13e0e226465e tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:04.188004 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5b11faeb-d046-4f10-83d2-13e0e226465e tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:04.189418 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5b11faeb-d046-4f10-83d2-13e0e226465e tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1878 microversion: 2.32 time: 0.678523 Jul 25 14:47:04.189999 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2356/4471] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:47:03 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1878 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:47:04.248462 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f9d55696-c36e-4796-948a-cd56483ce670 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:04.250113 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f9d55696-c36e-4796-948a-cd56483ce670 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:04.275613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f9d55696-c36e-4796-948a-cd56483ce670 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:04.276129 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f9d55696-c36e-4796-948a-cd56483ce670 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:04.280680 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f9d55696-c36e-4796-948a-cd56483ce670 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:04.281740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f9d55696-c36e-4796-948a-cd56483ce670 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:04.568893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f9d55696-c36e-4796-948a-cd56483ce670 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:04.586641 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f9d55696-c36e-4796-948a-cd56483ce670 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1308 microversion: 2.1 time: 0.342702 Jul 25 14:47:04.591609 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2116/4472] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:04 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1308 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:05.216738 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f4101daa-fcbf-4ef0-8ae4-887c57d4b3ca tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:05.218004 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f4101daa-fcbf-4ef0-8ae4-887c57d4b3ca tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:05.220763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:47:05.225727 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=8 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:47:05.247174 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f4101daa-fcbf-4ef0-8ae4-887c57d4b3ca tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:05.247623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f4101daa-fcbf-4ef0-8ae4-887c57d4b3ca tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:05.249022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f4101daa-fcbf-4ef0-8ae4-887c57d4b3ca tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:05.249617 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f4101daa-fcbf-4ef0-8ae4-887c57d4b3ca tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:05.616899 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2b2c4490-399d-4f5a-affc-1426e76becc5 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:05.617539 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2b2c4490-399d-4f5a-affc-1426e76becc5 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:05.632343 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2b2c4490-399d-4f5a-affc-1426e76becc5 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:05.633360 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2b2c4490-399d-4f5a-affc-1426e76becc5 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:05.634901 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2b2c4490-399d-4f5a-affc-1426e76becc5 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:05.635792 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2b2c4490-399d-4f5a-affc-1426e76becc5 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:05.908306 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2b2c4490-399d-4f5a-affc-1426e76becc5 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:05.920994 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2b2c4490-399d-4f5a-affc-1426e76becc5 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1308 microversion: 2.1 time: 0.310917 Jul 25 14:47:05.922543 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2117/4473] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:05 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1308 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:47:05.975288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f4101daa-fcbf-4ef0-8ae4-887c57d4b3ca tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:05.986825 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f4101daa-fcbf-4ef0-8ae4-887c57d4b3ca tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:05.988764 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f4101daa-fcbf-4ef0-8ae4-887c57d4b3ca tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:05.990272 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f4101daa-fcbf-4ef0-8ae4-887c57d4b3ca tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1878 microversion: 2.32 time: 0.779398 Jul 25 14:47:05.991344 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2357/4474] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:47:05 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1878 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:47:06.566861 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-06b8b402-2d2c-47d3-8aee-c4ff044e44bc tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1376185592", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "82e56c61-2302-46db-be33-02ff32bbb79f"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:47:06.674183 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-06b8b402-2d2c-47d3-8aee-c4ff044e44bc tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] validate_networks() for [('82e56c61-2302-46db-be33-02ff32bbb79f', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:47:06.943156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5243076f-4c6b-46fd-8122-fc84497db305 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:06.944683 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5243076f-4c6b-46fd-8122-fc84497db305 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:06.969755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5243076f-4c6b-46fd-8122-fc84497db305 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:06.970823 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5243076f-4c6b-46fd-8122-fc84497db305 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:06.972969 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5243076f-4c6b-46fd-8122-fc84497db305 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:06.974546 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5243076f-4c6b-46fd-8122-fc84497db305 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:07.505488 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5243076f-4c6b-46fd-8122-fc84497db305 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:07.514766 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5243076f-4c6b-46fd-8122-fc84497db305 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1308 microversion: 2.1 time: 0.575440 Jul 25 14:47:07.517185 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2358/4475] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:06 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1308 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:07.531350 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2c9d68b3-2a3d-44d2-b0fd-cf07ed00de91 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:07.543183 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2c9d68b3-2a3d-44d2-b0fd-cf07ed00de91 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:07.558054 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2c9d68b3-2a3d-44d2-b0fd-cf07ed00de91 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:07.558511 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2c9d68b3-2a3d-44d2-b0fd-cf07ed00de91 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:07.559303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2c9d68b3-2a3d-44d2-b0fd-cf07ed00de91 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:07.559742 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2c9d68b3-2a3d-44d2-b0fd-cf07ed00de91 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:07.923658 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-06b8b402-2d2c-47d3-8aee-c4ff044e44bc tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:47:07.924385 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-06b8b402-2d2c-47d3-8aee-c4ff044e44bc tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:47:07.924991 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-06b8b402-2d2c-47d3-8aee-c4ff044e44bc tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:47:07.925526 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-06b8b402-2d2c-47d3-8aee-c4ff044e44bc tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:47:07.926046 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-06b8b402-2d2c-47d3-8aee-c4ff044e44bc tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:47:07.928734 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:47:07.959437 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-06b8b402-2d2c-47d3-8aee-c4ff044e44bc tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:07.959892 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-06b8b402-2d2c-47d3-8aee-c4ff044e44bc tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:07.960757 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-06b8b402-2d2c-47d3-8aee-c4ff044e44bc tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:07.961197 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-06b8b402-2d2c-47d3-8aee-c4ff044e44bc tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:07.998155 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-06b8b402-2d2c-47d3-8aee-c4ff044e44bc tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Getting quotas for project 6fc80e38c63e4b7f9896bd407e3f0e24. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:47:08.007406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-06b8b402-2d2c-47d3-8aee-c4ff044e44bc tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Getting quotas for user cbdcc4a2177543a48cdb6bd3bc5b8d49 and project 6fc80e38c63e4b7f9896bd407e3f0e24. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:47:08.026173 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-06b8b402-2d2c-47d3-8aee-c4ff044e44bc tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:47:08.029152 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-06b8b402-2d2c-47d3-8aee-c4ff044e44bc tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] [instance: 953b1654-3a01-4cb8-a129-d98e32e7c1a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:47:08.088364 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-06b8b402-2d2c-47d3-8aee-c4ff044e44bc tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.756954 Jul 25 14:47:08.112157 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2118/4476] 10.222.0.88 () {62 vars in 1188 bytes} [Mon Jul 25 14:47:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1782 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 14:47:08.117970 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-04720e10-7f27-4f2e-aeea-5d8549d45135 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:08.146920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-04720e10-7f27-4f2e-aeea-5d8549d45135 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] [instance: 953b1654-3a01-4cb8-a129-d98e32e7c1a5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:08.167059 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2c9d68b3-2a3d-44d2-b0fd-cf07ed00de91 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:08.195164 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2c9d68b3-2a3d-44d2-b0fd-cf07ed00de91 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:08.205303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2c9d68b3-2a3d-44d2-b0fd-cf07ed00de91 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:08.210103 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2c9d68b3-2a3d-44d2-b0fd-cf07ed00de91 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 2827 microversion: 2.32 time: 0.683803 Jul 25 14:47:08.212481 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2359/4477] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:47:07 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 2827 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:47:08.257181 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fe0e756b-347d-4b71-92fd-b652c75b01b3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:08.257921 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fe0e756b-347d-4b71-92fd-b652c75b01b3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:08.283000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fe0e756b-347d-4b71-92fd-b652c75b01b3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:08.285934 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fe0e756b-347d-4b71-92fd-b652c75b01b3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:08.287187 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fe0e756b-347d-4b71-92fd-b652c75b01b3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:08.289171 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fe0e756b-347d-4b71-92fd-b652c75b01b3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:08.331153 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-04720e10-7f27-4f2e-aeea-5d8549d45135 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:08.348672 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-04720e10-7f27-4f2e-aeea-5d8549d45135 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:08.353196 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-04720e10-7f27-4f2e-aeea-5d8549d45135 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:08.370201 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-04720e10-7f27-4f2e-aeea-5d8549d45135 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] 10.222.0.88 "GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5" status: 200 len: 1259 microversion: 2.21 time: 0.250221 Jul 25 14:47:08.425303 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2119/4478] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:47:08 2022] GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5 => generated 1259 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:47:08.541184 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c416b2f9-2f94-49f8-a8e1-b6f6b35dc809 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:08.542099 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c416b2f9-2f94-49f8-a8e1-b6f6b35dc809 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:08.608990 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c416b2f9-2f94-49f8-a8e1-b6f6b35dc809 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:08.611585 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c416b2f9-2f94-49f8-a8e1-b6f6b35dc809 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:08.612971 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c416b2f9-2f94-49f8-a8e1-b6f6b35dc809 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:08.613691 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c416b2f9-2f94-49f8-a8e1-b6f6b35dc809 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:08.672775 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fe0e756b-347d-4b71-92fd-b652c75b01b3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.425278 Jul 25 14:47:08.676055 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2360/4479] 10.222.0.88 () {60 vars in 1316 bytes} [Mon Jul 25 14:47:08 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09/os-interface => generated 1830 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:47:09.023909 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c416b2f9-2f94-49f8-a8e1-b6f6b35dc809 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:09.044916 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c416b2f9-2f94-49f8-a8e1-b6f6b35dc809 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1308 microversion: 2.1 time: 0.508205 Jul 25 14:47:09.051245 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2120/4480] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:08 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1308 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:09.450494 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0ab6d187-678d-4272-9c94-bfa0458f56e8 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:09.451961 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0ab6d187-678d-4272-9c94-bfa0458f56e8 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] [instance: 953b1654-3a01-4cb8-a129-d98e32e7c1a5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:09.474922 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0ab6d187-678d-4272-9c94-bfa0458f56e8 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:09.475371 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0ab6d187-678d-4272-9c94-bfa0458f56e8 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:09.478816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0ab6d187-678d-4272-9c94-bfa0458f56e8 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:09.483722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0ab6d187-678d-4272-9c94-bfa0458f56e8 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:09.649167 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0ab6d187-678d-4272-9c94-bfa0458f56e8 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:09.671567 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0ab6d187-678d-4272-9c94-bfa0458f56e8 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:09.675109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0ab6d187-678d-4272-9c94-bfa0458f56e8 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:09.680185 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0ab6d187-678d-4272-9c94-bfa0458f56e8 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] 10.222.0.88 "GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5" status: 200 len: 1255 microversion: 2.21 time: 0.260731 Jul 25 14:47:09.681454 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2361/4481] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:47:09 2022] GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5 => generated 1255 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:47:10.078762 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-beca45eb-7779-4e55-b1bd-b66b4ab36180 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:10.081866 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-beca45eb-7779-4e55-b1bd-b66b4ab36180 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:10.112616 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-beca45eb-7779-4e55-b1bd-b66b4ab36180 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:10.115254 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-beca45eb-7779-4e55-b1bd-b66b4ab36180 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:10.118541 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-beca45eb-7779-4e55-b1bd-b66b4ab36180 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:10.119701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-beca45eb-7779-4e55-b1bd-b66b4ab36180 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:10.696791 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-beca45eb-7779-4e55-b1bd-b66b4ab36180 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:10.710974 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fbf07b3d-c6e4-4f62-8e39-1d95fe529760 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:10.713713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fbf07b3d-c6e4-4f62-8e39-1d95fe529760 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] [instance: 953b1654-3a01-4cb8-a129-d98e32e7c1a5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:10.728784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fbf07b3d-c6e4-4f62-8e39-1d95fe529760 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:10.729161 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-beca45eb-7779-4e55-b1bd-b66b4ab36180 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1308 microversion: 2.1 time: 0.654107 Jul 25 14:47:10.730364 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2121/4482] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:10 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1308 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:10.731121 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fbf07b3d-c6e4-4f62-8e39-1d95fe529760 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:10.732149 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fbf07b3d-c6e4-4f62-8e39-1d95fe529760 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:10.732737 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fbf07b3d-c6e4-4f62-8e39-1d95fe529760 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:11.120376 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fbf07b3d-c6e4-4f62-8e39-1d95fe529760 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:11.139021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fbf07b3d-c6e4-4f62-8e39-1d95fe529760 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:11.142889 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fbf07b3d-c6e4-4f62-8e39-1d95fe529760 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:11.145960 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fbf07b3d-c6e4-4f62-8e39-1d95fe529760 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] 10.222.0.88 "GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5" status: 200 len: 1317 microversion: 2.21 time: 0.439716 Jul 25 14:47:11.166489 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2362/4483] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:47:10 2022] GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5 => generated 1317 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:47:11.751953 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-67af1dfa-0172-4e42-9674-18793e172df2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:11.753711 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-67af1dfa-0172-4e42-9674-18793e172df2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:11.770881 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-67af1dfa-0172-4e42-9674-18793e172df2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:11.771144 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-67af1dfa-0172-4e42-9674-18793e172df2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:11.772539 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-67af1dfa-0172-4e42-9674-18793e172df2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:11.781640 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-67af1dfa-0172-4e42-9674-18793e172df2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:12.174244 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-84d6b306-3887-42df-885b-6110eb6787ab tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:12.176183 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-84d6b306-3887-42df-885b-6110eb6787ab tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] [instance: 953b1654-3a01-4cb8-a129-d98e32e7c1a5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:12.185227 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-84d6b306-3887-42df-885b-6110eb6787ab tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:12.188455 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-84d6b306-3887-42df-885b-6110eb6787ab tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:12.189498 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-84d6b306-3887-42df-885b-6110eb6787ab tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:12.190092 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-84d6b306-3887-42df-885b-6110eb6787ab tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:12.311049 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-67af1dfa-0172-4e42-9674-18793e172df2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:12.328889 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-67af1dfa-0172-4e42-9674-18793e172df2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1308 microversion: 2.1 time: 0.577319 Jul 25 14:47:12.329884 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2122/4484] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:11 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1308 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:12.339512 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-4a0a3eb0-116a-4709-9b4f-22013dab57c5 req-07cbf577-810d-4133-bda9-796bda77f449 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50f3696b-0e20-4fc7-9bd0-3955357f2b09", "tag": "8e48e753-58f9-4d03-a879-346119141e40"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:47:12.380460 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-4a0a3eb0-116a-4709-9b4f-22013dab57c5 req-07cbf577-810d-4133-bda9-796bda77f449 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:12.380907 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-4a0a3eb0-116a-4709-9b4f-22013dab57c5 req-07cbf577-810d-4133-bda9-796bda77f449 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:12.438368 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-4a0a3eb0-116a-4709-9b4f-22013dab57c5 req-07cbf577-810d-4133-bda9-796bda77f449 service nova] Creating event network-changed:8e48e753-58f9-4d03-a879-346119141e40 for instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 on n-h1-846435-14 Jul 25 14:47:12.459072 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-4a0a3eb0-116a-4709-9b4f-22013dab57c5 req-07cbf577-810d-4133-bda9-796bda77f449 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127777 Jul 25 14:47:12.464067 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2123/4485] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:47:12.563929 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-84d6b306-3887-42df-885b-6110eb6787ab tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:12.577905 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-84d6b306-3887-42df-885b-6110eb6787ab tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:12.580295 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-84d6b306-3887-42df-885b-6110eb6787ab tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:12.581713 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-84d6b306-3887-42df-885b-6110eb6787ab tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] 10.222.0.88 "GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5" status: 200 len: 1359 microversion: 2.21 time: 0.412452 Jul 25 14:47:12.596004 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2363/4486] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:47:12 2022] GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5 => generated 1359 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:47:12.811205 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-8e83e5e8-4aaa-4eb7-b8f2-ed43f342f25a req-a43b7e1b-db28-490a-9c56-85d2ee04d9e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdf119f5-416e-456f-86d6-8acff67d7c9b", "name": "network-vif-plugged", "status": "completed", "tag": "94e2f165-153f-4c22-881e-01b36ec8ec5d"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:47:12.824799 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-8e83e5e8-4aaa-4eb7-b8f2-ed43f342f25a req-a43b7e1b-db28-490a-9c56-85d2ee04d9e4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:12.833754 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-8e83e5e8-4aaa-4eb7-b8f2-ed43f342f25a req-a43b7e1b-db28-490a-9c56-85d2ee04d9e4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:12.862660 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-8e83e5e8-4aaa-4eb7-b8f2-ed43f342f25a req-a43b7e1b-db28-490a-9c56-85d2ee04d9e4 service nova] Creating event network-vif-plugged:94e2f165-153f-4c22-881e-01b36ec8ec5d for instance bdf119f5-416e-456f-86d6-8acff67d7c9b on n-h1-846435-14 Jul 25 14:47:12.888993 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-8e83e5e8-4aaa-4eb7-b8f2-ed43f342f25a req-a43b7e1b-db28-490a-9c56-85d2ee04d9e4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080490 Jul 25 14:47:12.892175 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2124/4487] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:47:13.356626 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dfb831e4-8593-494a-8fc6-7ca09ce05e66 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:13.358473 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dfb831e4-8593-494a-8fc6-7ca09ce05e66 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:13.374457 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dfb831e4-8593-494a-8fc6-7ca09ce05e66 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:13.378782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dfb831e4-8593-494a-8fc6-7ca09ce05e66 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:13.380076 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dfb831e4-8593-494a-8fc6-7ca09ce05e66 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:13.380737 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dfb831e4-8593-494a-8fc6-7ca09ce05e66 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:13.607893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2a97ee3e-153e-4804-849e-ca04180b4b25 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:13.609035 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2a97ee3e-153e-4804-849e-ca04180b4b25 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] [instance: 953b1654-3a01-4cb8-a129-d98e32e7c1a5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:13.624465 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a97ee3e-153e-4804-849e-ca04180b4b25 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:13.632806 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a97ee3e-153e-4804-849e-ca04180b4b25 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:13.633967 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a97ee3e-153e-4804-849e-ca04180b4b25 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:13.634603 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a97ee3e-153e-4804-849e-ca04180b4b25 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:13.893627 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dfb831e4-8593-494a-8fc6-7ca09ce05e66 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:13.906531 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dfb831e4-8593-494a-8fc6-7ca09ce05e66 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1308 microversion: 2.1 time: 0.555205 Jul 25 14:47:13.910157 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2364/4488] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:13 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1308 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:14.020799 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2a97ee3e-153e-4804-849e-ca04180b4b25 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:14.035093 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2a97ee3e-153e-4804-849e-ca04180b4b25 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:14.042611 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2a97ee3e-153e-4804-849e-ca04180b4b25 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:14.043832 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2a97ee3e-153e-4804-849e-ca04180b4b25 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] 10.222.0.88 "GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5" status: 200 len: 1359 microversion: 2.21 time: 0.440750 Jul 25 14:47:14.049664 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2125/4489] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:47:13 2022] GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5 => generated 1359 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:47:14.325719 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-b4e59178-19a8-4419-9ad9-a9f39de6d4a1 req-3f29b29c-0152-4d10-aaf6-e2cc05371f42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "953b1654-3a01-4cb8-a129-d98e32e7c1a5", "tag": "5ba73ca0-193d-4c3d-9417-4fb96ea8568a"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:47:14.395017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-b4e59178-19a8-4419-9ad9-a9f39de6d4a1 req-3f29b29c-0152-4d10-aaf6-e2cc05371f42 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:14.395769 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-b4e59178-19a8-4419-9ad9-a9f39de6d4a1 req-3f29b29c-0152-4d10-aaf6-e2cc05371f42 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:14.461652 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-b4e59178-19a8-4419-9ad9-a9f39de6d4a1 req-3f29b29c-0152-4d10-aaf6-e2cc05371f42 service nova] Creating event network-changed:5ba73ca0-193d-4c3d-9417-4fb96ea8568a for instance 953b1654-3a01-4cb8-a129-d98e32e7c1a5 on n-h2-846435-14 Jul 25 14:47:14.479824 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-b4e59178-19a8-4419-9ad9-a9f39de6d4a1 req-3f29b29c-0152-4d10-aaf6-e2cc05371f42 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188119 Jul 25 14:47:14.480803 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2365/4490] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:47:14.934239 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3c0136f5-7a20-4dc8-b888-3fcf0bfeb6fe tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:14.934854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3c0136f5-7a20-4dc8-b888-3fcf0bfeb6fe tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:14.950466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c0136f5-7a20-4dc8-b888-3fcf0bfeb6fe tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:14.952258 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c0136f5-7a20-4dc8-b888-3fcf0bfeb6fe tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:14.954028 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c0136f5-7a20-4dc8-b888-3fcf0bfeb6fe tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:14.954707 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c0136f5-7a20-4dc8-b888-3fcf0bfeb6fe tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:14.964834 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:47:15.075524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4152d52f-de26-4f7c-a596-ac8dbbce4bec tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:15.077595 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4152d52f-de26-4f7c-a596-ac8dbbce4bec tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] [instance: 953b1654-3a01-4cb8-a129-d98e32e7c1a5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:15.094172 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4152d52f-de26-4f7c-a596-ac8dbbce4bec tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:15.098677 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4152d52f-de26-4f7c-a596-ac8dbbce4bec tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:15.100876 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4152d52f-de26-4f7c-a596-ac8dbbce4bec tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:15.101972 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4152d52f-de26-4f7c-a596-ac8dbbce4bec tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:15.479060 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4152d52f-de26-4f7c-a596-ac8dbbce4bec tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:15.489972 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4152d52f-de26-4f7c-a596-ac8dbbce4bec tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:15.497588 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4152d52f-de26-4f7c-a596-ac8dbbce4bec tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:15.499401 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4152d52f-de26-4f7c-a596-ac8dbbce4bec tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] 10.222.0.88 "GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5" status: 200 len: 1359 microversion: 2.21 time: 0.432116 Jul 25 14:47:15.500034 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2366/4491] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:47:15 2022] GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5 => generated 1359 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:47:15.535246 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3c0136f5-7a20-4dc8-b888-3fcf0bfeb6fe tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:15.540832 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3c0136f5-7a20-4dc8-b888-3fcf0bfeb6fe tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1308 microversion: 2.1 time: 0.611202 Jul 25 14:47:15.555350 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2126/4492] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:14 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1308 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:16.535031 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e10706a4-4672-4eef-860d-18daae8891c0 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:16.537919 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e10706a4-4672-4eef-860d-18daae8891c0 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] [instance: 953b1654-3a01-4cb8-a129-d98e32e7c1a5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:16.556210 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e10706a4-4672-4eef-860d-18daae8891c0 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:16.557832 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e10706a4-4672-4eef-860d-18daae8891c0 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:16.559266 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e10706a4-4672-4eef-860d-18daae8891c0 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:16.559944 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e10706a4-4672-4eef-860d-18daae8891c0 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:16.567246 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-88acffb4-9684-4bb5-9a6f-a8cec814b439 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:16.567246 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-88acffb4-9684-4bb5-9a6f-a8cec814b439 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:16.582733 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-88acffb4-9684-4bb5-9a6f-a8cec814b439 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:16.583244 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-88acffb4-9684-4bb5-9a6f-a8cec814b439 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:16.589276 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-88acffb4-9684-4bb5-9a6f-a8cec814b439 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:16.590397 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-88acffb4-9684-4bb5-9a6f-a8cec814b439 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:16.846375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e10706a4-4672-4eef-860d-18daae8891c0 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:16.864787 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e10706a4-4672-4eef-860d-18daae8891c0 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:16.874470 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e10706a4-4672-4eef-860d-18daae8891c0 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:16.879023 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e10706a4-4672-4eef-860d-18daae8891c0 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] 10.222.0.88 "GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5" status: 200 len: 1359 microversion: 2.21 time: 0.354987 Jul 25 14:47:16.888888 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2367/4493] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:47:16 2022] GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5 => generated 1359 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:47:16.909432 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-88acffb4-9684-4bb5-9a6f-a8cec814b439 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:16.929708 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-88acffb4-9684-4bb5-9a6f-a8cec814b439 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1488 microversion: 2.1 time: 0.368348 Jul 25 14:47:16.935799 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2127/4494] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:16 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1488 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:16.959881 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ee74e65d-6f68-448d-8f91-9f20decb2c2b tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:47:16.969354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee74e65d-6f68-448d-8f91-9f20decb2c2b tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:16.970484 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee74e65d-6f68-448d-8f91-9f20decb2c2b tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:17.032760 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ee74e65d-6f68-448d-8f91-9f20decb2c2b tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Going to try to stop instance {{(pid=119304) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 14:47:17.116926 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ee74e65d-6f68-448d-8f91-9f20decb2c2b tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "POST /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b/action" status: 202 len: 0 microversion: 2.1 time: 0.160665 Jul 25 14:47:17.118452 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2368/4495] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:47:16 2022] POST /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:47:17.130129 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f11309ec-3a82-4832-9769-586d3f55a6c0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:17.131401 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f11309ec-3a82-4832-9769-586d3f55a6c0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:17.162318 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f11309ec-3a82-4832-9769-586d3f55a6c0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:17.164329 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f11309ec-3a82-4832-9769-586d3f55a6c0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:17.166354 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f11309ec-3a82-4832-9769-586d3f55a6c0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:17.168516 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f11309ec-3a82-4832-9769-586d3f55a6c0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:17.566098 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f11309ec-3a82-4832-9769-586d3f55a6c0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:17.579366 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f11309ec-3a82-4832-9769-586d3f55a6c0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1498 microversion: 2.1 time: 0.456131 Jul 25 14:47:17.583550 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2128/4496] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:17 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1498 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:17.922804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-57eb328c-cf40-401f-8130-80ae26c561e9 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:17.927915 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-57eb328c-cf40-401f-8130-80ae26c561e9 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] [instance: 953b1654-3a01-4cb8-a129-d98e32e7c1a5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:17.954372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-57eb328c-cf40-401f-8130-80ae26c561e9 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:17.958043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-57eb328c-cf40-401f-8130-80ae26c561e9 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:17.964817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-57eb328c-cf40-401f-8130-80ae26c561e9 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:17.965588 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-57eb328c-cf40-401f-8130-80ae26c561e9 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:18.415903 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-57eb328c-cf40-401f-8130-80ae26c561e9 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:18.427915 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-57eb328c-cf40-401f-8130-80ae26c561e9 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:18.429775 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-57eb328c-cf40-401f-8130-80ae26c561e9 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:18.432048 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-57eb328c-cf40-401f-8130-80ae26c561e9 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] 10.222.0.88 "GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5" status: 200 len: 1359 microversion: 2.21 time: 0.517350 Jul 25 14:47:18.435411 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2369/4497] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:47:17 2022] GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5 => generated 1359 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:47:18.606263 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-86bf3b21-4ce9-476e-bf55-e9be63a5b3e4 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:18.606885 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-86bf3b21-4ce9-476e-bf55-e9be63a5b3e4 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:18.610961 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:47:18.611939 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=8 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:47:18.633713 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-86bf3b21-4ce9-476e-bf55-e9be63a5b3e4 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:18.634174 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-86bf3b21-4ce9-476e-bf55-e9be63a5b3e4 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:18.642296 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-86bf3b21-4ce9-476e-bf55-e9be63a5b3e4 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:18.643445 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-86bf3b21-4ce9-476e-bf55-e9be63a5b3e4 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:19.002949 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-86bf3b21-4ce9-476e-bf55-e9be63a5b3e4 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:19.018398 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-86bf3b21-4ce9-476e-bf55-e9be63a5b3e4 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1498 microversion: 2.1 time: 0.417282 Jul 25 14:47:19.019250 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2129/4498] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:18 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1498 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:19.462842 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7cded054-8ab3-4ecb-8266-b0fe1dafa541 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:19.463700 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7cded054-8ab3-4ecb-8266-b0fe1dafa541 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] [instance: 953b1654-3a01-4cb8-a129-d98e32e7c1a5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:19.477538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7cded054-8ab3-4ecb-8266-b0fe1dafa541 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:19.478569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7cded054-8ab3-4ecb-8266-b0fe1dafa541 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:19.480241 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7cded054-8ab3-4ecb-8266-b0fe1dafa541 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:19.481152 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7cded054-8ab3-4ecb-8266-b0fe1dafa541 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:19.711654 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7cded054-8ab3-4ecb-8266-b0fe1dafa541 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:19.722362 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7cded054-8ab3-4ecb-8266-b0fe1dafa541 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:19.727521 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7cded054-8ab3-4ecb-8266-b0fe1dafa541 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:19.730504 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7cded054-8ab3-4ecb-8266-b0fe1dafa541 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] 10.222.0.88 "GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5" status: 200 len: 1359 microversion: 2.21 time: 0.273174 Jul 25 14:47:19.731147 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2370/4499] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:47:19 2022] GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5 => generated 1359 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:47:20.042829 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-63c813b2-312a-4041-9f99-71e6d93f5e17 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:20.043720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-63c813b2-312a-4041-9f99-71e6d93f5e17 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:20.052918 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-63c813b2-312a-4041-9f99-71e6d93f5e17 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:20.053551 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-63c813b2-312a-4041-9f99-71e6d93f5e17 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:20.054647 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-63c813b2-312a-4041-9f99-71e6d93f5e17 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:20.055349 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-63c813b2-312a-4041-9f99-71e6d93f5e17 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:20.291467 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-63c813b2-312a-4041-9f99-71e6d93f5e17 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:20.300325 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-63c813b2-312a-4041-9f99-71e6d93f5e17 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1498 microversion: 2.1 time: 0.261621 Jul 25 14:47:20.301270 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2130/4500] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:20 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1498 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:20.762359 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f356833a-c2f6-41cf-95b0-15399fc9bafa tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:20.766645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f356833a-c2f6-41cf-95b0-15399fc9bafa tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] [instance: 953b1654-3a01-4cb8-a129-d98e32e7c1a5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:20.779374 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f356833a-c2f6-41cf-95b0-15399fc9bafa tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:20.779959 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f356833a-c2f6-41cf-95b0-15399fc9bafa tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:20.780696 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f356833a-c2f6-41cf-95b0-15399fc9bafa tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:20.781130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f356833a-c2f6-41cf-95b0-15399fc9bafa tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:20.970330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f356833a-c2f6-41cf-95b0-15399fc9bafa tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:20.972710 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:47:20.987311 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f356833a-c2f6-41cf-95b0-15399fc9bafa tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:20.989278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f356833a-c2f6-41cf-95b0-15399fc9bafa tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:20.990939 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f356833a-c2f6-41cf-95b0-15399fc9bafa tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] 10.222.0.88 "GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5" status: 200 len: 1359 microversion: 2.21 time: 0.238719 Jul 25 14:47:20.999794 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2371/4501] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:47:20 2022] GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5 => generated 1359 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:47:21.332778 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5c518bc8-8e26-4110-a10b-58160730c9f4 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:21.333403 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5c518bc8-8e26-4110-a10b-58160730c9f4 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:21.343062 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5c518bc8-8e26-4110-a10b-58160730c9f4 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:21.348104 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5c518bc8-8e26-4110-a10b-58160730c9f4 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:21.350428 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5c518bc8-8e26-4110-a10b-58160730c9f4 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:21.351828 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5c518bc8-8e26-4110-a10b-58160730c9f4 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:21.778284 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5c518bc8-8e26-4110-a10b-58160730c9f4 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:21.787635 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5c518bc8-8e26-4110-a10b-58160730c9f4 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1498 microversion: 2.1 time: 0.459651 Jul 25 14:47:21.788646 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2131/4502] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:21 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1498 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:22.015747 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9729b618-a07d-4aa5-af2a-7527b67e1b01 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:22.017157 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9729b618-a07d-4aa5-af2a-7527b67e1b01 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] [instance: 953b1654-3a01-4cb8-a129-d98e32e7c1a5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:22.025811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9729b618-a07d-4aa5-af2a-7527b67e1b01 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:22.027019 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9729b618-a07d-4aa5-af2a-7527b67e1b01 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:22.028136 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9729b618-a07d-4aa5-af2a-7527b67e1b01 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:22.028874 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9729b618-a07d-4aa5-af2a-7527b67e1b01 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:22.242680 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9729b618-a07d-4aa5-af2a-7527b67e1b01 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:22.253869 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9729b618-a07d-4aa5-af2a-7527b67e1b01 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:22.255684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9729b618-a07d-4aa5-af2a-7527b67e1b01 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:22.257948 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9729b618-a07d-4aa5-af2a-7527b67e1b01 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] 10.222.0.88 "GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5" status: 200 len: 1359 microversion: 2.21 time: 0.245600 Jul 25 14:47:22.259152 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2372/4503] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:47:22 2022] GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5 => generated 1359 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:47:22.814977 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f0c1ba65-f87b-4bfe-81d3-5dc7402f6fc2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:22.816289 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f0c1ba65-f87b-4bfe-81d3-5dc7402f6fc2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:22.839429 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f0c1ba65-f87b-4bfe-81d3-5dc7402f6fc2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:22.840434 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f0c1ba65-f87b-4bfe-81d3-5dc7402f6fc2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:22.841287 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f0c1ba65-f87b-4bfe-81d3-5dc7402f6fc2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:22.841739 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f0c1ba65-f87b-4bfe-81d3-5dc7402f6fc2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:22.961608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-830e0498-44f5-4df3-b75c-87172dc38ecc req-47c81c82-4258-464f-a1b8-f553849c1f02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "953b1654-3a01-4cb8-a129-d98e32e7c1a5", "name": "network-vif-plugged", "status": "completed", "tag": "5ba73ca0-193d-4c3d-9417-4fb96ea8568a"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:47:22.978827 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:47:22.982916 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-830e0498-44f5-4df3-b75c-87172dc38ecc req-47c81c82-4258-464f-a1b8-f553849c1f02 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:22.983678 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-830e0498-44f5-4df3-b75c-87172dc38ecc req-47c81c82-4258-464f-a1b8-f553849c1f02 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:23.001603 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-830e0498-44f5-4df3-b75c-87172dc38ecc req-47c81c82-4258-464f-a1b8-f553849c1f02 service nova] Creating event network-vif-plugged:5ba73ca0-193d-4c3d-9417-4fb96ea8568a for instance 953b1654-3a01-4cb8-a129-d98e32e7c1a5 on n-h2-846435-14 Jul 25 14:47:23.015601 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-830e0498-44f5-4df3-b75c-87172dc38ecc req-47c81c82-4258-464f-a1b8-f553849c1f02 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067207 Jul 25 14:47:23.018458 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2373/4504] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:47:23.254165 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f0c1ba65-f87b-4bfe-81d3-5dc7402f6fc2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:23.269994 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f0c1ba65-f87b-4bfe-81d3-5dc7402f6fc2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1498 microversion: 2.1 time: 0.460478 Jul 25 14:47:23.273623 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2132/4505] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:22 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1498 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:23.287373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-af0a0d74-df61-4f67-a245-1684215386f9 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:23.288191 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-af0a0d74-df61-4f67-a245-1684215386f9 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] [instance: 953b1654-3a01-4cb8-a129-d98e32e7c1a5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:23.296233 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af0a0d74-df61-4f67-a245-1684215386f9 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:23.297707 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af0a0d74-df61-4f67-a245-1684215386f9 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:23.298759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af0a0d74-df61-4f67-a245-1684215386f9 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:23.299766 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af0a0d74-df61-4f67-a245-1684215386f9 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:23.531078 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-af0a0d74-df61-4f67-a245-1684215386f9 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:23.546881 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-af0a0d74-df61-4f67-a245-1684215386f9 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:23.550089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-af0a0d74-df61-4f67-a245-1684215386f9 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:23.552555 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-af0a0d74-df61-4f67-a245-1684215386f9 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] 10.222.0.88 "GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5" status: 200 len: 1359 microversion: 2.21 time: 0.270354 Jul 25 14:47:23.553940 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2374/4506] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:47:23 2022] GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5 => generated 1359 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:47:24.296671 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-05eb7bae-4126-45f6-9986-8f26482e9ce0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:24.298333 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-05eb7bae-4126-45f6-9986-8f26482e9ce0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:24.318232 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-05eb7bae-4126-45f6-9986-8f26482e9ce0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:24.319078 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-05eb7bae-4126-45f6-9986-8f26482e9ce0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:24.320114 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-05eb7bae-4126-45f6-9986-8f26482e9ce0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:24.323699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-05eb7bae-4126-45f6-9986-8f26482e9ce0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:24.577329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-35729056-00fc-4387-8cca-e1e76d10abd3 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:24.578964 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-35729056-00fc-4387-8cca-e1e76d10abd3 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] [instance: 953b1654-3a01-4cb8-a129-d98e32e7c1a5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:24.595647 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35729056-00fc-4387-8cca-e1e76d10abd3 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:24.596498 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35729056-00fc-4387-8cca-e1e76d10abd3 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:24.598562 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35729056-00fc-4387-8cca-e1e76d10abd3 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:24.599666 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35729056-00fc-4387-8cca-e1e76d10abd3 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:24.611395 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-05eb7bae-4126-45f6-9986-8f26482e9ce0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:24.626887 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-05eb7bae-4126-45f6-9986-8f26482e9ce0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1498 microversion: 2.1 time: 0.336373 Jul 25 14:47:24.630132 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2133/4507] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:24 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1498 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:25.094090 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-35729056-00fc-4387-8cca-e1e76d10abd3 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:25.110132 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-35729056-00fc-4387-8cca-e1e76d10abd3 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:25.123949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-35729056-00fc-4387-8cca-e1e76d10abd3 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:25.125413 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-35729056-00fc-4387-8cca-e1e76d10abd3 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] 10.222.0.88 "GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5" status: 200 len: 1359 microversion: 2.21 time: 0.553143 Jul 25 14:47:25.126128 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2375/4508] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:47:24 2022] GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5 => generated 1359 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:47:25.656675 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-339976e0-dd72-45c7-a54f-978c506497c3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:25.658460 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-339976e0-dd72-45c7-a54f-978c506497c3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:25.674212 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-339976e0-dd72-45c7-a54f-978c506497c3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:25.674669 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-339976e0-dd72-45c7-a54f-978c506497c3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:25.686679 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-339976e0-dd72-45c7-a54f-978c506497c3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:25.688146 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-339976e0-dd72-45c7-a54f-978c506497c3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:25.957900 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-339976e0-dd72-45c7-a54f-978c506497c3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:25.980792 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-339976e0-dd72-45c7-a54f-978c506497c3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1498 microversion: 2.1 time: 0.326869 Jul 25 14:47:25.997791 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2134/4509] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:25 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1498 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:26.149757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1a3643d1-0882-4436-bc6f-e8bc274cf52b tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:26.150507 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1a3643d1-0882-4436-bc6f-e8bc274cf52b tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] [instance: 953b1654-3a01-4cb8-a129-d98e32e7c1a5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:26.165134 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1a3643d1-0882-4436-bc6f-e8bc274cf52b tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:26.165854 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1a3643d1-0882-4436-bc6f-e8bc274cf52b tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:26.170612 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1a3643d1-0882-4436-bc6f-e8bc274cf52b tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:26.170612 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1a3643d1-0882-4436-bc6f-e8bc274cf52b tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:26.398292 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1a3643d1-0882-4436-bc6f-e8bc274cf52b tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:26.409572 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1a3643d1-0882-4436-bc6f-e8bc274cf52b tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:26.411614 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1a3643d1-0882-4436-bc6f-e8bc274cf52b tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:26.412796 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1a3643d1-0882-4436-bc6f-e8bc274cf52b tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] 10.222.0.88 "GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5" status: 200 len: 1551 microversion: 2.21 time: 0.267660 Jul 25 14:47:26.421364 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2376/4510] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:47:26 2022] GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5 => generated 1551 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:47:26.440920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4a78b6c8-a225-46dc-bb9c-95169c46657e tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:26.441724 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4a78b6c8-a225-46dc-bb9c-95169c46657e tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] [instance: 953b1654-3a01-4cb8-a129-d98e32e7c1a5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:26.448789 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4a78b6c8-a225-46dc-bb9c-95169c46657e tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:26.449586 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4a78b6c8-a225-46dc-bb9c-95169c46657e tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:26.451153 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4a78b6c8-a225-46dc-bb9c-95169c46657e tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:26.451812 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4a78b6c8-a225-46dc-bb9c-95169c46657e tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:26.484923 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4a78b6c8-a225-46dc-bb9c-95169c46657e tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] [instance: 953b1654-3a01-4cb8-a129-d98e32e7c1a5] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:47:26.601944 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4a78b6c8-a225-46dc-bb9c-95169c46657e tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] 10.222.0.88 "DELETE /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5" status: 204 len: 0 microversion: 2.21 time: 0.164000 Jul 25 14:47:26.604151 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2135/4511] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Jul 25 14:47:26 2022] DELETE /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 14:47:26.617192 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-57db7404-f60c-40f6-a573-8c3a7743de4a tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:26.617872 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-57db7404-f60c-40f6-a573-8c3a7743de4a tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] [instance: 953b1654-3a01-4cb8-a129-d98e32e7c1a5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:26.626727 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-57db7404-f60c-40f6-a573-8c3a7743de4a tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:26.627748 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-57db7404-f60c-40f6-a573-8c3a7743de4a tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:26.628581 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-57db7404-f60c-40f6-a573-8c3a7743de4a tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:26.629191 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-57db7404-f60c-40f6-a573-8c3a7743de4a tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:27.009410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f794c12b-8eb7-4c45-8f34-c9cd203cbabf tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:27.010934 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f794c12b-8eb7-4c45-8f34-c9cd203cbabf tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:27.019802 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f794c12b-8eb7-4c45-8f34-c9cd203cbabf tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:27.020506 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f794c12b-8eb7-4c45-8f34-c9cd203cbabf tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:27.021678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f794c12b-8eb7-4c45-8f34-c9cd203cbabf tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:27.022353 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f794c12b-8eb7-4c45-8f34-c9cd203cbabf tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:27.243704 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f794c12b-8eb7-4c45-8f34-c9cd203cbabf tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:27.253734 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f794c12b-8eb7-4c45-8f34-c9cd203cbabf tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1498 microversion: 2.1 time: 0.248581 Jul 25 14:47:27.254518 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2136/4512] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:27 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1498 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:47:27.379881 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-57db7404-f60c-40f6-a573-8c3a7743de4a tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:27.394911 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-57db7404-f60c-40f6-a573-8c3a7743de4a tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:27.400196 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-57db7404-f60c-40f6-a573-8c3a7743de4a tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:27.402841 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-57db7404-f60c-40f6-a573-8c3a7743de4a tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] 10.222.0.88 "GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5" status: 200 len: 1557 microversion: 2.21 time: 0.794091 Jul 25 14:47:27.413150 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2377/4513] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:47:26 2022] GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5 => generated 1557 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:47:28.286107 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7a4baaa5-5e92-4ed0-a00d-1ae56d9d0892 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:28.290212 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7a4baaa5-5e92-4ed0-a00d-1ae56d9d0892 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:28.308121 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7a4baaa5-5e92-4ed0-a00d-1ae56d9d0892 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:28.308598 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7a4baaa5-5e92-4ed0-a00d-1ae56d9d0892 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:28.309392 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7a4baaa5-5e92-4ed0-a00d-1ae56d9d0892 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:28.309835 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7a4baaa5-5e92-4ed0-a00d-1ae56d9d0892 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:28.436046 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5cf58b02-651b-4260-a814-8a72d2e44376 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:28.436046 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5cf58b02-651b-4260-a814-8a72d2e44376 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] [instance: 953b1654-3a01-4cb8-a129-d98e32e7c1a5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:28.454175 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5cf58b02-651b-4260-a814-8a72d2e44376 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:28.454663 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5cf58b02-651b-4260-a814-8a72d2e44376 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:28.455455 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5cf58b02-651b-4260-a814-8a72d2e44376 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:28.455893 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5cf58b02-651b-4260-a814-8a72d2e44376 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:28.844820 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7a4baaa5-5e92-4ed0-a00d-1ae56d9d0892 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:28.864086 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7a4baaa5-5e92-4ed0-a00d-1ae56d9d0892 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1498 microversion: 2.1 time: 0.591738 Jul 25 14:47:28.868889 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2137/4514] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:28 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1498 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:47:28.993776 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5cf58b02-651b-4260-a814-8a72d2e44376 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:29.006020 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5cf58b02-651b-4260-a814-8a72d2e44376 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:29.013243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5cf58b02-651b-4260-a814-8a72d2e44376 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbdcc4a2177543a48cdb6bd3bc5b8d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc80e38c63e4b7f9896bd407e3f0e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:29.019315 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5cf58b02-651b-4260-a814-8a72d2e44376 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] 10.222.0.88 "GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5" status: 200 len: 1557 microversion: 2.21 time: 0.585953 Jul 25 14:47:29.035343 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2378/4515] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:47:28 2022] GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5 => generated 1557 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:47:29.355482 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-df01b1cd-39e1-4695-ae67-2bafb0f4393e req-dd3bca41-a6b5-459a-880b-c8f1095aacf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "953b1654-3a01-4cb8-a129-d98e32e7c1a5", "name": "network-vif-deleted", "tag": "5ba73ca0-193d-4c3d-9417-4fb96ea8568a"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:47:29.371037 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-df01b1cd-39e1-4695-ae67-2bafb0f4393e req-dd3bca41-a6b5-459a-880b-c8f1095aacf8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:29.371797 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-df01b1cd-39e1-4695-ae67-2bafb0f4393e req-dd3bca41-a6b5-459a-880b-c8f1095aacf8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:29.391827 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-df01b1cd-39e1-4695-ae67-2bafb0f4393e req-dd3bca41-a6b5-459a-880b-c8f1095aacf8 service nova] Creating event network-vif-deleted:5ba73ca0-193d-4c3d-9417-4fb96ea8568a for instance 953b1654-3a01-4cb8-a129-d98e32e7c1a5 on n-h2-846435-14 Jul 25 14:47:29.399376 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-df01b1cd-39e1-4695-ae67-2bafb0f4393e req-dd3bca41-a6b5-459a-880b-c8f1095aacf8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049619 Jul 25 14:47:29.400713 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2138/4516] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:47:29.897766 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1eb25cb1-32c9-4abb-b0fc-9c10c50344f6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:29.898442 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1eb25cb1-32c9-4abb-b0fc-9c10c50344f6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:29.926376 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1eb25cb1-32c9-4abb-b0fc-9c10c50344f6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:29.926865 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1eb25cb1-32c9-4abb-b0fc-9c10c50344f6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:29.927689 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1eb25cb1-32c9-4abb-b0fc-9c10c50344f6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:29.928183 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1eb25cb1-32c9-4abb-b0fc-9c10c50344f6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:30.048721 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ec12514a-1ead-44f1-9d5e-b06905e3f0d5 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:30.050216 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ec12514a-1ead-44f1-9d5e-b06905e3f0d5 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] [instance: 953b1654-3a01-4cb8-a129-d98e32e7c1a5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:30.065812 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec12514a-1ead-44f1-9d5e-b06905e3f0d5 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:30.069292 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec12514a-1ead-44f1-9d5e-b06905e3f0d5 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:30.070262 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec12514a-1ead-44f1-9d5e-b06905e3f0d5 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:30.070825 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec12514a-1ead-44f1-9d5e-b06905e3f0d5 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:30.099504 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-ec12514a-1ead-44f1-9d5e-b06905e3f0d5 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] HTTP exception thrown: Instance 953b1654-3a01-4cb8-a129-d98e32e7c1a5 could not be found. Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ec12514a-1ead-44f1-9d5e-b06905e3f0d5 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Request method failure captured: Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5 HTTP/1.1 Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qzq8sjkLCB6uoJh9qsUu3CcHwGZ1ztZqT77WSLpUgiq3rCV1e9jP6iuUgCgXJ5-8lVwG1AnJiRVJk7EPntuVZq4LZ-XZ2_CUKi1XhNeWQ1cNvTZkBHtAviMml6Fewka1KaZBLxH-SyQg3sHaq60IPW6XNfj8cXaXuXRUhpfIXafS48 Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: X-Openstack-Nova-Api-Version: 2.21 Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 6fc80e38c63e4b7f9896bd407e3f0e24 Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-InstanceActionsV221TestJSON-152676182 Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6fc80e38c63e4b7f9896bd407e3f0e24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6fc80e38c63e4b7f9896bd407e3f0e24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6fc80e38c63e4b7f9896bd407e3f0e24", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6fc80e38c63e4b7f9896bd407e3f0e24"}]}] Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-InstanceActionsV221TestJSON-152676182 Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 6fc80e38c63e4b7f9896bd407e3f0e24 Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-152676182 Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-InstanceActionsV221TestJSON-152676182-project Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: cbdcc4a2177543a48cdb6bd3bc5b8d49 Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-InstanceActionsV221TestJSON-152676182-project Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 953b1654-3a01-4cb8-a129-d98e32e7c1a5 could not be found. Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '953b1654-3a01-4cb8-a129-d98e32e7c1a5'} Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 953b1654-3a01-4cb8-a129-d98e32e7c1a5 could not be found. Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 953b1654-3a01-4cb8-a129-d98e32e7c1a5 could not be found. Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:47:30.101288 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:47:30.106218 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:47:30.106218 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:47:30.106218 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:47:30.106218 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:47:30.106218 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:47:30.106218 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:47:30.106218 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 953b1654-3a01-4cb8-a129-d98e32e7c1a5 could not be found. Jul 25 14:47:30.106218 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:47:30.106218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ec12514a-1ead-44f1-9d5e-b06905e3f0d5 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Returning 404 to user: Instance 953b1654-3a01-4cb8-a129-d98e32e7c1a5 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:47:30.106218 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ec12514a-1ead-44f1-9d5e-b06905e3f0d5 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] 10.222.0.88 "GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5" status: 404 len: 111 microversion: 2.21 time: 0.062972 Jul 25 14:47:30.111122 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2139/4517] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:47:30 2022] GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:47:30.118623 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a43a6f1c-ff50-4a9a-9b69-b2135efa8a0e tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Calling method '.version_select at 0x7f46867638b0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:30.119450 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a43a6f1c-ff50-4a9a-9b69-b2135efa8a0e tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] [instance: 953b1654-3a01-4cb8-a129-d98e32e7c1a5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:30.143884 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a43a6f1c-ff50-4a9a-9b69-b2135efa8a0e tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:30.144494 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a43a6f1c-ff50-4a9a-9b69-b2135efa8a0e tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:30.145387 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a43a6f1c-ff50-4a9a-9b69-b2135efa8a0e tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:30.145837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a43a6f1c-ff50-4a9a-9b69-b2135efa8a0e tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:30.214978 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1eb25cb1-32c9-4abb-b0fc-9c10c50344f6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:30.227819 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1eb25cb1-32c9-4abb-b0fc-9c10c50344f6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1498 microversion: 2.1 time: 0.334773 Jul 25 14:47:30.228522 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2379/4518] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:29 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1498 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:30.231967 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a43a6f1c-ff50-4a9a-9b69-b2135efa8a0e tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] 10.222.0.88 "GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.119418 Jul 25 14:47:30.232819 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2140/4519] 10.222.0.88 () {60 vars in 1337 bytes} [Mon Jul 25 14:47:30 2022] GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5/os-instance-actions => generated 611 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:47:30.249604 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ddb3fffa-763c-4037-9269-7b6b96c8fb8c tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:30.250529 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ddb3fffa-763c-4037-9269-7b6b96c8fb8c tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] [instance: 953b1654-3a01-4cb8-a129-d98e32e7c1a5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:30.259243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ddb3fffa-763c-4037-9269-7b6b96c8fb8c tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:30.259801 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ddb3fffa-763c-4037-9269-7b6b96c8fb8c tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:30.260533 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ddb3fffa-763c-4037-9269-7b6b96c8fb8c tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:30.261053 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ddb3fffa-763c-4037-9269-7b6b96c8fb8c tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:30.278185 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-ddb3fffa-763c-4037-9269-7b6b96c8fb8c tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] HTTP exception thrown: Instance 953b1654-3a01-4cb8-a129-d98e32e7c1a5 could not be found. Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ddb3fffa-763c-4037-9269-7b6b96c8fb8c tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Request method failure captured: Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5 HTTP/1.1 Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qzq8sjkLCB6uoJh9qsUu3CcHwGZ1ztZqT77WSLpUgiq3rCV1e9jP6iuUgCgXJ5-8lVwG1AnJiRVJk7EPntuVZq4LZ-XZ2_CUKi1XhNeWQ1cNvTZkBHtAviMml6Fewka1KaZBLxH-SyQg3sHaq60IPW6XNfj8cXaXuXRUhpfIXafS48 Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: X-Openstack-Nova-Api-Version: 2.21 Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 6fc80e38c63e4b7f9896bd407e3f0e24 Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-InstanceActionsV221TestJSON-152676182 Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6fc80e38c63e4b7f9896bd407e3f0e24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6fc80e38c63e4b7f9896bd407e3f0e24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6fc80e38c63e4b7f9896bd407e3f0e24", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6fc80e38c63e4b7f9896bd407e3f0e24"}]}] Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-InstanceActionsV221TestJSON-152676182 Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 6fc80e38c63e4b7f9896bd407e3f0e24 Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-152676182 Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-InstanceActionsV221TestJSON-152676182-project Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: cbdcc4a2177543a48cdb6bd3bc5b8d49 Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-InstanceActionsV221TestJSON-152676182-project Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 953b1654-3a01-4cb8-a129-d98e32e7c1a5 could not be found. Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '953b1654-3a01-4cb8-a129-d98e32e7c1a5'} Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 953b1654-3a01-4cb8-a129-d98e32e7c1a5 could not be found. Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:47:30.280126 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:47:30.285766 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 953b1654-3a01-4cb8-a129-d98e32e7c1a5 could not be found. Jul 25 14:47:30.285766 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:47:30.285766 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:47:30.285766 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:47:30.285766 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:47:30.285766 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:47:30.285766 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:47:30.285766 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:47:30.285766 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:47:30.285766 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 953b1654-3a01-4cb8-a129-d98e32e7c1a5 could not be found. Jul 25 14:47:30.285766 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:47:30.285766 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ddb3fffa-763c-4037-9269-7b6b96c8fb8c tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Returning 404 to user: Instance 953b1654-3a01-4cb8-a129-d98e32e7c1a5 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:47:30.285766 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ddb3fffa-763c-4037-9269-7b6b96c8fb8c tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] 10.222.0.88 "DELETE /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5" status: 404 len: 111 microversion: 2.21 time: 0.036590 Jul 25 14:47:30.291399 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f39668d4-8bf2-47a1-b9d5-6b6a912fd9a3 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:30.292044 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f39668d4-8bf2-47a1-b9d5-6b6a912fd9a3 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] [instance: 953b1654-3a01-4cb8-a129-d98e32e7c1a5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:30.295488 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2380/4520] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Jul 25 14:47:30 2022] DELETE /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 25 14:47:30.299470 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f39668d4-8bf2-47a1-b9d5-6b6a912fd9a3 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:30.299892 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f39668d4-8bf2-47a1-b9d5-6b6a912fd9a3 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:30.301091 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f39668d4-8bf2-47a1-b9d5-6b6a912fd9a3 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:30.301841 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f39668d4-8bf2-47a1-b9d5-6b6a912fd9a3 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:30.319168 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-f39668d4-8bf2-47a1-b9d5-6b6a912fd9a3 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] HTTP exception thrown: Instance 953b1654-3a01-4cb8-a129-d98e32e7c1a5 could not be found. Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f39668d4-8bf2-47a1-b9d5-6b6a912fd9a3 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Request method failure captured: Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5 HTTP/1.1 Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qzq8sjkLCB6uoJh9qsUu3CcHwGZ1ztZqT77WSLpUgiq3rCV1e9jP6iuUgCgXJ5-8lVwG1AnJiRVJk7EPntuVZq4LZ-XZ2_CUKi1XhNeWQ1cNvTZkBHtAviMml6Fewka1KaZBLxH-SyQg3sHaq60IPW6XNfj8cXaXuXRUhpfIXafS48 Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: X-Openstack-Nova-Api-Version: 2.21 Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 6fc80e38c63e4b7f9896bd407e3f0e24 Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-InstanceActionsV221TestJSON-152676182 Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6fc80e38c63e4b7f9896bd407e3f0e24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6fc80e38c63e4b7f9896bd407e3f0e24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6fc80e38c63e4b7f9896bd407e3f0e24", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6fc80e38c63e4b7f9896bd407e3f0e24"}]}] Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-InstanceActionsV221TestJSON-152676182 Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 6fc80e38c63e4b7f9896bd407e3f0e24 Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-152676182 Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-InstanceActionsV221TestJSON-152676182-project Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: cbdcc4a2177543a48cdb6bd3bc5b8d49 Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-InstanceActionsV221TestJSON-152676182-project Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 953b1654-3a01-4cb8-a129-d98e32e7c1a5 could not be found. Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '953b1654-3a01-4cb8-a129-d98e32e7c1a5'} Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 953b1654-3a01-4cb8-a129-d98e32e7c1a5 could not be found. Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 953b1654-3a01-4cb8-a129-d98e32e7c1a5 could not be found. Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:47:30.322964 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:47:30.328417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:47:30.328417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:47:30.328417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:47:30.328417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:47:30.328417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:47:30.328417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:47:30.328417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 953b1654-3a01-4cb8-a129-d98e32e7c1a5 could not be found. Jul 25 14:47:30.328417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:47:30.330183 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f39668d4-8bf2-47a1-b9d5-6b6a912fd9a3 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] Returning 404 to user: Instance 953b1654-3a01-4cb8-a129-d98e32e7c1a5 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:47:30.331233 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f39668d4-8bf2-47a1-b9d5-6b6a912fd9a3 tempest-InstanceActionsV221TestJSON-152676182 tempest-InstanceActionsV221TestJSON-152676182-project] 10.222.0.88 "GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5" status: 404 len: 111 microversion: 2.21 time: 0.044576 Jul 25 14:47:30.335878 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2141/4521] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:47:30 2022] GET /compute/v2.1/servers/953b1654-3a01-4cb8-a129-d98e32e7c1a5 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 25 14:47:31.254009 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9ede8cad-737f-4daa-9652-aeb2d493398c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:31.255252 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9ede8cad-737f-4daa-9652-aeb2d493398c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:31.269226 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ede8cad-737f-4daa-9652-aeb2d493398c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:31.269958 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ede8cad-737f-4daa-9652-aeb2d493398c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:31.271149 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ede8cad-737f-4daa-9652-aeb2d493398c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:31.271640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ede8cad-737f-4daa-9652-aeb2d493398c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:31.655823 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9ede8cad-737f-4daa-9652-aeb2d493398c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:31.677106 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9ede8cad-737f-4daa-9652-aeb2d493398c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1498 microversion: 2.1 time: 0.424187 Jul 25 14:47:31.680728 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2381/4522] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:31 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1498 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:32.707091 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ae2ff18a-15c8-4c38-bc5e-b7c49b3579f9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:32.708588 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ae2ff18a-15c8-4c38-bc5e-b7c49b3579f9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:32.733491 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae2ff18a-15c8-4c38-bc5e-b7c49b3579f9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:32.742857 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae2ff18a-15c8-4c38-bc5e-b7c49b3579f9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:32.744218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae2ff18a-15c8-4c38-bc5e-b7c49b3579f9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:32.747783 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae2ff18a-15c8-4c38-bc5e-b7c49b3579f9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:33.655592 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ae2ff18a-15c8-4c38-bc5e-b7c49b3579f9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:33.679632 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ae2ff18a-15c8-4c38-bc5e-b7c49b3579f9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1498 microversion: 2.1 time: 0.976804 Jul 25 14:47:33.694103 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2142/4523] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:32 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1498 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:34.711681 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dcb5e32b-4e30-40be-8cc4-1b8d0ddc7b94 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:34.712491 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dcb5e32b-4e30-40be-8cc4-1b8d0ddc7b94 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:34.735045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dcb5e32b-4e30-40be-8cc4-1b8d0ddc7b94 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:34.736491 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dcb5e32b-4e30-40be-8cc4-1b8d0ddc7b94 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:34.740584 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dcb5e32b-4e30-40be-8cc4-1b8d0ddc7b94 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:34.742215 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dcb5e32b-4e30-40be-8cc4-1b8d0ddc7b94 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:35.346781 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dcb5e32b-4e30-40be-8cc4-1b8d0ddc7b94 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:35.370043 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dcb5e32b-4e30-40be-8cc4-1b8d0ddc7b94 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1498 microversion: 2.1 time: 0.665227 Jul 25 14:47:35.370827 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2382/4524] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:34 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1498 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:36.393514 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-39867f17-730b-4880-b1b8-f52507c8dede tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:36.394141 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-39867f17-730b-4880-b1b8-f52507c8dede tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:36.405541 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-39867f17-730b-4880-b1b8-f52507c8dede tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:36.406019 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-39867f17-730b-4880-b1b8-f52507c8dede tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:36.407029 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-39867f17-730b-4880-b1b8-f52507c8dede tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:36.407574 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-39867f17-730b-4880-b1b8-f52507c8dede tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:36.417427 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:47:36.675681 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-39867f17-730b-4880-b1b8-f52507c8dede tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:36.687340 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-39867f17-730b-4880-b1b8-f52507c8dede tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1498 microversion: 2.1 time: 0.297923 Jul 25 14:47:36.688631 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2143/4525] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:36 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1498 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:37.716926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-47e00938-97d1-4fcf-abeb-ae1fba35b6e2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:37.719345 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-47e00938-97d1-4fcf-abeb-ae1fba35b6e2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:37.733015 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-47e00938-97d1-4fcf-abeb-ae1fba35b6e2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:37.734706 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-47e00938-97d1-4fcf-abeb-ae1fba35b6e2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:37.736528 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-47e00938-97d1-4fcf-abeb-ae1fba35b6e2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:37.737343 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-47e00938-97d1-4fcf-abeb-ae1fba35b6e2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:38.076388 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-47e00938-97d1-4fcf-abeb-ae1fba35b6e2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:38.090882 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-47e00938-97d1-4fcf-abeb-ae1fba35b6e2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1498 microversion: 2.1 time: 0.382376 Jul 25 14:47:38.091916 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2383/4526] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:37 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1498 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:39.118702 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6fb0286e-b1d5-4058-b6cc-df018f76826c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:39.119532 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6fb0286e-b1d5-4058-b6cc-df018f76826c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:39.138808 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:47:39.143729 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6fb0286e-b1d5-4058-b6cc-df018f76826c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:39.144174 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6fb0286e-b1d5-4058-b6cc-df018f76826c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:39.145069 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6fb0286e-b1d5-4058-b6cc-df018f76826c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:39.145520 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6fb0286e-b1d5-4058-b6cc-df018f76826c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:39.427202 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6fb0286e-b1d5-4058-b6cc-df018f76826c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:39.437933 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6fb0286e-b1d5-4058-b6cc-df018f76826c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1498 microversion: 2.1 time: 0.324445 Jul 25 14:47:39.454392 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2144/4527] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:39 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1498 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:47:40.470613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2fb11904-7265-4ce4-8223-09cf708b6a58 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:40.471507 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2fb11904-7265-4ce4-8223-09cf708b6a58 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:40.491575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2fb11904-7265-4ce4-8223-09cf708b6a58 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:40.492231 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2fb11904-7265-4ce4-8223-09cf708b6a58 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:40.494526 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2fb11904-7265-4ce4-8223-09cf708b6a58 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:40.499246 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2fb11904-7265-4ce4-8223-09cf708b6a58 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:40.847647 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2fb11904-7265-4ce4-8223-09cf708b6a58 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:40.859876 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2fb11904-7265-4ce4-8223-09cf708b6a58 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1498 microversion: 2.1 time: 0.393879 Jul 25 14:47:40.862000 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2384/4528] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:40 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1498 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:41.888306 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-561a83ad-0e01-40f2-a8fd-a2c30f5a753a tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:41.889105 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-561a83ad-0e01-40f2-a8fd-a2c30f5a753a tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:41.902896 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-561a83ad-0e01-40f2-a8fd-a2c30f5a753a tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:41.903655 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-561a83ad-0e01-40f2-a8fd-a2c30f5a753a tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:41.904730 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-561a83ad-0e01-40f2-a8fd-a2c30f5a753a tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:41.905497 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-561a83ad-0e01-40f2-a8fd-a2c30f5a753a tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:42.398206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-561a83ad-0e01-40f2-a8fd-a2c30f5a753a tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:42.412703 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-561a83ad-0e01-40f2-a8fd-a2c30f5a753a tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1498 microversion: 2.1 time: 0.532103 Jul 25 14:47:42.439575 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2145/4529] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:41 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1498 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:43.438590 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8671dede-f4b5-43cc-a813-8c6425a1f165 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:43.439203 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8671dede-f4b5-43cc-a813-8c6425a1f165 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:43.457184 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8671dede-f4b5-43cc-a813-8c6425a1f165 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:43.460406 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8671dede-f4b5-43cc-a813-8c6425a1f165 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:43.461390 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8671dede-f4b5-43cc-a813-8c6425a1f165 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:43.467856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8671dede-f4b5-43cc-a813-8c6425a1f165 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:44.111084 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8671dede-f4b5-43cc-a813-8c6425a1f165 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:44.124853 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8671dede-f4b5-43cc-a813-8c6425a1f165 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1498 microversion: 2.1 time: 0.691398 Jul 25 14:47:44.128097 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2385/4530] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:43 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1498 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:45.166266 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-555a118e-067d-4966-9163-9ac90007fd70 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:45.167561 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-555a118e-067d-4966-9163-9ac90007fd70 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:45.178189 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-555a118e-067d-4966-9163-9ac90007fd70 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:45.179174 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-555a118e-067d-4966-9163-9ac90007fd70 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:45.182551 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-555a118e-067d-4966-9163-9ac90007fd70 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:45.184243 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-555a118e-067d-4966-9163-9ac90007fd70 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:45.622368 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-555a118e-067d-4966-9163-9ac90007fd70 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:45.637244 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-555a118e-067d-4966-9163-9ac90007fd70 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1498 microversion: 2.1 time: 0.491911 Jul 25 14:47:45.637823 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2146/4531] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:45 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1498 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:46.662802 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-770e045c-fc69-428a-a582-c808f62e1292 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:46.663565 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-770e045c-fc69-428a-a582-c808f62e1292 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:46.677065 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-770e045c-fc69-428a-a582-c808f62e1292 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:46.678736 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-770e045c-fc69-428a-a582-c808f62e1292 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:46.679950 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-770e045c-fc69-428a-a582-c808f62e1292 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:46.686542 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-770e045c-fc69-428a-a582-c808f62e1292 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:46.981844 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-770e045c-fc69-428a-a582-c808f62e1292 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:47.010509 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-770e045c-fc69-428a-a582-c808f62e1292 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1498 microversion: 2.1 time: 0.353279 Jul 25 14:47:47.031617 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2386/4532] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:46 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1498 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:47.193338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e7e9af63-4243-4939-a83f-e03a40388d62 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:47.196168 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e7e9af63-4243-4939-a83f-e03a40388d62 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:47.223559 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e7e9af63-4243-4939-a83f-e03a40388d62 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:47.224049 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e7e9af63-4243-4939-a83f-e03a40388d62 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:47.224895 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e7e9af63-4243-4939-a83f-e03a40388d62 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:47.225632 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e7e9af63-4243-4939-a83f-e03a40388d62 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:47.286320 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e7e9af63-4243-4939-a83f-e03a40388d62 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102906 Jul 25 14:47:47.287566 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2147/4533] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:47:47 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 14:47:47.689582 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a47d923f-b1cb-4e25-8a64-42d55963fd0b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:47.690189 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a47d923f-b1cb-4e25-8a64-42d55963fd0b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:47.701979 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a47d923f-b1cb-4e25-8a64-42d55963fd0b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:47.702439 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a47d923f-b1cb-4e25-8a64-42d55963fd0b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:47.703374 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a47d923f-b1cb-4e25-8a64-42d55963fd0b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:47.717645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a47d923f-b1cb-4e25-8a64-42d55963fd0b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:47.789828 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a47d923f-b1cb-4e25-8a64-42d55963fd0b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:47:48.040335 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7417d754-8b3a-474c-a3ac-99cee965bf75 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:48.041281 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7417d754-8b3a-474c-a3ac-99cee965bf75 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:48.053540 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a47d923f-b1cb-4e25-8a64-42d55963fd0b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "DELETE /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 204 len: 0 microversion: 2.1 time: 0.368604 Jul 25 14:47:48.057179 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7417d754-8b3a-474c-a3ac-99cee965bf75 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:48.058519 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2387/4534] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:47:47 2022] DELETE /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:47:48.059205 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7417d754-8b3a-474c-a3ac-99cee965bf75 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:48.064725 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7417d754-8b3a-474c-a3ac-99cee965bf75 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:48.065414 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7417d754-8b3a-474c-a3ac-99cee965bf75 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:48.081282 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-aebc912a-b1ae-436b-a7b6-f288eac86be5 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:48.086529 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-aebc912a-b1ae-436b-a7b6-f288eac86be5 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:48.117035 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aebc912a-b1ae-436b-a7b6-f288eac86be5 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:48.118302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aebc912a-b1ae-436b-a7b6-f288eac86be5 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:48.119130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aebc912a-b1ae-436b-a7b6-f288eac86be5 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:48.128180 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aebc912a-b1ae-436b-a7b6-f288eac86be5 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:48.234477 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:47:48.415436 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7417d754-8b3a-474c-a3ac-99cee965bf75 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:48.432503 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7417d754-8b3a-474c-a3ac-99cee965bf75 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 200 len: 1475 microversion: 2.1 time: 0.395968 Jul 25 14:47:48.434607 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2148/4535] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:48 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 1475 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:48.463797 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f71e8027-79e8-4aaa-8b60-2e72589bf423 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1023039084"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:47:48.466744 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f71e8027-79e8-4aaa-8b60-2e72589bf423 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:48.484191 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f71e8027-79e8-4aaa-8b60-2e72589bf423 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:48.484656 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f71e8027-79e8-4aaa-8b60-2e72589bf423 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:48.487860 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f71e8027-79e8-4aaa-8b60-2e72589bf423 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:48.488381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f71e8027-79e8-4aaa-8b60-2e72589bf423 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:48.597230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-aebc912a-b1ae-436b-a7b6-f288eac86be5 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:48.628705 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-aebc912a-b1ae-436b-a7b6-f288eac86be5 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1673 microversion: 2.1 time: 0.565418 Jul 25 14:47:48.629329 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2388/4536] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:48 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1673 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:48.976499 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f71e8027-79e8-4aaa-8b60-2e72589bf423 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "POST /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b/action" status: 202 len: 0 microversion: 2.1 time: 0.517669 Jul 25 14:47:48.980638 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2149/4537] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:47:48 2022] POST /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b/action => generated 0 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 14:47:48.993752 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-64e1c117-a646-44ee-8c24-90cc7f8605c8 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46987cf820>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:49.118066 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-64e1c117-a646-44ee-8c24-90cc7f8605c8 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1412 microversion: 2.1 time: 0.128976 Jul 25 14:47:49.119961 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2389/4538] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:47:48 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1412 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:49.656830 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b24ffee5-ae46-417d-b8c1-3db88bc8935e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:49.657568 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b24ffee5-ae46-417d-b8c1-3db88bc8935e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:49.682396 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b24ffee5-ae46-417d-b8c1-3db88bc8935e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:49.682857 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b24ffee5-ae46-417d-b8c1-3db88bc8935e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:49.683861 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b24ffee5-ae46-417d-b8c1-3db88bc8935e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:49.684483 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b24ffee5-ae46-417d-b8c1-3db88bc8935e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:50.026663 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b24ffee5-ae46-417d-b8c1-3db88bc8935e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:50.039331 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b24ffee5-ae46-417d-b8c1-3db88bc8935e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1673 microversion: 2.1 time: 0.389207 Jul 25 14:47:50.042454 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2150/4539] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:49 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1673 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:50.136179 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-85d1de98-cd8c-4f6e-ac13-743ac67ee307 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46989034c0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:50.213747 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-85d1de98-cd8c-4f6e-ac13-743ac67ee307 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1412 microversion: 2.1 time: 0.082611 Jul 25 14:47:50.224424 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2390/4540] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:47:50 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1412 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:51.064085 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-54dcbff5-5069-4418-abff-03963174dae4 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:51.065289 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-54dcbff5-5069-4418-abff-03963174dae4 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:51.077828 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-54dcbff5-5069-4418-abff-03963174dae4 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:51.078574 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-54dcbff5-5069-4418-abff-03963174dae4 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:51.079664 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-54dcbff5-5069-4418-abff-03963174dae4 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:51.080292 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-54dcbff5-5069-4418-abff-03963174dae4 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:51.231034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e54b74d5-e8d9-497a-a6c2-90ac33bb670a tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f468639a280>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:51.306827 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e54b74d5-e8d9-497a-a6c2-90ac33bb670a tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1412 microversion: 2.1 time: 0.081166 Jul 25 14:47:51.310539 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2391/4541] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:47:51 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1412 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:51.496494 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-54dcbff5-5069-4418-abff-03963174dae4 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:51.508315 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-54dcbff5-5069-4418-abff-03963174dae4 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1673 microversion: 2.1 time: 0.448416 Jul 25 14:47:51.512271 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2151/4542] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:51 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1673 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:51.710125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c04ccbca-9456-4564-95a5-a0f6f9bf82f8 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-206609013", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "66b410cc-87e7-413e-8935-1406376ebc30"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:47:51.824196 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-c04ccbca-9456-4564-95a5-a0f6f9bf82f8 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] validate_networks() for [('66b410cc-87e7-413e-8935-1406376ebc30', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:47:52.326346 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0955aa71-bdf2-4cd6-9d0d-addae256da4a tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f4686738820>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:52.443775 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0955aa71-bdf2-4cd6-9d0d-addae256da4a tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1412 microversion: 2.1 time: 0.121539 Jul 25 14:47:52.445984 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2152/4543] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:47:52 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1412 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:52.531371 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7570f632-f157-493e-a80f-187635090089 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:52.532346 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7570f632-f157-493e-a80f-187635090089 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:52.554466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7570f632-f157-493e-a80f-187635090089 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:52.555383 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7570f632-f157-493e-a80f-187635090089 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:52.584976 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7570f632-f157-493e-a80f-187635090089 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:52.587775 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7570f632-f157-493e-a80f-187635090089 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:52.876741 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7570f632-f157-493e-a80f-187635090089 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:52.888386 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7570f632-f157-493e-a80f-187635090089 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1606 microversion: 2.1 time: 0.361389 Jul 25 14:47:52.893389 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2153/4544] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:52 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1606 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:47:53.160110 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-4d8f2146-d45c-4251-b8cc-b2cd26ed64e5 req-d8da7861-fa91-41c7-ba27-52ef8f95dd75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5866023-cfeb-43b0-9788-334b6ad4b850", "name": "network-vif-deleted", "tag": "3ad83701-32d5-4489-b9ac-492dd82d885c"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:47:53.184229 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-4d8f2146-d45c-4251-b8cc-b2cd26ed64e5 req-d8da7861-fa91-41c7-ba27-52ef8f95dd75 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:53.192556 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-4d8f2146-d45c-4251-b8cc-b2cd26ed64e5 req-d8da7861-fa91-41c7-ba27-52ef8f95dd75 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:53.230739 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-4d8f2146-d45c-4251-b8cc-b2cd26ed64e5 req-d8da7861-fa91-41c7-ba27-52ef8f95dd75 service nova] Creating event network-vif-deleted:3ad83701-32d5-4489-b9ac-492dd82d885c for instance e5866023-cfeb-43b0-9788-334b6ad4b850 on n-h2-846435-14 Jul 25 14:47:53.243177 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-4d8f2146-d45c-4251-b8cc-b2cd26ed64e5 req-d8da7861-fa91-41c7-ba27-52ef8f95dd75 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086756 Jul 25 14:47:53.247563 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2154/4545] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:47:53.461723 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a3adcf82-aa09-404a-b80a-c5d4d29bf894 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46989bb550>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:53.598806 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a3adcf82-aa09-404a-b80a-c5d4d29bf894 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1412 microversion: 2.1 time: 0.142605 Jul 25 14:47:53.599413 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2155/4546] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:47:53 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1412 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:47:53.609509 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-c04ccbca-9456-4564-95a5-a0f6f9bf82f8 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:47:53.610129 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-c04ccbca-9456-4564-95a5-a0f6f9bf82f8 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:47:53.610378 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-c04ccbca-9456-4564-95a5-a0f6f9bf82f8 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:47:53.611642 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-c04ccbca-9456-4564-95a5-a0f6f9bf82f8 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:47:53.612354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-c04ccbca-9456-4564-95a5-a0f6f9bf82f8 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:47:53.614985 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:47:53.656434 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c04ccbca-9456-4564-95a5-a0f6f9bf82f8 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:53.657190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c04ccbca-9456-4564-95a5-a0f6f9bf82f8 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:53.658297 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c04ccbca-9456-4564-95a5-a0f6f9bf82f8 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:53.658889 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c04ccbca-9456-4564-95a5-a0f6f9bf82f8 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:53.729622 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-c04ccbca-9456-4564-95a5-a0f6f9bf82f8 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Getting quotas for project 23224ac0b91a4c1ca9ee4f30d5f6b25d. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:47:53.749274 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-c04ccbca-9456-4564-95a5-a0f6f9bf82f8 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Getting quotas for user 1486c9b817ac48ec9ce86571ce754fb8 and project 23224ac0b91a4c1ca9ee4f30d5f6b25d. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:47:53.806283 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c04ccbca-9456-4564-95a5-a0f6f9bf82f8 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:47:53.822176 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c04ccbca-9456-4564-95a5-a0f6f9bf82f8 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] [instance: e18669b5-0442-4689-836a-5971c684b0c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:47:53.915397 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cf6276e8-51e1-4d7f-bac8-1b89ee66c164 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:53.916736 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cf6276e8-51e1-4d7f-bac8-1b89ee66c164 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:53.928348 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf6276e8-51e1-4d7f-bac8-1b89ee66c164 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:53.935815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf6276e8-51e1-4d7f-bac8-1b89ee66c164 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:53.937234 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf6276e8-51e1-4d7f-bac8-1b89ee66c164 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:53.940633 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf6276e8-51e1-4d7f-bac8-1b89ee66c164 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:54.024449 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c04ccbca-9456-4564-95a5-a0f6f9bf82f8 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.712693 Jul 25 14:47:54.030493 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2392/4547] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:47:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:47:54.052812 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3ac33de1-32bb-4301-9b4f-c9bb1c6b6792 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:54.054640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3ac33de1-32bb-4301-9b4f-c9bb1c6b6792 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] [instance: e18669b5-0442-4689-836a-5971c684b0c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:54.096225 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf6276e8-51e1-4d7f-bac8-1b89ee66c164 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:54.097373 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf6276e8-51e1-4d7f-bac8-1b89ee66c164 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:54.098675 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-cf6276e8-51e1-4d7f-bac8-1b89ee66c164 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lazy-loading 'fault' on Instance uuid e5866023-cfeb-43b0-9788-334b6ad4b850 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:47:54.210426 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cf6276e8-51e1-4d7f-bac8-1b89ee66c164 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:54.225103 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cf6276e8-51e1-4d7f-bac8-1b89ee66c164 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 200 len: 1328 microversion: 2.1 time: 0.313713 Jul 25 14:47:54.242181 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2156/4548] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:53 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 1328 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:54.359605 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3ac33de1-32bb-4301-9b4f-c9bb1c6b6792 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486c9b817ac48ec9ce86571ce754fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23224ac0b91a4c1ca9ee4f30d5f6b25d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:54.372971 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3ac33de1-32bb-4301-9b4f-c9bb1c6b6792 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] 10.222.0.88 "GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8" status: 200 len: 1224 microversion: 2.1 time: 0.334652 Jul 25 14:47:54.376183 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2393/4549] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:54 2022] GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8 => generated 1224 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:54.558820 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-4bbb4c0f-60c7-4ae8-8e6c-d571353209ed req-b0dbd426-cc5a-4219-8b58-89fc170d671c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdf119f5-416e-456f-86d6-8acff67d7c9b", "name": "network-vif-plugged", "status": "completed", "tag": "94e2f165-153f-4c22-881e-01b36ec8ec5d"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:47:54.585989 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-4bbb4c0f-60c7-4ae8-8e6c-d571353209ed req-b0dbd426-cc5a-4219-8b58-89fc170d671c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:54.587185 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-4bbb4c0f-60c7-4ae8-8e6c-d571353209ed req-b0dbd426-cc5a-4219-8b58-89fc170d671c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:54.604029 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-4bbb4c0f-60c7-4ae8-8e6c-d571353209ed req-b0dbd426-cc5a-4219-8b58-89fc170d671c service nova] Creating event network-vif-plugged:94e2f165-153f-4c22-881e-01b36ec8ec5d for instance bdf119f5-416e-456f-86d6-8acff67d7c9b on n-h1-846435-14 Jul 25 14:47:54.617743 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-df4cee37-3f3f-4dc5-bc8d-74e5f01fb4a9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46864ebee0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:54.639232 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-4bbb4c0f-60c7-4ae8-8e6c-d571353209ed req-b0dbd426-cc5a-4219-8b58-89fc170d671c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084689 Jul 25 14:47:54.656448 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2157/4550] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:47:54.699955 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-df4cee37-3f3f-4dc5-bc8d-74e5f01fb4a9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1412 microversion: 2.1 time: 0.089306 Jul 25 14:47:54.701443 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2394/4551] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:47:54 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1412 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:54.998558 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b8ff2450-1d4f-4125-8207-b9e4f65f37f2 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:54.999672 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b8ff2450-1d4f-4125-8207-b9e4f65f37f2 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:55.015139 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8ff2450-1d4f-4125-8207-b9e4f65f37f2 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:55.027900 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8ff2450-1d4f-4125-8207-b9e4f65f37f2 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:55.033050 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8ff2450-1d4f-4125-8207-b9e4f65f37f2 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:55.039652 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8ff2450-1d4f-4125-8207-b9e4f65f37f2 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:55.263949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-86b38f35-a91e-4159-a3aa-072cb2343bbf tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:55.264875 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-86b38f35-a91e-4159-a3aa-072cb2343bbf tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:55.285635 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-86b38f35-a91e-4159-a3aa-072cb2343bbf tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:55.287311 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-86b38f35-a91e-4159-a3aa-072cb2343bbf tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:55.290701 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-86b38f35-a91e-4159-a3aa-072cb2343bbf tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:55.317671 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-86b38f35-a91e-4159-a3aa-072cb2343bbf tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:55.375939 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-86b38f35-a91e-4159-a3aa-072cb2343bbf tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] HTTP exception thrown: Instance e5866023-cfeb-43b0-9788-334b6ad4b850 could not be found. Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-86b38f35-a91e-4159-a3aa-072cb2343bbf tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Request method failure captured: Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 HTTP/1.1 Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qvmoQ3iOfSK0hVwpax8Cw2RBsdAfQl7sdfNVCK7qIkkXMGrQx5bveqINsWadN-IUWz-CGgJ1lhdczwWJtQjjn6gH67b-srQUCoNXKQz-p9lw0s_dp_QsXzym4T6UhDkE9WLRmEhf1jdH9KtF2RRAEvfidvnn968SPiTK1PokI1_PpM Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: b80269077ccc4482a91cb9e6b1d911b5 Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-AttachVolumeTestJSON-1980933828 Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b80269077ccc4482a91cb9e6b1d911b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b80269077ccc4482a91cb9e6b1d911b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b80269077ccc4482a91cb9e6b1d911b5", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b80269077ccc4482a91cb9e6b1d911b5"}]}] Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-AttachVolumeTestJSON-1980933828 Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: b80269077ccc4482a91cb9e6b1d911b5 Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1980933828 Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-AttachVolumeTestJSON-1980933828-project Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 0d7e3180b05b4f9fb877d031b73b5ee2 Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-AttachVolumeTestJSON-1980933828-project Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance e5866023-cfeb-43b0-9788-334b6ad4b850 could not be found. Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'e5866023-cfeb-43b0-9788-334b6ad4b850'} Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5866023-cfeb-43b0-9788-334b6ad4b850 could not be found. Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5866023-cfeb-43b0-9788-334b6ad4b850 could not be found. Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:47:55.380076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:47:55.384105 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:47:55.384105 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:47:55.384105 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:47:55.384105 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:47:55.384105 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:47:55.384105 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5866023-cfeb-43b0-9788-334b6ad4b850 could not be found. Jul 25 14:47:55.384105 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:47:55.389369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-86b38f35-a91e-4159-a3aa-072cb2343bbf tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Returning 404 to user: Instance e5866023-cfeb-43b0-9788-334b6ad4b850 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:47:55.395180 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-86b38f35-a91e-4159-a3aa-072cb2343bbf tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 404 len: 111 microversion: 2.1 time: 0.136567 Jul 25 14:47:55.399259 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2395/4552] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:55 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:47:55.416658 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6ecc4d11-30b3-4f73-ba33-dac14524facf tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:55.428918 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6ecc4d11-30b3-4f73-ba33-dac14524facf tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] [instance: e18669b5-0442-4689-836a-5971c684b0c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:55.588433 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6ecc4d11-30b3-4f73-ba33-dac14524facf tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486c9b817ac48ec9ce86571ce754fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23224ac0b91a4c1ca9ee4f30d5f6b25d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:55.606117 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6ecc4d11-30b3-4f73-ba33-dac14524facf tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] 10.222.0.88 "GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8" status: 200 len: 1224 microversion: 2.1 time: 0.205355 Jul 25 14:47:55.625018 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2396/4553] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:55 2022] GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8 => generated 1224 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:55.633025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8705536d-94f5-4618-854c-c5c2821f295d tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '.version_select at 0x7f468644c310>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:55.714381 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8705536d-94f5-4618-854c-c5c2821f295d tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1552429995" status: 202 len: 0 microversion: 2.1 time: 0.088084 Jul 25 14:47:55.718723 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2397/4554] 10.222.0.88 () {58 vars in 1221 bytes} [Mon Jul 25 14:47:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1552429995 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:47:55.723967 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d64df170-631b-4c84-8398-d2f6c59126a6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f468652eaf0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:55.886651 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d64df170-631b-4c84-8398-d2f6c59126a6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1412 microversion: 2.1 time: 0.166681 Jul 25 14:47:55.894795 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2398/4555] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:47:55 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1412 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:56.014049 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b8ff2450-1d4f-4125-8207-b9e4f65f37f2 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:56.039113 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b8ff2450-1d4f-4125-8207-b9e4f65f37f2 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:56.049292 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b8ff2450-1d4f-4125-8207-b9e4f65f37f2 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:56.053656 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b8ff2450-1d4f-4125-8207-b9e4f65f37f2 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 2945 microversion: 2.32 time: 1.058467 Jul 25 14:47:56.058584 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2158/4556] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:47:54 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 2945 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:47:56.089172 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-09df60cc-7326-4843-9d91-868f76cedc61 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:56.096424 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-09df60cc-7326-4843-9d91-868f76cedc61 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:56.113303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09df60cc-7326-4843-9d91-868f76cedc61 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:56.114178 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09df60cc-7326-4843-9d91-868f76cedc61 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:56.115261 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09df60cc-7326-4843-9d91-868f76cedc61 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:56.117439 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09df60cc-7326-4843-9d91-868f76cedc61 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:56.477028 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-09df60cc-7326-4843-9d91-868f76cedc61 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.395560 Jul 25 14:47:56.477676 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2399/4557] 10.222.0.88 () {60 vars in 1316 bytes} [Mon Jul 25 14:47:56 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09/os-interface => generated 1830 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:47:56.639571 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-49840136-43f2-497a-96d3-b1d02e967031 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:56.640514 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-49840136-43f2-497a-96d3-b1d02e967031 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] [instance: e18669b5-0442-4689-836a-5971c684b0c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:56.674979 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-49840136-43f2-497a-96d3-b1d02e967031 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:56.677982 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-49840136-43f2-497a-96d3-b1d02e967031 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:56.680768 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-49840136-43f2-497a-96d3-b1d02e967031 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:56.682392 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-49840136-43f2-497a-96d3-b1d02e967031 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:56.711655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-89e591a6-92de-4cb6-9025-4193dfb2520f tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:56.712893 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-89e591a6-92de-4cb6-9025-4193dfb2520f tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: f5e1c62b-88b7-4ec7-a2f3-b99b1566baab] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:56.738104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-89e591a6-92de-4cb6-9025-4193dfb2520f tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:56.738886 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-89e591a6-92de-4cb6-9025-4193dfb2520f tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:56.741588 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-89e591a6-92de-4cb6-9025-4193dfb2520f tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:56.746137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-89e591a6-92de-4cb6-9025-4193dfb2520f tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:56.840304 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-89e591a6-92de-4cb6-9025-4193dfb2520f tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab/ips" status: 200 len: 150 microversion: 2.1 time: 0.132830 Jul 25 14:47:56.841498 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2400/4558] 10.222.0.88 () {58 vars in 1248 bytes} [Mon Jul 25 14:47:56 2022] GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab/ips => generated 150 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:47:56.866503 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b600a16d-cc75-4ecf-91be-db5608cdd4d6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3e80da1-cc81-443e-8641-53a150fd4891"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:47:56.871583 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b600a16d-cc75-4ecf-91be-db5608cdd4d6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: f5e1c62b-88b7-4ec7-a2f3-b99b1566baab] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:56.890002 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b600a16d-cc75-4ecf-91be-db5608cdd4d6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:56.891857 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b600a16d-cc75-4ecf-91be-db5608cdd4d6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:56.893203 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b600a16d-cc75-4ecf-91be-db5608cdd4d6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:56.908834 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b600a16d-cc75-4ecf-91be-db5608cdd4d6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:57.122213 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-b600a16d-cc75-4ecf-91be-db5608cdd4d6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] HTTP exception thrown: Invalid volume: volume d3e80da1-cc81-443e-8641-53a150fd4891 is already attached to instances: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4 Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b600a16d-cc75-4ecf-91be-db5608cdd4d6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Request method failure captured: Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab/os-volume_attachments HTTP/1.1 Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 74 Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qxVTVC8FUnn-t2qK29pQ6gpvvVkF5Cd1ek9O6-ax9bIU4h-Acw7IM2XyPTWfCK6LWhHPoO7fpkEcbhitPiuVrA5WlFZ0WfmMB-2I-MAtgO20bt12dRN-m_gApdOXiuB_IoQnmtlPGVQzahhzXBQE11eo5L_JzE39RyLIYMYF8wTD50 Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 325aff76e61141a985b3b0f45521444f Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/325aff76e61141a985b3b0f45521444f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/325aff76e61141a985b3b0f45521444f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_325aff76e61141a985b3b0f45521444f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/325aff76e61141a985b3b0f45521444f"}]}] Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 325aff76e61141a985b3b0f45521444f Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-AttachVolumeNegativeTest-1959370092-project Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 571a2d92d7a34f86bb3c0bfdfcabc5ff Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-AttachVolumeNegativeTest-1959370092-project Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: {"volumeAttachment": {"volumeId": "d3e80da1-cc81-443e-8641-53a150fd4891"}} Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: exception: Invalid volume: volume d3e80da1-cc81-443e-8641-53a150fd4891 is already attached to instances: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4 Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'server_id': 'f5e1c62b-88b7-4ec7-a2f3-b99b1566baab', 'body': {'volumeAttachment': {'volumeId': 'd3e80da1-cc81-443e-8641-53a150fd4891'}}} Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d3e80da1-cc81-443e-8641-53a150fd4891 is already attached to instances: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4 Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:47:57.124530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:47:57.130089 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:47:57.130089 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:47:57.130089 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 25 14:47:57.130089 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 14:47:57.130089 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d3e80da1-cc81-443e-8641-53a150fd4891 is already attached to instances: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4 Jul 25 14:47:57.130089 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:47:57.130089 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:47:57.130089 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:47:57.130089 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:47:57.130089 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:47:57.130089 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:47:57.130089 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:47:57.130089 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:47:57.130089 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d3e80da1-cc81-443e-8641-53a150fd4891 is already attached to instances: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4 Jul 25 14:47:57.130089 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:47:57.133734 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b600a16d-cc75-4ecf-91be-db5608cdd4d6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Returning 400 to user: Invalid volume: volume d3e80da1-cc81-443e-8641-53a150fd4891 is already attached to instances: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4 {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:47:57.135476 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b600a16d-cc75-4ecf-91be-db5608cdd4d6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "POST /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.286390 Jul 25 14:47:57.136824 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2401/4559] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Jul 25 14:47:56 2022] POST /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab/os-volume_attachments => generated 174 bytes in 288 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:47:57.147760 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-da2c807e-c86f-4e49-98a1-c7542ae24a5f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f468652e550>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:57.208860 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-da2c807e-c86f-4e49-98a1-c7542ae24a5f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1412 microversion: 2.1 time: 0.070353 Jul 25 14:47:57.210813 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2402/4560] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:47:57 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1412 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:57.216981 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4eb2a449-da02-43cb-89eb-5f57461a4973 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:57.217835 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4eb2a449-da02-43cb-89eb-5f57461a4973 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: f5e1c62b-88b7-4ec7-a2f3-b99b1566baab] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:57.227322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4eb2a449-da02-43cb-89eb-5f57461a4973 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:57.228335 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4eb2a449-da02-43cb-89eb-5f57461a4973 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:57.229296 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4eb2a449-da02-43cb-89eb-5f57461a4973 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:57.230246 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4eb2a449-da02-43cb-89eb-5f57461a4973 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:57.264631 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4eb2a449-da02-43cb-89eb-5f57461a4973 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: f5e1c62b-88b7-4ec7-a2f3-b99b1566baab] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:47:57.432549 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4eb2a449-da02-43cb-89eb-5f57461a4973 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "DELETE /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab" status: 204 len: 0 microversion: 2.1 time: 0.219669 Jul 25 14:47:57.433906 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2403/4561] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:47:57 2022] DELETE /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:47:57.450418 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5ad94e1e-7f56-4e79-a53b-1da74bdc3b65 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:57.454164 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5ad94e1e-7f56-4e79-a53b-1da74bdc3b65 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: f5e1c62b-88b7-4ec7-a2f3-b99b1566baab] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:57.489274 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ad94e1e-7f56-4e79-a53b-1da74bdc3b65 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:57.489750 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ad94e1e-7f56-4e79-a53b-1da74bdc3b65 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:57.496156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ad94e1e-7f56-4e79-a53b-1da74bdc3b65 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:57.496617 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ad94e1e-7f56-4e79-a53b-1da74bdc3b65 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:57.811880 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-49840136-43f2-497a-96d3-b1d02e967031 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486c9b817ac48ec9ce86571ce754fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23224ac0b91a4c1ca9ee4f30d5f6b25d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:57.831950 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-49840136-43f2-497a-96d3-b1d02e967031 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] 10.222.0.88 "GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8" status: 200 len: 1284 microversion: 2.1 time: 1.202455 Jul 25 14:47:57.832743 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2159/4562] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:56 2022] GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8 => generated 1284 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:57.846908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5ad94e1e-7f56-4e79-a53b-1da74bdc3b65 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:57.859196 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5ad94e1e-7f56-4e79-a53b-1da74bdc3b65 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab" status: 200 len: 1683 microversion: 2.1 time: 0.417566 Jul 25 14:47:57.871630 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2404/4563] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:57 2022] GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab => generated 1683 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:58.234217 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0870d18b-d875-4dee-a5e2-4f6683bf9bdb tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46866deee0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:58.405985 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0870d18b-d875-4dee-a5e2-4f6683bf9bdb tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1412 microversion: 2.1 time: 0.178567 Jul 25 14:47:58.412859 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2160/4564] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:47:58 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1412 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:58.762169 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1c2c42ce-40f1-468e-b2ed-c78582354c7b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Action: 'create', calling method: .version_select at 0x7f4698888040>, body: {"keypair": {"name": "tempest-keypair-2147391423", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnJqEY2bWG7YRIwIrgejjnIrlalAaCAPwjELjaPFYW0WqhDIxQiBTa6bKS6YsT1/Yrfgmo8MTKtIhTpzCRS56Dgh2oRadGVKKppusfWQJ4ZRZj6+bLA7RVWlytzX/iNmg=="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:47:58.840705 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-1c2c42ce-40f1-468e-b2ed-c78582354c7b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Getting quotas for project b80269077ccc4482a91cb9e6b1d911b5. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:47:58.856950 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5f8a5f0d-b9b6-4226-9385-4924081c4016 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:58.861592 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-1c2c42ce-40f1-468e-b2ed-c78582354c7b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Getting quotas for user 0d7e3180b05b4f9fb877d031b73b5ee2 and project b80269077ccc4482a91cb9e6b1d911b5. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:47:58.867175 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5f8a5f0d-b9b6-4226-9385-4924081c4016 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] [instance: e18669b5-0442-4689-836a-5971c684b0c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:58.901832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f8a5f0d-b9b6-4226-9385-4924081c4016 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:58.906377 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f8a5f0d-b9b6-4226-9385-4924081c4016 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:58.912156 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f8a5f0d-b9b6-4226-9385-4924081c4016 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:58.918913 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f8a5f0d-b9b6-4226-9385-4924081c4016 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:58.924688 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1c2c42ce-40f1-468e-b2ed-c78582354c7b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.170763 Jul 25 14:47:58.932216 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2405/4565] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:47:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:47:58.944716 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1ed735f3-bb94-4a16-88f5-fe741f64ca2e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:58.953075 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1ed735f3-bb94-4a16-88f5-fe741f64ca2e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: f5e1c62b-88b7-4ec7-a2f3-b99b1566baab] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:47:58.964383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1ed735f3-bb94-4a16-88f5-fe741f64ca2e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:58.965521 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1ed735f3-bb94-4a16-88f5-fe741f64ca2e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:58.966713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1ed735f3-bb94-4a16-88f5-fe741f64ca2e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:47:58.967472 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1ed735f3-bb94-4a16-88f5-fe741f64ca2e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:47:59.704525 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5f8a5f0d-b9b6-4226-9385-4924081c4016 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486c9b817ac48ec9ce86571ce754fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23224ac0b91a4c1ca9ee4f30d5f6b25d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:47:59.722520 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5f8a5f0d-b9b6-4226-9385-4924081c4016 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] 10.222.0.88 "GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8" status: 200 len: 1282 microversion: 2.1 time: 0.872169 Jul 25 14:47:59.745614 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2161/4566] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:58 2022] GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8 => generated 1282 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:47:59.758009 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fcc600df-1e33-4ab0-8c0d-f2988a5fa9e7 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f468672b550>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:47:59.914493 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fcc600df-1e33-4ab0-8c0d-f2988a5fa9e7 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1412 microversion: 2.1 time: 0.167518 Jul 25 14:47:59.915420 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2162/4567] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:47:59 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1412 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:00.405663 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1ed735f3-bb94-4a16-88f5-fe741f64ca2e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:00.422887 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1ed735f3-bb94-4a16-88f5-fe741f64ca2e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab" status: 200 len: 1683 microversion: 2.1 time: 1.488682 Jul 25 14:48:00.429890 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2406/4568] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:47:58 2022] GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab => generated 1683 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:00.761718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ebdab6b2-a17d-4b97-9fb6-c678a393553b tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:00.762829 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ebdab6b2-a17d-4b97-9fb6-c678a393553b tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] [instance: e18669b5-0442-4689-836a-5971c684b0c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:00.801708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ebdab6b2-a17d-4b97-9fb6-c678a393553b tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:00.802323 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ebdab6b2-a17d-4b97-9fb6-c678a393553b tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:00.805813 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ebdab6b2-a17d-4b97-9fb6-c678a393553b tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:00.806361 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ebdab6b2-a17d-4b97-9fb6-c678a393553b tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:00.894320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:48:00.930462 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-87729093-c13b-48c4-bb68-796b8ea48bfd tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46864eb8b0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:01.086066 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-87729093-c13b-48c4-bb68-796b8ea48bfd tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1412 microversion: 2.1 time: 0.159696 Jul 25 14:48:01.087065 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2407/4569] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:48:00 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1412 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:48:01.451919 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ce6ad955-46c4-40a2-9a77-0bff5e06472b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:01.454130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ce6ad955-46c4-40a2-9a77-0bff5e06472b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: f5e1c62b-88b7-4ec7-a2f3-b99b1566baab] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:01.482651 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce6ad955-46c4-40a2-9a77-0bff5e06472b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:01.483407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce6ad955-46c4-40a2-9a77-0bff5e06472b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:01.486053 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce6ad955-46c4-40a2-9a77-0bff5e06472b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:01.486711 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce6ad955-46c4-40a2-9a77-0bff5e06472b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:01.839612 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ebdab6b2-a17d-4b97-9fb6-c678a393553b tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486c9b817ac48ec9ce86571ce754fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23224ac0b91a4c1ca9ee4f30d5f6b25d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:01.864064 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ebdab6b2-a17d-4b97-9fb6-c678a393553b tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] 10.222.0.88 "GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8" status: 200 len: 1324 microversion: 2.1 time: 1.112769 Jul 25 14:48:01.872416 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2163/4570] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:00 2022] GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8 => generated 1324 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:01.907905 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ce6ad955-46c4-40a2-9a77-0bff5e06472b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:01.925520 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ce6ad955-46c4-40a2-9a77-0bff5e06472b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab" status: 200 len: 1615 microversion: 2.1 time: 0.483017 Jul 25 14:48:01.938796 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2408/4571] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:01 2022] GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab => generated 1615 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:48:02.102415 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dc046584-a595-456b-8b34-8efde540f31d tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f468672b160>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:02.249172 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dc046584-a595-456b-8b34-8efde540f31d tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1412 microversion: 2.1 time: 0.150894 Jul 25 14:48:02.262437 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2164/4572] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:48:02 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1412 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:02.894297 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9e1ec4d6-8ea0-41d2-96d4-bc1587855308 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:02.894965 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9e1ec4d6-8ea0-41d2-96d4-bc1587855308 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] [instance: e18669b5-0442-4689-836a-5971c684b0c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:02.930303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9e1ec4d6-8ea0-41d2-96d4-bc1587855308 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:02.932968 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9e1ec4d6-8ea0-41d2-96d4-bc1587855308 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:02.941861 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9e1ec4d6-8ea0-41d2-96d4-bc1587855308 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:02.943206 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9e1ec4d6-8ea0-41d2-96d4-bc1587855308 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:02.964453 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-383a9c08-7709-4340-bba5-5f2fc39dd179 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:02.965125 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-383a9c08-7709-4340-bba5-5f2fc39dd179 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: f5e1c62b-88b7-4ec7-a2f3-b99b1566baab] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:03.010473 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-383a9c08-7709-4340-bba5-5f2fc39dd179 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:03.011372 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-383a9c08-7709-4340-bba5-5f2fc39dd179 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:03.012429 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-383a9c08-7709-4340-bba5-5f2fc39dd179 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:03.013779 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-383a9c08-7709-4340-bba5-5f2fc39dd179 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:03.292010 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-383a9c08-7709-4340-bba5-5f2fc39dd179 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:03.306050 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-383a9c08-7709-4340-bba5-5f2fc39dd179 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab" status: 200 len: 1615 microversion: 2.1 time: 0.348760 Jul 25 14:48:03.309558 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2165/4573] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:02 2022] GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab => generated 1615 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:48:03.325545 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0cdf0449-f8ef-4e46-8cc0-c76e0e916e6b tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f4686c06b80>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:03.447590 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0cdf0449-f8ef-4e46-8cc0-c76e0e916e6b tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1412 microversion: 2.1 time: 0.136295 Jul 25 14:48:03.448538 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2166/4574] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:48:03 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1412 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:03.697893 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:48:04.217201 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-bada3ca5-5168-4886-95ed-921845082bf0 req-28a843fe-5211-4cb3-87e1-1785c54ed4af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e18669b5-0442-4689-836a-5971c684b0c8", "tag": "44eda288-8494-4363-876d-010b3ce95c93"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:48:04.268889 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-bada3ca5-5168-4886-95ed-921845082bf0 req-28a843fe-5211-4cb3-87e1-1785c54ed4af service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:04.270113 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9e1ec4d6-8ea0-41d2-96d4-bc1587855308 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486c9b817ac48ec9ce86571ce754fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23224ac0b91a4c1ca9ee4f30d5f6b25d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:04.271476 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-bada3ca5-5168-4886-95ed-921845082bf0 req-28a843fe-5211-4cb3-87e1-1785c54ed4af service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:04.286123 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9e1ec4d6-8ea0-41d2-96d4-bc1587855308 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] 10.222.0.88 "GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8" status: 200 len: 1324 microversion: 2.1 time: 1.397910 Jul 25 14:48:04.290200 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2409/4575] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:02 2022] GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8 => generated 1324 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:04.342243 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-bada3ca5-5168-4886-95ed-921845082bf0 req-28a843fe-5211-4cb3-87e1-1785c54ed4af service nova] Creating event network-changed:44eda288-8494-4363-876d-010b3ce95c93 for instance e18669b5-0442-4689-836a-5971c684b0c8 on n-h2-846435-14 Jul 25 14:48:04.371175 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-bada3ca5-5168-4886-95ed-921845082bf0 req-28a843fe-5211-4cb3-87e1-1785c54ed4af service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162656 Jul 25 14:48:04.385735 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2167/4576] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:48:04.417816 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a2c0b14b-c2cb-498c-b6b8-4379c27d1a00 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:04.426514 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a2c0b14b-c2cb-498c-b6b8-4379c27d1a00 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: f5e1c62b-88b7-4ec7-a2f3-b99b1566baab] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:04.457654 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a2c0b14b-c2cb-498c-b6b8-4379c27d1a00 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:04.467177 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a2c0b14b-c2cb-498c-b6b8-4379c27d1a00 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:04.474703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a2c0b14b-c2cb-498c-b6b8-4379c27d1a00 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:04.477647 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a2c0b14b-c2cb-498c-b6b8-4379c27d1a00 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:04.560067 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-d2791552-e3c1-40e1-8427-3afe106d764d req-af6dbc06-f03c-45c3-9609-e9f3ada594cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5e1c62b-88b7-4ec7-a2f3-b99b1566baab", "name": "network-vif-deleted", "tag": "f26ef5c9-78ef-4d4e-ad54-598461e6e22e"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:48:04.581104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-d2791552-e3c1-40e1-8427-3afe106d764d req-af6dbc06-f03c-45c3-9609-e9f3ada594cb service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:04.583877 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-d2791552-e3c1-40e1-8427-3afe106d764d req-af6dbc06-f03c-45c3-9609-e9f3ada594cb service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:04.630556 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-d2791552-e3c1-40e1-8427-3afe106d764d req-af6dbc06-f03c-45c3-9609-e9f3ada594cb service nova] Creating event network-vif-deleted:f26ef5c9-78ef-4d4e-ad54-598461e6e22e for instance f5e1c62b-88b7-4ec7-a2f3-b99b1566baab on n-h2-846435-14 Jul 25 14:48:04.645311 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-d2791552-e3c1-40e1-8427-3afe106d764d req-af6dbc06-f03c-45c3-9609-e9f3ada594cb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.351435 Jul 25 14:48:04.647921 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2410/4577] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:48:04.664902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-00951fb7-b84a-4190-8624-00d7c41bcaa1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f468652ec10>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:04.816368 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-00951fb7-b84a-4190-8624-00d7c41bcaa1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1412 microversion: 2.1 time: 0.166702 Jul 25 14:48:04.816967 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2411/4578] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:48:04 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1412 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:05.313027 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6ebdc813-196c-4312-951b-4326a809be87 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:05.314072 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6ebdc813-196c-4312-951b-4326a809be87 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] [instance: e18669b5-0442-4689-836a-5971c684b0c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:05.359667 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6ebdc813-196c-4312-951b-4326a809be87 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:05.364048 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6ebdc813-196c-4312-951b-4326a809be87 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:05.376502 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6ebdc813-196c-4312-951b-4326a809be87 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:05.379095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6ebdc813-196c-4312-951b-4326a809be87 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:05.917704 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a2c0b14b-c2cb-498c-b6b8-4379c27d1a00 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:05.931893 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a2c0b14b-c2cb-498c-b6b8-4379c27d1a00 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab" status: 200 len: 1327 microversion: 2.1 time: 1.543411 Jul 25 14:48:05.939844 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2168/4579] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:04 2022] GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab => generated 1327 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:05.958222 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-eedf006d-9bd6-45e2-835b-b1ea4fea9048 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f4698797820>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:06.031760 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-eedf006d-9bd6-45e2-835b-b1ea4fea9048 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1412 microversion: 2.1 time: 0.077886 Jul 25 14:48:06.032426 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2169/4580] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:48:05 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1412 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:06.088630 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6ebdc813-196c-4312-951b-4326a809be87 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486c9b817ac48ec9ce86571ce754fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23224ac0b91a4c1ca9ee4f30d5f6b25d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:06.126803 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6ebdc813-196c-4312-951b-4326a809be87 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] 10.222.0.88 "GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8" status: 200 len: 1324 microversion: 2.1 time: 0.820316 Jul 25 14:48:06.131909 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2412/4581] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:05 2022] GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8 => generated 1324 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:48:06.965944 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7c7eae53-568c-4cd0-9916-3bb72bd91616 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:06.968204 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7c7eae53-568c-4cd0-9916-3bb72bd91616 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: f5e1c62b-88b7-4ec7-a2f3-b99b1566baab] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:06.992437 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7c7eae53-568c-4cd0-9916-3bb72bd91616 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:06.992905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7c7eae53-568c-4cd0-9916-3bb72bd91616 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:06.993716 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7c7eae53-568c-4cd0-9916-3bb72bd91616 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:06.994163 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7c7eae53-568c-4cd0-9916-3bb72bd91616 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:07.048060 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-65996ec4-cb42-4a1a-9795-00d38101f730 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46989409d0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:07.096860 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-7c7eae53-568c-4cd0-9916-3bb72bd91616 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] HTTP exception thrown: Instance f5e1c62b-88b7-4ec7-a2f3-b99b1566baab could not be found. Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7c7eae53-568c-4cd0-9916-3bb72bd91616 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Request method failure captured: Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab HTTP/1.1 Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qxVTVC8FUnn-t2qK29pQ6gpvvVkF5Cd1ek9O6-ax9bIU4h-Acw7IM2XyPTWfCK6LWhHPoO7fpkEcbhitPiuVrA5WlFZ0WfmMB-2I-MAtgO20bt12dRN-m_gApdOXiuB_IoQnmtlPGVQzahhzXBQE11eo5L_JzE39RyLIYMYF8wTD50 Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 325aff76e61141a985b3b0f45521444f Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/325aff76e61141a985b3b0f45521444f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/325aff76e61141a985b3b0f45521444f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_325aff76e61141a985b3b0f45521444f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/325aff76e61141a985b3b0f45521444f"}]}] Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 325aff76e61141a985b3b0f45521444f Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-AttachVolumeNegativeTest-1959370092-project Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 571a2d92d7a34f86bb3c0bfdfcabc5ff Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-AttachVolumeNegativeTest-1959370092-project Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance f5e1c62b-88b7-4ec7-a2f3-b99b1566baab could not be found. Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'f5e1c62b-88b7-4ec7-a2f3-b99b1566baab'} Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5e1c62b-88b7-4ec7-a2f3-b99b1566baab could not be found. Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5e1c62b-88b7-4ec7-a2f3-b99b1566baab could not be found. Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:48:07.123145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:48:07.127841 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:48:07.127841 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:48:07.127841 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:48:07.127841 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:48:07.127841 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:48:07.127841 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5e1c62b-88b7-4ec7-a2f3-b99b1566baab could not be found. Jul 25 14:48:07.127841 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:48:07.127841 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7c7eae53-568c-4cd0-9916-3bb72bd91616 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Returning 404 to user: Instance f5e1c62b-88b7-4ec7-a2f3-b99b1566baab could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:48:07.133172 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7c7eae53-568c-4cd0-9916-3bb72bd91616 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab" status: 404 len: 111 microversion: 2.1 time: 0.172352 Jul 25 14:48:07.133820 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2170/4582] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:06 2022] GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:48:07.161188 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c7ed137d-0a6f-4dcd-bf63-05dc46b42dfd tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '.version_select at 0x7f4698797d30>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:07.182904 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-65996ec4-cb42-4a1a-9795-00d38101f730 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1412 microversion: 2.1 time: 0.139429 Jul 25 14:48:07.184286 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2413/4583] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:48:07 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1412 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:48:07.207459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1745020e-e83c-450d-97bd-63c00e52570b tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:07.211033 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1745020e-e83c-450d-97bd-63c00e52570b tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] [instance: e18669b5-0442-4689-836a-5971c684b0c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:07.266758 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1745020e-e83c-450d-97bd-63c00e52570b tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:07.269931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1745020e-e83c-450d-97bd-63c00e52570b tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:07.280394 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c7ed137d-0a6f-4dcd-bf63-05dc46b42dfd tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2109503431" status: 202 len: 0 microversion: 2.1 time: 0.140949 Jul 25 14:48:07.284620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1745020e-e83c-450d-97bd-63c00e52570b tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:07.295126 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2171/4584] 10.222.0.88 () {58 vars in 1221 bytes} [Mon Jul 25 14:48:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2109503431 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:48:07.296650 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1745020e-e83c-450d-97bd-63c00e52570b tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:08.199330 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-75ad4749-a80b-4e1e-803c-0f7343410900 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f4686c06b80>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:08.276196 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-75ad4749-a80b-4e1e-803c-0f7343410900 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1412 microversion: 2.1 time: 0.080730 Jul 25 14:48:08.277403 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2172/4585] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:48:08 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1412 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:08.681263 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1745020e-e83c-450d-97bd-63c00e52570b tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486c9b817ac48ec9ce86571ce754fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23224ac0b91a4c1ca9ee4f30d5f6b25d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:08.699265 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1745020e-e83c-450d-97bd-63c00e52570b tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] 10.222.0.88 "GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8" status: 200 len: 1324 microversion: 2.1 time: 1.512310 Jul 25 14:48:08.704161 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2414/4586] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:07 2022] GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8 => generated 1324 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:09.292820 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8370f878-e5bd-4953-9dc0-df4207da06d5 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f4698899310>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:09.393571 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8370f878-e5bd-4953-9dc0-df4207da06d5 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1412 microversion: 2.1 time: 0.104934 Jul 25 14:48:09.394349 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2173/4587] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:48:09 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1412 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:09.721995 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-23f04e95-8a8c-4388-a870-ddc7118c2552 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:09.723282 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-23f04e95-8a8c-4388-a870-ddc7118c2552 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] [instance: e18669b5-0442-4689-836a-5971c684b0c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:09.734968 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=14 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:48:09.738298 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23f04e95-8a8c-4388-a870-ddc7118c2552 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:09.741391 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23f04e95-8a8c-4388-a870-ddc7118c2552 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:09.742489 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23f04e95-8a8c-4388-a870-ddc7118c2552 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:09.744774 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23f04e95-8a8c-4388-a870-ddc7118c2552 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:09.870232 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d2a97fd7-bef7-4052-a263-d6a319a1e9b7 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-397778377", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1ada738-03c1-4bc6-a9c8-d1a2220fdb72"}], "security_groups": [{"name": "tempest-securitygroup--459339390"}], "key_name": "tempest-keypair-2147391423", "user_data": "}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:48:09.895103 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:48:10.103260 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-d2a97fd7-bef7-4052-a263-d6a319a1e9b7 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] validate_networks() for [('c1ada738-03c1-4bc6-a9c8-d1a2220fdb72', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:48:10.318587 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-23f04e95-8a8c-4388-a870-ddc7118c2552 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486c9b817ac48ec9ce86571ce754fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23224ac0b91a4c1ca9ee4f30d5f6b25d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:10.329962 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-23f04e95-8a8c-4388-a870-ddc7118c2552 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] 10.222.0.88 "GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8" status: 200 len: 1324 microversion: 2.1 time: 0.612346 Jul 25 14:48:10.330597 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2415/4588] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:09 2022] GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8 => generated 1324 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:10.410015 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e80ed672-135d-4751-8608-fdd9bdd90922 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46863bbd30>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:10.519137 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e80ed672-135d-4751-8608-fdd9bdd90922 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1412 microversion: 2.1 time: 0.113097 Jul 25 14:48:10.538886 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2416/4589] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:48:10 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1412 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:11.365351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cb767c07-8fbd-4a01-a33a-202f14db616f tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:11.366351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cb767c07-8fbd-4a01-a33a-202f14db616f tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] [instance: e18669b5-0442-4689-836a-5971c684b0c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:11.406816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb767c07-8fbd-4a01-a33a-202f14db616f tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:11.407182 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb767c07-8fbd-4a01-a33a-202f14db616f tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:11.408007 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb767c07-8fbd-4a01-a33a-202f14db616f tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:11.408451 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb767c07-8fbd-4a01-a33a-202f14db616f tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:12.060642 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cb767c07-8fbd-4a01-a33a-202f14db616f tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486c9b817ac48ec9ce86571ce754fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23224ac0b91a4c1ca9ee4f30d5f6b25d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:12.065067 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-d2a97fd7-bef7-4052-a263-d6a319a1e9b7 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:48:12.066394 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-d2a97fd7-bef7-4052-a263-d6a319a1e9b7 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:48:12.067036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-d2a97fd7-bef7-4052-a263-d6a319a1e9b7 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:48:12.067663 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-d2a97fd7-bef7-4052-a263-d6a319a1e9b7 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:48:12.068255 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-d2a97fd7-bef7-4052-a263-d6a319a1e9b7 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:48:12.074739 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cb767c07-8fbd-4a01-a33a-202f14db616f tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] 10.222.0.88 "GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8" status: 200 len: 1324 microversion: 2.1 time: 0.726356 Jul 25 14:48:12.075724 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2417/4590] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:11 2022] GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8 => generated 1324 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:12.087922 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-01c6f9e1-1a08-4c39-b5c6-7295dfee5112 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:12.088510 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d2a97fd7-bef7-4052-a263-d6a319a1e9b7 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:12.089061 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d2a97fd7-bef7-4052-a263-d6a319a1e9b7 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:12.090380 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d2a97fd7-bef7-4052-a263-d6a319a1e9b7 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:12.093281 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-01c6f9e1-1a08-4c39-b5c6-7295dfee5112 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:12.094823 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d2a97fd7-bef7-4052-a263-d6a319a1e9b7 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:12.107478 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01c6f9e1-1a08-4c39-b5c6-7295dfee5112 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:12.107928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01c6f9e1-1a08-4c39-b5c6-7295dfee5112 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:12.108737 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01c6f9e1-1a08-4c39-b5c6-7295dfee5112 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:12.111876 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01c6f9e1-1a08-4c39-b5c6-7295dfee5112 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:12.205723 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-d2a97fd7-bef7-4052-a263-d6a319a1e9b7 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Getting quotas for project b80269077ccc4482a91cb9e6b1d911b5. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:48:12.243733 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-d2a97fd7-bef7-4052-a263-d6a319a1e9b7 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Getting quotas for user 0d7e3180b05b4f9fb877d031b73b5ee2 and project b80269077ccc4482a91cb9e6b1d911b5. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:48:12.300130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-01c6f9e1-1a08-4c39-b5c6-7295dfee5112 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lazy-loading 'services' on Instance uuid 5d038cc3-67d7-4ac0-93bd-e668700cd3b4 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:48:12.343835 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d2a97fd7-bef7-4052-a263-d6a319a1e9b7 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:48:12.362361 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d2a97fd7-bef7-4052-a263-d6a319a1e9b7 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:48:12.522220 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d2a97fd7-bef7-4052-a263-d6a319a1e9b7 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.656565 Jul 25 14:48:12.527170 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-01c6f9e1-1a08-4c39-b5c6-7295dfee5112 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "DELETE /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4/os-volume_attachments/d3e80da1-cc81-443e-8641-53a150fd4891" status: 202 len: 0 microversion: 2.1 time: 0.446760 Jul 25 14:48:12.536336 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2418/4591] 10.222.0.88 () {58 vars in 1416 bytes} [Mon Jul 25 14:48:12 2022] DELETE /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4/os-volume_attachments/d3e80da1-cc81-443e-8641-53a150fd4891 => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:48:12.540877 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2174/4592] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:48:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 2676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:48:12.554366 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-600fa717-eadb-4c3b-afe7-0ab2492c3941 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:12.562816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-57f0c6c9-cb33-43a7-ad00-1838bd15a63c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46864fb040>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:12.563261 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-600fa717-eadb-4c3b-afe7-0ab2492c3941 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:12.613184 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-600fa717-eadb-4c3b-afe7-0ab2492c3941 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:12.613652 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-600fa717-eadb-4c3b-afe7-0ab2492c3941 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:12.614479 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-600fa717-eadb-4c3b-afe7-0ab2492c3941 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:12.614921 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-600fa717-eadb-4c3b-afe7-0ab2492c3941 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:12.720118 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-57f0c6c9-cb33-43a7-ad00-1838bd15a63c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1412 microversion: 2.1 time: 0.181873 Jul 25 14:48:12.720902 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2419/4593] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:48:12 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1412 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:12.742393 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-93f5710d-e2cd-4f2b-8ac7-78f210acb5c2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:12.743679 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-93f5710d-e2cd-4f2b-8ac7-78f210acb5c2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:12.837227 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-600fa717-eadb-4c3b-afe7-0ab2492c3941 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.287195 Jul 25 14:48:12.847627 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2175/4594] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:48:12 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4/os-volume_attachments => generated 197 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:48:13.023169 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-93f5710d-e2cd-4f2b-8ac7-78f210acb5c2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:13.061158 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-93f5710d-e2cd-4f2b-8ac7-78f210acb5c2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea" status: 200 len: 1237 microversion: 2.1 time: 0.334835 Jul 25 14:48:13.074192 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2420/4595] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:12 2022] GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea => generated 1237 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:13.104595 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5479a457-1aa7-4244-9163-6e71563e3c1e tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:13.107677 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5479a457-1aa7-4244-9163-6e71563e3c1e tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] [instance: e18669b5-0442-4689-836a-5971c684b0c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:13.131001 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5479a457-1aa7-4244-9163-6e71563e3c1e tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:13.138136 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5479a457-1aa7-4244-9163-6e71563e3c1e tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:13.140325 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5479a457-1aa7-4244-9163-6e71563e3c1e tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:13.142054 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5479a457-1aa7-4244-9163-6e71563e3c1e tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:13.509495 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5479a457-1aa7-4244-9163-6e71563e3c1e tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486c9b817ac48ec9ce86571ce754fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23224ac0b91a4c1ca9ee4f30d5f6b25d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:13.532859 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5479a457-1aa7-4244-9163-6e71563e3c1e tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] 10.222.0.88 "GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8" status: 200 len: 1324 microversion: 2.1 time: 0.435214 Jul 25 14:48:13.540981 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2176/4596] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:13 2022] GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8 => generated 1324 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:13.737640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-788d6bd1-d0d3-49f4-9e89-2663a96781d1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46864fb940>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:13.863093 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-514e3077-dc3c-4976-a21e-d6fc2989829a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:13.867712 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-514e3077-dc3c-4976-a21e-d6fc2989829a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:13.908251 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-514e3077-dc3c-4976-a21e-d6fc2989829a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:13.910358 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-788d6bd1-d0d3-49f4-9e89-2663a96781d1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1412 microversion: 2.1 time: 0.179046 Jul 25 14:48:13.911281 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2421/4597] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:48:13 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1412 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:13.919795 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-514e3077-dc3c-4976-a21e-d6fc2989829a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:13.924883 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-514e3077-dc3c-4976-a21e-d6fc2989829a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:13.928331 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-514e3077-dc3c-4976-a21e-d6fc2989829a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:14.089161 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e62907d8-3ae8-4fad-a061-a2eae33c6607 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:14.089890 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e62907d8-3ae8-4fad-a061-a2eae33c6607 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:14.107672 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-514e3077-dc3c-4976-a21e-d6fc2989829a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.247597 Jul 25 14:48:14.109544 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2177/4598] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:48:13 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4/os-volume_attachments => generated 197 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:48:14.127251 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e62907d8-3ae8-4fad-a061-a2eae33c6607 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:14.127697 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e62907d8-3ae8-4fad-a061-a2eae33c6607 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:14.128511 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e62907d8-3ae8-4fad-a061-a2eae33c6607 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:14.128939 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e62907d8-3ae8-4fad-a061-a2eae33c6607 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:14.160648 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:48:14.439292 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e62907d8-3ae8-4fad-a061-a2eae33c6607 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:14.453823 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e62907d8-3ae8-4fad-a061-a2eae33c6607 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea" status: 200 len: 1241 microversion: 2.1 time: 0.369038 Jul 25 14:48:14.478695 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2422/4599] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:14 2022] GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea => generated 1241 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:48:14.555755 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-27cae502-5dc3-47fe-a950-3f84c744c940 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:14.556414 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-27cae502-5dc3-47fe-a950-3f84c744c940 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] [instance: e18669b5-0442-4689-836a-5971c684b0c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:14.577581 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27cae502-5dc3-47fe-a950-3f84c744c940 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:14.578084 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27cae502-5dc3-47fe-a950-3f84c744c940 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:14.578905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27cae502-5dc3-47fe-a950-3f84c744c940 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:14.594034 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27cae502-5dc3-47fe-a950-3f84c744c940 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:14.927042 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-aa93754e-ffbb-4ef1-971e-ff3997884f2e tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46863a3820>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:15.083037 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-aa93754e-ffbb-4ef1-971e-ff3997884f2e tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1412 microversion: 2.1 time: 0.160604 Jul 25 14:48:15.084452 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2423/4600] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:48:14 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1412 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:48:15.135735 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-09cc17c8-d2b0-486d-bba9-d36784111ce4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:15.145424 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-09cc17c8-d2b0-486d-bba9-d36784111ce4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:15.171327 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09cc17c8-d2b0-486d-bba9-d36784111ce4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:15.182212 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09cc17c8-d2b0-486d-bba9-d36784111ce4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:15.183556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09cc17c8-d2b0-486d-bba9-d36784111ce4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:15.184224 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09cc17c8-d2b0-486d-bba9-d36784111ce4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:15.324574 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-09cc17c8-d2b0-486d-bba9-d36784111ce4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.206306 Jul 25 14:48:15.359496 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2424/4601] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:48:15 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4/os-volume_attachments => generated 197 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:48:15.480258 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6265be46-9a0f-468e-9646-29c5c57c8d48 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:15.480993 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6265be46-9a0f-468e-9646-29c5c57c8d48 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:15.504902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6265be46-9a0f-468e-9646-29c5c57c8d48 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:15.505430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6265be46-9a0f-468e-9646-29c5c57c8d48 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:15.506795 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6265be46-9a0f-468e-9646-29c5c57c8d48 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:15.508431 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6265be46-9a0f-468e-9646-29c5c57c8d48 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:15.641071 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6265be46-9a0f-468e-9646-29c5c57c8d48 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:15.656036 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6265be46-9a0f-468e-9646-29c5c57c8d48 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea" status: 200 len: 1295 microversion: 2.1 time: 0.179338 Jul 25 14:48:15.657060 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2425/4602] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:15 2022] GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea => generated 1295 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:48:15.820343 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-27cae502-5dc3-47fe-a950-3f84c744c940 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486c9b817ac48ec9ce86571ce754fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23224ac0b91a4c1ca9ee4f30d5f6b25d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:15.835233 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-27cae502-5dc3-47fe-a950-3f84c744c940 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] 10.222.0.88 "GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8" status: 200 len: 1324 microversion: 2.1 time: 1.283474 Jul 25 14:48:15.848765 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2178/4603] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:14 2022] GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8 => generated 1324 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:16.101190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-916d69d9-3f11-43e3-ada8-403ee9b4951e tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46989e3550>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:16.227194 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-916d69d9-3f11-43e3-ada8-403ee9b4951e tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1412 microversion: 2.1 time: 0.130518 Jul 25 14:48:16.238836 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2426/4604] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:48:16 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1412 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:16.382945 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7ae289ac-9f2c-42dc-9b93-23f96becc40b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:16.386197 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7ae289ac-9f2c-42dc-9b93-23f96becc40b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:16.411603 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ae289ac-9f2c-42dc-9b93-23f96becc40b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:16.420462 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ae289ac-9f2c-42dc-9b93-23f96becc40b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:16.425321 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ae289ac-9f2c-42dc-9b93-23f96becc40b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:16.429684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ae289ac-9f2c-42dc-9b93-23f96becc40b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:16.622329 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7ae289ac-9f2c-42dc-9b93-23f96becc40b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.244443 Jul 25 14:48:16.625130 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2179/4605] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:48:16 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4/os-volume_attachments => generated 197 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:48:16.680411 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-95eb9f68-4cc7-4582-9a51-ea3c20149195 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:16.681094 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-95eb9f68-4cc7-4582-9a51-ea3c20149195 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:16.702634 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-95eb9f68-4cc7-4582-9a51-ea3c20149195 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:16.703135 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-95eb9f68-4cc7-4582-9a51-ea3c20149195 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:16.710266 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-95eb9f68-4cc7-4582-9a51-ea3c20149195 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:16.710720 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-95eb9f68-4cc7-4582-9a51-ea3c20149195 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:16.861487 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8ac71c95-73b7-4af9-a8cc-f86d292bfc93 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:16.863206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8ac71c95-73b7-4af9-a8cc-f86d292bfc93 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] [instance: e18669b5-0442-4689-836a-5971c684b0c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:16.875489 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ac71c95-73b7-4af9-a8cc-f86d292bfc93 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:16.877679 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ac71c95-73b7-4af9-a8cc-f86d292bfc93 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:16.881505 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ac71c95-73b7-4af9-a8cc-f86d292bfc93 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:16.885459 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ac71c95-73b7-4af9-a8cc-f86d292bfc93 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:16.962180 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-95eb9f68-4cc7-4582-9a51-ea3c20149195 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:16.971702 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-95eb9f68-4cc7-4582-9a51-ea3c20149195 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea" status: 200 len: 1295 microversion: 2.1 time: 0.298015 Jul 25 14:48:16.976528 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2427/4606] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:16 2022] GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea => generated 1295 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:17.246553 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-19e48412-878b-42b6-9c8a-29d99866e50f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f468644c280>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:17.353760 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-19e48412-878b-42b6-9c8a-29d99866e50f tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1412 microversion: 2.1 time: 0.111506 Jul 25 14:48:17.356294 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2428/4607] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:48:17 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1412 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:17.638342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-80c16d4f-50bf-4b9f-b129-88225a896215 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:17.640927 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-80c16d4f-50bf-4b9f-b129-88225a896215 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:17.658964 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-80c16d4f-50bf-4b9f-b129-88225a896215 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:17.659712 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-80c16d4f-50bf-4b9f-b129-88225a896215 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:17.660826 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-80c16d4f-50bf-4b9f-b129-88225a896215 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:17.661505 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-80c16d4f-50bf-4b9f-b129-88225a896215 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:17.743928 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-80c16d4f-50bf-4b9f-b129-88225a896215 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110741 Jul 25 14:48:17.745264 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2429/4608] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:48:17 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:48:17.994235 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-59f45107-7f79-43e7-9708-f9238ab2956e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:17.995164 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-59f45107-7f79-43e7-9708-f9238ab2956e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:18.007587 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59f45107-7f79-43e7-9708-f9238ab2956e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:18.012704 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59f45107-7f79-43e7-9708-f9238ab2956e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:18.013880 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59f45107-7f79-43e7-9708-f9238ab2956e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:18.016613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59f45107-7f79-43e7-9708-f9238ab2956e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:18.542843 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-59f45107-7f79-43e7-9708-f9238ab2956e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:18.580968 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-59f45107-7f79-43e7-9708-f9238ab2956e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea" status: 200 len: 1362 microversion: 2.1 time: 0.589579 Jul 25 14:48:18.598761 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2430/4609] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:17 2022] GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea => generated 1362 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:18.616226 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d078f84d-bdd6-4037-a48e-b140369c9f23 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f4698903160>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:18.774685 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d078f84d-bdd6-4037-a48e-b140369c9f23 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1412 microversion: 2.1 time: 0.184862 Jul 25 14:48:18.776890 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2431/4610] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:48:18 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1412 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:18.806577 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a6c0c4ba-ec60-498e-85da-04833e242776 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:18.810845 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a6c0c4ba-ec60-498e-85da-04833e242776 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:18.855361 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a6c0c4ba-ec60-498e-85da-04833e242776 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:18.856662 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a6c0c4ba-ec60-498e-85da-04833e242776 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:18.868871 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a6c0c4ba-ec60-498e-85da-04833e242776 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:18.870057 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a6c0c4ba-ec60-498e-85da-04833e242776 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:19.010183 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a6c0c4ba-ec60-498e-85da-04833e242776 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.231612 Jul 25 14:48:19.014946 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2432/4611] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:48:18 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4/os-volume_attachments => generated 197 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:48:19.207619 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-a3882dda-877d-4dd3-a7cb-af4034afb91c req-4c0895ef-4007-418e-991e-a29e766e8386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18669b5-0442-4689-836a-5971c684b0c8", "name": "network-vif-plugged", "status": "completed", "tag": "44eda288-8494-4363-876d-010b3ce95c93"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:48:19.247376 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a3882dda-877d-4dd3-a7cb-af4034afb91c req-4c0895ef-4007-418e-991e-a29e766e8386 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:19.255408 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a3882dda-877d-4dd3-a7cb-af4034afb91c req-4c0895ef-4007-418e-991e-a29e766e8386 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:19.316711 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-a3882dda-877d-4dd3-a7cb-af4034afb91c req-4c0895ef-4007-418e-991e-a29e766e8386 service nova] Creating event network-vif-plugged:44eda288-8494-4363-876d-010b3ce95c93 for instance e18669b5-0442-4689-836a-5971c684b0c8 on n-h2-846435-14 Jul 25 14:48:19.327039 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-a3882dda-877d-4dd3-a7cb-af4034afb91c req-4c0895ef-4007-418e-991e-a29e766e8386 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128195 Jul 25 14:48:19.338451 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2433/4612] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:48:19.608428 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-029a480f-3223-4d5c-83d1-86983dcf394d tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:19.610317 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-029a480f-3223-4d5c-83d1-86983dcf394d tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:19.638446 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-029a480f-3223-4d5c-83d1-86983dcf394d tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:19.649469 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-029a480f-3223-4d5c-83d1-86983dcf394d tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:19.656862 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-029a480f-3223-4d5c-83d1-86983dcf394d tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:19.657668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-029a480f-3223-4d5c-83d1-86983dcf394d tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:20.006819 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8ac71c95-73b7-4af9-a8cc-f86d292bfc93 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486c9b817ac48ec9ce86571ce754fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23224ac0b91a4c1ca9ee4f30d5f6b25d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:20.016224 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8ac71c95-73b7-4af9-a8cc-f86d292bfc93 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] 10.222.0.88 "GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8" status: 200 len: 1324 microversion: 2.1 time: 3.158571 Jul 25 14:48:20.027611 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2180/4613] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:16 2022] GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8 => generated 1324 bytes in 3171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:48:20.060346 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-88f830f0-f54c-40dd-ac23-9975bcdf1a7c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f4686763f70>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:20.199480 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-88f830f0-f54c-40dd-ac23-9975bcdf1a7c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1412 microversion: 2.1 time: 0.167426 Jul 25 14:48:20.200579 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2181/4614] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:48:20 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1412 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:20.230291 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1250f896-1f73-488b-a455-89ee6835e689 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:20.235007 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-029a480f-3223-4d5c-83d1-86983dcf394d tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:20.244717 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-029a480f-3223-4d5c-83d1-86983dcf394d tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea" status: 200 len: 1362 microversion: 2.1 time: 0.642046 Jul 25 14:48:20.260823 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1250f896-1f73-488b-a455-89ee6835e689 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:20.261410 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2434/4615] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:19 2022] GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea => generated 1362 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:20.281062 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1250f896-1f73-488b-a455-89ee6835e689 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:20.301423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1250f896-1f73-488b-a455-89ee6835e689 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:20.302524 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1250f896-1f73-488b-a455-89ee6835e689 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:20.303197 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1250f896-1f73-488b-a455-89ee6835e689 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:20.417571 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1250f896-1f73-488b-a455-89ee6835e689 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.201301 Jul 25 14:48:20.423866 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2182/4616] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:48:20 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4/os-volume_attachments => generated 197 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:48:21.052881 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-091f47a2-6c23-434a-bd85-b2d7aee5d16b tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:21.058307 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-091f47a2-6c23-434a-bd85-b2d7aee5d16b tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] [instance: e18669b5-0442-4689-836a-5971c684b0c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:21.084609 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-091f47a2-6c23-434a-bd85-b2d7aee5d16b tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:21.099002 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-091f47a2-6c23-434a-bd85-b2d7aee5d16b tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:21.100017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-091f47a2-6c23-434a-bd85-b2d7aee5d16b tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:21.103960 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-091f47a2-6c23-434a-bd85-b2d7aee5d16b tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:21.219290 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6aa29d0a-9f88-4842-9996-17d9721427b7 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f4698867af0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:21.405574 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6aa29d0a-9f88-4842-9996-17d9721427b7 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1412 microversion: 2.1 time: 0.189349 Jul 25 14:48:21.410443 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2183/4617] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:48:21 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1412 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:48:21.426336 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6203e0d6-c8ea-42e7-831e-1013e1969a1f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:21.428284 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6203e0d6-c8ea-42e7-831e-1013e1969a1f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:21.447062 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6203e0d6-c8ea-42e7-831e-1013e1969a1f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:21.448037 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6203e0d6-c8ea-42e7-831e-1013e1969a1f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:21.452756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6203e0d6-c8ea-42e7-831e-1013e1969a1f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:21.453542 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6203e0d6-c8ea-42e7-831e-1013e1969a1f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:21.642599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-091f47a2-6c23-434a-bd85-b2d7aee5d16b tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486c9b817ac48ec9ce86571ce754fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23224ac0b91a4c1ca9ee4f30d5f6b25d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:21.662323 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-091f47a2-6c23-434a-bd85-b2d7aee5d16b tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] 10.222.0.88 "GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8" status: 200 len: 1324 microversion: 2.1 time: 0.613250 Jul 25 14:48:21.665419 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2435/4618] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:21 2022] GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8 => generated 1324 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:21.690010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cd859ab8-54ef-4f7a-a410-9958e6e7defc tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:21.716645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cd859ab8-54ef-4f7a-a410-9958e6e7defc tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:21.735689 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cd859ab8-54ef-4f7a-a410-9958e6e7defc tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:21.736176 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cd859ab8-54ef-4f7a-a410-9958e6e7defc tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:21.736962 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cd859ab8-54ef-4f7a-a410-9958e6e7defc tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:21.740181 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cd859ab8-54ef-4f7a-a410-9958e6e7defc tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:21.809129 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cd859ab8-54ef-4f7a-a410-9958e6e7defc tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142162 Jul 25 14:48:21.820189 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2436/4619] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:48:21 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:48:22.161282 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:48:22.245282 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6203e0d6-c8ea-42e7-831e-1013e1969a1f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:22.262123 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6203e0d6-c8ea-42e7-831e-1013e1969a1f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea" status: 200 len: 1362 microversion: 2.1 time: 0.850158 Jul 25 14:48:22.268807 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2184/4620] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:21 2022] GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea => generated 1362 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:22.421400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d9b96d46-03d4-4717-bb02-a72a35890a98 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46863a3d30>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:22.545731 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d9b96d46-03d4-4717-bb02-a72a35890a98 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1412 microversion: 2.1 time: 0.128452 Jul 25 14:48:22.553982 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2437/4621] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:48:22 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1412 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:22.690528 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9a5aa1c6-cc13-4d1a-be1b-dc374a6e0cb4 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:22.709729 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9a5aa1c6-cc13-4d1a-be1b-dc374a6e0cb4 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] [instance: e18669b5-0442-4689-836a-5971c684b0c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:22.716631 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:48:22.726382 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9a5aa1c6-cc13-4d1a-be1b-dc374a6e0cb4 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:22.732578 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9a5aa1c6-cc13-4d1a-be1b-dc374a6e0cb4 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:22.743062 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9a5aa1c6-cc13-4d1a-be1b-dc374a6e0cb4 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:22.745483 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9a5aa1c6-cc13-4d1a-be1b-dc374a6e0cb4 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:22.826248 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7492b5b4-90f2-4cb9-a5b3-fc15ce26b781 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:22.828591 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7492b5b4-90f2-4cb9-a5b3-fc15ce26b781 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:22.848629 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:48:22.850897 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7492b5b4-90f2-4cb9-a5b3-fc15ce26b781 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:22.851335 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7492b5b4-90f2-4cb9-a5b3-fc15ce26b781 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:22.852183 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7492b5b4-90f2-4cb9-a5b3-fc15ce26b781 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:22.852624 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7492b5b4-90f2-4cb9-a5b3-fc15ce26b781 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:22.950041 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7492b5b4-90f2-4cb9-a5b3-fc15ce26b781 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122452 Jul 25 14:48:22.956010 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2438/4622] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:48:22 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:48:23.292546 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b8dcdd00-d0c1-492c-9ba8-9bc91a6a85de tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:23.293767 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b8dcdd00-d0c1-492c-9ba8-9bc91a6a85de tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:23.297928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:48:23.311621 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8dcdd00-d0c1-492c-9ba8-9bc91a6a85de tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:23.316529 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8dcdd00-d0c1-492c-9ba8-9bc91a6a85de tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:23.321736 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8dcdd00-d0c1-492c-9ba8-9bc91a6a85de tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:23.322430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8dcdd00-d0c1-492c-9ba8-9bc91a6a85de tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:23.559800 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9a5aa1c6-cc13-4d1a-be1b-dc374a6e0cb4 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486c9b817ac48ec9ce86571ce754fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23224ac0b91a4c1ca9ee4f30d5f6b25d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:23.573635 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9a5aa1c6-cc13-4d1a-be1b-dc374a6e0cb4 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] 10.222.0.88 "GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8" status: 200 len: 1520 microversion: 2.1 time: 0.890907 Jul 25 14:48:23.582170 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2185/4623] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:22 2022] GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8 => generated 1520 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:23.588175 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-14342ed7-15fa-44b2-ae55-8b4a66decfb2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f468675d160>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:23.714795 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-14342ed7-15fa-44b2-ae55-8b4a66decfb2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1412 microversion: 2.1 time: 0.129865 Jul 25 14:48:23.724772 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2186/4624] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:48:23 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1412 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:23.732462 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b6a9bb3d-9134-4b60-8757-87439f1f47ea tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:23.733406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b6a9bb3d-9134-4b60-8757-87439f1f47ea tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] [instance: e18669b5-0442-4689-836a-5971c684b0c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:23.743035 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b6a9bb3d-9134-4b60-8757-87439f1f47ea tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:23.745251 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b6a9bb3d-9134-4b60-8757-87439f1f47ea tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:23.747249 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b6a9bb3d-9134-4b60-8757-87439f1f47ea tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:23.747965 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b6a9bb3d-9134-4b60-8757-87439f1f47ea tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:23.872033 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b8dcdd00-d0c1-492c-9ba8-9bc91a6a85de tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:23.887525 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b8dcdd00-d0c1-492c-9ba8-9bc91a6a85de tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea" status: 200 len: 1362 microversion: 2.1 time: 0.598086 Jul 25 14:48:23.888428 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2439/4625] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:23 2022] GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea => generated 1362 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:23.935030 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-b6a9bb3d-9134-4b60-8757-87439f1f47ea tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] HTTP exception thrown: Action 999 not found Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b6a9bb3d-9134-4b60-8757-87439f1f47ea tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Request method failure captured: Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8/os-instance-actions/999 HTTP/1.1 Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q0W80byPUlIVpm3Ga67Upx3PMMJreS16Nw5TuzSIyFSc4nd6ng3nFmym160A1mkSWzHJ_aB3pABsYA9Tz9V0hZgPEhyA3kPT1WgIq_Sd9FfnFc0B10AcabC_gkpy5ZfYNdoODB6w7oTa9Kb2zQXc8BfUgQQjOyUv4nK4mnc0hhv24I Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 23224ac0b91a4c1ca9ee4f30d5f6b25d Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2003773253 Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/23224ac0b91a4c1ca9ee4f30d5f6b25d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/23224ac0b91a4c1ca9ee4f30d5f6b25d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_23224ac0b91a4c1ca9ee4f30d5f6b25d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/23224ac0b91a4c1ca9ee4f30d5f6b25d"}]}] Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2003773253 Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 23224ac0b91a4c1ca9ee4f30d5f6b25d Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2003773253 Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-InstanceActionsNegativeTestJSON-2003773253-project Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 1486c9b817ac48ec9ce86571ce754fb8 Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2003773253-project Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: exception: Action 999 not found Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'server_id': 'e18669b5-0442-4689-836a-5971c684b0c8', 'id': '999'} Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jul 25 14:48:23.944317 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:48:23.947722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b6a9bb3d-9134-4b60-8757-87439f1f47ea tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Returning 404 to user: Action 999 not found {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:48:23.947722 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b6a9bb3d-9134-4b60-8757-87439f1f47ea tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] 10.222.0.88 "GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.219928 Jul 25 14:48:23.959493 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2187/4626] 10.222.0.88 () {58 vars in 1308 bytes} [Mon Jul 25 14:48:23 2022] GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8/os-instance-actions/999 => generated 66 bytes in 234 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:48:23.967079 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6da66547-c13b-42aa-98d4-9874fa0ed69c tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Calling method '.version_select at 0x7f46876caca0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:23.976356 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d28aa6a1-ebd3-4849-acf4-c4b32fbf6013 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:23.979483 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6da66547-c13b-42aa-98d4-9874fa0ed69c tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] [instance: 19fca11b-d467-40b0-ab5b-53a96dbdc6fd] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:23.980674 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d28aa6a1-ebd3-4849-acf4-c4b32fbf6013 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:23.997285 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-6da66547-c13b-42aa-98d4-9874fa0ed69c tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] HTTP exception thrown: Instance 19fca11b-d467-40b0-ab5b-53a96dbdc6fd could not be found. Jul 25 14:48:24.000278 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d28aa6a1-ebd3-4849-acf4-c4b32fbf6013 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:24.001000 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d28aa6a1-ebd3-4849-acf4-c4b32fbf6013 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:24.002459 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d28aa6a1-ebd3-4849-acf4-c4b32fbf6013 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:24.004740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d28aa6a1-ebd3-4849-acf4-c4b32fbf6013 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6da66547-c13b-42aa-98d4-9874fa0ed69c tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Request method failure captured: Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/19fca11b-d467-40b0-ab5b-53a96dbdc6fd/os-instance-actions HTTP/1.1 Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q0W80byPUlIVpm3Ga67Upx3PMMJreS16Nw5TuzSIyFSc4nd6ng3nFmym160A1mkSWzHJ_aB3pABsYA9Tz9V0hZgPEhyA3kPT1WgIq_Sd9FfnFc0B10AcabC_gkpy5ZfYNdoODB6w7oTa9Kb2zQXc8BfUgQQjOyUv4nK4mnc0hhv24I Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 23224ac0b91a4c1ca9ee4f30d5f6b25d Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2003773253 Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/23224ac0b91a4c1ca9ee4f30d5f6b25d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/23224ac0b91a4c1ca9ee4f30d5f6b25d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_23224ac0b91a4c1ca9ee4f30d5f6b25d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/23224ac0b91a4c1ca9ee4f30d5f6b25d"}]}] Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2003773253 Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 23224ac0b91a4c1ca9ee4f30d5f6b25d Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2003773253 Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-InstanceActionsNegativeTestJSON-2003773253-project Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 1486c9b817ac48ec9ce86571ce754fb8 Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2003773253-project Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 19fca11b-d467-40b0-ab5b-53a96dbdc6fd could not be found. Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'server_id': '19fca11b-d467-40b0-ab5b-53a96dbdc6fd'} Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19fca11b-d467-40b0-ab5b-53a96dbdc6fd could not be found. Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:48:24.007950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:48:24.011913 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19fca11b-d467-40b0-ab5b-53a96dbdc6fd could not be found. Jul 25 14:48:24.011913 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:48:24.011913 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:48:24.011913 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:48:24.011913 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:48:24.011913 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:48:24.011913 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:48:24.011913 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:48:24.011913 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:48:24.011913 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19fca11b-d467-40b0-ab5b-53a96dbdc6fd could not be found. Jul 25 14:48:24.011913 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:48:24.011913 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6da66547-c13b-42aa-98d4-9874fa0ed69c tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Returning 404 to user: Instance 19fca11b-d467-40b0-ab5b-53a96dbdc6fd could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:48:24.012839 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6da66547-c13b-42aa-98d4-9874fa0ed69c tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] 10.222.0.88 "GET /compute/v2.1/servers/19fca11b-d467-40b0-ab5b-53a96dbdc6fd/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.053082 Jul 25 14:48:24.021098 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2440/4627] 10.222.0.88 () {58 vars in 1296 bytes} [Mon Jul 25 14:48:23 2022] GET /compute/v2.1/servers/19fca11b-d467-40b0-ab5b-53a96dbdc6fd/os-instance-actions => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:48:24.035426 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-67d4c4b1-acf6-4652-9d46-3756382a6990 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:24.039083 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-67d4c4b1-acf6-4652-9d46-3756382a6990 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] [instance: e18669b5-0442-4689-836a-5971c684b0c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:24.071863 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-67d4c4b1-acf6-4652-9d46-3756382a6990 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:24.074829 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-67d4c4b1-acf6-4652-9d46-3756382a6990 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:24.075926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-67d4c4b1-acf6-4652-9d46-3756382a6990 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:24.077303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-67d4c4b1-acf6-4652-9d46-3756382a6990 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:24.178092 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d28aa6a1-ebd3-4849-acf4-c4b32fbf6013 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.215081 Jul 25 14:48:24.194719 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2188/4628] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:48:23 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4/os-volume_attachments => generated 197 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:48:24.216075 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-459bcbc9-88ab-4010-ba8f-e7ecc5ecf953 req-89b8c0b3-2bfd-4f9d-9205-b0f420990ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6922ac9f-c929-47b6-84f1-12fb9289d3ea", "tag": "4368bd6d-0c96-4bb9-b5aa-1daedefa6065"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:48:24.232975 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-67d4c4b1-acf6-4652-9d46-3756382a6990 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] [instance: e18669b5-0442-4689-836a-5971c684b0c8] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:48:24.289010 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-459bcbc9-88ab-4010-ba8f-e7ecc5ecf953 req-89b8c0b3-2bfd-4f9d-9205-b0f420990ac9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:24.298722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-459bcbc9-88ab-4010-ba8f-e7ecc5ecf953 req-89b8c0b3-2bfd-4f9d-9205-b0f420990ac9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:24.360956 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-459bcbc9-88ab-4010-ba8f-e7ecc5ecf953 req-89b8c0b3-2bfd-4f9d-9205-b0f420990ac9 service nova] Creating event network-changed:4368bd6d-0c96-4bb9-b5aa-1daedefa6065 for instance 6922ac9f-c929-47b6-84f1-12fb9289d3ea on n-h1-846435-14 Jul 25 14:48:24.391891 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-459bcbc9-88ab-4010-ba8f-e7ecc5ecf953 req-89b8c0b3-2bfd-4f9d-9205-b0f420990ac9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187288 Jul 25 14:48:24.392970 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2189/4629] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:48:24.696493 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-67d4c4b1-acf6-4652-9d46-3756382a6990 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] 10.222.0.88 "DELETE /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8" status: 204 len: 0 microversion: 2.1 time: 0.670591 Jul 25 14:48:24.703679 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2441/4630] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:48:24 2022] DELETE /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 14:48:24.713414 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-452c969d-3f18-44cb-b9c8-77c3d25f19d2 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:24.714933 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-452c969d-3f18-44cb-b9c8-77c3d25f19d2 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] [instance: e18669b5-0442-4689-836a-5971c684b0c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:24.733030 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0ed0bb46-0809-4d5c-9df4-5561780d1936 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46987c5d30>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:24.734175 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-452c969d-3f18-44cb-b9c8-77c3d25f19d2 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:24.738122 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-452c969d-3f18-44cb-b9c8-77c3d25f19d2 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:24.747682 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-452c969d-3f18-44cb-b9c8-77c3d25f19d2 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:24.748681 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-452c969d-3f18-44cb-b9c8-77c3d25f19d2 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:24.878122 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0ed0bb46-0809-4d5c-9df4-5561780d1936 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1412 microversion: 2.1 time: 0.150012 Jul 25 14:48:24.893260 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2442/4631] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:48:24 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1412 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:24.921430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8be67079-930d-4027-97be-5bfaf37264f2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:24.922448 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8be67079-930d-4027-97be-5bfaf37264f2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:24.935809 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8be67079-930d-4027-97be-5bfaf37264f2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:24.944522 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8be67079-930d-4027-97be-5bfaf37264f2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:24.945648 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8be67079-930d-4027-97be-5bfaf37264f2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:24.948594 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8be67079-930d-4027-97be-5bfaf37264f2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:25.330903 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-452c969d-3f18-44cb-b9c8-77c3d25f19d2 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486c9b817ac48ec9ce86571ce754fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23224ac0b91a4c1ca9ee4f30d5f6b25d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:25.340355 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-452c969d-3f18-44cb-b9c8-77c3d25f19d2 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] 10.222.0.88 "GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8" status: 200 len: 1526 microversion: 2.1 time: 0.632007 Jul 25 14:48:25.344343 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2190/4632] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:24 2022] GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8 => generated 1526 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:25.349761 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-02b75afd-0f70-46de-a641-16fceb8666fd tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:25.352513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-02b75afd-0f70-46de-a641-16fceb8666fd tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:25.359637 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-02b75afd-0f70-46de-a641-16fceb8666fd tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:25.360380 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-02b75afd-0f70-46de-a641-16fceb8666fd tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:25.361420 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-02b75afd-0f70-46de-a641-16fceb8666fd tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:25.362068 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-02b75afd-0f70-46de-a641-16fceb8666fd tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:25.392993 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:48:25.399917 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-02b75afd-0f70-46de-a641-16fceb8666fd tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054080 Jul 25 14:48:25.403520 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2191/4633] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:48:25 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:48:25.794000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8be67079-930d-4027-97be-5bfaf37264f2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:25.802617 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8be67079-930d-4027-97be-5bfaf37264f2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea" status: 200 len: 1362 microversion: 2.1 time: 0.885103 Jul 25 14:48:25.807336 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2443/4634] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:24 2022] GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea => generated 1362 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:48:25.908367 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-85b93c3f-08d8-43db-8d72-e630710bc394 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46987e0700>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:26.023664 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-85b93c3f-08d8-43db-8d72-e630710bc394 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1412 microversion: 2.1 time: 0.126409 Jul 25 14:48:26.024888 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2192/4635] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:48:25 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1412 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:48:26.392611 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f73dab13-fdb1-4965-9130-f83e0efcde31 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:26.393224 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f73dab13-fdb1-4965-9130-f83e0efcde31 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] [instance: e18669b5-0442-4689-836a-5971c684b0c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:26.410614 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f73dab13-fdb1-4965-9130-f83e0efcde31 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:26.411354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f73dab13-fdb1-4965-9130-f83e0efcde31 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:26.412467 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f73dab13-fdb1-4965-9130-f83e0efcde31 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:26.417695 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f73dab13-fdb1-4965-9130-f83e0efcde31 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:26.424268 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-37c02e27-238b-4dd5-a3a3-1dbd92c8e264 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:26.426891 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-37c02e27-238b-4dd5-a3a3-1dbd92c8e264 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:26.451027 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37c02e27-238b-4dd5-a3a3-1dbd92c8e264 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:26.486220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37c02e27-238b-4dd5-a3a3-1dbd92c8e264 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:26.491678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37c02e27-238b-4dd5-a3a3-1dbd92c8e264 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:26.506390 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37c02e27-238b-4dd5-a3a3-1dbd92c8e264 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:26.622346 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-37c02e27-238b-4dd5-a3a3-1dbd92c8e264 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.202995 Jul 25 14:48:26.638059 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2193/4636] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:48:26 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4/os-volume_attachments => generated 25 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:48:26.773166 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fa1b2110-b94c-4982-9b09-fbefe621457d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:26.774291 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fa1b2110-b94c-4982-9b09-fbefe621457d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:26.787794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa1b2110-b94c-4982-9b09-fbefe621457d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:26.794723 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa1b2110-b94c-4982-9b09-fbefe621457d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:26.796832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa1b2110-b94c-4982-9b09-fbefe621457d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:26.802216 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa1b2110-b94c-4982-9b09-fbefe621457d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:26.891870 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fa1b2110-b94c-4982-9b09-fbefe621457d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:48:27.055115 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fa1b2110-b94c-4982-9b09-fbefe621457d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "DELETE /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4" status: 204 len: 0 microversion: 2.1 time: 0.285177 Jul 25 14:48:27.056740 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2194/4637] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:48:26 2022] DELETE /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 14:48:27.064093 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-72bb5a7d-1c96-4c5b-9df2-108918967a86 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:27.065521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-72bb5a7d-1c96-4c5b-9df2-108918967a86 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:27.074406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-72bb5a7d-1c96-4c5b-9df2-108918967a86 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:27.074896 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-72bb5a7d-1c96-4c5b-9df2-108918967a86 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:27.075964 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-72bb5a7d-1c96-4c5b-9df2-108918967a86 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:27.076737 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-72bb5a7d-1c96-4c5b-9df2-108918967a86 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:27.176266 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f73dab13-fdb1-4965-9130-f83e0efcde31 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486c9b817ac48ec9ce86571ce754fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23224ac0b91a4c1ca9ee4f30d5f6b25d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:27.176266 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:48:27.192317 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f73dab13-fdb1-4965-9130-f83e0efcde31 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] 10.222.0.88 "GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8" status: 200 len: 1526 microversion: 2.1 time: 0.807784 Jul 25 14:48:27.204511 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2444/4638] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:26 2022] GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8 => generated 1526 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:27.208258 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6db426a3-c6ee-473b-8568-10f470548fc0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46864ebf70>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:27.308577 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6db426a3-c6ee-473b-8568-10f470548fc0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1412 microversion: 2.1 time: 0.109035 Jul 25 14:48:27.312213 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2445/4639] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:48:27 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1412 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:27.320213 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-40fdad95-bf64-4516-92e8-834d86f86664 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:27.321031 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-40fdad95-bf64-4516-92e8-834d86f86664 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:27.329706 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-40fdad95-bf64-4516-92e8-834d86f86664 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:27.330504 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-40fdad95-bf64-4516-92e8-834d86f86664 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:27.331485 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-40fdad95-bf64-4516-92e8-834d86f86664 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:27.333057 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-40fdad95-bf64-4516-92e8-834d86f86664 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:27.484915 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-72bb5a7d-1c96-4c5b-9df2-108918967a86 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:27.505837 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-72bb5a7d-1c96-4c5b-9df2-108918967a86 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea" status: 200 len: 1362 microversion: 2.1 time: 0.441767 Jul 25 14:48:27.511292 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2195/4640] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:27 2022] GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea => generated 1362 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:27.714035 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-030e5942-ae7f-4c9a-a613-37fa1ebcf42b req-aa8dc6c2-7e72-44cf-a18a-3fb600bfb190 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18669b5-0442-4689-836a-5971c684b0c8", "name": "network-vif-deleted", "tag": "44eda288-8494-4363-876d-010b3ce95c93"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:48:27.761758 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-030e5942-ae7f-4c9a-a613-37fa1ebcf42b req-aa8dc6c2-7e72-44cf-a18a-3fb600bfb190 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:27.766299 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-030e5942-ae7f-4c9a-a613-37fa1ebcf42b req-aa8dc6c2-7e72-44cf-a18a-3fb600bfb190 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:27.802113 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-030e5942-ae7f-4c9a-a613-37fa1ebcf42b req-aa8dc6c2-7e72-44cf-a18a-3fb600bfb190 service nova] Creating event network-vif-deleted:44eda288-8494-4363-876d-010b3ce95c93 for instance e18669b5-0442-4689-836a-5971c684b0c8 on n-h2-846435-14 Jul 25 14:48:27.818971 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-030e5942-ae7f-4c9a-a613-37fa1ebcf42b req-aa8dc6c2-7e72-44cf-a18a-3fb600bfb190 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108692 Jul 25 14:48:27.822371 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2196/4641] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:48:27.991130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-40fdad95-bf64-4516-92e8-834d86f86664 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:28.001337 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-40fdad95-bf64-4516-92e8-834d86f86664 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4" status: 200 len: 1679 microversion: 2.1 time: 0.687086 Jul 25 14:48:28.019312 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2446/4642] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:27 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4 => generated 1679 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:28.222141 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-02231a57-84f2-46b7-9c4d-3a6495d80c08 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:28.223313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-02231a57-84f2-46b7-9c4d-3a6495d80c08 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] [instance: e18669b5-0442-4689-836a-5971c684b0c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:28.269464 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-02231a57-84f2-46b7-9c4d-3a6495d80c08 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:28.269921 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-02231a57-84f2-46b7-9c4d-3a6495d80c08 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:28.270727 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-02231a57-84f2-46b7-9c4d-3a6495d80c08 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:28.271181 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-02231a57-84f2-46b7-9c4d-3a6495d80c08 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:28.332010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d58cfb5d-daf7-4156-826b-64c5eb6f32b8 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46865301f0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:28.484504 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d58cfb5d-daf7-4156-826b-64c5eb6f32b8 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1421 microversion: 2.1 time: 0.161537 Jul 25 14:48:28.485791 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2447/4643] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:48:28 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1421 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:48:28.508783 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-18f5141e-937d-43ac-b29d-bc28980f1839 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46864ebee0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:28.523546 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-02231a57-84f2-46b7-9c4d-3a6495d80c08 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:28.523546 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-02231a57-84f2-46b7-9c4d-3a6495d80c08 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.046s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:28.523546 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-02231a57-84f2-46b7-9c4d-3a6495d80c08 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lazy-loading 'fault' on Instance uuid e18669b5-0442-4689-836a-5971c684b0c8 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:48:28.609761 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-18f5141e-937d-43ac-b29d-bc28980f1839 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 200 len: 1421 microversion: 2.1 time: 0.113713 Jul 25 14:48:28.612824 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2448/4644] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:48:28 2022] GET /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 1421 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:28.625467 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-025ba68a-89b3-4701-95cb-946ab7d74bce tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:28.627701 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-025ba68a-89b3-4701-95cb-946ab7d74bce tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:28.648513 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-025ba68a-89b3-4701-95cb-946ab7d74bce tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:28.649257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-025ba68a-89b3-4701-95cb-946ab7d74bce tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:28.650700 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-025ba68a-89b3-4701-95cb-946ab7d74bce tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:28.654548 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-025ba68a-89b3-4701-95cb-946ab7d74bce tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:29.114941 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-02231a57-84f2-46b7-9c4d-3a6495d80c08 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1486c9b817ac48ec9ce86571ce754fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23224ac0b91a4c1ca9ee4f30d5f6b25d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:29.126214 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-02231a57-84f2-46b7-9c4d-3a6495d80c08 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] 10.222.0.88 "GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8" status: 200 len: 1314 microversion: 2.1 time: 0.910901 Jul 25 14:48:29.127084 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2197/4645] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:28 2022] GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8 => generated 1314 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:29.139607 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-78e9eac2-b4be-407b-943d-53ed1e1f589c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46988995e0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:29.281885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-025ba68a-89b3-4701-95cb-946ab7d74bce tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:29.295060 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-025ba68a-89b3-4701-95cb-946ab7d74bce tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea" status: 200 len: 1362 microversion: 2.1 time: 0.680590 Jul 25 14:48:29.303423 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2449/4646] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:28 2022] GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea => generated 1362 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:29.322315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-212796df-7fc2-4334-a82c-5a53fe78f1cd tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:29.322985 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-212796df-7fc2-4334-a82c-5a53fe78f1cd tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:29.345767 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-212796df-7fc2-4334-a82c-5a53fe78f1cd tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:29.347509 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-212796df-7fc2-4334-a82c-5a53fe78f1cd tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:29.350763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-212796df-7fc2-4334-a82c-5a53fe78f1cd tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:29.351607 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-212796df-7fc2-4334-a82c-5a53fe78f1cd tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:30.111759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-212796df-7fc2-4334-a82c-5a53fe78f1cd tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:30.121094 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-212796df-7fc2-4334-a82c-5a53fe78f1cd tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4" status: 200 len: 1679 microversion: 2.1 time: 0.816394 Jul 25 14:48:30.136498 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2450/4647] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:29 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4 => generated 1679 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:30.151448 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c3b4036c-1507-4e7e-9dad-042d8738c1c4 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:30.152097 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c3b4036c-1507-4e7e-9dad-042d8738c1c4 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] [instance: e18669b5-0442-4689-836a-5971c684b0c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:30.187536 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c3b4036c-1507-4e7e-9dad-042d8738c1c4 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:30.196846 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c3b4036c-1507-4e7e-9dad-042d8738c1c4 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:30.203758 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c3b4036c-1507-4e7e-9dad-042d8738c1c4 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:30.231132 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c3b4036c-1507-4e7e-9dad-042d8738c1c4 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:30.238495 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-78e9eac2-b4be-407b-943d-53ed1e1f589c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "DELETE /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 204 len: 0 microversion: 2.1 time: 1.109261 Jul 25 14:48:30.242338 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2198/4648] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:29 2022] DELETE /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 0 bytes in 1111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:48:30.248025 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c4d77b8c-b80d-458d-a811-256dd52c7aa6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:30.248535 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c4d77b8c-b80d-458d-a811-256dd52c7aa6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:30.269341 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c4d77b8c-b80d-458d-a811-256dd52c7aa6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:30.280816 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c4d77b8c-b80d-458d-a811-256dd52c7aa6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:30.281987 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c4d77b8c-b80d-458d-a811-256dd52c7aa6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:30.282603 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c4d77b8c-b80d-458d-a811-256dd52c7aa6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:30.314250 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-c3b4036c-1507-4e7e-9dad-042d8738c1c4 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] HTTP exception thrown: Instance e18669b5-0442-4689-836a-5971c684b0c8 could not be found. Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c3b4036c-1507-4e7e-9dad-042d8738c1c4 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Request method failure captured: Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8 HTTP/1.1 Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q0W80byPUlIVpm3Ga67Upx3PMMJreS16Nw5TuzSIyFSc4nd6ng3nFmym160A1mkSWzHJ_aB3pABsYA9Tz9V0hZgPEhyA3kPT1WgIq_Sd9FfnFc0B10AcabC_gkpy5ZfYNdoODB6w7oTa9Kb2zQXc8BfUgQQjOyUv4nK4mnc0hhv24I Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 23224ac0b91a4c1ca9ee4f30d5f6b25d Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2003773253 Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/23224ac0b91a4c1ca9ee4f30d5f6b25d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/23224ac0b91a4c1ca9ee4f30d5f6b25d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_23224ac0b91a4c1ca9ee4f30d5f6b25d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/23224ac0b91a4c1ca9ee4f30d5f6b25d"}]}] Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2003773253 Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 23224ac0b91a4c1ca9ee4f30d5f6b25d Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2003773253 Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-InstanceActionsNegativeTestJSON-2003773253-project Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 1486c9b817ac48ec9ce86571ce754fb8 Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2003773253-project Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance e18669b5-0442-4689-836a-5971c684b0c8 could not be found. Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'e18669b5-0442-4689-836a-5971c684b0c8'} Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e18669b5-0442-4689-836a-5971c684b0c8 could not be found. Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e18669b5-0442-4689-836a-5971c684b0c8 could not be found. Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:48:30.322076 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:48:30.326955 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:48:30.326955 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:48:30.326955 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:48:30.326955 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:48:30.326955 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:48:30.326955 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:48:30.326955 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e18669b5-0442-4689-836a-5971c684b0c8 could not be found. Jul 25 14:48:30.326955 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:48:30.326955 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c3b4036c-1507-4e7e-9dad-042d8738c1c4 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] Returning 404 to user: Instance e18669b5-0442-4689-836a-5971c684b0c8 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:48:30.329506 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c3b4036c-1507-4e7e-9dad-042d8738c1c4 tempest-InstanceActionsNegativeTestJSON-2003773253 tempest-InstanceActionsNegativeTestJSON-2003773253-project] 10.222.0.88 "GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8" status: 404 len: 111 microversion: 2.1 time: 0.180248 Jul 25 14:48:30.333429 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2451/4649] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:30 2022] GET /compute/v2.1/servers/e18669b5-0442-4689-836a-5971c684b0c8 => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:48:30.346931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f44f3707-925c-4c2d-b9f0-aa5e1e327c75 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:30.347565 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f44f3707-925c-4c2d-b9f0-aa5e1e327c75 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:30.350944 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c4d77b8c-b80d-458d-a811-256dd52c7aa6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:48:30.375654 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f44f3707-925c-4c2d-b9f0-aa5e1e327c75 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:30.376368 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f44f3707-925c-4c2d-b9f0-aa5e1e327c75 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:30.379384 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f44f3707-925c-4c2d-b9f0-aa5e1e327c75 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:30.379965 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f44f3707-925c-4c2d-b9f0-aa5e1e327c75 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:30.581107 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c4d77b8c-b80d-458d-a811-256dd52c7aa6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "DELETE /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 204 len: 0 microversion: 2.1 time: 0.336985 Jul 25 14:48:30.593646 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2199/4650] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:48:30 2022] DELETE /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:48:30.829145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f44f3707-925c-4c2d-b9f0-aa5e1e327c75 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:30.839192 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b97764af-5390-4285-b8b7-f95fc29972b9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1220721729", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "87cfcadc-6ea1-4167-a535-aad1c1b10077"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:48:30.848725 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f44f3707-925c-4c2d-b9f0-aa5e1e327c75 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea" status: 200 len: 1362 microversion: 2.1 time: 0.513606 Jul 25 14:48:30.853027 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2452/4651] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:30 2022] GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea => generated 1362 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:30.969459 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-b97764af-5390-4285-b8b7-f95fc29972b9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] validate_networks() for [('87cfcadc-6ea1-4167-a535-aad1c1b10077', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:48:31.144680 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-292056ee-e8cb-4bc1-aaae-e379f6f7303a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:31.145598 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-292056ee-e8cb-4bc1-aaae-e379f6f7303a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:31.172296 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-292056ee-e8cb-4bc1-aaae-e379f6f7303a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:31.172973 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-292056ee-e8cb-4bc1-aaae-e379f6f7303a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:31.173969 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-292056ee-e8cb-4bc1-aaae-e379f6f7303a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:31.182327 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-292056ee-e8cb-4bc1-aaae-e379f6f7303a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:31.921870 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-292056ee-e8cb-4bc1-aaae-e379f6f7303a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:31.937268 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-292056ee-e8cb-4bc1-aaae-e379f6f7303a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4" status: 200 len: 1679 microversion: 2.1 time: 0.795889 Jul 25 14:48:31.937928 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2453/4652] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:31 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4 => generated 1679 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:48:31.955790 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d4e3d2d1-737c-4dc4-aa8a-1ce59b85276f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:31.961570 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d4e3d2d1-737c-4dc4-aa8a-1ce59b85276f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:31.979275 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d4e3d2d1-737c-4dc4-aa8a-1ce59b85276f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:31.981933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d4e3d2d1-737c-4dc4-aa8a-1ce59b85276f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:31.983333 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d4e3d2d1-737c-4dc4-aa8a-1ce59b85276f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:31.983782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d4e3d2d1-737c-4dc4-aa8a-1ce59b85276f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:32.968608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d4e3d2d1-737c-4dc4-aa8a-1ce59b85276f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:32.977969 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d4e3d2d1-737c-4dc4-aa8a-1ce59b85276f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea" status: 200 len: 1362 microversion: 2.1 time: 1.037237 Jul 25 14:48:32.980750 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2454/4653] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:31 2022] GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea => generated 1362 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:32.995819 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1521142b-6ce0-4926-932d-ae865e9788f8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:32.996963 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1521142b-6ce0-4926-932d-ae865e9788f8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:33.015565 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1521142b-6ce0-4926-932d-ae865e9788f8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:33.016770 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1521142b-6ce0-4926-932d-ae865e9788f8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:33.017977 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1521142b-6ce0-4926-932d-ae865e9788f8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:33.018623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1521142b-6ce0-4926-932d-ae865e9788f8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:33.307096 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1521142b-6ce0-4926-932d-ae865e9788f8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:33.327917 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1521142b-6ce0-4926-932d-ae865e9788f8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4" status: 200 len: 1612 microversion: 2.1 time: 0.341827 Jul 25 14:48:33.329825 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2455/4654] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:32 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4 => generated 1612 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:33.341926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-836e2290-ce6f-422f-a659-d07fa70f609c req-401967b3-03a6-458d-bb12-a94747822447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdf119f5-416e-456f-86d6-8acff67d7c9b", "name": "network-vif-unplugged", "status": "completed", "tag": "94e2f165-153f-4c22-881e-01b36ec8ec5d"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:48:33.378040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-836e2290-ce6f-422f-a659-d07fa70f609c req-401967b3-03a6-458d-bb12-a94747822447 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:33.378645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-836e2290-ce6f-422f-a659-d07fa70f609c req-401967b3-03a6-458d-bb12-a94747822447 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:33.414432 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-836e2290-ce6f-422f-a659-d07fa70f609c req-401967b3-03a6-458d-bb12-a94747822447 service nova] Creating event network-vif-unplugged:94e2f165-153f-4c22-881e-01b36ec8ec5d for instance bdf119f5-416e-456f-86d6-8acff67d7c9b on n-h1-846435-14 Jul 25 14:48:33.450910 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-836e2290-ce6f-422f-a659-d07fa70f609c req-401967b3-03a6-458d-bb12-a94747822447 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115136 Jul 25 14:48:33.452425 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2456/4655] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:48:33.971954 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-b97764af-5390-4285-b8b7-f95fc29972b9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:48:33.972527 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-b97764af-5390-4285-b8b7-f95fc29972b9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:48:33.981478 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-b97764af-5390-4285-b8b7-f95fc29972b9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:48:33.982084 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-b97764af-5390-4285-b8b7-f95fc29972b9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:48:33.982590 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-b97764af-5390-4285-b8b7-f95fc29972b9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:48:34.013195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ee092061-395c-45bf-ae35-1164087a77c8 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:34.013911 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ee092061-395c-45bf-ae35-1164087a77c8 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:34.053935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b97764af-5390-4285-b8b7-f95fc29972b9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:34.054432 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b97764af-5390-4285-b8b7-f95fc29972b9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:34.054862 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee092061-395c-45bf-ae35-1164087a77c8 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:34.055283 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b97764af-5390-4285-b8b7-f95fc29972b9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:34.055414 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee092061-395c-45bf-ae35-1164087a77c8 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:34.062083 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b97764af-5390-4285-b8b7-f95fc29972b9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:34.065478 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee092061-395c-45bf-ae35-1164087a77c8 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:34.066057 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee092061-395c-45bf-ae35-1164087a77c8 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:34.128476 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-b97764af-5390-4285-b8b7-f95fc29972b9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Getting quotas for project 87b0942d86634ed0a2f89a0001b5a887. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:48:34.147829 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-b97764af-5390-4285-b8b7-f95fc29972b9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Getting quotas for user 6e3de16106b3455b85f90dcd94d39ce0 and project 87b0942d86634ed0a2f89a0001b5a887. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:48:34.192768 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b97764af-5390-4285-b8b7-f95fc29972b9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:48:34.202716 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b97764af-5390-4285-b8b7-f95fc29972b9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 2a545a10-2062-4c00-97ef-19591b829c0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:48:34.348912 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b97764af-5390-4285-b8b7-f95fc29972b9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.514832 Jul 25 14:48:34.349914 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2200/4656] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:48:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 3517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:48:34.364272 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-36d772e6-50d9-40a9-a93f-48c7846206c0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:34.365052 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-36d772e6-50d9-40a9-a93f-48c7846206c0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:34.376787 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-36d772e6-50d9-40a9-a93f-48c7846206c0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:34.383491 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-36d772e6-50d9-40a9-a93f-48c7846206c0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:34.386490 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-36d772e6-50d9-40a9-a93f-48c7846206c0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:34.388783 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-36d772e6-50d9-40a9-a93f-48c7846206c0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:34.932813 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ee092061-395c-45bf-ae35-1164087a77c8 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:34.968554 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ee092061-395c-45bf-ae35-1164087a77c8 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea" status: 200 len: 1362 microversion: 2.1 time: 0.941291 Jul 25 14:48:34.975548 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2457/4657] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:34 2022] GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea => generated 1362 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:48:34.988658 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-03143923-d03d-44f7-8ae2-abbd9f4b6cbc tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:34.990546 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-03143923-d03d-44f7-8ae2-abbd9f4b6cbc tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 2a545a10-2062-4c00-97ef-19591b829c0d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:35.487702 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-03143923-d03d-44f7-8ae2-abbd9f4b6cbc tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:35.497436 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-03143923-d03d-44f7-8ae2-abbd9f4b6cbc tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d" status: 200 len: 1208 microversion: 2.1 time: 0.519593 Jul 25 14:48:35.513197 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2458/4658] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:34 2022] GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d => generated 1208 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:35.520248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-36d772e6-50d9-40a9-a93f-48c7846206c0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:35.558440 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-db5718a3-18d7-4667-9545-a4cb3c7b9fdd req-8f6925d8-fdca-4798-ab0e-040069fcf0dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6922ac9f-c929-47b6-84f1-12fb9289d3ea", "name": "network-vif-plugged", "status": "completed", "tag": "4368bd6d-0c96-4bb9-b5aa-1daedefa6065"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:48:35.565704 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-36d772e6-50d9-40a9-a93f-48c7846206c0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4" status: 200 len: 1612 microversion: 2.1 time: 1.214563 Jul 25 14:48:35.572172 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2201/4659] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:34 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4 => generated 1612 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:35.603441 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-db5718a3-18d7-4667-9545-a4cb3c7b9fdd req-8f6925d8-fdca-4798-ab0e-040069fcf0dc service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:35.603908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-db5718a3-18d7-4667-9545-a4cb3c7b9fdd req-8f6925d8-fdca-4798-ab0e-040069fcf0dc service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:35.619930 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-db5718a3-18d7-4667-9545-a4cb3c7b9fdd req-8f6925d8-fdca-4798-ab0e-040069fcf0dc service nova] Creating event network-vif-plugged:4368bd6d-0c96-4bb9-b5aa-1daedefa6065 for instance 6922ac9f-c929-47b6-84f1-12fb9289d3ea on n-h1-846435-14 Jul 25 14:48:35.649006 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-db5718a3-18d7-4667-9545-a4cb3c7b9fdd req-8f6925d8-fdca-4798-ab0e-040069fcf0dc service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105376 Jul 25 14:48:35.654247 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2459/4660] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:48:35.991286 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bcff3375-0fc6-42ef-ad3d-7d1065c361ad tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:35.993226 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bcff3375-0fc6-42ef-ad3d-7d1065c361ad tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:36.006614 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bcff3375-0fc6-42ef-ad3d-7d1065c361ad tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:36.014167 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bcff3375-0fc6-42ef-ad3d-7d1065c361ad tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:36.019362 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bcff3375-0fc6-42ef-ad3d-7d1065c361ad tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:36.024131 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bcff3375-0fc6-42ef-ad3d-7d1065c361ad tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:36.530211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-25b48314-85f0-4c68-a218-b26504343a0a tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:36.534648 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-25b48314-85f0-4c68-a218-b26504343a0a tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 2a545a10-2062-4c00-97ef-19591b829c0d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:36.543934 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25b48314-85f0-4c68-a218-b26504343a0a tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:36.545036 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25b48314-85f0-4c68-a218-b26504343a0a tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:36.546124 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25b48314-85f0-4c68-a218-b26504343a0a tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:36.546923 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25b48314-85f0-4c68-a218-b26504343a0a tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:36.805602 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-25b48314-85f0-4c68-a218-b26504343a0a tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:36.820090 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-25b48314-85f0-4c68-a218-b26504343a0a tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d" status: 200 len: 1260 microversion: 2.1 time: 0.295165 Jul 25 14:48:36.839031 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2460/4661] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:36 2022] GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d => generated 1260 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:36.853549 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d7f60ec7-0795-40d7-97c4-3b8183a16113 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:36.857909 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d7f60ec7-0795-40d7-97c4-3b8183a16113 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:36.868874 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d7f60ec7-0795-40d7-97c4-3b8183a16113 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:36.872384 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d7f60ec7-0795-40d7-97c4-3b8183a16113 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:36.874443 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d7f60ec7-0795-40d7-97c4-3b8183a16113 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:36.875488 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d7f60ec7-0795-40d7-97c4-3b8183a16113 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:36.917714 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d7f60ec7-0795-40d7-97c4-3b8183a16113 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:36.918297 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d7f60ec7-0795-40d7-97c4-3b8183a16113 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:36.918743 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-d7f60ec7-0795-40d7-97c4-3b8183a16113 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lazy-loading 'fault' on Instance uuid 5d038cc3-67d7-4ac0-93bd-e668700cd3b4 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:48:36.919517 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bcff3375-0fc6-42ef-ad3d-7d1065c361ad tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:36.930910 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bcff3375-0fc6-42ef-ad3d-7d1065c361ad tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea" status: 200 len: 1362 microversion: 2.1 time: 0.943815 Jul 25 14:48:36.932006 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2202/4662] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:35 2022] GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea => generated 1362 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:36.939824 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-65969899-72a6-4e66-a472-0fc9f737ca9f req-553e7dc3-32ca-4cfb-ae14-fb89cb84b149 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d038cc3-67d7-4ac0-93bd-e668700cd3b4", "name": "network-vif-deleted", "tag": "368a556a-b701-43a9-866d-cbb400f29ea0"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:48:36.952041 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-65969899-72a6-4e66-a472-0fc9f737ca9f req-553e7dc3-32ca-4cfb-ae14-fb89cb84b149 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:36.952943 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-65969899-72a6-4e66-a472-0fc9f737ca9f req-553e7dc3-32ca-4cfb-ae14-fb89cb84b149 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:36.975301 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-65969899-72a6-4e66-a472-0fc9f737ca9f req-553e7dc3-32ca-4cfb-ae14-fb89cb84b149 service nova] Creating event network-vif-deleted:368a556a-b701-43a9-866d-cbb400f29ea0 for instance 5d038cc3-67d7-4ac0-93bd-e668700cd3b4 on n-h1-846435-14 Jul 25 14:48:36.989480 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-65969899-72a6-4e66-a472-0fc9f737ca9f req-553e7dc3-32ca-4cfb-ae14-fb89cb84b149 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055882 Jul 25 14:48:36.990722 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2203/4663] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:48:37.405860 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d7f60ec7-0795-40d7-97c4-3b8183a16113 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:37.413908 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d7f60ec7-0795-40d7-97c4-3b8183a16113 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4" status: 200 len: 1330 microversion: 2.1 time: 0.569851 Jul 25 14:48:37.423033 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2461/4664] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:36 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4 => generated 1330 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:37.849000 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-03a22b54-c755-46bf-9469-0e05c694f59c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:37.849723 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-03a22b54-c755-46bf-9469-0e05c694f59c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 2a545a10-2062-4c00-97ef-19591b829c0d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:37.873328 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03a22b54-c755-46bf-9469-0e05c694f59c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:37.873943 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03a22b54-c755-46bf-9469-0e05c694f59c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:37.874812 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03a22b54-c755-46bf-9469-0e05c694f59c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:37.875260 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03a22b54-c755-46bf-9469-0e05c694f59c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:37.972560 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5efb8f98-16f9-48ae-ba83-77538819a3ba tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:37.973195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5efb8f98-16f9-48ae-ba83-77538819a3ba tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:37.989620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5efb8f98-16f9-48ae-ba83-77538819a3ba tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:37.991007 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5efb8f98-16f9-48ae-ba83-77538819a3ba tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:37.991815 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5efb8f98-16f9-48ae-ba83-77538819a3ba tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:37.992284 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5efb8f98-16f9-48ae-ba83-77538819a3ba tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:38.224902 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-03a22b54-c755-46bf-9469-0e05c694f59c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:38.243282 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-03a22b54-c755-46bf-9469-0e05c694f59c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d" status: 200 len: 1266 microversion: 2.1 time: 0.396968 Jul 25 14:48:38.243282 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2204/4665] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:37 2022] GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d => generated 1266 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:38.461402 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b380e1e4-3cae-4a84-912b-3c99d97d5789 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:38.462452 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b380e1e4-3cae-4a84-912b-3c99d97d5789 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:38.477658 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b380e1e4-3cae-4a84-912b-3c99d97d5789 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:38.479948 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b380e1e4-3cae-4a84-912b-3c99d97d5789 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:38.481233 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b380e1e4-3cae-4a84-912b-3c99d97d5789 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:38.484971 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b380e1e4-3cae-4a84-912b-3c99d97d5789 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:38.523116 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-b380e1e4-3cae-4a84-912b-3c99d97d5789 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] HTTP exception thrown: Instance 5d038cc3-67d7-4ac0-93bd-e668700cd3b4 could not be found. Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b380e1e4-3cae-4a84-912b-3c99d97d5789 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Request method failure captured: Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4 HTTP/1.1 Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qxVTVC8FUnn-t2qK29pQ6gpvvVkF5Cd1ek9O6-ax9bIU4h-Acw7IM2XyPTWfCK6LWhHPoO7fpkEcbhitPiuVrA5WlFZ0WfmMB-2I-MAtgO20bt12dRN-m_gApdOXiuB_IoQnmtlPGVQzahhzXBQE11eo5L_JzE39RyLIYMYF8wTD50 Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 325aff76e61141a985b3b0f45521444f Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/325aff76e61141a985b3b0f45521444f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/325aff76e61141a985b3b0f45521444f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_325aff76e61141a985b3b0f45521444f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/325aff76e61141a985b3b0f45521444f"}]}] Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 325aff76e61141a985b3b0f45521444f Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-AttachVolumeNegativeTest-1959370092-project Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 571a2d92d7a34f86bb3c0bfdfcabc5ff Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-AttachVolumeNegativeTest-1959370092-project Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 5d038cc3-67d7-4ac0-93bd-e668700cd3b4 could not be found. Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '5d038cc3-67d7-4ac0-93bd-e668700cd3b4'} Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d038cc3-67d7-4ac0-93bd-e668700cd3b4 could not be found. Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d038cc3-67d7-4ac0-93bd-e668700cd3b4 could not be found. Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:48:38.525805 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:48:38.530731 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:48:38.530731 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:48:38.530731 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:48:38.530731 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:48:38.530731 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:48:38.530731 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d038cc3-67d7-4ac0-93bd-e668700cd3b4 could not be found. Jul 25 14:48:38.530731 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:48:38.532909 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b380e1e4-3cae-4a84-912b-3c99d97d5789 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Returning 404 to user: Instance 5d038cc3-67d7-4ac0-93bd-e668700cd3b4 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:48:38.536987 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b380e1e4-3cae-4a84-912b-3c99d97d5789 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4" status: 404 len: 111 microversion: 2.1 time: 0.097767 Jul 25 14:48:38.540308 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2205/4666] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:38 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:48:38.558185 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6aca0b61-97f8-4b0c-8da4-ea533bac31af tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '.version_select at 0x7f4686c06820>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:38.589468 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:48:38.599768 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6aca0b61-97f8-4b0c-8da4-ea533bac31af tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-131251117" status: 202 len: 0 microversion: 2.1 time: 0.054901 Jul 25 14:48:38.600713 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2206/4667] 10.222.0.88 () {58 vars in 1218 bytes} [Mon Jul 25 14:48:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-131251117 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:48:38.879466 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5efb8f98-16f9-48ae-ba83-77538819a3ba tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:38.890788 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5efb8f98-16f9-48ae-ba83-77538819a3ba tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea" status: 200 len: 1362 microversion: 2.1 time: 0.925897 Jul 25 14:48:38.892141 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2462/4668] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:37 2022] GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea => generated 1362 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:39.084876 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-f9316889-fed7-49ef-9476-c62d8d354595 req-11264f5f-1fd1-4427-a3d9-6dafeec4e932 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdf119f5-416e-456f-86d6-8acff67d7c9b", "name": "network-vif-deleted", "tag": "94e2f165-153f-4c22-881e-01b36ec8ec5d"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:48:39.113649 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f9316889-fed7-49ef-9476-c62d8d354595 req-11264f5f-1fd1-4427-a3d9-6dafeec4e932 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:39.117172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f9316889-fed7-49ef-9476-c62d8d354595 req-11264f5f-1fd1-4427-a3d9-6dafeec4e932 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:39.153255 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-f9316889-fed7-49ef-9476-c62d8d354595 req-11264f5f-1fd1-4427-a3d9-6dafeec4e932 service nova] Creating event network-vif-deleted:94e2f165-153f-4c22-881e-01b36ec8ec5d for instance bdf119f5-416e-456f-86d6-8acff67d7c9b on n-h1-846435-14 Jul 25 14:48:39.169831 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-f9316889-fed7-49ef-9476-c62d8d354595 req-11264f5f-1fd1-4427-a3d9-6dafeec4e932 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101881 Jul 25 14:48:39.170504 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2207/4669] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:48:39.265155 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0f0b45f1-33d8-4579-8617-f9146ba525b1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:39.265798 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0f0b45f1-33d8-4579-8617-f9146ba525b1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 2a545a10-2062-4c00-97ef-19591b829c0d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:39.279755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0f0b45f1-33d8-4579-8617-f9146ba525b1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:39.280932 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0f0b45f1-33d8-4579-8617-f9146ba525b1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:39.282594 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0f0b45f1-33d8-4579-8617-f9146ba525b1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:39.284219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0f0b45f1-33d8-4579-8617-f9146ba525b1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:39.470043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0f0b45f1-33d8-4579-8617-f9146ba525b1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:39.486797 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0f0b45f1-33d8-4579-8617-f9146ba525b1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d" status: 200 len: 1266 microversion: 2.1 time: 0.227619 Jul 25 14:48:39.489851 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2463/4670] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:39 2022] GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:39.916381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f3aa1c5e-8e72-4a22-8a27-1fe0c24940cb tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:39.917109 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f3aa1c5e-8e72-4a22-8a27-1fe0c24940cb tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:39.943761 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3aa1c5e-8e72-4a22-8a27-1fe0c24940cb tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:39.949188 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3aa1c5e-8e72-4a22-8a27-1fe0c24940cb tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:39.951337 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3aa1c5e-8e72-4a22-8a27-1fe0c24940cb tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:39.954905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3aa1c5e-8e72-4a22-8a27-1fe0c24940cb tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:40.518885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-18e0b0b6-3d4e-4a16-9fb9-890dacdfd953 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:40.520321 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-18e0b0b6-3d4e-4a16-9fb9-890dacdfd953 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 2a545a10-2062-4c00-97ef-19591b829c0d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:40.535496 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-18e0b0b6-3d4e-4a16-9fb9-890dacdfd953 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:40.536310 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-18e0b0b6-3d4e-4a16-9fb9-890dacdfd953 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:40.538105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-18e0b0b6-3d4e-4a16-9fb9-890dacdfd953 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:40.539129 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-18e0b0b6-3d4e-4a16-9fb9-890dacdfd953 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:40.760329 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f3aa1c5e-8e72-4a22-8a27-1fe0c24940cb tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:40.779078 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f3aa1c5e-8e72-4a22-8a27-1fe0c24940cb tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea" status: 200 len: 1547 microversion: 2.1 time: 0.869767 Jul 25 14:48:40.786467 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2208/4671] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:39 2022] GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea => generated 1547 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:48:40.804680 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8a128fcd-ea23-4fd9-ad4f-ae068ce4d746 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:40.807172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8a128fcd-ea23-4fd9-ad4f-ae068ce4d746 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:40.825412 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8a128fcd-ea23-4fd9-ad4f-ae068ce4d746 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:40.827131 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8a128fcd-ea23-4fd9-ad4f-ae068ce4d746 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:40.828612 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8a128fcd-ea23-4fd9-ad4f-ae068ce4d746 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:40.831257 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8a128fcd-ea23-4fd9-ad4f-ae068ce4d746 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:40.989076 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-18e0b0b6-3d4e-4a16-9fb9-890dacdfd953 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:41.009602 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-18e0b0b6-3d4e-4a16-9fb9-890dacdfd953 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d" status: 200 len: 1308 microversion: 2.1 time: 0.502726 Jul 25 14:48:41.011622 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2464/4672] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:40 2022] GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d => generated 1308 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:48:41.441586 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8a128fcd-ea23-4fd9-ad4f-ae068ce4d746 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.641758 Jul 25 14:48:41.451380 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2209/4673] 10.222.0.88 () {58 vars in 1275 bytes} [Mon Jul 25 14:48:40 2022] GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea/os-interface => generated 284 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:48:42.046197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4c166405-bb2a-4330-ad9a-97e6b08b9d06 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:42.046954 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4c166405-bb2a-4330-ad9a-97e6b08b9d06 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 2a545a10-2062-4c00-97ef-19591b829c0d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:42.063956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4c166405-bb2a-4330-ad9a-97e6b08b9d06 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:42.064449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4c166405-bb2a-4330-ad9a-97e6b08b9d06 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:42.069829 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4c166405-bb2a-4330-ad9a-97e6b08b9d06 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:42.073342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4c166405-bb2a-4330-ad9a-97e6b08b9d06 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:42.718117 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-16a383e0-e9a7-44eb-abe0-e64dd3f91838 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Action: 'create', calling method: .version_select at 0x7f46989ad0d0>, body: {"keypair": {"name": "tempest-keypair-1683488160", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVXf5TYPByxi/493snrzQ1IE5uGaKu1K0ZnLeO4QrSNOL57NRB5cDOhyxvf3UlJJfhR19Qfq1oaeUBcNUI3tKRWbmYPVUJzIGRNkscxX5ikgz71TlN9UMXGaadQbYJ2nA=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:48:42.733078 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4c166405-bb2a-4330-ad9a-97e6b08b9d06 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:42.765075 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4c166405-bb2a-4330-ad9a-97e6b08b9d06 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d" status: 200 len: 1308 microversion: 2.1 time: 0.720143 Jul 25 14:48:42.769664 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2465/4674] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:42 2022] GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d => generated 1308 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:42.814278 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-16a383e0-e9a7-44eb-abe0-e64dd3f91838 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Getting quotas for project 325aff76e61141a985b3b0f45521444f. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:48:42.835357 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-16a383e0-e9a7-44eb-abe0-e64dd3f91838 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Getting quotas for user 571a2d92d7a34f86bb3c0bfdfcabc5ff and project 325aff76e61141a985b3b0f45521444f. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:48:42.890651 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-16a383e0-e9a7-44eb-abe0-e64dd3f91838 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.179862 Jul 25 14:48:42.896874 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2210/4675] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:48:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:48:43.790178 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2a70052d-9623-4509-b280-a1d461572ef9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:43.790950 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2a70052d-9623-4509-b280-a1d461572ef9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 2a545a10-2062-4c00-97ef-19591b829c0d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:43.805396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2a70052d-9623-4509-b280-a1d461572ef9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:43.806037 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2a70052d-9623-4509-b280-a1d461572ef9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:43.807007 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2a70052d-9623-4509-b280-a1d461572ef9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:43.807587 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2a70052d-9623-4509-b280-a1d461572ef9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:44.121037 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-389b4433-eff0-4895-872b-89e92a7463af req-43eecb1d-30b9-46a5-b245-e40f383feef4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a545a10-2062-4c00-97ef-19591b829c0d", "tag": "e11c38a4-9d6c-4fb9-933b-1470130b560f"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:48:44.128891 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:48:44.142879 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-389b4433-eff0-4895-872b-89e92a7463af req-43eecb1d-30b9-46a5-b245-e40f383feef4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:44.143654 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-389b4433-eff0-4895-872b-89e92a7463af req-43eecb1d-30b9-46a5-b245-e40f383feef4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:44.195803 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-389b4433-eff0-4895-872b-89e92a7463af req-43eecb1d-30b9-46a5-b245-e40f383feef4 service nova] Creating event network-changed:e11c38a4-9d6c-4fb9-933b-1470130b560f for instance 2a545a10-2062-4c00-97ef-19591b829c0d on n-h2-846435-14 Jul 25 14:48:44.207436 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-389b4433-eff0-4895-872b-89e92a7463af req-43eecb1d-30b9-46a5-b245-e40f383feef4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092836 Jul 25 14:48:44.208496 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2211/4676] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:48:44.321322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2a70052d-9623-4509-b280-a1d461572ef9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:44.329296 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2a70052d-9623-4509-b280-a1d461572ef9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d" status: 200 len: 1308 microversion: 2.1 time: 0.543772 Jul 25 14:48:44.337027 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2466/4677] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:43 2022] GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d => generated 1308 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:45.359466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1ec32035-a894-4ea1-b49e-612a883b08bb tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:45.361410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1ec32035-a894-4ea1-b49e-612a883b08bb tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 2a545a10-2062-4c00-97ef-19591b829c0d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:45.370981 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ec32035-a894-4ea1-b49e-612a883b08bb tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:45.372130 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ec32035-a894-4ea1-b49e-612a883b08bb tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:45.374159 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ec32035-a894-4ea1-b49e-612a883b08bb tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:45.375081 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ec32035-a894-4ea1-b49e-612a883b08bb tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:45.946010 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1ec32035-a894-4ea1-b49e-612a883b08bb tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:45.970799 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1ec32035-a894-4ea1-b49e-612a883b08bb tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d" status: 200 len: 1308 microversion: 2.1 time: 0.611802 Jul 25 14:48:45.975915 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2212/4678] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:45 2022] GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d => generated 1308 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:46.295222 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-bf211449-f3fa-4f2f-a079-8cb9c1cfe6a8 req-0b9a2e7b-8836-4fef-88e7-ae425bcafeed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6922ac9f-c929-47b6-84f1-12fb9289d3ea", "tag": "4368bd6d-0c96-4bb9-b5aa-1daedefa6065"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:48:46.311287 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:48:46.316973 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-bf211449-f3fa-4f2f-a079-8cb9c1cfe6a8 req-0b9a2e7b-8836-4fef-88e7-ae425bcafeed service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:46.317912 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-bf211449-f3fa-4f2f-a079-8cb9c1cfe6a8 req-0b9a2e7b-8836-4fef-88e7-ae425bcafeed service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:46.335944 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:48:46.339528 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-bf211449-f3fa-4f2f-a079-8cb9c1cfe6a8 req-0b9a2e7b-8836-4fef-88e7-ae425bcafeed service nova] Creating event network-changed:4368bd6d-0c96-4bb9-b5aa-1daedefa6065 for instance 6922ac9f-c929-47b6-84f1-12fb9289d3ea on n-h1-846435-14 Jul 25 14:48:46.346530 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-bf211449-f3fa-4f2f-a079-8cb9c1cfe6a8 req-0b9a2e7b-8836-4fef-88e7-ae425bcafeed service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060540 Jul 25 14:48:46.347732 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2467/4679] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:48:46.994056 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7aba5b59-965f-4e1a-be74-be283bf4b267 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:46.995322 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7aba5b59-965f-4e1a-be74-be283bf4b267 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 2a545a10-2062-4c00-97ef-19591b829c0d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:47.021407 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7aba5b59-965f-4e1a-be74-be283bf4b267 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:47.021866 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7aba5b59-965f-4e1a-be74-be283bf4b267 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:47.022644 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7aba5b59-965f-4e1a-be74-be283bf4b267 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:47.029441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7aba5b59-965f-4e1a-be74-be283bf4b267 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:47.052028 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:48:47.846252 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7aba5b59-965f-4e1a-be74-be283bf4b267 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:47.867376 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7aba5b59-965f-4e1a-be74-be283bf4b267 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d" status: 200 len: 1308 microversion: 2.1 time: 0.878120 Jul 25 14:48:47.871603 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2213/4680] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:46 2022] GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d => generated 1308 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:48.898274 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-67bb8539-0ef3-4f08-8ce9-4fffdab0b9f0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:48.898974 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-67bb8539-0ef3-4f08-8ce9-4fffdab0b9f0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 2a545a10-2062-4c00-97ef-19591b829c0d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:48.914032 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-67bb8539-0ef3-4f08-8ce9-4fffdab0b9f0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:48.914485 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-67bb8539-0ef3-4f08-8ce9-4fffdab0b9f0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:48.915274 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-67bb8539-0ef3-4f08-8ce9-4fffdab0b9f0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:48.915706 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-67bb8539-0ef3-4f08-8ce9-4fffdab0b9f0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:49.317021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-67bb8539-0ef3-4f08-8ce9-4fffdab0b9f0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:49.326409 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-67bb8539-0ef3-4f08-8ce9-4fffdab0b9f0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d" status: 200 len: 1308 microversion: 2.1 time: 0.433865 Jul 25 14:48:49.348317 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2468/4681] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:48 2022] GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d => generated 1308 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:50.368103 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e74855f7-f5d0-419f-bf75-b03225187c10 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:50.369325 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e74855f7-f5d0-419f-bf75-b03225187c10 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 2a545a10-2062-4c00-97ef-19591b829c0d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:50.384682 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e74855f7-f5d0-419f-bf75-b03225187c10 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:50.385139 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e74855f7-f5d0-419f-bf75-b03225187c10 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:50.385935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e74855f7-f5d0-419f-bf75-b03225187c10 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:50.386377 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e74855f7-f5d0-419f-bf75-b03225187c10 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:51.079931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e74855f7-f5d0-419f-bf75-b03225187c10 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:51.118161 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e74855f7-f5d0-419f-bf75-b03225187c10 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d" status: 200 len: 1308 microversion: 2.1 time: 0.753429 Jul 25 14:48:51.119018 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2214/4682] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:50 2022] GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d => generated 1308 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:51.569284 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5a9e6e19-093e-4318-b743-d2a5b11c1fdb tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-757814852", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b6c60dc-780d-4845-b966-40a7e9d46848"}], "security_groups": [{"name": "tempest-securitygroup--1618384155"}], "key_name": "tempest-keypair-1683488160", "user_data": "}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:48:52.016120 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-5a9e6e19-093e-4318-b743-d2a5b11c1fdb tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] validate_networks() for [('4b6c60dc-780d-4845-b966-40a7e9d46848', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:48:52.141838 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6e8958f2-fd8f-4b60-bb41-0b51b940bf37 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:52.142459 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6e8958f2-fd8f-4b60-bb41-0b51b940bf37 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 2a545a10-2062-4c00-97ef-19591b829c0d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:52.160329 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e8958f2-fd8f-4b60-bb41-0b51b940bf37 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:52.160700 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e8958f2-fd8f-4b60-bb41-0b51b940bf37 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:52.161492 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e8958f2-fd8f-4b60-bb41-0b51b940bf37 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:52.161927 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e8958f2-fd8f-4b60-bb41-0b51b940bf37 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:52.710444 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6e8958f2-fd8f-4b60-bb41-0b51b940bf37 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:52.723620 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6e8958f2-fd8f-4b60-bb41-0b51b940bf37 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d" status: 200 len: 1308 microversion: 2.1 time: 0.586988 Jul 25 14:48:52.725501 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2215/4683] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:52 2022] GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d => generated 1308 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:48:53.028150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-5a9e6e19-093e-4318-b743-d2a5b11c1fdb tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:48:53.028753 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-5a9e6e19-093e-4318-b743-d2a5b11c1fdb tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:48:53.029209 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-5a9e6e19-093e-4318-b743-d2a5b11c1fdb tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:48:53.029623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-5a9e6e19-093e-4318-b743-d2a5b11c1fdb tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:48:53.030038 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-5a9e6e19-093e-4318-b743-d2a5b11c1fdb tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:48:53.032265 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:48:53.066193 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5a9e6e19-093e-4318-b743-d2a5b11c1fdb tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:53.066636 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5a9e6e19-093e-4318-b743-d2a5b11c1fdb tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:53.077150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5a9e6e19-093e-4318-b743-d2a5b11c1fdb tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:53.077838 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5a9e6e19-093e-4318-b743-d2a5b11c1fdb tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:53.129168 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-5a9e6e19-093e-4318-b743-d2a5b11c1fdb tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Getting quotas for project 325aff76e61141a985b3b0f45521444f. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:48:53.141121 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-5a9e6e19-093e-4318-b743-d2a5b11c1fdb tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Getting quotas for user 571a2d92d7a34f86bb3c0bfdfcabc5ff and project 325aff76e61141a985b3b0f45521444f. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:48:53.186352 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5a9e6e19-093e-4318-b743-d2a5b11c1fdb tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:48:53.189109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5a9e6e19-093e-4318-b743-d2a5b11c1fdb tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:48:53.392996 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5a9e6e19-093e-4318-b743-d2a5b11c1fdb tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.830594 Jul 25 14:48:53.397781 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2469/4684] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:48:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 1839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:48:53.410509 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-76fb66ff-76cd-4d3d-a057-de46a72ee80e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:53.415122 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-76fb66ff-76cd-4d3d-a057-de46a72ee80e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:53.436247 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=10 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:48:53.628100 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-d8aef12f-1c40-4f3c-aaa7-83d5a8e3e89f req-8b9d89be-07ac-4ae0-b578-9066f58b2623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a545a10-2062-4c00-97ef-19591b829c0d", "name": "network-vif-plugged", "status": "completed", "tag": "e11c38a4-9d6c-4fb9-933b-1470130b560f"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:48:53.640547 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-76fb66ff-76cd-4d3d-a057-de46a72ee80e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:53.653964 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-76fb66ff-76cd-4d3d-a057-de46a72ee80e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412" status: 200 len: 1241 microversion: 2.1 time: 0.251255 Jul 25 14:48:53.657872 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2216/4685] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:53 2022] GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412 => generated 1241 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:53.666274 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-d8aef12f-1c40-4f3c-aaa7-83d5a8e3e89f req-8b9d89be-07ac-4ae0-b578-9066f58b2623 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:53.666980 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-d8aef12f-1c40-4f3c-aaa7-83d5a8e3e89f req-8b9d89be-07ac-4ae0-b578-9066f58b2623 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:53.692312 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-d8aef12f-1c40-4f3c-aaa7-83d5a8e3e89f req-8b9d89be-07ac-4ae0-b578-9066f58b2623 service nova] Creating event network-vif-plugged:e11c38a4-9d6c-4fb9-933b-1470130b560f for instance 2a545a10-2062-4c00-97ef-19591b829c0d on n-h2-846435-14 Jul 25 14:48:53.699286 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-d8aef12f-1c40-4f3c-aaa7-83d5a8e3e89f req-8b9d89be-07ac-4ae0-b578-9066f58b2623 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076157 Jul 25 14:48:53.699989 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2470/4686] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:48:53.744752 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-63dbfca2-1d06-4696-9495-bd88b47de7e9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:53.745382 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-63dbfca2-1d06-4696-9495-bd88b47de7e9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 2a545a10-2062-4c00-97ef-19591b829c0d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:53.754921 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-63dbfca2-1d06-4696-9495-bd88b47de7e9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:53.755391 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-63dbfca2-1d06-4696-9495-bd88b47de7e9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:53.756197 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-63dbfca2-1d06-4696-9495-bd88b47de7e9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:53.756639 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-63dbfca2-1d06-4696-9495-bd88b47de7e9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:54.410783 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-63dbfca2-1d06-4696-9495-bd88b47de7e9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:54.418878 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-63dbfca2-1d06-4696-9495-bd88b47de7e9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d" status: 200 len: 1308 microversion: 2.1 time: 0.678065 Jul 25 14:48:54.420330 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2217/4687] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:53 2022] GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d => generated 1308 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:54.681856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9b813e52-b4f8-4407-850f-11a4913dda43 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:54.685408 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9b813e52-b4f8-4407-850f-11a4913dda43 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:54.700970 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9b813e52-b4f8-4407-850f-11a4913dda43 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:54.701885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9b813e52-b4f8-4407-850f-11a4913dda43 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:54.702222 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9b813e52-b4f8-4407-850f-11a4913dda43 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:54.702655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9b813e52-b4f8-4407-850f-11a4913dda43 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:54.822393 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9b813e52-b4f8-4407-850f-11a4913dda43 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:54.832614 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9b813e52-b4f8-4407-850f-11a4913dda43 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412" status: 200 len: 1245 microversion: 2.1 time: 0.158718 Jul 25 14:48:54.833778 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2471/4688] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:54 2022] GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412 => generated 1245 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:55.448093 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-89d6235d-b6e7-45de-8e0f-37f35861b595 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:55.449899 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-89d6235d-b6e7-45de-8e0f-37f35861b595 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 2a545a10-2062-4c00-97ef-19591b829c0d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:55.475649 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89d6235d-b6e7-45de-8e0f-37f35861b595 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:55.479152 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89d6235d-b6e7-45de-8e0f-37f35861b595 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:55.481893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89d6235d-b6e7-45de-8e0f-37f35861b595 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:55.485842 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89d6235d-b6e7-45de-8e0f-37f35861b595 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:55.862503 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ef595a2b-ba1e-446e-ad60-d39da7e8813b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:55.863613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ef595a2b-ba1e-446e-ad60-d39da7e8813b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:55.902159 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ef595a2b-ba1e-446e-ad60-d39da7e8813b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:55.903582 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ef595a2b-ba1e-446e-ad60-d39da7e8813b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:55.905367 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ef595a2b-ba1e-446e-ad60-d39da7e8813b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:55.911695 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ef595a2b-ba1e-446e-ad60-d39da7e8813b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:56.128511 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ef595a2b-ba1e-446e-ad60-d39da7e8813b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:56.157541 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ef595a2b-ba1e-446e-ad60-d39da7e8813b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412" status: 200 len: 1301 microversion: 2.1 time: 0.303242 Jul 25 14:48:56.164763 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2472/4689] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:55 2022] GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412 => generated 1301 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:56.239331 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-89d6235d-b6e7-45de-8e0f-37f35861b595 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:56.251899 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-89d6235d-b6e7-45de-8e0f-37f35861b595 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d" status: 200 len: 1308 microversion: 2.1 time: 0.814290 Jul 25 14:48:56.256625 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2218/4690] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:55 2022] GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d => generated 1308 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:57.196787 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a3b032ab-dbc4-46e7-b79c-372bfbf635ff tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:57.198183 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a3b032ab-dbc4-46e7-b79c-372bfbf635ff tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:57.237623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3b032ab-dbc4-46e7-b79c-372bfbf635ff tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:57.238090 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3b032ab-dbc4-46e7-b79c-372bfbf635ff tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:57.240148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3b032ab-dbc4-46e7-b79c-372bfbf635ff tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:57.240613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3b032ab-dbc4-46e7-b79c-372bfbf635ff tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:57.290384 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-73c3dc6f-857c-4a16-a471-7c86aba56fb3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:57.291295 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-73c3dc6f-857c-4a16-a471-7c86aba56fb3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 2a545a10-2062-4c00-97ef-19591b829c0d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:57.359406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-73c3dc6f-857c-4a16-a471-7c86aba56fb3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:57.366220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-73c3dc6f-857c-4a16-a471-7c86aba56fb3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:57.366833 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-73c3dc6f-857c-4a16-a471-7c86aba56fb3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:57.367275 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-73c3dc6f-857c-4a16-a471-7c86aba56fb3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:57.574068 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a3b032ab-dbc4-46e7-b79c-372bfbf635ff tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:57.590020 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a3b032ab-dbc4-46e7-b79c-372bfbf635ff tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412" status: 200 len: 1299 microversion: 2.1 time: 0.398961 Jul 25 14:48:57.594232 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2473/4691] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:57 2022] GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412 => generated 1299 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:58.152821 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-73c3dc6f-857c-4a16-a471-7c86aba56fb3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:58.169859 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-73c3dc6f-857c-4a16-a471-7c86aba56fb3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d" status: 200 len: 1489 microversion: 2.1 time: 0.891322 Jul 25 14:48:58.189574 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2219/4692] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:57 2022] GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d => generated 1489 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:58.203564 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0c7536ef-5b90-40a1-8b3c-b82c1eee758c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:48:58.204542 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0c7536ef-5b90-40a1-8b3c-b82c1eee758c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 2a545a10-2062-4c00-97ef-19591b829c0d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:58.211681 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c7536ef-5b90-40a1-8b3c-b82c1eee758c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:58.212170 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c7536ef-5b90-40a1-8b3c-b82c1eee758c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:58.212957 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c7536ef-5b90-40a1-8b3c-b82c1eee758c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:58.213396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c7536ef-5b90-40a1-8b3c-b82c1eee758c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:58.302193 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-0c7536ef-5b90-40a1-8b3c-b82c1eee758c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lazy-loading 'flavor' on Instance uuid 2a545a10-2062-4c00-97ef-19591b829c0d {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:48:58.476268 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0c7536ef-5b90-40a1-8b3c-b82c1eee758c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "POST /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d/action" status: 202 len: 0 microversion: 2.1 time: 0.277278 Jul 25 14:48:58.481435 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2474/4693] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:48:58 2022] POST /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:48:58.492121 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ba3afe85-b318-4706-9781-e452e620e388 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:58.492749 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ba3afe85-b318-4706-9781-e452e620e388 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 2a545a10-2062-4c00-97ef-19591b829c0d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:58.518501 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ba3afe85-b318-4706-9781-e452e620e388 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:58.519074 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ba3afe85-b318-4706-9781-e452e620e388 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:58.520028 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ba3afe85-b318-4706-9781-e452e620e388 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:58.520469 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ba3afe85-b318-4706-9781-e452e620e388 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:58.613347 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c0f2d71b-0635-455c-981e-597a9e5e843f tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:58.613967 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c0f2d71b-0635-455c-981e-597a9e5e843f tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:58.633570 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c0f2d71b-0635-455c-981e-597a9e5e843f tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:58.634291 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c0f2d71b-0635-455c-981e-597a9e5e843f tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:58.635247 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c0f2d71b-0635-455c-981e-597a9e5e843f tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:58.636612 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c0f2d71b-0635-455c-981e-597a9e5e843f tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:58.885831 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ba3afe85-b318-4706-9781-e452e620e388 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:58.896381 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ba3afe85-b318-4706-9781-e452e620e388 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d" status: 200 len: 1497 microversion: 2.1 time: 0.410842 Jul 25 14:48:58.914228 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2220/4694] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:58 2022] GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d => generated 1497 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:48:59.069142 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c0f2d71b-0635-455c-981e-597a9e5e843f tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:48:59.098265 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c0f2d71b-0635-455c-981e-597a9e5e843f tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412" status: 200 len: 1367 microversion: 2.1 time: 0.489067 Jul 25 14:48:59.100009 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2475/4695] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:58 2022] GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412 => generated 1367 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:48:59.935332 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-31985b32-35c0-426a-a545-e9e41d10946f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1140903992", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:48:59.935941 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6da1f941-4553-4116-9ab9-89ede0b14523 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:48:59.936349 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6da1f941-4553-4116-9ab9-89ede0b14523 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 2a545a10-2062-4c00-97ef-19591b829c0d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:48:59.944367 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6da1f941-4553-4116-9ab9-89ede0b14523 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:59.944813 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6da1f941-4553-4116-9ab9-89ede0b14523 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:48:59.945582 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6da1f941-4553-4116-9ab9-89ede0b14523 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:48:59.946004 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6da1f941-4553-4116-9ab9-89ede0b14523 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:00.053319 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-31985b32-35c0-426a-a545-e9e41d10946f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] validate_networks() for [('4a1acd2e-4a9b-401c-a5c6-baa2b8f7918b', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:49:00.294765 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6da1f941-4553-4116-9ab9-89ede0b14523 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:00.302996 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6da1f941-4553-4116-9ab9-89ede0b14523 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d" status: 200 len: 1480 microversion: 2.1 time: 0.371594 Jul 25 14:49:00.303612 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2476/4696] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:48:59 2022] GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d => generated 1480 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:49:00.322206 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-09cba497-2f39-4184-944d-6851318db917 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:00.323622 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-09cba497-2f39-4184-944d-6851318db917 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:00.337923 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09cba497-2f39-4184-944d-6851318db917 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:00.338508 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09cba497-2f39-4184-944d-6851318db917 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:00.339326 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09cba497-2f39-4184-944d-6851318db917 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:00.340075 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09cba497-2f39-4184-944d-6851318db917 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:00.693650 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-09cba497-2f39-4184-944d-6851318db917 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:00.712884 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-09cba497-2f39-4184-944d-6851318db917 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412" status: 200 len: 1367 microversion: 2.1 time: 0.404037 Jul 25 14:49:00.721651 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2477/4697] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:00 2022] GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412 => generated 1367 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:00.731155 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d88363ad-af52-41a3-bae8-8827af759268 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-742513842"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:49:00.735850 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d88363ad-af52-41a3-bae8-8827af759268 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 2a545a10-2062-4c00-97ef-19591b829c0d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:00.769619 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d88363ad-af52-41a3-bae8-8827af759268 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:00.772837 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d88363ad-af52-41a3-bae8-8827af759268 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:00.781302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d88363ad-af52-41a3-bae8-8827af759268 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:00.783186 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d88363ad-af52-41a3-bae8-8827af759268 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:01.179729 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d88363ad-af52-41a3-bae8-8827af759268 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "POST /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d/action" status: 202 len: 0 microversion: 2.1 time: 0.453564 Jul 25 14:49:01.183007 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2478/4698] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:49:00 2022] POST /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 14:49:01.198598 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-fa55dd2b-97f8-4781-ae7d-75592ba03b1b req-ceb9bf5f-e243-4d21-91f2-7108c97138f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe421aa5-5038-479a-b496-04130c3de412", "tag": "1335551c-edd6-407d-af39-b40797568790"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:49:01.223191 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-fa55dd2b-97f8-4781-ae7d-75592ba03b1b req-ceb9bf5f-e243-4d21-91f2-7108c97138f4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:01.225781 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-fa55dd2b-97f8-4781-ae7d-75592ba03b1b req-ceb9bf5f-e243-4d21-91f2-7108c97138f4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:01.260797 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-fa55dd2b-97f8-4781-ae7d-75592ba03b1b req-ceb9bf5f-e243-4d21-91f2-7108c97138f4 service nova] Creating event network-changed:1335551c-edd6-407d-af39-b40797568790 for instance fe421aa5-5038-479a-b496-04130c3de412 on n-h2-846435-14 Jul 25 14:49:01.273263 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-fa55dd2b-97f8-4781-ae7d-75592ba03b1b req-ceb9bf5f-e243-4d21-91f2-7108c97138f4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085487 Jul 25 14:49:01.276058 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2479/4699] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:49:01.289481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-59f1fb28-4c93-43be-865e-6b038a2f10f8 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46863a3f70>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:01.381175 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-59f1fb28-4c93-43be-865e-6b038a2f10f8 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a" status: 200 len: 1437 microversion: 2.1 time: 0.102652 Jul 25 14:49:01.382083 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2480/4700] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:01 2022] GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a => generated 1437 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:01.729930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-31985b32-35c0-426a-a545-e9e41d10946f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:49:01.730496 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-31985b32-35c0-426a-a545-e9e41d10946f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:49:01.730879 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-31985b32-35c0-426a-a545-e9e41d10946f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:49:01.731297 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-31985b32-35c0-426a-a545-e9e41d10946f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:49:01.731715 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-31985b32-35c0-426a-a545-e9e41d10946f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:49:01.754274 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-31985b32-35c0-426a-a545-e9e41d10946f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:01.755073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-31985b32-35c0-426a-a545-e9e41d10946f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:01.761731 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-31985b32-35c0-426a-a545-e9e41d10946f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:01.762455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-31985b32-35c0-426a-a545-e9e41d10946f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:01.780073 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c39b47d8-c871-49ee-b682-ab860ecadb8e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:01.784967 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c39b47d8-c871-49ee-b682-ab860ecadb8e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:01.812013 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c39b47d8-c871-49ee-b682-ab860ecadb8e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:01.813978 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-31985b32-35c0-426a-a545-e9e41d10946f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Getting quotas for project 47e1c3839c9f406db5686216c0e9c83e. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:49:01.814330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c39b47d8-c871-49ee-b682-ab860ecadb8e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:01.818409 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c39b47d8-c871-49ee-b682-ab860ecadb8e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:01.819211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c39b47d8-c871-49ee-b682-ab860ecadb8e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:01.834938 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-31985b32-35c0-426a-a545-e9e41d10946f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Getting quotas for user 4c72922a47ea4af5a87a537fc463a2af and project 47e1c3839c9f406db5686216c0e9c83e. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:49:01.875572 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-31985b32-35c0-426a-a545-e9e41d10946f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:49:01.882112 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-31985b32-35c0-426a-a545-e9e41d10946f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:49:02.002408 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-31985b32-35c0-426a-a545-e9e41d10946f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.348597 Jul 25 14:49:02.009570 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2221/4701] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:48:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 2351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:49:02.017481 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8ce0386a-5cf9-42d2-9cfd-0a77ae19cf1a tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:02.018406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8ce0386a-5cf9-42d2-9cfd-0a77ae19cf1a tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:02.196114 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8ce0386a-5cf9-42d2-9cfd-0a77ae19cf1a tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:02.260939 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8ce0386a-5cf9-42d2-9cfd-0a77ae19cf1a tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1214 microversion: 2.1 time: 0.249221 Jul 25 14:49:02.266248 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2222/4702] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:02 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1214 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:49:02.399753 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bcde7c59-2e03-46c1-9c79-872a1d92a709 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46988adf70>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:02.501562 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bcde7c59-2e03-46c1-9c79-872a1d92a709 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a" status: 200 len: 1437 microversion: 2.1 time: 0.107165 Jul 25 14:49:02.516796 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2223/4703] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:02 2022] GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a => generated 1437 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:49:02.641855 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c39b47d8-c871-49ee-b682-ab860ecadb8e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:02.655589 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c39b47d8-c871-49ee-b682-ab860ecadb8e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412" status: 200 len: 1367 microversion: 2.1 time: 0.905770 Jul 25 14:49:02.665768 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2481/4704] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:01 2022] GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412 => generated 1367 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:49:03.292779 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-aabee92e-f877-4446-bda7-f2768dd64e3c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:03.294211 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-aabee92e-f877-4446-bda7-f2768dd64e3c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:03.306022 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aabee92e-f877-4446-bda7-f2768dd64e3c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:03.308130 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aabee92e-f877-4446-bda7-f2768dd64e3c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:03.311685 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aabee92e-f877-4446-bda7-f2768dd64e3c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:03.312338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aabee92e-f877-4446-bda7-f2768dd64e3c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:03.460836 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-aabee92e-f877-4446-bda7-f2768dd64e3c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:03.469016 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-aabee92e-f877-4446-bda7-f2768dd64e3c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1210 microversion: 2.1 time: 0.181998 Jul 25 14:49:03.473708 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2224/4705] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:03 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1210 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:03.515385 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:49:03.516306 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:49:03.540278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-127b0720-2bcc-4dec-b9f0-08e8114f4ed7 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f4698903430>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:03.651875 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-127b0720-2bcc-4dec-b9f0-08e8114f4ed7 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a" status: 200 len: 1437 microversion: 2.1 time: 0.137807 Jul 25 14:49:03.653119 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2482/4706] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:03 2022] GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a => generated 1437 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:03.685784 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-98057096-3caa-436f-a045-37085a88bfef tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:03.686883 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-98057096-3caa-436f-a045-37085a88bfef tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:03.695992 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-98057096-3caa-436f-a045-37085a88bfef tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:03.697467 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-98057096-3caa-436f-a045-37085a88bfef tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:03.699013 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-98057096-3caa-436f-a045-37085a88bfef tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:03.700457 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-98057096-3caa-436f-a045-37085a88bfef tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:04.098082 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-98057096-3caa-436f-a045-37085a88bfef tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:04.112615 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-98057096-3caa-436f-a045-37085a88bfef tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412" status: 200 len: 1367 microversion: 2.1 time: 0.429906 Jul 25 14:49:04.128504 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2225/4707] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:03 2022] GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412 => generated 1367 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:04.497312 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-65280dba-eadf-4826-91d7-7450770430fe tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:04.497963 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-65280dba-eadf-4826-91d7-7450770430fe tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:04.519737 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-65280dba-eadf-4826-91d7-7450770430fe tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:04.520599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-65280dba-eadf-4826-91d7-7450770430fe tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:04.521687 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-65280dba-eadf-4826-91d7-7450770430fe tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:04.522350 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-65280dba-eadf-4826-91d7-7450770430fe tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:04.669821 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d2bc2b73-4942-4a49-8dfe-83e3a0c21c55 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46875a0040>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:04.766984 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d2bc2b73-4942-4a49-8dfe-83e3a0c21c55 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a" status: 200 len: 1437 microversion: 2.1 time: 0.101837 Jul 25 14:49:04.775493 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2226/4708] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:04 2022] GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a => generated 1437 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:04.778488 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-65280dba-eadf-4826-91d7-7450770430fe tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:04.786557 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-65280dba-eadf-4826-91d7-7450770430fe tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1284 microversion: 2.1 time: 0.295436 Jul 25 14:49:04.794521 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2483/4709] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:04 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1284 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:05.198232 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1eb7f42b-89b1-4b10-af78-76b65dc87eea tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:05.203620 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1eb7f42b-89b1-4b10-af78-76b65dc87eea tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:05.248705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1eb7f42b-89b1-4b10-af78-76b65dc87eea tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:05.249641 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1eb7f42b-89b1-4b10-af78-76b65dc87eea tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:05.254339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1eb7f42b-89b1-4b10-af78-76b65dc87eea tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:05.255024 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1eb7f42b-89b1-4b10-af78-76b65dc87eea tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:05.784502 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c8272227-2931-40bf-a0d2-a6e2960e7015 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f468758aaf0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:05.802022 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1eb7f42b-89b1-4b10-af78-76b65dc87eea tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:05.823511 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1eb7f42b-89b1-4b10-af78-76b65dc87eea tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412" status: 200 len: 1367 microversion: 2.1 time: 0.687335 Jul 25 14:49:05.832447 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2227/4710] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:05 2022] GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412 => generated 1367 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:05.837570 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-45c8e108-820b-403f-a7fb-25a1d102b8f8 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:05.854728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-45c8e108-820b-403f-a7fb-25a1d102b8f8 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:05.893023 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c8272227-2931-40bf-a0d2-a6e2960e7015 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a" status: 200 len: 1437 microversion: 2.1 time: 0.113164 Jul 25 14:49:05.898811 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-45c8e108-820b-403f-a7fb-25a1d102b8f8 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:05.909535 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2484/4711] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:05 2022] GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a => generated 1437 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:49:05.909906 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-45c8e108-820b-403f-a7fb-25a1d102b8f8 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:05.911051 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-45c8e108-820b-403f-a7fb-25a1d102b8f8 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:05.916794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-45c8e108-820b-403f-a7fb-25a1d102b8f8 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:06.800621 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-45c8e108-820b-403f-a7fb-25a1d102b8f8 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:06.817839 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-45c8e108-820b-403f-a7fb-25a1d102b8f8 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1314 microversion: 2.1 time: 0.984004 Jul 25 14:49:06.829386 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2228/4712] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:05 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1314 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:06.867998 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-05ed8f56-0899-4078-86e5-a2b101e26167 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:06.869211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-05ed8f56-0899-4078-86e5-a2b101e26167 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:06.884665 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-05ed8f56-0899-4078-86e5-a2b101e26167 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:06.885680 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-05ed8f56-0899-4078-86e5-a2b101e26167 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:06.886214 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-05ed8f56-0899-4078-86e5-a2b101e26167 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:06.886643 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-05ed8f56-0899-4078-86e5-a2b101e26167 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:06.934044 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-622b2e4c-d418-4a03-82be-d194edcafac2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46874ec550>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:07.076844 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-622b2e4c-d418-4a03-82be-d194edcafac2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a" status: 200 len: 1437 microversion: 2.1 time: 0.138295 Jul 25 14:49:07.089288 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2229/4713] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:06 2022] GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a => generated 1437 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:49:07.237130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-05ed8f56-0899-4078-86e5-a2b101e26167 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:07.247401 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-05ed8f56-0899-4078-86e5-a2b101e26167 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412" status: 200 len: 1367 microversion: 2.1 time: 0.384353 Jul 25 14:49:07.248728 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2485/4714] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:06 2022] GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412 => generated 1367 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:07.876566 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-57873747-eed5-4e5b-8a10-75e784fdfe56 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:07.885465 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-57873747-eed5-4e5b-8a10-75e784fdfe56 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:07.910547 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57873747-eed5-4e5b-8a10-75e784fdfe56 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:07.911307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57873747-eed5-4e5b-8a10-75e784fdfe56 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:07.912311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57873747-eed5-4e5b-8a10-75e784fdfe56 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:07.912920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57873747-eed5-4e5b-8a10-75e784fdfe56 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:07.957538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-bc0509f9-8ae9-4e63-86e2-24632169ff88 req-abd87625-8932-43d2-84a3-28e3208a5d56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a545a10-2062-4c00-97ef-19591b829c0d", "name": "network-vif-plugged", "status": "completed", "tag": "e11c38a4-9d6c-4fb9-933b-1470130b560f"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:49:08.033798 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-bc0509f9-8ae9-4e63-86e2-24632169ff88 req-abd87625-8932-43d2-84a3-28e3208a5d56 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:08.034223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-bc0509f9-8ae9-4e63-86e2-24632169ff88 req-abd87625-8932-43d2-84a3-28e3208a5d56 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:08.064347 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-bc0509f9-8ae9-4e63-86e2-24632169ff88 req-abd87625-8932-43d2-84a3-28e3208a5d56 service nova] Creating event network-vif-plugged:e11c38a4-9d6c-4fb9-933b-1470130b560f for instance 2a545a10-2062-4c00-97ef-19591b829c0d on n-h2-846435-14 Jul 25 14:49:08.083881 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-bc0509f9-8ae9-4e63-86e2-24632169ff88 req-abd87625-8932-43d2-84a3-28e3208a5d56 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140307 Jul 25 14:49:08.084581 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2486/4715] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:49:08.098191 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0d3c6236-c159-49c1-b40c-49164a47ad19 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46862eeaf0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:08.196810 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0d3c6236-c159-49c1-b40c-49164a47ad19 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a" status: 200 len: 1437 microversion: 2.1 time: 0.103027 Jul 25 14:49:08.197913 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2487/4716] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:08 2022] GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a => generated 1437 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:08.269908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1cc2d6ba-a5a1-4dc5-a46e-d2fe084d9745 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:08.271056 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1cc2d6ba-a5a1-4dc5-a46e-d2fe084d9745 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:08.290453 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1cc2d6ba-a5a1-4dc5-a46e-d2fe084d9745 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:08.294792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1cc2d6ba-a5a1-4dc5-a46e-d2fe084d9745 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:08.295959 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1cc2d6ba-a5a1-4dc5-a46e-d2fe084d9745 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:08.301871 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1cc2d6ba-a5a1-4dc5-a46e-d2fe084d9745 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:08.308985 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:49:08.478403 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-57873747-eed5-4e5b-8a10-75e784fdfe56 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:08.524823 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-57873747-eed5-4e5b-8a10-75e784fdfe56 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1314 microversion: 2.1 time: 0.677634 Jul 25 14:49:08.525795 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2230/4717] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:07 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1314 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:08.739276 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1cc2d6ba-a5a1-4dc5-a46e-d2fe084d9745 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:08.763669 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1cc2d6ba-a5a1-4dc5-a46e-d2fe084d9745 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412" status: 200 len: 1367 microversion: 2.1 time: 0.497600 Jul 25 14:49:08.765390 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2488/4718] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:08 2022] GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412 => generated 1367 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:49:08.894154 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-75a3356c-ba78-49b3-b00b-2b902f5caab8 req-461119ba-f68a-4821-904e-59e3cc2411f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a8df180-ea82-4f01-98a8-5d19c4bd5a5a", "tag": "a3e26523-21b1-426c-97fd-3e98743e89e9"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:49:08.928931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-75a3356c-ba78-49b3-b00b-2b902f5caab8 req-461119ba-f68a-4821-904e-59e3cc2411f3 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:08.929985 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-75a3356c-ba78-49b3-b00b-2b902f5caab8 req-461119ba-f68a-4821-904e-59e3cc2411f3 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:08.947004 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-75a3356c-ba78-49b3-b00b-2b902f5caab8 req-461119ba-f68a-4821-904e-59e3cc2411f3 service nova] Creating event network-changed:a3e26523-21b1-426c-97fd-3e98743e89e9 for instance 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a on n-h1-846435-14 Jul 25 14:49:08.954190 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-75a3356c-ba78-49b3-b00b-2b902f5caab8 req-461119ba-f68a-4821-904e-59e3cc2411f3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065305 Jul 25 14:49:08.954984 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2231/4719] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:49:09.220129 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a93d91c8-f73a-49fd-ba96-29c0450a3d3c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f4698878160>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:09.324937 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a93d91c8-f73a-49fd-ba96-29c0450a3d3c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a" status: 200 len: 1437 microversion: 2.1 time: 0.115633 Jul 25 14:49:09.326893 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2489/4720] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:09 2022] GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a => generated 1437 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:09.554742 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a2f44a97-8165-4bbd-a459-2bee016ab32f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:09.556159 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a2f44a97-8165-4bbd-a459-2bee016ab32f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:09.569858 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=69,nova_api:INSERT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:49:09.576822 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a2f44a97-8165-4bbd-a459-2bee016ab32f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:09.577308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a2f44a97-8165-4bbd-a459-2bee016ab32f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:09.580313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a2f44a97-8165-4bbd-a459-2bee016ab32f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:09.580765 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a2f44a97-8165-4bbd-a459-2bee016ab32f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:09.787292 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-78c6bed1-b275-4b25-82e4-6d2b2eed06d9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:09.788016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-78c6bed1-b275-4b25-82e4-6d2b2eed06d9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:09.821190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-78c6bed1-b275-4b25-82e4-6d2b2eed06d9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:09.824880 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-78c6bed1-b275-4b25-82e4-6d2b2eed06d9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:09.826836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-78c6bed1-b275-4b25-82e4-6d2b2eed06d9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:09.827288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-78c6bed1-b275-4b25-82e4-6d2b2eed06d9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:10.230001 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-78c6bed1-b275-4b25-82e4-6d2b2eed06d9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:10.246667 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-78c6bed1-b275-4b25-82e4-6d2b2eed06d9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412" status: 200 len: 1367 microversion: 2.1 time: 0.464334 Jul 25 14:49:10.248026 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2490/4721] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:09 2022] GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412 => generated 1367 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:10.310550 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a2f44a97-8165-4bbd-a459-2bee016ab32f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:10.319890 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a2f44a97-8165-4bbd-a459-2bee016ab32f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1314 microversion: 2.1 time: 0.777062 Jul 25 14:49:10.337172 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2232/4722] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:09 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1314 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:10.343348 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-12ebeefd-3657-4cee-9291-0e193e28fb0b tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f468758a940>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:10.432335 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-12ebeefd-3657-4cee-9291-0e193e28fb0b tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a" status: 200 len: 1437 microversion: 2.1 time: 0.093863 Jul 25 14:49:10.439763 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2491/4723] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:10 2022] GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a => generated 1437 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:10.543396 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-d57de017-037b-4614-8cdb-a7fc1f5f6010 req-94caf545-0a64-4408-8910-9222d38533fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe421aa5-5038-479a-b496-04130c3de412", "name": "network-vif-plugged", "status": "completed", "tag": "1335551c-edd6-407d-af39-b40797568790"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:49:10.572324 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-d57de017-037b-4614-8cdb-a7fc1f5f6010 req-94caf545-0a64-4408-8910-9222d38533fc service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:10.572829 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-d57de017-037b-4614-8cdb-a7fc1f5f6010 req-94caf545-0a64-4408-8910-9222d38533fc service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:10.589632 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-d57de017-037b-4614-8cdb-a7fc1f5f6010 req-94caf545-0a64-4408-8910-9222d38533fc service nova] Creating event network-vif-plugged:1335551c-edd6-407d-af39-b40797568790 for instance fe421aa5-5038-479a-b496-04130c3de412 on n-h2-846435-14 Jul 25 14:49:10.604128 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-d57de017-037b-4614-8cdb-a7fc1f5f6010 req-94caf545-0a64-4408-8910-9222d38533fc service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064945 Jul 25 14:49:10.606735 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2233/4724] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:49:11.270860 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-91328b06-246e-4327-afca-ef2cb49c25b8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:11.271475 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-91328b06-246e-4327-afca-ef2cb49c25b8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:11.302080 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-91328b06-246e-4327-afca-ef2cb49c25b8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:11.302579 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-91328b06-246e-4327-afca-ef2cb49c25b8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:11.303361 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-91328b06-246e-4327-afca-ef2cb49c25b8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:11.303798 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-91328b06-246e-4327-afca-ef2cb49c25b8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:11.350418 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f06d5612-d194-41da-a268-0e926ba05234 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:11.351746 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f06d5612-d194-41da-a268-0e926ba05234 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:11.367257 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f06d5612-d194-41da-a268-0e926ba05234 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:11.372647 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f06d5612-d194-41da-a268-0e926ba05234 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:11.374648 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f06d5612-d194-41da-a268-0e926ba05234 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:11.377782 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f06d5612-d194-41da-a268-0e926ba05234 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:11.744686 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-91328b06-246e-4327-afca-ef2cb49c25b8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:11.753658 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-91328b06-246e-4327-afca-ef2cb49c25b8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412" status: 200 len: 1367 microversion: 2.1 time: 0.487933 Jul 25 14:49:11.766393 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2492/4725] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:11 2022] GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412 => generated 1367 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:11.772402 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:49:11.780564 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d79bd27a-00a8-4434-919b-4271e35d686d tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46861ed3a0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:11.929932 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d79bd27a-00a8-4434-919b-4271e35d686d tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a" status: 200 len: 1437 microversion: 2.1 time: 0.161611 Jul 25 14:49:11.930753 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2493/4726] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:11 2022] GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a => generated 1437 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:12.244819 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f06d5612-d194-41da-a268-0e926ba05234 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:12.252400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=10 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:49:12.258573 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f06d5612-d194-41da-a268-0e926ba05234 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1314 microversion: 2.1 time: 0.912931 Jul 25 14:49:12.291078 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2234/4727] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:11 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1314 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:12.790341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d5496698-8ea9-4886-a7c4-2890cadd6b66 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:12.790870 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d5496698-8ea9-4886-a7c4-2890cadd6b66 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:12.813436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5496698-8ea9-4886-a7c4-2890cadd6b66 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:12.816979 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5496698-8ea9-4886-a7c4-2890cadd6b66 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:12.818101 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5496698-8ea9-4886-a7c4-2890cadd6b66 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:12.818764 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5496698-8ea9-4886-a7c4-2890cadd6b66 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:12.946842 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0d158e2c-fc9d-4dca-b9f9-f2e97ea6fbbc tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f4698867d30>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:13.113369 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0d158e2c-fc9d-4dca-b9f9-f2e97ea6fbbc tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a" status: 200 len: 1437 microversion: 2.1 time: 0.171394 Jul 25 14:49:13.115633 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2235/4728] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:12 2022] GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a => generated 1437 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:49:13.137195 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-64baa967-e3e5-47c6-ae68-15e2e8f48d4e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:13.148458 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-64baa967-e3e5-47c6-ae68-15e2e8f48d4e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:13.166015 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-64baa967-e3e5-47c6-ae68-15e2e8f48d4e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:13.171278 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-64baa967-e3e5-47c6-ae68-15e2e8f48d4e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:13.172778 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-64baa967-e3e5-47c6-ae68-15e2e8f48d4e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:13.179007 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-64baa967-e3e5-47c6-ae68-15e2e8f48d4e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:13.242585 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-64baa967-e3e5-47c6-ae68-15e2e8f48d4e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea/ips" status: 200 len: 145 microversion: 2.1 time: 0.122315 Jul 25 14:49:13.246749 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2236/4729] 10.222.0.88 () {58 vars in 1248 bytes} [Mon Jul 25 14:49:13 2022] GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea/ips => generated 145 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:49:13.287192 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d5496698-8ea9-4886-a7c4-2890cadd6b66 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:13.296528 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7d177bd5-058d-4300-8084-4a475826008c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:13.297352 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7d177bd5-058d-4300-8084-4a475826008c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:13.297775 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d5496698-8ea9-4886-a7c4-2890cadd6b66 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412" status: 200 len: 1557 microversion: 2.1 time: 0.516986 Jul 25 14:49:13.298409 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2494/4730] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:12 2022] GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412 => generated 1557 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:13.326621 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7d177bd5-058d-4300-8084-4a475826008c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:13.326888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1ed49ec9-ce5c-4ca8-9414-027bc1b3cdc6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:13.327162 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1ed49ec9-ce5c-4ca8-9414-027bc1b3cdc6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:13.327857 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7d177bd5-058d-4300-8084-4a475826008c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:13.332486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7d177bd5-058d-4300-8084-4a475826008c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:13.333279 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7d177bd5-058d-4300-8084-4a475826008c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:13.362583 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1ed49ec9-ce5c-4ca8-9414-027bc1b3cdc6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:13.363038 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1ed49ec9-ce5c-4ca8-9414-027bc1b3cdc6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:13.374565 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1ed49ec9-ce5c-4ca8-9414-027bc1b3cdc6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:13.374859 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1ed49ec9-ce5c-4ca8-9414-027bc1b3cdc6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:13.579060 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1ed49ec9-ce5c-4ca8-9414-027bc1b3cdc6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.256331 Jul 25 14:49:13.589814 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2495/4731] 10.222.0.88 () {58 vars in 1275 bytes} [Mon Jul 25 14:49:13 2022] GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412/os-interface => generated 284 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:49:14.130589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5e35d45e-26c6-4369-b011-0e069d59bd27 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f4698903550>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:14.255822 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5e35d45e-26c6-4369-b011-0e069d59bd27 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a" status: 200 len: 1437 microversion: 2.1 time: 0.129256 Jul 25 14:49:14.259733 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2496/4732] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:14 2022] GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a => generated 1437 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:14.360634 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7d177bd5-058d-4300-8084-4a475826008c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:14.372370 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7d177bd5-058d-4300-8084-4a475826008c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1314 microversion: 2.1 time: 1.082718 Jul 25 14:49:14.389974 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2237/4733] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:13 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1314 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:15.271270 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-88a3cee7-19bb-4b88-af34-5f0e86ba5e71 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46861edca0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:15.401051 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-88a3cee7-19bb-4b88-af34-5f0e86ba5e71 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a" status: 200 len: 1437 microversion: 2.1 time: 0.133369 Jul 25 14:49:15.403186 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2497/4734] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:15 2022] GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a => generated 1437 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:15.410964 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1a0b4c85-bda3-4d00-af64-782de65e75d7 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:15.411583 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1a0b4c85-bda3-4d00-af64-782de65e75d7 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:15.432197 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1a0b4c85-bda3-4d00-af64-782de65e75d7 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:15.449228 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1a0b4c85-bda3-4d00-af64-782de65e75d7 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:15.450104 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1a0b4c85-bda3-4d00-af64-782de65e75d7 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:15.450555 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1a0b4c85-bda3-4d00-af64-782de65e75d7 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:15.481980 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:49:16.085428 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1a0b4c85-bda3-4d00-af64-782de65e75d7 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:16.113302 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1a0b4c85-bda3-4d00-af64-782de65e75d7 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1314 microversion: 2.1 time: 0.706294 Jul 25 14:49:16.114604 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2238/4735] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:15 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1314 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:16.417364 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-13c5c941-82bb-403b-b58a-96993d6ea4b1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46987c55e0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:16.579595 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-13c5c941-82bb-403b-b58a-96993d6ea4b1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a" status: 200 len: 1437 microversion: 2.1 time: 0.168114 Jul 25 14:49:16.581088 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2498/4736] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:16 2022] GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a => generated 1437 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:16.947786 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-64dae192-cfa6-436f-acc5-a2715e6aa133 req-ec45f7b6-38af-4443-947c-4e5ddd074c84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe421aa5-5038-479a-b496-04130c3de412", "tag": "1335551c-edd6-407d-af39-b40797568790"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:49:16.967288 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-64dae192-cfa6-436f-acc5-a2715e6aa133 req-ec45f7b6-38af-4443-947c-4e5ddd074c84 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:16.969947 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-64dae192-cfa6-436f-acc5-a2715e6aa133 req-ec45f7b6-38af-4443-947c-4e5ddd074c84 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:17.015430 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-64dae192-cfa6-436f-acc5-a2715e6aa133 req-ec45f7b6-38af-4443-947c-4e5ddd074c84 service nova] Creating event network-changed:1335551c-edd6-407d-af39-b40797568790 for instance fe421aa5-5038-479a-b496-04130c3de412 on n-h2-846435-14 Jul 25 14:49:17.031749 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-64dae192-cfa6-436f-acc5-a2715e6aa133 req-ec45f7b6-38af-4443-947c-4e5ddd074c84 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086481 Jul 25 14:49:17.033168 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2239/4737] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:49:17.135933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6be147e7-bf5a-4036-9f90-93e1c0c973d0 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:17.137570 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6be147e7-bf5a-4036-9f90-93e1c0c973d0 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:17.149904 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6be147e7-bf5a-4036-9f90-93e1c0c973d0 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:17.152759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6be147e7-bf5a-4036-9f90-93e1c0c973d0 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:17.154830 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6be147e7-bf5a-4036-9f90-93e1c0c973d0 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:17.155556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6be147e7-bf5a-4036-9f90-93e1c0c973d0 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:17.595643 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4acbcaa6-1c16-4a88-bc12-aca259b72f29 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f4698867d30>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:17.703893 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4acbcaa6-1c16-4a88-bc12-aca259b72f29 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a" status: 200 len: 1437 microversion: 2.1 time: 0.112673 Jul 25 14:49:17.704552 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2240/4738] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:17 2022] GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a => generated 1437 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:49:17.770535 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-0ae87101-cc19-44a0-8730-29429ab9cd3a req-8dae052a-78db-408f-b2d9-8e78247ab328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a8df180-ea82-4f01-98a8-5d19c4bd5a5a", "name": "network-vif-plugged", "status": "completed", "tag": "a3e26523-21b1-426c-97fd-3e98743e89e9"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:49:17.798841 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6be147e7-bf5a-4036-9f90-93e1c0c973d0 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:17.841263 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6be147e7-bf5a-4036-9f90-93e1c0c973d0 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1314 microversion: 2.1 time: 0.710138 Jul 25 14:49:17.845357 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-0ae87101-cc19-44a0-8730-29429ab9cd3a req-8dae052a-78db-408f-b2d9-8e78247ab328 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:17.851676 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2499/4739] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:17 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1314 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:17.858663 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-0ae87101-cc19-44a0-8730-29429ab9cd3a req-8dae052a-78db-408f-b2d9-8e78247ab328 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:17.881458 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8bc000c8-88b2-46bc-97e1-33146e59cc4f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5995456e-34af-4403-b898-9343212fc25a"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:49:17.900378 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8bc000c8-88b2-46bc-97e1-33146e59cc4f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:17.921874 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-0ae87101-cc19-44a0-8730-29429ab9cd3a req-8dae052a-78db-408f-b2d9-8e78247ab328 service nova] Creating event network-vif-plugged:a3e26523-21b1-426c-97fd-3e98743e89e9 for instance 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a on n-h1-846435-14 Jul 25 14:49:17.923288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8bc000c8-88b2-46bc-97e1-33146e59cc4f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:17.926611 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8bc000c8-88b2-46bc-97e1-33146e59cc4f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:17.929819 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8bc000c8-88b2-46bc-97e1-33146e59cc4f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:17.931545 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8bc000c8-88b2-46bc-97e1-33146e59cc4f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:17.948864 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-0ae87101-cc19-44a0-8730-29429ab9cd3a req-8dae052a-78db-408f-b2d9-8e78247ab328 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180455 Jul 25 14:49:17.951475 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2241/4740] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:49:18.657665 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8bc000c8-88b2-46bc-97e1-33146e59cc4f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "POST /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.801276 Jul 25 14:49:18.658582 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2500/4741] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Jul 25 14:49:17 2022] POST /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea/os-volume_attachments => generated 194 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:49:18.721339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-09319a92-ccb2-425b-b2c4-66e7bd148f20 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f468675a940>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:18.829772 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-09319a92-ccb2-425b-b2c4-66e7bd148f20 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a" status: 200 len: 1437 microversion: 2.1 time: 0.114610 Jul 25 14:49:18.830922 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2242/4742] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:18 2022] GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a => generated 1437 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:18.881184 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8fdb5264-942a-4138-ba67-8d6c23fc38f1 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:18.882734 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8fdb5264-942a-4138-ba67-8d6c23fc38f1 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:18.898542 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8fdb5264-942a-4138-ba67-8d6c23fc38f1 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:18.899563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8fdb5264-942a-4138-ba67-8d6c23fc38f1 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:18.900754 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8fdb5264-942a-4138-ba67-8d6c23fc38f1 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:18.901401 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8fdb5264-942a-4138-ba67-8d6c23fc38f1 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:19.336798 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8fdb5264-942a-4138-ba67-8d6c23fc38f1 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:19.346339 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8fdb5264-942a-4138-ba67-8d6c23fc38f1 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1314 microversion: 2.1 time: 0.477091 Jul 25 14:49:19.350507 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2501/4743] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:18 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:19.846408 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-40666d3a-536e-4d77-a708-47f1c68480f0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46987c79d0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:19.948862 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-40666d3a-536e-4d77-a708-47f1c68480f0 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a" status: 200 len: 1437 microversion: 2.1 time: 0.107530 Jul 25 14:49:19.949893 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2243/4744] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:19 2022] GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a => generated 1437 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:20.389631 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-799f857b-0816-4bc5-99e2-cd97079ea903 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:20.390250 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-799f857b-0816-4bc5-99e2-cd97079ea903 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:20.406081 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-799f857b-0816-4bc5-99e2-cd97079ea903 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:20.406826 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-799f857b-0816-4bc5-99e2-cd97079ea903 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:20.407798 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-799f857b-0816-4bc5-99e2-cd97079ea903 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:20.408455 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-799f857b-0816-4bc5-99e2-cd97079ea903 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:20.715495 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-799f857b-0816-4bc5-99e2-cd97079ea903 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:20.727999 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-799f857b-0816-4bc5-99e2-cd97079ea903 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1500 microversion: 2.1 time: 0.340050 Jul 25 14:49:20.730075 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2502/4745] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:20 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1500 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:20.753092 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-620198cc-c315-4a08-b014-2e2fffde9264 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:49:20.755832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-620198cc-c315-4a08-b014-2e2fffde9264 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:20.772452 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-620198cc-c315-4a08-b014-2e2fffde9264 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:20.773791 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-620198cc-c315-4a08-b014-2e2fffde9264 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:20.776088 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-620198cc-c315-4a08-b014-2e2fffde9264 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:20.776900 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-620198cc-c315-4a08-b014-2e2fffde9264 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:20.803745 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-620198cc-c315-4a08-b014-2e2fffde9264 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lazy-loading 'flavor' on Instance uuid 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:49:20.929817 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-620198cc-c315-4a08-b014-2e2fffde9264 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "POST /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a/action" status: 200 len: 32 microversion: 2.1 time: 0.181556 Jul 25 14:49:20.935708 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2244/4746] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:49:20 2022] POST /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a/action => generated 32 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:49:20.954600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5b6472ad-67f2-411b-899f-d6e9a8ec760e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:20.956580 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5b6472ad-67f2-411b-899f-d6e9a8ec760e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:20.964188 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-84eadaf2-4dcf-48ee-ae1a-d0489cd608e7 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46866de310>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:20.978112 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b6472ad-67f2-411b-899f-d6e9a8ec760e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:20.978570 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b6472ad-67f2-411b-899f-d6e9a8ec760e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:20.985892 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b6472ad-67f2-411b-899f-d6e9a8ec760e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:20.987053 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b6472ad-67f2-411b-899f-d6e9a8ec760e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:21.051756 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-84eadaf2-4dcf-48ee-ae1a-d0489cd608e7 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a" status: 200 len: 1437 microversion: 2.1 time: 0.091746 Jul 25 14:49:21.052642 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2245/4747] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:20 2022] GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a => generated 1437 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:49:21.280669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5b6472ad-67f2-411b-899f-d6e9a8ec760e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:21.302729 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5b6472ad-67f2-411b-899f-d6e9a8ec760e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1506 microversion: 2.1 time: 0.355879 Jul 25 14:49:21.303823 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2503/4748] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:20 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1506 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:22.068548 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-86f50ab0-0349-4c65-9d6d-b790ac17fdeb tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46989bb820>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:22.195700 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-86f50ab0-0349-4c65-9d6d-b790ac17fdeb tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a" status: 200 len: 1437 microversion: 2.1 time: 0.132694 Jul 25 14:49:22.196635 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2246/4749] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:22 2022] GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a => generated 1437 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:22.324433 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5360c18b-4623-48ef-8b96-16edf662158a tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:22.325204 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5360c18b-4623-48ef-8b96-16edf662158a tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:22.342695 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5360c18b-4623-48ef-8b96-16edf662158a tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:22.343305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5360c18b-4623-48ef-8b96-16edf662158a tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:22.344239 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5360c18b-4623-48ef-8b96-16edf662158a tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:22.345486 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5360c18b-4623-48ef-8b96-16edf662158a tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:22.655935 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5360c18b-4623-48ef-8b96-16edf662158a tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:22.666118 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5360c18b-4623-48ef-8b96-16edf662158a tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1506 microversion: 2.1 time: 0.346494 Jul 25 14:49:22.667996 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2504/4750] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:22 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1506 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:23.211786 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c3352c1d-c26d-478d-85e0-0f93d5b315e6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46989e5790>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:23.306788 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c3352c1d-c26d-478d-85e0-0f93d5b315e6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a" status: 200 len: 1437 microversion: 2.1 time: 0.099878 Jul 25 14:49:23.315923 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2247/4751] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:23 2022] GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a => generated 1437 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:23.692808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5330c402-97db-4705-a8c7-1511f5f187fb tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:23.694840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5330c402-97db-4705-a8c7-1511f5f187fb tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:23.704986 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:49:23.706597 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5330c402-97db-4705-a8c7-1511f5f187fb tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:23.707079 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5330c402-97db-4705-a8c7-1511f5f187fb tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:23.708056 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5330c402-97db-4705-a8c7-1511f5f187fb tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:23.708382 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5330c402-97db-4705-a8c7-1511f5f187fb tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:24.126027 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5330c402-97db-4705-a8c7-1511f5f187fb tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:24.139393 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5330c402-97db-4705-a8c7-1511f5f187fb tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1506 microversion: 2.1 time: 0.451967 Jul 25 14:49:24.140333 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2505/4752] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:23 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1506 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:24.326057 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b70d824a-3df6-461d-abd0-4d8ab732abbd tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46878f33a0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:24.426039 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b70d824a-3df6-461d-abd0-4d8ab732abbd tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a" status: 200 len: 1437 microversion: 2.1 time: 0.107074 Jul 25 14:49:24.433476 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2248/4753] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:24 2022] GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a => generated 1437 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:25.160415 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c67eb704-6d7a-40d4-b1aa-07e7938420e3 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:25.161034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c67eb704-6d7a-40d4-b1aa-07e7938420e3 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:25.175746 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c67eb704-6d7a-40d4-b1aa-07e7938420e3 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:25.177009 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c67eb704-6d7a-40d4-b1aa-07e7938420e3 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:25.177324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c67eb704-6d7a-40d4-b1aa-07e7938420e3 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:25.177752 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c67eb704-6d7a-40d4-b1aa-07e7938420e3 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:25.446365 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e356fda2-f895-4efc-b1ed-44514b3c010b tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46989c6670>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:25.508037 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c67eb704-6d7a-40d4-b1aa-07e7938420e3 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:25.522992 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c67eb704-6d7a-40d4-b1aa-07e7938420e3 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1506 microversion: 2.1 time: 0.366553 Jul 25 14:49:25.527552 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2506/4754] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:25 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1506 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:25.560852 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e356fda2-f895-4efc-b1ed-44514b3c010b tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a" status: 200 len: 1437 microversion: 2.1 time: 0.123381 Jul 25 14:49:25.561465 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2249/4755] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:25 2022] GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a => generated 1437 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:49:26.552592 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-47542238-f8f1-4ff4-9aed-2cc63ef59784 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:26.553623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-47542238-f8f1-4ff4-9aed-2cc63ef59784 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:26.565753 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-47542238-f8f1-4ff4-9aed-2cc63ef59784 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:26.568872 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-47542238-f8f1-4ff4-9aed-2cc63ef59784 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:26.570890 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-47542238-f8f1-4ff4-9aed-2cc63ef59784 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:26.572971 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-47542238-f8f1-4ff4-9aed-2cc63ef59784 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:26.583127 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2ae517e3-d2ee-428b-af5f-ddca96a7c5b9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46875fcc10>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:26.669124 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2ae517e3-d2ee-428b-af5f-ddca96a7c5b9 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a" status: 200 len: 1437 microversion: 2.1 time: 0.093836 Jul 25 14:49:26.670669 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2250/4756] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:26 2022] GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a => generated 1437 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:26.935461 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-47542238-f8f1-4ff4-9aed-2cc63ef59784 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:26.947813 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-47542238-f8f1-4ff4-9aed-2cc63ef59784 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1506 microversion: 2.1 time: 0.400562 Jul 25 14:49:26.951465 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2507/4757] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:26 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1506 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:27.686813 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a715e933-92b3-41a6-92a2-f464b8a23cc6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f468675a040>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:27.756946 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a715e933-92b3-41a6-92a2-f464b8a23cc6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a" status: 200 len: 1437 microversion: 2.1 time: 0.075300 Jul 25 14:49:27.757944 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2251/4758] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:27 2022] GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a => generated 1437 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:27.972385 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9538b5e2-c152-4fc4-85f8-d4b38fc8b8dd tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:27.974004 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9538b5e2-c152-4fc4-85f8-d4b38fc8b8dd tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:27.984962 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9538b5e2-c152-4fc4-85f8-d4b38fc8b8dd tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:27.986160 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9538b5e2-c152-4fc4-85f8-d4b38fc8b8dd tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:27.987191 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9538b5e2-c152-4fc4-85f8-d4b38fc8b8dd tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:27.987878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9538b5e2-c152-4fc4-85f8-d4b38fc8b8dd tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:28.237432 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9538b5e2-c152-4fc4-85f8-d4b38fc8b8dd tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:28.254918 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9538b5e2-c152-4fc4-85f8-d4b38fc8b8dd tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1506 microversion: 2.1 time: 0.286840 Jul 25 14:49:28.256258 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2508/4759] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:27 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1506 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:28.772990 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1682f004-55e7-4f38-a3f8-45f1b82725ad tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f468777ef70>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:28.859735 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1682f004-55e7-4f38-a3f8-45f1b82725ad tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a" status: 200 len: 1437 microversion: 2.1 time: 0.090665 Jul 25 14:49:28.860942 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2252/4760] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:28 2022] GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a => generated 1437 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:29.285715 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e159b8eb-8536-49ea-b2a7-0b200bb2b492 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:29.286867 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e159b8eb-8536-49ea-b2a7-0b200bb2b492 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:29.301543 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e159b8eb-8536-49ea-b2a7-0b200bb2b492 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:29.302277 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e159b8eb-8536-49ea-b2a7-0b200bb2b492 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:29.305382 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e159b8eb-8536-49ea-b2a7-0b200bb2b492 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:29.308009 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e159b8eb-8536-49ea-b2a7-0b200bb2b492 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:29.606059 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e159b8eb-8536-49ea-b2a7-0b200bb2b492 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:29.608305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:49:29.615149 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e159b8eb-8536-49ea-b2a7-0b200bb2b492 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1506 microversion: 2.1 time: 0.338403 Jul 25 14:49:29.632783 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2509/4761] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:29 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1506 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:29.876179 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cf94df83-d123-4128-bdfb-73cdd6ee7680 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46866deee0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:29.948377 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cf94df83-d123-4128-bdfb-73cdd6ee7680 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a" status: 200 len: 1437 microversion: 2.1 time: 0.077514 Jul 25 14:49:29.949896 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2253/4762] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:29 2022] GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a => generated 1437 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:30.655518 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d31dbdfd-dc31-4c41-bc45-5af291816a4d tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:30.656826 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d31dbdfd-dc31-4c41-bc45-5af291816a4d tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:30.675407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d31dbdfd-dc31-4c41-bc45-5af291816a4d tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:30.676212 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d31dbdfd-dc31-4c41-bc45-5af291816a4d tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:30.677212 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d31dbdfd-dc31-4c41-bc45-5af291816a4d tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:30.677811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d31dbdfd-dc31-4c41-bc45-5af291816a4d tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:30.860563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d31dbdfd-dc31-4c41-bc45-5af291816a4d tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:30.873592 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d31dbdfd-dc31-4c41-bc45-5af291816a4d tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1506 microversion: 2.1 time: 0.221759 Jul 25 14:49:30.876859 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2510/4763] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:30 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1506 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:30.962252 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=17 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:49:30.964592 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:49:30.970057 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a602a5e9-d808-42cf-a6bf-befe20f4dda2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f4686ba7e50>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:31.079511 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a602a5e9-d808-42cf-a6bf-befe20f4dda2 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a" status: 200 len: 1437 microversion: 2.1 time: 0.117949 Jul 25 14:49:31.083551 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2254/4764] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:30 2022] GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a => generated 1437 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:31.911558 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c814e81e-57db-4ff6-82c6-aa80be2f1ed6 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:31.911558 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c814e81e-57db-4ff6-82c6-aa80be2f1ed6 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:31.923035 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c814e81e-57db-4ff6-82c6-aa80be2f1ed6 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:31.929147 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c814e81e-57db-4ff6-82c6-aa80be2f1ed6 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:31.936568 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c814e81e-57db-4ff6-82c6-aa80be2f1ed6 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:31.938344 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c814e81e-57db-4ff6-82c6-aa80be2f1ed6 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:32.096011 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-602d99ed-67e8-4c53-ac72-3194183a735d tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46875fc280>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:32.195226 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-602d99ed-67e8-4c53-ac72-3194183a735d tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a" status: 200 len: 1437 microversion: 2.1 time: 0.104042 Jul 25 14:49:32.195828 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2255/4765] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:32 2022] GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a => generated 1437 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:49:32.243262 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c814e81e-57db-4ff6-82c6-aa80be2f1ed6 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:32.256368 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c814e81e-57db-4ff6-82c6-aa80be2f1ed6 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1506 microversion: 2.1 time: 0.361812 Jul 25 14:49:32.260198 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2511/4766] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:31 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1506 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:49:33.212287 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-de79f7ec-95f9-4a3c-a1bb-3c6c9110ef73 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46878f3f70>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:33.283257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-aa6c8252-9545-412b-9832-f1aafb83e654 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:33.285705 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-aa6c8252-9545-412b-9832-f1aafb83e654 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:33.312385 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aa6c8252-9545-412b-9832-f1aafb83e654 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:33.319099 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aa6c8252-9545-412b-9832-f1aafb83e654 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:33.319960 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aa6c8252-9545-412b-9832-f1aafb83e654 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:33.320430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aa6c8252-9545-412b-9832-f1aafb83e654 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:33.356418 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-de79f7ec-95f9-4a3c-a1bb-3c6c9110ef73 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a" status: 200 len: 1446 microversion: 2.1 time: 0.147608 Jul 25 14:49:33.357011 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2256/4767] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:33 2022] GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a => generated 1446 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:49:33.380772 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-85a59398-4f25-4439-bf23-d60bf75f483d tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f468763e160>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:33.465883 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-85a59398-4f25-4439-bf23-d60bf75f483d tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a" status: 200 len: 1446 microversion: 2.1 time: 0.092409 Jul 25 14:49:33.467855 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2257/4768] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:33 2022] GET /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a => generated 1446 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:33.483101 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bd7da5ef-157f-43d3-99a4-a3bb0d7eca06 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46869a9d30>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:33.651067 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-aa6c8252-9545-412b-9832-f1aafb83e654 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:33.663621 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-aa6c8252-9545-412b-9832-f1aafb83e654 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1506 microversion: 2.1 time: 0.384837 Jul 25 14:49:33.664259 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2512/4769] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:33 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1506 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:34.602416 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bd7da5ef-157f-43d3-99a4-a3bb0d7eca06 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "DELETE /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a" status: 204 len: 0 microversion: 2.1 time: 1.124735 Jul 25 14:49:34.603220 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2258/4770] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:33 2022] DELETE /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a => generated 0 bytes in 1126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 14:49:34.619435 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dde7ee7c-22eb-4fa8-a647-84310aa08211 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:34.620780 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dde7ee7c-22eb-4fa8-a647-84310aa08211 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 2a545a10-2062-4c00-97ef-19591b829c0d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:34.632713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dde7ee7c-22eb-4fa8-a647-84310aa08211 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:34.639122 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dde7ee7c-22eb-4fa8-a647-84310aa08211 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:34.643796 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dde7ee7c-22eb-4fa8-a647-84310aa08211 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:34.644813 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dde7ee7c-22eb-4fa8-a647-84310aa08211 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:34.675899 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dde7ee7c-22eb-4fa8-a647-84310aa08211 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 2a545a10-2062-4c00-97ef-19591b829c0d] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:49:34.689956 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-95c402c9-715d-43ab-a817-6a90ba7a35cc tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:34.690925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-95c402c9-715d-43ab-a817-6a90ba7a35cc tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:34.698262 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-95c402c9-715d-43ab-a817-6a90ba7a35cc tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:34.699200 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-95c402c9-715d-43ab-a817-6a90ba7a35cc tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:34.700336 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-95c402c9-715d-43ab-a817-6a90ba7a35cc tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:34.700983 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-95c402c9-715d-43ab-a817-6a90ba7a35cc tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:34.800676 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dde7ee7c-22eb-4fa8-a647-84310aa08211 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "DELETE /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d" status: 204 len: 0 microversion: 2.1 time: 0.189471 Jul 25 14:49:34.806083 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2513/4771] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:49:34 2022] DELETE /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:49:34.907743 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-95c402c9-715d-43ab-a817-6a90ba7a35cc tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:34.918215 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-95c402c9-715d-43ab-a817-6a90ba7a35cc tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1506 microversion: 2.1 time: 0.231673 Jul 25 14:49:34.919514 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2259/4772] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:34 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1506 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:49:34.985001 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f0eacc63-e5c5-49f7-a156-6068393e9628 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-161489283", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "87cfcadc-6ea1-4167-a535-aad1c1b10077"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:49:35.062453 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-f0eacc63-e5c5-49f7-a156-6068393e9628 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] validate_networks() for [('87cfcadc-6ea1-4167-a535-aad1c1b10077', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:49:35.612131 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f0eacc63-e5c5-49f7-a156-6068393e9628 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:49:35.612570 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f0eacc63-e5c5-49f7-a156-6068393e9628 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:49:35.613072 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f0eacc63-e5c5-49f7-a156-6068393e9628 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:49:35.613519 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f0eacc63-e5c5-49f7-a156-6068393e9628 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:49:35.613931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f0eacc63-e5c5-49f7-a156-6068393e9628 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:49:35.640128 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0eacc63-e5c5-49f7-a156-6068393e9628 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:35.640885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0eacc63-e5c5-49f7-a156-6068393e9628 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:35.641373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0eacc63-e5c5-49f7-a156-6068393e9628 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:35.641840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0eacc63-e5c5-49f7-a156-6068393e9628 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:35.661366 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-f0eacc63-e5c5-49f7-a156-6068393e9628 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Getting quotas for project 87b0942d86634ed0a2f89a0001b5a887. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:49:35.667261 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-f0eacc63-e5c5-49f7-a156-6068393e9628 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Getting quotas for user 6e3de16106b3455b85f90dcd94d39ce0 and project 87b0942d86634ed0a2f89a0001b5a887. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:49:35.698665 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f0eacc63-e5c5-49f7-a156-6068393e9628 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:49:35.701668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f0eacc63-e5c5-49f7-a156-6068393e9628 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: f20eb7aa-ad15-4041-a06f-06228eebb5d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:49:35.781888 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f0eacc63-e5c5-49f7-a156-6068393e9628 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.815876 Jul 25 14:49:35.783230 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2514/4773] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:49:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:49:35.798120 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f324436a-035c-421c-8df7-3e430abaa033 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:35.799415 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f324436a-035c-421c-8df7-3e430abaa033 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: f20eb7aa-ad15-4041-a06f-06228eebb5d6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:35.878734 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f324436a-035c-421c-8df7-3e430abaa033 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:35.887460 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f324436a-035c-421c-8df7-3e430abaa033 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6" status: 200 len: 1207 microversion: 2.1 time: 0.095897 Jul 25 14:49:35.888063 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2260/4774] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:35 2022] GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6 => generated 1207 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:35.940551 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d443a130-75ec-4008-80f6-ba219e77cfb2 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:35.941381 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d443a130-75ec-4008-80f6-ba219e77cfb2 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:35.949728 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d443a130-75ec-4008-80f6-ba219e77cfb2 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:35.950322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d443a130-75ec-4008-80f6-ba219e77cfb2 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:35.951270 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d443a130-75ec-4008-80f6-ba219e77cfb2 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:35.951948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d443a130-75ec-4008-80f6-ba219e77cfb2 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:36.166822 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d443a130-75ec-4008-80f6-ba219e77cfb2 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:36.175673 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d443a130-75ec-4008-80f6-ba219e77cfb2 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1506 microversion: 2.1 time: 0.240716 Jul 25 14:49:36.188233 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2515/4775] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:35 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1506 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:36.914345 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dcb55953-53fc-4eb5-956b-1fa8e0cf1a5c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:36.914771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-dcb55953-53fc-4eb5-956b-1fa8e0cf1a5c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: f20eb7aa-ad15-4041-a06f-06228eebb5d6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:36.929901 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dcb55953-53fc-4eb5-956b-1fa8e0cf1a5c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:36.930527 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dcb55953-53fc-4eb5-956b-1fa8e0cf1a5c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:36.931919 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dcb55953-53fc-4eb5-956b-1fa8e0cf1a5c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:36.932817 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dcb55953-53fc-4eb5-956b-1fa8e0cf1a5c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:37.066049 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-dcb55953-53fc-4eb5-956b-1fa8e0cf1a5c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:37.076788 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dcb55953-53fc-4eb5-956b-1fa8e0cf1a5c tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6" status: 200 len: 1259 microversion: 2.1 time: 0.165617 Jul 25 14:49:37.080943 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2261/4776] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:36 2022] GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6 => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:37.201173 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-25151442-e348-494a-8a71-d6ae27eb979a tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:37.205357 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-25151442-e348-494a-8a71-d6ae27eb979a tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:37.224865 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25151442-e348-494a-8a71-d6ae27eb979a tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:37.228868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25151442-e348-494a-8a71-d6ae27eb979a tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:37.229736 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25151442-e348-494a-8a71-d6ae27eb979a tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:37.230325 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25151442-e348-494a-8a71-d6ae27eb979a tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:37.522650 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-25151442-e348-494a-8a71-d6ae27eb979a tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:37.530870 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-25151442-e348-494a-8a71-d6ae27eb979a tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1506 microversion: 2.1 time: 0.336631 Jul 25 14:49:37.544598 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2516/4777] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:37 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1506 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:38.098133 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6e9ec020-49f2-486e-acc7-bf2ab8cdf16b tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:38.098978 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6e9ec020-49f2-486e-acc7-bf2ab8cdf16b tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: f20eb7aa-ad15-4041-a06f-06228eebb5d6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:38.109519 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e9ec020-49f2-486e-acc7-bf2ab8cdf16b tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:38.112739 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e9ec020-49f2-486e-acc7-bf2ab8cdf16b tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:38.113832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e9ec020-49f2-486e-acc7-bf2ab8cdf16b tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:38.117641 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e9ec020-49f2-486e-acc7-bf2ab8cdf16b tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:38.275595 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6e9ec020-49f2-486e-acc7-bf2ab8cdf16b tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:38.300523 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6e9ec020-49f2-486e-acc7-bf2ab8cdf16b tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6" status: 200 len: 1265 microversion: 2.1 time: 0.206439 Jul 25 14:49:38.301597 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2262/4778] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:38 2022] GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6 => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:38.558742 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-33e61fd1-2a3e-494d-a1c1-d7f4f6f75e54 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:38.559929 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-33e61fd1-2a3e-494d-a1c1-d7f4f6f75e54 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:38.582874 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-33e61fd1-2a3e-494d-a1c1-d7f4f6f75e54 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:38.583365 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-33e61fd1-2a3e-494d-a1c1-d7f4f6f75e54 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:38.584299 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-33e61fd1-2a3e-494d-a1c1-d7f4f6f75e54 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:38.584783 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-33e61fd1-2a3e-494d-a1c1-d7f4f6f75e54 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:38.626458 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-2d99b4b5-3f07-4d00-8c84-545446fbc2af req-8ce95200-7adb-4017-ae44-96bd74742e42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a545a10-2062-4c00-97ef-19591b829c0d", "name": "network-vif-deleted", "tag": "e11c38a4-9d6c-4fb9-933b-1470130b560f"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:49:38.656811 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-2d99b4b5-3f07-4d00-8c84-545446fbc2af req-8ce95200-7adb-4017-ae44-96bd74742e42 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:38.657267 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-2d99b4b5-3f07-4d00-8c84-545446fbc2af req-8ce95200-7adb-4017-ae44-96bd74742e42 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:38.732216 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-2d99b4b5-3f07-4d00-8c84-545446fbc2af req-8ce95200-7adb-4017-ae44-96bd74742e42 service nova] Creating event network-vif-deleted:e11c38a4-9d6c-4fb9-933b-1470130b560f for instance 2a545a10-2062-4c00-97ef-19591b829c0d on n-h2-846435-14 Jul 25 14:49:38.743075 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-2d99b4b5-3f07-4d00-8c84-545446fbc2af req-8ce95200-7adb-4017-ae44-96bd74742e42 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120418 Jul 25 14:49:38.751933 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2263/4779] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:49:38.943718 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-33e61fd1-2a3e-494d-a1c1-d7f4f6f75e54 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:38.951803 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-33e61fd1-2a3e-494d-a1c1-d7f4f6f75e54 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1506 microversion: 2.1 time: 0.398057 Jul 25 14:49:38.953024 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2517/4780] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:38 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1506 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:39.196096 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7b873f5a-36c4-4266-bbbf-522bea528aad tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:39.202831 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7b873f5a-36c4-4266-bbbf-522bea528aad tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:39.225766 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b873f5a-36c4-4266-bbbf-522bea528aad tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:39.226614 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b873f5a-36c4-4266-bbbf-522bea528aad tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:39.227857 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b873f5a-36c4-4266-bbbf-522bea528aad tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:39.230296 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b873f5a-36c4-4266-bbbf-522bea528aad tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:39.285217 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7b873f5a-36c4-4266-bbbf-522bea528aad tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096050 Jul 25 14:49:39.287652 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2264/4781] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:49:39 2022] GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:49:39.302664 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2090dfa8-b3ec-4153-b386-074866576418 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:39.303245 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2090dfa8-b3ec-4153-b386-074866576418 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:39.313299 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2090dfa8-b3ec-4153-b386-074866576418 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:39.314594 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2090dfa8-b3ec-4153-b386-074866576418 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:39.315341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2090dfa8-b3ec-4153-b386-074866576418 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:39.315836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2090dfa8-b3ec-4153-b386-074866576418 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:39.325520 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-33bd9a8f-f06a-4e42-ad2a-977b0a595818 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:39.326229 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-33bd9a8f-f06a-4e42-ad2a-977b0a595818 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: f20eb7aa-ad15-4041-a06f-06228eebb5d6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:39.342039 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-33bd9a8f-f06a-4e42-ad2a-977b0a595818 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:39.344925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-33bd9a8f-f06a-4e42-ad2a-977b0a595818 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:39.346515 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-33bd9a8f-f06a-4e42-ad2a-977b0a595818 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:39.348104 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-33bd9a8f-f06a-4e42-ad2a-977b0a595818 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:39.422463 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2090dfa8-b3ec-4153-b386-074866576418 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea/os-volume_attachments/5995456e-34af-4403-b898-9343212fc25a" status: 200 len: 194 microversion: 2.1 time: 0.126613 Jul 25 14:49:39.424703 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2518/4782] 10.222.0.88 () {58 vars in 1413 bytes} [Mon Jul 25 14:49:39 2022] GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea/os-volume_attachments/5995456e-34af-4403-b898-9343212fc25a => generated 194 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:49:39.753185 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-33bd9a8f-f06a-4e42-ad2a-977b0a595818 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:39.763524 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-33bd9a8f-f06a-4e42-ad2a-977b0a595818 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6" status: 200 len: 1307 microversion: 2.1 time: 0.444306 Jul 25 14:49:39.764155 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2265/4783] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:39 2022] GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6 => generated 1307 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:39.983201 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2a1b72c5-b513-4a43-a1de-048ab9d7663b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:39.984563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2a1b72c5-b513-4a43-a1de-048ab9d7663b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:40.002038 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2a1b72c5-b513-4a43-a1de-048ab9d7663b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:40.006018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2a1b72c5-b513-4a43-a1de-048ab9d7663b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:40.007053 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2a1b72c5-b513-4a43-a1de-048ab9d7663b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:40.008316 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2a1b72c5-b513-4a43-a1de-048ab9d7663b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:40.286349 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2a1b72c5-b513-4a43-a1de-048ab9d7663b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:40.295006 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2a1b72c5-b513-4a43-a1de-048ab9d7663b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1506 microversion: 2.1 time: 0.324139 Jul 25 14:49:40.297236 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2519/4784] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:39 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1506 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:40.787962 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3c1c34fe-1fc7-4bba-b4aa-5fe53dff982a tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:40.789235 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3c1c34fe-1fc7-4bba-b4aa-5fe53dff982a tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: f20eb7aa-ad15-4041-a06f-06228eebb5d6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:40.807205 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c1c34fe-1fc7-4bba-b4aa-5fe53dff982a tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:40.807656 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c1c34fe-1fc7-4bba-b4aa-5fe53dff982a tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:40.808619 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c1c34fe-1fc7-4bba-b4aa-5fe53dff982a tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:40.809040 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c1c34fe-1fc7-4bba-b4aa-5fe53dff982a tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:41.336685 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-463bdd5b-1018-434e-9159-65a9ecbea5aa tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:41.337914 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-463bdd5b-1018-434e-9159-65a9ecbea5aa tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:41.346397 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-463bdd5b-1018-434e-9159-65a9ecbea5aa tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:41.346847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-463bdd5b-1018-434e-9159-65a9ecbea5aa tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:41.347632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-463bdd5b-1018-434e-9159-65a9ecbea5aa tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:41.348307 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-463bdd5b-1018-434e-9159-65a9ecbea5aa tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:41.470478 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3c1c34fe-1fc7-4bba-b4aa-5fe53dff982a tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:41.507960 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3c1c34fe-1fc7-4bba-b4aa-5fe53dff982a tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6" status: 200 len: 1307 microversion: 2.1 time: 0.717525 Jul 25 14:49:41.530010 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2266/4785] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:40 2022] GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6 => generated 1307 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:41.677604 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-463bdd5b-1018-434e-9159-65a9ecbea5aa tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:41.687848 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-463bdd5b-1018-434e-9159-65a9ecbea5aa tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1506 microversion: 2.1 time: 0.373404 Jul 25 14:49:41.689303 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2520/4786] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:41 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1506 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:41.812854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-2af4df3b-5829-46ae-9705-0d78edcd8fc9 req-7ca5c116-791f-489c-8462-1125e85fa20c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f20eb7aa-ad15-4041-a06f-06228eebb5d6", "tag": "62680b70-77eb-4411-b4cb-9bb47d57ac03"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:49:41.835410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-2af4df3b-5829-46ae-9705-0d78edcd8fc9 req-7ca5c116-791f-489c-8462-1125e85fa20c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:41.835871 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-2af4df3b-5829-46ae-9705-0d78edcd8fc9 req-7ca5c116-791f-489c-8462-1125e85fa20c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:41.878143 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-2af4df3b-5829-46ae-9705-0d78edcd8fc9 req-7ca5c116-791f-489c-8462-1125e85fa20c service nova] Creating event network-changed:62680b70-77eb-4411-b4cb-9bb47d57ac03 for instance f20eb7aa-ad15-4041-a06f-06228eebb5d6 on n-h1-846435-14 Jul 25 14:49:41.922925 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-2af4df3b-5829-46ae-9705-0d78edcd8fc9 req-7ca5c116-791f-489c-8462-1125e85fa20c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114358 Jul 25 14:49:41.940736 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2267/4787] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:49:42.108256 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b5cec89a-9be3-4bd1-acc5-839a00c1ab6c tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc5531da-d5f0-4b81-b675-707a26759d24"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:49:42.110858 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b5cec89a-9be3-4bd1-acc5-839a00c1ab6c tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:42.128932 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b5cec89a-9be3-4bd1-acc5-839a00c1ab6c tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:42.129452 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b5cec89a-9be3-4bd1-acc5-839a00c1ab6c tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:42.130301 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b5cec89a-9be3-4bd1-acc5-839a00c1ab6c tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:42.130813 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b5cec89a-9be3-4bd1-acc5-839a00c1ab6c tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:42.565347 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-530cb26f-4fc2-433b-97f6-94552efeb802 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:42.566181 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-530cb26f-4fc2-433b-97f6-94552efeb802 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: f20eb7aa-ad15-4041-a06f-06228eebb5d6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:42.594932 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-530cb26f-4fc2-433b-97f6-94552efeb802 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:42.596742 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-530cb26f-4fc2-433b-97f6-94552efeb802 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:42.597587 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-530cb26f-4fc2-433b-97f6-94552efeb802 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:42.598041 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-530cb26f-4fc2-433b-97f6-94552efeb802 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:42.934234 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b5cec89a-9be3-4bd1-acc5-839a00c1ab6c tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "POST /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.829808 Jul 25 14:49:42.943564 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2521/4788] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Jul 25 14:49:42 2022] POST /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea/os-volume_attachments => generated 194 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:49:42.960701 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c87795ac-738d-459f-8413-512c58599f75 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:42.965991 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c87795ac-738d-459f-8413-512c58599f75 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:42.980229 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c87795ac-738d-459f-8413-512c58599f75 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:42.982817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c87795ac-738d-459f-8413-512c58599f75 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:42.983698 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c87795ac-738d-459f-8413-512c58599f75 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:42.984196 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c87795ac-738d-459f-8413-512c58599f75 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:43.007837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-530cb26f-4fc2-433b-97f6-94552efeb802 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:43.026192 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-530cb26f-4fc2-433b-97f6-94552efeb802 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6" status: 200 len: 1307 microversion: 2.1 time: 0.472440 Jul 25 14:49:43.027271 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2268/4789] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:42 2022] GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6 => generated 1307 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:43.319686 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c87795ac-738d-459f-8413-512c58599f75 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:43.329615 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c87795ac-738d-459f-8413-512c58599f75 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1506 microversion: 2.1 time: 0.388319 Jul 25 14:49:43.330819 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2522/4790] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:42 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1506 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:44.061549 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6b78f705-4971-4a49-b9b0-0476db67ae5e tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:44.062721 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6b78f705-4971-4a49-b9b0-0476db67ae5e tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: f20eb7aa-ad15-4041-a06f-06228eebb5d6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:44.108446 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6b78f705-4971-4a49-b9b0-0476db67ae5e tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:44.109199 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6b78f705-4971-4a49-b9b0-0476db67ae5e tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:44.110236 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6b78f705-4971-4a49-b9b0-0476db67ae5e tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:44.110833 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6b78f705-4971-4a49-b9b0-0476db67ae5e tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:44.351412 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ab20de97-09c7-40fd-ab81-af1439ab5b0a tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:44.351997 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ab20de97-09c7-40fd-ab81-af1439ab5b0a tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:44.373525 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ab20de97-09c7-40fd-ab81-af1439ab5b0a tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:44.374326 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ab20de97-09c7-40fd-ab81-af1439ab5b0a tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:44.375320 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ab20de97-09c7-40fd-ab81-af1439ab5b0a tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:44.375924 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ab20de97-09c7-40fd-ab81-af1439ab5b0a tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:44.510513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6b78f705-4971-4a49-b9b0-0476db67ae5e tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:44.526015 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6b78f705-4971-4a49-b9b0-0476db67ae5e tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6" status: 200 len: 1307 microversion: 2.1 time: 0.476352 Jul 25 14:49:44.526895 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2269/4791] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:44 2022] GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6 => generated 1307 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:44.669310 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ab20de97-09c7-40fd-ab81-af1439ab5b0a tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:44.678685 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ab20de97-09c7-40fd-ab81-af1439ab5b0a tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1506 microversion: 2.1 time: 0.331323 Jul 25 14:49:44.693528 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2523/4792] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:44 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:49:45.547829 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-481e957b-6a99-4be4-a077-79347c060086 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:45.549590 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-481e957b-6a99-4be4-a077-79347c060086 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: f20eb7aa-ad15-4041-a06f-06228eebb5d6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:45.558003 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-481e957b-6a99-4be4-a077-79347c060086 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:45.558827 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-481e957b-6a99-4be4-a077-79347c060086 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:45.559709 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-481e957b-6a99-4be4-a077-79347c060086 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:45.560437 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-481e957b-6a99-4be4-a077-79347c060086 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:45.706006 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-98187547-9643-4d5e-891f-fe84e5014a1f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:45.707374 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-98187547-9643-4d5e-891f-fe84e5014a1f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:45.710610 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:49:45.711280 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:49:45.751924 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98187547-9643-4d5e-891f-fe84e5014a1f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:45.751924 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98187547-9643-4d5e-891f-fe84e5014a1f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:45.751924 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98187547-9643-4d5e-891f-fe84e5014a1f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:45.751924 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98187547-9643-4d5e-891f-fe84e5014a1f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:45.783189 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:49:45.884255 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:49:45.924652 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-481e957b-6a99-4be4-a077-79347c060086 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:45.933039 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-481e957b-6a99-4be4-a077-79347c060086 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6" status: 200 len: 1307 microversion: 2.1 time: 0.389550 Jul 25 14:49:45.937327 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2270/4793] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:45 2022] GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6 => generated 1307 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:45.998542 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-98187547-9643-4d5e-891f-fe84e5014a1f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:46.014570 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-98187547-9643-4d5e-891f-fe84e5014a1f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1506 microversion: 2.1 time: 0.313970 Jul 25 14:49:46.015524 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2524/4794] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:45 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:46.956856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-355772dd-821e-413f-b781-d9ad78036b90 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:46.957461 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-355772dd-821e-413f-b781-d9ad78036b90 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: f20eb7aa-ad15-4041-a06f-06228eebb5d6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:46.974837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-355772dd-821e-413f-b781-d9ad78036b90 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:46.975307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-355772dd-821e-413f-b781-d9ad78036b90 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:46.976147 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-355772dd-821e-413f-b781-d9ad78036b90 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:46.976582 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-355772dd-821e-413f-b781-d9ad78036b90 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:47.049022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d57111cf-bc2f-4bb1-bf9a-7e3b7da989e0 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:47.049503 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d57111cf-bc2f-4bb1-bf9a-7e3b7da989e0 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:47.067227 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d57111cf-bc2f-4bb1-bf9a-7e3b7da989e0 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:47.067696 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d57111cf-bc2f-4bb1-bf9a-7e3b7da989e0 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:47.070054 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d57111cf-bc2f-4bb1-bf9a-7e3b7da989e0 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:47.075499 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d57111cf-bc2f-4bb1-bf9a-7e3b7da989e0 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:47.411345 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-355772dd-821e-413f-b781-d9ad78036b90 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:47.424485 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-355772dd-821e-413f-b781-d9ad78036b90 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6" status: 200 len: 1307 microversion: 2.1 time: 0.472764 Jul 25 14:49:47.425099 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2271/4795] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:46 2022] GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6 => generated 1307 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:47.440920 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d57111cf-bc2f-4bb1-bf9a-7e3b7da989e0 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:47.453551 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d57111cf-bc2f-4bb1-bf9a-7e3b7da989e0 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1506 microversion: 2.1 time: 0.416026 Jul 25 14:49:47.462235 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2525/4796] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:47 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1506 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:49:48.451700 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d643f10e-6475-49f3-99e1-4faabb520d32 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:48.452349 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d643f10e-6475-49f3-99e1-4faabb520d32 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: f20eb7aa-ad15-4041-a06f-06228eebb5d6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:48.468145 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d643f10e-6475-49f3-99e1-4faabb520d32 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:48.468520 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d643f10e-6475-49f3-99e1-4faabb520d32 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:48.469318 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d643f10e-6475-49f3-99e1-4faabb520d32 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:48.470062 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d643f10e-6475-49f3-99e1-4faabb520d32 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:48.479722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0fcd710d-3bbf-4bfc-a078-202cf7ae612c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:48.481582 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0fcd710d-3bbf-4bfc-a078-202cf7ae612c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:48.494239 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0fcd710d-3bbf-4bfc-a078-202cf7ae612c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:48.502089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0fcd710d-3bbf-4bfc-a078-202cf7ae612c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:48.503340 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0fcd710d-3bbf-4bfc-a078-202cf7ae612c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:48.504475 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0fcd710d-3bbf-4bfc-a078-202cf7ae612c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:48.910089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0fcd710d-3bbf-4bfc-a078-202cf7ae612c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:48.918453 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0fcd710d-3bbf-4bfc-a078-202cf7ae612c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1506 microversion: 2.1 time: 0.443444 Jul 25 14:49:48.925335 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2526/4797] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:48 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1506 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:48.942044 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-49fe0679-84dd-4c7e-9c0d-25621acbf050 req-e07b5c67-c1fa-4ccc-aaec-6022e8609ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f20eb7aa-ad15-4041-a06f-06228eebb5d6", "name": "network-vif-plugged", "status": "completed", "tag": "62680b70-77eb-4411-b4cb-9bb47d57ac03"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:49:48.957989 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-49fe0679-84dd-4c7e-9c0d-25621acbf050 req-e07b5c67-c1fa-4ccc-aaec-6022e8609ec9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:48.960645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-49fe0679-84dd-4c7e-9c0d-25621acbf050 req-e07b5c67-c1fa-4ccc-aaec-6022e8609ec9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:49.032264 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-49fe0679-84dd-4c7e-9c0d-25621acbf050 req-e07b5c67-c1fa-4ccc-aaec-6022e8609ec9 service nova] Creating event network-vif-plugged:62680b70-77eb-4411-b4cb-9bb47d57ac03 for instance f20eb7aa-ad15-4041-a06f-06228eebb5d6 on n-h1-846435-14 Jul 25 14:49:49.038547 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-49fe0679-84dd-4c7e-9c0d-25621acbf050 req-e07b5c67-c1fa-4ccc-aaec-6022e8609ec9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111427 Jul 25 14:49:49.039808 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2527/4798] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:49:49.654629 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d643f10e-6475-49f3-99e1-4faabb520d32 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:49.671592 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d643f10e-6475-49f3-99e1-4faabb520d32 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6" status: 200 len: 1307 microversion: 2.1 time: 1.221984 Jul 25 14:49:49.676130 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2272/4799] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:48 2022] GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6 => generated 1307 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:49.947311 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ea44888d-8480-4529-9c9c-c956e942a810 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:49.948954 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ea44888d-8480-4529-9c9c-c956e942a810 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:49.971084 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea44888d-8480-4529-9c9c-c956e942a810 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:49.972650 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea44888d-8480-4529-9c9c-c956e942a810 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:49.985917 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea44888d-8480-4529-9c9c-c956e942a810 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:49.986728 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea44888d-8480-4529-9c9c-c956e942a810 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:50.284262 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ea44888d-8480-4529-9c9c-c956e942a810 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:50.327733 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ea44888d-8480-4529-9c9c-c956e942a810 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1506 microversion: 2.1 time: 0.380782 Jul 25 14:49:50.328310 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2528/4800] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:49 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1506 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:50.694035 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0a66dd8a-ca50-4bf6-ac96-99f1b56a3849 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:50.694700 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0a66dd8a-ca50-4bf6-ac96-99f1b56a3849 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: f20eb7aa-ad15-4041-a06f-06228eebb5d6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:50.714235 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0a66dd8a-ca50-4bf6-ac96-99f1b56a3849 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:50.714755 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0a66dd8a-ca50-4bf6-ac96-99f1b56a3849 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:50.715494 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0a66dd8a-ca50-4bf6-ac96-99f1b56a3849 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:50.715943 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0a66dd8a-ca50-4bf6-ac96-99f1b56a3849 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:50.961299 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0a66dd8a-ca50-4bf6-ac96-99f1b56a3849 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:50.971590 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0a66dd8a-ca50-4bf6-ac96-99f1b56a3849 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6" status: 200 len: 1487 microversion: 2.1 time: 0.281868 Jul 25 14:49:50.987863 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2273/4801] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:50 2022] GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6 => generated 1487 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:50.994177 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a5e0c72e-c356-48ae-b203-51b4a406afda tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-727514722"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:49:50.997597 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a5e0c72e-c356-48ae-b203-51b4a406afda tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: f20eb7aa-ad15-4041-a06f-06228eebb5d6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:51.010057 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5e0c72e-c356-48ae-b203-51b4a406afda tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:51.010587 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5e0c72e-c356-48ae-b203-51b4a406afda tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:51.011580 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5e0c72e-c356-48ae-b203-51b4a406afda tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:51.012129 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5e0c72e-c356-48ae-b203-51b4a406afda tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:51.350476 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b3344f28-4cd0-466c-8795-8bd625170248 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:51.351376 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b3344f28-4cd0-466c-8795-8bd625170248 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:51.359906 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3344f28-4cd0-466c-8795-8bd625170248 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:51.367640 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3344f28-4cd0-466c-8795-8bd625170248 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:51.370333 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3344f28-4cd0-466c-8795-8bd625170248 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:51.372494 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3344f28-4cd0-466c-8795-8bd625170248 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:51.450907 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a5e0c72e-c356-48ae-b203-51b4a406afda tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "POST /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6/action" status: 202 len: 0 microversion: 2.1 time: 0.438797 Jul 25 14:49:51.457340 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2529/4802] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:49:50 2022] POST /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 14:49:51.463166 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4300d366-dbd6-4fc5-bae1-25f6fb656e09 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46861f3430>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:51.537583 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4300d366-dbd6-4fc5-bae1-25f6fb656e09 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/b4a43f08-bd06-47e4-97a1-45f6a1c9198a" status: 200 len: 1411 microversion: 2.1 time: 0.078669 Jul 25 14:49:51.542978 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2530/4803] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:51 2022] GET /compute/v2.1/images/b4a43f08-bd06-47e4-97a1-45f6a1c9198a => generated 1411 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:51.581104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fc7927b7-8a60-40e8-96b1-f8a1a46503ab tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46988c5310>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:51.695079 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fc7927b7-8a60-40e8-96b1-f8a1a46503ab tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/b4a43f08-bd06-47e4-97a1-45f6a1c9198a" status: 200 len: 1411 microversion: 2.1 time: 0.135067 Jul 25 14:49:51.695733 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2531/4804] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:51 2022] GET /compute/v2.1/images/b4a43f08-bd06-47e4-97a1-45f6a1c9198a => generated 1411 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:51.722573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a804b8f1-a91b-4b89-842c-c0f221225d9a tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46988e4ee0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:51.853849 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b3344f28-4cd0-466c-8795-8bd625170248 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:51.863679 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b3344f28-4cd0-466c-8795-8bd625170248 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1486 microversion: 2.1 time: 0.518658 Jul 25 14:49:51.884040 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2274/4805] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:51 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1486 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:49:52.058465 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a804b8f1-a91b-4b89-842c-c0f221225d9a tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "DELETE /compute/v2.1/images/b4a43f08-bd06-47e4-97a1-45f6a1c9198a" status: 204 len: 0 microversion: 2.1 time: 0.351529 Jul 25 14:49:52.059325 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2532/4806] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:51 2022] DELETE /compute/v2.1/images/b4a43f08-bd06-47e4-97a1-45f6a1c9198a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:49:52.068658 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0a1afb82-8623-4a5f-baa1-e8d67375aa28 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f4686ba74c0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:52.099717 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-0a1afb82-8623-4a5f-baa1-e8d67375aa28 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] HTTP exception thrown: Image not found. Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0a1afb82-8623-4a5f-baa1-e8d67375aa28 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Request method failure captured: Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/images/b4a43f08-bd06-47e4-97a1-45f6a1c9198a HTTP/1.1 Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qyatJqQrr08arTTYAwijcT05_0DmeHkII2vobDv21BlJcgehu9BcsiwDdPlfYw3H-855q6yyUohvyQZ_GbvjZpgl8ZkXM5qnqIcYBEVVR4ugRK1D8vgncAVZvcnAppeV7EeucTViHERKAZxQ3Ys7ErVRVL4cjio9Yzo-jYWQXPoJf0 Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 87b0942d86634ed0a2f89a0001b5a887 Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ImagesTestJSON-384251757 Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/87b0942d86634ed0a2f89a0001b5a887"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/87b0942d86634ed0a2f89a0001b5a887"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_87b0942d86634ed0a2f89a0001b5a887", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/87b0942d86634ed0a2f89a0001b5a887"}]}] Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ImagesTestJSON-384251757 Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 87b0942d86634ed0a2f89a0001b5a887 Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ImagesTestJSON-384251757 Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ImagesTestJSON-384251757-project Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 6e3de16106b3455b85f90dcd94d39ce0 Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ImagesTestJSON-384251757-project Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: exception: Image not found. Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'b4a43f08-bd06-47e4-97a1-45f6a1c9198a'} Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b4a43f08-bd06-47e4-97a1-45f6a1c9198a Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 14:49:52.102885 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b4a43f08-bd06-47e4-97a1-45f6a1c9198a could not be found. Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 14:49:52.108133 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:49:52.113257 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0a1afb82-8623-4a5f-baa1-e8d67375aa28 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Returning 404 to user: Image not found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:49:52.114341 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0a1afb82-8623-4a5f-baa1-e8d67375aa28 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/images/b4a43f08-bd06-47e4-97a1-45f6a1c9198a" status: 404 len: 62 microversion: 2.1 time: 0.050547 Jul 25 14:49:52.115390 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2275/4807] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:49:52 2022] GET /compute/v2.1/images/b4a43f08-bd06-47e4-97a1-45f6a1c9198a => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 25 14:49:52.116500 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-94668541-bfb6-4078-9a75-baa0af58dae7 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-357066032", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:49:52.127777 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-47912aed-7bcc-4930-a4b3-9cf437e6b0c8 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:52.128712 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-47912aed-7bcc-4930-a4b3-9cf437e6b0c8 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: f20eb7aa-ad15-4041-a06f-06228eebb5d6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:52.179511 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-47912aed-7bcc-4930-a4b3-9cf437e6b0c8 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:52.180348 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-47912aed-7bcc-4930-a4b3-9cf437e6b0c8 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:52.181949 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-47912aed-7bcc-4930-a4b3-9cf437e6b0c8 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:52.182789 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-47912aed-7bcc-4930-a4b3-9cf437e6b0c8 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:52.228036 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-94668541-bfb6-4078-9a75-baa0af58dae7 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] validate_networks() for [('4a1acd2e-4a9b-401c-a5c6-baa2b8f7918b', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:49:52.488170 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-47912aed-7bcc-4930-a4b3-9cf437e6b0c8 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:52.505227 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-47912aed-7bcc-4930-a4b3-9cf437e6b0c8 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6" status: 200 len: 1499 microversion: 2.1 time: 0.383563 Jul 25 14:49:52.520699 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2276/4808] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:52 2022] GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6 => generated 1499 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:53.014136 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-94668541-bfb6-4078-9a75-baa0af58dae7 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:49:53.015644 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-94668541-bfb6-4078-9a75-baa0af58dae7 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:49:53.016963 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-94668541-bfb6-4078-9a75-baa0af58dae7 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:49:53.017771 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-94668541-bfb6-4078-9a75-baa0af58dae7 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:49:53.018373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-94668541-bfb6-4078-9a75-baa0af58dae7 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:49:53.033751 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94668541-bfb6-4078-9a75-baa0af58dae7 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:53.034502 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94668541-bfb6-4078-9a75-baa0af58dae7 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:53.035497 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94668541-bfb6-4078-9a75-baa0af58dae7 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:53.036266 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94668541-bfb6-4078-9a75-baa0af58dae7 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:53.072328 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-94668541-bfb6-4078-9a75-baa0af58dae7 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Getting quotas for project 47e1c3839c9f406db5686216c0e9c83e. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:49:53.081115 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-94668541-bfb6-4078-9a75-baa0af58dae7 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Getting quotas for user 4c72922a47ea4af5a87a537fc463a2af and project 47e1c3839c9f406db5686216c0e9c83e. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:49:53.100322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-94668541-bfb6-4078-9a75-baa0af58dae7 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:49:53.102995 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-94668541-bfb6-4078-9a75-baa0af58dae7 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:49:53.177191 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-94668541-bfb6-4078-9a75-baa0af58dae7 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.064819 Jul 25 14:49:53.182062 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2533/4809] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:49:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 1070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:49:53.193703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fe220357-d9dd-42ed-a3c3-42dd2273e6ac tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:53.194142 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fe220357-d9dd-42ed-a3c3-42dd2273e6ac tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:53.298850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fe220357-d9dd-42ed-a3c3-42dd2273e6ac tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:53.307312 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fe220357-d9dd-42ed-a3c3-42dd2273e6ac tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1213 microversion: 2.1 time: 0.117607 Jul 25 14:49:53.307951 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2277/4810] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:53 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1213 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:53.529471 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ec456fc6-b7fa-4cc3-b092-2c8c6ebc8c53 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:53.530533 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ec456fc6-b7fa-4cc3-b092-2c8c6ebc8c53 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: f20eb7aa-ad15-4041-a06f-06228eebb5d6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:53.539126 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ec456fc6-b7fa-4cc3-b092-2c8c6ebc8c53 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:53.539697 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ec456fc6-b7fa-4cc3-b092-2c8c6ebc8c53 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:53.540613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ec456fc6-b7fa-4cc3-b092-2c8c6ebc8c53 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:53.541164 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ec456fc6-b7fa-4cc3-b092-2c8c6ebc8c53 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:53.761981 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ec456fc6-b7fa-4cc3-b092-2c8c6ebc8c53 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:53.779918 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ec456fc6-b7fa-4cc3-b092-2c8c6ebc8c53 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6" status: 200 len: 1505 microversion: 2.1 time: 0.255136 Jul 25 14:49:53.780583 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2534/4811] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:53 2022] GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6 => generated 1505 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:54.329798 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-87295b77-6211-4802-9609-a037e2253372 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:54.330391 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-87295b77-6211-4802-9609-a037e2253372 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:54.352454 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-87295b77-6211-4802-9609-a037e2253372 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:54.352576 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-87295b77-6211-4802-9609-a037e2253372 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:54.356184 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-87295b77-6211-4802-9609-a037e2253372 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:54.356662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-87295b77-6211-4802-9609-a037e2253372 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:54.485381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-87295b77-6211-4802-9609-a037e2253372 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:54.536640 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-87295b77-6211-4802-9609-a037e2253372 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1265 microversion: 2.1 time: 0.175215 Jul 25 14:49:54.537863 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2278/4812] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:54 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:54.802807 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2d583274-2418-49bc-a3fc-f89b50d96dd3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:54.803449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2d583274-2418-49bc-a3fc-f89b50d96dd3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: f20eb7aa-ad15-4041-a06f-06228eebb5d6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:54.809187 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:49:54.846546 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d583274-2418-49bc-a3fc-f89b50d96dd3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:54.847728 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d583274-2418-49bc-a3fc-f89b50d96dd3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:54.854333 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d583274-2418-49bc-a3fc-f89b50d96dd3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:54.854992 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d583274-2418-49bc-a3fc-f89b50d96dd3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:55.260406 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2d583274-2418-49bc-a3fc-f89b50d96dd3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:55.279854 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2d583274-2418-49bc-a3fc-f89b50d96dd3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6" status: 200 len: 1500 microversion: 2.1 time: 0.478888 Jul 25 14:49:55.281116 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2535/4813] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:54 2022] GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6 => generated 1500 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:55.558839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dcee2c1e-000f-44bc-be7d-5fca0f00793b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:55.559459 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-dcee2c1e-000f-44bc-be7d-5fca0f00793b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:55.575222 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dcee2c1e-000f-44bc-be7d-5fca0f00793b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:55.575934 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dcee2c1e-000f-44bc-be7d-5fca0f00793b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:55.576945 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dcee2c1e-000f-44bc-be7d-5fca0f00793b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:55.577573 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dcee2c1e-000f-44bc-be7d-5fca0f00793b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:55.697988 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-dcee2c1e-000f-44bc-be7d-5fca0f00793b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:55.706837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:49:55.715462 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dcee2c1e-000f-44bc-be7d-5fca0f00793b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1271 microversion: 2.1 time: 0.160594 Jul 25 14:49:55.717461 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2279/4814] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:55 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1271 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:56.306768 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a8afe27a-c129-473b-8847-a2e53b5ee8f5 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:56.307408 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a8afe27a-c129-473b-8847-a2e53b5ee8f5 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: f20eb7aa-ad15-4041-a06f-06228eebb5d6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:56.322652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a8afe27a-c129-473b-8847-a2e53b5ee8f5 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:56.323592 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a8afe27a-c129-473b-8847-a2e53b5ee8f5 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:56.325501 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a8afe27a-c129-473b-8847-a2e53b5ee8f5 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:56.327353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a8afe27a-c129-473b-8847-a2e53b5ee8f5 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:56.734320 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a8afe27a-c129-473b-8847-a2e53b5ee8f5 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:56.742495 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a8afe27a-c129-473b-8847-a2e53b5ee8f5 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6" status: 200 len: 1487 microversion: 2.1 time: 0.439936 Jul 25 14:49:56.743090 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2536/4815] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:56 2022] GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6 => generated 1487 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:56.744772 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-81dd5800-f9fb-47a7-af8a-2820f7c34f07 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:56.745606 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-81dd5800-f9fb-47a7-af8a-2820f7c34f07 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:56.767464 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-81dd5800-f9fb-47a7-af8a-2820f7c34f07 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:56.768772 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1b5384c4-784d-4378-b529-ff6c0c942a93 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:56.769900 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-81dd5800-f9fb-47a7-af8a-2820f7c34f07 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:56.770255 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1b5384c4-784d-4378-b529-ff6c0c942a93 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: f20eb7aa-ad15-4041-a06f-06228eebb5d6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:56.775546 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-81dd5800-f9fb-47a7-af8a-2820f7c34f07 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:56.777165 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-81dd5800-f9fb-47a7-af8a-2820f7c34f07 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:56.788064 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1b5384c4-784d-4378-b529-ff6c0c942a93 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:56.789847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1b5384c4-784d-4378-b529-ff6c0c942a93 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:56.792603 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1b5384c4-784d-4378-b529-ff6c0c942a93 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:56.793297 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1b5384c4-784d-4378-b529-ff6c0c942a93 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:56.870119 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1b5384c4-784d-4378-b529-ff6c0c942a93 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: f20eb7aa-ad15-4041-a06f-06228eebb5d6] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:49:57.072270 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1b5384c4-784d-4378-b529-ff6c0c942a93 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "DELETE /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6" status: 204 len: 0 microversion: 2.1 time: 0.306866 Jul 25 14:49:57.073669 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2537/4816] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:49:56 2022] DELETE /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:49:57.086996 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-26b809ee-b5b6-421c-a1f4-a8274e1866b6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46861c2ee0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:57.124276 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-26b809ee-b5b6-421c-a1f4-a8274e1866b6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] HTTP exception thrown: Image not found. Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-26b809ee-b5b6-421c-a1f4-a8274e1866b6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Request method failure captured: Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/images/b4a43f08-bd06-47e4-97a1-45f6a1c9198a HTTP/1.1 Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qyatJqQrr08arTTYAwijcT05_0DmeHkII2vobDv21BlJcgehu9BcsiwDdPlfYw3H-855q6yyUohvyQZ_GbvjZpgl8ZkXM5qnqIcYBEVVR4ugRK1D8vgncAVZvcnAppeV7EeucTViHERKAZxQ3Ys7ErVRVL4cjio9Yzo-jYWQXPoJf0 Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 87b0942d86634ed0a2f89a0001b5a887 Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ImagesTestJSON-384251757 Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/87b0942d86634ed0a2f89a0001b5a887"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/87b0942d86634ed0a2f89a0001b5a887"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_87b0942d86634ed0a2f89a0001b5a887", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/87b0942d86634ed0a2f89a0001b5a887"}]}] Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ImagesTestJSON-384251757 Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 87b0942d86634ed0a2f89a0001b5a887 Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ImagesTestJSON-384251757 Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ImagesTestJSON-384251757-project Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 6e3de16106b3455b85f90dcd94d39ce0 Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ImagesTestJSON-384251757-project Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: exception: Image not found. Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'b4a43f08-bd06-47e4-97a1-45f6a1c9198a'} Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b4a43f08-bd06-47e4-97a1-45f6a1c9198a to delete Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b4a43f08-bd06-47e4-97a1-45f6a1c9198a could not be found. Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:49:57.126623 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:49:57.132074 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:49:57.132074 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:49:57.132074 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:49:57.132074 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:49:57.132074 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:49:57.132074 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:49:57.132074 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:49:57.132074 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:49:57.132074 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 14:49:57.132074 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 14:49:57.132074 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 14:49:57.132074 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:49:57.132074 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:49:57.132074 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:49:57.132074 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:49:57.132074 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:49:57.132074 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:49:57.132074 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:49:57.132074 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:49:57.132074 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 14:49:57.132074 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:49:57.132074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-26b809ee-b5b6-421c-a1f4-a8274e1866b6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Returning 404 to user: Image not found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:49:57.132074 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-26b809ee-b5b6-421c-a1f4-a8274e1866b6 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "DELETE /compute/v2.1/images/b4a43f08-bd06-47e4-97a1-45f6a1c9198a" status: 404 len: 62 microversion: 2.1 time: 0.046169 Jul 25 14:49:57.132074 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2538/4817] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:57 2022] DELETE /compute/v2.1/images/b4a43f08-bd06-47e4-97a1-45f6a1c9198a => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 25 14:49:57.139014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-202cbe15-9c4f-40e0-aee7-908051eb23e4 req-939b26b9-126e-451c-905b-58b0c8c0a86c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f20eb7aa-ad15-4041-a06f-06228eebb5d6", "name": "network-vif-plugged", "status": "completed", "tag": "62680b70-77eb-4411-b4cb-9bb47d57ac03"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:49:57.199501 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-202cbe15-9c4f-40e0-aee7-908051eb23e4 req-939b26b9-126e-451c-905b-58b0c8c0a86c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:57.200943 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-202cbe15-9c4f-40e0-aee7-908051eb23e4 req-939b26b9-126e-451c-905b-58b0c8c0a86c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:57.216719 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-202cbe15-9c4f-40e0-aee7-908051eb23e4 req-939b26b9-126e-451c-905b-58b0c8c0a86c service nova] Creating event network-vif-plugged:62680b70-77eb-4411-b4cb-9bb47d57ac03 for instance f20eb7aa-ad15-4041-a06f-06228eebb5d6 on n-h1-846435-14 Jul 25 14:49:57.231453 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-202cbe15-9c4f-40e0-aee7-908051eb23e4 req-939b26b9-126e-451c-905b-58b0c8c0a86c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100835 Jul 25 14:49:57.234192 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2539/4818] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:49:57.253777 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-04432fb1-ae1b-4c7c-8b9c-b12160601819 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:57.255246 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-04432fb1-ae1b-4c7c-8b9c-b12160601819 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: f20eb7aa-ad15-4041-a06f-06228eebb5d6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:57.263647 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-04432fb1-ae1b-4c7c-8b9c-b12160601819 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:57.264567 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-04432fb1-ae1b-4c7c-8b9c-b12160601819 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:57.266376 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-04432fb1-ae1b-4c7c-8b9c-b12160601819 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:57.267014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-04432fb1-ae1b-4c7c-8b9c-b12160601819 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:57.308566 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-04432fb1-ae1b-4c7c-8b9c-b12160601819 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: f20eb7aa-ad15-4041-a06f-06228eebb5d6] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:49:57.415660 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.compute.api [None req-04432fb1-ae1b-4c7c-8b9c-b12160601819 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: f20eb7aa-ad15-4041-a06f-06228eebb5d6] Instance is already in deleting state, ignoring this request Jul 25 14:49:57.416559 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-04432fb1-ae1b-4c7c-8b9c-b12160601819 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "DELETE /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6" status: 204 len: 0 microversion: 2.1 time: 0.168779 Jul 25 14:49:57.420306 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2540/4819] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:49:57 2022] DELETE /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:49:57.455613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-be415ede-6869-456c-9bdd-fd0cdf36969b tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:57.460504 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-81dd5800-f9fb-47a7-af8a-2820f7c34f07 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:57.464320 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-be415ede-6869-456c-9bdd-fd0cdf36969b tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: f20eb7aa-ad15-4041-a06f-06228eebb5d6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:57.471492 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-81dd5800-f9fb-47a7-af8a-2820f7c34f07 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1313 microversion: 2.1 time: 0.734056 Jul 25 14:49:57.477196 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2280/4820] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:56 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1313 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:57.482178 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be415ede-6869-456c-9bdd-fd0cdf36969b tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:57.484467 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be415ede-6869-456c-9bdd-fd0cdf36969b tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:57.488839 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be415ede-6869-456c-9bdd-fd0cdf36969b tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:57.490506 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be415ede-6869-456c-9bdd-fd0cdf36969b tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:57.764542 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-be415ede-6869-456c-9bdd-fd0cdf36969b tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:57.775429 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-be415ede-6869-456c-9bdd-fd0cdf36969b tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6" status: 200 len: 1493 microversion: 2.1 time: 0.352765 Jul 25 14:49:57.775429 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2541/4821] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:57 2022] GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6 => generated 1493 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:58.037520 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-e1c324a8-2a38-4edb-baa3-8707c23d7845 req-b7c4afae-0e65-4a01-a07a-0c93d2171101 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c33a1f9f-9b8f-4886-9eda-145b96630df6", "tag": "0a55caf6-5c1c-4e3e-9b76-477f7d164296"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:49:58.060046 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-e1c324a8-2a38-4edb-baa3-8707c23d7845 req-b7c4afae-0e65-4a01-a07a-0c93d2171101 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:58.060786 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-e1c324a8-2a38-4edb-baa3-8707c23d7845 req-b7c4afae-0e65-4a01-a07a-0c93d2171101 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:58.077679 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-e1c324a8-2a38-4edb-baa3-8707c23d7845 req-b7c4afae-0e65-4a01-a07a-0c93d2171101 service nova] Creating event network-changed:0a55caf6-5c1c-4e3e-9b76-477f7d164296 for instance c33a1f9f-9b8f-4886-9eda-145b96630df6 on n-h2-846435-14 Jul 25 14:49:58.084966 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-e1c324a8-2a38-4edb-baa3-8707c23d7845 req-b7c4afae-0e65-4a01-a07a-0c93d2171101 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052124 Jul 25 14:49:58.087078 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2281/4822] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:49:58.498186 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-eae11159-9e7e-4261-ac70-7e1ffe0e7b26 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:58.499431 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-eae11159-9e7e-4261-ac70-7e1ffe0e7b26 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:58.514398 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eae11159-9e7e-4261-ac70-7e1ffe0e7b26 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:58.516632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eae11159-9e7e-4261-ac70-7e1ffe0e7b26 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:58.517716 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eae11159-9e7e-4261-ac70-7e1ffe0e7b26 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:58.518262 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eae11159-9e7e-4261-ac70-7e1ffe0e7b26 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:58.554656 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:49:58.798605 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d8e719fd-4150-479f-8099-926a86bfe731 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:58.802274 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d8e719fd-4150-479f-8099-926a86bfe731 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: f20eb7aa-ad15-4041-a06f-06228eebb5d6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:58.810063 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8e719fd-4150-479f-8099-926a86bfe731 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:58.810690 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8e719fd-4150-479f-8099-926a86bfe731 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:58.811652 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8e719fd-4150-479f-8099-926a86bfe731 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:58.812267 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8e719fd-4150-479f-8099-926a86bfe731 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:58.853865 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-eae11159-9e7e-4261-ac70-7e1ffe0e7b26 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:58.862282 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-eae11159-9e7e-4261-ac70-7e1ffe0e7b26 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1313 microversion: 2.1 time: 0.368735 Jul 25 14:49:58.862897 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2542/4823] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:58 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1313 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:59.026374 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d8e719fd-4150-479f-8099-926a86bfe731 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:49:59.038172 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d8e719fd-4150-479f-8099-926a86bfe731 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6" status: 200 len: 1493 microversion: 2.1 time: 0.244092 Jul 25 14:49:59.060076 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2282/4824] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:58 2022] GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6 => generated 1493 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:49:59.255218 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-3b6f4ff5-24d8-4d43-8376-50f7d8dc9a82 req-a80195e6-30a3-4c61-a6f6-57e65b0c0c3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f20eb7aa-ad15-4041-a06f-06228eebb5d6", "name": "network-vif-unplugged", "status": "completed", "tag": "62680b70-77eb-4411-b4cb-9bb47d57ac03"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:49:59.280434 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-3b6f4ff5-24d8-4d43-8376-50f7d8dc9a82 req-a80195e6-30a3-4c61-a6f6-57e65b0c0c3d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:59.282169 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-3b6f4ff5-24d8-4d43-8376-50f7d8dc9a82 req-a80195e6-30a3-4c61-a6f6-57e65b0c0c3d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:59.298819 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-3b6f4ff5-24d8-4d43-8376-50f7d8dc9a82 req-a80195e6-30a3-4c61-a6f6-57e65b0c0c3d service nova] Creating event network-vif-unplugged:62680b70-77eb-4411-b4cb-9bb47d57ac03 for instance f20eb7aa-ad15-4041-a06f-06228eebb5d6 on n-h1-846435-14 Jul 25 14:49:59.304584 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-3b6f4ff5-24d8-4d43-8376-50f7d8dc9a82 req-a80195e6-30a3-4c61-a6f6-57e65b0c0c3d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056313 Jul 25 14:49:59.305940 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2543/4825] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:49:59.883264 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-020bf7c5-d024-49f4-bad7-816f515d4f53 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:49:59.884250 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-020bf7c5-d024-49f4-bad7-816f515d4f53 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:49:59.902209 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-020bf7c5-d024-49f4-bad7-816f515d4f53 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:59.902721 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-020bf7c5-d024-49f4-bad7-816f515d4f53 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:49:59.903528 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-020bf7c5-d024-49f4-bad7-816f515d4f53 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:49:59.907079 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-020bf7c5-d024-49f4-bad7-816f515d4f53 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:00.068431 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4b18cf4d-063b-498a-847a-924955ae82b3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:00.069135 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4b18cf4d-063b-498a-847a-924955ae82b3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: f20eb7aa-ad15-4041-a06f-06228eebb5d6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:00.100375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4b18cf4d-063b-498a-847a-924955ae82b3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:00.100733 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4b18cf4d-063b-498a-847a-924955ae82b3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:00.106244 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4b18cf4d-063b-498a-847a-924955ae82b3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:00.116764 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4b18cf4d-063b-498a-847a-924955ae82b3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:00.301913 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-020bf7c5-d024-49f4-bad7-816f515d4f53 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:00.314824 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-020bf7c5-d024-49f4-bad7-816f515d4f53 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1313 microversion: 2.1 time: 0.435748 Jul 25 14:50:00.317499 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2283/4826] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:49:59 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1313 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:00.344701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6f269f8f-ff97-44dd-881b-e2861dff594c tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:00.351580 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6f269f8f-ff97-44dd-881b-e2861dff594c tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:00.381820 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6f269f8f-ff97-44dd-881b-e2861dff594c tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:00.398518 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6f269f8f-ff97-44dd-881b-e2861dff594c tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:00.401140 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6f269f8f-ff97-44dd-881b-e2861dff594c tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:00.402828 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6f269f8f-ff97-44dd-881b-e2861dff594c tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:00.425586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4b18cf4d-063b-498a-847a-924955ae82b3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e3de16106b3455b85f90dcd94d39ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b0942d86634ed0a2f89a0001b5a887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:00.441788 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4b18cf4d-063b-498a-847a-924955ae82b3 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6" status: 200 len: 1451 microversion: 2.1 time: 0.383350 Jul 25 14:50:00.442848 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2544/4827] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:00 2022] GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6 => generated 1451 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:00.456353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-25e7c553-edfa-4d39-b322-d104a24913f9 req-d08078f7-c6c3-4d85-b170-f0750ebc759f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f20eb7aa-ad15-4041-a06f-06228eebb5d6", "name": "network-vif-deleted", "tag": "62680b70-77eb-4411-b4cb-9bb47d57ac03"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:50:00.488455 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-25e7c553-edfa-4d39-b322-d104a24913f9 req-d08078f7-c6c3-4d85-b170-f0750ebc759f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:00.489443 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-25e7c553-edfa-4d39-b322-d104a24913f9 req-d08078f7-c6c3-4d85-b170-f0750ebc759f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:00.521601 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-25e7c553-edfa-4d39-b322-d104a24913f9 req-d08078f7-c6c3-4d85-b170-f0750ebc759f service nova] Creating event network-vif-deleted:62680b70-77eb-4411-b4cb-9bb47d57ac03 for instance f20eb7aa-ad15-4041-a06f-06228eebb5d6 on n-h1-846435-14 Jul 25 14:50:00.534767 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-25e7c553-edfa-4d39-b322-d104a24913f9 req-d08078f7-c6c3-4d85-b170-f0750ebc759f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090490 Jul 25 14:50:00.537456 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2545/4828] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:50:00.538429 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6f269f8f-ff97-44dd-881b-e2861dff594c tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.218840 Jul 25 14:50:00.539259 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2284/4829] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:50:00 2022] GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea/os-volume_attachments => generated 371 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:50:00.694728 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7890c25b-830e-4c44-b29b-4380d10f50ef tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:00.695466 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7890c25b-830e-4c44-b29b-4380d10f50ef tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:00.711556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7890c25b-830e-4c44-b29b-4380d10f50ef tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:00.716443 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7890c25b-830e-4c44-b29b-4380d10f50ef tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:00.717508 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7890c25b-830e-4c44-b29b-4380d10f50ef tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:00.718198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7890c25b-830e-4c44-b29b-4380d10f50ef tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:00.808863 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7890c25b-830e-4c44-b29b-4380d10f50ef tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea/os-volume_attachments/5995456e-34af-4403-b898-9343212fc25a" status: 200 len: 194 microversion: 2.1 time: 0.125437 Jul 25 14:50:00.817195 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2546/4830] 10.222.0.88 () {58 vars in 1413 bytes} [Mon Jul 25 14:50:00 2022] GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea/os-volume_attachments/5995456e-34af-4403-b898-9343212fc25a => generated 194 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:50:00.828105 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1dc425fd-df54-4398-aa62-4b88d4740bdc tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:00.828929 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1dc425fd-df54-4398-aa62-4b88d4740bdc tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:00.845581 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1dc425fd-df54-4398-aa62-4b88d4740bdc tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:00.846253 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1dc425fd-df54-4398-aa62-4b88d4740bdc tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:00.847402 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1dc425fd-df54-4398-aa62-4b88d4740bdc tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:00.848094 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1dc425fd-df54-4398-aa62-4b88d4740bdc tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:01.072069 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-1dc425fd-df54-4398-aa62-4b88d4740bdc tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lazy-loading 'services' on Instance uuid 6922ac9f-c929-47b6-84f1-12fb9289d3ea {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:50:01.200398 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1dc425fd-df54-4398-aa62-4b88d4740bdc tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "DELETE /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea/os-volume_attachments/5995456e-34af-4403-b898-9343212fc25a" status: 202 len: 0 microversion: 2.1 time: 0.376240 Jul 25 14:50:01.212712 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2285/4831] 10.222.0.88 () {58 vars in 1416 bytes} [Mon Jul 25 14:50:00 2022] DELETE /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea/os-volume_attachments/5995456e-34af-4403-b898-9343212fc25a => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:50:01.338288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ffd0c014-5630-4f7f-b06a-3e688e646a1e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:01.338937 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ffd0c014-5630-4f7f-b06a-3e688e646a1e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:01.358928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ffd0c014-5630-4f7f-b06a-3e688e646a1e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:01.360248 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ffd0c014-5630-4f7f-b06a-3e688e646a1e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:01.361037 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ffd0c014-5630-4f7f-b06a-3e688e646a1e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:01.361660 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ffd0c014-5630-4f7f-b06a-3e688e646a1e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:01.505363 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cf5d9d6e-da27-4a18-b61e-c03cbb80392e tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:01.506073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cf5d9d6e-da27-4a18-b61e-c03cbb80392e tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: f20eb7aa-ad15-4041-a06f-06228eebb5d6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:01.519265 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=57 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:50:01.540394 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf5d9d6e-da27-4a18-b61e-c03cbb80392e tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:01.541009 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf5d9d6e-da27-4a18-b61e-c03cbb80392e tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:01.541856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf5d9d6e-da27-4a18-b61e-c03cbb80392e tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:01.542371 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf5d9d6e-da27-4a18-b61e-c03cbb80392e tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:01.577050 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-cf5d9d6e-da27-4a18-b61e-c03cbb80392e tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] HTTP exception thrown: Instance f20eb7aa-ad15-4041-a06f-06228eebb5d6 could not be found. Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cf5d9d6e-da27-4a18-b61e-c03cbb80392e tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Request method failure captured: Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6 HTTP/1.1 Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qyatJqQrr08arTTYAwijcT05_0DmeHkII2vobDv21BlJcgehu9BcsiwDdPlfYw3H-855q6yyUohvyQZ_GbvjZpgl8ZkXM5qnqIcYBEVVR4ugRK1D8vgncAVZvcnAppeV7EeucTViHERKAZxQ3Ys7ErVRVL4cjio9Yzo-jYWQXPoJf0 Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 87b0942d86634ed0a2f89a0001b5a887 Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ImagesTestJSON-384251757 Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/87b0942d86634ed0a2f89a0001b5a887"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/87b0942d86634ed0a2f89a0001b5a887"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_87b0942d86634ed0a2f89a0001b5a887", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/87b0942d86634ed0a2f89a0001b5a887"}]}] Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ImagesTestJSON-384251757 Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 87b0942d86634ed0a2f89a0001b5a887 Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ImagesTestJSON-384251757 Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ImagesTestJSON-384251757-project Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 6e3de16106b3455b85f90dcd94d39ce0 Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ImagesTestJSON-384251757-project Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance f20eb7aa-ad15-4041-a06f-06228eebb5d6 could not be found. Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'f20eb7aa-ad15-4041-a06f-06228eebb5d6'} Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f20eb7aa-ad15-4041-a06f-06228eebb5d6 could not be found. Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f20eb7aa-ad15-4041-a06f-06228eebb5d6 could not be found. Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:01.581461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:01.585744 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:01.585744 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:01.585744 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:50:01.585744 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:50:01.585744 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f20eb7aa-ad15-4041-a06f-06228eebb5d6 could not be found. Jul 25 14:50:01.585744 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:01.585744 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cf5d9d6e-da27-4a18-b61e-c03cbb80392e tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Returning 404 to user: Instance f20eb7aa-ad15-4041-a06f-06228eebb5d6 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:50:01.586775 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cf5d9d6e-da27-4a18-b61e-c03cbb80392e tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6" status: 404 len: 111 microversion: 2.1 time: 0.124320 Jul 25 14:50:01.587891 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2286/4832] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:01 2022] GET /compute/v2.1/servers/f20eb7aa-ad15-4041-a06f-06228eebb5d6 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:50:01.595877 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-efa86d2b-8ff3-4e45-b310-549c0735ad64 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f4686c06160>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:01.633429 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-efa86d2b-8ff3-4e45-b310-549c0735ad64 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] HTTP exception thrown: Image not found. Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-efa86d2b-8ff3-4e45-b310-549c0735ad64 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Request method failure captured: Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a HTTP/1.1 Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qyatJqQrr08arTTYAwijcT05_0DmeHkII2vobDv21BlJcgehu9BcsiwDdPlfYw3H-855q6yyUohvyQZ_GbvjZpgl8ZkXM5qnqIcYBEVVR4ugRK1D8vgncAVZvcnAppeV7EeucTViHERKAZxQ3Ys7ErVRVL4cjio9Yzo-jYWQXPoJf0 Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 87b0942d86634ed0a2f89a0001b5a887 Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ImagesTestJSON-384251757 Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/87b0942d86634ed0a2f89a0001b5a887"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/87b0942d86634ed0a2f89a0001b5a887"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_87b0942d86634ed0a2f89a0001b5a887", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/87b0942d86634ed0a2f89a0001b5a887"}]}] Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ImagesTestJSON-384251757 Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 87b0942d86634ed0a2f89a0001b5a887 Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ImagesTestJSON-384251757 Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ImagesTestJSON-384251757-project Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 6e3de16106b3455b85f90dcd94d39ce0 Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ImagesTestJSON-384251757-project Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: exception: Image not found. Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '16e86294-6886-43a2-b219-3044808fec6a'} Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 16e86294-6886-43a2-b219-3044808fec6a to delete Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 16e86294-6886-43a2-b219-3044808fec6a could not be found. Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:01.635265 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:01.640764 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:01.640764 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:01.640764 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:50:01.640764 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:50:01.640764 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:50:01.640764 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:50:01.640764 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:50:01.640764 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:50:01.640764 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 14:50:01.640764 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 14:50:01.640764 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 14:50:01.640764 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:01.640764 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:01.640764 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:01.640764 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:01.640764 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:01.640764 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:01.640764 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:50:01.640764 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:50:01.640764 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 14:50:01.640764 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:01.640764 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-efa86d2b-8ff3-4e45-b310-549c0735ad64 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Returning 404 to user: Image not found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:50:01.640764 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-efa86d2b-8ff3-4e45-b310-549c0735ad64 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "DELETE /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a" status: 404 len: 62 microversion: 2.1 time: 0.044822 Jul 25 14:50:01.640764 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2287/4833] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:01 2022] DELETE /compute/v2.1/images/16e86294-6886-43a2-b219-3044808fec6a => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 25 14:50:01.646268 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b8ec023a-891f-4290-9d82-bddf16671a48 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:01.646771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b8ec023a-891f-4290-9d82-bddf16671a48 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 2a545a10-2062-4c00-97ef-19591b829c0d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:01.669063 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8ec023a-891f-4290-9d82-bddf16671a48 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:01.669513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8ec023a-891f-4290-9d82-bddf16671a48 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:01.674556 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8ec023a-891f-4290-9d82-bddf16671a48 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:01.675314 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8ec023a-891f-4290-9d82-bddf16671a48 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:01.722146 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-b8ec023a-891f-4290-9d82-bddf16671a48 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] HTTP exception thrown: Instance 2a545a10-2062-4c00-97ef-19591b829c0d could not be found. Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b8ec023a-891f-4290-9d82-bddf16671a48 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Request method failure captured: Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d HTTP/1.1 Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qyatJqQrr08arTTYAwijcT05_0DmeHkII2vobDv21BlJcgehu9BcsiwDdPlfYw3H-855q6yyUohvyQZ_GbvjZpgl8ZkXM5qnqIcYBEVVR4ugRK1D8vgncAVZvcnAppeV7EeucTViHERKAZxQ3Ys7ErVRVL4cjio9Yzo-jYWQXPoJf0 Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 87b0942d86634ed0a2f89a0001b5a887 Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ImagesTestJSON-384251757 Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/87b0942d86634ed0a2f89a0001b5a887"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/87b0942d86634ed0a2f89a0001b5a887"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_87b0942d86634ed0a2f89a0001b5a887", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/87b0942d86634ed0a2f89a0001b5a887"}]}] Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ImagesTestJSON-384251757 Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 87b0942d86634ed0a2f89a0001b5a887 Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ImagesTestJSON-384251757 Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ImagesTestJSON-384251757-project Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 6e3de16106b3455b85f90dcd94d39ce0 Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ImagesTestJSON-384251757-project Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 2a545a10-2062-4c00-97ef-19591b829c0d could not be found. Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '2a545a10-2062-4c00-97ef-19591b829c0d'} Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a545a10-2062-4c00-97ef-19591b829c0d could not be found. Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:50:01.726332 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a545a10-2062-4c00-97ef-19591b829c0d could not be found. Jul 25 14:50:01.732137 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:01.732137 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:01.732137 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:01.732137 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:01.732137 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:01.732137 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:01.732137 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:50:01.732137 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:50:01.732137 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a545a10-2062-4c00-97ef-19591b829c0d could not be found. Jul 25 14:50:01.732137 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:01.742295 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b8ec023a-891f-4290-9d82-bddf16671a48 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Returning 404 to user: Instance 2a545a10-2062-4c00-97ef-19591b829c0d could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:50:01.743718 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b8ec023a-891f-4290-9d82-bddf16671a48 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "DELETE /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d" status: 404 len: 111 microversion: 2.1 time: 0.102115 Jul 25 14:50:01.744716 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2288/4834] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:50:01 2022] DELETE /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:50:01.758067 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dd630db0-0a21-4d80-a585-3f3875ed28ca tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:01.761151 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-dd630db0-0a21-4d80-a585-3f3875ed28ca tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 2a545a10-2062-4c00-97ef-19591b829c0d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:01.761620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ffd0c014-5630-4f7f-b06a-3e688e646a1e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:01.772249 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ffd0c014-5630-4f7f-b06a-3e688e646a1e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1313 microversion: 2.1 time: 0.438561 Jul 25 14:50:01.773761 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2547/4835] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:01 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1313 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:01.791401 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dd630db0-0a21-4d80-a585-3f3875ed28ca tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:01.797146 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dd630db0-0a21-4d80-a585-3f3875ed28ca tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:01.798128 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dd630db0-0a21-4d80-a585-3f3875ed28ca tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:01.798578 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dd630db0-0a21-4d80-a585-3f3875ed28ca tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:01.840226 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-dd630db0-0a21-4d80-a585-3f3875ed28ca tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] HTTP exception thrown: Instance 2a545a10-2062-4c00-97ef-19591b829c0d could not be found. Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dd630db0-0a21-4d80-a585-3f3875ed28ca tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Request method failure captured: Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d HTTP/1.1 Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qyatJqQrr08arTTYAwijcT05_0DmeHkII2vobDv21BlJcgehu9BcsiwDdPlfYw3H-855q6yyUohvyQZ_GbvjZpgl8ZkXM5qnqIcYBEVVR4ugRK1D8vgncAVZvcnAppeV7EeucTViHERKAZxQ3Ys7ErVRVL4cjio9Yzo-jYWQXPoJf0 Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 87b0942d86634ed0a2f89a0001b5a887 Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ImagesTestJSON-384251757 Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/87b0942d86634ed0a2f89a0001b5a887"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/87b0942d86634ed0a2f89a0001b5a887"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_87b0942d86634ed0a2f89a0001b5a887", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/87b0942d86634ed0a2f89a0001b5a887"}]}] Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ImagesTestJSON-384251757 Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 87b0942d86634ed0a2f89a0001b5a887 Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ImagesTestJSON-384251757 Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ImagesTestJSON-384251757-project Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 6e3de16106b3455b85f90dcd94d39ce0 Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ImagesTestJSON-384251757-project Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 2a545a10-2062-4c00-97ef-19591b829c0d could not be found. Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '2a545a10-2062-4c00-97ef-19591b829c0d'} Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a545a10-2062-4c00-97ef-19591b829c0d could not be found. Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a545a10-2062-4c00-97ef-19591b829c0d could not be found. Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:01.845441 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:01.849886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:01.849886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:01.849886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:50:01.849886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:50:01.849886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a545a10-2062-4c00-97ef-19591b829c0d could not be found. Jul 25 14:50:01.849886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:01.849886 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dd630db0-0a21-4d80-a585-3f3875ed28ca tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Returning 404 to user: Instance 2a545a10-2062-4c00-97ef-19591b829c0d could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:50:01.849886 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dd630db0-0a21-4d80-a585-3f3875ed28ca tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d" status: 404 len: 111 microversion: 2.1 time: 0.097255 Jul 25 14:50:01.849886 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2289/4836] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:01 2022] GET /compute/v2.1/servers/2a545a10-2062-4c00-97ef-19591b829c0d => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:50:01.859319 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0e42f1bc-7634-4633-892c-c3ca9cdccadf tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46864d5280>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:01.908805 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-0e42f1bc-7634-4633-892c-c3ca9cdccadf tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] HTTP exception thrown: Image not found. Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0e42f1bc-7634-4633-892c-c3ca9cdccadf tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Request method failure captured: Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e HTTP/1.1 Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qyatJqQrr08arTTYAwijcT05_0DmeHkII2vobDv21BlJcgehu9BcsiwDdPlfYw3H-855q6yyUohvyQZ_GbvjZpgl8ZkXM5qnqIcYBEVVR4ugRK1D8vgncAVZvcnAppeV7EeucTViHERKAZxQ3Ys7ErVRVL4cjio9Yzo-jYWQXPoJf0 Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 87b0942d86634ed0a2f89a0001b5a887 Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ImagesTestJSON-384251757 Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/87b0942d86634ed0a2f89a0001b5a887"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/87b0942d86634ed0a2f89a0001b5a887"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_87b0942d86634ed0a2f89a0001b5a887", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/87b0942d86634ed0a2f89a0001b5a887"}]}] Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ImagesTestJSON-384251757 Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 87b0942d86634ed0a2f89a0001b5a887 Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ImagesTestJSON-384251757 Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ImagesTestJSON-384251757-project Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 6e3de16106b3455b85f90dcd94d39ce0 Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ImagesTestJSON-384251757-project Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: exception: Image not found. Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'bcdea0c5-d3e0-4ce2-be82-9e798576860e'} Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image bcdea0c5-d3e0-4ce2-be82-9e798576860e to delete Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bcdea0c5-d3e0-4ce2-be82-9e798576860e could not be found. Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:50:01.910725 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:01.916969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:01.916969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:01.916969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:50:01.916969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:50:01.916969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:50:01.916969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:50:01.916969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:50:01.916969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:50:01.916969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 14:50:01.916969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 14:50:01.916969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 14:50:01.916969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:50:01.916969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:01.916969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:50:01.916969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:01.916969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:01.916969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:01.916969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:50:01.916969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:50:01.916969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 14:50:01.916969 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:50:01.916969 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0e42f1bc-7634-4633-892c-c3ca9cdccadf tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Returning 404 to user: Image not found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:50:01.916969 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0e42f1bc-7634-4633-892c-c3ca9cdccadf tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "DELETE /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e" status: 404 len: 62 microversion: 2.1 time: 0.063797 Jul 25 14:50:01.924343 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2548/4837] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:01 2022] DELETE /compute/v2.1/images/bcdea0c5-d3e0-4ce2-be82-9e798576860e => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:50:01.925843 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cea29fd5-c58b-44e6-b9de-46ff70683a77 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:01.926643 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cea29fd5-c58b-44e6-b9de-46ff70683a77 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:01.950646 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cea29fd5-c58b-44e6-b9de-46ff70683a77 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:01.951169 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cea29fd5-c58b-44e6-b9de-46ff70683a77 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:01.953526 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cea29fd5-c58b-44e6-b9de-46ff70683a77 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:01.953984 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cea29fd5-c58b-44e6-b9de-46ff70683a77 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:01.994414 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-cea29fd5-c58b-44e6-b9de-46ff70683a77 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] HTTP exception thrown: Instance bdf119f5-416e-456f-86d6-8acff67d7c9b could not be found. Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cea29fd5-c58b-44e6-b9de-46ff70683a77 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Request method failure captured: Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b HTTP/1.1 Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qyatJqQrr08arTTYAwijcT05_0DmeHkII2vobDv21BlJcgehu9BcsiwDdPlfYw3H-855q6yyUohvyQZ_GbvjZpgl8ZkXM5qnqIcYBEVVR4ugRK1D8vgncAVZvcnAppeV7EeucTViHERKAZxQ3Ys7ErVRVL4cjio9Yzo-jYWQXPoJf0 Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 87b0942d86634ed0a2f89a0001b5a887 Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ImagesTestJSON-384251757 Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/87b0942d86634ed0a2f89a0001b5a887"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/87b0942d86634ed0a2f89a0001b5a887"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_87b0942d86634ed0a2f89a0001b5a887", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/87b0942d86634ed0a2f89a0001b5a887"}]}] Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ImagesTestJSON-384251757 Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 87b0942d86634ed0a2f89a0001b5a887 Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ImagesTestJSON-384251757 Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ImagesTestJSON-384251757-project Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 6e3de16106b3455b85f90dcd94d39ce0 Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ImagesTestJSON-384251757-project Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance bdf119f5-416e-456f-86d6-8acff67d7c9b could not be found. Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'bdf119f5-416e-456f-86d6-8acff67d7c9b'} Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdf119f5-416e-456f-86d6-8acff67d7c9b could not be found. Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:50:01.996234 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdf119f5-416e-456f-86d6-8acff67d7c9b could not be found. Jul 25 14:50:02.001448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:02.001448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:02.001448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:02.001448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:02.001448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:02.001448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:02.001448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:50:02.001448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:50:02.001448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdf119f5-416e-456f-86d6-8acff67d7c9b could not be found. Jul 25 14:50:02.001448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:02.009504 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cea29fd5-c58b-44e6-b9de-46ff70683a77 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Returning 404 to user: Instance bdf119f5-416e-456f-86d6-8acff67d7c9b could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:50:02.010470 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cea29fd5-c58b-44e6-b9de-46ff70683a77 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "DELETE /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 404 len: 111 microversion: 2.1 time: 0.089162 Jul 25 14:50:02.014175 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2290/4838] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:50:01 2022] DELETE /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:50:02.019547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5565ee72-2245-4f6c-91c3-e8d9afe62699 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:02.020608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5565ee72-2245-4f6c-91c3-e8d9afe62699 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: bdf119f5-416e-456f-86d6-8acff67d7c9b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:02.034084 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5565ee72-2245-4f6c-91c3-e8d9afe62699 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:02.034539 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5565ee72-2245-4f6c-91c3-e8d9afe62699 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:02.035327 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5565ee72-2245-4f6c-91c3-e8d9afe62699 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:02.035753 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5565ee72-2245-4f6c-91c3-e8d9afe62699 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:02.063490 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-5565ee72-2245-4f6c-91c3-e8d9afe62699 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] HTTP exception thrown: Instance bdf119f5-416e-456f-86d6-8acff67d7c9b could not be found. Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5565ee72-2245-4f6c-91c3-e8d9afe62699 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Request method failure captured: Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b HTTP/1.1 Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qyatJqQrr08arTTYAwijcT05_0DmeHkII2vobDv21BlJcgehu9BcsiwDdPlfYw3H-855q6yyUohvyQZ_GbvjZpgl8ZkXM5qnqIcYBEVVR4ugRK1D8vgncAVZvcnAppeV7EeucTViHERKAZxQ3Ys7ErVRVL4cjio9Yzo-jYWQXPoJf0 Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 87b0942d86634ed0a2f89a0001b5a887 Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ImagesTestJSON-384251757 Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/87b0942d86634ed0a2f89a0001b5a887"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/87b0942d86634ed0a2f89a0001b5a887"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_87b0942d86634ed0a2f89a0001b5a887", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/87b0942d86634ed0a2f89a0001b5a887"}]}] Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ImagesTestJSON-384251757 Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 87b0942d86634ed0a2f89a0001b5a887 Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ImagesTestJSON-384251757 Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ImagesTestJSON-384251757-project Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 6e3de16106b3455b85f90dcd94d39ce0 Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ImagesTestJSON-384251757-project Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance bdf119f5-416e-456f-86d6-8acff67d7c9b could not be found. Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'bdf119f5-416e-456f-86d6-8acff67d7c9b'} Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdf119f5-416e-456f-86d6-8acff67d7c9b could not be found. Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdf119f5-416e-456f-86d6-8acff67d7c9b could not be found. Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:50:02.065388 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:02.070389 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:02.070389 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:02.070389 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:50:02.070389 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:50:02.070389 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdf119f5-416e-456f-86d6-8acff67d7c9b could not be found. Jul 25 14:50:02.070389 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:50:02.072588 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5565ee72-2245-4f6c-91c3-e8d9afe62699 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Returning 404 to user: Instance bdf119f5-416e-456f-86d6-8acff67d7c9b could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:50:02.073913 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5565ee72-2245-4f6c-91c3-e8d9afe62699 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b" status: 404 len: 111 microversion: 2.1 time: 0.058482 Jul 25 14:50:02.090139 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-19f2af69-3d3b-43b6-9a59-d3b802ad35f1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '.version_select at 0x7f46878d3af0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:02.096862 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2549/4839] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:02 2022] GET /compute/v2.1/servers/bdf119f5-416e-456f-86d6-8acff67d7c9b => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:50:02.118025 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-19f2af69-3d3b-43b6-9a59-d3b802ad35f1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] HTTP exception thrown: Image not found. Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-19f2af69-3d3b-43b6-9a59-d3b802ad35f1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Request method failure captured: Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e HTTP/1.1 Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qyatJqQrr08arTTYAwijcT05_0DmeHkII2vobDv21BlJcgehu9BcsiwDdPlfYw3H-855q6yyUohvyQZ_GbvjZpgl8ZkXM5qnqIcYBEVVR4ugRK1D8vgncAVZvcnAppeV7EeucTViHERKAZxQ3Ys7ErVRVL4cjio9Yzo-jYWQXPoJf0 Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 87b0942d86634ed0a2f89a0001b5a887 Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ImagesTestJSON-384251757 Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/87b0942d86634ed0a2f89a0001b5a887"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/87b0942d86634ed0a2f89a0001b5a887"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_87b0942d86634ed0a2f89a0001b5a887", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/87b0942d86634ed0a2f89a0001b5a887"}]}] Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ImagesTestJSON-384251757 Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 87b0942d86634ed0a2f89a0001b5a887 Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ImagesTestJSON-384251757 Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ImagesTestJSON-384251757-project Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 6e3de16106b3455b85f90dcd94d39ce0 Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ImagesTestJSON-384251757-project Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: exception: Image not found. Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '6fab5ef0-0bd3-4777-b3e2-65414384b01e'} Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6fab5ef0-0bd3-4777-b3e2-65414384b01e to delete Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6fab5ef0-0bd3-4777-b3e2-65414384b01e could not be found. Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:02.121556 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:02.135967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:02.135967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:02.135967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:50:02.135967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:50:02.135967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:50:02.135967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:50:02.135967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:50:02.135967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:50:02.135967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 14:50:02.135967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 14:50:02.135967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 14:50:02.135967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:02.135967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:02.135967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:02.135967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:02.135967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:02.135967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:02.135967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:50:02.135967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:50:02.135967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 14:50:02.135967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:02.135967 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-19f2af69-3d3b-43b6-9a59-d3b802ad35f1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Returning 404 to user: Image not found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:50:02.135967 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-19f2af69-3d3b-43b6-9a59-d3b802ad35f1 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "DELETE /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e" status: 404 len: 62 microversion: 2.1 time: 0.043965 Jul 25 14:50:02.135967 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2291/4840] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:02 2022] DELETE /compute/v2.1/images/6fab5ef0-0bd3-4777-b3e2-65414384b01e => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:50:02.142670 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dd3e2d71-f62c-4bbe-a106-6c881cd57c60 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:02.143170 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dd3e2d71-f62c-4bbe-a106-6c881cd57c60 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 704739ea-1723-4329-9079-fb1fe74df834] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:02.150710 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd3e2d71-f62c-4bbe-a106-6c881cd57c60 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:02.151161 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd3e2d71-f62c-4bbe-a106-6c881cd57c60 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:02.152000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd3e2d71-f62c-4bbe-a106-6c881cd57c60 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:02.153250 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd3e2d71-f62c-4bbe-a106-6c881cd57c60 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:02.170196 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-dd3e2d71-f62c-4bbe-a106-6c881cd57c60 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] HTTP exception thrown: Instance 704739ea-1723-4329-9079-fb1fe74df834 could not be found. Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dd3e2d71-f62c-4bbe-a106-6c881cd57c60 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Request method failure captured: Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834 HTTP/1.1 Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qyatJqQrr08arTTYAwijcT05_0DmeHkII2vobDv21BlJcgehu9BcsiwDdPlfYw3H-855q6yyUohvyQZ_GbvjZpgl8ZkXM5qnqIcYBEVVR4ugRK1D8vgncAVZvcnAppeV7EeucTViHERKAZxQ3Ys7ErVRVL4cjio9Yzo-jYWQXPoJf0 Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 87b0942d86634ed0a2f89a0001b5a887 Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ImagesTestJSON-384251757 Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/87b0942d86634ed0a2f89a0001b5a887"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/87b0942d86634ed0a2f89a0001b5a887"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_87b0942d86634ed0a2f89a0001b5a887", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/87b0942d86634ed0a2f89a0001b5a887"}]}] Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ImagesTestJSON-384251757 Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 87b0942d86634ed0a2f89a0001b5a887 Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ImagesTestJSON-384251757 Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ImagesTestJSON-384251757-project Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 6e3de16106b3455b85f90dcd94d39ce0 Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ImagesTestJSON-384251757-project Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 704739ea-1723-4329-9079-fb1fe74df834 could not be found. Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '704739ea-1723-4329-9079-fb1fe74df834'} Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 704739ea-1723-4329-9079-fb1fe74df834 could not be found. Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:50:02.171465 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 704739ea-1723-4329-9079-fb1fe74df834 could not be found. Jul 25 14:50:02.176471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:50:02.176471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:02.176471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:50:02.176471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:02.176471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:02.176471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:02.176471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:50:02.176471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:50:02.176471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 704739ea-1723-4329-9079-fb1fe74df834 could not be found. Jul 25 14:50:02.176471 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:50:02.179851 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dd3e2d71-f62c-4bbe-a106-6c881cd57c60 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Returning 404 to user: Instance 704739ea-1723-4329-9079-fb1fe74df834 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:50:02.179851 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dd3e2d71-f62c-4bbe-a106-6c881cd57c60 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "DELETE /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834" status: 404 len: 111 microversion: 2.1 time: 0.042069 Jul 25 14:50:02.183507 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2550/4841] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:50:02 2022] DELETE /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:50:02.189544 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dada0d4f-c8b3-450a-9cf0-00a217c6fb40 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:02.190167 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-dada0d4f-c8b3-450a-9cf0-00a217c6fb40 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] [instance: 704739ea-1723-4329-9079-fb1fe74df834] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:02.201383 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dada0d4f-c8b3-450a-9cf0-00a217c6fb40 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:02.201985 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dada0d4f-c8b3-450a-9cf0-00a217c6fb40 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:02.203297 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dada0d4f-c8b3-450a-9cf0-00a217c6fb40 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:02.203896 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dada0d4f-c8b3-450a-9cf0-00a217c6fb40 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:02.237366 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-dada0d4f-c8b3-450a-9cf0-00a217c6fb40 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] HTTP exception thrown: Instance 704739ea-1723-4329-9079-fb1fe74df834 could not be found. Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dada0d4f-c8b3-450a-9cf0-00a217c6fb40 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Request method failure captured: Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834 HTTP/1.1 Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qyatJqQrr08arTTYAwijcT05_0DmeHkII2vobDv21BlJcgehu9BcsiwDdPlfYw3H-855q6yyUohvyQZ_GbvjZpgl8ZkXM5qnqIcYBEVVR4ugRK1D8vgncAVZvcnAppeV7EeucTViHERKAZxQ3Ys7ErVRVL4cjio9Yzo-jYWQXPoJf0 Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 87b0942d86634ed0a2f89a0001b5a887 Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ImagesTestJSON-384251757 Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/87b0942d86634ed0a2f89a0001b5a887"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/87b0942d86634ed0a2f89a0001b5a887"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_87b0942d86634ed0a2f89a0001b5a887", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/87b0942d86634ed0a2f89a0001b5a887"}]}] Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ImagesTestJSON-384251757 Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 87b0942d86634ed0a2f89a0001b5a887 Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ImagesTestJSON-384251757 Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ImagesTestJSON-384251757-project Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 6e3de16106b3455b85f90dcd94d39ce0 Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ImagesTestJSON-384251757-project Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 704739ea-1723-4329-9079-fb1fe74df834 could not be found. Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '704739ea-1723-4329-9079-fb1fe74df834'} Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 704739ea-1723-4329-9079-fb1fe74df834 could not be found. Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 704739ea-1723-4329-9079-fb1fe74df834 could not be found. Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:02.241007 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:02.245351 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:02.245351 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:02.245351 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:50:02.245351 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:50:02.245351 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 704739ea-1723-4329-9079-fb1fe74df834 could not be found. Jul 25 14:50:02.245351 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:02.245351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dada0d4f-c8b3-450a-9cf0-00a217c6fb40 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] Returning 404 to user: Instance 704739ea-1723-4329-9079-fb1fe74df834 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:50:02.245351 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dada0d4f-c8b3-450a-9cf0-00a217c6fb40 tempest-ImagesTestJSON-384251757 tempest-ImagesTestJSON-384251757-project] 10.222.0.88 "GET /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834" status: 404 len: 111 microversion: 2.1 time: 0.057646 Jul 25 14:50:02.251028 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2292/4842] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:02 2022] GET /compute/v2.1/servers/704739ea-1723-4329-9079-fb1fe74df834 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:50:02.794927 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-08146b04-8637-40bd-bd6b-e6193e6c98c0 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:02.795716 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-08146b04-8637-40bd-bd6b-e6193e6c98c0 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:02.812357 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-08146b04-8637-40bd-bd6b-e6193e6c98c0 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:02.813250 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-08146b04-8637-40bd-bd6b-e6193e6c98c0 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:02.814288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-08146b04-8637-40bd-bd6b-e6193e6c98c0 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:02.815327 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-08146b04-8637-40bd-bd6b-e6193e6c98c0 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:03.047573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:50:03.094465 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:50:03.336822 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-08146b04-8637-40bd-bd6b-e6193e6c98c0 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:03.347191 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-08146b04-8637-40bd-bd6b-e6193e6c98c0 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1313 microversion: 2.1 time: 0.556848 Jul 25 14:50:03.351243 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2551/4843] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:02 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1313 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:04.371051 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fcd86818-f8ed-443c-a28c-d603b9de4231 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:04.371695 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fcd86818-f8ed-443c-a28c-d603b9de4231 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:04.374678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:50:04.389513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fcd86818-f8ed-443c-a28c-d603b9de4231 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:04.389963 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fcd86818-f8ed-443c-a28c-d603b9de4231 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:04.390746 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fcd86818-f8ed-443c-a28c-d603b9de4231 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:04.391178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fcd86818-f8ed-443c-a28c-d603b9de4231 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:05.107310 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fcd86818-f8ed-443c-a28c-d603b9de4231 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:05.116567 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fcd86818-f8ed-443c-a28c-d603b9de4231 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1313 microversion: 2.1 time: 0.749381 Jul 25 14:50:05.123312 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2293/4844] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:04 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1313 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:06.142945 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-15159c5c-aefb-45a9-a6fa-da092253514c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:06.144386 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-15159c5c-aefb-45a9-a6fa-da092253514c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:06.160197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-15159c5c-aefb-45a9-a6fa-da092253514c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:06.164655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-15159c5c-aefb-45a9-a6fa-da092253514c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:06.165905 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-15159c5c-aefb-45a9-a6fa-da092253514c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:06.166989 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-15159c5c-aefb-45a9-a6fa-da092253514c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:06.559375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-15159c5c-aefb-45a9-a6fa-da092253514c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:06.568629 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-15159c5c-aefb-45a9-a6fa-da092253514c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1313 microversion: 2.1 time: 0.429791 Jul 25 14:50:06.573221 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2552/4845] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:06 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1313 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:06.720372 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-41feaa3f-9a4c-4453-b37b-d92d01c42852 req-ec55b17e-380a-44b7-8a99-26f8ac50769a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c33a1f9f-9b8f-4886-9eda-145b96630df6", "name": "network-vif-plugged", "status": "completed", "tag": "0a55caf6-5c1c-4e3e-9b76-477f7d164296"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:50:06.742591 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-41feaa3f-9a4c-4453-b37b-d92d01c42852 req-ec55b17e-380a-44b7-8a99-26f8ac50769a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:06.743196 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-41feaa3f-9a4c-4453-b37b-d92d01c42852 req-ec55b17e-380a-44b7-8a99-26f8ac50769a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:06.769050 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-41feaa3f-9a4c-4453-b37b-d92d01c42852 req-ec55b17e-380a-44b7-8a99-26f8ac50769a service nova] Creating event network-vif-plugged:0a55caf6-5c1c-4e3e-9b76-477f7d164296 for instance c33a1f9f-9b8f-4886-9eda-145b96630df6 on n-h2-846435-14 Jul 25 14:50:06.779924 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-41feaa3f-9a4c-4453-b37b-d92d01c42852 req-ec55b17e-380a-44b7-8a99-26f8ac50769a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065115 Jul 25 14:50:06.781379 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2294/4846] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:50:07.596016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dd87776c-bf8f-4141-85f6-962ef91d16ec tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:07.596016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dd87776c-bf8f-4141-85f6-962ef91d16ec tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:07.607336 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd87776c-bf8f-4141-85f6-962ef91d16ec tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:07.607790 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd87776c-bf8f-4141-85f6-962ef91d16ec tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:07.610978 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd87776c-bf8f-4141-85f6-962ef91d16ec tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:07.611428 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd87776c-bf8f-4141-85f6-962ef91d16ec tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:07.891381 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dd87776c-bf8f-4141-85f6-962ef91d16ec tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:07.903595 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dd87776c-bf8f-4141-85f6-962ef91d16ec tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1313 microversion: 2.1 time: 0.312519 Jul 25 14:50:07.905664 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2553/4847] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:07 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:08.929884 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0c25e809-06ba-41f0-b8b3-8cf5d602c483 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:08.931372 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0c25e809-06ba-41f0-b8b3-8cf5d602c483 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:08.948398 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0c25e809-06ba-41f0-b8b3-8cf5d602c483 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:08.960022 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0c25e809-06ba-41f0-b8b3-8cf5d602c483 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:08.961195 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0c25e809-06ba-41f0-b8b3-8cf5d602c483 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:08.968519 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0c25e809-06ba-41f0-b8b3-8cf5d602c483 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:09.409761 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0c25e809-06ba-41f0-b8b3-8cf5d602c483 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:09.427320 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0c25e809-06ba-41f0-b8b3-8cf5d602c483 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1500 microversion: 2.1 time: 0.502389 Jul 25 14:50:09.442818 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2295/4848] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:08 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1500 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:09.459105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b296ab4a-f3e6-4fd7-96a7-9ab63f41614e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:50:09.468542 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b296ab4a-f3e6-4fd7-96a7-9ab63f41614e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:09.521823 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b296ab4a-f3e6-4fd7-96a7-9ab63f41614e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:09.522538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b296ab4a-f3e6-4fd7-96a7-9ab63f41614e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:09.529332 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b296ab4a-f3e6-4fd7-96a7-9ab63f41614e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:09.535347 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b296ab4a-f3e6-4fd7-96a7-9ab63f41614e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:09.613084 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-b296ab4a-f3e6-4fd7-96a7-9ab63f41614e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lazy-loading 'flavor' on Instance uuid c33a1f9f-9b8f-4886-9eda-145b96630df6 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:50:09.837042 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b296ab4a-f3e6-4fd7-96a7-9ab63f41614e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "POST /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6/action" status: 200 len: 32 microversion: 2.1 time: 0.392341 Jul 25 14:50:09.837721 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2554/4849] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:50:09 2022] POST /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6/action => generated 32 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:50:09.849535 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3871e719-98e4-48b0-8158-0df4ad846def tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:09.849881 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3871e719-98e4-48b0-8158-0df4ad846def tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:09.882766 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3871e719-98e4-48b0-8158-0df4ad846def tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:09.883321 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3871e719-98e4-48b0-8158-0df4ad846def tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:09.884173 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3871e719-98e4-48b0-8158-0df4ad846def tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:09.884626 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3871e719-98e4-48b0-8158-0df4ad846def tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:10.576628 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3871e719-98e4-48b0-8158-0df4ad846def tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:10.596803 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3871e719-98e4-48b0-8158-0df4ad846def tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1506 microversion: 2.1 time: 0.751399 Jul 25 14:50:10.600567 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2296/4850] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:09 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1506 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:11.628361 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b64c57ba-ed4b-450c-bc91-705b00d87055 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:11.629753 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b64c57ba-ed4b-450c-bc91-705b00d87055 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:11.646610 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b64c57ba-ed4b-450c-bc91-705b00d87055 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:11.647330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b64c57ba-ed4b-450c-bc91-705b00d87055 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:11.648864 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b64c57ba-ed4b-450c-bc91-705b00d87055 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:11.649494 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b64c57ba-ed4b-450c-bc91-705b00d87055 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:12.240503 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b64c57ba-ed4b-450c-bc91-705b00d87055 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:12.251477 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b64c57ba-ed4b-450c-bc91-705b00d87055 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1506 microversion: 2.1 time: 0.629450 Jul 25 14:50:12.277379 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2555/4851] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:11 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1506 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:13.278233 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-718d5dae-bdd1-427e-97fd-82a4645debcc tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:13.278943 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-718d5dae-bdd1-427e-97fd-82a4645debcc tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:13.309416 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-718d5dae-bdd1-427e-97fd-82a4645debcc tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:13.310040 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-718d5dae-bdd1-427e-97fd-82a4645debcc tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:13.312827 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-718d5dae-bdd1-427e-97fd-82a4645debcc tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:13.313287 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-718d5dae-bdd1-427e-97fd-82a4645debcc tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:13.593884 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-718d5dae-bdd1-427e-97fd-82a4645debcc tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:13.615445 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-718d5dae-bdd1-427e-97fd-82a4645debcc tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1506 microversion: 2.1 time: 0.334708 Jul 25 14:50:13.630393 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2297/4852] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:13 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1506 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:14.298514 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-da0a3fd0-c7a4-4fda-a9a9-64ad6e1f4e68 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-831051711", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:50:14.377933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-da0a3fd0-c7a4-4fda-a9a9-64ad6e1f4e68 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] validate_networks() for None {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:50:14.641676 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b61b0253-4bc9-49a9-9e36-552a3c0c39bd tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:14.643896 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b61b0253-4bc9-49a9-9e36-552a3c0c39bd tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:14.662163 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b61b0253-4bc9-49a9-9e36-552a3c0c39bd tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:14.665661 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b61b0253-4bc9-49a9-9e36-552a3c0c39bd tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:14.670252 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b61b0253-4bc9-49a9-9e36-552a3c0c39bd tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:14.674158 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b61b0253-4bc9-49a9-9e36-552a3c0c39bd tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:14.896081 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b61b0253-4bc9-49a9-9e36-552a3c0c39bd tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:14.907567 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b61b0253-4bc9-49a9-9e36-552a3c0c39bd tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1506 microversion: 2.1 time: 0.270041 Jul 25 14:50:14.920923 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2298/4853] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:14 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1506 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:50:15.424419 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-46011825-b4a3-4a73-b5e9-a51e80b0b4bf tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:15.425049 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-46011825-b4a3-4a73-b5e9-a51e80b0b4bf tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:15.438060 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46011825-b4a3-4a73-b5e9-a51e80b0b4bf tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:15.439802 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46011825-b4a3-4a73-b5e9-a51e80b0b4bf tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:15.440797 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46011825-b4a3-4a73-b5e9-a51e80b0b4bf tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:15.442488 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46011825-b4a3-4a73-b5e9-a51e80b0b4bf tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:15.532330 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-46011825-b4a3-4a73-b5e9-a51e80b0b4bf tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea/os-volume_attachments/fc5531da-d5f0-4b81-b675-707a26759d24" status: 200 len: 194 microversion: 2.1 time: 0.112449 Jul 25 14:50:15.535523 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2299/4854] 10.222.0.88 () {58 vars in 1413 bytes} [Mon Jul 25 14:50:15 2022] GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea/os-volume_attachments/fc5531da-d5f0-4b81-b675-707a26759d24 => generated 194 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:50:15.550519 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2df898e4-51ef-4d64-8121-32606a98bbb2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:15.551027 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2df898e4-51ef-4d64-8121-32606a98bbb2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:15.572654 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2df898e4-51ef-4d64-8121-32606a98bbb2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:15.575627 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2df898e4-51ef-4d64-8121-32606a98bbb2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:15.580257 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2df898e4-51ef-4d64-8121-32606a98bbb2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:15.580727 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2df898e4-51ef-4d64-8121-32606a98bbb2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:15.656386 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-da0a3fd0-c7a4-4fda-a9a9-64ad6e1f4e68 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:50:15.656862 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-da0a3fd0-c7a4-4fda-a9a9-64ad6e1f4e68 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:50:15.661490 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-da0a3fd0-c7a4-4fda-a9a9-64ad6e1f4e68 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:50:15.662091 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-da0a3fd0-c7a4-4fda-a9a9-64ad6e1f4e68 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:50:15.662908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-da0a3fd0-c7a4-4fda-a9a9-64ad6e1f4e68 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:50:15.684830 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-da0a3fd0-c7a4-4fda-a9a9-64ad6e1f4e68 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:15.687531 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-da0a3fd0-c7a4-4fda-a9a9-64ad6e1f4e68 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:15.688724 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-da0a3fd0-c7a4-4fda-a9a9-64ad6e1f4e68 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:15.690730 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-da0a3fd0-c7a4-4fda-a9a9-64ad6e1f4e68 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:15.757510 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-da0a3fd0-c7a4-4fda-a9a9-64ad6e1f4e68 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Getting quotas for project 572a6bbf7f4541bbba9249cd2ce3a9a8. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:50:15.769512 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-da0a3fd0-c7a4-4fda-a9a9-64ad6e1f4e68 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Getting quotas for user b0d15b8d3057425dbf014609cacef9e6 and project 572a6bbf7f4541bbba9249cd2ce3a9a8. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:50:15.787770 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-2df898e4-51ef-4d64-8121-32606a98bbb2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lazy-loading 'services' on Instance uuid 6922ac9f-c929-47b6-84f1-12fb9289d3ea {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:50:15.791928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-da0a3fd0-c7a4-4fda-a9a9-64ad6e1f4e68 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:50:15.794604 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-da0a3fd0-c7a4-4fda-a9a9-64ad6e1f4e68 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] [instance: b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:50:15.902495 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-da0a3fd0-c7a4-4fda-a9a9-64ad6e1f4e68 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.791502 Jul 25 14:50:15.910531 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2556/4855] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:50:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:50:15.945094 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-63d1dfc8-79bf-49c2-a9d1-e4aad1314e97 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:15.947130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-63d1dfc8-79bf-49c2-a9d1-e4aad1314e97 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] [instance: b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:15.992000 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2df898e4-51ef-4d64-8121-32606a98bbb2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "DELETE /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea/os-volume_attachments/fc5531da-d5f0-4b81-b675-707a26759d24" status: 202 len: 0 microversion: 2.1 time: 0.445257 Jul 25 14:50:15.993390 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2300/4856] 10.222.0.88 () {58 vars in 1416 bytes} [Mon Jul 25 14:50:15 2022] DELETE /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea/os-volume_attachments/fc5531da-d5f0-4b81-b675-707a26759d24 => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:50:16.015776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-42490f42-551c-48dc-ba85-18b10782499c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:16.019095 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-42490f42-551c-48dc-ba85-18b10782499c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:16.070988 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42490f42-551c-48dc-ba85-18b10782499c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:16.075917 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42490f42-551c-48dc-ba85-18b10782499c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:16.084886 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42490f42-551c-48dc-ba85-18b10782499c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:16.085626 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42490f42-551c-48dc-ba85-18b10782499c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:16.204621 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-63d1dfc8-79bf-49c2-a9d1-e4aad1314e97 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d15b8d3057425dbf014609cacef9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a6bbf7f4541bbba9249cd2ce3a9a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:16.221089 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-63d1dfc8-79bf-49c2-a9d1-e4aad1314e97 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736" status: 200 len: 1216 microversion: 2.1 time: 0.305271 Jul 25 14:50:16.224148 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2557/4857] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:15 2022] GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 => generated 1216 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:16.516535 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-42490f42-551c-48dc-ba85-18b10782499c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:16.520412 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:50:16.536522 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-42490f42-551c-48dc-ba85-18b10782499c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1506 microversion: 2.1 time: 0.540528 Jul 25 14:50:16.538291 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2301/4858] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:15 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1506 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:17.259386 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2f82ba64-1454-45c3-b67e-ab002f059ef4 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:17.260173 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2f82ba64-1454-45c3-b67e-ab002f059ef4 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] [instance: b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:17.288231 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2f82ba64-1454-45c3-b67e-ab002f059ef4 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:17.300672 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2f82ba64-1454-45c3-b67e-ab002f059ef4 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:17.301789 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2f82ba64-1454-45c3-b67e-ab002f059ef4 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:17.307344 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2f82ba64-1454-45c3-b67e-ab002f059ef4 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:17.477294 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2f82ba64-1454-45c3-b67e-ab002f059ef4 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d15b8d3057425dbf014609cacef9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a6bbf7f4541bbba9249cd2ce3a9a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:17.496863 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2f82ba64-1454-45c3-b67e-ab002f059ef4 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736" status: 200 len: 1212 microversion: 2.1 time: 0.253371 Jul 25 14:50:17.501620 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2558/4859] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:17 2022] GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 => generated 1212 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:17.560559 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cee09f3a-3454-42ad-a062-cad6d98cc626 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:17.561270 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cee09f3a-3454-42ad-a062-cad6d98cc626 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:17.573911 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cee09f3a-3454-42ad-a062-cad6d98cc626 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:17.577086 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cee09f3a-3454-42ad-a062-cad6d98cc626 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:17.577931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cee09f3a-3454-42ad-a062-cad6d98cc626 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:17.578382 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cee09f3a-3454-42ad-a062-cad6d98cc626 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:17.591884 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b77ef0f9-852c-4d98-8d0d-167939f3fa4f tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Action: 'create', calling method: .version_select at 0x7f46989e5dc0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1051387249", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD70KqGDGXszjIa02wSET0a3DslgrNJfHZfJwqhyUI+uZ/VqsyRSAVuWvsPdkRTq/Xcxi7Bd4VLJYQf3f27cimDZW0KUwAwYUFowB6CBRDaRUSRLjxMO5h5x/UT2B86dUQ=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:50:17.625652 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-b77ef0f9-852c-4d98-8d0d-167939f3fa4f tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Getting quotas for project c65097f882d949469009707d1eff8506. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:50:17.641467 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-b77ef0f9-852c-4d98-8d0d-167939f3fa4f tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Getting quotas for user 91784e3a38a34d3ca64a06b2617a0154 and project c65097f882d949469009707d1eff8506. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:50:17.700469 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b77ef0f9-852c-4d98-8d0d-167939f3fa4f tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.368437 Jul 25 14:50:17.701984 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2302/4860] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:50:17 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:50:17.773347 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cee09f3a-3454-42ad-a062-cad6d98cc626 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:17.783567 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cee09f3a-3454-42ad-a062-cad6d98cc626 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1506 microversion: 2.1 time: 0.228056 Jul 25 14:50:17.784910 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2559/4861] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:17 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1506 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:50:18.520116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d9020472-5c39-493a-9dbb-3d170ccca79d tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:18.523815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d9020472-5c39-493a-9dbb-3d170ccca79d tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] [instance: b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:18.539179 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d9020472-5c39-493a-9dbb-3d170ccca79d tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:18.539774 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d9020472-5c39-493a-9dbb-3d170ccca79d tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:18.543334 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d9020472-5c39-493a-9dbb-3d170ccca79d tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:18.547359 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d9020472-5c39-493a-9dbb-3d170ccca79d tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:18.829498 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-71274e41-a1b3-4346-99f7-f7e9251544e2 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:18.830148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-71274e41-a1b3-4346-99f7-f7e9251544e2 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:18.876139 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d9020472-5c39-493a-9dbb-3d170ccca79d tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d15b8d3057425dbf014609cacef9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a6bbf7f4541bbba9249cd2ce3a9a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:18.885873 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71274e41-a1b3-4346-99f7-f7e9251544e2 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:18.888566 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71274e41-a1b3-4346-99f7-f7e9251544e2 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:18.893208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71274e41-a1b3-4346-99f7-f7e9251544e2 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:18.893695 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71274e41-a1b3-4346-99f7-f7e9251544e2 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:18.899577 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d9020472-5c39-493a-9dbb-3d170ccca79d tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736" status: 200 len: 1274 microversion: 2.1 time: 0.384002 Jul 25 14:50:18.927116 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2303/4862] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:18 2022] GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 => generated 1274 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:19.200377 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-71274e41-a1b3-4346-99f7-f7e9251544e2 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:19.218930 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-71274e41-a1b3-4346-99f7-f7e9251544e2 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1506 microversion: 2.1 time: 0.410261 Jul 25 14:50:19.220117 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2560/4863] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:18 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1506 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:19.923364 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-77632a15-3b98-4e03-abc2-431020bbf904 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:19.924047 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-77632a15-3b98-4e03-abc2-431020bbf904 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] [instance: b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:19.943575 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77632a15-3b98-4e03-abc2-431020bbf904 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:19.944002 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77632a15-3b98-4e03-abc2-431020bbf904 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:19.944851 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77632a15-3b98-4e03-abc2-431020bbf904 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:19.945293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77632a15-3b98-4e03-abc2-431020bbf904 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:20.243792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8b2fe556-42d8-44b7-b6f9-6a43fa5b7577 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:20.244637 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8b2fe556-42d8-44b7-b6f9-6a43fa5b7577 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:20.260573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8b2fe556-42d8-44b7-b6f9-6a43fa5b7577 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:20.261020 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8b2fe556-42d8-44b7-b6f9-6a43fa5b7577 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:20.265390 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8b2fe556-42d8-44b7-b6f9-6a43fa5b7577 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:20.275564 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8b2fe556-42d8-44b7-b6f9-6a43fa5b7577 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:20.415194 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-77632a15-3b98-4e03-abc2-431020bbf904 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d15b8d3057425dbf014609cacef9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a6bbf7f4541bbba9249cd2ce3a9a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:20.429669 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-77632a15-3b98-4e03-abc2-431020bbf904 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736" status: 200 len: 1316 microversion: 2.1 time: 0.510448 Jul 25 14:50:20.430628 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2304/4864] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:19 2022] GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 => generated 1316 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:20.443331 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c555e0f5-4a33-4362-9232-d75552dfabd1 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1179473694", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1051387249", "security_groups": [{"name": "tempest-secgroup-smoke-1161793061"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "5baede94-19bf-4c2b-b125-ebdf01255d70"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:50:20.672994 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8b2fe556-42d8-44b7-b6f9-6a43fa5b7577 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:20.681602 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8b2fe556-42d8-44b7-b6f9-6a43fa5b7577 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1506 microversion: 2.1 time: 0.442028 Jul 25 14:50:20.682315 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2561/4865] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:20 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1506 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:20.924350 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-c555e0f5-4a33-4362-9232-d75552dfabd1 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] validate_networks() for [('5baede94-19bf-4c2b-b125-ebdf01255d70', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:50:21.451349 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6dc8f1c6-5da0-448b-815d-9d0d52a04092 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:21.451714 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6dc8f1c6-5da0-448b-815d-9d0d52a04092 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] [instance: b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:21.470289 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6dc8f1c6-5da0-448b-815d-9d0d52a04092 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:21.470763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6dc8f1c6-5da0-448b-815d-9d0d52a04092 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:21.473325 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6dc8f1c6-5da0-448b-815d-9d0d52a04092 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:21.473325 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6dc8f1c6-5da0-448b-815d-9d0d52a04092 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:21.517280 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:50:21.861836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6dc8f1c6-5da0-448b-815d-9d0d52a04092 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d15b8d3057425dbf014609cacef9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a6bbf7f4541bbba9249cd2ce3a9a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:21.919901 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6dc8f1c6-5da0-448b-815d-9d0d52a04092 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736" status: 200 len: 1316 microversion: 2.1 time: 0.471350 Jul 25 14:50:21.920536 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-c555e0f5-4a33-4362-9232-d75552dfabd1 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Getting quotas for project c65097f882d949469009707d1eff8506. Resources: dict_keys(['metadata_items']) {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:50:21.924368 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2562/4866] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:21 2022] GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 => generated 1316 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:50:21.940684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d32b6ae3-9224-4b68-8735-e10afab37640 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:21.941314 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d32b6ae3-9224-4b68-8735-e10afab37640 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:21.949682 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-c555e0f5-4a33-4362-9232-d75552dfabd1 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Getting quotas for user 91784e3a38a34d3ca64a06b2617a0154 and project c65097f882d949469009707d1eff8506. Resources: dict_keys(['metadata_items']) {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:50:21.961964 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d32b6ae3-9224-4b68-8735-e10afab37640 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:21.963158 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d32b6ae3-9224-4b68-8735-e10afab37640 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:21.965093 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d32b6ae3-9224-4b68-8735-e10afab37640 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:21.968303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d32b6ae3-9224-4b68-8735-e10afab37640 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:21.988295 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-c555e0f5-4a33-4362-9232-d75552dfabd1 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:50:21.990758 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-c555e0f5-4a33-4362-9232-d75552dfabd1 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:50:21.991314 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-c555e0f5-4a33-4362-9232-d75552dfabd1 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:50:21.991857 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-c555e0f5-4a33-4362-9232-d75552dfabd1 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:50:21.992704 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-c555e0f5-4a33-4362-9232-d75552dfabd1 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:50:22.018004 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c555e0f5-4a33-4362-9232-d75552dfabd1 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:22.018794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c555e0f5-4a33-4362-9232-d75552dfabd1 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:22.028872 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c555e0f5-4a33-4362-9232-d75552dfabd1 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:22.029508 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c555e0f5-4a33-4362-9232-d75552dfabd1 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:22.104164 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-c555e0f5-4a33-4362-9232-d75552dfabd1 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Getting quotas for project c65097f882d949469009707d1eff8506. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:50:22.137787 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-c555e0f5-4a33-4362-9232-d75552dfabd1 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Getting quotas for user 91784e3a38a34d3ca64a06b2617a0154 and project c65097f882d949469009707d1eff8506. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:50:22.170831 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c555e0f5-4a33-4362-9232-d75552dfabd1 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:50:22.174415 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c555e0f5-4a33-4362-9232-d75552dfabd1 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] [instance: 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:50:22.290470 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c555e0f5-4a33-4362-9232-d75552dfabd1 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.858366 Jul 25 14:50:22.291453 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2305/4867] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:50:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:50:22.306071 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-7ea9e792-e8ba-42d9-b14a-e1867c7311d0 req-b747cf76-fdee-4bf4-a3cb-0732af7a264d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736", "tag": "35c26f0c-c295-4c03-b37c-60c401d0d30e"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:50:22.343611 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-7ea9e792-e8ba-42d9-b14a-e1867c7311d0 req-b747cf76-fdee-4bf4-a3cb-0732af7a264d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:22.344269 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-7ea9e792-e8ba-42d9-b14a-e1867c7311d0 req-b747cf76-fdee-4bf4-a3cb-0732af7a264d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:22.370868 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-7ea9e792-e8ba-42d9-b14a-e1867c7311d0 req-b747cf76-fdee-4bf4-a3cb-0732af7a264d service nova] Creating event network-changed:35c26f0c-c295-4c03-b37c-60c401d0d30e for instance b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 on n-h2-846435-14 Jul 25 14:50:22.383989 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-7ea9e792-e8ba-42d9-b14a-e1867c7311d0 req-b747cf76-fdee-4bf4-a3cb-0732af7a264d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087179 Jul 25 14:50:22.384935 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2306/4868] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:50:22.400622 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d32b6ae3-9224-4b68-8735-e10afab37640 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:22.402263 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c756356d-dd5a-4013-a0ca-403449447a03 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:22.403234 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c756356d-dd5a-4013-a0ca-403449447a03 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] [instance: 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:22.418951 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d32b6ae3-9224-4b68-8735-e10afab37640 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1506 microversion: 2.1 time: 0.493453 Jul 25 14:50:22.419882 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2563/4869] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:21 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1506 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:22.566639 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c756356d-dd5a-4013-a0ca-403449447a03 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91784e3a38a34d3ca64a06b2617a0154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65097f882d949469009707d1eff8506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:22.575953 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c756356d-dd5a-4013-a0ca-403449447a03 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] 10.222.0.88 "GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e" status: 200 len: 1303 microversion: 2.1 time: 0.189408 Jul 25 14:50:22.578800 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2307/4870] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:22 2022] GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e => generated 1303 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:22.944001 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5d3a9220-2726-489a-ba06-d0703d4eb40c tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:22.945605 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5d3a9220-2726-489a-ba06-d0703d4eb40c tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] [instance: b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:22.961707 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d3a9220-2726-489a-ba06-d0703d4eb40c tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:22.964818 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d3a9220-2726-489a-ba06-d0703d4eb40c tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:22.965879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d3a9220-2726-489a-ba06-d0703d4eb40c tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:22.967048 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d3a9220-2726-489a-ba06-d0703d4eb40c tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:23.236676 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5d3a9220-2726-489a-ba06-d0703d4eb40c tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d15b8d3057425dbf014609cacef9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a6bbf7f4541bbba9249cd2ce3a9a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:23.248215 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5d3a9220-2726-489a-ba06-d0703d4eb40c tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736" status: 200 len: 1316 microversion: 2.1 time: 0.306432 Jul 25 14:50:23.249586 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2564/4871] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:22 2022] GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 => generated 1316 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:23.444189 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e0f894ef-49b0-47ea-af58-8c4c4363a4d6 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:23.445481 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e0f894ef-49b0-47ea-af58-8c4c4363a4d6 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:23.463256 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e0f894ef-49b0-47ea-af58-8c4c4363a4d6 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:23.463961 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e0f894ef-49b0-47ea-af58-8c4c4363a4d6 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:23.464945 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e0f894ef-49b0-47ea-af58-8c4c4363a4d6 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:23.465498 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e0f894ef-49b0-47ea-af58-8c4c4363a4d6 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:23.603960 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-11c7be44-01b3-4d78-9ea2-47523cc94279 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:23.604722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-11c7be44-01b3-4d78-9ea2-47523cc94279 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] [instance: 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:23.612922 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11c7be44-01b3-4d78-9ea2-47523cc94279 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:23.613371 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11c7be44-01b3-4d78-9ea2-47523cc94279 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:23.614356 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11c7be44-01b3-4d78-9ea2-47523cc94279 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:23.614799 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11c7be44-01b3-4d78-9ea2-47523cc94279 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:24.647537 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-11c7be44-01b3-4d78-9ea2-47523cc94279 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91784e3a38a34d3ca64a06b2617a0154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65097f882d949469009707d1eff8506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:24.665533 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-11c7be44-01b3-4d78-9ea2-47523cc94279 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] 10.222.0.88 "GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e" status: 200 len: 1299 microversion: 2.1 time: 1.070381 Jul 25 14:50:24.687554 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2565/4872] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:23 2022] GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e => generated 1299 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:24.700215 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9173a1c9-e13e-4178-91e5-68889b9ae72f tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:24.700868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9173a1c9-e13e-4178-91e5-68889b9ae72f tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] [instance: b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:24.719678 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9173a1c9-e13e-4178-91e5-68889b9ae72f tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:24.721121 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9173a1c9-e13e-4178-91e5-68889b9ae72f tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:24.722153 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9173a1c9-e13e-4178-91e5-68889b9ae72f tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:24.722751 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9173a1c9-e13e-4178-91e5-68889b9ae72f tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:24.825820 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e0f894ef-49b0-47ea-af58-8c4c4363a4d6 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:24.841607 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e0f894ef-49b0-47ea-af58-8c4c4363a4d6 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1506 microversion: 2.1 time: 1.404774 Jul 25 14:50:24.842251 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2308/4873] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:23 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1506 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:24.993718 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9173a1c9-e13e-4178-91e5-68889b9ae72f tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d15b8d3057425dbf014609cacef9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a6bbf7f4541bbba9249cd2ce3a9a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:25.003206 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9173a1c9-e13e-4178-91e5-68889b9ae72f tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736" status: 200 len: 1316 microversion: 2.1 time: 0.313931 Jul 25 14:50:25.003936 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2566/4874] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:24 2022] GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 => generated 1316 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:25.687373 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9f10c748-f8f6-4f15-a0b3-609fab33987b tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:25.688756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9f10c748-f8f6-4f15-a0b3-609fab33987b tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] [instance: 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:25.697965 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f10c748-f8f6-4f15-a0b3-609fab33987b tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:25.698746 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f10c748-f8f6-4f15-a0b3-609fab33987b tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:25.699890 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f10c748-f8f6-4f15-a0b3-609fab33987b tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:25.700589 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f10c748-f8f6-4f15-a0b3-609fab33987b tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:25.827776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9f10c748-f8f6-4f15-a0b3-609fab33987b tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91784e3a38a34d3ca64a06b2617a0154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65097f882d949469009707d1eff8506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:25.842933 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9f10c748-f8f6-4f15-a0b3-609fab33987b tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] 10.222.0.88 "GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e" status: 200 len: 1361 microversion: 2.1 time: 0.159531 Jul 25 14:50:25.857161 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2309/4875] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:25 2022] GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:25.876616 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-52e188f1-0f52-424c-81be-fd9e41d11c7e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:25.877899 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-52e188f1-0f52-424c-81be-fd9e41d11c7e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:25.881590 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:50:25.889354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:50:25.905030 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52e188f1-0f52-424c-81be-fd9e41d11c7e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:25.906573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52e188f1-0f52-424c-81be-fd9e41d11c7e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:25.909882 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52e188f1-0f52-424c-81be-fd9e41d11c7e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:25.910511 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52e188f1-0f52-424c-81be-fd9e41d11c7e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:26.024640 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b1484763-a66f-48ca-a7bd-928328f3cb9f tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:26.042056 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b1484763-a66f-48ca-a7bd-928328f3cb9f tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] [instance: b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:26.069959 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b1484763-a66f-48ca-a7bd-928328f3cb9f tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:26.070898 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b1484763-a66f-48ca-a7bd-928328f3cb9f tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:26.071898 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b1484763-a66f-48ca-a7bd-928328f3cb9f tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:26.072798 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b1484763-a66f-48ca-a7bd-928328f3cb9f tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:26.211794 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=8 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:50:26.262815 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-52e188f1-0f52-424c-81be-fd9e41d11c7e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:26.275513 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-52e188f1-0f52-424c-81be-fd9e41d11c7e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1506 microversion: 2.1 time: 0.411771 Jul 25 14:50:26.280150 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2567/4876] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:25 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1506 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:26.712401 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b1484763-a66f-48ca-a7bd-928328f3cb9f tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d15b8d3057425dbf014609cacef9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a6bbf7f4541bbba9249cd2ce3a9a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:26.722621 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b1484763-a66f-48ca-a7bd-928328f3cb9f tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736" status: 200 len: 1316 microversion: 2.1 time: 0.702723 Jul 25 14:50:26.736162 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2310/4877] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:26 2022] GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 => generated 1316 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:26.866472 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b0abce5c-b86d-4bd1-bbcb-aff199e8c137 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:26.867086 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b0abce5c-b86d-4bd1-bbcb-aff199e8c137 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] [instance: 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:26.884282 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0abce5c-b86d-4bd1-bbcb-aff199e8c137 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:26.886901 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0abce5c-b86d-4bd1-bbcb-aff199e8c137 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:26.896608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0abce5c-b86d-4bd1-bbcb-aff199e8c137 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:26.898055 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0abce5c-b86d-4bd1-bbcb-aff199e8c137 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:26.904465 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-de8d6d1d-de8d-46b8-ac1a-d84b23f3c5cf tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:26.907316 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-de8d6d1d-de8d-46b8-ac1a-d84b23f3c5cf tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:26.918874 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-de8d6d1d-de8d-46b8-ac1a-d84b23f3c5cf tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:26.919330 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-de8d6d1d-de8d-46b8-ac1a-d84b23f3c5cf tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:26.926334 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-de8d6d1d-de8d-46b8-ac1a-d84b23f3c5cf tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:26.926966 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-de8d6d1d-de8d-46b8-ac1a-d84b23f3c5cf tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:27.016560 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-de8d6d1d-de8d-46b8-ac1a-d84b23f3c5cf tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.118376 Jul 25 14:50:27.017358 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2311/4878] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:50:26 2022] GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea/os-volume_attachments => generated 25 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:50:27.112734 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b0abce5c-b86d-4bd1-bbcb-aff199e8c137 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91784e3a38a34d3ca64a06b2617a0154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65097f882d949469009707d1eff8506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:27.124314 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b0abce5c-b86d-4bd1-bbcb-aff199e8c137 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] 10.222.0.88 "GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e" status: 200 len: 1429 microversion: 2.1 time: 0.262140 Jul 25 14:50:27.125723 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2568/4879] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:26 2022] GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e => generated 1429 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:27.191102 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-09d79255-1a66-4b38-83e6-bc66540aa63f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:27.193472 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-09d79255-1a66-4b38-83e6-bc66540aa63f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:27.203088 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-09d79255-1a66-4b38-83e6-bc66540aa63f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:27.203542 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-09d79255-1a66-4b38-83e6-bc66540aa63f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:27.204598 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-09d79255-1a66-4b38-83e6-bc66540aa63f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:27.205184 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-09d79255-1a66-4b38-83e6-bc66540aa63f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:27.241738 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-09d79255-1a66-4b38-83e6-bc66540aa63f tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054925 Jul 25 14:50:27.253761 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2312/4880] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:50:27 2022] GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:50:27.302040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8cbc404b-3ceb-4d20-acee-02dc13f9781c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:27.302933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8cbc404b-3ceb-4d20-acee-02dc13f9781c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:27.315842 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8cbc404b-3ceb-4d20-acee-02dc13f9781c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:27.324510 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8cbc404b-3ceb-4d20-acee-02dc13f9781c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:27.325608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8cbc404b-3ceb-4d20-acee-02dc13f9781c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:27.327492 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8cbc404b-3ceb-4d20-acee-02dc13f9781c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:27.392940 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-692e1a62-bde0-4dfa-8447-5991a3143aa4 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:27.393718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-692e1a62-bde0-4dfa-8447-5991a3143aa4 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:27.401168 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-692e1a62-bde0-4dfa-8447-5991a3143aa4 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:27.401907 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-692e1a62-bde0-4dfa-8447-5991a3143aa4 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:27.402854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-692e1a62-bde0-4dfa-8447-5991a3143aa4 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:27.403580 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-692e1a62-bde0-4dfa-8447-5991a3143aa4 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:27.440468 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-692e1a62-bde0-4dfa-8447-5991a3143aa4 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:50:27.597476 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8cbc404b-3ceb-4d20-acee-02dc13f9781c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:27.637489 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-692e1a62-bde0-4dfa-8447-5991a3143aa4 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "DELETE /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea" status: 204 len: 0 microversion: 2.1 time: 0.247930 Jul 25 14:50:27.637643 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8cbc404b-3ceb-4d20-acee-02dc13f9781c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1506 microversion: 2.1 time: 0.336735 Jul 25 14:50:27.639210 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2569/4882] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:27 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1506 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:27.642135 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2313/4882] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:50:27 2022] DELETE /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 14:50:27.660565 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2406c0f3-ff29-42e0-be67-f55102c9d1fe tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:27.661341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2406c0f3-ff29-42e0-be67-f55102c9d1fe tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:27.665560 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-1996c06c-1acd-4ad6-a085-8550134d1e28 req-884368c0-8c23-42ee-a3c0-c1774b77fdfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e", "tag": "d3d30104-e768-41d5-993f-98045266d43b"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:50:27.673872 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2406c0f3-ff29-42e0-be67-f55102c9d1fe tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:27.678195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2406c0f3-ff29-42e0-be67-f55102c9d1fe tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:27.679351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2406c0f3-ff29-42e0-be67-f55102c9d1fe tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:27.680329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2406c0f3-ff29-42e0-be67-f55102c9d1fe tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:27.713708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-1996c06c-1acd-4ad6-a085-8550134d1e28 req-884368c0-8c23-42ee-a3c0-c1774b77fdfa service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:27.714642 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-1996c06c-1acd-4ad6-a085-8550134d1e28 req-884368c0-8c23-42ee-a3c0-c1774b77fdfa service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:27.751155 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-1996c06c-1acd-4ad6-a085-8550134d1e28 req-884368c0-8c23-42ee-a3c0-c1774b77fdfa service nova] Creating event network-changed:d3d30104-e768-41d5-993f-98045266d43b for instance 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e on n-h1-846435-14 Jul 25 14:50:27.758769 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-1996c06c-1acd-4ad6-a085-8550134d1e28 req-884368c0-8c23-42ee-a3c0-c1774b77fdfa service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103898 Jul 25 14:50:27.759814 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2314/4883] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:50:27.767494 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-306237b0-e808-4803-8294-d0af74fb5dfa tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:27.768630 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-306237b0-e808-4803-8294-d0af74fb5dfa tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] [instance: b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:27.778969 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-306237b0-e808-4803-8294-d0af74fb5dfa tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:27.779899 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-306237b0-e808-4803-8294-d0af74fb5dfa tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:27.781353 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-306237b0-e808-4803-8294-d0af74fb5dfa tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:27.782018 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-306237b0-e808-4803-8294-d0af74fb5dfa tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:27.940157 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2406c0f3-ff29-42e0-be67-f55102c9d1fe tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:27.949767 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2406c0f3-ff29-42e0-be67-f55102c9d1fe tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea" status: 200 len: 1672 microversion: 2.1 time: 0.294592 Jul 25 14:50:27.950722 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2570/4884] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:27 2022] GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea => generated 1672 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:27.999549 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-306237b0-e808-4803-8294-d0af74fb5dfa tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d15b8d3057425dbf014609cacef9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a6bbf7f4541bbba9249cd2ce3a9a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:28.007624 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-306237b0-e808-4803-8294-d0af74fb5dfa tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736" status: 200 len: 1316 microversion: 2.1 time: 0.245762 Jul 25 14:50:28.008463 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2315/4885] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:27 2022] GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 => generated 1316 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:28.148210 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-58185171-bb08-4568-8aed-a47d95169779 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:28.149222 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-58185171-bb08-4568-8aed-a47d95169779 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] [instance: 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:28.157691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-58185171-bb08-4568-8aed-a47d95169779 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:28.157691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-58185171-bb08-4568-8aed-a47d95169779 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:28.158631 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-58185171-bb08-4568-8aed-a47d95169779 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:28.159354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-58185171-bb08-4568-8aed-a47d95169779 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:28.332328 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-58185171-bb08-4568-8aed-a47d95169779 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91784e3a38a34d3ca64a06b2617a0154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65097f882d949469009707d1eff8506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:28.343548 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-58185171-bb08-4568-8aed-a47d95169779 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] 10.222.0.88 "GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e" status: 200 len: 1429 microversion: 2.1 time: 0.199695 Jul 25 14:50:28.357411 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2571/4886] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:28 2022] GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e => generated 1429 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:28.660257 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-30a7d675-9792-4439-8131-950f160c1f5b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:28.660899 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-30a7d675-9792-4439-8131-950f160c1f5b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:28.667684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-30a7d675-9792-4439-8131-950f160c1f5b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:28.668170 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-30a7d675-9792-4439-8131-950f160c1f5b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:28.668948 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-30a7d675-9792-4439-8131-950f160c1f5b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:28.669390 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-30a7d675-9792-4439-8131-950f160c1f5b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:28.841453 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-30a7d675-9792-4439-8131-950f160c1f5b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:28.850453 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-30a7d675-9792-4439-8131-950f160c1f5b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1506 microversion: 2.1 time: 0.194186 Jul 25 14:50:28.851775 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2316/4887] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:28 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1506 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:28.980500 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-04606b21-4289-45c1-b51a-10fc5221c6a2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:28.983638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-04606b21-4289-45c1-b51a-10fc5221c6a2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:28.994361 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-04606b21-4289-45c1-b51a-10fc5221c6a2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:28.996644 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-04606b21-4289-45c1-b51a-10fc5221c6a2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:28.997918 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-04606b21-4289-45c1-b51a-10fc5221c6a2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:28.998660 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-04606b21-4289-45c1-b51a-10fc5221c6a2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:29.033912 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-03f108c8-17f4-43da-8c01-276ad47fb805 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:29.035116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-03f108c8-17f4-43da-8c01-276ad47fb805 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] [instance: b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:29.038160 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:50:29.055212 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03f108c8-17f4-43da-8c01-276ad47fb805 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:29.055672 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03f108c8-17f4-43da-8c01-276ad47fb805 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:29.056624 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03f108c8-17f4-43da-8c01-276ad47fb805 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:29.057574 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03f108c8-17f4-43da-8c01-276ad47fb805 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:29.243604 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-04606b21-4289-45c1-b51a-10fc5221c6a2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:29.254481 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-04606b21-4289-45c1-b51a-10fc5221c6a2 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea" status: 200 len: 1672 microversion: 2.1 time: 0.281814 Jul 25 14:50:29.255828 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2572/4888] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:28 2022] GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea => generated 1672 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:29.347022 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-03f108c8-17f4-43da-8c01-276ad47fb805 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d15b8d3057425dbf014609cacef9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a6bbf7f4541bbba9249cd2ce3a9a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:29.355611 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-03f108c8-17f4-43da-8c01-276ad47fb805 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736" status: 200 len: 1316 microversion: 2.1 time: 0.326126 Jul 25 14:50:29.356557 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2317/4889] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:29 2022] GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 => generated 1316 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:29.367516 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-744dd1d9-e4cd-483c-8325-b98a899845b9 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:29.368223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-744dd1d9-e4cd-483c-8325-b98a899845b9 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] [instance: 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:29.375396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-744dd1d9-e4cd-483c-8325-b98a899845b9 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:29.375849 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-744dd1d9-e4cd-483c-8325-b98a899845b9 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:29.376681 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-744dd1d9-e4cd-483c-8325-b98a899845b9 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:29.377115 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-744dd1d9-e4cd-483c-8325-b98a899845b9 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:29.744608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-744dd1d9-e4cd-483c-8325-b98a899845b9 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91784e3a38a34d3ca64a06b2617a0154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65097f882d949469009707d1eff8506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:29.754180 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-744dd1d9-e4cd-483c-8325-b98a899845b9 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] 10.222.0.88 "GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e" status: 200 len: 1429 microversion: 2.1 time: 0.391283 Jul 25 14:50:29.757099 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2573/4890] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:29 2022] GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e => generated 1429 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:29.875235 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-74d70db5-c131-4362-b524-6e5052bf0282 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:29.875656 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-74d70db5-c131-4362-b524-6e5052bf0282 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:29.892970 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-74d70db5-c131-4362-b524-6e5052bf0282 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:29.894583 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-74d70db5-c131-4362-b524-6e5052bf0282 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:29.899957 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-74d70db5-c131-4362-b524-6e5052bf0282 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:29.900135 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-74d70db5-c131-4362-b524-6e5052bf0282 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:30.166790 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-74d70db5-c131-4362-b524-6e5052bf0282 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:30.176662 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-74d70db5-c131-4362-b524-6e5052bf0282 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1506 microversion: 2.1 time: 0.306498 Jul 25 14:50:30.181375 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2318/4891] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:29 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1506 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:30.280740 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6f4eb792-8392-4506-abff-14fe8e23d607 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:30.280740 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6f4eb792-8392-4506-abff-14fe8e23d607 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:30.297923 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f4eb792-8392-4506-abff-14fe8e23d607 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:30.302898 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f4eb792-8392-4506-abff-14fe8e23d607 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:30.304000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f4eb792-8392-4506-abff-14fe8e23d607 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:30.304549 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f4eb792-8392-4506-abff-14fe8e23d607 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:30.377657 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8ca23fdd-a425-4f7a-89a8-3bade59647d1 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:30.379137 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8ca23fdd-a425-4f7a-89a8-3bade59647d1 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] [instance: b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:30.392903 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ca23fdd-a425-4f7a-89a8-3bade59647d1 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:30.393362 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ca23fdd-a425-4f7a-89a8-3bade59647d1 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:30.394170 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ca23fdd-a425-4f7a-89a8-3bade59647d1 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:30.394611 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ca23fdd-a425-4f7a-89a8-3bade59647d1 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:30.531698 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6f4eb792-8392-4506-abff-14fe8e23d607 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:30.550417 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6f4eb792-8392-4506-abff-14fe8e23d607 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea" status: 200 len: 1605 microversion: 2.1 time: 0.276760 Jul 25 14:50:30.551995 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2574/4892] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:30 2022] GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea => generated 1605 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:30.563045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-f01bd952-cdca-40a9-8a30-f5f830a01a9f req-f6e1956d-e675-4972-884d-1fc182dc7d0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736", "name": "network-vif-plugged", "status": "completed", "tag": "35c26f0c-c295-4c03-b37c-60c401d0d30e"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:50:30.591650 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-f01bd952-cdca-40a9-8a30-f5f830a01a9f req-f6e1956d-e675-4972-884d-1fc182dc7d0e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:30.592483 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-f01bd952-cdca-40a9-8a30-f5f830a01a9f req-f6e1956d-e675-4972-884d-1fc182dc7d0e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:30.607215 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-f01bd952-cdca-40a9-8a30-f5f830a01a9f req-f6e1956d-e675-4972-884d-1fc182dc7d0e service nova] Creating event network-vif-plugged:35c26f0c-c295-4c03-b37c-60c401d0d30e for instance b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 on n-h2-846435-14 Jul 25 14:50:30.614302 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-f01bd952-cdca-40a9-8a30-f5f830a01a9f req-f6e1956d-e675-4972-884d-1fc182dc7d0e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060846 Jul 25 14:50:30.616394 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2575/4893] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:50:30.838363 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8ca23fdd-a425-4f7a-89a8-3bade59647d1 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d15b8d3057425dbf014609cacef9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a6bbf7f4541bbba9249cd2ce3a9a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:30.864075 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8ca23fdd-a425-4f7a-89a8-3bade59647d1 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736" status: 200 len: 1316 microversion: 2.1 time: 0.482904 Jul 25 14:50:30.865805 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2319/4894] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:30 2022] GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 => generated 1316 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:30.881433 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dae8f7a7-964c-433c-8544-83e63538035c tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:30.886669 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-dae8f7a7-964c-433c-8544-83e63538035c tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] [instance: 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:30.921007 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dae8f7a7-964c-433c-8544-83e63538035c tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:30.922180 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dae8f7a7-964c-433c-8544-83e63538035c tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:30.924233 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dae8f7a7-964c-433c-8544-83e63538035c tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:30.931353 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dae8f7a7-964c-433c-8544-83e63538035c tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:30.965378 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-805ba81c-b04a-4249-951e-633c15f06264 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:30.965971 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-805ba81c-b04a-4249-951e-633c15f06264 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:30.973967 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-805ba81c-b04a-4249-951e-633c15f06264 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:30.974661 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-805ba81c-b04a-4249-951e-633c15f06264 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:30.976271 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-805ba81c-b04a-4249-951e-633c15f06264 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:30.976906 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-805ba81c-b04a-4249-951e-633c15f06264 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:31.025669 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-805ba81c-b04a-4249-951e-633c15f06264 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412/ips" status: 200 len: 150 microversion: 2.1 time: 0.281547 Jul 25 14:50:31.026879 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2576/4895] 10.222.0.88 () {58 vars in 1248 bytes} [Mon Jul 25 14:50:30 2022] GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412/ips => generated 150 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:50:31.032616 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-20f93af2-90c8-40ab-90a9-52ea586ce8e8 req-58d7c686-df9c-4903-94f6-be15e4568f60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6922ac9f-c929-47b6-84f1-12fb9289d3ea", "name": "network-vif-deleted", "tag": "4368bd6d-0c96-4bb9-b5aa-1daedefa6065"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:50:31.044215 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-20f93af2-90c8-40ab-90a9-52ea586ce8e8 req-58d7c686-df9c-4903-94f6-be15e4568f60 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:31.044822 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-20f93af2-90c8-40ab-90a9-52ea586ce8e8 req-58d7c686-df9c-4903-94f6-be15e4568f60 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:31.076856 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-20f93af2-90c8-40ab-90a9-52ea586ce8e8 req-58d7c686-df9c-4903-94f6-be15e4568f60 service nova] Creating event network-vif-deleted:4368bd6d-0c96-4bb9-b5aa-1daedefa6065 for instance 6922ac9f-c929-47b6-84f1-12fb9289d3ea on n-h1-846435-14 Jul 25 14:50:31.103183 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-20f93af2-90c8-40ab-90a9-52ea586ce8e8 req-58d7c686-df9c-4903-94f6-be15e4568f60 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074639 Jul 25 14:50:31.104350 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2577/4896] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:50:31.203388 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7b9b1fd8-3729-4365-9fe6-a21e9e34a81f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:31.204713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7b9b1fd8-3729-4365-9fe6-a21e9e34a81f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:31.216795 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7b9b1fd8-3729-4365-9fe6-a21e9e34a81f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:31.217788 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7b9b1fd8-3729-4365-9fe6-a21e9e34a81f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:31.220298 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7b9b1fd8-3729-4365-9fe6-a21e9e34a81f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:31.220942 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7b9b1fd8-3729-4365-9fe6-a21e9e34a81f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:31.262142 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-dae8f7a7-964c-433c-8544-83e63538035c tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91784e3a38a34d3ca64a06b2617a0154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65097f882d949469009707d1eff8506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:31.266184 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:50:31.275632 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dae8f7a7-964c-433c-8544-83e63538035c tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] 10.222.0.88 "GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e" status: 200 len: 1429 microversion: 2.1 time: 0.407699 Jul 25 14:50:31.276775 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2320/4897] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:30 2022] GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e => generated 1429 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:31.492081 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7b9b1fd8-3729-4365-9fe6-a21e9e34a81f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:31.509846 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7b9b1fd8-3729-4365-9fe6-a21e9e34a81f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1506 microversion: 2.1 time: 0.308320 Jul 25 14:50:31.514884 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2578/4898] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:31 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:31.585071 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6679725f-b21c-4db1-ade2-ab24f51720a8 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:31.587331 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6679725f-b21c-4db1-ade2-ab24f51720a8 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:31.599137 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6679725f-b21c-4db1-ade2-ab24f51720a8 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:31.600283 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6679725f-b21c-4db1-ade2-ab24f51720a8 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:31.601278 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6679725f-b21c-4db1-ade2-ab24f51720a8 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:31.601847 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6679725f-b21c-4db1-ade2-ab24f51720a8 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:31.719270 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6679725f-b21c-4db1-ade2-ab24f51720a8 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7e3180b05b4f9fb877d031b73b5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b80269077ccc4482a91cb9e6b1d911b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:31.734284 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6679725f-b21c-4db1-ade2-ab24f51720a8 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea" status: 200 len: 1322 microversion: 2.1 time: 0.157830 Jul 25 14:50:31.751059 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2321/4899] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:31 2022] GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:31.892799 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-36da0fc0-491c-43f1-bdcf-c5f1e919d68a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:31.893650 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-36da0fc0-491c-43f1-bdcf-c5f1e919d68a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] [instance: b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:31.901558 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-36da0fc0-491c-43f1-bdcf-c5f1e919d68a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:31.902256 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-36da0fc0-491c-43f1-bdcf-c5f1e919d68a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:31.903363 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-36da0fc0-491c-43f1-bdcf-c5f1e919d68a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:31.904006 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-36da0fc0-491c-43f1-bdcf-c5f1e919d68a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:32.206893 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-36da0fc0-491c-43f1-bdcf-c5f1e919d68a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d15b8d3057425dbf014609cacef9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a6bbf7f4541bbba9249cd2ce3a9a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:32.223422 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-36da0fc0-491c-43f1-bdcf-c5f1e919d68a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736" status: 200 len: 1316 microversion: 2.1 time: 0.335103 Jul 25 14:50:32.226230 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2579/4900] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:31 2022] GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 => generated 1316 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:32.305626 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-630f4a6e-910a-4431-bcad-068f56392850 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:32.307012 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-630f4a6e-910a-4431-bcad-068f56392850 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] [instance: 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:32.326578 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:50:32.328724 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-630f4a6e-910a-4431-bcad-068f56392850 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:32.330609 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-630f4a6e-910a-4431-bcad-068f56392850 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:32.331649 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-630f4a6e-910a-4431-bcad-068f56392850 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:32.332311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-630f4a6e-910a-4431-bcad-068f56392850 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:32.552797 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6a54fccf-4d9c-4175-b941-9f629ba1f547 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:32.556400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6a54fccf-4d9c-4175-b941-9f629ba1f547 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:32.571163 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6a54fccf-4d9c-4175-b941-9f629ba1f547 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:32.572679 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=16 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:50:32.576674 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6a54fccf-4d9c-4175-b941-9f629ba1f547 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:32.577823 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6a54fccf-4d9c-4175-b941-9f629ba1f547 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:32.581392 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6a54fccf-4d9c-4175-b941-9f629ba1f547 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:32.737866 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-630f4a6e-910a-4431-bcad-068f56392850 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91784e3a38a34d3ca64a06b2617a0154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65097f882d949469009707d1eff8506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:32.749707 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-630f4a6e-910a-4431-bcad-068f56392850 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] 10.222.0.88 "GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e" status: 200 len: 1429 microversion: 2.1 time: 0.448637 Jul 25 14:50:32.755736 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2322/4901] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:32 2022] GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e => generated 1429 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:32.761053 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ca801675-6897-4adc-a9e3-3b1d2e7b566b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:32.768989 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ca801675-6897-4adc-a9e3-3b1d2e7b566b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:32.782698 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ca801675-6897-4adc-a9e3-3b1d2e7b566b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:32.784589 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ca801675-6897-4adc-a9e3-3b1d2e7b566b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:32.785644 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ca801675-6897-4adc-a9e3-3b1d2e7b566b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:32.788437 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ca801675-6897-4adc-a9e3-3b1d2e7b566b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:32.836237 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-ca801675-6897-4adc-a9e3-3b1d2e7b566b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] HTTP exception thrown: Instance 6922ac9f-c929-47b6-84f1-12fb9289d3ea could not be found. Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ca801675-6897-4adc-a9e3-3b1d2e7b566b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Request method failure captured: Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea HTTP/1.1 Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qvmoQ3iOfSK0hVwpax8Cw2RBsdAfQl7sdfNVCK7qIkkXMGrQx5bveqINsWadN-IUWz-CGgJ1lhdczwWJtQjjn6gH67b-srQUCoNXKQz-p9lw0s_dp_QsXzym4T6UhDkE9WLRmEhf1jdH9KtF2RRAEvfidvnn968SPiTK1PokI1_PpM Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: b80269077ccc4482a91cb9e6b1d911b5 Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-AttachVolumeTestJSON-1980933828 Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b80269077ccc4482a91cb9e6b1d911b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b80269077ccc4482a91cb9e6b1d911b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b80269077ccc4482a91cb9e6b1d911b5", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b80269077ccc4482a91cb9e6b1d911b5"}]}] Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-AttachVolumeTestJSON-1980933828 Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: b80269077ccc4482a91cb9e6b1d911b5 Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1980933828 Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-AttachVolumeTestJSON-1980933828-project Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 0d7e3180b05b4f9fb877d031b73b5ee2 Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-AttachVolumeTestJSON-1980933828-project Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 6922ac9f-c929-47b6-84f1-12fb9289d3ea could not be found. Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '6922ac9f-c929-47b6-84f1-12fb9289d3ea'} Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6922ac9f-c929-47b6-84f1-12fb9289d3ea could not be found. Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6922ac9f-c929-47b6-84f1-12fb9289d3ea could not be found. Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:32.839674 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:32.848853 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:32.848853 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:32.848853 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:32.848853 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:50:32.848853 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:50:32.848853 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6922ac9f-c929-47b6-84f1-12fb9289d3ea could not be found. Jul 25 14:50:32.848853 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:32.853413 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ca801675-6897-4adc-a9e3-3b1d2e7b566b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Returning 404 to user: Instance 6922ac9f-c929-47b6-84f1-12fb9289d3ea could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:50:32.855166 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ca801675-6897-4adc-a9e3-3b1d2e7b566b tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea" status: 404 len: 111 microversion: 2.1 time: 0.097719 Jul 25 14:50:32.861857 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2323/4902] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:32 2022] GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:50:32.868269 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-be4e50be-4574-44e6-bb1f-37e2abe386e6 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '.version_select at 0x7f46869a9040>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:32.921556 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-be4e50be-4574-44e6-bb1f-37e2abe386e6 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2147391423" status: 202 len: 0 microversion: 2.1 time: 0.057783 Jul 25 14:50:32.934002 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2324/4903] 10.222.0.88 () {58 vars in 1221 bytes} [Mon Jul 25 14:50:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2147391423 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:50:32.952658 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6a54fccf-4d9c-4175-b941-9f629ba1f547 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:32.955162 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:50:32.978831 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6a54fccf-4d9c-4175-b941-9f629ba1f547 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1506 microversion: 2.1 time: 0.433515 Jul 25 14:50:32.983564 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2580/4904] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:32 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1506 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:33.262391 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-eb65a4d9-976b-4f7b-87f6-e7badc09e14a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:33.267955 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-eb65a4d9-976b-4f7b-87f6-e7badc09e14a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] [instance: b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:33.300871 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eb65a4d9-976b-4f7b-87f6-e7badc09e14a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:33.301331 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eb65a4d9-976b-4f7b-87f6-e7badc09e14a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:33.302125 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eb65a4d9-976b-4f7b-87f6-e7badc09e14a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:33.302562 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eb65a4d9-976b-4f7b-87f6-e7badc09e14a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:33.666620 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-eb65a4d9-976b-4f7b-87f6-e7badc09e14a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d15b8d3057425dbf014609cacef9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a6bbf7f4541bbba9249cd2ce3a9a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:33.681700 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-eb65a4d9-976b-4f7b-87f6-e7badc09e14a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736" status: 200 len: 1465 microversion: 2.1 time: 0.437670 Jul 25 14:50:33.682391 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2325/4905] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:33 2022] GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 => generated 1465 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:33.704167 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8627dab8-b248-413e-b262-3873c344b318 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-500148258", "metadata": {"image_type": "test"}}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:50:33.707488 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8627dab8-b248-413e-b262-3873c344b318 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] [instance: b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:33.722704 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8627dab8-b248-413e-b262-3873c344b318 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:33.728937 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8627dab8-b248-413e-b262-3873c344b318 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:33.730053 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8627dab8-b248-413e-b262-3873c344b318 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:33.730490 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8627dab8-b248-413e-b262-3873c344b318 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:33.780067 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-748a1236-bdba-4727-9de7-ceda339a8a71 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:33.780689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-748a1236-bdba-4727-9de7-ceda339a8a71 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] [instance: 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:33.792358 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-748a1236-bdba-4727-9de7-ceda339a8a71 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:33.796737 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-748a1236-bdba-4727-9de7-ceda339a8a71 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:33.801041 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-748a1236-bdba-4727-9de7-ceda339a8a71 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:33.801697 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-748a1236-bdba-4727-9de7-ceda339a8a71 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:33.832626 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-8627dab8-b248-413e-b262-3873c344b318 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Getting quotas for project 572a6bbf7f4541bbba9249cd2ce3a9a8. Resources: dict_keys(['metadata_items']) {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:50:33.846180 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-8627dab8-b248-413e-b262-3873c344b318 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Getting quotas for user b0d15b8d3057425dbf014609cacef9e6 and project 572a6bbf7f4541bbba9249cd2ce3a9a8. Resources: dict_keys(['metadata_items']) {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:50:34.188003 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8627dab8-b248-413e-b262-3873c344b318 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "POST /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736/action" status: 202 len: 0 microversion: 2.1 time: 0.486445 Jul 25 14:50:34.189406 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2581/4906] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:50:33 2022] POST /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 14:50:34.214267 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-748a1236-bdba-4727-9de7-ceda339a8a71 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91784e3a38a34d3ca64a06b2617a0154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65097f882d949469009707d1eff8506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:34.223300 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-748a1236-bdba-4727-9de7-ceda339a8a71 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] 10.222.0.88 "GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e" status: 200 len: 1429 microversion: 2.1 time: 0.447179 Jul 25 14:50:34.224230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-60717405-7d92-4220-af38-03adf66f2d32 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60b220e9-878a-4210-96e9-ae8f391a4517"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:50:34.227026 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2326/4907] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:33 2022] GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e => generated 1429 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:50:34.232298 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-60717405-7d92-4220-af38-03adf66f2d32 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:34.249872 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60717405-7d92-4220-af38-03adf66f2d32 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:34.251095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60717405-7d92-4220-af38-03adf66f2d32 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:34.253697 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60717405-7d92-4220-af38-03adf66f2d32 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:34.255085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60717405-7d92-4220-af38-03adf66f2d32 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:34.256255 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c2dbaa4a-beaa-4995-a219-052b60cc551e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:34.259404 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c2dbaa4a-beaa-4995-a219-052b60cc551e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:34.274830 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c2dbaa4a-beaa-4995-a219-052b60cc551e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:34.275649 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c2dbaa4a-beaa-4995-a219-052b60cc551e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:34.278055 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c2dbaa4a-beaa-4995-a219-052b60cc551e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:34.278690 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c2dbaa4a-beaa-4995-a219-052b60cc551e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:34.632984 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c2dbaa4a-beaa-4995-a219-052b60cc551e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:34.668777 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c2dbaa4a-beaa-4995-a219-052b60cc551e tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1506 microversion: 2.1 time: 0.439880 Jul 25 14:50:34.683053 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2327/4908] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:34 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1506 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:34.706782 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d9923a3a-9544-4789-9e6f-da1bdef1ccb0 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f46869a9040>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:34.795290 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d9923a3a-9544-4789-9e6f-da1bdef1ccb0 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a" status: 200 len: 1419 microversion: 2.1 time: 0.109349 Jul 25 14:50:34.795290 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2328/4909] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:50:34 2022] GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a => generated 1419 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:34.936752 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-60717405-7d92-4220-af38-03adf66f2d32 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "POST /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.744479 Jul 25 14:50:34.937801 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2582/4910] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Jul 25 14:50:34 2022] POST /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412/os-volume_attachments => generated 194 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:50:35.245461 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fb5ee50c-7686-48af-a4be-f0c97d9804bb tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:35.246929 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fb5ee50c-7686-48af-a4be-f0c97d9804bb tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] [instance: 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:35.289777 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fb5ee50c-7686-48af-a4be-f0c97d9804bb tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:35.298339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fb5ee50c-7686-48af-a4be-f0c97d9804bb tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:35.299308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fb5ee50c-7686-48af-a4be-f0c97d9804bb tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:35.299789 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fb5ee50c-7686-48af-a4be-f0c97d9804bb tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:35.672137 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fb5ee50c-7686-48af-a4be-f0c97d9804bb tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91784e3a38a34d3ca64a06b2617a0154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65097f882d949469009707d1eff8506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:35.681643 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fb5ee50c-7686-48af-a4be-f0c97d9804bb tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] 10.222.0.88 "GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e" status: 200 len: 1429 microversion: 2.1 time: 0.440931 Jul 25 14:50:35.688781 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2329/4911] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:35 2022] GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e => generated 1429 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:35.726333 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-48483fc3-fa6f-434e-8946-6e4dd5cefe16 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:35.727104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-48483fc3-fa6f-434e-8946-6e4dd5cefe16 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:35.739472 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48483fc3-fa6f-434e-8946-6e4dd5cefe16 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:35.739926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48483fc3-fa6f-434e-8946-6e4dd5cefe16 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:35.740750 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48483fc3-fa6f-434e-8946-6e4dd5cefe16 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:35.741197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48483fc3-fa6f-434e-8946-6e4dd5cefe16 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:35.809198 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6805c964-3762-4fc4-be18-9b4edaedb775 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f46988add30>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:35.896703 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6805c964-3762-4fc4-be18-9b4edaedb775 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a" status: 200 len: 1419 microversion: 2.1 time: 0.091272 Jul 25 14:50:35.907585 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2330/4912] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:50:35 2022] GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a => generated 1419 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:50:36.070835 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-48483fc3-fa6f-434e-8946-6e4dd5cefe16 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:36.078996 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-48483fc3-fa6f-434e-8946-6e4dd5cefe16 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1506 microversion: 2.1 time: 0.356996 Jul 25 14:50:36.091734 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2583/4913] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:35 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1506 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:36.721616 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f3ad6c3b-0c5b-41db-81c8-168e457693d9 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:36.723266 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f3ad6c3b-0c5b-41db-81c8-168e457693d9 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] [instance: 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:36.744339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3ad6c3b-0c5b-41db-81c8-168e457693d9 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:36.745842 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3ad6c3b-0c5b-41db-81c8-168e457693d9 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:36.747029 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3ad6c3b-0c5b-41db-81c8-168e457693d9 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:36.748631 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3ad6c3b-0c5b-41db-81c8-168e457693d9 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:36.913885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-00dbc0bc-aaf0-42d9-8b67-115bd0f915f6 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f46861a7dc0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:36.996996 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-00dbc0bc-aaf0-42d9-8b67-115bd0f915f6 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a" status: 200 len: 1419 microversion: 2.1 time: 0.086980 Jul 25 14:50:37.000651 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2584/4914] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:50:36 2022] GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a => generated 1419 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:37.105392 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-50dcc4c7-d632-44d1-92a6-7be2f4689a9d tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:37.106069 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-50dcc4c7-d632-44d1-92a6-7be2f4689a9d tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:37.125349 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f3ad6c3b-0c5b-41db-81c8-168e457693d9 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91784e3a38a34d3ca64a06b2617a0154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65097f882d949469009707d1eff8506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:37.137310 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f3ad6c3b-0c5b-41db-81c8-168e457693d9 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] 10.222.0.88 "GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e" status: 200 len: 1429 microversion: 2.1 time: 0.420207 Jul 25 14:50:37.141117 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2331/4915] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:36 2022] GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e => generated 1429 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:50:37.141416 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50dcc4c7-d632-44d1-92a6-7be2f4689a9d tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:37.144910 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50dcc4c7-d632-44d1-92a6-7be2f4689a9d tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:37.146139 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50dcc4c7-d632-44d1-92a6-7be2f4689a9d tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:37.146794 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50dcc4c7-d632-44d1-92a6-7be2f4689a9d tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:37.502143 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-50dcc4c7-d632-44d1-92a6-7be2f4689a9d tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:37.517403 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-50dcc4c7-d632-44d1-92a6-7be2f4689a9d tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1506 microversion: 2.1 time: 0.417286 Jul 25 14:50:37.521836 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2585/4916] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:37 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1506 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:37.831383 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-15d0d8c7-a121-4710-9fc2-9ca2fb9d8177 req-1662a2f1-9a1a-4927-a4ca-7cbe9ea1a700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e", "name": "network-vif-plugged", "status": "completed", "tag": "d3d30104-e768-41d5-993f-98045266d43b"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:50:37.853885 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-15d0d8c7-a121-4710-9fc2-9ca2fb9d8177 req-1662a2f1-9a1a-4927-a4ca-7cbe9ea1a700 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:37.855546 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-15d0d8c7-a121-4710-9fc2-9ca2fb9d8177 req-1662a2f1-9a1a-4927-a4ca-7cbe9ea1a700 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:37.908044 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-15d0d8c7-a121-4710-9fc2-9ca2fb9d8177 req-1662a2f1-9a1a-4927-a4ca-7cbe9ea1a700 service nova] Creating event network-vif-plugged:d3d30104-e768-41d5-993f-98045266d43b for instance 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e on n-h1-846435-14 Jul 25 14:50:37.930967 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-15d0d8c7-a121-4710-9fc2-9ca2fb9d8177 req-1662a2f1-9a1a-4927-a4ca-7cbe9ea1a700 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103246 Jul 25 14:50:37.931424 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2332/4917] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:50:38.014894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6ebe1c02-07c9-4f8d-ab78-dd4494d15302 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f4686119e50>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:38.134674 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6ebe1c02-07c9-4f8d-ab78-dd4494d15302 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a" status: 200 len: 1419 microversion: 2.1 time: 0.123178 Jul 25 14:50:38.135366 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2586/4918] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:50:38 2022] GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a => generated 1419 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:38.163206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2502d55e-31a8-4a68-8209-9266cb1370bb tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:38.164235 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2502d55e-31a8-4a68-8209-9266cb1370bb tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] [instance: 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:38.176398 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2502d55e-31a8-4a68-8209-9266cb1370bb tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:38.177328 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2502d55e-31a8-4a68-8209-9266cb1370bb tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:38.180411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2502d55e-31a8-4a68-8209-9266cb1370bb tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:38.181094 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2502d55e-31a8-4a68-8209-9266cb1370bb tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:38.539472 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2502d55e-31a8-4a68-8209-9266cb1370bb tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91784e3a38a34d3ca64a06b2617a0154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65097f882d949469009707d1eff8506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:38.546336 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3a1f6355-81cf-4134-88ab-1d884d2fed34 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:38.547229 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3a1f6355-81cf-4134-88ab-1d884d2fed34 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:38.552356 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2502d55e-31a8-4a68-8209-9266cb1370bb tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] 10.222.0.88 "GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e" status: 200 len: 1429 microversion: 2.1 time: 0.393600 Jul 25 14:50:38.556010 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2333/4919] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:38 2022] GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e => generated 1429 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:38.562377 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a1f6355-81cf-4134-88ab-1d884d2fed34 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:38.568076 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a1f6355-81cf-4134-88ab-1d884d2fed34 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:38.570897 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a1f6355-81cf-4134-88ab-1d884d2fed34 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:38.584693 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a1f6355-81cf-4134-88ab-1d884d2fed34 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:38.829295 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3a1f6355-81cf-4134-88ab-1d884d2fed34 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:38.838218 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3a1f6355-81cf-4134-88ab-1d884d2fed34 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1506 microversion: 2.1 time: 0.296265 Jul 25 14:50:38.852029 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2587/4920] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:38 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1506 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:39.150049 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6db82aa4-d2e5-4b96-b287-46949d279c2a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f46988adf70>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:39.574237 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f70209cf-e643-4c68-8a6d-1a12ea11db6a tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:39.574873 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f70209cf-e643-4c68-8a6d-1a12ea11db6a tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] [instance: 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:39.600576 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f70209cf-e643-4c68-8a6d-1a12ea11db6a tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:39.601631 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f70209cf-e643-4c68-8a6d-1a12ea11db6a tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:39.602580 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f70209cf-e643-4c68-8a6d-1a12ea11db6a tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:39.603178 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f70209cf-e643-4c68-8a6d-1a12ea11db6a tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:39.727091 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6db82aa4-d2e5-4b96-b287-46949d279c2a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a" status: 200 len: 1419 microversion: 2.1 time: 0.581225 Jul 25 14:50:39.736148 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2334/4921] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:50:39 2022] GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a => generated 1419 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:39.859693 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c84d7c09-850b-4450-91ce-0ac4debaf762 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:39.860715 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c84d7c09-850b-4450-91ce-0ac4debaf762 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:39.877692 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c84d7c09-850b-4450-91ce-0ac4debaf762 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:39.881692 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c84d7c09-850b-4450-91ce-0ac4debaf762 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:39.883269 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c84d7c09-850b-4450-91ce-0ac4debaf762 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:39.885436 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c84d7c09-850b-4450-91ce-0ac4debaf762 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:40.153955 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f70209cf-e643-4c68-8a6d-1a12ea11db6a tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91784e3a38a34d3ca64a06b2617a0154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65097f882d949469009707d1eff8506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:40.162075 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f70209cf-e643-4c68-8a6d-1a12ea11db6a tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] 10.222.0.88 "GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e" status: 200 len: 1608 microversion: 2.1 time: 0.592687 Jul 25 14:50:40.169951 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2588/4922] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:39 2022] GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e => generated 1608 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:40.191402 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c4ff3e41-5221-481a-8938-6508cf045a38 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:40.192381 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c4ff3e41-5221-481a-8938-6508cf045a38 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] [instance: 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:40.213403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c4ff3e41-5221-481a-8938-6508cf045a38 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:40.213849 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c4ff3e41-5221-481a-8938-6508cf045a38 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:40.218817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c4ff3e41-5221-481a-8938-6508cf045a38 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:40.219520 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c4ff3e41-5221-481a-8938-6508cf045a38 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:40.347844 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c84d7c09-850b-4450-91ce-0ac4debaf762 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:40.359728 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c84d7c09-850b-4450-91ce-0ac4debaf762 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1506 microversion: 2.1 time: 0.503856 Jul 25 14:50:40.361114 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2335/4923] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:39 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1506 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:40.599727 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-7a441fce-cda0-4de0-8d18-fce133d04e2d req-ba5d6ff2-2cb7-43b9-a4dd-5f7e965821bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736", "name": "network-vif-plugged", "status": "completed", "tag": "35c26f0c-c295-4c03-b37c-60c401d0d30e"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:50:40.638201 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-7a441fce-cda0-4de0-8d18-fce133d04e2d req-ba5d6ff2-2cb7-43b9-a4dd-5f7e965821bc service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:40.639086 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-7a441fce-cda0-4de0-8d18-fce133d04e2d req-ba5d6ff2-2cb7-43b9-a4dd-5f7e965821bc service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:40.706963 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-7a441fce-cda0-4de0-8d18-fce133d04e2d req-ba5d6ff2-2cb7-43b9-a4dd-5f7e965821bc service nova] Creating event network-vif-plugged:35c26f0c-c295-4c03-b37c-60c401d0d30e for instance b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 on n-h2-846435-14 Jul 25 14:50:40.728334 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-7a441fce-cda0-4de0-8d18-fce133d04e2d req-ba5d6ff2-2cb7-43b9-a4dd-5f7e965821bc service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130050 Jul 25 14:50:40.732125 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2336/4924] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:50:40.751354 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0072b1b8-3250-466e-82a5-2cd38cb19070 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f4686b15700>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:40.824065 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0072b1b8-3250-466e-82a5-2cd38cb19070 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a" status: 200 len: 1419 microversion: 2.1 time: 0.083179 Jul 25 14:50:40.824805 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2337/4925] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:50:40 2022] GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a => generated 1419 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:40.838419 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-857b2d18-d9bb-40b0-8926-f6f0daf109c1 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-893759325", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "4e335baf-3d43-423d-bf9b-e035e66b1252"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:50:40.882023 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c4ff3e41-5221-481a-8938-6508cf045a38 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91784e3a38a34d3ca64a06b2617a0154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65097f882d949469009707d1eff8506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:40.890897 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c4ff3e41-5221-481a-8938-6508cf045a38 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] 10.222.0.88 "GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e" status: 200 len: 1608 microversion: 2.1 time: 0.703803 Jul 25 14:50:40.913111 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2589/4926] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:40 2022] GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e => generated 1608 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:50:40.919291 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6408476c-92b2-4812-a030-bc7ec0b78caa tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:40.920156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6408476c-92b2-4812-a030-bc7ec0b78caa tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] [instance: 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:40.925096 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-857b2d18-d9bb-40b0-8926-f6f0daf109c1 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] validate_networks() for [('4e335baf-3d43-423d-bf9b-e035e66b1252', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:50:40.948429 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6408476c-92b2-4812-a030-bc7ec0b78caa tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:40.960807 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6408476c-92b2-4812-a030-bc7ec0b78caa tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:40.961942 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6408476c-92b2-4812-a030-bc7ec0b78caa tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:40.962552 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6408476c-92b2-4812-a030-bc7ec0b78caa tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:41.329997 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6408476c-92b2-4812-a030-bc7ec0b78caa tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91784e3a38a34d3ca64a06b2617a0154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65097f882d949469009707d1eff8506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:41.338899 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6408476c-92b2-4812-a030-bc7ec0b78caa tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] 10.222.0.88 "GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e" status: 200 len: 1608 microversion: 2.1 time: 0.424324 Jul 25 14:50:41.343526 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2590/4927] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:40 2022] GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e => generated 1608 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:41.387170 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9350db79-8976-43e2-952c-83b19162f4cb tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:41.388016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9350db79-8976-43e2-952c-83b19162f4cb tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:41.399245 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9350db79-8976-43e2-952c-83b19162f4cb tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:41.401293 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9350db79-8976-43e2-952c-83b19162f4cb tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:41.402192 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9350db79-8976-43e2-952c-83b19162f4cb tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:41.405702 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9350db79-8976-43e2-952c-83b19162f4cb tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:41.596299 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-857b2d18-d9bb-40b0-8926-f6f0daf109c1 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:50:41.596785 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-857b2d18-d9bb-40b0-8926-f6f0daf109c1 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:50:41.597202 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-857b2d18-d9bb-40b0-8926-f6f0daf109c1 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:50:41.597621 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-857b2d18-d9bb-40b0-8926-f6f0daf109c1 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:50:41.598040 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-857b2d18-d9bb-40b0-8926-f6f0daf109c1 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:50:41.625865 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-857b2d18-d9bb-40b0-8926-f6f0daf109c1 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:41.626737 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-857b2d18-d9bb-40b0-8926-f6f0daf109c1 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:41.630084 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-857b2d18-d9bb-40b0-8926-f6f0daf109c1 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:41.631800 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-857b2d18-d9bb-40b0-8926-f6f0daf109c1 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:41.714617 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-857b2d18-d9bb-40b0-8926-f6f0daf109c1 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Getting quotas for project 68574d1c346d4507a2c25afd4de146e5. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:50:41.726633 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-857b2d18-d9bb-40b0-8926-f6f0daf109c1 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Getting quotas for user 03e0c7ce41d64772a87a0ec7416ae6ea and project 68574d1c346d4507a2c25afd4de146e5. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:50:41.765352 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-857b2d18-d9bb-40b0-8926-f6f0daf109c1 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:50:41.767860 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-857b2d18-d9bb-40b0-8926-f6f0daf109c1 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 298b0992-a307-40cf-a42a-9964e711730e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:50:41.872815 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-857b2d18-d9bb-40b0-8926-f6f0daf109c1 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.038334 Jul 25 14:50:41.873498 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2338/4928] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:50:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:50:41.886622 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cbca5f91-0838-4763-aae3-19b55ec4c6db tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f4686bbe1f0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:41.960167 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cbca5f91-0838-4763-aae3-19b55ec4c6db tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a" status: 200 len: 1419 microversion: 2.1 time: 0.081401 Jul 25 14:50:41.960798 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2339/4929] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:50:41 2022] GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a => generated 1419 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:41.971496 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-33106fd5-93bf-4c61-bbbe-7c68b1301d94 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:41.972201 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-33106fd5-93bf-4c61-bbbe-7c68b1301d94 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 298b0992-a307-40cf-a42a-9964e711730e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:42.037152 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9350db79-8976-43e2-952c-83b19162f4cb tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:42.045382 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9350db79-8976-43e2-952c-83b19162f4cb tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1506 microversion: 2.1 time: 0.664035 Jul 25 14:50:42.045991 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2591/4930] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:41 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1506 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:42.976539 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-675778e9-aa5c-4dec-bdf3-4c97819f91f3 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f46861edca0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:43.068043 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-675778e9-aa5c-4dec-bdf3-4c97819f91f3 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a" status: 200 len: 1419 microversion: 2.1 time: 0.097155 Jul 25 14:50:43.076383 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2592/4931] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:50:42 2022] GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a => generated 1419 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:50:43.081790 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-00f4c650-6793-4d2f-af1c-2d47c954a582 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:43.082830 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-00f4c650-6793-4d2f-af1c-2d47c954a582 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:43.135552 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-00f4c650-6793-4d2f-af1c-2d47c954a582 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:43.136506 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-00f4c650-6793-4d2f-af1c-2d47c954a582 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:43.146369 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-33106fd5-93bf-4c61-bbbe-7c68b1301d94 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0c7ce41d64772a87a0ec7416ae6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68574d1c346d4507a2c25afd4de146e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:43.151155 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-00f4c650-6793-4d2f-af1c-2d47c954a582 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:43.153956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-00f4c650-6793-4d2f-af1c-2d47c954a582 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:43.160092 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-33106fd5-93bf-4c61-bbbe-7c68b1301d94 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e" status: 200 len: 1218 microversion: 2.1 time: 1.198102 Jul 25 14:50:43.163167 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2340/4932] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:41 2022] GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e => generated 1218 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:43.697449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-00f4c650-6793-4d2f-af1c-2d47c954a582 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:43.725348 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-00f4c650-6793-4d2f-af1c-2d47c954a582 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1486 microversion: 2.1 time: 0.645201 Jul 25 14:50:43.730535 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2593/4933] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:43 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1486 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:43.750851 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bdacee3a-3920-4743-b2d1-4972feaa3ed8 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:50:43.751441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bdacee3a-3920-4743-b2d1-4972feaa3ed8 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:43.769073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bdacee3a-3920-4743-b2d1-4972feaa3ed8 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:43.769523 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bdacee3a-3920-4743-b2d1-4972feaa3ed8 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:43.772012 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bdacee3a-3920-4743-b2d1-4972feaa3ed8 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:43.776063 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bdacee3a-3920-4743-b2d1-4972feaa3ed8 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:43.986777 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bdacee3a-3920-4743-b2d1-4972feaa3ed8 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "POST /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6/action" status: 202 len: 0 microversion: 2.1 time: 0.240028 Jul 25 14:50:43.991473 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2341/4934] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:50:43 2022] POST /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:50:43.998059 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7281d49d-8f03-4d9b-a9cc-63e7f2712e01 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:43.999462 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7281d49d-8f03-4d9b-a9cc-63e7f2712e01 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:44.029546 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7281d49d-8f03-4d9b-a9cc-63e7f2712e01 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:44.037349 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7281d49d-8f03-4d9b-a9cc-63e7f2712e01 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:44.040137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7281d49d-8f03-4d9b-a9cc-63e7f2712e01 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:44.040591 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7281d49d-8f03-4d9b-a9cc-63e7f2712e01 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:44.085524 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d325ae5b-63bd-4d26-8029-ad22c4227949 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f4686ad28b0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:44.183379 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d325ae5b-63bd-4d26-8029-ad22c4227949 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a" status: 200 len: 1419 microversion: 2.1 time: 0.104036 Jul 25 14:50:44.185193 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2342/4935] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:50:44 2022] GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a => generated 1419 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:44.201951 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-83b7fff5-32e9-4c91-9f1b-a9d6f931380c tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:44.205334 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-83b7fff5-32e9-4c91-9f1b-a9d6f931380c tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 298b0992-a307-40cf-a42a-9964e711730e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:44.229239 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-83b7fff5-32e9-4c91-9f1b-a9d6f931380c tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:44.236892 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-83b7fff5-32e9-4c91-9f1b-a9d6f931380c tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:44.245859 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-83b7fff5-32e9-4c91-9f1b-a9d6f931380c tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:44.258618 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-83b7fff5-32e9-4c91-9f1b-a9d6f931380c tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:44.984373 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-83b7fff5-32e9-4c91-9f1b-a9d6f931380c tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0c7ce41d64772a87a0ec7416ae6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68574d1c346d4507a2c25afd4de146e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:44.992589 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-83b7fff5-32e9-4c91-9f1b-a9d6f931380c tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e" status: 200 len: 1276 microversion: 2.1 time: 0.806175 Jul 25 14:50:44.999126 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2343/4936] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:44 2022] GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e => generated 1276 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:45.199519 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-93466390-825f-475e-b037-c87338f9062a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f4686ad2040>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:45.285426 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-93466390-825f-475e-b037-c87338f9062a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a" status: 200 len: 1419 microversion: 2.1 time: 0.089872 Jul 25 14:50:45.292765 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2344/4937] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:50:45 2022] GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a => generated 1419 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:45.576214 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7281d49d-8f03-4d9b-a9cc-63e7f2712e01 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:45.585824 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7281d49d-8f03-4d9b-a9cc-63e7f2712e01 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1494 microversion: 2.1 time: 1.592908 Jul 25 14:50:45.588633 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2594/4938] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:43 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1494 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:46.029869 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-79262a76-ca54-4f4b-8af4-9e36c536d97d tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:46.030489 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-79262a76-ca54-4f4b-8af4-9e36c536d97d tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 298b0992-a307-40cf-a42a-9964e711730e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:46.048731 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-79262a76-ca54-4f4b-8af4-9e36c536d97d tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:46.049190 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-79262a76-ca54-4f4b-8af4-9e36c536d97d tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:46.049999 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-79262a76-ca54-4f4b-8af4-9e36c536d97d tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:46.050439 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-79262a76-ca54-4f4b-8af4-9e36c536d97d tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:46.300286 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-25543711-8c56-445e-9dfd-22ce6d34e983 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f4698940790>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:46.384789 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-25543711-8c56-445e-9dfd-22ce6d34e983 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a" status: 200 len: 1419 microversion: 2.1 time: 0.088118 Jul 25 14:50:46.408428 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2595/4939] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:50:46 2022] GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a => generated 1419 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:46.421941 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-79262a76-ca54-4f4b-8af4-9e36c536d97d tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0c7ce41d64772a87a0ec7416ae6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68574d1c346d4507a2c25afd4de146e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:46.434532 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-79262a76-ca54-4f4b-8af4-9e36c536d97d tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e" status: 200 len: 1276 microversion: 2.1 time: 0.409566 Jul 25 14:50:46.448236 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2345/4940] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:46 2022] GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e => generated 1276 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:46.612145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b8e0095e-04a3-4a86-9945-036387ca32dd tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:46.612754 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b8e0095e-04a3-4a86-9945-036387ca32dd tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:46.628575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8e0095e-04a3-4a86-9945-036387ca32dd tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:46.629530 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8e0095e-04a3-4a86-9945-036387ca32dd tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:46.636757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8e0095e-04a3-4a86-9945-036387ca32dd tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:46.638017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8e0095e-04a3-4a86-9945-036387ca32dd tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:47.015331 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b8e0095e-04a3-4a86-9945-036387ca32dd tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:47.024823 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b8e0095e-04a3-4a86-9945-036387ca32dd tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1494 microversion: 2.1 time: 0.416493 Jul 25 14:50:47.025449 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2596/4941] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:46 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1494 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:47.410888 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c91cfc82-a829-4384-8e8d-d7f493a43a1d tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f4686ae3790>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:47.468315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b9d09019-aad8-4d8a-b962-915adf9a7fae tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:47.468315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b9d09019-aad8-4d8a-b962-915adf9a7fae tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 298b0992-a307-40cf-a42a-9964e711730e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:47.484729 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b9d09019-aad8-4d8a-b962-915adf9a7fae tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:47.485027 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b9d09019-aad8-4d8a-b962-915adf9a7fae tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:47.490440 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b9d09019-aad8-4d8a-b962-915adf9a7fae tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:47.493728 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b9d09019-aad8-4d8a-b962-915adf9a7fae tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:47.550361 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c91cfc82-a829-4384-8e8d-d7f493a43a1d tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a" status: 200 len: 1419 microversion: 2.1 time: 0.143612 Jul 25 14:50:47.558215 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2346/4942] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:50:47 2022] GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a => generated 1419 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:47.851719 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b9d09019-aad8-4d8a-b962-915adf9a7fae tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0c7ce41d64772a87a0ec7416ae6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68574d1c346d4507a2c25afd4de146e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:47.865097 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b9d09019-aad8-4d8a-b962-915adf9a7fae tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e" status: 200 len: 1318 microversion: 2.1 time: 0.406090 Jul 25 14:50:47.865773 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2597/4943] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:47 2022] GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:48.046925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-19bdc16d-cfdb-4e27-8641-68a5a535220f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:48.047534 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-19bdc16d-cfdb-4e27-8641-68a5a535220f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:48.080407 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-19bdc16d-cfdb-4e27-8641-68a5a535220f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:48.085442 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-19bdc16d-cfdb-4e27-8641-68a5a535220f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:48.086271 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-19bdc16d-cfdb-4e27-8641-68a5a535220f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:48.086714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-19bdc16d-cfdb-4e27-8641-68a5a535220f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:48.564866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-86e7df8a-d835-402d-bf55-6678cf9445fb tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f4686131dc0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:48.645194 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-86e7df8a-d835-402d-bf55-6678cf9445fb tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a" status: 200 len: 1419 microversion: 2.1 time: 0.084094 Jul 25 14:50:48.646029 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2598/4944] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:50:48 2022] GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a => generated 1419 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:50:48.652921 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-19bdc16d-cfdb-4e27-8641-68a5a535220f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:48.656884 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c71065c9-e950-46b7-a07f-34a85ca5c106 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:48.663480 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c71065c9-e950-46b7-a07f-34a85ca5c106 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:48.683805 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-19bdc16d-cfdb-4e27-8641-68a5a535220f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1494 microversion: 2.1 time: 0.641091 Jul 25 14:50:48.688420 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c71065c9-e950-46b7-a07f-34a85ca5c106 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:48.700104 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2347/4945] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:48 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1494 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:48.713538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c71065c9-e950-46b7-a07f-34a85ca5c106 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:48.718863 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c71065c9-e950-46b7-a07f-34a85ca5c106 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:48.719714 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c71065c9-e950-46b7-a07f-34a85ca5c106 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:48.724668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:50:48.760718 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-c71065c9-e950-46b7-a07f-34a85ca5c106 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] HTTP exception thrown: Instance 6922ac9f-c929-47b6-84f1-12fb9289d3ea could not be found. Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c71065c9-e950-46b7-a07f-34a85ca5c106 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Request method failure captured: Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea HTTP/1.1 Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qvmoQ3iOfSK0hVwpax8Cw2RBsdAfQl7sdfNVCK7qIkkXMGrQx5bveqINsWadN-IUWz-CGgJ1lhdczwWJtQjjn6gH67b-srQUCoNXKQz-p9lw0s_dp_QsXzym4T6UhDkE9WLRmEhf1jdH9KtF2RRAEvfidvnn968SPiTK1PokI1_PpM Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: b80269077ccc4482a91cb9e6b1d911b5 Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-AttachVolumeTestJSON-1980933828 Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b80269077ccc4482a91cb9e6b1d911b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b80269077ccc4482a91cb9e6b1d911b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b80269077ccc4482a91cb9e6b1d911b5", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b80269077ccc4482a91cb9e6b1d911b5"}]}] Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-AttachVolumeTestJSON-1980933828 Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: b80269077ccc4482a91cb9e6b1d911b5 Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1980933828 Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-AttachVolumeTestJSON-1980933828-project Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 0d7e3180b05b4f9fb877d031b73b5ee2 Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-AttachVolumeTestJSON-1980933828-project Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 6922ac9f-c929-47b6-84f1-12fb9289d3ea could not be found. Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '6922ac9f-c929-47b6-84f1-12fb9289d3ea'} Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6922ac9f-c929-47b6-84f1-12fb9289d3ea could not be found. Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:50:48.770050 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:50:48.775067 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6922ac9f-c929-47b6-84f1-12fb9289d3ea could not be found. Jul 25 14:50:48.775067 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:50:48.775067 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:48.775067 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:50:48.775067 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:48.775067 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:48.775067 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:48.775067 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:50:48.775067 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:50:48.775067 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6922ac9f-c929-47b6-84f1-12fb9289d3ea could not be found. Jul 25 14:50:48.775067 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:50:48.780239 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c71065c9-e950-46b7-a07f-34a85ca5c106 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Returning 404 to user: Instance 6922ac9f-c929-47b6-84f1-12fb9289d3ea could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:50:48.781336 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c71065c9-e950-46b7-a07f-34a85ca5c106 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "DELETE /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea" status: 404 len: 111 microversion: 2.1 time: 0.134216 Jul 25 14:50:48.782356 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2599/4946] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:50:48 2022] DELETE /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:50:48.791397 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-950845b2-0bee-4a64-ad64-6be4f29ae6d9 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:48.792045 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-950845b2-0bee-4a64-ad64-6be4f29ae6d9 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: 6922ac9f-c929-47b6-84f1-12fb9289d3ea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:48.803907 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-950845b2-0bee-4a64-ad64-6be4f29ae6d9 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:48.805588 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-950845b2-0bee-4a64-ad64-6be4f29ae6d9 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:48.806913 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-950845b2-0bee-4a64-ad64-6be4f29ae6d9 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:48.811017 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-950845b2-0bee-4a64-ad64-6be4f29ae6d9 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:48.850226 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-950845b2-0bee-4a64-ad64-6be4f29ae6d9 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] HTTP exception thrown: Instance 6922ac9f-c929-47b6-84f1-12fb9289d3ea could not be found. Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-950845b2-0bee-4a64-ad64-6be4f29ae6d9 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Request method failure captured: Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea HTTP/1.1 Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qvmoQ3iOfSK0hVwpax8Cw2RBsdAfQl7sdfNVCK7qIkkXMGrQx5bveqINsWadN-IUWz-CGgJ1lhdczwWJtQjjn6gH67b-srQUCoNXKQz-p9lw0s_dp_QsXzym4T6UhDkE9WLRmEhf1jdH9KtF2RRAEvfidvnn968SPiTK1PokI1_PpM Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: b80269077ccc4482a91cb9e6b1d911b5 Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-AttachVolumeTestJSON-1980933828 Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b80269077ccc4482a91cb9e6b1d911b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b80269077ccc4482a91cb9e6b1d911b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b80269077ccc4482a91cb9e6b1d911b5", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b80269077ccc4482a91cb9e6b1d911b5"}]}] Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-AttachVolumeTestJSON-1980933828 Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: b80269077ccc4482a91cb9e6b1d911b5 Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1980933828 Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-AttachVolumeTestJSON-1980933828-project Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 0d7e3180b05b4f9fb877d031b73b5ee2 Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-AttachVolumeTestJSON-1980933828-project Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 6922ac9f-c929-47b6-84f1-12fb9289d3ea could not be found. Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '6922ac9f-c929-47b6-84f1-12fb9289d3ea'} Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6922ac9f-c929-47b6-84f1-12fb9289d3ea could not be found. Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6922ac9f-c929-47b6-84f1-12fb9289d3ea could not be found. Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:48.852310 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:48.856886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:48.856886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:48.856886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:48.856886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:50:48.856886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:50:48.856886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6922ac9f-c929-47b6-84f1-12fb9289d3ea could not be found. Jul 25 14:50:48.856886 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:48.856886 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-950845b2-0bee-4a64-ad64-6be4f29ae6d9 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Returning 404 to user: Instance 6922ac9f-c929-47b6-84f1-12fb9289d3ea could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:50:48.856886 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-950845b2-0bee-4a64-ad64-6be4f29ae6d9 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea" status: 404 len: 111 microversion: 2.1 time: 0.066949 Jul 25 14:50:48.856886 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2348/4947] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:48 2022] GET /compute/v2.1/servers/6922ac9f-c929-47b6-84f1-12fb9289d3ea => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:50:48.887266 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3165a380-ffd5-4f92-80b8-1ea68eb8cd08 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:48.887882 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3165a380-ffd5-4f92-80b8-1ea68eb8cd08 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 298b0992-a307-40cf-a42a-9964e711730e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:48.899200 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3165a380-ffd5-4f92-80b8-1ea68eb8cd08 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:48.899676 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3165a380-ffd5-4f92-80b8-1ea68eb8cd08 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:48.900574 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3165a380-ffd5-4f92-80b8-1ea68eb8cd08 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:48.901010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3165a380-ffd5-4f92-80b8-1ea68eb8cd08 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:49.224968 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3165a380-ffd5-4f92-80b8-1ea68eb8cd08 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0c7ce41d64772a87a0ec7416ae6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68574d1c346d4507a2c25afd4de146e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:49.234647 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3165a380-ffd5-4f92-80b8-1ea68eb8cd08 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e" status: 200 len: 1318 microversion: 2.1 time: 0.351883 Jul 25 14:50:49.236015 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2600/4948] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:48 2022] GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:49.660726 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c888bded-bc05-4a5f-8eb4-dc7f3e06ff94 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f468766f670>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:49.714643 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-793d7e6b-798a-4122-b4ad-12797b6cce5f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:49.715836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-793d7e6b-798a-4122-b4ad-12797b6cce5f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:49.747571 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-793d7e6b-798a-4122-b4ad-12797b6cce5f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:49.750967 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-793d7e6b-798a-4122-b4ad-12797b6cce5f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:49.758619 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-793d7e6b-798a-4122-b4ad-12797b6cce5f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:49.764953 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-793d7e6b-798a-4122-b4ad-12797b6cce5f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:49.780515 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c888bded-bc05-4a5f-8eb4-dc7f3e06ff94 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a" status: 200 len: 1419 microversion: 2.1 time: 0.123569 Jul 25 14:50:49.788321 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2349/4949] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:50:49 2022] GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a => generated 1419 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:50.139045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-793d7e6b-798a-4122-b4ad-12797b6cce5f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:50.155357 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-793d7e6b-798a-4122-b4ad-12797b6cce5f tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1500 microversion: 2.1 time: 0.444829 Jul 25 14:50:50.158170 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2601/4950] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:49 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1500 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:50:50.188543 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4237cf1f-daa4-45c4-86e6-eb92fc61db31 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:50.189057 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4237cf1f-daa4-45c4-86e6-eb92fc61db31 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:50.197703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4237cf1f-daa4-45c4-86e6-eb92fc61db31 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:50.198202 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4237cf1f-daa4-45c4-86e6-eb92fc61db31 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:50.199065 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4237cf1f-daa4-45c4-86e6-eb92fc61db31 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:50.201539 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4237cf1f-daa4-45c4-86e6-eb92fc61db31 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:50.250910 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4237cf1f-daa4-45c4-86e6-eb92fc61db31 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:50:50.256403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b696de81-4f79-4636-befd-41ffab14ee70 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:50.257225 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b696de81-4f79-4636-befd-41ffab14ee70 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 298b0992-a307-40cf-a42a-9964e711730e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:50.274322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b696de81-4f79-4636-befd-41ffab14ee70 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:50.274781 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b696de81-4f79-4636-befd-41ffab14ee70 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:50.275625 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b696de81-4f79-4636-befd-41ffab14ee70 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:50.276089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b696de81-4f79-4636-befd-41ffab14ee70 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:50.288061 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:50:50.604464 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4237cf1f-daa4-45c4-86e6-eb92fc61db31 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 204 len: 0 microversion: 2.1 time: 0.419450 Jul 25 14:50:50.605049 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2350/4951] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:50:50 2022] DELETE /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:50:50.625628 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-0017dedd-a27d-41aa-a357-f4cfae1474ed req-914704ac-8dca-4c77-a370-1b111b3fcf9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e", "tag": "d3d30104-e768-41d5-993f-98045266d43b"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:50:50.671623 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-0017dedd-a27d-41aa-a357-f4cfae1474ed req-914704ac-8dca-4c77-a370-1b111b3fcf9d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:50.672263 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-0017dedd-a27d-41aa-a357-f4cfae1474ed req-914704ac-8dca-4c77-a370-1b111b3fcf9d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:50.726304 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-0017dedd-a27d-41aa-a357-f4cfae1474ed req-914704ac-8dca-4c77-a370-1b111b3fcf9d service nova] Creating event network-changed:d3d30104-e768-41d5-993f-98045266d43b for instance 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e on n-h1-846435-14 Jul 25 14:50:50.741202 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-0017dedd-a27d-41aa-a357-f4cfae1474ed req-914704ac-8dca-4c77-a370-1b111b3fcf9d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119545 Jul 25 14:50:50.741812 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2351/4952] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:50:50.744846 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b696de81-4f79-4636-befd-41ffab14ee70 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0c7ce41d64772a87a0ec7416ae6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68574d1c346d4507a2c25afd4de146e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:50.756658 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7f61f4bd-dd63-4890-98c9-6e186ffea0dc tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:50.757489 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7f61f4bd-dd63-4890-98c9-6e186ffea0dc tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:50.767230 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b696de81-4f79-4636-befd-41ffab14ee70 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e" status: 200 len: 1318 microversion: 2.1 time: 0.514541 Jul 25 14:50:50.779799 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2602/4953] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:50 2022] GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e => generated 1318 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:50:50.784273 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7f61f4bd-dd63-4890-98c9-6e186ffea0dc tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:50.784956 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7f61f4bd-dd63-4890-98c9-6e186ffea0dc tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:50.785963 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7f61f4bd-dd63-4890-98c9-6e186ffea0dc tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:50.786570 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7f61f4bd-dd63-4890-98c9-6e186ffea0dc tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:50.796583 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-35e44a47-7fc8-4e81-88e7-8d8a438b117a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f46861faca0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:50.901635 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-35e44a47-7fc8-4e81-88e7-8d8a438b117a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a" status: 200 len: 1419 microversion: 2.1 time: 0.110504 Jul 25 14:50:50.903250 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2603/4954] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:50:50 2022] GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a => generated 1419 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:50:51.298139 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7f61f4bd-dd63-4890-98c9-6e186ffea0dc tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:51.320567 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7f61f4bd-dd63-4890-98c9-6e186ffea0dc tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1506 microversion: 2.1 time: 0.577502 Jul 25 14:50:51.336053 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2352/4955] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:50 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1506 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:51.788620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-015d1355-ddbe-40c7-a62f-4ae8bad5e6ee tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:51.789232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-015d1355-ddbe-40c7-a62f-4ae8bad5e6ee tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 298b0992-a307-40cf-a42a-9964e711730e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:51.805877 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-015d1355-ddbe-40c7-a62f-4ae8bad5e6ee tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:51.806356 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-015d1355-ddbe-40c7-a62f-4ae8bad5e6ee tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:51.807150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-015d1355-ddbe-40c7-a62f-4ae8bad5e6ee tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:51.807585 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-015d1355-ddbe-40c7-a62f-4ae8bad5e6ee tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:51.917511 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ad7f5430-f4cb-4a40-b824-c11d257ac6e4 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f4686b15d30>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:51.935506 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:50:51.995392 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ad7f5430-f4cb-4a40-b824-c11d257ac6e4 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a" status: 200 len: 1419 microversion: 2.1 time: 0.081712 Jul 25 14:50:52.004443 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2353/4956] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:50:51 2022] GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a => generated 1419 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:52.109798 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-015d1355-ddbe-40c7-a62f-4ae8bad5e6ee tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0c7ce41d64772a87a0ec7416ae6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68574d1c346d4507a2c25afd4de146e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:52.119554 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-015d1355-ddbe-40c7-a62f-4ae8bad5e6ee tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e" status: 200 len: 1318 microversion: 2.1 time: 0.334691 Jul 25 14:50:52.123959 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2604/4957] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:51 2022] GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:52.358790 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-546e22a2-c3e3-40df-b5e6-129111bf7b4c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:52.360111 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-546e22a2-c3e3-40df-b5e6-129111bf7b4c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:52.378125 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-546e22a2-c3e3-40df-b5e6-129111bf7b4c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:52.378589 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-546e22a2-c3e3-40df-b5e6-129111bf7b4c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:52.379367 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-546e22a2-c3e3-40df-b5e6-129111bf7b4c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:52.379803 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-546e22a2-c3e3-40df-b5e6-129111bf7b4c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:52.763491 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-546e22a2-c3e3-40df-b5e6-129111bf7b4c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:52.772545 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-d25b9bb5-585c-4897-b145-71156779d477 req-ab1f43f9-32ae-4cde-9e05-c09f2baad729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "298b0992-a307-40cf-a42a-9964e711730e", "tag": "48481a85-b1da-4f8a-85b3-9e354574ca92"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:50:52.773625 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-546e22a2-c3e3-40df-b5e6-129111bf7b4c tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1506 microversion: 2.1 time: 0.419442 Jul 25 14:50:52.774803 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2354/4958] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:52 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1506 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:52.789499 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-d25b9bb5-585c-4897-b145-71156779d477 req-ab1f43f9-32ae-4cde-9e05-c09f2baad729 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:52.790624 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-d25b9bb5-585c-4897-b145-71156779d477 req-ab1f43f9-32ae-4cde-9e05-c09f2baad729 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:52.821647 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-d25b9bb5-585c-4897-b145-71156779d477 req-ab1f43f9-32ae-4cde-9e05-c09f2baad729 service nova] Creating event network-changed:48481a85-b1da-4f8a-85b3-9e354574ca92 for instance 298b0992-a307-40cf-a42a-9964e711730e on n-h1-846435-14 Jul 25 14:50:52.841019 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-d25b9bb5-585c-4897-b145-71156779d477 req-ab1f43f9-32ae-4cde-9e05-c09f2baad729 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069417 Jul 25 14:50:52.844752 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2605/4959] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:50:53.010399 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6881441c-1221-437d-919f-b2d1c0442849 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f46872163a0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:53.079418 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6881441c-1221-437d-919f-b2d1c0442849 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a" status: 200 len: 1419 microversion: 2.1 time: 0.073131 Jul 25 14:50:53.080006 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2355/4960] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:50:53 2022] GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a => generated 1419 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:53.146576 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-82291af5-a410-449d-9d21-df6f3915bfc9 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:53.147818 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-82291af5-a410-449d-9d21-df6f3915bfc9 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 298b0992-a307-40cf-a42a-9964e711730e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:53.161398 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-82291af5-a410-449d-9d21-df6f3915bfc9 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:53.162162 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-82291af5-a410-449d-9d21-df6f3915bfc9 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:53.165319 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-82291af5-a410-449d-9d21-df6f3915bfc9 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:53.166051 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-82291af5-a410-449d-9d21-df6f3915bfc9 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:53.353522 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-82291af5-a410-449d-9d21-df6f3915bfc9 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0c7ce41d64772a87a0ec7416ae6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68574d1c346d4507a2c25afd4de146e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:53.363124 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-82291af5-a410-449d-9d21-df6f3915bfc9 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e" status: 200 len: 1318 microversion: 2.1 time: 0.221472 Jul 25 14:50:53.383071 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2606/4961] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:53 2022] GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:53.795678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-491e661f-08a0-4cf9-bb69-63add06e0824 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:53.796563 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-491e661f-08a0-4cf9-bb69-63add06e0824 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:53.800412 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=8 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:50:53.819361 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-491e661f-08a0-4cf9-bb69-63add06e0824 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:53.820330 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-491e661f-08a0-4cf9-bb69-63add06e0824 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:53.821561 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-491e661f-08a0-4cf9-bb69-63add06e0824 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:53.822282 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-491e661f-08a0-4cf9-bb69-63add06e0824 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:54.106560 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7a7cf9c8-6534-4fe2-916a-640d62248030 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f4686193700>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:54.197996 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7a7cf9c8-6534-4fe2-916a-640d62248030 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a" status: 200 len: 1419 microversion: 2.1 time: 0.106843 Jul 25 14:50:54.240224 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2607/4962] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:50:54 2022] GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a => generated 1419 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:54.312599 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-491e661f-08a0-4cf9-bb69-63add06e0824 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:54.341249 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-491e661f-08a0-4cf9-bb69-63add06e0824 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1506 microversion: 2.1 time: 0.550258 Jul 25 14:50:54.352820 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2356/4963] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:53 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1506 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:54.386466 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7df44e32-2a32-4384-a3f0-86c421b97911 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:54.387170 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7df44e32-2a32-4384-a3f0-86c421b97911 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 298b0992-a307-40cf-a42a-9964e711730e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:54.409396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7df44e32-2a32-4384-a3f0-86c421b97911 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:54.410644 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7df44e32-2a32-4384-a3f0-86c421b97911 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:54.411655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7df44e32-2a32-4384-a3f0-86c421b97911 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:54.412358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7df44e32-2a32-4384-a3f0-86c421b97911 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:54.693335 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1873dfb6-b16f-4e6a-88cb-3e185f7ed11e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:54.693843 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1873dfb6-b16f-4e6a-88cb-3e185f7ed11e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:54.714247 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1873dfb6-b16f-4e6a-88cb-3e185f7ed11e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:54.717959 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1873dfb6-b16f-4e6a-88cb-3e185f7ed11e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:54.720235 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1873dfb6-b16f-4e6a-88cb-3e185f7ed11e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:54.723400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1873dfb6-b16f-4e6a-88cb-3e185f7ed11e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:54.785331 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-1873dfb6-b16f-4e6a-88cb-3e185f7ed11e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] HTTP exception thrown: Instance e5866023-cfeb-43b0-9788-334b6ad4b850 could not be found. Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1873dfb6-b16f-4e6a-88cb-3e185f7ed11e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Request method failure captured: Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 HTTP/1.1 Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qvmoQ3iOfSK0hVwpax8Cw2RBsdAfQl7sdfNVCK7qIkkXMGrQx5bveqINsWadN-IUWz-CGgJ1lhdczwWJtQjjn6gH67b-srQUCoNXKQz-p9lw0s_dp_QsXzym4T6UhDkE9WLRmEhf1jdH9KtF2RRAEvfidvnn968SPiTK1PokI1_PpM Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: b80269077ccc4482a91cb9e6b1d911b5 Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-AttachVolumeTestJSON-1980933828 Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b80269077ccc4482a91cb9e6b1d911b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b80269077ccc4482a91cb9e6b1d911b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b80269077ccc4482a91cb9e6b1d911b5", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b80269077ccc4482a91cb9e6b1d911b5"}]}] Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-AttachVolumeTestJSON-1980933828 Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: b80269077ccc4482a91cb9e6b1d911b5 Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1980933828 Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-AttachVolumeTestJSON-1980933828-project Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 0d7e3180b05b4f9fb877d031b73b5ee2 Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-AttachVolumeTestJSON-1980933828-project Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance e5866023-cfeb-43b0-9788-334b6ad4b850 could not be found. Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'e5866023-cfeb-43b0-9788-334b6ad4b850'} Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5866023-cfeb-43b0-9788-334b6ad4b850 could not be found. Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:50:54.797958 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:50:54.802959 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5866023-cfeb-43b0-9788-334b6ad4b850 could not be found. Jul 25 14:50:54.802959 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:54.802959 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:54.802959 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:54.802959 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:54.802959 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:54.802959 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:54.802959 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:50:54.802959 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:50:54.802959 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5866023-cfeb-43b0-9788-334b6ad4b850 could not be found. Jul 25 14:50:54.802959 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:54.806657 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1873dfb6-b16f-4e6a-88cb-3e185f7ed11e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Returning 404 to user: Instance e5866023-cfeb-43b0-9788-334b6ad4b850 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:50:54.808101 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1873dfb6-b16f-4e6a-88cb-3e185f7ed11e tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "DELETE /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 404 len: 111 microversion: 2.1 time: 0.118628 Jul 25 14:50:54.814469 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7df44e32-2a32-4384-a3f0-86c421b97911 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0c7ce41d64772a87a0ec7416ae6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68574d1c346d4507a2c25afd4de146e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:54.824303 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2357/4964] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:50:54 2022] DELETE /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:50:54.825104 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7df44e32-2a32-4384-a3f0-86c421b97911 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e" status: 200 len: 1318 microversion: 2.1 time: 0.442603 Jul 25 14:50:54.825867 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2608/4965] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:54 2022] GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e => generated 1318 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:54.840087 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-925e5f61-637a-46b5-9ea5-51a75cf00869 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:54.841954 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-925e5f61-637a-46b5-9ea5-51a75cf00869 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] [instance: e5866023-cfeb-43b0-9788-334b6ad4b850] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:54.854181 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-925e5f61-637a-46b5-9ea5-51a75cf00869 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:54.854905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-925e5f61-637a-46b5-9ea5-51a75cf00869 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:54.857955 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-925e5f61-637a-46b5-9ea5-51a75cf00869 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:54.858585 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-925e5f61-637a-46b5-9ea5-51a75cf00869 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:54.893154 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-925e5f61-637a-46b5-9ea5-51a75cf00869 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] HTTP exception thrown: Instance e5866023-cfeb-43b0-9788-334b6ad4b850 could not be found. Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-925e5f61-637a-46b5-9ea5-51a75cf00869 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Request method failure captured: Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 HTTP/1.1 Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qvmoQ3iOfSK0hVwpax8Cw2RBsdAfQl7sdfNVCK7qIkkXMGrQx5bveqINsWadN-IUWz-CGgJ1lhdczwWJtQjjn6gH67b-srQUCoNXKQz-p9lw0s_dp_QsXzym4T6UhDkE9WLRmEhf1jdH9KtF2RRAEvfidvnn968SPiTK1PokI1_PpM Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: b80269077ccc4482a91cb9e6b1d911b5 Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-AttachVolumeTestJSON-1980933828 Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b80269077ccc4482a91cb9e6b1d911b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b80269077ccc4482a91cb9e6b1d911b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b80269077ccc4482a91cb9e6b1d911b5", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b80269077ccc4482a91cb9e6b1d911b5"}]}] Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-AttachVolumeTestJSON-1980933828 Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: b80269077ccc4482a91cb9e6b1d911b5 Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1980933828 Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-AttachVolumeTestJSON-1980933828-project Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 0d7e3180b05b4f9fb877d031b73b5ee2 Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-AttachVolumeTestJSON-1980933828-project Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance e5866023-cfeb-43b0-9788-334b6ad4b850 could not be found. Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'e5866023-cfeb-43b0-9788-334b6ad4b850'} Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5866023-cfeb-43b0-9788-334b6ad4b850 could not be found. Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5866023-cfeb-43b0-9788-334b6ad4b850 could not be found. Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:54.905782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:54.911196 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:54.911196 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:54.911196 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:54.911196 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:50:54.911196 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:50:54.911196 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5866023-cfeb-43b0-9788-334b6ad4b850 could not be found. Jul 25 14:50:54.911196 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:54.912519 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-925e5f61-637a-46b5-9ea5-51a75cf00869 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] Returning 404 to user: Instance e5866023-cfeb-43b0-9788-334b6ad4b850 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:50:54.913557 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-925e5f61-637a-46b5-9ea5-51a75cf00869 tempest-AttachVolumeTestJSON-1980933828 tempest-AttachVolumeTestJSON-1980933828-project] 10.222.0.88 "GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850" status: 404 len: 111 microversion: 2.1 time: 0.085316 Jul 25 14:50:54.914661 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2358/4966] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:54 2022] GET /compute/v2.1/servers/e5866023-cfeb-43b0-9788-334b6ad4b850 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:50:55.254708 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8453a53c-46ff-4471-bd74-a1cf226a07da tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f46861939d0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:55.344442 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8453a53c-46ff-4471-bd74-a1cf226a07da tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a" status: 200 len: 1419 microversion: 2.1 time: 0.093482 Jul 25 14:50:55.347064 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2609/4967] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:50:55 2022] GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a => generated 1419 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:55.362965 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bec35db8-712c-4c58-9667-a45e5f73b3d6 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:55.363751 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bec35db8-712c-4c58-9667-a45e5f73b3d6 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:55.386297 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bec35db8-712c-4c58-9667-a45e5f73b3d6 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:55.387066 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bec35db8-712c-4c58-9667-a45e5f73b3d6 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:55.394308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bec35db8-712c-4c58-9667-a45e5f73b3d6 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:55.395008 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bec35db8-712c-4c58-9667-a45e5f73b3d6 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:55.678795 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-098b9b99-d159-4e64-a135-f082463481d4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60b220e9-878a-4210-96e9-ae8f391a4517"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:50:55.681898 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-098b9b99-d159-4e64-a135-f082463481d4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:55.697880 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-098b9b99-d159-4e64-a135-f082463481d4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:55.705234 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-098b9b99-d159-4e64-a135-f082463481d4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:55.706382 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-098b9b99-d159-4e64-a135-f082463481d4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:55.708840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-098b9b99-d159-4e64-a135-f082463481d4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:55.719400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bec35db8-712c-4c58-9667-a45e5f73b3d6 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:55.730648 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bec35db8-712c-4c58-9667-a45e5f73b3d6 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1464 microversion: 2.1 time: 0.371550 Jul 25 14:50:55.752682 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2359/4968] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:55 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1464 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:55.849203 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5f646cd3-2ef8-42a7-8231-19481c196d75 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:55.850352 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5f646cd3-2ef8-42a7-8231-19481c196d75 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 298b0992-a307-40cf-a42a-9964e711730e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:55.866382 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f646cd3-2ef8-42a7-8231-19481c196d75 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:55.869691 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f646cd3-2ef8-42a7-8231-19481c196d75 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:55.873121 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f646cd3-2ef8-42a7-8231-19481c196d75 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:55.874303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f646cd3-2ef8-42a7-8231-19481c196d75 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:55.919154 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-098b9b99-d159-4e64-a135-f082463481d4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] HTTP exception thrown: Invalid volume: volume 60b220e9-878a-4210-96e9-ae8f391a4517 is already attached to instances: fe421aa5-5038-479a-b496-04130c3de412 Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-098b9b99-d159-4e64-a135-f082463481d4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Request method failure captured: Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412/os-volume_attachments HTTP/1.1 Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 74 Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qxVTVC8FUnn-t2qK29pQ6gpvvVkF5Cd1ek9O6-ax9bIU4h-Acw7IM2XyPTWfCK6LWhHPoO7fpkEcbhitPiuVrA5WlFZ0WfmMB-2I-MAtgO20bt12dRN-m_gApdOXiuB_IoQnmtlPGVQzahhzXBQE11eo5L_JzE39RyLIYMYF8wTD50 Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 325aff76e61141a985b3b0f45521444f Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/325aff76e61141a985b3b0f45521444f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/325aff76e61141a985b3b0f45521444f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_325aff76e61141a985b3b0f45521444f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/325aff76e61141a985b3b0f45521444f"}]}] Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 325aff76e61141a985b3b0f45521444f Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-AttachVolumeNegativeTest-1959370092-project Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 571a2d92d7a34f86bb3c0bfdfcabc5ff Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-AttachVolumeNegativeTest-1959370092-project Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: {"volumeAttachment": {"volumeId": "60b220e9-878a-4210-96e9-ae8f391a4517"}} Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: exception: Invalid volume: volume 60b220e9-878a-4210-96e9-ae8f391a4517 is already attached to instances: fe421aa5-5038-479a-b496-04130c3de412 Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'server_id': 'fe421aa5-5038-479a-b496-04130c3de412', 'body': {'volumeAttachment': {'volumeId': '60b220e9-878a-4210-96e9-ae8f391a4517'}}} Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 60b220e9-878a-4210-96e9-ae8f391a4517 is already attached to instances: fe421aa5-5038-479a-b496-04130c3de412 Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:50:55.921633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:50:55.926292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:50:55.926292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:50:55.926292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 25 14:50:55.926292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 14:50:55.926292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 60b220e9-878a-4210-96e9-ae8f391a4517 is already attached to instances: fe421aa5-5038-479a-b496-04130c3de412 Jul 25 14:50:55.926292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:50:55.926292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:55.926292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:50:55.926292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:55.926292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:55.926292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:55.926292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:50:55.926292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:50:55.926292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 60b220e9-878a-4210-96e9-ae8f391a4517 is already attached to instances: fe421aa5-5038-479a-b496-04130c3de412 Jul 25 14:50:55.926292 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:50:55.933316 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-098b9b99-d159-4e64-a135-f082463481d4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Returning 400 to user: Invalid volume: volume 60b220e9-878a-4210-96e9-ae8f391a4517 is already attached to instances: fe421aa5-5038-479a-b496-04130c3de412 {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:50:55.934451 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-098b9b99-d159-4e64-a135-f082463481d4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "POST /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.259896 Jul 25 14:50:55.935571 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2610/4969] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Jul 25 14:50:55 2022] POST /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412/os-volume_attachments => generated 174 bytes in 261 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:50:55.960958 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-1dd2a166-7bd5-40bc-a029-5aea38e5f40b req-931fad66-e03c-4db5-a1e1-70dc630937ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c33a1f9f-9b8f-4886-9eda-145b96630df6", "name": "network-vif-deleted", "tag": "0a55caf6-5c1c-4e3e-9b76-477f7d164296"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:50:55.983636 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-1dd2a166-7bd5-40bc-a029-5aea38e5f40b req-931fad66-e03c-4db5-a1e1-70dc630937ef service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:55.984477 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-1dd2a166-7bd5-40bc-a029-5aea38e5f40b req-931fad66-e03c-4db5-a1e1-70dc630937ef service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:56.026190 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-1dd2a166-7bd5-40bc-a029-5aea38e5f40b req-931fad66-e03c-4db5-a1e1-70dc630937ef service nova] Creating event network-vif-deleted:0a55caf6-5c1c-4e3e-9b76-477f7d164296 for instance c33a1f9f-9b8f-4886-9eda-145b96630df6 on n-h2-846435-14 Jul 25 14:50:56.035216 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-1dd2a166-7bd5-40bc-a029-5aea38e5f40b req-931fad66-e03c-4db5-a1e1-70dc630937ef service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080874 Jul 25 14:50:56.056796 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2611/4970] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:50:56.120713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c960d798-c918-4753-83f1-c2c64ed01575 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:56.121299 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c960d798-c918-4753-83f1-c2c64ed01575 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:56.138473 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=82 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:50:56.142609 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c960d798-c918-4753-83f1-c2c64ed01575 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:56.149091 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c960d798-c918-4753-83f1-c2c64ed01575 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:56.154270 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c960d798-c918-4753-83f1-c2c64ed01575 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:56.157803 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c960d798-c918-4753-83f1-c2c64ed01575 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:56.375944 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5f646cd3-2ef8-42a7-8231-19481c196d75 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0c7ce41d64772a87a0ec7416ae6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68574d1c346d4507a2c25afd4de146e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:56.392379 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5f646cd3-2ef8-42a7-8231-19481c196d75 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e" status: 200 len: 1318 microversion: 2.1 time: 0.544884 Jul 25 14:50:56.394691 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2360/4971] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:55 2022] GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e => generated 1318 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:56.421746 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ce76c607-6ba2-4496-9470-40d637060911 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f4686b2c5e0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:56.452499 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-c960d798-c918-4753-83f1-c2c64ed01575 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lazy-loading 'services' on Instance uuid fe421aa5-5038-479a-b496-04130c3de412 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:50:56.523548 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ce76c607-6ba2-4496-9470-40d637060911 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a" status: 200 len: 1419 microversion: 2.1 time: 0.101470 Jul 25 14:50:56.535991 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2361/4972] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:50:56 2022] GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a => generated 1419 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:56.648103 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c960d798-c918-4753-83f1-c2c64ed01575 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "DELETE /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412/os-volume_attachments/60b220e9-878a-4210-96e9-ae8f391a4517" status: 202 len: 0 microversion: 2.1 time: 0.531235 Jul 25 14:50:56.656164 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2612/4973] 10.222.0.88 () {58 vars in 1416 bytes} [Mon Jul 25 14:50:56 2022] DELETE /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412/os-volume_attachments/60b220e9-878a-4210-96e9-ae8f391a4517 => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 14:50:56.667365 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-61e71077-3785-4939-a597-bb08d56fbd1c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:56.672927 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-61e71077-3785-4939-a597-bb08d56fbd1c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:56.701729 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-61e71077-3785-4939-a597-bb08d56fbd1c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:56.703108 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-61e71077-3785-4939-a597-bb08d56fbd1c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:56.704950 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-61e71077-3785-4939-a597-bb08d56fbd1c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:56.706137 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-61e71077-3785-4939-a597-bb08d56fbd1c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:56.750369 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-61e71077-3785-4939-a597-bb08d56fbd1c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091306 Jul 25 14:50:56.756555 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2362/4974] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:50:56 2022] GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:50:56.760416 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-430db21a-4074-4965-8f1c-b1c365e7603b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:56.761209 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-430db21a-4074-4965-8f1c-b1c365e7603b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:56.771783 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-430db21a-4074-4965-8f1c-b1c365e7603b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:56.772575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-430db21a-4074-4965-8f1c-b1c365e7603b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:56.773352 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-430db21a-4074-4965-8f1c-b1c365e7603b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:56.773782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-430db21a-4074-4965-8f1c-b1c365e7603b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:56.864004 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-430db21a-4074-4965-8f1c-b1c365e7603b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:56.864490 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-430db21a-4074-4965-8f1c-b1c365e7603b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:56.864985 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-430db21a-4074-4965-8f1c-b1c365e7603b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lazy-loading 'fault' on Instance uuid c33a1f9f-9b8f-4886-9eda-145b96630df6 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:50:56.966937 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-430db21a-4074-4965-8f1c-b1c365e7603b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:56.976514 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-430db21a-4074-4965-8f1c-b1c365e7603b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 200 len: 1303 microversion: 2.1 time: 0.220464 Jul 25 14:50:56.979476 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2613/4975] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:56 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 1303 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:57.423294 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e57b0e06-7f45-441e-8f06-0231680eb673 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:57.423929 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e57b0e06-7f45-441e-8f06-0231680eb673 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 298b0992-a307-40cf-a42a-9964e711730e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:57.432204 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e57b0e06-7f45-441e-8f06-0231680eb673 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:57.432662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e57b0e06-7f45-441e-8f06-0231680eb673 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:57.433516 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e57b0e06-7f45-441e-8f06-0231680eb673 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:57.433960 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e57b0e06-7f45-441e-8f06-0231680eb673 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:57.539548 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3092d864-ac6d-4861-b7f6-b448c4f6f41b tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f46861f3430>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:57.641282 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e57b0e06-7f45-441e-8f06-0231680eb673 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0c7ce41d64772a87a0ec7416ae6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68574d1c346d4507a2c25afd4de146e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:57.651115 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3092d864-ac6d-4861-b7f6-b448c4f6f41b tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a" status: 200 len: 1419 microversion: 2.1 time: 0.115335 Jul 25 14:50:57.651587 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2614/4976] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:50:57 2022] GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a => generated 1419 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:57.654184 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e57b0e06-7f45-441e-8f06-0231680eb673 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e" status: 200 len: 1318 microversion: 2.1 time: 0.234835 Jul 25 14:50:57.660667 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2363/4977] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:57 2022] GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:50:57.764783 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e2fe059a-e39a-435d-8afd-592fefcc4327 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:57.767312 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e2fe059a-e39a-435d-8afd-592fefcc4327 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:57.786438 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2fe059a-e39a-435d-8afd-592fefcc4327 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:57.786889 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2fe059a-e39a-435d-8afd-592fefcc4327 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:57.787693 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2fe059a-e39a-435d-8afd-592fefcc4327 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:57.788160 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2fe059a-e39a-435d-8afd-592fefcc4327 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:57.876456 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e2fe059a-e39a-435d-8afd-592fefcc4327 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116891 Jul 25 14:50:57.881329 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2615/4978] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:50:57 2022] GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:50:58.004734 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8ef78a70-1a3a-4b51-a0fa-a3aeb47fba60 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:58.005359 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8ef78a70-1a3a-4b51-a0fa-a3aeb47fba60 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: c33a1f9f-9b8f-4886-9eda-145b96630df6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:58.014348 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ef78a70-1a3a-4b51-a0fa-a3aeb47fba60 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:58.018441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ef78a70-1a3a-4b51-a0fa-a3aeb47fba60 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:58.021361 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ef78a70-1a3a-4b51-a0fa-a3aeb47fba60 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:58.021996 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ef78a70-1a3a-4b51-a0fa-a3aeb47fba60 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:58.060384 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-8ef78a70-1a3a-4b51-a0fa-a3aeb47fba60 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] HTTP exception thrown: Instance c33a1f9f-9b8f-4886-9eda-145b96630df6 could not be found. Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8ef78a70-1a3a-4b51-a0fa-a3aeb47fba60 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Request method failure captured: Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 HTTP/1.1 Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q1bpmHJ5_rMB5-6SEmItyHt3CUNP-BP74f5EZihxj6f8qE1nhyG3BsmHM9-w8UczXtSCXx-MWnHgqG9P2wJKgv6tvXz1MHG9354Y_LkQScT4LDvtucNvm8mWCHtszLFwHF2t0RMWF_hm_Vs9ChwexHRwb0kWeZQWMMUoCvhtLbRP3c Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 47e1c3839c9f406db5686216c0e9c83e Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServerRescueTestJSON-1586053606 Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/47e1c3839c9f406db5686216c0e9c83e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/47e1c3839c9f406db5686216c0e9c83e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_47e1c3839c9f406db5686216c0e9c83e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/47e1c3839c9f406db5686216c0e9c83e"}]}] Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServerRescueTestJSON-1586053606 Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 47e1c3839c9f406db5686216c0e9c83e Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServerRescueTestJSON-1586053606 Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServerRescueTestJSON-1586053606-project Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 4c72922a47ea4af5a87a537fc463a2af Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServerRescueTestJSON-1586053606-project Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance c33a1f9f-9b8f-4886-9eda-145b96630df6 could not be found. Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'c33a1f9f-9b8f-4886-9eda-145b96630df6'} Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c33a1f9f-9b8f-4886-9eda-145b96630df6 could not be found. Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c33a1f9f-9b8f-4886-9eda-145b96630df6 could not be found. Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:50:58.062131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:58.067657 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:50:58.067657 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:50:58.067657 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:50:58.067657 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:50:58.067657 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:50:58.067657 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c33a1f9f-9b8f-4886-9eda-145b96630df6 could not be found. Jul 25 14:50:58.067657 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:50:58.067657 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8ef78a70-1a3a-4b51-a0fa-a3aeb47fba60 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Returning 404 to user: Instance c33a1f9f-9b8f-4886-9eda-145b96630df6 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:50:58.067657 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8ef78a70-1a3a-4b51-a0fa-a3aeb47fba60 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6" status: 404 len: 111 microversion: 2.1 time: 0.063271 Jul 25 14:50:58.067657 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2364/4979] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:57 2022] GET /compute/v2.1/servers/c33a1f9f-9b8f-4886-9eda-145b96630df6 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:50:58.072725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3e45195f-2ca7-4507-bdbb-df1cbd33abb3 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:58.073222 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3e45195f-2ca7-4507-bdbb-df1cbd33abb3 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:58.090284 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-2458189d-8c64-418f-be77-e52de101a701 req-900cfabb-64cc-46eb-86d5-e1c041d362bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "298b0992-a307-40cf-a42a-9964e711730e", "name": "network-vif-plugged", "status": "completed", "tag": "48481a85-b1da-4f8a-85b3-9e354574ca92"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:50:58.091529 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e45195f-2ca7-4507-bdbb-df1cbd33abb3 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:58.092018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e45195f-2ca7-4507-bdbb-df1cbd33abb3 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:58.092837 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e45195f-2ca7-4507-bdbb-df1cbd33abb3 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:58.093297 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e45195f-2ca7-4507-bdbb-df1cbd33abb3 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:58.119902 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-2458189d-8c64-418f-be77-e52de101a701 req-900cfabb-64cc-46eb-86d5-e1c041d362bc service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:58.122250 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-2458189d-8c64-418f-be77-e52de101a701 req-900cfabb-64cc-46eb-86d5-e1c041d362bc service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:58.154658 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3e45195f-2ca7-4507-bdbb-df1cbd33abb3 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:50:58.161873 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-2458189d-8c64-418f-be77-e52de101a701 req-900cfabb-64cc-46eb-86d5-e1c041d362bc service nova] Creating event network-vif-plugged:48481a85-b1da-4f8a-85b3-9e354574ca92 for instance 298b0992-a307-40cf-a42a-9964e711730e on n-h1-846435-14 Jul 25 14:50:58.211690 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-2458189d-8c64-418f-be77-e52de101a701 req-900cfabb-64cc-46eb-86d5-e1c041d362bc service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134983 Jul 25 14:50:58.217115 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2365/4980] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:50:58.368240 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3e45195f-2ca7-4507-bdbb-df1cbd33abb3 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "DELETE /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 204 len: 0 microversion: 2.1 time: 0.299137 Jul 25 14:50:58.371928 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2616/4981] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:50:58 2022] DELETE /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:50:58.378793 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bb45e26c-11ba-4470-b501-53aa3f011360 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:58.388222 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bb45e26c-11ba-4470-b501-53aa3f011360 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:58.403026 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bb45e26c-11ba-4470-b501-53aa3f011360 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:58.405509 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bb45e26c-11ba-4470-b501-53aa3f011360 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:58.406511 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bb45e26c-11ba-4470-b501-53aa3f011360 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:58.409255 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bb45e26c-11ba-4470-b501-53aa3f011360 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:58.666632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-72e1bbfd-1271-44f2-9261-c46321d81cd2 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f4686138b80>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:58.741342 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bb45e26c-11ba-4470-b501-53aa3f011360 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:58.754541 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-72e1bbfd-1271-44f2-9261-c46321d81cd2 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a" status: 200 len: 1419 microversion: 2.1 time: 0.091993 Jul 25 14:50:58.755597 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bb45e26c-11ba-4470-b501-53aa3f011360 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1492 microversion: 2.1 time: 0.381714 Jul 25 14:50:58.758989 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2366/4982] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:58 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1492 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:58.767251 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-77103d41-23c1-4955-ab68-ae95d0193c5d tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:58.769870 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-77103d41-23c1-4955-ab68-ae95d0193c5d tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 298b0992-a307-40cf-a42a-9964e711730e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:58.773458 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2617/4983] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:50:58 2022] GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a => generated 1419 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:58.785007 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:50:58.788020 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77103d41-23c1-4955-ab68-ae95d0193c5d tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:58.789593 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77103d41-23c1-4955-ab68-ae95d0193c5d tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:58.792920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77103d41-23c1-4955-ab68-ae95d0193c5d tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:58.793519 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77103d41-23c1-4955-ab68-ae95d0193c5d tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:58.889317 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bd7034e4-d012-4d46-8d6c-4c1234f3ff75 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:58.891706 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bd7034e4-d012-4d46-8d6c-4c1234f3ff75 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:58.907437 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bd7034e4-d012-4d46-8d6c-4c1234f3ff75 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:58.910253 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bd7034e4-d012-4d46-8d6c-4c1234f3ff75 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:58.911485 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bd7034e4-d012-4d46-8d6c-4c1234f3ff75 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:58.914651 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bd7034e4-d012-4d46-8d6c-4c1234f3ff75 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:58.996712 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bd7034e4-d012-4d46-8d6c-4c1234f3ff75 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107669 Jul 25 14:50:58.997847 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2618/4984] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:50:58 2022] GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:50:59.620982 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-77103d41-23c1-4955-ab68-ae95d0193c5d tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0c7ce41d64772a87a0ec7416ae6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68574d1c346d4507a2c25afd4de146e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:50:59.644365 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-77103d41-23c1-4955-ab68-ae95d0193c5d tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e" status: 200 len: 1318 microversion: 2.1 time: 0.871694 Jul 25 14:50:59.645648 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2367/4985] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:58 2022] GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e => generated 1318 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:50:59.784872 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e3694aef-ce9c-4418-8ede-554bf8d0095b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:59.786679 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e3694aef-ce9c-4418-8ede-554bf8d0095b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:50:59.788713 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-218e5621-4c03-4860-baed-a3338993ddf1 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f46866a1160>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:50:59.813444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3694aef-ce9c-4418-8ede-554bf8d0095b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:59.814263 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3694aef-ce9c-4418-8ede-554bf8d0095b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:59.815409 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3694aef-ce9c-4418-8ede-554bf8d0095b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:50:59.816114 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3694aef-ce9c-4418-8ede-554bf8d0095b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:50:59.841271 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-218e5621-4c03-4860-baed-a3338993ddf1 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a" status: 200 len: 1419 microversion: 2.1 time: 0.056320 Jul 25 14:50:59.850872 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2368/4986] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:50:59 2022] GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a => generated 1419 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:00.009647 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-60663484-9a6e-4dc9-8e72-a417e2652ccb tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:00.012271 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-60663484-9a6e-4dc9-8e72-a417e2652ccb tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:00.036905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-60663484-9a6e-4dc9-8e72-a417e2652ccb tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:00.037379 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-60663484-9a6e-4dc9-8e72-a417e2652ccb tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:00.038222 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-60663484-9a6e-4dc9-8e72-a417e2652ccb tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:00.038663 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-60663484-9a6e-4dc9-8e72-a417e2652ccb tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:00.144697 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-60663484-9a6e-4dc9-8e72-a417e2652ccb tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139254 Jul 25 14:51:00.154000 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2369/4987] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:51:00 2022] GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:51:00.355726 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e3694aef-ce9c-4418-8ede-554bf8d0095b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:00.367138 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e3694aef-ce9c-4418-8ede-554bf8d0095b tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1492 microversion: 2.1 time: 0.585024 Jul 25 14:51:00.381687 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2619/4988] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:50:59 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1492 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:00.666527 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3cb322d7-1861-4b0d-8372-d10e2495f9a8 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:00.667174 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3cb322d7-1861-4b0d-8372-d10e2495f9a8 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 298b0992-a307-40cf-a42a-9964e711730e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:00.708656 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3cb322d7-1861-4b0d-8372-d10e2495f9a8 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:00.710388 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3cb322d7-1861-4b0d-8372-d10e2495f9a8 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:00.713166 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3cb322d7-1861-4b0d-8372-d10e2495f9a8 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:00.716333 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3cb322d7-1861-4b0d-8372-d10e2495f9a8 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:00.861218 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5ad129e0-231e-4adf-90f8-4ecfc39c722e tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f4686131f70>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:00.944955 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5ad129e0-231e-4adf-90f8-4ecfc39c722e tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a" status: 200 len: 1419 microversion: 2.1 time: 0.088010 Jul 25 14:51:00.946182 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2620/4989] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:00 2022] GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a => generated 1419 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:01.164163 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-699b1dee-6438-48e2-a51e-b64278c62523 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:01.167198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-699b1dee-6438-48e2-a51e-b64278c62523 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:01.186066 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-699b1dee-6438-48e2-a51e-b64278c62523 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:01.186875 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-699b1dee-6438-48e2-a51e-b64278c62523 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:01.188002 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-699b1dee-6438-48e2-a51e-b64278c62523 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:01.188646 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-699b1dee-6438-48e2-a51e-b64278c62523 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:01.233164 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:51:01.251275 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3cb322d7-1861-4b0d-8372-d10e2495f9a8 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0c7ce41d64772a87a0ec7416ae6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68574d1c346d4507a2c25afd4de146e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:01.268966 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3cb322d7-1861-4b0d-8372-d10e2495f9a8 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e" status: 200 len: 1318 microversion: 2.1 time: 0.605149 Jul 25 14:51:01.275806 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-699b1dee-6438-48e2-a51e-b64278c62523 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114552 Jul 25 14:51:01.280387 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2621/4990] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:51:01 2022] GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:51:01.284376 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2370/4991] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:00 2022] GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e => generated 1318 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:01.391451 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5bff1ab2-8759-489b-8386-b8b0b26b71ba tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:01.392400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5bff1ab2-8759-489b-8386-b8b0b26b71ba tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:01.414964 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5bff1ab2-8759-489b-8386-b8b0b26b71ba tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:01.415433 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5bff1ab2-8759-489b-8386-b8b0b26b71ba tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:01.416588 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5bff1ab2-8759-489b-8386-b8b0b26b71ba tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:01.417027 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5bff1ab2-8759-489b-8386-b8b0b26b71ba tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:01.661370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5bff1ab2-8759-489b-8386-b8b0b26b71ba tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:01.688804 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5bff1ab2-8759-489b-8386-b8b0b26b71ba tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1492 microversion: 2.1 time: 0.301463 Jul 25 14:51:01.695103 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2622/4992] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:01 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1492 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:01.963742 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-41548146-b712-4777-82d6-d8d48c3c339b tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f4686b7a940>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:02.096914 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-41548146-b712-4777-82d6-d8d48c3c339b tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a" status: 200 len: 1419 microversion: 2.1 time: 0.139220 Jul 25 14:51:02.104904 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2371/4993] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:01 2022] GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a => generated 1419 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:02.291856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e9aea3bc-a26a-4b0a-8753-f41d69d397af tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:02.294692 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6ed1c481-06c5-415a-bc0a-acd3dae745b5 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:02.295333 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6ed1c481-06c5-415a-bc0a-acd3dae745b5 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 298b0992-a307-40cf-a42a-9964e711730e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:02.303417 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e9aea3bc-a26a-4b0a-8753-f41d69d397af tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:02.312745 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ed1c481-06c5-415a-bc0a-acd3dae745b5 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:02.313194 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ed1c481-06c5-415a-bc0a-acd3dae745b5 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:02.316913 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ed1c481-06c5-415a-bc0a-acd3dae745b5 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:02.318011 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ed1c481-06c5-415a-bc0a-acd3dae745b5 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:02.318685 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e9aea3bc-a26a-4b0a-8753-f41d69d397af tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:02.320876 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e9aea3bc-a26a-4b0a-8753-f41d69d397af tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:02.321946 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e9aea3bc-a26a-4b0a-8753-f41d69d397af tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:02.326646 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e9aea3bc-a26a-4b0a-8753-f41d69d397af tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:02.407207 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e9aea3bc-a26a-4b0a-8753-f41d69d397af tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122067 Jul 25 14:51:02.414829 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2623/4994] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:51:02 2022] GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:51:02.755257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2d14347f-5cb4-4deb-b633-d387b4a4a369 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:02.756255 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2d14347f-5cb4-4deb-b633-d387b4a4a369 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:02.766253 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d14347f-5cb4-4deb-b633-d387b4a4a369 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:02.775290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d14347f-5cb4-4deb-b633-d387b4a4a369 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:02.776569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d14347f-5cb4-4deb-b633-d387b4a4a369 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:02.777183 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d14347f-5cb4-4deb-b633-d387b4a4a369 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:03.017403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2d14347f-5cb4-4deb-b633-d387b4a4a369 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:03.026708 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2d14347f-5cb4-4deb-b633-d387b4a4a369 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1492 microversion: 2.1 time: 0.276766 Jul 25 14:51:03.028095 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2624/4995] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:02 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1492 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:51:03.115158 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-449a5bd3-3ef8-47a3-bc21-d19f61424ef2 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f46864fbdc0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:03.198940 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-449a5bd3-3ef8-47a3-bc21-d19f61424ef2 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a" status: 200 len: 1419 microversion: 2.1 time: 0.089507 Jul 25 14:51:03.202308 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2625/4996] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:03 2022] GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a => generated 1419 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:03.412503 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6ed1c481-06c5-415a-bc0a-acd3dae745b5 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0c7ce41d64772a87a0ec7416ae6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68574d1c346d4507a2c25afd4de146e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:03.427523 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-376d170e-6b64-4df7-a968-fbfa322708c4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:03.431132 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-376d170e-6b64-4df7-a968-fbfa322708c4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:03.451303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-376d170e-6b64-4df7-a968-fbfa322708c4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:03.453474 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-376d170e-6b64-4df7-a968-fbfa322708c4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:03.453474 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-376d170e-6b64-4df7-a968-fbfa322708c4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:03.453474 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-376d170e-6b64-4df7-a968-fbfa322708c4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:03.457023 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6ed1c481-06c5-415a-bc0a-acd3dae745b5 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e" status: 200 len: 1507 microversion: 2.1 time: 1.170179 Jul 25 14:51:03.457686 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2372/4997] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:02 2022] GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e => generated 1507 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:03.561030 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-376d170e-6b64-4df7-a968-fbfa322708c4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128191 Jul 25 14:51:03.563215 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2626/4998] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:51:03 2022] GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:51:03.715766 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-fa023562-d941-4c2b-a14d-59434c509edd req-4ed361bd-0f9e-4372-9c7b-13377120f5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a8df180-ea82-4f01-98a8-5d19c4bd5a5a", "name": "network-vif-deleted", "tag": "a3e26523-21b1-426c-97fd-3e98743e89e9"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:51:03.752323 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-fa023562-d941-4c2b-a14d-59434c509edd req-4ed361bd-0f9e-4372-9c7b-13377120f5b3 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:03.755051 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-fa023562-d941-4c2b-a14d-59434c509edd req-4ed361bd-0f9e-4372-9c7b-13377120f5b3 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:03.809449 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-fa023562-d941-4c2b-a14d-59434c509edd req-4ed361bd-0f9e-4372-9c7b-13377120f5b3 service nova] Creating event network-vif-deleted:a3e26523-21b1-426c-97fd-3e98743e89e9 for instance 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a on n-h1-846435-14 Jul 25 14:51:03.837992 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-fa023562-d941-4c2b-a14d-59434c509edd req-4ed361bd-0f9e-4372-9c7b-13377120f5b3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135272 Jul 25 14:51:03.838565 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2373/4999] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:51:04.048311 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2b9b54f7-68c4-4947-8845-675d055e6a15 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:04.049220 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2b9b54f7-68c4-4947-8845-675d055e6a15 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:04.060140 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b9b54f7-68c4-4947-8845-675d055e6a15 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:04.061102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b9b54f7-68c4-4947-8845-675d055e6a15 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:04.063937 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b9b54f7-68c4-4947-8845-675d055e6a15 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:04.064977 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b9b54f7-68c4-4947-8845-675d055e6a15 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:04.160662 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b9b54f7-68c4-4947-8845-675d055e6a15 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:04.168477 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b9b54f7-68c4-4947-8845-675d055e6a15 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:04.169419 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-2b9b54f7-68c4-4947-8845-675d055e6a15 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lazy-loading 'fault' on Instance uuid 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:51:04.218872 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b5b562f1-ae7b-4d37-80ff-9b28de6d080c tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f4686b41430>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:04.235071 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2b9b54f7-68c4-4947-8845-675d055e6a15 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c72922a47ea4af5a87a537fc463a2af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e1c3839c9f406db5686216c0e9c83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:04.246996 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2b9b54f7-68c4-4947-8845-675d055e6a15 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 200 len: 1304 microversion: 2.1 time: 0.202564 Jul 25 14:51:04.275476 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2627/5000] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:04 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 1304 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:04.378234 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b5b562f1-ae7b-4d37-80ff-9b28de6d080c tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a" status: 200 len: 1419 microversion: 2.1 time: 0.157503 Jul 25 14:51:04.380263 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2374/5001] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:04 2022] GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a => generated 1419 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:04.578529 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f6ad40cf-8e89-4124-a990-ee30f5b16467 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:04.585698 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f6ad40cf-8e89-4124-a990-ee30f5b16467 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:04.617817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6ad40cf-8e89-4124-a990-ee30f5b16467 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:04.618652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6ad40cf-8e89-4124-a990-ee30f5b16467 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:04.622618 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6ad40cf-8e89-4124-a990-ee30f5b16467 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:04.623183 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6ad40cf-8e89-4124-a990-ee30f5b16467 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:04.703667 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f6ad40cf-8e89-4124-a990-ee30f5b16467 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133635 Jul 25 14:51:04.704303 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2628/5002] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:51:04 2022] GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:51:05.280415 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-26ea3146-33ec-45ba-a4a0-97c42b4ec390 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:05.281758 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-26ea3146-33ec-45ba-a4a0-97c42b4ec390 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] [instance: 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:05.303907 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-26ea3146-33ec-45ba-a4a0-97c42b4ec390 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:05.307412 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-26ea3146-33ec-45ba-a4a0-97c42b4ec390 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:05.310327 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-26ea3146-33ec-45ba-a4a0-97c42b4ec390 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:05.311330 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-26ea3146-33ec-45ba-a4a0-97c42b4ec390 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:05.369582 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-26ea3146-33ec-45ba-a4a0-97c42b4ec390 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] HTTP exception thrown: Instance 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a could not be found. Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-26ea3146-33ec-45ba-a4a0-97c42b4ec390 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Request method failure captured: Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a HTTP/1.1 Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q1bpmHJ5_rMB5-6SEmItyHt3CUNP-BP74f5EZihxj6f8qE1nhyG3BsmHM9-w8UczXtSCXx-MWnHgqG9P2wJKgv6tvXz1MHG9354Y_LkQScT4LDvtucNvm8mWCHtszLFwHF2t0RMWF_hm_Vs9ChwexHRwb0kWeZQWMMUoCvhtLbRP3c Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 47e1c3839c9f406db5686216c0e9c83e Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServerRescueTestJSON-1586053606 Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/47e1c3839c9f406db5686216c0e9c83e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/47e1c3839c9f406db5686216c0e9c83e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_47e1c3839c9f406db5686216c0e9c83e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/47e1c3839c9f406db5686216c0e9c83e"}]}] Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServerRescueTestJSON-1586053606 Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 47e1c3839c9f406db5686216c0e9c83e Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServerRescueTestJSON-1586053606 Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServerRescueTestJSON-1586053606-project Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 4c72922a47ea4af5a87a537fc463a2af Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServerRescueTestJSON-1586053606-project Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a could not be found. Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '4a8df180-ea82-4f01-98a8-5d19c4bd5a5a'} Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a could not be found. Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a could not be found. Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:51:05.374717 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:51:05.380408 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:51:05.380408 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:51:05.380408 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:51:05.380408 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:51:05.380408 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:51:05.380408 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a could not be found. Jul 25 14:51:05.380408 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:51:05.382960 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-26ea3146-33ec-45ba-a4a0-97c42b4ec390 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] Returning 404 to user: Instance 4a8df180-ea82-4f01-98a8-5d19c4bd5a5a could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:51:05.387207 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-26ea3146-33ec-45ba-a4a0-97c42b4ec390 tempest-ServerRescueTestJSON-1586053606 tempest-ServerRescueTestJSON-1586053606-project] 10.222.0.88 "GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a" status: 404 len: 111 microversion: 2.1 time: 0.111791 Jul 25 14:51:05.388001 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2375/5003] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:05 2022] GET /compute/v2.1/servers/4a8df180-ea82-4f01-98a8-5d19c4bd5a5a => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:51:05.408988 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f647c7b8-2ba3-4697-a346-855c08b3e389 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f46864fbb80>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:05.742859 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2f113f20-268c-41f1-b254-ecdc647ab323 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:05.750456 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2f113f20-268c-41f1-b254-ecdc647ab323 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:05.769811 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f113f20-268c-41f1-b254-ecdc647ab323 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:05.770299 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f113f20-268c-41f1-b254-ecdc647ab323 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:05.778035 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f113f20-268c-41f1-b254-ecdc647ab323 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:05.778687 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f113f20-268c-41f1-b254-ecdc647ab323 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:05.833471 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:51:05.871231 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2f113f20-268c-41f1-b254-ecdc647ab323 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.158769 Jul 25 14:51:05.885139 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2376/5004] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:51:05 2022] GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412/os-volume_attachments => generated 25 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 14:51:05.976581 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fc861ab6-560b-4d94-9dff-83c5c2d06f74 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:05.977729 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fc861ab6-560b-4d94-9dff-83c5c2d06f74 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:05.990022 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fc861ab6-560b-4d94-9dff-83c5c2d06f74 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:05.991045 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fc861ab6-560b-4d94-9dff-83c5c2d06f74 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:05.992085 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fc861ab6-560b-4d94-9dff-83c5c2d06f74 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:05.992752 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fc861ab6-560b-4d94-9dff-83c5c2d06f74 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:06.056709 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fc861ab6-560b-4d94-9dff-83c5c2d06f74 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:51:06.263522 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fc861ab6-560b-4d94-9dff-83c5c2d06f74 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "DELETE /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412" status: 204 len: 0 microversion: 2.1 time: 0.291072 Jul 25 14:51:06.284467 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2377/5005] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:51:05 2022] DELETE /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 14:51:06.297582 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-62ac6298-5965-4623-a3db-d068a9634487 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:06.298296 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-62ac6298-5965-4623-a3db-d068a9634487 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:06.320388 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f647c7b8-2ba3-4697-a346-855c08b3e389 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a" status: 200 len: 1428 microversion: 2.1 time: 0.926224 Jul 25 14:51:06.320985 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2629/5006] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:05 2022] GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a => generated 1428 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:06.324484 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-62ac6298-5965-4623-a3db-d068a9634487 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:06.326668 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-62ac6298-5965-4623-a3db-d068a9634487 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:06.329392 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-62ac6298-5965-4623-a3db-d068a9634487 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:06.330628 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-62ac6298-5965-4623-a3db-d068a9634487 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:06.334900 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c85e6c78-7fa3-48ab-8a86-a159496dfc6f tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f46861468b0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:06.405982 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c85e6c78-7fa3-48ab-8a86-a159496dfc6f tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a" status: 200 len: 1428 microversion: 2.1 time: 0.075682 Jul 25 14:51:06.410706 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2630/5007] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:06 2022] GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a => generated 1428 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:51:06.423595 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a1a1e514-1b45-40f4-8ff3-34ec3b3814b8 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:06.424485 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a1a1e514-1b45-40f4-8ff3-34ec3b3814b8 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] [instance: b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:06.431152 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1a1e514-1b45-40f4-8ff3-34ec3b3814b8 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:06.431599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1a1e514-1b45-40f4-8ff3-34ec3b3814b8 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:06.437630 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1a1e514-1b45-40f4-8ff3-34ec3b3814b8 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:06.438309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1a1e514-1b45-40f4-8ff3-34ec3b3814b8 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:06.579608 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-62ac6298-5965-4623-a3db-d068a9634487 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:06.594421 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-62ac6298-5965-4623-a3db-d068a9634487 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412" status: 200 len: 1682 microversion: 2.1 time: 0.304231 Jul 25 14:51:06.595925 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2378/5008] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:06 2022] GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412 => generated 1682 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:06.704878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a1a1e514-1b45-40f4-8ff3-34ec3b3814b8 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d15b8d3057425dbf014609cacef9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a6bbf7f4541bbba9249cd2ce3a9a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:06.714870 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a1a1e514-1b45-40f4-8ff3-34ec3b3814b8 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736" status: 200 len: 1478 microversion: 2.1 time: 0.295105 Jul 25 14:51:06.716246 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2631/5009] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:06 2022] GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 => generated 1478 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:07.621263 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-28f1f1bc-7583-4499-889a-bd44f57c4d43 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:07.622864 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-28f1f1bc-7583-4499-889a-bd44f57c4d43 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:07.636099 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-28f1f1bc-7583-4499-889a-bd44f57c4d43 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:07.636898 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-28f1f1bc-7583-4499-889a-bd44f57c4d43 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:07.638874 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-28f1f1bc-7583-4499-889a-bd44f57c4d43 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:07.639604 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-28f1f1bc-7583-4499-889a-bd44f57c4d43 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:07.739585 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1c1014d0-7bc8-40af-8e54-d787ebcd99dc tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:07.740260 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1c1014d0-7bc8-40af-8e54-d787ebcd99dc tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] [instance: b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:07.775664 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1c1014d0-7bc8-40af-8e54-d787ebcd99dc tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:07.776615 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1c1014d0-7bc8-40af-8e54-d787ebcd99dc tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:07.792352 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1c1014d0-7bc8-40af-8e54-d787ebcd99dc tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:07.792933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1c1014d0-7bc8-40af-8e54-d787ebcd99dc tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:07.889336 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-28f1f1bc-7583-4499-889a-bd44f57c4d43 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:07.900079 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-28f1f1bc-7583-4499-889a-bd44f57c4d43 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412" status: 200 len: 1682 microversion: 2.1 time: 0.284984 Jul 25 14:51:07.903115 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2379/5010] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:07 2022] GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412 => generated 1682 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:08.155695 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1c1014d0-7bc8-40af-8e54-d787ebcd99dc tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d15b8d3057425dbf014609cacef9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a6bbf7f4541bbba9249cd2ce3a9a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:08.172187 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1c1014d0-7bc8-40af-8e54-d787ebcd99dc tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736" status: 200 len: 1478 microversion: 2.1 time: 0.437095 Jul 25 14:51:08.187426 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2632/5011] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:07 2022] GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 => generated 1478 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:51:08.925263 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-05227df0-e48d-4326-86d3-077633b4a822 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:08.925893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-05227df0-e48d-4326-86d3-077633b4a822 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:08.951277 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-05227df0-e48d-4326-86d3-077633b4a822 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:08.952420 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-05227df0-e48d-4326-86d3-077633b4a822 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:08.955637 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-05227df0-e48d-4326-86d3-077633b4a822 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:08.956276 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-05227df0-e48d-4326-86d3-077633b4a822 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:09.195221 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0f87fb5d-f4b1-4ce6-867a-5659e6b46fee tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:09.196985 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0f87fb5d-f4b1-4ce6-867a-5659e6b46fee tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] [instance: b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:09.211589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0f87fb5d-f4b1-4ce6-867a-5659e6b46fee tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:09.212603 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0f87fb5d-f4b1-4ce6-867a-5659e6b46fee tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:09.214065 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0f87fb5d-f4b1-4ce6-867a-5659e6b46fee tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:09.217125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0f87fb5d-f4b1-4ce6-867a-5659e6b46fee tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:09.430779 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-05227df0-e48d-4326-86d3-077633b4a822 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:09.448519 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-05227df0-e48d-4326-86d3-077633b4a822 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412" status: 200 len: 1682 microversion: 2.1 time: 0.529931 Jul 25 14:51:09.465714 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2380/5012] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:08 2022] GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412 => generated 1682 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:09.793201 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0f87fb5d-f4b1-4ce6-867a-5659e6b46fee tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d15b8d3057425dbf014609cacef9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a6bbf7f4541bbba9249cd2ce3a9a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:09.821226 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0f87fb5d-f4b1-4ce6-867a-5659e6b46fee tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736" status: 200 len: 1465 microversion: 2.1 time: 0.621170 Jul 25 14:51:09.827609 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2633/5013] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:09 2022] GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 => generated 1465 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:09.850746 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e733d046-5564-46c6-ae96-18dc433a8fe1 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f4686c06f70>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:09.951576 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e733d046-5564-46c6-ae96-18dc433a8fe1 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/a7b14aba-1848-4a00-a3e7-b66eb3e97925" status: 200 len: 784 microversion: 2.1 time: 0.102790 Jul 25 14:51:09.962520 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2381/5014] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:09 2022] GET /compute/v2.1/images/a7b14aba-1848-4a00-a3e7-b66eb3e97925 => generated 784 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:51:09.984008 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0ed55078-e7ab-4ae9-a63a-7f2675288e3b tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:10.023653 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0ed55078-e7ab-4ae9-a63a-7f2675288e3b tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.059498 Jul 25 14:51:10.041831 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2634/5015] 10.222.0.88 () {58 vars in 1137 bytes} [Mon Jul 25 14:51:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:51:10.053319 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0bc4c108-f712-4998-a215-cdb5fac550f6 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f4686a44ca0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:10.470584 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5d507946-c350-4cef-b3ce-1fe2e2c58ec1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:10.471210 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5d507946-c350-4cef-b3ce-1fe2e2c58ec1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:10.484270 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d507946-c350-4cef-b3ce-1fe2e2c58ec1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:10.484721 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d507946-c350-4cef-b3ce-1fe2e2c58ec1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:10.485502 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d507946-c350-4cef-b3ce-1fe2e2c58ec1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:10.504185 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d507946-c350-4cef-b3ce-1fe2e2c58ec1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:10.792728 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5d507946-c350-4cef-b3ce-1fe2e2c58ec1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:10.809025 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5d507946-c350-4cef-b3ce-1fe2e2c58ec1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412" status: 200 len: 1614 microversion: 2.1 time: 0.342770 Jul 25 14:51:10.810747 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2635/5016] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:10 2022] GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412 => generated 1614 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:51:11.130357 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-42b2c578-6162-40d0-8169-a9ddff92c458 req-da1388ec-3b92-4395-90d6-72f53ba665ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe421aa5-5038-479a-b496-04130c3de412", "name": "network-vif-deleted", "tag": "1335551c-edd6-407d-af39-b40797568790"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:51:11.177403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-42b2c578-6162-40d0-8169-a9ddff92c458 req-da1388ec-3b92-4395-90d6-72f53ba665ea service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:11.180216 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-42b2c578-6162-40d0-8169-a9ddff92c458 req-da1388ec-3b92-4395-90d6-72f53ba665ea service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:11.206683 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0bc4c108-f712-4998-a215-cdb5fac550f6 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "DELETE /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a" status: 204 len: 0 microversion: 2.1 time: 1.163744 Jul 25 14:51:11.207213 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2382/5017] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:10 2022] DELETE /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a => generated 0 bytes in 1172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 14:51:11.216641 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e5657826-230a-4b6a-9ab3-63e1f5887b10 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f4686ad2940>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:11.222269 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-42b2c578-6162-40d0-8169-a9ddff92c458 req-da1388ec-3b92-4395-90d6-72f53ba665ea service nova] Creating event network-vif-deleted:1335551c-edd6-407d-af39-b40797568790 for instance fe421aa5-5038-479a-b496-04130c3de412 on n-h2-846435-14 Jul 25 14:51:11.250588 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-42b2c578-6162-40d0-8169-a9ddff92c458 req-da1388ec-3b92-4395-90d6-72f53ba665ea service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.403039 Jul 25 14:51:11.254124 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2636/5018] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:51:11.259892 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-e5657826-230a-4b6a-9ab3-63e1f5887b10 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] HTTP exception thrown: Image not found. Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e5657826-230a-4b6a-9ab3-63e1f5887b10 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Request method failure captured: Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a HTTP/1.1 Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q2l0e2yo1jNqh4BurHmAud90lxwsySbCA1bryVHAa8QAx-D2zW7NbynlsTX4MnxHfCrOvLCcjzeRdLsdfJHFR1ViMSaXh7mZe1uJHPM4enUCYRRSkDGsZhtDJXkVVEiNN1Xn090LpIVUSr6X0cDLtxLmMu8VPKCM2IXOrAqAXCNIJY Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 572a6bbf7f4541bbba9249cd2ce3a9a8 Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ImagesOneServerTestJSON-59585443 Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/572a6bbf7f4541bbba9249cd2ce3a9a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/572a6bbf7f4541bbba9249cd2ce3a9a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_572a6bbf7f4541bbba9249cd2ce3a9a8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/572a6bbf7f4541bbba9249cd2ce3a9a8"}]}] Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ImagesOneServerTestJSON-59585443 Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 572a6bbf7f4541bbba9249cd2ce3a9a8 Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-59585443 Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ImagesOneServerTestJSON-59585443-project Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: b0d15b8d3057425dbf014609cacef9e6 Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ImagesOneServerTestJSON-59585443-project Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: exception: Image not found. Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '14e1f34d-3c7e-46a1-9f79-f2232036b45a'} Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 14e1f34d-3c7e-46a1-9f79-f2232036b45a Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 14:51:11.262115 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 14e1f34d-3c7e-46a1-9f79-f2232036b45a could not be found. Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:51:11.267887 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e5657826-230a-4b6a-9ab3-63e1f5887b10 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Returning 404 to user: Image not found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:51:11.273032 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e5657826-230a-4b6a-9ab3-63e1f5887b10 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a" status: 404 len: 62 microversion: 2.1 time: 0.057925 Jul 25 14:51:11.273032 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2383/5019] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:11 2022] GET /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 25 14:51:11.297690 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5f85a9df-5e6b-4624-b35c-5a5c9ae7c9f6 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1192283570"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:51:11.314211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5f85a9df-5e6b-4624-b35c-5a5c9ae7c9f6 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] [instance: b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:11.331060 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5f85a9df-5e6b-4624-b35c-5a5c9ae7c9f6 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:11.332459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5f85a9df-5e6b-4624-b35c-5a5c9ae7c9f6 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:11.335353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5f85a9df-5e6b-4624-b35c-5a5c9ae7c9f6 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:11.336367 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5f85a9df-5e6b-4624-b35c-5a5c9ae7c9f6 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:11.834698 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5c5ce098-4780-4e56-b35f-db8a50a8cfc9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:11.835573 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5c5ce098-4780-4e56-b35f-db8a50a8cfc9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:11.849131 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5f85a9df-5e6b-4624-b35c-5a5c9ae7c9f6 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "POST /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736/action" status: 202 len: 0 microversion: 2.1 time: 0.563625 Jul 25 14:51:11.851727 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2637/5020] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:51:11 2022] POST /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736/action => generated 0 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 14:51:11.857603 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5c5ce098-4780-4e56-b35f-db8a50a8cfc9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:11.858702 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5c5ce098-4780-4e56-b35f-db8a50a8cfc9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:11.860003 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5c5ce098-4780-4e56-b35f-db8a50a8cfc9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:11.860681 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5c5ce098-4780-4e56-b35f-db8a50a8cfc9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:11.883166 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e889b84b-105e-4b4d-8b78-376e6774b64e tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f4686107af0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:11.894258 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-5c5ce098-4780-4e56-b35f-db8a50a8cfc9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] HTTP exception thrown: Instance fe421aa5-5038-479a-b496-04130c3de412 could not be found. Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5c5ce098-4780-4e56-b35f-db8a50a8cfc9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Request method failure captured: Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412 HTTP/1.1 Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qxVTVC8FUnn-t2qK29pQ6gpvvVkF5Cd1ek9O6-ax9bIU4h-Acw7IM2XyPTWfCK6LWhHPoO7fpkEcbhitPiuVrA5WlFZ0WfmMB-2I-MAtgO20bt12dRN-m_gApdOXiuB_IoQnmtlPGVQzahhzXBQE11eo5L_JzE39RyLIYMYF8wTD50 Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 325aff76e61141a985b3b0f45521444f Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/325aff76e61141a985b3b0f45521444f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/325aff76e61141a985b3b0f45521444f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_325aff76e61141a985b3b0f45521444f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/325aff76e61141a985b3b0f45521444f"}]}] Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 325aff76e61141a985b3b0f45521444f Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-AttachVolumeNegativeTest-1959370092-project Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 571a2d92d7a34f86bb3c0bfdfcabc5ff Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-AttachVolumeNegativeTest-1959370092-project Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance fe421aa5-5038-479a-b496-04130c3de412 could not be found. Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'fe421aa5-5038-479a-b496-04130c3de412'} Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe421aa5-5038-479a-b496-04130c3de412 could not be found. Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe421aa5-5038-479a-b496-04130c3de412 could not be found. Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:51:11.897315 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:51:11.903131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:51:11.903131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:51:11.903131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:51:11.903131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:51:11.903131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:51:11.903131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe421aa5-5038-479a-b496-04130c3de412 could not be found. Jul 25 14:51:11.903131 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:51:11.906785 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5c5ce098-4780-4e56-b35f-db8a50a8cfc9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Returning 404 to user: Instance fe421aa5-5038-479a-b496-04130c3de412 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:51:11.908027 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5c5ce098-4780-4e56-b35f-db8a50a8cfc9 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412" status: 404 len: 111 microversion: 2.1 time: 0.079285 Jul 25 14:51:11.912377 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2384/5021] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:11 2022] GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:51:11.926656 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f2f02f26-ca3d-4bc6-b5b3-6b7d5b688ae4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '.version_select at 0x7f4687216ee0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:11.986426 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f2f02f26-ca3d-4bc6-b5b3-6b7d5b688ae4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1683488160" status: 202 len: 0 microversion: 2.1 time: 0.068947 Jul 25 14:51:11.987717 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2385/5022] 10.222.0.88 () {58 vars in 1221 bytes} [Mon Jul 25 14:51:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1683488160 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 14:51:11.995093 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e889b84b-105e-4b4d-8b78-376e6774b64e tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1425 microversion: 2.1 time: 0.123998 Jul 25 14:51:12.008827 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2638/5023] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:11 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1425 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:12.924833 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-10c58132-a410-4a16-8a32-5e8968c63308 req-3a477d24-4d1f-4785-9bee-53b0c9785dfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736", "name": "network-vif-unplugged", "status": "completed", "tag": "35c26f0c-c295-4c03-b37c-60c401d0d30e"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:51:12.961320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-10c58132-a410-4a16-8a32-5e8968c63308 req-3a477d24-4d1f-4785-9bee-53b0c9785dfc service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:12.961876 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-10c58132-a410-4a16-8a32-5e8968c63308 req-3a477d24-4d1f-4785-9bee-53b0c9785dfc service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:12.993721 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-10c58132-a410-4a16-8a32-5e8968c63308 req-3a477d24-4d1f-4785-9bee-53b0c9785dfc service nova] Creating event network-vif-unplugged:35c26f0c-c295-4c03-b37c-60c401d0d30e for instance b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 on n-h2-846435-14 Jul 25 14:51:13.017098 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-10c58132-a410-4a16-8a32-5e8968c63308 req-3a477d24-4d1f-4785-9bee-53b0c9785dfc service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097060 Jul 25 14:51:13.019619 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2386/5024] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:51:13.023699 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9a803570-b85b-44f3-b9f4-bb7c8ece3fc9 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f46860d7e50>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:13.133339 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9a803570-b85b-44f3-b9f4-bb7c8ece3fc9 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1425 microversion: 2.1 time: 0.114007 Jul 25 14:51:13.136775 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2639/5025] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:13 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1425 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:13.654280 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e182970f-95ca-49de-a62b-7ba902e2f631 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Action: 'create', calling method: .version_select at 0x7f4686baee50>, body: {"keypair": {"name": "tempest-keypair-766092198", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJY3BmYGff2xbA69WK98Gx2772eU6mT+w6amRsbWNZ6B26ZK2LTXHM6EZREzAYA6XnMx6oI2lUGPD2LHSaGLuBi3uO2uj9syDf5KOPlallZm53vlZTnNnKXQX0qI4wj3A=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:51:13.674599 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-e182970f-95ca-49de-a62b-7ba902e2f631 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Getting quotas for project 325aff76e61141a985b3b0f45521444f. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:51:13.682986 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-e182970f-95ca-49de-a62b-7ba902e2f631 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Getting quotas for user 571a2d92d7a34f86bb3c0bfdfcabc5ff and project 325aff76e61141a985b3b0f45521444f. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:51:13.731264 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e182970f-95ca-49de-a62b-7ba902e2f631 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.085356 Jul 25 14:51:13.734786 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2387/5026] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:51:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:51:14.149101 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fd673f92-9fd0-4a8f-8a02-80dc0a88f07e tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f4686107160>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:14.210670 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fd673f92-9fd0-4a8f-8a02-80dc0a88f07e tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1425 microversion: 2.1 time: 0.065924 Jul 25 14:51:14.211844 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2640/5027] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:14 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1425 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:15.228848 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-59b6208c-3ccd-4367-9550-a252a2cefc78 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f4686992670>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:15.331335 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-59b6208c-3ccd-4367-9550-a252a2cefc78 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1425 microversion: 2.1 time: 0.108284 Jul 25 14:51:15.334039 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2388/5028] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:15 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1425 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:51:16.350139 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-309c8f7c-10f9-4970-976f-ecd28be7b27a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f468623d310>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:16.419871 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-309c8f7c-10f9-4970-976f-ecd28be7b27a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1425 microversion: 2.1 time: 0.075193 Jul 25 14:51:16.430151 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2641/5029] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:16 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1425 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:16.766274 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8db94289-a35d-4528-82ac-62e9b2649d9a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1142737641", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b6c60dc-780d-4845-b966-40a7e9d46848"}], "security_groups": [{"name": "tempest-securitygroup--884515973"}], "key_name": "tempest-keypair-766092198", "user_data": "}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:51:17.047909 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-8db94289-a35d-4528-82ac-62e9b2649d9a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] validate_networks() for [('4b6c60dc-780d-4845-b966-40a7e9d46848', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:51:17.454380 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-33d42565-18f4-4511-b62c-a72ecf10c86b tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f46860e5e50>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:17.536153 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-33d42565-18f4-4511-b62c-a72ecf10c86b tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1425 microversion: 2.1 time: 0.095993 Jul 25 14:51:17.537383 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2642/5030] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:17 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1425 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:18.552106 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bff13b0b-5522-4c93-bc79-473654d505ad tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f46861ede50>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:18.644086 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bff13b0b-5522-4c93-bc79-473654d505ad tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1425 microversion: 2.1 time: 0.091975 Jul 25 14:51:18.646044 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2643/5031] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:18 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1425 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:51:18.742708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-8db94289-a35d-4528-82ac-62e9b2649d9a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:51:18.743936 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-8db94289-a35d-4528-82ac-62e9b2649d9a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:51:18.744493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-8db94289-a35d-4528-82ac-62e9b2649d9a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:51:18.744917 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-8db94289-a35d-4528-82ac-62e9b2649d9a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:51:18.745338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-8db94289-a35d-4528-82ac-62e9b2649d9a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:51:18.759489 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8db94289-a35d-4528-82ac-62e9b2649d9a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:18.760336 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8db94289-a35d-4528-82ac-62e9b2649d9a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:18.765662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8db94289-a35d-4528-82ac-62e9b2649d9a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:18.766527 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8db94289-a35d-4528-82ac-62e9b2649d9a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:18.808097 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-8db94289-a35d-4528-82ac-62e9b2649d9a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Getting quotas for project 325aff76e61141a985b3b0f45521444f. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:51:18.832206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-8db94289-a35d-4528-82ac-62e9b2649d9a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Getting quotas for user 571a2d92d7a34f86bb3c0bfdfcabc5ff and project 325aff76e61141a985b3b0f45521444f. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:51:18.858675 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8db94289-a35d-4528-82ac-62e9b2649d9a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:51:18.863783 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8db94289-a35d-4528-82ac-62e9b2649d9a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:51:19.025580 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8db94289-a35d-4528-82ac-62e9b2649d9a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.266276 Jul 25 14:51:19.031539 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2389/5032] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:51:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 2273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 14:51:19.042147 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-af3f14eb-6676-4082-87f1-b8bd91f49995 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:19.043198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-af3f14eb-6676-4082-87f1-b8bd91f49995 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:19.661796 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-234877b8-e2f1-43f9-aa85-ee463b3bc12f tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f4686b28ee0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:19.754019 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-234877b8-e2f1-43f9-aa85-ee463b3bc12f tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1425 microversion: 2.1 time: 0.096616 Jul 25 14:51:19.754609 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2390/5033] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:19 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1425 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:19.831069 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-af3f14eb-6676-4082-87f1-b8bd91f49995 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:19.849849 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-af3f14eb-6676-4082-87f1-b8bd91f49995 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed" status: 200 len: 1241 microversion: 2.1 time: 0.812299 Jul 25 14:51:19.855277 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2644/5034] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:19 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed => generated 1241 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:20.769943 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dab45158-bb66-4d6a-b4dd-4c0b15188469 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f46868b2700>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:20.877953 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8f759b1c-a001-4e8e-90ef-40fb20605359 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:20.877953 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8f759b1c-a001-4e8e-90ef-40fb20605359 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:20.900848 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f759b1c-a001-4e8e-90ef-40fb20605359 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:20.907225 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f759b1c-a001-4e8e-90ef-40fb20605359 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:20.909449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f759b1c-a001-4e8e-90ef-40fb20605359 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:20.911308 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f759b1c-a001-4e8e-90ef-40fb20605359 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:20.985449 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dab45158-bb66-4d6a-b4dd-4c0b15188469 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1425 microversion: 2.1 time: 0.220437 Jul 25 14:51:20.988492 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2391/5035] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:20 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1425 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:21.210236 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8f759b1c-a001-4e8e-90ef-40fb20605359 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:21.236344 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8f759b1c-a001-4e8e-90ef-40fb20605359 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed" status: 200 len: 1237 microversion: 2.1 time: 0.357491 Jul 25 14:51:21.238213 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2645/5036] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:20 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed => generated 1237 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:22.003755 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-030a5c58-a084-4190-bb19-ffe2eb55a4de tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f46874f1310>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:22.262683 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ebed5175-9048-489b-8911-efbe572280ed tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:22.264482 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ebed5175-9048-489b-8911-efbe572280ed tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:22.290404 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ebed5175-9048-489b-8911-efbe572280ed tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:22.291086 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ebed5175-9048-489b-8911-efbe572280ed tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:22.294269 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ebed5175-9048-489b-8911-efbe572280ed tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:22.299941 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ebed5175-9048-489b-8911-efbe572280ed tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:22.560339 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ebed5175-9048-489b-8911-efbe572280ed tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:22.573308 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ebed5175-9048-489b-8911-efbe572280ed tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed" status: 200 len: 1299 microversion: 2.1 time: 0.316228 Jul 25 14:51:22.577956 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2646/5037] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:22 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed => generated 1299 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:22.589098 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b5af92d1-d2ed-4e54-8560-33a86af6f20c tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:22.593798 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b5af92d1-d2ed-4e54-8560-33a86af6f20c tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] [instance: 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:22.602859 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b5af92d1-d2ed-4e54-8560-33a86af6f20c tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:22.605336 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b5af92d1-d2ed-4e54-8560-33a86af6f20c tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:22.606427 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b5af92d1-d2ed-4e54-8560-33a86af6f20c tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:22.606762 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b5af92d1-d2ed-4e54-8560-33a86af6f20c tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:22.711182 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b5af92d1-d2ed-4e54-8560-33a86af6f20c tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] [instance: 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:51:22.729602 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:51:22.986153 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b5af92d1-d2ed-4e54-8560-33a86af6f20c tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] 10.222.0.88 "DELETE /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e" status: 204 len: 0 microversion: 2.1 time: 0.400937 Jul 25 14:51:22.988969 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2647/5038] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:51:22 2022] DELETE /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 14:51:23.004639 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-78d43b61-4217-4123-be84-8d08b252ab19 req-48243645-00a3-4a2f-9dca-590415637f99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e", "tag": "d3d30104-e768-41d5-993f-98045266d43b"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:51:23.053655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-78d43b61-4217-4123-be84-8d08b252ab19 req-48243645-00a3-4a2f-9dca-590415637f99 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:23.059449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-78d43b61-4217-4123-be84-8d08b252ab19 req-48243645-00a3-4a2f-9dca-590415637f99 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:23.105208 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-78d43b61-4217-4123-be84-8d08b252ab19 req-48243645-00a3-4a2f-9dca-590415637f99 service nova] Creating event network-changed:d3d30104-e768-41d5-993f-98045266d43b for instance 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e on n-h1-846435-14 Jul 25 14:51:23.123072 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-78d43b61-4217-4123-be84-8d08b252ab19 req-48243645-00a3-4a2f-9dca-590415637f99 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132167 Jul 25 14:51:23.125408 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2648/5039] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:51:23.157437 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-8b64fc34-d71c-4d12-8876-fae04fd2fd0e req-395cfaf7-2012-4590-866d-afdc3cf862cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736", "name": "network-vif-plugged", "status": "completed", "tag": "35c26f0c-c295-4c03-b37c-60c401d0d30e"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:51:23.194632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-8b64fc34-d71c-4d12-8876-fae04fd2fd0e req-395cfaf7-2012-4590-866d-afdc3cf862cd service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:23.195249 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-8b64fc34-d71c-4d12-8876-fae04fd2fd0e req-395cfaf7-2012-4590-866d-afdc3cf862cd service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:23.236467 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-8b64fc34-d71c-4d12-8876-fae04fd2fd0e req-395cfaf7-2012-4590-866d-afdc3cf862cd service nova] Creating event network-vif-plugged:35c26f0c-c295-4c03-b37c-60c401d0d30e for instance b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 on n-h2-846435-14 Jul 25 14:51:23.266370 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-8b64fc34-d71c-4d12-8876-fae04fd2fd0e req-395cfaf7-2012-4590-866d-afdc3cf862cd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139442 Jul 25 14:51:23.275749 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2649/5040] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:51:23.286400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-16c0a7f2-5c51-45e0-a55e-e6dae800c1c3 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:23.291936 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-16c0a7f2-5c51-45e0-a55e-e6dae800c1c3 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] [instance: 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:23.313703 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-16c0a7f2-5c51-45e0-a55e-e6dae800c1c3 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:23.314502 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-16c0a7f2-5c51-45e0-a55e-e6dae800c1c3 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:23.315542 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-16c0a7f2-5c51-45e0-a55e-e6dae800c1c3 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:23.319497 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-16c0a7f2-5c51-45e0-a55e-e6dae800c1c3 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:23.792436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-16c0a7f2-5c51-45e0-a55e-e6dae800c1c3 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91784e3a38a34d3ca64a06b2617a0154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65097f882d949469009707d1eff8506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:23.818644 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-16c0a7f2-5c51-45e0-a55e-e6dae800c1c3 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] 10.222.0.88 "GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e" status: 200 len: 1732 microversion: 2.1 time: 0.540363 Jul 25 14:51:23.848563 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2650/5041] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:23 2022] GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e => generated 1732 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:23.867048 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ce7e0be1-dc64-4d27-ad28-ffe4a8624c77 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:23.867688 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ce7e0be1-dc64-4d27-ad28-ffe4a8624c77 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:23.890970 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce7e0be1-dc64-4d27-ad28-ffe4a8624c77 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:23.893757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce7e0be1-dc64-4d27-ad28-ffe4a8624c77 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:23.894558 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce7e0be1-dc64-4d27-ad28-ffe4a8624c77 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:23.897424 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce7e0be1-dc64-4d27-ad28-ffe4a8624c77 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:24.168196 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ce7e0be1-dc64-4d27-ad28-ffe4a8624c77 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:24.178200 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ce7e0be1-dc64-4d27-ad28-ffe4a8624c77 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed" status: 200 len: 1299 microversion: 2.1 time: 0.327825 Jul 25 14:51:24.178794 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2651/5042] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:23 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed => generated 1299 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:24.846935 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8c7014fb-fafb-4490-8834-c9cab3e88af3 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:24.847884 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8c7014fb-fafb-4490-8834-c9cab3e88af3 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] [instance: 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:24.878025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8c7014fb-fafb-4490-8834-c9cab3e88af3 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:24.878600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8c7014fb-fafb-4490-8834-c9cab3e88af3 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:24.879444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8c7014fb-fafb-4490-8834-c9cab3e88af3 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:24.880338 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8c7014fb-fafb-4490-8834-c9cab3e88af3 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:25.493789 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8c7014fb-fafb-4490-8834-c9cab3e88af3 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91784e3a38a34d3ca64a06b2617a0154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65097f882d949469009707d1eff8506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:25.505058 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8c7014fb-fafb-4490-8834-c9cab3e88af3 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] 10.222.0.88 "GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e" status: 200 len: 1732 microversion: 2.1 time: 0.662339 Jul 25 14:51:25.507837 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2652/5043] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:24 2022] GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e => generated 1732 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:51:25.519548 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c4419ae4-7e89-487c-b75e-7da4c70d11c0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:25.520396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c4419ae4-7e89-487c-b75e-7da4c70d11c0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:25.561304 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c4419ae4-7e89-487c-b75e-7da4c70d11c0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:25.562811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c4419ae4-7e89-487c-b75e-7da4c70d11c0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:25.564662 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c4419ae4-7e89-487c-b75e-7da4c70d11c0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:25.566046 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c4419ae4-7e89-487c-b75e-7da4c70d11c0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:25.752592 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c4419ae4-7e89-487c-b75e-7da4c70d11c0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:25.762661 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c4419ae4-7e89-487c-b75e-7da4c70d11c0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed" status: 200 len: 1299 microversion: 2.1 time: 0.253449 Jul 25 14:51:25.767760 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2653/5044] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:25 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed => generated 1299 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:26.194999 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-5b9da01e-10e8-43b4-ab29-daf80c6ddb2e req-462038dc-c714-4ef1-94a6-c981e6036080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e", "name": "network-vif-deleted", "tag": "d3d30104-e768-41d5-993f-98045266d43b"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:51:26.208951 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-5b9da01e-10e8-43b4-ab29-daf80c6ddb2e req-462038dc-c714-4ef1-94a6-c981e6036080 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:26.209397 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-5b9da01e-10e8-43b4-ab29-daf80c6ddb2e req-462038dc-c714-4ef1-94a6-c981e6036080 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:26.225612 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-5b9da01e-10e8-43b4-ab29-daf80c6ddb2e req-462038dc-c714-4ef1-94a6-c981e6036080 service nova] Creating event network-vif-deleted:d3d30104-e768-41d5-993f-98045266d43b for instance 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e on n-h1-846435-14 Jul 25 14:51:26.235828 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-5b9da01e-10e8-43b4-ab29-daf80c6ddb2e req-462038dc-c714-4ef1-94a6-c981e6036080 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045595 Jul 25 14:51:26.242187 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2654/5045] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:51:26.529464 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-872884ff-e80e-4e2e-b6e4-8941785eff28 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:26.530245 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-872884ff-e80e-4e2e-b6e4-8941785eff28 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] [instance: 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:26.534239 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:51:26.551962 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-872884ff-e80e-4e2e-b6e4-8941785eff28 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:26.570172 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-872884ff-e80e-4e2e-b6e4-8941785eff28 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:26.571423 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-872884ff-e80e-4e2e-b6e4-8941785eff28 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:26.572801 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-872884ff-e80e-4e2e-b6e4-8941785eff28 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:26.783234 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-872884ff-e80e-4e2e-b6e4-8941785eff28 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:26.783782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-872884ff-e80e-4e2e-b6e4-8941785eff28 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:26.784330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-872884ff-e80e-4e2e-b6e4-8941785eff28 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lazy-loading 'fault' on Instance uuid 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:51:26.934430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-872884ff-e80e-4e2e-b6e4-8941785eff28 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91784e3a38a34d3ca64a06b2617a0154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65097f882d949469009707d1eff8506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:26.946338 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-872884ff-e80e-4e2e-b6e4-8941785eff28 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] 10.222.0.88 "GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e" status: 200 len: 1389 microversion: 2.1 time: 0.421207 Jul 25 14:51:26.957806 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2655/5046] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:26 2022] GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e => generated 1389 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:51:26.963121 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f164c005-4f9d-4315-b9af-5cb70e525bfa tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:26.982586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f164c005-4f9d-4315-b9af-5cb70e525bfa tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:27.017098 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f164c005-4f9d-4315-b9af-5cb70e525bfa tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:27.024034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f164c005-4f9d-4315-b9af-5cb70e525bfa tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:27.025123 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f164c005-4f9d-4315-b9af-5cb70e525bfa tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:27.028970 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f164c005-4f9d-4315-b9af-5cb70e525bfa tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:27.124403 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-030a5c58-a084-4190-bb19-ffe2eb55a4de tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1425 microversion: 2.1 time: 5.124321 Jul 25 14:51:27.131919 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2392/5047] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:21 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1425 bytes in 5126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:27.472188 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f164c005-4f9d-4315-b9af-5cb70e525bfa tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:27.482561 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f164c005-4f9d-4315-b9af-5cb70e525bfa tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed" status: 200 len: 1366 microversion: 2.1 time: 0.523423 Jul 25 14:51:27.485101 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2656/5048] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:26 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed => generated 1366 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:27.992195 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8aba018a-5c03-4b99-98c0-1e26a2cfc7cd tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:27.993287 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8aba018a-5c03-4b99-98c0-1e26a2cfc7cd tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] [instance: 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:28.014456 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8aba018a-5c03-4b99-98c0-1e26a2cfc7cd tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:28.014933 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8aba018a-5c03-4b99-98c0-1e26a2cfc7cd tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:28.015918 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8aba018a-5c03-4b99-98c0-1e26a2cfc7cd tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:28.016406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8aba018a-5c03-4b99-98c0-1e26a2cfc7cd tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:28.068258 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-8aba018a-5c03-4b99-98c0-1e26a2cfc7cd tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] HTTP exception thrown: Instance 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e could not be found. Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8aba018a-5c03-4b99-98c0-1e26a2cfc7cd tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Request method failure captured: Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e HTTP/1.1 Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q2emqYpqcyAkHztfcIs4dT86QyOqK7Lgc8fHhEtPrVBd4RUI6FjErEmX2Bz0p7sEK1dJyCfOYjv-PQr4DIVShqmQV9Qd17NV1-eZ5a4hmZdwUh1z9934WpOo9DbW3LAy93POIMRFKpHW_JKSAxEptRPWci5ZSd2d5OeWO5jct4rdk8 Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: c65097f882d949469009707d1eff8506 Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-TestServerBasicOps-235175538 Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c65097f882d949469009707d1eff8506"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c65097f882d949469009707d1eff8506"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c65097f882d949469009707d1eff8506", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c65097f882d949469009707d1eff8506"}]}] Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-TestServerBasicOps-235175538 Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: c65097f882d949469009707d1eff8506 Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-TestServerBasicOps-235175538 Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-TestServerBasicOps-235175538-project Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 91784e3a38a34d3ca64a06b2617a0154 Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-TestServerBasicOps-235175538-project Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e could not be found. Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e'} Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e could not be found. Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e could not be found. Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:51:28.073171 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:51:28.079361 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:51:28.079361 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:51:28.079361 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:51:28.079361 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:51:28.079361 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:51:28.079361 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e could not be found. Jul 25 14:51:28.079361 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:51:28.080877 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8aba018a-5c03-4b99-98c0-1e26a2cfc7cd tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Returning 404 to user: Instance 7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:51:28.082270 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8aba018a-5c03-4b99-98c0-1e26a2cfc7cd tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] 10.222.0.88 "GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e" status: 404 len: 111 microversion: 2.1 time: 0.103687 Jul 25 14:51:28.083460 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2393/5049] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:27 2022] GET /compute/v2.1/servers/7fc02c8b-c0d1-4d9d-ae6f-566630b17c4e => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:51:28.139731 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-354653e8-b0f0-4417-99e7-a8666e8e6a88 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f46860e19d0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:28.233247 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-354653e8-b0f0-4417-99e7-a8666e8e6a88 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1425 microversion: 2.1 time: 0.098164 Jul 25 14:51:28.244496 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2657/5050] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:28 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1425 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:28.507656 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-aef3ac50-dd97-40fc-afc9-1e9866e15800 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:28.516806 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-aef3ac50-dd97-40fc-afc9-1e9866e15800 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:28.550482 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aef3ac50-dd97-40fc-afc9-1e9866e15800 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:28.550993 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aef3ac50-dd97-40fc-afc9-1e9866e15800 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:28.551871 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aef3ac50-dd97-40fc-afc9-1e9866e15800 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:28.561750 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aef3ac50-dd97-40fc-afc9-1e9866e15800 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:28.614066 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-81d9c51c-987f-4be1-8d8e-dea1ecd23920 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] Calling method '.version_select at 0x7f4686138d30>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:28.693345 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-81d9c51c-987f-4be1-8d8e-dea1ecd23920 tempest-TestServerBasicOps-235175538 tempest-TestServerBasicOps-235175538-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1051387249" status: 202 len: 0 microversion: 2.1 time: 0.083564 Jul 25 14:51:28.694573 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2658/5051] 10.222.0.88 () {58 vars in 1254 bytes} [Mon Jul 25 14:51:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1051387249 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 14:51:28.790094 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:51:28.846473 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=10 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:51:29.177297 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-aef3ac50-dd97-40fc-afc9-1e9866e15800 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:29.192615 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-aef3ac50-dd97-40fc-afc9-1e9866e15800 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed" status: 200 len: 1366 microversion: 2.1 time: 0.689418 Jul 25 14:51:29.215115 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2394/5052] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:28 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed => generated 1366 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:29.253459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b10f7506-6b23-4a17-9a0a-8132c8bc6c0d tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f4686131f70>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:29.329112 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b10f7506-6b23-4a17-9a0a-8132c8bc6c0d tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1425 microversion: 2.1 time: 0.082121 Jul 25 14:51:29.330065 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2659/5053] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:29 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1425 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:30.220940 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2de31d2d-162e-4357-a965-dcb6aec23680 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:30.224542 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2de31d2d-162e-4357-a965-dcb6aec23680 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:30.249705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:51:30.290285 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2de31d2d-162e-4357-a965-dcb6aec23680 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:30.295589 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2de31d2d-162e-4357-a965-dcb6aec23680 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:30.299278 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2de31d2d-162e-4357-a965-dcb6aec23680 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:30.299750 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2de31d2d-162e-4357-a965-dcb6aec23680 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:30.340588 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:51:30.350563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ab7634dc-6ced-4280-a1e5-422c966cc22e tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f468618a940>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:30.496622 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ab7634dc-6ced-4280-a1e5-422c966cc22e tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1425 microversion: 2.1 time: 0.155412 Jul 25 14:51:30.498307 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2660/5054] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:30 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1425 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:31.515123 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4540ce2a-fcb9-4ff5-9a8c-7cd11fee07ab tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f4686131a60>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:31.612338 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4540ce2a-fcb9-4ff5-9a8c-7cd11fee07ab tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1425 microversion: 2.1 time: 0.102763 Jul 25 14:51:31.613136 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2661/5055] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:31 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1425 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:51:31.801716 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2de31d2d-162e-4357-a965-dcb6aec23680 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:31.815809 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2de31d2d-162e-4357-a965-dcb6aec23680 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed" status: 200 len: 1366 microversion: 2.1 time: 1.603828 Jul 25 14:51:31.816559 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2395/5056] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:30 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed => generated 1366 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:31.926418 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-a95295c7-ee2a-47ec-9df4-4c46c6fc92e1 req-f77d653d-3ccc-416f-9ce8-53a8eb885f80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a89d95ca-8efe-45dd-9037-82e97797e7ed", "tag": "a45c46f1-811e-4a04-8d37-7e83dba03d15"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:51:31.955256 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a95295c7-ee2a-47ec-9df4-4c46c6fc92e1 req-f77d653d-3ccc-416f-9ce8-53a8eb885f80 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:31.966683 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a95295c7-ee2a-47ec-9df4-4c46c6fc92e1 req-f77d653d-3ccc-416f-9ce8-53a8eb885f80 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:32.022784 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-a95295c7-ee2a-47ec-9df4-4c46c6fc92e1 req-f77d653d-3ccc-416f-9ce8-53a8eb885f80 service nova] Creating event network-changed:a45c46f1-811e-4a04-8d37-7e83dba03d15 for instance a89d95ca-8efe-45dd-9037-82e97797e7ed on n-h2-846435-14 Jul 25 14:51:32.091222 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-a95295c7-ee2a-47ec-9df4-4c46c6fc92e1 req-f77d653d-3ccc-416f-9ce8-53a8eb885f80 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144921 Jul 25 14:51:32.099331 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2662/5057] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:51:32.628965 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-22b97af9-77ec-47c8-8059-50f9791e19ce tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f46860e15e0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:32.731643 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-22b97af9-77ec-47c8-8059-50f9791e19ce tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1425 microversion: 2.1 time: 0.107740 Jul 25 14:51:32.732679 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2663/5058] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:32 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1425 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:51:32.843424 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-aad9e027-31e2-47bd-89f2-2fe10f45eac1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:32.844370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-aad9e027-31e2-47bd-89f2-2fe10f45eac1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:32.871366 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aad9e027-31e2-47bd-89f2-2fe10f45eac1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:32.877606 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aad9e027-31e2-47bd-89f2-2fe10f45eac1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:32.882190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aad9e027-31e2-47bd-89f2-2fe10f45eac1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:32.898675 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aad9e027-31e2-47bd-89f2-2fe10f45eac1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:33.423386 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bec50233-76f7-4686-8d05-aadbabf11a2b tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1834100409", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "74496896-1a0e-4561-809d-4d1ad8292dbb"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:51:33.550523 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-bec50233-76f7-4686-8d05-aadbabf11a2b tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] validate_networks() for [('74496896-1a0e-4561-809d-4d1ad8292dbb', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:51:33.673051 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-aad9e027-31e2-47bd-89f2-2fe10f45eac1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:33.688816 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-aad9e027-31e2-47bd-89f2-2fe10f45eac1 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed" status: 200 len: 1366 microversion: 2.1 time: 0.850250 Jul 25 14:51:33.708690 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2664/5059] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:32 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed => generated 1366 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:33.747453 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-736c32ad-ca09-4771-b37b-6c04844c5b06 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f46860d7550>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:33.835908 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-736c32ad-ca09-4771-b37b-6c04844c5b06 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1425 microversion: 2.1 time: 0.092802 Jul 25 14:51:33.837214 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2665/5060] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:33 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1425 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:34.712770 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6f949f8d-7ca8-4b7a-bef9-5e0ce2416e52 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:34.714300 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6f949f8d-7ca8-4b7a-bef9-5e0ce2416e52 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:34.724359 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f949f8d-7ca8-4b7a-bef9-5e0ce2416e52 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:34.724809 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f949f8d-7ca8-4b7a-bef9-5e0ce2416e52 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:34.725601 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f949f8d-7ca8-4b7a-bef9-5e0ce2416e52 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:34.726028 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f949f8d-7ca8-4b7a-bef9-5e0ce2416e52 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:35.469795 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-bec50233-76f7-4686-8d05-aadbabf11a2b tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:51:35.470353 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-bec50233-76f7-4686-8d05-aadbabf11a2b tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:51:35.470696 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-bec50233-76f7-4686-8d05-aadbabf11a2b tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:51:35.471112 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-bec50233-76f7-4686-8d05-aadbabf11a2b tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:51:35.471528 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-bec50233-76f7-4686-8d05-aadbabf11a2b tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:51:35.499920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bec50233-76f7-4686-8d05-aadbabf11a2b tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:35.504358 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bec50233-76f7-4686-8d05-aadbabf11a2b tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:35.505543 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bec50233-76f7-4686-8d05-aadbabf11a2b tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:35.506183 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bec50233-76f7-4686-8d05-aadbabf11a2b tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:35.554303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-bec50233-76f7-4686-8d05-aadbabf11a2b tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Getting quotas for project 32c0f6803c644cf5af8fc38f9fc43442. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:51:35.580650 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-bec50233-76f7-4686-8d05-aadbabf11a2b tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Getting quotas for user acb08a16e9424132ab756f57492d7ba1 and project 32c0f6803c644cf5af8fc38f9fc43442. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:51:35.617059 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bec50233-76f7-4686-8d05-aadbabf11a2b tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:51:35.622431 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bec50233-76f7-4686-8d05-aadbabf11a2b tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:51:35.775838 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bec50233-76f7-4686-8d05-aadbabf11a2b tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 3.208779 Jul 25 14:51:35.794213 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2396/5061] 10.222.0.88 () {62 vars in 1188 bytes} [Mon Jul 25 14:51:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 3229 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 25 14:51:35.803875 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6f60642c-85d5-4dbf-bfb9-efd5194cf7c3 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f4686b7a3a0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:35.938101 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6f60642c-85d5-4dbf-bfb9-efd5194cf7c3 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1425 microversion: 2.1 time: 0.140644 Jul 25 14:51:35.940682 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2397/5062] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:35 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1425 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:35.960536 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0b4feb1e-9688-4420-8f5a-d99f94c6d2b4 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:35.966608 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0b4feb1e-9688-4420-8f5a-d99f94c6d2b4 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:36.377478 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0b4feb1e-9688-4420-8f5a-d99f94c6d2b4 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:36.379338 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6f949f8d-7ca8-4b7a-bef9-5e0ce2416e52 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:36.390722 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6f949f8d-7ca8-4b7a-bef9-5e0ce2416e52 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed" status: 200 len: 1366 microversion: 2.1 time: 1.679869 Jul 25 14:51:36.395644 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2666/5063] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:34 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed => generated 1366 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:51:36.407770 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0b4feb1e-9688-4420-8f5a-d99f94c6d2b4 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:36.415244 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0b4feb1e-9688-4420-8f5a-d99f94c6d2b4 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:36.423151 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0b4feb1e-9688-4420-8f5a-d99f94c6d2b4 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488" status: 200 len: 1262 microversion: 2.26 time: 0.480158 Jul 25 14:51:36.429711 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2398/5064] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:51:35 2022] GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488 => generated 1262 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:51:36.963267 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5bb41565-bff9-43ba-82f0-e0e679730838 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f46860ef1f0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:37.112516 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5bb41565-bff9-43ba-82f0-e0e679730838 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1425 microversion: 2.1 time: 0.159945 Jul 25 14:51:37.114414 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2667/5065] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:36 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1425 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:37.420158 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4fd504a9-ee83-4dd1-84e0-0e8d91c98e7d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:37.421044 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4fd504a9-ee83-4dd1-84e0-0e8d91c98e7d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:37.433192 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4fd504a9-ee83-4dd1-84e0-0e8d91c98e7d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:37.433658 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4fd504a9-ee83-4dd1-84e0-0e8d91c98e7d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:37.434465 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4fd504a9-ee83-4dd1-84e0-0e8d91c98e7d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:37.434911 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4fd504a9-ee83-4dd1-84e0-0e8d91c98e7d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:37.456058 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bb333f03-0e52-4962-a1e0-00782f907ede tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:37.459138 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bb333f03-0e52-4962-a1e0-00782f907ede tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:37.471152 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bb333f03-0e52-4962-a1e0-00782f907ede tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:37.480657 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bb333f03-0e52-4962-a1e0-00782f907ede tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:37.482327 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bb333f03-0e52-4962-a1e0-00782f907ede tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:37.483016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bb333f03-0e52-4962-a1e0-00782f907ede tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:37.509572 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:51:37.613295 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bb333f03-0e52-4962-a1e0-00782f907ede tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:37.636522 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bb333f03-0e52-4962-a1e0-00782f907ede tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:37.642454 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bb333f03-0e52-4962-a1e0-00782f907ede tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:37.648986 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bb333f03-0e52-4962-a1e0-00782f907ede tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488" status: 200 len: 1314 microversion: 2.26 time: 0.197018 Jul 25 14:51:37.661489 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2668/5066] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:51:37 2022] GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:51:38.120886 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4fd504a9-ee83-4dd1-84e0-0e8d91c98e7d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:38.129244 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b4bd5513-b0e8-48e5-99d2-3db00831827c tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f46860928b0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:38.131694 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4fd504a9-ee83-4dd1-84e0-0e8d91c98e7d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed" status: 200 len: 1366 microversion: 2.1 time: 0.716508 Jul 25 14:51:38.138048 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2399/5067] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:37 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed => generated 1366 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:38.236729 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b4bd5513-b0e8-48e5-99d2-3db00831827c tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1425 microversion: 2.1 time: 0.106870 Jul 25 14:51:38.250583 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2669/5068] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:38 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1425 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:51:38.680922 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b87b924a-8508-41c9-9394-99a40871931b tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:38.681557 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b87b924a-8508-41c9-9394-99a40871931b tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:38.700942 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b87b924a-8508-41c9-9394-99a40871931b tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:38.701400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b87b924a-8508-41c9-9394-99a40871931b tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:38.708904 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b87b924a-8508-41c9-9394-99a40871931b tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:38.709368 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b87b924a-8508-41c9-9394-99a40871931b tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:39.157191 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-20002dd1-c60a-4bee-b348-dacbaba00b9e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:39.157861 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-20002dd1-c60a-4bee-b348-dacbaba00b9e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:39.178161 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-20002dd1-c60a-4bee-b348-dacbaba00b9e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:39.191359 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-20002dd1-c60a-4bee-b348-dacbaba00b9e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:39.192717 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-20002dd1-c60a-4bee-b348-dacbaba00b9e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:39.194037 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-20002dd1-c60a-4bee-b348-dacbaba00b9e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:39.352881 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b87b924a-8508-41c9-9394-99a40871931b tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:39.369310 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b87b924a-8508-41c9-9394-99a40871931b tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:39.371071 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b87b924a-8508-41c9-9394-99a40871931b tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:39.372388 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b87b924a-8508-41c9-9394-99a40871931b tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488" status: 200 len: 1320 microversion: 2.26 time: 0.696556 Jul 25 14:51:39.379644 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2400/5069] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:51:38 2022] GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488 => generated 1320 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:51:39.412939 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-93d4e628-0945-4d12-9830-2bd64fae068b tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f4686b2c3a0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:39.539372 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-93d4e628-0945-4d12-9830-2bd64fae068b tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1425 microversion: 2.1 time: 0.158241 Jul 25 14:51:39.541345 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2401/5070] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:39 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1425 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:39.649778 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-20002dd1-c60a-4bee-b348-dacbaba00b9e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:39.659529 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-20002dd1-c60a-4bee-b348-dacbaba00b9e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed" status: 200 len: 1366 microversion: 2.1 time: 0.506053 Jul 25 14:51:39.669542 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2670/5071] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:39 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed => generated 1366 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:51:40.402587 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ecc6af4c-fcab-46f5-8da3-dca9c32d48b5 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:40.403376 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ecc6af4c-fcab-46f5-8da3-dca9c32d48b5 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:40.424203 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ecc6af4c-fcab-46f5-8da3-dca9c32d48b5 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:40.436764 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ecc6af4c-fcab-46f5-8da3-dca9c32d48b5 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:40.454403 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ecc6af4c-fcab-46f5-8da3-dca9c32d48b5 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:40.455542 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ecc6af4c-fcab-46f5-8da3-dca9c32d48b5 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:40.559543 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-495bb34b-b4ce-4730-aee2-deca89b42967 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f4686098b80>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:40.673945 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-495bb34b-b4ce-4730-aee2-deca89b42967 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1425 microversion: 2.1 time: 0.122742 Jul 25 14:51:40.688059 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2671/5072] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:40 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1425 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:40.696778 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9b98408b-402b-4d70-8b38-be57c35825eb tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:40.723275 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9b98408b-402b-4d70-8b38-be57c35825eb tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:40.762570 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9b98408b-402b-4d70-8b38-be57c35825eb tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:40.763052 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9b98408b-402b-4d70-8b38-be57c35825eb tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:40.763924 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9b98408b-402b-4d70-8b38-be57c35825eb tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:40.764405 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9b98408b-402b-4d70-8b38-be57c35825eb tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:41.043416 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ecc6af4c-fcab-46f5-8da3-dca9c32d48b5 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:41.059332 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ecc6af4c-fcab-46f5-8da3-dca9c32d48b5 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:41.060899 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ecc6af4c-fcab-46f5-8da3-dca9c32d48b5 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:41.062091 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ecc6af4c-fcab-46f5-8da3-dca9c32d48b5 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488" status: 200 len: 1320 microversion: 2.26 time: 0.666074 Jul 25 14:51:41.068669 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2402/5073] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:51:40 2022] GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488 => generated 1320 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:51:41.501465 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9b98408b-402b-4d70-8b38-be57c35825eb tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:41.555358 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9b98408b-402b-4d70-8b38-be57c35825eb tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed" status: 200 len: 1366 microversion: 2.1 time: 0.865580 Jul 25 14:51:41.568069 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2672/5074] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:40 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed => generated 1366 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:41.702736 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e5e7cb63-b6a4-4c5b-b68d-f912676049b1 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f4686b2c310>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:41.858358 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e5e7cb63-b6a4-4c5b-b68d-f912676049b1 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1425 microversion: 2.1 time: 0.161886 Jul 25 14:51:41.868233 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2403/5075] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:41 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1425 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:42.093160 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e091ee12-1a25-4d3b-bc34-a0e4f1caa7fb tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:42.095719 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e091ee12-1a25-4d3b-bc34-a0e4f1caa7fb tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:42.143607 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e091ee12-1a25-4d3b-bc34-a0e4f1caa7fb tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:42.147681 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e091ee12-1a25-4d3b-bc34-a0e4f1caa7fb tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:42.153791 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e091ee12-1a25-4d3b-bc34-a0e4f1caa7fb tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:42.161021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e091ee12-1a25-4d3b-bc34-a0e4f1caa7fb tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:42.581263 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-91ca243f-7a44-401b-a84f-b06f306feb1f tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:42.582020 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-91ca243f-7a44-401b-a84f-b06f306feb1f tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:42.596462 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-91ca243f-7a44-401b-a84f-b06f306feb1f tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:42.596955 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-91ca243f-7a44-401b-a84f-b06f306feb1f tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:42.597771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-91ca243f-7a44-401b-a84f-b06f306feb1f tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:42.600613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-91ca243f-7a44-401b-a84f-b06f306feb1f tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:43.173814 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e091ee12-1a25-4d3b-bc34-a0e4f1caa7fb tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:43.194320 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e091ee12-1a25-4d3b-bc34-a0e4f1caa7fb tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:43.201443 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e091ee12-1a25-4d3b-bc34-a0e4f1caa7fb tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:43.215092 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e091ee12-1a25-4d3b-bc34-a0e4f1caa7fb tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488" status: 200 len: 1362 microversion: 2.26 time: 1.121415 Jul 25 14:51:43.219229 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2673/5076] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:51:42 2022] GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488 => generated 1362 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:51:43.245476 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6a9cbd84-06b8-4776-a393-b01c52fdbb4e tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f46860efe50>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:43.334252 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6a9cbd84-06b8-4776-a393-b01c52fdbb4e tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1425 microversion: 2.1 time: 0.113611 Jul 25 14:51:43.335854 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2674/5077] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:43 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1425 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:43.702986 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-91ca243f-7a44-401b-a84f-b06f306feb1f tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:43.712408 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-91ca243f-7a44-401b-a84f-b06f306feb1f tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed" status: 200 len: 1366 microversion: 2.1 time: 1.135397 Jul 25 14:51:43.723698 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2404/5078] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:42 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed => generated 1366 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:44.242898 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b75819c5-7fce-4a79-9df9-11b572dfddbb tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:44.243773 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b75819c5-7fce-4a79-9df9-11b572dfddbb tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:44.281749 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b75819c5-7fce-4a79-9df9-11b572dfddbb tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:44.285126 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b75819c5-7fce-4a79-9df9-11b572dfddbb tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:44.287500 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b75819c5-7fce-4a79-9df9-11b572dfddbb tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:44.289208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b75819c5-7fce-4a79-9df9-11b572dfddbb tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:44.352922 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f46af63e-7a5a-43fe-ac15-9de98c456ef8 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f4686a44310>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:44.493920 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f46af63e-7a5a-43fe-ac15-9de98c456ef8 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1425 microversion: 2.1 time: 0.147530 Jul 25 14:51:44.498168 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2405/5079] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:44 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1425 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:51:44.693864 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b75819c5-7fce-4a79-9df9-11b572dfddbb tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:44.712402 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b75819c5-7fce-4a79-9df9-11b572dfddbb tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:44.714671 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b75819c5-7fce-4a79-9df9-11b572dfddbb tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:44.720172 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b75819c5-7fce-4a79-9df9-11b572dfddbb tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488" status: 200 len: 1362 microversion: 2.26 time: 0.484694 Jul 25 14:51:44.724024 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2675/5080] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:51:44 2022] GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488 => generated 1362 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:51:44.750755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-880de9ea-527e-4ed0-8df1-05532d68c285 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:44.752502 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-880de9ea-527e-4ed0-8df1-05532d68c285 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:44.762049 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-880de9ea-527e-4ed0-8df1-05532d68c285 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:44.764887 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-880de9ea-527e-4ed0-8df1-05532d68c285 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:44.766382 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-880de9ea-527e-4ed0-8df1-05532d68c285 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:44.767143 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-880de9ea-527e-4ed0-8df1-05532d68c285 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:44.776649 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:51:45.163498 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-880de9ea-527e-4ed0-8df1-05532d68c285 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:45.177460 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-880de9ea-527e-4ed0-8df1-05532d68c285 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed" status: 200 len: 1366 microversion: 2.1 time: 0.431104 Jul 25 14:51:45.180208 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2676/5081] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:44 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed => generated 1366 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:45.330866 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-1a6f3fc5-1bda-4d6e-b895-5818db405c8c req-fad2b3b6-b371-4161-b681-4ac68505f015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a89d95ca-8efe-45dd-9037-82e97797e7ed", "name": "network-vif-plugged", "status": "completed", "tag": "a45c46f1-811e-4a04-8d37-7e83dba03d15"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:51:45.354096 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-1a6f3fc5-1bda-4d6e-b895-5818db405c8c req-fad2b3b6-b371-4161-b681-4ac68505f015 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:45.356392 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-1a6f3fc5-1bda-4d6e-b895-5818db405c8c req-fad2b3b6-b371-4161-b681-4ac68505f015 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:45.382569 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-1a6f3fc5-1bda-4d6e-b895-5818db405c8c req-fad2b3b6-b371-4161-b681-4ac68505f015 service nova] Creating event network-vif-plugged:a45c46f1-811e-4a04-8d37-7e83dba03d15 for instance a89d95ca-8efe-45dd-9037-82e97797e7ed on n-h2-846435-14 Jul 25 14:51:45.396411 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-1a6f3fc5-1bda-4d6e-b895-5818db405c8c req-fad2b3b6-b371-4161-b681-4ac68505f015 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.896297 Jul 25 14:51:45.403548 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2406/5082] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:51:45.509662 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fd0782ca-4d13-4a52-b37f-f5be38db493b tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f46860f54c0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:45.593972 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fd0782ca-4d13-4a52-b37f-f5be38db493b tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1425 microversion: 2.1 time: 0.085463 Jul 25 14:51:45.601862 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2677/5083] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:45 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1425 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:45.726173 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e9c97fa0-68e5-45b2-ac4a-5178103d28af tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4f55411-bd2d-4bc6-8518-822e228e3da7", "device": "/dev/sdb"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:51:45.733196 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e9c97fa0-68e5-45b2-ac4a-5178103d28af tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 298b0992-a307-40cf-a42a-9964e711730e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:45.747359 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-19649ebd-ee9a-4440-8055-1584b98e56df tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:45.748014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-19649ebd-ee9a-4440-8055-1584b98e56df tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:45.754103 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:51:45.756295 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e9c97fa0-68e5-45b2-ac4a-5178103d28af tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:45.756990 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e9c97fa0-68e5-45b2-ac4a-5178103d28af tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:45.757797 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e9c97fa0-68e5-45b2-ac4a-5178103d28af tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:45.758232 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e9c97fa0-68e5-45b2-ac4a-5178103d28af tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:45.765611 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-19649ebd-ee9a-4440-8055-1584b98e56df tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:45.776374 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-19649ebd-ee9a-4440-8055-1584b98e56df tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:45.777421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-19649ebd-ee9a-4440-8055-1584b98e56df tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:45.777877 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-19649ebd-ee9a-4440-8055-1584b98e56df tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:46.275807 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e9c97fa0-68e5-45b2-ac4a-5178103d28af tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "POST /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.557012 Jul 25 14:51:46.276568 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2407/5084] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Jul 25 14:51:45 2022] POST /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e/os-volume_attachments => generated 194 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:51:46.313750 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-18e79fb8-bab0-4ec9-83ac-87346012214c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:46.318025 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-18e79fb8-bab0-4ec9-83ac-87346012214c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:46.359100 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-18e79fb8-bab0-4ec9-83ac-87346012214c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:46.367391 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-18e79fb8-bab0-4ec9-83ac-87346012214c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:46.373045 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-18e79fb8-bab0-4ec9-83ac-87346012214c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:46.374745 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-18e79fb8-bab0-4ec9-83ac-87346012214c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:46.399754 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=8 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:51:46.751717 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-19649ebd-ee9a-4440-8055-1584b98e56df tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:46.772529 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-19649ebd-ee9a-4440-8055-1584b98e56df tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:46.774963 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-19649ebd-ee9a-4440-8055-1584b98e56df tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:46.787895 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-19649ebd-ee9a-4440-8055-1584b98e56df tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488" status: 200 len: 1362 microversion: 2.26 time: 1.039155 Jul 25 14:51:46.794343 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2678/5085] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:51:45 2022] GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488 => generated 1362 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:51:46.802175 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3d88f22c-62c5-424a-b310-ee1ef21e8f41 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f4686146040>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:46.849099 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-18e79fb8-bab0-4ec9-83ac-87346012214c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:46.863845 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-18e79fb8-bab0-4ec9-83ac-87346012214c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed" status: 200 len: 1366 microversion: 2.1 time: 0.579466 Jul 25 14:51:46.865524 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2408/5086] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:46 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed => generated 1366 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:46.967191 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3d88f22c-62c5-424a-b310-ee1ef21e8f41 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1425 microversion: 2.1 time: 0.171317 Jul 25 14:51:46.967998 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2679/5087] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:46 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1425 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:47.143407 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-3269f586-5ebf-43a5-9a6b-245c06122878 req-4ba57848-2ffb-47a6-a0f8-9ab6ee299c14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d74c1b24-d135-49c0-9d8f-0e90794d2488", "tag": "80f41e3e-c2f2-492c-b649-67bb4317f232"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:51:47.212458 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-3269f586-5ebf-43a5-9a6b-245c06122878 req-4ba57848-2ffb-47a6-a0f8-9ab6ee299c14 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:47.213044 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-3269f586-5ebf-43a5-9a6b-245c06122878 req-4ba57848-2ffb-47a6-a0f8-9ab6ee299c14 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:47.266395 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-3269f586-5ebf-43a5-9a6b-245c06122878 req-4ba57848-2ffb-47a6-a0f8-9ab6ee299c14 service nova] Creating event network-changed:80f41e3e-c2f2-492c-b649-67bb4317f232 for instance d74c1b24-d135-49c0-9d8f-0e90794d2488 on n-h1-846435-14 Jul 25 14:51:47.297826 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-3269f586-5ebf-43a5-9a6b-245c06122878 req-4ba57848-2ffb-47a6-a0f8-9ab6ee299c14 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167545 Jul 25 14:51:47.298464 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2409/5088] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:51:47.813673 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-24899acb-6f31-4cec-92c2-dbde6bf64c24 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:47.814394 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-24899acb-6f31-4cec-92c2-dbde6bf64c24 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:47.825875 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-24899acb-6f31-4cec-92c2-dbde6bf64c24 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:47.827340 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-24899acb-6f31-4cec-92c2-dbde6bf64c24 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:47.828573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-24899acb-6f31-4cec-92c2-dbde6bf64c24 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:47.830011 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-24899acb-6f31-4cec-92c2-dbde6bf64c24 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:47.888881 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fdcd31f2-cb9e-456b-bed2-9206582a9c07 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:47.889580 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fdcd31f2-cb9e-456b-bed2-9206582a9c07 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:47.901808 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fdcd31f2-cb9e-456b-bed2-9206582a9c07 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:47.902418 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fdcd31f2-cb9e-456b-bed2-9206582a9c07 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:47.908434 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fdcd31f2-cb9e-456b-bed2-9206582a9c07 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:47.912472 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fdcd31f2-cb9e-456b-bed2-9206582a9c07 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:48.168886 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-24899acb-6f31-4cec-92c2-dbde6bf64c24 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:48.196113 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-24899acb-6f31-4cec-92c2-dbde6bf64c24 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:48.198436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-24899acb-6f31-4cec-92c2-dbde6bf64c24 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:48.199865 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-24899acb-6f31-4cec-92c2-dbde6bf64c24 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488" status: 200 len: 1362 microversion: 2.26 time: 0.391209 Jul 25 14:51:48.202454 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2680/5089] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:51:47 2022] GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488 => generated 1362 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:51:48.216436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ee936641-24d6-4aa7-9285-64ddb8a78a49 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f46860e1a60>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:48.321940 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ee936641-24d6-4aa7-9285-64ddb8a78a49 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1425 microversion: 2.1 time: 0.115713 Jul 25 14:51:48.322794 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2681/5090] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:48 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1425 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:48.530446 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fdcd31f2-cb9e-456b-bed2-9206582a9c07 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:48.543525 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fdcd31f2-cb9e-456b-bed2-9206582a9c07 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed" status: 200 len: 1556 microversion: 2.1 time: 0.660512 Jul 25 14:51:48.544367 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2410/5091] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:47 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed => generated 1556 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:51:48.570938 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4ac3a397-1317-4e23-8aef-8fe2511fd458 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:48.571439 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4ac3a397-1317-4e23-8aef-8fe2511fd458 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:48.581397 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4ac3a397-1317-4e23-8aef-8fe2511fd458 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:48.581843 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4ac3a397-1317-4e23-8aef-8fe2511fd458 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:48.582625 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4ac3a397-1317-4e23-8aef-8fe2511fd458 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:48.595938 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4ac3a397-1317-4e23-8aef-8fe2511fd458 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:48.936998 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4ac3a397-1317-4e23-8aef-8fe2511fd458 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.370903 Jul 25 14:51:48.937658 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2682/5092] 10.222.0.88 () {58 vars in 1275 bytes} [Mon Jul 25 14:51:48 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed/os-interface => generated 284 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:51:49.216076 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f9487631-bf09-40d1-b224-a8b835ece163 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Action: 'create', calling method: .version_select at 0x7f4686992af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1414331621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGSRrp1VLDLZPDouqaoJ3wCAuCyg/5MeX5UoAtKHay6XalAjcxw9RgF9rbubDkOt1n9szPI874YBt6tXgxBAQ56aR5v4PumtPDdYrjHLm0CrwylpPw4U7yB52q9aOsXQA=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:51:49.228257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-209e4aba-e6ff-436b-abca-fd50e669a561 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:49.228876 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-209e4aba-e6ff-436b-abca-fd50e669a561 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:49.240950 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-f9487631-bf09-40d1-b224-a8b835ece163 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Getting quotas for project 8dd09177faea4702992aaab182125b5a. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:51:49.245433 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-209e4aba-e6ff-436b-abca-fd50e669a561 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:49.245878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-209e4aba-e6ff-436b-abca-fd50e669a561 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:49.246898 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-209e4aba-e6ff-436b-abca-fd50e669a561 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:49.250116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-f9487631-bf09-40d1-b224-a8b835ece163 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Getting quotas for user ca46c8e84b8644b69937ec9c06cb0e9a and project 8dd09177faea4702992aaab182125b5a. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:51:49.256742 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-209e4aba-e6ff-436b-abca-fd50e669a561 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:49.285445 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f9487631-bf09-40d1-b224-a8b835ece163 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.371728 Jul 25 14:51:49.287493 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2411/5093] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:51:48 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:51:49.344773 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a68432af-58ff-4f55-97f9-c6e93608e44b tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f46868b21f0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:49.431320 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a68432af-58ff-4f55-97f9-c6e93608e44b tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1425 microversion: 2.1 time: 0.096363 Jul 25 14:51:49.432350 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2412/5094] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:49 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1425 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:50.189253 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-209e4aba-e6ff-436b-abca-fd50e669a561 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:50.203941 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-209e4aba-e6ff-436b-abca-fd50e669a561 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:50.208550 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-209e4aba-e6ff-436b-abca-fd50e669a561 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:50.213414 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-209e4aba-e6ff-436b-abca-fd50e669a561 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488" status: 200 len: 1362 microversion: 2.26 time: 0.988467 Jul 25 14:51:50.215847 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2683/5095] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:51:49 2022] GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488 => generated 1362 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:51:50.459894 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6467fbc4-8803-47ec-b3dc-f7fa9204e064 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f46868af5e0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:50.555082 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6467fbc4-8803-47ec-b3dc-f7fa9204e064 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1425 microversion: 2.1 time: 0.112026 Jul 25 14:51:50.556376 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2413/5096] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:50 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1425 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:51.239209 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4ee26653-27c5-4d64-9179-8f2f8fa72cfe tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:51.239774 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4ee26653-27c5-4d64-9179-8f2f8fa72cfe tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:51.250178 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4ee26653-27c5-4d64-9179-8f2f8fa72cfe tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:51.250946 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4ee26653-27c5-4d64-9179-8f2f8fa72cfe tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:51.251949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4ee26653-27c5-4d64-9179-8f2f8fa72cfe tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:51.252587 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4ee26653-27c5-4d64-9179-8f2f8fa72cfe tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:51.658624 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-43122c1f-78d8-48a0-84d9-6483b3f0969b tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f4686992280>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:51.661131 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4ee26653-27c5-4d64-9179-8f2f8fa72cfe tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:51.661131 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4ee26653-27c5-4d64-9179-8f2f8fa72cfe tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:51.661131 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4ee26653-27c5-4d64-9179-8f2f8fa72cfe tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:51.661131 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4ee26653-27c5-4d64-9179-8f2f8fa72cfe tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488" status: 200 len: 1362 microversion: 2.26 time: 0.394840 Jul 25 14:51:51.661131 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2684/5097] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:51:51 2022] GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488 => generated 1362 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:51:51.662696 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-43122c1f-78d8-48a0-84d9-6483b3f0969b tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1425 microversion: 2.1 time: 0.067416 Jul 25 14:51:51.662696 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2414/5098] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:51 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1425 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:51.663134 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-0f6d5eb7-65ec-41d9-8c75-763b8ab6e8f7 req-35901a9c-285c-4e52-9176-b3bf56d17b3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a89d95ca-8efe-45dd-9037-82e97797e7ed", "tag": "a45c46f1-811e-4a04-8d37-7e83dba03d15"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:51:51.663134 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-0f6d5eb7-65ec-41d9-8c75-763b8ab6e8f7 req-35901a9c-285c-4e52-9176-b3bf56d17b3d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:51.663134 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-0f6d5eb7-65ec-41d9-8c75-763b8ab6e8f7 req-35901a9c-285c-4e52-9176-b3bf56d17b3d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:51.685235 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-0f6d5eb7-65ec-41d9-8c75-763b8ab6e8f7 req-35901a9c-285c-4e52-9176-b3bf56d17b3d service nova] Creating event network-changed:a45c46f1-811e-4a04-8d37-7e83dba03d15 for instance a89d95ca-8efe-45dd-9037-82e97797e7ed on n-h2-846435-14 Jul 25 14:51:51.704255 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-0f6d5eb7-65ec-41d9-8c75-763b8ab6e8f7 req-35901a9c-285c-4e52-9176-b3bf56d17b3d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071465 Jul 25 14:51:51.707271 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2685/5099] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:51:52.662566 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-de6f19aa-06e8-4ea0-bd59-b0998eb5f704 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f46869b6550>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:52.681068 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-53bc7286-43a3-4f5c-8dcd-f0fe8d161659 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:52.682189 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-53bc7286-43a3-4f5c-8dcd-f0fe8d161659 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:52.711789 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-53bc7286-43a3-4f5c-8dcd-f0fe8d161659 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:52.712430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-53bc7286-43a3-4f5c-8dcd-f0fe8d161659 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:52.713267 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-53bc7286-43a3-4f5c-8dcd-f0fe8d161659 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:52.720861 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-53bc7286-43a3-4f5c-8dcd-f0fe8d161659 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:52.748557 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-de6f19aa-06e8-4ea0-bd59-b0998eb5f704 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1425 microversion: 2.1 time: 0.089982 Jul 25 14:51:52.749662 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2415/5100] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:52 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1425 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:53.339568 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-53bc7286-43a3-4f5c-8dcd-f0fe8d161659 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:53.349651 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-53bc7286-43a3-4f5c-8dcd-f0fe8d161659 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:53.351638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-53bc7286-43a3-4f5c-8dcd-f0fe8d161659 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:53.371668 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-53bc7286-43a3-4f5c-8dcd-f0fe8d161659 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488" status: 200 len: 1362 microversion: 2.26 time: 0.695898 Jul 25 14:51:53.390234 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2686/5101] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:51:52 2022] GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488 => generated 1362 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:51:53.768563 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a5b23c2b-638e-465a-91b1-435215092666 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f46869929d0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:53.866336 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a5b23c2b-638e-465a-91b1-435215092666 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1434 microversion: 2.1 time: 0.106007 Jul 25 14:51:53.867771 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2416/5102] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:53 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1434 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:53.883629 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-76155fab-45f8-41ca-a985-e0e4562da1b3 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f46860f1c10>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:53.968708 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-76155fab-45f8-41ca-a985-e0e4562da1b3 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 200 len: 1434 microversion: 2.1 time: 0.089117 Jul 25 14:51:53.971888 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2687/5103] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Jul 25 14:51:53 2022] GET /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 1434 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:53.985260 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8c767fff-2a22-4cec-a5c7-75fb291d13f5 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:53.986305 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8c767fff-2a22-4cec-a5c7-75fb291d13f5 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] [instance: b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:54.008682 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8c767fff-2a22-4cec-a5c7-75fb291d13f5 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:54.011132 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8c767fff-2a22-4cec-a5c7-75fb291d13f5 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:54.014197 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8c767fff-2a22-4cec-a5c7-75fb291d13f5 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:54.017697 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8c767fff-2a22-4cec-a5c7-75fb291d13f5 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:54.403490 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b569d449-9733-430d-83ec-4099c2755da9 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:54.404299 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b569d449-9733-430d-83ec-4099c2755da9 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:54.424117 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b569d449-9733-430d-83ec-4099c2755da9 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:54.426416 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b569d449-9733-430d-83ec-4099c2755da9 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:54.430570 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b569d449-9733-430d-83ec-4099c2755da9 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:54.434243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b569d449-9733-430d-83ec-4099c2755da9 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:54.576475 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8c767fff-2a22-4cec-a5c7-75fb291d13f5 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d15b8d3057425dbf014609cacef9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a6bbf7f4541bbba9249cd2ce3a9a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:54.588247 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8c767fff-2a22-4cec-a5c7-75fb291d13f5 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736" status: 200 len: 1478 microversion: 2.1 time: 0.607047 Jul 25 14:51:54.590885 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2417/5104] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:53 2022] GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 => generated 1478 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:51:54.871203 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b569d449-9733-430d-83ec-4099c2755da9 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:54.882359 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b569d449-9733-430d-83ec-4099c2755da9 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:54.884121 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b569d449-9733-430d-83ec-4099c2755da9 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:54.885394 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b569d449-9733-430d-83ec-4099c2755da9 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488" status: 200 len: 1362 microversion: 2.26 time: 0.486273 Jul 25 14:51:54.886188 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2688/5105] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:51:54 2022] GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488 => generated 1362 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:51:55.650702 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d1a3642a-04f0-47ea-a2bd-1f2ba82c2a84 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:55.651731 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d1a3642a-04f0-47ea-a2bd-1f2ba82c2a84 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] [instance: b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:55.667497 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d1a3642a-04f0-47ea-a2bd-1f2ba82c2a84 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:55.668634 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d1a3642a-04f0-47ea-a2bd-1f2ba82c2a84 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:55.669685 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d1a3642a-04f0-47ea-a2bd-1f2ba82c2a84 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:55.670670 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d1a3642a-04f0-47ea-a2bd-1f2ba82c2a84 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:55.913897 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-67a2dd6f-c1ae-46ea-a97d-89b3c6280846 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:55.915415 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-67a2dd6f-c1ae-46ea-a97d-89b3c6280846 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:55.929027 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-67a2dd6f-c1ae-46ea-a97d-89b3c6280846 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:55.930973 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-67a2dd6f-c1ae-46ea-a97d-89b3c6280846 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:55.932457 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-67a2dd6f-c1ae-46ea-a97d-89b3c6280846 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:55.933740 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-67a2dd6f-c1ae-46ea-a97d-89b3c6280846 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:56.111167 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d1a3642a-04f0-47ea-a2bd-1f2ba82c2a84 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d15b8d3057425dbf014609cacef9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a6bbf7f4541bbba9249cd2ce3a9a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:56.126810 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d1a3642a-04f0-47ea-a2bd-1f2ba82c2a84 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736" status: 200 len: 1465 microversion: 2.1 time: 0.515910 Jul 25 14:51:56.133005 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2418/5106] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:55 2022] GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 => generated 1465 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:56.141377 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-6d9937f4-6eae-4000-9ca5-11f8ab7e2837 req-9455ef7a-cf3b-4e66-8d47-38d89396407f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d74c1b24-d135-49c0-9d8f-0e90794d2488", "name": "network-vif-plugged", "status": "completed", "tag": "80f41e3e-c2f2-492c-b649-67bb4317f232"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:51:56.154249 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-6d9937f4-6eae-4000-9ca5-11f8ab7e2837 req-9455ef7a-cf3b-4e66-8d47-38d89396407f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:56.155108 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-6d9937f4-6eae-4000-9ca5-11f8ab7e2837 req-9455ef7a-cf3b-4e66-8d47-38d89396407f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:56.170513 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-6d9937f4-6eae-4000-9ca5-11f8ab7e2837 req-9455ef7a-cf3b-4e66-8d47-38d89396407f service nova] Creating event network-vif-plugged:80f41e3e-c2f2-492c-b649-67bb4317f232 for instance d74c1b24-d135-49c0-9d8f-0e90794d2488 on n-h1-846435-14 Jul 25 14:51:56.177334 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-6d9937f4-6eae-4000-9ca5-11f8ab7e2837 req-9455ef7a-cf3b-4e66-8d47-38d89396407f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041152 Jul 25 14:51:56.183460 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2419/5107] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:51:56.192206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-16e56d7a-1249-42c0-a150-82e16a57f34c tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f4686b2ce50>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:56.279232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-67a2dd6f-c1ae-46ea-a97d-89b3c6280846 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:56.293680 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-67a2dd6f-c1ae-46ea-a97d-89b3c6280846 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:56.295296 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-67a2dd6f-c1ae-46ea-a97d-89b3c6280846 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:56.297797 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-67a2dd6f-c1ae-46ea-a97d-89b3c6280846 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488" status: 200 len: 1362 microversion: 2.26 time: 0.388783 Jul 25 14:51:56.298949 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2689/5108] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:51:55 2022] GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488 => generated 1362 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:51:57.036838 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-16e56d7a-1249-42c0-a150-82e16a57f34c tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "DELETE /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4" status: 204 len: 0 microversion: 2.1 time: 0.851393 Jul 25 14:51:57.039372 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2420/5109] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:56 2022] DELETE /compute/v2.1/images/04add98f-3d3e-4412-a3b0-bbcf34d0d5c4 => generated 0 bytes in 855 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:51:57.048859 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-74f06d33-444f-4039-a4b1-73a969d446ce tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '.version_select at 0x7f468609ef70>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:57.078541 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-74f06d33-444f-4039-a4b1-73a969d446ce tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] HTTP exception thrown: Image not found. Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-74f06d33-444f-4039-a4b1-73a969d446ce tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Request method failure captured: Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a HTTP/1.1 Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q2l0e2yo1jNqh4BurHmAud90lxwsySbCA1bryVHAa8QAx-D2zW7NbynlsTX4MnxHfCrOvLCcjzeRdLsdfJHFR1ViMSaXh7mZe1uJHPM4enUCYRRSkDGsZhtDJXkVVEiNN1Xn090LpIVUSr6X0cDLtxLmMu8VPKCM2IXOrAqAXCNIJY Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 572a6bbf7f4541bbba9249cd2ce3a9a8 Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ImagesOneServerTestJSON-59585443 Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/572a6bbf7f4541bbba9249cd2ce3a9a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/572a6bbf7f4541bbba9249cd2ce3a9a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_572a6bbf7f4541bbba9249cd2ce3a9a8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/572a6bbf7f4541bbba9249cd2ce3a9a8"}]}] Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ImagesOneServerTestJSON-59585443 Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 572a6bbf7f4541bbba9249cd2ce3a9a8 Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-59585443 Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ImagesOneServerTestJSON-59585443-project Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: b0d15b8d3057425dbf014609cacef9e6 Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ImagesOneServerTestJSON-59585443-project Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: exception: Image not found. Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '14e1f34d-3c7e-46a1-9f79-f2232036b45a'} Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 14e1f34d-3c7e-46a1-9f79-f2232036b45a to delete Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 14e1f34d-3c7e-46a1-9f79-f2232036b45a could not be found. Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:51:57.081625 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:51:57.088266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:51:57.088266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:51:57.088266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:51:57.088266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:51:57.088266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 14:51:57.088266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 14:51:57.088266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:51:57.088266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:51:57.088266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 14:51:57.088266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 14:51:57.088266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 14:51:57.088266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:51:57.088266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:51:57.088266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:51:57.088266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:51:57.088266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:51:57.088266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:51:57.088266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:51:57.088266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:51:57.088266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 14:51:57.088266 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:51:57.088266 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-74f06d33-444f-4039-a4b1-73a969d446ce tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Returning 404 to user: Image not found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:51:57.088266 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-74f06d33-444f-4039-a4b1-73a969d446ce tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "DELETE /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a" status: 404 len: 62 microversion: 2.1 time: 0.040565 Jul 25 14:51:57.090490 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2690/5110] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:57 2022] DELETE /compute/v2.1/images/14e1f34d-3c7e-46a1-9f79-f2232036b45a => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:51:57.093785 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fea04c3b-d53e-46e8-97fc-8227c8fb45cd tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:57.094424 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fea04c3b-d53e-46e8-97fc-8227c8fb45cd tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] [instance: b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:57.104492 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fea04c3b-d53e-46e8-97fc-8227c8fb45cd tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:57.104961 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fea04c3b-d53e-46e8-97fc-8227c8fb45cd tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:57.105777 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fea04c3b-d53e-46e8-97fc-8227c8fb45cd tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:57.106226 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fea04c3b-d53e-46e8-97fc-8227c8fb45cd tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:57.157120 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fea04c3b-d53e-46e8-97fc-8227c8fb45cd tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] [instance: b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:51:57.323226 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1baf98d8-e196-4244-ae81-2127bb49f125 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:57.324144 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1baf98d8-e196-4244-ae81-2127bb49f125 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:57.326087 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fea04c3b-d53e-46e8-97fc-8227c8fb45cd tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736" status: 204 len: 0 microversion: 2.1 time: 0.235724 Jul 25 14:51:57.328201 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2421/5111] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:51:57 2022] DELETE /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:51:57.330603 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:51:57.341878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9ee85ca1-7e3e-463e-ab74-6ff35d1d80b3 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:57.343486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9ee85ca1-7e3e-463e-ab74-6ff35d1d80b3 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] [instance: b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:57.344611 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1baf98d8-e196-4244-ae81-2127bb49f125 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:57.346400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1baf98d8-e196-4244-ae81-2127bb49f125 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:57.349337 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1baf98d8-e196-4244-ae81-2127bb49f125 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:57.355537 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1baf98d8-e196-4244-ae81-2127bb49f125 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:57.380032 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9ee85ca1-7e3e-463e-ab74-6ff35d1d80b3 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:57.380648 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9ee85ca1-7e3e-463e-ab74-6ff35d1d80b3 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:57.381468 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9ee85ca1-7e3e-463e-ab74-6ff35d1d80b3 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:57.381920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9ee85ca1-7e3e-463e-ab74-6ff35d1d80b3 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:57.631480 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1baf98d8-e196-4244-ae81-2127bb49f125 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:57.641127 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1baf98d8-e196-4244-ae81-2127bb49f125 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:57.642599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1baf98d8-e196-4244-ae81-2127bb49f125 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:57.650628 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1baf98d8-e196-4244-ae81-2127bb49f125 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488" status: 200 len: 1362 microversion: 2.26 time: 0.333481 Jul 25 14:51:57.670112 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2691/5112] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:51:57 2022] GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488 => generated 1362 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:51:57.700546 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9ee85ca1-7e3e-463e-ab74-6ff35d1d80b3 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d15b8d3057425dbf014609cacef9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a6bbf7f4541bbba9249cd2ce3a9a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:57.710546 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9ee85ca1-7e3e-463e-ab74-6ff35d1d80b3 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736" status: 200 len: 1471 microversion: 2.1 time: 0.376842 Jul 25 14:51:57.711463 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2422/5113] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:57 2022] GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 => generated 1471 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:58.679393 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0e5d0507-49a9-4503-bcf0-b56cd17161c6 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:58.680821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0e5d0507-49a9-4503-bcf0-b56cd17161c6 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:58.688247 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0e5d0507-49a9-4503-bcf0-b56cd17161c6 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:58.689034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0e5d0507-49a9-4503-bcf0-b56cd17161c6 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:58.690020 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0e5d0507-49a9-4503-bcf0-b56cd17161c6 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:58.690618 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0e5d0507-49a9-4503-bcf0-b56cd17161c6 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:58.731890 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3f01595b-8be7-4584-a2d8-6f9add54e403 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:58.732711 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3f01595b-8be7-4584-a2d8-6f9add54e403 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] [instance: b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:58.743008 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3f01595b-8be7-4584-a2d8-6f9add54e403 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:58.743456 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3f01595b-8be7-4584-a2d8-6f9add54e403 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:58.744271 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3f01595b-8be7-4584-a2d8-6f9add54e403 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:58.744800 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3f01595b-8be7-4584-a2d8-6f9add54e403 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:58.943068 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3f01595b-8be7-4584-a2d8-6f9add54e403 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d15b8d3057425dbf014609cacef9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a6bbf7f4541bbba9249cd2ce3a9a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:58.963515 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3f01595b-8be7-4584-a2d8-6f9add54e403 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736" status: 200 len: 1471 microversion: 2.1 time: 0.235188 Jul 25 14:51:58.964863 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2423/5114] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:58 2022] GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 => generated 1471 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:58.972140 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-d5ae5feb-0839-4dea-b97c-7c0b99cffc30 req-447a389b-a09d-4dda-a92a-59a49e328800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736", "name": "network-vif-unplugged", "status": "completed", "tag": "35c26f0c-c295-4c03-b37c-60c401d0d30e"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:51:58.981693 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0e5d0507-49a9-4503-bcf0-b56cd17161c6 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:58.990028 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0e5d0507-49a9-4503-bcf0-b56cd17161c6 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:58.991742 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0e5d0507-49a9-4503-bcf0-b56cd17161c6 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:51:58.993259 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0e5d0507-49a9-4503-bcf0-b56cd17161c6 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488" status: 200 len: 1545 microversion: 2.26 time: 0.318333 Jul 25 14:51:58.994393 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2692/5115] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:51:58 2022] GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488 => generated 1545 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:51:59.007829 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-d5ae5feb-0839-4dea-b97c-7c0b99cffc30 req-447a389b-a09d-4dda-a92a-59a49e328800 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:59.008753 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-d5ae5feb-0839-4dea-b97c-7c0b99cffc30 req-447a389b-a09d-4dda-a92a-59a49e328800 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:59.019128 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-637e53db-4c26-452c-bcbc-cf319c55a4ed tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '.version_select at 0x7f46860f5160>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:59.046187 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-d5ae5feb-0839-4dea-b97c-7c0b99cffc30 req-447a389b-a09d-4dda-a92a-59a49e328800 service nova] Creating event network-vif-unplugged:35c26f0c-c295-4c03-b37c-60c401d0d30e for instance b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 on n-h2-846435-14 Jul 25 14:51:59.052350 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-637e53db-4c26-452c-bcbc-cf319c55a4ed tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:59.052892 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-637e53db-4c26-452c-bcbc-cf319c55a4ed tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:59.053554 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-d5ae5feb-0839-4dea-b97c-7c0b99cffc30 req-447a389b-a09d-4dda-a92a-59a49e328800 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086489 Jul 25 14:51:59.054675 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2424/5116] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:51:59.054807 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-637e53db-4c26-452c-bcbc-cf319c55a4ed tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:59.066379 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-637e53db-4c26-452c-bcbc-cf319c55a4ed tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:59.066831 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-637e53db-4c26-452c-bcbc-cf319c55a4ed tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:59.067651 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-637e53db-4c26-452c-bcbc-cf319c55a4ed tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:59.068147 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-637e53db-4c26-452c-bcbc-cf319c55a4ed tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:59.097521 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-637e53db-4c26-452c-bcbc-cf319c55a4ed tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:59.098163 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-637e53db-4c26-452c-bcbc-cf319c55a4ed tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:59.118554 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-637e53db-4c26-452c-bcbc-cf319c55a4ed tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:59.119869 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-637e53db-4c26-452c-bcbc-cf319c55a4ed tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:59.157917 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-637e53db-4c26-452c-bcbc-cf319c55a4ed tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lazy-loading 'flavor' on Instance uuid d74c1b24-d135-49c0-9d8f-0e90794d2488 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:51:59.183162 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-637e53db-4c26-452c-bcbc-cf319c55a4ed tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "PUT /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags/tempest-tag-1744740046" status: 201 len: 0 microversion: 2.26 time: 0.168180 Jul 25 14:51:59.190121 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2693/5117] 10.222.0.88 () {62 vars in 1380 bytes} [Mon Jul 25 14:51:59 2022] PUT /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags/tempest-tag-1744740046 => generated 0 bytes in 176 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Jul 25 14:51:59.196220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1b52866d-11a9-4425-b2ef-ec86037a6c60 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '.version_select at 0x7f46869b6f70>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:59.205224 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1b52866d-11a9-4425-b2ef-ec86037a6c60 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:59.206103 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1b52866d-11a9-4425-b2ef-ec86037a6c60 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:59.231419 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:51:59.236178 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1b52866d-11a9-4425-b2ef-ec86037a6c60 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags/tempest-tag-1744740046" status: 204 len: 0 microversion: 2.26 time: 0.044916 Jul 25 14:51:59.237417 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2425/5118] 10.222.0.88 () {60 vars in 1361 bytes} [Mon Jul 25 14:51:59 2022] GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags/tempest-tag-1744740046 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 25 14:51:59.245900 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ac1c75c5-0855-48dd-b66c-6af3c6a41256 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '.version_select at 0x7f468609ed30>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:59.259841 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac1c75c5-0855-48dd-b66c-6af3c6a41256 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:59.260710 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac1c75c5-0855-48dd-b66c-6af3c6a41256 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:59.261374 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ac1c75c5-0855-48dd-b66c-6af3c6a41256 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:59.270419 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac1c75c5-0855-48dd-b66c-6af3c6a41256 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:59.271440 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac1c75c5-0855-48dd-b66c-6af3c6a41256 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:59.272423 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac1c75c5-0855-48dd-b66c-6af3c6a41256 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:59.273018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac1c75c5-0855-48dd-b66c-6af3c6a41256 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:59.322229 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac1c75c5-0855-48dd-b66c-6af3c6a41256 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:59.322677 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac1c75c5-0855-48dd-b66c-6af3c6a41256 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:59.346630 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-ac1c75c5-0855-48dd-b66c-6af3c6a41256 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lazy-loading 'flavor' on Instance uuid d74c1b24-d135-49c0-9d8f-0e90794d2488 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:51:59.369732 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ac1c75c5-0855-48dd-b66c-6af3c6a41256 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "DELETE /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags" status: 204 len: 0 microversion: 2.26 time: 0.127983 Jul 25 14:51:59.375678 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2694/5119] 10.222.0.88 () {60 vars in 1295 bytes} [Mon Jul 25 14:51:59 2022] DELETE /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 14:51:59.381854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cadf4e45-72ad-46e5-8c2c-317e3da065ac tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '.version_select at 0x7f46869b6a60>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:59.388713 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:51:59.393275 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cadf4e45-72ad-46e5-8c2c-317e3da065ac tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:59.394065 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cadf4e45-72ad-46e5-8c2c-317e3da065ac tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:59.408378 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cadf4e45-72ad-46e5-8c2c-317e3da065ac tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags" status: 200 len: 12 microversion: 2.26 time: 0.031558 Jul 25 14:51:59.409505 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2426/5120] 10.222.0.88 () {60 vars in 1292 bytes} [Mon Jul 25 14:51:59 2022] GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags => generated 12 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:59.423626 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1221420f-b25f-4091-ab87-00c783d46611 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '.version_select at 0x7f46860efee0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:59.446214 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1221420f-b25f-4091-ab87-00c783d46611 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:59.446759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1221420f-b25f-4091-ab87-00c783d46611 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:59.447193 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1221420f-b25f-4091-ab87-00c783d46611 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:59.454076 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1221420f-b25f-4091-ab87-00c783d46611 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:59.454865 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1221420f-b25f-4091-ab87-00c783d46611 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:59.455887 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1221420f-b25f-4091-ab87-00c783d46611 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:59.456520 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1221420f-b25f-4091-ab87-00c783d46611 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:59.504204 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1221420f-b25f-4091-ab87-00c783d46611 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:59.504908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1221420f-b25f-4091-ab87-00c783d46611 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:59.518002 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1221420f-b25f-4091-ab87-00c783d46611 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:59.518738 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1221420f-b25f-4091-ab87-00c783d46611 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:59.524169 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:51:59.557472 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-1221420f-b25f-4091-ab87-00c783d46611 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lazy-loading 'flavor' on Instance uuid d74c1b24-d135-49c0-9d8f-0e90794d2488 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:51:59.582583 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1221420f-b25f-4091-ab87-00c783d46611 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "PUT /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags/tempest-tag-1555460781" status: 201 len: 0 microversion: 2.26 time: 0.166700 Jul 25 14:51:59.583888 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2695/5121] 10.222.0.88 () {62 vars in 1380 bytes} [Mon Jul 25 14:51:59 2022] PUT /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags/tempest-tag-1555460781 => generated 0 bytes in 169 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 25 14:51:59.593508 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7cc34a53-8957-4489-b97c-f84209381e28 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '.version_select at 0x7f46989ad0d0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:59.611093 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7cc34a53-8957-4489-b97c-f84209381e28 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:59.611690 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7cc34a53-8957-4489-b97c-f84209381e28 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:59.634208 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7cc34a53-8957-4489-b97c-f84209381e28 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags" status: 200 len: 36 microversion: 2.26 time: 0.044599 Jul 25 14:51:59.635489 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2427/5122] 10.222.0.88 () {60 vars in 1292 bytes} [Mon Jul 25 14:51:59 2022] GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags => generated 36 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:59.647784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-556645c8-39be-43a5-be4d-496fdb5d4635 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '.version_select at 0x7f46860ef160>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:59.662037 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-556645c8-39be-43a5-be4d-496fdb5d4635 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:59.662624 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-556645c8-39be-43a5-be4d-496fdb5d4635 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:59.662994 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-556645c8-39be-43a5-be4d-496fdb5d4635 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:59.669764 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-556645c8-39be-43a5-be4d-496fdb5d4635 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:59.670411 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-556645c8-39be-43a5-be4d-496fdb5d4635 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:59.671353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-556645c8-39be-43a5-be4d-496fdb5d4635 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:59.671959 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-556645c8-39be-43a5-be4d-496fdb5d4635 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:59.709124 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-556645c8-39be-43a5-be4d-496fdb5d4635 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:59.710259 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-556645c8-39be-43a5-be4d-496fdb5d4635 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:59.754819 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-556645c8-39be-43a5-be4d-496fdb5d4635 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lazy-loading 'flavor' on Instance uuid d74c1b24-d135-49c0-9d8f-0e90794d2488 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:51:59.798719 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-556645c8-39be-43a5-be4d-496fdb5d4635 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "DELETE /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags/tempest-tag-1555460781" status: 204 len: 0 microversion: 2.26 time: 0.155517 Jul 25 14:51:59.799792 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2696/5123] 10.222.0.88 () {60 vars in 1364 bytes} [Mon Jul 25 14:51:59 2022] DELETE /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags/tempest-tag-1555460781 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 14:51:59.816158 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-854bc9eb-bdf2-46ff-8ac9-6ddef099a29b tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '.version_select at 0x7f46869b65e0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:59.839471 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-854bc9eb-bdf2-46ff-8ac9-6ddef099a29b tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:59.840357 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-854bc9eb-bdf2-46ff-8ac9-6ddef099a29b tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:59.856522 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-854bc9eb-bdf2-46ff-8ac9-6ddef099a29b tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags" status: 200 len: 12 microversion: 2.26 time: 0.051860 Jul 25 14:51:59.857874 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2428/5124] 10.222.0.88 () {60 vars in 1292 bytes} [Mon Jul 25 14:51:59 2022] GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags => generated 12 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:51:59.870124 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ad1eb38b-e4c5-4ef5-b1bd-6fd48bcd5b34 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '.version_select at 0x7f46860e19d0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:59.878533 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad1eb38b-e4c5-4ef5-b1bd-6fd48bcd5b34 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:59.879194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad1eb38b-e4c5-4ef5-b1bd-6fd48bcd5b34 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:59.880199 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ad1eb38b-e4c5-4ef5-b1bd-6fd48bcd5b34 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:59.889975 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad1eb38b-e4c5-4ef5-b1bd-6fd48bcd5b34 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:59.925088 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad1eb38b-e4c5-4ef5-b1bd-6fd48bcd5b34 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:59.936570 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad1eb38b-e4c5-4ef5-b1bd-6fd48bcd5b34 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:59.941011 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad1eb38b-e4c5-4ef5-b1bd-6fd48bcd5b34 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:51:59.993191 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f7180b41-7925-43d4-99c2-2a97d7f27218 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:51:59.994678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f7180b41-7925-43d4-99c2-2a97d7f27218 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] [instance: b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:51:59.995061 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad1eb38b-e4c5-4ef5-b1bd-6fd48bcd5b34 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:51:59.996207 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad1eb38b-e4c5-4ef5-b1bd-6fd48bcd5b34 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:00.014949 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f7180b41-7925-43d4-99c2-2a97d7f27218 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:00.021215 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f7180b41-7925-43d4-99c2-2a97d7f27218 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:00.022651 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f7180b41-7925-43d4-99c2-2a97d7f27218 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:00.024121 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f7180b41-7925-43d4-99c2-2a97d7f27218 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:00.035045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-ad1eb38b-e4c5-4ef5-b1bd-6fd48bcd5b34 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lazy-loading 'flavor' on Instance uuid d74c1b24-d135-49c0-9d8f-0e90794d2488 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:52:00.060209 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ad1eb38b-e4c5-4ef5-b1bd-6fd48bcd5b34 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "DELETE /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags" status: 204 len: 0 microversion: 2.26 time: 0.195772 Jul 25 14:52:00.061341 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2697/5125] 10.222.0.88 () {60 vars in 1295 bytes} [Mon Jul 25 14:51:59 2022] DELETE /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 14:52:00.095046 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-01bd98a6-b9e8-42b5-b612-121a95a88238 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '.version_select at 0x7f46860988b0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:00.124184 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01bd98a6-b9e8-42b5-b612-121a95a88238 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:00.124968 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01bd98a6-b9e8-42b5-b612-121a95a88238 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:00.127707 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-01bd98a6-b9e8-42b5-b612-121a95a88238 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:00.145590 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01bd98a6-b9e8-42b5-b612-121a95a88238 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:00.146637 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01bd98a6-b9e8-42b5-b612-121a95a88238 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:00.154014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01bd98a6-b9e8-42b5-b612-121a95a88238 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:00.156298 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01bd98a6-b9e8-42b5-b612-121a95a88238 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:00.238623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01bd98a6-b9e8-42b5-b612-121a95a88238 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:00.239005 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01bd98a6-b9e8-42b5-b612-121a95a88238 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:00.274257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01bd98a6-b9e8-42b5-b612-121a95a88238 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:00.274705 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01bd98a6-b9e8-42b5-b612-121a95a88238 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:00.315670 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f7180b41-7925-43d4-99c2-2a97d7f27218 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d15b8d3057425dbf014609cacef9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a6bbf7f4541bbba9249cd2ce3a9a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:00.330162 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f7180b41-7925-43d4-99c2-2a97d7f27218 tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736" status: 200 len: 1471 microversion: 2.1 time: 0.341331 Jul 25 14:52:00.330756 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-01bd98a6-b9e8-42b5-b612-121a95a88238 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lazy-loading 'flavor' on Instance uuid d74c1b24-d135-49c0-9d8f-0e90794d2488 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:52:00.347314 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2429/5126] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:51:59 2022] GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 => generated 1471 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:00.358905 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-01bd98a6-b9e8-42b5-b612-121a95a88238 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "PUT /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags/tempest-tag-620835974" status: 201 len: 0 microversion: 2.26 time: 0.287699 Jul 25 14:52:00.360373 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2698/5127] 10.222.0.88 () {62 vars in 1377 bytes} [Mon Jul 25 14:52:00 2022] PUT /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags/tempest-tag-620835974 => generated 0 bytes in 290 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 25 14:52:00.370190 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a38fd7f8-0a6c-4108-8987-f575a22bb227 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '.version_select at 0x7f46869b6af0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:00.380945 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a38fd7f8-0a6c-4108-8987-f575a22bb227 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:00.381401 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a38fd7f8-0a6c-4108-8987-f575a22bb227 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:00.381887 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a38fd7f8-0a6c-4108-8987-f575a22bb227 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:00.404029 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a38fd7f8-0a6c-4108-8987-f575a22bb227 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:00.404480 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a38fd7f8-0a6c-4108-8987-f575a22bb227 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:00.405422 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a38fd7f8-0a6c-4108-8987-f575a22bb227 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:00.405693 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a38fd7f8-0a6c-4108-8987-f575a22bb227 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:00.465607 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a38fd7f8-0a6c-4108-8987-f575a22bb227 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:00.466275 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a38fd7f8-0a6c-4108-8987-f575a22bb227 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:00.482654 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a38fd7f8-0a6c-4108-8987-f575a22bb227 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:00.493008 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a38fd7f8-0a6c-4108-8987-f575a22bb227 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:00.537626 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-a38fd7f8-0a6c-4108-8987-f575a22bb227 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lazy-loading 'flavor' on Instance uuid d74c1b24-d135-49c0-9d8f-0e90794d2488 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:52:00.578814 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a38fd7f8-0a6c-4108-8987-f575a22bb227 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "PUT /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags/tempest-tag-71262043" status: 201 len: 0 microversion: 2.26 time: 0.209713 Jul 25 14:52:00.585314 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2430/5128] 10.222.0.88 () {62 vars in 1374 bytes} [Mon Jul 25 14:52:00 2022] PUT /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags/tempest-tag-71262043 => generated 0 bytes in 220 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Jul 25 14:52:00.590272 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-23541b94-8e3a-4d25-bf7f-35e5b0f91b16 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '.version_select at 0x7f46860e5dc0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:00.606830 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23541b94-8e3a-4d25-bf7f-35e5b0f91b16 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:00.607342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23541b94-8e3a-4d25-bf7f-35e5b0f91b16 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:00.607843 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-23541b94-8e3a-4d25-bf7f-35e5b0f91b16 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:00.625563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23541b94-8e3a-4d25-bf7f-35e5b0f91b16 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:00.626416 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23541b94-8e3a-4d25-bf7f-35e5b0f91b16 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:00.627611 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23541b94-8e3a-4d25-bf7f-35e5b0f91b16 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:00.628246 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23541b94-8e3a-4d25-bf7f-35e5b0f91b16 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:00.685962 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23541b94-8e3a-4d25-bf7f-35e5b0f91b16 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:00.686400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23541b94-8e3a-4d25-bf7f-35e5b0f91b16 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:00.716278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-23541b94-8e3a-4d25-bf7f-35e5b0f91b16 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lazy-loading 'flavor' on Instance uuid d74c1b24-d135-49c0-9d8f-0e90794d2488 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:52:00.756834 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-23541b94-8e3a-4d25-bf7f-35e5b0f91b16 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "DELETE /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags" status: 204 len: 0 microversion: 2.26 time: 0.171308 Jul 25 14:52:00.760048 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2699/5129] 10.222.0.88 () {60 vars in 1295 bytes} [Mon Jul 25 14:52:00 2022] DELETE /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 25 14:52:00.772128 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1585aa7c-89c2-4a45-9e63-0f0f8d27b4e6 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '.version_select at 0x7f4687216820>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:00.777092 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:52:00.792863 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1585aa7c-89c2-4a45-9e63-0f0f8d27b4e6 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:00.793332 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1585aa7c-89c2-4a45-9e63-0f0f8d27b4e6 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:00.823725 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1585aa7c-89c2-4a45-9e63-0f0f8d27b4e6 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags" status: 200 len: 12 microversion: 2.26 time: 0.059196 Jul 25 14:52:00.831619 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2431/5130] 10.222.0.88 () {60 vars in 1292 bytes} [Mon Jul 25 14:52:00 2022] GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags => generated 12 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:00.836605 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d0a8ba8f-7eea-47ba-99fb-26c3c62be754 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '.version_select at 0x7f468609e280>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:00.851943 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d0a8ba8f-7eea-47ba-99fb-26c3c62be754 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:00.856093 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d0a8ba8f-7eea-47ba-99fb-26c3c62be754 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:00.856772 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d0a8ba8f-7eea-47ba-99fb-26c3c62be754 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:00.864313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-c484b8a2-d2a3-4fa5-8b4d-51f69b52b607 req-9a237a66-f7ca-4870-ac18-74186c9c0653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736", "name": "network-vif-deleted", "tag": "35c26f0c-c295-4c03-b37c-60c401d0d30e"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:52:00.875342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d0a8ba8f-7eea-47ba-99fb-26c3c62be754 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:00.876578 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d0a8ba8f-7eea-47ba-99fb-26c3c62be754 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:00.878575 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c484b8a2-d2a3-4fa5-8b4d-51f69b52b607 req-9a237a66-f7ca-4870-ac18-74186c9c0653 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:00.879052 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c484b8a2-d2a3-4fa5-8b4d-51f69b52b607 req-9a237a66-f7ca-4870-ac18-74186c9c0653 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:00.882764 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d0a8ba8f-7eea-47ba-99fb-26c3c62be754 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:00.883630 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d0a8ba8f-7eea-47ba-99fb-26c3c62be754 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:00.908270 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-c484b8a2-d2a3-4fa5-8b4d-51f69b52b607 req-9a237a66-f7ca-4870-ac18-74186c9c0653 service nova] Creating event network-vif-deleted:35c26f0c-c295-4c03-b37c-60c401d0d30e for instance b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 on n-h2-846435-14 Jul 25 14:52:00.946761 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-c484b8a2-d2a3-4fa5-8b4d-51f69b52b607 req-9a237a66-f7ca-4870-ac18-74186c9c0653 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088460 Jul 25 14:52:00.948716 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2432/5131] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:52:00.956833 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d0a8ba8f-7eea-47ba-99fb-26c3c62be754 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:00.956833 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d0a8ba8f-7eea-47ba-99fb-26c3c62be754 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:00.972140 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-d0a8ba8f-7eea-47ba-99fb-26c3c62be754 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lazy-loading 'flavor' on Instance uuid d74c1b24-d135-49c0-9d8f-0e90794d2488 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:52:01.014479 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d0a8ba8f-7eea-47ba-99fb-26c3c62be754 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "DELETE /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags" status: 204 len: 0 microversion: 2.26 time: 0.182711 Jul 25 14:52:01.022043 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2700/5132] 10.222.0.88 () {60 vars in 1295 bytes} [Mon Jul 25 14:52:00 2022] DELETE /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 14:52:01.028498 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-51f32b30-4427-47bd-91f5-5fb152e5ada6 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '.version_select at 0x7f46869b6820>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:01.043531 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-51f32b30-4427-47bd-91f5-5fb152e5ada6 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:01.044192 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-51f32b30-4427-47bd-91f5-5fb152e5ada6 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:01.044968 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-51f32b30-4427-47bd-91f5-5fb152e5ada6 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:01.058526 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-51f32b30-4427-47bd-91f5-5fb152e5ada6 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:01.059153 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-51f32b30-4427-47bd-91f5-5fb152e5ada6 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:01.061939 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-51f32b30-4427-47bd-91f5-5fb152e5ada6 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:01.064112 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-51f32b30-4427-47bd-91f5-5fb152e5ada6 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:01.143342 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-51f32b30-4427-47bd-91f5-5fb152e5ada6 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:01.144406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-51f32b30-4427-47bd-91f5-5fb152e5ada6 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:01.157640 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-51f32b30-4427-47bd-91f5-5fb152e5ada6 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:01.158435 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-51f32b30-4427-47bd-91f5-5fb152e5ada6 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:01.214013 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-51f32b30-4427-47bd-91f5-5fb152e5ada6 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lazy-loading 'flavor' on Instance uuid d74c1b24-d135-49c0-9d8f-0e90794d2488 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:52:01.273210 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-51f32b30-4427-47bd-91f5-5fb152e5ada6 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "PUT /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags/tempest-tag-364926668" status: 201 len: 0 microversion: 2.26 time: 0.249613 Jul 25 14:52:01.274675 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2433/5133] 10.222.0.88 () {62 vars in 1377 bytes} [Mon Jul 25 14:52:01 2022] PUT /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags/tempest-tag-364926668 => generated 0 bytes in 252 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 25 14:52:01.287015 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8e468173-5a34-4a1b-8b10-c8a64d367615 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '.version_select at 0x7f46860ef310>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:01.311999 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e468173-5a34-4a1b-8b10-c8a64d367615 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:01.313418 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e468173-5a34-4a1b-8b10-c8a64d367615 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:01.315582 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8e468173-5a34-4a1b-8b10-c8a64d367615 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:01.334254 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e468173-5a34-4a1b-8b10-c8a64d367615 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:01.335241 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e468173-5a34-4a1b-8b10-c8a64d367615 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:01.338396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e468173-5a34-4a1b-8b10-c8a64d367615 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:01.339561 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e468173-5a34-4a1b-8b10-c8a64d367615 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:01.356741 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b0d4bdf9-1aad-4db4-bd4e-332be1a8cd8a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:01.357816 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b0d4bdf9-1aad-4db4-bd4e-332be1a8cd8a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] [instance: b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:01.368939 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b0d4bdf9-1aad-4db4-bd4e-332be1a8cd8a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:01.373309 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b0d4bdf9-1aad-4db4-bd4e-332be1a8cd8a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:01.374996 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b0d4bdf9-1aad-4db4-bd4e-332be1a8cd8a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:01.377913 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b0d4bdf9-1aad-4db4-bd4e-332be1a8cd8a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:01.420046 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e468173-5a34-4a1b-8b10-c8a64d367615 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:01.420515 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e468173-5a34-4a1b-8b10-c8a64d367615 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:01.455914 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b0d4bdf9-1aad-4db4-bd4e-332be1a8cd8a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:01.456431 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b0d4bdf9-1aad-4db4-bd4e-332be1a8cd8a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:01.457247 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-b0d4bdf9-1aad-4db4-bd4e-332be1a8cd8a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lazy-loading 'fault' on Instance uuid b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:52:01.457498 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e468173-5a34-4a1b-8b10-c8a64d367615 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:01.457984 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e468173-5a34-4a1b-8b10-c8a64d367615 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:01.539650 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-8e468173-5a34-4a1b-8b10-c8a64d367615 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lazy-loading 'flavor' on Instance uuid d74c1b24-d135-49c0-9d8f-0e90794d2488 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:52:01.565486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b0d4bdf9-1aad-4db4-bd4e-332be1a8cd8a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d15b8d3057425dbf014609cacef9e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572a6bbf7f4541bbba9249cd2ce3a9a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:01.577318 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b0d4bdf9-1aad-4db4-bd4e-332be1a8cd8a tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736" status: 200 len: 1306 microversion: 2.1 time: 0.226959 Jul 25 14:52:01.586834 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2434/5134] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:01 2022] GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 => generated 1306 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:01.592047 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8e468173-5a34-4a1b-8b10-c8a64d367615 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "PUT /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags/tempest-tag-824014906" status: 201 len: 0 microversion: 2.26 time: 0.308659 Jul 25 14:52:01.592914 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2701/5135] 10.222.0.88 () {62 vars in 1377 bytes} [Mon Jul 25 14:52:01 2022] PUT /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags/tempest-tag-824014906 => generated 0 bytes in 311 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 25 14:52:01.602475 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4f379c78-5619-4cd0-8c8c-722c5b664869 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Action: 'update_all', calling method: .version_select at 0x7f46860f1b80>, body: {"tags": ["tempest-tag-1683052196", "tempest-tag-179297906"]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:52:01.613462 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4f379c78-5619-4cd0-8c8c-722c5b664869 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:01.614038 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4f379c78-5619-4cd0-8c8c-722c5b664869 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:01.614796 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4f379c78-5619-4cd0-8c8c-722c5b664869 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:01.626525 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4f379c78-5619-4cd0-8c8c-722c5b664869 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:01.627656 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4f379c78-5619-4cd0-8c8c-722c5b664869 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:01.628754 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4f379c78-5619-4cd0-8c8c-722c5b664869 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:01.629403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4f379c78-5619-4cd0-8c8c-722c5b664869 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:01.666150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4f379c78-5619-4cd0-8c8c-722c5b664869 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:01.666600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4f379c78-5619-4cd0-8c8c-722c5b664869 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:01.699392 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-4f379c78-5619-4cd0-8c8c-722c5b664869 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lazy-loading 'flavor' on Instance uuid d74c1b24-d135-49c0-9d8f-0e90794d2488 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:52:01.729626 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4f379c78-5619-4cd0-8c8c-722c5b664869 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "PUT /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags" status: 200 len: 61 microversion: 2.26 time: 0.131386 Jul 25 14:52:01.730651 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2702/5136] 10.222.0.88 () {62 vars in 1312 bytes} [Mon Jul 25 14:52:01 2022] PUT /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags => generated 61 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:52:01.743184 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f06e1cb6-6fa6-4abd-be45-311646996209 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '.version_select at 0x7f46988adf70>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:01.753070 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f06e1cb6-6fa6-4abd-be45-311646996209 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:01.753516 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f06e1cb6-6fa6-4abd-be45-311646996209 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:01.771862 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f06e1cb6-6fa6-4abd-be45-311646996209 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags" status: 200 len: 61 microversion: 2.26 time: 0.034894 Jul 25 14:52:01.772425 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2435/5137] 10.222.0.88 () {60 vars in 1292 bytes} [Mon Jul 25 14:52:01 2022] GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags => generated 61 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:01.785229 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4e5734c8-6e1e-496b-8e48-fb7b78d74c8f tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '.version_select at 0x7f4686138b80>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:01.792684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e5734c8-6e1e-496b-8e48-fb7b78d74c8f tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:01.793731 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e5734c8-6e1e-496b-8e48-fb7b78d74c8f tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:01.794216 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4e5734c8-6e1e-496b-8e48-fb7b78d74c8f tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:01.800689 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e5734c8-6e1e-496b-8e48-fb7b78d74c8f tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:01.801133 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e5734c8-6e1e-496b-8e48-fb7b78d74c8f tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:01.802097 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e5734c8-6e1e-496b-8e48-fb7b78d74c8f tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:01.802528 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e5734c8-6e1e-496b-8e48-fb7b78d74c8f tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:01.829906 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e5734c8-6e1e-496b-8e48-fb7b78d74c8f tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:01.830350 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e5734c8-6e1e-496b-8e48-fb7b78d74c8f tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:01.838225 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=4,nova_cell1:RELEASE=3,nova_cell1:SELECT=84,nova_cell1:DELETE=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:52:01.850362 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-4e5734c8-6e1e-496b-8e48-fb7b78d74c8f tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lazy-loading 'flavor' on Instance uuid d74c1b24-d135-49c0-9d8f-0e90794d2488 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:52:01.877140 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4e5734c8-6e1e-496b-8e48-fb7b78d74c8f tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "DELETE /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags" status: 204 len: 0 microversion: 2.26 time: 0.098161 Jul 25 14:52:01.878084 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2703/5138] 10.222.0.88 () {60 vars in 1295 bytes} [Mon Jul 25 14:52:01 2022] DELETE /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488/tags => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 14:52:01.887353 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-75de4649-8526-4d90-9ca6-311e75aed850 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:01.888603 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-75de4649-8526-4d90-9ca6-311e75aed850 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:01.897048 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-75de4649-8526-4d90-9ca6-311e75aed850 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:01.897628 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-75de4649-8526-4d90-9ca6-311e75aed850 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:01.898655 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-75de4649-8526-4d90-9ca6-311e75aed850 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:01.899702 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-75de4649-8526-4d90-9ca6-311e75aed850 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:01.941606 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-75de4649-8526-4d90-9ca6-311e75aed850 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:52:02.061922 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-75de4649-8526-4d90-9ca6-311e75aed850 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "DELETE /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488" status: 204 len: 0 microversion: 2.26 time: 0.178144 Jul 25 14:52:02.068565 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2436/5139] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Jul 25 14:52:01 2022] DELETE /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 14:52:02.074221 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-48d13e02-b74e-4fdf-82b0-046554db9745 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:02.074862 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-48d13e02-b74e-4fdf-82b0-046554db9745 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:02.094021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48d13e02-b74e-4fdf-82b0-046554db9745 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:02.095068 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48d13e02-b74e-4fdf-82b0-046554db9745 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:02.096688 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48d13e02-b74e-4fdf-82b0-046554db9745 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:02.097379 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48d13e02-b74e-4fdf-82b0-046554db9745 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:02.603766 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2534c998-0601-4126-95b4-f9f67a82c2fb tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:02.604604 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2534c998-0601-4126-95b4-f9f67a82c2fb tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] [instance: b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:02.618272 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2534c998-0601-4126-95b4-f9f67a82c2fb tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:02.619127 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2534c998-0601-4126-95b4-f9f67a82c2fb tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:02.619431 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2534c998-0601-4126-95b4-f9f67a82c2fb tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:02.627034 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2534c998-0601-4126-95b4-f9f67a82c2fb tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:02.699310 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-2534c998-0601-4126-95b4-f9f67a82c2fb tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] HTTP exception thrown: Instance b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 could not be found. Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2534c998-0601-4126-95b4-f9f67a82c2fb tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Request method failure captured: Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 HTTP/1.1 Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q2l0e2yo1jNqh4BurHmAud90lxwsySbCA1bryVHAa8QAx-D2zW7NbynlsTX4MnxHfCrOvLCcjzeRdLsdfJHFR1ViMSaXh7mZe1uJHPM4enUCYRRSkDGsZhtDJXkVVEiNN1Xn090LpIVUSr6X0cDLtxLmMu8VPKCM2IXOrAqAXCNIJY Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 572a6bbf7f4541bbba9249cd2ce3a9a8 Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ImagesOneServerTestJSON-59585443 Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/572a6bbf7f4541bbba9249cd2ce3a9a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/572a6bbf7f4541bbba9249cd2ce3a9a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_572a6bbf7f4541bbba9249cd2ce3a9a8", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/572a6bbf7f4541bbba9249cd2ce3a9a8"}]}] Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ImagesOneServerTestJSON-59585443 Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 572a6bbf7f4541bbba9249cd2ce3a9a8 Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-59585443 Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ImagesOneServerTestJSON-59585443-project Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: b0d15b8d3057425dbf014609cacef9e6 Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ImagesOneServerTestJSON-59585443-project Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 could not be found. Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736'} Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 could not be found. Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 could not be found. Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:52:02.701644 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:52:02.708345 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:52:02.708345 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:52:02.708345 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:52:02.708345 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:52:02.708345 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:52:02.708345 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 could not be found. Jul 25 14:52:02.708345 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:52:02.708345 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2534c998-0601-4126-95b4-f9f67a82c2fb tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] Returning 404 to user: Instance b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:52:02.709376 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2534c998-0601-4126-95b4-f9f67a82c2fb tempest-ImagesOneServerTestJSON-59585443 tempest-ImagesOneServerTestJSON-59585443-project] 10.222.0.88 "GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736" status: 404 len: 111 microversion: 2.1 time: 0.112445 Jul 25 14:52:02.710044 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2437/5140] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:02 2022] GET /compute/v2.1/servers/b34fe2f0-1ebe-4933-8fbb-e11ff7e2d736 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:52:02.897141 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-48d13e02-b74e-4fdf-82b0-046554db9745 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:02.905733 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-48d13e02-b74e-4fdf-82b0-046554db9745 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:02.911949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-48d13e02-b74e-4fdf-82b0-046554db9745 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:02.917196 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-48d13e02-b74e-4fdf-82b0-046554db9745 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488" status: 200 len: 1551 microversion: 2.26 time: 0.848393 Jul 25 14:52:02.932018 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2704/5141] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:52:02 2022] GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488 => generated 1551 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:52:03.947656 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0bb6d494-bd33-4d1f-8122-29e88ae624c5 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:03.948554 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0bb6d494-bd33-4d1f-8122-29e88ae624c5 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:03.963795 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0bb6d494-bd33-4d1f-8122-29e88ae624c5 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:03.965912 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0bb6d494-bd33-4d1f-8122-29e88ae624c5 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:03.967130 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0bb6d494-bd33-4d1f-8122-29e88ae624c5 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:03.969151 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0bb6d494-bd33-4d1f-8122-29e88ae624c5 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:04.171429 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-510d020f-02fc-42ef-b330-90274504ea93 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-961930611", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "0944b5b0-36d5-4dc6-993f-6011aef2eaba"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1414331621", "security_groups": [{"name": "tempest-secgroup-smoke-2030023353"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:52:04.334511 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-510d020f-02fc-42ef-b330-90274504ea93 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] validate_networks() for [('0944b5b0-36d5-4dc6-993f-6011aef2eaba', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:52:04.561599 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0bb6d494-bd33-4d1f-8122-29e88ae624c5 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:04.571002 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0bb6d494-bd33-4d1f-8122-29e88ae624c5 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:04.594269 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0bb6d494-bd33-4d1f-8122-29e88ae624c5 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:04.597072 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0bb6d494-bd33-4d1f-8122-29e88ae624c5 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488" status: 200 len: 1551 microversion: 2.26 time: 0.655180 Jul 25 14:52:04.597644 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2438/5142] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:52:03 2022] GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488 => generated 1551 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:52:04.962487 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-fde92093-dabb-4049-a085-da2806f25479 req-d517c3ef-4448-4c73-bb16-9b553776a3bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d74c1b24-d135-49c0-9d8f-0e90794d2488", "name": "network-vif-deleted", "tag": "80f41e3e-c2f2-492c-b649-67bb4317f232"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:52:05.010367 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-fde92093-dabb-4049-a085-da2806f25479 req-d517c3ef-4448-4c73-bb16-9b553776a3bf service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:05.010827 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-fde92093-dabb-4049-a085-da2806f25479 req-d517c3ef-4448-4c73-bb16-9b553776a3bf service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:05.048464 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-fde92093-dabb-4049-a085-da2806f25479 req-d517c3ef-4448-4c73-bb16-9b553776a3bf service nova] Creating event network-vif-deleted:80f41e3e-c2f2-492c-b649-67bb4317f232 for instance d74c1b24-d135-49c0-9d8f-0e90794d2488 on n-h1-846435-14 Jul 25 14:52:05.058046 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-fde92093-dabb-4049-a085-da2806f25479 req-d517c3ef-4448-4c73-bb16-9b553776a3bf service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104473 Jul 25 14:52:05.058673 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2439/5143] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:52:05.153446 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-510d020f-02fc-42ef-b330-90274504ea93 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:52:05.153994 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-510d020f-02fc-42ef-b330-90274504ea93 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:52:05.154901 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-510d020f-02fc-42ef-b330-90274504ea93 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:52:05.155704 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-510d020f-02fc-42ef-b330-90274504ea93 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:52:05.156840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-510d020f-02fc-42ef-b330-90274504ea93 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:52:05.234248 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-510d020f-02fc-42ef-b330-90274504ea93 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:05.237789 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-510d020f-02fc-42ef-b330-90274504ea93 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:05.241232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-510d020f-02fc-42ef-b330-90274504ea93 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:05.244986 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-510d020f-02fc-42ef-b330-90274504ea93 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:05.310282 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-510d020f-02fc-42ef-b330-90274504ea93 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Getting quotas for project 8dd09177faea4702992aaab182125b5a. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:52:05.324105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-510d020f-02fc-42ef-b330-90274504ea93 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Getting quotas for user ca46c8e84b8644b69937ec9c06cb0e9a and project 8dd09177faea4702992aaab182125b5a. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:52:05.366726 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-510d020f-02fc-42ef-b330-90274504ea93 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:52:05.369866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-510d020f-02fc-42ef-b330-90274504ea93 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:52:05.487141 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-510d020f-02fc-42ef-b330-90274504ea93 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.318157 Jul 25 14:52:05.491511 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2705/5144] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:52:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 1325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 14:52:05.501422 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-97d129da-e550-4d5a-976e-cfa0248cccad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:05.503926 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-97d129da-e550-4d5a-976e-cfa0248cccad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:05.621124 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-99b43c83-f0ef-4295-b6b1-ef21022ac437 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:05.622213 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-99b43c83-f0ef-4295-b6b1-ef21022ac437 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:05.625793 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-97d129da-e550-4d5a-976e-cfa0248cccad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:05.637724 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-99b43c83-f0ef-4295-b6b1-ef21022ac437 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:05.637981 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-97d129da-e550-4d5a-976e-cfa0248cccad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1266 microversion: 2.1 time: 0.141692 Jul 25 14:52:05.642290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-99b43c83-f0ef-4295-b6b1-ef21022ac437 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:05.644460 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-99b43c83-f0ef-4295-b6b1-ef21022ac437 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:05.646024 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-99b43c83-f0ef-4295-b6b1-ef21022ac437 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:05.664011 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2440/5145] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:05 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:05.742816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-99b43c83-f0ef-4295-b6b1-ef21022ac437 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:05.744190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-99b43c83-f0ef-4295-b6b1-ef21022ac437 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:05.744859 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-99b43c83-f0ef-4295-b6b1-ef21022ac437 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lazy-loading 'fault' on Instance uuid d74c1b24-d135-49c0-9d8f-0e90794d2488 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:52:05.800364 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-99b43c83-f0ef-4295-b6b1-ef21022ac437 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:05.813086 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-99b43c83-f0ef-4295-b6b1-ef21022ac437 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:05.814848 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-99b43c83-f0ef-4295-b6b1-ef21022ac437 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acb08a16e9424132ab756f57492d7ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c0f6803c644cf5af8fc38f9fc43442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:05.817425 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-99b43c83-f0ef-4295-b6b1-ef21022ac437 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488" status: 200 len: 1352 microversion: 2.26 time: 0.200770 Jul 25 14:52:05.826671 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2706/5146] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:52:05 2022] GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488 => generated 1352 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:52:06.676280 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1460e3b3-1831-42cc-a954-665d5b6300a9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:06.679490 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1460e3b3-1831-42cc-a954-665d5b6300a9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:06.705400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1460e3b3-1831-42cc-a954-665d5b6300a9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:06.706976 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1460e3b3-1831-42cc-a954-665d5b6300a9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:06.709520 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1460e3b3-1831-42cc-a954-665d5b6300a9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:06.713301 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1460e3b3-1831-42cc-a954-665d5b6300a9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:06.909125 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1460e3b3-1831-42cc-a954-665d5b6300a9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:06.918461 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1460e3b3-1831-42cc-a954-665d5b6300a9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1262 microversion: 2.1 time: 0.256584 Jul 25 14:52:06.921082 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2441/5147] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:06 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1262 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:06.933024 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f5bb1e5c-96bb-4ad5-85b4-560963946a60 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:06.937663 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f5bb1e5c-96bb-4ad5-85b4-560963946a60 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] [instance: d74c1b24-d135-49c0-9d8f-0e90794d2488] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:06.952801 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f5bb1e5c-96bb-4ad5-85b4-560963946a60 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:06.955099 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f5bb1e5c-96bb-4ad5-85b4-560963946a60 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:06.956376 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f5bb1e5c-96bb-4ad5-85b4-560963946a60 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:06.958201 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f5bb1e5c-96bb-4ad5-85b4-560963946a60 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:06.999216 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-f5bb1e5c-96bb-4ad5-85b4-560963946a60 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] HTTP exception thrown: Instance d74c1b24-d135-49c0-9d8f-0e90794d2488 could not be found. Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f5bb1e5c-96bb-4ad5-85b4-560963946a60 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Request method failure captured: Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488 HTTP/1.1 Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q30WvPH3P7AZvO8nB5d5HFEVw8QsDRE-NFcOHXFrGUMMI6LXrDhT2N8BLs__251VNi4iZxpdddCz6sBDNtuOL3GpxlAnmNh-xMGKg6CJN3iiWkESOlo3M3AKNZpM4M5MvH5ZppknBPbCeZ9SWwfbgCurl8NrfvoAnaniSMpqojc31A Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: X-Openstack-Nova-Api-Version: 2.26 Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 32c0f6803c644cf5af8fc38f9fc43442 Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServerTagsTestJSON-1283838402 Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/32c0f6803c644cf5af8fc38f9fc43442"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/32c0f6803c644cf5af8fc38f9fc43442"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_32c0f6803c644cf5af8fc38f9fc43442", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/32c0f6803c644cf5af8fc38f9fc43442"}]}] Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServerTagsTestJSON-1283838402 Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 32c0f6803c644cf5af8fc38f9fc43442 Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServerTagsTestJSON-1283838402 Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServerTagsTestJSON-1283838402-project Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: acb08a16e9424132ab756f57492d7ba1 Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServerTagsTestJSON-1283838402-project Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance d74c1b24-d135-49c0-9d8f-0e90794d2488 could not be found. Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'd74c1b24-d135-49c0-9d8f-0e90794d2488'} Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d74c1b24-d135-49c0-9d8f-0e90794d2488 could not be found. Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d74c1b24-d135-49c0-9d8f-0e90794d2488 could not be found. Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:52:07.002855 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:52:07.008513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:52:07.008513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:52:07.008513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:52:07.008513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:52:07.008513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:52:07.008513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d74c1b24-d135-49c0-9d8f-0e90794d2488 could not be found. Jul 25 14:52:07.008513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:52:07.011943 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f5bb1e5c-96bb-4ad5-85b4-560963946a60 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] Returning 404 to user: Instance d74c1b24-d135-49c0-9d8f-0e90794d2488 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:52:07.012852 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f5bb1e5c-96bb-4ad5-85b4-560963946a60 tempest-ServerTagsTestJSON-1283838402 tempest-ServerTagsTestJSON-1283838402-project] 10.222.0.88 "GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488" status: 404 len: 111 microversion: 2.26 time: 0.090292 Jul 25 14:52:07.013439 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2442/5148] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:52:06 2022] GET /compute/v2.1/servers/d74c1b24-d135-49c0-9d8f-0e90794d2488 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:52:07.032243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4e86bca8-59f0-480f-a6a4-0b0584e8249b tempest-AbsoluteLimitsNegativeTestJSON-1548389880 tempest-AbsoluteLimitsNegativeTestJSON-1548389880-project] Calling method '.version_select at 0x7f46860615e0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:07.044385 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e86bca8-59f0-480f-a6a4-0b0584e8249b tempest-AbsoluteLimitsNegativeTestJSON-1548389880 tempest-AbsoluteLimitsNegativeTestJSON-1548389880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:07.045156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e86bca8-59f0-480f-a6a4-0b0584e8249b tempest-AbsoluteLimitsNegativeTestJSON-1548389880 tempest-AbsoluteLimitsNegativeTestJSON-1548389880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:07.046143 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e86bca8-59f0-480f-a6a4-0b0584e8249b tempest-AbsoluteLimitsNegativeTestJSON-1548389880 tempest-AbsoluteLimitsNegativeTestJSON-1548389880-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:07.046767 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e86bca8-59f0-480f-a6a4-0b0584e8249b tempest-AbsoluteLimitsNegativeTestJSON-1548389880 tempest-AbsoluteLimitsNegativeTestJSON-1548389880-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:07.070269 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4e86bca8-59f0-480f-a6a4-0b0584e8249b tempest-AbsoluteLimitsNegativeTestJSON-1548389880 tempest-AbsoluteLimitsNegativeTestJSON-1548389880-project] 10.222.0.88 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.286683 Jul 25 14:52:07.071502 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2707/5149] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Jul 25 14:52:06 2022] GET /compute/v2.1/limits => generated 511 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:52:07.303371 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2bbd6410-9de9-488d-ab8a-367edd33c70c tempest-AbsoluteLimitsNegativeTestJSON-1548389880 tempest-AbsoluteLimitsNegativeTestJSON-1548389880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1175375084", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:52:07.494521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-2bbd6410-9de9-488d-ab8a-367edd33c70c tempest-AbsoluteLimitsNegativeTestJSON-1548389880 tempest-AbsoluteLimitsNegativeTestJSON-1548389880-project] validate_networks() for None {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:52:07.943916 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6e0e5524-29e9-4f0b-be72-c1d9a4a0faf1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:07.945043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6e0e5524-29e9-4f0b-be72-c1d9a4a0faf1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:07.962470 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e0e5524-29e9-4f0b-be72-c1d9a4a0faf1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:07.965440 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e0e5524-29e9-4f0b-be72-c1d9a4a0faf1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:07.967471 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e0e5524-29e9-4f0b-be72-c1d9a4a0faf1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:07.968912 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e0e5524-29e9-4f0b-be72-c1d9a4a0faf1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:08.160247 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6e0e5524-29e9-4f0b-be72-c1d9a4a0faf1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:08.173076 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6e0e5524-29e9-4f0b-be72-c1d9a4a0faf1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1324 microversion: 2.1 time: 0.234792 Jul 25 14:52:08.188706 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2708/5150] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:07 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1324 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:08.218650 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-2bbd6410-9de9-488d-ab8a-367edd33c70c tempest-AbsoluteLimitsNegativeTestJSON-1548389880 tempest-AbsoluteLimitsNegativeTestJSON-1548389880-project] Getting quotas for project 6310503fc251462d86747d64592f8f78. Resources: dict_keys(['metadata_items']) {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:52:08.232501 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-2bbd6410-9de9-488d-ab8a-367edd33c70c tempest-AbsoluteLimitsNegativeTestJSON-1548389880 tempest-AbsoluteLimitsNegativeTestJSON-1548389880-project] Getting quotas for user 3585676541a1454ba62731e26df48600 and project 6310503fc251462d86747d64592f8f78. Resources: dict_keys(['metadata_items']) {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:52:08.263835 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-2bbd6410-9de9-488d-ab8a-367edd33c70c tempest-AbsoluteLimitsNegativeTestJSON-1548389880 tempest-AbsoluteLimitsNegativeTestJSON-1548389880-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2bbd6410-9de9-488d-ab8a-367edd33c70c tempest-AbsoluteLimitsNegativeTestJSON-1548389880 tempest-AbsoluteLimitsNegativeTestJSON-1548389880-project] Request method failure captured: Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 1752 Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q4WkDG8oqr1pPp2Hrhi9VLJ7GsC3yXxp7f8jZSIr1OkWGdctW-a_vwtUWJ8bBGIdcN_UGepr7ghccwa1LdjrrggCHQTmYTsr-6eJAVaPMweMBqqFGmCRGZhyieTvoeBEMb3TnUdBJy5KQ0wTrNUH7sdJ-_LIQxzhciCYMPWngoml1g Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 6310503fc251462d86747d64592f8f78 Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1548389880 Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6310503fc251462d86747d64592f8f78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6310503fc251462d86747d64592f8f78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6310503fc251462d86747d64592f8f78", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6310503fc251462d86747d64592f8f78"}]}] Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1548389880 Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 6310503fc251462d86747d64592f8f78 Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1548389880 Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1548389880-project Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 3585676541a1454ba62731e26df48600 Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1548389880-project Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1175375084", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:52:08.268610 n-d-846435-14 devstack@n-api.service[119303]: exception: Maximum number of metadata items exceeds 128 Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1175375084', 'imageRef': 'a7b14aba-1848-4a00-a3e7-b66eb3e97925', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:52:08.273240 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:52:08.278507 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:52:08.278507 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 14:52:08.278507 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 25 14:52:08.278507 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 25 14:52:08.278507 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jul 25 14:52:08.278507 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:52:08.278507 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:52:08.278507 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:52:08.278507 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:52:08.278507 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:52:08.278507 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:52:08.278507 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:52:08.278507 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:52:08.278507 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jul 25 14:52:08.278507 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:52:08.286253 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2bbd6410-9de9-488d-ab8a-367edd33c70c tempest-AbsoluteLimitsNegativeTestJSON-1548389880 tempest-AbsoluteLimitsNegativeTestJSON-1548389880-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:52:08.289746 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2bbd6410-9de9-488d-ab8a-367edd33c70c tempest-AbsoluteLimitsNegativeTestJSON-1548389880 tempest-AbsoluteLimitsNegativeTestJSON-1548389880-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.993623 Jul 25 14:52:08.292823 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2443/5151] 10.222.0.88 () {60 vars in 1148 bytes} [Mon Jul 25 14:52:07 2022] POST /compute/v2.1/servers => generated 87 bytes in 1002 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:52:09.202000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0950b2a8-ab56-4fa8-956c-5b7a1280ce30 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:09.203506 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0950b2a8-ab56-4fa8-956c-5b7a1280ce30 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:09.221441 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0950b2a8-ab56-4fa8-956c-5b7a1280ce30 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:09.225786 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0950b2a8-ab56-4fa8-956c-5b7a1280ce30 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:09.227644 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0950b2a8-ab56-4fa8-956c-5b7a1280ce30 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:09.229849 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0950b2a8-ab56-4fa8-956c-5b7a1280ce30 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:09.836027 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0950b2a8-ab56-4fa8-956c-5b7a1280ce30 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:09.848592 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0950b2a8-ab56-4fa8-956c-5b7a1280ce30 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1392 microversion: 2.1 time: 0.648882 Jul 25 14:52:09.851002 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2709/5152] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:09 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1392 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:10.869822 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7c7283b2-193b-4478-a720-626f6f57c2ce tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:10.871455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7c7283b2-193b-4478-a720-626f6f57c2ce tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:10.883077 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7c7283b2-193b-4478-a720-626f6f57c2ce tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:10.887575 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7c7283b2-193b-4478-a720-626f6f57c2ce tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:10.888848 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7c7283b2-193b-4478-a720-626f6f57c2ce tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:10.889600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7c7283b2-193b-4478-a720-626f6f57c2ce tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:10.934738 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:UPDATE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:52:10.954168 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-1687921a-3a22-49c7-abd2-ffb2e9822f1d req-eb729167-3ae8-4982-8328-306ab23cdd50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24543e41-c6a3-4964-a14a-d7273d59dc3d", "tag": "c3bc1148-2a77-4263-9fb0-9cce5305d01d"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:52:10.980965 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-1687921a-3a22-49c7-abd2-ffb2e9822f1d req-eb729167-3ae8-4982-8328-306ab23cdd50 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:11.003072 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-1687921a-3a22-49c7-abd2-ffb2e9822f1d req-eb729167-3ae8-4982-8328-306ab23cdd50 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:11.038927 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-1687921a-3a22-49c7-abd2-ffb2e9822f1d req-eb729167-3ae8-4982-8328-306ab23cdd50 service nova] Creating event network-changed:c3bc1148-2a77-4263-9fb0-9cce5305d01d for instance 24543e41-c6a3-4964-a14a-d7273d59dc3d on n-h1-846435-14 Jul 25 14:52:11.053816 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-1687921a-3a22-49c7-abd2-ffb2e9822f1d req-eb729167-3ae8-4982-8328-306ab23cdd50 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104602 Jul 25 14:52:11.057280 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2710/5153] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:52:11.387780 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7c7283b2-193b-4478-a720-626f6f57c2ce tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:11.396378 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7c7283b2-193b-4478-a720-626f6f57c2ce tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1392 microversion: 2.1 time: 0.530513 Jul 25 14:52:11.406746 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2444/5154] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:10 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1392 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:12.425402 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3d741947-9ac8-42e5-9552-1ea87fd5d17e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:12.425812 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3d741947-9ac8-42e5-9552-1ea87fd5d17e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:12.459109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3d741947-9ac8-42e5-9552-1ea87fd5d17e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:12.459573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3d741947-9ac8-42e5-9552-1ea87fd5d17e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:12.461087 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3d741947-9ac8-42e5-9552-1ea87fd5d17e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:12.462299 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3d741947-9ac8-42e5-9552-1ea87fd5d17e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:13.149081 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3d741947-9ac8-42e5-9552-1ea87fd5d17e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:13.162284 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3d741947-9ac8-42e5-9552-1ea87fd5d17e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1392 microversion: 2.1 time: 0.741792 Jul 25 14:52:13.166750 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2711/5155] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:12 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1392 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:13.223213 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-819c4f02-f1c7-4412-bc1b-da54b2a0e944 tempest-PortsAdminExtendedAttrsTestJSON-2069171722 tempest-PortsAdminExtendedAttrsTestJSON-2069171722-project-admin] Calling method '.version_select at 0x7f4686957c10>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:13.224224 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:52:13.224224 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 14:52:13.225674 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-819c4f02-f1c7-4412-bc1b-da54b2a0e944 tempest-PortsAdminExtendedAttrsTestJSON-2069171722 tempest-PortsAdminExtendedAttrsTestJSON-2069171722-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:13.226362 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-819c4f02-f1c7-4412-bc1b-da54b2a0e944 tempest-PortsAdminExtendedAttrsTestJSON-2069171722 tempest-PortsAdminExtendedAttrsTestJSON-2069171722-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:13.244595 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-819c4f02-f1c7-4412-bc1b-da54b2a0e944 tempest-PortsAdminExtendedAttrsTestJSON-2069171722 tempest-PortsAdminExtendedAttrsTestJSON-2069171722-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:13.246193 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-819c4f02-f1c7-4412-bc1b-da54b2a0e944 tempest-PortsAdminExtendedAttrsTestJSON-2069171722 tempest-PortsAdminExtendedAttrsTestJSON-2069171722-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:13.264389 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-819c4f02-f1c7-4412-bc1b-da54b2a0e944 tempest-PortsAdminExtendedAttrsTestJSON-2069171722 tempest-PortsAdminExtendedAttrsTestJSON-2069171722-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:13.265313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-819c4f02-f1c7-4412-bc1b-da54b2a0e944 tempest-PortsAdminExtendedAttrsTestJSON-2069171722 tempest-PortsAdminExtendedAttrsTestJSON-2069171722-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:13.276955 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-819c4f02-f1c7-4412-bc1b-da54b2a0e944 tempest-PortsAdminExtendedAttrsTestJSON-2069171722 tempest-PortsAdminExtendedAttrsTestJSON-2069171722-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.348600 Jul 25 14:52:13.280954 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2445/5156] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:52:12 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:52:14.193567 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d79f7ec1-00c2-4e1b-b25d-4ca863eb1478 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:14.194706 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d79f7ec1-00c2-4e1b-b25d-4ca863eb1478 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:14.210354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d79f7ec1-00c2-4e1b-b25d-4ca863eb1478 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:14.212789 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d79f7ec1-00c2-4e1b-b25d-4ca863eb1478 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:14.216888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d79f7ec1-00c2-4e1b-b25d-4ca863eb1478 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:14.217495 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d79f7ec1-00c2-4e1b-b25d-4ca863eb1478 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:14.774163 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d79f7ec1-00c2-4e1b-b25d-4ca863eb1478 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:14.787806 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d79f7ec1-00c2-4e1b-b25d-4ca863eb1478 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1392 microversion: 2.1 time: 0.598849 Jul 25 14:52:14.788467 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2712/5157] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:14 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1392 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:15.809352 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-88126302-3876-4f03-89dc-65f17222ca6e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:15.810164 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-88126302-3876-4f03-89dc-65f17222ca6e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:15.824344 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-88126302-3876-4f03-89dc-65f17222ca6e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:15.824853 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-88126302-3876-4f03-89dc-65f17222ca6e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:15.825756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-88126302-3876-4f03-89dc-65f17222ca6e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:15.826297 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-88126302-3876-4f03-89dc-65f17222ca6e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:16.298951 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-88126302-3876-4f03-89dc-65f17222ca6e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:16.309912 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-88126302-3876-4f03-89dc-65f17222ca6e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1392 microversion: 2.1 time: 0.504265 Jul 25 14:52:16.313770 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2446/5158] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:15 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1392 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:17.338204 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7a6986c1-2160-45cd-ae43-9fc3755c5510 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:17.338845 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7a6986c1-2160-45cd-ae43-9fc3755c5510 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:17.364841 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=8 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:52:17.367217 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=4 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:52:17.370799 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a6986c1-2160-45cd-ae43-9fc3755c5510 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:17.373686 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a6986c1-2160-45cd-ae43-9fc3755c5510 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:17.374694 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a6986c1-2160-45cd-ae43-9fc3755c5510 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:17.375140 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a6986c1-2160-45cd-ae43-9fc3755c5510 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:17.715113 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7a6986c1-2160-45cd-ae43-9fc3755c5510 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:17.723118 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7a6986c1-2160-45cd-ae43-9fc3755c5510 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1392 microversion: 2.1 time: 0.391045 Jul 25 14:52:17.741321 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2713/5159] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:17 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1392 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:18.744360 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e7a4b1d3-f3be-405d-9c84-e54d075af278 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:18.744974 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e7a4b1d3-f3be-405d-9c84-e54d075af278 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:18.758236 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:52:18.760634 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e7a4b1d3-f3be-405d-9c84-e54d075af278 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:18.764998 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e7a4b1d3-f3be-405d-9c84-e54d075af278 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:18.766082 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e7a4b1d3-f3be-405d-9c84-e54d075af278 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:18.770749 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e7a4b1d3-f3be-405d-9c84-e54d075af278 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:19.217680 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-7d7ace13-03d0-44bd-bea8-6ef44d707b88 req-61e468ef-5f7c-4ea0-bf52-94a09de59a84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24543e41-c6a3-4964-a14a-d7273d59dc3d", "name": "network-vif-plugged", "status": "completed", "tag": "c3bc1148-2a77-4263-9fb0-9cce5305d01d"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:52:19.249857 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-7d7ace13-03d0-44bd-bea8-6ef44d707b88 req-61e468ef-5f7c-4ea0-bf52-94a09de59a84 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:19.250294 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-7d7ace13-03d0-44bd-bea8-6ef44d707b88 req-61e468ef-5f7c-4ea0-bf52-94a09de59a84 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:19.273625 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-7d7ace13-03d0-44bd-bea8-6ef44d707b88 req-61e468ef-5f7c-4ea0-bf52-94a09de59a84 service nova] Creating event network-vif-plugged:c3bc1148-2a77-4263-9fb0-9cce5305d01d for instance 24543e41-c6a3-4964-a14a-d7273d59dc3d on n-h1-846435-14 Jul 25 14:52:19.304231 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-7d7ace13-03d0-44bd-bea8-6ef44d707b88 req-61e468ef-5f7c-4ea0-bf52-94a09de59a84 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090569 Jul 25 14:52:19.312008 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2714/5160] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:52:19.421986 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e7a4b1d3-f3be-405d-9c84-e54d075af278 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:19.433051 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e7a4b1d3-f3be-405d-9c84-e54d075af278 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1392 microversion: 2.1 time: 0.692109 Jul 25 14:52:19.437003 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2447/5161] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:18 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1392 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:19.659814 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4dc2289b-d73a-4b66-a3ab-d319a06b3893 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:19.660761 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4dc2289b-d73a-4b66-a3ab-d319a06b3893 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 298b0992-a307-40cf-a42a-9964e711730e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:19.670169 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4dc2289b-d73a-4b66-a3ab-d319a06b3893 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:19.670872 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4dc2289b-d73a-4b66-a3ab-d319a06b3893 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:19.671816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4dc2289b-d73a-4b66-a3ab-d319a06b3893 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:19.673657 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4dc2289b-d73a-4b66-a3ab-d319a06b3893 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:19.832015 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-4dc2289b-d73a-4b66-a3ab-d319a06b3893 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lazy-loading 'services' on Instance uuid 298b0992-a307-40cf-a42a-9964e711730e {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:52:19.983712 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4dc2289b-d73a-4b66-a3ab-d319a06b3893 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "DELETE /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e/os-volume_attachments/f4f55411-bd2d-4bc6-8518-822e228e3da7" status: 202 len: 0 microversion: 2.1 time: 0.333141 Jul 25 14:52:19.987838 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2715/5162] 10.222.0.88 () {58 vars in 1416 bytes} [Mon Jul 25 14:52:19 2022] DELETE /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e/os-volume_attachments/f4f55411-bd2d-4bc6-8518-822e228e3da7 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:52:20.461325 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1b751f4f-a1c5-4fe1-ab6b-1570ff059f9f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:20.461947 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1b751f4f-a1c5-4fe1-ab6b-1570ff059f9f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:20.472465 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1b751f4f-a1c5-4fe1-ab6b-1570ff059f9f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:20.480733 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1b751f4f-a1c5-4fe1-ab6b-1570ff059f9f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:20.482166 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1b751f4f-a1c5-4fe1-ab6b-1570ff059f9f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:20.482857 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1b751f4f-a1c5-4fe1-ab6b-1570ff059f9f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:21.402697 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1b751f4f-a1c5-4fe1-ab6b-1570ff059f9f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:21.428219 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1b751f4f-a1c5-4fe1-ab6b-1570ff059f9f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1392 microversion: 2.1 time: 0.967006 Jul 25 14:52:21.463157 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2448/5163] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:20 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1392 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:22.490083 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b1d4c3e3-c0d8-42de-adab-29458d5ba260 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:22.491010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b1d4c3e3-c0d8-42de-adab-29458d5ba260 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:22.512613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b1d4c3e3-c0d8-42de-adab-29458d5ba260 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:22.513073 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b1d4c3e3-c0d8-42de-adab-29458d5ba260 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:22.513865 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b1d4c3e3-c0d8-42de-adab-29458d5ba260 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:22.514308 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b1d4c3e3-c0d8-42de-adab-29458d5ba260 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:22.921831 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b1d4c3e3-c0d8-42de-adab-29458d5ba260 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:22.935083 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b1d4c3e3-c0d8-42de-adab-29458d5ba260 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1565 microversion: 2.1 time: 0.452840 Jul 25 14:52:22.935684 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2716/5164] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:22 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1565 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:22.955761 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5d359b75-8aec-47a7-ad0d-124ce97e9bb1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:22.956454 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5d359b75-8aec-47a7-ad0d-124ce97e9bb1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:22.971110 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5d359b75-8aec-47a7-ad0d-124ce97e9bb1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:22.971880 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5d359b75-8aec-47a7-ad0d-124ce97e9bb1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:22.972947 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5d359b75-8aec-47a7-ad0d-124ce97e9bb1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:22.975056 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5d359b75-8aec-47a7-ad0d-124ce97e9bb1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:23.361780 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5d359b75-8aec-47a7-ad0d-124ce97e9bb1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:23.382371 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5d359b75-8aec-47a7-ad0d-124ce97e9bb1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1565 microversion: 2.1 time: 0.422814 Jul 25 14:52:23.385789 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2449/5165] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:22 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1565 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:23.638253 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4176aac9-9d06-4363-9baa-83d29a106d59 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'create', calling method: .version_select at 0x7f4686064ca0>, body: {"keypair": {"name": "tempest-keypair-1648294775", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMUWx4uByrB0VGWq3PngkcNAlOntsXBwf+xAbDKAP51CFPxY4ueZuHpUsoTmfsxWiStGUx4IicoZWEmoPIE6GdWpAJ4iCfDHzmbUTN8kEylr/yyxjA56huRHgxS9G/dIWQ=="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:52:23.684984 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-4176aac9-9d06-4363-9baa-83d29a106d59 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Getting quotas for project 649465d992d749eca5d73d30e61ab62e. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:52:23.700046 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:52:23.702004 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-4176aac9-9d06-4363-9baa-83d29a106d59 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Getting quotas for user 72d5f52dd1ae4cf999f7df131b70223c and project 649465d992d749eca5d73d30e61ab62e. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:52:23.767479 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4176aac9-9d06-4363-9baa-83d29a106d59 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.462071 Jul 25 14:52:23.769537 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2717/5166] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:52:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:52:28.731314 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5d359b75-8aec-47a7-ad0d-124ce97e9bb1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:28.732333 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5d359b75-8aec-47a7-ad0d-124ce97e9bb1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001373 Jul 25 14:52:28.732674 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2450/5167] 10.222.0.88 () {56 vars in 886 bytes} [Mon Jul 25 14:52:28 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 25 14:52:29.051084 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-51a978e1-74e2-4b59-95c1-73cc84b03587 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-72447305", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "00285697-02be-4390-bafc-7b88de31480b"}], "security_groups": [{"name": "tempest-securitygroup--1239070937"}], "key_name": "tempest-keypair-1648294775", "user_data": "}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:52:29.114363 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7c4f8a58-b627-4199-aebc-009e2e0fb983 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:29.115374 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7c4f8a58-b627-4199-aebc-009e2e0fb983 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:29.140256 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7c4f8a58-b627-4199-aebc-009e2e0fb983 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:29.140256 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7c4f8a58-b627-4199-aebc-009e2e0fb983 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:29.140256 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7c4f8a58-b627-4199-aebc-009e2e0fb983 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:29.140256 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7c4f8a58-b627-4199-aebc-009e2e0fb983 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:29.351910 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-51a978e1-74e2-4b59-95c1-73cc84b03587 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] validate_networks() for [('00285697-02be-4390-bafc-7b88de31480b', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:52:29.403677 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7c4f8a58-b627-4199-aebc-009e2e0fb983 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:29.417842 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7c4f8a58-b627-4199-aebc-009e2e0fb983 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1565 microversion: 2.1 time: 0.308684 Jul 25 14:52:29.418635 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2451/5168] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:29 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1565 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:29.424658 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-1d8cff80-b242-4102-bed9-a4b05027b642 req-aca6f246-73f2-483d-832a-66714a6d043c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24543e41-c6a3-4964-a14a-d7273d59dc3d", "tag": "c3bc1148-2a77-4263-9fb0-9cce5305d01d"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:52:29.451058 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-1d8cff80-b242-4102-bed9-a4b05027b642 req-aca6f246-73f2-483d-832a-66714a6d043c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:29.452210 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-1d8cff80-b242-4102-bed9-a4b05027b642 req-aca6f246-73f2-483d-832a-66714a6d043c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:29.472633 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-1d8cff80-b242-4102-bed9-a4b05027b642 req-aca6f246-73f2-483d-832a-66714a6d043c service nova] Creating event network-changed:c3bc1148-2a77-4263-9fb0-9cce5305d01d for instance 24543e41-c6a3-4964-a14a-d7273d59dc3d on n-h1-846435-14 Jul 25 14:52:29.490642 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-1d8cff80-b242-4102-bed9-a4b05027b642 req-aca6f246-73f2-483d-832a-66714a6d043c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069541 Jul 25 14:52:29.492231 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2452/5169] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:52:29.531605 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-07b61b70-f21c-4246-b2f4-d6698efc872c tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:29.534036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-07b61b70-f21c-4246-b2f4-d6698efc872c tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 298b0992-a307-40cf-a42a-9964e711730e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:29.543896 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-07b61b70-f21c-4246-b2f4-d6698efc872c tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:29.544653 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-07b61b70-f21c-4246-b2f4-d6698efc872c tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:29.546390 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-07b61b70-f21c-4246-b2f4-d6698efc872c tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:29.547570 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-07b61b70-f21c-4246-b2f4-d6698efc872c tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:29.609697 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-07b61b70-f21c-4246-b2f4-d6698efc872c tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 298b0992-a307-40cf-a42a-9964e711730e] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:52:29.775298 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-07b61b70-f21c-4246-b2f4-d6698efc872c tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "DELETE /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e" status: 204 len: 0 microversion: 2.1 time: 0.281133 Jul 25 14:52:29.776699 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2453/5170] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:52:29 2022] DELETE /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:52:29.786043 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-27221bbd-8b1b-4476-8830-c67f5ae0219b tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:29.787774 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-27221bbd-8b1b-4476-8830-c67f5ae0219b tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 298b0992-a307-40cf-a42a-9964e711730e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:29.797893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27221bbd-8b1b-4476-8830-c67f5ae0219b tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:29.798420 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27221bbd-8b1b-4476-8830-c67f5ae0219b tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:29.799354 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27221bbd-8b1b-4476-8830-c67f5ae0219b tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:29.800010 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27221bbd-8b1b-4476-8830-c67f5ae0219b tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:30.066876 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-27221bbd-8b1b-4476-8830-c67f5ae0219b tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0c7ce41d64772a87a0ec7416ae6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68574d1c346d4507a2c25afd4de146e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:30.088122 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-27221bbd-8b1b-4476-8830-c67f5ae0219b tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e" status: 200 len: 1513 microversion: 2.1 time: 0.306372 Jul 25 14:52:30.089684 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2454/5171] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:29 2022] GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e => generated 1513 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:52:30.549405 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-51a978e1-74e2-4b59-95c1-73cc84b03587 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:52:30.549902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-51a978e1-74e2-4b59-95c1-73cc84b03587 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:52:30.550392 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-51a978e1-74e2-4b59-95c1-73cc84b03587 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:52:30.550797 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-51a978e1-74e2-4b59-95c1-73cc84b03587 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:52:30.551258 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-51a978e1-74e2-4b59-95c1-73cc84b03587 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:52:30.568477 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51a978e1-74e2-4b59-95c1-73cc84b03587 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:30.568945 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51a978e1-74e2-4b59-95c1-73cc84b03587 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:30.575908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51a978e1-74e2-4b59-95c1-73cc84b03587 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:30.576538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51a978e1-74e2-4b59-95c1-73cc84b03587 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:30.623337 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-51a978e1-74e2-4b59-95c1-73cc84b03587 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Getting quotas for project 649465d992d749eca5d73d30e61ab62e. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:52:30.633413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-51a978e1-74e2-4b59-95c1-73cc84b03587 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Getting quotas for user 72d5f52dd1ae4cf999f7df131b70223c and project 649465d992d749eca5d73d30e61ab62e. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:52:30.671517 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-51a978e1-74e2-4b59-95c1-73cc84b03587 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:52:30.674176 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-51a978e1-74e2-4b59-95c1-73cc84b03587 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:52:30.784585 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-51a978e1-74e2-4b59-95c1-73cc84b03587 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.739204 Jul 25 14:52:30.791410 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2718/5172] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:52:29 2022] POST /compute/v2.1/servers => generated 409 bytes in 1744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:52:30.802891 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6bd3af14-3f24-495c-9012-5c892c8c0c05 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:30.812811 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6bd3af14-3f24-495c-9012-5c892c8c0c05 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:30.994754 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6bd3af14-3f24-495c-9012-5c892c8c0c05 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:31.006764 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6bd3af14-3f24-495c-9012-5c892c8c0c05 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1237 microversion: 2.1 time: 0.210223 Jul 25 14:52:31.010342 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2455/5173] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:30 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1237 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:31.110507 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-200e651f-37dc-43f0-a3e9-116e4964ec3e tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:31.111156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-200e651f-37dc-43f0-a3e9-116e4964ec3e tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 298b0992-a307-40cf-a42a-9964e711730e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:31.126463 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-200e651f-37dc-43f0-a3e9-116e4964ec3e tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:31.126924 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-200e651f-37dc-43f0-a3e9-116e4964ec3e tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:31.127713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-200e651f-37dc-43f0-a3e9-116e4964ec3e tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:31.131939 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-200e651f-37dc-43f0-a3e9-116e4964ec3e tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:31.641267 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-200e651f-37dc-43f0-a3e9-116e4964ec3e tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0c7ce41d64772a87a0ec7416ae6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68574d1c346d4507a2c25afd4de146e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:31.651447 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-200e651f-37dc-43f0-a3e9-116e4964ec3e tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e" status: 200 len: 1513 microversion: 2.1 time: 0.544907 Jul 25 14:52:31.657926 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2719/5174] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:31 2022] GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e => generated 1513 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:32.028507 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a35acb81-0843-4992-988c-9d93edaccf74 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:32.032466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a35acb81-0843-4992-988c-9d93edaccf74 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:32.045935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:52:32.053284 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a35acb81-0843-4992-988c-9d93edaccf74 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:32.053975 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a35acb81-0843-4992-988c-9d93edaccf74 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:32.058598 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a35acb81-0843-4992-988c-9d93edaccf74 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:32.060270 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a35acb81-0843-4992-988c-9d93edaccf74 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:32.200965 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a35acb81-0843-4992-988c-9d93edaccf74 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:32.218195 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a35acb81-0843-4992-988c-9d93edaccf74 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1233 microversion: 2.1 time: 0.193441 Jul 25 14:52:32.219291 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2456/5175] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:32 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1233 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:32.679832 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2d78bd67-09fc-4086-be13-57b820564799 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:32.680657 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2d78bd67-09fc-4086-be13-57b820564799 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 298b0992-a307-40cf-a42a-9964e711730e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:32.689008 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d78bd67-09fc-4086-be13-57b820564799 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:32.689744 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d78bd67-09fc-4086-be13-57b820564799 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:32.690664 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d78bd67-09fc-4086-be13-57b820564799 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:32.691228 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d78bd67-09fc-4086-be13-57b820564799 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:32.697223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:52:33.235360 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2d78bd67-09fc-4086-be13-57b820564799 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0c7ce41d64772a87a0ec7416ae6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68574d1c346d4507a2c25afd4de146e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:33.241374 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7ae513a2-8d6e-4340-9765-1ff287dd9803 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:33.243456 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7ae513a2-8d6e-4340-9765-1ff287dd9803 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:33.255401 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2d78bd67-09fc-4086-be13-57b820564799 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e" status: 200 len: 1513 microversion: 2.1 time: 0.578161 Jul 25 14:52:33.269099 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2720/5176] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:32 2022] GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e => generated 1513 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:33.275235 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ae513a2-8d6e-4340-9765-1ff287dd9803 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:33.276171 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ae513a2-8d6e-4340-9765-1ff287dd9803 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:33.277152 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ae513a2-8d6e-4340-9765-1ff287dd9803 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:33.277756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ae513a2-8d6e-4340-9765-1ff287dd9803 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:33.318148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-ba879823-b2fd-44ba-b73c-2198a9a9c72a req-1ea40202-dad3-40d1-898f-a838a85ee2de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "298b0992-a307-40cf-a42a-9964e711730e", "name": "network-vif-deleted", "tag": "48481a85-b1da-4f8a-85b3-9e354574ca92"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:52:33.347171 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ba879823-b2fd-44ba-b73c-2198a9a9c72a req-1ea40202-dad3-40d1-898f-a838a85ee2de service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:33.348040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ba879823-b2fd-44ba-b73c-2198a9a9c72a req-1ea40202-dad3-40d1-898f-a838a85ee2de service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:33.404439 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7ae513a2-8d6e-4340-9765-1ff287dd9803 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:33.406660 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-ba879823-b2fd-44ba-b73c-2198a9a9c72a req-1ea40202-dad3-40d1-898f-a838a85ee2de service nova] Creating event network-vif-deleted:48481a85-b1da-4f8a-85b3-9e354574ca92 for instance 298b0992-a307-40cf-a42a-9964e711730e on n-h1-846435-14 Jul 25 14:52:33.416918 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7ae513a2-8d6e-4340-9765-1ff287dd9803 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1295 microversion: 2.1 time: 0.179824 Jul 25 14:52:33.435181 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2457/5177] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:33 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1295 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:52:33.436790 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-ba879823-b2fd-44ba-b73c-2198a9a9c72a req-1ea40202-dad3-40d1-898f-a838a85ee2de service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126586 Jul 25 14:52:33.437812 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2721/5178] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:52:34.278613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-37898339-58da-463e-b95f-83a77e235796 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:34.279350 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-37898339-58da-463e-b95f-83a77e235796 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 298b0992-a307-40cf-a42a-9964e711730e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:34.287568 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37898339-58da-463e-b95f-83a77e235796 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:34.289538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37898339-58da-463e-b95f-83a77e235796 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:34.290592 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37898339-58da-463e-b95f-83a77e235796 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:34.291221 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37898339-58da-463e-b95f-83a77e235796 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:34.309772 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-37898339-58da-463e-b95f-83a77e235796 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] HTTP exception thrown: Instance 298b0992-a307-40cf-a42a-9964e711730e could not be found. Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-37898339-58da-463e-b95f-83a77e235796 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Request method failure captured: Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e HTTP/1.1 Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q1QZBoeB4cFVKaRLzrYL4kNfmL6-sG_CA2EvbcPKlnS-c9LfqWavAL38zgJccsMIKFsl0cXJ4GraWGBT_CyOIEeG6kteHsej-KgMUbMop62K9tdjeRHsxfsRgr9DcnobToFukjsCt89mJQZKPZoIV0Eh59a044YYbv9gRuGvEVNc18 Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 68574d1c346d4507a2c25afd4de146e5 Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-VolumesSnapshotTestJSON-745734763 Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/68574d1c346d4507a2c25afd4de146e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/68574d1c346d4507a2c25afd4de146e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_68574d1c346d4507a2c25afd4de146e5", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/68574d1c346d4507a2c25afd4de146e5"}]}] Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-VolumesSnapshotTestJSON-745734763 Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 68574d1c346d4507a2c25afd4de146e5 Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-745734763 Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-VolumesSnapshotTestJSON-745734763-project Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 03e0c7ce41d64772a87a0ec7416ae6ea Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-VolumesSnapshotTestJSON-745734763-project Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 298b0992-a307-40cf-a42a-9964e711730e could not be found. Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '298b0992-a307-40cf-a42a-9964e711730e'} Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 298b0992-a307-40cf-a42a-9964e711730e could not be found. Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 298b0992-a307-40cf-a42a-9964e711730e could not be found. Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:52:34.312537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:52:34.316517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:52:34.316517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:52:34.316517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:52:34.316517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:52:34.316517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:52:34.316517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 298b0992-a307-40cf-a42a-9964e711730e could not be found. Jul 25 14:52:34.316517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:52:34.320170 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-37898339-58da-463e-b95f-83a77e235796 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Returning 404 to user: Instance 298b0992-a307-40cf-a42a-9964e711730e could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:52:34.321414 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-37898339-58da-463e-b95f-83a77e235796 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e" status: 404 len: 111 microversion: 2.1 time: 0.047812 Jul 25 14:52:34.322588 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2458/5179] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:34 2022] GET /compute/v2.1/servers/298b0992-a307-40cf-a42a-9964e711730e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:52:34.440833 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-279e1ae0-b0bc-4b01-a376-aeb11d2abf3a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:34.442740 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-279e1ae0-b0bc-4b01-a376-aeb11d2abf3a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:34.457993 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-279e1ae0-b0bc-4b01-a376-aeb11d2abf3a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:34.460629 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-279e1ae0-b0bc-4b01-a376-aeb11d2abf3a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:34.461833 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-279e1ae0-b0bc-4b01-a376-aeb11d2abf3a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:34.462596 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-279e1ae0-b0bc-4b01-a376-aeb11d2abf3a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:34.973667 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-279e1ae0-b0bc-4b01-a376-aeb11d2abf3a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:34.987353 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-279e1ae0-b0bc-4b01-a376-aeb11d2abf3a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1363 microversion: 2.1 time: 0.548788 Jul 25 14:52:34.988638 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2722/5180] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:34 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1363 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:36.013746 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-debdce7d-07b1-4577-a4c7-ec85d24c8ad4 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:36.014423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-debdce7d-07b1-4577-a4c7-ec85d24c8ad4 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:36.029682 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-debdce7d-07b1-4577-a4c7-ec85d24c8ad4 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:36.030128 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-debdce7d-07b1-4577-a4c7-ec85d24c8ad4 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:36.031086 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-debdce7d-07b1-4577-a4c7-ec85d24c8ad4 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:36.031486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-debdce7d-07b1-4577-a4c7-ec85d24c8ad4 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:36.397373 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-debdce7d-07b1-4577-a4c7-ec85d24c8ad4 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:36.406404 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-debdce7d-07b1-4577-a4c7-ec85d24c8ad4 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1363 microversion: 2.1 time: 0.396653 Jul 25 14:52:36.412440 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2459/5181] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:36 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1363 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:36.602353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-8fe80e43-8704-432d-94d2-1356d08f75ff req-d02a5f3a-c9c2-45ca-93bf-ee2e80da3468 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e054ea1-6a81-43c7-9746-25b466d4647b", "tag": "24859a24-8dd1-490f-b1c7-01178f7f59b2"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:52:36.661780 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-8fe80e43-8704-432d-94d2-1356d08f75ff req-d02a5f3a-c9c2-45ca-93bf-ee2e80da3468 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:36.667873 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-8fe80e43-8704-432d-94d2-1356d08f75ff req-d02a5f3a-c9c2-45ca-93bf-ee2e80da3468 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:36.710544 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-8fe80e43-8704-432d-94d2-1356d08f75ff req-d02a5f3a-c9c2-45ca-93bf-ee2e80da3468 service nova] Creating event network-changed:24859a24-8dd1-490f-b1c7-01178f7f59b2 for instance 9e054ea1-6a81-43c7-9746-25b466d4647b on n-h2-846435-14 Jul 25 14:52:36.720256 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-8fe80e43-8704-432d-94d2-1356d08f75ff req-d02a5f3a-c9c2-45ca-93bf-ee2e80da3468 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123795 Jul 25 14:52:36.728683 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2723/5182] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:52:37.436089 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ee09f925-82b2-48aa-a327-85fe4d492640 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:37.440159 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ee09f925-82b2-48aa-a327-85fe4d492640 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:37.450378 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee09f925-82b2-48aa-a327-85fe4d492640 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:37.451884 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee09f925-82b2-48aa-a327-85fe4d492640 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:37.452767 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee09f925-82b2-48aa-a327-85fe4d492640 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:37.453219 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee09f925-82b2-48aa-a327-85fe4d492640 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:37.608502 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ee09f925-82b2-48aa-a327-85fe4d492640 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:37.617222 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ee09f925-82b2-48aa-a327-85fe4d492640 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1363 microversion: 2.1 time: 0.186052 Jul 25 14:52:37.618355 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2460/5183] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:37 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:38.639028 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-69094efb-0b0d-4ae4-9da2-dd515b13b66c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:38.641024 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-69094efb-0b0d-4ae4-9da2-dd515b13b66c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:38.665216 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69094efb-0b0d-4ae4-9da2-dd515b13b66c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:38.665908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69094efb-0b0d-4ae4-9da2-dd515b13b66c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:38.666891 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69094efb-0b0d-4ae4-9da2-dd515b13b66c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:38.667474 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69094efb-0b0d-4ae4-9da2-dd515b13b66c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:38.940223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-69094efb-0b0d-4ae4-9da2-dd515b13b66c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:38.949835 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-69094efb-0b0d-4ae4-9da2-dd515b13b66c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1363 microversion: 2.1 time: 0.315963 Jul 25 14:52:38.960837 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2724/5184] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:38 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1363 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:39.973345 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2853f9c6-b51d-4f8f-8c1f-ba20e4151e1a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:39.974885 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2853f9c6-b51d-4f8f-8c1f-ba20e4151e1a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:39.983768 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2853f9c6-b51d-4f8f-8c1f-ba20e4151e1a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:39.997124 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2853f9c6-b51d-4f8f-8c1f-ba20e4151e1a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:39.998408 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2853f9c6-b51d-4f8f-8c1f-ba20e4151e1a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:39.999493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2853f9c6-b51d-4f8f-8c1f-ba20e4151e1a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:40.456892 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2853f9c6-b51d-4f8f-8c1f-ba20e4151e1a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:40.486879 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2853f9c6-b51d-4f8f-8c1f-ba20e4151e1a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1363 microversion: 2.1 time: 0.518453 Jul 25 14:52:40.492696 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2461/5185] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:39 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1363 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:41.514747 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5f85b6f2-6f2b-4e7b-88eb-62725b12aff8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:41.515554 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5f85b6f2-6f2b-4e7b-88eb-62725b12aff8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:41.525560 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:52:41.528919 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=10 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:52:41.534876 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5f85b6f2-6f2b-4e7b-88eb-62725b12aff8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:41.535479 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5f85b6f2-6f2b-4e7b-88eb-62725b12aff8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:41.536976 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5f85b6f2-6f2b-4e7b-88eb-62725b12aff8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:41.540019 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5f85b6f2-6f2b-4e7b-88eb-62725b12aff8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:41.841506 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5f85b6f2-6f2b-4e7b-88eb-62725b12aff8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:41.854890 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5f85b6f2-6f2b-4e7b-88eb-62725b12aff8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1363 microversion: 2.1 time: 0.343180 Jul 25 14:52:41.856242 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2725/5186] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:41 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1363 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:42.630190 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-584772c3-18bf-427f-8eb6-067abc3eef25 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-499630776", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "4e335baf-3d43-423d-bf9b-e035e66b1252"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:52:42.641689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:52:42.716570 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-584772c3-18bf-427f-8eb6-067abc3eef25 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] validate_networks() for [('4e335baf-3d43-423d-bf9b-e035e66b1252', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:52:42.879063 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e7c12dad-9382-4529-bf27-51c89628741a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:42.880719 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e7c12dad-9382-4529-bf27-51c89628741a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:42.908619 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e7c12dad-9382-4529-bf27-51c89628741a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:42.911513 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e7c12dad-9382-4529-bf27-51c89628741a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:42.912632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e7c12dad-9382-4529-bf27-51c89628741a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:42.913197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e7c12dad-9382-4529-bf27-51c89628741a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:43.194705 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e7c12dad-9382-4529-bf27-51c89628741a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:43.209491 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e7c12dad-9382-4529-bf27-51c89628741a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1363 microversion: 2.1 time: 0.331422 Jul 25 14:52:43.212945 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2726/5187] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:42 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1363 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:43.443751 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-584772c3-18bf-427f-8eb6-067abc3eef25 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:52:43.444803 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-584772c3-18bf-427f-8eb6-067abc3eef25 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:52:43.446047 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-584772c3-18bf-427f-8eb6-067abc3eef25 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:52:43.446818 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-584772c3-18bf-427f-8eb6-067abc3eef25 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:52:43.447381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-584772c3-18bf-427f-8eb6-067abc3eef25 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:52:43.460810 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-584772c3-18bf-427f-8eb6-067abc3eef25 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:43.461494 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-584772c3-18bf-427f-8eb6-067abc3eef25 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:43.462892 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-584772c3-18bf-427f-8eb6-067abc3eef25 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:43.463554 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-584772c3-18bf-427f-8eb6-067abc3eef25 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:43.474613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:52:43.487009 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-584772c3-18bf-427f-8eb6-067abc3eef25 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Getting quotas for project 68574d1c346d4507a2c25afd4de146e5. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:52:43.495702 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-584772c3-18bf-427f-8eb6-067abc3eef25 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Getting quotas for user 03e0c7ce41d64772a87a0ec7416ae6ea and project 68574d1c346d4507a2c25afd4de146e5. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:52:43.521466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-584772c3-18bf-427f-8eb6-067abc3eef25 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:52:43.524293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-584772c3-18bf-427f-8eb6-067abc3eef25 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 5dc1536b-b1cd-4fb7-a42d-87e82d57dada] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:52:43.679377 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-584772c3-18bf-427f-8eb6-067abc3eef25 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.047784 Jul 25 14:52:43.681202 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2462/5188] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:52:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:52:43.692798 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bc270dfd-1a28-4048-b0ee-63fd505f7130 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:43.693757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bc270dfd-1a28-4048-b0ee-63fd505f7130 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 5dc1536b-b1cd-4fb7-a42d-87e82d57dada] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:43.797356 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bc270dfd-1a28-4048-b0ee-63fd505f7130 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0c7ce41d64772a87a0ec7416ae6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68574d1c346d4507a2c25afd4de146e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:43.810620 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bc270dfd-1a28-4048-b0ee-63fd505f7130 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada" status: 200 len: 1218 microversion: 2.1 time: 0.121956 Jul 25 14:52:43.812329 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2727/5189] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:43 2022] GET /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada => generated 1218 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:44.242845 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5577421d-6eb9-461d-ae9d-737dfc6e5dda tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:44.243744 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5577421d-6eb9-461d-ae9d-737dfc6e5dda tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:44.259769 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5577421d-6eb9-461d-ae9d-737dfc6e5dda tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:44.260257 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5577421d-6eb9-461d-ae9d-737dfc6e5dda tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:44.262037 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5577421d-6eb9-461d-ae9d-737dfc6e5dda tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:44.262617 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5577421d-6eb9-461d-ae9d-737dfc6e5dda tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:44.640682 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5577421d-6eb9-461d-ae9d-737dfc6e5dda tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:44.650975 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5577421d-6eb9-461d-ae9d-737dfc6e5dda tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1363 microversion: 2.1 time: 0.416464 Jul 25 14:52:44.663562 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2463/5190] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:44 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1363 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:44.843039 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2ce9bd4c-e0a4-40dc-84b3-e40eb23dc1f8 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:44.843548 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2ce9bd4c-e0a4-40dc-84b3-e40eb23dc1f8 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 5dc1536b-b1cd-4fb7-a42d-87e82d57dada] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:44.867591 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2ce9bd4c-e0a4-40dc-84b3-e40eb23dc1f8 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:44.867591 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2ce9bd4c-e0a4-40dc-84b3-e40eb23dc1f8 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:44.867591 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2ce9bd4c-e0a4-40dc-84b3-e40eb23dc1f8 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:44.874862 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2ce9bd4c-e0a4-40dc-84b3-e40eb23dc1f8 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:45.052687 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2ce9bd4c-e0a4-40dc-84b3-e40eb23dc1f8 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0c7ce41d64772a87a0ec7416ae6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68574d1c346d4507a2c25afd4de146e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:45.073079 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2ce9bd4c-e0a4-40dc-84b3-e40eb23dc1f8 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada" status: 200 len: 1270 microversion: 2.1 time: 0.227980 Jul 25 14:52:45.073079 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2728/5191] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:44 2022] GET /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada => generated 1270 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:45.130290 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-a43dc32a-99fc-4fd0-b888-ad41357ff2b2 req-0627dc19-d39f-43c7-a5b4-275f369de31b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e054ea1-6a81-43c7-9746-25b466d4647b", "name": "network-vif-plugged", "status": "completed", "tag": "24859a24-8dd1-490f-b1c7-01178f7f59b2"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:52:45.148706 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-a43dc32a-99fc-4fd0-b888-ad41357ff2b2 req-0627dc19-d39f-43c7-a5b4-275f369de31b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:45.150603 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-a43dc32a-99fc-4fd0-b888-ad41357ff2b2 req-0627dc19-d39f-43c7-a5b4-275f369de31b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:45.168976 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-a43dc32a-99fc-4fd0-b888-ad41357ff2b2 req-0627dc19-d39f-43c7-a5b4-275f369de31b service nova] Creating event network-vif-plugged:24859a24-8dd1-490f-b1c7-01178f7f59b2 for instance 9e054ea1-6a81-43c7-9746-25b466d4647b on n-h2-846435-14 Jul 25 14:52:45.175198 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-a43dc32a-99fc-4fd0-b888-ad41357ff2b2 req-0627dc19-d39f-43c7-a5b4-275f369de31b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049723 Jul 25 14:52:45.177477 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2464/5192] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:52:45.673149 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-906dddf1-9998-4ce7-9edb-0d75809be448 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:45.674279 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-906dddf1-9998-4ce7-9edb-0d75809be448 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:45.681102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-906dddf1-9998-4ce7-9edb-0d75809be448 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:45.681861 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-906dddf1-9998-4ce7-9edb-0d75809be448 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:45.682827 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-906dddf1-9998-4ce7-9edb-0d75809be448 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:45.684177 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-906dddf1-9998-4ce7-9edb-0d75809be448 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:45.967601 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-906dddf1-9998-4ce7-9edb-0d75809be448 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:45.982285 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-906dddf1-9998-4ce7-9edb-0d75809be448 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1363 microversion: 2.1 time: 0.313212 Jul 25 14:52:45.985173 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2729/5193] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:45 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1363 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:46.091675 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bc469b43-1e20-4cb7-98a7-2de06915817d tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:46.092319 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bc469b43-1e20-4cb7-98a7-2de06915817d tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 5dc1536b-b1cd-4fb7-a42d-87e82d57dada] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:46.099924 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bc469b43-1e20-4cb7-98a7-2de06915817d tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:46.100687 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bc469b43-1e20-4cb7-98a7-2de06915817d tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:46.101704 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bc469b43-1e20-4cb7-98a7-2de06915817d tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:46.102333 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bc469b43-1e20-4cb7-98a7-2de06915817d tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:46.193054 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bc469b43-1e20-4cb7-98a7-2de06915817d tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0c7ce41d64772a87a0ec7416ae6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68574d1c346d4507a2c25afd4de146e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:46.205420 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bc469b43-1e20-4cb7-98a7-2de06915817d tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada" status: 200 len: 1276 microversion: 2.1 time: 0.117062 Jul 25 14:52:46.206369 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2465/5194] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:46 2022] GET /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada => generated 1276 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:52:47.014969 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4fddc05b-9800-4117-8432-139d5e046c19 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:47.016175 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4fddc05b-9800-4117-8432-139d5e046c19 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:47.042507 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-02373567-9740-4533-947c-aac1c36a0a1a tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:52:47.046703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-02373567-9740-4533-947c-aac1c36a0a1a tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:47.055615 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4fddc05b-9800-4117-8432-139d5e046c19 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:47.068025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4fddc05b-9800-4117-8432-139d5e046c19 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:47.077208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4fddc05b-9800-4117-8432-139d5e046c19 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:47.078045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4fddc05b-9800-4117-8432-139d5e046c19 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:47.119063 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-02373567-9740-4533-947c-aac1c36a0a1a tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:47.120058 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-02373567-9740-4533-947c-aac1c36a0a1a tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:47.121462 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-02373567-9740-4533-947c-aac1c36a0a1a tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:47.122188 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-02373567-9740-4533-947c-aac1c36a0a1a tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:47.302336 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-02373567-9740-4533-947c-aac1c36a0a1a tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "POST /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d/action" status: 200 len: 24570 microversion: 2.1 time: 0.267547 Jul 25 14:52:47.304814 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2466/5195] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:52:47 2022] POST /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d/action => generated 24570 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:52:47.326943 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ae02cf5e-544e-4405-ae15-6036e8bc1c67 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:47.334296 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ae02cf5e-544e-4405-ae15-6036e8bc1c67 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 5dc1536b-b1cd-4fb7-a42d-87e82d57dada] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:47.360033 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae02cf5e-544e-4405-ae15-6036e8bc1c67 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:47.362271 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae02cf5e-544e-4405-ae15-6036e8bc1c67 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:47.364979 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae02cf5e-544e-4405-ae15-6036e8bc1c67 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:47.367121 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae02cf5e-544e-4405-ae15-6036e8bc1c67 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:47.842568 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ae02cf5e-544e-4405-ae15-6036e8bc1c67 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0c7ce41d64772a87a0ec7416ae6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68574d1c346d4507a2c25afd4de146e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:47.852222 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ae02cf5e-544e-4405-ae15-6036e8bc1c67 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada" status: 200 len: 1318 microversion: 2.1 time: 0.543895 Jul 25 14:52:47.853471 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2467/5196] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:47 2022] GET /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada => generated 1318 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:47.892528 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4fddc05b-9800-4117-8432-139d5e046c19 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:47.912606 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4fddc05b-9800-4117-8432-139d5e046c19 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1551 microversion: 2.1 time: 0.902987 Jul 25 14:52:47.929036 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2730/5197] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:47 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1551 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:47.934698 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1757af62-507e-41af-98bf-65324753d25e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:47.935212 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1757af62-507e-41af-98bf-65324753d25e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:47.946593 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1757af62-507e-41af-98bf-65324753d25e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:47.947067 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1757af62-507e-41af-98bf-65324753d25e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:47.947879 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1757af62-507e-41af-98bf-65324753d25e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:47.948356 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1757af62-507e-41af-98bf-65324753d25e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:48.097945 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1757af62-507e-41af-98bf-65324753d25e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.167389 Jul 25 14:52:48.098757 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2468/5198] 10.222.0.88 () {58 vars in 1275 bytes} [Mon Jul 25 14:52:47 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/os-interface => generated 285 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:52:48.456674 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-654e06d9-09eb-40e4-affb-6e1bc7036c00 req-a1ee709a-c99c-4d8b-8000-d9bba07761d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dc1536b-b1cd-4fb7-a42d-87e82d57dada", "tag": "5bf93d89-d31c-400c-b5f8-06f616908615"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:52:48.493229 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-654e06d9-09eb-40e4-affb-6e1bc7036c00 req-a1ee709a-c99c-4d8b-8000-d9bba07761d8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:48.494199 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-654e06d9-09eb-40e4-affb-6e1bc7036c00 req-a1ee709a-c99c-4d8b-8000-d9bba07761d8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:48.511261 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-654e06d9-09eb-40e4-affb-6e1bc7036c00 req-a1ee709a-c99c-4d8b-8000-d9bba07761d8 service nova] Creating event network-changed:5bf93d89-d31c-400c-b5f8-06f616908615 for instance 5dc1536b-b1cd-4fb7-a42d-87e82d57dada on n-h1-846435-14 Jul 25 14:52:48.518820 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-654e06d9-09eb-40e4-affb-6e1bc7036c00 req-a1ee709a-c99c-4d8b-8000-d9bba07761d8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071472 Jul 25 14:52:48.520612 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2731/5199] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:52:48.874933 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6db86623-93ab-4ea0-8760-b247b571348c tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:48.878393 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6db86623-93ab-4ea0-8760-b247b571348c tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 5dc1536b-b1cd-4fb7-a42d-87e82d57dada] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:48.893483 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6db86623-93ab-4ea0-8760-b247b571348c tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:48.894266 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6db86623-93ab-4ea0-8760-b247b571348c tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:48.895664 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6db86623-93ab-4ea0-8760-b247b571348c tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:48.896432 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6db86623-93ab-4ea0-8760-b247b571348c tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:49.265384 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6db86623-93ab-4ea0-8760-b247b571348c tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0c7ce41d64772a87a0ec7416ae6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68574d1c346d4507a2c25afd4de146e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:49.276418 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6db86623-93ab-4ea0-8760-b247b571348c tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada" status: 200 len: 1318 microversion: 2.1 time: 0.406791 Jul 25 14:52:49.277699 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2469/5200] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:48 2022] GET /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada => generated 1318 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:50.152106 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-227d0fb2-2029-443c-aa63-8e56763e7afb req-3fe7d0e0-8f31-4738-9dfc-2a27db8bcb68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e054ea1-6a81-43c7-9746-25b466d4647b", "tag": "24859a24-8dd1-490f-b1c7-01178f7f59b2"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:52:50.163033 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-227d0fb2-2029-443c-aa63-8e56763e7afb req-3fe7d0e0-8f31-4738-9dfc-2a27db8bcb68 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:50.163714 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-227d0fb2-2029-443c-aa63-8e56763e7afb req-3fe7d0e0-8f31-4738-9dfc-2a27db8bcb68 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:50.184323 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-227d0fb2-2029-443c-aa63-8e56763e7afb req-3fe7d0e0-8f31-4738-9dfc-2a27db8bcb68 service nova] Creating event network-changed:24859a24-8dd1-490f-b1c7-01178f7f59b2 for instance 9e054ea1-6a81-43c7-9746-25b466d4647b on n-h2-846435-14 Jul 25 14:52:50.190203 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-227d0fb2-2029-443c-aa63-8e56763e7afb req-3fe7d0e0-8f31-4738-9dfc-2a27db8bcb68 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043479 Jul 25 14:52:50.191006 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2732/5201] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:52:50.298304 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-47186c12-344e-4899-ac6e-0937c1def64f tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:50.298853 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-47186c12-344e-4899-ac6e-0937c1def64f tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 5dc1536b-b1cd-4fb7-a42d-87e82d57dada] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:50.314214 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-47186c12-344e-4899-ac6e-0937c1def64f tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:50.314843 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-47186c12-344e-4899-ac6e-0937c1def64f tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:50.315785 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-47186c12-344e-4899-ac6e-0937c1def64f tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:50.316397 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-47186c12-344e-4899-ac6e-0937c1def64f tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:50.717433 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-47186c12-344e-4899-ac6e-0937c1def64f tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0c7ce41d64772a87a0ec7416ae6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68574d1c346d4507a2c25afd4de146e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:50.731568 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-47186c12-344e-4899-ac6e-0937c1def64f tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada" status: 200 len: 1318 microversion: 2.1 time: 0.437051 Jul 25 14:52:50.735534 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2470/5202] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:50 2022] GET /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada => generated 1318 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:51.770524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dc675797-7781-4bb5-9e80-a49f415b9295 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:51.771259 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dc675797-7781-4bb5-9e80-a49f415b9295 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 5dc1536b-b1cd-4fb7-a42d-87e82d57dada] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:51.780224 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dc675797-7781-4bb5-9e80-a49f415b9295 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:51.780840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dc675797-7781-4bb5-9e80-a49f415b9295 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:51.781806 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dc675797-7781-4bb5-9e80-a49f415b9295 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:51.782241 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dc675797-7781-4bb5-9e80-a49f415b9295 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:52.031089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dc675797-7781-4bb5-9e80-a49f415b9295 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0c7ce41d64772a87a0ec7416ae6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68574d1c346d4507a2c25afd4de146e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:52.048019 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dc675797-7781-4bb5-9e80-a49f415b9295 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada" status: 200 len: 1318 microversion: 2.1 time: 0.285521 Jul 25 14:52:52.050189 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2733/5203] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:51 2022] GET /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:53.070555 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a7d0d552-70c7-41ff-8093-2cfcee38466b tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:53.071175 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a7d0d552-70c7-41ff-8093-2cfcee38466b tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 5dc1536b-b1cd-4fb7-a42d-87e82d57dada] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:53.085134 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a7d0d552-70c7-41ff-8093-2cfcee38466b tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:53.085600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a7d0d552-70c7-41ff-8093-2cfcee38466b tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:53.086402 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a7d0d552-70c7-41ff-8093-2cfcee38466b tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:53.086842 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a7d0d552-70c7-41ff-8093-2cfcee38466b tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:53.237321 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a7d0d552-70c7-41ff-8093-2cfcee38466b tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0c7ce41d64772a87a0ec7416ae6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68574d1c346d4507a2c25afd4de146e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:53.246567 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a7d0d552-70c7-41ff-8093-2cfcee38466b tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada" status: 200 len: 1318 microversion: 2.1 time: 0.180271 Jul 25 14:52:53.247360 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2471/5204] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:53 2022] GET /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:54.271222 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b41577a3-f14a-4fe2-8df6-4884c198f88d tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:54.272197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b41577a3-f14a-4fe2-8df6-4884c198f88d tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 5dc1536b-b1cd-4fb7-a42d-87e82d57dada] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:54.284671 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:52:54.285994 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:52:54.288174 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b41577a3-f14a-4fe2-8df6-4884c198f88d tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:54.289093 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b41577a3-f14a-4fe2-8df6-4884c198f88d tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:54.299171 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b41577a3-f14a-4fe2-8df6-4884c198f88d tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:54.301297 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b41577a3-f14a-4fe2-8df6-4884c198f88d tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:54.616059 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b41577a3-f14a-4fe2-8df6-4884c198f88d tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0c7ce41d64772a87a0ec7416ae6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68574d1c346d4507a2c25afd4de146e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:54.629002 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b41577a3-f14a-4fe2-8df6-4884c198f88d tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada" status: 200 len: 1318 microversion: 2.1 time: 0.363767 Jul 25 14:52:54.630120 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2734/5205] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:54 2022] GET /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:54.658254 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-5c1ece8a-8373-4125-b9f7-7e986d201c0c req-4d33d542-1777-40df-9d65-a161128415ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dc1536b-b1cd-4fb7-a42d-87e82d57dada", "name": "network-vif-plugged", "status": "completed", "tag": "5bf93d89-d31c-400c-b5f8-06f616908615"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:52:54.667172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:52:54.668259 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:52:54.675085 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-5c1ece8a-8373-4125-b9f7-7e986d201c0c req-4d33d542-1777-40df-9d65-a161128415ce service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:54.675772 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-5c1ece8a-8373-4125-b9f7-7e986d201c0c req-4d33d542-1777-40df-9d65-a161128415ce service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:54.691290 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-5c1ece8a-8373-4125-b9f7-7e986d201c0c req-4d33d542-1777-40df-9d65-a161128415ce service nova] Creating event network-vif-plugged:5bf93d89-d31c-400c-b5f8-06f616908615 for instance 5dc1536b-b1cd-4fb7-a42d-87e82d57dada on n-h1-846435-14 Jul 25 14:52:54.697580 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-5c1ece8a-8373-4125-b9f7-7e986d201c0c req-4d33d542-1777-40df-9d65-a161128415ce service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045593 Jul 25 14:52:54.698907 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2472/5206] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:52:55.650772 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a85c8cff-be68-4ce1-86da-772c76f8c8a9 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:55.651869 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a85c8cff-be68-4ce1-86da-772c76f8c8a9 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 5dc1536b-b1cd-4fb7-a42d-87e82d57dada] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:55.659821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a85c8cff-be68-4ce1-86da-772c76f8c8a9 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:55.660500 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a85c8cff-be68-4ce1-86da-772c76f8c8a9 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:55.661411 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a85c8cff-be68-4ce1-86da-772c76f8c8a9 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:55.661999 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a85c8cff-be68-4ce1-86da-772c76f8c8a9 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:55.827144 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a85c8cff-be68-4ce1-86da-772c76f8c8a9 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0c7ce41d64772a87a0ec7416ae6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68574d1c346d4507a2c25afd4de146e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:55.844933 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a85c8cff-be68-4ce1-86da-772c76f8c8a9 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada" status: 200 len: 1318 microversion: 2.1 time: 0.198842 Jul 25 14:52:55.845886 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2735/5207] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:55 2022] GET /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:56.872004 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1f4f4412-473b-4771-9be7-d878ae350612 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:56.873486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1f4f4412-473b-4771-9be7-d878ae350612 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 5dc1536b-b1cd-4fb7-a42d-87e82d57dada] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:56.880394 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1f4f4412-473b-4771-9be7-d878ae350612 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:56.880859 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1f4f4412-473b-4771-9be7-d878ae350612 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:56.881635 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1f4f4412-473b-4771-9be7-d878ae350612 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:56.882143 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1f4f4412-473b-4771-9be7-d878ae350612 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:57.046856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1f4f4412-473b-4771-9be7-d878ae350612 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0c7ce41d64772a87a0ec7416ae6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68574d1c346d4507a2c25afd4de146e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:57.055354 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1f4f4412-473b-4771-9be7-d878ae350612 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada" status: 200 len: 1507 microversion: 2.1 time: 0.188470 Jul 25 14:52:57.057089 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2473/5208] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:56 2022] GET /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada => generated 1507 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:57.080144 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0d842aab-ee54-48d1-a1f4-7c3a8dc89a38 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e307a30-7f33-4888-9563-0b8036661769", "device": "/dev/sdb"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:52:57.082855 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0d842aab-ee54-48d1-a1f4-7c3a8dc89a38 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 5dc1536b-b1cd-4fb7-a42d-87e82d57dada] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:57.090462 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0d842aab-ee54-48d1-a1f4-7c3a8dc89a38 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:57.090943 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0d842aab-ee54-48d1-a1f4-7c3a8dc89a38 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:57.091923 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0d842aab-ee54-48d1-a1f4-7c3a8dc89a38 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:57.092669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0d842aab-ee54-48d1-a1f4-7c3a8dc89a38 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:57.377430 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0d842aab-ee54-48d1-a1f4-7c3a8dc89a38 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "POST /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301868 Jul 25 14:52:57.380007 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2736/5209] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Jul 25 14:52:57 2022] POST /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:52:58.431832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bed819ca-8c70-4e8b-9867-ab8ff9cf6452 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:58.433925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bed819ca-8c70-4e8b-9867-ab8ff9cf6452 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:58.445604 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bed819ca-8c70-4e8b-9867-ab8ff9cf6452 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:58.446484 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bed819ca-8c70-4e8b-9867-ab8ff9cf6452 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:58.447495 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bed819ca-8c70-4e8b-9867-ab8ff9cf6452 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:58.448184 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bed819ca-8c70-4e8b-9867-ab8ff9cf6452 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:58.814180 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bed819ca-8c70-4e8b-9867-ab8ff9cf6452 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1836 microversion: 2.1 time: 0.393099 Jul 25 14:52:58.814997 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2474/5210] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:58 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1836 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:58.839420 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-01935821-ee30-4127-9275-af60f4614ae9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:52:58.840591 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-01935821-ee30-4127-9275-af60f4614ae9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:58.856060 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01935821-ee30-4127-9275-af60f4614ae9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:58.859271 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01935821-ee30-4127-9275-af60f4614ae9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:58.860246 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01935821-ee30-4127-9275-af60f4614ae9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:58.863289 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01935821-ee30-4127-9275-af60f4614ae9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:59.249444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-01935821-ee30-4127-9275-af60f4614ae9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:59.265641 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-01935821-ee30-4127-9275-af60f4614ae9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1683 microversion: 2.1 time: 0.428034 Jul 25 14:52:59.268004 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2737/5211] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:52:58 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1683 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:52:59.399507 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b067c056-6546-4818-bd34-25cefb1a7413 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:52:59.402887 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b067c056-6546-4818-bd34-25cefb1a7413 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:59.426432 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b067c056-6546-4818-bd34-25cefb1a7413 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:59.427115 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b067c056-6546-4818-bd34-25cefb1a7413 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:59.429879 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b067c056-6546-4818-bd34-25cefb1a7413 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:59.430613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b067c056-6546-4818-bd34-25cefb1a7413 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:59.508076 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b067c056-6546-4818-bd34-25cefb1a7413 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "POST /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d/action" status: 200 len: 32641 microversion: 2.1 time: 0.114390 Jul 25 14:52:59.518251 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2475/5212] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:52:59 2022] POST /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d/action => generated 32641 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 14:52:59.686423 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bc61a28c-9019-48c5-a099-ea95c8131490 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:52:59.687350 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bc61a28c-9019-48c5-a099-ea95c8131490 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:52:59.699999 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bc61a28c-9019-48c5-a099-ea95c8131490 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:59.702218 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bc61a28c-9019-48c5-a099-ea95c8131490 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:59.705594 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bc61a28c-9019-48c5-a099-ea95c8131490 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:52:59.706088 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bc61a28c-9019-48c5-a099-ea95c8131490 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:52:59.774673 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bc61a28c-9019-48c5-a099-ea95c8131490 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '70e72978507240e59a62131875512f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658bc187e1494c37bd05fcb41c37d580', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:52:59.775549 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bc61a28c-9019-48c5-a099-ea95c8131490 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] flavor_id is None. Assuming migration. {{(pid=119304) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 25 14:52:59.776186 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bc61a28c-9019-48c5-a099-ea95c8131490 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119304) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 14:53:00.186215 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:53:00.365859 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bc61a28c-9019-48c5-a099-ea95c8131490 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d/action" status: 202 len: 0 microversion: 2.1 time: 0.683504 Jul 25 14:53:00.370308 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2738/5213] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:52:59 2022] POST /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d/action => generated 0 bytes in 688 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:53:00.380130 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-45954d1e-cc8a-4631-b604-8ef343833d75 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:00.381244 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-45954d1e-cc8a-4631-b604-8ef343833d75 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:00.417046 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-45954d1e-cc8a-4631-b604-8ef343833d75 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:00.417536 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-45954d1e-cc8a-4631-b604-8ef343833d75 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:00.418353 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-45954d1e-cc8a-4631-b604-8ef343833d75 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:00.418791 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-45954d1e-cc8a-4631-b604-8ef343833d75 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:00.908677 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-45954d1e-cc8a-4631-b604-8ef343833d75 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:53:00.916908 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-45954d1e-cc8a-4631-b604-8ef343833d75 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1692 microversion: 2.1 time: 0.544539 Jul 25 14:53:00.917524 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2476/5214] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:00 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1692 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:53:01.943504 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-516d0942-ba9e-4947-89be-d697e3d0e897 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:01.944319 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-516d0942-ba9e-4947-89be-d697e3d0e897 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:01.962795 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-516d0942-ba9e-4947-89be-d697e3d0e897 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:01.963318 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-516d0942-ba9e-4947-89be-d697e3d0e897 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:01.964129 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-516d0942-ba9e-4947-89be-d697e3d0e897 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:01.964724 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-516d0942-ba9e-4947-89be-d697e3d0e897 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:02.242944 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-516d0942-ba9e-4947-89be-d697e3d0e897 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:53:02.251568 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-516d0942-ba9e-4947-89be-d697e3d0e897 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1692 microversion: 2.1 time: 0.312586 Jul 25 14:53:02.252712 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2739/5215] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:01 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1692 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:53:03.274167 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-74de77c7-c874-4772-b9d1-a21b9c0454dc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:03.275588 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-74de77c7-c874-4772-b9d1-a21b9c0454dc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:03.282289 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:53:03.305824 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-74de77c7-c874-4772-b9d1-a21b9c0454dc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:03.306334 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-74de77c7-c874-4772-b9d1-a21b9c0454dc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:03.307246 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-74de77c7-c874-4772-b9d1-a21b9c0454dc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:03.307719 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-74de77c7-c874-4772-b9d1-a21b9c0454dc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:03.488351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-030f0fd0-5e0d-4eeb-bf49-60eaf87724b8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:03.488862 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-030f0fd0-5e0d-4eeb-bf49-60eaf87724b8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:03.502596 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-030f0fd0-5e0d-4eeb-bf49-60eaf87724b8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:03.503256 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-030f0fd0-5e0d-4eeb-bf49-60eaf87724b8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:03.504357 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-030f0fd0-5e0d-4eeb-bf49-60eaf87724b8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:03.516739 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-030f0fd0-5e0d-4eeb-bf49-60eaf87724b8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:03.559241 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-030f0fd0-5e0d-4eeb-bf49-60eaf87724b8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed/ips" status: 200 len: 150 microversion: 2.1 time: 0.075067 Jul 25 14:53:03.560475 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2740/5216] 10.222.0.88 () {58 vars in 1248 bytes} [Mon Jul 25 14:53:03 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed/ips => generated 150 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:53:03.615879 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-74de77c7-c874-4772-b9d1-a21b9c0454dc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:53:03.626789 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-74de77c7-c874-4772-b9d1-a21b9c0454dc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1692 microversion: 2.1 time: 0.355551 Jul 25 14:53:03.630157 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2477/5217] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:03 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1692 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:53:04.651453 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8b826546-637d-4a14-b205-101957f48f11 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:04.653088 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8b826546-637d-4a14-b205-101957f48f11 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:04.672360 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8b826546-637d-4a14-b205-101957f48f11 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:04.674459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8b826546-637d-4a14-b205-101957f48f11 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:04.676331 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8b826546-637d-4a14-b205-101957f48f11 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:04.677560 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8b826546-637d-4a14-b205-101957f48f11 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:04.981391 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8b826546-637d-4a14-b205-101957f48f11 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:53:04.992090 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8b826546-637d-4a14-b205-101957f48f11 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1697 microversion: 2.1 time: 0.345994 Jul 25 14:53:04.995902 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2741/5218] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:04 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1697 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:53:06.023597 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6e90777c-e074-431d-9885-a5f055920560 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:06.025499 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6e90777c-e074-431d-9885-a5f055920560 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:06.034823 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e90777c-e074-431d-9885-a5f055920560 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:06.035601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e90777c-e074-431d-9885-a5f055920560 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:06.036635 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e90777c-e074-431d-9885-a5f055920560 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:06.037967 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e90777c-e074-431d-9885-a5f055920560 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:06.241509 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fd0aa082-6b45-42db-be3f-4f3aad843db5 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "079aef9e-fbe7-4e69-a5aa-cc2c0fd1d60d"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:53:06.245472 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fd0aa082-6b45-42db-be3f-4f3aad843db5 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:06.255047 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fd0aa082-6b45-42db-be3f-4f3aad843db5 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:06.255797 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fd0aa082-6b45-42db-be3f-4f3aad843db5 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:06.256798 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fd0aa082-6b45-42db-be3f-4f3aad843db5 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:06.257586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fd0aa082-6b45-42db-be3f-4f3aad843db5 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:06.321986 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6e90777c-e074-431d-9885-a5f055920560 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:53:06.339787 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6e90777c-e074-431d-9885-a5f055920560 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1697 microversion: 2.1 time: 0.325676 Jul 25 14:53:06.341286 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2478/5219] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:06 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1697 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:53:06.622617 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fd0aa082-6b45-42db-be3f-4f3aad843db5 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "POST /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.387023 Jul 25 14:53:06.628304 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2742/5220] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Jul 25 14:53:06 2022] POST /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed/os-volume_attachments => generated 194 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:53:07.362072 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-94db08be-bca0-46ef-84b7-44d1c75c03c2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:07.362745 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-94db08be-bca0-46ef-84b7-44d1c75c03c2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:07.369968 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-94db08be-bca0-46ef-84b7-44d1c75c03c2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:07.370384 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-94db08be-bca0-46ef-84b7-44d1c75c03c2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:07.371213 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-94db08be-bca0-46ef-84b7-44d1c75c03c2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:07.371843 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-94db08be-bca0-46ef-84b7-44d1c75c03c2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:07.568322 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-94db08be-bca0-46ef-84b7-44d1c75c03c2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:53:07.576111 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-94db08be-bca0-46ef-84b7-44d1c75c03c2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1697 microversion: 2.1 time: 0.218285 Jul 25 14:53:07.600698 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2479/5221] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:07 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1697 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:53:08.622543 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8f10b8dc-54e1-4593-859b-142ffe4d79f5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:08.624650 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8f10b8dc-54e1-4593-859b-142ffe4d79f5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:08.633598 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f10b8dc-54e1-4593-859b-142ffe4d79f5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:08.634779 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f10b8dc-54e1-4593-859b-142ffe4d79f5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:08.635799 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f10b8dc-54e1-4593-859b-142ffe4d79f5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:08.636466 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f10b8dc-54e1-4593-859b-142ffe4d79f5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:08.929815 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8f10b8dc-54e1-4593-859b-142ffe4d79f5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:53:08.950766 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8f10b8dc-54e1-4593-859b-142ffe4d79f5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1697 microversion: 2.1 time: 0.331424 Jul 25 14:53:08.951824 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2743/5222] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:08 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1697 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:53:09.978427 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-058449fe-a991-4485-9b2f-738df34b5c4e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:09.979154 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-058449fe-a991-4485-9b2f-738df34b5c4e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:09.995843 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-058449fe-a991-4485-9b2f-738df34b5c4e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:09.996613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-058449fe-a991-4485-9b2f-738df34b5c4e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:09.997730 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-058449fe-a991-4485-9b2f-738df34b5c4e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:09.998548 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-058449fe-a991-4485-9b2f-738df34b5c4e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:10.265212 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-058449fe-a991-4485-9b2f-738df34b5c4e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:53:10.277507 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-058449fe-a991-4485-9b2f-738df34b5c4e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1697 microversion: 2.1 time: 0.305859 Jul 25 14:53:10.278602 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2480/5223] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:09 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1697 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:53:11.304169 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-153a52fa-b35a-4d45-89b8-023dcb6619d4 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:11.306433 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-153a52fa-b35a-4d45-89b8-023dcb6619d4 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:11.339103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-153a52fa-b35a-4d45-89b8-023dcb6619d4 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:11.349790 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-153a52fa-b35a-4d45-89b8-023dcb6619d4 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:11.351020 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-153a52fa-b35a-4d45-89b8-023dcb6619d4 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:11.355421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-153a52fa-b35a-4d45-89b8-023dcb6619d4 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:12.296303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-153a52fa-b35a-4d45-89b8-023dcb6619d4 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:53:12.310269 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-153a52fa-b35a-4d45-89b8-023dcb6619d4 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1697 microversion: 2.1 time: 1.013888 Jul 25 14:53:12.313196 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2744/5224] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:11 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1697 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:53:13.331959 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-34a56db9-ca38-426d-b9cd-a0c9069cc8b8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:13.332603 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-34a56db9-ca38-426d-b9cd-a0c9069cc8b8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:13.345406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-34a56db9-ca38-426d-b9cd-a0c9069cc8b8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:13.345813 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-34a56db9-ca38-426d-b9cd-a0c9069cc8b8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:13.347803 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-34a56db9-ca38-426d-b9cd-a0c9069cc8b8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:13.348272 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-34a56db9-ca38-426d-b9cd-a0c9069cc8b8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:13.647946 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-34a56db9-ca38-426d-b9cd-a0c9069cc8b8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:53:13.650473 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:53:13.670224 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-34a56db9-ca38-426d-b9cd-a0c9069cc8b8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1697 microversion: 2.1 time: 0.342004 Jul 25 14:53:13.671705 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2481/5225] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:13 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1697 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:53:14.693351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e827e361-88a8-451e-afc5-05c12db15f70 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:14.693928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e827e361-88a8-451e-afc5-05c12db15f70 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:14.704829 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e827e361-88a8-451e-afc5-05c12db15f70 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:14.705521 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e827e361-88a8-451e-afc5-05c12db15f70 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:14.706458 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e827e361-88a8-451e-afc5-05c12db15f70 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:14.707042 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e827e361-88a8-451e-afc5-05c12db15f70 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:14.885533 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e827e361-88a8-451e-afc5-05c12db15f70 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:53:14.895654 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e827e361-88a8-451e-afc5-05c12db15f70 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1697 microversion: 2.1 time: 0.206085 Jul 25 14:53:14.896730 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2745/5226] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:14 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1697 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:53:15.918398 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-13d93256-1b86-4ef5-b307-222ae7760562 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:15.919862 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-13d93256-1b86-4ef5-b307-222ae7760562 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:15.938247 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-13d93256-1b86-4ef5-b307-222ae7760562 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:15.939079 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-13d93256-1b86-4ef5-b307-222ae7760562 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:15.940525 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-13d93256-1b86-4ef5-b307-222ae7760562 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:15.941162 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-13d93256-1b86-4ef5-b307-222ae7760562 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:16.461976 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-13d93256-1b86-4ef5-b307-222ae7760562 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:53:16.474417 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-13d93256-1b86-4ef5-b307-222ae7760562 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1697 microversion: 2.1 time: 0.560601 Jul 25 14:53:16.484500 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2482/5227] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:15 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1697 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:53:17.501834 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cb47684a-69bf-4987-b381-ef36ed886f5b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:17.502705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cb47684a-69bf-4987-b381-ef36ed886f5b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:17.515305 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cb47684a-69bf-4987-b381-ef36ed886f5b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:17.515765 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cb47684a-69bf-4987-b381-ef36ed886f5b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:17.523264 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cb47684a-69bf-4987-b381-ef36ed886f5b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:17.523851 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cb47684a-69bf-4987-b381-ef36ed886f5b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:17.832071 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-05385e8a-8f0b-4f5f-af1f-608950bd84d4 req-91bacd52-ef7d-44e4-9271-bfc0b136a83e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24543e41-c6a3-4964-a14a-d7273d59dc3d", "name": "network-vif-unplugged", "status": "completed", "tag": "c3bc1148-2a77-4263-9fb0-9cce5305d01d"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:53:17.850465 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-05385e8a-8f0b-4f5f-af1f-608950bd84d4 req-91bacd52-ef7d-44e4-9271-bfc0b136a83e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:17.851025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-05385e8a-8f0b-4f5f-af1f-608950bd84d4 req-91bacd52-ef7d-44e4-9271-bfc0b136a83e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:17.869956 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-05385e8a-8f0b-4f5f-af1f-608950bd84d4 req-91bacd52-ef7d-44e4-9271-bfc0b136a83e service nova] Creating event network-vif-unplugged:c3bc1148-2a77-4263-9fb0-9cce5305d01d for instance 24543e41-c6a3-4964-a14a-d7273d59dc3d on n-h2-846435-14 Jul 25 14:53:17.876162 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [req-05385e8a-8f0b-4f5f-af1f-608950bd84d4 req-91bacd52-ef7d-44e4-9271-bfc0b136a83e service nova] Instance 24543e41-c6a3-4964-a14a-d7273d59dc3d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119304) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 14:53:17.890251 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-05385e8a-8f0b-4f5f-af1f-608950bd84d4 req-91bacd52-ef7d-44e4-9271-bfc0b136a83e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.437762 Jul 25 14:53:17.891432 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2746/5228] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:53:18.116966 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cb47684a-69bf-4987-b381-ef36ed886f5b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:53:18.129491 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cb47684a-69bf-4987-b381-ef36ed886f5b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1696 microversion: 2.1 time: 0.630247 Jul 25 14:53:18.130399 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2483/5229] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:17 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1696 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:53:19.157186 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ce227745-cb99-4509-b927-0add42ce56b2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:19.159143 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ce227745-cb99-4509-b927-0add42ce56b2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:19.176290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce227745-cb99-4509-b927-0add42ce56b2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:19.176751 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce227745-cb99-4509-b927-0add42ce56b2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:19.179237 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce227745-cb99-4509-b927-0add42ce56b2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:19.179691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce227745-cb99-4509-b927-0add42ce56b2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:19.435115 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ce227745-cb99-4509-b927-0add42ce56b2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:53:19.449460 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ce227745-cb99-4509-b927-0add42ce56b2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1696 microversion: 2.1 time: 0.299366 Jul 25 14:53:19.457437 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2747/5230] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:19 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1696 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:53:19.924911 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-bb9afd5b-eb11-4e95-9df3-724ac92da2f7 req-fbac5d13-b972-47c9-965d-215957ca8680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24543e41-c6a3-4964-a14a-d7273d59dc3d", "tag": "c3bc1148-2a77-4263-9fb0-9cce5305d01d"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:53:19.954264 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-bb9afd5b-eb11-4e95-9df3-724ac92da2f7 req-fbac5d13-b972-47c9-965d-215957ca8680 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:19.954806 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-bb9afd5b-eb11-4e95-9df3-724ac92da2f7 req-fbac5d13-b972-47c9-965d-215957ca8680 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:19.979635 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-bb9afd5b-eb11-4e95-9df3-724ac92da2f7 req-fbac5d13-b972-47c9-965d-215957ca8680 service nova] Creating event network-changed:c3bc1148-2a77-4263-9fb0-9cce5305d01d for instance 24543e41-c6a3-4964-a14a-d7273d59dc3d on n-h2-846435-14 Jul 25 14:53:19.989248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [req-bb9afd5b-eb11-4e95-9df3-724ac92da2f7 req-fbac5d13-b972-47c9-965d-215957ca8680 service nova] Instance 24543e41-c6a3-4964-a14a-d7273d59dc3d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119303) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 14:53:20.005194 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-bb9afd5b-eb11-4e95-9df3-724ac92da2f7 req-fbac5d13-b972-47c9-965d-215957ca8680 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086657 Jul 25 14:53:20.006341 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2484/5231] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:53:20.100403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f89497b8-710a-43d7-bf8f-452cd5e07637 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:20.101354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f89497b8-710a-43d7-bf8f-452cd5e07637 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:20.109555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f89497b8-710a-43d7-bf8f-452cd5e07637 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:20.110453 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f89497b8-710a-43d7-bf8f-452cd5e07637 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:20.111552 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f89497b8-710a-43d7-bf8f-452cd5e07637 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:20.112208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f89497b8-710a-43d7-bf8f-452cd5e07637 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:20.221080 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-f89497b8-710a-43d7-bf8f-452cd5e07637 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lazy-loading 'services' on Instance uuid a89d95ca-8efe-45dd-9037-82e97797e7ed {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:53:20.366395 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f89497b8-710a-43d7-bf8f-452cd5e07637 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed/os-volume_attachments/079aef9e-fbe7-4e69-a5aa-cc2c0fd1d60d" status: 202 len: 0 microversion: 2.1 time: 0.270847 Jul 25 14:53:20.369083 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2748/5232] 10.222.0.88 () {58 vars in 1416 bytes} [Mon Jul 25 14:53:20 2022] DELETE /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed/os-volume_attachments/079aef9e-fbe7-4e69-a5aa-cc2c0fd1d60d => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:53:20.378263 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e74a5004-5ffc-484a-9dc2-6a2f4c95ab3e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:20.380914 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e74a5004-5ffc-484a-9dc2-6a2f4c95ab3e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:20.393315 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e74a5004-5ffc-484a-9dc2-6a2f4c95ab3e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:20.412084 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e74a5004-5ffc-484a-9dc2-6a2f4c95ab3e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:20.415419 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e74a5004-5ffc-484a-9dc2-6a2f4c95ab3e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:20.421245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e74a5004-5ffc-484a-9dc2-6a2f4c95ab3e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:20.471463 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fe0bc491-bc56-4c8b-b812-34608c5abd69 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:20.472612 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fe0bc491-bc56-4c8b-b812-34608c5abd69 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:20.491206 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fe0bc491-bc56-4c8b-b812-34608c5abd69 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:20.495068 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fe0bc491-bc56-4c8b-b812-34608c5abd69 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:20.496113 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fe0bc491-bc56-4c8b-b812-34608c5abd69 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:20.496711 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fe0bc491-bc56-4c8b-b812-34608c5abd69 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:20.510519 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e74a5004-5ffc-484a-9dc2-6a2f4c95ab3e tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136572 Jul 25 14:53:20.511173 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2485/5233] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:53:20 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:53:20.803413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fe0bc491-bc56-4c8b-b812-34608c5abd69 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:53:20.811066 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fe0bc491-bc56-4c8b-b812-34608c5abd69 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1694 microversion: 2.1 time: 0.343854 Jul 25 14:53:20.812279 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2749/5234] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:20 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1694 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:53:21.525978 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8a4f6ff7-7da7-49b7-9c1e-a810b235faac tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:21.528295 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8a4f6ff7-7da7-49b7-9c1e-a810b235faac tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:21.540248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8a4f6ff7-7da7-49b7-9c1e-a810b235faac tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:21.542731 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8a4f6ff7-7da7-49b7-9c1e-a810b235faac tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:21.546696 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8a4f6ff7-7da7-49b7-9c1e-a810b235faac tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:21.547215 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8a4f6ff7-7da7-49b7-9c1e-a810b235faac tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:21.604589 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8a4f6ff7-7da7-49b7-9c1e-a810b235faac tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083387 Jul 25 14:53:21.605845 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2486/5235] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:53:21 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:53:21.833335 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e4251ec5-d16a-4119-bd18-2a4e868723fc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:21.834740 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e4251ec5-d16a-4119-bd18-2a4e868723fc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:21.849118 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e4251ec5-d16a-4119-bd18-2a4e868723fc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:21.849573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e4251ec5-d16a-4119-bd18-2a4e868723fc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:21.850578 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e4251ec5-d16a-4119-bd18-2a4e868723fc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:21.851234 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e4251ec5-d16a-4119-bd18-2a4e868723fc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:22.059062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e4251ec5-d16a-4119-bd18-2a4e868723fc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:53:22.068101 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e4251ec5-d16a-4119-bd18-2a4e868723fc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1694 microversion: 2.1 time: 0.238798 Jul 25 14:53:22.068921 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2750/5236] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:21 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1694 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:53:22.620455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0cc734b7-a3e0-4b06-b4f9-ca476de731f0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:22.623251 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0cc734b7-a3e0-4b06-b4f9-ca476de731f0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:22.631351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0cc734b7-a3e0-4b06-b4f9-ca476de731f0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:22.631940 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0cc734b7-a3e0-4b06-b4f9-ca476de731f0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:22.632861 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0cc734b7-a3e0-4b06-b4f9-ca476de731f0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:22.633506 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0cc734b7-a3e0-4b06-b4f9-ca476de731f0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:22.693872 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0cc734b7-a3e0-4b06-b4f9-ca476de731f0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080229 Jul 25 14:53:22.698388 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2487/5237] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:53:22 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:53:23.090235 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e41f464c-8512-41c4-ab6d-4bfce611ed68 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:23.090686 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e41f464c-8512-41c4-ab6d-4bfce611ed68 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:23.103017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e41f464c-8512-41c4-ab6d-4bfce611ed68 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:23.103676 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e41f464c-8512-41c4-ab6d-4bfce611ed68 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:23.104683 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e41f464c-8512-41c4-ab6d-4bfce611ed68 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:23.108548 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e41f464c-8512-41c4-ab6d-4bfce611ed68 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:23.743148 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bdb4a5e9-ff58-46a0-b07e-e0e3bf82afe3 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:23.747338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bdb4a5e9-ff58-46a0-b07e-e0e3bf82afe3 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:23.800474 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bdb4a5e9-ff58-46a0-b07e-e0e3bf82afe3 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:23.801353 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bdb4a5e9-ff58-46a0-b07e-e0e3bf82afe3 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:23.802361 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bdb4a5e9-ff58-46a0-b07e-e0e3bf82afe3 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:23.802992 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bdb4a5e9-ff58-46a0-b07e-e0e3bf82afe3 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:23.854650 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bdb4a5e9-ff58-46a0-b07e-e0e3bf82afe3 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149123 Jul 25 14:53:23.863858 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2488/5238] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:53:23 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:53:24.463711 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e41f464c-8512-41c4-ab6d-4bfce611ed68 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:53:24.473584 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e41f464c-8512-41c4-ab6d-4bfce611ed68 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1694 microversion: 2.1 time: 1.387333 Jul 25 14:53:24.474201 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2751/5239] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:23 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1694 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:53:24.868192 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2b04082c-beab-42ae-883e-ea0e51f7648b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:24.871107 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2b04082c-beab-42ae-883e-ea0e51f7648b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:24.885042 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2b04082c-beab-42ae-883e-ea0e51f7648b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:24.885961 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2b04082c-beab-42ae-883e-ea0e51f7648b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:24.887701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2b04082c-beab-42ae-883e-ea0e51f7648b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:24.890535 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2b04082c-beab-42ae-883e-ea0e51f7648b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:24.937472 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2b04082c-beab-42ae-883e-ea0e51f7648b tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073934 Jul 25 14:53:24.942661 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2489/5240] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:53:24 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:53:25.322400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e8c61da2-c391-462b-84db-193df830a174 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:25.323132 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e8c61da2-c391-462b-84db-193df830a174 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 5dc1536b-b1cd-4fb7-a42d-87e82d57dada] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:25.332816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=38 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:53:25.335514 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e8c61da2-c391-462b-84db-193df830a174 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:25.336179 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e8c61da2-c391-462b-84db-193df830a174 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:25.339137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e8c61da2-c391-462b-84db-193df830a174 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:25.340115 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e8c61da2-c391-462b-84db-193df830a174 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:25.472418 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:53:25.479455 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-e8c61da2-c391-462b-84db-193df830a174 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lazy-loading 'services' on Instance uuid 5dc1536b-b1cd-4fb7-a42d-87e82d57dada {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:53:25.498690 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a36a7a03-2094-4486-9a35-ce9647dfa0ed tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:25.499311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a36a7a03-2094-4486-9a35-ce9647dfa0ed tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:25.514261 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a36a7a03-2094-4486-9a35-ce9647dfa0ed tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:25.521252 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a36a7a03-2094-4486-9a35-ce9647dfa0ed tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:25.522480 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a36a7a03-2094-4486-9a35-ce9647dfa0ed tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:25.523223 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a36a7a03-2094-4486-9a35-ce9647dfa0ed tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:25.596876 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e8c61da2-c391-462b-84db-193df830a174 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "DELETE /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada/os-volume_attachments/1e307a30-7f33-4888-9563-0b8036661769" status: 202 len: 0 microversion: 2.1 time: 0.282900 Jul 25 14:53:25.598948 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2752/5241] 10.222.0.88 () {58 vars in 1416 bytes} [Mon Jul 25 14:53:25 2022] DELETE /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada/os-volume_attachments/1e307a30-7f33-4888-9563-0b8036661769 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:53:25.825173 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a36a7a03-2094-4486-9a35-ce9647dfa0ed tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:53:25.838257 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a36a7a03-2094-4486-9a35-ce9647dfa0ed tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1691 microversion: 2.1 time: 0.343528 Jul 25 14:53:25.849615 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2490/5242] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:25 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1691 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:53:25.860575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3b29ad61-8962-4c89-b4d9-9fd56c4420a7 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:53:25.861202 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3b29ad61-8962-4c89-b4d9-9fd56c4420a7 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:25.868021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b29ad61-8962-4c89-b4d9-9fd56c4420a7 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:25.868477 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b29ad61-8962-4c89-b4d9-9fd56c4420a7 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:25.869250 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b29ad61-8962-4c89-b4d9-9fd56c4420a7 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:25.869895 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b29ad61-8962-4c89-b4d9-9fd56c4420a7 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:25.951329 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9feab62f-a0d5-4a6e-8b4c-0a3b82a76072 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:25.954119 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9feab62f-a0d5-4a6e-8b4c-0a3b82a76072 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:25.966541 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3b29ad61-8962-4c89-b4d9-9fd56c4420a7 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "POST /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d/action" status: 204 len: 0 microversion: 2.1 time: 0.110305 Jul 25 14:53:25.968019 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2753/5243] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:53:25 2022] POST /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d/action => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:53:25.969463 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9feab62f-a0d5-4a6e-8b4c-0a3b82a76072 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:25.969990 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9feab62f-a0d5-4a6e-8b4c-0a3b82a76072 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:25.973406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9feab62f-a0d5-4a6e-8b4c-0a3b82a76072 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:25.973999 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9feab62f-a0d5-4a6e-8b4c-0a3b82a76072 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:25.980801 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ce25816d-fb62-492c-8ca4-41544f745398 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:25.981515 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ce25816d-fb62-492c-8ca4-41544f745398 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:25.988960 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce25816d-fb62-492c-8ca4-41544f745398 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:25.989856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce25816d-fb62-492c-8ca4-41544f745398 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:25.990863 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce25816d-fb62-492c-8ca4-41544f745398 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:25.991488 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce25816d-fb62-492c-8ca4-41544f745398 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:26.038862 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9feab62f-a0d5-4a6e-8b4c-0a3b82a76072 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092523 Jul 25 14:53:26.046183 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2491/5244] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:53:25 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:53:26.368220 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ce25816d-fb62-492c-8ca4-41544f745398 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:53:26.375988 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ce25816d-fb62-492c-8ca4-41544f745398 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1691 microversion: 2.1 time: 0.403484 Jul 25 14:53:26.389515 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2754/5245] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:25 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1691 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:53:27.058164 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ba3168b6-d16c-41e2-8661-d7f82204aab4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:27.061225 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ba3168b6-d16c-41e2-8661-d7f82204aab4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:27.082665 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ba3168b6-d16c-41e2-8661-d7f82204aab4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:27.083557 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ba3168b6-d16c-41e2-8661-d7f82204aab4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:27.084706 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ba3168b6-d16c-41e2-8661-d7f82204aab4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:27.085284 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ba3168b6-d16c-41e2-8661-d7f82204aab4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:27.209465 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ba3168b6-d16c-41e2-8661-d7f82204aab4 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155138 Jul 25 14:53:27.210987 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2492/5246] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:53:27 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:53:27.400256 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-48d7db2d-b2a7-4f02-8a80-5540605c3a09 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:27.401786 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-48d7db2d-b2a7-4f02-8a80-5540605c3a09 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:27.409878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48d7db2d-b2a7-4f02-8a80-5540605c3a09 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:27.410657 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48d7db2d-b2a7-4f02-8a80-5540605c3a09 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:27.411698 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48d7db2d-b2a7-4f02-8a80-5540605c3a09 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:27.412149 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48d7db2d-b2a7-4f02-8a80-5540605c3a09 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:27.458359 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-768e49c1-a77e-4811-9765-6ee600a421d6 req-788d6db4-211b-4b9b-8741-0734faca4643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24543e41-c6a3-4964-a14a-d7273d59dc3d", "name": "network-vif-plugged", "status": "completed", "tag": "c3bc1148-2a77-4263-9fb0-9cce5305d01d"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:53:27.479842 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-768e49c1-a77e-4811-9765-6ee600a421d6 req-788d6db4-211b-4b9b-8741-0734faca4643 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:27.480827 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-768e49c1-a77e-4811-9765-6ee600a421d6 req-788d6db4-211b-4b9b-8741-0734faca4643 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:27.498925 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-768e49c1-a77e-4811-9765-6ee600a421d6 req-788d6db4-211b-4b9b-8741-0734faca4643 service nova] Creating event network-vif-plugged:c3bc1148-2a77-4263-9fb0-9cce5305d01d for instance 24543e41-c6a3-4964-a14a-d7273d59dc3d on n-h2-846435-14 Jul 25 14:53:27.508928 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-768e49c1-a77e-4811-9765-6ee600a421d6 req-788d6db4-211b-4b9b-8741-0734faca4643 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057091 Jul 25 14:53:27.509918 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2493/5247] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:53:27.691383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-48d7db2d-b2a7-4f02-8a80-5540605c3a09 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:53:27.701982 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-48d7db2d-b2a7-4f02-8a80-5540605c3a09 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1691 microversion: 2.1 time: 0.306591 Jul 25 14:53:27.702577 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2755/5248] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:27 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1691 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:53:28.226612 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5eac5ae2-8130-4620-abac-4de49311f4fa tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:28.229728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5eac5ae2-8130-4620-abac-4de49311f4fa tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:28.249147 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5eac5ae2-8130-4620-abac-4de49311f4fa tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:28.249937 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5eac5ae2-8130-4620-abac-4de49311f4fa tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:28.250391 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5eac5ae2-8130-4620-abac-4de49311f4fa tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:28.250815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5eac5ae2-8130-4620-abac-4de49311f4fa tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:28.310067 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5eac5ae2-8130-4620-abac-4de49311f4fa tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088698 Jul 25 14:53:28.311016 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2494/5249] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:53:28 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:53:28.730307 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f5786a8b-017a-48be-aa13-423bccdec1f8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:28.730913 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f5786a8b-017a-48be-aa13-423bccdec1f8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:28.739578 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5786a8b-017a-48be-aa13-423bccdec1f8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:28.752761 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5786a8b-017a-48be-aa13-423bccdec1f8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:28.754000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5786a8b-017a-48be-aa13-423bccdec1f8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:28.754585 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5786a8b-017a-48be-aa13-423bccdec1f8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:28.984798 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f5786a8b-017a-48be-aa13-423bccdec1f8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:53:28.994362 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f5786a8b-017a-48be-aa13-423bccdec1f8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1683 microversion: 2.1 time: 0.268036 Jul 25 14:53:28.995566 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2756/5250] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:28 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1683 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:53:29.323818 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a4da632e-688d-4373-a61f-1851dee89faf tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:29.326137 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a4da632e-688d-4373-a61f-1851dee89faf tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:29.336854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a4da632e-688d-4373-a61f-1851dee89faf tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:29.337311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a4da632e-688d-4373-a61f-1851dee89faf tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:29.338100 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a4da632e-688d-4373-a61f-1851dee89faf tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:29.341424 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a4da632e-688d-4373-a61f-1851dee89faf tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:29.388762 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a4da632e-688d-4373-a61f-1851dee89faf tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066874 Jul 25 14:53:29.389426 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2495/5251] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 14:53:29 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:53:29.485583 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-afe01462-9399-4c0f-836f-da3fac698da3 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:29.486369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-afe01462-9399-4c0f-836f-da3fac698da3 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:29.498317 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-afe01462-9399-4c0f-836f-da3fac698da3 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:29.499001 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-afe01462-9399-4c0f-836f-da3fac698da3 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:29.499957 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-afe01462-9399-4c0f-836f-da3fac698da3 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:29.500598 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-afe01462-9399-4c0f-836f-da3fac698da3 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:29.543502 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-afe01462-9399-4c0f-836f-da3fac698da3 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:53:29.667503 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-afe01462-9399-4c0f-836f-da3fac698da3 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed" status: 204 len: 0 microversion: 2.1 time: 0.185448 Jul 25 14:53:29.668761 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2757/5252] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:53:29 2022] DELETE /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:53:29.682571 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9572eefd-abd9-49df-b867-6ec42043b6c5 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:29.683352 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9572eefd-abd9-49df-b867-6ec42043b6c5 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:29.690646 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9572eefd-abd9-49df-b867-6ec42043b6c5 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:29.691400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9572eefd-abd9-49df-b867-6ec42043b6c5 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:29.692397 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9572eefd-abd9-49df-b867-6ec42043b6c5 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:29.693002 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9572eefd-abd9-49df-b867-6ec42043b6c5 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:29.985713 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9572eefd-abd9-49df-b867-6ec42043b6c5 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:53:29.995765 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9572eefd-abd9-49df-b867-6ec42043b6c5 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed" status: 200 len: 1681 microversion: 2.1 time: 0.322412 Jul 25 14:53:29.996168 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2496/5253] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:29 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed => generated 1681 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:53:31.018342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4a93e9d9-eeab-4873-8824-3db6ca6109f6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:31.020294 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4a93e9d9-eeab-4873-8824-3db6ca6109f6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:31.035045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4a93e9d9-eeab-4873-8824-3db6ca6109f6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:31.036547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4a93e9d9-eeab-4873-8824-3db6ca6109f6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:31.040302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4a93e9d9-eeab-4873-8824-3db6ca6109f6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:31.040957 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4a93e9d9-eeab-4873-8824-3db6ca6109f6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:31.311287 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4a93e9d9-eeab-4873-8824-3db6ca6109f6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:53:31.323854 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4a93e9d9-eeab-4873-8824-3db6ca6109f6 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed" status: 200 len: 1681 microversion: 2.1 time: 0.309832 Jul 25 14:53:31.326478 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2758/5254] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:31 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed => generated 1681 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:53:32.347482 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-58eea230-71f9-4d89-8cac-45ab918a0d0a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:32.348208 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-58eea230-71f9-4d89-8cac-45ab918a0d0a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:32.365901 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-58eea230-71f9-4d89-8cac-45ab918a0d0a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:32.367247 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-58eea230-71f9-4d89-8cac-45ab918a0d0a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:32.369264 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-58eea230-71f9-4d89-8cac-45ab918a0d0a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:32.369721 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-58eea230-71f9-4d89-8cac-45ab918a0d0a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:32.474672 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-58eea230-71f9-4d89-8cac-45ab918a0d0a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:53:32.485168 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-58eea230-71f9-4d89-8cac-45ab918a0d0a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed" status: 200 len: 1614 microversion: 2.1 time: 0.143497 Jul 25 14:53:32.485771 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2497/5255] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:32 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed => generated 1614 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:53:33.436373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-70cc8a61-9e76-4bc6-ab9b-5916a6e09f9a req-314d7912-2142-487e-a356-5f3caed1a96a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a89d95ca-8efe-45dd-9037-82e97797e7ed", "name": "network-vif-deleted", "tag": "a45c46f1-811e-4a04-8d37-7e83dba03d15"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:53:33.457840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-70cc8a61-9e76-4bc6-ab9b-5916a6e09f9a req-314d7912-2142-487e-a356-5f3caed1a96a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:33.461886 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-70cc8a61-9e76-4bc6-ab9b-5916a6e09f9a req-314d7912-2142-487e-a356-5f3caed1a96a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:33.494519 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-70cc8a61-9e76-4bc6-ab9b-5916a6e09f9a req-314d7912-2142-487e-a356-5f3caed1a96a service nova] Creating event network-vif-deleted:a45c46f1-811e-4a04-8d37-7e83dba03d15 for instance a89d95ca-8efe-45dd-9037-82e97797e7ed on n-h2-846435-14 Jul 25 14:53:33.500589 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-70cc8a61-9e76-4bc6-ab9b-5916a6e09f9a req-314d7912-2142-487e-a356-5f3caed1a96a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068122 Jul 25 14:53:33.501746 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2759/5256] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:53:33.511396 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-67076562-9255-4b87-834a-533b1a42ea69 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:33.512652 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-67076562-9255-4b87-834a-533b1a42ea69 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:33.520021 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=42 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:53:33.522607 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-67076562-9255-4b87-834a-533b1a42ea69 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:33.523438 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-67076562-9255-4b87-834a-533b1a42ea69 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:33.524419 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-67076562-9255-4b87-834a-533b1a42ea69 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:33.525138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-67076562-9255-4b87-834a-533b1a42ea69 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:33.612577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-67076562-9255-4b87-834a-533b1a42ea69 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '571a2d92d7a34f86bb3c0bfdfcabc5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325aff76e61141a985b3b0f45521444f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:53:33.626860 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-67076562-9255-4b87-834a-533b1a42ea69 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed" status: 200 len: 1326 microversion: 2.1 time: 0.120020 Jul 25 14:53:33.628067 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2498/5257] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:33 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed => generated 1326 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:53:34.312912 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d8db1cb2-132f-49bf-a6b6-c026a3945802 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:34.315753 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d8db1cb2-132f-49bf-a6b6-c026a3945802 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 5dc1536b-b1cd-4fb7-a42d-87e82d57dada] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:34.323535 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d8db1cb2-132f-49bf-a6b6-c026a3945802 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:34.324223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d8db1cb2-132f-49bf-a6b6-c026a3945802 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:34.325201 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d8db1cb2-132f-49bf-a6b6-c026a3945802 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:34.325631 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d8db1cb2-132f-49bf-a6b6-c026a3945802 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:34.352610 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d8db1cb2-132f-49bf-a6b6-c026a3945802 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 5dc1536b-b1cd-4fb7-a42d-87e82d57dada] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:53:34.471810 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d8db1cb2-132f-49bf-a6b6-c026a3945802 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "DELETE /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada" status: 204 len: 0 microversion: 2.1 time: 0.166466 Jul 25 14:53:34.472924 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2760/5258] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:53:34 2022] DELETE /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:53:34.481198 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-338496d9-1653-43a3-9028-f1a0a29057dc tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:34.481840 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-338496d9-1653-43a3-9028-f1a0a29057dc tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 5dc1536b-b1cd-4fb7-a42d-87e82d57dada] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:34.489430 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-338496d9-1653-43a3-9028-f1a0a29057dc tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:34.490177 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-338496d9-1653-43a3-9028-f1a0a29057dc tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:34.491197 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-338496d9-1653-43a3-9028-f1a0a29057dc tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:34.491795 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-338496d9-1653-43a3-9028-f1a0a29057dc tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:34.509909 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:53:34.652664 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f3be8e49-d13f-4a8c-9b2b-66c1cd0004c8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:34.653373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f3be8e49-d13f-4a8c-9b2b-66c1cd0004c8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:34.658997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-338496d9-1653-43a3-9028-f1a0a29057dc tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0c7ce41d64772a87a0ec7416ae6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68574d1c346d4507a2c25afd4de146e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:53:34.669796 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-338496d9-1653-43a3-9028-f1a0a29057dc tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada" status: 200 len: 1513 microversion: 2.1 time: 0.192566 Jul 25 14:53:34.670399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f3be8e49-d13f-4a8c-9b2b-66c1cd0004c8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:34.670516 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2499/5259] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:34 2022] GET /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada => generated 1513 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:53:34.672466 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f3be8e49-d13f-4a8c-9b2b-66c1cd0004c8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:34.673358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f3be8e49-d13f-4a8c-9b2b-66c1cd0004c8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:34.680541 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f3be8e49-d13f-4a8c-9b2b-66c1cd0004c8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:34.707062 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-f3be8e49-d13f-4a8c-9b2b-66c1cd0004c8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] HTTP exception thrown: Instance a89d95ca-8efe-45dd-9037-82e97797e7ed could not be found. Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f3be8e49-d13f-4a8c-9b2b-66c1cd0004c8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Request method failure captured: Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed HTTP/1.1 Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qxVTVC8FUnn-t2qK29pQ6gpvvVkF5Cd1ek9O6-ax9bIU4h-Acw7IM2XyPTWfCK6LWhHPoO7fpkEcbhitPiuVrA5WlFZ0WfmMB-2I-MAtgO20bt12dRN-m_gApdOXiuB_IoQnmtlPGVQzahhzXBQE11eo5L_JzE39RyLIYMYF8wTD50 Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 325aff76e61141a985b3b0f45521444f Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/325aff76e61141a985b3b0f45521444f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/325aff76e61141a985b3b0f45521444f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_325aff76e61141a985b3b0f45521444f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/325aff76e61141a985b3b0f45521444f"}]}] Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 325aff76e61141a985b3b0f45521444f Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-AttachVolumeNegativeTest-1959370092-project Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 571a2d92d7a34f86bb3c0bfdfcabc5ff Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-AttachVolumeNegativeTest-1959370092-project Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance a89d95ca-8efe-45dd-9037-82e97797e7ed could not be found. Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'a89d95ca-8efe-45dd-9037-82e97797e7ed'} Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a89d95ca-8efe-45dd-9037-82e97797e7ed could not be found. Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a89d95ca-8efe-45dd-9037-82e97797e7ed could not be found. Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:53:34.708682 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:53:34.713091 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:53:34.713091 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:53:34.713091 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:53:34.713091 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:53:34.713091 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:53:34.713091 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a89d95ca-8efe-45dd-9037-82e97797e7ed could not be found. Jul 25 14:53:34.713091 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:53:34.714755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f3be8e49-d13f-4a8c-9b2b-66c1cd0004c8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Returning 404 to user: Instance a89d95ca-8efe-45dd-9037-82e97797e7ed could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:53:34.715796 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f3be8e49-d13f-4a8c-9b2b-66c1cd0004c8 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed" status: 404 len: 111 microversion: 2.1 time: 0.070831 Jul 25 14:53:34.716921 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2761/5260] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:34 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:53:34.730151 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1c1bb004-aa7b-4ef4-a189-ac661a6cae4c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '.version_select at 0x7f46867bcdc0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:34.773615 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1c1bb004-aa7b-4ef4-a189-ac661a6cae4c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-766092198" status: 202 len: 0 microversion: 2.1 time: 0.052201 Jul 25 14:53:34.774274 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2500/5261] 10.222.0.88 () {58 vars in 1218 bytes} [Mon Jul 25 14:53:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-766092198 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:53:35.690940 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8d6a7eba-bae9-44a3-b170-73cad4820fef tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:35.691660 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8d6a7eba-bae9-44a3-b170-73cad4820fef tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 5dc1536b-b1cd-4fb7-a42d-87e82d57dada] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:35.699745 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d6a7eba-bae9-44a3-b170-73cad4820fef tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:35.700406 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d6a7eba-bae9-44a3-b170-73cad4820fef tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:35.701567 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d6a7eba-bae9-44a3-b170-73cad4820fef tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:35.702521 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d6a7eba-bae9-44a3-b170-73cad4820fef tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:36.028980 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8d6a7eba-bae9-44a3-b170-73cad4820fef tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0c7ce41d64772a87a0ec7416ae6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68574d1c346d4507a2c25afd4de146e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:53:36.054149 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8d6a7eba-bae9-44a3-b170-73cad4820fef tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada" status: 200 len: 1513 microversion: 2.1 time: 0.367023 Jul 25 14:53:36.059126 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2762/5262] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:35 2022] GET /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada => generated 1513 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:53:37.077014 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-494b9d85-7553-49b5-85a7-bf8d94ab48e4 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:37.078169 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-494b9d85-7553-49b5-85a7-bf8d94ab48e4 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 5dc1536b-b1cd-4fb7-a42d-87e82d57dada] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:37.094378 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-494b9d85-7553-49b5-85a7-bf8d94ab48e4 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:37.095052 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-494b9d85-7553-49b5-85a7-bf8d94ab48e4 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:37.096044 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-494b9d85-7553-49b5-85a7-bf8d94ab48e4 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:37.097506 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-494b9d85-7553-49b5-85a7-bf8d94ab48e4 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:37.308986 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-9c1f72ba-8faa-4201-9941-ddc6921f955e req-f81c6d51-8ef6-490b-a179-262803aaaaea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dc1536b-b1cd-4fb7-a42d-87e82d57dada", "name": "network-vif-deleted", "tag": "5bf93d89-d31c-400c-b5f8-06f616908615"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:53:37.333687 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-9c1f72ba-8faa-4201-9941-ddc6921f955e req-f81c6d51-8ef6-490b-a179-262803aaaaea service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:37.334896 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-9c1f72ba-8faa-4201-9941-ddc6921f955e req-f81c6d51-8ef6-490b-a179-262803aaaaea service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:37.358977 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-494b9d85-7553-49b5-85a7-bf8d94ab48e4 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0c7ce41d64772a87a0ec7416ae6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68574d1c346d4507a2c25afd4de146e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:53:37.364224 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-9c1f72ba-8faa-4201-9941-ddc6921f955e req-f81c6d51-8ef6-490b-a179-262803aaaaea service nova] Creating event network-vif-deleted:5bf93d89-d31c-400c-b5f8-06f616908615 for instance 5dc1536b-b1cd-4fb7-a42d-87e82d57dada on n-h1-846435-14 Jul 25 14:53:37.367876 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-494b9d85-7553-49b5-85a7-bf8d94ab48e4 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada" status: 200 len: 1471 microversion: 2.1 time: 0.295819 Jul 25 14:53:37.368510 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2501/5263] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:37 2022] GET /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada => generated 1471 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:53:37.386011 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-9c1f72ba-8faa-4201-9941-ddc6921f955e req-f81c6d51-8ef6-490b-a179-262803aaaaea service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082129 Jul 25 14:53:37.386011 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2763/5264] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:53:38.394344 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-99a08355-6950-4696-96b1-7ec7fb50d5b7 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:38.395637 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-99a08355-6950-4696-96b1-7ec7fb50d5b7 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] [instance: 5dc1536b-b1cd-4fb7-a42d-87e82d57dada] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:38.402791 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99a08355-6950-4696-96b1-7ec7fb50d5b7 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:38.403244 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99a08355-6950-4696-96b1-7ec7fb50d5b7 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:38.404267 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99a08355-6950-4696-96b1-7ec7fb50d5b7 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:38.404766 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99a08355-6950-4696-96b1-7ec7fb50d5b7 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:38.419114 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-99a08355-6950-4696-96b1-7ec7fb50d5b7 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] HTTP exception thrown: Instance 5dc1536b-b1cd-4fb7-a42d-87e82d57dada could not be found. Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-99a08355-6950-4696-96b1-7ec7fb50d5b7 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Request method failure captured: Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada HTTP/1.1 Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q1QZBoeB4cFVKaRLzrYL4kNfmL6-sG_CA2EvbcPKlnS-c9LfqWavAL38zgJccsMIKFsl0cXJ4GraWGBT_CyOIEeG6kteHsej-KgMUbMop62K9tdjeRHsxfsRgr9DcnobToFukjsCt89mJQZKPZoIV0Eh59a044YYbv9gRuGvEVNc18 Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 68574d1c346d4507a2c25afd4de146e5 Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-VolumesSnapshotTestJSON-745734763 Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/68574d1c346d4507a2c25afd4de146e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/68574d1c346d4507a2c25afd4de146e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_68574d1c346d4507a2c25afd4de146e5", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/68574d1c346d4507a2c25afd4de146e5"}]}] Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-VolumesSnapshotTestJSON-745734763 Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 68574d1c346d4507a2c25afd4de146e5 Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-745734763 Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-VolumesSnapshotTestJSON-745734763-project Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 03e0c7ce41d64772a87a0ec7416ae6ea Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-VolumesSnapshotTestJSON-745734763-project Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 5dc1536b-b1cd-4fb7-a42d-87e82d57dada could not be found. Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '5dc1536b-b1cd-4fb7-a42d-87e82d57dada'} Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dc1536b-b1cd-4fb7-a42d-87e82d57dada could not be found. Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dc1536b-b1cd-4fb7-a42d-87e82d57dada could not be found. Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:53:38.420850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:53:38.426487 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:53:38.426487 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:53:38.426487 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:53:38.426487 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:53:38.426487 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:53:38.426487 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dc1536b-b1cd-4fb7-a42d-87e82d57dada could not be found. Jul 25 14:53:38.426487 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:53:38.426487 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-99a08355-6950-4696-96b1-7ec7fb50d5b7 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] Returning 404 to user: Instance 5dc1536b-b1cd-4fb7-a42d-87e82d57dada could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:53:38.426487 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-99a08355-6950-4696-96b1-7ec7fb50d5b7 tempest-VolumesSnapshotTestJSON-745734763 tempest-VolumesSnapshotTestJSON-745734763-project] 10.222.0.88 "GET /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada" status: 404 len: 111 microversion: 2.1 time: 0.032568 Jul 25 14:53:38.430731 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2502/5265] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:38 2022] GET /compute/v2.1/servers/5dc1536b-b1cd-4fb7-a42d-87e82d57dada => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:53:40.189090 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-20a54682-8a1e-4f08-bd3b-2aa5162e8f1a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:40.190235 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-20a54682-8a1e-4f08-bd3b-2aa5162e8f1a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:40.204258 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-20a54682-8a1e-4f08-bd3b-2aa5162e8f1a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:40.205813 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-20a54682-8a1e-4f08-bd3b-2aa5162e8f1a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:40.207929 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-20a54682-8a1e-4f08-bd3b-2aa5162e8f1a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:40.208412 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-20a54682-8a1e-4f08-bd3b-2aa5162e8f1a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:40.238860 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-20a54682-8a1e-4f08-bd3b-2aa5162e8f1a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] HTTP exception thrown: Instance a89d95ca-8efe-45dd-9037-82e97797e7ed could not be found. Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-20a54682-8a1e-4f08-bd3b-2aa5162e8f1a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Request method failure captured: Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed HTTP/1.1 Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qxVTVC8FUnn-t2qK29pQ6gpvvVkF5Cd1ek9O6-ax9bIU4h-Acw7IM2XyPTWfCK6LWhHPoO7fpkEcbhitPiuVrA5WlFZ0WfmMB-2I-MAtgO20bt12dRN-m_gApdOXiuB_IoQnmtlPGVQzahhzXBQE11eo5L_JzE39RyLIYMYF8wTD50 Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 325aff76e61141a985b3b0f45521444f Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/325aff76e61141a985b3b0f45521444f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/325aff76e61141a985b3b0f45521444f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_325aff76e61141a985b3b0f45521444f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/325aff76e61141a985b3b0f45521444f"}]}] Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 325aff76e61141a985b3b0f45521444f Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-AttachVolumeNegativeTest-1959370092-project Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 571a2d92d7a34f86bb3c0bfdfcabc5ff Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-AttachVolumeNegativeTest-1959370092-project Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance a89d95ca-8efe-45dd-9037-82e97797e7ed could not be found. Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'a89d95ca-8efe-45dd-9037-82e97797e7ed'} Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a89d95ca-8efe-45dd-9037-82e97797e7ed could not be found. Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:53:40.241054 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:53:40.244490 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a89d95ca-8efe-45dd-9037-82e97797e7ed could not be found. Jul 25 14:53:40.244490 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:53:40.244490 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:53:40.244490 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:53:40.244490 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:53:40.244490 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:53:40.244490 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:53:40.244490 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:53:40.244490 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:53:40.244490 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a89d95ca-8efe-45dd-9037-82e97797e7ed could not be found. Jul 25 14:53:40.244490 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:53:40.244490 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-20a54682-8a1e-4f08-bd3b-2aa5162e8f1a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Returning 404 to user: Instance a89d95ca-8efe-45dd-9037-82e97797e7ed could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:53:40.244490 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-20a54682-8a1e-4f08-bd3b-2aa5162e8f1a tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed" status: 404 len: 111 microversion: 2.1 time: 0.072249 Jul 25 14:53:40.244490 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2764/5266] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:53:40 2022] DELETE /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:53:40.253584 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-36f9ad3d-a3ae-4754-9334-fca353e6453c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:40.254916 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-36f9ad3d-a3ae-4754-9334-fca353e6453c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: a89d95ca-8efe-45dd-9037-82e97797e7ed] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:40.282046 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-36f9ad3d-a3ae-4754-9334-fca353e6453c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:40.282750 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-36f9ad3d-a3ae-4754-9334-fca353e6453c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:40.283853 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-36f9ad3d-a3ae-4754-9334-fca353e6453c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:40.286432 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-36f9ad3d-a3ae-4754-9334-fca353e6453c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:40.317000 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-36f9ad3d-a3ae-4754-9334-fca353e6453c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] HTTP exception thrown: Instance a89d95ca-8efe-45dd-9037-82e97797e7ed could not be found. Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-36f9ad3d-a3ae-4754-9334-fca353e6453c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Request method failure captured: Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed HTTP/1.1 Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qxVTVC8FUnn-t2qK29pQ6gpvvVkF5Cd1ek9O6-ax9bIU4h-Acw7IM2XyPTWfCK6LWhHPoO7fpkEcbhitPiuVrA5WlFZ0WfmMB-2I-MAtgO20bt12dRN-m_gApdOXiuB_IoQnmtlPGVQzahhzXBQE11eo5L_JzE39RyLIYMYF8wTD50 Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 325aff76e61141a985b3b0f45521444f Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/325aff76e61141a985b3b0f45521444f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/325aff76e61141a985b3b0f45521444f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_325aff76e61141a985b3b0f45521444f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/325aff76e61141a985b3b0f45521444f"}]}] Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 325aff76e61141a985b3b0f45521444f Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-AttachVolumeNegativeTest-1959370092-project Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 571a2d92d7a34f86bb3c0bfdfcabc5ff Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-AttachVolumeNegativeTest-1959370092-project Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance a89d95ca-8efe-45dd-9037-82e97797e7ed could not be found. Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'a89d95ca-8efe-45dd-9037-82e97797e7ed'} Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a89d95ca-8efe-45dd-9037-82e97797e7ed could not be found. Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a89d95ca-8efe-45dd-9037-82e97797e7ed could not be found. Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:53:40.319222 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:53:40.323516 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:53:40.323516 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:53:40.323516 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:53:40.323516 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:53:40.323516 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:53:40.323516 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a89d95ca-8efe-45dd-9037-82e97797e7ed could not be found. Jul 25 14:53:40.323516 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:53:40.323516 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-36f9ad3d-a3ae-4754-9334-fca353e6453c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Returning 404 to user: Instance a89d95ca-8efe-45dd-9037-82e97797e7ed could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:53:40.323516 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-36f9ad3d-a3ae-4754-9334-fca353e6453c tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed" status: 404 len: 111 microversion: 2.1 time: 0.072325 Jul 25 14:53:40.323516 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2503/5267] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:40 2022] GET /compute/v2.1/servers/a89d95ca-8efe-45dd-9037-82e97797e7ed => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:53:45.996375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-592a9099-2823-43be-b28f-520d995c939d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:45.997579 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-592a9099-2823-43be-b28f-520d995c939d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:46.005687 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-592a9099-2823-43be-b28f-520d995c939d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:46.006432 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-592a9099-2823-43be-b28f-520d995c939d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:46.007672 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-592a9099-2823-43be-b28f-520d995c939d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:46.009582 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-592a9099-2823-43be-b28f-520d995c939d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:46.052706 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-592a9099-2823-43be-b28f-520d995c939d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] HTTP exception thrown: Instance fe421aa5-5038-479a-b496-04130c3de412 could not be found. Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-592a9099-2823-43be-b28f-520d995c939d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Request method failure captured: Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412 HTTP/1.1 Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qxVTVC8FUnn-t2qK29pQ6gpvvVkF5Cd1ek9O6-ax9bIU4h-Acw7IM2XyPTWfCK6LWhHPoO7fpkEcbhitPiuVrA5WlFZ0WfmMB-2I-MAtgO20bt12dRN-m_gApdOXiuB_IoQnmtlPGVQzahhzXBQE11eo5L_JzE39RyLIYMYF8wTD50 Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 325aff76e61141a985b3b0f45521444f Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/325aff76e61141a985b3b0f45521444f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/325aff76e61141a985b3b0f45521444f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_325aff76e61141a985b3b0f45521444f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/325aff76e61141a985b3b0f45521444f"}]}] Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 325aff76e61141a985b3b0f45521444f Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-AttachVolumeNegativeTest-1959370092-project Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 571a2d92d7a34f86bb3c0bfdfcabc5ff Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-AttachVolumeNegativeTest-1959370092-project Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance fe421aa5-5038-479a-b496-04130c3de412 could not be found. Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'fe421aa5-5038-479a-b496-04130c3de412'} Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe421aa5-5038-479a-b496-04130c3de412 could not be found. Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:53:46.054792 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:53:46.059242 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe421aa5-5038-479a-b496-04130c3de412 could not be found. Jul 25 14:53:46.059242 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:53:46.059242 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:53:46.059242 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:53:46.059242 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:53:46.059242 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:53:46.059242 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:53:46.059242 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:53:46.059242 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:53:46.059242 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe421aa5-5038-479a-b496-04130c3de412 could not be found. Jul 25 14:53:46.059242 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:53:46.059242 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-592a9099-2823-43be-b28f-520d995c939d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Returning 404 to user: Instance fe421aa5-5038-479a-b496-04130c3de412 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:53:46.059242 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-592a9099-2823-43be-b28f-520d995c939d tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "DELETE /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412" status: 404 len: 111 microversion: 2.1 time: 0.064841 Jul 25 14:53:46.067089 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-59ad4c3e-ad88-4cf1-86a0-fcaad4fe7ec3 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:46.068246 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2765/5268] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:53:45 2022] DELETE /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:53:46.068923 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-59ad4c3e-ad88-4cf1-86a0-fcaad4fe7ec3 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: fe421aa5-5038-479a-b496-04130c3de412] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:46.085598 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59ad4c3e-ad88-4cf1-86a0-fcaad4fe7ec3 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:46.086070 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59ad4c3e-ad88-4cf1-86a0-fcaad4fe7ec3 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:46.086897 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59ad4c3e-ad88-4cf1-86a0-fcaad4fe7ec3 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:46.087474 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59ad4c3e-ad88-4cf1-86a0-fcaad4fe7ec3 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:46.114071 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-59ad4c3e-ad88-4cf1-86a0-fcaad4fe7ec3 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] HTTP exception thrown: Instance fe421aa5-5038-479a-b496-04130c3de412 could not be found. Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-59ad4c3e-ad88-4cf1-86a0-fcaad4fe7ec3 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Request method failure captured: Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412 HTTP/1.1 Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qxVTVC8FUnn-t2qK29pQ6gpvvVkF5Cd1ek9O6-ax9bIU4h-Acw7IM2XyPTWfCK6LWhHPoO7fpkEcbhitPiuVrA5WlFZ0WfmMB-2I-MAtgO20bt12dRN-m_gApdOXiuB_IoQnmtlPGVQzahhzXBQE11eo5L_JzE39RyLIYMYF8wTD50 Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 325aff76e61141a985b3b0f45521444f Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/325aff76e61141a985b3b0f45521444f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/325aff76e61141a985b3b0f45521444f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_325aff76e61141a985b3b0f45521444f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/325aff76e61141a985b3b0f45521444f"}]}] Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 325aff76e61141a985b3b0f45521444f Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-AttachVolumeNegativeTest-1959370092-project Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 571a2d92d7a34f86bb3c0bfdfcabc5ff Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-AttachVolumeNegativeTest-1959370092-project Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance fe421aa5-5038-479a-b496-04130c3de412 could not be found. Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'fe421aa5-5038-479a-b496-04130c3de412'} Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe421aa5-5038-479a-b496-04130c3de412 could not be found. Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe421aa5-5038-479a-b496-04130c3de412 could not be found. Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:53:46.122678 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:53:46.128410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:53:46.128410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:53:46.128410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:53:46.128410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:53:46.128410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:53:46.128410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe421aa5-5038-479a-b496-04130c3de412 could not be found. Jul 25 14:53:46.128410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:53:46.130573 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-59ad4c3e-ad88-4cf1-86a0-fcaad4fe7ec3 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Returning 404 to user: Instance fe421aa5-5038-479a-b496-04130c3de412 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:53:46.131660 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-59ad4c3e-ad88-4cf1-86a0-fcaad4fe7ec3 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412" status: 404 len: 111 microversion: 2.1 time: 0.070300 Jul 25 14:53:46.132798 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2504/5269] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:46 2022] GET /compute/v2.1/servers/fe421aa5-5038-479a-b496-04130c3de412 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:53:46.142225 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7cab7f14-ff71-4821-bc85-3d12079ad571 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:46.142836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7cab7f14-ff71-4821-bc85-3d12079ad571 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: f5e1c62b-88b7-4ec7-a2f3-b99b1566baab] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:46.150758 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7cab7f14-ff71-4821-bc85-3d12079ad571 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:46.151653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7cab7f14-ff71-4821-bc85-3d12079ad571 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:46.152633 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7cab7f14-ff71-4821-bc85-3d12079ad571 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:46.154185 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7cab7f14-ff71-4821-bc85-3d12079ad571 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:46.172498 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-7cab7f14-ff71-4821-bc85-3d12079ad571 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] HTTP exception thrown: Instance f5e1c62b-88b7-4ec7-a2f3-b99b1566baab could not be found. Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7cab7f14-ff71-4821-bc85-3d12079ad571 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Request method failure captured: Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab HTTP/1.1 Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qxVTVC8FUnn-t2qK29pQ6gpvvVkF5Cd1ek9O6-ax9bIU4h-Acw7IM2XyPTWfCK6LWhHPoO7fpkEcbhitPiuVrA5WlFZ0WfmMB-2I-MAtgO20bt12dRN-m_gApdOXiuB_IoQnmtlPGVQzahhzXBQE11eo5L_JzE39RyLIYMYF8wTD50 Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 325aff76e61141a985b3b0f45521444f Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/325aff76e61141a985b3b0f45521444f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/325aff76e61141a985b3b0f45521444f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_325aff76e61141a985b3b0f45521444f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/325aff76e61141a985b3b0f45521444f"}]}] Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 325aff76e61141a985b3b0f45521444f Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-AttachVolumeNegativeTest-1959370092-project Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 571a2d92d7a34f86bb3c0bfdfcabc5ff Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-AttachVolumeNegativeTest-1959370092-project Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance f5e1c62b-88b7-4ec7-a2f3-b99b1566baab could not be found. Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'f5e1c62b-88b7-4ec7-a2f3-b99b1566baab'} Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5e1c62b-88b7-4ec7-a2f3-b99b1566baab could not be found. Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:53:46.174193 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:53:46.181437 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5e1c62b-88b7-4ec7-a2f3-b99b1566baab could not be found. Jul 25 14:53:46.181437 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:53:46.181437 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:53:46.181437 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:53:46.181437 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:53:46.181437 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:53:46.181437 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:53:46.181437 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:53:46.181437 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:53:46.181437 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5e1c62b-88b7-4ec7-a2f3-b99b1566baab could not be found. Jul 25 14:53:46.181437 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:53:46.181437 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7cab7f14-ff71-4821-bc85-3d12079ad571 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Returning 404 to user: Instance f5e1c62b-88b7-4ec7-a2f3-b99b1566baab could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:53:46.181437 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7cab7f14-ff71-4821-bc85-3d12079ad571 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "DELETE /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab" status: 404 len: 111 microversion: 2.1 time: 0.038016 Jul 25 14:53:46.181437 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2766/5270] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:53:46 2022] DELETE /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:53:46.185446 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9c5b4c26-9122-4da3-9016-6f3b783a0832 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:46.186067 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9c5b4c26-9122-4da3-9016-6f3b783a0832 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: f5e1c62b-88b7-4ec7-a2f3-b99b1566baab] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:46.196660 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9c5b4c26-9122-4da3-9016-6f3b783a0832 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:46.196848 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9c5b4c26-9122-4da3-9016-6f3b783a0832 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:46.197919 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9c5b4c26-9122-4da3-9016-6f3b783a0832 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:46.199075 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9c5b4c26-9122-4da3-9016-6f3b783a0832 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:46.217047 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-9c5b4c26-9122-4da3-9016-6f3b783a0832 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] HTTP exception thrown: Instance f5e1c62b-88b7-4ec7-a2f3-b99b1566baab could not be found. Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9c5b4c26-9122-4da3-9016-6f3b783a0832 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Request method failure captured: Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab HTTP/1.1 Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qxVTVC8FUnn-t2qK29pQ6gpvvVkF5Cd1ek9O6-ax9bIU4h-Acw7IM2XyPTWfCK6LWhHPoO7fpkEcbhitPiuVrA5WlFZ0WfmMB-2I-MAtgO20bt12dRN-m_gApdOXiuB_IoQnmtlPGVQzahhzXBQE11eo5L_JzE39RyLIYMYF8wTD50 Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 325aff76e61141a985b3b0f45521444f Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/325aff76e61141a985b3b0f45521444f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/325aff76e61141a985b3b0f45521444f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_325aff76e61141a985b3b0f45521444f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/325aff76e61141a985b3b0f45521444f"}]}] Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 325aff76e61141a985b3b0f45521444f Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-AttachVolumeNegativeTest-1959370092-project Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 571a2d92d7a34f86bb3c0bfdfcabc5ff Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-AttachVolumeNegativeTest-1959370092-project Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance f5e1c62b-88b7-4ec7-a2f3-b99b1566baab could not be found. Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'f5e1c62b-88b7-4ec7-a2f3-b99b1566baab'} Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5e1c62b-88b7-4ec7-a2f3-b99b1566baab could not be found. Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5e1c62b-88b7-4ec7-a2f3-b99b1566baab could not be found. Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:53:46.219326 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:53:46.223095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:53:46.223095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:53:46.223095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:53:46.223095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:53:46.223095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:53:46.223095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5e1c62b-88b7-4ec7-a2f3-b99b1566baab could not be found. Jul 25 14:53:46.223095 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:53:46.226004 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9c5b4c26-9122-4da3-9016-6f3b783a0832 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Returning 404 to user: Instance f5e1c62b-88b7-4ec7-a2f3-b99b1566baab could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:53:46.227127 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9c5b4c26-9122-4da3-9016-6f3b783a0832 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab" status: 404 len: 111 microversion: 2.1 time: 0.045855 Jul 25 14:53:46.228416 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2505/5271] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:46 2022] GET /compute/v2.1/servers/f5e1c62b-88b7-4ec7-a2f3-b99b1566baab => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:53:50.888875 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-63084e72-5212-46b5-b41b-d5c335e23bb0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:50.889431 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-63084e72-5212-46b5-b41b-d5c335e23bb0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:50.904337 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63084e72-5212-46b5-b41b-d5c335e23bb0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:50.905177 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63084e72-5212-46b5-b41b-d5c335e23bb0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:50.908793 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63084e72-5212-46b5-b41b-d5c335e23bb0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:50.911194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63084e72-5212-46b5-b41b-d5c335e23bb0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:50.958063 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-63084e72-5212-46b5-b41b-d5c335e23bb0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] HTTP exception thrown: Instance 5d038cc3-67d7-4ac0-93bd-e668700cd3b4 could not be found. Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-63084e72-5212-46b5-b41b-d5c335e23bb0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Request method failure captured: Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4 HTTP/1.1 Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qxVTVC8FUnn-t2qK29pQ6gpvvVkF5Cd1ek9O6-ax9bIU4h-Acw7IM2XyPTWfCK6LWhHPoO7fpkEcbhitPiuVrA5WlFZ0WfmMB-2I-MAtgO20bt12dRN-m_gApdOXiuB_IoQnmtlPGVQzahhzXBQE11eo5L_JzE39RyLIYMYF8wTD50 Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 325aff76e61141a985b3b0f45521444f Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/325aff76e61141a985b3b0f45521444f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/325aff76e61141a985b3b0f45521444f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_325aff76e61141a985b3b0f45521444f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/325aff76e61141a985b3b0f45521444f"}]}] Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 325aff76e61141a985b3b0f45521444f Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-AttachVolumeNegativeTest-1959370092-project Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 571a2d92d7a34f86bb3c0bfdfcabc5ff Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-AttachVolumeNegativeTest-1959370092-project Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 5d038cc3-67d7-4ac0-93bd-e668700cd3b4 could not be found. Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '5d038cc3-67d7-4ac0-93bd-e668700cd3b4'} Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d038cc3-67d7-4ac0-93bd-e668700cd3b4 could not be found. Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:53:50.968036 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:53:50.975522 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d038cc3-67d7-4ac0-93bd-e668700cd3b4 could not be found. Jul 25 14:53:50.975522 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:53:50.975522 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:53:50.975522 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:53:50.975522 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:53:50.975522 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:53:50.975522 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:53:50.975522 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:53:50.975522 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:53:50.975522 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d038cc3-67d7-4ac0-93bd-e668700cd3b4 could not be found. Jul 25 14:53:50.975522 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:53:50.977883 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-63084e72-5212-46b5-b41b-d5c335e23bb0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Returning 404 to user: Instance 5d038cc3-67d7-4ac0-93bd-e668700cd3b4 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:53:50.978774 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-63084e72-5212-46b5-b41b-d5c335e23bb0 tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "DELETE /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4" status: 404 len: 111 microversion: 2.1 time: 0.094256 Jul 25 14:53:50.979678 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2767/5272] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:53:50 2022] DELETE /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:53:50.996995 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-17a7f2b1-b90e-4bd1-8ed2-420fdd97e4ea tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:50.998478 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-17a7f2b1-b90e-4bd1-8ed2-420fdd97e4ea tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] [instance: 5d038cc3-67d7-4ac0-93bd-e668700cd3b4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:51.022655 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-17a7f2b1-b90e-4bd1-8ed2-420fdd97e4ea tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:51.024792 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-17a7f2b1-b90e-4bd1-8ed2-420fdd97e4ea tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:51.025848 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-17a7f2b1-b90e-4bd1-8ed2-420fdd97e4ea tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:51.026459 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-17a7f2b1-b90e-4bd1-8ed2-420fdd97e4ea tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:51.069805 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-17a7f2b1-b90e-4bd1-8ed2-420fdd97e4ea tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] HTTP exception thrown: Instance 5d038cc3-67d7-4ac0-93bd-e668700cd3b4 could not be found. Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-17a7f2b1-b90e-4bd1-8ed2-420fdd97e4ea tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Request method failure captured: Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4 HTTP/1.1 Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qxVTVC8FUnn-t2qK29pQ6gpvvVkF5Cd1ek9O6-ax9bIU4h-Acw7IM2XyPTWfCK6LWhHPoO7fpkEcbhitPiuVrA5WlFZ0WfmMB-2I-MAtgO20bt12dRN-m_gApdOXiuB_IoQnmtlPGVQzahhzXBQE11eo5L_JzE39RyLIYMYF8wTD50 Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 325aff76e61141a985b3b0f45521444f Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/325aff76e61141a985b3b0f45521444f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/325aff76e61141a985b3b0f45521444f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_325aff76e61141a985b3b0f45521444f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/325aff76e61141a985b3b0f45521444f"}]}] Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 325aff76e61141a985b3b0f45521444f Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1959370092 Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-AttachVolumeNegativeTest-1959370092-project Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 571a2d92d7a34f86bb3c0bfdfcabc5ff Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-AttachVolumeNegativeTest-1959370092-project Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 5d038cc3-67d7-4ac0-93bd-e668700cd3b4 could not be found. Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '5d038cc3-67d7-4ac0-93bd-e668700cd3b4'} Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d038cc3-67d7-4ac0-93bd-e668700cd3b4 could not be found. Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d038cc3-67d7-4ac0-93bd-e668700cd3b4 could not be found. Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:53:51.074167 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:53:51.079830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:53:51.079830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:53:51.079830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:53:51.079830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:53:51.079830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:53:51.079830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d038cc3-67d7-4ac0-93bd-e668700cd3b4 could not be found. Jul 25 14:53:51.079830 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:53:51.082315 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-17a7f2b1-b90e-4bd1-8ed2-420fdd97e4ea tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] Returning 404 to user: Instance 5d038cc3-67d7-4ac0-93bd-e668700cd3b4 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:53:51.085708 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-17a7f2b1-b90e-4bd1-8ed2-420fdd97e4ea tempest-AttachVolumeNegativeTest-1959370092 tempest-AttachVolumeNegativeTest-1959370092-project] 10.222.0.88 "GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4" status: 404 len: 111 microversion: 2.1 time: 0.099626 Jul 25 14:53:51.086436 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2506/5273] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:53:50 2022] GET /compute/v2.1/servers/5d038cc3-67d7-4ac0-93bd-e668700cd3b4 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:53:58.183632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c1170426-7960-4d4c-935d-97eac3cff102 tempest-PortsAdminExtendedAttrsIpV6TestJSON-619242354 tempest-PortsAdminExtendedAttrsIpV6TestJSON-619242354-project-admin] Calling method '.version_select at 0x7f4686146820>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:58.185961 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 14:53:58.185961 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 14:53:58.187763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c1170426-7960-4d4c-935d-97eac3cff102 tempest-PortsAdminExtendedAttrsIpV6TestJSON-619242354 tempest-PortsAdminExtendedAttrsIpV6TestJSON-619242354-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:58.188534 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c1170426-7960-4d4c-935d-97eac3cff102 tempest-PortsAdminExtendedAttrsIpV6TestJSON-619242354 tempest-PortsAdminExtendedAttrsIpV6TestJSON-619242354-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:58.193233 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:53:58.238530 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:53:58.242661 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c1170426-7960-4d4c-935d-97eac3cff102 tempest-PortsAdminExtendedAttrsIpV6TestJSON-619242354 tempest-PortsAdminExtendedAttrsIpV6TestJSON-619242354-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:58.243559 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c1170426-7960-4d4c-935d-97eac3cff102 tempest-PortsAdminExtendedAttrsIpV6TestJSON-619242354 tempest-PortsAdminExtendedAttrsIpV6TestJSON-619242354-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:58.267329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c1170426-7960-4d4c-935d-97eac3cff102 tempest-PortsAdminExtendedAttrsIpV6TestJSON-619242354 tempest-PortsAdminExtendedAttrsIpV6TestJSON-619242354-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:58.268692 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c1170426-7960-4d4c-935d-97eac3cff102 tempest-PortsAdminExtendedAttrsIpV6TestJSON-619242354 tempest-PortsAdminExtendedAttrsIpV6TestJSON-619242354-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:58.290143 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c1170426-7960-4d4c-935d-97eac3cff102 tempest-PortsAdminExtendedAttrsIpV6TestJSON-619242354 tempest-PortsAdminExtendedAttrsIpV6TestJSON-619242354-project-admin] 10.222.0.88 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.337742 Jul 25 14:53:58.291047 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2768/5274] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 14:53:57 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:53:58.901139 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c64277a5-d464-4470-8f35-38510e777ec5 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:58.901775 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c64277a5-d464-4470-8f35-38510e777ec5 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:58.918266 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c64277a5-d464-4470-8f35-38510e777ec5 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:58.923518 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c64277a5-d464-4470-8f35-38510e777ec5 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:58.924893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c64277a5-d464-4470-8f35-38510e777ec5 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:58.925516 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c64277a5-d464-4470-8f35-38510e777ec5 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:58.984265 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c64277a5-d464-4470-8f35-38510e777ec5 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:53:59.181299 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c64277a5-d464-4470-8f35-38510e777ec5 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "DELETE /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 204 len: 0 microversion: 2.32 time: 0.545692 Jul 25 14:53:59.182490 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2507/5275] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Jul 25 14:53:58 2022] DELETE /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 14:53:59.191923 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-16c44426-1dcd-4019-9c81-37d0d51fffb7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:53:59.192647 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-16c44426-1dcd-4019-9c81-37d0d51fffb7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:59.213808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-16c44426-1dcd-4019-9c81-37d0d51fffb7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:59.216322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-16c44426-1dcd-4019-9c81-37d0d51fffb7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:59.217394 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-16c44426-1dcd-4019-9c81-37d0d51fffb7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:59.218638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-16c44426-1dcd-4019-9c81-37d0d51fffb7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:59.316068 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-98e3db92-013f-47ec-8818-cd98dd70aa3c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:53:59.319891 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-98e3db92-013f-47ec-8818-cd98dd70aa3c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:53:59.359950 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-98e3db92-013f-47ec-8818-cd98dd70aa3c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:59.361194 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-98e3db92-013f-47ec-8818-cd98dd70aa3c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:59.362278 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-98e3db92-013f-47ec-8818-cd98dd70aa3c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:53:59.362871 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-98e3db92-013f-47ec-8818-cd98dd70aa3c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:53:59.472961 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-98e3db92-013f-47ec-8818-cd98dd70aa3c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "POST /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d/action" status: 200 len: 24573 microversion: 2.1 time: 0.166988 Jul 25 14:53:59.474271 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2508/5276] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:53:59 2022] POST /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d/action => generated 24573 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:53:59.837900 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-16c44426-1dcd-4019-9c81-37d0d51fffb7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:53:59.879106 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-16c44426-1dcd-4019-9c81-37d0d51fffb7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:53:59.880806 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-16c44426-1dcd-4019-9c81-37d0d51fffb7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:53:59.882138 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-16c44426-1dcd-4019-9c81-37d0d51fffb7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 2951 microversion: 2.32 time: 0.695569 Jul 25 14:53:59.882758 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2769/5277] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:53:59 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 2951 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:54:00.911832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-608428b5-c7e0-4460-a818-0c9354e81118 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:00.916572 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-608428b5-c7e0-4460-a818-0c9354e81118 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:00.935024 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-608428b5-c7e0-4460-a818-0c9354e81118 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:00.935721 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-608428b5-c7e0-4460-a818-0c9354e81118 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:00.936712 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-608428b5-c7e0-4460-a818-0c9354e81118 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:00.938127 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-608428b5-c7e0-4460-a818-0c9354e81118 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:01.421165 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-608428b5-c7e0-4460-a818-0c9354e81118 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:01.433970 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-608428b5-c7e0-4460-a818-0c9354e81118 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:01.435610 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-608428b5-c7e0-4460-a818-0c9354e81118 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:01.440862 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-608428b5-c7e0-4460-a818-0c9354e81118 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 2951 microversion: 2.32 time: 0.533919 Jul 25 14:54:01.444107 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2509/5278] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:54:00 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 2951 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:54:02.467348 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-150fec14-c26d-4378-bb26-2b4cc8ddf7de tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:02.469254 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-150fec14-c26d-4378-bb26-2b4cc8ddf7de tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:02.483504 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-150fec14-c26d-4378-bb26-2b4cc8ddf7de tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:02.484288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-150fec14-c26d-4378-bb26-2b4cc8ddf7de tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:02.487013 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-150fec14-c26d-4378-bb26-2b4cc8ddf7de tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:02.489822 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-150fec14-c26d-4378-bb26-2b4cc8ddf7de tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:03.234090 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-150fec14-c26d-4378-bb26-2b4cc8ddf7de tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:03.244563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-150fec14-c26d-4378-bb26-2b4cc8ddf7de tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:03.252429 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-150fec14-c26d-4378-bb26-2b4cc8ddf7de tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:03.254106 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-150fec14-c26d-4378-bb26-2b4cc8ddf7de tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 2930 microversion: 2.32 time: 0.791150 Jul 25 14:54:03.256169 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2770/5279] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:54:02 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 2930 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:54:03.453843 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-474cb3c4-87ca-4182-8262-a3bc00c34c3e req-2b84d8e8-d298-4609-852f-7f998bc44675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50f3696b-0e20-4fc7-9bd0-3955357f2b09", "name": "network-vif-unplugged", "status": "completed", "tag": "53062311-961a-458b-9f1e-309c2f468465"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:54:03.468575 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-474cb3c4-87ca-4182-8262-a3bc00c34c3e req-2b84d8e8-d298-4609-852f-7f998bc44675 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:03.469108 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-474cb3c4-87ca-4182-8262-a3bc00c34c3e req-2b84d8e8-d298-4609-852f-7f998bc44675 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:03.485403 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-474cb3c4-87ca-4182-8262-a3bc00c34c3e req-2b84d8e8-d298-4609-852f-7f998bc44675 service nova] Creating event network-vif-unplugged:53062311-961a-458b-9f1e-309c2f468465 for instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 on n-h1-846435-14 Jul 25 14:54:03.492610 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-474cb3c4-87ca-4182-8262-a3bc00c34c3e req-2b84d8e8-d298-4609-852f-7f998bc44675 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051539 Jul 25 14:54:03.494586 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2510/5280] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:54:04.008407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d01ec558-7901-43e5-b12a-21aaf4851c79 tempest-VolumesTestJSON-1589931742 tempest-VolumesTestJSON-1589931742-project] Calling method '.version_select at 0x7f4687624700>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:04.119042 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d01ec558-7901-43e5-b12a-21aaf4851c79 tempest-VolumesTestJSON-1589931742 tempest-VolumesTestJSON-1589931742-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/fbe22c91-8592-4af9-b903-75cbe10330ab" status: 200 len: 350 microversion: 2.1 time: 0.114515 Jul 25 14:54:04.120259 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2771/5281] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Jul 25 14:54:04 2022] GET /compute/v2.1/os-volumes/fbe22c91-8592-4af9-b903-75cbe10330ab => generated 350 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:54:04.286185 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0898bdb1-a377-4a0f-88c3-684cc924f064 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:04.286971 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0898bdb1-a377-4a0f-88c3-684cc924f064 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:04.290472 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:54:04.306098 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0898bdb1-a377-4a0f-88c3-684cc924f064 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:04.308626 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0898bdb1-a377-4a0f-88c3-684cc924f064 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:04.309135 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0898bdb1-a377-4a0f-88c3-684cc924f064 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:04.309893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0898bdb1-a377-4a0f-88c3-684cc924f064 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:05.043162 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0898bdb1-a377-4a0f-88c3-684cc924f064 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:05.053190 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:54:05.075027 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0898bdb1-a377-4a0f-88c3-684cc924f064 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:05.090483 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0898bdb1-a377-4a0f-88c3-684cc924f064 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:05.101073 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0898bdb1-a377-4a0f-88c3-684cc924f064 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 2909 microversion: 2.32 time: 0.819580 Jul 25 14:54:05.103315 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2511/5282] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:54:04 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 2909 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:54:05.542015 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-c8b82025-ff9f-4e02-9823-826133906753 req-112204d5-28c4-401f-acf6-7dc8822c1269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50f3696b-0e20-4fc7-9bd0-3955357f2b09", "name": "network-vif-unplugged", "status": "completed", "tag": "4bc5802b-3581-47f4-b3fd-3ec9db912406"}, {"server_uuid": "50f3696b-0e20-4fc7-9bd0-3955357f2b09", "name": "network-vif-unplugged", "status": "completed", "tag": "2faa258c-a4e9-4d6b-8205-234eebed8d96"}, {"server_uuid": "50f3696b-0e20-4fc7-9bd0-3955357f2b09", "name": "network-vif-unplugged", "status": "completed", "tag": "ee179acc-1c8f-4d3d-b7a4-b3147e289771"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:54:05.585933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c8b82025-ff9f-4e02-9823-826133906753 req-112204d5-28c4-401f-acf6-7dc8822c1269 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:05.588460 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c8b82025-ff9f-4e02-9823-826133906753 req-112204d5-28c4-401f-acf6-7dc8822c1269 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:05.601942 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-c8b82025-ff9f-4e02-9823-826133906753 req-112204d5-28c4-401f-acf6-7dc8822c1269 service nova] Creating event network-vif-unplugged:4bc5802b-3581-47f4-b3fd-3ec9db912406 for instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 on n-h1-846435-14 Jul 25 14:54:05.607787 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-c8b82025-ff9f-4e02-9823-826133906753 req-112204d5-28c4-401f-acf6-7dc8822c1269 service nova] Creating event network-vif-unplugged:2faa258c-a4e9-4d6b-8205-234eebed8d96 for instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 on n-h1-846435-14 Jul 25 14:54:05.608754 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-c8b82025-ff9f-4e02-9823-826133906753 req-112204d5-28c4-401f-acf6-7dc8822c1269 service nova] Creating event network-vif-unplugged:ee179acc-1c8f-4d3d-b7a4-b3147e289771 for instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 on n-h1-846435-14 Jul 25 14:54:05.616194 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-c8b82025-ff9f-4e02-9823-826133906753 req-112204d5-28c4-401f-acf6-7dc8822c1269 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.078770 Jul 25 14:54:05.624287 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2772/5283] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:54:05.742136 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-17c7bf79-40ab-40b1-b4dc-63a2e549ddb1 req-7d8358fc-1e08-417f-a7db-ea355bd2fd02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50f3696b-0e20-4fc7-9bd0-3955357f2b09", "name": "network-vif-deleted", "tag": "8e48e753-58f9-4d03-a879-346119141e40"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:54:05.758504 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-17c7bf79-40ab-40b1-b4dc-63a2e549ddb1 req-7d8358fc-1e08-417f-a7db-ea355bd2fd02 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:05.759152 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-17c7bf79-40ab-40b1-b4dc-63a2e549ddb1 req-7d8358fc-1e08-417f-a7db-ea355bd2fd02 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:05.772966 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-17c7bf79-40ab-40b1-b4dc-63a2e549ddb1 req-7d8358fc-1e08-417f-a7db-ea355bd2fd02 service nova] Creating event network-vif-deleted:8e48e753-58f9-4d03-a879-346119141e40 for instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 on n-h1-846435-14 Jul 25 14:54:05.779757 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-17c7bf79-40ab-40b1-b4dc-63a2e549ddb1 req-7d8358fc-1e08-417f-a7db-ea355bd2fd02 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045415 Jul 25 14:54:05.780691 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2512/5284] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:54:05.838239 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-47e0781d-8c8c-41eb-be23-834f8a08aca6 tempest-VolumesTestJSON-1589931742 tempest-VolumesTestJSON-1589931742-project] Calling method '.version_select at 0x7f4687624820>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:05.850718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2314f88d-e956-4a81-8d35-3fcafe0de2c7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:05.852425 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2314f88d-e956-4a81-8d35-3fcafe0de2c7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:05.862667 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2314f88d-e956-4a81-8d35-3fcafe0de2c7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:05.867260 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2314f88d-e956-4a81-8d35-3fcafe0de2c7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:05.868435 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2314f88d-e956-4a81-8d35-3fcafe0de2c7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:05.869079 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2314f88d-e956-4a81-8d35-3fcafe0de2c7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:05.940349 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-47e0781d-8c8c-41eb-be23-834f8a08aca6 tempest-VolumesTestJSON-1589931742 tempest-VolumesTestJSON-1589931742-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/8cfa784c-a02e-430c-8731-00e44bbeb92e" status: 200 len: 350 microversion: 2.1 time: 0.107425 Jul 25 14:54:05.941473 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2773/5285] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Jul 25 14:54:05 2022] GET /compute/v2.1/os-volumes/8cfa784c-a02e-430c-8731-00e44bbeb92e => generated 350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:54:06.128905 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d93d8447-806d-4b5e-8b59-e53ef570a36f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:06.130491 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d93d8447-806d-4b5e-8b59-e53ef570a36f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:06.149563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d93d8447-806d-4b5e-8b59-e53ef570a36f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:06.151407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d93d8447-806d-4b5e-8b59-e53ef570a36f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:06.154904 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d93d8447-806d-4b5e-8b59-e53ef570a36f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:06.155787 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d93d8447-806d-4b5e-8b59-e53ef570a36f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:06.332089 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2314f88d-e956-4a81-8d35-3fcafe0de2c7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:06.345766 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2314f88d-e956-4a81-8d35-3fcafe0de2c7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.499682 Jul 25 14:54:06.346402 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2513/5286] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:54:05 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:54:06.370694 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8d2d07e1-517d-4557-be55-6e142e3134ca tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:06.371309 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8d2d07e1-517d-4557-be55-6e142e3134ca tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:06.396508 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8d2d07e1-517d-4557-be55-6e142e3134ca tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:06.397385 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8d2d07e1-517d-4557-be55-6e142e3134ca tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:06.399188 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8d2d07e1-517d-4557-be55-6e142e3134ca tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:06.401276 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8d2d07e1-517d-4557-be55-6e142e3134ca tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:06.615687 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d93d8447-806d-4b5e-8b59-e53ef570a36f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:06.625972 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d93d8447-806d-4b5e-8b59-e53ef570a36f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:06.627960 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d93d8447-806d-4b5e-8b59-e53ef570a36f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:06.629472 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d93d8447-806d-4b5e-8b59-e53ef570a36f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 2577 microversion: 2.32 time: 0.506734 Jul 25 14:54:06.630750 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2774/5287] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:54:06 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 2577 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 14:54:06.749097 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8d2d07e1-517d-4557-be55-6e142e3134ca tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:06.763404 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8d2d07e1-517d-4557-be55-6e142e3134ca tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.397856 Jul 25 14:54:06.776013 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2514/5288] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:54:06 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:54:06.786953 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cec06f4d-08b4-4330-b679-b211d32511e1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:06.788417 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cec06f4d-08b4-4330-b679-b211d32511e1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:06.801589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cec06f4d-08b4-4330-b679-b211d32511e1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:06.802242 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cec06f4d-08b4-4330-b679-b211d32511e1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:06.803275 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cec06f4d-08b4-4330-b679-b211d32511e1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:06.803869 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cec06f4d-08b4-4330-b679-b211d32511e1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:07.212391 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cec06f4d-08b4-4330-b679-b211d32511e1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:07.221555 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cec06f4d-08b4-4330-b679-b211d32511e1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.439390 Jul 25 14:54:07.226148 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2775/5289] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:54:06 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:54:07.246367 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e2c341c8-2100-4264-8c0f-a7f3c412abcc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-598513624"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:54:07.248949 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e2c341c8-2100-4264-8c0f-a7f3c412abcc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:07.257073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e2c341c8-2100-4264-8c0f-a7f3c412abcc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:07.257770 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e2c341c8-2100-4264-8c0f-a7f3c412abcc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:07.258745 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e2c341c8-2100-4264-8c0f-a7f3c412abcc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:07.259335 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e2c341c8-2100-4264-8c0f-a7f3c412abcc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:07.657036 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-12f8544e-a1b1-4500-b11e-8ab8298d501f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:07.658237 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-12f8544e-a1b1-4500-b11e-8ab8298d501f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:07.676322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-12f8544e-a1b1-4500-b11e-8ab8298d501f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:07.676997 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-12f8544e-a1b1-4500-b11e-8ab8298d501f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:07.678200 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-12f8544e-a1b1-4500-b11e-8ab8298d501f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:07.678805 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-12f8544e-a1b1-4500-b11e-8ab8298d501f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:07.833409 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e2c341c8-2100-4264-8c0f-a7f3c412abcc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action" status: 202 len: 0 microversion: 2.1 time: 0.587420 Jul 25 14:54:07.837262 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2515/5290] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:54:07 2022] POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action => generated 0 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 25 14:54:07.896426 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-62b9faca-3f10-4bb5-8a25-49c220accf52 req-03b19d14-6c4f-4eee-9918-61602e210f9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50f3696b-0e20-4fc7-9bd0-3955357f2b09", "name": "network-vif-deleted", "tag": "4bc5802b-3581-47f4-b3fd-3ec9db912406"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:54:07.942472 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-62b9faca-3f10-4bb5-8a25-49c220accf52 req-03b19d14-6c4f-4eee-9918-61602e210f9e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:07.948721 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-62b9faca-3f10-4bb5-8a25-49c220accf52 req-03b19d14-6c4f-4eee-9918-61602e210f9e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:07.971275 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-62b9faca-3f10-4bb5-8a25-49c220accf52 req-03b19d14-6c4f-4eee-9918-61602e210f9e service nova] Creating event network-vif-deleted:4bc5802b-3581-47f4-b3fd-3ec9db912406 for instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 on n-h1-846435-14 Jul 25 14:54:08.008681 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-62b9faca-3f10-4bb5-8a25-49c220accf52 req-03b19d14-6c4f-4eee-9918-61602e210f9e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113876 Jul 25 14:54:08.011190 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2516/5291] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:54:08.142172 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-12f8544e-a1b1-4500-b11e-8ab8298d501f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:08.168292 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-12f8544e-a1b1-4500-b11e-8ab8298d501f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:08.184433 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-12f8544e-a1b1-4500-b11e-8ab8298d501f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:08.186078 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-12f8544e-a1b1-4500-b11e-8ab8298d501f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 2483 microversion: 2.32 time: 0.533204 Jul 25 14:54:08.187182 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2776/5292] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:54:07 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 2483 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:54:08.581835 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d3fcce2f-a7b6-4749-973e-0d82311a2e60 tempest-VolumesTestJSON-1589931742 tempest-VolumesTestJSON-1589931742-project] Calling method '.version_select at 0x7f468678de50>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:08.696277 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d3fcce2f-a7b6-4749-973e-0d82311a2e60 tempest-VolumesTestJSON-1589931742 tempest-VolumesTestJSON-1589931742-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/367e322d-fc13-48d8-8119-d7ac939bae30" status: 200 len: 351 microversion: 2.1 time: 0.118679 Jul 25 14:54:08.705412 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2517/5293] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Jul 25 14:54:08 2022] GET /compute/v2.1/os-volumes/367e322d-fc13-48d8-8119-d7ac939bae30 => generated 351 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:54:08.719403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-19635e77-654e-4c95-b79c-bb9fc592ec63 tempest-VolumesTestJSON-1589931742 tempest-VolumesTestJSON-1589931742-project] Calling method '.version_select at 0x7f4686176b80>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:08.882542 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-19635e77-654e-4c95-b79c-bb9fc592ec63 tempest-VolumesTestJSON-1589931742 tempest-VolumesTestJSON-1589931742-project] 10.222.0.88 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.174523 Jul 25 14:54:08.883116 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2777/5294] 10.222.0.88 () {58 vars in 1134 bytes} [Mon Jul 25 14:54:08 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:54:08.904119 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d8001e6d-e95d-4208-a47b-4fade4db14fb tempest-VolumesTestJSON-1589931742 tempest-VolumesTestJSON-1589931742-project] Calling method '.version_select at 0x7f4686798af0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:09.043240 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d8001e6d-e95d-4208-a47b-4fade4db14fb tempest-VolumesTestJSON-1589931742 tempest-VolumesTestJSON-1589931742-project] 10.222.0.88 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.150510 Jul 25 14:54:09.043818 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2518/5295] 10.222.0.88 () {58 vars in 1149 bytes} [Mon Jul 25 14:54:08 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:54:09.057602 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bcbc9d37-6197-448a-9a74-3442b6029b38 tempest-VolumesTestJSON-1589931742 tempest-VolumesTestJSON-1589931742-project] Calling method '.version_select at 0x7f4686146820>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:09.209728 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bcbc9d37-6197-448a-9a74-3442b6029b38 tempest-VolumesTestJSON-1589931742 tempest-VolumesTestJSON-1589931742-project] 10.222.0.88 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.156353 Jul 25 14:54:09.210557 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2778/5296] 10.222.0.88 () {58 vars in 1134 bytes} [Mon Jul 25 14:54:09 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:54:09.213931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bc202a34-6fe1-4833-8672-b5a880a65db6 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:09.214781 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bc202a34-6fe1-4833-8672-b5a880a65db6 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:09.224437 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ab0cca3f-9932-42ca-9cdc-2e852cd57ad1 tempest-VolumesTestJSON-1589931742 tempest-VolumesTestJSON-1589931742-project] Calling method '.version_select at 0x7f468618adc0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:09.236286 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bc202a34-6fe1-4833-8672-b5a880a65db6 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:09.238619 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bc202a34-6fe1-4833-8672-b5a880a65db6 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:09.239443 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bc202a34-6fe1-4833-8672-b5a880a65db6 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:09.239944 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bc202a34-6fe1-4833-8672-b5a880a65db6 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:09.357046 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ab0cca3f-9932-42ca-9cdc-2e852cd57ad1 tempest-VolumesTestJSON-1589931742 tempest-VolumesTestJSON-1589931742-project] 10.222.0.88 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.137004 Jul 25 14:54:09.358145 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2779/5297] 10.222.0.88 () {58 vars in 1167 bytes} [Mon Jul 25 14:54:09 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:54:09.371403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9c15abf4-ea3f-4675-ab01-6ff3873e6417 tempest-VolumesTestJSON-1589931742 tempest-VolumesTestJSON-1589931742-project] Calling method '.version_select at 0x7f4687624d30>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:09.476703 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9c15abf4-ea3f-4675-ab01-6ff3873e6417 tempest-VolumesTestJSON-1589931742 tempest-VolumesTestJSON-1589931742-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.109185 Jul 25 14:54:09.477825 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2780/5298] 10.222.0.88 () {58 vars in 1170 bytes} [Mon Jul 25 14:54:09 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:54:09.491023 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e307a19f-e43a-479d-8253-41b7cf37314f tempest-VolumesTestJSON-1589931742 tempest-VolumesTestJSON-1589931742-project] Calling method '.version_select at 0x7f46860e1670>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:09.548594 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bc202a34-6fe1-4833-8672-b5a880a65db6 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:09.560272 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bc202a34-6fe1-4833-8672-b5a880a65db6 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:09.564536 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bc202a34-6fe1-4833-8672-b5a880a65db6 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:09.572955 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bc202a34-6fe1-4833-8672-b5a880a65db6 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 2323 microversion: 2.32 time: 0.365918 Jul 25 14:54:09.575502 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2519/5299] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:54:09 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 2323 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:54:09.612768 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e307a19f-e43a-479d-8253-41b7cf37314f tempest-VolumesTestJSON-1589931742 tempest-VolumesTestJSON-1589931742-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.125699 Jul 25 14:54:09.613842 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2781/5300] 10.222.0.88 () {58 vars in 1155 bytes} [Mon Jul 25 14:54:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:54:09.627536 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ecb81d0c-1e8a-4bd3-bf28-59a34772012e tempest-VolumesTestJSON-1589931742 tempest-VolumesTestJSON-1589931742-project] Calling method '.version_select at 0x7f46867bce50>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:09.743730 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ecb81d0c-1e8a-4bd3-bf28-59a34772012e tempest-VolumesTestJSON-1589931742 tempest-VolumesTestJSON-1589931742-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.120384 Jul 25 14:54:09.744853 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2520/5301] 10.222.0.88 () {58 vars in 1188 bytes} [Mon Jul 25 14:54:09 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:54:09.757435 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-241c2e31-7d47-4cf9-bd35-1d09ec7021e8 tempest-VolumesTestJSON-1589931742 tempest-VolumesTestJSON-1589931742-project] Calling method '.version_select at 0x7f4686176b80>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:09.890020 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-241c2e31-7d47-4cf9-bd35-1d09ec7021e8 tempest-VolumesTestJSON-1589931742 tempest-VolumesTestJSON-1589931742-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.136410 Jul 25 14:54:09.890677 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2782/5302] 10.222.0.88 () {58 vars in 1155 bytes} [Mon Jul 25 14:54:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:54:10.045223 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-c23c22a4-2deb-4733-9953-5e5ba15d8592 req-3efd82ec-ee3b-4e58-b5ff-f66e2754ea34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50f3696b-0e20-4fc7-9bd0-3955357f2b09", "name": "network-vif-deleted", "tag": "2faa258c-a4e9-4d6b-8205-234eebed8d96"}, {"server_uuid": "50f3696b-0e20-4fc7-9bd0-3955357f2b09", "name": "network-vif-deleted", "tag": "53062311-961a-458b-9f1e-309c2f468465"}, {"server_uuid": "50f3696b-0e20-4fc7-9bd0-3955357f2b09", "name": "network-vif-deleted", "tag": "ee179acc-1c8f-4d3d-b7a4-b3147e289771"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:54:10.069187 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c23c22a4-2deb-4733-9953-5e5ba15d8592 req-3efd82ec-ee3b-4e58-b5ff-f66e2754ea34 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:10.069643 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c23c22a4-2deb-4733-9953-5e5ba15d8592 req-3efd82ec-ee3b-4e58-b5ff-f66e2754ea34 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:10.087814 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-c23c22a4-2deb-4733-9953-5e5ba15d8592 req-3efd82ec-ee3b-4e58-b5ff-f66e2754ea34 service nova] Creating event network-vif-deleted:2faa258c-a4e9-4d6b-8205-234eebed8d96 for instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 on n-h1-846435-14 Jul 25 14:54:10.100009 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-c23c22a4-2deb-4733-9953-5e5ba15d8592 req-3efd82ec-ee3b-4e58-b5ff-f66e2754ea34 service nova] Creating event network-vif-deleted:53062311-961a-458b-9f1e-309c2f468465 for instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 on n-h1-846435-14 Jul 25 14:54:10.100803 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-c23c22a4-2deb-4733-9953-5e5ba15d8592 req-3efd82ec-ee3b-4e58-b5ff-f66e2754ea34 service nova] Creating event network-vif-deleted:ee179acc-1c8f-4d3d-b7a4-b3147e289771 for instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 on n-h1-846435-14 Jul 25 14:54:10.113513 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-c23c22a4-2deb-4733-9953-5e5ba15d8592 req-3efd82ec-ee3b-4e58-b5ff-f66e2754ea34 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.072794 Jul 25 14:54:10.114173 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2521/5303] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:54:10.604935 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-400838d0-12ce-4a61-8b80-789d7bb18839 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:10.606317 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-400838d0-12ce-4a61-8b80-789d7bb18839 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:10.620989 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-400838d0-12ce-4a61-8b80-789d7bb18839 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:10.623137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-400838d0-12ce-4a61-8b80-789d7bb18839 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:10.625738 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-400838d0-12ce-4a61-8b80-789d7bb18839 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:10.628145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-400838d0-12ce-4a61-8b80-789d7bb18839 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:10.856997 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-400838d0-12ce-4a61-8b80-789d7bb18839 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:10.872682 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-400838d0-12ce-4a61-8b80-789d7bb18839 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:10.875529 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-400838d0-12ce-4a61-8b80-789d7bb18839 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:10.880593 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-400838d0-12ce-4a61-8b80-789d7bb18839 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1603 microversion: 2.32 time: 0.281240 Jul 25 14:54:10.881194 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2783/5304] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:54:10 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1603 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:54:11.913211 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-baaa5827-b54e-4a6f-9922-4c3411d89ace tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:11.915289 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-baaa5827-b54e-4a6f-9922-4c3411d89ace tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:11.944837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-baaa5827-b54e-4a6f-9922-4c3411d89ace tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:11.945502 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-baaa5827-b54e-4a6f-9922-4c3411d89ace tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:11.946904 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-baaa5827-b54e-4a6f-9922-4c3411d89ace tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:11.948498 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-baaa5827-b54e-4a6f-9922-4c3411d89ace tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:12.165613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-baaa5827-b54e-4a6f-9922-4c3411d89ace tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:12.177567 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-baaa5827-b54e-4a6f-9922-4c3411d89ace tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:12.179608 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-baaa5827-b54e-4a6f-9922-4c3411d89ace tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:12.182880 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-baaa5827-b54e-4a6f-9922-4c3411d89ace tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1603 microversion: 2.32 time: 0.278971 Jul 25 14:54:12.184521 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2522/5305] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:54:11 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1603 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:54:13.209212 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4e26f797-14fd-48a5-aa21-7fba1a8b6fdd tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:13.209883 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4e26f797-14fd-48a5-aa21-7fba1a8b6fdd tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:13.221118 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e26f797-14fd-48a5-aa21-7fba1a8b6fdd tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:13.230838 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e26f797-14fd-48a5-aa21-7fba1a8b6fdd tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:13.234337 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e26f797-14fd-48a5-aa21-7fba1a8b6fdd tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:13.234952 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e26f797-14fd-48a5-aa21-7fba1a8b6fdd tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:13.408967 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4e26f797-14fd-48a5-aa21-7fba1a8b6fdd tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:13.425748 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4e26f797-14fd-48a5-aa21-7fba1a8b6fdd tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:13.449677 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4e26f797-14fd-48a5-aa21-7fba1a8b6fdd tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:13.452354 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4e26f797-14fd-48a5-aa21-7fba1a8b6fdd tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1603 microversion: 2.32 time: 0.247641 Jul 25 14:54:13.463625 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2784/5306] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:54:13 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1603 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:54:14.480307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-95758490-8b05-48aa-b9e6-5fbb6d7251ec tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:14.481172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-95758490-8b05-48aa-b9e6-5fbb6d7251ec tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:14.495549 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-95758490-8b05-48aa-b9e6-5fbb6d7251ec tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:14.496397 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-95758490-8b05-48aa-b9e6-5fbb6d7251ec tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:14.501352 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-95758490-8b05-48aa-b9e6-5fbb6d7251ec tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:14.505807 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-95758490-8b05-48aa-b9e6-5fbb6d7251ec tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:14.700547 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-95758490-8b05-48aa-b9e6-5fbb6d7251ec tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:14.716866 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-95758490-8b05-48aa-b9e6-5fbb6d7251ec tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:14.718488 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-95758490-8b05-48aa-b9e6-5fbb6d7251ec tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:14.720001 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-95758490-8b05-48aa-b9e6-5fbb6d7251ec tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1603 microversion: 2.32 time: 0.244066 Jul 25 14:54:14.725471 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2523/5307] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:54:14 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1603 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:54:15.562618 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-e61c6b67-4ad0-4d14-b59b-b590cdc9c5e7 req-4f3cc7b8-22ad-4207-98ef-b7c259817055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e054ea1-6a81-43c7-9746-25b466d4647b", "name": "network-vif-plugged", "status": "completed", "tag": "24859a24-8dd1-490f-b1c7-01178f7f59b2"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:54:15.590286 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-e61c6b67-4ad0-4d14-b59b-b590cdc9c5e7 req-4f3cc7b8-22ad-4207-98ef-b7c259817055 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:15.590982 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-e61c6b67-4ad0-4d14-b59b-b590cdc9c5e7 req-4f3cc7b8-22ad-4207-98ef-b7c259817055 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:15.616645 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-e61c6b67-4ad0-4d14-b59b-b590cdc9c5e7 req-4f3cc7b8-22ad-4207-98ef-b7c259817055 service nova] Creating event network-vif-plugged:24859a24-8dd1-490f-b1c7-01178f7f59b2 for instance 9e054ea1-6a81-43c7-9746-25b466d4647b on n-h2-846435-14 Jul 25 14:54:15.629848 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-e61c6b67-4ad0-4d14-b59b-b590cdc9c5e7 req-4f3cc7b8-22ad-4207-98ef-b7c259817055 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070808 Jul 25 14:54:15.631744 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2785/5308] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:54:15.749824 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b7b20dc1-2758-487e-87d3-8d0fd7cfcf57 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:15.751021 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b7b20dc1-2758-487e-87d3-8d0fd7cfcf57 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:15.768493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b7b20dc1-2758-487e-87d3-8d0fd7cfcf57 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:15.769245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b7b20dc1-2758-487e-87d3-8d0fd7cfcf57 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:15.770249 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b7b20dc1-2758-487e-87d3-8d0fd7cfcf57 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:15.770944 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b7b20dc1-2758-487e-87d3-8d0fd7cfcf57 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:15.909736 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b7b20dc1-2758-487e-87d3-8d0fd7cfcf57 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:15.930155 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b7b20dc1-2758-487e-87d3-8d0fd7cfcf57 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:15.932784 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b7b20dc1-2758-487e-87d3-8d0fd7cfcf57 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:15.934351 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b7b20dc1-2758-487e-87d3-8d0fd7cfcf57 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1603 microversion: 2.32 time: 0.188731 Jul 25 14:54:15.935535 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2524/5309] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:54:15 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1603 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:54:16.980026 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ad9b2b6c-c395-44ac-9f16-9d675a31f6bd tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:16.980848 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ad9b2b6c-c395-44ac-9f16-9d675a31f6bd tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:17.031102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad9b2b6c-c395-44ac-9f16-9d675a31f6bd tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:17.035485 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad9b2b6c-c395-44ac-9f16-9d675a31f6bd tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:17.035715 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad9b2b6c-c395-44ac-9f16-9d675a31f6bd tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:17.036211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad9b2b6c-c395-44ac-9f16-9d675a31f6bd tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:17.248726 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ad9b2b6c-c395-44ac-9f16-9d675a31f6bd tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:17.265966 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ad9b2b6c-c395-44ac-9f16-9d675a31f6bd tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:17.272485 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ad9b2b6c-c395-44ac-9f16-9d675a31f6bd tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:17.273758 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ad9b2b6c-c395-44ac-9f16-9d675a31f6bd tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1603 microversion: 2.32 time: 0.309563 Jul 25 14:54:17.284146 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2786/5310] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:54:16 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1603 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:54:18.297978 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3dac4c04-5eb1-4719-b99f-8231c66bf4b3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:18.298614 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3dac4c04-5eb1-4719-b99f-8231c66bf4b3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:18.316563 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3dac4c04-5eb1-4719-b99f-8231c66bf4b3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:18.317021 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3dac4c04-5eb1-4719-b99f-8231c66bf4b3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:18.317870 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3dac4c04-5eb1-4719-b99f-8231c66bf4b3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:18.318312 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3dac4c04-5eb1-4719-b99f-8231c66bf4b3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:19.030030 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3dac4c04-5eb1-4719-b99f-8231c66bf4b3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:19.039849 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3dac4c04-5eb1-4719-b99f-8231c66bf4b3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:19.051957 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3dac4c04-5eb1-4719-b99f-8231c66bf4b3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:19.053229 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3dac4c04-5eb1-4719-b99f-8231c66bf4b3 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1603 microversion: 2.32 time: 0.759552 Jul 25 14:54:19.065825 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2525/5311] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:54:18 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1603 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:54:20.085531 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f9522541-0e4c-4b91-828e-bb4477431d17 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:20.087707 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f9522541-0e4c-4b91-828e-bb4477431d17 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:20.138613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f9522541-0e4c-4b91-828e-bb4477431d17 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:20.144230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f9522541-0e4c-4b91-828e-bb4477431d17 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:20.149888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f9522541-0e4c-4b91-828e-bb4477431d17 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:20.153802 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f9522541-0e4c-4b91-828e-bb4477431d17 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:20.401252 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f9522541-0e4c-4b91-828e-bb4477431d17 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:20.418928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f9522541-0e4c-4b91-828e-bb4477431d17 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:20.422605 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f9522541-0e4c-4b91-828e-bb4477431d17 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:20.436532 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f9522541-0e4c-4b91-828e-bb4477431d17 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1603 microversion: 2.32 time: 0.346908 Jul 25 14:54:20.440390 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2787/5312] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:54:20 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1603 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:54:21.462512 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cb1c835b-df39-4756-8c36-81a74331beb4 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:21.463156 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cb1c835b-df39-4756-8c36-81a74331beb4 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:21.492522 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cb1c835b-df39-4756-8c36-81a74331beb4 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:21.492973 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cb1c835b-df39-4756-8c36-81a74331beb4 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:21.493759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cb1c835b-df39-4756-8c36-81a74331beb4 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:21.494194 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cb1c835b-df39-4756-8c36-81a74331beb4 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:21.779000 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cb1c835b-df39-4756-8c36-81a74331beb4 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:21.799574 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cb1c835b-df39-4756-8c36-81a74331beb4 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:21.821629 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cb1c835b-df39-4756-8c36-81a74331beb4 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:21.823261 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cb1c835b-df39-4756-8c36-81a74331beb4 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1603 microversion: 2.32 time: 0.365139 Jul 25 14:54:21.823861 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2526/5313] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:54:21 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1603 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:54:22.853817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-76f7fa0b-1498-44dd-b1f2-fa19f1232231 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:22.854617 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-76f7fa0b-1498-44dd-b1f2-fa19f1232231 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:22.864821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-76f7fa0b-1498-44dd-b1f2-fa19f1232231 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:22.867438 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-76f7fa0b-1498-44dd-b1f2-fa19f1232231 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:22.872367 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-76f7fa0b-1498-44dd-b1f2-fa19f1232231 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:22.873700 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-76f7fa0b-1498-44dd-b1f2-fa19f1232231 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:23.153005 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-76f7fa0b-1498-44dd-b1f2-fa19f1232231 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:23.185408 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-76f7fa0b-1498-44dd-b1f2-fa19f1232231 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:23.187190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-76f7fa0b-1498-44dd-b1f2-fa19f1232231 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:23.188489 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-76f7fa0b-1498-44dd-b1f2-fa19f1232231 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1603 microversion: 2.32 time: 0.340576 Jul 25 14:54:23.193523 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2788/5314] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:54:22 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1603 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:54:24.214956 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-360c4698-3ac2-4d4c-8669-03ddb7b2ebaa tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:24.216056 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-360c4698-3ac2-4d4c-8669-03ddb7b2ebaa tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:24.231642 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-360c4698-3ac2-4d4c-8669-03ddb7b2ebaa tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:24.232121 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-360c4698-3ac2-4d4c-8669-03ddb7b2ebaa tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:24.232915 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-360c4698-3ac2-4d4c-8669-03ddb7b2ebaa tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:24.233349 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-360c4698-3ac2-4d4c-8669-03ddb7b2ebaa tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:24.571140 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-360c4698-3ac2-4d4c-8669-03ddb7b2ebaa tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:24.589605 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-360c4698-3ac2-4d4c-8669-03ddb7b2ebaa tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:24.593544 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-360c4698-3ac2-4d4c-8669-03ddb7b2ebaa tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:24.605286 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-360c4698-3ac2-4d4c-8669-03ddb7b2ebaa tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1603 microversion: 2.32 time: 0.394364 Jul 25 14:54:24.610088 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2527/5315] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:54:24 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1603 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:54:25.639242 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5c9915b5-4367-454c-bff8-e0b761982608 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:25.641041 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5c9915b5-4367-454c-bff8-e0b761982608 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:25.669086 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c9915b5-4367-454c-bff8-e0b761982608 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:25.686689 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c9915b5-4367-454c-bff8-e0b761982608 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:25.690182 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c9915b5-4367-454c-bff8-e0b761982608 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:25.694973 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c9915b5-4367-454c-bff8-e0b761982608 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:26.040851 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5c9915b5-4367-454c-bff8-e0b761982608 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:26.055954 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5c9915b5-4367-454c-bff8-e0b761982608 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:26.092183 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5c9915b5-4367-454c-bff8-e0b761982608 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:26.094064 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5c9915b5-4367-454c-bff8-e0b761982608 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1603 microversion: 2.32 time: 0.460097 Jul 25 14:54:26.113495 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2789/5316] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:54:25 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1603 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:54:27.127409 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ad94fef9-da19-4a00-8d81-4fd58dfd6a13 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:27.128766 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ad94fef9-da19-4a00-8d81-4fd58dfd6a13 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:27.151049 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ad94fef9-da19-4a00-8d81-4fd58dfd6a13 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:27.153052 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ad94fef9-da19-4a00-8d81-4fd58dfd6a13 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:27.154642 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ad94fef9-da19-4a00-8d81-4fd58dfd6a13 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:27.160287 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ad94fef9-da19-4a00-8d81-4fd58dfd6a13 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:27.463487 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ad94fef9-da19-4a00-8d81-4fd58dfd6a13 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:27.479966 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ad94fef9-da19-4a00-8d81-4fd58dfd6a13 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:27.490238 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ad94fef9-da19-4a00-8d81-4fd58dfd6a13 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:27.501092 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ad94fef9-da19-4a00-8d81-4fd58dfd6a13 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1603 microversion: 2.32 time: 0.373314 Jul 25 14:54:27.502045 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2528/5317] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:54:27 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1603 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:54:28.533612 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-35ea7187-d0e0-4722-9275-e6b2ab1961ec tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:28.534365 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-35ea7187-d0e0-4722-9275-e6b2ab1961ec tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:28.567844 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=30 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:54:28.583620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35ea7187-d0e0-4722-9275-e6b2ab1961ec tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:28.592498 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35ea7187-d0e0-4722-9275-e6b2ab1961ec tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:28.597707 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35ea7187-d0e0-4722-9275-e6b2ab1961ec tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:28.600312 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35ea7187-d0e0-4722-9275-e6b2ab1961ec tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:28.671732 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=76 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:54:28.838102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-35ea7187-d0e0-4722-9275-e6b2ab1961ec tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:28.850846 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-35ea7187-d0e0-4722-9275-e6b2ab1961ec tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:28.859366 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-35ea7187-d0e0-4722-9275-e6b2ab1961ec tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:28.861119 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-35ea7187-d0e0-4722-9275-e6b2ab1961ec tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1603 microversion: 2.32 time: 0.335583 Jul 25 14:54:28.877296 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2790/5318] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:54:28 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1603 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:54:29.803761 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-36a0932b-f1f3-4a5c-98a3-d99d44f836e3 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:29.804428 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-36a0932b-f1f3-4a5c-98a3-d99d44f836e3 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:29.817440 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-36a0932b-f1f3-4a5c-98a3-d99d44f836e3 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:29.821771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-36a0932b-f1f3-4a5c-98a3-d99d44f836e3 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:29.822781 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-36a0932b-f1f3-4a5c-98a3-d99d44f836e3 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:29.823471 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-36a0932b-f1f3-4a5c-98a3-d99d44f836e3 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:29.891339 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5ca13035-7afe-4f7f-a6db-0570b91776ae tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:29.893015 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5ca13035-7afe-4f7f-a6db-0570b91776ae tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:29.900596 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ca13035-7afe-4f7f-a6db-0570b91776ae tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:29.901405 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ca13035-7afe-4f7f-a6db-0570b91776ae tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:29.902398 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ca13035-7afe-4f7f-a6db-0570b91776ae tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:29.903184 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ca13035-7afe-4f7f-a6db-0570b91776ae tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:30.030497 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5ca13035-7afe-4f7f-a6db-0570b91776ae tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:30.048688 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5ca13035-7afe-4f7f-a6db-0570b91776ae tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:30.068642 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5ca13035-7afe-4f7f-a6db-0570b91776ae tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:30.071005 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5ca13035-7afe-4f7f-a6db-0570b91776ae tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1603 microversion: 2.32 time: 0.184067 Jul 25 14:54:30.097699 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2791/5319] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:54:29 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1603 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:54:30.124228 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-36a0932b-f1f3-4a5c-98a3-d99d44f836e3 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1836 microversion: 2.1 time: 0.324153 Jul 25 14:54:30.127150 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2529/5320] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:54:29 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1836 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:54:31.101741 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3cde0dba-825e-455c-8ccb-cfaf6c30615f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:31.102374 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3cde0dba-825e-455c-8ccb-cfaf6c30615f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:31.109856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3cde0dba-825e-455c-8ccb-cfaf6c30615f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:31.110474 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3cde0dba-825e-455c-8ccb-cfaf6c30615f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:31.111386 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3cde0dba-825e-455c-8ccb-cfaf6c30615f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:31.136730 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3cde0dba-825e-455c-8ccb-cfaf6c30615f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:31.484411 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3cde0dba-825e-455c-8ccb-cfaf6c30615f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:31.504417 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3cde0dba-825e-455c-8ccb-cfaf6c30615f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:31.511715 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3cde0dba-825e-455c-8ccb-cfaf6c30615f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:31.522211 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3cde0dba-825e-455c-8ccb-cfaf6c30615f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1603 microversion: 2.32 time: 0.424747 Jul 25 14:54:31.537937 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2792/5321] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:54:31 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1603 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:54:32.551219 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-af9510b8-7ffc-48c0-930a-21adbb864a9b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:32.552683 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-af9510b8-7ffc-48c0-930a-21adbb864a9b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:32.567610 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-af9510b8-7ffc-48c0-930a-21adbb864a9b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:32.568556 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-af9510b8-7ffc-48c0-930a-21adbb864a9b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:32.569964 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-af9510b8-7ffc-48c0-930a-21adbb864a9b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:32.571427 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-af9510b8-7ffc-48c0-930a-21adbb864a9b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:32.768134 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-11897e69-e789-4b84-8c26-29ea8074b8ad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:32.768641 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-11897e69-e789-4b84-8c26-29ea8074b8ad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:32.789332 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11897e69-e789-4b84-8c26-29ea8074b8ad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:32.789794 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11897e69-e789-4b84-8c26-29ea8074b8ad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:32.798877 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11897e69-e789-4b84-8c26-29ea8074b8ad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:32.799432 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11897e69-e789-4b84-8c26-29ea8074b8ad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:32.850595 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-af9510b8-7ffc-48c0-930a-21adbb864a9b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:32.873379 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-af9510b8-7ffc-48c0-930a-21adbb864a9b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:32.882580 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-af9510b8-7ffc-48c0-930a-21adbb864a9b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:32.885030 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-af9510b8-7ffc-48c0-930a-21adbb864a9b tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1603 microversion: 2.32 time: 0.337936 Jul 25 14:54:32.892559 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2530/5322] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:54:32 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1603 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:54:32.910080 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-e4816757-1d4c-483d-95bb-b23d5b8a5923 req-9b4d10bf-8fdd-4150-af2d-b33b7b57e2cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24543e41-c6a3-4964-a14a-d7273d59dc3d", "tag": "c3bc1148-2a77-4263-9fb0-9cce5305d01d"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:54:32.930119 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-11897e69-e789-4b84-8c26-29ea8074b8ad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:54:32.949270 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-e4816757-1d4c-483d-95bb-b23d5b8a5923 req-9b4d10bf-8fdd-4150-af2d-b33b7b57e2cf service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:32.953869 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-e4816757-1d4c-483d-95bb-b23d5b8a5923 req-9b4d10bf-8fdd-4150-af2d-b33b7b57e2cf service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:32.997740 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-e4816757-1d4c-483d-95bb-b23d5b8a5923 req-9b4d10bf-8fdd-4150-af2d-b33b7b57e2cf service nova] Creating event network-changed:c3bc1148-2a77-4263-9fb0-9cce5305d01d for instance 24543e41-c6a3-4964-a14a-d7273d59dc3d on n-h2-846435-14 Jul 25 14:54:33.044827 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-e4816757-1d4c-483d-95bb-b23d5b8a5923 req-9b4d10bf-8fdd-4150-af2d-b33b7b57e2cf service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150099 Jul 25 14:54:33.045806 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2531/5323] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:54:33.165041 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-11897e69-e789-4b84-8c26-29ea8074b8ad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "DELETE /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 204 len: 0 microversion: 2.1 time: 0.400906 Jul 25 14:54:33.166027 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2793/5324] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:54:32 2022] DELETE /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:54:33.179954 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-387bd9ab-629f-48be-bb61-3b298ffd9570 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:33.181661 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-387bd9ab-629f-48be-bb61-3b298ffd9570 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:33.203789 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-387bd9ab-629f-48be-bb61-3b298ffd9570 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:33.220619 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-387bd9ab-629f-48be-bb61-3b298ffd9570 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:33.222816 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-387bd9ab-629f-48be-bb61-3b298ffd9570 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:33.223905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-387bd9ab-629f-48be-bb61-3b298ffd9570 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:33.623429 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-387bd9ab-629f-48be-bb61-3b298ffd9570 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:33.647790 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:54:33.662131 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-387bd9ab-629f-48be-bb61-3b298ffd9570 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1689 microversion: 2.1 time: 0.490718 Jul 25 14:54:33.677517 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2532/5325] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:54:33 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1689 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:54:33.913903 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1f574729-8c5a-4dd6-b9a4-94865cf2c506 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:33.915368 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1f574729-8c5a-4dd6-b9a4-94865cf2c506 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:33.937063 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1f574729-8c5a-4dd6-b9a4-94865cf2c506 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:33.941460 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1f574729-8c5a-4dd6-b9a4-94865cf2c506 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:33.944561 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1f574729-8c5a-4dd6-b9a4-94865cf2c506 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:33.951762 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1f574729-8c5a-4dd6-b9a4-94865cf2c506 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:34.170469 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1f574729-8c5a-4dd6-b9a4-94865cf2c506 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:34.195043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1f574729-8c5a-4dd6-b9a4-94865cf2c506 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:34.205450 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1f574729-8c5a-4dd6-b9a4-94865cf2c506 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:34.206737 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1f574729-8c5a-4dd6-b9a4-94865cf2c506 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1603 microversion: 2.32 time: 0.299639 Jul 25 14:54:34.208972 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2794/5326] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:54:33 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1603 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:54:34.687620 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-42bfcb93-2113-47bf-8c1e-4693334739ef tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:34.688978 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-42bfcb93-2113-47bf-8c1e-4693334739ef tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:34.716728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=38 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:54:34.718400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42bfcb93-2113-47bf-8c1e-4693334739ef tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:34.718872 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42bfcb93-2113-47bf-8c1e-4693334739ef tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:34.719780 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42bfcb93-2113-47bf-8c1e-4693334739ef tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:34.732738 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42bfcb93-2113-47bf-8c1e-4693334739ef tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:35.235353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-77819974-e5cd-46e8-b7dc-035794c7a9b9 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:35.236600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-77819974-e5cd-46e8-b7dc-035794c7a9b9 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:35.262177 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-77819974-e5cd-46e8-b7dc-035794c7a9b9 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:35.262905 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-77819974-e5cd-46e8-b7dc-035794c7a9b9 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:35.266644 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-77819974-e5cd-46e8-b7dc-035794c7a9b9 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:35.270315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-77819974-e5cd-46e8-b7dc-035794c7a9b9 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:35.313599 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-42bfcb93-2113-47bf-8c1e-4693334739ef tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:35.321355 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-42bfcb93-2113-47bf-8c1e-4693334739ef tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1689 microversion: 2.1 time: 0.638474 Jul 25 14:54:35.326459 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2533/5327] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:54:34 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1689 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:54:35.637550 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-77819974-e5cd-46e8-b7dc-035794c7a9b9 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:35.676207 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-77819974-e5cd-46e8-b7dc-035794c7a9b9 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:35.687415 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-77819974-e5cd-46e8-b7dc-035794c7a9b9 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:35.688715 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-77819974-e5cd-46e8-b7dc-035794c7a9b9 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1603 microversion: 2.32 time: 0.459427 Jul 25 14:54:35.700080 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2795/5328] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:54:35 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1603 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:54:36.343704 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0c223ccf-0218-4ce1-bd5b-a23826759c37 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:36.344591 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0c223ccf-0218-4ce1-bd5b-a23826759c37 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:36.365644 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0c223ccf-0218-4ce1-bd5b-a23826759c37 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:36.366105 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0c223ccf-0218-4ce1-bd5b-a23826759c37 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:36.366903 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0c223ccf-0218-4ce1-bd5b-a23826759c37 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:36.367347 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0c223ccf-0218-4ce1-bd5b-a23826759c37 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:36.563853 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-60c3bf80-996a-49ab-9959-523e6f52a7cc req-607ced8b-7a69-4d11-80fd-39677a9d0bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24543e41-c6a3-4964-a14a-d7273d59dc3d", "name": "network-vif-deleted", "tag": "c3bc1148-2a77-4263-9fb0-9cce5305d01d"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:54:36.594027 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-60c3bf80-996a-49ab-9959-523e6f52a7cc req-607ced8b-7a69-4d11-80fd-39677a9d0bd3 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:36.594469 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-60c3bf80-996a-49ab-9959-523e6f52a7cc req-607ced8b-7a69-4d11-80fd-39677a9d0bd3 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:36.630278 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-60c3bf80-996a-49ab-9959-523e6f52a7cc req-607ced8b-7a69-4d11-80fd-39677a9d0bd3 service nova] Creating event network-vif-deleted:c3bc1148-2a77-4263-9fb0-9cce5305d01d for instance 24543e41-c6a3-4964-a14a-d7273d59dc3d on n-h2-846435-14 Jul 25 14:54:36.637339 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-60c3bf80-996a-49ab-9959-523e6f52a7cc req-607ced8b-7a69-4d11-80fd-39677a9d0bd3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078144 Jul 25 14:54:36.640633 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2796/5329] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 25 14:54:36.706132 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0c223ccf-0218-4ce1-bd5b-a23826759c37 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:36.716782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e6de0ff1-bba6-4b33-957d-c8404c799c7e tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:36.717951 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e6de0ff1-bba6-4b33-957d-c8404c799c7e tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:36.726078 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0c223ccf-0218-4ce1-bd5b-a23826759c37 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 200 len: 1503 microversion: 2.1 time: 0.386194 Jul 25 14:54:36.738285 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2534/5330] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:54:36 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 1503 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:54:36.740533 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6de0ff1-bba6-4b33-957d-c8404c799c7e tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:36.741903 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6de0ff1-bba6-4b33-957d-c8404c799c7e tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:36.744359 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6de0ff1-bba6-4b33-957d-c8404c799c7e tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:36.744966 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6de0ff1-bba6-4b33-957d-c8404c799c7e tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:37.466249 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e6de0ff1-bba6-4b33-957d-c8404c799c7e tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:37.483960 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e6de0ff1-bba6-4b33-957d-c8404c799c7e tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:37.485450 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e6de0ff1-bba6-4b33-957d-c8404c799c7e tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:37.486785 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e6de0ff1-bba6-4b33-957d-c8404c799c7e tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1603 microversion: 2.32 time: 0.774223 Jul 25 14:54:37.487359 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2797/5331] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:54:36 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1603 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:54:37.758961 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0abf13de-48f6-4ff4-97b0-275d10c0f573 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:37.760238 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0abf13de-48f6-4ff4-97b0-275d10c0f573 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 24543e41-c6a3-4964-a14a-d7273d59dc3d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:37.773042 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0abf13de-48f6-4ff4-97b0-275d10c0f573 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:37.775936 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0abf13de-48f6-4ff4-97b0-275d10c0f573 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:37.777200 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0abf13de-48f6-4ff4-97b0-275d10c0f573 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:37.777859 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0abf13de-48f6-4ff4-97b0-275d10c0f573 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:37.812210 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-0abf13de-48f6-4ff4-97b0-275d10c0f573 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] HTTP exception thrown: Instance 24543e41-c6a3-4964-a14a-d7273d59dc3d could not be found. Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0abf13de-48f6-4ff4-97b0-275d10c0f573 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Request method failure captured: Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d HTTP/1.1 Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q4DBDAuynnb9b8nJFNNex8XXIdUxDWuP-PEkAZMub_ZUkZMduVSsCJMD66yCrnruIywPy2lvVpDMBFR-BQiaLm_rcOzEza3QKBSQ9Q0j7zyfwq4sXID1DSbTq1QnPsc4nPy2BUSC17V5E20v3AYQkR2U7b_KL_5EYlXpiDz-Ll6u0Y Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 8dd09177faea4702992aaab182125b5a Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-919260591 Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8dd09177faea4702992aaab182125b5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8dd09177faea4702992aaab182125b5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8dd09177faea4702992aaab182125b5a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8dd09177faea4702992aaab182125b5a"}]}] Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-TestNetworkAdvancedServerOps-919260591 Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 8dd09177faea4702992aaab182125b5a Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-919260591 Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-TestNetworkAdvancedServerOps-919260591-project Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: ca46c8e84b8644b69937ec9c06cb0e9a Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-TestNetworkAdvancedServerOps-919260591-project Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 24543e41-c6a3-4964-a14a-d7273d59dc3d could not be found. Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '24543e41-c6a3-4964-a14a-d7273d59dc3d'} Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24543e41-c6a3-4964-a14a-d7273d59dc3d could not be found. Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24543e41-c6a3-4964-a14a-d7273d59dc3d could not be found. Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:54:37.823864 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:54:37.828461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:54:37.828461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:54:37.828461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:54:37.828461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:54:37.828461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:54:37.828461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24543e41-c6a3-4964-a14a-d7273d59dc3d could not be found. Jul 25 14:54:37.828461 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:54:37.828461 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0abf13de-48f6-4ff4-97b0-275d10c0f573 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Returning 404 to user: Instance 24543e41-c6a3-4964-a14a-d7273d59dc3d could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:54:37.829103 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0abf13de-48f6-4ff4-97b0-275d10c0f573 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d" status: 404 len: 111 microversion: 2.1 time: 0.073171 Jul 25 14:54:37.830083 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2535/5332] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:54:37 2022] GET /compute/v2.1/servers/24543e41-c6a3-4964-a14a-d7273d59dc3d => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:54:38.510761 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-086d691a-74ba-4bc5-b6a7-6f3c24913430 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:38.512103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-086d691a-74ba-4bc5-b6a7-6f3c24913430 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:38.531713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-086d691a-74ba-4bc5-b6a7-6f3c24913430 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:38.534531 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-086d691a-74ba-4bc5-b6a7-6f3c24913430 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:38.539904 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-086d691a-74ba-4bc5-b6a7-6f3c24913430 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:38.543254 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-086d691a-74ba-4bc5-b6a7-6f3c24913430 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:38.885906 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-086d691a-74ba-4bc5-b6a7-6f3c24913430 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:38.924600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-086d691a-74ba-4bc5-b6a7-6f3c24913430 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:38.928263 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-086d691a-74ba-4bc5-b6a7-6f3c24913430 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:38.934224 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-086d691a-74ba-4bc5-b6a7-6f3c24913430 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1603 microversion: 2.32 time: 0.427670 Jul 25 14:54:38.955884 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2798/5333] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:54:38 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1603 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:54:39.963416 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7b284463-b02b-4ae3-ba82-b216c22e41c7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:39.965299 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7b284463-b02b-4ae3-ba82-b216c22e41c7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:40.020854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b284463-b02b-4ae3-ba82-b216c22e41c7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:40.024499 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b284463-b02b-4ae3-ba82-b216c22e41c7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:40.028942 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b284463-b02b-4ae3-ba82-b216c22e41c7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:40.029404 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b284463-b02b-4ae3-ba82-b216c22e41c7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:40.377610 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7b284463-b02b-4ae3-ba82-b216c22e41c7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:40.415768 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7b284463-b02b-4ae3-ba82-b216c22e41c7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:40.418221 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7b284463-b02b-4ae3-ba82-b216c22e41c7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59a44de1685b4c1f959a652432bd9c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b00fe1f11f472da3e053f029bd78fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:40.422020 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7b284463-b02b-4ae3-ba82-b216c22e41c7 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 200 len: 1603 microversion: 2.32 time: 0.462138 Jul 25 14:54:40.438216 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2536/5334] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:54:39 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 1603 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 14:54:41.464700 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f0230bd7-55cc-4cc1-8412-956e87de2a56 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:41.468292 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f0230bd7-55cc-4cc1-8412-956e87de2a56 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:41.491798 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0230bd7-55cc-4cc1-8412-956e87de2a56 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:41.492280 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0230bd7-55cc-4cc1-8412-956e87de2a56 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:41.493497 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0230bd7-55cc-4cc1-8412-956e87de2a56 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:41.493497 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0230bd7-55cc-4cc1-8412-956e87de2a56 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:41.567514 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-f0230bd7-55cc-4cc1-8412-956e87de2a56 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] HTTP exception thrown: Instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 could not be found. Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f0230bd7-55cc-4cc1-8412-956e87de2a56 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Request method failure captured: Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 HTTP/1.1 Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qw3sbqAN7FDISw-pN4klYMQL5fJUy7dWrNJj69zRrZqTVKkJJaILNJItQdt9N8HS61tu7ABQcQ87ExT0mR34UM__BOhVanYNw5_3pwBeJAp3_YY1O-HV3QQiLa2VKVpOGtSKyoR5J1Hw-lhr1NX7G9dHd0MqEfGX_07la7OR-EKY7A Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: X-Openstack-Nova-Api-Version: 2.32 Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: e0b00fe1f11f472da3e053f029bd78fa Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-TaggedBootDevicesTest-1390916075 Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e0b00fe1f11f472da3e053f029bd78fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e0b00fe1f11f472da3e053f029bd78fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e0b00fe1f11f472da3e053f029bd78fa", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e0b00fe1f11f472da3e053f029bd78fa"}]}] Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-TaggedBootDevicesTest-1390916075 Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: e0b00fe1f11f472da3e053f029bd78fa Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1390916075 Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-TaggedBootDevicesTest-1390916075-project Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 59a44de1685b4c1f959a652432bd9c75 Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-TaggedBootDevicesTest-1390916075-project Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 could not be found. Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '50f3696b-0e20-4fc7-9bd0-3955357f2b09'} Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 could not be found. Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 could not be found. Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:54:41.571824 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:54:41.575923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:54:41.575923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:54:41.575923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:54:41.575923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:54:41.575923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:54:41.575923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 could not be found. Jul 25 14:54:41.575923 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:54:41.581549 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f0230bd7-55cc-4cc1-8412-956e87de2a56 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Returning 404 to user: Instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:54:41.591210 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f0230bd7-55cc-4cc1-8412-956e87de2a56 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 404 len: 111 microversion: 2.32 time: 0.144561 Jul 25 14:54:41.592501 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2799/5335] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:54:41 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:54:41.600396 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ce850d81-fea2-4f46-a77e-774a7d501f30 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '.version_select at 0x7f46867bcee0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:41.640847 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ce850d81-fea2-4f46-a77e-774a7d501f30 tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-348752637" status: 204 len: 0 microversion: 2.32 time: 0.044479 Jul 25 14:54:41.646258 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2537/5336] 10.222.0.88 () {60 vars in 1259 bytes} [Mon Jul 25 14:54:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-348752637 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 14:54:46.747608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f21aa841-f94d-4565-8e45-1e68ce22f9df tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '.version_select at 0x7f468618a0d0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:46.819742 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f21aa841-f94d-4565-8e45-1e68ce22f9df tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1414331621" status: 202 len: 0 microversion: 2.1 time: 0.075719 Jul 25 14:54:46.820372 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2800/5337] 10.222.0.88 () {58 vars in 1284 bytes} [Mon Jul 25 14:54:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1414331621 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:54:46.851789 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0e426170-bd51-40fb-86c5-cb16835478f4 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Action: 'create', calling method: .version_select at 0x7f468666cd30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-827472442", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzwq4tNSSdMRaJ356Vk4EDqYhYsEYQOFhjptWl/TBdNlDCni2bZyqoK106jpAlgKdWb7KHF5zKJea+S00xY0Zdhk9NPKKZ4rhQOkCd3SWZLXxdDVFaSzSKmnQDZmMx79A=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:54:46.916624 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-0e426170-bd51-40fb-86c5-cb16835478f4 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Getting quotas for project 8dd09177faea4702992aaab182125b5a. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:54:46.927659 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-0e426170-bd51-40fb-86c5-cb16835478f4 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Getting quotas for user ca46c8e84b8644b69937ec9c06cb0e9a and project 8dd09177faea4702992aaab182125b5a. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:54:47.005039 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0e426170-bd51-40fb-86c5-cb16835478f4 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.158295 Jul 25 14:54:47.007281 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2538/5338] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:54:46 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:54:52.618634 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:54:52.624262 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bddb2d02-0997-4646-9d13-1195cffa799e tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:52.624893 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bddb2d02-0997-4646-9d13-1195cffa799e tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:52.643750 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bddb2d02-0997-4646-9d13-1195cffa799e tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:52.645550 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bddb2d02-0997-4646-9d13-1195cffa799e tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:52.648124 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bddb2d02-0997-4646-9d13-1195cffa799e tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:52.650255 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bddb2d02-0997-4646-9d13-1195cffa799e tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:52.713233 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-bddb2d02-0997-4646-9d13-1195cffa799e tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] HTTP exception thrown: Instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 could not be found. Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bddb2d02-0997-4646-9d13-1195cffa799e tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Request method failure captured: Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 HTTP/1.1 Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3qw3sbqAN7FDISw-pN4klYMQL5fJUy7dWrNJj69zRrZqTVKkJJaILNJItQdt9N8HS61tu7ABQcQ87ExT0mR34UM__BOhVanYNw5_3pwBeJAp3_YY1O-HV3QQiLa2VKVpOGtSKyoR5J1Hw-lhr1NX7G9dHd0MqEfGX_07la7OR-EKY7A Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: X-Openstack-Nova-Api-Version: 2.32 Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: e0b00fe1f11f472da3e053f029bd78fa Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-TaggedBootDevicesTest-1390916075 Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e0b00fe1f11f472da3e053f029bd78fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e0b00fe1f11f472da3e053f029bd78fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e0b00fe1f11f472da3e053f029bd78fa", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e0b00fe1f11f472da3e053f029bd78fa"}]}] Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-TaggedBootDevicesTest-1390916075 Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: e0b00fe1f11f472da3e053f029bd78fa Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1390916075 Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-TaggedBootDevicesTest-1390916075-project Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 59a44de1685b4c1f959a652432bd9c75 Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-TaggedBootDevicesTest-1390916075-project Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 could not be found. Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '50f3696b-0e20-4fc7-9bd0-3955357f2b09'} Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 could not be found. Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:54:52.720147 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:54:52.723829 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 could not be found. Jul 25 14:54:52.723829 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:54:52.723829 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:54:52.723829 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:54:52.723829 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:54:52.723829 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:54:52.723829 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:54:52.723829 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:54:52.723829 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:54:52.723829 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 could not be found. Jul 25 14:54:52.723829 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:54:52.732844 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bddb2d02-0997-4646-9d13-1195cffa799e tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Returning 404 to user: Instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:54:52.734349 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bddb2d02-0997-4646-9d13-1195cffa799e tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "DELETE /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 404 len: 111 microversion: 2.32 time: 0.125132 Jul 25 14:54:52.735613 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2801/5339] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Jul 25 14:54:52 2022] DELETE /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:54:52.741609 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=21 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:54:52.747206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-da0bae25-e3e0-492b-8600-fe96089f653f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:52.748218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-da0bae25-e3e0-492b-8600-fe96089f653f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] [instance: 50f3696b-0e20-4fc7-9bd0-3955357f2b09] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:52.762609 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da0bae25-e3e0-492b-8600-fe96089f653f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:52.775634 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da0bae25-e3e0-492b-8600-fe96089f653f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:52.776915 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da0bae25-e3e0-492b-8600-fe96089f653f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:52.781704 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da0bae25-e3e0-492b-8600-fe96089f653f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:52.818465 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-da0bae25-e3e0-492b-8600-fe96089f653f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] HTTP exception thrown: Instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 could not be found. Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-da0bae25-e3e0-492b-8600-fe96089f653f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Request method failure captured: Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 HTTP/1.1 Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3qw3sbqAN7FDISw-pN4klYMQL5fJUy7dWrNJj69zRrZqTVKkJJaILNJItQdt9N8HS61tu7ABQcQ87ExT0mR34UM__BOhVanYNw5_3pwBeJAp3_YY1O-HV3QQiLa2VKVpOGtSKyoR5J1Hw-lhr1NX7G9dHd0MqEfGX_07la7OR-EKY7A Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: X-Openstack-Nova-Api-Version: 2.32 Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: e0b00fe1f11f472da3e053f029bd78fa Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-TaggedBootDevicesTest-1390916075 Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e0b00fe1f11f472da3e053f029bd78fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/e0b00fe1f11f472da3e053f029bd78fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_e0b00fe1f11f472da3e053f029bd78fa", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/e0b00fe1f11f472da3e053f029bd78fa"}]}] Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-TaggedBootDevicesTest-1390916075 Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: e0b00fe1f11f472da3e053f029bd78fa Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1390916075 Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-TaggedBootDevicesTest-1390916075-project Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 59a44de1685b4c1f959a652432bd9c75 Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-TaggedBootDevicesTest-1390916075-project Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 could not be found. Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '50f3696b-0e20-4fc7-9bd0-3955357f2b09'} Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 could not be found. Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 could not be found. Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:54:52.823169 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:54:52.826672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:54:52.826672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:54:52.826672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:54:52.826672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:54:52.826672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:54:52.826672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 could not be found. Jul 25 14:54:52.826672 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:54:52.830740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-da0bae25-e3e0-492b-8600-fe96089f653f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] Returning 404 to user: Instance 50f3696b-0e20-4fc7-9bd0-3955357f2b09 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:54:52.840795 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-da0bae25-e3e0-492b-8600-fe96089f653f tempest-TaggedBootDevicesTest-1390916075 tempest-TaggedBootDevicesTest-1390916075-project] 10.222.0.88 "GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09" status: 404 len: 111 microversion: 2.32 time: 0.093827 Jul 25 14:54:52.858302 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2539/5340] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 14:54:52 2022] GET /compute/v2.1/servers/50f3696b-0e20-4fc7-9bd0-3955357f2b09 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:54:54.290708 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9d72a201-c7cf-4e20-afd8-095bf676cdd7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:54:54.291317 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9d72a201-c7cf-4e20-afd8-095bf676cdd7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:54.312415 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d72a201-c7cf-4e20-afd8-095bf676cdd7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:54.314559 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d72a201-c7cf-4e20-afd8-095bf676cdd7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:54.320973 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d72a201-c7cf-4e20-afd8-095bf676cdd7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:54.323140 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d72a201-c7cf-4e20-afd8-095bf676cdd7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:55.073681 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9d72a201-c7cf-4e20-afd8-095bf676cdd7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:54:55.090297 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9d72a201-c7cf-4e20-afd8-095bf676cdd7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.803967 Jul 25 14:54:55.091424 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2802/5341] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:54:54 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:54:55.117713 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-932c2513-d940-4641-8f2b-365a6772e5d5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-983225149"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:54:55.120455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-932c2513-d940-4641-8f2b-365a6772e5d5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:54:55.144205 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-932c2513-d940-4641-8f2b-365a6772e5d5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:55.144681 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-932c2513-d940-4641-8f2b-365a6772e5d5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:55.145514 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-932c2513-d940-4641-8f2b-365a6772e5d5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:55.145955 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-932c2513-d940-4641-8f2b-365a6772e5d5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:55.578062 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-932c2513-d940-4641-8f2b-365a6772e5d5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action" status: 202 len: 0 microversion: 2.1 time: 0.459001 Jul 25 14:54:55.583040 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2540/5342] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:54:55 2022] POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 25 14:54:57.575365 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-09c16856-7edd-4815-a3c5-56338e5827f5 req-6ad0eee6-ca35-4b36-b020-ee2681042c87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e054ea1-6a81-43c7-9746-25b466d4647b", "name": "network-vif-unplugged", "status": "completed", "tag": "24859a24-8dd1-490f-b1c7-01178f7f59b2"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:54:57.611085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-09c16856-7edd-4815-a3c5-56338e5827f5 req-6ad0eee6-ca35-4b36-b020-ee2681042c87 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:54:57.615394 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-09c16856-7edd-4815-a3c5-56338e5827f5 req-6ad0eee6-ca35-4b36-b020-ee2681042c87 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:54:57.645907 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-09c16856-7edd-4815-a3c5-56338e5827f5 req-6ad0eee6-ca35-4b36-b020-ee2681042c87 service nova] Creating event network-vif-unplugged:24859a24-8dd1-490f-b1c7-01178f7f59b2 for instance 9e054ea1-6a81-43c7-9746-25b466d4647b on n-h2-846435-14 Jul 25 14:54:57.657170 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-09c16856-7edd-4815-a3c5-56338e5827f5 req-6ad0eee6-ca35-4b36-b020-ee2681042c87 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088742 Jul 25 14:54:57.658912 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2803/5343] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:55:05.915539 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5f7fb032-5390-4244-88b7-e97fa25bbd6e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1315557155", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "0ebdc523-f668-41d1-a367-03b2f469936e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-827472442", "security_groups": [{"name": "tempest-secgroup-smoke-1401684329"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:55:05.957932 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:55:05.958671 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:55:05.967997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:55:06.094504 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-55cf3e11-1132-4eb7-847c-3299b5786d3e req-b5afeb3c-c440-415a-8c73-3501fc88b01a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e054ea1-6a81-43c7-9746-25b466d4647b", "name": "network-vif-plugged", "status": "completed", "tag": "24859a24-8dd1-490f-b1c7-01178f7f59b2"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:55:06.101172 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:55:06.123420 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-55cf3e11-1132-4eb7-847c-3299b5786d3e req-b5afeb3c-c440-415a-8c73-3501fc88b01a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:06.124270 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-55cf3e11-1132-4eb7-847c-3299b5786d3e req-b5afeb3c-c440-415a-8c73-3501fc88b01a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:06.155196 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-55cf3e11-1132-4eb7-847c-3299b5786d3e req-b5afeb3c-c440-415a-8c73-3501fc88b01a service nova] Creating event network-vif-plugged:24859a24-8dd1-490f-b1c7-01178f7f59b2 for instance 9e054ea1-6a81-43c7-9746-25b466d4647b on n-h2-846435-14 Jul 25 14:55:06.168542 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-55cf3e11-1132-4eb7-847c-3299b5786d3e req-b5afeb3c-c440-415a-8c73-3501fc88b01a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079966 Jul 25 14:55:06.171031 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2804/5344] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:55:06.286480 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-5f7fb032-5390-4244-88b7-e97fa25bbd6e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] validate_networks() for [('0ebdc523-f668-41d1-a367-03b2f469936e', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:55:07.763008 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-5f7fb032-5390-4244-88b7-e97fa25bbd6e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:55:07.763811 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-5f7fb032-5390-4244-88b7-e97fa25bbd6e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:55:07.764691 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-5f7fb032-5390-4244-88b7-e97fa25bbd6e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:55:07.765220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-5f7fb032-5390-4244-88b7-e97fa25bbd6e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:55:07.766002 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-5f7fb032-5390-4244-88b7-e97fa25bbd6e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:55:07.800999 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f7fb032-5390-4244-88b7-e97fa25bbd6e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:07.801461 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f7fb032-5390-4244-88b7-e97fa25bbd6e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:07.802274 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f7fb032-5390-4244-88b7-e97fa25bbd6e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:07.802719 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f7fb032-5390-4244-88b7-e97fa25bbd6e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:07.914571 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-5f7fb032-5390-4244-88b7-e97fa25bbd6e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Getting quotas for project 8dd09177faea4702992aaab182125b5a. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:55:07.938486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-5f7fb032-5390-4244-88b7-e97fa25bbd6e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Getting quotas for user ca46c8e84b8644b69937ec9c06cb0e9a and project 8dd09177faea4702992aaab182125b5a. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:55:08.027076 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5f7fb032-5390-4244-88b7-e97fa25bbd6e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:55:08.038938 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5f7fb032-5390-4244-88b7-e97fa25bbd6e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:55:08.250118 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5f7fb032-5390-4244-88b7-e97fa25bbd6e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.339479 Jul 25 14:55:08.252902 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2541/5345] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:55:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 2343 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 14:55:08.276873 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2f27ccbe-8b10-4a76-8130-276bec99223b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:08.277709 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2f27ccbe-8b10-4a76-8130-276bec99223b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:08.751898 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2f27ccbe-8b10-4a76-8130-276bec99223b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:08.759475 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2f27ccbe-8b10-4a76-8130-276bec99223b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1266 microversion: 2.1 time: 0.497749 Jul 25 14:55:08.786660 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2805/5346] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:08 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1266 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:09.782183 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fb0de5d7-2a1e-4462-bbfc-92115505b6a5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:09.784435 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fb0de5d7-2a1e-4462-bbfc-92115505b6a5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:09.806048 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fb0de5d7-2a1e-4462-bbfc-92115505b6a5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:09.806689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fb0de5d7-2a1e-4462-bbfc-92115505b6a5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:09.807629 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fb0de5d7-2a1e-4462-bbfc-92115505b6a5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:09.808635 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fb0de5d7-2a1e-4462-bbfc-92115505b6a5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:10.571496 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fb0de5d7-2a1e-4462-bbfc-92115505b6a5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:10.580726 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fb0de5d7-2a1e-4462-bbfc-92115505b6a5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1270 microversion: 2.1 time: 0.804009 Jul 25 14:55:10.592357 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2542/5347] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:09 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1270 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:11.601808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c65b072f-1216-4b6d-bae2-2bfd0cc046e8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:11.602434 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c65b072f-1216-4b6d-bae2-2bfd0cc046e8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:11.615144 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c65b072f-1216-4b6d-bae2-2bfd0cc046e8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:11.615796 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c65b072f-1216-4b6d-bae2-2bfd0cc046e8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:11.618084 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c65b072f-1216-4b6d-bae2-2bfd0cc046e8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:11.618524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c65b072f-1216-4b6d-bae2-2bfd0cc046e8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:11.819963 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c65b072f-1216-4b6d-bae2-2bfd0cc046e8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:11.839689 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c65b072f-1216-4b6d-bae2-2bfd0cc046e8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1324 microversion: 2.1 time: 0.241594 Jul 25 14:55:11.848006 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2806/5348] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:11 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1324 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:12.871351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dd2a73f6-51ae-4009-b554-e57f62e2e752 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:12.872720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-dd2a73f6-51ae-4009-b554-e57f62e2e752 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:12.890100 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dd2a73f6-51ae-4009-b554-e57f62e2e752 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:12.891660 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dd2a73f6-51ae-4009-b554-e57f62e2e752 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:12.895828 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dd2a73f6-51ae-4009-b554-e57f62e2e752 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:12.896580 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dd2a73f6-51ae-4009-b554-e57f62e2e752 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:13.231933 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-dd2a73f6-51ae-4009-b554-e57f62e2e752 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:13.240133 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dd2a73f6-51ae-4009-b554-e57f62e2e752 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1324 microversion: 2.1 time: 0.374709 Jul 25 14:55:13.245026 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2543/5349] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:12 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1324 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:14.269128 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7d29465d-cf53-401b-8716-8a8af16a88ad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:14.272009 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7d29465d-cf53-401b-8716-8a8af16a88ad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:14.299073 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d29465d-cf53-401b-8716-8a8af16a88ad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:14.306174 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d29465d-cf53-401b-8716-8a8af16a88ad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:14.308718 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d29465d-cf53-401b-8716-8a8af16a88ad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:14.310555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d29465d-cf53-401b-8716-8a8af16a88ad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:15.019309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7d29465d-cf53-401b-8716-8a8af16a88ad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:15.050688 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7d29465d-cf53-401b-8716-8a8af16a88ad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1392 microversion: 2.1 time: 0.790910 Jul 25 14:55:15.054383 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2807/5350] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:14 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1392 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:16.084107 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-65d250f3-16a1-4f23-b6a3-c3e31ec20fb3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:16.084674 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-65d250f3-16a1-4f23-b6a3-c3e31ec20fb3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:16.096583 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-65d250f3-16a1-4f23-b6a3-c3e31ec20fb3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:16.103418 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-65d250f3-16a1-4f23-b6a3-c3e31ec20fb3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:16.106608 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-65d250f3-16a1-4f23-b6a3-c3e31ec20fb3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:16.116236 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-65d250f3-16a1-4f23-b6a3-c3e31ec20fb3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:16.949536 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-65d250f3-16a1-4f23-b6a3-c3e31ec20fb3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:16.958465 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-65d250f3-16a1-4f23-b6a3-c3e31ec20fb3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1392 microversion: 2.1 time: 0.878192 Jul 25 14:55:16.965698 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2544/5351] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:16 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1392 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:17.250435 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-ba6512b6-ea9b-4882-a7bc-1f3b1e96efc7 req-0d2782f6-2678-4ae9-b79a-746af69bf713 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d027db2-6df4-4295-a5e1-d8886d34018d", "tag": "6edba24d-b14c-4866-afee-2438b889d8bb"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:55:17.291862 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ba6512b6-ea9b-4882-a7bc-1f3b1e96efc7 req-0d2782f6-2678-4ae9-b79a-746af69bf713 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:17.298967 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ba6512b6-ea9b-4882-a7bc-1f3b1e96efc7 req-0d2782f6-2678-4ae9-b79a-746af69bf713 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:17.361323 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-ba6512b6-ea9b-4882-a7bc-1f3b1e96efc7 req-0d2782f6-2678-4ae9-b79a-746af69bf713 service nova] Creating event network-changed:6edba24d-b14c-4866-afee-2438b889d8bb for instance 4d027db2-6df4-4295-a5e1-d8886d34018d on n-h1-846435-14 Jul 25 14:55:17.392794 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-ba6512b6-ea9b-4882-a7bc-1f3b1e96efc7 req-0d2782f6-2678-4ae9-b79a-746af69bf713 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148894 Jul 25 14:55:17.398695 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2808/5352] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:55:17.989463 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2e688391-085b-4a0c-aff9-8fbbeb7248c1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:17.990082 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2e688391-085b-4a0c-aff9-8fbbeb7248c1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:17.999559 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:55:18.002548 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:55:18.006838 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2e688391-085b-4a0c-aff9-8fbbeb7248c1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:18.008501 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2e688391-085b-4a0c-aff9-8fbbeb7248c1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:18.009485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2e688391-085b-4a0c-aff9-8fbbeb7248c1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:18.011923 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2e688391-085b-4a0c-aff9-8fbbeb7248c1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:18.826966 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2e688391-085b-4a0c-aff9-8fbbeb7248c1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:18.857730 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2e688391-085b-4a0c-aff9-8fbbeb7248c1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1392 microversion: 2.1 time: 0.872222 Jul 25 14:55:18.858349 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2545/5353] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:17 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1392 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:55:19.876701 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:55:19.882134 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-47b87c41-2539-4ae5-ae27-0c32253f518f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:19.882948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-47b87c41-2539-4ae5-ae27-0c32253f518f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:19.912275 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-47b87c41-2539-4ae5-ae27-0c32253f518f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:19.912875 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-47b87c41-2539-4ae5-ae27-0c32253f518f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:19.913743 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-47b87c41-2539-4ae5-ae27-0c32253f518f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:19.914411 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-47b87c41-2539-4ae5-ae27-0c32253f518f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:20.745927 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-051e7851-a2f2-4668-9adf-c22de11692e0 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-775032726", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "07ce225f-9164-4b7a-ad69-9cad8361a45c"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:55:20.802779 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-47b87c41-2539-4ae5-ae27-0c32253f518f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:20.812126 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-47b87c41-2539-4ae5-ae27-0c32253f518f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1392 microversion: 2.1 time: 0.937037 Jul 25 14:55:20.819433 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2809/5354] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:19 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1392 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:20.897658 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-051e7851-a2f2-4668-9adf-c22de11692e0 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] validate_networks() for [('07ce225f-9164-4b7a-ad69-9cad8361a45c', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:55:21.839651 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e0eca2e1-3fa1-4df6-8b3d-c49343ab2d6b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:21.840475 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e0eca2e1-3fa1-4df6-8b3d-c49343ab2d6b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:21.848801 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e0eca2e1-3fa1-4df6-8b3d-c49343ab2d6b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:21.849246 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e0eca2e1-3fa1-4df6-8b3d-c49343ab2d6b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:21.859092 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e0eca2e1-3fa1-4df6-8b3d-c49343ab2d6b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:21.859549 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e0eca2e1-3fa1-4df6-8b3d-c49343ab2d6b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:22.350909 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e0eca2e1-3fa1-4df6-8b3d-c49343ab2d6b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:22.358898 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e0eca2e1-3fa1-4df6-8b3d-c49343ab2d6b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1392 microversion: 2.1 time: 0.523101 Jul 25 14:55:22.359447 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2810/5355] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:21 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1392 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:55:22.565469 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-051e7851-a2f2-4668-9adf-c22de11692e0 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:55:22.566167 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-051e7851-a2f2-4668-9adf-c22de11692e0 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:55:22.566394 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-051e7851-a2f2-4668-9adf-c22de11692e0 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:55:22.567059 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-051e7851-a2f2-4668-9adf-c22de11692e0 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:55:22.567660 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-051e7851-a2f2-4668-9adf-c22de11692e0 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:55:22.589209 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-051e7851-a2f2-4668-9adf-c22de11692e0 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:22.589708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-051e7851-a2f2-4668-9adf-c22de11692e0 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:22.590459 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-051e7851-a2f2-4668-9adf-c22de11692e0 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:22.590972 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-051e7851-a2f2-4668-9adf-c22de11692e0 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:22.616832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-051e7851-a2f2-4668-9adf-c22de11692e0 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Getting quotas for project 6f1b698373774d8d9c5793628380d87c. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:55:22.623014 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-051e7851-a2f2-4668-9adf-c22de11692e0 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Getting quotas for user 150c3183768349a78d0ed356d7d44c72 and project 6f1b698373774d8d9c5793628380d87c. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:55:22.637558 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-051e7851-a2f2-4668-9adf-c22de11692e0 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:55:22.640122 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-051e7851-a2f2-4668-9adf-c22de11692e0 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] [instance: 6d378a2c-1b48-46cc-86f1-46534f04c545] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:55:22.746864 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-051e7851-a2f2-4668-9adf-c22de11692e0 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.381105 Jul 25 14:55:22.748331 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2546/5356] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:55:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2383 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 14:55:22.760365 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d7215ac5-f246-48ce-bd50-fe44638a71c8 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:22.761351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d7215ac5-f246-48ce-bd50-fe44638a71c8 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] [instance: 6d378a2c-1b48-46cc-86f1-46534f04c545] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:22.986563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d7215ac5-f246-48ce-bd50-fe44638a71c8 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150c3183768349a78d0ed356d7d44c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1b698373774d8d9c5793628380d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:22.999859 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d7215ac5-f246-48ce-bd50-fe44638a71c8 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] 10.222.0.88 "GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545" status: 200 len: 1213 microversion: 2.1 time: 0.244243 Jul 25 14:55:23.008544 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2811/5357] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:22 2022] GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545 => generated 1213 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:23.386245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-17913319-182e-47c0-940f-10490e10ee78 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:23.386897 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-17913319-182e-47c0-940f-10490e10ee78 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:23.403238 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-17913319-182e-47c0-940f-10490e10ee78 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:23.403659 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-17913319-182e-47c0-940f-10490e10ee78 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:23.404500 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-17913319-182e-47c0-940f-10490e10ee78 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:23.404942 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-17913319-182e-47c0-940f-10490e10ee78 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:23.762346 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-17913319-182e-47c0-940f-10490e10ee78 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:23.775881 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-17913319-182e-47c0-940f-10490e10ee78 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1392 microversion: 2.1 time: 0.394241 Jul 25 14:55:23.779322 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2547/5358] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:23 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1392 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:23.853756 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-71c01266-8f59-438d-a100-b84585786879 req-eb88187a-14ad-4a2a-8064-db2ee77d64dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d027db2-6df4-4295-a5e1-d8886d34018d", "name": "network-vif-plugged", "status": "completed", "tag": "6edba24d-b14c-4866-afee-2438b889d8bb"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:55:23.879832 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-71c01266-8f59-438d-a100-b84585786879 req-eb88187a-14ad-4a2a-8064-db2ee77d64dd service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:23.880563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-71c01266-8f59-438d-a100-b84585786879 req-eb88187a-14ad-4a2a-8064-db2ee77d64dd service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:23.897529 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=39 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:55:23.932314 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-71c01266-8f59-438d-a100-b84585786879 req-eb88187a-14ad-4a2a-8064-db2ee77d64dd service nova] Creating event network-vif-plugged:6edba24d-b14c-4866-afee-2438b889d8bb for instance 4d027db2-6df4-4295-a5e1-d8886d34018d on n-h1-846435-14 Jul 25 14:55:23.953170 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-71c01266-8f59-438d-a100-b84585786879 req-eb88187a-14ad-4a2a-8064-db2ee77d64dd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100693 Jul 25 14:55:23.955863 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2812/5359] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:55:24.032528 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fe254dd6-a99e-42a6-be30-de702f44f33b tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:24.033303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fe254dd6-a99e-42a6-be30-de702f44f33b tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] [instance: 6d378a2c-1b48-46cc-86f1-46534f04c545] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:24.045925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fe254dd6-a99e-42a6-be30-de702f44f33b tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:24.052630 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fe254dd6-a99e-42a6-be30-de702f44f33b tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:24.057674 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fe254dd6-a99e-42a6-be30-de702f44f33b tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:24.060923 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fe254dd6-a99e-42a6-be30-de702f44f33b tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:24.441047 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fe254dd6-a99e-42a6-be30-de702f44f33b tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150c3183768349a78d0ed356d7d44c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1b698373774d8d9c5793628380d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:24.454190 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fe254dd6-a99e-42a6-be30-de702f44f33b tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] 10.222.0.88 "GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545" status: 200 len: 1209 microversion: 2.1 time: 0.425680 Jul 25 14:55:24.455386 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2548/5360] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:24 2022] GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545 => generated 1209 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:24.801367 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f26b77a6-8ff4-43d8-8748-20d8776ab633 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:24.802091 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f26b77a6-8ff4-43d8-8748-20d8776ab633 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:24.819875 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f26b77a6-8ff4-43d8-8748-20d8776ab633 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:24.820383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f26b77a6-8ff4-43d8-8748-20d8776ab633 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:24.821192 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f26b77a6-8ff4-43d8-8748-20d8776ab633 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:24.823931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f26b77a6-8ff4-43d8-8748-20d8776ab633 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:25.476051 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-639cb08d-81bf-46bc-adb9-5a98bad95e3e tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:25.476716 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-639cb08d-81bf-46bc-adb9-5a98bad95e3e tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] [instance: 6d378a2c-1b48-46cc-86f1-46534f04c545] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:25.508363 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-639cb08d-81bf-46bc-adb9-5a98bad95e3e tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:25.511232 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-639cb08d-81bf-46bc-adb9-5a98bad95e3e tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:25.516493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-639cb08d-81bf-46bc-adb9-5a98bad95e3e tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:25.517275 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-639cb08d-81bf-46bc-adb9-5a98bad95e3e tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:25.776135 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-639cb08d-81bf-46bc-adb9-5a98bad95e3e tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150c3183768349a78d0ed356d7d44c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1b698373774d8d9c5793628380d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:25.785916 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-639cb08d-81bf-46bc-adb9-5a98bad95e3e tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] 10.222.0.88 "GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545" status: 200 len: 1271 microversion: 2.1 time: 0.313187 Jul 25 14:55:25.786528 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2549/5361] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:25 2022] GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545 => generated 1271 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:26.176827 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f26b77a6-8ff4-43d8-8748-20d8776ab633 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:26.186420 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f26b77a6-8ff4-43d8-8748-20d8776ab633 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1392 microversion: 2.1 time: 1.391280 Jul 25 14:55:26.195795 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2813/5362] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:24 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1392 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:26.812943 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2ecb12b7-e943-46a2-9fdc-755a15063040 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:26.814173 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2ecb12b7-e943-46a2-9fdc-755a15063040 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] [instance: 6d378a2c-1b48-46cc-86f1-46534f04c545] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:26.831806 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ecb12b7-e943-46a2-9fdc-755a15063040 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:26.833252 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ecb12b7-e943-46a2-9fdc-755a15063040 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:26.838235 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ecb12b7-e943-46a2-9fdc-755a15063040 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:26.840777 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ecb12b7-e943-46a2-9fdc-755a15063040 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:27.216842 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a48a58d6-cf63-425b-b3dc-e905f5561d1e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:27.217637 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a48a58d6-cf63-425b-b3dc-e905f5561d1e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:27.233034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a48a58d6-cf63-425b-b3dc-e905f5561d1e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:27.237619 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a48a58d6-cf63-425b-b3dc-e905f5561d1e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:27.246356 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a48a58d6-cf63-425b-b3dc-e905f5561d1e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:27.247165 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a48a58d6-cf63-425b-b3dc-e905f5561d1e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:28.020937 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a48a58d6-cf63-425b-b3dc-e905f5561d1e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:28.030026 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a48a58d6-cf63-425b-b3dc-e905f5561d1e tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1565 microversion: 2.1 time: 0.817540 Jul 25 14:55:28.055482 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2814/5363] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:27 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1565 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:55:28.071536 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1345646b-4e7a-49be-af10-635498d4cb38 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:28.072195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1345646b-4e7a-49be-af10-635498d4cb38 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:28.124723 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1345646b-4e7a-49be-af10-635498d4cb38 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:28.125462 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1345646b-4e7a-49be-af10-635498d4cb38 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:28.128521 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1345646b-4e7a-49be-af10-635498d4cb38 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:28.129814 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1345646b-4e7a-49be-af10-635498d4cb38 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:28.247993 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2ecb12b7-e943-46a2-9fdc-755a15063040 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150c3183768349a78d0ed356d7d44c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1b698373774d8d9c5793628380d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:28.258620 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2ecb12b7-e943-46a2-9fdc-755a15063040 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] 10.222.0.88 "GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545" status: 200 len: 1313 microversion: 2.1 time: 1.449920 Jul 25 14:55:28.260151 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2550/5364] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:26 2022] GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545 => generated 1313 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:28.759342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1345646b-4e7a-49be-af10-635498d4cb38 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:28.780594 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1345646b-4e7a-49be-af10-635498d4cb38 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1565 microversion: 2.1 time: 0.723556 Jul 25 14:55:28.781199 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2815/5365] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:28 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1565 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:29.286338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0cf4a1a4-e057-4497-9c75-4880f4d6403d tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:29.286958 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0cf4a1a4-e057-4497-9c75-4880f4d6403d tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] [instance: 6d378a2c-1b48-46cc-86f1-46534f04c545] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:29.294341 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0cf4a1a4-e057-4497-9c75-4880f4d6403d tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:29.294785 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0cf4a1a4-e057-4497-9c75-4880f4d6403d tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:29.295565 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0cf4a1a4-e057-4497-9c75-4880f4d6403d tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:29.311629 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0cf4a1a4-e057-4497-9c75-4880f4d6403d tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:30.187988 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0cf4a1a4-e057-4497-9c75-4880f4d6403d tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150c3183768349a78d0ed356d7d44c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1b698373774d8d9c5793628380d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:30.196420 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0cf4a1a4-e057-4497-9c75-4880f4d6403d tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] 10.222.0.88 "GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545" status: 200 len: 1313 microversion: 2.1 time: 0.913893 Jul 25 14:55:30.205227 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2551/5366] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:29 2022] GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545 => generated 1313 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:30.537784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-18243286-4fa3-43dc-b3a3-f4fde59334cd req-bceb3bf2-63e5-4332-8528-0aea42ed7f65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d378a2c-1b48-46cc-86f1-46534f04c545", "tag": "17e6bc71-c8bc-4192-aef4-9782cf0cb6ce"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:55:30.562974 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-18243286-4fa3-43dc-b3a3-f4fde59334cd req-bceb3bf2-63e5-4332-8528-0aea42ed7f65 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:30.563418 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-18243286-4fa3-43dc-b3a3-f4fde59334cd req-bceb3bf2-63e5-4332-8528-0aea42ed7f65 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:30.597025 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-18243286-4fa3-43dc-b3a3-f4fde59334cd req-bceb3bf2-63e5-4332-8528-0aea42ed7f65 service nova] Creating event network-changed:17e6bc71-c8bc-4192-aef4-9782cf0cb6ce for instance 6d378a2c-1b48-46cc-86f1-46534f04c545 on n-h2-846435-14 Jul 25 14:55:30.632537 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-18243286-4fa3-43dc-b3a3-f4fde59334cd req-bceb3bf2-63e5-4332-8528-0aea42ed7f65 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085136 Jul 25 14:55:30.638029 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2816/5367] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:55:31.237907 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0b966003-1b4f-47a3-a1a8-3a9f2f2539ed tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:31.239279 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0b966003-1b4f-47a3-a1a8-3a9f2f2539ed tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] [instance: 6d378a2c-1b48-46cc-86f1-46534f04c545] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:31.317846 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b966003-1b4f-47a3-a1a8-3a9f2f2539ed tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:31.321703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b966003-1b4f-47a3-a1a8-3a9f2f2539ed tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:31.330461 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b966003-1b4f-47a3-a1a8-3a9f2f2539ed tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:31.333832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b966003-1b4f-47a3-a1a8-3a9f2f2539ed tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:31.827063 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0b966003-1b4f-47a3-a1a8-3a9f2f2539ed tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150c3183768349a78d0ed356d7d44c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1b698373774d8d9c5793628380d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:31.842770 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0b966003-1b4f-47a3-a1a8-3a9f2f2539ed tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] 10.222.0.88 "GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545" status: 200 len: 1313 microversion: 2.1 time: 0.628725 Jul 25 14:55:31.856182 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2552/5368] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:31 2022] GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545 => generated 1313 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:32.864473 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bbe3c6ae-d9cc-42b2-ad59-1a095330c9f6 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:32.865381 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bbe3c6ae-d9cc-42b2-ad59-1a095330c9f6 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] [instance: 6d378a2c-1b48-46cc-86f1-46534f04c545] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:32.876961 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bbe3c6ae-d9cc-42b2-ad59-1a095330c9f6 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:32.879291 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bbe3c6ae-d9cc-42b2-ad59-1a095330c9f6 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:32.880218 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bbe3c6ae-d9cc-42b2-ad59-1a095330c9f6 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:32.884262 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bbe3c6ae-d9cc-42b2-ad59-1a095330c9f6 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:32.991521 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:55:33.628548 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bbe3c6ae-d9cc-42b2-ad59-1a095330c9f6 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150c3183768349a78d0ed356d7d44c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1b698373774d8d9c5793628380d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:33.644769 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bbe3c6ae-d9cc-42b2-ad59-1a095330c9f6 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] 10.222.0.88 "GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545" status: 200 len: 1313 microversion: 2.1 time: 0.777051 Jul 25 14:55:33.645974 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2817/5369] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:32 2022] GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545 => generated 1313 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:34.680836 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-62b3ad35-8c7d-4ca1-a7f8-02ea50569355 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:34.681607 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-62b3ad35-8c7d-4ca1-a7f8-02ea50569355 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] [instance: 6d378a2c-1b48-46cc-86f1-46534f04c545] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:34.727532 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:55:34.728542 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:55:34.743803 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-62b3ad35-8c7d-4ca1-a7f8-02ea50569355 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:34.756317 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-62b3ad35-8c7d-4ca1-a7f8-02ea50569355 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:34.772714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-62b3ad35-8c7d-4ca1-a7f8-02ea50569355 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:34.786227 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-62b3ad35-8c7d-4ca1-a7f8-02ea50569355 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:35.490190 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-62b3ad35-8c7d-4ca1-a7f8-02ea50569355 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150c3183768349a78d0ed356d7d44c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1b698373774d8d9c5793628380d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:35.498822 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-62b3ad35-8c7d-4ca1-a7f8-02ea50569355 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] 10.222.0.88 "GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545" status: 200 len: 1313 microversion: 2.1 time: 0.834218 Jul 25 14:55:35.504607 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2553/5370] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:34 2022] GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545 => generated 1313 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:36.258901 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-728531c0-d890-4a84-aa90-131310c61953 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:36.260533 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-728531c0-d890-4a84-aa90-131310c61953 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:36.284495 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-728531c0-d890-4a84-aa90-131310c61953 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:36.284495 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-728531c0-d890-4a84-aa90-131310c61953 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:36.284495 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-728531c0-d890-4a84-aa90-131310c61953 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:36.284495 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-728531c0-d890-4a84-aa90-131310c61953 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:36.284916 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-78ed4a10-93fb-42c3-a9bd-656f3901a501 req-33a216ec-aa04-4267-bcfe-f2479dab8f56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d027db2-6df4-4295-a5e1-d8886d34018d", "tag": "6edba24d-b14c-4866-afee-2438b889d8bb"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:55:36.315531 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:55:36.326569 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-78ed4a10-93fb-42c3-a9bd-656f3901a501 req-33a216ec-aa04-4267-bcfe-f2479dab8f56 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:36.328455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-78ed4a10-93fb-42c3-a9bd-656f3901a501 req-33a216ec-aa04-4267-bcfe-f2479dab8f56 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:36.362477 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=71 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:55:36.371304 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-78ed4a10-93fb-42c3-a9bd-656f3901a501 req-33a216ec-aa04-4267-bcfe-f2479dab8f56 service nova] Creating event network-changed:6edba24d-b14c-4866-afee-2438b889d8bb for instance 4d027db2-6df4-4295-a5e1-d8886d34018d on n-h1-846435-14 Jul 25 14:55:36.395396 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-78ed4a10-93fb-42c3-a9bd-656f3901a501 req-33a216ec-aa04-4267-bcfe-f2479dab8f56 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115230 Jul 25 14:55:36.396580 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2554/5371] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:55:36.529094 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-90306bce-1ceb-4756-9993-64ba870ba4d6 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:36.530120 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-90306bce-1ceb-4756-9993-64ba870ba4d6 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] [instance: 6d378a2c-1b48-46cc-86f1-46534f04c545] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:36.557377 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-90306bce-1ceb-4756-9993-64ba870ba4d6 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:36.557881 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-90306bce-1ceb-4756-9993-64ba870ba4d6 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:36.558713 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-90306bce-1ceb-4756-9993-64ba870ba4d6 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:36.581496 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-90306bce-1ceb-4756-9993-64ba870ba4d6 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:36.813906 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-728531c0-d890-4a84-aa90-131310c61953 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:36.819555 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-728531c0-d890-4a84-aa90-131310c61953 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1565 microversion: 2.1 time: 0.566022 Jul 25 14:55:36.823696 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2818/5372] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:36 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1565 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:37.138139 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-90306bce-1ceb-4756-9993-64ba870ba4d6 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150c3183768349a78d0ed356d7d44c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1b698373774d8d9c5793628380d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:37.154283 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-90306bce-1ceb-4756-9993-64ba870ba4d6 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] 10.222.0.88 "GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545" status: 200 len: 1313 microversion: 2.1 time: 0.631846 Jul 25 14:55:37.181183 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2555/5373] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:36 2022] GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545 => generated 1313 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:55:38.031670 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3a795167-1d41-4be4-ad75-0165e356c361 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:38.032326 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3a795167-1d41-4be4-ad75-0165e356c361 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:38.053652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a795167-1d41-4be4-ad75-0165e356c361 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:38.054420 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a795167-1d41-4be4-ad75-0165e356c361 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:38.055395 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a795167-1d41-4be4-ad75-0165e356c361 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:38.056566 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a795167-1d41-4be4-ad75-0165e356c361 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:38.201337 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-55732b94-d3be-4e03-82f3-c2c1c3522d7f tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:38.201980 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-55732b94-d3be-4e03-82f3-c2c1c3522d7f tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] [instance: 6d378a2c-1b48-46cc-86f1-46534f04c545] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:38.270603 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-55732b94-d3be-4e03-82f3-c2c1c3522d7f tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:38.271127 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-55732b94-d3be-4e03-82f3-c2c1c3522d7f tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:38.272047 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-55732b94-d3be-4e03-82f3-c2c1c3522d7f tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:38.275266 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-55732b94-d3be-4e03-82f3-c2c1c3522d7f tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:38.430712 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3a795167-1d41-4be4-ad75-0165e356c361 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:38.439551 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3a795167-1d41-4be4-ad75-0165e356c361 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.412812 Jul 25 14:55:38.445671 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2819/5374] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:38 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:38.469698 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dd0561f3-126f-4b85-a7f5-ccfabece6edd tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1870332420"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:55:38.472336 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dd0561f3-126f-4b85-a7f5-ccfabece6edd tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:38.480173 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=36 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:55:38.503696 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd0561f3-126f-4b85-a7f5-ccfabece6edd tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:38.506954 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd0561f3-126f-4b85-a7f5-ccfabece6edd tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:38.508284 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd0561f3-126f-4b85-a7f5-ccfabece6edd tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:38.508938 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd0561f3-126f-4b85-a7f5-ccfabece6edd tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:38.964502 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dd0561f3-126f-4b85-a7f5-ccfabece6edd tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action" status: 202 len: 0 microversion: 2.1 time: 0.498832 Jul 25 14:55:38.969423 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2820/5375] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:55:38 2022] POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 25 14:55:38.977028 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4dd24654-054b-465b-9b50-5301d39b63ff tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-882006318", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:55:39.006674 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-55732b94-d3be-4e03-82f3-c2c1c3522d7f tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150c3183768349a78d0ed356d7d44c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1b698373774d8d9c5793628380d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:39.016948 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-55732b94-d3be-4e03-82f3-c2c1c3522d7f tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] 10.222.0.88 "GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545" status: 200 len: 1313 microversion: 2.1 time: 0.828394 Jul 25 14:55:39.031416 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2556/5376] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:38 2022] GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545 => generated 1313 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:39.044423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-29d1a429-0a41-415a-822d-36b48aded060 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:39.045239 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-29d1a429-0a41-415a-822d-36b48aded060 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:39.054737 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-4dd24654-054b-465b-9b50-5301d39b63ff tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] validate_networks() for None {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:55:39.068966 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-29d1a429-0a41-415a-822d-36b48aded060 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:39.070788 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-29d1a429-0a41-415a-822d-36b48aded060 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:39.073032 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-29d1a429-0a41-415a-822d-36b48aded060 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:39.073919 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-29d1a429-0a41-415a-822d-36b48aded060 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:39.614816 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-29d1a429-0a41-415a-822d-36b48aded060 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:39.627172 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-29d1a429-0a41-415a-822d-36b48aded060 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1680 microversion: 2.1 time: 0.594193 Jul 25 14:55:39.642313 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2557/5377] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:39 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1680 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:39.652363 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-4dd24654-054b-465b-9b50-5301d39b63ff tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:55:39.652688 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-4dd24654-054b-465b-9b50-5301d39b63ff tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:55:39.653346 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-4dd24654-054b-465b-9b50-5301d39b63ff tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:55:39.653911 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-4dd24654-054b-465b-9b50-5301d39b63ff tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:55:39.654499 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-4dd24654-054b-465b-9b50-5301d39b63ff tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:55:39.668089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4dd24654-054b-465b-9b50-5301d39b63ff tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:39.668970 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4dd24654-054b-465b-9b50-5301d39b63ff tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:39.670105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4dd24654-054b-465b-9b50-5301d39b63ff tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:39.670684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4dd24654-054b-465b-9b50-5301d39b63ff tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:39.690430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-4dd24654-054b-465b-9b50-5301d39b63ff tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Getting quotas for project ea69016f034f4a8ca1774789b71100f7. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:55:39.696535 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-4dd24654-054b-465b-9b50-5301d39b63ff tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Getting quotas for user 2db7c1475dda40b7bac6e1c11bb08ab3 and project ea69016f034f4a8ca1774789b71100f7. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:55:39.710543 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4dd24654-054b-465b-9b50-5301d39b63ff tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:55:39.713389 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4dd24654-054b-465b-9b50-5301d39b63ff tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] [instance: 90b721e0-9e11-412d-8b3c-ec13558486df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:55:39.717941 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-2627c5f0-5045-4c44-96c0-8ed1fa0c52e4 req-97f7dfa7-2b07-4c07-9559-5dd4e03b7b27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d378a2c-1b48-46cc-86f1-46534f04c545", "name": "network-vif-plugged", "status": "completed", "tag": "17e6bc71-c8bc-4192-aef4-9782cf0cb6ce"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:55:39.733041 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-2627c5f0-5045-4c44-96c0-8ed1fa0c52e4 req-97f7dfa7-2b07-4c07-9559-5dd4e03b7b27 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:39.733500 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-2627c5f0-5045-4c44-96c0-8ed1fa0c52e4 req-97f7dfa7-2b07-4c07-9559-5dd4e03b7b27 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:39.759233 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-2627c5f0-5045-4c44-96c0-8ed1fa0c52e4 req-97f7dfa7-2b07-4c07-9559-5dd4e03b7b27 service nova] Creating event network-vif-plugged:17e6bc71-c8bc-4192-aef4-9782cf0cb6ce for instance 6d378a2c-1b48-46cc-86f1-46534f04c545 on n-h2-846435-14 Jul 25 14:55:39.765376 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-2627c5f0-5045-4c44-96c0-8ed1fa0c52e4 req-97f7dfa7-2b07-4c07-9559-5dd4e03b7b27 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051740 Jul 25 14:55:39.767206 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2558/5378] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:55:39.798576 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4dd24654-054b-465b-9b50-5301d39b63ff tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.815667 Jul 25 14:55:39.806959 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2821/5379] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:55:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:55:39.811437 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-eadf2521-8085-4327-9124-03d10b16d503 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:39.812183 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-eadf2521-8085-4327-9124-03d10b16d503 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] [instance: 90b721e0-9e11-412d-8b3c-ec13558486df] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:39.927520 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-eadf2521-8085-4327-9124-03d10b16d503 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db7c1475dda40b7bac6e1c11bb08ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea69016f034f4a8ca1774789b71100f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:39.934657 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-eadf2521-8085-4327-9124-03d10b16d503 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] 10.222.0.88 "GET /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df" status: 200 len: 1213 microversion: 2.1 time: 0.127825 Jul 25 14:55:39.935731 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2559/5380] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:39 2022] GET /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df => generated 1213 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:40.044305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-385c0b00-2cdd-4532-8cd0-9a9b157cab57 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:40.049793 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-385c0b00-2cdd-4532-8cd0-9a9b157cab57 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] [instance: 6d378a2c-1b48-46cc-86f1-46534f04c545] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:40.073543 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-385c0b00-2cdd-4532-8cd0-9a9b157cab57 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:40.074192 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-385c0b00-2cdd-4532-8cd0-9a9b157cab57 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:40.074749 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-385c0b00-2cdd-4532-8cd0-9a9b157cab57 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:40.083356 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-385c0b00-2cdd-4532-8cd0-9a9b157cab57 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:40.386750 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-385c0b00-2cdd-4532-8cd0-9a9b157cab57 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150c3183768349a78d0ed356d7d44c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1b698373774d8d9c5793628380d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:40.397325 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-385c0b00-2cdd-4532-8cd0-9a9b157cab57 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] 10.222.0.88 "GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545" status: 200 len: 1313 microversion: 2.1 time: 0.361025 Jul 25 14:55:40.398444 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2822/5381] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:40 2022] GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545 => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:40.650588 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-12be8ce0-4164-4aec-8714-9fb6d75b13b6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:40.651317 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-12be8ce0-4164-4aec-8714-9fb6d75b13b6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:40.669472 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-12be8ce0-4164-4aec-8714-9fb6d75b13b6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:40.669764 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-12be8ce0-4164-4aec-8714-9fb6d75b13b6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:40.671311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-12be8ce0-4164-4aec-8714-9fb6d75b13b6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:40.671806 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-12be8ce0-4164-4aec-8714-9fb6d75b13b6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:40.882785 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-12be8ce0-4164-4aec-8714-9fb6d75b13b6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:40.928300 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-12be8ce0-4164-4aec-8714-9fb6d75b13b6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1680 microversion: 2.1 time: 0.281597 Jul 25 14:55:40.929199 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2560/5382] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:40 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1680 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:55:40.956783 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a782bd5a-b62a-4689-be72-6a7436a98d86 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:40.957497 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a782bd5a-b62a-4689-be72-6a7436a98d86 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] [instance: 90b721e0-9e11-412d-8b3c-ec13558486df] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:40.963961 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a782bd5a-b62a-4689-be72-6a7436a98d86 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:40.964449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a782bd5a-b62a-4689-be72-6a7436a98d86 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:40.965299 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a782bd5a-b62a-4689-be72-6a7436a98d86 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:40.965776 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a782bd5a-b62a-4689-be72-6a7436a98d86 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:41.070445 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a782bd5a-b62a-4689-be72-6a7436a98d86 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db7c1475dda40b7bac6e1c11bb08ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea69016f034f4a8ca1774789b71100f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:41.089822 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a782bd5a-b62a-4689-be72-6a7436a98d86 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] 10.222.0.88 "GET /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df" status: 200 len: 1265 microversion: 2.1 time: 0.138524 Jul 25 14:55:41.090785 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2823/5383] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:40 2022] GET /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:41.417401 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c861056e-9924-496d-85f6-3320d732577b tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:41.418396 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c861056e-9924-496d-85f6-3320d732577b tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] [instance: 6d378a2c-1b48-46cc-86f1-46534f04c545] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:41.431666 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c861056e-9924-496d-85f6-3320d732577b tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:41.432527 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c861056e-9924-496d-85f6-3320d732577b tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:41.433569 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c861056e-9924-496d-85f6-3320d732577b tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:41.434221 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c861056e-9924-496d-85f6-3320d732577b tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:41.836027 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-c722ef4e-d710-46a1-8570-f4b6e95659e0 req-a9f2b02d-5e4e-4da6-a7cf-3479ca1d75f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e054ea1-6a81-43c7-9746-25b466d4647b", "name": "network-vif-unplugged", "status": "completed", "tag": "24859a24-8dd1-490f-b1c7-01178f7f59b2"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:55:41.857707 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c722ef4e-d710-46a1-8570-f4b6e95659e0 req-a9f2b02d-5e4e-4da6-a7cf-3479ca1d75f9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:41.859570 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c722ef4e-d710-46a1-8570-f4b6e95659e0 req-a9f2b02d-5e4e-4da6-a7cf-3479ca1d75f9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:41.901949 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-c722ef4e-d710-46a1-8570-f4b6e95659e0 req-a9f2b02d-5e4e-4da6-a7cf-3479ca1d75f9 service nova] Creating event network-vif-unplugged:24859a24-8dd1-490f-b1c7-01178f7f59b2 for instance 9e054ea1-6a81-43c7-9746-25b466d4647b on n-h2-846435-14 Jul 25 14:55:41.917712 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-c722ef4e-d710-46a1-8570-f4b6e95659e0 req-a9f2b02d-5e4e-4da6-a7cf-3479ca1d75f9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086757 Jul 25 14:55:41.918514 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2824/5384] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:55:41.951609 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-efdeda2b-3eee-4aeb-9b6a-58cee136ea1d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:41.952567 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-efdeda2b-3eee-4aeb-9b6a-58cee136ea1d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:41.974111 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-efdeda2b-3eee-4aeb-9b6a-58cee136ea1d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:41.974737 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-efdeda2b-3eee-4aeb-9b6a-58cee136ea1d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:41.975682 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-efdeda2b-3eee-4aeb-9b6a-58cee136ea1d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:41.976304 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-efdeda2b-3eee-4aeb-9b6a-58cee136ea1d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:42.191110 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c861056e-9924-496d-85f6-3320d732577b tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150c3183768349a78d0ed356d7d44c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1b698373774d8d9c5793628380d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:42.199626 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c861056e-9924-496d-85f6-3320d732577b tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] 10.222.0.88 "GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545" status: 200 len: 1313 microversion: 2.1 time: 0.786060 Jul 25 14:55:42.205124 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2561/5385] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:41 2022] GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545 => generated 1313 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:42.219672 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b79cf5fd-69ed-4e8d-889f-fe91957393fa tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:42.220366 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b79cf5fd-69ed-4e8d-889f-fe91957393fa tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] [instance: 90b721e0-9e11-412d-8b3c-ec13558486df] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:42.237973 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b79cf5fd-69ed-4e8d-889f-fe91957393fa tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:42.238423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b79cf5fd-69ed-4e8d-889f-fe91957393fa tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:42.239198 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b79cf5fd-69ed-4e8d-889f-fe91957393fa tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:42.239631 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b79cf5fd-69ed-4e8d-889f-fe91957393fa tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:42.344532 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-efdeda2b-3eee-4aeb-9b6a-58cee136ea1d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:42.355547 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-efdeda2b-3eee-4aeb-9b6a-58cee136ea1d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1680 microversion: 2.1 time: 0.408552 Jul 25 14:55:42.370557 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2825/5386] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:41 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1680 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:55:42.377740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b79cf5fd-69ed-4e8d-889f-fe91957393fa tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db7c1475dda40b7bac6e1c11bb08ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea69016f034f4a8ca1774789b71100f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:42.388987 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b79cf5fd-69ed-4e8d-889f-fe91957393fa tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] 10.222.0.88 "GET /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df" status: 200 len: 1271 microversion: 2.1 time: 0.182744 Jul 25 14:55:42.389593 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2562/5387] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:42 2022] GET /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df => generated 1271 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:43.225655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-925db1c3-90d0-49dc-94cd-fef26219abbb tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:43.226150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-925db1c3-90d0-49dc-94cd-fef26219abbb tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] [instance: 6d378a2c-1b48-46cc-86f1-46534f04c545] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:43.238309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-925db1c3-90d0-49dc-94cd-fef26219abbb tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:43.238964 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-925db1c3-90d0-49dc-94cd-fef26219abbb tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:43.240792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-925db1c3-90d0-49dc-94cd-fef26219abbb tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:43.241441 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-925db1c3-90d0-49dc-94cd-fef26219abbb tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:43.392710 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-efa00939-c8a1-43df-b3e7-1942210ee12a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:43.394413 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-efa00939-c8a1-43df-b3e7-1942210ee12a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:43.415572 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-efa00939-c8a1-43df-b3e7-1942210ee12a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:43.416049 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-efa00939-c8a1-43df-b3e7-1942210ee12a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:43.416832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-efa00939-c8a1-43df-b3e7-1942210ee12a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:43.417264 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-efa00939-c8a1-43df-b3e7-1942210ee12a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:43.486105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-925db1c3-90d0-49dc-94cd-fef26219abbb tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150c3183768349a78d0ed356d7d44c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1b698373774d8d9c5793628380d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:43.497153 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-925db1c3-90d0-49dc-94cd-fef26219abbb tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] 10.222.0.88 "GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545" status: 200 len: 1497 microversion: 2.1 time: 0.276087 Jul 25 14:55:43.498255 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2826/5388] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:43 2022] GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545 => generated 1497 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:43.503628 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f307dffa-a6fa-4c76-9ce1-d07564599ba4 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:43.504414 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f307dffa-a6fa-4c76-9ce1-d07564599ba4 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] [instance: 90b721e0-9e11-412d-8b3c-ec13558486df] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:43.511111 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f307dffa-a6fa-4c76-9ce1-d07564599ba4 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:43.511787 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f307dffa-a6fa-4c76-9ce1-d07564599ba4 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:43.512761 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f307dffa-a6fa-4c76-9ce1-d07564599ba4 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:43.513345 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f307dffa-a6fa-4c76-9ce1-d07564599ba4 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:43.804728 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f307dffa-a6fa-4c76-9ce1-d07564599ba4 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db7c1475dda40b7bac6e1c11bb08ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea69016f034f4a8ca1774789b71100f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:43.829436 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f307dffa-a6fa-4c76-9ce1-d07564599ba4 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] 10.222.0.88 "GET /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df" status: 200 len: 1313 microversion: 2.1 time: 0.329791 Jul 25 14:55:43.833995 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2827/5389] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:43 2022] GET /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:44.295888 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-efa00939-c8a1-43df-b3e7-1942210ee12a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:44.306409 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-efa00939-c8a1-43df-b3e7-1942210ee12a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1688 microversion: 2.1 time: 0.918309 Jul 25 14:55:44.306991 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2563/5390] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:43 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1688 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:44.859148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3279b529-f2c5-45e0-b087-3806f1ab4392 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:44.862088 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3279b529-f2c5-45e0-b087-3806f1ab4392 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] [instance: 90b721e0-9e11-412d-8b3c-ec13558486df] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:44.875086 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3279b529-f2c5-45e0-b087-3806f1ab4392 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:44.876238 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3279b529-f2c5-45e0-b087-3806f1ab4392 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:44.878183 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3279b529-f2c5-45e0-b087-3806f1ab4392 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:44.880031 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3279b529-f2c5-45e0-b087-3806f1ab4392 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:45.329464 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-725242cb-067c-4d23-be2e-4873f60df60a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:45.332241 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-725242cb-067c-4d23-be2e-4873f60df60a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:45.352502 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-725242cb-067c-4d23-be2e-4873f60df60a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:45.357545 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-725242cb-067c-4d23-be2e-4873f60df60a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:45.360189 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-725242cb-067c-4d23-be2e-4873f60df60a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:45.361508 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-725242cb-067c-4d23-be2e-4873f60df60a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:45.976829 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-725242cb-067c-4d23-be2e-4873f60df60a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:45.991078 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-725242cb-067c-4d23-be2e-4873f60df60a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1688 microversion: 2.1 time: 0.665756 Jul 25 14:55:46.008836 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2564/5391] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:45 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1688 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:46.020844 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-81a98bc9-f547-4a3d-93f0-d89dc7a01ec7 req-cee1121a-a022-41db-84d7-95c4b43fc579 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90b721e0-9e11-412d-8b3c-ec13558486df", "tag": "69cf11be-45e6-47af-b464-7b7cfd9b0e94"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:55:46.048739 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-81a98bc9-f547-4a3d-93f0-d89dc7a01ec7 req-cee1121a-a022-41db-84d7-95c4b43fc579 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:46.049428 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-81a98bc9-f547-4a3d-93f0-d89dc7a01ec7 req-cee1121a-a022-41db-84d7-95c4b43fc579 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:46.079429 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-81a98bc9-f547-4a3d-93f0-d89dc7a01ec7 req-cee1121a-a022-41db-84d7-95c4b43fc579 service nova] Creating event network-changed:69cf11be-45e6-47af-b464-7b7cfd9b0e94 for instance 90b721e0-9e11-412d-8b3c-ec13558486df on n-h1-846435-14 Jul 25 14:55:46.090573 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-81a98bc9-f547-4a3d-93f0-d89dc7a01ec7 req-cee1121a-a022-41db-84d7-95c4b43fc579 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079995 Jul 25 14:55:46.093093 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2565/5392] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:55:46.214549 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-b9316887-2829-43b8-8650-eb92de901204 req-a2b9a099-ed7c-410a-aee5-c3ec15348ef8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e054ea1-6a81-43c7-9746-25b466d4647b", "name": "network-vif-plugged", "status": "completed", "tag": "24859a24-8dd1-490f-b1c7-01178f7f59b2"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:55:46.242395 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b9316887-2829-43b8-8650-eb92de901204 req-a2b9a099-ed7c-410a-aee5-c3ec15348ef8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:46.244188 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b9316887-2829-43b8-8650-eb92de901204 req-a2b9a099-ed7c-410a-aee5-c3ec15348ef8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:46.292750 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-b9316887-2829-43b8-8650-eb92de901204 req-a2b9a099-ed7c-410a-aee5-c3ec15348ef8 service nova] Creating event network-vif-plugged:24859a24-8dd1-490f-b1c7-01178f7f59b2 for instance 9e054ea1-6a81-43c7-9746-25b466d4647b on n-h2-846435-14 Jul 25 14:55:46.310869 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-b9316887-2829-43b8-8650-eb92de901204 req-a2b9a099-ed7c-410a-aee5-c3ec15348ef8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100668 Jul 25 14:55:46.311561 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2566/5393] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:55:46.623228 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3279b529-f2c5-45e0-b087-3806f1ab4392 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db7c1475dda40b7bac6e1c11bb08ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea69016f034f4a8ca1774789b71100f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:46.653616 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3279b529-f2c5-45e0-b087-3806f1ab4392 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] 10.222.0.88 "GET /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df" status: 200 len: 1313 microversion: 2.1 time: 1.799947 Jul 25 14:55:46.669730 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2828/5394] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:44 2022] GET /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df => generated 1313 bytes in 1817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:47.015076 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fac23cae-b271-4653-8415-32d527b39349 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:47.016390 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fac23cae-b271-4653-8415-32d527b39349 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:47.029075 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fac23cae-b271-4653-8415-32d527b39349 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:47.029528 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fac23cae-b271-4653-8415-32d527b39349 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:47.035364 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fac23cae-b271-4653-8415-32d527b39349 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:47.036544 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fac23cae-b271-4653-8415-32d527b39349 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:47.303010 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fac23cae-b271-4653-8415-32d527b39349 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:47.314382 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fac23cae-b271-4653-8415-32d527b39349 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1688 microversion: 2.1 time: 0.304598 Jul 25 14:55:47.335939 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2567/5395] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:47 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1688 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:47.676485 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2d79dea2-82a5-4cd3-8e19-b298ec46c380 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:47.677427 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2d79dea2-82a5-4cd3-8e19-b298ec46c380 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] [instance: 90b721e0-9e11-412d-8b3c-ec13558486df] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:47.701899 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d79dea2-82a5-4cd3-8e19-b298ec46c380 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:47.702355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d79dea2-82a5-4cd3-8e19-b298ec46c380 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:47.707672 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d79dea2-82a5-4cd3-8e19-b298ec46c380 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:47.709844 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d79dea2-82a5-4cd3-8e19-b298ec46c380 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:48.331311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-37fb57c4-f542-4bc8-85ef-06033acf6a6b tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:48.332552 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-37fb57c4-f542-4bc8-85ef-06033acf6a6b tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] [instance: 6d378a2c-1b48-46cc-86f1-46534f04c545] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:48.348367 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37fb57c4-f542-4bc8-85ef-06033acf6a6b tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:48.349120 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37fb57c4-f542-4bc8-85ef-06033acf6a6b tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:48.350124 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37fb57c4-f542-4bc8-85ef-06033acf6a6b tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:48.350796 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37fb57c4-f542-4bc8-85ef-06033acf6a6b tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:48.403872 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-37fb57c4-f542-4bc8-85ef-06033acf6a6b tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] [instance: 6d378a2c-1b48-46cc-86f1-46534f04c545] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:55:48.487665 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2d79dea2-82a5-4cd3-8e19-b298ec46c380 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db7c1475dda40b7bac6e1c11bb08ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea69016f034f4a8ca1774789b71100f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:48.505145 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2d79dea2-82a5-4cd3-8e19-b298ec46c380 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] 10.222.0.88 "GET /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df" status: 200 len: 1313 microversion: 2.1 time: 0.833132 Jul 25 14:55:48.505810 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2829/5396] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:47 2022] GET /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df => generated 1313 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:48.528330 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-37fb57c4-f542-4bc8-85ef-06033acf6a6b tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] 10.222.0.88 "DELETE /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545" status: 204 len: 0 microversion: 2.1 time: 0.200552 Jul 25 14:55:48.532746 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2568/5397] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:55:48 2022] DELETE /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:55:48.532936 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c48b3c5f-19b8-41e0-b6c8-92ed2223a748 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:48.533603 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c48b3c5f-19b8-41e0-b6c8-92ed2223a748 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:48.545776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-82f620b1-c3c7-43b9-a2b9-ada5ef152256 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:48.546749 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-82f620b1-c3c7-43b9-a2b9-ada5ef152256 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] [instance: 6d378a2c-1b48-46cc-86f1-46534f04c545] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:48.556631 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c48b3c5f-19b8-41e0-b6c8-92ed2223a748 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:48.558391 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c48b3c5f-19b8-41e0-b6c8-92ed2223a748 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:48.559676 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c48b3c5f-19b8-41e0-b6c8-92ed2223a748 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:48.560505 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c48b3c5f-19b8-41e0-b6c8-92ed2223a748 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:48.562194 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-82f620b1-c3c7-43b9-a2b9-ada5ef152256 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:48.564692 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:55:48.565354 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-82f620b1-c3c7-43b9-a2b9-ada5ef152256 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:48.566690 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-82f620b1-c3c7-43b9-a2b9-ada5ef152256 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:48.567079 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-82f620b1-c3c7-43b9-a2b9-ada5ef152256 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:48.802754 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-82f620b1-c3c7-43b9-a2b9-ada5ef152256 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150c3183768349a78d0ed356d7d44c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1b698373774d8d9c5793628380d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:48.813143 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-82f620b1-c3c7-43b9-a2b9-ada5ef152256 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] 10.222.0.88 "GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545" status: 200 len: 1503 microversion: 2.1 time: 0.271662 Jul 25 14:55:48.820422 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2569/5398] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:48 2022] GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545 => generated 1503 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:48.943904 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c48b3c5f-19b8-41e0-b6c8-92ed2223a748 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:48.956290 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c48b3c5f-19b8-41e0-b6c8-92ed2223a748 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1688 microversion: 2.1 time: 0.449032 Jul 25 14:55:48.961551 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2830/5399] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:48 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1688 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:49.527059 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b3717254-ba51-4010-abff-fcd886151001 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:49.528529 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b3717254-ba51-4010-abff-fcd886151001 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] [instance: 90b721e0-9e11-412d-8b3c-ec13558486df] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:49.537092 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3717254-ba51-4010-abff-fcd886151001 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:49.537784 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3717254-ba51-4010-abff-fcd886151001 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:49.538948 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3717254-ba51-4010-abff-fcd886151001 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:49.539625 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3717254-ba51-4010-abff-fcd886151001 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:49.809421 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b3717254-ba51-4010-abff-fcd886151001 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db7c1475dda40b7bac6e1c11bb08ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea69016f034f4a8ca1774789b71100f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:49.824198 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b3717254-ba51-4010-abff-fcd886151001 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] 10.222.0.88 "GET /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df" status: 200 len: 1313 microversion: 2.1 time: 0.300917 Jul 25 14:55:49.825364 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2570/5400] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:49 2022] GET /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:49.844695 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6c3a21f8-b9b0-4cd9-aec9-b88b3622aa40 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:49.845314 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6c3a21f8-b9b0-4cd9-aec9-b88b3622aa40 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] [instance: 6d378a2c-1b48-46cc-86f1-46534f04c545] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:49.847447 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:55:49.849653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:55:49.857395 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6c3a21f8-b9b0-4cd9-aec9-b88b3622aa40 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:49.858247 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6c3a21f8-b9b0-4cd9-aec9-b88b3622aa40 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:49.859060 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6c3a21f8-b9b0-4cd9-aec9-b88b3622aa40 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:49.859520 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6c3a21f8-b9b0-4cd9-aec9-b88b3622aa40 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:49.983351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a1ffdf56-7af0-4733-a21b-a8abb7cb9150 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:49.983879 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a1ffdf56-7af0-4733-a21b-a8abb7cb9150 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:49.986833 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:55:50.000220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a1ffdf56-7af0-4733-a21b-a8abb7cb9150 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:50.000933 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a1ffdf56-7af0-4733-a21b-a8abb7cb9150 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:50.001889 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a1ffdf56-7af0-4733-a21b-a8abb7cb9150 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:50.002482 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a1ffdf56-7af0-4733-a21b-a8abb7cb9150 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:50.157442 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6c3a21f8-b9b0-4cd9-aec9-b88b3622aa40 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150c3183768349a78d0ed356d7d44c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1b698373774d8d9c5793628380d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:50.170931 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6c3a21f8-b9b0-4cd9-aec9-b88b3622aa40 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] 10.222.0.88 "GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545" status: 200 len: 1503 microversion: 2.1 time: 0.328949 Jul 25 14:55:50.172805 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2831/5401] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:49 2022] GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545 => generated 1503 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:50.736708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a1ffdf56-7af0-4733-a21b-a8abb7cb9150 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:50.747341 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a1ffdf56-7af0-4733-a21b-a8abb7cb9150 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1688 microversion: 2.1 time: 0.767625 Jul 25 14:55:50.753251 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2571/5402] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:49 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1688 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:55:50.847153 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5c26e4e3-0ae6-44d6-842f-6962578e9f20 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:50.848140 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5c26e4e3-0ae6-44d6-842f-6962578e9f20 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] [instance: 90b721e0-9e11-412d-8b3c-ec13558486df] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:50.862433 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c26e4e3-0ae6-44d6-842f-6962578e9f20 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:50.863140 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c26e4e3-0ae6-44d6-842f-6962578e9f20 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:50.864103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c26e4e3-0ae6-44d6-842f-6962578e9f20 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:50.867809 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c26e4e3-0ae6-44d6-842f-6962578e9f20 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:51.161953 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5c26e4e3-0ae6-44d6-842f-6962578e9f20 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db7c1475dda40b7bac6e1c11bb08ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea69016f034f4a8ca1774789b71100f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:51.180476 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5c26e4e3-0ae6-44d6-842f-6962578e9f20 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] 10.222.0.88 "GET /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df" status: 200 len: 1313 microversion: 2.1 time: 0.337114 Jul 25 14:55:51.181744 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2832/5403] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:50 2022] GET /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:51.197721 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6493c2af-f68e-4bf1-b92f-50172d207cc9 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:51.198328 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6493c2af-f68e-4bf1-b92f-50172d207cc9 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] [instance: 6d378a2c-1b48-46cc-86f1-46534f04c545] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:51.237931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6493c2af-f68e-4bf1-b92f-50172d207cc9 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:51.243477 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6493c2af-f68e-4bf1-b92f-50172d207cc9 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:51.244547 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6493c2af-f68e-4bf1-b92f-50172d207cc9 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:51.258887 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6493c2af-f68e-4bf1-b92f-50172d207cc9 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:51.773327 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f8c77d34-8cdb-44d4-92af-4de4419dc543 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:51.773943 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f8c77d34-8cdb-44d4-92af-4de4419dc543 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:51.787634 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8c77d34-8cdb-44d4-92af-4de4419dc543 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:51.788104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8c77d34-8cdb-44d4-92af-4de4419dc543 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:51.788886 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8c77d34-8cdb-44d4-92af-4de4419dc543 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:51.789314 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8c77d34-8cdb-44d4-92af-4de4419dc543 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:51.975248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6493c2af-f68e-4bf1-b92f-50172d207cc9 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150c3183768349a78d0ed356d7d44c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1b698373774d8d9c5793628380d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:51.982047 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:55:51.984426 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6493c2af-f68e-4bf1-b92f-50172d207cc9 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] 10.222.0.88 "GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545" status: 200 len: 1503 microversion: 2.1 time: 0.790730 Jul 25 14:55:51.985010 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2572/5404] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:51 2022] GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545 => generated 1503 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:55:51.989550 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-4a5172e3-605b-402c-8828-8922b54dd1c5 req-8bd67d64-6d9e-47fe-9c50-b63d97720ddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90b721e0-9e11-412d-8b3c-ec13558486df", "name": "network-vif-plugged", "status": "completed", "tag": "69cf11be-45e6-47af-b464-7b7cfd9b0e94"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:55:52.023456 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-4a5172e3-605b-402c-8828-8922b54dd1c5 req-8bd67d64-6d9e-47fe-9c50-b63d97720ddb service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:52.023888 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-4a5172e3-605b-402c-8828-8922b54dd1c5 req-8bd67d64-6d9e-47fe-9c50-b63d97720ddb service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:52.078778 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-4a5172e3-605b-402c-8828-8922b54dd1c5 req-8bd67d64-6d9e-47fe-9c50-b63d97720ddb service nova] Creating event network-vif-plugged:69cf11be-45e6-47af-b464-7b7cfd9b0e94 for instance 90b721e0-9e11-412d-8b3c-ec13558486df on n-h1-846435-14 Jul 25 14:55:52.110353 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-4a5172e3-605b-402c-8828-8922b54dd1c5 req-8bd67d64-6d9e-47fe-9c50-b63d97720ddb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124079 Jul 25 14:55:52.110974 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2573/5405] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:55:52.206102 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-00c31275-33cd-48d2-bcd0-2e5fac57a8c1 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:52.207003 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-00c31275-33cd-48d2-bcd0-2e5fac57a8c1 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] [instance: 90b721e0-9e11-412d-8b3c-ec13558486df] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:52.218406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00c31275-33cd-48d2-bcd0-2e5fac57a8c1 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:52.228716 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00c31275-33cd-48d2-bcd0-2e5fac57a8c1 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:52.229831 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00c31275-33cd-48d2-bcd0-2e5fac57a8c1 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:52.230431 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00c31275-33cd-48d2-bcd0-2e5fac57a8c1 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:52.342896 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f8c77d34-8cdb-44d4-92af-4de4419dc543 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:52.354832 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f8c77d34-8cdb-44d4-92af-4de4419dc543 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1683 microversion: 2.1 time: 0.584037 Jul 25 14:55:52.369355 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2833/5406] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:51 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1683 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:55:52.384901 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-25234905-5f19-407b-9fe1-c3f22ad84a8c req-50e78d6a-e2da-4885-a556-6f0dc9cb2975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d378a2c-1b48-46cc-86f1-46534f04c545", "name": "network-vif-deleted", "tag": "17e6bc71-c8bc-4192-aef4-9782cf0cb6ce"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:55:52.413937 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-25234905-5f19-407b-9fe1-c3f22ad84a8c req-50e78d6a-e2da-4885-a556-6f0dc9cb2975 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:52.414285 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-25234905-5f19-407b-9fe1-c3f22ad84a8c req-50e78d6a-e2da-4885-a556-6f0dc9cb2975 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:52.435382 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-25234905-5f19-407b-9fe1-c3f22ad84a8c req-50e78d6a-e2da-4885-a556-6f0dc9cb2975 service nova] Creating event network-vif-deleted:17e6bc71-c8bc-4192-aef4-9782cf0cb6ce for instance 6d378a2c-1b48-46cc-86f1-46534f04c545 on n-h2-846435-14 Jul 25 14:55:52.445007 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-25234905-5f19-407b-9fe1-c3f22ad84a8c req-50e78d6a-e2da-4885-a556-6f0dc9cb2975 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074303 Jul 25 14:55:52.450252 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2834/5407] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:55:52.735315 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-00c31275-33cd-48d2-bcd0-2e5fac57a8c1 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db7c1475dda40b7bac6e1c11bb08ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea69016f034f4a8ca1774789b71100f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:52.744250 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-00c31275-33cd-48d2-bcd0-2e5fac57a8c1 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] 10.222.0.88 "GET /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df" status: 200 len: 1313 microversion: 2.1 time: 0.543181 Jul 25 14:55:52.756558 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2574/5408] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:52 2022] GET /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df => generated 1313 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:55:53.007301 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-28278108-0638-461e-825d-9f706caa0156 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:53.008013 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-28278108-0638-461e-825d-9f706caa0156 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] [instance: 6d378a2c-1b48-46cc-86f1-46534f04c545] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:53.026305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28278108-0638-461e-825d-9f706caa0156 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:53.026305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28278108-0638-461e-825d-9f706caa0156 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:53.026305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28278108-0638-461e-825d-9f706caa0156 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:53.026305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28278108-0638-461e-825d-9f706caa0156 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:53.049602 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-28278108-0638-461e-825d-9f706caa0156 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] HTTP exception thrown: Instance 6d378a2c-1b48-46cc-86f1-46534f04c545 could not be found. Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-28278108-0638-461e-825d-9f706caa0156 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Request method failure captured: Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545 HTTP/1.1 Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q7QGN98lLgp1ZFnUXg-QRJk9R0zB46GdxKzTZ_AuNmsZKS9xD-2j45SJ9uGbBg48RkhZD3njMDyiDyGmg9pCV6Ff9ZlpKdHICLpUUz_FPZxtq6kYg87r_fkODayxXjLzRXvrSYdMGZYsPierDi4nIPE2_74uv2P-z6CCeyvv5mR65Y Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 6f1b698373774d8d9c5793628380d87c Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-VolumesActionsTest-640936790 Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6f1b698373774d8d9c5793628380d87c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/6f1b698373774d8d9c5793628380d87c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_6f1b698373774d8d9c5793628380d87c", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/6f1b698373774d8d9c5793628380d87c"}]}] Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-VolumesActionsTest-640936790 Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 6f1b698373774d8d9c5793628380d87c Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-VolumesActionsTest-640936790 Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-VolumesActionsTest-640936790-project Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 150c3183768349a78d0ed356d7d44c72 Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-VolumesActionsTest-640936790-project Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 6d378a2c-1b48-46cc-86f1-46534f04c545 could not be found. Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '6d378a2c-1b48-46cc-86f1-46534f04c545'} Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d378a2c-1b48-46cc-86f1-46534f04c545 could not be found. Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d378a2c-1b48-46cc-86f1-46534f04c545 could not be found. Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:55:53.052569 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:55:53.059497 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:55:53.059497 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:55:53.059497 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:55:53.059497 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:55:53.059497 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:55:53.059497 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d378a2c-1b48-46cc-86f1-46534f04c545 could not be found. Jul 25 14:55:53.059497 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:55:53.063043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-28278108-0638-461e-825d-9f706caa0156 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] Returning 404 to user: Instance 6d378a2c-1b48-46cc-86f1-46534f04c545 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:55:53.068961 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-28278108-0638-461e-825d-9f706caa0156 tempest-VolumesActionsTest-640936790 tempest-VolumesActionsTest-640936790-project] 10.222.0.88 "GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545" status: 404 len: 111 microversion: 2.1 time: 0.065878 Jul 25 14:55:53.073874 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2835/5409] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:53 2022] GET /compute/v2.1/servers/6d378a2c-1b48-46cc-86f1-46534f04c545 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:55:53.381058 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-72046073-d54a-400b-aa63-9a5d68649bfe tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:53.381698 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-72046073-d54a-400b-aa63-9a5d68649bfe tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:53.401999 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-72046073-d54a-400b-aa63-9a5d68649bfe tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:53.402664 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-72046073-d54a-400b-aa63-9a5d68649bfe tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:53.406232 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-72046073-d54a-400b-aa63-9a5d68649bfe tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:53.427803 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8de5ede0-babf-4e79-a643-82ac2baa2fcf tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:55:53.431243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8de5ede0-babf-4e79-a643-82ac2baa2fcf tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:53.437755 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-72046073-d54a-400b-aa63-9a5d68649bfe tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:53.467575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8de5ede0-babf-4e79-a643-82ac2baa2fcf tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:53.467916 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8de5ede0-babf-4e79-a643-82ac2baa2fcf tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:53.475000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8de5ede0-babf-4e79-a643-82ac2baa2fcf tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:53.475787 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8de5ede0-babf-4e79-a643-82ac2baa2fcf tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:53.624643 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8de5ede0-babf-4e79-a643-82ac2baa2fcf tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "POST /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d/action" status: 200 len: 24573 microversion: 2.1 time: 0.202052 Jul 25 14:55:53.625576 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2836/5410] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:55:53 2022] POST /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d/action => generated 24573 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:55:53.774507 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-88b459df-5dcb-4485-9d70-651759b68b39 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:53.776427 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-88b459df-5dcb-4485-9d70-651759b68b39 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] [instance: 90b721e0-9e11-412d-8b3c-ec13558486df] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:53.791374 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-88b459df-5dcb-4485-9d70-651759b68b39 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:53.798798 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-88b459df-5dcb-4485-9d70-651759b68b39 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:53.802853 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-88b459df-5dcb-4485-9d70-651759b68b39 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:53.805400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-88b459df-5dcb-4485-9d70-651759b68b39 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:54.305744 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-72046073-d54a-400b-aa63-9a5d68649bfe tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:54.314363 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-72046073-d54a-400b-aa63-9a5d68649bfe tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1683 microversion: 2.1 time: 0.938573 Jul 25 14:55:54.315382 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2575/5411] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:53 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1683 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:54.357141 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-88b459df-5dcb-4485-9d70-651759b68b39 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db7c1475dda40b7bac6e1c11bb08ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea69016f034f4a8ca1774789b71100f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:54.365892 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-88b459df-5dcb-4485-9d70-651759b68b39 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] 10.222.0.88 "GET /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df" status: 200 len: 1313 microversion: 2.1 time: 0.596002 Jul 25 14:55:54.369013 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2837/5412] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:53 2022] GET /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df => generated 1313 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:54.634319 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cef39bf2-36eb-478d-9a9f-f72c0de6ffb5 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1496910847", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "f2a5632c-45d6-4ede-bd35-918998021e4e"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:55:54.709154 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-cef39bf2-36eb-478d-9a9f-f72c0de6ffb5 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] validate_networks() for [('f2a5632c-45d6-4ede-bd35-918998021e4e', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:55:55.347107 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1cd55329-3474-4ba1-b3bf-cc5b3d3a890c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:55.350096 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1cd55329-3474-4ba1-b3bf-cc5b3d3a890c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:55.387494 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1cd55329-3474-4ba1-b3bf-cc5b3d3a890c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:55.389449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1cd55329-3474-4ba1-b3bf-cc5b3d3a890c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:55.393765 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1cd55329-3474-4ba1-b3bf-cc5b3d3a890c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:55.395058 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1cd55329-3474-4ba1-b3bf-cc5b3d3a890c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:55.535445 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-cef39bf2-36eb-478d-9a9f-f72c0de6ffb5 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:55:55.535786 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-cef39bf2-36eb-478d-9a9f-f72c0de6ffb5 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:55:55.536289 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-cef39bf2-36eb-478d-9a9f-f72c0de6ffb5 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:55:55.536982 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-cef39bf2-36eb-478d-9a9f-f72c0de6ffb5 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:55:55.537582 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-cef39bf2-36eb-478d-9a9f-f72c0de6ffb5 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:55:55.561470 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cef39bf2-36eb-478d-9a9f-f72c0de6ffb5 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:55.562396 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cef39bf2-36eb-478d-9a9f-f72c0de6ffb5 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:55.563462 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cef39bf2-36eb-478d-9a9f-f72c0de6ffb5 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:55.564133 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cef39bf2-36eb-478d-9a9f-f72c0de6ffb5 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:55.604405 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-cef39bf2-36eb-478d-9a9f-f72c0de6ffb5 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Getting quotas for project 4db4d0f898d548b9a88e1bfa7c69a941. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:55:55.619171 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-cef39bf2-36eb-478d-9a9f-f72c0de6ffb5 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Getting quotas for user 12c817e69a244f0fb1c364bc7ce90e83 and project 4db4d0f898d548b9a88e1bfa7c69a941. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:55:55.648369 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cef39bf2-36eb-478d-9a9f-f72c0de6ffb5 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Going to run 2 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:55:55.653835 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cef39bf2-36eb-478d-9a9f-f72c0de6ffb5 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 36956163-9db4-450d-b548-fcb3629c7ecf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:55:55.740686 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cef39bf2-36eb-478d-9a9f-f72c0de6ffb5 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 6dd72192-fbd7-4ae4-902d-6bda149afb5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=36956163-9db4-450d-b548-fcb3629c7ecf,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:55:55.818235 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1cd55329-3474-4ba1-b3bf-cc5b3d3a890c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:55.829991 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1cd55329-3474-4ba1-b3bf-cc5b3d3a890c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1683 microversion: 2.1 time: 0.494464 Jul 25 14:55:55.833058 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2838/5413] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:55 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1683 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:55:55.844638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dbe0ad15-bfd3-4844-844b-b45d870199c6 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:55.845571 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dbe0ad15-bfd3-4844-844b-b45d870199c6 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] [instance: 90b721e0-9e11-412d-8b3c-ec13558486df] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:55.860388 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dbe0ad15-bfd3-4844-844b-b45d870199c6 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:55.862411 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dbe0ad15-bfd3-4844-844b-b45d870199c6 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:55.864689 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dbe0ad15-bfd3-4844-844b-b45d870199c6 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:55.865678 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dbe0ad15-bfd3-4844-844b-b45d870199c6 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:55.927596 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cef39bf2-36eb-478d-9a9f-f72c0de6ffb5 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.569207 Jul 25 14:55:55.942253 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2576/5414] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:55:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:55:55.953368 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1fe9c8fd-e084-46ea-91a5-372416166ac2 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:55.966695 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1fe9c8fd-e084-46ea-91a5-372416166ac2 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:55.967554 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1fe9c8fd-e084-46ea-91a5-372416166ac2 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Searching by: {'deleted': False, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941'} {{(pid=119303) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:55:56.013973 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1fe9c8fd-e084-46ea-91a5-372416166ac2 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:56.032650 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1fe9c8fd-e084-46ea-91a5-372416166ac2 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:56.033652 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1fe9c8fd-e084-46ea-91a5-372416166ac2 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:56.034313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1fe9c8fd-e084-46ea-91a5-372416166ac2 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:56.105680 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1fe9c8fd-e084-46ea-91a5-372416166ac2 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.162203 Jul 25 14:55:56.106501 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2577/5415] 10.222.0.88 () {58 vars in 1125 bytes} [Mon Jul 25 14:55:55 2022] GET /compute/v2.1/servers => generated 677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:55:56.117991 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-28493462-8254-4f7f-8925-c777343ba25e tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:56.118824 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-28493462-8254-4f7f-8925-c777343ba25e tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 6dd72192-fbd7-4ae4-902d-6bda149afb5d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:56.232847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dbe0ad15-bfd3-4844-844b-b45d870199c6 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db7c1475dda40b7bac6e1c11bb08ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea69016f034f4a8ca1774789b71100f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:56.248310 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dbe0ad15-bfd3-4844-844b-b45d870199c6 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] 10.222.0.88 "GET /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df" status: 200 len: 1462 microversion: 2.1 time: 0.413789 Jul 25 14:55:56.251191 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2839/5416] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:55 2022] GET /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df => generated 1462 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:56.272485 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4c721f32-9ced-42f6-bd89-ef1887dd0f41 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bcc1a094-c722-4a34-918a-750cc3ab43d3", "device": "/dev/sdb"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:55:56.275859 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4c721f32-9ced-42f6-bd89-ef1887dd0f41 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] [instance: 90b721e0-9e11-412d-8b3c-ec13558486df] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:56.285873 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4c721f32-9ced-42f6-bd89-ef1887dd0f41 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:56.286634 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4c721f32-9ced-42f6-bd89-ef1887dd0f41 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:56.287625 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4c721f32-9ced-42f6-bd89-ef1887dd0f41 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:56.288645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4c721f32-9ced-42f6-bd89-ef1887dd0f41 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:56.400789 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-28493462-8254-4f7f-8925-c777343ba25e tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:56.409033 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-28493462-8254-4f7f-8925-c777343ba25e tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/6dd72192-fbd7-4ae4-902d-6bda149afb5d" status: 200 len: 1220 microversion: 2.1 time: 0.294749 Jul 25 14:55:56.413727 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2578/5417] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:56 2022] GET /compute/v2.1/servers/6dd72192-fbd7-4ae4-902d-6bda149afb5d => generated 1220 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:56.855436 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-45f42da6-7066-4106-9e93-a361d91e6c78 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:56.856803 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-45f42da6-7066-4106-9e93-a361d91e6c78 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:56.886445 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-45f42da6-7066-4106-9e93-a361d91e6c78 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:56.889301 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-45f42da6-7066-4106-9e93-a361d91e6c78 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:56.892633 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-45f42da6-7066-4106-9e93-a361d91e6c78 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:56.893924 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-45f42da6-7066-4106-9e93-a361d91e6c78 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:56.966936 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4c721f32-9ced-42f6-bd89-ef1887dd0f41 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] 10.222.0.88 "POST /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.700423 Jul 25 14:55:56.968689 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2840/5418] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Jul 25 14:55:56 2022] POST /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df/os-volume_attachments => generated 194 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:55:57.439029 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d1e99e0d-3dc4-4fc3-9856-9793a17cb5d2 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:57.445736 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d1e99e0d-3dc4-4fc3-9856-9793a17cb5d2 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 6dd72192-fbd7-4ae4-902d-6bda149afb5d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:57.640288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d1e99e0d-3dc4-4fc3-9856-9793a17cb5d2 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:57.648438 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d1e99e0d-3dc4-4fc3-9856-9793a17cb5d2 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/6dd72192-fbd7-4ae4-902d-6bda149afb5d" status: 200 len: 1220 microversion: 2.1 time: 0.216641 Jul 25 14:55:57.666700 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2841/5419] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:57 2022] GET /compute/v2.1/servers/6dd72192-fbd7-4ae4-902d-6bda149afb5d => generated 1220 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:58.424378 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-45f42da6-7066-4106-9e93-a361d91e6c78 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:58.435932 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-45f42da6-7066-4106-9e93-a361d91e6c78 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1683 microversion: 2.1 time: 1.585116 Jul 25 14:55:58.444065 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2579/5420] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:56 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1683 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:55:58.671886 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7fa2936f-801c-48a6-940f-8b146596a1ca tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:58.672492 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7fa2936f-801c-48a6-940f-8b146596a1ca tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 6dd72192-fbd7-4ae4-902d-6bda149afb5d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:58.704016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7fa2936f-801c-48a6-940f-8b146596a1ca tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:58.707127 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7fa2936f-801c-48a6-940f-8b146596a1ca tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:58.711994 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7fa2936f-801c-48a6-940f-8b146596a1ca tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:58.713190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7fa2936f-801c-48a6-940f-8b146596a1ca tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:59.377111 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7fa2936f-801c-48a6-940f-8b146596a1ca tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:55:59.395400 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7fa2936f-801c-48a6-940f-8b146596a1ca tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/6dd72192-fbd7-4ae4-902d-6bda149afb5d" status: 200 len: 1272 microversion: 2.1 time: 0.719654 Jul 25 14:55:59.396348 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2842/5421] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:58 2022] GET /compute/v2.1/servers/6dd72192-fbd7-4ae4-902d-6bda149afb5d => generated 1272 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:55:59.463820 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-650c519b-ad61-401d-976c-17a1da1c41e3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:55:59.465023 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-650c519b-ad61-401d-976c-17a1da1c41e3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:55:59.475124 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-650c519b-ad61-401d-976c-17a1da1c41e3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:59.479547 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-650c519b-ad61-401d-976c-17a1da1c41e3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:55:59.481246 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-650c519b-ad61-401d-976c-17a1da1c41e3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:55:59.483159 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-650c519b-ad61-401d-976c-17a1da1c41e3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:00.420169 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5621b5f6-22b0-482d-a86d-dfe07e26393b tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:00.420977 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5621b5f6-22b0-482d-a86d-dfe07e26393b tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 6dd72192-fbd7-4ae4-902d-6bda149afb5d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:00.435214 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5621b5f6-22b0-482d-a86d-dfe07e26393b tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:00.442896 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5621b5f6-22b0-482d-a86d-dfe07e26393b tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:00.447671 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5621b5f6-22b0-482d-a86d-dfe07e26393b tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:00.449756 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5621b5f6-22b0-482d-a86d-dfe07e26393b tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:00.497641 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-650c519b-ad61-401d-976c-17a1da1c41e3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:00.518483 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-650c519b-ad61-401d-976c-17a1da1c41e3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1683 microversion: 2.1 time: 1.059820 Jul 25 14:56:00.540033 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2580/5422] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:55:59 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1683 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:00.720257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5621b5f6-22b0-482d-a86d-dfe07e26393b tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:00.731802 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5621b5f6-22b0-482d-a86d-dfe07e26393b tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/6dd72192-fbd7-4ae4-902d-6bda149afb5d" status: 200 len: 1278 microversion: 2.1 time: 0.314720 Jul 25 14:56:00.744926 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2843/5423] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:00 2022] GET /compute/v2.1/servers/6dd72192-fbd7-4ae4-902d-6bda149afb5d => generated 1278 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:01.567370 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fd46bc80-4607-4baa-bc97-252a1ff78bf8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:01.567370 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fd46bc80-4607-4baa-bc97-252a1ff78bf8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:01.594331 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fd46bc80-4607-4baa-bc97-252a1ff78bf8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:01.598255 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fd46bc80-4607-4baa-bc97-252a1ff78bf8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:01.601099 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fd46bc80-4607-4baa-bc97-252a1ff78bf8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:01.605575 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fd46bc80-4607-4baa-bc97-252a1ff78bf8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:01.770379 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f5821a46-f0c7-4082-8cd5-6296d215bc55 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:01.770994 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f5821a46-f0c7-4082-8cd5-6296d215bc55 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 6dd72192-fbd7-4ae4-902d-6bda149afb5d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:01.788308 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5821a46-f0c7-4082-8cd5-6296d215bc55 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:01.788756 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5821a46-f0c7-4082-8cd5-6296d215bc55 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:01.793342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5821a46-f0c7-4082-8cd5-6296d215bc55 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:01.794265 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5821a46-f0c7-4082-8cd5-6296d215bc55 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:02.054973 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f5821a46-f0c7-4082-8cd5-6296d215bc55 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:02.077067 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f5821a46-f0c7-4082-8cd5-6296d215bc55 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/6dd72192-fbd7-4ae4-902d-6bda149afb5d" status: 200 len: 1278 microversion: 2.1 time: 0.302074 Jul 25 14:56:02.079917 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2844/5424] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:01 2022] GET /compute/v2.1/servers/6dd72192-fbd7-4ae4-902d-6bda149afb5d => generated 1278 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:02.297154 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fd46bc80-4607-4baa-bc97-252a1ff78bf8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:02.316075 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fd46bc80-4607-4baa-bc97-252a1ff78bf8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1683 microversion: 2.1 time: 0.764631 Jul 25 14:56:02.340974 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2581/5425] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:01 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1683 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:03.099089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4177ee5e-b4e3-41ec-a12a-0c472bc33071 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:03.099857 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4177ee5e-b4e3-41ec-a12a-0c472bc33071 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 6dd72192-fbd7-4ae4-902d-6bda149afb5d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:03.121553 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4177ee5e-b4e3-41ec-a12a-0c472bc33071 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:03.124573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4177ee5e-b4e3-41ec-a12a-0c472bc33071 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:03.125583 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4177ee5e-b4e3-41ec-a12a-0c472bc33071 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:03.126180 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4177ee5e-b4e3-41ec-a12a-0c472bc33071 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:03.348221 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ebb9f178-f701-4619-96cd-c25f19612988 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:03.348887 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ebb9f178-f701-4619-96cd-c25f19612988 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:03.382397 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ebb9f178-f701-4619-96cd-c25f19612988 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:03.383804 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ebb9f178-f701-4619-96cd-c25f19612988 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:03.387772 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ebb9f178-f701-4619-96cd-c25f19612988 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:03.388529 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ebb9f178-f701-4619-96cd-c25f19612988 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:04.171199 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4177ee5e-b4e3-41ec-a12a-0c472bc33071 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:04.184771 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4177ee5e-b4e3-41ec-a12a-0c472bc33071 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/6dd72192-fbd7-4ae4-902d-6bda149afb5d" status: 200 len: 1320 microversion: 2.1 time: 1.089045 Jul 25 14:56:04.189140 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2845/5426] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:03 2022] GET /compute/v2.1/servers/6dd72192-fbd7-4ae4-902d-6bda149afb5d => generated 1320 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:04.543641 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-59675b71-053c-4b9a-88c3-eee101385b99 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:04.544400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-59675b71-053c-4b9a-88c3-eee101385b99 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:04.557478 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59675b71-053c-4b9a-88c3-eee101385b99 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:04.565217 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59675b71-053c-4b9a-88c3-eee101385b99 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:04.566481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59675b71-053c-4b9a-88c3-eee101385b99 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:04.568879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59675b71-053c-4b9a-88c3-eee101385b99 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:04.596409 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ebb9f178-f701-4619-96cd-c25f19612988 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:04.616270 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ebb9f178-f701-4619-96cd-c25f19612988 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1683 microversion: 2.1 time: 1.273125 Jul 25 14:56:04.620132 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2582/5427] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:03 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1683 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:04.912414 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-62c2bf48-0915-4804-b349-4dead3ed6650 req-63ab5330-1e8f-4cc2-962a-b8046951afbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36956163-9db4-450d-b548-fcb3629c7ecf", "tag": "0ef1493d-7b10-4e52-8961-d71845f604bb"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:56:04.959901 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-62c2bf48-0915-4804-b349-4dead3ed6650 req-63ab5330-1e8f-4cc2-962a-b8046951afbb service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:04.966337 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-62c2bf48-0915-4804-b349-4dead3ed6650 req-63ab5330-1e8f-4cc2-962a-b8046951afbb service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:05.041026 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-62c2bf48-0915-4804-b349-4dead3ed6650 req-63ab5330-1e8f-4cc2-962a-b8046951afbb service nova] Creating event network-changed:0ef1493d-7b10-4e52-8961-d71845f604bb for instance 36956163-9db4-450d-b548-fcb3629c7ecf on n-h2-846435-14 Jul 25 14:56:05.059600 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-62c2bf48-0915-4804-b349-4dead3ed6650 req-63ab5330-1e8f-4cc2-962a-b8046951afbb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143416 Jul 25 14:56:05.060451 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2583/5428] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:56:05.219056 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-044794a9-bf4a-4dbd-b8b2-de11d1f124de tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:05.220439 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-044794a9-bf4a-4dbd-b8b2-de11d1f124de tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 6dd72192-fbd7-4ae4-902d-6bda149afb5d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:05.249508 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-044794a9-bf4a-4dbd-b8b2-de11d1f124de tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:05.253544 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-044794a9-bf4a-4dbd-b8b2-de11d1f124de tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:05.254601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-044794a9-bf4a-4dbd-b8b2-de11d1f124de tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:05.255206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-044794a9-bf4a-4dbd-b8b2-de11d1f124de tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:05.966085 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-044794a9-bf4a-4dbd-b8b2-de11d1f124de tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:05.974511 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-044794a9-bf4a-4dbd-b8b2-de11d1f124de tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/6dd72192-fbd7-4ae4-902d-6bda149afb5d" status: 200 len: 1320 microversion: 2.1 time: 0.763487 Jul 25 14:56:05.983181 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2584/5429] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:05 2022] GET /compute/v2.1/servers/6dd72192-fbd7-4ae4-902d-6bda149afb5d => generated 1320 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:06.006241 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-275e6dd1-8c40-43c7-9b25-33c49dece33f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:06.008364 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-275e6dd1-8c40-43c7-9b25-33c49dece33f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:06.037715 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-275e6dd1-8c40-43c7-9b25-33c49dece33f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:06.038555 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-275e6dd1-8c40-43c7-9b25-33c49dece33f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:06.040028 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-275e6dd1-8c40-43c7-9b25-33c49dece33f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:06.040694 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-275e6dd1-8c40-43c7-9b25-33c49dece33f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:06.105470 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:56:06.408901 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=8 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:56:06.479902 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-59675b71-053c-4b9a-88c3-eee101385b99 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1836 microversion: 2.1 time: 1.938951 Jul 25 14:56:06.482012 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2846/5430] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:04 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1836 bytes in 1944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:06.506049 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-41514bd3-a39e-428c-99cc-2b25aa8b3682 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:06.507017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-41514bd3-a39e-428c-99cc-2b25aa8b3682 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:06.521024 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-41514bd3-a39e-428c-99cc-2b25aa8b3682 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:06.522016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-41514bd3-a39e-428c-99cc-2b25aa8b3682 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:06.524061 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-41514bd3-a39e-428c-99cc-2b25aa8b3682 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:06.525152 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-41514bd3-a39e-428c-99cc-2b25aa8b3682 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:06.909074 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-275e6dd1-8c40-43c7-9b25-33c49dece33f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:06.929743 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-275e6dd1-8c40-43c7-9b25-33c49dece33f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1683 microversion: 2.1 time: 0.943326 Jul 25 14:56:06.932691 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2585/5431] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:05 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1683 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:06.950722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-d1aeb37d-7be1-438e-ba9e-ccd88cc75af5 req-70c9c106-feee-4f74-adfd-ef4ec5b45b48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dd72192-fbd7-4ae4-902d-6bda149afb5d", "tag": "95b2f2b0-6e07-4f9b-8438-ee573ba9bd91"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:56:06.983809 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:56:07.016511 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-d1aeb37d-7be1-438e-ba9e-ccd88cc75af5 req-70c9c106-feee-4f74-adfd-ef4ec5b45b48 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:07.016962 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-d1aeb37d-7be1-438e-ba9e-ccd88cc75af5 req-70c9c106-feee-4f74-adfd-ef4ec5b45b48 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:07.057155 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-d1aeb37d-7be1-438e-ba9e-ccd88cc75af5 req-70c9c106-feee-4f74-adfd-ef4ec5b45b48 service nova] Creating event network-changed:95b2f2b0-6e07-4f9b-8438-ee573ba9bd91 for instance 6dd72192-fbd7-4ae4-902d-6bda149afb5d on n-h1-846435-14 Jul 25 14:56:07.065622 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-d1aeb37d-7be1-438e-ba9e-ccd88cc75af5 req-70c9c106-feee-4f74-adfd-ef4ec5b45b48 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131368 Jul 25 14:56:07.066930 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2586/5432] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:56:07.074017 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-40a22ac3-b7d0-422e-b374-9f6fa3bc5fc8 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:07.076587 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-40a22ac3-b7d0-422e-b374-9f6fa3bc5fc8 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 6dd72192-fbd7-4ae4-902d-6bda149afb5d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:07.086127 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-40a22ac3-b7d0-422e-b374-9f6fa3bc5fc8 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:07.088614 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-40a22ac3-b7d0-422e-b374-9f6fa3bc5fc8 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:07.089708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-40a22ac3-b7d0-422e-b374-9f6fa3bc5fc8 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:07.090373 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-40a22ac3-b7d0-422e-b374-9f6fa3bc5fc8 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:07.317477 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-41514bd3-a39e-428c-99cc-2b25aa8b3682 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:07.328994 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-41514bd3-a39e-428c-99cc-2b25aa8b3682 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1683 microversion: 2.1 time: 0.827788 Jul 25 14:56:07.329577 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2847/5433] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:06 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1683 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:07.498059 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-aedd325e-f436-4d34-900e-9ed5091f4798 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:56:07.502333 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-aedd325e-f436-4d34-900e-9ed5091f4798 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:07.518221 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aedd325e-f436-4d34-900e-9ed5091f4798 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:07.519381 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aedd325e-f436-4d34-900e-9ed5091f4798 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:07.521758 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aedd325e-f436-4d34-900e-9ed5091f4798 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:07.522861 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aedd325e-f436-4d34-900e-9ed5091f4798 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:07.529731 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:56:07.617344 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-aedd325e-f436-4d34-900e-9ed5091f4798 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "POST /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d/action" status: 200 len: 32645 microversion: 2.1 time: 0.124141 Jul 25 14:56:07.618276 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2848/5434] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:56:07 2022] POST /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d/action => generated 32645 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 14:56:07.744255 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-40a22ac3-b7d0-422e-b374-9f6fa3bc5fc8 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:07.758868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a14846e2-47a3-4b6d-937d-88d2c1a99c76 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:56:07.760324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a14846e2-47a3-4b6d-937d-88d2c1a99c76 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:07.762730 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-40a22ac3-b7d0-422e-b374-9f6fa3bc5fc8 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/6dd72192-fbd7-4ae4-902d-6bda149afb5d" status: 200 len: 1320 microversion: 2.1 time: 0.692235 Jul 25 14:56:07.766458 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2587/5435] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:07 2022] GET /compute/v2.1/servers/6dd72192-fbd7-4ae4-902d-6bda149afb5d => generated 1320 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:07.770068 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:56:07.796921 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a14846e2-47a3-4b6d-937d-88d2c1a99c76 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:07.797369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a14846e2-47a3-4b6d-937d-88d2c1a99c76 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:07.798152 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a14846e2-47a3-4b6d-937d-88d2c1a99c76 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:07.798578 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a14846e2-47a3-4b6d-937d-88d2c1a99c76 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:07.913367 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a14846e2-47a3-4b6d-937d-88d2c1a99c76 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '70e72978507240e59a62131875512f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658bc187e1494c37bd05fcb41c37d580', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:07.921621 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a14846e2-47a3-4b6d-937d-88d2c1a99c76 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] flavor_id is None. Assuming migration. {{(pid=119304) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 25 14:56:07.923292 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a14846e2-47a3-4b6d-937d-88d2c1a99c76 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119304) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 14:56:07.963408 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5c9109ce-1057-4d33-a2ae-4a37251ab172 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:07.965503 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5c9109ce-1057-4d33-a2ae-4a37251ab172 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:07.988315 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5c9109ce-1057-4d33-a2ae-4a37251ab172 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:07.989184 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5c9109ce-1057-4d33-a2ae-4a37251ab172 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:07.998565 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5c9109ce-1057-4d33-a2ae-4a37251ab172 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:07.999153 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5c9109ce-1057-4d33-a2ae-4a37251ab172 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:08.226672 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a14846e2-47a3-4b6d-937d-88d2c1a99c76 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d/action" status: 202 len: 0 microversion: 2.1 time: 0.471814 Jul 25 14:56:08.230561 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2849/5436] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:56:07 2022] POST /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:56:08.239094 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bc37770f-6eaf-4a4c-a352-027b9cefe8fb tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:08.239725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bc37770f-6eaf-4a4c-a352-027b9cefe8fb tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:08.251988 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bc37770f-6eaf-4a4c-a352-027b9cefe8fb tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:08.252486 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bc37770f-6eaf-4a4c-a352-027b9cefe8fb tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:08.253271 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bc37770f-6eaf-4a4c-a352-027b9cefe8fb tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:08.253692 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bc37770f-6eaf-4a4c-a352-027b9cefe8fb tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:08.519464 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bc37770f-6eaf-4a4c-a352-027b9cefe8fb tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:08.531917 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bc37770f-6eaf-4a4c-a352-027b9cefe8fb tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1692 microversion: 2.1 time: 0.298911 Jul 25 14:56:08.534119 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2850/5437] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:08 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1692 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:08.798436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2d9907e9-096d-4670-a63f-8944cad5766b tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:08.800640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2d9907e9-096d-4670-a63f-8944cad5766b tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 6dd72192-fbd7-4ae4-902d-6bda149afb5d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:08.804894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:56:08.838244 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d9907e9-096d-4670-a63f-8944cad5766b tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:08.841189 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d9907e9-096d-4670-a63f-8944cad5766b tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:08.846559 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d9907e9-096d-4670-a63f-8944cad5766b tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:08.847484 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d9907e9-096d-4670-a63f-8944cad5766b tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:09.228316 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2d9907e9-096d-4670-a63f-8944cad5766b tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:09.236581 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2d9907e9-096d-4670-a63f-8944cad5766b tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/6dd72192-fbd7-4ae4-902d-6bda149afb5d" status: 200 len: 1320 microversion: 2.1 time: 0.449391 Jul 25 14:56:09.253484 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2851/5438] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:08 2022] GET /compute/v2.1/servers/6dd72192-fbd7-4ae4-902d-6bda149afb5d => generated 1320 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:09.432140 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5c9109ce-1057-4d33-a2ae-4a37251ab172 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:09.446273 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5c9109ce-1057-4d33-a2ae-4a37251ab172 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1683 microversion: 2.1 time: 1.492552 Jul 25 14:56:09.459366 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2588/5439] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:07 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1683 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:09.558448 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-230aff76-2076-47ca-9bac-dd5345bf045f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:09.559722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-230aff76-2076-47ca-9bac-dd5345bf045f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:09.572126 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-230aff76-2076-47ca-9bac-dd5345bf045f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:09.578705 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-230aff76-2076-47ca-9bac-dd5345bf045f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:09.582468 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-230aff76-2076-47ca-9bac-dd5345bf045f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:09.584503 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-230aff76-2076-47ca-9bac-dd5345bf045f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:10.205555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-230aff76-2076-47ca-9bac-dd5345bf045f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:10.214423 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-230aff76-2076-47ca-9bac-dd5345bf045f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1692 microversion: 2.1 time: 0.662186 Jul 25 14:56:10.215017 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2852/5440] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:09 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1692 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:10.259804 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-11c73166-a87d-4dc9-822f-bcefbcd2a645 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:10.260441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-11c73166-a87d-4dc9-822f-bcefbcd2a645 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 6dd72192-fbd7-4ae4-902d-6bda149afb5d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:10.281489 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-11c73166-a87d-4dc9-822f-bcefbcd2a645 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:10.284246 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-11c73166-a87d-4dc9-822f-bcefbcd2a645 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:10.290134 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-11c73166-a87d-4dc9-822f-bcefbcd2a645 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:10.292206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-11c73166-a87d-4dc9-822f-bcefbcd2a645 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:10.484992 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1283ba1b-ea1d-4b38-a626-fbae18e5d296 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:10.489306 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1283ba1b-ea1d-4b38-a626-fbae18e5d296 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:10.518342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1283ba1b-ea1d-4b38-a626-fbae18e5d296 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:10.518791 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1283ba1b-ea1d-4b38-a626-fbae18e5d296 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:10.519574 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1283ba1b-ea1d-4b38-a626-fbae18e5d296 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:10.520244 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1283ba1b-ea1d-4b38-a626-fbae18e5d296 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:10.900432 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-11c73166-a87d-4dc9-822f-bcefbcd2a645 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:10.913724 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-11c73166-a87d-4dc9-822f-bcefbcd2a645 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/6dd72192-fbd7-4ae4-902d-6bda149afb5d" status: 200 len: 1320 microversion: 2.1 time: 0.658942 Jul 25 14:56:10.918383 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2589/5441] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:10 2022] GET /compute/v2.1/servers/6dd72192-fbd7-4ae4-902d-6bda149afb5d => generated 1320 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:11.042664 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1283ba1b-ea1d-4b38-a626-fbae18e5d296 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:11.059482 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1283ba1b-ea1d-4b38-a626-fbae18e5d296 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1683 microversion: 2.1 time: 0.582813 Jul 25 14:56:11.060168 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2853/5442] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:10 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1683 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:11.245754 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-77180a40-8032-4214-ba39-9c49cafb69c2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:11.247087 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-77180a40-8032-4214-ba39-9c49cafb69c2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:11.266896 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77180a40-8032-4214-ba39-9c49cafb69c2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:11.269212 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77180a40-8032-4214-ba39-9c49cafb69c2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:11.270112 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77180a40-8032-4214-ba39-9c49cafb69c2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:11.289405 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77180a40-8032-4214-ba39-9c49cafb69c2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:11.952263 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0c933656-401f-448b-a81a-a7a1e8d40f2d tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:11.953916 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0c933656-401f-448b-a81a-a7a1e8d40f2d tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 6dd72192-fbd7-4ae4-902d-6bda149afb5d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:11.959056 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-77180a40-8032-4214-ba39-9c49cafb69c2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:11.971831 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-77180a40-8032-4214-ba39-9c49cafb69c2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1692 microversion: 2.1 time: 0.730718 Jul 25 14:56:11.984265 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c933656-401f-448b-a81a-a7a1e8d40f2d tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:11.992162 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2590/5443] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:11 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1692 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:11.995325 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c933656-401f-448b-a81a-a7a1e8d40f2d tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:11.998753 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c933656-401f-448b-a81a-a7a1e8d40f2d tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:12.000708 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c933656-401f-448b-a81a-a7a1e8d40f2d tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:12.087369 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-20954f25-e45c-4636-b8ea-7469301916b6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:12.091243 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-20954f25-e45c-4636-b8ea-7469301916b6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:12.131058 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-20954f25-e45c-4636-b8ea-7469301916b6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:12.131515 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-20954f25-e45c-4636-b8ea-7469301916b6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:12.132370 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-20954f25-e45c-4636-b8ea-7469301916b6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:12.132864 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-20954f25-e45c-4636-b8ea-7469301916b6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:12.415607 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0c933656-401f-448b-a81a-a7a1e8d40f2d tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:12.428974 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0c933656-401f-448b-a81a-a7a1e8d40f2d tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/6dd72192-fbd7-4ae4-902d-6bda149afb5d" status: 200 len: 1320 microversion: 2.1 time: 0.493268 Jul 25 14:56:12.456675 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2854/5444] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:11 2022] GET /compute/v2.1/servers/6dd72192-fbd7-4ae4-902d-6bda149afb5d => generated 1320 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:12.832537 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-20954f25-e45c-4636-b8ea-7469301916b6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:12.841267 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-20954f25-e45c-4636-b8ea-7469301916b6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1683 microversion: 2.1 time: 0.757755 Jul 25 14:56:12.848578 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2591/5445] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:12 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1683 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:12.998725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-84988950-7712-4eef-b520-0f1c4c74a994 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:12.999339 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-84988950-7712-4eef-b520-0f1c4c74a994 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:13.013451 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-84988950-7712-4eef-b520-0f1c4c74a994 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:13.014776 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-84988950-7712-4eef-b520-0f1c4c74a994 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:13.016215 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-84988950-7712-4eef-b520-0f1c4c74a994 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:13.016815 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-84988950-7712-4eef-b520-0f1c4c74a994 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:13.324013 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-84988950-7712-4eef-b520-0f1c4c74a994 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:13.337244 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-84988950-7712-4eef-b520-0f1c4c74a994 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1692 microversion: 2.1 time: 0.342370 Jul 25 14:56:13.338444 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2855/5446] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:12 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1692 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:13.451231 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6be24667-2e3d-4f86-b219-383bd3174bae tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:13.452083 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6be24667-2e3d-4f86-b219-383bd3174bae tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 6dd72192-fbd7-4ae4-902d-6bda149afb5d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:13.465156 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6be24667-2e3d-4f86-b219-383bd3174bae tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:13.465681 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6be24667-2e3d-4f86-b219-383bd3174bae tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:13.466601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6be24667-2e3d-4f86-b219-383bd3174bae tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:13.467237 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6be24667-2e3d-4f86-b219-383bd3174bae tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:13.863624 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2650d78d-1e62-4901-8df2-da51a7caa107 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:13.870843 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2650d78d-1e62-4901-8df2-da51a7caa107 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:13.894413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2650d78d-1e62-4901-8df2-da51a7caa107 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:13.900776 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2650d78d-1e62-4901-8df2-da51a7caa107 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:13.902220 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2650d78d-1e62-4901-8df2-da51a7caa107 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:13.905271 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2650d78d-1e62-4901-8df2-da51a7caa107 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:14.115305 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6be24667-2e3d-4f86-b219-383bd3174bae tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:14.135401 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6be24667-2e3d-4f86-b219-383bd3174bae tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/6dd72192-fbd7-4ae4-902d-6bda149afb5d" status: 200 len: 1320 microversion: 2.1 time: 0.689051 Jul 25 14:56:14.136036 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2592/5447] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:13 2022] GET /compute/v2.1/servers/6dd72192-fbd7-4ae4-902d-6bda149afb5d => generated 1320 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:14.173710 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-ff20f6fa-7556-45e9-8916-2f00c8b851f5 req-f26c2ad8-c6ce-435a-a4b0-fd0302ba28bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd72192-fbd7-4ae4-902d-6bda149afb5d", "name": "network-vif-plugged", "status": "completed", "tag": "95b2f2b0-6e07-4f9b-8438-ee573ba9bd91"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:56:14.219237 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ff20f6fa-7556-45e9-8916-2f00c8b851f5 req-f26c2ad8-c6ce-435a-a4b0-fd0302ba28bc service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:14.219896 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ff20f6fa-7556-45e9-8916-2f00c8b851f5 req-f26c2ad8-c6ce-435a-a4b0-fd0302ba28bc service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:14.264857 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-ff20f6fa-7556-45e9-8916-2f00c8b851f5 req-f26c2ad8-c6ce-435a-a4b0-fd0302ba28bc service nova] Creating event network-vif-plugged:95b2f2b0-6e07-4f9b-8438-ee573ba9bd91 for instance 6dd72192-fbd7-4ae4-902d-6bda149afb5d on n-h1-846435-14 Jul 25 14:56:14.280011 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-ff20f6fa-7556-45e9-8916-2f00c8b851f5 req-f26c2ad8-c6ce-435a-a4b0-fd0302ba28bc service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135930 Jul 25 14:56:14.280207 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2650d78d-1e62-4901-8df2-da51a7caa107 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:14.288767 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2593/5448] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:56:14.304376 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2650d78d-1e62-4901-8df2-da51a7caa107 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1683 microversion: 2.1 time: 0.436167 Jul 25 14:56:14.308374 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2856/5449] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:13 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1683 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:14.371341 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-de31bf2b-f782-434e-9891-9e102456c4e3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:14.372271 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-de31bf2b-f782-434e-9891-9e102456c4e3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:14.382598 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-de31bf2b-f782-434e-9891-9e102456c4e3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:14.385755 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-de31bf2b-f782-434e-9891-9e102456c4e3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:14.386697 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-de31bf2b-f782-434e-9891-9e102456c4e3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:14.388601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-de31bf2b-f782-434e-9891-9e102456c4e3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:14.448409 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:56:14.733436 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-de31bf2b-f782-434e-9891-9e102456c4e3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:14.749154 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-de31bf2b-f782-434e-9891-9e102456c4e3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1697 microversion: 2.1 time: 0.377243 Jul 25 14:56:14.752110 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2594/5450] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:14 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1697 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:15.162753 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b917907c-4b8f-4ec9-8ae8-1141efc2df4a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:15.165245 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b917907c-4b8f-4ec9-8ae8-1141efc2df4a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 6dd72192-fbd7-4ae4-902d-6bda149afb5d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:15.185469 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b917907c-4b8f-4ec9-8ae8-1141efc2df4a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:15.196589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b917907c-4b8f-4ec9-8ae8-1141efc2df4a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:15.197898 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b917907c-4b8f-4ec9-8ae8-1141efc2df4a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:15.198598 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b917907c-4b8f-4ec9-8ae8-1141efc2df4a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:15.326798 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2ca3cf6d-3504-44f2-bedf-024a61a168e7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:15.327410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2ca3cf6d-3504-44f2-bedf-024a61a168e7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:15.336206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ca3cf6d-3504-44f2-bedf-024a61a168e7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:15.338233 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ca3cf6d-3504-44f2-bedf-024a61a168e7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:15.340450 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ca3cf6d-3504-44f2-bedf-024a61a168e7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:15.341725 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ca3cf6d-3504-44f2-bedf-024a61a168e7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:15.525916 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b917907c-4b8f-4ec9-8ae8-1141efc2df4a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:15.534290 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b917907c-4b8f-4ec9-8ae8-1141efc2df4a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/6dd72192-fbd7-4ae4-902d-6bda149afb5d" status: 200 len: 1320 microversion: 2.1 time: 0.377879 Jul 25 14:56:15.545711 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2857/5451] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:15 2022] GET /compute/v2.1/servers/6dd72192-fbd7-4ae4-902d-6bda149afb5d => generated 1320 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:15.778302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9fbc5eec-6d32-4cde-ab2f-306f4024d83d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:15.779398 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9fbc5eec-6d32-4cde-ab2f-306f4024d83d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:15.801216 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9fbc5eec-6d32-4cde-ab2f-306f4024d83d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:15.801718 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9fbc5eec-6d32-4cde-ab2f-306f4024d83d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:15.802540 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9fbc5eec-6d32-4cde-ab2f-306f4024d83d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:15.803046 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9fbc5eec-6d32-4cde-ab2f-306f4024d83d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:15.821878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2ca3cf6d-3504-44f2-bedf-024a61a168e7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:15.829825 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2ca3cf6d-3504-44f2-bedf-024a61a168e7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1683 microversion: 2.1 time: 0.506835 Jul 25 14:56:15.840578 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2595/5452] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:15 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1683 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:16.076209 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9fbc5eec-6d32-4cde-ab2f-306f4024d83d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:16.088423 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9fbc5eec-6d32-4cde-ab2f-306f4024d83d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1697 microversion: 2.1 time: 0.314557 Jul 25 14:56:16.089679 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2858/5453] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:15 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1697 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:16.367798 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-f64bbd0a-09ae-4437-b99d-a045229afdf1 req-1ea76dd2-1e70-4525-9d53-1c3b32ae48ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36956163-9db4-450d-b548-fcb3629c7ecf", "name": "network-vif-plugged", "status": "completed", "tag": "0ef1493d-7b10-4e52-8961-d71845f604bb"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:56:16.391568 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f64bbd0a-09ae-4437-b99d-a045229afdf1 req-1ea76dd2-1e70-4525-9d53-1c3b32ae48ef service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:16.392025 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f64bbd0a-09ae-4437-b99d-a045229afdf1 req-1ea76dd2-1e70-4525-9d53-1c3b32ae48ef service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:16.425683 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-f64bbd0a-09ae-4437-b99d-a045229afdf1 req-1ea76dd2-1e70-4525-9d53-1c3b32ae48ef service nova] Creating event network-vif-plugged:0ef1493d-7b10-4e52-8961-d71845f604bb for instance 36956163-9db4-450d-b548-fcb3629c7ecf on n-h2-846435-14 Jul 25 14:56:16.432991 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-f64bbd0a-09ae-4437-b99d-a045229afdf1 req-1ea76dd2-1e70-4525-9d53-1c3b32ae48ef service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069009 Jul 25 14:56:16.437398 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2596/5454] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:56:16.567102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0dbdf2c8-4fd0-4ef9-8d05-b3d52da1b733 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:16.568425 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0dbdf2c8-4fd0-4ef9-8d05-b3d52da1b733 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 6dd72192-fbd7-4ae4-902d-6bda149afb5d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:16.576947 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0dbdf2c8-4fd0-4ef9-8d05-b3d52da1b733 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:16.577668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0dbdf2c8-4fd0-4ef9-8d05-b3d52da1b733 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:16.578747 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0dbdf2c8-4fd0-4ef9-8d05-b3d52da1b733 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:16.579376 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0dbdf2c8-4fd0-4ef9-8d05-b3d52da1b733 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:16.814328 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0dbdf2c8-4fd0-4ef9-8d05-b3d52da1b733 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:16.824403 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0dbdf2c8-4fd0-4ef9-8d05-b3d52da1b733 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/6dd72192-fbd7-4ae4-902d-6bda149afb5d" status: 200 len: 1508 microversion: 2.1 time: 0.262434 Jul 25 14:56:16.841968 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2859/5455] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:16 2022] GET /compute/v2.1/servers/6dd72192-fbd7-4ae4-902d-6bda149afb5d => generated 1508 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:16.851394 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dc80f3d6-fa42-4cc3-9c41-bb19ebfe7dba tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:16.852933 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-dc80f3d6-fa42-4cc3-9c41-bb19ebfe7dba tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 36956163-9db4-450d-b548-fcb3629c7ecf] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:16.867369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-08ae9f17-c3b7-47c8-a76a-0001dd256c73 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:16.869171 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dc80f3d6-fa42-4cc3-9c41-bb19ebfe7dba tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:16.870831 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-08ae9f17-c3b7-47c8-a76a-0001dd256c73 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:16.871289 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dc80f3d6-fa42-4cc3-9c41-bb19ebfe7dba tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:16.872443 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dc80f3d6-fa42-4cc3-9c41-bb19ebfe7dba tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:16.874481 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dc80f3d6-fa42-4cc3-9c41-bb19ebfe7dba tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:16.887749 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-08ae9f17-c3b7-47c8-a76a-0001dd256c73 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:16.888486 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-08ae9f17-c3b7-47c8-a76a-0001dd256c73 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:16.889453 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-08ae9f17-c3b7-47c8-a76a-0001dd256c73 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:16.890035 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-08ae9f17-c3b7-47c8-a76a-0001dd256c73 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:17.288122 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-08ae9f17-c3b7-47c8-a76a-0001dd256c73 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:17.305121 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-08ae9f17-c3b7-47c8-a76a-0001dd256c73 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1683 microversion: 2.1 time: 0.445644 Jul 25 14:56:17.307220 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2860/5456] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:16 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1683 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:17.324981 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8cdf27bf-4b97-498b-918b-8059fbc8a8bc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:17.327660 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8cdf27bf-4b97-498b-918b-8059fbc8a8bc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:17.337615 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-dc80f3d6-fa42-4cc3-9c41-bb19ebfe7dba tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:17.369740 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dc80f3d6-fa42-4cc3-9c41-bb19ebfe7dba tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/36956163-9db4-450d-b548-fcb3629c7ecf" status: 200 len: 1320 microversion: 2.1 time: 0.515460 Jul 25 14:56:17.375777 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2597/5457] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:16 2022] GET /compute/v2.1/servers/36956163-9db4-450d-b548-fcb3629c7ecf => generated 1320 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:17.385774 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8cdf27bf-4b97-498b-918b-8059fbc8a8bc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:17.385774 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8cdf27bf-4b97-498b-918b-8059fbc8a8bc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:17.385774 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8cdf27bf-4b97-498b-918b-8059fbc8a8bc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:17.389694 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8cdf27bf-4b97-498b-918b-8059fbc8a8bc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:17.960257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8cdf27bf-4b97-498b-918b-8059fbc8a8bc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:17.975833 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8cdf27bf-4b97-498b-918b-8059fbc8a8bc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1697 microversion: 2.1 time: 0.665230 Jul 25 14:56:17.979505 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2861/5458] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:17 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1697 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:18.329172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f8887930-5aa7-4391-bc43-ddb4df27d91a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:18.329848 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f8887930-5aa7-4391-bc43-ddb4df27d91a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:18.344153 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8887930-5aa7-4391-bc43-ddb4df27d91a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:18.344619 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8887930-5aa7-4391-bc43-ddb4df27d91a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:18.347878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8887930-5aa7-4391-bc43-ddb4df27d91a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:18.348653 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8887930-5aa7-4391-bc43-ddb4df27d91a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:18.407493 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cb730a07-0a51-4f8a-9986-9fe3190fbf09 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:18.408421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cb730a07-0a51-4f8a-9986-9fe3190fbf09 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 36956163-9db4-450d-b548-fcb3629c7ecf] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:18.420537 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb730a07-0a51-4f8a-9986-9fe3190fbf09 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:18.421256 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb730a07-0a51-4f8a-9986-9fe3190fbf09 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:18.422186 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb730a07-0a51-4f8a-9986-9fe3190fbf09 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:18.424111 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb730a07-0a51-4f8a-9986-9fe3190fbf09 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:18.692102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cb730a07-0a51-4f8a-9986-9fe3190fbf09 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:18.706193 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cb730a07-0a51-4f8a-9986-9fe3190fbf09 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/36956163-9db4-450d-b548-fcb3629c7ecf" status: 200 len: 1320 microversion: 2.1 time: 0.303518 Jul 25 14:56:18.707415 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2862/5459] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:18 2022] GET /compute/v2.1/servers/36956163-9db4-450d-b548-fcb3629c7ecf => generated 1320 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:19.001214 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-97e1423c-4bae-43d9-9e1d-bf2f9b6caac1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:19.002780 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-97e1423c-4bae-43d9-9e1d-bf2f9b6caac1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:19.018518 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-97e1423c-4bae-43d9-9e1d-bf2f9b6caac1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:19.019639 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-97e1423c-4bae-43d9-9e1d-bf2f9b6caac1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:19.022108 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-97e1423c-4bae-43d9-9e1d-bf2f9b6caac1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:19.023811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-97e1423c-4bae-43d9-9e1d-bf2f9b6caac1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:19.091611 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:56:19.197004 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f8887930-5aa7-4391-bc43-ddb4df27d91a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:19.228295 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f8887930-5aa7-4391-bc43-ddb4df27d91a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1683 microversion: 2.1 time: 0.903809 Jul 25 14:56:19.231099 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2598/5460] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:18 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1683 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:19.391422 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-97e1423c-4bae-43d9-9e1d-bf2f9b6caac1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:19.415411 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-97e1423c-4bae-43d9-9e1d-bf2f9b6caac1 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1697 microversion: 2.1 time: 0.419143 Jul 25 14:56:19.431785 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2863/5461] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:18 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1697 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:19.732214 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a29f3c4b-de7b-494e-8ad4-df4e6d2fcd99 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:19.733937 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a29f3c4b-de7b-494e-8ad4-df4e6d2fcd99 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 36956163-9db4-450d-b548-fcb3629c7ecf] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:19.744176 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a29f3c4b-de7b-494e-8ad4-df4e6d2fcd99 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:19.745355 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a29f3c4b-de7b-494e-8ad4-df4e6d2fcd99 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:19.746558 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a29f3c4b-de7b-494e-8ad4-df4e6d2fcd99 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:19.747209 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a29f3c4b-de7b-494e-8ad4-df4e6d2fcd99 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:20.054263 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a29f3c4b-de7b-494e-8ad4-df4e6d2fcd99 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:20.067312 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a29f3c4b-de7b-494e-8ad4-df4e6d2fcd99 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/36956163-9db4-450d-b548-fcb3629c7ecf" status: 200 len: 1508 microversion: 2.1 time: 0.343285 Jul 25 14:56:20.074095 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2599/5462] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:19 2022] GET /compute/v2.1/servers/36956163-9db4-450d-b548-fcb3629c7ecf => generated 1508 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:20.094650 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b840867a-d964-4252-8e70-f0e0dd8ef00f tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:20.095770 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b840867a-d964-4252-8e70-f0e0dd8ef00f tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 36956163-9db4-450d-b548-fcb3629c7ecf] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:20.104926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b840867a-d964-4252-8e70-f0e0dd8ef00f tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:20.105752 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b840867a-d964-4252-8e70-f0e0dd8ef00f tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:20.107027 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b840867a-d964-4252-8e70-f0e0dd8ef00f tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:20.107921 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b840867a-d964-4252-8e70-f0e0dd8ef00f tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:20.167859 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b840867a-d964-4252-8e70-f0e0dd8ef00f tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 36956163-9db4-450d-b548-fcb3629c7ecf] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:56:20.255813 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f8fcf409-a653-4d38-aef2-6600812be5bc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:20.256562 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f8fcf409-a653-4d38-aef2-6600812be5bc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:20.264928 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8fcf409-a653-4d38-aef2-6600812be5bc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:20.265839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8fcf409-a653-4d38-aef2-6600812be5bc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:20.276837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8fcf409-a653-4d38-aef2-6600812be5bc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:20.277665 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8fcf409-a653-4d38-aef2-6600812be5bc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:20.357819 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b840867a-d964-4252-8e70-f0e0dd8ef00f tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "DELETE /compute/v2.1/servers/36956163-9db4-450d-b548-fcb3629c7ecf" status: 204 len: 0 microversion: 2.1 time: 0.266475 Jul 25 14:56:20.359023 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2864/5463] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:56:20 2022] DELETE /compute/v2.1/servers/36956163-9db4-450d-b548-fcb3629c7ecf => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:56:20.377021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-71eec378-3417-4cfb-9ce6-1c2323a07b18 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:20.377840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-71eec378-3417-4cfb-9ce6-1c2323a07b18 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 6dd72192-fbd7-4ae4-902d-6bda149afb5d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:20.407743 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71eec378-3417-4cfb-9ce6-1c2323a07b18 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:20.411068 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71eec378-3417-4cfb-9ce6-1c2323a07b18 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:20.420331 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71eec378-3417-4cfb-9ce6-1c2323a07b18 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:20.421943 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71eec378-3417-4cfb-9ce6-1c2323a07b18 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:20.537708 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-71eec378-3417-4cfb-9ce6-1c2323a07b18 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 6dd72192-fbd7-4ae4-902d-6bda149afb5d] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:56:20.683558 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f8fcf409-a653-4d38-aef2-6600812be5bc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:20.698636 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f8fcf409-a653-4d38-aef2-6600812be5bc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1683 microversion: 2.1 time: 0.446904 Jul 25 14:56:20.703285 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2600/5464] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:20 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1683 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:20.732662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f5fe9879-4a5d-4f82-add7-632893f7d5ae tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:20.738117 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f5fe9879-4a5d-4f82-add7-632893f7d5ae tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:20.759694 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f5fe9879-4a5d-4f82-add7-632893f7d5ae tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:20.766196 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f5fe9879-4a5d-4f82-add7-632893f7d5ae tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:20.767343 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f5fe9879-4a5d-4f82-add7-632893f7d5ae tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:20.770023 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f5fe9879-4a5d-4f82-add7-632893f7d5ae tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:20.783569 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-71eec378-3417-4cfb-9ce6-1c2323a07b18 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "DELETE /compute/v2.1/servers/6dd72192-fbd7-4ae4-902d-6bda149afb5d" status: 204 len: 0 microversion: 2.1 time: 0.418759 Jul 25 14:56:20.784661 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2865/5465] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:56:20 2022] DELETE /compute/v2.1/servers/6dd72192-fbd7-4ae4-902d-6bda149afb5d => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:56:20.973772 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-06f4d712-5208-4b34-8ff9-138f154e931a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1793348153", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "f2a5632c-45d6-4ede-bd35-918998021e4e"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:56:21.041753 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f5fe9879-4a5d-4f82-add7-632893f7d5ae tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:21.068698 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f5fe9879-4a5d-4f82-add7-632893f7d5ae tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1697 microversion: 2.1 time: 0.340289 Jul 25 14:56:21.071265 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2601/5466] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:20 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1697 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:21.094267 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-06f4d712-5208-4b34-8ff9-138f154e931a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] validate_networks() for [('f2a5632c-45d6-4ede-bd35-918998021e4e', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:56:21.728786 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c04b1802-4e2d-4e68-b06d-98795a212f34 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:21.729487 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c04b1802-4e2d-4e68-b06d-98795a212f34 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:21.746078 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c04b1802-4e2d-4e68-b06d-98795a212f34 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:21.747369 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c04b1802-4e2d-4e68-b06d-98795a212f34 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:21.749193 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c04b1802-4e2d-4e68-b06d-98795a212f34 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:21.751431 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c04b1802-4e2d-4e68-b06d-98795a212f34 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:22.405802 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c04b1802-4e2d-4e68-b06d-98795a212f34 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:22.418777 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c04b1802-4e2d-4e68-b06d-98795a212f34 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.696202 Jul 25 14:56:22.420587 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2602/5467] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:21 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:22.476194 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ec1ed35e-01d6-4560-a8e2-65bbd6303a9c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:22.477013 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ec1ed35e-01d6-4560-a8e2-65bbd6303a9c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:22.505863 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec1ed35e-01d6-4560-a8e2-65bbd6303a9c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:22.506327 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec1ed35e-01d6-4560-a8e2-65bbd6303a9c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:22.507138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec1ed35e-01d6-4560-a8e2-65bbd6303a9c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:22.507582 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec1ed35e-01d6-4560-a8e2-65bbd6303a9c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:23.221422 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ec1ed35e-01d6-4560-a8e2-65bbd6303a9c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:23.233626 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ec1ed35e-01d6-4560-a8e2-65bbd6303a9c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1697 microversion: 2.1 time: 0.810796 Jul 25 14:56:23.247576 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2603/5468] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:22 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1697 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:23.795255 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-43b3a62c-9cdd-4500-a005-3b5c97fcdfd1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:23.796439 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-43b3a62c-9cdd-4500-a005-3b5c97fcdfd1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:23.810142 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43b3a62c-9cdd-4500-a005-3b5c97fcdfd1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:23.810688 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43b3a62c-9cdd-4500-a005-3b5c97fcdfd1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:23.817695 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43b3a62c-9cdd-4500-a005-3b5c97fcdfd1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:23.818247 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43b3a62c-9cdd-4500-a005-3b5c97fcdfd1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:24.136870 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-43b3a62c-9cdd-4500-a005-3b5c97fcdfd1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:24.157933 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-43b3a62c-9cdd-4500-a005-3b5c97fcdfd1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.366813 Jul 25 14:56:24.159319 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2604/5469] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:23 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:24.211607 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-5df1fe06-0798-4518-a0ce-ffec912974db req-80f3de25-470e-49c8-8285-9faa3e364af8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e054ea1-6a81-43c7-9746-25b466d4647b", "name": "network-vif-unplugged", "status": "completed", "tag": "24859a24-8dd1-490f-b1c7-01178f7f59b2"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:56:24.234860 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-5df1fe06-0798-4518-a0ce-ffec912974db req-80f3de25-470e-49c8-8285-9faa3e364af8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:24.235489 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-5df1fe06-0798-4518-a0ce-ffec912974db req-80f3de25-470e-49c8-8285-9faa3e364af8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:24.274743 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-5df1fe06-0798-4518-a0ce-ffec912974db req-80f3de25-470e-49c8-8285-9faa3e364af8 service nova] Creating event network-vif-unplugged:24859a24-8dd1-490f-b1c7-01178f7f59b2 for instance 9e054ea1-6a81-43c7-9746-25b466d4647b on n-h2-846435-14 Jul 25 14:56:24.289470 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-5df1fe06-0798-4518-a0ce-ffec912974db req-80f3de25-470e-49c8-8285-9faa3e364af8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079584 Jul 25 14:56:24.290393 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2605/5470] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:56:24.304253 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b171c69a-71e6-48aa-acd8-cc3dcfbc85ec tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:24.305595 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b171c69a-71e6-48aa-acd8-cc3dcfbc85ec tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:24.330815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b171c69a-71e6-48aa-acd8-cc3dcfbc85ec tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:24.331892 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b171c69a-71e6-48aa-acd8-cc3dcfbc85ec tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:24.334241 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b171c69a-71e6-48aa-acd8-cc3dcfbc85ec tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:24.342446 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b171c69a-71e6-48aa-acd8-cc3dcfbc85ec tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:24.380818 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-06f4d712-5208-4b34-8ff9-138f154e931a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:56:24.383074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-06f4d712-5208-4b34-8ff9-138f154e931a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:56:24.384566 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-06f4d712-5208-4b34-8ff9-138f154e931a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:56:24.385867 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-06f4d712-5208-4b34-8ff9-138f154e931a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:56:24.386302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-06f4d712-5208-4b34-8ff9-138f154e931a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:56:24.420573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-06f4d712-5208-4b34-8ff9-138f154e931a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:24.421058 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-06f4d712-5208-4b34-8ff9-138f154e931a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:24.427174 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-06f4d712-5208-4b34-8ff9-138f154e931a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:24.427768 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-06f4d712-5208-4b34-8ff9-138f154e931a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:24.500660 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-06f4d712-5208-4b34-8ff9-138f154e931a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Getting quotas for project 4db4d0f898d548b9a88e1bfa7c69a941. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:56:24.524627 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-06f4d712-5208-4b34-8ff9-138f154e931a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Getting quotas for user 12c817e69a244f0fb1c364bc7ce90e83 and project 4db4d0f898d548b9a88e1bfa7c69a941. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:56:24.570817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-06f4d712-5208-4b34-8ff9-138f154e931a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Going to run 2 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:56:24.593022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-06f4d712-5208-4b34-8ff9-138f154e931a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 8df6413f-d937-4446-b01e-31ed3f057ad1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:56:24.681175 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-06f4d712-5208-4b34-8ff9-138f154e931a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: b09bf101-ff6e-4517-8bd4-bd69a377470f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=8df6413f-d937-4446-b01e-31ed3f057ad1,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:56:24.818574 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-06f4d712-5208-4b34-8ff9-138f154e931a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 3.849274 Jul 25 14:56:24.825672 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2866/5471] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:56:20 2022] POST /compute/v2.1/servers => generated 32 bytes in 3858 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Jul 25 14:56:24.986082 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b171c69a-71e6-48aa-acd8-cc3dcfbc85ec tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:24.998989 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b171c69a-71e6-48aa-acd8-cc3dcfbc85ec tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1697 microversion: 2.1 time: 0.704106 Jul 25 14:56:25.004262 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2606/5472] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:24 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1697 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:25.012430 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fed54687-e750-49fd-95a1-dabca14ffb02 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:25.030689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fed54687-e750-49fd-95a1-dabca14ffb02 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:25.035843 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fed54687-e750-49fd-95a1-dabca14ffb02 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Searching by: {'deleted': False, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941'} {{(pid=119303) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 14:56:25.072071 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fed54687-e750-49fd-95a1-dabca14ffb02 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:25.080757 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fed54687-e750-49fd-95a1-dabca14ffb02 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:25.084108 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fed54687-e750-49fd-95a1-dabca14ffb02 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:25.085510 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fed54687-e750-49fd-95a1-dabca14ffb02 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:25.170624 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.multi_cell_list [None req-fed54687-e750-49fd-95a1-dabca14ffb02 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=119303) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 14:56:25.227112 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-f6680dff-d8aa-43f4-bc36-5af8f8a01b5b req-94685320-5c33-42a6-abdd-c032e4904e46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36956163-9db4-450d-b548-fcb3629c7ecf", "name": "network-vif-deleted", "tag": "0ef1493d-7b10-4e52-8961-d71845f604bb"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:56:25.254237 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-f6680dff-d8aa-43f4-bc36-5af8f8a01b5b req-94685320-5c33-42a6-abdd-c032e4904e46 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:25.266522 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-f6680dff-d8aa-43f4-bc36-5af8f8a01b5b req-94685320-5c33-42a6-abdd-c032e4904e46 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:25.280451 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fed54687-e750-49fd-95a1-dabca14ffb02 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.274793 Jul 25 14:56:25.292938 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2607/5473] 10.222.0.88 () {58 vars in 1125 bytes} [Mon Jul 25 14:56:25 2022] GET /compute/v2.1/servers => generated 1337 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:25.304970 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7630ecc9-e05c-4d28-8756-63e2b0d8b83b tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:25.307799 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-f6680dff-d8aa-43f4-bc36-5af8f8a01b5b req-94685320-5c33-42a6-abdd-c032e4904e46 service nova] Creating event network-vif-deleted:0ef1493d-7b10-4e52-8961-d71845f604bb for instance 36956163-9db4-450d-b548-fcb3629c7ecf on n-h2-846435-14 Jul 25 14:56:25.312786 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7630ecc9-e05c-4d28-8756-63e2b0d8b83b tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: b09bf101-ff6e-4517-8bd4-bd69a377470f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:25.321769 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-f6680dff-d8aa-43f4-bc36-5af8f8a01b5b req-94685320-5c33-42a6-abdd-c032e4904e46 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.494403 Jul 25 14:56:25.323247 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2867/5474] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:56:25.507247 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7630ecc9-e05c-4d28-8756-63e2b0d8b83b tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:25.517100 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7630ecc9-e05c-4d28-8756-63e2b0d8b83b tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f" status: 200 len: 1218 microversion: 2.1 time: 0.215849 Jul 25 14:56:25.532512 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2608/5475] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:25 2022] GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f => generated 1218 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:25.896302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-2d6799ea-da68-4bce-8c84-1eea31f80d65 req-35288ba8-cb2f-4736-bc89-a3d1947c0b4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd72192-fbd7-4ae4-902d-6bda149afb5d", "name": "network-vif-deleted", "tag": "95b2f2b0-6e07-4f9b-8438-ee573ba9bd91"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:56:25.962358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-2d6799ea-da68-4bce-8c84-1eea31f80d65 req-35288ba8-cb2f-4736-bc89-a3d1947c0b4e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:25.965837 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-2d6799ea-da68-4bce-8c84-1eea31f80d65 req-35288ba8-cb2f-4736-bc89-a3d1947c0b4e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:26.029833 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-687b9498-a310-40dc-a1d8-57d012667932 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:26.030628 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-687b9498-a310-40dc-a1d8-57d012667932 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:26.051437 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-687b9498-a310-40dc-a1d8-57d012667932 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:26.052054 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-687b9498-a310-40dc-a1d8-57d012667932 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:26.052877 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-2d6799ea-da68-4bce-8c84-1eea31f80d65 req-35288ba8-cb2f-4736-bc89-a3d1947c0b4e service nova] Creating event network-vif-deleted:95b2f2b0-6e07-4f9b-8438-ee573ba9bd91 for instance 6dd72192-fbd7-4ae4-902d-6bda149afb5d on n-h1-846435-14 Jul 25 14:56:26.053934 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-687b9498-a310-40dc-a1d8-57d012667932 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:26.062096 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-687b9498-a310-40dc-a1d8-57d012667932 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:26.095044 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-2d6799ea-da68-4bce-8c84-1eea31f80d65 req-35288ba8-cb2f-4736-bc89-a3d1947c0b4e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208439 Jul 25 14:56:26.099775 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2868/5476] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:56:26.384658 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-687b9498-a310-40dc-a1d8-57d012667932 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:26.394642 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-687b9498-a310-40dc-a1d8-57d012667932 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1697 microversion: 2.1 time: 0.368648 Jul 25 14:56:26.402137 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2609/5477] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:26 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1697 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:26.413373 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-99b4c275-b226-4534-88a1-9640ed379e91 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:26.419480 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-99b4c275-b226-4534-88a1-9640ed379e91 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:26.449547 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99b4c275-b226-4534-88a1-9640ed379e91 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:26.450014 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99b4c275-b226-4534-88a1-9640ed379e91 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:26.456983 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99b4c275-b226-4534-88a1-9640ed379e91 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:26.457445 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99b4c275-b226-4534-88a1-9640ed379e91 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:26.501545 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2eb79b3d-95c3-40b0-90f2-60c111ec5b35 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1891315328", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "248e4982-fd1b-4d67-a6bb-cd7f7e3eb407"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:56:26.616394 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-2eb79b3d-95c3-40b0-90f2-60c111ec5b35 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] validate_networks() for [('248e4982-fd1b-4d67-a6bb-cd7f7e3eb407', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:56:26.781920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-99b4c275-b226-4534-88a1-9640ed379e91 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:26.795930 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-99b4c275-b226-4534-88a1-9640ed379e91 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.387617 Jul 25 14:56:26.800411 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2610/5478] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:26 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:26.813096 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bec4e181-fe2f-4d16-9b0b-aeaafa048b71 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:26.817510 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bec4e181-fe2f-4d16-9b0b-aeaafa048b71 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: b09bf101-ff6e-4517-8bd4-bd69a377470f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:26.990753 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bec4e181-fe2f-4d16-9b0b-aeaafa048b71 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:27.000166 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bec4e181-fe2f-4d16-9b0b-aeaafa048b71 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f" status: 200 len: 1218 microversion: 2.1 time: 0.195155 Jul 25 14:56:27.003456 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2611/5479] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:26 2022] GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f => generated 1218 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:27.008993 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-beeab387-66c0-4281-8380-a41e967d43cb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:27.016560 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-beeab387-66c0-4281-8380-a41e967d43cb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:27.032487 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-beeab387-66c0-4281-8380-a41e967d43cb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:27.033498 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-beeab387-66c0-4281-8380-a41e967d43cb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:27.035070 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-beeab387-66c0-4281-8380-a41e967d43cb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:27.035681 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-beeab387-66c0-4281-8380-a41e967d43cb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:27.293542 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-beeab387-66c0-4281-8380-a41e967d43cb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:27.303229 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-beeab387-66c0-4281-8380-a41e967d43cb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.297791 Jul 25 14:56:27.307006 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2612/5480] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:27 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:27.329764 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bbe62dcf-319b-480d-8bad-e480660cc4f7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:27.330699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bbe62dcf-319b-480d-8bad-e480660cc4f7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:27.338707 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bbe62dcf-319b-480d-8bad-e480660cc4f7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:27.340553 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bbe62dcf-319b-480d-8bad-e480660cc4f7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:27.341881 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bbe62dcf-319b-480d-8bad-e480660cc4f7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:27.342491 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bbe62dcf-319b-480d-8bad-e480660cc4f7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:27.585860 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bbe62dcf-319b-480d-8bad-e480660cc4f7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:27.601707 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bbe62dcf-319b-480d-8bad-e480660cc4f7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.276085 Jul 25 14:56:27.605589 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2613/5481] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:27 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:27.612120 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-27cfd804-ed92-4bd1-86ea-8b4850132caa tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:27.613341 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-27cfd804-ed92-4bd1-86ea-8b4850132caa tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:27.622519 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27cfd804-ed92-4bd1-86ea-8b4850132caa tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:27.623317 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27cfd804-ed92-4bd1-86ea-8b4850132caa tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:27.624984 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27cfd804-ed92-4bd1-86ea-8b4850132caa tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:27.625935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27cfd804-ed92-4bd1-86ea-8b4850132caa tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:27.632366 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:56:28.332201 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-2eb79b3d-95c3-40b0-90f2-60c111ec5b35 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:56:28.333792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-2eb79b3d-95c3-40b0-90f2-60c111ec5b35 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:56:28.334420 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-2eb79b3d-95c3-40b0-90f2-60c111ec5b35 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:56:28.335003 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-2eb79b3d-95c3-40b0-90f2-60c111ec5b35 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:56:28.335557 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-2eb79b3d-95c3-40b0-90f2-60c111ec5b35 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:56:28.355179 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2eb79b3d-95c3-40b0-90f2-60c111ec5b35 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:28.359320 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2eb79b3d-95c3-40b0-90f2-60c111ec5b35 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:28.362353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2eb79b3d-95c3-40b0-90f2-60c111ec5b35 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:28.368485 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2eb79b3d-95c3-40b0-90f2-60c111ec5b35 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:28.415730 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-2eb79b3d-95c3-40b0-90f2-60c111ec5b35 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Getting quotas for project 83a42abd216b46978be871418669dd8f. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:56:28.447846 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-2eb79b3d-95c3-40b0-90f2-60c111ec5b35 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Getting quotas for user 398d222c122d43cb8eb518b47e816f4e and project 83a42abd216b46978be871418669dd8f. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:56:28.483039 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2eb79b3d-95c3-40b0-90f2-60c111ec5b35 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:56:28.490161 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2eb79b3d-95c3-40b0-90f2-60c111ec5b35 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:56:28.615472 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2eb79b3d-95c3-40b0-90f2-60c111ec5b35 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.259332 Jul 25 14:56:28.619074 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2869/5482] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:56:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2264 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:56:28.631853 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-16036a4d-1cf4-43b6-a0ca-16b8afa8f403 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:56:28.637025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-16036a4d-1cf4-43b6-a0ca-16b8afa8f403 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:28.663589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-16036a4d-1cf4-43b6-a0ca-16b8afa8f403 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:28.679384 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-16036a4d-1cf4-43b6-a0ca-16b8afa8f403 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:28.681778 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-16036a4d-1cf4-43b6-a0ca-16b8afa8f403 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:28.684325 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-16036a4d-1cf4-43b6-a0ca-16b8afa8f403 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:28.768548 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-27cfd804-ed92-4bd1-86ea-8b4850132caa tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:28.781627 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-27cfd804-ed92-4bd1-86ea-8b4850132caa tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1697 microversion: 2.1 time: 1.174181 Jul 25 14:56:28.796688 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2614/5483] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:27 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1697 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:28.802268 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8ed15c1d-9288-4148-a823-54251816719f tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:28.806683 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8ed15c1d-9288-4148-a823-54251816719f tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: b09bf101-ff6e-4517-8bd4-bd69a377470f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:28.822672 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ed15c1d-9288-4148-a823-54251816719f tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:28.825094 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ed15c1d-9288-4148-a823-54251816719f tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:28.831342 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ed15c1d-9288-4148-a823-54251816719f tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:28.832183 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ed15c1d-9288-4148-a823-54251816719f tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:28.947417 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8ed15c1d-9288-4148-a823-54251816719f tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:28.957792 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8ed15c1d-9288-4148-a823-54251816719f tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f" status: 200 len: 1276 microversion: 2.1 time: 0.159346 Jul 25 14:56:28.960134 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2615/5484] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:28 2022] GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f => generated 1276 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:28.976466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-21d1b34f-4261-4e60-bdf8-c1bb85dfdeb8 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:28.977194 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-21d1b34f-4261-4e60-bdf8-c1bb85dfdeb8 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:29.003824 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-16036a4d-1cf4-43b6-a0ca-16b8afa8f403 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action" status: 202 len: 0 microversion: 2.1 time: 0.368097 Jul 25 14:56:29.006097 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2870/5485] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:56:28 2022] POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:56:29.042949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0208cdf9-06d9-4ddf-b1f5-772434e130d5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:29.053633 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0208cdf9-06d9-4ddf-b1f5-772434e130d5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:29.113932 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0208cdf9-06d9-4ddf-b1f5-772434e130d5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:29.115152 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0208cdf9-06d9-4ddf-b1f5-772434e130d5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:29.117182 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0208cdf9-06d9-4ddf-b1f5-772434e130d5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:29.119082 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0208cdf9-06d9-4ddf-b1f5-772434e130d5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:29.175835 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-21d1b34f-4261-4e60-bdf8-c1bb85dfdeb8 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398d222c122d43cb8eb518b47e816f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a42abd216b46978be871418669dd8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:29.206555 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-21d1b34f-4261-4e60-bdf8-c1bb85dfdeb8 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0" status: 200 len: 1215 microversion: 2.1 time: 0.242296 Jul 25 14:56:29.211193 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2616/5486] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:28 2022] GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0 => generated 1215 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:29.805091 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-782101ad-0d12-4f80-9761-1bdad9775b82 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:29.806211 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-782101ad-0d12-4f80-9761-1bdad9775b82 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:29.817106 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-782101ad-0d12-4f80-9761-1bdad9775b82 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:29.817661 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-782101ad-0d12-4f80-9761-1bdad9775b82 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:29.818491 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-782101ad-0d12-4f80-9761-1bdad9775b82 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:29.824745 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-782101ad-0d12-4f80-9761-1bdad9775b82 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:30.357281 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0208cdf9-06d9-4ddf-b1f5-772434e130d5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:30.370947 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0208cdf9-06d9-4ddf-b1f5-772434e130d5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1672 microversion: 2.1 time: 1.353158 Jul 25 14:56:30.395421 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2871/5487] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:29 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1672 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:30.409545 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-de463c69-60dc-4f38-832d-99f564dcb1f1 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:30.412059 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-de463c69-60dc-4f38-832d-99f564dcb1f1 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: b09bf101-ff6e-4517-8bd4-bd69a377470f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:30.420242 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-de463c69-60dc-4f38-832d-99f564dcb1f1 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:30.421811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-de463c69-60dc-4f38-832d-99f564dcb1f1 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:30.422871 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-de463c69-60dc-4f38-832d-99f564dcb1f1 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:30.423693 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-de463c69-60dc-4f38-832d-99f564dcb1f1 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:30.718679 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-782101ad-0d12-4f80-9761-1bdad9775b82 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:30.729880 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-782101ad-0d12-4f80-9761-1bdad9775b82 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1697 microversion: 2.1 time: 0.929026 Jul 25 14:56:30.743663 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2617/5488] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:29 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1697 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:30.764417 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8104a97e-a913-411c-bfb3-af93df406193 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:30.765035 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8104a97e-a913-411c-bfb3-af93df406193 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:30.802969 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8104a97e-a913-411c-bfb3-af93df406193 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:30.803429 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8104a97e-a913-411c-bfb3-af93df406193 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:30.804251 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8104a97e-a913-411c-bfb3-af93df406193 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:30.804685 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8104a97e-a913-411c-bfb3-af93df406193 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:30.809045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-de463c69-60dc-4f38-832d-99f564dcb1f1 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:30.826064 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-de463c69-60dc-4f38-832d-99f564dcb1f1 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f" status: 200 len: 1276 microversion: 2.1 time: 0.421365 Jul 25 14:56:30.831268 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2872/5489] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:30 2022] GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f => generated 1276 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:31.117034 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8104a97e-a913-411c-bfb3-af93df406193 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398d222c122d43cb8eb518b47e816f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a42abd216b46978be871418669dd8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:31.139920 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8104a97e-a913-411c-bfb3-af93df406193 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0" status: 200 len: 1267 microversion: 2.1 time: 0.393664 Jul 25 14:56:31.141710 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2618/5490] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:30 2022] GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0 => generated 1267 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:31.397319 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-163aacf6-b40b-4e5c-805e-95156b1e0dd5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:31.398647 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-163aacf6-b40b-4e5c-805e-95156b1e0dd5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:31.411629 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-163aacf6-b40b-4e5c-805e-95156b1e0dd5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:31.412481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-163aacf6-b40b-4e5c-805e-95156b1e0dd5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:31.413732 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-163aacf6-b40b-4e5c-805e-95156b1e0dd5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:31.414681 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-163aacf6-b40b-4e5c-805e-95156b1e0dd5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:31.764705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6c9bc60d-7699-419e-931f-56027bea3319 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:31.765850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6c9bc60d-7699-419e-931f-56027bea3319 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:31.774457 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6c9bc60d-7699-419e-931f-56027bea3319 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:31.777630 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6c9bc60d-7699-419e-931f-56027bea3319 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:31.783955 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6c9bc60d-7699-419e-931f-56027bea3319 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:31.784793 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6c9bc60d-7699-419e-931f-56027bea3319 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:32.350467 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-163aacf6-b40b-4e5c-805e-95156b1e0dd5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:32.360003 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-163aacf6-b40b-4e5c-805e-95156b1e0dd5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1672 microversion: 2.1 time: 0.966371 Jul 25 14:56:32.371511 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2873/5491] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:31 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1672 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:32.400232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-39230efc-2b8d-4471-9ece-1109e3f9b872 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:32.405437 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-39230efc-2b8d-4471-9ece-1109e3f9b872 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: b09bf101-ff6e-4517-8bd4-bd69a377470f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:32.443544 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-39230efc-2b8d-4471-9ece-1109e3f9b872 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:32.448937 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-39230efc-2b8d-4471-9ece-1109e3f9b872 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:32.452955 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-39230efc-2b8d-4471-9ece-1109e3f9b872 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:32.461251 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-39230efc-2b8d-4471-9ece-1109e3f9b872 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:32.756000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-39230efc-2b8d-4471-9ece-1109e3f9b872 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:32.770647 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-39230efc-2b8d-4471-9ece-1109e3f9b872 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f" status: 200 len: 1276 microversion: 2.1 time: 0.391995 Jul 25 14:56:32.771297 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2874/5492] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:32 2022] GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f => generated 1276 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:32.784301 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ed5a74ec-60c4-4479-b411-efa518966b7f tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:32.784922 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ed5a74ec-60c4-4479-b411-efa518966b7f tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:32.815858 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed5a74ec-60c4-4479-b411-efa518966b7f tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:32.817684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed5a74ec-60c4-4479-b411-efa518966b7f tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:32.821538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed5a74ec-60c4-4479-b411-efa518966b7f tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:32.822153 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed5a74ec-60c4-4479-b411-efa518966b7f tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:32.978253 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6c9bc60d-7699-419e-931f-56027bea3319 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:32.988681 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6c9bc60d-7699-419e-931f-56027bea3319 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1697 microversion: 2.1 time: 1.228433 Jul 25 14:56:32.998710 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2619/5493] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:31 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1697 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:33.070847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ed5a74ec-60c4-4479-b411-efa518966b7f tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398d222c122d43cb8eb518b47e816f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a42abd216b46978be871418669dd8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:33.080028 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ed5a74ec-60c4-4479-b411-efa518966b7f tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0" status: 200 len: 1273 microversion: 2.1 time: 0.307586 Jul 25 14:56:33.091996 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2875/5494] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:32 2022] GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0 => generated 1273 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:33.383319 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-57488daf-70e3-4451-a7d2-46057cc2e1cc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:33.384554 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-57488daf-70e3-4451-a7d2-46057cc2e1cc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:33.397239 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57488daf-70e3-4451-a7d2-46057cc2e1cc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:33.398695 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57488daf-70e3-4451-a7d2-46057cc2e1cc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:33.403479 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57488daf-70e3-4451-a7d2-46057cc2e1cc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:33.404012 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57488daf-70e3-4451-a7d2-46057cc2e1cc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:33.554258 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-bf85a731-32fa-480d-a485-a8325168df16 req-099c35f3-3bcd-4aa3-8748-e9aa34e02699 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8df6413f-d937-4446-b01e-31ed3f057ad1", "tag": "fee08e4f-b3a1-474a-8f68-5861b94e2bc5"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:56:33.573691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-bf85a731-32fa-480d-a485-a8325168df16 req-099c35f3-3bcd-4aa3-8748-e9aa34e02699 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:33.577603 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-bf85a731-32fa-480d-a485-a8325168df16 req-099c35f3-3bcd-4aa3-8748-e9aa34e02699 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:33.601898 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-bf85a731-32fa-480d-a485-a8325168df16 req-099c35f3-3bcd-4aa3-8748-e9aa34e02699 service nova] Creating event network-changed:fee08e4f-b3a1-474a-8f68-5861b94e2bc5 for instance 8df6413f-d937-4446-b01e-31ed3f057ad1 on n-h2-846435-14 Jul 25 14:56:33.618405 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-bf85a731-32fa-480d-a485-a8325168df16 req-099c35f3-3bcd-4aa3-8748-e9aa34e02699 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067645 Jul 25 14:56:33.619653 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2876/5495] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:56:33.793106 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ea74926f-a1c8-445f-aec5-0c60affadc9e tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:33.794163 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ea74926f-a1c8-445f-aec5-0c60affadc9e tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: b09bf101-ff6e-4517-8bd4-bd69a377470f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:33.816666 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea74926f-a1c8-445f-aec5-0c60affadc9e tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:33.817440 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea74926f-a1c8-445f-aec5-0c60affadc9e tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:33.824176 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea74926f-a1c8-445f-aec5-0c60affadc9e tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:33.832315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea74926f-a1c8-445f-aec5-0c60affadc9e tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:34.061180 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-57488daf-70e3-4451-a7d2-46057cc2e1cc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:34.073322 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-57488daf-70e3-4451-a7d2-46057cc2e1cc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1672 microversion: 2.1 time: 0.694106 Jul 25 14:56:34.078232 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2620/5496] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:33 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1672 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:34.106395 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7577fd15-b079-4a77-a0ad-2dd62cffd498 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:34.108246 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7577fd15-b079-4a77-a0ad-2dd62cffd498 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:34.122740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7577fd15-b079-4a77-a0ad-2dd62cffd498 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:34.125481 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7577fd15-b079-4a77-a0ad-2dd62cffd498 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:34.129307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7577fd15-b079-4a77-a0ad-2dd62cffd498 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:34.130437 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7577fd15-b079-4a77-a0ad-2dd62cffd498 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:34.416607 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ea74926f-a1c8-445f-aec5-0c60affadc9e tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:34.427228 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ea74926f-a1c8-445f-aec5-0c60affadc9e tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f" status: 200 len: 1318 microversion: 2.1 time: 0.638901 Jul 25 14:56:34.440018 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2877/5497] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:33 2022] GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f => generated 1318 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:34.445583 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-657511bd-ca8d-436b-b542-97746157a6c4 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:34.446216 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-657511bd-ca8d-436b-b542-97746157a6c4 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:34.461345 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-657511bd-ca8d-436b-b542-97746157a6c4 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:34.461796 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-657511bd-ca8d-436b-b542-97746157a6c4 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:34.466783 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-657511bd-ca8d-436b-b542-97746157a6c4 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:34.470437 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-657511bd-ca8d-436b-b542-97746157a6c4 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:34.531068 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7577fd15-b079-4a77-a0ad-2dd62cffd498 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:34.542549 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7577fd15-b079-4a77-a0ad-2dd62cffd498 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1697 microversion: 2.1 time: 0.462076 Jul 25 14:56:34.548628 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2621/5498] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:34 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1697 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:35.102568 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bf9ea281-194c-48ab-83b1-5d160da7de6e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:35.103388 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bf9ea281-194c-48ab-83b1-5d160da7de6e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:35.125797 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:56:35.127441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bf9ea281-194c-48ab-83b1-5d160da7de6e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:35.127896 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bf9ea281-194c-48ab-83b1-5d160da7de6e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:35.131146 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bf9ea281-194c-48ab-83b1-5d160da7de6e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:35.131600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bf9ea281-194c-48ab-83b1-5d160da7de6e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:35.507765 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bf9ea281-194c-48ab-83b1-5d160da7de6e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:35.515654 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-657511bd-ca8d-436b-b542-97746157a6c4 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398d222c122d43cb8eb518b47e816f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a42abd216b46978be871418669dd8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:35.547700 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-657511bd-ca8d-436b-b542-97746157a6c4 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0" status: 200 len: 1315 microversion: 2.1 time: 1.103807 Jul 25 14:56:35.548800 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2878/5499] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:34 2022] GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0 => generated 1315 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:35.554733 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bf9ea281-194c-48ab-83b1-5d160da7de6e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.452156 Jul 25 14:56:35.575418 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2622/5500] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:35 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:35.581953 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-53b0bbfa-9575-43ee-af28-f4a58b139eb7 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:35.589604 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1c2b79cf-c27d-4661-b1e4-b73fb8f41005 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:35.590217 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1c2b79cf-c27d-4661-b1e4-b73fb8f41005 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: b09bf101-ff6e-4517-8bd4-bd69a377470f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:35.591200 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-53b0bbfa-9575-43ee-af28-f4a58b139eb7 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:35.605055 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=9 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:56:35.610417 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-53b0bbfa-9575-43ee-af28-f4a58b139eb7 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:35.610880 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-53b0bbfa-9575-43ee-af28-f4a58b139eb7 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:35.611759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-53b0bbfa-9575-43ee-af28-f4a58b139eb7 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:35.618631 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1c2b79cf-c27d-4661-b1e4-b73fb8f41005 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:35.619458 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-53b0bbfa-9575-43ee-af28-f4a58b139eb7 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:35.620278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1c2b79cf-c27d-4661-b1e4-b73fb8f41005 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:35.621081 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1c2b79cf-c27d-4661-b1e4-b73fb8f41005 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:35.628749 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1c2b79cf-c27d-4661-b1e4-b73fb8f41005 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:35.634547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:56:35.944275 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1c2b79cf-c27d-4661-b1e4-b73fb8f41005 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:35.952659 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1c2b79cf-c27d-4661-b1e4-b73fb8f41005 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f" status: 200 len: 1318 microversion: 2.1 time: 0.396634 Jul 25 14:56:35.959651 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-53b0bbfa-9575-43ee-af28-f4a58b139eb7 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:35.967556 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-53b0bbfa-9575-43ee-af28-f4a58b139eb7 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1697 microversion: 2.1 time: 0.390641 Jul 25 14:56:35.977530 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2623/5501] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:35 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1697 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:35.980740 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2879/5502] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:35 2022] GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f => generated 1318 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:35.989400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7024347a-2ff5-40b5-acf0-b5eeec3ac106 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:56:35.992421 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7024347a-2ff5-40b5-acf0-b5eeec3ac106 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:36.008484 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7024347a-2ff5-40b5-acf0-b5eeec3ac106 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:36.010360 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7024347a-2ff5-40b5-acf0-b5eeec3ac106 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:36.011357 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7024347a-2ff5-40b5-acf0-b5eeec3ac106 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:36.012014 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7024347a-2ff5-40b5-acf0-b5eeec3ac106 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:36.569361 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9896c9de-e0b3-4892-9ccc-f63c1eb3ad2e tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:36.570612 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9896c9de-e0b3-4892-9ccc-f63c1eb3ad2e tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:36.582183 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9896c9de-e0b3-4892-9ccc-f63c1eb3ad2e tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:36.582917 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9896c9de-e0b3-4892-9ccc-f63c1eb3ad2e tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:36.588601 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9896c9de-e0b3-4892-9ccc-f63c1eb3ad2e tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:36.589256 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9896c9de-e0b3-4892-9ccc-f63c1eb3ad2e tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:36.912447 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9896c9de-e0b3-4892-9ccc-f63c1eb3ad2e tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398d222c122d43cb8eb518b47e816f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a42abd216b46978be871418669dd8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:36.925137 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9896c9de-e0b3-4892-9ccc-f63c1eb3ad2e tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0" status: 200 len: 1315 microversion: 2.1 time: 0.359637 Jul 25 14:56:36.938830 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2880/5503] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:36 2022] GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0 => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:37.000338 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ecc682d3-8788-4cec-adb3-637aee3c7835 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:37.000967 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ecc682d3-8788-4cec-adb3-637aee3c7835 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:37.017534 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ecc682d3-8788-4cec-adb3-637aee3c7835 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:37.018264 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ecc682d3-8788-4cec-adb3-637aee3c7835 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:37.020459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ecc682d3-8788-4cec-adb3-637aee3c7835 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:37.021087 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ecc682d3-8788-4cec-adb3-637aee3c7835 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:37.343531 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ecc682d3-8788-4cec-adb3-637aee3c7835 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:37.356345 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ecc682d3-8788-4cec-adb3-637aee3c7835 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1696 microversion: 2.1 time: 0.361915 Jul 25 14:56:37.357555 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2881/5504] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:36 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1696 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:37.369146 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c477c366-1b13-4bf7-bbc7-0c3d2601bf8a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:37.369983 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c477c366-1b13-4bf7-bbc7-0c3d2601bf8a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: b09bf101-ff6e-4517-8bd4-bd69a377470f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:37.419291 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c477c366-1b13-4bf7-bbc7-0c3d2601bf8a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:37.423251 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c477c366-1b13-4bf7-bbc7-0c3d2601bf8a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:37.424950 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c477c366-1b13-4bf7-bbc7-0c3d2601bf8a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:37.429941 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c477c366-1b13-4bf7-bbc7-0c3d2601bf8a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:37.736809 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c477c366-1b13-4bf7-bbc7-0c3d2601bf8a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:37.746278 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c477c366-1b13-4bf7-bbc7-0c3d2601bf8a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f" status: 200 len: 1318 microversion: 2.1 time: 0.387367 Jul 25 14:56:37.760279 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2882/5505] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:37 2022] GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f => generated 1318 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:37.766618 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-9949b2f1-d53f-484f-aac7-cc7ada3e069b req-f7fc6e32-9c9a-4027-b4b8-4770fff33bcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b09bf101-ff6e-4517-8bd4-bd69a377470f", "tag": "b914e258-00bb-43ca-8139-2c8d1a39c5a7"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:56:37.777240 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-9949b2f1-d53f-484f-aac7-cc7ada3e069b req-f7fc6e32-9c9a-4027-b4b8-4770fff33bcc service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:37.778029 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-9949b2f1-d53f-484f-aac7-cc7ada3e069b req-f7fc6e32-9c9a-4027-b4b8-4770fff33bcc service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:37.792159 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-9949b2f1-d53f-484f-aac7-cc7ada3e069b req-f7fc6e32-9c9a-4027-b4b8-4770fff33bcc service nova] Creating event network-changed:b914e258-00bb-43ca-8139-2c8d1a39c5a7 for instance b09bf101-ff6e-4517-8bd4-bd69a377470f on n-h2-846435-14 Jul 25 14:56:37.801890 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-9949b2f1-d53f-484f-aac7-cc7ada3e069b req-f7fc6e32-9c9a-4027-b4b8-4770fff33bcc service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039791 Jul 25 14:56:37.802521 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2883/5506] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:56:37.946683 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-baa52571-ec77-4a76-a690-af2ec2951cb6 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:37.948974 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-baa52571-ec77-4a76-a690-af2ec2951cb6 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:37.960202 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-baa52571-ec77-4a76-a690-af2ec2951cb6 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:37.965303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-baa52571-ec77-4a76-a690-af2ec2951cb6 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:37.967493 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-baa52571-ec77-4a76-a690-af2ec2951cb6 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:37.969103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-baa52571-ec77-4a76-a690-af2ec2951cb6 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:38.358484 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7024347a-2ff5-40b5-acf0-b5eeec3ac106 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action" status: 200 len: 324 microversion: 2.1 time: 2.379581 Jul 25 14:56:38.359933 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2624/5507] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:56:35 2022] POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action => generated 324 bytes in 2382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:56:38.371310 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3c879613-9043-44e0-9a9b-27d416569950 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:38.373910 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3c879613-9043-44e0-9a9b-27d416569950 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:38.386928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=4 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:56:38.391377 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=84 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:56:38.396357 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c879613-9043-44e0-9a9b-27d416569950 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:38.397964 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c879613-9043-44e0-9a9b-27d416569950 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:38.399580 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c879613-9043-44e0-9a9b-27d416569950 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:38.400370 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c879613-9043-44e0-9a9b-27d416569950 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:38.469469 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=12 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:56:38.587474 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-baa52571-ec77-4a76-a690-af2ec2951cb6 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398d222c122d43cb8eb518b47e816f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a42abd216b46978be871418669dd8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:38.596842 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-baa52571-ec77-4a76-a690-af2ec2951cb6 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0" status: 200 len: 1315 microversion: 2.1 time: 0.653282 Jul 25 14:56:38.602062 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2884/5508] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:37 2022] GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0 => generated 1315 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:38.609264 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-03752caf-43ea-4d97-ba1d-e7352d21bee3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:38.617040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-03752caf-43ea-4d97-ba1d-e7352d21bee3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:38.639682 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-03752caf-43ea-4d97-ba1d-e7352d21bee3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:38.642991 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-03752caf-43ea-4d97-ba1d-e7352d21bee3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:38.643868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-03752caf-43ea-4d97-ba1d-e7352d21bee3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:38.652596 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-03752caf-43ea-4d97-ba1d-e7352d21bee3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:38.907909 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3c879613-9043-44e0-9a9b-27d416569950 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:38.918054 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3c879613-9043-44e0-9a9b-27d416569950 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.551976 Jul 25 14:56:38.922653 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2625/5509] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:38 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:38.940423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-db484f3b-ba80-4765-983e-5d459c06a6e8 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:38.942231 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-db484f3b-ba80-4765-983e-5d459c06a6e8 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: b09bf101-ff6e-4517-8bd4-bd69a377470f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:38.974510 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-db484f3b-ba80-4765-983e-5d459c06a6e8 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:38.975352 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-db484f3b-ba80-4765-983e-5d459c06a6e8 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:38.979584 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-db484f3b-ba80-4765-983e-5d459c06a6e8 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:38.980297 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-db484f3b-ba80-4765-983e-5d459c06a6e8 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:39.186801 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:56:39.363864 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-03752caf-43ea-4d97-ba1d-e7352d21bee3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:39.372593 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-03752caf-43ea-4d97-ba1d-e7352d21bee3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1696 microversion: 2.1 time: 0.769067 Jul 25 14:56:39.373770 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2885/5510] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:38 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1696 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:39.390595 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c8fea943-5c8e-407d-91ce-0c7728a21f07 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:39.394321 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c8fea943-5c8e-407d-91ce-0c7728a21f07 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:39.411036 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c8fea943-5c8e-407d-91ce-0c7728a21f07 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:39.412334 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c8fea943-5c8e-407d-91ce-0c7728a21f07 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:39.414622 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c8fea943-5c8e-407d-91ce-0c7728a21f07 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:39.416594 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c8fea943-5c8e-407d-91ce-0c7728a21f07 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:39.508905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-db484f3b-ba80-4765-983e-5d459c06a6e8 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:39.522701 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-db484f3b-ba80-4765-983e-5d459c06a6e8 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f" status: 200 len: 1318 microversion: 2.1 time: 0.596043 Jul 25 14:56:39.523876 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2626/5511] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:38 2022] GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f => generated 1318 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:39.617220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b696c528-a558-4713-b080-2e39c1ef3763 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:39.619727 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b696c528-a558-4713-b080-2e39c1ef3763 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:39.636878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b696c528-a558-4713-b080-2e39c1ef3763 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:39.636878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b696c528-a558-4713-b080-2e39c1ef3763 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:39.637866 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b696c528-a558-4713-b080-2e39c1ef3763 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:39.638403 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b696c528-a558-4713-b080-2e39c1ef3763 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:40.020036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b696c528-a558-4713-b080-2e39c1ef3763 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398d222c122d43cb8eb518b47e816f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a42abd216b46978be871418669dd8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:40.028798 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b696c528-a558-4713-b080-2e39c1ef3763 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0" status: 200 len: 1315 microversion: 2.1 time: 0.415349 Jul 25 14:56:40.034680 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2627/5512] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:39 2022] GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0 => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:40.039652 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-f950079e-10e9-4a59-b60e-f1190c1c0d02 req-663c7404-ed4d-4001-9128-e0f8a23e9a43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "238133c4-5cb9-47aa-990b-9b890682a9e0", "tag": "818ad8ee-4bbb-4ccb-9600-80a946c83530"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:56:40.047751 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c8fea943-5c8e-407d-91ce-0c7728a21f07 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:40.055857 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c8fea943-5c8e-407d-91ce-0c7728a21f07 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.680618 Jul 25 14:56:40.056486 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2886/5513] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:39 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:40.072124 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f950079e-10e9-4a59-b60e-f1190c1c0d02 req-663c7404-ed4d-4001-9128-e0f8a23e9a43 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:40.075654 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f950079e-10e9-4a59-b60e-f1190c1c0d02 req-663c7404-ed4d-4001-9128-e0f8a23e9a43 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:40.076682 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e92668ee-d0ae-4fa7-a3e2-f00aa58286fe tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:40.077557 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e92668ee-d0ae-4fa7-a3e2-f00aa58286fe tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:40.084224 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e92668ee-d0ae-4fa7-a3e2-f00aa58286fe tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:40.084944 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e92668ee-d0ae-4fa7-a3e2-f00aa58286fe tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:40.085894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e92668ee-d0ae-4fa7-a3e2-f00aa58286fe tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:40.086483 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e92668ee-d0ae-4fa7-a3e2-f00aa58286fe tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:40.108468 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-f950079e-10e9-4a59-b60e-f1190c1c0d02 req-663c7404-ed4d-4001-9128-e0f8a23e9a43 service nova] Creating event network-changed:818ad8ee-4bbb-4ccb-9600-80a946c83530 for instance 238133c4-5cb9-47aa-990b-9b890682a9e0 on n-h1-846435-14 Jul 25 14:56:40.121747 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-f950079e-10e9-4a59-b60e-f1190c1c0d02 req-663c7404-ed4d-4001-9128-e0f8a23e9a43 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085516 Jul 25 14:56:40.122984 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2628/5514] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:56:40.219310 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-c19701f5-bdc9-4c3b-ad23-af0c33a5a60a req-c3ff5289-bf4a-46d0-9027-c43940f6746a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d027db2-6df4-4295-a5e1-d8886d34018d", "name": "network-vif-unplugged", "status": "completed", "tag": "6edba24d-b14c-4866-afee-2438b889d8bb"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:56:40.240297 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c19701f5-bdc9-4c3b-ad23-af0c33a5a60a req-c3ff5289-bf4a-46d0-9027-c43940f6746a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:40.241202 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c19701f5-bdc9-4c3b-ad23-af0c33a5a60a req-c3ff5289-bf4a-46d0-9027-c43940f6746a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:40.261050 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-c19701f5-bdc9-4c3b-ad23-af0c33a5a60a req-c3ff5289-bf4a-46d0-9027-c43940f6746a service nova] Creating event network-vif-unplugged:6edba24d-b14c-4866-afee-2438b889d8bb for instance 4d027db2-6df4-4295-a5e1-d8886d34018d on n-h2-846435-14 Jul 25 14:56:40.269477 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [req-c19701f5-bdc9-4c3b-ad23-af0c33a5a60a req-c3ff5289-bf4a-46d0-9027-c43940f6746a service nova] Instance 4d027db2-6df4-4295-a5e1-d8886d34018d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119303) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 14:56:40.292678 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-c19701f5-bdc9-4c3b-ad23-af0c33a5a60a req-c3ff5289-bf4a-46d0-9027-c43940f6746a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077878 Jul 25 14:56:40.293696 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2629/5515] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:56:40.299338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-31ad6542-b719-44e4-b74a-334d7a332edf req-7121a3f3-34a9-4bfd-8a99-93bdd722db99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8df6413f-d937-4446-b01e-31ed3f057ad1", "name": "network-vif-plugged", "status": "completed", "tag": "fee08e4f-b3a1-474a-8f68-5861b94e2bc5"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:56:40.322832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-31ad6542-b719-44e4-b74a-334d7a332edf req-7121a3f3-34a9-4bfd-8a99-93bdd722db99 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:40.325782 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-31ad6542-b719-44e4-b74a-334d7a332edf req-7121a3f3-34a9-4bfd-8a99-93bdd722db99 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:40.362568 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-31ad6542-b719-44e4-b74a-334d7a332edf req-7121a3f3-34a9-4bfd-8a99-93bdd722db99 service nova] Creating event network-vif-plugged:fee08e4f-b3a1-474a-8f68-5861b94e2bc5 for instance 8df6413f-d937-4446-b01e-31ed3f057ad1 on n-h2-846435-14 Jul 25 14:56:40.374634 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-31ad6542-b719-44e4-b74a-334d7a332edf req-7121a3f3-34a9-4bfd-8a99-93bdd722db99 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079179 Jul 25 14:56:40.375641 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2630/5516] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:56:40.398575 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5f6579bf-863e-4a85-88f7-53184cf0d4f8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:40.399689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5f6579bf-863e-4a85-88f7-53184cf0d4f8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:40.425338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f6579bf-863e-4a85-88f7-53184cf0d4f8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:40.439213 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f6579bf-863e-4a85-88f7-53184cf0d4f8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:40.450708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f6579bf-863e-4a85-88f7-53184cf0d4f8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:40.451447 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f6579bf-863e-4a85-88f7-53184cf0d4f8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:40.932470 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5f6579bf-863e-4a85-88f7-53184cf0d4f8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:40.946103 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5f6579bf-863e-4a85-88f7-53184cf0d4f8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1696 microversion: 2.1 time: 0.550066 Jul 25 14:56:40.947879 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2631/5517] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:40 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1696 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:40.952870 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dd061ae2-f341-41a3-a3b8-079fc00e64b1 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:40.953701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-dd061ae2-f341-41a3-a3b8-079fc00e64b1 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: b09bf101-ff6e-4517-8bd4-bd69a377470f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:40.963138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dd061ae2-f341-41a3-a3b8-079fc00e64b1 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:40.963813 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dd061ae2-f341-41a3-a3b8-079fc00e64b1 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:40.965185 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dd061ae2-f341-41a3-a3b8-079fc00e64b1 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:40.965903 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dd061ae2-f341-41a3-a3b8-079fc00e64b1 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:41.270069 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-dd061ae2-f341-41a3-a3b8-079fc00e64b1 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:41.280977 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dd061ae2-f341-41a3-a3b8-079fc00e64b1 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f" status: 200 len: 1318 microversion: 2.1 time: 0.331625 Jul 25 14:56:41.282185 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2632/5518] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:40 2022] GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:41.287664 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9721d206-fcb0-4468-b25e-8ec2ff8f6a54 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:41.288597 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9721d206-fcb0-4468-b25e-8ec2ff8f6a54 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:41.295712 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9721d206-fcb0-4468-b25e-8ec2ff8f6a54 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:41.296436 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9721d206-fcb0-4468-b25e-8ec2ff8f6a54 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:41.297434 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9721d206-fcb0-4468-b25e-8ec2ff8f6a54 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:41.298058 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9721d206-fcb0-4468-b25e-8ec2ff8f6a54 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:41.513946 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e92668ee-d0ae-4fa7-a3e2-f00aa58286fe tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:41.527476 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e92668ee-d0ae-4fa7-a3e2-f00aa58286fe tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 1.454455 Jul 25 14:56:41.536732 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2887/5519] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:40 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:41.549134 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e884b621-8667-4c59-90fb-ca15bbc46117 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:41.550051 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e884b621-8667-4c59-90fb-ca15bbc46117 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:41.588550 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e884b621-8667-4c59-90fb-ca15bbc46117 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:41.589790 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e884b621-8667-4c59-90fb-ca15bbc46117 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:41.592829 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e884b621-8667-4c59-90fb-ca15bbc46117 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:41.593517 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e884b621-8667-4c59-90fb-ca15bbc46117 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:41.710527 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9721d206-fcb0-4468-b25e-8ec2ff8f6a54 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398d222c122d43cb8eb518b47e816f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a42abd216b46978be871418669dd8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:41.713675 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:56:41.726073 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9721d206-fcb0-4468-b25e-8ec2ff8f6a54 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0" status: 200 len: 1315 microversion: 2.1 time: 0.442281 Jul 25 14:56:41.729270 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2633/5520] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:41 2022] GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0 => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:41.967533 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fadb265e-c501-4f92-84f9-653e25847bd3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:41.969028 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fadb265e-c501-4f92-84f9-653e25847bd3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:41.981593 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fadb265e-c501-4f92-84f9-653e25847bd3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:41.987536 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fadb265e-c501-4f92-84f9-653e25847bd3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:41.988645 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fadb265e-c501-4f92-84f9-653e25847bd3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:41.991934 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fadb265e-c501-4f92-84f9-653e25847bd3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:42.251501 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e884b621-8667-4c59-90fb-ca15bbc46117 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:42.262242 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e884b621-8667-4c59-90fb-ca15bbc46117 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.717041 Jul 25 14:56:42.272204 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2888/5521] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:41 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:42.303739 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ca61905b-3b13-4271-bb31-538d8d5afb4e tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:42.304396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ca61905b-3b13-4271-bb31-538d8d5afb4e tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: b09bf101-ff6e-4517-8bd4-bd69a377470f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:42.316465 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ca61905b-3b13-4271-bb31-538d8d5afb4e tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:42.316934 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ca61905b-3b13-4271-bb31-538d8d5afb4e tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:42.317862 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ca61905b-3b13-4271-bb31-538d8d5afb4e tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:42.318161 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ca61905b-3b13-4271-bb31-538d8d5afb4e tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:42.740429 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ca61905b-3b13-4271-bb31-538d8d5afb4e tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:42.748541 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ca61905b-3b13-4271-bb31-538d8d5afb4e tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f" status: 200 len: 1318 microversion: 2.1 time: 0.449801 Jul 25 14:56:42.752809 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2889/5522] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:42 2022] GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f => generated 1318 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:42.762949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f77d31b6-4708-43ef-ae66-2664868f500c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1417391902", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "00285697-02be-4390-bafc-7b88de31480b"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:56:42.839637 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-f77d31b6-4708-43ef-ae66-2664868f500c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] validate_networks() for [('00285697-02be-4390-bafc-7b88de31480b', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:56:42.992325 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fadb265e-c501-4f92-84f9-653e25847bd3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:43.004376 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fadb265e-c501-4f92-84f9-653e25847bd3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1696 microversion: 2.1 time: 1.040677 Jul 25 14:56:43.006786 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2634/5523] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:41 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1696 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:43.036493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-c2c15f43-2c9e-4bfa-a527-e6ceeeb3b97e req-5619c426-09e9-4800-8a5b-0739275131e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d027db2-6df4-4295-a5e1-d8886d34018d", "tag": "6edba24d-b14c-4866-afee-2438b889d8bb"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:56:43.053174 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c2c15f43-2c9e-4bfa-a527-e6ceeeb3b97e req-5619c426-09e9-4800-8a5b-0739275131e2 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:43.053638 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c2c15f43-2c9e-4bfa-a527-e6ceeeb3b97e req-5619c426-09e9-4800-8a5b-0739275131e2 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:43.094487 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-c2c15f43-2c9e-4bfa-a527-e6ceeeb3b97e req-5619c426-09e9-4800-8a5b-0739275131e2 service nova] Creating event network-changed:6edba24d-b14c-4866-afee-2438b889d8bb for instance 4d027db2-6df4-4295-a5e1-d8886d34018d on n-h2-846435-14 Jul 25 14:56:43.108589 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [req-c2c15f43-2c9e-4bfa-a527-e6ceeeb3b97e req-5619c426-09e9-4800-8a5b-0739275131e2 service nova] Instance 4d027db2-6df4-4295-a5e1-d8886d34018d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119303) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 14:56:43.137018 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-c2c15f43-2c9e-4bfa-a527-e6ceeeb3b97e req-5619c426-09e9-4800-8a5b-0739275131e2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109854 Jul 25 14:56:43.137717 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2635/5524] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:56:43.154053 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-afc8102a-2fe4-44cc-ae9d-9233b1a4ad77 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:43.154769 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-afc8102a-2fe4-44cc-ae9d-9233b1a4ad77 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:43.195575 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-afc8102a-2fe4-44cc-ae9d-9233b1a4ad77 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:43.196053 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-afc8102a-2fe4-44cc-ae9d-9233b1a4ad77 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:43.196866 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-afc8102a-2fe4-44cc-ae9d-9233b1a4ad77 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:43.197385 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-afc8102a-2fe4-44cc-ae9d-9233b1a4ad77 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:43.552856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-afc8102a-2fe4-44cc-ae9d-9233b1a4ad77 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398d222c122d43cb8eb518b47e816f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a42abd216b46978be871418669dd8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:43.573362 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-afc8102a-2fe4-44cc-ae9d-9233b1a4ad77 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0" status: 200 len: 1315 microversion: 2.1 time: 0.427597 Jul 25 14:56:43.574220 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2636/5525] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:43 2022] GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0 => generated 1315 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:43.750329 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-2f84f908-89aa-4e8a-b6dd-47fd449ba613 req-4a9efd64-47e3-4fc3-a9ab-b1e83c428210 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "238133c4-5cb9-47aa-990b-9b890682a9e0", "name": "network-vif-plugged", "status": "completed", "tag": "818ad8ee-4bbb-4ccb-9600-80a946c83530"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:56:43.760361 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-2f84f908-89aa-4e8a-b6dd-47fd449ba613 req-4a9efd64-47e3-4fc3-a9ab-b1e83c428210 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:43.761211 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-2f84f908-89aa-4e8a-b6dd-47fd449ba613 req-4a9efd64-47e3-4fc3-a9ab-b1e83c428210 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:43.780142 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-2f84f908-89aa-4e8a-b6dd-47fd449ba613 req-4a9efd64-47e3-4fc3-a9ab-b1e83c428210 service nova] Creating event network-vif-plugged:818ad8ee-4bbb-4ccb-9600-80a946c83530 for instance 238133c4-5cb9-47aa-990b-9b890682a9e0 on n-h1-846435-14 Jul 25 14:56:43.787669 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-2f84f908-89aa-4e8a-b6dd-47fd449ba613 req-4a9efd64-47e3-4fc3-a9ab-b1e83c428210 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040356 Jul 25 14:56:43.789168 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2637/5526] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:56:43.796868 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5a8577f8-37ba-4cde-8b65-8e5a297bd870 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:43.798031 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5a8577f8-37ba-4cde-8b65-8e5a297bd870 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: b09bf101-ff6e-4517-8bd4-bd69a377470f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:43.808611 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5a8577f8-37ba-4cde-8b65-8e5a297bd870 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:43.809335 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5a8577f8-37ba-4cde-8b65-8e5a297bd870 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:43.811812 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5a8577f8-37ba-4cde-8b65-8e5a297bd870 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:43.812451 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5a8577f8-37ba-4cde-8b65-8e5a297bd870 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:44.009386 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f77d31b6-4708-43ef-ae66-2664868f500c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:56:44.009386 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f77d31b6-4708-43ef-ae66-2664868f500c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:56:44.009386 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f77d31b6-4708-43ef-ae66-2664868f500c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:56:44.009386 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f77d31b6-4708-43ef-ae66-2664868f500c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:56:44.009386 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f77d31b6-4708-43ef-ae66-2664868f500c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:56:44.018590 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f77d31b6-4708-43ef-ae66-2664868f500c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:44.019297 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f77d31b6-4708-43ef-ae66-2664868f500c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:44.020359 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f77d31b6-4708-43ef-ae66-2664868f500c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:44.021005 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f77d31b6-4708-43ef-ae66-2664868f500c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:44.037036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5a8577f8-37ba-4cde-8b65-8e5a297bd870 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:44.047620 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5a8577f8-37ba-4cde-8b65-8e5a297bd870 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f" status: 200 len: 1318 microversion: 2.1 time: 0.256984 Jul 25 14:56:44.048246 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2638/5527] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:43 2022] GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:44.053482 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-f77d31b6-4708-43ef-ae66-2664868f500c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Getting quotas for project 649465d992d749eca5d73d30e61ab62e. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:56:44.061503 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-f77d31b6-4708-43ef-ae66-2664868f500c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Getting quotas for user 72d5f52dd1ae4cf999f7df131b70223c and project 649465d992d749eca5d73d30e61ab62e. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:56:44.062227 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-621dc9e4-6fcf-433e-bc6c-af6b4fb2e844 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:44.062980 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-621dc9e4-6fcf-433e-bc6c-af6b4fb2e844 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:44.074649 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-621dc9e4-6fcf-433e-bc6c-af6b4fb2e844 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:44.075108 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-621dc9e4-6fcf-433e-bc6c-af6b4fb2e844 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:44.079511 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f77d31b6-4708-43ef-ae66-2664868f500c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:56:44.081322 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-621dc9e4-6fcf-433e-bc6c-af6b4fb2e844 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:44.081951 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-621dc9e4-6fcf-433e-bc6c-af6b4fb2e844 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:44.082895 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f77d31b6-4708-43ef-ae66-2664868f500c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:56:44.161342 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f77d31b6-4708-43ef-ae66-2664868f500c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.406938 Jul 25 14:56:44.163133 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2890/5528] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:56:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:56:44.179416 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-99514679-b744-4f01-bd1f-f2eeea6eda8d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:44.183095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-99514679-b744-4f01-bd1f-f2eeea6eda8d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:44.258641 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-99514679-b744-4f01-bd1f-f2eeea6eda8d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:44.268569 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-99514679-b744-4f01-bd1f-f2eeea6eda8d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 200 len: 1215 microversion: 2.1 time: 0.093046 Jul 25 14:56:44.273792 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2891/5529] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:44 2022] GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 1215 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:44.281750 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-621dc9e4-6fcf-433e-bc6c-af6b4fb2e844 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:44.290069 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-621dc9e4-6fcf-433e-bc6c-af6b4fb2e844 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1696 microversion: 2.1 time: 0.240538 Jul 25 14:56:44.290667 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2639/5530] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:44 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1696 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:44.598948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f8f16deb-409b-4fe6-87f3-0e0bef2cd6b1 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:44.600009 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f8f16deb-409b-4fe6-87f3-0e0bef2cd6b1 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:44.607520 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8f16deb-409b-4fe6-87f3-0e0bef2cd6b1 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:44.608458 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8f16deb-409b-4fe6-87f3-0e0bef2cd6b1 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:44.609585 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8f16deb-409b-4fe6-87f3-0e0bef2cd6b1 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:44.610259 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8f16deb-409b-4fe6-87f3-0e0bef2cd6b1 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:45.072670 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b5aa7f76-5fae-4f20-824e-c616e4024d62 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:45.073871 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b5aa7f76-5fae-4f20-824e-c616e4024d62 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: b09bf101-ff6e-4517-8bd4-bd69a377470f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:45.085483 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b5aa7f76-5fae-4f20-824e-c616e4024d62 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:45.086225 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b5aa7f76-5fae-4f20-824e-c616e4024d62 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:45.087208 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b5aa7f76-5fae-4f20-824e-c616e4024d62 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:45.087740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b5aa7f76-5fae-4f20-824e-c616e4024d62 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:45.280653 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b5aa7f76-5fae-4f20-824e-c616e4024d62 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:45.290781 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b5aa7f76-5fae-4f20-824e-c616e4024d62 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f" status: 200 len: 1318 microversion: 2.1 time: 0.221870 Jul 25 14:56:45.291912 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2640/5531] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:45 2022] GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:45.297655 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0c51c427-7e54-459c-b6f6-36203c0476c6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:45.298321 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0c51c427-7e54-459c-b6f6-36203c0476c6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:45.304763 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0c51c427-7e54-459c-b6f6-36203c0476c6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:45.305213 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0c51c427-7e54-459c-b6f6-36203c0476c6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:45.306834 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0c51c427-7e54-459c-b6f6-36203c0476c6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:45.307646 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0c51c427-7e54-459c-b6f6-36203c0476c6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:45.379254 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f8f16deb-409b-4fe6-87f3-0e0bef2cd6b1 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398d222c122d43cb8eb518b47e816f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a42abd216b46978be871418669dd8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:45.387726 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0c51c427-7e54-459c-b6f6-36203c0476c6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:45.391498 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f8f16deb-409b-4fe6-87f3-0e0bef2cd6b1 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0" status: 200 len: 1315 microversion: 2.1 time: 0.796544 Jul 25 14:56:45.404197 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0c51c427-7e54-459c-b6f6-36203c0476c6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 200 len: 1267 microversion: 2.1 time: 0.105600 Jul 25 14:56:45.404197 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2641/5532] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:45 2022] GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 1267 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:45.405175 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2892/5533] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:44 2022] GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0 => generated 1315 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:45.412089 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c572f6af-1b12-4f48-8f99-581072d46adb tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:45.412720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c572f6af-1b12-4f48-8f99-581072d46adb tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:45.420521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c572f6af-1b12-4f48-8f99-581072d46adb tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:45.421174 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c572f6af-1b12-4f48-8f99-581072d46adb tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:45.422177 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c572f6af-1b12-4f48-8f99-581072d46adb tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:45.422628 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c572f6af-1b12-4f48-8f99-581072d46adb tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:45.584982 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c572f6af-1b12-4f48-8f99-581072d46adb tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:45.595526 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c572f6af-1b12-4f48-8f99-581072d46adb tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1696 microversion: 2.1 time: 0.194157 Jul 25 14:56:45.603535 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2642/5534] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:45 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1696 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:46.315922 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-92ca169a-3875-477a-bb2e-7e849307f57a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:46.317588 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-92ca169a-3875-477a-bb2e-7e849307f57a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: b09bf101-ff6e-4517-8bd4-bd69a377470f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:46.333710 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-92ca169a-3875-477a-bb2e-7e849307f57a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:46.337062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-92ca169a-3875-477a-bb2e-7e849307f57a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:46.338124 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-92ca169a-3875-477a-bb2e-7e849307f57a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:46.341205 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-92ca169a-3875-477a-bb2e-7e849307f57a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:46.415602 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a7b42ecf-ad56-459f-ad75-d82a9114d3db tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:46.417671 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a7b42ecf-ad56-459f-ad75-d82a9114d3db tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:46.456768 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a7b42ecf-ad56-459f-ad75-d82a9114d3db tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:46.458456 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a7b42ecf-ad56-459f-ad75-d82a9114d3db tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:46.460569 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a7b42ecf-ad56-459f-ad75-d82a9114d3db tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:46.461411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a7b42ecf-ad56-459f-ad75-d82a9114d3db tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:46.796679 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a7b42ecf-ad56-459f-ad75-d82a9114d3db tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398d222c122d43cb8eb518b47e816f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a42abd216b46978be871418669dd8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:46.808686 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a7b42ecf-ad56-459f-ad75-d82a9114d3db tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0" status: 200 len: 1502 microversion: 2.1 time: 0.396274 Jul 25 14:56:46.810383 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2643/5535] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:46 2022] GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0 => generated 1502 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:46.817754 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-01cfb2ad-4ed3-40ad-b559-b8512b2f6c8a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:46.820517 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-01cfb2ad-4ed3-40ad-b559-b8512b2f6c8a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:46.832247 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-01cfb2ad-4ed3-40ad-b559-b8512b2f6c8a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:46.832967 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-01cfb2ad-4ed3-40ad-b559-b8512b2f6c8a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:46.834956 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-01cfb2ad-4ed3-40ad-b559-b8512b2f6c8a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:46.836486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-01cfb2ad-4ed3-40ad-b559-b8512b2f6c8a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:46.873392 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-92ca169a-3875-477a-bb2e-7e849307f57a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:46.887778 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-92ca169a-3875-477a-bb2e-7e849307f57a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f" status: 200 len: 1318 microversion: 2.1 time: 0.576257 Jul 25 14:56:46.911791 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2893/5536] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:46 2022] GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f => generated 1318 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:46.917353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-54e9f44a-2e2f-49fb-bbae-2c0587609eff tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:46.917963 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-54e9f44a-2e2f-49fb-bbae-2c0587609eff tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:46.939568 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-54e9f44a-2e2f-49fb-bbae-2c0587609eff tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:46.942669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-54e9f44a-2e2f-49fb-bbae-2c0587609eff tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:46.946132 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-54e9f44a-2e2f-49fb-bbae-2c0587609eff tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:46.946593 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-54e9f44a-2e2f-49fb-bbae-2c0587609eff tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:47.197785 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-01cfb2ad-4ed3-40ad-b559-b8512b2f6c8a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:47.206247 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-01cfb2ad-4ed3-40ad-b559-b8512b2f6c8a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 200 len: 1315 microversion: 2.1 time: 0.393338 Jul 25 14:56:47.225354 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2644/5537] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:46 2022] GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:47.231062 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-020a5b99-595f-4340-bd08-573e1a3f85f1 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:47.232199 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-020a5b99-595f-4340-bd08-573e1a3f85f1 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:47.239462 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-020a5b99-595f-4340-bd08-573e1a3f85f1 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:47.240065 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-020a5b99-595f-4340-bd08-573e1a3f85f1 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:47.241075 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-020a5b99-595f-4340-bd08-573e1a3f85f1 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:47.241739 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-020a5b99-595f-4340-bd08-573e1a3f85f1 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:47.292121 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-54e9f44a-2e2f-49fb-bbae-2c0587609eff tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:47.300063 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-54e9f44a-2e2f-49fb-bbae-2c0587609eff tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1694 microversion: 2.1 time: 0.386862 Jul 25 14:56:47.305244 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2894/5538] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:46 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1694 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:47.489068 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-020a5b99-595f-4340-bd08-573e1a3f85f1 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398d222c122d43cb8eb518b47e816f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a42abd216b46978be871418669dd8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:47.501107 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-020a5b99-595f-4340-bd08-573e1a3f85f1 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0" status: 200 len: 1502 microversion: 2.1 time: 0.273724 Jul 25 14:56:47.518102 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2645/5539] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:47 2022] GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0 => generated 1502 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:47.522438 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b9bf9ca3-9819-42a6-bb24-b51fc5e208ed tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:56:47.522980 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b9bf9ca3-9819-42a6-bb24-b51fc5e208ed tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:47.537145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b9bf9ca3-9819-42a6-bb24-b51fc5e208ed tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:47.538016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b9bf9ca3-9819-42a6-bb24-b51fc5e208ed tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:47.538382 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b9bf9ca3-9819-42a6-bb24-b51fc5e208ed tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:47.538843 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b9bf9ca3-9819-42a6-bb24-b51fc5e208ed tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:47.579902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-b9bf9ca3-9819-42a6-bb24-b51fc5e208ed tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lazy-loading 'flavor' on Instance uuid 238133c4-5cb9-47aa-990b-9b890682a9e0 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:56:47.703477 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b9bf9ca3-9819-42a6-bb24-b51fc5e208ed tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "POST /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0/action" status: 202 len: 0 microversion: 2.1 time: 0.183000 Jul 25 14:56:47.704185 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2895/5540] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:56:47 2022] POST /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 14:56:47.721669 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bcfc566f-ce1c-4652-acd0-0da6877a00e8 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:47.722682 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bcfc566f-ce1c-4652-acd0-0da6877a00e8 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:47.738885 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bcfc566f-ce1c-4652-acd0-0da6877a00e8 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:47.739432 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bcfc566f-ce1c-4652-acd0-0da6877a00e8 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:47.740550 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bcfc566f-ce1c-4652-acd0-0da6877a00e8 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:47.741189 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bcfc566f-ce1c-4652-acd0-0da6877a00e8 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:47.920550 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e4b829b3-a651-47e3-bbd0-915fe916dd7a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:47.921859 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e4b829b3-a651-47e3-bbd0-915fe916dd7a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: b09bf101-ff6e-4517-8bd4-bd69a377470f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:47.933406 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e4b829b3-a651-47e3-bbd0-915fe916dd7a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:47.934100 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e4b829b3-a651-47e3-bbd0-915fe916dd7a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:47.935400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e4b829b3-a651-47e3-bbd0-915fe916dd7a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:47.936142 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e4b829b3-a651-47e3-bbd0-915fe916dd7a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:48.009494 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:56:48.236402 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bcfc566f-ce1c-4652-acd0-0da6877a00e8 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398d222c122d43cb8eb518b47e816f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a42abd216b46978be871418669dd8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:48.248660 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bcfc566f-ce1c-4652-acd0-0da6877a00e8 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0" status: 200 len: 1510 microversion: 2.1 time: 0.540094 Jul 25 14:56:48.251331 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2646/5541] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:47 2022] GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0 => generated 1510 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:48.271371 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e833e990-4b7b-4fe3-afcf-763078044012 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:48.272332 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e833e990-4b7b-4fe3-afcf-763078044012 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:48.303917 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e833e990-4b7b-4fe3-afcf-763078044012 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:48.305557 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e833e990-4b7b-4fe3-afcf-763078044012 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:48.307211 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e833e990-4b7b-4fe3-afcf-763078044012 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:48.311054 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e833e990-4b7b-4fe3-afcf-763078044012 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:48.368881 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e4b829b3-a651-47e3-bbd0-915fe916dd7a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:48.380433 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e4b829b3-a651-47e3-bbd0-915fe916dd7a tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f" status: 200 len: 1318 microversion: 2.1 time: 0.466301 Jul 25 14:56:48.381590 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2896/5542] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:47 2022] GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f => generated 1318 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:48.792284 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-851e7650-1f72-46a3-8042-d06db8d97522 req-2e57efe9-e1c7-41a9-8cc0-e41aff08d92e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b09bf101-ff6e-4517-8bd4-bd69a377470f", "name": "network-vif-plugged", "status": "completed", "tag": "b914e258-00bb-43ca-8139-2c8d1a39c5a7"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:56:48.808074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-851e7650-1f72-46a3-8042-d06db8d97522 req-2e57efe9-e1c7-41a9-8cc0-e41aff08d92e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:48.812307 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-851e7650-1f72-46a3-8042-d06db8d97522 req-2e57efe9-e1c7-41a9-8cc0-e41aff08d92e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:48.845155 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-851e7650-1f72-46a3-8042-d06db8d97522 req-2e57efe9-e1c7-41a9-8cc0-e41aff08d92e service nova] Creating event network-vif-plugged:b914e258-00bb-43ca-8139-2c8d1a39c5a7 for instance b09bf101-ff6e-4517-8bd4-bd69a377470f on n-h2-846435-14 Jul 25 14:56:48.853184 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-851e7650-1f72-46a3-8042-d06db8d97522 req-2e57efe9-e1c7-41a9-8cc0-e41aff08d92e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.468946 Jul 25 14:56:48.854032 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2897/5543] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:56:48.911880 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e833e990-4b7b-4fe3-afcf-763078044012 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:48.935001 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e833e990-4b7b-4fe3-afcf-763078044012 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 200 len: 1315 microversion: 2.1 time: 0.681245 Jul 25 14:56:48.939042 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2647/5544] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:48 2022] GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 1315 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:48.944503 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-c9ec451a-0af6-44c4-baf6-462675c0ad6f req-559052cd-00ab-4b22-b4cc-a5465758f42f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eb5bcc4-4054-4195-9e38-af9363c52a64", "tag": "e9f7bebc-006c-4e01-866f-4ca11248affc"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:56:48.969022 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c9ec451a-0af6-44c4-baf6-462675c0ad6f req-559052cd-00ab-4b22-b4cc-a5465758f42f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:48.972868 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c9ec451a-0af6-44c4-baf6-462675c0ad6f req-559052cd-00ab-4b22-b4cc-a5465758f42f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:48.990320 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-c9ec451a-0af6-44c4-baf6-462675c0ad6f req-559052cd-00ab-4b22-b4cc-a5465758f42f service nova] Creating event network-changed:e9f7bebc-006c-4e01-866f-4ca11248affc for instance 7eb5bcc4-4054-4195-9e38-af9363c52a64 on n-h1-846435-14 Jul 25 14:56:48.996512 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-c9ec451a-0af6-44c4-baf6-462675c0ad6f req-559052cd-00ab-4b22-b4cc-a5465758f42f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055398 Jul 25 14:56:48.997743 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2648/5545] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:56:49.190235 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c2963128-5dbb-4e7c-a34d-b0da92759779 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:49.194938 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c2963128-5dbb-4e7c-a34d-b0da92759779 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:49.211916 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c2963128-5dbb-4e7c-a34d-b0da92759779 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:49.212396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c2963128-5dbb-4e7c-a34d-b0da92759779 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:49.219430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c2963128-5dbb-4e7c-a34d-b0da92759779 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:49.220195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c2963128-5dbb-4e7c-a34d-b0da92759779 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:49.276832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9d7fb8b4-4f3f-4477-9957-3299fa3d0248 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:49.278413 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9d7fb8b4-4f3f-4477-9957-3299fa3d0248 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:49.287702 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d7fb8b4-4f3f-4477-9957-3299fa3d0248 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:49.288529 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d7fb8b4-4f3f-4477-9957-3299fa3d0248 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:49.289601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d7fb8b4-4f3f-4477-9957-3299fa3d0248 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:49.290267 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d7fb8b4-4f3f-4477-9957-3299fa3d0248 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:49.522244 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c2963128-5dbb-4e7c-a34d-b0da92759779 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:49.543177 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c2963128-5dbb-4e7c-a34d-b0da92759779 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1694 microversion: 2.1 time: 0.685938 Jul 25 14:56:49.547499 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2898/5546] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:48 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1694 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:49.554662 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8f2b20db-5b31-47ff-af92-1feb3ca09823 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:49.559132 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8f2b20db-5b31-47ff-af92-1feb3ca09823 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: b09bf101-ff6e-4517-8bd4-bd69a377470f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:49.570425 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f2b20db-5b31-47ff-af92-1feb3ca09823 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:49.573754 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f2b20db-5b31-47ff-af92-1feb3ca09823 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:49.574767 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f2b20db-5b31-47ff-af92-1feb3ca09823 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:49.577000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f2b20db-5b31-47ff-af92-1feb3ca09823 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:49.916612 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8f2b20db-5b31-47ff-af92-1feb3ca09823 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:49.926177 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8f2b20db-5b31-47ff-af92-1feb3ca09823 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f" status: 200 len: 1318 microversion: 2.1 time: 0.377198 Jul 25 14:56:49.927014 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2899/5547] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:49 2022] GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:49.944687 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9d7fb8b4-4f3f-4477-9957-3299fa3d0248 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398d222c122d43cb8eb518b47e816f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a42abd216b46978be871418669dd8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:49.953874 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9d7fb8b4-4f3f-4477-9957-3299fa3d0248 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0" status: 200 len: 1493 microversion: 2.1 time: 0.682580 Jul 25 14:56:49.955441 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2649/5548] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:49 2022] GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0 => generated 1493 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:49.959121 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-96ac6917-d3a9-4a2d-88f2-9753436115f5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:49.959744 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-96ac6917-d3a9-4a2d-88f2-9753436115f5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:49.966004 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-96ac6917-d3a9-4a2d-88f2-9753436115f5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:49.966661 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-96ac6917-d3a9-4a2d-88f2-9753436115f5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:49.967437 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-96ac6917-d3a9-4a2d-88f2-9753436115f5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:49.967868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-96ac6917-d3a9-4a2d-88f2-9753436115f5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:49.986831 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c7dca8a6-1916-4d8d-a5ea-1a1192921f31 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:56:49.987660 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c7dca8a6-1916-4d8d-a5ea-1a1192921f31 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:49.996804 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c7dca8a6-1916-4d8d-a5ea-1a1192921f31 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:49.997661 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c7dca8a6-1916-4d8d-a5ea-1a1192921f31 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:49.998905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c7dca8a6-1916-4d8d-a5ea-1a1192921f31 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:49.999577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c7dca8a6-1916-4d8d-a5ea-1a1192921f31 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:50.101982 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c7dca8a6-1916-4d8d-a5ea-1a1192921f31 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "POST /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0/action" status: 202 len: 0 microversion: 2.1 time: 0.119730 Jul 25 14:56:50.102809 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2650/5549] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:56:49 2022] POST /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 14:56:50.117920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ea627129-04b3-4ba2-9f89-e3c248b5ceb9 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:50.119482 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ea627129-04b3-4ba2-9f89-e3c248b5ceb9 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:50.128219 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ea627129-04b3-4ba2-9f89-e3c248b5ceb9 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:50.129604 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ea627129-04b3-4ba2-9f89-e3c248b5ceb9 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:50.131045 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ea627129-04b3-4ba2-9f89-e3c248b5ceb9 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:50.132136 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ea627129-04b3-4ba2-9f89-e3c248b5ceb9 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:50.137938 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:56:50.268187 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-96ac6917-d3a9-4a2d-88f2-9753436115f5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:50.292191 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-96ac6917-d3a9-4a2d-88f2-9753436115f5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 200 len: 1315 microversion: 2.1 time: 0.334962 Jul 25 14:56:50.304456 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2900/5550] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:49 2022] GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:50.572240 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fb192256-6184-46e1-8047-73eb3ebbaf85 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:50.573002 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fb192256-6184-46e1-8047-73eb3ebbaf85 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:50.585144 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fb192256-6184-46e1-8047-73eb3ebbaf85 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:50.585746 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fb192256-6184-46e1-8047-73eb3ebbaf85 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:50.586538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fb192256-6184-46e1-8047-73eb3ebbaf85 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:50.592812 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fb192256-6184-46e1-8047-73eb3ebbaf85 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:50.973935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ea627129-04b3-4ba2-9f89-e3c248b5ceb9 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398d222c122d43cb8eb518b47e816f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a42abd216b46978be871418669dd8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:50.983349 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ea627129-04b3-4ba2-9f89-e3c248b5ceb9 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0" status: 200 len: 1499 microversion: 2.1 time: 0.875735 Jul 25 14:56:50.984581 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2651/5551] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:50 2022] GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0 => generated 1499 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:50.990363 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6b80501c-a130-4cb0-a96f-b6585f376db7 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:50.991281 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6b80501c-a130-4cb0-a96f-b6585f376db7 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: b09bf101-ff6e-4517-8bd4-bd69a377470f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:50.994469 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fb192256-6184-46e1-8047-73eb3ebbaf85 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:50.999864 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6b80501c-a130-4cb0-a96f-b6585f376db7 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:51.000625 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6b80501c-a130-4cb0-a96f-b6585f376db7 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:51.001779 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6b80501c-a130-4cb0-a96f-b6585f376db7 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:51.002435 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6b80501c-a130-4cb0-a96f-b6585f376db7 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:51.010138 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fb192256-6184-46e1-8047-73eb3ebbaf85 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1691 microversion: 2.1 time: 0.442175 Jul 25 14:56:51.011088 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2901/5552] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:50 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1691 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:51.036103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8eb86e20-c31a-4955-9f66-7feda058734d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:56:51.036642 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8eb86e20-c31a-4955-9f66-7feda058734d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:51.059035 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8eb86e20-c31a-4955-9f66-7feda058734d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:51.059816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8eb86e20-c31a-4955-9f66-7feda058734d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:51.060964 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8eb86e20-c31a-4955-9f66-7feda058734d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:51.061557 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8eb86e20-c31a-4955-9f66-7feda058734d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:51.278673 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8eb86e20-c31a-4955-9f66-7feda058734d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "POST /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d/action" status: 202 len: 0 microversion: 2.1 time: 0.244527 Jul 25 14:56:51.290972 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2902/5553] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:56:51 2022] POST /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:56:51.300545 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-734e9ae5-e92c-4ae9-8145-ad59ce565d50 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:51.305149 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-734e9ae5-e92c-4ae9-8145-ad59ce565d50 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:51.322921 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-734e9ae5-e92c-4ae9-8145-ad59ce565d50 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:51.323789 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-734e9ae5-e92c-4ae9-8145-ad59ce565d50 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:51.325120 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-734e9ae5-e92c-4ae9-8145-ad59ce565d50 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:51.325711 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-734e9ae5-e92c-4ae9-8145-ad59ce565d50 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:51.662411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6b80501c-a130-4cb0-a96f-b6585f376db7 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:51.672531 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6b80501c-a130-4cb0-a96f-b6585f376db7 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f" status: 200 len: 1318 microversion: 2.1 time: 0.685726 Jul 25 14:56:51.694312 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2652/5554] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:50 2022] GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f => generated 1318 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:51.709105 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e709b3d1-ca50-4168-9ffd-5b7a1568321a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:51.709648 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e709b3d1-ca50-4168-9ffd-5b7a1568321a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:51.735375 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e709b3d1-ca50-4168-9ffd-5b7a1568321a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:51.735718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e709b3d1-ca50-4168-9ffd-5b7a1568321a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:51.736601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e709b3d1-ca50-4168-9ffd-5b7a1568321a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:51.737047 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e709b3d1-ca50-4168-9ffd-5b7a1568321a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:52.045458 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-734e9ae5-e92c-4ae9-8145-ad59ce565d50 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:52.065178 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-734e9ae5-e92c-4ae9-8145-ad59ce565d50 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1690 microversion: 2.1 time: 0.772848 Jul 25 14:56:52.066375 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2903/5555] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:51 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1690 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:52.071538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2b1a4516-cf4e-44b5-8ec2-4fe3b4191eaa tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:52.072450 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2b1a4516-cf4e-44b5-8ec2-4fe3b4191eaa tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:52.086365 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b1a4516-cf4e-44b5-8ec2-4fe3b4191eaa tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:52.087072 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b1a4516-cf4e-44b5-8ec2-4fe3b4191eaa tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:52.088058 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b1a4516-cf4e-44b5-8ec2-4fe3b4191eaa tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:52.089005 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2b1a4516-cf4e-44b5-8ec2-4fe3b4191eaa tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:52.140177 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e709b3d1-ca50-4168-9ffd-5b7a1568321a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:52.150561 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e709b3d1-ca50-4168-9ffd-5b7a1568321a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 200 len: 1315 microversion: 2.1 time: 0.455034 Jul 25 14:56:52.155402 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2653/5556] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:51 2022] GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 1315 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:52.425644 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2b1a4516-cf4e-44b5-8ec2-4fe3b4191eaa tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398d222c122d43cb8eb518b47e816f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a42abd216b46978be871418669dd8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:52.459501 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2b1a4516-cf4e-44b5-8ec2-4fe3b4191eaa tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0" status: 200 len: 1499 microversion: 2.1 time: 0.391822 Jul 25 14:56:52.462777 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2904/5557] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:52 2022] GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0 => generated 1499 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:52.667592 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-c0d45d69-7047-44be-93e5-2b53c45ea9ae req-8383ff72-4b01-44ce-bac7-eadcda91c0f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d027db2-6df4-4295-a5e1-d8886d34018d", "name": "network-vif-plugged", "status": "completed", "tag": "6edba24d-b14c-4866-afee-2438b889d8bb"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:56:52.692911 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c0d45d69-7047-44be-93e5-2b53c45ea9ae req-8383ff72-4b01-44ce-bac7-eadcda91c0f9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:52.697523 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c0d45d69-7047-44be-93e5-2b53c45ea9ae req-8383ff72-4b01-44ce-bac7-eadcda91c0f9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:52.700309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6fb4c575-1072-49cd-ae30-4bcc6bb15718 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:52.710348 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6fb4c575-1072-49cd-ae30-4bcc6bb15718 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: b09bf101-ff6e-4517-8bd4-bd69a377470f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:52.720178 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6fb4c575-1072-49cd-ae30-4bcc6bb15718 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:52.726790 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-c0d45d69-7047-44be-93e5-2b53c45ea9ae req-8383ff72-4b01-44ce-bac7-eadcda91c0f9 service nova] Creating event network-vif-plugged:6edba24d-b14c-4866-afee-2438b889d8bb for instance 4d027db2-6df4-4295-a5e1-d8886d34018d on n-h2-846435-14 Jul 25 14:56:52.727666 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6fb4c575-1072-49cd-ae30-4bcc6bb15718 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:52.728732 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6fb4c575-1072-49cd-ae30-4bcc6bb15718 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:52.729334 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6fb4c575-1072-49cd-ae30-4bcc6bb15718 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:52.740021 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [req-c0d45d69-7047-44be-93e5-2b53c45ea9ae req-8383ff72-4b01-44ce-bac7-eadcda91c0f9 service nova] Instance 4d027db2-6df4-4295-a5e1-d8886d34018d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119303) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 14:56:52.768512 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-c0d45d69-7047-44be-93e5-2b53c45ea9ae req-8383ff72-4b01-44ce-bac7-eadcda91c0f9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105422 Jul 25 14:56:52.772428 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2654/5558] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:56:53.040555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6fb4c575-1072-49cd-ae30-4bcc6bb15718 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:53.049342 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6fb4c575-1072-49cd-ae30-4bcc6bb15718 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f" status: 200 len: 1506 microversion: 2.1 time: 0.352872 Jul 25 14:56:53.052632 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2905/5559] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:52 2022] GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f => generated 1506 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:53.074886 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0cdf1f8d-0003-48fc-bf9c-3654b7b19a98 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:53.075524 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0cdf1f8d-0003-48fc-bf9c-3654b7b19a98 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 8df6413f-d937-4446-b01e-31ed3f057ad1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:53.086695 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c9800fa7-5a87-49d3-9ed0-fc3c50fe1766 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:53.087867 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c9800fa7-5a87-49d3-9ed0-fc3c50fe1766 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:53.093209 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0cdf1f8d-0003-48fc-bf9c-3654b7b19a98 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:53.096566 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0cdf1f8d-0003-48fc-bf9c-3654b7b19a98 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:53.099571 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0cdf1f8d-0003-48fc-bf9c-3654b7b19a98 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:53.100274 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0cdf1f8d-0003-48fc-bf9c-3654b7b19a98 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:53.101504 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c9800fa7-5a87-49d3-9ed0-fc3c50fe1766 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:53.106897 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c9800fa7-5a87-49d3-9ed0-fc3c50fe1766 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:53.108304 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c9800fa7-5a87-49d3-9ed0-fc3c50fe1766 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:53.108939 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c9800fa7-5a87-49d3-9ed0-fc3c50fe1766 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:53.390229 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0cdf1f8d-0003-48fc-bf9c-3654b7b19a98 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:53.410592 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0cdf1f8d-0003-48fc-bf9c-3654b7b19a98 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/8df6413f-d937-4446-b01e-31ed3f057ad1" status: 200 len: 1505 microversion: 2.1 time: 0.340348 Jul 25 14:56:53.411250 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2655/5560] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:53 2022] GET /compute/v2.1/servers/8df6413f-d937-4446-b01e-31ed3f057ad1 => generated 1505 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:53.442753 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0ac0b221-360c-44f6-b60e-a790a8342386 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:53.448045 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0ac0b221-360c-44f6-b60e-a790a8342386 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:53.464594 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0ac0b221-360c-44f6-b60e-a790a8342386 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:53.465225 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0ac0b221-360c-44f6-b60e-a790a8342386 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:53.466207 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0ac0b221-360c-44f6-b60e-a790a8342386 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:53.468800 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0ac0b221-360c-44f6-b60e-a790a8342386 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:53.549683 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c9800fa7-5a87-49d3-9ed0-fc3c50fe1766 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:53.572876 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c9800fa7-5a87-49d3-9ed0-fc3c50fe1766 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1690 microversion: 2.1 time: 0.489896 Jul 25 14:56:53.576281 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2906/5561] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:53 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1690 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:53.587777 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ea44b0e4-dc88-4ddb-8536-c4afd6cd3c43 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:53.593917 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ea44b0e4-dc88-4ddb-8536-c4afd6cd3c43 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 8df6413f-d937-4446-b01e-31ed3f057ad1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:53.620044 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea44b0e4-dc88-4ddb-8536-c4afd6cd3c43 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:53.620722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea44b0e4-dc88-4ddb-8536-c4afd6cd3c43 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:53.623144 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea44b0e4-dc88-4ddb-8536-c4afd6cd3c43 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:53.623770 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea44b0e4-dc88-4ddb-8536-c4afd6cd3c43 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:53.711575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ea44b0e4-dc88-4ddb-8536-c4afd6cd3c43 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 8df6413f-d937-4446-b01e-31ed3f057ad1] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:56:53.923876 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ea44b0e4-dc88-4ddb-8536-c4afd6cd3c43 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "DELETE /compute/v2.1/servers/8df6413f-d937-4446-b01e-31ed3f057ad1" status: 204 len: 0 microversion: 2.1 time: 0.332993 Jul 25 14:56:53.925206 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2907/5562] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:56:53 2022] DELETE /compute/v2.1/servers/8df6413f-d937-4446-b01e-31ed3f057ad1 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:56:53.940229 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-36c451b0-d01b-4d6b-bb69-ab68d4339863 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:53.951018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-36c451b0-d01b-4d6b-bb69-ab68d4339863 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:53.977190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-36c451b0-d01b-4d6b-bb69-ab68d4339863 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:53.977879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-36c451b0-d01b-4d6b-bb69-ab68d4339863 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:53.978815 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-36c451b0-d01b-4d6b-bb69-ab68d4339863 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:53.979242 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-36c451b0-d01b-4d6b-bb69-ab68d4339863 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:54.040262 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:56:54.257787 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-36c451b0-d01b-4d6b-bb69-ab68d4339863 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398d222c122d43cb8eb518b47e816f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a42abd216b46978be871418669dd8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:54.265168 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=8 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:56:54.269791 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-36c451b0-d01b-4d6b-bb69-ab68d4339863 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0" status: 200 len: 1502 microversion: 2.1 time: 0.342998 Jul 25 14:56:54.270416 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2908/5563] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:53 2022] GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0 => generated 1502 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:54.276408 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fcf957ab-8c6c-4091-80cc-bdca49289aa6 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:54.277134 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fcf957ab-8c6c-4091-80cc-bdca49289aa6 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: b09bf101-ff6e-4517-8bd4-bd69a377470f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:54.293988 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fcf957ab-8c6c-4091-80cc-bdca49289aa6 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:54.295208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fcf957ab-8c6c-4091-80cc-bdca49289aa6 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:54.297112 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fcf957ab-8c6c-4091-80cc-bdca49289aa6 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:54.297450 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fcf957ab-8c6c-4091-80cc-bdca49289aa6 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:54.329610 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fcf957ab-8c6c-4091-80cc-bdca49289aa6 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: b09bf101-ff6e-4517-8bd4-bd69a377470f] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:56:54.347155 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:56:54.425087 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fcf957ab-8c6c-4091-80cc-bdca49289aa6 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f" status: 204 len: 0 microversion: 2.1 time: 0.152342 Jul 25 14:56:54.425812 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2909/5564] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:56:54 2022] DELETE /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:56:54.431260 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5401fa29-046e-4eab-b9c2-47263834c223 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:56:54.431878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5401fa29-046e-4eab-b9c2-47263834c223 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:54.439001 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5401fa29-046e-4eab-b9c2-47263834c223 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:54.440492 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5401fa29-046e-4eab-b9c2-47263834c223 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:54.441273 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5401fa29-046e-4eab-b9c2-47263834c223 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:54.442369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5401fa29-046e-4eab-b9c2-47263834c223 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:54.449595 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0ac0b221-360c-44f6-b60e-a790a8342386 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:54.457572 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0ac0b221-360c-44f6-b60e-a790a8342386 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 200 len: 1315 microversion: 2.1 time: 1.018659 Jul 25 14:56:54.470845 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2656/5565] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:53 2022] GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 1315 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:54.471107 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-5401fa29-046e-4eab-b9c2-47263834c223 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lazy-loading 'flavor' on Instance uuid 238133c4-5cb9-47aa-990b-9b890682a9e0 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:56:54.476280 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b356000c-d9be-48f5-ada1-539db9c9e537 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:54.477099 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b356000c-d9be-48f5-ada1-539db9c9e537 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 8df6413f-d937-4446-b01e-31ed3f057ad1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:54.484254 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b356000c-d9be-48f5-ada1-539db9c9e537 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:54.484911 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b356000c-d9be-48f5-ada1-539db9c9e537 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:54.485902 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b356000c-d9be-48f5-ada1-539db9c9e537 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:54.486484 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b356000c-d9be-48f5-ada1-539db9c9e537 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:54.572155 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5401fa29-046e-4eab-b9c2-47263834c223 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "POST /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0/action" status: 202 len: 0 microversion: 2.1 time: 0.144680 Jul 25 14:56:54.573259 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2910/5566] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:56:54 2022] POST /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:56:54.583937 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-158910a2-cb41-4e5e-9e01-44250679ec49 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:54.584935 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-158910a2-cb41-4e5e-9e01-44250679ec49 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:54.597259 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-158910a2-cb41-4e5e-9e01-44250679ec49 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:54.597704 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-158910a2-cb41-4e5e-9e01-44250679ec49 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:54.598497 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-158910a2-cb41-4e5e-9e01-44250679ec49 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:54.598919 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-158910a2-cb41-4e5e-9e01-44250679ec49 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:54.752411 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-158910a2-cb41-4e5e-9e01-44250679ec49 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398d222c122d43cb8eb518b47e816f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a42abd216b46978be871418669dd8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:54.762414 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-158910a2-cb41-4e5e-9e01-44250679ec49 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0" status: 200 len: 1510 microversion: 2.1 time: 0.183407 Jul 25 14:56:54.763142 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2911/5567] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:54 2022] GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0 => generated 1510 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:54.770057 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9c328b72-6d11-4d56-bb80-2e1bb2d371e4 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:54.770885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9c328b72-6d11-4d56-bb80-2e1bb2d371e4 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:54.785317 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9c328b72-6d11-4d56-bb80-2e1bb2d371e4 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:54.785763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9c328b72-6d11-4d56-bb80-2e1bb2d371e4 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:54.787257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9c328b72-6d11-4d56-bb80-2e1bb2d371e4 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:54.787693 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9c328b72-6d11-4d56-bb80-2e1bb2d371e4 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:54.794076 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b356000c-d9be-48f5-ada1-539db9c9e537 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:54.804452 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b356000c-d9be-48f5-ada1-539db9c9e537 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/8df6413f-d937-4446-b01e-31ed3f057ad1" status: 200 len: 1511 microversion: 2.1 time: 0.332084 Jul 25 14:56:54.805022 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2657/5568] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:54 2022] GET /compute/v2.1/servers/8df6413f-d937-4446-b01e-31ed3f057ad1 => generated 1511 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:54.811166 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-ac96fb90-c0fc-46b1-a17e-ee2b9f4a5183 req-66860733-6086-4113-b33d-311632ca8912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb5bcc4-4054-4195-9e38-af9363c52a64", "name": "network-vif-plugged", "status": "completed", "tag": "e9f7bebc-006c-4e01-866f-4ca11248affc"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:56:54.821564 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ac96fb90-c0fc-46b1-a17e-ee2b9f4a5183 req-66860733-6086-4113-b33d-311632ca8912 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:54.822330 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ac96fb90-c0fc-46b1-a17e-ee2b9f4a5183 req-66860733-6086-4113-b33d-311632ca8912 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:54.847139 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-ac96fb90-c0fc-46b1-a17e-ee2b9f4a5183 req-66860733-6086-4113-b33d-311632ca8912 service nova] Creating event network-vif-plugged:e9f7bebc-006c-4e01-866f-4ca11248affc for instance 7eb5bcc4-4054-4195-9e38-af9363c52a64 on n-h1-846435-14 Jul 25 14:56:54.854370 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-ac96fb90-c0fc-46b1-a17e-ee2b9f4a5183 req-66860733-6086-4113-b33d-311632ca8912 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047526 Jul 25 14:56:54.858267 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2658/5569] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:56:54.965042 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9c328b72-6d11-4d56-bb80-2e1bb2d371e4 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:54.973401 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9c328b72-6d11-4d56-bb80-2e1bb2d371e4 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1690 microversion: 2.1 time: 0.208737 Jul 25 14:56:54.974080 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2912/5570] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:54 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1690 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:55.479122 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e3659d17-2c4b-4bd6-ad08-458ef77da064 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:55.480060 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e3659d17-2c4b-4bd6-ad08-458ef77da064 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:55.492170 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3659d17-2c4b-4bd6-ad08-458ef77da064 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:55.493194 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3659d17-2c4b-4bd6-ad08-458ef77da064 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:55.494303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3659d17-2c4b-4bd6-ad08-458ef77da064 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:55.498354 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3659d17-2c4b-4bd6-ad08-458ef77da064 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:55.784209 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-df30986a-a0c5-4ccd-a5f1-9a32f7b1beee tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:55.785532 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-df30986a-a0c5-4ccd-a5f1-9a32f7b1beee tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:55.791901 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:56:55.793804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-df30986a-a0c5-4ccd-a5f1-9a32f7b1beee tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:55.794403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-df30986a-a0c5-4ccd-a5f1-9a32f7b1beee tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:55.795622 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-df30986a-a0c5-4ccd-a5f1-9a32f7b1beee tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:55.797384 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e3659d17-2c4b-4bd6-ad08-458ef77da064 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:55.797940 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-df30986a-a0c5-4ccd-a5f1-9a32f7b1beee tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:55.805821 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e3659d17-2c4b-4bd6-ad08-458ef77da064 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 200 len: 1315 microversion: 2.1 time: 0.331205 Jul 25 14:56:55.812054 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2659/5571] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:55 2022] GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:55.828843 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-33bebba6-b47a-420c-9f28-95cd5194b332 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:55.829748 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-33bebba6-b47a-420c-9f28-95cd5194b332 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 8df6413f-d937-4446-b01e-31ed3f057ad1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:55.839396 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-33bebba6-b47a-420c-9f28-95cd5194b332 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:55.840432 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-33bebba6-b47a-420c-9f28-95cd5194b332 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:55.841454 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-33bebba6-b47a-420c-9f28-95cd5194b332 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:55.842158 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-33bebba6-b47a-420c-9f28-95cd5194b332 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:56.006267 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-df30986a-a0c5-4ccd-a5f1-9a32f7b1beee tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398d222c122d43cb8eb518b47e816f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a42abd216b46978be871418669dd8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:56.024237 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-df30986a-a0c5-4ccd-a5f1-9a32f7b1beee tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0" status: 200 len: 1493 microversion: 2.1 time: 0.235666 Jul 25 14:56:56.024237 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2913/5572] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:55 2022] GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0 => generated 1493 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:56.028636 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-caf7c7e7-f1d1-4b63-acb1-fd3b710777df tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:56.035128 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-caf7c7e7-f1d1-4b63-acb1-fd3b710777df tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:56.056095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-caf7c7e7-f1d1-4b63-acb1-fd3b710777df tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:56.056903 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-caf7c7e7-f1d1-4b63-acb1-fd3b710777df tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:56.057743 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-caf7c7e7-f1d1-4b63-acb1-fd3b710777df tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:56.058256 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-caf7c7e7-f1d1-4b63-acb1-fd3b710777df tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:56.173938 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-33bebba6-b47a-420c-9f28-95cd5194b332 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:56.189185 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-33bebba6-b47a-420c-9f28-95cd5194b332 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/8df6413f-d937-4446-b01e-31ed3f057ad1" status: 200 len: 1511 microversion: 2.1 time: 0.364173 Jul 25 14:56:56.201036 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2660/5573] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:55 2022] GET /compute/v2.1/servers/8df6413f-d937-4446-b01e-31ed3f057ad1 => generated 1511 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:56.211542 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e4515a8a-f5d3-48b4-9586-5c9f302ce800 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:56:56.214449 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e4515a8a-f5d3-48b4-9586-5c9f302ce800 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:56.230046 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e4515a8a-f5d3-48b4-9586-5c9f302ce800 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:56.236025 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e4515a8a-f5d3-48b4-9586-5c9f302ce800 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:56.237405 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e4515a8a-f5d3-48b4-9586-5c9f302ce800 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:56.238074 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e4515a8a-f5d3-48b4-9586-5c9f302ce800 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:56.334941 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-caf7c7e7-f1d1-4b63-acb1-fd3b710777df tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:56.345920 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-caf7c7e7-f1d1-4b63-acb1-fd3b710777df tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1690 microversion: 2.1 time: 0.322016 Jul 25 14:56:56.362330 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2914/5574] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:56 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1690 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:56.374004 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e4515a8a-f5d3-48b4-9586-5c9f302ce800 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "POST /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0/action" status: 202 len: 0 microversion: 2.1 time: 0.171630 Jul 25 14:56:56.374665 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2661/5575] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:56:56 2022] POST /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:56:56.383784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d4f88f8b-0e84-42d2-a8aa-82bfc51744b1 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:56.384675 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d4f88f8b-0e84-42d2-a8aa-82bfc51744b1 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:56.391882 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d4f88f8b-0e84-42d2-a8aa-82bfc51744b1 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:56.392416 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d4f88f8b-0e84-42d2-a8aa-82bfc51744b1 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:56.393914 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d4f88f8b-0e84-42d2-a8aa-82bfc51744b1 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:56.394354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d4f88f8b-0e84-42d2-a8aa-82bfc51744b1 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:56.607542 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d4f88f8b-0e84-42d2-a8aa-82bfc51744b1 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398d222c122d43cb8eb518b47e816f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a42abd216b46978be871418669dd8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:56.615607 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d4f88f8b-0e84-42d2-a8aa-82bfc51744b1 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0" status: 200 len: 1499 microversion: 2.1 time: 0.236472 Jul 25 14:56:56.620724 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2915/5576] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:56 2022] GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0 => generated 1499 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:56.831412 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bb6faeb2-6081-4a3d-9448-255a6ee4a756 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:56.832877 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bb6faeb2-6081-4a3d-9448-255a6ee4a756 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:56.851662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bb6faeb2-6081-4a3d-9448-255a6ee4a756 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:56.852161 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bb6faeb2-6081-4a3d-9448-255a6ee4a756 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:56.852976 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bb6faeb2-6081-4a3d-9448-255a6ee4a756 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:56.853425 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bb6faeb2-6081-4a3d-9448-255a6ee4a756 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:57.197623 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bb6faeb2-6081-4a3d-9448-255a6ee4a756 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:57.213044 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f1ad42de-e5c3-4fee-b356-c86215111d54 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:57.213549 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f1ad42de-e5c3-4fee-b356-c86215111d54 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 8df6413f-d937-4446-b01e-31ed3f057ad1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:57.220297 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bb6faeb2-6081-4a3d-9448-255a6ee4a756 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 200 len: 1502 microversion: 2.1 time: 0.393126 Jul 25 14:56:57.220914 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2662/5577] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:56 2022] GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 1502 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:57.224012 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f1ad42de-e5c3-4fee-b356-c86215111d54 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:57.232688 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f1ad42de-e5c3-4fee-b356-c86215111d54 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:57.233857 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f1ad42de-e5c3-4fee-b356-c86215111d54 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:57.234453 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f1ad42de-e5c3-4fee-b356-c86215111d54 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:57.244516 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2172599e-c000-452d-93e6-621a5486f9e1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:56:57.256148 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2172599e-c000-452d-93e6-621a5486f9e1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:57.256608 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2172599e-c000-452d-93e6-621a5486f9e1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:57.290233 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2172599e-c000-452d-93e6-621a5486f9e1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Going to try to stop instance {{(pid=119303) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 14:56:57.362476 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2172599e-c000-452d-93e6-621a5486f9e1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64/action" status: 202 len: 0 microversion: 2.1 time: 0.121527 Jul 25 14:56:57.363595 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2663/5578] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:56:57 2022] POST /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 14:56:57.374845 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7856b490-3d46-4303-9e07-afdaedf55224 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:57.375469 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7856b490-3d46-4303-9e07-afdaedf55224 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:57.382918 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7856b490-3d46-4303-9e07-afdaedf55224 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:57.383326 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7856b490-3d46-4303-9e07-afdaedf55224 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:57.384163 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7856b490-3d46-4303-9e07-afdaedf55224 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:57.384716 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7856b490-3d46-4303-9e07-afdaedf55224 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:57.534706 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7856b490-3d46-4303-9e07-afdaedf55224 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:57.543628 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7856b490-3d46-4303-9e07-afdaedf55224 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 200 len: 1512 microversion: 2.1 time: 0.174776 Jul 25 14:56:57.543628 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2664/5579] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:57 2022] GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 1512 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:57.549414 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a25d2b3a-925e-4440-9bd2-bb72949e9f07 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:57.550327 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a25d2b3a-925e-4440-9bd2-bb72949e9f07 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:57.556618 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a25d2b3a-925e-4440-9bd2-bb72949e9f07 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:57.557071 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a25d2b3a-925e-4440-9bd2-bb72949e9f07 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:57.557845 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a25d2b3a-925e-4440-9bd2-bb72949e9f07 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:57.558276 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a25d2b3a-925e-4440-9bd2-bb72949e9f07 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:57.688629 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f1ad42de-e5c3-4fee-b356-c86215111d54 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:57.715023 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f1ad42de-e5c3-4fee-b356-c86215111d54 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/8df6413f-d937-4446-b01e-31ed3f057ad1" status: 200 len: 1511 microversion: 2.1 time: 0.500740 Jul 25 14:56:57.717133 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2916/5580] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:57 2022] GET /compute/v2.1/servers/8df6413f-d937-4446-b01e-31ed3f057ad1 => generated 1511 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:57.737348 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-93921892-9a42-439b-9c1a-2bdc8138db74 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:57.744232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-93921892-9a42-439b-9c1a-2bdc8138db74 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:57.746965 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a25d2b3a-925e-4440-9bd2-bb72949e9f07 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:57.756928 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a25d2b3a-925e-4440-9bd2-bb72949e9f07 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1690 microversion: 2.1 time: 0.212157 Jul 25 14:56:57.769983 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2665/5581] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:57 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1690 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:57.770166 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-93921892-9a42-439b-9c1a-2bdc8138db74 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:57.770166 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-93921892-9a42-439b-9c1a-2bdc8138db74 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:57.770166 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-93921892-9a42-439b-9c1a-2bdc8138db74 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:57.770166 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-93921892-9a42-439b-9c1a-2bdc8138db74 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:58.092779 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-93921892-9a42-439b-9c1a-2bdc8138db74 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398d222c122d43cb8eb518b47e816f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a42abd216b46978be871418669dd8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:58.107653 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-93921892-9a42-439b-9c1a-2bdc8138db74 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0" status: 200 len: 1499 microversion: 2.1 time: 0.385457 Jul 25 14:56:58.108395 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2917/5582] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:57 2022] GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0 => generated 1499 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:58.568178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-97583b42-9502-4c97-b51f-0d18ba244c85 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:58.569245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-97583b42-9502-4c97-b51f-0d18ba244c85 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:58.578445 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-97583b42-9502-4c97-b51f-0d18ba244c85 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:58.579572 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-97583b42-9502-4c97-b51f-0d18ba244c85 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:58.580888 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-97583b42-9502-4c97-b51f-0d18ba244c85 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:58.581489 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-97583b42-9502-4c97-b51f-0d18ba244c85 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:58.742233 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a63b8aa7-5c04-4088-a759-d2a0143e6bb4 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:58.742960 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a63b8aa7-5c04-4088-a759-d2a0143e6bb4 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 8df6413f-d937-4446-b01e-31ed3f057ad1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:58.761688 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a63b8aa7-5c04-4088-a759-d2a0143e6bb4 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:58.762149 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a63b8aa7-5c04-4088-a759-d2a0143e6bb4 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:58.762955 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a63b8aa7-5c04-4088-a759-d2a0143e6bb4 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:58.763523 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a63b8aa7-5c04-4088-a759-d2a0143e6bb4 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:58.872366 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-97583b42-9502-4c97-b51f-0d18ba244c85 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:58.877708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:56:58.908989 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-97583b42-9502-4c97-b51f-0d18ba244c85 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 200 len: 1512 microversion: 2.1 time: 0.345057 Jul 25 14:56:58.909448 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2666/5583] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:58 2022] GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 1512 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:58.917119 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2f8c733c-8eb4-46c3-870b-43906ae67610 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:58.918389 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2f8c733c-8eb4-46c3-870b-43906ae67610 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:58.929606 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f8c733c-8eb4-46c3-870b-43906ae67610 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:58.930925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f8c733c-8eb4-46c3-870b-43906ae67610 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:58.932792 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f8c733c-8eb4-46c3-870b-43906ae67610 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:58.933881 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f8c733c-8eb4-46c3-870b-43906ae67610 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:59.136919 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2f8c733c-8eb4-46c3-870b-43906ae67610 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:59.153750 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2f8c733c-8eb4-46c3-870b-43906ae67610 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1690 microversion: 2.1 time: 0.242715 Jul 25 14:56:59.155027 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2667/5584] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:58 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1690 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:59.160752 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0639e360-f714-4713-bdef-855df742e77c tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:59.161671 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0639e360-f714-4713-bdef-855df742e77c tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:59.169141 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0639e360-f714-4713-bdef-855df742e77c tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:59.169854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0639e360-f714-4713-bdef-855df742e77c tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:59.170807 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0639e360-f714-4713-bdef-855df742e77c tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:59.171401 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0639e360-f714-4713-bdef-855df742e77c tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:59.509762 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a63b8aa7-5c04-4088-a759-d2a0143e6bb4 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:59.518722 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a63b8aa7-5c04-4088-a759-d2a0143e6bb4 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/8df6413f-d937-4446-b01e-31ed3f057ad1" status: 200 len: 1511 microversion: 2.1 time: 0.781851 Jul 25 14:56:59.520116 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2918/5585] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:58 2022] GET /compute/v2.1/servers/8df6413f-d937-4446-b01e-31ed3f057ad1 => generated 1511 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:56:59.625416 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0639e360-f714-4713-bdef-855df742e77c tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398d222c122d43cb8eb518b47e816f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a42abd216b46978be871418669dd8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:56:59.647876 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0639e360-f714-4713-bdef-855df742e77c tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0" status: 200 len: 1502 microversion: 2.1 time: 0.491037 Jul 25 14:56:59.650500 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2668/5586] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:59 2022] GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0 => generated 1502 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:56:59.671158 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ae9420b8-f3d8-4f1f-a99c-8d0fd76502b6 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:59.671956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ae9420b8-f3d8-4f1f-a99c-8d0fd76502b6 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:59.683639 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ae9420b8-f3d8-4f1f-a99c-8d0fd76502b6 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:59.684126 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ae9420b8-f3d8-4f1f-a99c-8d0fd76502b6 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:59.685070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ae9420b8-f3d8-4f1f-a99c-8d0fd76502b6 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:59.685580 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ae9420b8-f3d8-4f1f-a99c-8d0fd76502b6 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:59.765533 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ae9420b8-f3d8-4f1f-a99c-8d0fd76502b6 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:56:59.924962 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ae9420b8-f3d8-4f1f-a99c-8d0fd76502b6 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "DELETE /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0" status: 204 len: 0 microversion: 2.1 time: 0.256451 Jul 25 14:56:59.927014 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2919/5587] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:56:59 2022] DELETE /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:56:59.936355 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3fbe76d3-8cdf-4424-9811-087f6939bafb tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:59.936980 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3fbe76d3-8cdf-4424-9811-087f6939bafb tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:59.941569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cd1f2f25-7639-4a10-895c-e0f0db35a301 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:56:59.943163 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cd1f2f25-7639-4a10-895c-e0f0db35a301 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:56:59.948006 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3fbe76d3-8cdf-4424-9811-087f6939bafb tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:59.948169 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3fbe76d3-8cdf-4424-9811-087f6939bafb tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:59.948853 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3fbe76d3-8cdf-4424-9811-087f6939bafb tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:59.955670 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3fbe76d3-8cdf-4424-9811-087f6939bafb tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:59.967405 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cd1f2f25-7639-4a10-895c-e0f0db35a301 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:59.968206 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cd1f2f25-7639-4a10-895c-e0f0db35a301 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:56:59.975086 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cd1f2f25-7639-4a10-895c-e0f0db35a301 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:56:59.976094 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cd1f2f25-7639-4a10-895c-e0f0db35a301 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:00.296431 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3fbe76d3-8cdf-4424-9811-087f6939bafb tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398d222c122d43cb8eb518b47e816f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a42abd216b46978be871418669dd8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:00.306565 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3fbe76d3-8cdf-4424-9811-087f6939bafb tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0" status: 200 len: 1508 microversion: 2.1 time: 0.372811 Jul 25 14:57:00.321550 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2669/5588] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:59 2022] GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0 => generated 1508 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:00.326511 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-51ffb1ff-633f-43aa-b2be-2632505fb178 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:00.327142 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-51ffb1ff-633f-43aa-b2be-2632505fb178 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:00.345127 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-51ffb1ff-633f-43aa-b2be-2632505fb178 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:00.345588 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-51ffb1ff-633f-43aa-b2be-2632505fb178 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:00.352551 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-51ffb1ff-633f-43aa-b2be-2632505fb178 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:00.356362 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-51ffb1ff-633f-43aa-b2be-2632505fb178 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:00.917582 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-51ffb1ff-633f-43aa-b2be-2632505fb178 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:00.935057 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-51ffb1ff-633f-43aa-b2be-2632505fb178 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1690 microversion: 2.1 time: 0.611606 Jul 25 14:57:00.949698 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2670/5589] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:00 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1690 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:00.959899 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-15c3615b-3709-400f-9a78-818c4baba5e8 req-1da120d6-c569-4c72-a298-7909b2d38b2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d027db2-6df4-4295-a5e1-d8886d34018d", "name": "network-vif-unplugged", "status": "completed", "tag": "6edba24d-b14c-4866-afee-2438b889d8bb"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:00.993536 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-15c3615b-3709-400f-9a78-818c4baba5e8 req-1da120d6-c569-4c72-a298-7909b2d38b2b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:00.994731 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-15c3615b-3709-400f-9a78-818c4baba5e8 req-1da120d6-c569-4c72-a298-7909b2d38b2b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:01.037615 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-15c3615b-3709-400f-9a78-818c4baba5e8 req-1da120d6-c569-4c72-a298-7909b2d38b2b service nova] Creating event network-vif-unplugged:6edba24d-b14c-4866-afee-2438b889d8bb for instance 4d027db2-6df4-4295-a5e1-d8886d34018d on n-h1-846435-14 Jul 25 14:57:01.051462 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [req-15c3615b-3709-400f-9a78-818c4baba5e8 req-1da120d6-c569-4c72-a298-7909b2d38b2b service nova] Instance 4d027db2-6df4-4295-a5e1-d8886d34018d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119303) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 14:57:01.068191 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-15c3615b-3709-400f-9a78-818c4baba5e8 req-1da120d6-c569-4c72-a298-7909b2d38b2b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116874 Jul 25 14:57:01.069978 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2671/5590] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:57:01.077384 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6418b444-8f7c-4e84-b644-7a24a6d95238 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:01.078331 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6418b444-8f7c-4e84-b644-7a24a6d95238 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 8df6413f-d937-4446-b01e-31ed3f057ad1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:01.086555 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6418b444-8f7c-4e84-b644-7a24a6d95238 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:01.087293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6418b444-8f7c-4e84-b644-7a24a6d95238 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:01.088268 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6418b444-8f7c-4e84-b644-7a24a6d95238 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:01.089469 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6418b444-8f7c-4e84-b644-7a24a6d95238 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:01.233073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6418b444-8f7c-4e84-b644-7a24a6d95238 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12c817e69a244f0fb1c364bc7ce90e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db4d0f898d548b9a88e1bfa7c69a941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:01.242358 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6418b444-8f7c-4e84-b644-7a24a6d95238 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/8df6413f-d937-4446-b01e-31ed3f057ad1" status: 200 len: 1469 microversion: 2.1 time: 0.169746 Jul 25 14:57:01.245947 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2672/5591] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:01 2022] GET /compute/v2.1/servers/8df6413f-d937-4446-b01e-31ed3f057ad1 => generated 1469 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:01.254335 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-71abac6d-6de4-4c29-8276-3294b4ef5c9b req-fb06e034-66fa-421d-b566-80beeb11959b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8df6413f-d937-4446-b01e-31ed3f057ad1", "name": "network-vif-deleted", "tag": "fee08e4f-b3a1-474a-8f68-5861b94e2bc5"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:01.321295 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-71abac6d-6de4-4c29-8276-3294b4ef5c9b req-fb06e034-66fa-421d-b566-80beeb11959b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:01.326007 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-71abac6d-6de4-4c29-8276-3294b4ef5c9b req-fb06e034-66fa-421d-b566-80beeb11959b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:01.363382 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-71abac6d-6de4-4c29-8276-3294b4ef5c9b req-fb06e034-66fa-421d-b566-80beeb11959b service nova] Creating event network-vif-deleted:fee08e4f-b3a1-474a-8f68-5861b94e2bc5 for instance 8df6413f-d937-4446-b01e-31ed3f057ad1 on n-h2-846435-14 Jul 25 14:57:01.369110 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-71abac6d-6de4-4c29-8276-3294b4ef5c9b req-fb06e034-66fa-421d-b566-80beeb11959b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121548 Jul 25 14:57:01.370822 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2673/5592] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:57:01.377539 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bd031950-2c25-428c-9921-7fcb7e43c9c7 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:01.378735 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bd031950-2c25-428c-9921-7fcb7e43c9c7 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:01.388735 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd031950-2c25-428c-9921-7fcb7e43c9c7 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:01.389434 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd031950-2c25-428c-9921-7fcb7e43c9c7 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:01.390842 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cd1f2f25-7639-4a10-895c-e0f0db35a301 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:01.394374 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd031950-2c25-428c-9921-7fcb7e43c9c7 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:01.395948 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd031950-2c25-428c-9921-7fcb7e43c9c7 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:01.406560 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cd1f2f25-7639-4a10-895c-e0f0db35a301 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 200 len: 1512 microversion: 2.1 time: 1.474224 Jul 25 14:57:01.409480 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2920/5593] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:56:59 2022] GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 1512 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:01.958527 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ac5f3f5a-c2ed-4770-b5f5-46f45ee40a74 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:01.959414 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ac5f3f5a-c2ed-4770-b5f5-46f45ee40a74 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:01.969626 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac5f3f5a-c2ed-4770-b5f5-46f45ee40a74 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:01.975213 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac5f3f5a-c2ed-4770-b5f5-46f45ee40a74 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:01.976333 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac5f3f5a-c2ed-4770-b5f5-46f45ee40a74 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:01.976922 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac5f3f5a-c2ed-4770-b5f5-46f45ee40a74 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:02.543362 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ac5f3f5a-c2ed-4770-b5f5-46f45ee40a74 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:02.557518 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:57:02.570456 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ac5f3f5a-c2ed-4770-b5f5-46f45ee40a74 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1690 microversion: 2.1 time: 0.616414 Jul 25 14:57:02.571056 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2921/5594] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:01 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1690 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:02.608448 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-daac750b-908a-429c-b879-73e4701fbff0 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:02.609320 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-daac750b-908a-429c-b879-73e4701fbff0 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: 8df6413f-d937-4446-b01e-31ed3f057ad1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:02.621023 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-daac750b-908a-429c-b879-73e4701fbff0 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:02.621711 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-daac750b-908a-429c-b879-73e4701fbff0 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:02.622895 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-daac750b-908a-429c-b879-73e4701fbff0 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:02.623626 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-daac750b-908a-429c-b879-73e4701fbff0 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:02.647893 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-daac750b-908a-429c-b879-73e4701fbff0 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] HTTP exception thrown: Instance 8df6413f-d937-4446-b01e-31ed3f057ad1 could not be found. Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-daac750b-908a-429c-b879-73e4701fbff0 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Request method failure captured: Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/8df6413f-d937-4446-b01e-31ed3f057ad1 HTTP/1.1 Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q76MzSsKMewQSCxQkQbeQVgADIqtz0k2mmZoQaVfok_X2G0cHJShrCoMCkSia-i_VSeO9vAVZxp6VPVT2lWs9zRquNos08DRCTediOf-95dHnUIfjcF8BmoATAd2EK1Ufj_P7DKW7JwEGk13nENeV-m1pVqqrXKsttgIENTl6-QyjU Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 4db4d0f898d548b9a88e1bfa7c69a941 Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-MultipleCreateTestJSON-1882769833 Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/4db4d0f898d548b9a88e1bfa7c69a941"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/4db4d0f898d548b9a88e1bfa7c69a941"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_4db4d0f898d548b9a88e1bfa7c69a941", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/4db4d0f898d548b9a88e1bfa7c69a941"}]}] Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-MultipleCreateTestJSON-1882769833 Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 4db4d0f898d548b9a88e1bfa7c69a941 Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1882769833 Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-MultipleCreateTestJSON-1882769833-project Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 12c817e69a244f0fb1c364bc7ce90e83 Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-MultipleCreateTestJSON-1882769833-project Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 8df6413f-d937-4446-b01e-31ed3f057ad1 could not be found. Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '8df6413f-d937-4446-b01e-31ed3f057ad1'} Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8df6413f-d937-4446-b01e-31ed3f057ad1 could not be found. Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8df6413f-d937-4446-b01e-31ed3f057ad1 could not be found. Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:57:02.651047 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:02.655813 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:57:02.655813 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:57:02.655813 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:57:02.655813 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:57:02.655813 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:57:02.655813 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8df6413f-d937-4446-b01e-31ed3f057ad1 could not be found. Jul 25 14:57:02.655813 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:02.657509 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-daac750b-908a-429c-b879-73e4701fbff0 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Returning 404 to user: Instance 8df6413f-d937-4446-b01e-31ed3f057ad1 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:57:02.658589 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-daac750b-908a-429c-b879-73e4701fbff0 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/8df6413f-d937-4446-b01e-31ed3f057ad1" status: 404 len: 111 microversion: 2.1 time: 0.079914 Jul 25 14:57:02.659600 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2922/5595] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:02 2022] GET /compute/v2.1/servers/8df6413f-d937-4446-b01e-31ed3f057ad1 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:57:02.666650 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-052e7193-1d8a-459e-96a7-fad7c52ced88 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:02.668113 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-052e7193-1d8a-459e-96a7-fad7c52ced88 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:02.679351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-052e7193-1d8a-459e-96a7-fad7c52ced88 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:02.680349 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-052e7193-1d8a-459e-96a7-fad7c52ced88 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:02.683329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-052e7193-1d8a-459e-96a7-fad7c52ced88 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:02.684075 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-052e7193-1d8a-459e-96a7-fad7c52ced88 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:02.854064 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bd031950-2c25-428c-9921-7fcb7e43c9c7 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398d222c122d43cb8eb518b47e816f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a42abd216b46978be871418669dd8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:02.863468 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bd031950-2c25-428c-9921-7fcb7e43c9c7 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0" status: 200 len: 1508 microversion: 2.1 time: 1.490877 Jul 25 14:57:02.866415 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2674/5596] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:01 2022] GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0 => generated 1508 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:02.883883 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-54b6c9fc-a3d8-4950-ac26-3deeb0bcd080 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:02.884848 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-54b6c9fc-a3d8-4950-ac26-3deeb0bcd080 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] [instance: b09bf101-ff6e-4517-8bd4-bd69a377470f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:02.891708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:57:02.894074 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-54b6c9fc-a3d8-4950-ac26-3deeb0bcd080 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:02.896185 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-54b6c9fc-a3d8-4950-ac26-3deeb0bcd080 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:02.897062 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-54b6c9fc-a3d8-4950-ac26-3deeb0bcd080 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:02.903623 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-54b6c9fc-a3d8-4950-ac26-3deeb0bcd080 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:03.290152 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-54b6c9fc-a3d8-4950-ac26-3deeb0bcd080 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] HTTP exception thrown: Instance b09bf101-ff6e-4517-8bd4-bd69a377470f could not be found. Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-54b6c9fc-a3d8-4950-ac26-3deeb0bcd080 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Request method failure captured: Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f HTTP/1.1 Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q76MzSsKMewQSCxQkQbeQVgADIqtz0k2mmZoQaVfok_X2G0cHJShrCoMCkSia-i_VSeO9vAVZxp6VPVT2lWs9zRquNos08DRCTediOf-95dHnUIfjcF8BmoATAd2EK1Ufj_P7DKW7JwEGk13nENeV-m1pVqqrXKsttgIENTl6-QyjU Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 4db4d0f898d548b9a88e1bfa7c69a941 Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-MultipleCreateTestJSON-1882769833 Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/4db4d0f898d548b9a88e1bfa7c69a941"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/4db4d0f898d548b9a88e1bfa7c69a941"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_4db4d0f898d548b9a88e1bfa7c69a941", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/4db4d0f898d548b9a88e1bfa7c69a941"}]}] Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-MultipleCreateTestJSON-1882769833 Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 4db4d0f898d548b9a88e1bfa7c69a941 Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1882769833 Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-MultipleCreateTestJSON-1882769833-project Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 12c817e69a244f0fb1c364bc7ce90e83 Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-MultipleCreateTestJSON-1882769833-project Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance b09bf101-ff6e-4517-8bd4-bd69a377470f could not be found. Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'b09bf101-ff6e-4517-8bd4-bd69a377470f'} Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b09bf101-ff6e-4517-8bd4-bd69a377470f could not be found. Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b09bf101-ff6e-4517-8bd4-bd69a377470f could not be found. Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:57:03.292209 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:57:03.299327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:57:03.299327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:57:03.299327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:57:03.299327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:57:03.299327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:57:03.299327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b09bf101-ff6e-4517-8bd4-bd69a377470f could not be found. Jul 25 14:57:03.299327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:57:03.299327 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-54b6c9fc-a3d8-4950-ac26-3deeb0bcd080 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] Returning 404 to user: Instance b09bf101-ff6e-4517-8bd4-bd69a377470f could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:57:03.299327 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-54b6c9fc-a3d8-4950-ac26-3deeb0bcd080 tempest-MultipleCreateTestJSON-1882769833 tempest-MultipleCreateTestJSON-1882769833-project] 10.222.0.88 "GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f" status: 404 len: 111 microversion: 2.1 time: 0.427017 Jul 25 14:57:03.299327 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2675/5597] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:02 2022] GET /compute/v2.1/servers/b09bf101-ff6e-4517-8bd4-bd69a377470f => generated 111 bytes in 429 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:57:03.305037 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-b0b7fdb6-bcb1-4031-9df5-4ab9a01ab515 req-77a495f2-2a6c-435e-b777-6d0ff2863372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d027db2-6df4-4295-a5e1-d8886d34018d", "tag": "6edba24d-b14c-4866-afee-2438b889d8bb"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:03.317078 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b0b7fdb6-bcb1-4031-9df5-4ab9a01ab515 req-77a495f2-2a6c-435e-b777-6d0ff2863372 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:03.317609 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b0b7fdb6-bcb1-4031-9df5-4ab9a01ab515 req-77a495f2-2a6c-435e-b777-6d0ff2863372 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:03.331094 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-b0b7fdb6-bcb1-4031-9df5-4ab9a01ab515 req-77a495f2-2a6c-435e-b777-6d0ff2863372 service nova] Creating event network-changed:6edba24d-b14c-4866-afee-2438b889d8bb for instance 4d027db2-6df4-4295-a5e1-d8886d34018d on n-h1-846435-14 Jul 25 14:57:03.337642 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [req-b0b7fdb6-bcb1-4031-9df5-4ab9a01ab515 req-77a495f2-2a6c-435e-b777-6d0ff2863372 service nova] Instance 4d027db2-6df4-4295-a5e1-d8886d34018d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119303) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 14:57:03.350342 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-b0b7fdb6-bcb1-4031-9df5-4ab9a01ab515 req-77a495f2-2a6c-435e-b777-6d0ff2863372 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051237 Jul 25 14:57:03.351365 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2676/5598] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:57:03.470880 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-e72e105b-bd9e-4094-bb14-2696705c23a0 req-447e97e5-b39e-4197-8aaf-1f5d2e34e125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b09bf101-ff6e-4517-8bd4-bd69a377470f", "name": "network-vif-deleted", "tag": "b914e258-00bb-43ca-8139-2c8d1a39c5a7"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:03.497438 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-e72e105b-bd9e-4094-bb14-2696705c23a0 req-447e97e5-b39e-4197-8aaf-1f5d2e34e125 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:03.498544 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-e72e105b-bd9e-4094-bb14-2696705c23a0 req-447e97e5-b39e-4197-8aaf-1f5d2e34e125 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:03.525419 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-e72e105b-bd9e-4094-bb14-2696705c23a0 req-447e97e5-b39e-4197-8aaf-1f5d2e34e125 service nova] Creating event network-vif-deleted:b914e258-00bb-43ca-8139-2c8d1a39c5a7 for instance b09bf101-ff6e-4517-8bd4-bd69a377470f on n-h2-846435-14 Jul 25 14:57:03.534439 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-e72e105b-bd9e-4094-bb14-2696705c23a0 req-447e97e5-b39e-4197-8aaf-1f5d2e34e125 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068922 Jul 25 14:57:03.535703 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2677/5599] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:57:03.568914 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-052e7193-1d8a-459e-96a7-fad7c52ced88 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:03.586008 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-052e7193-1d8a-459e-96a7-fad7c52ced88 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 200 len: 1512 microversion: 2.1 time: 0.924259 Jul 25 14:57:03.588336 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2923/5600] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:02 2022] GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 1512 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:03.607220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d8e98ce9-00e3-4172-9863-67c3911d2671 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:03.608016 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d8e98ce9-00e3-4172-9863-67c3911d2671 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:03.615847 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8e98ce9-00e3-4172-9863-67c3911d2671 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:03.616520 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8e98ce9-00e3-4172-9863-67c3911d2671 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:03.617391 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8e98ce9-00e3-4172-9863-67c3911d2671 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:03.618200 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8e98ce9-00e3-4172-9863-67c3911d2671 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:03.895032 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-37caadac-15d2-40dd-afc6-ff4378303923 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:03.896411 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-37caadac-15d2-40dd-afc6-ff4378303923 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:03.908314 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37caadac-15d2-40dd-afc6-ff4378303923 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:03.909504 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37caadac-15d2-40dd-afc6-ff4378303923 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:03.910983 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37caadac-15d2-40dd-afc6-ff4378303923 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:03.911900 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37caadac-15d2-40dd-afc6-ff4378303923 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:04.250678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d8e98ce9-00e3-4172-9863-67c3911d2671 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:04.261298 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d8e98ce9-00e3-4172-9863-67c3911d2671 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1690 microversion: 2.1 time: 0.656595 Jul 25 14:57:04.263933 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2678/5601] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:03 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1690 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:04.379923 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-37caadac-15d2-40dd-afc6-ff4378303923 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398d222c122d43cb8eb518b47e816f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a42abd216b46978be871418669dd8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:04.391088 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-37caadac-15d2-40dd-afc6-ff4378303923 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0" status: 200 len: 1508 microversion: 2.1 time: 0.500604 Jul 25 14:57:04.393635 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2924/5602] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:03 2022] GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0 => generated 1508 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:04.616281 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8a1f3361-8749-4d51-8dea-a0e0f487059d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:04.618357 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8a1f3361-8749-4d51-8dea-a0e0f487059d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:04.628254 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8a1f3361-8749-4d51-8dea-a0e0f487059d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:04.628945 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8a1f3361-8749-4d51-8dea-a0e0f487059d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:04.631589 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8a1f3361-8749-4d51-8dea-a0e0f487059d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:04.632761 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8a1f3361-8749-4d51-8dea-a0e0f487059d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:04.986610 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8a1f3361-8749-4d51-8dea-a0e0f487059d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:04.996253 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8a1f3361-8749-4d51-8dea-a0e0f487059d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 200 len: 1512 microversion: 2.1 time: 0.391171 Jul 25 14:57:04.998753 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2679/5603] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:04 2022] GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 1512 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:05.306854 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bbfe3051-6a7e-4d82-8fbd-a53fd7cea4a5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:05.308128 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bbfe3051-6a7e-4d82-8fbd-a53fd7cea4a5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:05.317485 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bbfe3051-6a7e-4d82-8fbd-a53fd7cea4a5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:05.318216 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bbfe3051-6a7e-4d82-8fbd-a53fd7cea4a5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:05.319145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bbfe3051-6a7e-4d82-8fbd-a53fd7cea4a5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:05.319727 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bbfe3051-6a7e-4d82-8fbd-a53fd7cea4a5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:05.394256 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-7192cb0f-8dc2-49e0-b852-46affcf7473d req-6b3dfd05-ac66-4c89-b987-37d42584c406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "238133c4-5cb9-47aa-990b-9b890682a9e0", "name": "network-vif-deleted", "tag": "818ad8ee-4bbb-4ccb-9600-80a946c83530"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:05.411495 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-7192cb0f-8dc2-49e0-b852-46affcf7473d req-6b3dfd05-ac66-4c89-b987-37d42584c406 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:05.412297 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-7192cb0f-8dc2-49e0-b852-46affcf7473d req-6b3dfd05-ac66-4c89-b987-37d42584c406 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:05.426480 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-7192cb0f-8dc2-49e0-b852-46affcf7473d req-6b3dfd05-ac66-4c89-b987-37d42584c406 service nova] Creating event network-vif-deleted:818ad8ee-4bbb-4ccb-9600-80a946c83530 for instance 238133c4-5cb9-47aa-990b-9b890682a9e0 on n-h1-846435-14 Jul 25 14:57:05.431948 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-7192cb0f-8dc2-49e0-b852-46affcf7473d req-6b3dfd05-ac66-4c89-b987-37d42584c406 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042572 Jul 25 14:57:05.432884 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2680/5604] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:57:05.438222 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5499d51f-2862-49ba-8d29-067c31bc33c2 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:05.439240 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5499d51f-2862-49ba-8d29-067c31bc33c2 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:05.446421 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5499d51f-2862-49ba-8d29-067c31bc33c2 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:05.447171 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5499d51f-2862-49ba-8d29-067c31bc33c2 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:05.448248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5499d51f-2862-49ba-8d29-067c31bc33c2 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:05.448895 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5499d51f-2862-49ba-8d29-067c31bc33c2 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:05.535736 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5499d51f-2862-49ba-8d29-067c31bc33c2 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398d222c122d43cb8eb518b47e816f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a42abd216b46978be871418669dd8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:05.556216 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5499d51f-2862-49ba-8d29-067c31bc33c2 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0" status: 200 len: 1466 microversion: 2.1 time: 0.116330 Jul 25 14:57:05.558070 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2681/5605] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:05 2022] GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0 => generated 1466 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:05.686932 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bbfe3051-6a7e-4d82-8fbd-a53fd7cea4a5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:05.723392 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bbfe3051-6a7e-4d82-8fbd-a53fd7cea4a5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1690 microversion: 2.1 time: 0.423386 Jul 25 14:57:05.756900 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2925/5606] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:05 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1690 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:06.027035 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4e25f34f-70f2-41de-9de9-abd5e6ca9f29 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:06.030203 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4e25f34f-70f2-41de-9de9-abd5e6ca9f29 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:06.040662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4e25f34f-70f2-41de-9de9-abd5e6ca9f29 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:06.045014 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4e25f34f-70f2-41de-9de9-abd5e6ca9f29 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:06.046490 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4e25f34f-70f2-41de-9de9-abd5e6ca9f29 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:06.047617 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4e25f34f-70f2-41de-9de9-abd5e6ca9f29 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:06.606825 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5df94abb-8e75-49ac-bd43-a69daee02307 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:06.609864 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5df94abb-8e75-49ac-bd43-a69daee02307 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] [instance: 238133c4-5cb9-47aa-990b-9b890682a9e0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:06.650210 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5df94abb-8e75-49ac-bd43-a69daee02307 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:06.655161 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5df94abb-8e75-49ac-bd43-a69daee02307 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:06.659759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5df94abb-8e75-49ac-bd43-a69daee02307 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:06.661009 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5df94abb-8e75-49ac-bd43-a69daee02307 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:06.722159 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-5df94abb-8e75-49ac-bd43-a69daee02307 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] HTTP exception thrown: Instance 238133c4-5cb9-47aa-990b-9b890682a9e0 could not be found. Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5df94abb-8e75-49ac-bd43-a69daee02307 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Request method failure captured: Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0 HTTP/1.1 Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q8VewFou_OvA6EBIxYf3VyRBI8Epgc6PsOgi_s3wSYuiWVsMJg4GG73kTMonKfge_4xwp2QC7wst1BBLgLj2_qYESUU1yfgJfXQoS5zMp6ki1cV3iW9weph-UjkqiCFXEmzuhxUHq3oofcg7ueMrUU-3MHyv32ft-4OXaEUMgeh_KE Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 83a42abd216b46978be871418669dd8f Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-TestServerAdvancedOps-1407478804 Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/83a42abd216b46978be871418669dd8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/83a42abd216b46978be871418669dd8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_83a42abd216b46978be871418669dd8f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/83a42abd216b46978be871418669dd8f"}]}] Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-TestServerAdvancedOps-1407478804 Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 83a42abd216b46978be871418669dd8f Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-TestServerAdvancedOps-1407478804 Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-TestServerAdvancedOps-1407478804-project Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 398d222c122d43cb8eb518b47e816f4e Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-TestServerAdvancedOps-1407478804-project Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 238133c4-5cb9-47aa-990b-9b890682a9e0 could not be found. Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '238133c4-5cb9-47aa-990b-9b890682a9e0'} Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 238133c4-5cb9-47aa-990b-9b890682a9e0 could not be found. Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 238133c4-5cb9-47aa-990b-9b890682a9e0 could not be found. Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:57:06.726426 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:06.734487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:57:06.734487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:57:06.734487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:57:06.734487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:57:06.734487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:57:06.734487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 238133c4-5cb9-47aa-990b-9b890682a9e0 could not be found. Jul 25 14:57:06.734487 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:06.748639 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5df94abb-8e75-49ac-bd43-a69daee02307 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] Returning 404 to user: Instance 238133c4-5cb9-47aa-990b-9b890682a9e0 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:57:06.748639 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5df94abb-8e75-49ac-bd43-a69daee02307 tempest-TestServerAdvancedOps-1407478804 tempest-TestServerAdvancedOps-1407478804-project] 10.222.0.88 "GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0" status: 404 len: 111 microversion: 2.1 time: 0.140727 Jul 25 14:57:06.748639 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2926/5607] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:06 2022] GET /compute/v2.1/servers/238133c4-5cb9-47aa-990b-9b890682a9e0 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:57:06.787304 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-868c023f-e4e7-479d-be16-267d7f29824f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:06.788552 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-868c023f-e4e7-479d-be16-267d7f29824f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:06.804702 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-868c023f-e4e7-479d-be16-267d7f29824f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:06.805736 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-868c023f-e4e7-479d-be16-267d7f29824f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:06.807297 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-868c023f-e4e7-479d-be16-267d7f29824f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:06.808152 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-868c023f-e4e7-479d-be16-267d7f29824f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:07.477060 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4e25f34f-70f2-41de-9de9-abd5e6ca9f29 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:07.489685 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4e25f34f-70f2-41de-9de9-abd5e6ca9f29 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 200 len: 1512 microversion: 2.1 time: 1.470571 Jul 25 14:57:07.490284 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2682/5608] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:06 2022] GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 1512 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:07.703348 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-868c023f-e4e7-479d-be16-267d7f29824f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:07.714248 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-868c023f-e4e7-479d-be16-267d7f29824f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1683 microversion: 2.1 time: 0.937125 Jul 25 14:57:07.715053 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2927/5609] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:06 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1683 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:57:08.515339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0d33a9c4-56c7-4362-b358-b605ba49a854 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:08.517163 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0d33a9c4-56c7-4362-b358-b605ba49a854 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:08.534608 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0d33a9c4-56c7-4362-b358-b605ba49a854 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:08.535704 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0d33a9c4-56c7-4362-b358-b605ba49a854 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:08.537617 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0d33a9c4-56c7-4362-b358-b605ba49a854 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:08.538213 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0d33a9c4-56c7-4362-b358-b605ba49a854 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:09.245064 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0d33a9c4-56c7-4362-b358-b605ba49a854 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:09.256253 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0d33a9c4-56c7-4362-b358-b605ba49a854 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 200 len: 1512 microversion: 2.1 time: 0.745679 Jul 25 14:57:09.260049 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2683/5610] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:08 2022] GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 1512 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:57:09.889672 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-0c85ab40-7eb9-4afb-b90d-092fb71efc77 req-95380d74-c54c-4822-b179-124560e47fca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d027db2-6df4-4295-a5e1-d8886d34018d", "name": "network-vif-plugged", "status": "completed", "tag": "6edba24d-b14c-4866-afee-2438b889d8bb"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:09.915073 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-0c85ab40-7eb9-4afb-b90d-092fb71efc77 req-95380d74-c54c-4822-b179-124560e47fca service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:09.917075 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-0c85ab40-7eb9-4afb-b90d-092fb71efc77 req-95380d74-c54c-4822-b179-124560e47fca service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:09.954089 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-0c85ab40-7eb9-4afb-b90d-092fb71efc77 req-95380d74-c54c-4822-b179-124560e47fca service nova] Creating event network-vif-plugged:6edba24d-b14c-4866-afee-2438b889d8bb for instance 4d027db2-6df4-4295-a5e1-d8886d34018d on n-h1-846435-14 Jul 25 14:57:09.960831 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-0c85ab40-7eb9-4afb-b90d-092fb71efc77 req-95380d74-c54c-4822-b179-124560e47fca service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075850 Jul 25 14:57:09.961762 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2928/5611] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:57:10.278124 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0e56d26b-608f-4ca3-8de5-29230ee88c3d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:10.278754 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0e56d26b-608f-4ca3-8de5-29230ee88c3d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:10.293755 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e56d26b-608f-4ca3-8de5-29230ee88c3d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:10.297740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e56d26b-608f-4ca3-8de5-29230ee88c3d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:10.299929 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e56d26b-608f-4ca3-8de5-29230ee88c3d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:10.301841 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e56d26b-608f-4ca3-8de5-29230ee88c3d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:10.904648 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0e56d26b-608f-4ca3-8de5-29230ee88c3d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:10.918497 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0e56d26b-608f-4ca3-8de5-29230ee88c3d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 200 len: 1512 microversion: 2.1 time: 0.644320 Jul 25 14:57:10.920386 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2684/5612] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:10 2022] GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 1512 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:11.943549 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2765a82c-7cd9-49f3-9f6b-e0af5aed6bf6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:11.952292 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2765a82c-7cd9-49f3-9f6b-e0af5aed6bf6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:11.968936 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2765a82c-7cd9-49f3-9f6b-e0af5aed6bf6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:11.971640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2765a82c-7cd9-49f3-9f6b-e0af5aed6bf6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:11.972854 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2765a82c-7cd9-49f3-9f6b-e0af5aed6bf6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:11.973535 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2765a82c-7cd9-49f3-9f6b-e0af5aed6bf6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:12.339387 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2765a82c-7cd9-49f3-9f6b-e0af5aed6bf6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:12.361814 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2765a82c-7cd9-49f3-9f6b-e0af5aed6bf6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 200 len: 1512 microversion: 2.1 time: 0.421129 Jul 25 14:57:12.376055 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2929/5613] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:11 2022] GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 1512 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:12.945677 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 14:57:12.946358 n-d-846435-14 devstack@n-api.service[119304]: Mon Jul 25 14:57:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 14:57:13.385258 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-34b60ac7-885c-4248-af81-37bf669dc75b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:13.386523 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-34b60ac7-885c-4248-af81-37bf669dc75b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:13.398480 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-34b60ac7-885c-4248-af81-37bf669dc75b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:13.403603 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-34b60ac7-885c-4248-af81-37bf669dc75b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:13.405362 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-34b60ac7-885c-4248-af81-37bf669dc75b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:13.411185 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-34b60ac7-885c-4248-af81-37bf669dc75b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:13.862947 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-34b60ac7-885c-4248-af81-37bf669dc75b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:13.875306 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-34b60ac7-885c-4248-af81-37bf669dc75b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 200 len: 1512 microversion: 2.1 time: 0.494121 Jul 25 14:57:13.876690 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2685/5614] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:13 2022] GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 1512 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:14.841837 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-54e727bb-00fd-49e0-82b1-de00b19d85da tempest-MultipleCreateNegativeTestJSON-827747692 tempest-MultipleCreateNegativeTestJSON-827747692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1572817627", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:14.846494 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-54e727bb-00fd-49e0-82b1-de00b19d85da tempest-MultipleCreateNegativeTestJSON-827747692 tempest-MultipleCreateNegativeTestJSON-827747692-project] HTTP exception thrown: min_count must be <= max_count Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-54e727bb-00fd-49e0-82b1-de00b19d85da tempest-MultipleCreateNegativeTestJSON-827747692 tempest-MultipleCreateNegativeTestJSON-827747692-project] Request method failure captured: Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 184 Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q9K71GLyRFZH_qNXUCZduTLvrSvTuGGrIEZl3yT-m_F7g-7QAPsCZQAhk8uvX__bw7zfR6_frl3OWZWHi_eUNYQDMUJ78aEj8CrnFWLwGiHSM25omgtXrNUnA-xFCqGEl5oJgr7xqeumlReuscnkUMG4c_ce8ALRqTRxqcvkgGfR_U Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 1e7c6de0a67a4c69a15de4515a0e9ce9 Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-827747692 Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1e7c6de0a67a4c69a15de4515a0e9ce9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1e7c6de0a67a4c69a15de4515a0e9ce9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1e7c6de0a67a4c69a15de4515a0e9ce9", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1e7c6de0a67a4c69a15de4515a0e9ce9"}]}] Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-827747692 Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 1e7c6de0a67a4c69a15de4515a0e9ce9 Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-827747692 Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-MultipleCreateNegativeTestJSON-827747692-project Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 76d2c9a99e154e5689d1b7d6488a45fe Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-827747692-project Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1572817627", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: exception: min_count must be <= max_count Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1572817627', 'imageRef': 'a7b14aba-1848-4a00-a3e7-b66eb3e97925', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jul 25 14:57:14.848640 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:14.856066 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-54e727bb-00fd-49e0-82b1-de00b19d85da tempest-MultipleCreateNegativeTestJSON-827747692 tempest-MultipleCreateNegativeTestJSON-827747692-project] Returning 400 to user: min_count must be <= max_count {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:57:14.857642 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-54e727bb-00fd-49e0-82b1-de00b19d85da tempest-MultipleCreateNegativeTestJSON-827747692 tempest-MultipleCreateNegativeTestJSON-827747692-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.153910 Jul 25 14:57:14.869107 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2930/5615] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:57:14 2022] POST /compute/v2.1/servers => generated 74 bytes in 166 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 14:57:14.899604 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4a25b21f-6f3d-4c89-8d10-f8b42f93eac3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:14.900389 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4a25b21f-6f3d-4c89-8d10-f8b42f93eac3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:14.934894 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4a25b21f-6f3d-4c89-8d10-f8b42f93eac3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:14.935793 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4a25b21f-6f3d-4c89-8d10-f8b42f93eac3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:14.940166 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4a25b21f-6f3d-4c89-8d10-f8b42f93eac3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:14.942395 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4a25b21f-6f3d-4c89-8d10-f8b42f93eac3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:14.981403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7b40cd8c-dbe6-455d-9248-3a8896821f04 tempest-MultipleCreateNegativeTestJSON-827747692 tempest-MultipleCreateNegativeTestJSON-827747692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1139202525", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "max_count": 0}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7b40cd8c-dbe6-455d-9248-3a8896821f04 tempest-MultipleCreateNegativeTestJSON-827747692 tempest-MultipleCreateNegativeTestJSON-827747692-project] Request method failure captured: Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 168 Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q9K71GLyRFZH_qNXUCZduTLvrSvTuGGrIEZl3yT-m_F7g-7QAPsCZQAhk8uvX__bw7zfR6_frl3OWZWHi_eUNYQDMUJ78aEj8CrnFWLwGiHSM25omgtXrNUnA-xFCqGEl5oJgr7xqeumlReuscnkUMG4c_ce8ALRqTRxqcvkgGfR_U Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 1e7c6de0a67a4c69a15de4515a0e9ce9 Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-827747692 Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1e7c6de0a67a4c69a15de4515a0e9ce9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1e7c6de0a67a4c69a15de4515a0e9ce9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1e7c6de0a67a4c69a15de4515a0e9ce9", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1e7c6de0a67a4c69a15de4515a0e9ce9"}]}] Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-827747692 Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 1e7c6de0a67a4c69a15de4515a0e9ce9 Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-827747692 Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-MultipleCreateNegativeTestJSON-827747692-project Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 76d2c9a99e154e5689d1b7d6488a45fe Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-827747692-project Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1139202525", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "max_count": 0}} Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1139202525', 'imageRef': 'a7b14aba-1848-4a00-a3e7-b66eb3e97925', 'flavorRef': '452', 'max_count': 0}}} Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 0 Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:57:14.989158 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:57:14.994140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:57:14.994140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:57:14.994140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:57:14.994140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:57:14.994140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 25 14:57:14.994140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:14.994140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:57:14.994140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:14.994140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:57:14.994140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:57:14.994140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:57:14.994140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:57:14.994140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:57:14.994140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 25 14:57:14.994140 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:14.994140 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7b40cd8c-dbe6-455d-9248-3a8896821f04 tempest-MultipleCreateNegativeTestJSON-827747692 tempest-MultipleCreateNegativeTestJSON-827747692-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:57:14.994140 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7b40cd8c-dbe6-455d-9248-3a8896821f04 tempest-MultipleCreateNegativeTestJSON-827747692 tempest-MultipleCreateNegativeTestJSON-827747692-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.015167 Jul 25 14:57:14.994140 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2931/5616] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:57:14 2022] POST /compute/v2.1/servers => generated 130 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 14:57:15.059108 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fb659018-757b-463f-a305-da3f89414ca2 tempest-MultipleCreateNegativeTestJSON-827747692 tempest-MultipleCreateNegativeTestJSON-827747692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1548998317", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "max_count": 2.5}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fb659018-757b-463f-a305-da3f89414ca2 tempest-MultipleCreateNegativeTestJSON-827747692 tempest-MultipleCreateNegativeTestJSON-827747692-project] Request method failure captured: Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 170 Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q9K71GLyRFZH_qNXUCZduTLvrSvTuGGrIEZl3yT-m_F7g-7QAPsCZQAhk8uvX__bw7zfR6_frl3OWZWHi_eUNYQDMUJ78aEj8CrnFWLwGiHSM25omgtXrNUnA-xFCqGEl5oJgr7xqeumlReuscnkUMG4c_ce8ALRqTRxqcvkgGfR_U Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 1e7c6de0a67a4c69a15de4515a0e9ce9 Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-827747692 Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1e7c6de0a67a4c69a15de4515a0e9ce9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1e7c6de0a67a4c69a15de4515a0e9ce9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1e7c6de0a67a4c69a15de4515a0e9ce9", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1e7c6de0a67a4c69a15de4515a0e9ce9"}]}] Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-827747692 Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 1e7c6de0a67a4c69a15de4515a0e9ce9 Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-827747692 Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-MultipleCreateNegativeTestJSON-827747692-project Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 76d2c9a99e154e5689d1b7d6488a45fe Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-827747692-project Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1548998317", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "max_count": 2.5}} Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1548998317', 'imageRef': 'a7b14aba-1848-4a00-a3e7-b66eb3e97925', 'flavorRef': '452', 'max_count': 2.5}}} Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 2.5 Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:57:15.063950 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:57:15.069143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:57:15.069143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:57:15.069143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:57:15.069143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:57:15.069143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 25 14:57:15.069143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:15.069143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:57:15.069143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:15.069143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:57:15.069143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:57:15.069143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:57:15.069143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:57:15.069143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:57:15.069143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 25 14:57:15.069143 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:15.071402 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fb659018-757b-463f-a305-da3f89414ca2 tempest-MultipleCreateNegativeTestJSON-827747692 tempest-MultipleCreateNegativeTestJSON-827747692-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:57:15.072485 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fb659018-757b-463f-a305-da3f89414ca2 tempest-MultipleCreateNegativeTestJSON-827747692 tempest-MultipleCreateNegativeTestJSON-827747692-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.021730 Jul 25 14:57:15.076566 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2932/5617] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:57:15 2022] POST /compute/v2.1/servers => generated 139 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 14:57:15.134759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cf805e77-82a9-4a73-ab4f-5ece96d25598 tempest-MultipleCreateNegativeTestJSON-827747692 tempest-MultipleCreateNegativeTestJSON-827747692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-452532799", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "min_count": 0}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cf805e77-82a9-4a73-ab4f-5ece96d25598 tempest-MultipleCreateNegativeTestJSON-827747692 tempest-MultipleCreateNegativeTestJSON-827747692-project] Request method failure captured: Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 167 Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q9K71GLyRFZH_qNXUCZduTLvrSvTuGGrIEZl3yT-m_F7g-7QAPsCZQAhk8uvX__bw7zfR6_frl3OWZWHi_eUNYQDMUJ78aEj8CrnFWLwGiHSM25omgtXrNUnA-xFCqGEl5oJgr7xqeumlReuscnkUMG4c_ce8ALRqTRxqcvkgGfR_U Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 1e7c6de0a67a4c69a15de4515a0e9ce9 Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-827747692 Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1e7c6de0a67a4c69a15de4515a0e9ce9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1e7c6de0a67a4c69a15de4515a0e9ce9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1e7c6de0a67a4c69a15de4515a0e9ce9", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1e7c6de0a67a4c69a15de4515a0e9ce9"}]}] Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-827747692 Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 1e7c6de0a67a4c69a15de4515a0e9ce9 Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-827747692 Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-MultipleCreateNegativeTestJSON-827747692-project Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 76d2c9a99e154e5689d1b7d6488a45fe Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-827747692-project Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-452532799", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "min_count": 0}} Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-452532799', 'imageRef': 'a7b14aba-1848-4a00-a3e7-b66eb3e97925', 'flavorRef': '452', 'min_count': 0}}} Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 0 Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:57:15.139885 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:57:15.143941 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:57:15.143941 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:57:15.143941 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:57:15.143941 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:57:15.143941 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 25 14:57:15.143941 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:15.143941 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:57:15.143941 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:15.143941 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:57:15.143941 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:57:15.143941 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:57:15.143941 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:57:15.143941 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:57:15.143941 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 25 14:57:15.143941 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:15.152356 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cf805e77-82a9-4a73-ab4f-5ece96d25598 tempest-MultipleCreateNegativeTestJSON-827747692 tempest-MultipleCreateNegativeTestJSON-827747692-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:57:15.153372 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cf805e77-82a9-4a73-ab4f-5ece96d25598 tempest-MultipleCreateNegativeTestJSON-827747692 tempest-MultipleCreateNegativeTestJSON-827747692-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.023213 Jul 25 14:57:15.154190 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2933/5618] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:57:15 2022] POST /compute/v2.1/servers => generated 130 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:57:15.205532 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f94e6b8b-2367-4f49-82d1-be0a049b939e tempest-MultipleCreateNegativeTestJSON-827747692 tempest-MultipleCreateNegativeTestJSON-827747692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-556467930", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "min_count": 2.5}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f94e6b8b-2367-4f49-82d1-be0a049b939e tempest-MultipleCreateNegativeTestJSON-827747692 tempest-MultipleCreateNegativeTestJSON-827747692-project] Request method failure captured: Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 169 Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q9K71GLyRFZH_qNXUCZduTLvrSvTuGGrIEZl3yT-m_F7g-7QAPsCZQAhk8uvX__bw7zfR6_frl3OWZWHi_eUNYQDMUJ78aEj8CrnFWLwGiHSM25omgtXrNUnA-xFCqGEl5oJgr7xqeumlReuscnkUMG4c_ce8ALRqTRxqcvkgGfR_U Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 1e7c6de0a67a4c69a15de4515a0e9ce9 Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-827747692 Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1e7c6de0a67a4c69a15de4515a0e9ce9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1e7c6de0a67a4c69a15de4515a0e9ce9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1e7c6de0a67a4c69a15de4515a0e9ce9", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1e7c6de0a67a4c69a15de4515a0e9ce9"}]}] Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-827747692 Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 1e7c6de0a67a4c69a15de4515a0e9ce9 Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-827747692 Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-MultipleCreateNegativeTestJSON-827747692-project Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 76d2c9a99e154e5689d1b7d6488a45fe Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-827747692-project Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-556467930", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "min_count": 2.5}} Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-556467930', 'imageRef': 'a7b14aba-1848-4a00-a3e7-b66eb3e97925', 'flavorRef': '452', 'min_count': 2.5}}} Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 2.5 Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:57:15.210142 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:57:15.214167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:57:15.214167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:57:15.214167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:57:15.214167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:57:15.214167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 25 14:57:15.214167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:15.214167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:57:15.214167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:15.214167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:57:15.214167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:57:15.214167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:57:15.214167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:57:15.214167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:57:15.214167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 25 14:57:15.214167 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:57:15.216944 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f94e6b8b-2367-4f49-82d1-be0a049b939e tempest-MultipleCreateNegativeTestJSON-827747692 tempest-MultipleCreateNegativeTestJSON-827747692-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:57:15.218264 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f94e6b8b-2367-4f49-82d1-be0a049b939e tempest-MultipleCreateNegativeTestJSON-827747692 tempest-MultipleCreateNegativeTestJSON-827747692-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.018565 Jul 25 14:57:15.219171 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2934/5619] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:57:15 2022] POST /compute/v2.1/servers => generated 139 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 14:57:15.288596 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4a25b21f-6f3d-4c89-8d10-f8b42f93eac3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:15.291443 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:57:15.301539 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4a25b21f-6f3d-4c89-8d10-f8b42f93eac3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 200 len: 1512 microversion: 2.1 time: 0.406517 Jul 25 14:57:15.302854 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2686/5620] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:14 2022] GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 1512 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:16.324684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ed6e31d1-a311-4087-a0fb-9ec3cd809900 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:16.325958 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ed6e31d1-a311-4087-a0fb-9ec3cd809900 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:16.338325 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed6e31d1-a311-4087-a0fb-9ec3cd809900 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:16.338868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed6e31d1-a311-4087-a0fb-9ec3cd809900 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:16.340085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed6e31d1-a311-4087-a0fb-9ec3cd809900 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:16.341503 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed6e31d1-a311-4087-a0fb-9ec3cd809900 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:16.527675 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ed6e31d1-a311-4087-a0fb-9ec3cd809900 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:16.538568 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ed6e31d1-a311-4087-a0fb-9ec3cd809900 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 200 len: 1512 microversion: 2.1 time: 0.219306 Jul 25 14:57:16.539838 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2935/5621] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:16 2022] GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 1512 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:17.565863 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-13a873e0-7a45-447d-98d4-906c12dcf35a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:17.567958 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-13a873e0-7a45-447d-98d4-906c12dcf35a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:17.579511 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-13a873e0-7a45-447d-98d4-906c12dcf35a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:17.580150 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-13a873e0-7a45-447d-98d4-906c12dcf35a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:17.581528 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-13a873e0-7a45-447d-98d4-906c12dcf35a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:17.582646 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-13a873e0-7a45-447d-98d4-906c12dcf35a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:17.775730 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-13a873e0-7a45-447d-98d4-906c12dcf35a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:17.797671 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-13a873e0-7a45-447d-98d4-906c12dcf35a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 200 len: 1512 microversion: 2.1 time: 0.237656 Jul 25 14:57:17.798334 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2687/5622] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:17 2022] GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 1512 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:18.838370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8ab48c62-538c-461b-9ea4-7fc78a24d284 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:18.844649 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8ab48c62-538c-461b-9ea4-7fc78a24d284 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:18.870567 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8ab48c62-538c-461b-9ea4-7fc78a24d284 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:18.872620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8ab48c62-538c-461b-9ea4-7fc78a24d284 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:18.874931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8ab48c62-538c-461b-9ea4-7fc78a24d284 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:18.881152 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8ab48c62-538c-461b-9ea4-7fc78a24d284 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:19.374931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8ab48c62-538c-461b-9ea4-7fc78a24d284 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:19.385002 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8ab48c62-538c-461b-9ea4-7fc78a24d284 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 200 len: 1512 microversion: 2.1 time: 0.567577 Jul 25 14:57:19.401621 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2936/5623] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:18 2022] GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 1512 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:20.408355 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1bb70e9e-bfea-4a5b-92d1-5374526e0878 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:20.409221 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1bb70e9e-bfea-4a5b-92d1-5374526e0878 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:20.425406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1bb70e9e-bfea-4a5b-92d1-5374526e0878 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:20.426277 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1bb70e9e-bfea-4a5b-92d1-5374526e0878 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:20.428801 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1bb70e9e-bfea-4a5b-92d1-5374526e0878 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:20.429359 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1bb70e9e-bfea-4a5b-92d1-5374526e0878 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:21.026181 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1bb70e9e-bfea-4a5b-92d1-5374526e0878 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:21.038468 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1bb70e9e-bfea-4a5b-92d1-5374526e0878 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 200 len: 1512 microversion: 2.1 time: 0.635340 Jul 25 14:57:21.055219 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2688/5624] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:20 2022] GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 1512 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:22.073075 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5b47f292-8bee-4617-9488-11c0e1cf79e9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:22.074423 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5b47f292-8bee-4617-9488-11c0e1cf79e9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:22.092893 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b47f292-8bee-4617-9488-11c0e1cf79e9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:22.094184 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b47f292-8bee-4617-9488-11c0e1cf79e9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:22.101013 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b47f292-8bee-4617-9488-11c0e1cf79e9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:22.101712 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b47f292-8bee-4617-9488-11c0e1cf79e9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:22.285425 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5b47f292-8bee-4617-9488-11c0e1cf79e9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:22.312743 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5b47f292-8bee-4617-9488-11c0e1cf79e9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 200 len: 1512 microversion: 2.1 time: 0.254330 Jul 25 14:57:22.314442 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2937/5625] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:22 2022] GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 1512 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:22.516814 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-65f1f059-e47a-49ce-812a-e5a385819e4c tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1419568310", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "89ff8548-ceb2-4707-9470-548d70a981a2"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:22.635158 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-65f1f059-e47a-49ce-812a-e5a385819e4c tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] validate_networks() for [('89ff8548-ceb2-4707-9470-548d70a981a2', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:57:23.743186 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4e85bbc8-ea46-483e-becc-937de0a27c1a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:23.743796 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4e85bbc8-ea46-483e-becc-937de0a27c1a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:23.753825 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e85bbc8-ea46-483e-becc-937de0a27c1a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:23.756563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e85bbc8-ea46-483e-becc-937de0a27c1a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:23.757289 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e85bbc8-ea46-483e-becc-937de0a27c1a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:23.757724 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e85bbc8-ea46-483e-becc-937de0a27c1a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:24.005620 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-65f1f059-e47a-49ce-812a-e5a385819e4c tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:57:24.006991 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-65f1f059-e47a-49ce-812a-e5a385819e4c tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:57:24.008040 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-65f1f059-e47a-49ce-812a-e5a385819e4c tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:57:24.008040 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-65f1f059-e47a-49ce-812a-e5a385819e4c tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:57:24.008795 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-65f1f059-e47a-49ce-812a-e5a385819e4c tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:57:24.033417 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-65f1f059-e47a-49ce-812a-e5a385819e4c tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:24.033902 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-65f1f059-e47a-49ce-812a-e5a385819e4c tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:24.034706 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-65f1f059-e47a-49ce-812a-e5a385819e4c tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:24.035144 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-65f1f059-e47a-49ce-812a-e5a385819e4c tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:24.080856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-65f1f059-e47a-49ce-812a-e5a385819e4c tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Getting quotas for project 490fa4c8a9404273aa12b641cbd83470. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:57:24.095462 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-65f1f059-e47a-49ce-812a-e5a385819e4c tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Getting quotas for user b580f876ee76475386429eec6cc68189 and project 490fa4c8a9404273aa12b641cbd83470. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:57:24.127699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-65f1f059-e47a-49ce-812a-e5a385819e4c tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:57:24.137342 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-65f1f059-e47a-49ce-812a-e5a385819e4c tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: a20ca8e3-c6c2-4469-bc62-2d14a13e3940] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:57:24.239059 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-65f1f059-e47a-49ce-812a-e5a385819e4c tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.725337 Jul 25 14:57:24.244208 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2689/5626] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:57:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:57:24.246909 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4e85bbc8-ea46-483e-becc-937de0a27c1a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:24.252144 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1e2a4257-4eed-423e-a717-d0f516f00497 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:24.252675 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1e2a4257-4eed-423e-a717-d0f516f00497 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: a20ca8e3-c6c2-4469-bc62-2d14a13e3940] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:24.266148 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4e85bbc8-ea46-483e-becc-937de0a27c1a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 200 len: 1512 microversion: 2.1 time: 0.935175 Jul 25 14:57:24.287314 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2938/5627] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:23 2022] GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 1512 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:57:24.454767 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1e2a4257-4eed-423e-a717-d0f516f00497 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:24.467352 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1e2a4257-4eed-423e-a717-d0f516f00497 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940" status: 200 len: 1214 microversion: 2.1 time: 0.218181 Jul 25 14:57:24.468380 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2690/5628] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:24 2022] GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940 => generated 1214 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:25.312715 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fc07218f-f940-4e53-92b9-20e680f0f1d2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:25.314041 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fc07218f-f940-4e53-92b9-20e680f0f1d2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:25.344270 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fc07218f-f940-4e53-92b9-20e680f0f1d2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:25.345183 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fc07218f-f940-4e53-92b9-20e680f0f1d2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:25.349439 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fc07218f-f940-4e53-92b9-20e680f0f1d2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:25.351169 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fc07218f-f940-4e53-92b9-20e680f0f1d2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:25.492380 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d149e217-726e-4528-a7be-b741df494d35 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:25.492999 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d149e217-726e-4528-a7be-b741df494d35 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: a20ca8e3-c6c2-4469-bc62-2d14a13e3940] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:25.512975 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d149e217-726e-4528-a7be-b741df494d35 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:25.520387 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d149e217-726e-4528-a7be-b741df494d35 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:25.521326 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d149e217-726e-4528-a7be-b741df494d35 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:25.521783 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d149e217-726e-4528-a7be-b741df494d35 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:25.607420 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fc07218f-f940-4e53-92b9-20e680f0f1d2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:25.623558 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d149e217-726e-4528-a7be-b741df494d35 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:25.629652 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fc07218f-f940-4e53-92b9-20e680f0f1d2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 200 len: 1512 microversion: 2.1 time: 0.323459 Jul 25 14:57:25.630772 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2939/5629] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:25 2022] GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 1512 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:25.638590 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d149e217-726e-4528-a7be-b741df494d35 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940" status: 200 len: 1266 microversion: 2.1 time: 0.149343 Jul 25 14:57:25.652004 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2691/5630] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:25 2022] GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:26.653848 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fd6edecc-c0ca-4ce8-824c-d14c93bcb928 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:26.655869 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fd6edecc-c0ca-4ce8-824c-d14c93bcb928 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:26.671263 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-18c30096-bfcb-496a-8b6c-2bd200f3690e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-674300096", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "41af874f-bd06-4a71-827d-6d815f202a2b"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:26.679729 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fd6edecc-c0ca-4ce8-824c-d14c93bcb928 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:26.680688 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fd6edecc-c0ca-4ce8-824c-d14c93bcb928 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:26.681599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:57:26.683768 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fd6edecc-c0ca-4ce8-824c-d14c93bcb928 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:26.684450 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fd6edecc-c0ca-4ce8-824c-d14c93bcb928 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:26.815227 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-18c30096-bfcb-496a-8b6c-2bd200f3690e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] validate_networks() for [('41af874f-bd06-4a71-827d-6d815f202a2b', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:57:27.377713 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fd6edecc-c0ca-4ce8-824c-d14c93bcb928 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:27.386171 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fd6edecc-c0ca-4ce8-824c-d14c93bcb928 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 200 len: 1512 microversion: 2.1 time: 0.736906 Jul 25 14:57:27.387452 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2692/5631] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:26 2022] GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 1512 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:57:27.392661 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-16284eed-7642-4b3c-9485-299d8508a15c tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:27.393474 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-16284eed-7642-4b3c-9485-299d8508a15c tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: a20ca8e3-c6c2-4469-bc62-2d14a13e3940] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:27.400144 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-16284eed-7642-4b3c-9485-299d8508a15c tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:27.400874 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-16284eed-7642-4b3c-9485-299d8508a15c tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:27.401845 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-16284eed-7642-4b3c-9485-299d8508a15c tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:27.402483 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-16284eed-7642-4b3c-9485-299d8508a15c tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:27.729321 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-16284eed-7642-4b3c-9485-299d8508a15c tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:27.738872 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-16284eed-7642-4b3c-9485-299d8508a15c tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940" status: 200 len: 1314 microversion: 2.1 time: 0.350083 Jul 25 14:57:27.739460 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2693/5632] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:27 2022] GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940 => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:27.998904 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-18c30096-bfcb-496a-8b6c-2bd200f3690e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:57:27.999545 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-18c30096-bfcb-496a-8b6c-2bd200f3690e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:57:27.999836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-18c30096-bfcb-496a-8b6c-2bd200f3690e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:57:28.000405 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-18c30096-bfcb-496a-8b6c-2bd200f3690e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:57:28.000911 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-18c30096-bfcb-496a-8b6c-2bd200f3690e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:57:28.020317 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-18c30096-bfcb-496a-8b6c-2bd200f3690e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:28.024414 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-18c30096-bfcb-496a-8b6c-2bd200f3690e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:28.026469 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-18c30096-bfcb-496a-8b6c-2bd200f3690e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:28.027121 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-18c30096-bfcb-496a-8b6c-2bd200f3690e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:28.086711 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-18c30096-bfcb-496a-8b6c-2bd200f3690e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Getting quotas for project 27b0b15d99804beb844e1dc74f2d5776. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:57:28.101774 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-18c30096-bfcb-496a-8b6c-2bd200f3690e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Getting quotas for user a9cb3d7cefcf45b391fb35d61226bbf4 and project 27b0b15d99804beb844e1dc74f2d5776. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:57:28.142763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-18c30096-bfcb-496a-8b6c-2bd200f3690e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:57:28.151252 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-18c30096-bfcb-496a-8b6c-2bd200f3690e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:57:28.299109 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-18c30096-bfcb-496a-8b6c-2bd200f3690e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.748916 Jul 25 14:57:28.299950 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2940/5633] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:57:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 14:57:28.315898 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-349d255c-a58b-4cfb-b306-c687d3e7a8fc tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:28.316855 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-349d255c-a58b-4cfb-b306-c687d3e7a8fc tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:28.399378 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-349d255c-a58b-4cfb-b306-c687d3e7a8fc tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:28.412589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ff74a518-9028-4b77-8d70-00f20f504733 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:28.413204 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ff74a518-9028-4b77-8d70-00f20f504733 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:28.419138 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-349d255c-a58b-4cfb-b306-c687d3e7a8fc tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1216 microversion: 2.1 time: 0.110016 Jul 25 14:57:28.420038 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2694/5634] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:28 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1216 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:28.435457 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff74a518-9028-4b77-8d70-00f20f504733 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:28.436850 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff74a518-9028-4b77-8d70-00f20f504733 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:28.437878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff74a518-9028-4b77-8d70-00f20f504733 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:28.438593 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff74a518-9028-4b77-8d70-00f20f504733 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:28.765933 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ddb403d4-f99c-4fa1-9417-516d02f214f2 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:28.766585 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ddb403d4-f99c-4fa1-9417-516d02f214f2 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: a20ca8e3-c6c2-4469-bc62-2d14a13e3940] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:28.775038 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ddb403d4-f99c-4fa1-9417-516d02f214f2 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:28.775506 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ddb403d4-f99c-4fa1-9417-516d02f214f2 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:28.776397 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ddb403d4-f99c-4fa1-9417-516d02f214f2 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:28.776895 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ddb403d4-f99c-4fa1-9417-516d02f214f2 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:29.031174 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ff74a518-9028-4b77-8d70-00f20f504733 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:29.050092 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ddb403d4-f99c-4fa1-9417-516d02f214f2 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:29.054498 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ff74a518-9028-4b77-8d70-00f20f504733 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 200 len: 1489 microversion: 2.1 time: 0.633960 Jul 25 14:57:29.057775 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2941/5635] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:28 2022] GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 1489 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:29.059804 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ddb403d4-f99c-4fa1-9417-516d02f214f2 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940" status: 200 len: 1314 microversion: 2.1 time: 0.297663 Jul 25 14:57:29.060811 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2695/5636] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:28 2022] GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:29.084498 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3c20f2fe-f5bc-4ea9-8acb-77651293321c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:29.088145 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3c20f2fe-f5bc-4ea9-8acb-77651293321c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:29.095711 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c20f2fe-f5bc-4ea9-8acb-77651293321c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:29.096538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c20f2fe-f5bc-4ea9-8acb-77651293321c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:29.097677 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c20f2fe-f5bc-4ea9-8acb-77651293321c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:29.099394 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c20f2fe-f5bc-4ea9-8acb-77651293321c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:29.155181 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3c20f2fe-f5bc-4ea9-8acb-77651293321c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action" status: 200 len: 170 microversion: 2.1 time: 0.077555 Jul 25 14:57:29.157078 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2696/5637] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:57:29 2022] POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action => generated 170 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:57:29.167092 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e9c15b7a-133b-41a2-b415-926311976fc0 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:29.169043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e9c15b7a-133b-41a2-b415-926311976fc0 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:29.181879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e9c15b7a-133b-41a2-b415-926311976fc0 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:29.183166 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e9c15b7a-133b-41a2-b415-926311976fc0 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:29.184476 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e9c15b7a-133b-41a2-b415-926311976fc0 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:29.185292 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e9c15b7a-133b-41a2-b415-926311976fc0 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:29.448735 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8b79f47d-f27b-43ac-97d0-09c31d6e36f6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:29.453320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8b79f47d-f27b-43ac-97d0-09c31d6e36f6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:29.463324 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b79f47d-f27b-43ac-97d0-09c31d6e36f6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:29.466911 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b79f47d-f27b-43ac-97d0-09c31d6e36f6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:29.467948 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b79f47d-f27b-43ac-97d0-09c31d6e36f6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:29.469597 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b79f47d-f27b-43ac-97d0-09c31d6e36f6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:29.572475 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8b79f47d-f27b-43ac-97d0-09c31d6e36f6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:29.577787 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e9c15b7a-133b-41a2-b415-926311976fc0 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:29.598222 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e9c15b7a-133b-41a2-b415-926311976fc0 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.435777 Jul 25 14:57:29.598640 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8b79f47d-f27b-43ac-97d0-09c31d6e36f6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1268 microversion: 2.1 time: 0.151544 Jul 25 14:57:29.600859 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2697/5639] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:29 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:29.601208 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2942/5639] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:29 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:29.625383 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e4ec9bea-6d6b-4b55-819e-ff927b268804 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:29.626354 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e4ec9bea-6d6b-4b55-819e-ff927b268804 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:29.639730 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e4ec9bea-6d6b-4b55-819e-ff927b268804 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:29.640780 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e4ec9bea-6d6b-4b55-819e-ff927b268804 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:29.641742 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e4ec9bea-6d6b-4b55-819e-ff927b268804 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:29.642285 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e4ec9bea-6d6b-4b55-819e-ff927b268804 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:29.972756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e4ec9bea-6d6b-4b55-819e-ff927b268804 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:29.993839 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e4ec9bea-6d6b-4b55-819e-ff927b268804 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.371291 Jul 25 14:57:29.994388 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2698/5640] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:29 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:57:30.021005 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2d8eb766-ba04-46ed-a0ab-fb4e5b220b35 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:30.025204 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2d8eb766-ba04-46ed-a0ab-fb4e5b220b35 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:30.035817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d8eb766-ba04-46ed-a0ab-fb4e5b220b35 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:30.039645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d8eb766-ba04-46ed-a0ab-fb4e5b220b35 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:30.041187 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d8eb766-ba04-46ed-a0ab-fb4e5b220b35 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:30.042735 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d8eb766-ba04-46ed-a0ab-fb4e5b220b35 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:30.088126 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7cb1c45b-641e-403b-9a3e-53bee3248c16 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:30.088847 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7cb1c45b-641e-403b-9a3e-53bee3248c16 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: a20ca8e3-c6c2-4469-bc62-2d14a13e3940] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:30.100478 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7cb1c45b-641e-403b-9a3e-53bee3248c16 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:30.101460 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7cb1c45b-641e-403b-9a3e-53bee3248c16 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:30.103107 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7cb1c45b-641e-403b-9a3e-53bee3248c16 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:30.105966 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7cb1c45b-641e-403b-9a3e-53bee3248c16 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:30.374644 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7cb1c45b-641e-403b-9a3e-53bee3248c16 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:30.393135 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7cb1c45b-641e-403b-9a3e-53bee3248c16 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940" status: 200 len: 1314 microversion: 2.1 time: 0.305965 Jul 25 14:57:30.395098 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2699/5641] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:30 2022] GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:30.621513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0e18a5e8-8438-4188-b4b7-9789550d505c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:30.622708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0e18a5e8-8438-4188-b4b7-9789550d505c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:30.639317 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e18a5e8-8438-4188-b4b7-9789550d505c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:30.640392 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e18a5e8-8438-4188-b4b7-9789550d505c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:30.642028 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e18a5e8-8438-4188-b4b7-9789550d505c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:30.642571 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e18a5e8-8438-4188-b4b7-9789550d505c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:30.734686 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0e18a5e8-8438-4188-b4b7-9789550d505c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:30.742914 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0e18a5e8-8438-4188-b4b7-9789550d505c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1274 microversion: 2.1 time: 0.125990 Jul 25 14:57:30.746370 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2700/5642] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:30 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1274 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:31.073200 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2d8eb766-ba04-46ed-a0ab-fb4e5b220b35 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:31.088845 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2d8eb766-ba04-46ed-a0ab-fb4e5b220b35 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 1.075873 Jul 25 14:57:31.112857 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0d27dcb3-f99c-4d0a-b4d5-8883cb9261d0 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:31.113636 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0d27dcb3-f99c-4d0a-b4d5-8883cb9261d0 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:31.114263 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2943/5643] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:30 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:31.121567 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0d27dcb3-f99c-4d0a-b4d5-8883cb9261d0 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:31.122287 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0d27dcb3-f99c-4d0a-b4d5-8883cb9261d0 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:31.123394 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0d27dcb3-f99c-4d0a-b4d5-8883cb9261d0 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:31.124000 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0d27dcb3-f99c-4d0a-b4d5-8883cb9261d0 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:31.343177 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0d27dcb3-f99c-4d0a-b4d5-8883cb9261d0 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:31.379865 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0d27dcb3-f99c-4d0a-b4d5-8883cb9261d0 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.261424 Jul 25 14:57:31.380754 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2701/5644] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:31 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:31.413178 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-800e73b2-260e-4ccd-a458-a3c701a719f0 req-212d3b29-405c-4a65-97de-b466cc9f7487 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a20ca8e3-c6c2-4469-bc62-2d14a13e3940", "tag": "363aca14-9247-4680-9d82-36eb6f2e8d60"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:31.423652 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-42e868ea-85e0-4e68-9032-da3fab9e25b1 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:31.431527 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-800e73b2-260e-4ccd-a458-a3c701a719f0 req-212d3b29-405c-4a65-97de-b466cc9f7487 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:31.432242 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-800e73b2-260e-4ccd-a458-a3c701a719f0 req-212d3b29-405c-4a65-97de-b466cc9f7487 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:31.437575 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-42e868ea-85e0-4e68-9032-da3fab9e25b1 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: a20ca8e3-c6c2-4469-bc62-2d14a13e3940] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:31.450448 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-800e73b2-260e-4ccd-a458-a3c701a719f0 req-212d3b29-405c-4a65-97de-b466cc9f7487 service nova] Creating event network-changed:363aca14-9247-4680-9d82-36eb6f2e8d60 for instance a20ca8e3-c6c2-4469-bc62-2d14a13e3940 on n-h2-846435-14 Jul 25 14:57:31.458100 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-800e73b2-260e-4ccd-a458-a3c701a719f0 req-212d3b29-405c-4a65-97de-b466cc9f7487 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058713 Jul 25 14:57:31.459786 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2944/5645] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:57:31.469042 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42e868ea-85e0-4e68-9032-da3fab9e25b1 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:31.470630 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42e868ea-85e0-4e68-9032-da3fab9e25b1 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:31.479853 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42e868ea-85e0-4e68-9032-da3fab9e25b1 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:31.482254 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-42e868ea-85e0-4e68-9032-da3fab9e25b1 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:31.537633 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0ee9c474-1d1a-44d2-943d-c4fe0956b53f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-840291501", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "00285697-02be-4390-bafc-7b88de31480b"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:31.619352 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-0ee9c474-1d1a-44d2-943d-c4fe0956b53f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] validate_networks() for [('00285697-02be-4390-bafc-7b88de31480b', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:57:31.767720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-42e868ea-85e0-4e68-9032-da3fab9e25b1 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:31.778583 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-42e868ea-85e0-4e68-9032-da3fab9e25b1 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940" status: 200 len: 1314 microversion: 2.1 time: 0.367208 Jul 25 14:57:31.800304 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2702/5646] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:31 2022] GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940 => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:31.806993 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cf514f3f-54bc-4ddc-8b0b-50eff113e496 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:31.808673 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cf514f3f-54bc-4ddc-8b0b-50eff113e496 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:31.824976 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf514f3f-54bc-4ddc-8b0b-50eff113e496 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:31.825667 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf514f3f-54bc-4ddc-8b0b-50eff113e496 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:31.826629 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf514f3f-54bc-4ddc-8b0b-50eff113e496 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:31.827214 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf514f3f-54bc-4ddc-8b0b-50eff113e496 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:31.973086 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cf514f3f-54bc-4ddc-8b0b-50eff113e496 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:31.987900 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cf514f3f-54bc-4ddc-8b0b-50eff113e496 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1274 microversion: 2.1 time: 0.185568 Jul 25 14:57:31.988564 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2703/5647] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:31 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1274 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:32.089172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ae7ac8e3-f361-48ef-aaef-2deedeaf8629 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:32.092590 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ae7ac8e3-f361-48ef-aaef-2deedeaf8629 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:32.116969 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae7ac8e3-f361-48ef-aaef-2deedeaf8629 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:32.117915 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae7ac8e3-f361-48ef-aaef-2deedeaf8629 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:32.120694 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae7ac8e3-f361-48ef-aaef-2deedeaf8629 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:32.126175 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae7ac8e3-f361-48ef-aaef-2deedeaf8629 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:32.223337 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ae7ac8e3-f361-48ef-aaef-2deedeaf8629 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "POST /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d/action" status: 200 len: 63129 microversion: 2.1 time: 0.139842 Jul 25 14:57:32.233341 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2704/5648] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:57:32 2022] POST /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d/action => generated 63129 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 14:57:32.800971 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-93f93f05-ae73-42fb-86c8-568e8693375d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:32.802116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-93f93f05-ae73-42fb-86c8-568e8693375d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: a20ca8e3-c6c2-4469-bc62-2d14a13e3940] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:32.817068 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93f93f05-ae73-42fb-86c8-568e8693375d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:32.824437 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93f93f05-ae73-42fb-86c8-568e8693375d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:32.825532 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93f93f05-ae73-42fb-86c8-568e8693375d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:32.826219 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93f93f05-ae73-42fb-86c8-568e8693375d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:33.051904 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-93f93f05-ae73-42fb-86c8-568e8693375d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:33.069096 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-93f93f05-ae73-42fb-86c8-568e8693375d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940" status: 200 len: 1314 microversion: 2.1 time: 0.273226 Jul 25 14:57:33.070069 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2705/5649] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:32 2022] GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:57:33.075679 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b67718ab-c9bc-4a8e-847a-284c820bde7c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:33.076676 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b67718ab-c9bc-4a8e-847a-284c820bde7c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:33.083613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:57:33.087142 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b67718ab-c9bc-4a8e-847a-284c820bde7c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:33.089716 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b67718ab-c9bc-4a8e-847a-284c820bde7c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:33.090835 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b67718ab-c9bc-4a8e-847a-284c820bde7c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:33.091514 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b67718ab-c9bc-4a8e-847a-284c820bde7c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:33.350051 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-0ee9c474-1d1a-44d2-943d-c4fe0956b53f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:57:33.350984 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-0ee9c474-1d1a-44d2-943d-c4fe0956b53f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:57:33.352596 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-0ee9c474-1d1a-44d2-943d-c4fe0956b53f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:57:33.353491 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-0ee9c474-1d1a-44d2-943d-c4fe0956b53f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:57:33.354218 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-0ee9c474-1d1a-44d2-943d-c4fe0956b53f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:57:33.368484 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0ee9c474-1d1a-44d2-943d-c4fe0956b53f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:33.369134 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0ee9c474-1d1a-44d2-943d-c4fe0956b53f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:33.370084 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0ee9c474-1d1a-44d2-943d-c4fe0956b53f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:33.370697 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0ee9c474-1d1a-44d2-943d-c4fe0956b53f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:33.390461 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=89 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:57:33.439885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-0ee9c474-1d1a-44d2-943d-c4fe0956b53f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Getting quotas for project 649465d992d749eca5d73d30e61ab62e. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:57:33.477010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-0ee9c474-1d1a-44d2-943d-c4fe0956b53f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Getting quotas for user 72d5f52dd1ae4cf999f7df131b70223c and project 649465d992d749eca5d73d30e61ab62e. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:57:33.521347 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0ee9c474-1d1a-44d2-943d-c4fe0956b53f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:57:33.522166 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b67718ab-c9bc-4a8e-847a-284c820bde7c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:33.528994 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0ee9c474-1d1a-44d2-943d-c4fe0956b53f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:57:33.535835 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:57:33.540226 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b67718ab-c9bc-4a8e-847a-284c820bde7c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1316 microversion: 2.1 time: 0.468556 Jul 25 14:57:33.540927 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2706/5650] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:33 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1316 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:33.640080 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0ee9c474-1d1a-44d2-943d-c4fe0956b53f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.111234 Jul 25 14:57:33.647436 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2945/5651] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:57:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:57:33.655819 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9d93de92-da89-4e8c-9a15-8be0053dad9e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:33.657104 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9d93de92-da89-4e8c-9a15-8be0053dad9e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:33.898804 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9d93de92-da89-4e8c-9a15-8be0053dad9e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:33.909032 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9d93de92-da89-4e8c-9a15-8be0053dad9e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8" status: 200 len: 1214 microversion: 2.1 time: 0.258584 Jul 25 14:57:33.909667 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2707/5652] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:33 2022] GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8 => generated 1214 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:57:34.094616 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-645239ce-eeb9-4015-9e07-a72ee793be11 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:34.095697 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-645239ce-eeb9-4015-9e07-a72ee793be11 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: a20ca8e3-c6c2-4469-bc62-2d14a13e3940] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:34.108315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-645239ce-eeb9-4015-9e07-a72ee793be11 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:34.110023 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-645239ce-eeb9-4015-9e07-a72ee793be11 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:34.112450 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-645239ce-eeb9-4015-9e07-a72ee793be11 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:34.113223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-645239ce-eeb9-4015-9e07-a72ee793be11 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:34.347081 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-645239ce-eeb9-4015-9e07-a72ee793be11 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:34.360817 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-645239ce-eeb9-4015-9e07-a72ee793be11 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940" status: 200 len: 1314 microversion: 2.1 time: 0.272028 Jul 25 14:57:34.363254 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2946/5653] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:34 2022] GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:34.564945 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f1fd16ca-5730-467a-b9a3-870d2e28fcb5 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:34.574406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f1fd16ca-5730-467a-b9a3-870d2e28fcb5 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:34.581483 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:57:34.600592 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f1fd16ca-5730-467a-b9a3-870d2e28fcb5 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:34.601056 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f1fd16ca-5730-467a-b9a3-870d2e28fcb5 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:34.601854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f1fd16ca-5730-467a-b9a3-870d2e28fcb5 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:34.602291 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f1fd16ca-5730-467a-b9a3-870d2e28fcb5 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:34.929582 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b520fc5f-5896-447d-a693-3c9324e5c615 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:34.930821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b520fc5f-5896-447d-a693-3c9324e5c615 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:34.939167 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b520fc5f-5896-447d-a693-3c9324e5c615 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:34.940010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b520fc5f-5896-447d-a693-3c9324e5c615 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:34.941188 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b520fc5f-5896-447d-a693-3c9324e5c615 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:34.941878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b520fc5f-5896-447d-a693-3c9324e5c615 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:35.015793 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b520fc5f-5896-447d-a693-3c9324e5c615 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:35.027481 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b520fc5f-5896-447d-a693-3c9324e5c615 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8" status: 200 len: 1266 microversion: 2.1 time: 0.101869 Jul 25 14:57:35.028718 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2947/5654] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:34 2022] GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8 => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:35.260132 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f1fd16ca-5730-467a-b9a3-870d2e28fcb5 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:35.270486 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f1fd16ca-5730-467a-b9a3-870d2e28fcb5 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1316 microversion: 2.1 time: 0.710043 Jul 25 14:57:35.273117 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2708/5655] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:34 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1316 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:35.407163 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fa9b6a68-e0b6-4563-9403-d1fd30b6e571 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:35.407915 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fa9b6a68-e0b6-4563-9403-d1fd30b6e571 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: a20ca8e3-c6c2-4469-bc62-2d14a13e3940] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:35.423104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fa9b6a68-e0b6-4563-9403-d1fd30b6e571 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:35.423655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fa9b6a68-e0b6-4563-9403-d1fd30b6e571 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:35.424904 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fa9b6a68-e0b6-4563-9403-d1fd30b6e571 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:35.425450 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fa9b6a68-e0b6-4563-9403-d1fd30b6e571 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:35.593520 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fa9b6a68-e0b6-4563-9403-d1fd30b6e571 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:35.604318 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fa9b6a68-e0b6-4563-9403-d1fd30b6e571 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940" status: 200 len: 1314 microversion: 2.1 time: 0.202896 Jul 25 14:57:35.605776 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2948/5656] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:35 2022] GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:57:36.049858 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8872d3b4-0f81-46e5-adc2-3ce452014686 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:36.051178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8872d3b4-0f81-46e5-adc2-3ce452014686 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:36.059178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8872d3b4-0f81-46e5-adc2-3ce452014686 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:36.059908 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8872d3b4-0f81-46e5-adc2-3ce452014686 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:36.061069 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8872d3b4-0f81-46e5-adc2-3ce452014686 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:36.061734 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8872d3b4-0f81-46e5-adc2-3ce452014686 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:36.151166 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8872d3b4-0f81-46e5-adc2-3ce452014686 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:36.162442 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8872d3b4-0f81-46e5-adc2-3ce452014686 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8" status: 200 len: 1272 microversion: 2.1 time: 0.116431 Jul 25 14:57:36.163739 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2709/5657] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:36 2022] GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8 => generated 1272 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:36.294573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0d41aef6-ce73-409c-97c6-94869fc34f11 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:36.295205 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0d41aef6-ce73-409c-97c6-94869fc34f11 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:36.326104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0d41aef6-ce73-409c-97c6-94869fc34f11 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:36.326560 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0d41aef6-ce73-409c-97c6-94869fc34f11 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:36.327360 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0d41aef6-ce73-409c-97c6-94869fc34f11 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:36.327799 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0d41aef6-ce73-409c-97c6-94869fc34f11 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:36.626415 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6bd54b9a-ae8f-427c-8307-248381d92faf tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:36.627040 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6bd54b9a-ae8f-427c-8307-248381d92faf tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: a20ca8e3-c6c2-4469-bc62-2d14a13e3940] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:36.656864 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6bd54b9a-ae8f-427c-8307-248381d92faf tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:36.657621 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6bd54b9a-ae8f-427c-8307-248381d92faf tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:36.658661 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6bd54b9a-ae8f-427c-8307-248381d92faf tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:36.660945 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6bd54b9a-ae8f-427c-8307-248381d92faf tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:37.316018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0d41aef6-ce73-409c-97c6-94869fc34f11 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:37.328429 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0d41aef6-ce73-409c-97c6-94869fc34f11 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1316 microversion: 2.1 time: 1.037661 Jul 25 14:57:37.332108 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2949/5658] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:36 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1316 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:37.348585 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6c38d46b-7439-44e7-9f54-12765315f683 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:37.351564 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6c38d46b-7439-44e7-9f54-12765315f683 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:37.376074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6c38d46b-7439-44e7-9f54-12765315f683 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:37.376819 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6c38d46b-7439-44e7-9f54-12765315f683 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:37.377671 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6c38d46b-7439-44e7-9f54-12765315f683 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:37.378119 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6c38d46b-7439-44e7-9f54-12765315f683 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:37.716152 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6bd54b9a-ae8f-427c-8307-248381d92faf tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:37.726687 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6bd54b9a-ae8f-427c-8307-248381d92faf tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940" status: 200 len: 1314 microversion: 2.1 time: 1.104697 Jul 25 14:57:37.733156 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2710/5659] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:36 2022] GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940 => generated 1314 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:38.015358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6c38d46b-7439-44e7-9f54-12765315f683 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:38.045584 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6c38d46b-7439-44e7-9f54-12765315f683 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8" status: 200 len: 1314 microversion: 2.1 time: 0.710003 Jul 25 14:57:38.048992 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2950/5660] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:37 2022] GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8 => generated 1314 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:38.150058 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-4c457067-de23-4e53-9461-b660ab245a18 req-cad38825-36f5-4bbf-95bd-004fcf3cb7f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34bbd65c-a1e0-4f6c-a775-8c9f847eccec", "tag": "6bd9c9b1-8f44-48ec-8ace-8bfe7e29920e"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:38.183167 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-4c457067-de23-4e53-9461-b660ab245a18 req-cad38825-36f5-4bbf-95bd-004fcf3cb7f0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:38.186128 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-4c457067-de23-4e53-9461-b660ab245a18 req-cad38825-36f5-4bbf-95bd-004fcf3cb7f0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:38.231485 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-4c457067-de23-4e53-9461-b660ab245a18 req-cad38825-36f5-4bbf-95bd-004fcf3cb7f0 service nova] Creating event network-changed:6bd9c9b1-8f44-48ec-8ace-8bfe7e29920e for instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec on n-h2-846435-14 Jul 25 14:57:38.244148 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-4c457067-de23-4e53-9461-b660ab245a18 req-cad38825-36f5-4bbf-95bd-004fcf3cb7f0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097727 Jul 25 14:57:38.244771 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2711/5661] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:57:38.359162 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-60e888e8-209d-4747-b56d-1b65fa0d3f7d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:38.360936 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-60e888e8-209d-4747-b56d-1b65fa0d3f7d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:38.384121 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60e888e8-209d-4747-b56d-1b65fa0d3f7d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:38.384383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60e888e8-209d-4747-b56d-1b65fa0d3f7d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:38.386293 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60e888e8-209d-4747-b56d-1b65fa0d3f7d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:38.386557 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60e888e8-209d-4747-b56d-1b65fa0d3f7d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:38.872331 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-60e888e8-209d-4747-b56d-1b65fa0d3f7d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:38.884132 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-60e888e8-209d-4747-b56d-1b65fa0d3f7d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1316 microversion: 2.1 time: 0.531490 Jul 25 14:57:38.885201 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2951/5662] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:38 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1316 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:38.892676 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d5882b4f-a705-402f-9e21-52f0e33c3433 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:38.893284 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d5882b4f-a705-402f-9e21-52f0e33c3433 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: a20ca8e3-c6c2-4469-bc62-2d14a13e3940] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:38.906124 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5882b4f-a705-402f-9e21-52f0e33c3433 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:38.915666 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5882b4f-a705-402f-9e21-52f0e33c3433 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:38.916799 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5882b4f-a705-402f-9e21-52f0e33c3433 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:38.917802 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5882b4f-a705-402f-9e21-52f0e33c3433 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:38.931218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fa8381d3-c6d1-463f-951f-5163509d4c19 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:38.933407 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fa8381d3-c6d1-463f-951f-5163509d4c19 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:38.955507 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa8381d3-c6d1-463f-951f-5163509d4c19 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:38.955507 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa8381d3-c6d1-463f-951f-5163509d4c19 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:38.956261 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa8381d3-c6d1-463f-951f-5163509d4c19 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:38.956695 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa8381d3-c6d1-463f-951f-5163509d4c19 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:39.334179 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d5882b4f-a705-402f-9e21-52f0e33c3433 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:39.344247 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d5882b4f-a705-402f-9e21-52f0e33c3433 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940" status: 200 len: 1314 microversion: 2.1 time: 0.455977 Jul 25 14:57:39.345826 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2952/5663] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:38 2022] GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940 => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:39.352246 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-698e76fe-198b-48af-8114-088cc5a72aef tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:39.353044 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-698e76fe-198b-48af-8114-088cc5a72aef tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:39.364280 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-698e76fe-198b-48af-8114-088cc5a72aef tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:39.364984 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-698e76fe-198b-48af-8114-088cc5a72aef tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:39.365745 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-698e76fe-198b-48af-8114-088cc5a72aef tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:39.366188 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-698e76fe-198b-48af-8114-088cc5a72aef tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:39.464563 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fa8381d3-c6d1-463f-951f-5163509d4c19 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1836 microversion: 2.1 time: 0.909004 Jul 25 14:57:39.470132 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2712/5664] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:38 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1836 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:57:39.484135 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-3d606a4f-e82b-4542-85e8-3489b2263ec4 req-739da5ca-02ad-4d44-88b6-7113d4d3bb5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a20ca8e3-c6c2-4469-bc62-2d14a13e3940", "name": "network-vif-plugged", "status": "completed", "tag": "363aca14-9247-4680-9d82-36eb6f2e8d60"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:39.507896 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-3d606a4f-e82b-4542-85e8-3489b2263ec4 req-739da5ca-02ad-4d44-88b6-7113d4d3bb5d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:39.508378 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-3d606a4f-e82b-4542-85e8-3489b2263ec4 req-739da5ca-02ad-4d44-88b6-7113d4d3bb5d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:39.535151 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-3d606a4f-e82b-4542-85e8-3489b2263ec4 req-739da5ca-02ad-4d44-88b6-7113d4d3bb5d service nova] Creating event network-vif-plugged:363aca14-9247-4680-9d82-36eb6f2e8d60 for instance a20ca8e3-c6c2-4469-bc62-2d14a13e3940 on n-h2-846435-14 Jul 25 14:57:39.557248 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-3d606a4f-e82b-4542-85e8-3489b2263ec4 req-739da5ca-02ad-4d44-88b6-7113d4d3bb5d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085703 Jul 25 14:57:39.559363 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2713/5665] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:57:39.582863 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-4ccc3b2c-4cd9-4a3a-b3d3-7bab2527e80d req-ffbf8d2f-5981-49c2-930c-682fd3aaddd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c087d29-02f8-4ba4-b67e-33b4b7ad84c8", "tag": "cf762bd4-1078-44cb-a494-b566822784ae"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:39.616013 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-4ccc3b2c-4cd9-4a3a-b3d3-7bab2527e80d req-ffbf8d2f-5981-49c2-930c-682fd3aaddd1 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:39.616466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-4ccc3b2c-4cd9-4a3a-b3d3-7bab2527e80d req-ffbf8d2f-5981-49c2-930c-682fd3aaddd1 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:39.646933 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-4ccc3b2c-4cd9-4a3a-b3d3-7bab2527e80d req-ffbf8d2f-5981-49c2-930c-682fd3aaddd1 service nova] Creating event network-changed:cf762bd4-1078-44cb-a494-b566822784ae for instance 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8 on n-h1-846435-14 Jul 25 14:57:39.664377 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-4ccc3b2c-4cd9-4a3a-b3d3-7bab2527e80d req-ffbf8d2f-5981-49c2-930c-682fd3aaddd1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101792 Jul 25 14:57:39.665067 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2714/5666] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:57:39.910628 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c94b73ee-4dc2-45ef-ad83-9a7645b63999 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:39.911305 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c94b73ee-4dc2-45ef-ad83-9a7645b63999 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:39.925969 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c94b73ee-4dc2-45ef-ad83-9a7645b63999 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:39.928608 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c94b73ee-4dc2-45ef-ad83-9a7645b63999 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:39.934060 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c94b73ee-4dc2-45ef-ad83-9a7645b63999 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:39.935258 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c94b73ee-4dc2-45ef-ad83-9a7645b63999 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:40.306484 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-698e76fe-198b-48af-8114-088cc5a72aef tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:40.332579 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-698e76fe-198b-48af-8114-088cc5a72aef tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8" status: 200 len: 1314 microversion: 2.1 time: 0.985094 Jul 25 14:57:40.338273 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2953/5667] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:39 2022] GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8 => generated 1314 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:40.402731 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8bb8b91c-b97a-4346-aecf-3bc2ed3aef71 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:40.404139 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8bb8b91c-b97a-4346-aecf-3bc2ed3aef71 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: a20ca8e3-c6c2-4469-bc62-2d14a13e3940] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:40.421808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8bb8b91c-b97a-4346-aecf-3bc2ed3aef71 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:40.422665 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8bb8b91c-b97a-4346-aecf-3bc2ed3aef71 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:40.423637 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8bb8b91c-b97a-4346-aecf-3bc2ed3aef71 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:40.424298 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8bb8b91c-b97a-4346-aecf-3bc2ed3aef71 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:40.659869 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c94b73ee-4dc2-45ef-ad83-9a7645b63999 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:40.673463 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c94b73ee-4dc2-45ef-ad83-9a7645b63999 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1316 microversion: 2.1 time: 0.767313 Jul 25 14:57:40.681296 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2715/5668] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:39 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1316 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:40.878141 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8bb8b91c-b97a-4346-aecf-3bc2ed3aef71 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:40.889993 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8bb8b91c-b97a-4346-aecf-3bc2ed3aef71 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940" status: 200 len: 1314 microversion: 2.1 time: 0.526246 Jul 25 14:57:40.906669 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2954/5669] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:40 2022] GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940 => generated 1314 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:57:41.361185 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7036f35b-5cde-4e53-a4ca-e01cc0535ab7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:41.361813 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7036f35b-5cde-4e53-a4ca-e01cc0535ab7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:41.380645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f18137df-bc48-4482-8033-4068c31d2f7c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:41.380645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f18137df-bc48-4482-8033-4068c31d2f7c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:41.387637 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7036f35b-5cde-4e53-a4ca-e01cc0535ab7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:41.390931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7036f35b-5cde-4e53-a4ca-e01cc0535ab7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:41.393882 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7036f35b-5cde-4e53-a4ca-e01cc0535ab7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:41.396271 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f18137df-bc48-4482-8033-4068c31d2f7c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:41.400463 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7036f35b-5cde-4e53-a4ca-e01cc0535ab7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:41.401859 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f18137df-bc48-4482-8033-4068c31d2f7c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:41.409128 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f18137df-bc48-4482-8033-4068c31d2f7c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:41.412955 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f18137df-bc48-4482-8033-4068c31d2f7c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:41.491288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f18137df-bc48-4482-8033-4068c31d2f7c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:57:41.646342 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f18137df-bc48-4482-8033-4068c31d2f7c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "DELETE /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 204 len: 0 microversion: 2.1 time: 0.271168 Jul 25 14:57:41.657727 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2955/5670] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:57:41 2022] DELETE /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:57:41.677178 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-2cd2fc57-4049-41a5-965d-223bee73a106 req-3f09df2e-f6fa-4108-b8a6-be94d422f45c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d027db2-6df4-4295-a5e1-d8886d34018d", "tag": "6edba24d-b14c-4866-afee-2438b889d8bb"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:41.713670 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-2cd2fc57-4049-41a5-965d-223bee73a106 req-3f09df2e-f6fa-4108-b8a6-be94d422f45c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:41.715501 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-2cd2fc57-4049-41a5-965d-223bee73a106 req-3f09df2e-f6fa-4108-b8a6-be94d422f45c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:41.738004 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-2cd2fc57-4049-41a5-965d-223bee73a106 req-3f09df2e-f6fa-4108-b8a6-be94d422f45c service nova] Creating event network-changed:6edba24d-b14c-4866-afee-2438b889d8bb for instance 4d027db2-6df4-4295-a5e1-d8886d34018d on n-h1-846435-14 Jul 25 14:57:41.744906 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-2cd2fc57-4049-41a5-965d-223bee73a106 req-3f09df2e-f6fa-4108-b8a6-be94d422f45c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084516 Jul 25 14:57:41.746453 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2956/5671] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:57:41.773902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-33fcb20b-998b-42be-a3e1-153f6a7370ad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:41.775019 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-33fcb20b-998b-42be-a3e1-153f6a7370ad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:41.804147 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-33fcb20b-998b-42be-a3e1-153f6a7370ad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:41.804620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-33fcb20b-998b-42be-a3e1-153f6a7370ad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:41.805620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-33fcb20b-998b-42be-a3e1-153f6a7370ad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:41.811848 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-33fcb20b-998b-42be-a3e1-153f6a7370ad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:41.859464 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7036f35b-5cde-4e53-a4ca-e01cc0535ab7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:41.870122 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7036f35b-5cde-4e53-a4ca-e01cc0535ab7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8" status: 200 len: 1314 microversion: 2.1 time: 0.511819 Jul 25 14:57:41.876994 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2716/5672] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:41 2022] GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8 => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:41.895000 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f79083df-5787-4e68-b310-199d961a6106 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:41.896850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f79083df-5787-4e68-b310-199d961a6106 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:41.906176 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f79083df-5787-4e68-b310-199d961a6106 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:41.906695 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f79083df-5787-4e68-b310-199d961a6106 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:41.907496 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f79083df-5787-4e68-b310-199d961a6106 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:41.908140 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f79083df-5787-4e68-b310-199d961a6106 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:42.049931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f79083df-5787-4e68-b310-199d961a6106 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:42.061744 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f79083df-5787-4e68-b310-199d961a6106 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1316 microversion: 2.1 time: 0.182686 Jul 25 14:57:42.062346 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2717/5673] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:41 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1316 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:42.067269 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b71e6cd2-769d-4446-8564-b00c6d5f06a4 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:42.067890 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b71e6cd2-769d-4446-8564-b00c6d5f06a4 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: a20ca8e3-c6c2-4469-bc62-2d14a13e3940] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:42.074267 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b71e6cd2-769d-4446-8564-b00c6d5f06a4 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:42.075018 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b71e6cd2-769d-4446-8564-b00c6d5f06a4 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:42.076040 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b71e6cd2-769d-4446-8564-b00c6d5f06a4 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:42.076804 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b71e6cd2-769d-4446-8564-b00c6d5f06a4 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:42.259590 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-33fcb20b-998b-42be-a3e1-153f6a7370ad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:42.269010 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-33fcb20b-998b-42be-a3e1-153f6a7370ad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1689 microversion: 2.1 time: 0.521089 Jul 25 14:57:42.274350 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2957/5674] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:41 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1689 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:42.293716 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ffe2889c-19f9-453c-a5af-4de601a78134 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:42.294526 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ffe2889c-19f9-453c-a5af-4de601a78134 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] [instance: 90b721e0-9e11-412d-8b3c-ec13558486df] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:42.301430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ffe2889c-19f9-453c-a5af-4de601a78134 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:42.302197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ffe2889c-19f9-453c-a5af-4de601a78134 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:42.303236 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ffe2889c-19f9-453c-a5af-4de601a78134 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:42.303886 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ffe2889c-19f9-453c-a5af-4de601a78134 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:42.304132 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b71e6cd2-769d-4446-8564-b00c6d5f06a4 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:42.312352 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b71e6cd2-769d-4446-8564-b00c6d5f06a4 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940" status: 200 len: 1314 microversion: 2.1 time: 0.248852 Jul 25 14:57:42.313019 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2718/5675] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:42 2022] GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:42.405738 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-ffe2889c-19f9-453c-a5af-4de601a78134 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lazy-loading 'services' on Instance uuid 90b721e0-9e11-412d-8b3c-ec13558486df {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:57:42.511466 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ffe2889c-19f9-453c-a5af-4de601a78134 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] 10.222.0.88 "DELETE /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df/os-volume_attachments/bcc1a094-c722-4a34-918a-750cc3ab43d3" status: 202 len: 0 microversion: 2.1 time: 0.221655 Jul 25 14:57:42.512411 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2958/5676] 10.222.0.88 () {58 vars in 1416 bytes} [Mon Jul 25 14:57:42 2022] DELETE /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df/os-volume_attachments/bcc1a094-c722-4a34-918a-750cc3ab43d3 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:57:42.898346 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e67bbd31-4f39-468c-9e4d-e22b6b4107f6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:42.899950 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e67bbd31-4f39-468c-9e4d-e22b6b4107f6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:42.918165 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e67bbd31-4f39-468c-9e4d-e22b6b4107f6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:42.918626 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e67bbd31-4f39-468c-9e4d-e22b6b4107f6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:42.922969 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e67bbd31-4f39-468c-9e4d-e22b6b4107f6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:42.923944 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e67bbd31-4f39-468c-9e4d-e22b6b4107f6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:43.084106 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f3751be0-a60a-4b24-ab71-9844e1af08e7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:43.084998 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f3751be0-a60a-4b24-ab71-9844e1af08e7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:43.097962 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f3751be0-a60a-4b24-ab71-9844e1af08e7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:43.098649 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f3751be0-a60a-4b24-ab71-9844e1af08e7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:43.099618 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f3751be0-a60a-4b24-ab71-9844e1af08e7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:43.100083 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f3751be0-a60a-4b24-ab71-9844e1af08e7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:43.171819 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e67bbd31-4f39-468c-9e4d-e22b6b4107f6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:43.182650 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e67bbd31-4f39-468c-9e4d-e22b6b4107f6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8" status: 200 len: 1314 microversion: 2.1 time: 0.289019 Jul 25 14:57:43.196291 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2719/5677] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:42 2022] GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:43.295908 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a6c7338c-5b98-4018-9819-c42215e027ca tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:43.297558 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a6c7338c-5b98-4018-9819-c42215e027ca tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:43.314641 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a6c7338c-5b98-4018-9819-c42215e027ca tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:43.315625 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a6c7338c-5b98-4018-9819-c42215e027ca tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:43.316706 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a6c7338c-5b98-4018-9819-c42215e027ca tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:43.317364 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a6c7338c-5b98-4018-9819-c42215e027ca tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:43.383005 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=4 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:57:43.494159 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f3751be0-a60a-4b24-ab71-9844e1af08e7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:43.528019 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=12 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:57:43.535359 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f3751be0-a60a-4b24-ab71-9844e1af08e7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1316 microversion: 2.1 time: 0.455671 Jul 25 14:57:43.537992 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2959/5678] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:43 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1316 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:57:43.544214 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4ac9c7b5-94bf-4418-8c21-1b3167ff7e3d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:43.545232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4ac9c7b5-94bf-4418-8c21-1b3167ff7e3d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: a20ca8e3-c6c2-4469-bc62-2d14a13e3940] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:43.556268 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4ac9c7b5-94bf-4418-8c21-1b3167ff7e3d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:43.557098 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4ac9c7b5-94bf-4418-8c21-1b3167ff7e3d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:43.558075 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4ac9c7b5-94bf-4418-8c21-1b3167ff7e3d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:43.558671 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4ac9c7b5-94bf-4418-8c21-1b3167ff7e3d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:43.907431 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=12 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:57:43.937484 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4ac9c7b5-94bf-4418-8c21-1b3167ff7e3d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:43.944305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:57:43.949737 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4ac9c7b5-94bf-4418-8c21-1b3167ff7e3d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940" status: 200 len: 1497 microversion: 2.1 time: 0.410562 Jul 25 14:57:43.965096 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2960/5679] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:43 2022] GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940 => generated 1497 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:44.206633 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-624efa8e-40ff-448c-8e5e-4ef8d2968e30 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:44.207894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-624efa8e-40ff-448c-8e5e-4ef8d2968e30 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:44.231331 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-624efa8e-40ff-448c-8e5e-4ef8d2968e30 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:44.231794 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-624efa8e-40ff-448c-8e5e-4ef8d2968e30 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:44.235061 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-624efa8e-40ff-448c-8e5e-4ef8d2968e30 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:44.238263 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-624efa8e-40ff-448c-8e5e-4ef8d2968e30 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:44.278514 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a6c7338c-5b98-4018-9819-c42215e027ca tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:44.292447 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a6c7338c-5b98-4018-9819-c42215e027ca tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 200 len: 1689 microversion: 2.1 time: 1.001240 Jul 25 14:57:44.293368 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2720/5680] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:43 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 1689 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:57:44.558855 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b26d4aa9-44a3-4ed3-b7b7-43087f82e252 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:44.559777 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b26d4aa9-44a3-4ed3-b7b7-43087f82e252 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:44.575905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b26d4aa9-44a3-4ed3-b7b7-43087f82e252 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:44.576397 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b26d4aa9-44a3-4ed3-b7b7-43087f82e252 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:44.577191 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b26d4aa9-44a3-4ed3-b7b7-43087f82e252 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:44.577631 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b26d4aa9-44a3-4ed3-b7b7-43087f82e252 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:44.803058 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-624efa8e-40ff-448c-8e5e-4ef8d2968e30 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:44.813011 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-624efa8e-40ff-448c-8e5e-4ef8d2968e30 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8" status: 200 len: 1314 microversion: 2.1 time: 0.611792 Jul 25 14:57:44.826388 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2961/5681] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:44 2022] GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8 => generated 1314 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:44.826388 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-370876bb-4bf4-4d6c-b134-8ac8634a3cbe tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:44.826388 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-370876bb-4bf4-4d6c-b134-8ac8634a3cbe tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: a20ca8e3-c6c2-4469-bc62-2d14a13e3940] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:44.829870 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-370876bb-4bf4-4d6c-b134-8ac8634a3cbe tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:44.830551 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-370876bb-4bf4-4d6c-b134-8ac8634a3cbe tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:44.831333 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-370876bb-4bf4-4d6c-b134-8ac8634a3cbe tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:44.831763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-370876bb-4bf4-4d6c-b134-8ac8634a3cbe tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:44.865898 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-370876bb-4bf4-4d6c-b134-8ac8634a3cbe tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: a20ca8e3-c6c2-4469-bc62-2d14a13e3940] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:57:45.002627 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-370876bb-4bf4-4d6c-b134-8ac8634a3cbe tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940" status: 204 len: 0 microversion: 2.1 time: 0.185613 Jul 25 14:57:45.009157 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2962/5682] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:57:44 2022] DELETE /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:57:45.020433 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-67946c84-06e4-47af-978b-dca115305036 req-9abdd957-9781-4727-af43-7f35ca8bce0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d027db2-6df4-4295-a5e1-d8886d34018d", "name": "network-vif-deleted", "tag": "6edba24d-b14c-4866-afee-2438b889d8bb"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:45.036817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-67946c84-06e4-47af-978b-dca115305036 req-9abdd957-9781-4727-af43-7f35ca8bce0c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:45.037614 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-67946c84-06e4-47af-978b-dca115305036 req-9abdd957-9781-4727-af43-7f35ca8bce0c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:45.058401 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-67946c84-06e4-47af-978b-dca115305036 req-9abdd957-9781-4727-af43-7f35ca8bce0c service nova] Creating event network-vif-deleted:6edba24d-b14c-4866-afee-2438b889d8bb for instance 4d027db2-6df4-4295-a5e1-d8886d34018d on n-h1-846435-14 Jul 25 14:57:45.071887 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-67946c84-06e4-47af-978b-dca115305036 req-9abdd957-9781-4727-af43-7f35ca8bce0c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056680 Jul 25 14:57:45.075593 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2963/5683] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:57:45.086827 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7e3c472b-85bd-4c2c-8933-8aa50751278a tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:45.088316 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7e3c472b-85bd-4c2c-8933-8aa50751278a tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: a20ca8e3-c6c2-4469-bc62-2d14a13e3940] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:45.097597 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7e3c472b-85bd-4c2c-8933-8aa50751278a tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:45.098383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7e3c472b-85bd-4c2c-8933-8aa50751278a tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:45.099570 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7e3c472b-85bd-4c2c-8933-8aa50751278a tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:45.100271 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7e3c472b-85bd-4c2c-8933-8aa50751278a tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:45.366865 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b26d4aa9-44a3-4ed3-b7b7-43087f82e252 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:45.390731 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b26d4aa9-44a3-4ed3-b7b7-43087f82e252 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1316 microversion: 2.1 time: 0.827839 Jul 25 14:57:45.391549 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2721/5684] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:44 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1316 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:45.404726 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-438f90da-f87b-4e5d-81fa-434799b4cb4f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:45.404726 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-438f90da-f87b-4e5d-81fa-434799b4cb4f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4d027db2-6df4-4295-a5e1-d8886d34018d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:45.426914 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-438f90da-f87b-4e5d-81fa-434799b4cb4f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:45.427751 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-438f90da-f87b-4e5d-81fa-434799b4cb4f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:45.430147 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-438f90da-f87b-4e5d-81fa-434799b4cb4f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:45.430879 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-438f90da-f87b-4e5d-81fa-434799b4cb4f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:45.463303 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-438f90da-f87b-4e5d-81fa-434799b4cb4f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] HTTP exception thrown: Instance 4d027db2-6df4-4295-a5e1-d8886d34018d could not be found. Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-438f90da-f87b-4e5d-81fa-434799b4cb4f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Request method failure captured: Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d HTTP/1.1 Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q4DBDAuynnb9b8nJFNNex8XXIdUxDWuP-PEkAZMub_ZUkZMduVSsCJMD66yCrnruIywPy2lvVpDMBFR-BQiaLm_rcOzEza3QKBSQ9Q0j7zyfwq4sXID1DSbTq1QnPsc4nPy2BUSC17V5E20v3AYQkR2U7b_KL_5EYlXpiDz-Ll6u0Y Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 8dd09177faea4702992aaab182125b5a Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-919260591 Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8dd09177faea4702992aaab182125b5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8dd09177faea4702992aaab182125b5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8dd09177faea4702992aaab182125b5a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8dd09177faea4702992aaab182125b5a"}]}] Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-TestNetworkAdvancedServerOps-919260591 Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 8dd09177faea4702992aaab182125b5a Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-919260591 Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-TestNetworkAdvancedServerOps-919260591-project Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: ca46c8e84b8644b69937ec9c06cb0e9a Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-TestNetworkAdvancedServerOps-919260591-project Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 4d027db2-6df4-4295-a5e1-d8886d34018d could not be found. Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '4d027db2-6df4-4295-a5e1-d8886d34018d'} Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d027db2-6df4-4295-a5e1-d8886d34018d could not be found. Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d027db2-6df4-4295-a5e1-d8886d34018d could not be found. Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:57:45.465535 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:57:45.470733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:57:45.470733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:57:45.470733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:57:45.470733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:57:45.470733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:57:45.470733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d027db2-6df4-4295-a5e1-d8886d34018d could not be found. Jul 25 14:57:45.470733 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:57:45.473074 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-438f90da-f87b-4e5d-81fa-434799b4cb4f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Returning 404 to user: Instance 4d027db2-6df4-4295-a5e1-d8886d34018d could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:57:45.474959 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-438f90da-f87b-4e5d-81fa-434799b4cb4f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d" status: 404 len: 111 microversion: 2.1 time: 0.082325 Jul 25 14:57:45.476222 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2722/5685] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:45 2022] GET /compute/v2.1/servers/4d027db2-6df4-4295-a5e1-d8886d34018d => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:57:45.547459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7e3c472b-85bd-4c2c-8933-8aa50751278a tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:45.557417 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7e3c472b-85bd-4c2c-8933-8aa50751278a tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940" status: 200 len: 1503 microversion: 2.1 time: 0.478078 Jul 25 14:57:45.558017 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2964/5686] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:45 2022] GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940 => generated 1503 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:45.617415 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-bae509ac-4f46-4573-ac1e-24dc1fd018b0 req-ee605789-309c-4cc9-92cc-7e8363f87d5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34bbd65c-a1e0-4f6c-a775-8c9f847eccec", "name": "network-vif-plugged", "status": "completed", "tag": "6bd9c9b1-8f44-48ec-8ace-8bfe7e29920e"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:45.633843 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-bae509ac-4f46-4573-ac1e-24dc1fd018b0 req-ee605789-309c-4cc9-92cc-7e8363f87d5e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:45.634517 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-bae509ac-4f46-4573-ac1e-24dc1fd018b0 req-ee605789-309c-4cc9-92cc-7e8363f87d5e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:45.655640 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-bae509ac-4f46-4573-ac1e-24dc1fd018b0 req-ee605789-309c-4cc9-92cc-7e8363f87d5e service nova] Creating event network-vif-plugged:6bd9c9b1-8f44-48ec-8ace-8bfe7e29920e for instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec on n-h2-846435-14 Jul 25 14:57:45.664216 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-bae509ac-4f46-4573-ac1e-24dc1fd018b0 req-ee605789-309c-4cc9-92cc-7e8363f87d5e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051083 Jul 25 14:57:45.665340 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2723/5687] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:57:45.835403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d84bf882-f1d4-47e8-b472-88bca72331f1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:45.835882 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d84bf882-f1d4-47e8-b472-88bca72331f1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:45.859273 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d84bf882-f1d4-47e8-b472-88bca72331f1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:45.860243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d84bf882-f1d4-47e8-b472-88bca72331f1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:45.868102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d84bf882-f1d4-47e8-b472-88bca72331f1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:45.868786 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d84bf882-f1d4-47e8-b472-88bca72331f1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:46.105940 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d84bf882-f1d4-47e8-b472-88bca72331f1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:46.117275 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d84bf882-f1d4-47e8-b472-88bca72331f1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8" status: 200 len: 1314 microversion: 2.1 time: 0.286849 Jul 25 14:57:46.118460 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2965/5688] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:45 2022] GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:46.414034 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-492f16a6-2e4a-44c2-ab8b-a6eaf128d6cd tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:46.415325 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-492f16a6-2e4a-44c2-ab8b-a6eaf128d6cd tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:46.422996 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-492f16a6-2e4a-44c2-ab8b-a6eaf128d6cd tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:46.423705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-492f16a6-2e4a-44c2-ab8b-a6eaf128d6cd tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:46.424725 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-492f16a6-2e4a-44c2-ab8b-a6eaf128d6cd tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:46.427785 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-492f16a6-2e4a-44c2-ab8b-a6eaf128d6cd tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:46.583506 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b7348c46-a54f-4b74-816c-9840693ba108 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:46.583779 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b7348c46-a54f-4b74-816c-9840693ba108 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: a20ca8e3-c6c2-4469-bc62-2d14a13e3940] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:46.596473 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b7348c46-a54f-4b74-816c-9840693ba108 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:46.602925 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b7348c46-a54f-4b74-816c-9840693ba108 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:46.604353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b7348c46-a54f-4b74-816c-9840693ba108 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:46.604965 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b7348c46-a54f-4b74-816c-9840693ba108 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:46.751784 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-492f16a6-2e4a-44c2-ab8b-a6eaf128d6cd tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:46.762390 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-492f16a6-2e4a-44c2-ab8b-a6eaf128d6cd tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1316 microversion: 2.1 time: 0.353653 Jul 25 14:57:46.776437 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2724/5689] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:46 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1316 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:46.918899 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b7348c46-a54f-4b74-816c-9840693ba108 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:46.927368 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b7348c46-a54f-4b74-816c-9840693ba108 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940" status: 200 len: 1503 microversion: 2.1 time: 0.348419 Jul 25 14:57:46.927961 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2966/5690] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:46 2022] GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940 => generated 1503 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:57:47.139128 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-65450630-759f-4019-a906-53a3a4bace75 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:47.140297 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-65450630-759f-4019-a906-53a3a4bace75 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:47.148009 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-65450630-759f-4019-a906-53a3a4bace75 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:47.149481 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-65450630-759f-4019-a906-53a3a4bace75 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:47.152616 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-65450630-759f-4019-a906-53a3a4bace75 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:47.153333 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-65450630-759f-4019-a906-53a3a4bace75 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:47.482856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-65450630-759f-4019-a906-53a3a4bace75 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:47.492878 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-65450630-759f-4019-a906-53a3a4bace75 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8" status: 200 len: 1314 microversion: 2.1 time: 0.357938 Jul 25 14:57:47.508080 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2725/5691] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:47 2022] GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8 => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:47.695723 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-a5d9bc36-f4a4-4a0b-9a10-05f37c49e8d4 req-50621120-2324-4371-8866-e00bf97a1e92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c087d29-02f8-4ba4-b67e-33b4b7ad84c8", "name": "network-vif-plugged", "status": "completed", "tag": "cf762bd4-1078-44cb-a494-b566822784ae"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:47.727655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a5d9bc36-f4a4-4a0b-9a10-05f37c49e8d4 req-50621120-2324-4371-8866-e00bf97a1e92 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:47.731079 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a5d9bc36-f4a4-4a0b-9a10-05f37c49e8d4 req-50621120-2324-4371-8866-e00bf97a1e92 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:47.760936 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-a5d9bc36-f4a4-4a0b-9a10-05f37c49e8d4 req-50621120-2324-4371-8866-e00bf97a1e92 service nova] Creating event network-vif-plugged:cf762bd4-1078-44cb-a494-b566822784ae for instance 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8 on n-h1-846435-14 Jul 25 14:57:47.779069 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-a5d9bc36-f4a4-4a0b-9a10-05f37c49e8d4 req-50621120-2324-4371-8866-e00bf97a1e92 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087501 Jul 25 14:57:47.785196 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a73864d5-9cc2-49e0-a301-befb67642460 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:47.786018 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a73864d5-9cc2-49e0-a301-befb67642460 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:47.792992 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2967/5692] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:57:47.803774 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a73864d5-9cc2-49e0-a301-befb67642460 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:47.806455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a73864d5-9cc2-49e0-a301-befb67642460 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:47.808715 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a73864d5-9cc2-49e0-a301-befb67642460 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:47.809356 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a73864d5-9cc2-49e0-a301-befb67642460 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:47.951725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-77ac5471-8121-421d-8518-e1454481183f tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:47.952559 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-77ac5471-8121-421d-8518-e1454481183f tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: a20ca8e3-c6c2-4469-bc62-2d14a13e3940] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:47.964900 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-77ac5471-8121-421d-8518-e1454481183f tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:47.965209 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-77ac5471-8121-421d-8518-e1454481183f tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:47.969591 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-77ac5471-8121-421d-8518-e1454481183f tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:47.970047 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-77ac5471-8121-421d-8518-e1454481183f tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:48.659345 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a73864d5-9cc2-49e0-a301-befb67642460 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:48.670767 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a73864d5-9cc2-49e0-a301-befb67642460 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.889861 Jul 25 14:57:48.672477 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2726/5693] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:47 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:57:48.683121 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-93df61f4-79dc-4cb8-9226-818a509be1ab tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:48.685283 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-93df61f4-79dc-4cb8-9226-818a509be1ab tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:48.694358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-77ac5471-8121-421d-8518-e1454481183f tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:48.696396 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93df61f4-79dc-4cb8-9226-818a509be1ab tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:48.697118 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93df61f4-79dc-4cb8-9226-818a509be1ab tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:48.698628 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93df61f4-79dc-4cb8-9226-818a509be1ab tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:48.716946 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-77ac5471-8121-421d-8518-e1454481183f tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940" status: 200 len: 1503 microversion: 2.1 time: 0.759775 Jul 25 14:57:48.717438 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93df61f4-79dc-4cb8-9226-818a509be1ab tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:48.720786 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2968/5694] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:47 2022] GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940 => generated 1503 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:57:48.779024 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-85107666-8c2e-47e9-bd0d-82c5358a9a6f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-180902692", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "41af874f-bd06-4a71-827d-6d815f202a2b"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:48.844310 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-85107666-8c2e-47e9-bd0d-82c5358a9a6f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] validate_networks() for [('41af874f-bd06-4a71-827d-6d815f202a2b', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:57:49.076988 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-93df61f4-79dc-4cb8-9226-818a509be1ab tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:49.127719 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:57:49.166441 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-93df61f4-79dc-4cb8-9226-818a509be1ab tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8" status: 200 len: 1314 microversion: 2.1 time: 0.472930 Jul 25 14:57:49.169314 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2727/5695] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:48 2022] GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8 => generated 1314 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:49.203759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-51078dfb-c624-4f80-acf6-6c98753ef947 req-53b43c71-22ac-49e5-a3b1-25a9867a91fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a20ca8e3-c6c2-4469-bc62-2d14a13e3940", "name": "network-vif-deleted", "tag": "363aca14-9247-4680-9d82-36eb6f2e8d60"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:49.229713 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-51078dfb-c624-4f80-acf6-6c98753ef947 req-53b43c71-22ac-49e5-a3b1-25a9867a91fc service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:49.232986 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-51078dfb-c624-4f80-acf6-6c98753ef947 req-53b43c71-22ac-49e5-a3b1-25a9867a91fc service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:49.268143 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-51078dfb-c624-4f80-acf6-6c98753ef947 req-53b43c71-22ac-49e5-a3b1-25a9867a91fc service nova] Creating event network-vif-deleted:363aca14-9247-4680-9d82-36eb6f2e8d60 for instance a20ca8e3-c6c2-4469-bc62-2d14a13e3940 on n-h2-846435-14 Jul 25 14:57:49.278743 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-51078dfb-c624-4f80-acf6-6c98753ef947 req-53b43c71-22ac-49e5-a3b1-25a9867a91fc service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085485 Jul 25 14:57:49.279774 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2728/5696] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:57:49.744853 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e4bd1333-b25d-441d-98e5-5bb5601614f8 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:49.747014 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e4bd1333-b25d-441d-98e5-5bb5601614f8 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: a20ca8e3-c6c2-4469-bc62-2d14a13e3940] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:49.772034 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e4bd1333-b25d-441d-98e5-5bb5601614f8 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:49.772513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e4bd1333-b25d-441d-98e5-5bb5601614f8 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:49.773303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e4bd1333-b25d-441d-98e5-5bb5601614f8 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:49.779240 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e4bd1333-b25d-441d-98e5-5bb5601614f8 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:49.854336 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-e4bd1333-b25d-441d-98e5-5bb5601614f8 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] HTTP exception thrown: Instance a20ca8e3-c6c2-4469-bc62-2d14a13e3940 could not be found. Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e4bd1333-b25d-441d-98e5-5bb5601614f8 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Request method failure captured: Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940 HTTP/1.1 Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q9PMNvvNsRtYwjedUqFtMuGik5loz_4iw7X_PLGDvnuDWT4usVMbbe9-YqTU7DCqv00a6JLa3Z3FKqjIm2NUvbEVw4TbWcHPr1Ig0gYUr1nEomUH8rZyoIweGM_ORCE3ReDzQ2fP96RtnnaDl7ij-W8aDXGmm6bPvyEv2zF2uYamLA Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 490fa4c8a9404273aa12b641cbd83470 Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-VolumesActionsTest-1991525498 Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/490fa4c8a9404273aa12b641cbd83470"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/490fa4c8a9404273aa12b641cbd83470"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_490fa4c8a9404273aa12b641cbd83470", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/490fa4c8a9404273aa12b641cbd83470"}]}] Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-VolumesActionsTest-1991525498 Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 490fa4c8a9404273aa12b641cbd83470 Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-VolumesActionsTest-1991525498 Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-VolumesActionsTest-1991525498-project Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: b580f876ee76475386429eec6cc68189 Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-VolumesActionsTest-1991525498-project Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance a20ca8e3-c6c2-4469-bc62-2d14a13e3940 could not be found. Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'a20ca8e3-c6c2-4469-bc62-2d14a13e3940'} Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a20ca8e3-c6c2-4469-bc62-2d14a13e3940 could not be found. Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a20ca8e3-c6c2-4469-bc62-2d14a13e3940 could not be found. Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:57:49.857387 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:57:49.862784 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:57:49.862784 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:57:49.862784 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:57:49.862784 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:57:49.862784 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:57:49.862784 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a20ca8e3-c6c2-4469-bc62-2d14a13e3940 could not be found. Jul 25 14:57:49.862784 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:57:49.870701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e4bd1333-b25d-441d-98e5-5bb5601614f8 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Returning 404 to user: Instance a20ca8e3-c6c2-4469-bc62-2d14a13e3940 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:57:49.871590 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e4bd1333-b25d-441d-98e5-5bb5601614f8 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940" status: 404 len: 111 microversion: 2.1 time: 0.134377 Jul 25 14:57:49.872232 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2729/5697] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:49 2022] GET /compute/v2.1/servers/a20ca8e3-c6c2-4469-bc62-2d14a13e3940 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:57:49.952213 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e6fba5e6-4bf4-4845-8afd-b71fd7ca1db0 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-946169511", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "89ff8548-ceb2-4707-9470-548d70a981a2"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:50.026169 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-e6fba5e6-4bf4-4845-8afd-b71fd7ca1db0 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] validate_networks() for [('89ff8548-ceb2-4707-9470-548d70a981a2', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:57:50.251574 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-85107666-8c2e-47e9-bd0d-82c5358a9a6f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:57:50.252291 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-85107666-8c2e-47e9-bd0d-82c5358a9a6f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:57:50.252687 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-85107666-8c2e-47e9-bd0d-82c5358a9a6f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:57:50.253094 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-85107666-8c2e-47e9-bd0d-82c5358a9a6f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:57:50.253506 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-85107666-8c2e-47e9-bd0d-82c5358a9a6f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:57:50.256173 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:57:50.276690 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-85107666-8c2e-47e9-bd0d-82c5358a9a6f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:50.277139 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-85107666-8c2e-47e9-bd0d-82c5358a9a6f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:50.281794 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-85107666-8c2e-47e9-bd0d-82c5358a9a6f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:50.282263 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-85107666-8c2e-47e9-bd0d-82c5358a9a6f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:50.331290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-85107666-8c2e-47e9-bd0d-82c5358a9a6f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Getting quotas for project 27b0b15d99804beb844e1dc74f2d5776. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:57:50.339427 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-85107666-8c2e-47e9-bd0d-82c5358a9a6f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Getting quotas for user a9cb3d7cefcf45b391fb35d61226bbf4 and project 27b0b15d99804beb844e1dc74f2d5776. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:57:50.354245 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-85107666-8c2e-47e9-bd0d-82c5358a9a6f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:57:50.356712 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-85107666-8c2e-47e9-bd0d-82c5358a9a6f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 667424b9-7b86-4204-9272-afd7ac83ff5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:57:50.418132 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-85107666-8c2e-47e9-bd0d-82c5358a9a6f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.643158 Jul 25 14:57:50.419543 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2969/5698] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:57:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 14:57:50.434733 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-42e5864b-a90e-4f85-a4c2-5d9088784506 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:50.436071 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-42e5864b-a90e-4f85-a4c2-5d9088784506 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:50.451196 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-42e5864b-a90e-4f85-a4c2-5d9088784506 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:50.452823 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-42e5864b-a90e-4f85-a4c2-5d9088784506 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:50.454239 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-42e5864b-a90e-4f85-a4c2-5d9088784506 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:50.455018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-42e5864b-a90e-4f85-a4c2-5d9088784506 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:50.622710 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-42e5864b-a90e-4f85-a4c2-5d9088784506 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:50.631386 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-42e5864b-a90e-4f85-a4c2-5d9088784506 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8" status: 200 len: 1502 microversion: 2.1 time: 0.210433 Jul 25 14:57:50.632147 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2970/5699] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:50 2022] GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8 => generated 1502 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:50.653266 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-26685d5b-98af-4dec-b5b4-8eaf88d5ed2d tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:50.653849 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-26685d5b-98af-4dec-b5b4-8eaf88d5ed2d tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] [instance: 90b721e0-9e11-412d-8b3c-ec13558486df] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:50.660847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26685d5b-98af-4dec-b5b4-8eaf88d5ed2d tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:50.661277 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26685d5b-98af-4dec-b5b4-8eaf88d5ed2d tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:50.662037 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26685d5b-98af-4dec-b5b4-8eaf88d5ed2d tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:50.662462 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26685d5b-98af-4dec-b5b4-8eaf88d5ed2d tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:50.695650 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-26685d5b-98af-4dec-b5b4-8eaf88d5ed2d tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] [instance: 90b721e0-9e11-412d-8b3c-ec13558486df] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:57:50.897878 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-26685d5b-98af-4dec-b5b4-8eaf88d5ed2d tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] 10.222.0.88 "DELETE /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df" status: 204 len: 0 microversion: 2.1 time: 0.250576 Jul 25 14:57:50.900045 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2971/5700] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:57:50 2022] DELETE /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:57:50.910034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0a158dbb-6c00-4c40-a21d-8619da0b8f42 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:50.910973 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0a158dbb-6c00-4c40-a21d-8619da0b8f42 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 667424b9-7b86-4204-9272-afd7ac83ff5e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:50.969655 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-e6fba5e6-4bf4-4845-8afd-b71fd7ca1db0 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:57:50.972476 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-e6fba5e6-4bf4-4845-8afd-b71fd7ca1db0 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:57:50.973470 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-e6fba5e6-4bf4-4845-8afd-b71fd7ca1db0 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:57:50.975011 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-e6fba5e6-4bf4-4845-8afd-b71fd7ca1db0 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:57:50.975801 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-e6fba5e6-4bf4-4845-8afd-b71fd7ca1db0 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:57:50.976438 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0a158dbb-6c00-4c40-a21d-8619da0b8f42 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:50.988036 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0a158dbb-6c00-4c40-a21d-8619da0b8f42 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e" status: 200 len: 1216 microversion: 2.1 time: 0.085973 Jul 25 14:57:50.988758 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2972/5701] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:50 2022] GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e => generated 1216 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:51.003013 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d1cfdf95-61b2-49b4-891b-7c32c466ff5e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:51.012263 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d1cfdf95-61b2-49b4-891b-7c32c466ff5e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:51.016087 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e6fba5e6-4bf4-4845-8afd-b71fd7ca1db0 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:51.016963 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e6fba5e6-4bf4-4845-8afd-b71fd7ca1db0 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:51.018409 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e6fba5e6-4bf4-4845-8afd-b71fd7ca1db0 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:51.019299 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e6fba5e6-4bf4-4845-8afd-b71fd7ca1db0 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:51.029802 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1cfdf95-61b2-49b4-891b-7c32c466ff5e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:51.031534 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1cfdf95-61b2-49b4-891b-7c32c466ff5e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:51.035207 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1cfdf95-61b2-49b4-891b-7c32c466ff5e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:51.036548 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1cfdf95-61b2-49b4-891b-7c32c466ff5e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:51.077526 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-e6fba5e6-4bf4-4845-8afd-b71fd7ca1db0 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Getting quotas for project 490fa4c8a9404273aa12b641cbd83470. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:57:51.090032 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-e6fba5e6-4bf4-4845-8afd-b71fd7ca1db0 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Getting quotas for user b580f876ee76475386429eec6cc68189 and project 490fa4c8a9404273aa12b641cbd83470. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:57:51.126578 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e6fba5e6-4bf4-4845-8afd-b71fd7ca1db0 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:57:51.136737 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e6fba5e6-4bf4-4845-8afd-b71fd7ca1db0 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: 40d6fea7-fbd6-49fe-b08a-98e61f3485cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:57:51.202345 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e6fba5e6-4bf4-4845-8afd-b71fd7ca1db0 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.255381 Jul 25 14:57:51.214758 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2730/5702] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:57:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1269 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 14:57:51.220577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-99ea1493-f05e-4584-8ab3-6e6827e3ddf1 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:51.221890 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-99ea1493-f05e-4584-8ab3-6e6827e3ddf1 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] [instance: 90b721e0-9e11-412d-8b3c-ec13558486df] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:51.229513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99ea1493-f05e-4584-8ab3-6e6827e3ddf1 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:51.230239 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99ea1493-f05e-4584-8ab3-6e6827e3ddf1 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:51.232530 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99ea1493-f05e-4584-8ab3-6e6827e3ddf1 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:51.233184 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99ea1493-f05e-4584-8ab3-6e6827e3ddf1 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:51.672416 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-99ea1493-f05e-4584-8ab3-6e6827e3ddf1 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db7c1475dda40b7bac6e1c11bb08ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea69016f034f4a8ca1774789b71100f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:51.688854 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-99ea1493-f05e-4584-8ab3-6e6827e3ddf1 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] 10.222.0.88 "GET /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df" status: 200 len: 1468 microversion: 2.1 time: 0.472509 Jul 25 14:57:51.709806 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2731/5703] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:51 2022] GET /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df => generated 1468 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:51.719348 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7331e163-bb23-47d8-8435-9279cae2e7a9 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:51.720306 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7331e163-bb23-47d8-8435-9279cae2e7a9 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: 40d6fea7-fbd6-49fe-b08a-98e61f3485cb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:51.867944 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7331e163-bb23-47d8-8435-9279cae2e7a9 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:51.916552 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7331e163-bb23-47d8-8435-9279cae2e7a9 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb" status: 200 len: 1213 microversion: 2.1 time: 0.204914 Jul 25 14:57:51.917636 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2732/5704] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:51 2022] GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb => generated 1213 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:52.009496 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9779ab8f-7514-4ceb-96d9-0ef99fec3249 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:52.010822 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9779ab8f-7514-4ceb-96d9-0ef99fec3249 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 667424b9-7b86-4204-9272-afd7ac83ff5e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:52.027594 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9779ab8f-7514-4ceb-96d9-0ef99fec3249 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:52.028288 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9779ab8f-7514-4ceb-96d9-0ef99fec3249 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:52.029447 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9779ab8f-7514-4ceb-96d9-0ef99fec3249 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:52.030162 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9779ab8f-7514-4ceb-96d9-0ef99fec3249 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:52.181876 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9779ab8f-7514-4ceb-96d9-0ef99fec3249 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:52.194196 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9779ab8f-7514-4ceb-96d9-0ef99fec3249 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e" status: 200 len: 1276 microversion: 2.1 time: 0.188699 Jul 25 14:57:52.195826 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2733/5705] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:52 2022] GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e => generated 1276 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:52.280278 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d1cfdf95-61b2-49b4-891b-7c32c466ff5e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8/action" status: 200 len: 14 microversion: 2.1 time: 1.290087 Jul 25 14:57:52.282069 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2973/5706] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:57:50 2022] POST /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8/action => generated 14 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:57:52.718280 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ed6a8813-8301-4fcf-91b2-a2b118d96a63 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:52.720954 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ed6a8813-8301-4fcf-91b2-a2b118d96a63 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] [instance: 90b721e0-9e11-412d-8b3c-ec13558486df] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:52.746010 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ed6a8813-8301-4fcf-91b2-a2b118d96a63 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:52.747658 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ed6a8813-8301-4fcf-91b2-a2b118d96a63 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:52.750922 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ed6a8813-8301-4fcf-91b2-a2b118d96a63 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:52.758351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ed6a8813-8301-4fcf-91b2-a2b118d96a63 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:52.938204 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6fecea51-7d46-4eb5-9e80-b1fa05063539 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:52.939170 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6fecea51-7d46-4eb5-9e80-b1fa05063539 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: 40d6fea7-fbd6-49fe-b08a-98e61f3485cb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:52.957039 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6fecea51-7d46-4eb5-9e80-b1fa05063539 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:52.957521 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6fecea51-7d46-4eb5-9e80-b1fa05063539 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:52.958691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6fecea51-7d46-4eb5-9e80-b1fa05063539 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:52.959342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6fecea51-7d46-4eb5-9e80-b1fa05063539 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:53.134244 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6fecea51-7d46-4eb5-9e80-b1fa05063539 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:53.180730 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6fecea51-7d46-4eb5-9e80-b1fa05063539 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb" status: 200 len: 1283 microversion: 2.1 time: 0.246863 Jul 25 14:57:53.186149 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2974/5707] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:52 2022] GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb => generated 1283 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:53.216892 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-45214a92-7147-4d6a-8d5c-d11c0469feac tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:53.218488 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-45214a92-7147-4d6a-8d5c-d11c0469feac tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 667424b9-7b86-4204-9272-afd7ac83ff5e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:53.227469 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45214a92-7147-4d6a-8d5c-d11c0469feac tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:53.228373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45214a92-7147-4d6a-8d5c-d11c0469feac tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:53.229810 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45214a92-7147-4d6a-8d5c-d11c0469feac tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:53.230498 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45214a92-7147-4d6a-8d5c-d11c0469feac tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:53.259865 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ed6a8813-8301-4fcf-91b2-a2b118d96a63 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db7c1475dda40b7bac6e1c11bb08ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea69016f034f4a8ca1774789b71100f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:53.270409 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ed6a8813-8301-4fcf-91b2-a2b118d96a63 tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] 10.222.0.88 "GET /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df" status: 200 len: 1468 microversion: 2.1 time: 0.561625 Jul 25 14:57:53.276251 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2734/5708] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:52 2022] GET /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df => generated 1468 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:53.294074 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2c9b9c23-aff5-4355-b5b1-8986e08763eb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:53.297137 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2c9b9c23-aff5-4355-b5b1-8986e08763eb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:53.319191 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c9b9c23-aff5-4355-b5b1-8986e08763eb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:53.319761 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c9b9c23-aff5-4355-b5b1-8986e08763eb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:53.320989 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c9b9c23-aff5-4355-b5b1-8986e08763eb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:53.321924 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c9b9c23-aff5-4355-b5b1-8986e08763eb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:53.387174 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2c9b9c23-aff5-4355-b5b1-8986e08763eb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8/action" status: 200 len: 14 microversion: 2.1 time: 0.097615 Jul 25 14:57:53.392569 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2735/5709] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:57:53 2022] POST /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 14:57:53.397004 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e94093a9-987e-4256-852e-f58a5993fb0d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '.version_select at 0x7f4686570790>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:53.409320 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-45214a92-7147-4d6a-8d5c-d11c0469feac tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:53.419157 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-45214a92-7147-4d6a-8d5c-d11c0469feac tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e" status: 200 len: 1274 microversion: 2.1 time: 0.207063 Jul 25 14:57:53.429638 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e94093a9-987e-4256-852e-f58a5993fb0d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-827472442" status: 202 len: 0 microversion: 2.1 time: 0.040055 Jul 25 14:57:53.430392 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2736/5710] 10.222.0.88 () {58 vars in 1281 bytes} [Mon Jul 25 14:57:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-827472442 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:57:53.433011 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2975/5711] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:53 2022] GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e => generated 1274 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:53.476587 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-08702732-b30a-455a-8d78-0390544cf3b2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Action: 'create', calling method: .version_select at 0x7f4686848ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1430484760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2LElpsa2LgH91i0/gHx+lX6ujv3MvfoPdfEa27VQZxDYhbipVdVOEQdYnfyUS55WMWxRgD/Fu3Dug/sxYjygs6lBLBRfqaOoZ8BoXEGIXdIaxhi3+AoZrTFTsDWbMe1A=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:53.511207 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-08702732-b30a-455a-8d78-0390544cf3b2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Getting quotas for project 8dd09177faea4702992aaab182125b5a. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:57:53.518507 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-08702732-b30a-455a-8d78-0390544cf3b2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Getting quotas for user ca46c8e84b8644b69937ec9c06cb0e9a and project 8dd09177faea4702992aaab182125b5a. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:57:53.553253 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-08702732-b30a-455a-8d78-0390544cf3b2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.080779 Jul 25 14:57:53.555158 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2737/5712] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:57:53 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:57:54.205846 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0a7caeb1-c55a-4747-bbf2-b975c16fc8b0 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:54.206559 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0a7caeb1-c55a-4747-bbf2-b975c16fc8b0 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: 40d6fea7-fbd6-49fe-b08a-98e61f3485cb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:54.214147 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0a7caeb1-c55a-4747-bbf2-b975c16fc8b0 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:54.215027 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0a7caeb1-c55a-4747-bbf2-b975c16fc8b0 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:54.216082 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0a7caeb1-c55a-4747-bbf2-b975c16fc8b0 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:54.216715 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0a7caeb1-c55a-4747-bbf2-b975c16fc8b0 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:54.234118 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-bfd64c4a-4457-4a5a-bea7-d9c706f18193 req-c7d115dc-1cc8-4252-b5dc-c26bcbedf600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90b721e0-9e11-412d-8b3c-ec13558486df", "name": "network-vif-deleted", "tag": "69cf11be-45e6-47af-b464-7b7cfd9b0e94"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:54.276240 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-bfd64c4a-4457-4a5a-bea7-d9c706f18193 req-c7d115dc-1cc8-4252-b5dc-c26bcbedf600 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:54.276799 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-bfd64c4a-4457-4a5a-bea7-d9c706f18193 req-c7d115dc-1cc8-4252-b5dc-c26bcbedf600 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:54.312844 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-bfd64c4a-4457-4a5a-bea7-d9c706f18193 req-c7d115dc-1cc8-4252-b5dc-c26bcbedf600 service nova] Creating event network-vif-deleted:69cf11be-45e6-47af-b464-7b7cfd9b0e94 for instance 90b721e0-9e11-412d-8b3c-ec13558486df on n-h1-846435-14 Jul 25 14:57:54.339687 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-bfd64c4a-4457-4a5a-bea7-d9c706f18193 req-c7d115dc-1cc8-4252-b5dc-c26bcbedf600 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111040 Jul 25 14:57:54.344737 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2738/5713] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:57:54.358250 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1d08a510-c244-466e-b7d2-af449633a72c tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:54.359075 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1d08a510-c244-466e-b7d2-af449633a72c tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] [instance: 90b721e0-9e11-412d-8b3c-ec13558486df] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:54.373965 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d08a510-c244-466e-b7d2-af449633a72c tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:54.374447 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d08a510-c244-466e-b7d2-af449633a72c tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:54.375313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d08a510-c244-466e-b7d2-af449633a72c tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:54.375760 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d08a510-c244-466e-b7d2-af449633a72c tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:54.433712 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d08a510-c244-466e-b7d2-af449633a72c tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:54.435842 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d08a510-c244-466e-b7d2-af449633a72c tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:54.435842 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-1d08a510-c244-466e-b7d2-af449633a72c tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lazy-loading 'fault' on Instance uuid 90b721e0-9e11-412d-8b3c-ec13558486df {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:57:54.454064 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0a7caeb1-c55a-4747-bbf2-b975c16fc8b0 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:54.468434 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0a7caeb1-c55a-4747-bbf2-b975c16fc8b0 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb" status: 200 len: 1271 microversion: 2.1 time: 0.266328 Jul 25 14:57:54.469422 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2976/5714] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:54 2022] GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb => generated 1271 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:54.477406 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9965a7ce-7052-44b1-88b5-823b9bf2f65f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:54.480085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9965a7ce-7052-44b1-88b5-823b9bf2f65f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:54.488284 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9965a7ce-7052-44b1-88b5-823b9bf2f65f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:54.489021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9965a7ce-7052-44b1-88b5-823b9bf2f65f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:54.490167 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9965a7ce-7052-44b1-88b5-823b9bf2f65f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:54.490824 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9965a7ce-7052-44b1-88b5-823b9bf2f65f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:54.516246 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:57:54.550355 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1d08a510-c244-466e-b7d2-af449633a72c tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db7c1475dda40b7bac6e1c11bb08ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea69016f034f4a8ca1774789b71100f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:54.562631 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1d08a510-c244-466e-b7d2-af449633a72c tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] 10.222.0.88 "GET /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df" status: 200 len: 1303 microversion: 2.1 time: 0.216252 Jul 25 14:57:54.574509 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2739/5715] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:54 2022] GET /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df => generated 1303 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:54.583621 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-114a6229-5244-4a89-a0ff-a3fb24da329c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:54.585230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-114a6229-5244-4a89-a0ff-a3fb24da329c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 667424b9-7b86-4204-9272-afd7ac83ff5e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:54.589355 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:57:54.599190 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-114a6229-5244-4a89-a0ff-a3fb24da329c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:54.599854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-114a6229-5244-4a89-a0ff-a3fb24da329c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:54.601257 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-114a6229-5244-4a89-a0ff-a3fb24da329c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:54.601890 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-114a6229-5244-4a89-a0ff-a3fb24da329c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:54.692390 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9965a7ce-7052-44b1-88b5-823b9bf2f65f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8/action" status: 200 len: 14 microversion: 2.1 time: 0.218383 Jul 25 14:57:54.693373 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2977/5716] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:57:54 2022] POST /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8/action => generated 14 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:57:55.016774 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-114a6229-5244-4a89-a0ff-a3fb24da329c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:55.031536 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-114a6229-5244-4a89-a0ff-a3fb24da329c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e" status: 200 len: 1316 microversion: 2.1 time: 0.453432 Jul 25 14:57:55.032706 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2740/5717] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:54 2022] GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e => generated 1316 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:55.497898 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-be400f37-c1eb-406f-addf-34549a40e35f tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:55.498615 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-be400f37-c1eb-406f-addf-34549a40e35f tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: 40d6fea7-fbd6-49fe-b08a-98e61f3485cb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:55.508691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be400f37-c1eb-406f-addf-34549a40e35f tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:55.509419 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be400f37-c1eb-406f-addf-34549a40e35f tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:55.519821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be400f37-c1eb-406f-addf-34549a40e35f tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:55.521366 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be400f37-c1eb-406f-addf-34549a40e35f tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:55.591743 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2e4442bb-c665-483c-8f50-6e08e87fbe2a tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:55.593567 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2e4442bb-c665-483c-8f50-6e08e87fbe2a tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] [instance: 90b721e0-9e11-412d-8b3c-ec13558486df] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:55.603848 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2e4442bb-c665-483c-8f50-6e08e87fbe2a tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:55.605605 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2e4442bb-c665-483c-8f50-6e08e87fbe2a tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:55.607320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2e4442bb-c665-483c-8f50-6e08e87fbe2a tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:55.607779 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2e4442bb-c665-483c-8f50-6e08e87fbe2a tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:55.626736 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-2e4442bb-c665-483c-8f50-6e08e87fbe2a tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] HTTP exception thrown: Instance 90b721e0-9e11-412d-8b3c-ec13558486df could not be found. Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2e4442bb-c665-483c-8f50-6e08e87fbe2a tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Request method failure captured: Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df HTTP/1.1 Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q7mdpvikUaUYeY-4DEeG_1yIpu2ycxS2eE-ZURgMkx9i-5N3O_XYQX_wTzLyqp11cm9213RpP4NGyEDEm8T19HX3xDPBhoS9hT_S6A52v_ExNaBpgL02sdGJgwozNp1f6rArzmWOymyLMApdeQnJe6kLKuwbmdJmY2WmyOZSaMoGTU Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: ea69016f034f4a8ca1774789b71100f7 Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-VolumesBackupsTest-1907750140 Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ea69016f034f4a8ca1774789b71100f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ea69016f034f4a8ca1774789b71100f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ea69016f034f4a8ca1774789b71100f7", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ea69016f034f4a8ca1774789b71100f7"}]}] Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-VolumesBackupsTest-1907750140 Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: ea69016f034f4a8ca1774789b71100f7 Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-VolumesBackupsTest-1907750140 Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-VolumesBackupsTest-1907750140-project Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 2db7c1475dda40b7bac6e1c11bb08ab3 Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-VolumesBackupsTest-1907750140-project Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 90b721e0-9e11-412d-8b3c-ec13558486df could not be found. Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '90b721e0-9e11-412d-8b3c-ec13558486df'} Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90b721e0-9e11-412d-8b3c-ec13558486df could not be found. Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90b721e0-9e11-412d-8b3c-ec13558486df could not be found. Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:57:55.628909 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:57:55.633701 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:57:55.633701 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:57:55.633701 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:57:55.633701 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:57:55.633701 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:57:55.633701 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90b721e0-9e11-412d-8b3c-ec13558486df could not be found. Jul 25 14:57:55.633701 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:57:55.635554 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2e4442bb-c665-483c-8f50-6e08e87fbe2a tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] Returning 404 to user: Instance 90b721e0-9e11-412d-8b3c-ec13558486df could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:57:55.636769 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2e4442bb-c665-483c-8f50-6e08e87fbe2a tempest-VolumesBackupsTest-1907750140 tempest-VolumesBackupsTest-1907750140-project] 10.222.0.88 "GET /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df" status: 404 len: 111 microversion: 2.1 time: 0.053787 Jul 25 14:57:55.637925 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2741/5718] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:55 2022] GET /compute/v2.1/servers/90b721e0-9e11-412d-8b3c-ec13558486df => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:57:55.704864 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-067cd7e1-6744-46b8-8dfd-e4ecac5152e3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:55.707884 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-067cd7e1-6744-46b8-8dfd-e4ecac5152e3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:55.753014 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-067cd7e1-6744-46b8-8dfd-e4ecac5152e3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:55.754253 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-067cd7e1-6744-46b8-8dfd-e4ecac5152e3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:55.762173 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-067cd7e1-6744-46b8-8dfd-e4ecac5152e3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:55.767554 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-067cd7e1-6744-46b8-8dfd-e4ecac5152e3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:55.869288 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-067cd7e1-6744-46b8-8dfd-e4ecac5152e3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8/action" status: 200 len: 14 microversion: 2.1 time: 0.168609 Jul 25 14:57:55.870301 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2742/5719] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:57:55 2022] POST /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8/action => generated 14 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 14:57:56.055197 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ab36191a-702b-4961-ae15-ff7d11a5aa73 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:56.056268 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ab36191a-702b-4961-ae15-ff7d11a5aa73 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 667424b9-7b86-4204-9272-afd7ac83ff5e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:56.081263 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab36191a-702b-4961-ae15-ff7d11a5aa73 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:56.082262 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab36191a-702b-4961-ae15-ff7d11a5aa73 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:56.085610 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab36191a-702b-4961-ae15-ff7d11a5aa73 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:56.086276 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab36191a-702b-4961-ae15-ff7d11a5aa73 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:56.198479 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-be400f37-c1eb-406f-addf-34549a40e35f tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:56.213785 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-be400f37-c1eb-406f-addf-34549a40e35f tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb" status: 200 len: 1313 microversion: 2.1 time: 0.726590 Jul 25 14:57:56.217088 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2978/5720] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:55 2022] GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb => generated 1313 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:57:56.386523 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ab36191a-702b-4961-ae15-ff7d11a5aa73 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:56.400511 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ab36191a-702b-4961-ae15-ff7d11a5aa73 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e" status: 200 len: 1316 microversion: 2.1 time: 0.350691 Jul 25 14:57:56.405123 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2743/5721] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:56 2022] GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e => generated 1316 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:57:56.760720 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-ad4d0c0e-8b37-48e6-8a78-b0c478bf7ee2 req-82358506-3f5d-41fb-996b-b7c4c4fdd728 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "667424b9-7b86-4204-9272-afd7ac83ff5e", "tag": "197b3d4a-13fb-4362-aa5b-1a9cb0cd1083"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:56.793857 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ad4d0c0e-8b37-48e6-8a78-b0c478bf7ee2 req-82358506-3f5d-41fb-996b-b7c4c4fdd728 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:56.794937 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ad4d0c0e-8b37-48e6-8a78-b0c478bf7ee2 req-82358506-3f5d-41fb-996b-b7c4c4fdd728 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:56.825697 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-ad4d0c0e-8b37-48e6-8a78-b0c478bf7ee2 req-82358506-3f5d-41fb-996b-b7c4c4fdd728 service nova] Creating event network-changed:197b3d4a-13fb-4362-aa5b-1a9cb0cd1083 for instance 667424b9-7b86-4204-9272-afd7ac83ff5e on n-h2-846435-14 Jul 25 14:57:56.845327 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-ad4d0c0e-8b37-48e6-8a78-b0c478bf7ee2 req-82358506-3f5d-41fb-996b-b7c4c4fdd728 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095901 Jul 25 14:57:56.846710 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2979/5722] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:57:56.883505 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d392e16e-d5b8-43a0-8080-74bdbbbfae5c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:56.886632 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d392e16e-d5b8-43a0-8080-74bdbbbfae5c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:56.917309 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d392e16e-d5b8-43a0-8080-74bdbbbfae5c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:56.917826 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d392e16e-d5b8-43a0-8080-74bdbbbfae5c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:56.918642 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d392e16e-d5b8-43a0-8080-74bdbbbfae5c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:56.919109 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d392e16e-d5b8-43a0-8080-74bdbbbfae5c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:57.018012 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d392e16e-d5b8-43a0-8080-74bdbbbfae5c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8/action" status: 200 len: 14 microversion: 2.1 time: 0.140395 Jul 25 14:57:57.019431 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2744/5723] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:57:56 2022] POST /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:57:57.240048 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c9b1d1dd-3cdd-4a08-8f35-337985d7f0bc tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:57.243589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c9b1d1dd-3cdd-4a08-8f35-337985d7f0bc tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: 40d6fea7-fbd6-49fe-b08a-98e61f3485cb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:57.261463 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c9b1d1dd-3cdd-4a08-8f35-337985d7f0bc tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:57.268771 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c9b1d1dd-3cdd-4a08-8f35-337985d7f0bc tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:57.269797 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c9b1d1dd-3cdd-4a08-8f35-337985d7f0bc tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:57.270362 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c9b1d1dd-3cdd-4a08-8f35-337985d7f0bc tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:57.435505 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ac02f4a8-1299-456a-8357-f1d9257b80ae tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:57.436623 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ac02f4a8-1299-456a-8357-f1d9257b80ae tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 667424b9-7b86-4204-9272-afd7ac83ff5e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:57.456323 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ac02f4a8-1299-456a-8357-f1d9257b80ae tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:57.459963 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ac02f4a8-1299-456a-8357-f1d9257b80ae tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:57.462776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ac02f4a8-1299-456a-8357-f1d9257b80ae tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:57.465283 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ac02f4a8-1299-456a-8357-f1d9257b80ae tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:57.791509 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ac02f4a8-1299-456a-8357-f1d9257b80ae tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:57.802641 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ac02f4a8-1299-456a-8357-f1d9257b80ae tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e" status: 200 len: 1316 microversion: 2.1 time: 0.378466 Jul 25 14:57:57.803556 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2745/5724] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:57 2022] GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e => generated 1316 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:57.837759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c9b1d1dd-3cdd-4a08-8f35-337985d7f0bc tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:57.854959 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c9b1d1dd-3cdd-4a08-8f35-337985d7f0bc tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb" status: 200 len: 1313 microversion: 2.1 time: 0.620270 Jul 25 14:57:57.856083 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2980/5725] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:57 2022] GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb => generated 1313 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:58.034618 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-892976d8-c09e-4845-8bd9-70ab4026eca5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:58.045719 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-892976d8-c09e-4845-8bd9-70ab4026eca5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:58.055208 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-892976d8-c09e-4845-8bd9-70ab4026eca5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:58.055669 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-892976d8-c09e-4845-8bd9-70ab4026eca5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:58.056486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-892976d8-c09e-4845-8bd9-70ab4026eca5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:58.056929 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-892976d8-c09e-4845-8bd9-70ab4026eca5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:58.123793 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-892976d8-c09e-4845-8bd9-70ab4026eca5 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8/action" status: 200 len: 14 microversion: 2.1 time: 0.096247 Jul 25 14:57:58.124491 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2746/5726] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:57:58 2022] POST /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:57:58.824888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-abe27a3c-b50b-4955-ac22-a32d290265d6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:58.825523 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-abe27a3c-b50b-4955-ac22-a32d290265d6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 667424b9-7b86-4204-9272-afd7ac83ff5e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:58.833010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-abe27a3c-b50b-4955-ac22-a32d290265d6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:58.833477 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-abe27a3c-b50b-4955-ac22-a32d290265d6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:58.834266 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-abe27a3c-b50b-4955-ac22-a32d290265d6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:58.834707 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-abe27a3c-b50b-4955-ac22-a32d290265d6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:58.882843 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-26ac2b52-5369-4f4f-b4ed-b537d25f5bc0 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:57:58.884473 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-26ac2b52-5369-4f4f-b4ed-b537d25f5bc0 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: 40d6fea7-fbd6-49fe-b08a-98e61f3485cb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:58.896728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-26ac2b52-5369-4f4f-b4ed-b537d25f5bc0 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:58.904406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-26ac2b52-5369-4f4f-b4ed-b537d25f5bc0 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:58.905710 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-26ac2b52-5369-4f4f-b4ed-b537d25f5bc0 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:58.906409 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-26ac2b52-5369-4f4f-b4ed-b537d25f5bc0 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:59.095022 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-26ac2b52-5369-4f4f-b4ed-b537d25f5bc0 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:59.104988 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-26ac2b52-5369-4f4f-b4ed-b537d25f5bc0 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb" status: 200 len: 1313 microversion: 2.1 time: 0.227012 Jul 25 14:57:59.118414 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2747/5727] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:58 2022] GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:57:59.118414 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-856ef679-627c-49f2-a612-b87d8fcadaf6 req-cdbcde18-dc47-4591-90e4-d273059d1b98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d6fea7-fbd6-49fe-b08a-98e61f3485cb", "tag": "2c7e2572-4d72-43b3-913d-9ce1824c249a"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:59.127483 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-856ef679-627c-49f2-a612-b87d8fcadaf6 req-cdbcde18-dc47-4591-90e4-d273059d1b98 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:59.127927 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-856ef679-627c-49f2-a612-b87d8fcadaf6 req-cdbcde18-dc47-4591-90e4-d273059d1b98 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:59.140842 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-856ef679-627c-49f2-a612-b87d8fcadaf6 req-cdbcde18-dc47-4591-90e4-d273059d1b98 service nova] Creating event network-changed:2c7e2572-4d72-43b3-913d-9ce1824c249a for instance 40d6fea7-fbd6-49fe-b08a-98e61f3485cb on n-h2-846435-14 Jul 25 14:57:59.148269 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-856ef679-627c-49f2-a612-b87d8fcadaf6 req-cdbcde18-dc47-4591-90e4-d273059d1b98 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037428 Jul 25 14:57:59.149207 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2748/5728] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:57:59.154441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-108ee667-5b9d-420e-add2-1806c69ca583 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:57:59.157038 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-108ee667-5b9d-420e-add2-1806c69ca583 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:57:59.163529 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-108ee667-5b9d-420e-add2-1806c69ca583 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:59.164006 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-108ee667-5b9d-420e-add2-1806c69ca583 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:59.165004 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-108ee667-5b9d-420e-add2-1806c69ca583 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:57:59.165444 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-108ee667-5b9d-420e-add2-1806c69ca583 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:57:59.206731 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-108ee667-5b9d-420e-add2-1806c69ca583 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8/action" status: 200 len: 14 microversion: 2.1 time: 0.056086 Jul 25 14:57:59.207845 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2749/5729] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:57:59 2022] POST /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8/action => generated 14 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:57:59.417446 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-abe27a3c-b50b-4955-ac22-a32d290265d6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:57:59.429282 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-abe27a3c-b50b-4955-ac22-a32d290265d6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e" status: 200 len: 1316 microversion: 2.1 time: 0.608266 Jul 25 14:57:59.442721 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2981/5730] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:57:58 2022] GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e => generated 1316 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:00.129315 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-972eb7c5-f353-4bbb-b72c-2854e42ca228 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:00.130740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-972eb7c5-f353-4bbb-b72c-2854e42ca228 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: 40d6fea7-fbd6-49fe-b08a-98e61f3485cb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:00.149870 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-972eb7c5-f353-4bbb-b72c-2854e42ca228 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:00.150590 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-972eb7c5-f353-4bbb-b72c-2854e42ca228 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:00.151586 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-972eb7c5-f353-4bbb-b72c-2854e42ca228 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:00.152228 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-972eb7c5-f353-4bbb-b72c-2854e42ca228 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:00.219206 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dba01560-c11d-428b-8ef3-d8c610abbc6d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:00.221831 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dba01560-c11d-428b-8ef3-d8c610abbc6d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:00.232795 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dba01560-c11d-428b-8ef3-d8c610abbc6d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:00.233585 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dba01560-c11d-428b-8ef3-d8c610abbc6d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:00.234558 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dba01560-c11d-428b-8ef3-d8c610abbc6d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:00.235165 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dba01560-c11d-428b-8ef3-d8c610abbc6d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:00.283932 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dba01560-c11d-428b-8ef3-d8c610abbc6d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8/action" status: 200 len: 14 microversion: 2.1 time: 0.069455 Jul 25 14:58:00.285148 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2982/5731] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:58:00 2022] POST /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:58:00.453685 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6e851ec0-8def-4911-b322-ea78b06c9222 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:00.454399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6e851ec0-8def-4911-b322-ea78b06c9222 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 667424b9-7b86-4204-9272-afd7ac83ff5e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:00.464329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:58:00.485271 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e851ec0-8def-4911-b322-ea78b06c9222 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:00.486070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e851ec0-8def-4911-b322-ea78b06c9222 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:00.487048 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e851ec0-8def-4911-b322-ea78b06c9222 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:00.487485 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e851ec0-8def-4911-b322-ea78b06c9222 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:00.637760 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-972eb7c5-f353-4bbb-b72c-2854e42ca228 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:00.647790 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-972eb7c5-f353-4bbb-b72c-2854e42ca228 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb" status: 200 len: 1313 microversion: 2.1 time: 0.524684 Jul 25 14:58:00.651776 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2750/5732] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:00 2022] GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb => generated 1313 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:00.985451 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=8 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:58:01.193919 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6e851ec0-8def-4911-b322-ea78b06c9222 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:01.210157 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6e851ec0-8def-4911-b322-ea78b06c9222 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e" status: 200 len: 1316 microversion: 2.1 time: 0.757132 Jul 25 14:58:01.224724 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2983/5733] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:00 2022] GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e => generated 1316 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:01.297081 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-65379c99-9021-49d3-b081-9cacbc88524c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:01.299947 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-65379c99-9021-49d3-b081-9cacbc88524c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:01.314256 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:58:01.323509 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-65379c99-9021-49d3-b081-9cacbc88524c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:01.324149 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-65379c99-9021-49d3-b081-9cacbc88524c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:01.326760 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-65379c99-9021-49d3-b081-9cacbc88524c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:01.331376 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-65379c99-9021-49d3-b081-9cacbc88524c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:01.415487 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-65379c99-9021-49d3-b081-9cacbc88524c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8/action" status: 200 len: 14 microversion: 2.1 time: 0.121606 Jul 25 14:58:01.417300 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2751/5734] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:58:01 2022] POST /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:58:01.667857 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a36c5171-c46f-43de-a443-de80309a2b73 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:01.668573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a36c5171-c46f-43de-a443-de80309a2b73 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: 40d6fea7-fbd6-49fe-b08a-98e61f3485cb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:01.687894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a36c5171-c46f-43de-a443-de80309a2b73 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:01.690775 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a36c5171-c46f-43de-a443-de80309a2b73 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:01.691815 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a36c5171-c46f-43de-a443-de80309a2b73 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:01.692446 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a36c5171-c46f-43de-a443-de80309a2b73 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:02.115590 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a36c5171-c46f-43de-a443-de80309a2b73 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:02.129613 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a36c5171-c46f-43de-a443-de80309a2b73 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb" status: 200 len: 1313 microversion: 2.1 time: 0.465472 Jul 25 14:58:02.130110 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2984/5735] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:01 2022] GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb => generated 1313 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:02.233639 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6975d13a-083b-40d9-8355-96d291b89d24 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:02.234821 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6975d13a-083b-40d9-8355-96d291b89d24 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 667424b9-7b86-4204-9272-afd7ac83ff5e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:02.246146 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6975d13a-083b-40d9-8355-96d291b89d24 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:02.246607 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6975d13a-083b-40d9-8355-96d291b89d24 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:02.247404 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6975d13a-083b-40d9-8355-96d291b89d24 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:02.247845 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6975d13a-083b-40d9-8355-96d291b89d24 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:02.426403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-31e5ffbf-8790-469a-a6fc-3e23770d5a8a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:02.430751 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-31e5ffbf-8790-469a-a6fc-3e23770d5a8a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:02.447093 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-31e5ffbf-8790-469a-a6fc-3e23770d5a8a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:02.448513 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-31e5ffbf-8790-469a-a6fc-3e23770d5a8a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:02.452431 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-31e5ffbf-8790-469a-a6fc-3e23770d5a8a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:02.454376 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-31e5ffbf-8790-469a-a6fc-3e23770d5a8a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:02.538669 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6975d13a-083b-40d9-8355-96d291b89d24 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:02.550003 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-31e5ffbf-8790-469a-a6fc-3e23770d5a8a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8/action" status: 200 len: 14 microversion: 2.1 time: 0.128723 Jul 25 14:58:02.553574 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2985/5736] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:58:02 2022] POST /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 14:58:02.561037 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6975d13a-083b-40d9-8355-96d291b89d24 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e" status: 200 len: 1316 microversion: 2.1 time: 0.333138 Jul 25 14:58:02.561660 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2752/5737] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:02 2022] GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e => generated 1316 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:03.159614 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0a8dc4d0-b008-442f-9489-034ca2396414 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:03.170442 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0a8dc4d0-b008-442f-9489-034ca2396414 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: 40d6fea7-fbd6-49fe-b08a-98e61f3485cb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:03.181807 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0a8dc4d0-b008-442f-9489-034ca2396414 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:03.182780 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0a8dc4d0-b008-442f-9489-034ca2396414 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:03.196259 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0a8dc4d0-b008-442f-9489-034ca2396414 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:03.196924 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0a8dc4d0-b008-442f-9489-034ca2396414 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:03.563279 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8c0ce46f-a1a6-4a6b-9641-8649defe10f6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:03.566581 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8c0ce46f-a1a6-4a6b-9641-8649defe10f6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:03.599403 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=12 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:58:03.608112 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8c0ce46f-a1a6-4a6b-9641-8649defe10f6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:03.609232 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8c0ce46f-a1a6-4a6b-9641-8649defe10f6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:03.611624 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8c0ce46f-a1a6-4a6b-9641-8649defe10f6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:03.612466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8c0ce46f-a1a6-4a6b-9641-8649defe10f6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:03.625329 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:58:03.723438 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8c0ce46f-a1a6-4a6b-9641-8649defe10f6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8/action" status: 200 len: 8207 microversion: 2.1 time: 0.165501 Jul 25 14:58:03.726116 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2753/5738] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:58:03 2022] POST /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8/action => generated 8207 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:03.738248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2a351927-400f-4835-b2ca-914e6c12e3b9 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:03.739578 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2a351927-400f-4835-b2ca-914e6c12e3b9 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 667424b9-7b86-4204-9272-afd7ac83ff5e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:03.757841 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a351927-400f-4835-b2ca-914e6c12e3b9 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:03.759042 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a351927-400f-4835-b2ca-914e6c12e3b9 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:03.760103 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a351927-400f-4835-b2ca-914e6c12e3b9 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:03.761250 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a351927-400f-4835-b2ca-914e6c12e3b9 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:04.029013 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2a351927-400f-4835-b2ca-914e6c12e3b9 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:04.042970 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2a351927-400f-4835-b2ca-914e6c12e3b9 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e" status: 200 len: 1316 microversion: 2.1 time: 0.314531 Jul 25 14:58:04.044920 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2754/5739] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:03 2022] GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e => generated 1316 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:04.050194 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e967f99b-1faa-408d-9b46-e150a7322843 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:04.051036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e967f99b-1faa-408d-9b46-e150a7322843 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:04.058640 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e967f99b-1faa-408d-9b46-e150a7322843 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:04.059392 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e967f99b-1faa-408d-9b46-e150a7322843 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:04.060443 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e967f99b-1faa-408d-9b46-e150a7322843 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:04.061095 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e967f99b-1faa-408d-9b46-e150a7322843 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:04.108391 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0a8dc4d0-b008-442f-9489-034ca2396414 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:04.123677 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0a8dc4d0-b008-442f-9489-034ca2396414 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb" status: 200 len: 1313 microversion: 2.1 time: 0.976144 Jul 25 14:58:04.124328 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2986/5740] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:03 2022] GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb => generated 1313 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:04.264093 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-58d0be9e-3941-4613-b124-6b4ef5a5f087 req-8adc546c-5bc8-469b-8fbe-00e0430728e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "667424b9-7b86-4204-9272-afd7ac83ff5e", "name": "network-vif-plugged", "status": "completed", "tag": "197b3d4a-13fb-4362-aa5b-1a9cb0cd1083"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:04.285620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-58d0be9e-3941-4613-b124-6b4ef5a5f087 req-8adc546c-5bc8-469b-8fbe-00e0430728e6 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:04.293780 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-58d0be9e-3941-4613-b124-6b4ef5a5f087 req-8adc546c-5bc8-469b-8fbe-00e0430728e6 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:04.335607 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-58d0be9e-3941-4613-b124-6b4ef5a5f087 req-8adc546c-5bc8-469b-8fbe-00e0430728e6 service nova] Creating event network-vif-plugged:197b3d4a-13fb-4362-aa5b-1a9cb0cd1083 for instance 667424b9-7b86-4204-9272-afd7ac83ff5e on n-h2-846435-14 Jul 25 14:58:04.347113 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-58d0be9e-3941-4613-b124-6b4ef5a5f087 req-8adc546c-5bc8-469b-8fbe-00e0430728e6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092490 Jul 25 14:58:04.348823 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2987/5741] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:58:04.528517 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e967f99b-1faa-408d-9b46-e150a7322843 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:04.551544 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e967f99b-1faa-408d-9b46-e150a7322843 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.500088 Jul 25 14:58:04.552399 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2755/5742] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:04 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:04.580497 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ac982859-e292-4914-bd77-6b299749a069 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:04.581551 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ac982859-e292-4914-bd77-6b299749a069 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:04.592761 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac982859-e292-4914-bd77-6b299749a069 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:04.593288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac982859-e292-4914-bd77-6b299749a069 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:04.596715 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac982859-e292-4914-bd77-6b299749a069 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:04.597266 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac982859-e292-4914-bd77-6b299749a069 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:05.043409 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ac982859-e292-4914-bd77-6b299749a069 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:05.051340 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ac982859-e292-4914-bd77-6b299749a069 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.478332 Jul 25 14:58:05.057414 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2988/5743] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:04 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:05.064850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-052f4911-dec0-4e34-8de6-1c8d993895e8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:05.066033 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-052f4911-dec0-4e34-8de6-1c8d993895e8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 667424b9-7b86-4204-9272-afd7ac83ff5e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:05.078148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-eda65e91-153b-4d38-83d0-793eedf81cfb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:05.079044 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-eda65e91-153b-4d38-83d0-793eedf81cfb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:05.084377 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-052f4911-dec0-4e34-8de6-1c8d993895e8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:05.085055 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-052f4911-dec0-4e34-8de6-1c8d993895e8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:05.086046 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-052f4911-dec0-4e34-8de6-1c8d993895e8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:05.087247 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-052f4911-dec0-4e34-8de6-1c8d993895e8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:05.090767 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eda65e91-153b-4d38-83d0-793eedf81cfb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:05.096299 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eda65e91-153b-4d38-83d0-793eedf81cfb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:05.097529 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eda65e91-153b-4d38-83d0-793eedf81cfb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:05.098139 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eda65e91-153b-4d38-83d0-793eedf81cfb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:05.504217 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-eda65e91-153b-4d38-83d0-793eedf81cfb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:05.514124 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-eda65e91-153b-4d38-83d0-793eedf81cfb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.440122 Jul 25 14:58:05.515185 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2989/5744] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:05 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:58:05.525692 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7624ca83-5bd9-414d-8b00-1bbbd90efe77 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:05.530047 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7624ca83-5bd9-414d-8b00-1bbbd90efe77 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: 40d6fea7-fbd6-49fe-b08a-98e61f3485cb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:05.545912 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7624ca83-5bd9-414d-8b00-1bbbd90efe77 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:05.546684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7624ca83-5bd9-414d-8b00-1bbbd90efe77 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:05.547682 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7624ca83-5bd9-414d-8b00-1bbbd90efe77 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:05.548331 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7624ca83-5bd9-414d-8b00-1bbbd90efe77 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:06.073895 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-052f4911-dec0-4e34-8de6-1c8d993895e8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:06.089931 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-052f4911-dec0-4e34-8de6-1c8d993895e8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e" status: 200 len: 1316 microversion: 2.1 time: 1.028787 Jul 25 14:58:06.091842 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2756/5745] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:05 2022] GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e => generated 1316 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:06.097382 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-89790572-62a1-4483-8b09-69d046145271 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:06.100380 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-89790572-62a1-4483-8b09-69d046145271 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:06.114553 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89790572-62a1-4483-8b09-69d046145271 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:06.115310 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89790572-62a1-4483-8b09-69d046145271 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:06.116874 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89790572-62a1-4483-8b09-69d046145271 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:06.118469 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89790572-62a1-4483-8b09-69d046145271 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:06.306345 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7624ca83-5bd9-414d-8b00-1bbbd90efe77 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:06.322401 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7624ca83-5bd9-414d-8b00-1bbbd90efe77 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb" status: 200 len: 1313 microversion: 2.1 time: 0.800667 Jul 25 14:58:06.323256 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2990/5746] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:05 2022] GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb => generated 1313 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:06.556468 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-89790572-62a1-4483-8b09-69d046145271 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:06.568477 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-89790572-62a1-4483-8b09-69d046145271 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.475153 Jul 25 14:58:06.569612 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2757/5747] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:06 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:06.589199 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-85975352-b965-40be-987a-88cb80ca0a5b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:06.590400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-85975352-b965-40be-987a-88cb80ca0a5b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:06.598435 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-85975352-b965-40be-987a-88cb80ca0a5b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:06.608784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-85975352-b965-40be-987a-88cb80ca0a5b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:06.609708 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-85975352-b965-40be-987a-88cb80ca0a5b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:06.610158 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-85975352-b965-40be-987a-88cb80ca0a5b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:06.735634 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-85975352-b965-40be-987a-88cb80ca0a5b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Locking {{(pid=119304) lock /opt/stack/nova/nova/compute/api.py:4700}} Jul 25 14:58:06.850319 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-85975352-b965-40be-987a-88cb80ca0a5b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action" status: 202 len: 0 microversion: 2.1 time: 0.264769 Jul 25 14:58:06.855711 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2991/5748] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:58:06 2022] POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:58:06.861238 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2ba7b941-bcc1-4809-abf5-448dbe302a1e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:06.861935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2ba7b941-bcc1-4809-abf5-448dbe302a1e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:06.871865 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ba7b941-bcc1-4809-abf5-448dbe302a1e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:06.878647 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ba7b941-bcc1-4809-abf5-448dbe302a1e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:06.879639 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ba7b941-bcc1-4809-abf5-448dbe302a1e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:06.883380 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ba7b941-bcc1-4809-abf5-448dbe302a1e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:07.116420 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3f4a9037-f360-4000-a1bc-a69e3b146883 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:07.117119 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3f4a9037-f360-4000-a1bc-a69e3b146883 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 667424b9-7b86-4204-9272-afd7ac83ff5e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:07.124332 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f4a9037-f360-4000-a1bc-a69e3b146883 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:07.125127 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f4a9037-f360-4000-a1bc-a69e3b146883 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:07.126370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f4a9037-f360-4000-a1bc-a69e3b146883 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:07.126997 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f4a9037-f360-4000-a1bc-a69e3b146883 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:07.222752 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2ba7b941-bcc1-4809-abf5-448dbe302a1e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:07.233989 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2ba7b941-bcc1-4809-abf5-448dbe302a1e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.376684 Jul 25 14:58:07.235283 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2758/5749] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:06 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:07.254835 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fc18b1a9-af81-43cb-ab0f-dd3744c87f52 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:07.264866 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fc18b1a9-af81-43cb-ab0f-dd3744c87f52 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:07.265655 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fc18b1a9-af81-43cb-ab0f-dd3744c87f52 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:07.315582 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-fc18b1a9-af81-43cb-ab0f-dd3744c87f52 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] HTTP exception thrown: Instance 9e054ea1-6a81-43c7-9746-25b466d4647b is locked Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fc18b1a9-af81-43cb-ab0f-dd3744c87f52 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Request method failure captured: Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action HTTP/1.1 Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 15 Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q4n_GLv427uSoooHGGe9soSmjgDeZCGUQueNy_xefyEgT-hSczU2kL3hiXWGeYfdKN8k2BuCstNXM98_x-OYwwQ0qAirrTIoXCChnna0H4neT9udv1ZiUItYpB2Emh8V7JLfjmknmcgS6w8ksKxU_IdJSwJPWFMtYFf7L60cdnHC6o Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 649465d992d749eca5d73d30e61ab62e Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServerActionsTestJSON-1540418270 Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/649465d992d749eca5d73d30e61ab62e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/649465d992d749eca5d73d30e61ab62e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_649465d992d749eca5d73d30e61ab62e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/649465d992d749eca5d73d30e61ab62e"}]}] Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServerActionsTestJSON-1540418270 Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 649465d992d749eca5d73d30e61ab62e Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServerActionsTestJSON-1540418270 Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServerActionsTestJSON-1540418270-project Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 72d5f52dd1ae4cf999f7df131b70223c Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServerActionsTestJSON-1540418270-project Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: {"os-stop": {}} Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 9e054ea1-6a81-43c7-9746-25b466d4647b is locked Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '9e054ea1-6a81-43c7-9746-25b466d4647b', 'body': {'os-stop': {}}} Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 9e054ea1-6a81-43c7-9746-25b466d4647b is locked Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 9e054ea1-6a81-43c7-9746-25b466d4647b is locked Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e054ea1-6a81-43c7-9746-25b466d4647b is locked Jul 25 14:58:07.317622 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:07.323360 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fc18b1a9-af81-43cb-ab0f-dd3744c87f52 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Returning 409 to user: Instance 9e054ea1-6a81-43c7-9746-25b466d4647b is locked {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:07.324630 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fc18b1a9-af81-43cb-ab0f-dd3744c87f52 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action" status: 409 len: 107 microversion: 2.1 time: 0.073873 Jul 25 14:58:07.326231 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2759/5750] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:58:07 2022] POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action => generated 107 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 25 14:58:07.338868 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cf32d8fb-0f88-432c-9221-0f574cc753a3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:07.339755 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cf32d8fb-0f88-432c-9221-0f574cc753a3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:07.347181 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf32d8fb-0f88-432c-9221-0f574cc753a3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:07.347944 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf32d8fb-0f88-432c-9221-0f574cc753a3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:07.349114 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf32d8fb-0f88-432c-9221-0f574cc753a3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:07.350957 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf32d8fb-0f88-432c-9221-0f574cc753a3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:07.422430 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cf32d8fb-0f88-432c-9221-0f574cc753a3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Unlocking {{(pid=119303) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 25 14:58:07.447452 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3f4a9037-f360-4000-a1bc-a69e3b146883 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:07.463089 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3f4a9037-f360-4000-a1bc-a69e3b146883 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e" status: 200 len: 1506 microversion: 2.1 time: 0.345128 Jul 25 14:58:07.465537 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2992/5751] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:07 2022] GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e => generated 1506 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:07.492815 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-581c43d4-ab48-4e04-a7c3-2a426d1f7cdb tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:07.495456 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-581c43d4-ab48-4e04-a7c3-2a426d1f7cdb tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: 40d6fea7-fbd6-49fe-b08a-98e61f3485cb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:07.508386 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-581c43d4-ab48-4e04-a7c3-2a426d1f7cdb tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:07.509384 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-581c43d4-ab48-4e04-a7c3-2a426d1f7cdb tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:07.511531 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-581c43d4-ab48-4e04-a7c3-2a426d1f7cdb tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:07.512370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-581c43d4-ab48-4e04-a7c3-2a426d1f7cdb tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:07.515662 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cf32d8fb-0f88-432c-9221-0f574cc753a3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action" status: 202 len: 0 microversion: 2.1 time: 0.183476 Jul 25 14:58:07.525608 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2760/5752] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:58:07 2022] POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:58:07.549225 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-586954f9-5e96-4a71-855d-5d9f3d6930d4 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:07.549990 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-586954f9-5e96-4a71-855d-5d9f3d6930d4 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 667424b9-7b86-4204-9272-afd7ac83ff5e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:07.567463 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-586954f9-5e96-4a71-855d-5d9f3d6930d4 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:07.568148 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-586954f9-5e96-4a71-855d-5d9f3d6930d4 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:07.569741 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-586954f9-5e96-4a71-855d-5d9f3d6930d4 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:07.570342 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-586954f9-5e96-4a71-855d-5d9f3d6930d4 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:07.604427 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-586954f9-5e96-4a71-855d-5d9f3d6930d4 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 667424b9-7b86-4204-9272-afd7ac83ff5e] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:58:07.838052 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-586954f9-5e96-4a71-855d-5d9f3d6930d4 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "DELETE /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e" status: 204 len: 0 microversion: 2.1 time: 0.304574 Jul 25 14:58:07.839235 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2761/5753] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:58:07 2022] DELETE /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:58:07.863323 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-70710ab0-e326-4075-94f9-9545aea067f2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:07.883701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70710ab0-e326-4075-94f9-9545aea067f2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:07.887118 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70710ab0-e326-4075-94f9-9545aea067f2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:07.944372 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-70710ab0-e326-4075-94f9-9545aea067f2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Going to try to stop instance {{(pid=119303) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 14:58:08.033252 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-581c43d4-ab48-4e04-a7c3-2a426d1f7cdb tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:08.044563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:58:08.055313 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-70710ab0-e326-4075-94f9-9545aea067f2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action" status: 202 len: 0 microversion: 2.1 time: 0.213641 Jul 25 14:58:08.056711 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2762/5754] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:58:07 2022] POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:58:08.062631 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6ec38118-aea0-4edc-aede-63297eaf6a6d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:08.063355 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6ec38118-aea0-4edc-aede-63297eaf6a6d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 667424b9-7b86-4204-9272-afd7ac83ff5e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:08.069895 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ec38118-aea0-4edc-aede-63297eaf6a6d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:08.070354 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ec38118-aea0-4edc-aede-63297eaf6a6d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:08.071156 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ec38118-aea0-4edc-aede-63297eaf6a6d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:08.071598 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ec38118-aea0-4edc-aede-63297eaf6a6d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:08.074139 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-581c43d4-ab48-4e04-a7c3-2a426d1f7cdb tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb" status: 200 len: 1313 microversion: 2.1 time: 0.607187 Jul 25 14:58:08.081018 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2993/5755] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:07 2022] GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb => generated 1313 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:08.094538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-91ae4ce9-2d3a-46f7-9600-45398888b33e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:08.106225 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-91ae4ce9-2d3a-46f7-9600-45398888b33e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:08.121025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-91ae4ce9-2d3a-46f7-9600-45398888b33e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:08.121738 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-91ae4ce9-2d3a-46f7-9600-45398888b33e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:08.139718 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-91ae4ce9-2d3a-46f7-9600-45398888b33e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:08.140611 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-91ae4ce9-2d3a-46f7-9600-45398888b33e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:08.378223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-91ae4ce9-2d3a-46f7-9600-45398888b33e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:08.391885 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-91ae4ce9-2d3a-46f7-9600-45398888b33e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1680 microversion: 2.1 time: 0.308737 Jul 25 14:58:08.392551 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2994/5756] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:08 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1680 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:08.427282 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6ec38118-aea0-4edc-aede-63297eaf6a6d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:08.438993 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6ec38118-aea0-4edc-aede-63297eaf6a6d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e" status: 200 len: 1512 microversion: 2.1 time: 0.380980 Jul 25 14:58:08.441918 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2763/5757] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:08 2022] GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e => generated 1512 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:08.829710 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f8150ddb-99ca-496d-b702-a3e3d601efda tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-255429711", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "d00e4cf4-fe86-45da-8cf6-17b941d33461"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1430484760", "security_groups": [{"name": "tempest-secgroup-smoke-557795736"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:09.101767 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d4074e98-4491-46bb-8a0e-93becff3ba1e tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:09.102450 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d4074e98-4491-46bb-8a0e-93becff3ba1e tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: 40d6fea7-fbd6-49fe-b08a-98e61f3485cb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:09.110252 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d4074e98-4491-46bb-8a0e-93becff3ba1e tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:09.111210 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d4074e98-4491-46bb-8a0e-93becff3ba1e tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:09.112287 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d4074e98-4491-46bb-8a0e-93becff3ba1e tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:09.112920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d4074e98-4491-46bb-8a0e-93becff3ba1e tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:09.142769 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-f8150ddb-99ca-496d-b702-a3e3d601efda tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] validate_networks() for [('d00e4cf4-fe86-45da-8cf6-17b941d33461', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:58:09.330749 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d4074e98-4491-46bb-8a0e-93becff3ba1e tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:09.342269 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d4074e98-4491-46bb-8a0e-93becff3ba1e tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb" status: 200 len: 1313 microversion: 2.1 time: 0.244653 Jul 25 14:58:09.344075 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2764/5758] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:09 2022] GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:58:09.349911 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-5fb04e92-238f-4cb6-acee-1a0b14cca451 req-bfede91f-4cad-44fa-b88c-025e4abc0e1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d6fea7-fbd6-49fe-b08a-98e61f3485cb", "name": "network-vif-plugged", "status": "completed", "tag": "2c7e2572-4d72-43b3-913d-9ce1824c249a"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:09.365463 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-5fb04e92-238f-4cb6-acee-1a0b14cca451 req-bfede91f-4cad-44fa-b88c-025e4abc0e1e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:09.369741 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-5fb04e92-238f-4cb6-acee-1a0b14cca451 req-bfede91f-4cad-44fa-b88c-025e4abc0e1e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:09.382563 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:58:09.411279 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-5fb04e92-238f-4cb6-acee-1a0b14cca451 req-bfede91f-4cad-44fa-b88c-025e4abc0e1e service nova] Creating event network-vif-plugged:2c7e2572-4d72-43b3-913d-9ce1824c249a for instance 40d6fea7-fbd6-49fe-b08a-98e61f3485cb on n-h2-846435-14 Jul 25 14:58:09.420834 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-5fb04e92-238f-4cb6-acee-1a0b14cca451 req-bfede91f-4cad-44fa-b88c-025e4abc0e1e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074810 Jul 25 14:58:09.421685 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2765/5759] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:58:09.462362 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-53f2b550-32a7-438c-ac3d-df48f0507fba tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:09.463135 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-53f2b550-32a7-438c-ac3d-df48f0507fba tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:09.499276 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-53f2b550-32a7-438c-ac3d-df48f0507fba tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:09.500206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-53f2b550-32a7-438c-ac3d-df48f0507fba tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:09.501261 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-53f2b550-32a7-438c-ac3d-df48f0507fba tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:09.502545 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-53f2b550-32a7-438c-ac3d-df48f0507fba tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:09.740242 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-53f2b550-32a7-438c-ac3d-df48f0507fba tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:09.756660 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-53f2b550-32a7-438c-ac3d-df48f0507fba tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1680 microversion: 2.1 time: 0.333643 Jul 25 14:58:09.757827 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2766/5760] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:09 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1680 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:09.764670 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8f22790b-4e26-4f29-9917-692b64b5826b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:09.766397 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8f22790b-4e26-4f29-9917-692b64b5826b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 667424b9-7b86-4204-9272-afd7ac83ff5e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:09.777842 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f22790b-4e26-4f29-9917-692b64b5826b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:09.778436 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f22790b-4e26-4f29-9917-692b64b5826b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:09.779525 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f22790b-4e26-4f29-9917-692b64b5826b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:09.780097 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f22790b-4e26-4f29-9917-692b64b5826b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:10.120039 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8f22790b-4e26-4f29-9917-692b64b5826b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:10.144379 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8f22790b-4e26-4f29-9917-692b64b5826b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e" status: 200 len: 1512 microversion: 2.1 time: 0.385082 Jul 25 14:58:10.148285 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2767/5761] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:09 2022] GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e => generated 1512 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:10.366103 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d7041a7e-e159-403d-9c10-4bd1b7ee0f6c tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:10.366941 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d7041a7e-e159-403d-9c10-4bd1b7ee0f6c tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: 40d6fea7-fbd6-49fe-b08a-98e61f3485cb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:10.381461 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d7041a7e-e159-403d-9c10-4bd1b7ee0f6c tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:10.382018 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d7041a7e-e159-403d-9c10-4bd1b7ee0f6c tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:10.386077 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d7041a7e-e159-403d-9c10-4bd1b7ee0f6c tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:10.386616 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d7041a7e-e159-403d-9c10-4bd1b7ee0f6c tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:10.652769 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d7041a7e-e159-403d-9c10-4bd1b7ee0f6c tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:10.664252 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d7041a7e-e159-403d-9c10-4bd1b7ee0f6c tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb" status: 200 len: 1313 microversion: 2.1 time: 0.302512 Jul 25 14:58:10.664910 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2768/5762] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:10 2022] GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:10.810163 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d32ee50c-936d-464e-ab58-94355ae3a62b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:10.811092 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d32ee50c-936d-464e-ab58-94355ae3a62b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:10.832357 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d32ee50c-936d-464e-ab58-94355ae3a62b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:10.833078 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d32ee50c-936d-464e-ab58-94355ae3a62b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:10.835610 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d32ee50c-936d-464e-ab58-94355ae3a62b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:10.841936 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d32ee50c-936d-464e-ab58-94355ae3a62b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:11.239526 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d32ee50c-936d-464e-ab58-94355ae3a62b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:11.253487 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d32ee50c-936d-464e-ab58-94355ae3a62b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1680 microversion: 2.1 time: 0.473235 Jul 25 14:58:11.254652 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2769/5763] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:10 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1680 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:11.272615 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f819a160-55f2-44ba-995c-8c9291fa23dd tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:11.273245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f819a160-55f2-44ba-995c-8c9291fa23dd tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 667424b9-7b86-4204-9272-afd7ac83ff5e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:11.289716 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f819a160-55f2-44ba-995c-8c9291fa23dd tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:11.290328 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f819a160-55f2-44ba-995c-8c9291fa23dd tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:11.290979 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f819a160-55f2-44ba-995c-8c9291fa23dd tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:11.298943 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f819a160-55f2-44ba-995c-8c9291fa23dd tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:11.650647 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f819a160-55f2-44ba-995c-8c9291fa23dd tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:11.661064 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f819a160-55f2-44ba-995c-8c9291fa23dd tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e" status: 200 len: 1512 microversion: 2.1 time: 0.404380 Jul 25 14:58:11.677945 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2770/5764] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:11 2022] GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e => generated 1512 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:11.687759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-30c5a139-56df-44fd-b623-71d8e5abc693 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:11.688612 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-30c5a139-56df-44fd-b623-71d8e5abc693 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: 40d6fea7-fbd6-49fe-b08a-98e61f3485cb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:11.689124 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f8150ddb-99ca-496d-b702-a3e3d601efda tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:58:11.689685 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f8150ddb-99ca-496d-b702-a3e3d601efda tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:58:11.690257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f8150ddb-99ca-496d-b702-a3e3d601efda tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:58:11.690772 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f8150ddb-99ca-496d-b702-a3e3d601efda tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:58:11.691261 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f8150ddb-99ca-496d-b702-a3e3d601efda tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:58:11.707786 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-30c5a139-56df-44fd-b623-71d8e5abc693 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:11.708089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8150ddb-99ca-496d-b702-a3e3d601efda tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:11.710265 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-30c5a139-56df-44fd-b623-71d8e5abc693 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:11.711055 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8150ddb-99ca-496d-b702-a3e3d601efda tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:11.712198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8150ddb-99ca-496d-b702-a3e3d601efda tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:11.712936 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8150ddb-99ca-496d-b702-a3e3d601efda tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:11.713603 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-30c5a139-56df-44fd-b623-71d8e5abc693 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:11.714096 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-30c5a139-56df-44fd-b623-71d8e5abc693 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:11.761502 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-f8150ddb-99ca-496d-b702-a3e3d601efda tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Getting quotas for project 8dd09177faea4702992aaab182125b5a. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:58:11.775207 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-f8150ddb-99ca-496d-b702-a3e3d601efda tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Getting quotas for user ca46c8e84b8644b69937ec9c06cb0e9a and project 8dd09177faea4702992aaab182125b5a. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:58:11.814590 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f8150ddb-99ca-496d-b702-a3e3d601efda tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:58:11.817454 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f8150ddb-99ca-496d-b702-a3e3d601efda tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:58:11.936326 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f8150ddb-99ca-496d-b702-a3e3d601efda tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.111737 Jul 25 14:58:11.943650 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2995/5765] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:58:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 3120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:58:11.949537 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d9d9e93b-e5bc-4614-8275-9cd21fb1db3a tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:11.950554 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d9d9e93b-e5bc-4614-8275-9cd21fb1db3a tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:12.053697 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d9d9e93b-e5bc-4614-8275-9cd21fb1db3a tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:12.063932 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d9d9e93b-e5bc-4614-8275-9cd21fb1db3a tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1266 microversion: 2.1 time: 0.117555 Jul 25 14:58:12.066340 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2996/5766] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:11 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1266 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:12.116722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-30c5a139-56df-44fd-b623-71d8e5abc693 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:12.125496 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-30c5a139-56df-44fd-b623-71d8e5abc693 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb" status: 200 len: 1497 microversion: 2.1 time: 0.444131 Jul 25 14:58:12.126669 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2771/5767] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:11 2022] GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb => generated 1497 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:58:12.277008 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a5a553c0-7a4f-4fff-b891-52381cbb89f9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:12.277773 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a5a553c0-7a4f-4fff-b891-52381cbb89f9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:12.290407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5a553c0-7a4f-4fff-b891-52381cbb89f9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:12.294022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5a553c0-7a4f-4fff-b891-52381cbb89f9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:12.298891 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5a553c0-7a4f-4fff-b891-52381cbb89f9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:12.299613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5a553c0-7a4f-4fff-b891-52381cbb89f9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:12.353264 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-9bf01a72-ece4-485f-ab27-62016efed4b3 req-7593653d-4d8c-4887-acde-8f558021a8e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "667424b9-7b86-4204-9272-afd7ac83ff5e", "name": "network-vif-deleted", "tag": "197b3d4a-13fb-4362-aa5b-1a9cb0cd1083"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:12.398736 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-9bf01a72-ece4-485f-ab27-62016efed4b3 req-7593653d-4d8c-4887-acde-8f558021a8e3 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:12.400094 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-9bf01a72-ece4-485f-ab27-62016efed4b3 req-7593653d-4d8c-4887-acde-8f558021a8e3 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:12.448367 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-9bf01a72-ece4-485f-ab27-62016efed4b3 req-7593653d-4d8c-4887-acde-8f558021a8e3 service nova] Creating event network-vif-deleted:197b3d4a-13fb-4362-aa5b-1a9cb0cd1083 for instance 667424b9-7b86-4204-9272-afd7ac83ff5e on n-h2-846435-14 Jul 25 14:58:12.480094 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-9bf01a72-ece4-485f-ab27-62016efed4b3 req-7593653d-4d8c-4887-acde-8f558021a8e3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126015 Jul 25 14:58:12.482574 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2772/5768] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:58:12.684340 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7d20e0b5-fb0e-4d23-895b-ec2207206a89 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:12.685059 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7d20e0b5-fb0e-4d23-895b-ec2207206a89 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 667424b9-7b86-4204-9272-afd7ac83ff5e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:12.698745 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7d20e0b5-fb0e-4d23-895b-ec2207206a89 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:12.701548 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7d20e0b5-fb0e-4d23-895b-ec2207206a89 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:12.702812 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7d20e0b5-fb0e-4d23-895b-ec2207206a89 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:12.703441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7d20e0b5-fb0e-4d23-895b-ec2207206a89 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:12.818036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7d20e0b5-fb0e-4d23-895b-ec2207206a89 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:12.821990 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7d20e0b5-fb0e-4d23-895b-ec2207206a89 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:12.821990 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-7d20e0b5-fb0e-4d23-895b-ec2207206a89 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lazy-loading 'fault' on Instance uuid 667424b9-7b86-4204-9272-afd7ac83ff5e {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:58:12.945730 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7d20e0b5-fb0e-4d23-895b-ec2207206a89 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:12.968870 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7d20e0b5-fb0e-4d23-895b-ec2207206a89 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e" status: 200 len: 1306 microversion: 2.1 time: 0.289500 Jul 25 14:58:12.973331 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2773/5769] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:12 2022] GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e => generated 1306 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:13.014400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a5a553c0-7a4f-4fff-b891-52381cbb89f9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:13.032936 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a5a553c0-7a4f-4fff-b891-52381cbb89f9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1680 microversion: 2.1 time: 0.750211 Jul 25 14:58:13.033628 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2997/5770] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:12 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1680 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:13.089839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6758779b-dfd6-4ce3-9835-4ac6a24bd9af tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:13.099712 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6758779b-dfd6-4ce3-9835-4ac6a24bd9af tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:13.250144 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6758779b-dfd6-4ce3-9835-4ac6a24bd9af tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:13.282349 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6758779b-dfd6-4ce3-9835-4ac6a24bd9af tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1266 microversion: 2.1 time: 0.199330 Jul 25 14:58:13.292302 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2774/5771] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:13 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:13.386552 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-59b368cb-effa-4da8-8ba6-28420084ef50 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:13.389239 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-59b368cb-effa-4da8-8ba6-28420084ef50 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: 40d6fea7-fbd6-49fe-b08a-98e61f3485cb] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:13.405234 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59b368cb-effa-4da8-8ba6-28420084ef50 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:13.406331 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59b368cb-effa-4da8-8ba6-28420084ef50 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:13.407438 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59b368cb-effa-4da8-8ba6-28420084ef50 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:13.408150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59b368cb-effa-4da8-8ba6-28420084ef50 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:13.463948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-59b368cb-effa-4da8-8ba6-28420084ef50 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: 40d6fea7-fbd6-49fe-b08a-98e61f3485cb] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:58:13.586531 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:58:13.614531 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-59b368cb-effa-4da8-8ba6-28420084ef50 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "DELETE /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb" status: 204 len: 0 microversion: 2.1 time: 0.233415 Jul 25 14:58:13.617151 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2998/5772] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:58:13 2022] DELETE /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:58:13.627230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e9545b06-3149-46fb-b7aa-9e7ffc2a1ac4 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:13.628201 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e9545b06-3149-46fb-b7aa-9e7ffc2a1ac4 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: 40d6fea7-fbd6-49fe-b08a-98e61f3485cb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:13.642906 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e9545b06-3149-46fb-b7aa-9e7ffc2a1ac4 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:13.643380 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e9545b06-3149-46fb-b7aa-9e7ffc2a1ac4 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:13.647573 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e9545b06-3149-46fb-b7aa-9e7ffc2a1ac4 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:13.651952 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e9545b06-3149-46fb-b7aa-9e7ffc2a1ac4 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:13.903409 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e9545b06-3149-46fb-b7aa-9e7ffc2a1ac4 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:13.916860 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e9545b06-3149-46fb-b7aa-9e7ffc2a1ac4 tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb" status: 200 len: 1503 microversion: 2.1 time: 0.291781 Jul 25 14:58:13.917676 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2775/5773] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:13 2022] GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb => generated 1503 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:13.995835 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8db17c61-acef-4dd8-8ed9-247fa8edbc4b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:13.996710 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8db17c61-acef-4dd8-8ed9-247fa8edbc4b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 667424b9-7b86-4204-9272-afd7ac83ff5e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:14.010397 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8db17c61-acef-4dd8-8ed9-247fa8edbc4b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:14.011541 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8db17c61-acef-4dd8-8ed9-247fa8edbc4b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:14.012494 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8db17c61-acef-4dd8-8ed9-247fa8edbc4b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:14.012936 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8db17c61-acef-4dd8-8ed9-247fa8edbc4b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:14.034422 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-8db17c61-acef-4dd8-8ed9-247fa8edbc4b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Instance 667424b9-7b86-4204-9272-afd7ac83ff5e could not be found. Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8db17c61-acef-4dd8-8ed9-247fa8edbc4b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e HTTP/1.1 Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 667424b9-7b86-4204-9272-afd7ac83ff5e could not be found. Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '667424b9-7b86-4204-9272-afd7ac83ff5e'} Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 667424b9-7b86-4204-9272-afd7ac83ff5e could not be found. Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 667424b9-7b86-4204-9272-afd7ac83ff5e could not be found. Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:14.044384 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:14.050921 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:14.050921 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:14.050921 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:14.050921 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:58:14.050921 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:58:14.050921 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 667424b9-7b86-4204-9272-afd7ac83ff5e could not be found. Jul 25 14:58:14.050921 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:14.050921 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8db17c61-acef-4dd8-8ed9-247fa8edbc4b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 404 to user: Instance 667424b9-7b86-4204-9272-afd7ac83ff5e could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:14.050921 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8db17c61-acef-4dd8-8ed9-247fa8edbc4b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e" status: 404 len: 111 microversion: 2.1 time: 0.055381 Jul 25 14:58:14.050921 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 2999/5774] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:13 2022] GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:58:14.055489 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-05c09e0c-3bcc-4ac5-b355-289fab079bd7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:14.055742 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7701ef11-ad43-4c0f-b8d5-f04ba4c22310 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:14.056150 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-05c09e0c-3bcc-4ac5-b355-289fab079bd7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:14.056487 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7701ef11-ad43-4c0f-b8d5-f04ba4c22310 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:14.064160 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7701ef11-ad43-4c0f-b8d5-f04ba4c22310 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:14.064613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7701ef11-ad43-4c0f-b8d5-f04ba4c22310 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:14.065395 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7701ef11-ad43-4c0f-b8d5-f04ba4c22310 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:14.065835 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7701ef11-ad43-4c0f-b8d5-f04ba4c22310 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:14.067074 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-05c09e0c-3bcc-4ac5-b355-289fab079bd7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:14.068383 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-05c09e0c-3bcc-4ac5-b355-289fab079bd7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:14.069625 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-05c09e0c-3bcc-4ac5-b355-289fab079bd7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:14.070248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-05c09e0c-3bcc-4ac5-b355-289fab079bd7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:14.320855 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7701ef11-ad43-4c0f-b8d5-f04ba4c22310 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:14.330769 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7701ef11-ad43-4c0f-b8d5-f04ba4c22310 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.279569 Jul 25 14:58:14.331825 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3000/5775] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:14 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:14.336854 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-11b3b1dd-c0bc-4b81-8173-dc9337969602 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:14.337744 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-11b3b1dd-c0bc-4b81-8173-dc9337969602 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:14.344664 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11b3b1dd-c0bc-4b81-8173-dc9337969602 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:14.345354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11b3b1dd-c0bc-4b81-8173-dc9337969602 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:14.346497 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11b3b1dd-c0bc-4b81-8173-dc9337969602 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:14.347088 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11b3b1dd-c0bc-4b81-8173-dc9337969602 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:14.459168 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-11b3b1dd-c0bc-4b81-8173-dc9337969602 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:14.473679 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-11b3b1dd-c0bc-4b81-8173-dc9337969602 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1336 microversion: 2.1 time: 0.140582 Jul 25 14:58:14.475072 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3001/5776] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:14 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1336 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:14.482288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-534a13ab-264b-4268-9458-bd0c1e24cf20 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "41af874f-bd06-4a71-827d-6d815f202a2b"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-534a13ab-264b-4268-9458-bd0c1e24cf20 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 163 Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: {"server": {"name": 12345, "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "41af874f-bd06-4a71-827d-6d815f202a2b"}]}} Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'a7b14aba-1848-4a00-a3e7-b66eb3e97925', 'flavorRef': '452', 'networks': [{'uuid': '41af874f-bd06-4a71-827d-6d815f202a2b'}]}}} Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 12345 Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:58:14.488211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:58:14.492783 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:58:14.492783 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 25 14:58:14.492783 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:14.492783 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:14.492783 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:14.492783 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:14.492783 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:14.492783 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:14.492783 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:58:14.492783 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:58:14.492783 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 25 14:58:14.492783 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:14.495392 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-534a13ab-264b-4268-9458-bd0c1e24cf20 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:14.497029 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-534a13ab-264b-4268-9458-bd0c1e24cf20 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.018469 Jul 25 14:58:14.497029 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3002/5777] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:58:14 2022] POST /compute/v2.1/servers => generated 127 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:58:14.507951 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bbffeabe-53a3-4874-a76f-2629a96942c1 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:14.509224 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bbffeabe-53a3-4874-a76f-2629a96942c1 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:14.520313 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bbffeabe-53a3-4874-a76f-2629a96942c1 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:14.521084 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bbffeabe-53a3-4874-a76f-2629a96942c1 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:14.522111 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bbffeabe-53a3-4874-a76f-2629a96942c1 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:14.522775 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bbffeabe-53a3-4874-a76f-2629a96942c1 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:14.538534 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-05c09e0c-3bcc-4ac5-b355-289fab079bd7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:14.552855 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-05c09e0c-3bcc-4ac5-b355-289fab079bd7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1680 microversion: 2.1 time: 0.500326 Jul 25 14:58:14.570268 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2776/5778] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:14 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1680 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:14.940499 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-75ba6cd0-f0df-4fec-b85c-697b984c0d4d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:14.941317 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-75ba6cd0-f0df-4fec-b85c-697b984c0d4d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: 40d6fea7-fbd6-49fe-b08a-98e61f3485cb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:14.955120 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-75ba6cd0-f0df-4fec-b85c-697b984c0d4d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:14.958417 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-75ba6cd0-f0df-4fec-b85c-697b984c0d4d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:14.960754 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-75ba6cd0-f0df-4fec-b85c-697b984c0d4d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:14.963613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-75ba6cd0-f0df-4fec-b85c-697b984c0d4d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:14.996555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bbffeabe-53a3-4874-a76f-2629a96942c1 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:15.007593 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bbffeabe-53a3-4874-a76f-2629a96942c1 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.505840 Jul 25 14:58:15.016135 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3003/5779] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:14 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:15.031763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-00a8edf3-b3e9-4ff1-a657-deeba19b7d23 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:15.032419 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-00a8edf3-b3e9-4ff1-a657-deeba19b7d23 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:15.040046 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-00a8edf3-b3e9-4ff1-a657-deeba19b7d23 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:15.040671 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-00a8edf3-b3e9-4ff1-a657-deeba19b7d23 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:15.041256 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-00a8edf3-b3e9-4ff1-a657-deeba19b7d23 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:15.044635 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-00a8edf3-b3e9-4ff1-a657-deeba19b7d23 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:15.306584 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-75ba6cd0-f0df-4fec-b85c-697b984c0d4d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:15.325945 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-75ba6cd0-f0df-4fec-b85c-697b984c0d4d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb" status: 200 len: 1503 microversion: 2.1 time: 0.391749 Jul 25 14:58:15.332724 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2777/5780] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:14 2022] GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb => generated 1503 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:58:15.496540 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7efb568b-6a56-412f-95e3-9a9d6709e56f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:15.497158 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7efb568b-6a56-412f-95e3-9a9d6709e56f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:15.503863 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7efb568b-6a56-412f-95e3-9a9d6709e56f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:15.504631 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7efb568b-6a56-412f-95e3-9a9d6709e56f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:15.505421 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7efb568b-6a56-412f-95e3-9a9d6709e56f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:15.505963 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7efb568b-6a56-412f-95e3-9a9d6709e56f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:15.647775 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7efb568b-6a56-412f-95e3-9a9d6709e56f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:15.659895 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7efb568b-6a56-412f-95e3-9a9d6709e56f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1324 microversion: 2.1 time: 0.167072 Jul 25 14:58:15.661188 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2778/5781] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:15 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1324 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:58:15.667935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6ad99c68-fb33-4d2d-b56e-4c18ce7e8910 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:15.668954 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6ad99c68-fb33-4d2d-b56e-4c18ce7e8910 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:15.681234 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ad99c68-fb33-4d2d-b56e-4c18ce7e8910 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:15.681930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ad99c68-fb33-4d2d-b56e-4c18ce7e8910 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:15.683083 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ad99c68-fb33-4d2d-b56e-4c18ce7e8910 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:15.683552 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ad99c68-fb33-4d2d-b56e-4c18ce7e8910 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:15.715497 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-00a8edf3-b3e9-4ff1-a657-deeba19b7d23 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:15.732216 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-00a8edf3-b3e9-4ff1-a657-deeba19b7d23 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.704276 Jul 25 14:58:15.733674 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3004/5782] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:15 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:58:16.137855 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6ad99c68-fb33-4d2d-b56e-4c18ce7e8910 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:16.156383 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6ad99c68-fb33-4d2d-b56e-4c18ce7e8910 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1680 microversion: 2.1 time: 0.484522 Jul 25 14:58:16.170413 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2779/5783] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:15 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1680 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:16.238923 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-9efcce92-12d4-45b1-9d49-43ff134df046 req-3c2d1dc6-f8c7-4e0e-980a-6e3c4f791edf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d6fea7-fbd6-49fe-b08a-98e61f3485cb", "name": "network-vif-deleted", "tag": "2c7e2572-4d72-43b3-913d-9ce1824c249a"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:16.258636 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-9efcce92-12d4-45b1-9d49-43ff134df046 req-3c2d1dc6-f8c7-4e0e-980a-6e3c4f791edf service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:16.262593 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-9efcce92-12d4-45b1-9d49-43ff134df046 req-3c2d1dc6-f8c7-4e0e-980a-6e3c4f791edf service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:16.312795 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-9efcce92-12d4-45b1-9d49-43ff134df046 req-3c2d1dc6-f8c7-4e0e-980a-6e3c4f791edf service nova] Creating event network-vif-deleted:2c7e2572-4d72-43b3-913d-9ce1824c249a for instance 40d6fea7-fbd6-49fe-b08a-98e61f3485cb on n-h2-846435-14 Jul 25 14:58:16.327870 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-9efcce92-12d4-45b1-9d49-43ff134df046 req-3c2d1dc6-f8c7-4e0e-980a-6e3c4f791edf service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091775 Jul 25 14:58:16.336373 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3005/5784] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:58:16.354782 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-648c422e-5f59-4eb3-be50-ff874fa9a23f tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:16.356220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-648c422e-5f59-4eb3-be50-ff874fa9a23f tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: 40d6fea7-fbd6-49fe-b08a-98e61f3485cb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:16.363856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-648c422e-5f59-4eb3-be50-ff874fa9a23f tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:16.364800 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-648c422e-5f59-4eb3-be50-ff874fa9a23f tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:16.365861 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-648c422e-5f59-4eb3-be50-ff874fa9a23f tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:16.366791 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-648c422e-5f59-4eb3-be50-ff874fa9a23f tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:16.683369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-df032139-759c-42b1-ba42-3efe5b38175d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:16.684128 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-df032139-759c-42b1-ba42-3efe5b38175d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:16.695454 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-df032139-759c-42b1-ba42-3efe5b38175d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:16.695911 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-df032139-759c-42b1-ba42-3efe5b38175d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:16.697507 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-df032139-759c-42b1-ba42-3efe5b38175d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:16.697861 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-df032139-759c-42b1-ba42-3efe5b38175d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:16.818211 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-648c422e-5f59-4eb3-be50-ff874fa9a23f tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b580f876ee76475386429eec6cc68189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490fa4c8a9404273aa12b641cbd83470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:16.830106 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-648c422e-5f59-4eb3-be50-ff874fa9a23f tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb" status: 200 len: 1298 microversion: 2.1 time: 0.479392 Jul 25 14:58:16.848845 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2780/5785] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:16 2022] GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb => generated 1298 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:16.962330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-df032139-759c-42b1-ba42-3efe5b38175d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:16.971047 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-df032139-759c-42b1-ba42-3efe5b38175d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1391 microversion: 2.1 time: 0.291947 Jul 25 14:58:16.971862 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3006/5786] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:16 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1391 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:58:17.177409 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-da2bc122-d8ce-4c87-a23b-e02257b63c45 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:17.183112 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-da2bc122-d8ce-4c87-a23b-e02257b63c45 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:17.207858 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da2bc122-d8ce-4c87-a23b-e02257b63c45 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:17.208364 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da2bc122-d8ce-4c87-a23b-e02257b63c45 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:17.209164 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da2bc122-d8ce-4c87-a23b-e02257b63c45 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:17.212418 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da2bc122-d8ce-4c87-a23b-e02257b63c45 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:17.540671 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-da2bc122-d8ce-4c87-a23b-e02257b63c45 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:17.551674 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-da2bc122-d8ce-4c87-a23b-e02257b63c45 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1680 microversion: 2.1 time: 0.378449 Jul 25 14:58:17.554855 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2781/5787] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:17 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1680 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:17.713422 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-5bc75364-6a42-440f-82ae-04a47def4b5c req-5440f9cd-8331-4107-ae53-fc7c214ed80a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56335d40-d6c2-4292-9547-16a55e66d2dc", "tag": "f01e46b0-4607-4910-97dc-20a41f89640b"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:17.729404 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-5bc75364-6a42-440f-82ae-04a47def4b5c req-5440f9cd-8331-4107-ae53-fc7c214ed80a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:17.730034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-5bc75364-6a42-440f-82ae-04a47def4b5c req-5440f9cd-8331-4107-ae53-fc7c214ed80a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:17.749928 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-5bc75364-6a42-440f-82ae-04a47def4b5c req-5440f9cd-8331-4107-ae53-fc7c214ed80a service nova] Creating event network-changed:f01e46b0-4607-4910-97dc-20a41f89640b for instance 56335d40-d6c2-4292-9547-16a55e66d2dc on n-h1-846435-14 Jul 25 14:58:17.770058 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-5bc75364-6a42-440f-82ae-04a47def4b5c req-5440f9cd-8331-4107-ae53-fc7c214ed80a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063794 Jul 25 14:58:17.771425 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3007/5788] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:58:17.853807 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9d445667-a996-4c28-89aa-f8cabf832a0d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:17.854534 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9d445667-a996-4c28-89aa-f8cabf832a0d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] [instance: 40d6fea7-fbd6-49fe-b08a-98e61f3485cb] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:17.871196 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d445667-a996-4c28-89aa-f8cabf832a0d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:17.871925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d445667-a996-4c28-89aa-f8cabf832a0d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:17.872968 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d445667-a996-4c28-89aa-f8cabf832a0d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:17.873603 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d445667-a996-4c28-89aa-f8cabf832a0d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:17.895141 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-9d445667-a996-4c28-89aa-f8cabf832a0d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] HTTP exception thrown: Instance 40d6fea7-fbd6-49fe-b08a-98e61f3485cb could not be found. Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9d445667-a996-4c28-89aa-f8cabf832a0d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Request method failure captured: Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb HTTP/1.1 Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q9PMNvvNsRtYwjedUqFtMuGik5loz_4iw7X_PLGDvnuDWT4usVMbbe9-YqTU7DCqv00a6JLa3Z3FKqjIm2NUvbEVw4TbWcHPr1Ig0gYUr1nEomUH8rZyoIweGM_ORCE3ReDzQ2fP96RtnnaDl7ij-W8aDXGmm6bPvyEv2zF2uYamLA Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 490fa4c8a9404273aa12b641cbd83470 Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-VolumesActionsTest-1991525498 Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/490fa4c8a9404273aa12b641cbd83470"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/490fa4c8a9404273aa12b641cbd83470"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_490fa4c8a9404273aa12b641cbd83470", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/490fa4c8a9404273aa12b641cbd83470"}]}] Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-VolumesActionsTest-1991525498 Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 490fa4c8a9404273aa12b641cbd83470 Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-VolumesActionsTest-1991525498 Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-VolumesActionsTest-1991525498-project Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: b580f876ee76475386429eec6cc68189 Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-VolumesActionsTest-1991525498-project Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 40d6fea7-fbd6-49fe-b08a-98e61f3485cb could not be found. Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '40d6fea7-fbd6-49fe-b08a-98e61f3485cb'} Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40d6fea7-fbd6-49fe-b08a-98e61f3485cb could not be found. Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40d6fea7-fbd6-49fe-b08a-98e61f3485cb could not be found. Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:17.898746 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:17.903850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:17.903850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:17.903850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:17.903850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:58:17.903850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:58:17.903850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40d6fea7-fbd6-49fe-b08a-98e61f3485cb could not be found. Jul 25 14:58:17.903850 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:17.903850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9d445667-a996-4c28-89aa-f8cabf832a0d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] Returning 404 to user: Instance 40d6fea7-fbd6-49fe-b08a-98e61f3485cb could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:17.903850 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9d445667-a996-4c28-89aa-f8cabf832a0d tempest-VolumesActionsTest-1991525498 tempest-VolumesActionsTest-1991525498-project] 10.222.0.88 "GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb" status: 404 len: 111 microversion: 2.1 time: 0.051729 Jul 25 14:58:17.903850 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2782/5789] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:17 2022] GET /compute/v2.1/servers/40d6fea7-fbd6-49fe-b08a-98e61f3485cb => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:58:18.053042 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0dfc4e9c-03f6-4b85-b58f-79e03172a4ad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:18.054659 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0dfc4e9c-03f6-4b85-b58f-79e03172a4ad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:18.086732 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0dfc4e9c-03f6-4b85-b58f-79e03172a4ad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:18.090583 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0dfc4e9c-03f6-4b85-b58f-79e03172a4ad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:18.092668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0dfc4e9c-03f6-4b85-b58f-79e03172a4ad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:18.095869 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0dfc4e9c-03f6-4b85-b58f-79e03172a4ad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:18.547611 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0dfc4e9c-03f6-4b85-b58f-79e03172a4ad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:18.556341 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0dfc4e9c-03f6-4b85-b58f-79e03172a4ad tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1391 microversion: 2.1 time: 0.538798 Jul 25 14:58:18.559665 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3008/5790] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:17 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1391 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:18.577934 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ec7c33d9-9394-42ea-a605-d67cfd6afefb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:18.578665 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ec7c33d9-9394-42ea-a605-d67cfd6afefb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:18.596242 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec7c33d9-9394-42ea-a605-d67cfd6afefb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:18.596758 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec7c33d9-9394-42ea-a605-d67cfd6afefb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:18.600362 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec7c33d9-9394-42ea-a605-d67cfd6afefb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:18.600825 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec7c33d9-9394-42ea-a605-d67cfd6afefb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:18.744970 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-36b7ee81-c8b5-4af7-b3c5-11c34cfdc109 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-221611714", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "0a7d171a-d2e6-412b-936f-27d0e3ad65fe", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "41af874f-bd06-4a71-827d-6d815f202a2b"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:18.849937 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-36b7ee81-c8b5-4af7-b3c5-11c34cfdc109 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Block Device 0a7d171a-d2e6-412b-936f-27d0e3ad65fe is not bootable. Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-36b7ee81-c8b5-4af7-b3c5-11c34cfdc109 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 357 Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-221611714", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "0a7d171a-d2e6-412b-936f-27d0e3ad65fe", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "41af874f-bd06-4a71-827d-6d815f202a2b"}]}} Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: exception: Block Device 0a7d171a-d2e6-412b-936f-27d0e3ad65fe is not bootable. Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-221611714', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '0a7d171a-d2e6-412b-936f-27d0e3ad65fe'}], 'networks': [{'uuid': '41af874f-bd06-4a71-827d-6d815f202a2b'}]}}} Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 0a7d171a-d2e6-412b-936f-27d0e3ad65fe is not bootable. Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:58:18.867022 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:58:18.873173 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:58:18.873173 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:58:18.873173 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:58:18.873173 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 14:58:18.873173 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 25 14:58:18.873173 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 25 14:58:18.873173 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 0a7d171a-d2e6-412b-936f-27d0e3ad65fe is not bootable. Jul 25 14:58:18.873173 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:18.873173 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:18.873173 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:18.873173 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:18.873173 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:18.873173 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:18.873173 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:58:18.873173 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:58:18.873173 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 0a7d171a-d2e6-412b-936f-27d0e3ad65fe is not bootable. Jul 25 14:58:18.873173 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:18.882759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-36b7ee81-c8b5-4af7-b3c5-11c34cfdc109 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 400 to user: Block Device 0a7d171a-d2e6-412b-936f-27d0e3ad65fe is not bootable. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:18.884969 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-36b7ee81-c8b5-4af7-b3c5-11c34cfdc109 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.146762 Jul 25 14:58:18.885587 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3009/5791] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:58:18 2022] POST /compute/v2.1/servers => generated 110 bytes in 148 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 14:58:18.901166 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-87c0fa5f-0595-4040-a958-ce38d784407c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:18.902162 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-87c0fa5f-0595-4040-a958-ce38d784407c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:18.910210 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-87c0fa5f-0595-4040-a958-ce38d784407c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:18.910908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-87c0fa5f-0595-4040-a958-ce38d784407c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:18.914509 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-87c0fa5f-0595-4040-a958-ce38d784407c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:18.915141 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-87c0fa5f-0595-4040-a958-ce38d784407c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:18.949541 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ec7c33d9-9394-42ea-a605-d67cfd6afefb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:18.966272 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ec7c33d9-9394-42ea-a605-d67cfd6afefb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1680 microversion: 2.1 time: 0.393944 Jul 25 14:58:18.968213 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2783/5792] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:18 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1680 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:19.233102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-87c0fa5f-0595-4040-a958-ce38d784407c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:19.245925 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-87c0fa5f-0595-4040-a958-ce38d784407c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.348880 Jul 25 14:58:19.246471 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3010/5793] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:18 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:19.271846 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-588afe57-ec66-4b44-ac2b-eeb5cfb7d6d0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:19.272776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-588afe57-ec66-4b44-ac2b-eeb5cfb7d6d0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:19.282677 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-588afe57-ec66-4b44-ac2b-eeb5cfb7d6d0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:19.283372 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-588afe57-ec66-4b44-ac2b-eeb5cfb7d6d0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:19.284229 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-588afe57-ec66-4b44-ac2b-eeb5cfb7d6d0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:19.284676 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-588afe57-ec66-4b44-ac2b-eeb5cfb7d6d0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:19.315251 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:58:19.580145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-35c8d2bc-8718-4eb2-8d89-7202c8bd5696 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:19.580816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-35c8d2bc-8718-4eb2-8d89-7202c8bd5696 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:19.588948 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-588afe57-ec66-4b44-ac2b-eeb5cfb7d6d0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:19.596523 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35c8d2bc-8718-4eb2-8d89-7202c8bd5696 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:19.597409 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35c8d2bc-8718-4eb2-8d89-7202c8bd5696 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:19.599078 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-588afe57-ec66-4b44-ac2b-eeb5cfb7d6d0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.332309 Jul 25 14:58:19.600628 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35c8d2bc-8718-4eb2-8d89-7202c8bd5696 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:19.601341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35c8d2bc-8718-4eb2-8d89-7202c8bd5696 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:19.617969 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2784/5794] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:19 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:19.990032 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6760366b-de7f-4bed-9f90-86328e1d363c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:19.991223 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6760366b-de7f-4bed-9f90-86328e1d363c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:19.994898 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:58:20.011611 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6760366b-de7f-4bed-9f90-86328e1d363c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:20.012551 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6760366b-de7f-4bed-9f90-86328e1d363c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:20.015730 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6760366b-de7f-4bed-9f90-86328e1d363c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:20.016977 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6760366b-de7f-4bed-9f90-86328e1d363c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:20.023035 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-35c8d2bc-8718-4eb2-8d89-7202c8bd5696 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:20.044633 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-35c8d2bc-8718-4eb2-8d89-7202c8bd5696 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1391 microversion: 2.1 time: 0.467900 Jul 25 14:58:20.050840 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3011/5795] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:19 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1391 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:20.670642 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6760366b-de7f-4bed-9f90-86328e1d363c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:20.678846 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6760366b-de7f-4bed-9f90-86328e1d363c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1657 microversion: 2.1 time: 0.693676 Jul 25 14:58:20.679457 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2785/5796] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:19 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1657 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:20.710126 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1f54fdbe-7a8e-4b94-ac25-cc1b86b3391a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:20.720533 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1f54fdbe-7a8e-4b94-ac25-cc1b86b3391a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:20.723610 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1f54fdbe-7a8e-4b94-ac25-cc1b86b3391a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:20.788869 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1f54fdbe-7a8e-4b94-ac25-cc1b86b3391a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Going to try to start instance {{(pid=119304) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 14:58:20.873470 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1f54fdbe-7a8e-4b94-ac25-cc1b86b3391a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action" status: 202 len: 0 microversion: 2.1 time: 0.170834 Jul 25 14:58:20.874091 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3012/5797] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:58:20 2022] POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:58:20.882177 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-524e41e0-40ec-4c99-a9de-89f88c174e58 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:20.882781 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-524e41e0-40ec-4c99-a9de-89f88c174e58 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:20.898204 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-524e41e0-40ec-4c99-a9de-89f88c174e58 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:20.898650 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-524e41e0-40ec-4c99-a9de-89f88c174e58 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:20.899486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-524e41e0-40ec-4c99-a9de-89f88c174e58 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:20.899922 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-524e41e0-40ec-4c99-a9de-89f88c174e58 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:21.071827 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dd994783-9401-4d9c-afda-c91123c52b6c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:21.073283 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dd994783-9401-4d9c-afda-c91123c52b6c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:21.083691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd994783-9401-4d9c-afda-c91123c52b6c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:21.086543 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd994783-9401-4d9c-afda-c91123c52b6c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:21.087571 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd994783-9401-4d9c-afda-c91123c52b6c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:21.088522 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd994783-9401-4d9c-afda-c91123c52b6c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:21.138257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:58:21.260407 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-524e41e0-40ec-4c99-a9de-89f88c174e58 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:21.272905 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-524e41e0-40ec-4c99-a9de-89f88c174e58 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1666 microversion: 2.1 time: 0.394588 Jul 25 14:58:21.274447 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2786/5798] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:20 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1666 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:21.722832 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:58:21.892329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dd994783-9401-4d9c-afda-c91123c52b6c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:21.907056 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dd994783-9401-4d9c-afda-c91123c52b6c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1391 microversion: 2.1 time: 0.834423 Jul 25 14:58:21.910357 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3013/5799] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:21 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1391 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:22.296824 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-93555598-1a10-4de2-bf36-75d5f39a3563 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:22.299089 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-93555598-1a10-4de2-bf36-75d5f39a3563 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:22.312972 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93555598-1a10-4de2-bf36-75d5f39a3563 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:22.313768 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93555598-1a10-4de2-bf36-75d5f39a3563 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:22.317445 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93555598-1a10-4de2-bf36-75d5f39a3563 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:22.318976 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-93555598-1a10-4de2-bf36-75d5f39a3563 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:22.781217 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-93555598-1a10-4de2-bf36-75d5f39a3563 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:22.790008 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-93555598-1a10-4de2-bf36-75d5f39a3563 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1666 microversion: 2.1 time: 0.497593 Jul 25 14:58:22.802772 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2787/5800] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:22 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1666 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:22.930743 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-84a57a5f-9901-43dd-8f8a-130bbe92ec55 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:22.932030 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-84a57a5f-9901-43dd-8f8a-130bbe92ec55 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:22.934314 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=8 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:58:22.951664 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-84a57a5f-9901-43dd-8f8a-130bbe92ec55 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:22.952557 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-84a57a5f-9901-43dd-8f8a-130bbe92ec55 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:22.955966 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-84a57a5f-9901-43dd-8f8a-130bbe92ec55 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:22.958643 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-84a57a5f-9901-43dd-8f8a-130bbe92ec55 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:23.340151 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-84a57a5f-9901-43dd-8f8a-130bbe92ec55 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:23.362691 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-84a57a5f-9901-43dd-8f8a-130bbe92ec55 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1391 microversion: 2.1 time: 0.436014 Jul 25 14:58:23.366974 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3014/5801] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:22 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1391 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:23.723073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-92c685fb-39c7-43b1-bf71-423be053230f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1524223421", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "destination_type": "local"}, {"source_type": "volume", "uuid": "e0415755-a9ca-4b73-b90f-b1a6cce601af", "destination_type": "invalid"}], "networks": [{"uuid": "41af874f-bd06-4a71-827d-6d815f202a2b"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-92c685fb-39c7-43b1-bf71-423be053230f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 495 Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1524223421", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "destination_type": "local"}, {"source_type": "volume", "uuid": "e0415755-a9ca-4b73-b90f-b1a6cce601af", "destination_type": "invalid"}], "networks": [{"uuid": "41af874f-bd06-4a71-827d-6d815f202a2b"}]}} Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1524223421', 'imageRef': 'a7b14aba-1848-4a00-a3e7-b66eb3e97925', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'a7b14aba-1848-4a00-a3e7-b66eb3e97925', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'e0415755-a9ca-4b73-b90f-b1a6cce601af', 'destination_type': 'invalid'}], 'networks': [{'uuid': '41af874f-bd06-4a71-827d-6d815f202a2b'}]}}} Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'invalid' Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:23.727664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:23.731667 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:58:23.731667 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:58:23.731667 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:58:23.731667 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:58:23.731667 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:58:23.731667 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:58:23.731667 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:58:23.731667 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:58:23.731667 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 25 14:58:23.731667 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:23.731667 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:23.731667 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:23.731667 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:23.731667 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:23.731667 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:23.731667 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:58:23.731667 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:58:23.731667 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 25 14:58:23.731667 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:23.743658 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-92c685fb-39c7-43b1-bf71-423be053230f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:23.744984 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-92c685fb-39c7-43b1-bf71-423be053230f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.026130 Jul 25 14:58:23.747261 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2788/5802] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:58:23 2022] POST /compute/v2.1/servers => generated 155 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:58:23.754942 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-916d07a6-ea32-4082-8daf-a0e2064bc188 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:23.755882 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-916d07a6-ea32-4082-8daf-a0e2064bc188 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:23.767415 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-916d07a6-ea32-4082-8daf-a0e2064bc188 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:23.778286 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-916d07a6-ea32-4082-8daf-a0e2064bc188 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:23.781507 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-916d07a6-ea32-4082-8daf-a0e2064bc188 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:23.782224 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-916d07a6-ea32-4082-8daf-a0e2064bc188 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:23.822472 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:58:23.829291 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-29dc6b21-7a59-4090-9fab-e257029fdf15 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:23.830228 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-29dc6b21-7a59-4090-9fab-e257029fdf15 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:23.858387 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-29dc6b21-7a59-4090-9fab-e257029fdf15 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:23.858929 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-29dc6b21-7a59-4090-9fab-e257029fdf15 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:23.859738 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-29dc6b21-7a59-4090-9fab-e257029fdf15 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:23.860219 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-29dc6b21-7a59-4090-9fab-e257029fdf15 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:24.118784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-916d07a6-ea32-4082-8daf-a0e2064bc188 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:24.129551 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-916d07a6-ea32-4082-8daf-a0e2064bc188 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.377609 Jul 25 14:58:24.131879 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3015/5803] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:23 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:24.153818 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-118bb405-f8ce-4522-ac6f-034539793998 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:24.161670 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-118bb405-f8ce-4522-ac6f-034539793998 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:24.168755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-118bb405-f8ce-4522-ac6f-034539793998 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:24.172971 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-118bb405-f8ce-4522-ac6f-034539793998 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:24.173991 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-118bb405-f8ce-4522-ac6f-034539793998 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:24.175871 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-118bb405-f8ce-4522-ac6f-034539793998 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:24.494084 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-118bb405-f8ce-4522-ac6f-034539793998 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:24.505115 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-118bb405-f8ce-4522-ac6f-034539793998 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.355082 Jul 25 14:58:24.506515 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3016/5804] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:24 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:58:24.518186 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-52b88d10-ee36-49e5-8709-2eed27f9d2a8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:24.519082 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-52b88d10-ee36-49e5-8709-2eed27f9d2a8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:24.527302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52b88d10-ee36-49e5-8709-2eed27f9d2a8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:24.527920 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52b88d10-ee36-49e5-8709-2eed27f9d2a8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:24.528943 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52b88d10-ee36-49e5-8709-2eed27f9d2a8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:24.529519 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52b88d10-ee36-49e5-8709-2eed27f9d2a8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:24.559915 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-29dc6b21-7a59-4090-9fab-e257029fdf15 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:24.569717 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-29dc6b21-7a59-4090-9fab-e257029fdf15 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.748035 Jul 25 14:58:24.575769 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2789/5805] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:23 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:58:24.596903 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f8e829b5-d4fb-45f7-a293-73f869cd384c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:24.599627 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f8e829b5-d4fb-45f7-a293-73f869cd384c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:24.623934 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8e829b5-d4fb-45f7-a293-73f869cd384c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:24.624733 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8e829b5-d4fb-45f7-a293-73f869cd384c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:24.629640 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8e829b5-d4fb-45f7-a293-73f869cd384c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:24.630298 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8e829b5-d4fb-45f7-a293-73f869cd384c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:24.907019 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f8e829b5-d4fb-45f7-a293-73f869cd384c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:24.921913 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f8e829b5-d4fb-45f7-a293-73f869cd384c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.330539 Jul 25 14:58:24.944407 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2790/5806] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:24 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:58:24.951451 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-015de343-6da8-4e5d-8aad-13b1e2aab02d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-111050540", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "41af874f-bd06-4a71-827d-6d815f202a2b"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-015de343-6da8-4e5d-8aad-13b1e2aab02d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 491 Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-111050540", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "41af874f-bd06-4a71-827d-6d815f202a2b"}]}} Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-111050540', 'imageRef': 'a7b14aba-1848-4a00-a3e7-b66eb3e97925', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '41af874f-bd06-4a71-827d-6d815f202a2b'}]}}} Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:24.956417 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jul 25 14:58:24.960284 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jul 25 14:58:24.960284 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:24.960284 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:24.960284 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:24.960284 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:24.960284 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:24.960284 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:24.960284 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:24.960284 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:24.960284 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:24.960284 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:24.960284 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:58:24.960284 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:58:24.960284 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:58:24.960284 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:58:24.960284 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:58:24.960284 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:58:24.960284 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:58:24.960284 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:58:24.960284 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 25 14:58:24.960284 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:24.960284 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:24.960284 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:24.960284 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:24.960284 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:24.960284 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:24.960284 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:58:24.960284 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:58:24.960284 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 25 14:58:24.960284 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:24.966949 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-015de343-6da8-4e5d-8aad-13b1e2aab02d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:24.968215 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-015de343-6da8-4e5d-8aad-13b1e2aab02d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.022377 Jul 25 14:58:24.969284 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2791/5807] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:58:24 2022] POST /compute/v2.1/servers => generated 624 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:58:24.974455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-a396321c-7bbb-4a57-a9de-8bc4245bb5e3 req-d8433744-d1bd-4965-b3fe-cf3c9190239b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56335d40-d6c2-4292-9547-16a55e66d2dc", "name": "network-vif-plugged", "status": "completed", "tag": "f01e46b0-4607-4910-97dc-20a41f89640b"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:24.988976 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-a396321c-7bbb-4a57-a9de-8bc4245bb5e3 req-d8433744-d1bd-4965-b3fe-cf3c9190239b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:24.989619 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-a396321c-7bbb-4a57-a9de-8bc4245bb5e3 req-d8433744-d1bd-4965-b3fe-cf3c9190239b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:25.008744 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-52b88d10-ee36-49e5-8709-2eed27f9d2a8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:25.019377 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-52b88d10-ee36-49e5-8709-2eed27f9d2a8 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1391 microversion: 2.1 time: 0.511607 Jul 25 14:58:25.024380 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-a396321c-7bbb-4a57-a9de-8bc4245bb5e3 req-d8433744-d1bd-4965-b3fe-cf3c9190239b service nova] Creating event network-vif-plugged:f01e46b0-4607-4910-97dc-20a41f89640b for instance 56335d40-d6c2-4292-9547-16a55e66d2dc on n-h1-846435-14 Jul 25 14:58:25.025601 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3017/5808] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:24 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1391 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:25.030669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9a78cb66-d864-4ce6-8683-6ab52badf2ec tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:25.034545 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9a78cb66-d864-4ce6-8683-6ab52badf2ec tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:25.037924 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-a396321c-7bbb-4a57-a9de-8bc4245bb5e3 req-d8433744-d1bd-4965-b3fe-cf3c9190239b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067207 Jul 25 14:58:25.043825 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2792/5809] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:58:25.052281 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9a78cb66-d864-4ce6-8683-6ab52badf2ec tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:25.056766 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9a78cb66-d864-4ce6-8683-6ab52badf2ec tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:25.060781 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9a78cb66-d864-4ce6-8683-6ab52badf2ec tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:25.061982 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-be5f3ad7-ea84-44e2-9c92-96abf7916ce2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:25.062338 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9a78cb66-d864-4ce6-8683-6ab52badf2ec tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:25.067622 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-be5f3ad7-ea84-44e2-9c92-96abf7916ce2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:25.100310 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-be5f3ad7-ea84-44e2-9c92-96abf7916ce2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:25.111289 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-be5f3ad7-ea84-44e2-9c92-96abf7916ce2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:25.114880 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-be5f3ad7-ea84-44e2-9c92-96abf7916ce2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:25.115907 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-be5f3ad7-ea84-44e2-9c92-96abf7916ce2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:25.191762 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9a78cb66-d864-4ce6-8683-6ab52badf2ec tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Unlocking {{(pid=119304) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 25 14:58:25.272142 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9a78cb66-d864-4ce6-8683-6ab52badf2ec tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action" status: 202 len: 0 microversion: 2.1 time: 0.244657 Jul 25 14:58:25.281534 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3018/5810] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:58:25 2022] POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:58:25.291820 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-711dc4c9-abd8-43c4-8596-7147a0d0ef61 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:25.293003 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-711dc4c9-abd8-43c4-8596-7147a0d0ef61 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:25.307635 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-711dc4c9-abd8-43c4-8596-7147a0d0ef61 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:25.309023 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-711dc4c9-abd8-43c4-8596-7147a0d0ef61 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:25.310900 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-711dc4c9-abd8-43c4-8596-7147a0d0ef61 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:25.312155 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-711dc4c9-abd8-43c4-8596-7147a0d0ef61 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:25.510714 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-711dc4c9-abd8-43c4-8596-7147a0d0ef61 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:25.522409 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-711dc4c9-abd8-43c4-8596-7147a0d0ef61 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.238458 Jul 25 14:58:25.540749 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3019/5811] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:25 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:25.548082 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-16cc66cf-b0fe-4407-bc4b-2036ecdac380 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:25.549130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-16cc66cf-b0fe-4407-bc4b-2036ecdac380 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:25.556514 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-16cc66cf-b0fe-4407-bc4b-2036ecdac380 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:25.557083 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-16cc66cf-b0fe-4407-bc4b-2036ecdac380 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:25.558140 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-16cc66cf-b0fe-4407-bc4b-2036ecdac380 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:25.558582 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-16cc66cf-b0fe-4407-bc4b-2036ecdac380 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:25.770294 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-16cc66cf-b0fe-4407-bc4b-2036ecdac380 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:25.791706 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-16cc66cf-b0fe-4407-bc4b-2036ecdac380 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.238166 Jul 25 14:58:25.794446 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3020/5812] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:25 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:25.822545 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-db0794d1-c4b5-47d9-96ab-9826603bd49d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:25.823194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-db0794d1-c4b5-47d9-96ab-9826603bd49d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:25.834585 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db0794d1-c4b5-47d9-96ab-9826603bd49d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:25.835032 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db0794d1-c4b5-47d9-96ab-9826603bd49d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:25.835921 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db0794d1-c4b5-47d9-96ab-9826603bd49d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:25.836385 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db0794d1-c4b5-47d9-96ab-9826603bd49d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:26.106510 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-db0794d1-c4b5-47d9-96ab-9826603bd49d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:26.115538 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-db0794d1-c4b5-47d9-96ab-9826603bd49d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.303677 Jul 25 14:58:26.116723 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3021/5813] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:25 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:26.121588 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ee31247e-80df-4465-b5ee-db44238baca9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:26.122415 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ee31247e-80df-4465-b5ee-db44238baca9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:26.130353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee31247e-80df-4465-b5ee-db44238baca9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:26.131095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee31247e-80df-4465-b5ee-db44238baca9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:26.132112 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee31247e-80df-4465-b5ee-db44238baca9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:26.132705 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee31247e-80df-4465-b5ee-db44238baca9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:26.256740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-be5f3ad7-ea84-44e2-9c92-96abf7916ce2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:26.266624 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-be5f3ad7-ea84-44e2-9c92-96abf7916ce2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 1.219034 Jul 25 14:58:26.271434 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2793/5814] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:25 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:26.278522 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7db7e79a-98d0-4918-8afe-e714c442fde9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:26.279402 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7db7e79a-98d0-4918-8afe-e714c442fde9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:26.296454 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7db7e79a-98d0-4918-8afe-e714c442fde9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:26.297482 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7db7e79a-98d0-4918-8afe-e714c442fde9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:26.298706 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7db7e79a-98d0-4918-8afe-e714c442fde9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:26.299535 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7db7e79a-98d0-4918-8afe-e714c442fde9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:26.504314 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7db7e79a-98d0-4918-8afe-e714c442fde9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action" status: 202 len: 0 microversion: 2.1 time: 0.231202 Jul 25 14:58:26.509498 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ee31247e-80df-4465-b5ee-db44238baca9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:26.512446 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2794/5815] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:58:26 2022] POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:58:26.520496 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3371bd07-7802-488e-a1be-ea9a591a759f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:26.523899 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ee31247e-80df-4465-b5ee-db44238baca9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1391 microversion: 2.1 time: 0.405896 Jul 25 14:58:26.524608 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3022/5816] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:26 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1391 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:26.529254 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3371bd07-7802-488e-a1be-ea9a591a759f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:26.538541 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0eeee899-3f8c-4905-8e5a-ef973763b136 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:26.539241 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0eeee899-3f8c-4905-8e5a-ef973763b136 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:26.548400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3371bd07-7802-488e-a1be-ea9a591a759f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:26.549486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3371bd07-7802-488e-a1be-ea9a591a759f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:26.550600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3371bd07-7802-488e-a1be-ea9a591a759f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:26.551243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0eeee899-3f8c-4905-8e5a-ef973763b136 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:26.551682 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3371bd07-7802-488e-a1be-ea9a591a759f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:26.551806 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0eeee899-3f8c-4905-8e5a-ef973763b136 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:26.552688 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0eeee899-3f8c-4905-8e5a-ef973763b136 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:26.553210 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0eeee899-3f8c-4905-8e5a-ef973763b136 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:26.793664 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3371bd07-7802-488e-a1be-ea9a591a759f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:26.802838 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3371bd07-7802-488e-a1be-ea9a591a759f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.287148 Jul 25 14:58:26.808848 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2795/5817] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:26 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:26.909476 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4b5e043b-c6fc-42a3-b5c8-d06b9f824536 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "41af874f-bd06-4a71-827d-6d815f202a2b"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4b5e043b-c6fc-42a3-b5c8-d06b9f824536 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 416 Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "41af874f-bd06-4a71-827d-6d815f202a2b"}]}} Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'a7b14aba-1848-4a00-a3e7-b66eb3e97925', 'flavorRef': '452', 'networks': [{'uuid': '41af874f-bd06-4a71-827d-6d815f202a2b'}]}}} Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:26.913718 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:26.922405 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:26.922405 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:26.922405 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:26.922405 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:26.922405 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:26.922405 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:26.922405 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:26.922405 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:26.922405 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:58:26.922405 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:58:26.922405 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:58:26.922405 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:58:26.922405 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:58:26.922405 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:58:26.922405 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:58:26.922405 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:58:26.922405 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 14:58:26.922405 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:26.922405 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:26.922405 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:26.922405 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:26.922405 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:26.922405 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:26.922405 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:58:26.922405 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:58:26.922405 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 14:58:26.922405 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:26.922405 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4b5e043b-c6fc-42a3-b5c8-d06b9f824536 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:26.922405 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4b5e043b-c6fc-42a3-b5c8-d06b9f824536 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.010055 Jul 25 14:58:26.922405 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2796/5818] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:58:26 2022] POST /compute/v2.1/servers => generated 619 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:58:26.926639 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0d639972-08be-4ee0-bc79-c36f69c79f65 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:26.927047 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0d639972-08be-4ee0-bc79-c36f69c79f65 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:26.946123 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0d639972-08be-4ee0-bc79-c36f69c79f65 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:26.946960 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0d639972-08be-4ee0-bc79-c36f69c79f65 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:26.948014 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0d639972-08be-4ee0-bc79-c36f69c79f65 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:26.953137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0eeee899-3f8c-4905-8e5a-ef973763b136 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:26.955893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0d639972-08be-4ee0-bc79-c36f69c79f65 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:26.967361 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0eeee899-3f8c-4905-8e5a-ef973763b136 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1675 microversion: 2.1 time: 0.440927 Jul 25 14:58:26.981367 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3023/5819] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:26 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1675 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:27.244428 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0d639972-08be-4ee0-bc79-c36f69c79f65 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:27.257280 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0d639972-08be-4ee0-bc79-c36f69c79f65 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.336729 Jul 25 14:58:27.258926 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2797/5820] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:26 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:27.284118 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-58b5db57-f433-43f7-a875-6a578c251e3d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:27.285037 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-58b5db57-f433-43f7-a875-6a578c251e3d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:27.291802 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-58b5db57-f433-43f7-a875-6a578c251e3d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:27.292555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-58b5db57-f433-43f7-a875-6a578c251e3d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:27.293995 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-58b5db57-f433-43f7-a875-6a578c251e3d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:27.294604 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-58b5db57-f433-43f7-a875-6a578c251e3d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:27.545189 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cb4dd5c1-3e98-459b-9e5a-f2c82f2aa845 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:27.545806 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cb4dd5c1-3e98-459b-9e5a-f2c82f2aa845 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:27.558255 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cb4dd5c1-3e98-459b-9e5a-f2c82f2aa845 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:27.558934 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cb4dd5c1-3e98-459b-9e5a-f2c82f2aa845 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:27.559916 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cb4dd5c1-3e98-459b-9e5a-f2c82f2aa845 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:27.564372 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cb4dd5c1-3e98-459b-9e5a-f2c82f2aa845 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:27.845998 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cb4dd5c1-3e98-459b-9e5a-f2c82f2aa845 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:27.856478 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cb4dd5c1-3e98-459b-9e5a-f2c82f2aa845 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1563 microversion: 2.1 time: 0.313418 Jul 25 14:58:27.857763 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2798/5821] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:27 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1563 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:27.881928 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-becbad9a-6fd9-4e25-8086-883a6f393d5b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:27.882558 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-becbad9a-6fd9-4e25-8086-883a6f393d5b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:27.891363 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-becbad9a-6fd9-4e25-8086-883a6f393d5b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:27.891815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-becbad9a-6fd9-4e25-8086-883a6f393d5b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:27.892644 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-becbad9a-6fd9-4e25-8086-883a6f393d5b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:27.893077 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-becbad9a-6fd9-4e25-8086-883a6f393d5b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:28.211330 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-becbad9a-6fd9-4e25-8086-883a6f393d5b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:28.224176 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-becbad9a-6fd9-4e25-8086-883a6f393d5b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1563 microversion: 2.1 time: 0.344589 Jul 25 14:58:28.228777 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2799/5822] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:27 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1563 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:28.244649 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-799290da-b9f2-4cfd-a192-7f1b026d6596 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:28.245476 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-799290da-b9f2-4cfd-a192-7f1b026d6596 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:28.266604 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-799290da-b9f2-4cfd-a192-7f1b026d6596 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:28.268833 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-799290da-b9f2-4cfd-a192-7f1b026d6596 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:28.273559 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-799290da-b9f2-4cfd-a192-7f1b026d6596 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:28.275356 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-799290da-b9f2-4cfd-a192-7f1b026d6596 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:28.406165 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-58b5db57-f433-43f7-a875-6a578c251e3d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:28.420205 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-58b5db57-f433-43f7-a875-6a578c251e3d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 1.140239 Jul 25 14:58:28.437462 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3024/5823] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:27 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:28.491821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-36051ed6-0566-4842-b54c-1c6cb20d720f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1312774243", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": -1, "networks": [{"uuid": "41af874f-bd06-4a71-827d-6d815f202a2b"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:28.507709 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-36051ed6-0566-4842-b54c-1c6cb20d720f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Flavor -1 could not be found. Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-36051ed6-0566-4842-b54c-1c6cb20d720f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 206 Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1312774243", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": -1, "networks": [{"uuid": "41af874f-bd06-4a71-827d-6d815f202a2b"}]}} Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: exception: Flavor -1 could not be found. Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1312774243', 'imageRef': 'a7b14aba-1848-4a00-a3e7-b66eb3e97925', 'flavorRef': -1, 'networks': [{'uuid': '41af874f-bd06-4a71-827d-6d815f202a2b'}]}}} Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:58:28.518131 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:58:28.522899 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:58:28.522899 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:58:28.522899 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:58:28.522899 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:58:28.522899 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 14:58:28.522899 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 25 14:58:28.522899 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 25 14:58:28.522899 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jul 25 14:58:28.522899 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:28.522899 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:28.522899 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:28.522899 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:28.522899 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:28.522899 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:28.522899 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:58:28.522899 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:58:28.522899 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jul 25 14:58:28.522899 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:28.526247 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-36051ed6-0566-4842-b54c-1c6cb20d720f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:28.529095 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-36051ed6-0566-4842-b54c-1c6cb20d720f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.039957 Jul 25 14:58:28.529890 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3025/5824] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:58:28 2022] POST /compute/v2.1/servers => generated 73 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 14:58:28.542944 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fdccf467-4da1-4a8c-b030-3124dc02ebdb tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:28.546467 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fdccf467-4da1-4a8c-b030-3124dc02ebdb tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:28.554768 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fdccf467-4da1-4a8c-b030-3124dc02ebdb tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:28.555879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fdccf467-4da1-4a8c-b030-3124dc02ebdb tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:28.557517 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fdccf467-4da1-4a8c-b030-3124dc02ebdb tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:28.558164 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fdccf467-4da1-4a8c-b030-3124dc02ebdb tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:28.832095 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-799290da-b9f2-4cfd-a192-7f1b026d6596 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:28.845699 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-799290da-b9f2-4cfd-a192-7f1b026d6596 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1655 microversion: 2.1 time: 0.612440 Jul 25 14:58:28.846823 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2800/5825] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:28 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1655 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:28.866293 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fdccf467-4da1-4a8c-b030-3124dc02ebdb tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:28.876851 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-46338ea2-a3da-4b0a-ad4e-5525b1a429d8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:28.877907 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-46338ea2-a3da-4b0a-ad4e-5525b1a429d8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:28.878419 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fdccf467-4da1-4a8c-b030-3124dc02ebdb tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.343733 Jul 25 14:58:28.879039 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3026/5826] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:28 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:28.906821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0e682dc1-7a50-4a68-9c0a-bfb88aa073e1 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:28.907433 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0e682dc1-7a50-4a68-9c0a-bfb88aa073e1 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:28.909643 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46338ea2-a3da-4b0a-ad4e-5525b1a429d8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:28.917422 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46338ea2-a3da-4b0a-ad4e-5525b1a429d8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:28.925625 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0e682dc1-7a50-4a68-9c0a-bfb88aa073e1 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:28.926829 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0e682dc1-7a50-4a68-9c0a-bfb88aa073e1 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:28.927766 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0e682dc1-7a50-4a68-9c0a-bfb88aa073e1 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:28.928496 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46338ea2-a3da-4b0a-ad4e-5525b1a429d8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:28.928629 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0e682dc1-7a50-4a68-9c0a-bfb88aa073e1 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:28.929219 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46338ea2-a3da-4b0a-ad4e-5525b1a429d8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:29.150259 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-46338ea2-a3da-4b0a-ad4e-5525b1a429d8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action" status: 202 len: 0 microversion: 2.1 time: 0.275135 Jul 25 14:58:29.152728 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2801/5827] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:58:28 2022] POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:58:29.163520 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e231254b-9793-4728-b2f3-514416a1d5dd tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:29.175218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e231254b-9793-4728-b2f3-514416a1d5dd tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:29.219691 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e231254b-9793-4728-b2f3-514416a1d5dd tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:29.221721 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e231254b-9793-4728-b2f3-514416a1d5dd tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:29.224181 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e231254b-9793-4728-b2f3-514416a1d5dd tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:29.230345 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e231254b-9793-4728-b2f3-514416a1d5dd tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:29.275585 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0e682dc1-7a50-4a68-9c0a-bfb88aa073e1 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:29.290726 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0e682dc1-7a50-4a68-9c0a-bfb88aa073e1 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.387694 Jul 25 14:58:29.326731 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3027/5828] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:28 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:29.405675 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2035b1d9-3290-4005-ad4e-38801be61e85 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-405658932", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "41af874f-bd06-4a71-827d-6d815f202a2b"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2035b1d9-3290-4005-ad4e-38801be61e85 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 172 Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-405658932", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "41af874f-bd06-4a71-827d-6d815f202a2b"}]}} Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-405658932', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '41af874f-bd06-4a71-827d-6d815f202a2b'}]}}} Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi -1 Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:58:29.410668 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:58:29.415227 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:58:29.415227 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:58:29.415227 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 25 14:58:29.415227 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:29.415227 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:29.415227 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:29.415227 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:29.415227 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:29.415227 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:29.415227 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:58:29.415227 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:58:29.415227 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 25 14:58:29.415227 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:29.420536 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2035b1d9-3290-4005-ad4e-38801be61e85 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:29.423197 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2035b1d9-3290-4005-ad4e-38801be61e85 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.022808 Jul 25 14:58:29.429978 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3028/5829] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:58:29 2022] POST /compute/v2.1/servers => generated 145 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:58:29.435566 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4703618e-7221-4b2c-9736-f8ea2478486b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:29.442596 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4703618e-7221-4b2c-9736-f8ea2478486b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:29.464709 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4703618e-7221-4b2c-9736-f8ea2478486b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:29.465522 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4703618e-7221-4b2c-9736-f8ea2478486b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:29.472869 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4703618e-7221-4b2c-9736-f8ea2478486b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:29.473560 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4703618e-7221-4b2c-9736-f8ea2478486b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:29.757092 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e231254b-9793-4728-b2f3-514416a1d5dd tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:29.769263 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:58:29.793898 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e231254b-9793-4728-b2f3-514416a1d5dd tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1662 microversion: 2.1 time: 0.635227 Jul 25 14:58:29.794860 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2802/5830] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:29 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1662 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:29.825240 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4703618e-7221-4b2c-9736-f8ea2478486b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:29.828406 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:58:29.844071 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4703618e-7221-4b2c-9736-f8ea2478486b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.412489 Jul 25 14:58:29.844960 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3029/5831] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:29 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:29.869063 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6e27284e-b7c4-4109-9c0a-48ee23acb122 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:29.870041 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6e27284e-b7c4-4109-9c0a-48ee23acb122 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:29.879423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e27284e-b7c4-4109-9c0a-48ee23acb122 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:29.880231 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e27284e-b7c4-4109-9c0a-48ee23acb122 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:29.881466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e27284e-b7c4-4109-9c0a-48ee23acb122 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:29.882102 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e27284e-b7c4-4109-9c0a-48ee23acb122 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:30.211216 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6e27284e-b7c4-4109-9c0a-48ee23acb122 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:30.225254 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6e27284e-b7c4-4109-9c0a-48ee23acb122 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.360172 Jul 25 14:58:30.240084 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2803/5832] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:29 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:30.343103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ebd12284-e054-4158-a43f-5460a00c3a33 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1793138545", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:30.348601 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-ebd12284-e054-4158-a43f-5460a00c3a33 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ebd12284-e054-4158-a43f-5460a00c3a33 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 216 Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1793138545", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1793138545', 'imageRef': 'a7b14aba-1848-4a00-a3e7-b66eb3e97925', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:30.355533 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:30.360035 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:30.360035 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:30.360035 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:30.360035 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:58:30.360035 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:58:30.360035 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 25 14:58:30.360035 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:30.365538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ebd12284-e054-4158-a43f-5460a00c3a33 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:30.367710 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ebd12284-e054-4158-a43f-5460a00c3a33 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.030463 Jul 25 14:58:30.371066 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3030/5833] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:58:30 2022] POST /compute/v2.1/servers => generated 123 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 14:58:30.379600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6d24770d-6189-4c8d-8dab-75aaffbd46d2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:30.380642 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6d24770d-6189-4c8d-8dab-75aaffbd46d2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:30.399217 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6d24770d-6189-4c8d-8dab-75aaffbd46d2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:30.408096 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6d24770d-6189-4c8d-8dab-75aaffbd46d2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:30.414551 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6d24770d-6189-4c8d-8dab-75aaffbd46d2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:30.415692 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6d24770d-6189-4c8d-8dab-75aaffbd46d2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:30.816305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-02169dff-1d90-40c8-be68-9244efb483f7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:30.817610 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-02169dff-1d90-40c8-be68-9244efb483f7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:30.851755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-02169dff-1d90-40c8-be68-9244efb483f7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:30.852356 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-02169dff-1d90-40c8-be68-9244efb483f7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:30.853213 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-02169dff-1d90-40c8-be68-9244efb483f7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:30.860742 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-02169dff-1d90-40c8-be68-9244efb483f7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:30.908966 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6d24770d-6189-4c8d-8dab-75aaffbd46d2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:30.923724 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6d24770d-6189-4c8d-8dab-75aaffbd46d2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.548142 Jul 25 14:58:30.926478 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2804/5834] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:30 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:30.957111 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5645484b-bd3d-4c8a-acd8-ae2d97a46f9d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:30.958009 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5645484b-bd3d-4c8a-acd8-ae2d97a46f9d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:30.966758 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5645484b-bd3d-4c8a-acd8-ae2d97a46f9d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:30.967587 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5645484b-bd3d-4c8a-acd8-ae2d97a46f9d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:30.970003 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5645484b-bd3d-4c8a-acd8-ae2d97a46f9d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:30.971391 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5645484b-bd3d-4c8a-acd8-ae2d97a46f9d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:31.380046 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5645484b-bd3d-4c8a-acd8-ae2d97a46f9d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:31.392991 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5645484b-bd3d-4c8a-acd8-ae2d97a46f9d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.442965 Jul 25 14:58:31.396297 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2805/5835] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:30 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:31.507165 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b6ae9475-fa7d-4750-810f-443b25834762 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1319484788", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "key_name": "tempest-key-785188033", "networks": [{"uuid": "41af874f-bd06-4a71-827d-6d815f202a2b"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:31.615246 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-b6ae9475-fa7d-4750-810f-443b25834762 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] validate_networks() for [('41af874f-bd06-4a71-827d-6d815f202a2b', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:58:31.726529 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-02169dff-1d90-40c8-be68-9244efb483f7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:31.734822 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-02169dff-1d90-40c8-be68-9244efb483f7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.922500 Jul 25 14:58:31.738568 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3031/5836] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:30 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:58:31.766946 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3948a749-e30e-4c14-9e20-80761ce39654 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:31.768264 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3948a749-e30e-4c14-9e20-80761ce39654 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:31.797527 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3948a749-e30e-4c14-9e20-80761ce39654 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:31.798447 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3948a749-e30e-4c14-9e20-80761ce39654 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:31.799638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3948a749-e30e-4c14-9e20-80761ce39654 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:31.800399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3948a749-e30e-4c14-9e20-80761ce39654 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:32.064422 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-b6ae9475-fa7d-4750-810f-443b25834762 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Invalid key_name provided. Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b6ae9475-fa7d-4750-810f-443b25834762 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 246 Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1319484788", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "key_name": "tempest-key-785188033", "networks": [{"uuid": "41af874f-bd06-4a71-827d-6d815f202a2b"}]}} Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: exception: Invalid key_name provided. Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1319484788', 'imageRef': 'a7b14aba-1848-4a00-a3e7-b66eb3e97925', 'flavorRef': '452', 'key_name': 'tempest-key-785188033', 'networks': [{'uuid': '41af874f-bd06-4a71-827d-6d815f202a2b'}]}}} Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-785188033 not found for user a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:32.076271 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:32.083110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:32.083110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:32.083110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:32.083110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:32.083110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:32.083110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:58:32.083110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:58:32.083110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:58:32.083110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:58:32.083110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:58:32.083110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:58:32.083110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 14:58:32.083110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Jul 25 14:58:32.083110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 25 14:58:32.083110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jul 25 14:58:32.083110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:32.083110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:32.083110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:32.083110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:32.083110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:32.083110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:32.083110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:58:32.083110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:58:32.083110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jul 25 14:58:32.083110 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:32.088756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b6ae9475-fa7d-4750-810f-443b25834762 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 400 to user: Invalid key_name provided. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:32.090251 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b6ae9475-fa7d-4750-810f-443b25834762 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.587879 Jul 25 14:58:32.091206 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2806/5837] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:58:31 2022] POST /compute/v2.1/servers => generated 70 bytes in 590 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 25 14:58:32.103206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3f19d58c-4ced-4f0f-9340-73776638ed5e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:32.104788 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3f19d58c-4ced-4f0f-9340-73776638ed5e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:32.127538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3f19d58c-4ced-4f0f-9340-73776638ed5e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:32.128725 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3f19d58c-4ced-4f0f-9340-73776638ed5e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:32.131907 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3f19d58c-4ced-4f0f-9340-73776638ed5e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:32.138893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3f19d58c-4ced-4f0f-9340-73776638ed5e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:32.411200 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3948a749-e30e-4c14-9e20-80761ce39654 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:32.434187 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3948a749-e30e-4c14-9e20-80761ce39654 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.671290 Jul 25 14:58:32.440557 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3032/5838] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:31 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:32.469175 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8010e2ae-dc5d-4faf-a7cd-de2b57a44549 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:32.470185 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8010e2ae-dc5d-4faf-a7cd-de2b57a44549 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:32.490963 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8010e2ae-dc5d-4faf-a7cd-de2b57a44549 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:32.505462 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8010e2ae-dc5d-4faf-a7cd-de2b57a44549 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:32.506530 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8010e2ae-dc5d-4faf-a7cd-de2b57a44549 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:32.515548 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8010e2ae-dc5d-4faf-a7cd-de2b57a44549 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:32.908899 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3f19d58c-4ced-4f0f-9340-73776638ed5e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:32.923575 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3f19d58c-4ced-4f0f-9340-73776638ed5e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.827394 Jul 25 14:58:32.932393 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2807/5839] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:32 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:32.960548 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-60efc657-e7d9-4b23-89ce-726483e9cab0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:32.961288 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-60efc657-e7d9-4b23-89ce-726483e9cab0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:32.981911 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-60efc657-e7d9-4b23-89ce-726483e9cab0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:32.982447 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-60efc657-e7d9-4b23-89ce-726483e9cab0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:32.985108 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-60efc657-e7d9-4b23-89ce-726483e9cab0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:32.990304 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-60efc657-e7d9-4b23-89ce-726483e9cab0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:33.033862 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8010e2ae-dc5d-4faf-a7cd-de2b57a44549 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:33.042018 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8010e2ae-dc5d-4faf-a7cd-de2b57a44549 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.577723 Jul 25 14:58:33.050115 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3033/5840] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:32 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:33.067143 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-37bf4561-ab56-4785-9d2d-6649bfe8b608 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:33.071489 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-37bf4561-ab56-4785-9d2d-6649bfe8b608 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:33.100000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37bf4561-ab56-4785-9d2d-6649bfe8b608 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:33.120561 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37bf4561-ab56-4785-9d2d-6649bfe8b608 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:33.125172 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37bf4561-ab56-4785-9d2d-6649bfe8b608 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:33.125931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37bf4561-ab56-4785-9d2d-6649bfe8b608 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:33.540908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-37bf4561-ab56-4785-9d2d-6649bfe8b608 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:33.549591 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-37bf4561-ab56-4785-9d2d-6649bfe8b608 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.486193 Jul 25 14:58:33.554724 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3034/5841] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:33 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:33.579943 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1b4cb366-a732-47a5-893c-a42dc9e34e4c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:33.580854 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1b4cb366-a732-47a5-893c-a42dc9e34e4c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:33.605226 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1b4cb366-a732-47a5-893c-a42dc9e34e4c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:33.606058 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1b4cb366-a732-47a5-893c-a42dc9e34e4c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:33.607010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1b4cb366-a732-47a5-893c-a42dc9e34e4c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:33.607876 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1b4cb366-a732-47a5-893c-a42dc9e34e4c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:33.796844 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-60efc657-e7d9-4b23-89ce-726483e9cab0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:33.810701 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-60efc657-e7d9-4b23-89ce-726483e9cab0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.858568 Jul 25 14:58:33.811317 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2808/5842] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:32 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:58:33.832266 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-881eaec4-5f86-4724-8508-8f151f9565bc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:33.832995 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-881eaec4-5f86-4724-8508-8f151f9565bc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:33.860311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-881eaec4-5f86-4724-8508-8f151f9565bc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:33.860765 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-881eaec4-5f86-4724-8508-8f151f9565bc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:33.861562 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-881eaec4-5f86-4724-8508-8f151f9565bc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:33.862003 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-881eaec4-5f86-4724-8508-8f151f9565bc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:34.212995 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1b4cb366-a732-47a5-893c-a42dc9e34e4c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:34.223731 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1b4cb366-a732-47a5-893c-a42dc9e34e4c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.650366 Jul 25 14:58:34.229172 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3035/5843] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:33 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:34.241009 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-881eaec4-5f86-4724-8508-8f151f9565bc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:34.241009 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-881eaec4-5f86-4724-8508-8f151f9565bc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1563 microversion: 2.1 time: 0.427786 Jul 25 14:58:34.255297 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-f1a7974f-750a-4a2d-b7b1-5df312864687 req-38cb12e1-f92e-4b05-a1eb-e363f539db6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56335d40-d6c2-4292-9547-16a55e66d2dc", "tag": "f01e46b0-4607-4910-97dc-20a41f89640b"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:34.266560 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2809/5844] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:33 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1563 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:34.285165 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-66997b40-5b0c-4b2b-8429-f71bf72f79f9 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2032149794", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "41af874f-bd06-4a71-827d-6d815f202a2b"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:34.296482 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-f1a7974f-750a-4a2d-b7b1-5df312864687 req-38cb12e1-f92e-4b05-a1eb-e363f539db6b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:34.296930 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-f1a7974f-750a-4a2d-b7b1-5df312864687 req-38cb12e1-f92e-4b05-a1eb-e363f539db6b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:34.361097 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-f1a7974f-750a-4a2d-b7b1-5df312864687 req-38cb12e1-f92e-4b05-a1eb-e363f539db6b service nova] Creating event network-changed:f01e46b0-4607-4910-97dc-20a41f89640b for instance 56335d40-d6c2-4292-9547-16a55e66d2dc on n-h1-846435-14 Jul 25 14:58:34.389067 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-f1a7974f-750a-4a2d-b7b1-5df312864687 req-38cb12e1-f92e-4b05-a1eb-e363f539db6b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138865 Jul 25 14:58:34.392749 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3036/5845] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:58:34.415997 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-aea8d5a4-7379-4c32-b553-3f2a191cf69c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:34.417874 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-aea8d5a4-7379-4c32-b553-3f2a191cf69c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:34.443618 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aea8d5a4-7379-4c32-b553-3f2a191cf69c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:34.449739 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aea8d5a4-7379-4c32-b553-3f2a191cf69c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:34.450702 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aea8d5a4-7379-4c32-b553-3f2a191cf69c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:34.456336 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aea8d5a4-7379-4c32-b553-3f2a191cf69c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:35.073060 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-aea8d5a4-7379-4c32-b553-3f2a191cf69c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:35.087966 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-aea8d5a4-7379-4c32-b553-3f2a191cf69c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.692205 Jul 25 14:58:35.090017 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3037/5846] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:34 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:35.335355 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.security_group_api [None req-66997b40-5b0c-4b2b-8429-f71bf72f79f9 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Neutron security group does_not_exist not found {{(pid=119303) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jul 25 14:58:35.336669 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-66997b40-5b0c-4b2b-8429-f71bf72f79f9 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-66997b40-5b0c-4b2b-8429-f71bf72f79f9 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 258 Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2032149794", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "41af874f-bd06-4a71-827d-6d815f202a2b"}]}} Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: exception: Unable to find security_group with name or id 'does_not_exist' Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2032149794', 'imageRef': 'a7b14aba-1848-4a00-a3e7-b66eb3e97925', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '41af874f-bd06-4a71-827d-6d815f202a2b'}]}}} Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jul 25 14:58:35.390536 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:35.394865 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-66997b40-5b0c-4b2b-8429-f71bf72f79f9 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:35.401516 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-66997b40-5b0c-4b2b-8429-f71bf72f79f9 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 1.126222 Jul 25 14:58:35.401516 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2810/5847] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:58:34 2022] POST /compute/v2.1/servers => generated 106 bytes in 1128 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:58:35.408765 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-12b298fc-0e1a-4165-9b4a-f6b448f69f03 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:35.409713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-12b298fc-0e1a-4165-9b4a-f6b448f69f03 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:35.422823 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-12b298fc-0e1a-4165-9b4a-f6b448f69f03 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:35.424095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-12b298fc-0e1a-4165-9b4a-f6b448f69f03 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:35.425234 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-12b298fc-0e1a-4165-9b4a-f6b448f69f03 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:35.426379 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-12b298fc-0e1a-4165-9b4a-f6b448f69f03 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:36.020611 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-12b298fc-0e1a-4165-9b4a-f6b448f69f03 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:36.044090 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-12b298fc-0e1a-4165-9b4a-f6b448f69f03 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.636413 Jul 25 14:58:36.048318 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3038/5848] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:35 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:36.077917 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c8b2ff15-003b-40d6-a081-f86ad2cd897e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:36.078858 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c8b2ff15-003b-40d6-a081-f86ad2cd897e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:36.088573 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c8b2ff15-003b-40d6-a081-f86ad2cd897e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:36.092080 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c8b2ff15-003b-40d6-a081-f86ad2cd897e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:36.094650 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c8b2ff15-003b-40d6-a081-f86ad2cd897e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:36.097678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c8b2ff15-003b-40d6-a081-f86ad2cd897e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:36.651052 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c8b2ff15-003b-40d6-a081-f86ad2cd897e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:36.667260 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c8b2ff15-003b-40d6-a081-f86ad2cd897e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.592223 Jul 25 14:58:36.671457 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2811/5849] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:36 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:36.693612 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fb46add2-5a3c-4007-981b-fef7a781a0b2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:36.694215 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fb46add2-5a3c-4007-981b-fef7a781a0b2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 6b2b10dd-eb4b-4df6-bad5-39aff608f906] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:36.718056 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-fb46add2-5a3c-4007-981b-fef7a781a0b2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Instance 6b2b10dd-eb4b-4df6-bad5-39aff608f906 could not be found. Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fb46add2-5a3c-4007-981b-fef7a781a0b2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/6b2b10dd-eb4b-4df6-bad5-39aff608f906 HTTP/1.1 Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 6b2b10dd-eb4b-4df6-bad5-39aff608f906 could not be found. Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '6b2b10dd-eb4b-4df6-bad5-39aff608f906'} Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b2b10dd-eb4b-4df6-bad5-39aff608f906 could not be found. Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b2b10dd-eb4b-4df6-bad5-39aff608f906 could not be found. Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:36.721537 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:36.725883 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:36.725883 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:36.725883 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:36.725883 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:36.725883 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:58:36.725883 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:58:36.725883 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b2b10dd-eb4b-4df6-bad5-39aff608f906 could not be found. Jul 25 14:58:36.725883 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:36.728034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fb46add2-5a3c-4007-981b-fef7a781a0b2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 404 to user: Instance 6b2b10dd-eb4b-4df6-bad5-39aff608f906 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:36.736449 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fb46add2-5a3c-4007-981b-fef7a781a0b2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "DELETE /compute/v2.1/servers/6b2b10dd-eb4b-4df6-bad5-39aff608f906" status: 404 len: 111 microversion: 2.1 time: 0.043480 Jul 25 14:58:36.740259 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3039/5850] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:58:36 2022] DELETE /compute/v2.1/servers/6b2b10dd-eb4b-4df6-bad5-39aff608f906 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:58:36.749300 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2220c160-121c-46c2-8c9a-f4b28a36bf1e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:36.750339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2220c160-121c-46c2-8c9a-f4b28a36bf1e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:36.761751 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2220c160-121c-46c2-8c9a-f4b28a36bf1e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:36.764832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2220c160-121c-46c2-8c9a-f4b28a36bf1e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:36.765880 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2220c160-121c-46c2-8c9a-f4b28a36bf1e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:36.769811 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2220c160-121c-46c2-8c9a-f4b28a36bf1e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:37.292133 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2220c160-121c-46c2-8c9a-f4b28a36bf1e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:37.334712 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2220c160-121c-46c2-8c9a-f4b28a36bf1e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.589115 Jul 25 14:58:37.336160 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2812/5851] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:36 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:58:37.366753 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-558c74d6-3484-4986-adab-896998fd2804 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:37.367493 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-558c74d6-3484-4986-adab-896998fd2804 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:37.375601 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-558c74d6-3484-4986-adab-896998fd2804 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:37.376086 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-558c74d6-3484-4986-adab-896998fd2804 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:37.376920 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-558c74d6-3484-4986-adab-896998fd2804 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:37.377291 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-558c74d6-3484-4986-adab-896998fd2804 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:37.629762 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-558c74d6-3484-4986-adab-896998fd2804 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:37.640439 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-558c74d6-3484-4986-adab-896998fd2804 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.278083 Jul 25 14:58:37.641667 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3040/5852] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:37 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:37.663137 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-30b112ec-04bb-4fe9-a764-5d9e6dfdfd58 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:37.664544 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-30b112ec-04bb-4fe9-a764-5d9e6dfdfd58 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Failed to fetch instance by id 9223372036854775808 {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 25 14:58:37.665316 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-30b112ec-04bb-4fe9-a764-5d9e6dfdfd58 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-30b112ec-04bb-4fe9-a764-5d9e6dfdfd58 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 9223372036854775808 could not be found. Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '9223372036854775808'} Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:37.667456 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:37.672768 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:37.672768 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:58:37.672768 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:58:37.672768 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jul 25 14:58:37.672768 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:37.675303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-30b112ec-04bb-4fe9-a764-5d9e6dfdfd58 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:37.680151 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-30b112ec-04bb-4fe9-a764-5d9e6dfdfd58 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.021084 Jul 25 14:58:37.685345 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2813/5853] 10.222.0.88 () {58 vars in 1188 bytes} [Mon Jul 25 14:58:37 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:58:37.691334 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e5a875f2-923c-49c6-983a-8312d814cd8b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:37.692280 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e5a875f2-923c-49c6-983a-8312d814cd8b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:37.701877 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e5a875f2-923c-49c6-983a-8312d814cd8b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:37.702657 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e5a875f2-923c-49c6-983a-8312d814cd8b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:37.703998 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e5a875f2-923c-49c6-983a-8312d814cd8b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:37.705372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e5a875f2-923c-49c6-983a-8312d814cd8b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:38.029360 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e5a875f2-923c-49c6-983a-8312d814cd8b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:38.045568 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e5a875f2-923c-49c6-983a-8312d814cd8b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.358687 Jul 25 14:58:38.046372 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3041/5854] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:37 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:38.070879 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5a56a212-5205-4d5c-86a7-17aa06f5e24c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:38.071856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5a56a212-5205-4d5c-86a7-17aa06f5e24c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:38.080924 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5a56a212-5205-4d5c-86a7-17aa06f5e24c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:38.081717 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5a56a212-5205-4d5c-86a7-17aa06f5e24c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:38.082772 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5a56a212-5205-4d5c-86a7-17aa06f5e24c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:38.083426 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5a56a212-5205-4d5c-86a7-17aa06f5e24c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:38.371554 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5a56a212-5205-4d5c-86a7-17aa06f5e24c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:38.403809 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5a56a212-5205-4d5c-86a7-17aa06f5e24c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.338116 Jul 25 14:58:38.410306 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2814/5855] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:38 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:38.423738 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-32d53cd4-c0fe-488c-a54c-c8309a5cdbc0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:38.424250 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-32d53cd4-c0fe-488c-a54c-c8309a5cdbc0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Failed to fetch instance by id -1 {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 25 14:58:38.425139 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-32d53cd4-c0fe-488c-a54c-c8309a5cdbc0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Instance -1 could not be found. Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-32d53cd4-c0fe-488c-a54c-c8309a5cdbc0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance -1 could not be found. Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '-1'} Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:38.426864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:38.431727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:58:38.431727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:58:38.431727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jul 25 14:58:38.431727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:38.432816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-32d53cd4-c0fe-488c-a54c-c8309a5cdbc0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 404 to user: Instance -1 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:38.435569 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-32d53cd4-c0fe-488c-a54c-c8309a5cdbc0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.014040 Jul 25 14:58:38.436409 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3042/5856] 10.222.0.88 () {58 vars in 1137 bytes} [Mon Jul 25 14:58:38 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:58:38.444797 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-89a9c8c6-08d1-4c49-8ee8-d2db20c9b877 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:38.452978 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-89a9c8c6-08d1-4c49-8ee8-d2db20c9b877 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:38.468417 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89a9c8c6-08d1-4c49-8ee8-d2db20c9b877 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:38.469148 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89a9c8c6-08d1-4c49-8ee8-d2db20c9b877 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:38.470221 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89a9c8c6-08d1-4c49-8ee8-d2db20c9b877 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:38.470812 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89a9c8c6-08d1-4c49-8ee8-d2db20c9b877 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:38.832111 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-89a9c8c6-08d1-4c49-8ee8-d2db20c9b877 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:38.845299 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-89a9c8c6-08d1-4c49-8ee8-d2db20c9b877 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.404290 Jul 25 14:58:38.846093 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2815/5857] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:38 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:58:38.866580 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4d5c8b6a-ec4a-4e6e-b3d3-979d6f2cd02f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:38.867856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4d5c8b6a-ec4a-4e6e-b3d3-979d6f2cd02f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:38.876858 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4d5c8b6a-ec4a-4e6e-b3d3-979d6f2cd02f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:38.877593 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4d5c8b6a-ec4a-4e6e-b3d3-979d6f2cd02f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:38.878520 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4d5c8b6a-ec4a-4e6e-b3d3-979d6f2cd02f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:38.879091 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4d5c8b6a-ec4a-4e6e-b3d3-979d6f2cd02f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:39.069367 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4d5c8b6a-ec4a-4e6e-b3d3-979d6f2cd02f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:39.080599 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4d5c8b6a-ec4a-4e6e-b3d3-979d6f2cd02f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.217887 Jul 25 14:58:39.081625 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3043/5858] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:38 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:58:39.103651 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5cc6d8eb-a944-4cbe-b585-4b7585a8167a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:39.104290 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5cc6d8eb-a944-4cbe-b585-4b7585a8167a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 60afa689-14a6-4c08-ab55-ac2e178c3ebc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:39.113695 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-5cc6d8eb-a944-4cbe-b585-4b7585a8167a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Instance 60afa689-14a6-4c08-ab55-ac2e178c3ebc could not be found. Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5cc6d8eb-a944-4cbe-b585-4b7585a8167a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/servers/60afa689-14a6-4c08-ab55-ac2e178c3ebc/action HTTP/1.1 Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 19 Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: {"forceDelete": {}} Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 60afa689-14a6-4c08-ab55-ac2e178c3ebc could not be found. Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '60afa689-14a6-4c08-ab55-ac2e178c3ebc', 'body': {'forceDelete': {}}} Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60afa689-14a6-4c08-ab55-ac2e178c3ebc could not be found. Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60afa689-14a6-4c08-ab55-ac2e178c3ebc could not be found. Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:39.124302 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:39.128690 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:58:39.128690 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:58:39.128690 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60afa689-14a6-4c08-ab55-ac2e178c3ebc could not be found. Jul 25 14:58:39.128690 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:39.128690 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5cc6d8eb-a944-4cbe-b585-4b7585a8167a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 404 to user: Instance 60afa689-14a6-4c08-ab55-ac2e178c3ebc could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:39.128690 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5cc6d8eb-a944-4cbe-b585-4b7585a8167a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers/60afa689-14a6-4c08-ab55-ac2e178c3ebc/action" status: 404 len: 111 microversion: 2.1 time: 0.030222 Jul 25 14:58:39.132622 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2816/5859] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:58:39 2022] POST /compute/v2.1/servers/60afa689-14a6-4c08-ab55-ac2e178c3ebc/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:58:39.138501 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-be569ded-7cd4-4ba4-bddf-664a1af43996 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:39.139652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-be569ded-7cd4-4ba4-bddf-664a1af43996 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:39.147025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be569ded-7cd4-4ba4-bddf-664a1af43996 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:39.147813 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be569ded-7cd4-4ba4-bddf-664a1af43996 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:39.149199 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be569ded-7cd4-4ba4-bddf-664a1af43996 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:39.150018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be569ded-7cd4-4ba4-bddf-664a1af43996 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:39.411279 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-be569ded-7cd4-4ba4-bddf-664a1af43996 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:39.428364 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-be569ded-7cd4-4ba4-bddf-664a1af43996 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.293515 Jul 25 14:58:39.429580 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3044/5860] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:39 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:39.452817 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-57b06d92-194a-45ee-bdf3-74c7fec9da75 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:39.453490 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-57b06d92-194a-45ee-bdf3-74c7fec9da75 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:39.477668 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57b06d92-194a-45ee-bdf3-74c7fec9da75 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:39.478144 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57b06d92-194a-45ee-bdf3-74c7fec9da75 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:39.481818 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57b06d92-194a-45ee-bdf3-74c7fec9da75 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:39.485013 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57b06d92-194a-45ee-bdf3-74c7fec9da75 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:39.738080 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-57b06d92-194a-45ee-bdf3-74c7fec9da75 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:39.746765 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-57b06d92-194a-45ee-bdf3-74c7fec9da75 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.298304 Jul 25 14:58:39.749404 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2817/5861] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:39 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:39.769750 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5a37ec9e-958a-4eb2-88aa-b4c44629af72 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:39.782765 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5a37ec9e-958a-4eb2-88aa-b4c44629af72 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: f858c915-cc90-4332-b93d-6feac16f4a6f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:39.810366 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-5a37ec9e-958a-4eb2-88aa-b4c44629af72 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Instance f858c915-cc90-4332-b93d-6feac16f4a6f could not be found. Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5a37ec9e-958a-4eb2-88aa-b4c44629af72 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers/f858c915-cc90-4332-b93d-6feac16f4a6f/action HTTP/1.1 Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 39 Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: {"os-getConsoleOutput": {"length": 10}} Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance f858c915-cc90-4332-b93d-6feac16f4a6f could not be found. Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'f858c915-cc90-4332-b93d-6feac16f4a6f', 'body': {'os-getConsoleOutput': {'length': 10}}} Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f858c915-cc90-4332-b93d-6feac16f4a6f could not be found. Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f858c915-cc90-4332-b93d-6feac16f4a6f could not be found. Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:39.832252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:39.836516 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:39.836516 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:39.836516 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:58:39.836516 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:58:39.836516 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f858c915-cc90-4332-b93d-6feac16f4a6f could not be found. Jul 25 14:58:39.836516 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:39.838036 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5a37ec9e-958a-4eb2-88aa-b4c44629af72 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 404 to user: Instance f858c915-cc90-4332-b93d-6feac16f4a6f could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:39.839253 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5a37ec9e-958a-4eb2-88aa-b4c44629af72 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers/f858c915-cc90-4332-b93d-6feac16f4a6f/action" status: 404 len: 111 microversion: 2.1 time: 0.073883 Jul 25 14:58:39.841789 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3045/5862] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:58:39 2022] POST /compute/v2.1/servers/f858c915-cc90-4332-b93d-6feac16f4a6f/action => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:58:39.849625 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-27701ecf-55a4-4101-8e9d-084b59ec191e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:39.850245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-27701ecf-55a4-4101-8e9d-084b59ec191e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:39.856606 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27701ecf-55a4-4101-8e9d-084b59ec191e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:39.857066 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27701ecf-55a4-4101-8e9d-084b59ec191e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:39.857859 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27701ecf-55a4-4101-8e9d-084b59ec191e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:39.860351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27701ecf-55a4-4101-8e9d-084b59ec191e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:40.168614 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-27701ecf-55a4-4101-8e9d-084b59ec191e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:40.178495 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-27701ecf-55a4-4101-8e9d-084b59ec191e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.333273 Jul 25 14:58:40.182403 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2818/5863] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:39 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:40.206739 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-228df245-8d9b-4cc8-8d23-30bc11c91cc6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:40.207350 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-228df245-8d9b-4cc8-8d23-30bc11c91cc6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:40.228928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-228df245-8d9b-4cc8-8d23-30bc11c91cc6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:40.237635 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-228df245-8d9b-4cc8-8d23-30bc11c91cc6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:40.238743 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-228df245-8d9b-4cc8-8d23-30bc11c91cc6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:40.239690 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-228df245-8d9b-4cc8-8d23-30bc11c91cc6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:40.512146 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-228df245-8d9b-4cc8-8d23-30bc11c91cc6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:40.521219 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-228df245-8d9b-4cc8-8d23-30bc11c91cc6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.319261 Jul 25 14:58:40.525165 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3046/5864] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:40 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:40.546333 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-50273dea-eab7-4e6d-be5b-2ed6dec6ba57 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:40.547271 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-50273dea-eab7-4e6d-be5b-2ed6dec6ba57 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: a5189812-4bbb-4d18-b7b5-9b467e937c95] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:40.557318 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-50273dea-eab7-4e6d-be5b-2ed6dec6ba57 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Instance a5189812-4bbb-4d18-b7b5-9b467e937c95 could not be found. Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-50273dea-eab7-4e6d-be5b-2ed6dec6ba57 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/a5189812-4bbb-4d18-b7b5-9b467e937c95 HTTP/1.1 Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance a5189812-4bbb-4d18-b7b5-9b467e937c95 could not be found. Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'a5189812-4bbb-4d18-b7b5-9b467e937c95'} Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5189812-4bbb-4d18-b7b5-9b467e937c95 could not be found. Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5189812-4bbb-4d18-b7b5-9b467e937c95 could not be found. Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:40.561552 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:40.566519 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:40.566519 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:58:40.566519 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:58:40.566519 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5189812-4bbb-4d18-b7b5-9b467e937c95 could not be found. Jul 25 14:58:40.566519 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:40.569462 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-50273dea-eab7-4e6d-be5b-2ed6dec6ba57 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 404 to user: Instance a5189812-4bbb-4d18-b7b5-9b467e937c95 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:40.570845 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-50273dea-eab7-4e6d-be5b-2ed6dec6ba57 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/a5189812-4bbb-4d18-b7b5-9b467e937c95" status: 404 len: 111 microversion: 2.1 time: 0.029373 Jul 25 14:58:40.572083 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2819/5865] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:40 2022] GET /compute/v2.1/servers/a5189812-4bbb-4d18-b7b5-9b467e937c95 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:58:40.580936 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7e442573-e280-4bc5-829e-109b7eb66577 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:40.583202 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7e442573-e280-4bc5-829e-109b7eb66577 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:40.598262 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7e442573-e280-4bc5-829e-109b7eb66577 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:40.601396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7e442573-e280-4bc5-829e-109b7eb66577 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:40.602598 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7e442573-e280-4bc5-829e-109b7eb66577 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:40.606435 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7e442573-e280-4bc5-829e-109b7eb66577 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:41.276866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7e442573-e280-4bc5-829e-109b7eb66577 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:41.286075 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7e442573-e280-4bc5-829e-109b7eb66577 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.709587 Jul 25 14:58:41.290587 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3047/5866] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:40 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:58:41.317254 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9186a58e-88d6-4d65-af04-5155197b4205 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:41.321237 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9186a58e-88d6-4d65-af04-5155197b4205 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:41.339739 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9186a58e-88d6-4d65-af04-5155197b4205 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:41.343666 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9186a58e-88d6-4d65-af04-5155197b4205 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:41.344585 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9186a58e-88d6-4d65-af04-5155197b4205 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:41.345287 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9186a58e-88d6-4d65-af04-5155197b4205 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:41.597493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9186a58e-88d6-4d65-af04-5155197b4205 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:41.605947 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9186a58e-88d6-4d65-af04-5155197b4205 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.295848 Jul 25 14:58:41.606545 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2820/5867] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:41 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:41.714705 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f08466ad-4cda-4214-87da-15c817f3d5a2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1839548909", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "41af874f-bd06-4a71-827d-6d815f202a2b"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f08466ad-4cda-4214-87da-15c817f3d5a2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 238 Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1839548909", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "41af874f-bd06-4a71-827d-6d815f202a2b"}]}} Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1839548909', 'imageRef': 'a7b14aba-1848-4a00-a3e7-b66eb3e97925', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '41af874f-bd06-4a71-827d-6d815f202a2b'}]}}} Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:41.742062 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:41.746788 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:41.746788 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:41.746788 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:41.746788 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:41.746788 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:41.746788 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:41.746788 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:58:41.746788 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:58:41.746788 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:58:41.746788 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:58:41.746788 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:58:41.746788 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:58:41.746788 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:58:41.746788 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:58:41.746788 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 25 14:58:41.746788 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:41.746788 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:41.746788 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:41.746788 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:41.746788 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:41.746788 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:41.746788 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:58:41.746788 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:58:41.746788 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 25 14:58:41.746788 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:41.750441 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f08466ad-4cda-4214-87da-15c817f3d5a2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:41.751319 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f08466ad-4cda-4214-87da-15c817f3d5a2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.046373 Jul 25 14:58:41.751919 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3048/5868] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:58:41 2022] POST /compute/v2.1/servers => generated 139 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:58:41.762049 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cadd5094-9a58-4176-b794-229e635888b8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:41.763290 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cadd5094-9a58-4176-b794-229e635888b8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:41.773375 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cadd5094-9a58-4176-b794-229e635888b8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:41.774573 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cadd5094-9a58-4176-b794-229e635888b8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:41.775525 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cadd5094-9a58-4176-b794-229e635888b8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:41.776647 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cadd5094-9a58-4176-b794-229e635888b8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:42.179266 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cadd5094-9a58-4176-b794-229e635888b8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:42.189616 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cadd5094-9a58-4176-b794-229e635888b8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.433215 Jul 25 14:58:42.199076 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2821/5869] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:41 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:42.214004 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9f6b5972-0fe1-4184-bcdc-22dccb0ab783 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:42.215470 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9f6b5972-0fe1-4184-bcdc-22dccb0ab783 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:42.229290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f6b5972-0fe1-4184-bcdc-22dccb0ab783 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:42.230020 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f6b5972-0fe1-4184-bcdc-22dccb0ab783 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:42.231059 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f6b5972-0fe1-4184-bcdc-22dccb0ab783 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:42.231735 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f6b5972-0fe1-4184-bcdc-22dccb0ab783 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:42.453722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9f6b5972-0fe1-4184-bcdc-22dccb0ab783 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:42.463795 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9f6b5972-0fe1-4184-bcdc-22dccb0ab783 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.254311 Jul 25 14:58:42.479600 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3049/5870] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:42 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:42.643916 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-11a55607-591a-472f-9567-b4d15b910d0f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-626511495", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "41af874f-bd06-4a71-827d-6d815f202a2b"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-11a55607-591a-472f-9567-b4d15b910d0f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 234 Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-626511495", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "41af874f-bd06-4a71-827d-6d815f202a2b"}]}} Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-626511495', 'imageRef': 'a7b14aba-1848-4a00-a3e7-b66eb3e97925', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '41af874f-bd06-4a71-827d-6d815f202a2b'}]}}} Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi 'notvalid' Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:42.650782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:42.655046 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:42.655046 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:42.655046 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:42.655046 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:42.655046 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:42.655046 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:42.655046 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:58:42.655046 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:58:42.655046 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:58:42.655046 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:58:42.655046 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:58:42.655046 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:58:42.655046 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:58:42.655046 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:58:42.655046 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 25 14:58:42.655046 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:42.655046 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:42.655046 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:42.655046 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:42.655046 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:42.655046 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:42.655046 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:58:42.655046 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:58:42.655046 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 25 14:58:42.655046 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:42.660526 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-11a55607-591a-472f-9567-b4d15b910d0f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:42.661632 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-11a55607-591a-472f-9567-b4d15b910d0f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.026290 Jul 25 14:58:42.662746 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2822/5871] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:58:42 2022] POST /compute/v2.1/servers => generated 133 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 14:58:42.671333 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6e97e22e-4be2-4f34-9190-daca05c7491d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:42.672376 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6e97e22e-4be2-4f34-9190-daca05c7491d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:42.682024 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e97e22e-4be2-4f34-9190-daca05c7491d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:42.682827 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e97e22e-4be2-4f34-9190-daca05c7491d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:42.684292 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e97e22e-4be2-4f34-9190-daca05c7491d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:42.684812 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e97e22e-4be2-4f34-9190-daca05c7491d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:42.968808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6e97e22e-4be2-4f34-9190-daca05c7491d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:42.978459 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6e97e22e-4be2-4f34-9190-daca05c7491d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.311487 Jul 25 14:58:42.984161 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3050/5872] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:42 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:43.003073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-43586afd-4ef6-4770-bc64-9acc9c963034 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:43.003694 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-43586afd-4ef6-4770-bc64-9acc9c963034 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:43.017985 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43586afd-4ef6-4770-bc64-9acc9c963034 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:43.018450 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43586afd-4ef6-4770-bc64-9acc9c963034 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:43.019243 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43586afd-4ef6-4770-bc64-9acc9c963034 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:43.019685 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43586afd-4ef6-4770-bc64-9acc9c963034 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:43.268193 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-43586afd-4ef6-4770-bc64-9acc9c963034 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:43.278369 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-43586afd-4ef6-4770-bc64-9acc9c963034 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.279067 Jul 25 14:58:43.284617 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2823/5873] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:42 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:43.304729 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fef803fe-6181-458f-a143-d6135ff74a5e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:43.305678 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fef803fe-6181-458f-a143-d6135ff74a5e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 3c17faba-32e4-4dcc-a356-8e44a7789a2b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:43.321969 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-fef803fe-6181-458f-a143-d6135ff74a5e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Instance 3c17faba-32e4-4dcc-a356-8e44a7789a2b could not be found. Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fef803fe-6181-458f-a143-d6135ff74a5e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers/3c17faba-32e4-4dcc-a356-8e44a7789a2b/action HTTP/1.1 Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 13 Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: {"pause": {}} Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 3c17faba-32e4-4dcc-a356-8e44a7789a2b could not be found. Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '3c17faba-32e4-4dcc-a356-8e44a7789a2b', 'body': {'pause': {}}} Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c17faba-32e4-4dcc-a356-8e44a7789a2b could not be found. Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c17faba-32e4-4dcc-a356-8e44a7789a2b could not be found. Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:43.339011 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:43.344194 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:58:43.344194 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:58:43.344194 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c17faba-32e4-4dcc-a356-8e44a7789a2b could not be found. Jul 25 14:58:43.344194 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:43.347235 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fef803fe-6181-458f-a143-d6135ff74a5e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 404 to user: Instance 3c17faba-32e4-4dcc-a356-8e44a7789a2b could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:43.354060 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fef803fe-6181-458f-a143-d6135ff74a5e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers/3c17faba-32e4-4dcc-a356-8e44a7789a2b/action" status: 404 len: 111 microversion: 2.1 time: 0.049752 Jul 25 14:58:43.357863 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3051/5874] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:58:43 2022] POST /compute/v2.1/servers/3c17faba-32e4-4dcc-a356-8e44a7789a2b/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:58:43.365280 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4b4fe8b3-7186-4590-862d-7ef0805151c0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:43.366114 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4b4fe8b3-7186-4590-862d-7ef0805151c0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:43.383935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4b4fe8b3-7186-4590-862d-7ef0805151c0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:43.392313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4b4fe8b3-7186-4590-862d-7ef0805151c0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:43.393776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4b4fe8b3-7186-4590-862d-7ef0805151c0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:43.394433 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4b4fe8b3-7186-4590-862d-7ef0805151c0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:43.651698 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4b4fe8b3-7186-4590-862d-7ef0805151c0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:43.661089 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4b4fe8b3-7186-4590-862d-7ef0805151c0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.299699 Jul 25 14:58:43.676001 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2824/5875] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:43 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:43.697999 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a8a2c313-05a6-444c-a103-e8340fd2f20f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:43.698987 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a8a2c313-05a6-444c-a103-e8340fd2f20f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:43.707921 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:58:43.709949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a8a2c313-05a6-444c-a103-e8340fd2f20f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:43.710561 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a8a2c313-05a6-444c-a103-e8340fd2f20f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:43.711559 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a8a2c313-05a6-444c-a103-e8340fd2f20f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:43.712171 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a8a2c313-05a6-444c-a103-e8340fd2f20f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:44.065130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a8a2c313-05a6-444c-a103-e8340fd2f20f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:44.091818 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a8a2c313-05a6-444c-a103-e8340fd2f20f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.410563 Jul 25 14:58:44.119604 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f7b0802b-34ec-405a-8d5c-1419018de2d6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:44.120273 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f7b0802b-34ec-405a-8d5c-1419018de2d6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:44.126248 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3052/5876] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:43 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:44.130193 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f7b0802b-34ec-405a-8d5c-1419018de2d6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:44.131013 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f7b0802b-34ec-405a-8d5c-1419018de2d6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:44.132336 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f7b0802b-34ec-405a-8d5c-1419018de2d6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:44.133767 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f7b0802b-34ec-405a-8d5c-1419018de2d6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:44.166087 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:58:44.254992 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f7b0802b-34ec-405a-8d5c-1419018de2d6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action" status: 202 len: 0 microversion: 2.1 time: 0.139599 Jul 25 14:58:44.255968 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2825/5877] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:58:44 2022] POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:58:44.266383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0e3b8d86-4679-497c-a34e-ec72e14a336a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:44.267051 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0e3b8d86-4679-497c-a34e-ec72e14a336a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:44.274429 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0e3b8d86-4679-497c-a34e-ec72e14a336a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:44.275794 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0e3b8d86-4679-497c-a34e-ec72e14a336a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:44.277145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0e3b8d86-4679-497c-a34e-ec72e14a336a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:44.277749 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0e3b8d86-4679-497c-a34e-ec72e14a336a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:44.288813 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:58:44.572604 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0e3b8d86-4679-497c-a34e-ec72e14a336a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:44.607142 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0e3b8d86-4679-497c-a34e-ec72e14a336a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1510 microversion: 2.1 time: 0.345478 Jul 25 14:58:44.608483 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3053/5878] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:44 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1510 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:45.631600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f8d76643-d07c-4afb-b1bd-cedbb3ff5618 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:45.633669 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f8d76643-d07c-4afb-b1bd-cedbb3ff5618 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:45.649785 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8d76643-d07c-4afb-b1bd-cedbb3ff5618 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:45.651928 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8d76643-d07c-4afb-b1bd-cedbb3ff5618 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:45.654707 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8d76643-d07c-4afb-b1bd-cedbb3ff5618 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:45.656017 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8d76643-d07c-4afb-b1bd-cedbb3ff5618 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:45.971720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f8d76643-d07c-4afb-b1bd-cedbb3ff5618 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:45.980222 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f8d76643-d07c-4afb-b1bd-cedbb3ff5618 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1490 microversion: 2.1 time: 0.354148 Jul 25 14:58:45.982009 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2826/5879] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:45 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1490 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:46.004594 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-90604092-2298-49c1-abbc-addf494b0f77 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:46.005823 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-90604092-2298-49c1-abbc-addf494b0f77 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:46.022827 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-90604092-2298-49c1-abbc-addf494b0f77 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:46.023663 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-90604092-2298-49c1-abbc-addf494b0f77 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:46.024623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-90604092-2298-49c1-abbc-addf494b0f77 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:46.025058 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-90604092-2298-49c1-abbc-addf494b0f77 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:46.056975 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-90604092-2298-49c1-abbc-addf494b0f77 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Cannot 'pause' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state paused Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-90604092-2298-49c1-abbc-addf494b0f77 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action HTTP/1.1 Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 13 Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: {"pause": {}} Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: exception: Cannot 'pause' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state paused Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '34bbd65c-a1e0-4f6c-a775-8c9f847eccec', 'body': {'pause': {}}} Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec in vm_state paused. Cannot pause while the instance is in this state. Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state paused Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:46.058861 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:46.063741 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:46.063741 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:58:46.063741 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:58:46.063741 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state paused Jul 25 14:58:46.063741 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:46.065792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-90604092-2298-49c1-abbc-addf494b0f77 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 409 to user: Cannot 'pause' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state paused {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:46.066889 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-90604092-2298-49c1-abbc-addf494b0f77 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action" status: 409 len: 143 microversion: 2.1 time: 0.066996 Jul 25 14:58:46.067955 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3054/5880] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:58:45 2022] POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action => generated 143 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:58:46.077633 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-27745188-e03b-49bf-8e22-0b8bbafb03d7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:46.078561 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-27745188-e03b-49bf-8e22-0b8bbafb03d7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:46.086593 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27745188-e03b-49bf-8e22-0b8bbafb03d7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:46.087262 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27745188-e03b-49bf-8e22-0b8bbafb03d7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:46.088230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27745188-e03b-49bf-8e22-0b8bbafb03d7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:46.088919 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27745188-e03b-49bf-8e22-0b8bbafb03d7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:46.225220 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-27745188-e03b-49bf-8e22-0b8bbafb03d7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action" status: 202 len: 0 microversion: 2.1 time: 0.152021 Jul 25 14:58:46.226295 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2827/5881] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:58:46 2022] POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:58:46.235516 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b1a2459c-7fa3-4217-a0b1-75ae036b0b14 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:46.236440 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b1a2459c-7fa3-4217-a0b1-75ae036b0b14 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:46.249928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b1a2459c-7fa3-4217-a0b1-75ae036b0b14 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:46.250728 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b1a2459c-7fa3-4217-a0b1-75ae036b0b14 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:46.252295 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b1a2459c-7fa3-4217-a0b1-75ae036b0b14 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:46.252881 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b1a2459c-7fa3-4217-a0b1-75ae036b0b14 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:46.658742 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b1a2459c-7fa3-4217-a0b1-75ae036b0b14 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:46.668010 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b1a2459c-7fa3-4217-a0b1-75ae036b0b14 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1497 microversion: 2.1 time: 0.436841 Jul 25 14:58:46.683247 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3055/5882] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:46 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1497 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:47.692353 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8f9956cf-6d22-47f7-b3fc-2beb71c7f0e7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:47.696455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8f9956cf-6d22-47f7-b3fc-2beb71c7f0e7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:47.705789 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f9956cf-6d22-47f7-b3fc-2beb71c7f0e7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:47.707057 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f9956cf-6d22-47f7-b3fc-2beb71c7f0e7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:47.708319 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f9956cf-6d22-47f7-b3fc-2beb71c7f0e7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:47.710518 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f9956cf-6d22-47f7-b3fc-2beb71c7f0e7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:48.219046 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8f9956cf-6d22-47f7-b3fc-2beb71c7f0e7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:48.234746 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8f9956cf-6d22-47f7-b3fc-2beb71c7f0e7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.546842 Jul 25 14:58:48.236915 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2828/5883] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:47 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:48.258009 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bde1501e-0d13-4e16-8309-1fded173f14e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:48.259389 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bde1501e-0d13-4e16-8309-1fded173f14e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:48.267563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bde1501e-0d13-4e16-8309-1fded173f14e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:48.268395 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bde1501e-0d13-4e16-8309-1fded173f14e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:48.269442 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bde1501e-0d13-4e16-8309-1fded173f14e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:48.270100 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bde1501e-0d13-4e16-8309-1fded173f14e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:48.501492 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bde1501e-0d13-4e16-8309-1fded173f14e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:48.522711 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bde1501e-0d13-4e16-8309-1fded173f14e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.268662 Jul 25 14:58:48.542243 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3056/5884] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:48 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:48.549013 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ec5c734c-6b92-4feb-9ead-8bab0c3fe214 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:48.552030 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ec5c734c-6b92-4feb-9ead-8bab0c3fe214 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 667424b9-7b86-4204-9272-afd7ac83ff5e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:48.583320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec5c734c-6b92-4feb-9ead-8bab0c3fe214 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:48.583852 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec5c734c-6b92-4feb-9ead-8bab0c3fe214 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:48.584694 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec5c734c-6b92-4feb-9ead-8bab0c3fe214 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:48.585135 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec5c734c-6b92-4feb-9ead-8bab0c3fe214 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:48.618396 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-ec5c734c-6b92-4feb-9ead-8bab0c3fe214 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Instance 667424b9-7b86-4204-9272-afd7ac83ff5e could not be found. Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ec5c734c-6b92-4feb-9ead-8bab0c3fe214 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e/action HTTP/1.1 Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 28 Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: {"reboot": {"type": "SOFT"}} Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 667424b9-7b86-4204-9272-afd7ac83ff5e could not be found. Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '667424b9-7b86-4204-9272-afd7ac83ff5e', 'body': {'reboot': {'type': 'SOFT'}}} Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 667424b9-7b86-4204-9272-afd7ac83ff5e could not be found. Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:58:48.622537 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:58:48.627741 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 667424b9-7b86-4204-9272-afd7ac83ff5e could not be found. Jul 25 14:58:48.627741 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:48.627741 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:48.627741 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:48.627741 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:48.627741 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:48.627741 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:48.627741 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:58:48.627741 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:58:48.627741 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 667424b9-7b86-4204-9272-afd7ac83ff5e could not be found. Jul 25 14:58:48.627741 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:48.627741 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ec5c734c-6b92-4feb-9ead-8bab0c3fe214 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 404 to user: Instance 667424b9-7b86-4204-9272-afd7ac83ff5e could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:48.627741 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ec5c734c-6b92-4feb-9ead-8bab0c3fe214 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e/action" status: 404 len: 111 microversion: 2.1 time: 0.081400 Jul 25 14:58:48.627741 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2829/5885] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:58:48 2022] POST /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e/action => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:58:48.633851 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-db253f30-2b44-4c4f-a94a-b6100298179e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:48.634470 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-db253f30-2b44-4c4f-a94a-b6100298179e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:48.653355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db253f30-2b44-4c4f-a94a-b6100298179e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:48.653812 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db253f30-2b44-4c4f-a94a-b6100298179e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:48.654790 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db253f30-2b44-4c4f-a94a-b6100298179e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:48.655796 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db253f30-2b44-4c4f-a94a-b6100298179e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:49.136013 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-db253f30-2b44-4c4f-a94a-b6100298179e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:49.150391 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-db253f30-2b44-4c4f-a94a-b6100298179e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.520325 Jul 25 14:58:49.158881 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3057/5886] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:48 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:49.183539 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d372635f-eca2-43a9-bf47-99053b73b321 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:49.184407 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d372635f-eca2-43a9-bf47-99053b73b321 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:49.207735 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d372635f-eca2-43a9-bf47-99053b73b321 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:49.208827 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d372635f-eca2-43a9-bf47-99053b73b321 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:49.215244 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d372635f-eca2-43a9-bf47-99053b73b321 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:49.215787 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d372635f-eca2-43a9-bf47-99053b73b321 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:49.811239 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d372635f-eca2-43a9-bf47-99053b73b321 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:49.825267 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d372635f-eca2-43a9-bf47-99053b73b321 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.646452 Jul 25 14:58:49.827657 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2830/5887] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:49 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:49.847405 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3b0b70b5-54a8-4947-a2fe-f50d936e6bed tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:49.849978 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3b0b70b5-54a8-4947-a2fe-f50d936e6bed tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: bae1d3fd-13b9-4ec5-be77-9d7382002cf0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:49.860514 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-3b0b70b5-54a8-4947-a2fe-f50d936e6bed tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Instance bae1d3fd-13b9-4ec5-be77-9d7382002cf0 could not be found. Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3b0b70b5-54a8-4947-a2fe-f50d936e6bed tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers/bae1d3fd-13b9-4ec5-be77-9d7382002cf0/action HTTP/1.1 Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 28 Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: {"reboot": {"type": "SOFT"}} Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance bae1d3fd-13b9-4ec5-be77-9d7382002cf0 could not be found. Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'bae1d3fd-13b9-4ec5-be77-9d7382002cf0', 'body': {'reboot': {'type': 'SOFT'}}} Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bae1d3fd-13b9-4ec5-be77-9d7382002cf0 could not be found. Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bae1d3fd-13b9-4ec5-be77-9d7382002cf0 could not be found. Jul 25 14:58:49.867252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:49.871539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:49.871539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:49.871539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:49.871539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:49.871539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:49.871539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:58:49.871539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:58:49.871539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bae1d3fd-13b9-4ec5-be77-9d7382002cf0 could not be found. Jul 25 14:58:49.871539 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:49.890650 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3b0b70b5-54a8-4947-a2fe-f50d936e6bed tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 404 to user: Instance bae1d3fd-13b9-4ec5-be77-9d7382002cf0 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:49.892040 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3b0b70b5-54a8-4947-a2fe-f50d936e6bed tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers/bae1d3fd-13b9-4ec5-be77-9d7382002cf0/action" status: 404 len: 111 microversion: 2.1 time: 0.048586 Jul 25 14:58:49.893162 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3058/5888] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:58:49 2022] POST /compute/v2.1/servers/bae1d3fd-13b9-4ec5-be77-9d7382002cf0/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:58:49.905863 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2c54a9c1-de09-48fa-8459-f930e4180923 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:49.905987 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2c54a9c1-de09-48fa-8459-f930e4180923 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:49.921882 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c54a9c1-de09-48fa-8459-f930e4180923 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:49.922340 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c54a9c1-de09-48fa-8459-f930e4180923 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:49.923167 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c54a9c1-de09-48fa-8459-f930e4180923 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:49.929009 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c54a9c1-de09-48fa-8459-f930e4180923 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:50.386486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2c54a9c1-de09-48fa-8459-f930e4180923 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:50.399683 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2c54a9c1-de09-48fa-8459-f930e4180923 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.502348 Jul 25 14:58:50.403353 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2831/5889] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:49 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:58:50.469421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5177bd52-f72c-4592-a6c5-72ed4405b079 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:50.470478 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5177bd52-f72c-4592-a6c5-72ed4405b079 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:50.490966 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5177bd52-f72c-4592-a6c5-72ed4405b079 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:50.492355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5177bd52-f72c-4592-a6c5-72ed4405b079 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:50.495232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5177bd52-f72c-4592-a6c5-72ed4405b079 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:50.496977 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5177bd52-f72c-4592-a6c5-72ed4405b079 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:50.791512 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5177bd52-f72c-4592-a6c5-72ed4405b079 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:50.804198 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5177bd52-f72c-4592-a6c5-72ed4405b079 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.379016 Jul 25 14:58:50.805939 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3059/5890] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:50 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:50.833544 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4c7a6238-39c8-41cc-a9c2-4b11ad979b11 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:50.837581 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4c7a6238-39c8-41cc-a9c2-4b11ad979b11 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 667424b9-7b86-4204-9272-afd7ac83ff5e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:50.853344 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=86 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:58:50.858444 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c7a6238-39c8-41cc-a9c2-4b11ad979b11 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:50.858823 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c7a6238-39c8-41cc-a9c2-4b11ad979b11 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:50.861465 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c7a6238-39c8-41cc-a9c2-4b11ad979b11 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:50.862170 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c7a6238-39c8-41cc-a9c2-4b11ad979b11 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:50.896247 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-4c7a6238-39c8-41cc-a9c2-4b11ad979b11 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Instance 667424b9-7b86-4204-9272-afd7ac83ff5e could not be found. Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4c7a6238-39c8-41cc-a9c2-4b11ad979b11 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e/action HTTP/1.1 Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 65 Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: {"rebuild": {"imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925"}} Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 667424b9-7b86-4204-9272-afd7ac83ff5e could not be found. Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '667424b9-7b86-4204-9272-afd7ac83ff5e', 'body': {'rebuild': {'imageRef': 'a7b14aba-1848-4a00-a3e7-b66eb3e97925'}}} Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 667424b9-7b86-4204-9272-afd7ac83ff5e could not be found. Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 25 14:58:50.898228 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 25 14:58:50.902967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 25 14:58:50.902967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:58:50.902967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:58:50.902967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:58:50.902967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:58:50.902967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 667424b9-7b86-4204-9272-afd7ac83ff5e could not be found. Jul 25 14:58:50.902967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:50.902967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:50.902967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:50.902967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:50.902967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:50.902967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:50.902967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:58:50.902967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:58:50.902967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 667424b9-7b86-4204-9272-afd7ac83ff5e could not be found. Jul 25 14:58:50.902967 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:50.905567 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4c7a6238-39c8-41cc-a9c2-4b11ad979b11 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 404 to user: Instance 667424b9-7b86-4204-9272-afd7ac83ff5e could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:50.906667 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4c7a6238-39c8-41cc-a9c2-4b11ad979b11 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e/action" status: 404 len: 111 microversion: 2.1 time: 0.078175 Jul 25 14:58:50.908034 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2832/5891] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:58:50 2022] POST /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e/action => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:58:50.915955 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-db0add75-6eac-4463-a7d0-37e196118276 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:50.916648 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-db0add75-6eac-4463-a7d0-37e196118276 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:50.940122 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db0add75-6eac-4463-a7d0-37e196118276 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:50.940725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db0add75-6eac-4463-a7d0-37e196118276 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:50.942864 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db0add75-6eac-4463-a7d0-37e196118276 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:50.943312 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db0add75-6eac-4463-a7d0-37e196118276 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:51.295192 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-db0add75-6eac-4463-a7d0-37e196118276 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:51.310908 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-db0add75-6eac-4463-a7d0-37e196118276 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.399065 Jul 25 14:58:51.313167 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3060/5892] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:50 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:51.339876 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f44ef2f1-2939-40b4-902a-1f1397f1b239 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:51.341670 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f44ef2f1-2939-40b4-902a-1f1397f1b239 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:51.397920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f44ef2f1-2939-40b4-902a-1f1397f1b239 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:51.398675 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f44ef2f1-2939-40b4-902a-1f1397f1b239 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:51.399382 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f44ef2f1-2939-40b4-902a-1f1397f1b239 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:51.399834 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f44ef2f1-2939-40b4-902a-1f1397f1b239 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:52.000227 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5a7ae2c6-cbed-4e5b-b670-2d0e5a66fc34 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:52.003139 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5a7ae2c6-cbed-4e5b-b670-2d0e5a66fc34 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:52.019777 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5a7ae2c6-cbed-4e5b-b670-2d0e5a66fc34 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:52.020264 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5a7ae2c6-cbed-4e5b-b670-2d0e5a66fc34 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:52.021025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5a7ae2c6-cbed-4e5b-b670-2d0e5a66fc34 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:52.021451 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5a7ae2c6-cbed-4e5b-b670-2d0e5a66fc34 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:52.104374 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5a7ae2c6-cbed-4e5b-b670-2d0e5a66fc34 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "POST /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc/action" status: 200 len: 24569 microversion: 2.1 time: 0.107748 Jul 25 14:58:52.113449 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3061/5893] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:58:51 2022] POST /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc/action => generated 24569 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:58:52.372978 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f44ef2f1-2939-40b4-902a-1f1397f1b239 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:52.387121 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f44ef2f1-2939-40b4-902a-1f1397f1b239 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 1.053074 Jul 25 14:58:52.388720 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2833/5894] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:51 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:52.409902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f728f34a-3f17-4d24-ba5e-9053f28c28b8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:52.413191 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f728f34a-3f17-4d24-ba5e-9053f28c28b8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 9f8b1f0f-b156-472e-9d6c-2472faa41847] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:52.423421 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-f728f34a-3f17-4d24-ba5e-9053f28c28b8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Instance 9f8b1f0f-b156-472e-9d6c-2472faa41847 could not be found. Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f728f34a-3f17-4d24-ba5e-9053f28c28b8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers/9f8b1f0f-b156-472e-9d6c-2472faa41847/action HTTP/1.1 Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 65 Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: {"rebuild": {"imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925"}} Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 9f8b1f0f-b156-472e-9d6c-2472faa41847 could not be found. Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '9f8b1f0f-b156-472e-9d6c-2472faa41847', 'body': {'rebuild': {'imageRef': 'a7b14aba-1848-4a00-a3e7-b66eb3e97925'}}} Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f8b1f0f-b156-472e-9d6c-2472faa41847 could not be found. Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 25 14:58:52.426134 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:58:52.430451 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:58:52.430451 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:58:52.430451 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:58:52.430451 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f8b1f0f-b156-472e-9d6c-2472faa41847 could not be found. Jul 25 14:58:52.430451 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:52.430451 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:52.430451 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:52.430451 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:52.430451 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:52.430451 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:52.430451 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:58:52.430451 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:58:52.430451 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f8b1f0f-b156-472e-9d6c-2472faa41847 could not be found. Jul 25 14:58:52.430451 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:52.433221 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f728f34a-3f17-4d24-ba5e-9053f28c28b8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 404 to user: Instance 9f8b1f0f-b156-472e-9d6c-2472faa41847 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:52.434353 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f728f34a-3f17-4d24-ba5e-9053f28c28b8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers/9f8b1f0f-b156-472e-9d6c-2472faa41847/action" status: 404 len: 111 microversion: 2.1 time: 0.030009 Jul 25 14:58:52.443713 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-97c53a85-4e3d-4387-be90-b0af7cb19b90 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:52.445164 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-97c53a85-4e3d-4387-be90-b0af7cb19b90 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:52.450883 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3062/5895] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:58:52 2022] POST /compute/v2.1/servers/9f8b1f0f-b156-472e-9d6c-2472faa41847/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:58:52.453533 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-97c53a85-4e3d-4387-be90-b0af7cb19b90 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:52.454227 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-97c53a85-4e3d-4387-be90-b0af7cb19b90 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:52.455290 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-97c53a85-4e3d-4387-be90-b0af7cb19b90 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:52.455921 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-97c53a85-4e3d-4387-be90-b0af7cb19b90 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:52.807114 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-97c53a85-4e3d-4387-be90-b0af7cb19b90 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:52.832797 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-97c53a85-4e3d-4387-be90-b0af7cb19b90 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.392861 Jul 25 14:58:52.836129 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2834/5896] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:52 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:52.857942 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9ae5de21-ae0c-49b6-9861-1a0d0a999c77 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:52.858637 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9ae5de21-ae0c-49b6-9861-1a0d0a999c77 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:52.883998 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ae5de21-ae0c-49b6-9861-1a0d0a999c77 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:52.884480 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ae5de21-ae0c-49b6-9861-1a0d0a999c77 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:52.885298 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ae5de21-ae0c-49b6-9861-1a0d0a999c77 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:52.890018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ae5de21-ae0c-49b6-9861-1a0d0a999c77 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:53.368243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9ae5de21-ae0c-49b6-9861-1a0d0a999c77 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:53.378835 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9ae5de21-ae0c-49b6-9861-1a0d0a999c77 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.524845 Jul 25 14:58:53.383679 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3063/5897] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:52 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:53.406913 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-40676893-7422-4af3-a43a-4d509bb96783 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:53.407338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-40676893-7422-4af3-a43a-4d509bb96783 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 22b85acd-93e1-497b-9353-03a8e7711986] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:53.427325 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-40676893-7422-4af3-a43a-4d509bb96783 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Instance 22b85acd-93e1-497b-9353-03a8e7711986 could not be found. Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-40676893-7422-4af3-a43a-4d509bb96783 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/servers/22b85acd-93e1-497b-9353-03a8e7711986/action HTTP/1.1 Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 15 Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: {"restore": {}} Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 22b85acd-93e1-497b-9353-03a8e7711986 could not be found. Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '22b85acd-93e1-497b-9353-03a8e7711986', 'body': {'restore': {}}} Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22b85acd-93e1-497b-9353-03a8e7711986 could not be found. Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22b85acd-93e1-497b-9353-03a8e7711986 could not be found. Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:53.429410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:53.433513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:58:53.433513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:58:53.433513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22b85acd-93e1-497b-9353-03a8e7711986 could not be found. Jul 25 14:58:53.433513 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:53.435888 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-40676893-7422-4af3-a43a-4d509bb96783 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 404 to user: Instance 22b85acd-93e1-497b-9353-03a8e7711986 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:53.437191 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-40676893-7422-4af3-a43a-4d509bb96783 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers/22b85acd-93e1-497b-9353-03a8e7711986/action" status: 404 len: 111 microversion: 2.1 time: 0.034963 Jul 25 14:58:53.437981 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2835/5898] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:58:53 2022] POST /compute/v2.1/servers/22b85acd-93e1-497b-9353-03a8e7711986/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:58:53.446795 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d0097e57-9e59-4b27-8776-eadc0cb41873 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:53.447690 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d0097e57-9e59-4b27-8776-eadc0cb41873 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:53.461254 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d0097e57-9e59-4b27-8776-eadc0cb41873 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:53.461808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d0097e57-9e59-4b27-8776-eadc0cb41873 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:53.462657 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d0097e57-9e59-4b27-8776-eadc0cb41873 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:53.463098 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d0097e57-9e59-4b27-8776-eadc0cb41873 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:53.928553 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d0097e57-9e59-4b27-8776-eadc0cb41873 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:53.936979 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d0097e57-9e59-4b27-8776-eadc0cb41873 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.494323 Jul 25 14:58:53.953283 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3064/5899] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:53 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:53.959891 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c3c26c81-cccc-4319-b800-45d510a9899b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:53.960610 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c3c26c81-cccc-4319-b800-45d510a9899b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:53.971107 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c3c26c81-cccc-4319-b800-45d510a9899b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:53.971855 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c3c26c81-cccc-4319-b800-45d510a9899b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:53.972831 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c3c26c81-cccc-4319-b800-45d510a9899b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:53.973443 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c3c26c81-cccc-4319-b800-45d510a9899b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:54.186944 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c3c26c81-cccc-4319-b800-45d510a9899b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:54.200270 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c3c26c81-cccc-4319-b800-45d510a9899b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.244414 Jul 25 14:58:54.203017 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2836/5900] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:53 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:54.236250 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d1198b52-dcd0-411b-8028-405c05852d7f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:54.238191 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d1198b52-dcd0-411b-8028-405c05852d7f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:54.269767 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1198b52-dcd0-411b-8028-405c05852d7f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:54.271058 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1198b52-dcd0-411b-8028-405c05852d7f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:54.273001 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1198b52-dcd0-411b-8028-405c05852d7f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:54.275712 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d1198b52-dcd0-411b-8028-405c05852d7f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:54.361164 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-d1198b52-dcd0-411b-8028-405c05852d7f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Cannot 'restore' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state active Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d1198b52-dcd0-411b-8028-405c05852d7f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action HTTP/1.1 Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 15 Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: {"restore": {}} Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: exception: Cannot 'restore' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state active Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '34bbd65c-a1e0-4f6c-a775-8c9f847eccec', 'body': {'restore': {}}} Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec in vm_state active. Cannot restore while the instance is in this state. Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state active Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:54.366482 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:54.372652 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:54.372652 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:58:54.372652 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:58:54.372652 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state active Jul 25 14:58:54.372652 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:54.377015 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d1198b52-dcd0-411b-8028-405c05852d7f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 409 to user: Cannot 'restore' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state active {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:54.379146 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d1198b52-dcd0-411b-8028-405c05852d7f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action" status: 409 len: 145 microversion: 2.1 time: 0.156382 Jul 25 14:58:54.380799 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3065/5901] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:58:54 2022] POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action => generated 145 bytes in 159 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:58:54.391334 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-10364a31-735e-464c-a89f-39745662803e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:54.392243 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-10364a31-735e-464c-a89f-39745662803e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:54.411668 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-10364a31-735e-464c-a89f-39745662803e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:54.415121 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-10364a31-735e-464c-a89f-39745662803e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:54.418399 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-10364a31-735e-464c-a89f-39745662803e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:54.420917 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-10364a31-735e-464c-a89f-39745662803e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:54.751571 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-10364a31-735e-464c-a89f-39745662803e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:54.767397 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-10364a31-735e-464c-a89f-39745662803e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.378952 Jul 25 14:58:54.769343 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2837/5902] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:54 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:54.793436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-123ca289-599a-418a-b4bf-0ea7ea5fae81 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:54.794691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-123ca289-599a-418a-b4bf-0ea7ea5fae81 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:54.802289 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-123ca289-599a-418a-b4bf-0ea7ea5fae81 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:54.803171 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-123ca289-599a-418a-b4bf-0ea7ea5fae81 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:54.804209 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-123ca289-599a-418a-b4bf-0ea7ea5fae81 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:54.805574 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-123ca289-599a-418a-b4bf-0ea7ea5fae81 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:55.086025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-123ca289-599a-418a-b4bf-0ea7ea5fae81 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:55.105167 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-123ca289-599a-418a-b4bf-0ea7ea5fae81 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.313199 Jul 25 14:58:55.106415 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3066/5903] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:54 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:55.126734 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1807116b-f1e7-42c5-b2b1-16e1b4946c0d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:55.128411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1807116b-f1e7-42c5-b2b1-16e1b4946c0d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: ef1bf091-4e93-4b28-b5b4-1afafd7cf268] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:55.136407 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-1807116b-f1e7-42c5-b2b1-16e1b4946c0d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Instance ef1bf091-4e93-4b28-b5b4-1afafd7cf268 could not be found. Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1807116b-f1e7-42c5-b2b1-16e1b4946c0d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/servers/ef1bf091-4e93-4b28-b5b4-1afafd7cf268/action HTTP/1.1 Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 14 Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: {"resume": {}} Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance ef1bf091-4e93-4b28-b5b4-1afafd7cf268 could not be found. Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'ef1bf091-4e93-4b28-b5b4-1afafd7cf268', 'body': {'resume': {}}} Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef1bf091-4e93-4b28-b5b4-1afafd7cf268 could not be found. Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef1bf091-4e93-4b28-b5b4-1afafd7cf268 could not be found. Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:55.143505 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:55.148191 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:58:55.148191 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:58:55.148191 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef1bf091-4e93-4b28-b5b4-1afafd7cf268 could not be found. Jul 25 14:58:55.148191 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:55.150208 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1807116b-f1e7-42c5-b2b1-16e1b4946c0d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 404 to user: Instance ef1bf091-4e93-4b28-b5b4-1afafd7cf268 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:55.151659 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1807116b-f1e7-42c5-b2b1-16e1b4946c0d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers/ef1bf091-4e93-4b28-b5b4-1afafd7cf268/action" status: 404 len: 111 microversion: 2.1 time: 0.029286 Jul 25 14:58:55.162475 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5e2edf26-dc8b-4140-afd8-84bd67dc28ca tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:55.163584 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5e2edf26-dc8b-4140-afd8-84bd67dc28ca tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:55.171589 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2838/5904] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:58:55 2022] POST /compute/v2.1/servers/ef1bf091-4e93-4b28-b5b4-1afafd7cf268/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:58:55.175791 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5e2edf26-dc8b-4140-afd8-84bd67dc28ca tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:55.176865 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5e2edf26-dc8b-4140-afd8-84bd67dc28ca tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:55.177919 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5e2edf26-dc8b-4140-afd8-84bd67dc28ca tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:55.178727 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5e2edf26-dc8b-4140-afd8-84bd67dc28ca tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:55.506982 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5e2edf26-dc8b-4140-afd8-84bd67dc28ca tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:55.521608 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5e2edf26-dc8b-4140-afd8-84bd67dc28ca tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.364139 Jul 25 14:58:55.522625 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3067/5905] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:55 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:55.547105 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a6f1d61e-8635-4122-a8fd-d563da8a8160 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:55.548226 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a6f1d61e-8635-4122-a8fd-d563da8a8160 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:55.559888 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a6f1d61e-8635-4122-a8fd-d563da8a8160 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:55.563626 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a6f1d61e-8635-4122-a8fd-d563da8a8160 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:55.564845 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a6f1d61e-8635-4122-a8fd-d563da8a8160 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:55.569023 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a6f1d61e-8635-4122-a8fd-d563da8a8160 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:56.100434 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a6f1d61e-8635-4122-a8fd-d563da8a8160 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:56.120663 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a6f1d61e-8635-4122-a8fd-d563da8a8160 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.577278 Jul 25 14:58:56.130436 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2839/5906] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:55 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:56.151836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-07f890a9-f378-496d-b517-52fec1965f0a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:56.152848 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-07f890a9-f378-496d-b517-52fec1965f0a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:56.165601 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-07f890a9-f378-496d-b517-52fec1965f0a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:56.166042 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-07f890a9-f378-496d-b517-52fec1965f0a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:56.166867 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-07f890a9-f378-496d-b517-52fec1965f0a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:56.167571 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-07f890a9-f378-496d-b517-52fec1965f0a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:56.204099 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-07f890a9-f378-496d-b517-52fec1965f0a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Cannot 'resume' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state active Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-07f890a9-f378-496d-b517-52fec1965f0a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action HTTP/1.1 Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 14 Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: {"resume": {}} Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: exception: Cannot 'resume' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state active Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '34bbd65c-a1e0-4f6c-a775-8c9f847eccec', 'body': {'resume': {}}} Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec in vm_state active. Cannot resume while the instance is in this state. Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state active Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:56.221315 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:56.226814 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:56.226814 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:58:56.226814 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:58:56.226814 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state active Jul 25 14:58:56.226814 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:56.226814 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-07f890a9-f378-496d-b517-52fec1965f0a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 409 to user: Cannot 'resume' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state active {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:56.226814 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-07f890a9-f378-496d-b517-52fec1965f0a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action" status: 409 len: 144 microversion: 2.1 time: 0.075104 Jul 25 14:58:56.226814 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3068/5907] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:58:56 2022] POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action => generated 144 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:58:56.232952 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2e82fa55-9fa9-496f-a4c3-d1ce23994c1e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:56.233723 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2e82fa55-9fa9-496f-a4c3-d1ce23994c1e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:56.243090 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2e82fa55-9fa9-496f-a4c3-d1ce23994c1e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:56.246545 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2e82fa55-9fa9-496f-a4c3-d1ce23994c1e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:56.248139 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2e82fa55-9fa9-496f-a4c3-d1ce23994c1e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:56.248896 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2e82fa55-9fa9-496f-a4c3-d1ce23994c1e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:56.486092 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2e82fa55-9fa9-496f-a4c3-d1ce23994c1e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:56.494737 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2e82fa55-9fa9-496f-a4c3-d1ce23994c1e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.266255 Jul 25 14:58:56.509841 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2840/5908] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:56 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:56.520948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-14ad5adf-8980-4c9b-b288-4baea87d99fe tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:56.521575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-14ad5adf-8980-4c9b-b288-4baea87d99fe tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:56.533130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-14ad5adf-8980-4c9b-b288-4baea87d99fe tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:56.533510 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-14ad5adf-8980-4c9b-b288-4baea87d99fe tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:56.537555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-14ad5adf-8980-4c9b-b288-4baea87d99fe tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:56.539139 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-14ad5adf-8980-4c9b-b288-4baea87d99fe tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:56.805929 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-14ad5adf-8980-4c9b-b288-4baea87d99fe tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:56.830390 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-14ad5adf-8980-4c9b-b288-4baea87d99fe tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.313909 Jul 25 14:58:56.831266 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3069/5909] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:56 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:56.925416 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4bd0b81b-fac7-47b3-b46e-131b59221e97 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "41af874f-bd06-4a71-827d-6d815f202a2b"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4bd0b81b-fac7-47b3-b46e-131b59221e97 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 160 Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: {"server": {"name": "", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "41af874f-bd06-4a71-827d-6d815f202a2b"}]}} Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'body': {'server': {'name': '', 'imageRef': 'a7b14aba-1848-4a00-a3e7-b66eb3e97925', 'flavorRef': '452', 'networks': [{'uuid': '41af874f-bd06-4a71-827d-6d815f202a2b'}]}}} Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise error Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi '' Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 14:58:56.929722 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 14:58:56.934372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 14:58:56.934372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 25 14:58:56.934372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:56.934372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:56.934372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:56.934372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:56.934372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:56.934372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:56.934372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 14:58:56.934372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 14:58:56.934372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 25 14:58:56.934372 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 14:58:56.938332 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4bd0b81b-fac7-47b3-b46e-131b59221e97 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:56.939501 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4bd0b81b-fac7-47b3-b46e-131b59221e97 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.018015 Jul 25 14:58:56.947453 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2841/5910] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:58:56 2022] POST /compute/v2.1/servers => generated 108 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 14:58:56.953067 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2518c81a-98c0-469f-9660-7b4bcc9e6833 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:56.953755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2518c81a-98c0-469f-9660-7b4bcc9e6833 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:56.966383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2518c81a-98c0-469f-9660-7b4bcc9e6833 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:56.967800 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2518c81a-98c0-469f-9660-7b4bcc9e6833 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:56.970773 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2518c81a-98c0-469f-9660-7b4bcc9e6833 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:56.971262 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2518c81a-98c0-469f-9660-7b4bcc9e6833 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:57.359316 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2518c81a-98c0-469f-9660-7b4bcc9e6833 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:57.376848 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2518c81a-98c0-469f-9660-7b4bcc9e6833 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.427707 Jul 25 14:58:57.379704 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3070/5911] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:56 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:57.399843 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cba0a396-7c82-41af-8954-3c9fc6f03080 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:57.402899 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cba0a396-7c82-41af-8954-3c9fc6f03080 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:57.419698 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cba0a396-7c82-41af-8954-3c9fc6f03080 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:57.423107 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cba0a396-7c82-41af-8954-3c9fc6f03080 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:57.424766 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cba0a396-7c82-41af-8954-3c9fc6f03080 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:57.426576 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cba0a396-7c82-41af-8954-3c9fc6f03080 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:57.618269 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cba0a396-7c82-41af-8954-3c9fc6f03080 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:57.638658 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cba0a396-7c82-41af-8954-3c9fc6f03080 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.243185 Jul 25 14:58:57.648040 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2842/5912] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:57 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:58:57.660067 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6d1a4962-9676-44df-88df-0066656e5d36 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:57.660657 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6d1a4962-9676-44df-88df-0066656e5d36 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: fa48b8e0-95f6-4bdd-bc42-94b286676455] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:57.673941 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-6d1a4962-9676-44df-88df-0066656e5d36 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Instance fa48b8e0-95f6-4bdd-bc42-94b286676455 could not be found. Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6d1a4962-9676-44df-88df-0066656e5d36 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers/fa48b8e0-95f6-4bdd-bc42-94b286676455/action HTTP/1.1 Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 14 Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: {"shelve": {}} Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance fa48b8e0-95f6-4bdd-bc42-94b286676455 could not be found. Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'fa48b8e0-95f6-4bdd-bc42-94b286676455', 'body': {'shelve': {}}} Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa48b8e0-95f6-4bdd-bc42-94b286676455 could not be found. Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa48b8e0-95f6-4bdd-bc42-94b286676455 could not be found. Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:58:57.679144 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:58:57.683701 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:58:57.683701 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:58:57.683701 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa48b8e0-95f6-4bdd-bc42-94b286676455 could not be found. Jul 25 14:58:57.683701 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:58:57.683701 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6d1a4962-9676-44df-88df-0066656e5d36 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 404 to user: Instance fa48b8e0-95f6-4bdd-bc42-94b286676455 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:58:57.683701 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6d1a4962-9676-44df-88df-0066656e5d36 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers/fa48b8e0-95f6-4bdd-bc42-94b286676455/action" status: 404 len: 111 microversion: 2.1 time: 0.025358 Jul 25 14:58:57.691406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fab2f5e9-7788-4a84-b0bb-13bbcebf0589 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:57.692254 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fab2f5e9-7788-4a84-b0bb-13bbcebf0589 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:57.700483 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3071/5913] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:58:57 2022] POST /compute/v2.1/servers/fa48b8e0-95f6-4bdd-bc42-94b286676455/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 14:58:57.704636 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fab2f5e9-7788-4a84-b0bb-13bbcebf0589 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:57.705117 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fab2f5e9-7788-4a84-b0bb-13bbcebf0589 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:57.705915 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fab2f5e9-7788-4a84-b0bb-13bbcebf0589 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:57.706357 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fab2f5e9-7788-4a84-b0bb-13bbcebf0589 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:57.953657 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fab2f5e9-7788-4a84-b0bb-13bbcebf0589 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:57.965205 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fab2f5e9-7788-4a84-b0bb-13bbcebf0589 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.277577 Jul 25 14:58:57.967568 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2843/5914] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:57 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:57.988520 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e6dd4174-c279-418c-a4d4-88b10f28e21e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:57.989348 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e6dd4174-c279-418c-a4d4-88b10f28e21e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:58.002074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6dd4174-c279-418c-a4d4-88b10f28e21e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:58.002860 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6dd4174-c279-418c-a4d4-88b10f28e21e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:58.003680 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6dd4174-c279-418c-a4d4-88b10f28e21e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:58.005250 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6dd4174-c279-418c-a4d4-88b10f28e21e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:58.330611 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e6dd4174-c279-418c-a4d4-88b10f28e21e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:58.349292 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e6dd4174-c279-418c-a4d4-88b10f28e21e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.365212 Jul 25 14:58:58.354449 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3072/5915] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:57 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:58:58.377600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-495745a7-2806-4739-8cb7-f1998c6f9d4a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:58:58.378338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-495745a7-2806-4739-8cb7-f1998c6f9d4a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:58.386813 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-495745a7-2806-4739-8cb7-f1998c6f9d4a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:58.387666 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-495745a7-2806-4739-8cb7-f1998c6f9d4a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:58.388504 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-495745a7-2806-4739-8cb7-f1998c6f9d4a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:58.388827 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-495745a7-2806-4739-8cb7-f1998c6f9d4a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:58.425425 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:58:58.442884 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-495745a7-2806-4739-8cb7-f1998c6f9d4a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lazy-loading 'flavor' on Instance uuid 34bbd65c-a1e0-4f6c-a775-8c9f847eccec {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:58:58.732545 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-495745a7-2806-4739-8cb7-f1998c6f9d4a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action" status: 202 len: 0 microversion: 2.1 time: 0.358761 Jul 25 14:58:58.733235 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2844/5916] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:58:58 2022] POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:58:58.742506 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-793d941a-cd06-473b-a83d-1eb4690ff63c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:58:58.742506 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-793d941a-cd06-473b-a83d-1eb4690ff63c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:58:58.753942 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-793d941a-cd06-473b-a83d-1eb4690ff63c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:58.758773 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-793d941a-cd06-473b-a83d-1eb4690ff63c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:58.761473 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-793d941a-cd06-473b-a83d-1eb4690ff63c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:58:58.768060 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-793d941a-cd06-473b-a83d-1eb4690ff63c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:58:59.042334 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-793d941a-cd06-473b-a83d-1eb4690ff63c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:58:59.063315 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-793d941a-cd06-473b-a83d-1eb4690ff63c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1511 microversion: 2.1 time: 0.324905 Jul 25 14:58:59.064311 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3073/5917] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:58:58 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1511 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:00.097811 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c1c72d03-edad-4076-9e74-474f9887344f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:00.099698 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c1c72d03-edad-4076-9e74-474f9887344f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:00.120380 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c1c72d03-edad-4076-9e74-474f9887344f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:00.121352 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c1c72d03-edad-4076-9e74-474f9887344f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:00.124925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c1c72d03-edad-4076-9e74-474f9887344f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:00.125600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c1c72d03-edad-4076-9e74-474f9887344f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:00.479033 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c1c72d03-edad-4076-9e74-474f9887344f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:00.487401 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c1c72d03-edad-4076-9e74-474f9887344f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1511 microversion: 2.1 time: 0.405259 Jul 25 14:59:00.491902 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2845/5918] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:00 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1511 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:01.511288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b557a171-0b7a-4ef3-af45-4afc6c4a1f39 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:01.512914 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b557a171-0b7a-4ef3-af45-4afc6c4a1f39 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:01.520373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b557a171-0b7a-4ef3-af45-4afc6c4a1f39 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:01.521236 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b557a171-0b7a-4ef3-af45-4afc6c4a1f39 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:01.522465 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b557a171-0b7a-4ef3-af45-4afc6c4a1f39 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:01.522946 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b557a171-0b7a-4ef3-af45-4afc6c4a1f39 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:01.527875 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:59:01.731623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b557a171-0b7a-4ef3-af45-4afc6c4a1f39 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:01.744423 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b557a171-0b7a-4ef3-af45-4afc6c4a1f39 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1511 microversion: 2.1 time: 0.239253 Jul 25 14:59:01.765734 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3074/5919] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:01 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1511 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:02.796672 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0b645333-4c83-4fe5-b26b-5eff85bbb5f8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:02.797346 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0b645333-4c83-4fe5-b26b-5eff85bbb5f8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:02.831459 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b645333-4c83-4fe5-b26b-5eff85bbb5f8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:02.832058 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b645333-4c83-4fe5-b26b-5eff85bbb5f8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:02.835838 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b645333-4c83-4fe5-b26b-5eff85bbb5f8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:02.836577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b645333-4c83-4fe5-b26b-5eff85bbb5f8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:03.177539 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0b645333-4c83-4fe5-b26b-5eff85bbb5f8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:03.190619 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0b645333-4c83-4fe5-b26b-5eff85bbb5f8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1511 microversion: 2.1 time: 0.420834 Jul 25 14:59:03.191588 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2846/5920] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:02 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1511 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:03.252332 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-24dc9810-f557-4e56-a62f-194854b4eb31 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:03.252878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-24dc9810-f557-4e56-a62f-194854b4eb31 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:03.270081 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-24dc9810-f557-4e56-a62f-194854b4eb31 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:03.270599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-24dc9810-f557-4e56-a62f-194854b4eb31 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:03.271425 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-24dc9810-f557-4e56-a62f-194854b4eb31 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:03.271861 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-24dc9810-f557-4e56-a62f-194854b4eb31 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:03.506753 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-24dc9810-f557-4e56-a62f-194854b4eb31 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:03.516435 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-24dc9810-f557-4e56-a62f-194854b4eb31 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1682 microversion: 2.1 time: 0.268196 Jul 25 14:59:03.517104 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3075/5921] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:03 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1682 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:03.681954 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3d3008a6-a426-4eb3-92e2-e531270fba49 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:59:03.685501 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3d3008a6-a426-4eb3-92e2-e531270fba49 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:03.694520 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3d3008a6-a426-4eb3-92e2-e531270fba49 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:03.695155 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3d3008a6-a426-4eb3-92e2-e531270fba49 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:03.696139 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3d3008a6-a426-4eb3-92e2-e531270fba49 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:03.696740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3d3008a6-a426-4eb3-92e2-e531270fba49 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:03.768544 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3d3008a6-a426-4eb3-92e2-e531270fba49 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "POST /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc/action" status: 200 len: 32642 microversion: 2.1 time: 0.090288 Jul 25 14:59:03.769452 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2847/5922] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:59:03 2022] POST /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc/action => generated 32642 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 14:59:03.941582 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d2733484-7f9e-4969-91fc-ff9e12a1164d tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:03.946082 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d2733484-7f9e-4969-91fc-ff9e12a1164d tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:03.956219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d2733484-7f9e-4969-91fc-ff9e12a1164d tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:03.964576 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d2733484-7f9e-4969-91fc-ff9e12a1164d tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:03.965716 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d2733484-7f9e-4969-91fc-ff9e12a1164d tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:03.966268 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d2733484-7f9e-4969-91fc-ff9e12a1164d tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:04.191485 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d2733484-7f9e-4969-91fc-ff9e12a1164d tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1835 microversion: 2.1 time: 0.253697 Jul 25 14:59:04.196115 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3076/5923] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:03 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1835 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:04.211161 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e7c1e216-926c-464e-beff-1f023ac3a161 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:04.211887 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e7c1e216-926c-464e-beff-1f023ac3a161 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:04.230789 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5ccd4438-6b5d-4e14-9343-374e6ae379c5 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:59:04.233710 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5ccd4438-6b5d-4e14-9343-374e6ae379c5 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:04.243703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e7c1e216-926c-464e-beff-1f023ac3a161 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:04.244327 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e7c1e216-926c-464e-beff-1f023ac3a161 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:04.245186 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e7c1e216-926c-464e-beff-1f023ac3a161 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:04.245631 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e7c1e216-926c-464e-beff-1f023ac3a161 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:04.255552 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ccd4438-6b5d-4e14-9343-374e6ae379c5 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:04.256144 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ccd4438-6b5d-4e14-9343-374e6ae379c5 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:04.263132 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ccd4438-6b5d-4e14-9343-374e6ae379c5 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:04.263587 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ccd4438-6b5d-4e14-9343-374e6ae379c5 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:04.368557 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-5ccd4438-6b5d-4e14-9343-374e6ae379c5 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lazy-loading 'flavor' on Instance uuid 56335d40-d6c2-4292-9547-16a55e66d2dc {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:59:04.398862 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5ccd4438-6b5d-4e14-9343-374e6ae379c5 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Going to try to live migrate instance to another host {{(pid=119304) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 14:59:04.787457 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e7c1e216-926c-464e-beff-1f023ac3a161 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:04.816844 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e7c1e216-926c-464e-beff-1f023ac3a161 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1511 microversion: 2.1 time: 0.606820 Jul 25 14:59:04.832139 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2848/5924] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:04 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1511 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:05.856449 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-72290577-3f1c-433a-a9e6-ffa8968f154e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:05.857079 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-72290577-3f1c-433a-a9e6-ffa8968f154e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:05.871587 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-72290577-3f1c-433a-a9e6-ffa8968f154e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:05.872065 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-72290577-3f1c-433a-a9e6-ffa8968f154e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:05.872885 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-72290577-3f1c-433a-a9e6-ffa8968f154e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:05.873354 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-72290577-3f1c-433a-a9e6-ffa8968f154e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:06.117417 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-72290577-3f1c-433a-a9e6-ffa8968f154e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:06.131948 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-72290577-3f1c-433a-a9e6-ffa8968f154e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1511 microversion: 2.1 time: 0.282749 Jul 25 14:59:06.132567 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2849/5925] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:05 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1511 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:59:07.153830 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cbb8e75b-8cd2-4914-b24b-beb672c7e386 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:07.154451 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cbb8e75b-8cd2-4914-b24b-beb672c7e386 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:07.161862 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cbb8e75b-8cd2-4914-b24b-beb672c7e386 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:07.162550 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cbb8e75b-8cd2-4914-b24b-beb672c7e386 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:07.163533 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cbb8e75b-8cd2-4914-b24b-beb672c7e386 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:07.164185 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cbb8e75b-8cd2-4914-b24b-beb672c7e386 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:07.558527 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cbb8e75b-8cd2-4914-b24b-beb672c7e386 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:07.574349 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cbb8e75b-8cd2-4914-b24b-beb672c7e386 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1511 microversion: 2.1 time: 0.422315 Jul 25 14:59:07.597190 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2850/5926] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:07 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1511 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:07.743920 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5ccd4438-6b5d-4e14-9343-374e6ae379c5 tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc/action" status: 202 len: 0 microversion: 2.1 time: 3.515915 Jul 25 14:59:07.753386 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3077/5927] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:59:04 2022] POST /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc/action => generated 0 bytes in 3526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:59:07.758662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7f9feede-e981-4ff0-a30a-44b1eda02467 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:07.760527 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7f9feede-e981-4ff0-a30a-44b1eda02467 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:07.777039 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7f9feede-e981-4ff0-a30a-44b1eda02467 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:07.778137 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7f9feede-e981-4ff0-a30a-44b1eda02467 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:07.779332 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7f9feede-e981-4ff0-a30a-44b1eda02467 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:07.800405 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7f9feede-e981-4ff0-a30a-44b1eda02467 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:08.088712 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7f9feede-e981-4ff0-a30a-44b1eda02467 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:08.102970 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7f9feede-e981-4ff0-a30a-44b1eda02467 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1692 microversion: 2.1 time: 0.350309 Jul 25 14:59:08.105296 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2851/5928] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:07 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1692 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:08.606887 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7daba2c1-556e-4171-ac79-c70f8a27a5f7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:08.607763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7daba2c1-556e-4171-ac79-c70f8a27a5f7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:08.624522 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7daba2c1-556e-4171-ac79-c70f8a27a5f7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:08.626019 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7daba2c1-556e-4171-ac79-c70f8a27a5f7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:08.627777 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7daba2c1-556e-4171-ac79-c70f8a27a5f7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:08.629648 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7daba2c1-556e-4171-ac79-c70f8a27a5f7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:09.038684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7daba2c1-556e-4171-ac79-c70f8a27a5f7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:09.052163 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7daba2c1-556e-4171-ac79-c70f8a27a5f7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1511 microversion: 2.1 time: 0.450949 Jul 25 14:59:09.053229 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3078/5929] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:08 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1511 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:09.127080 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2843a84f-61ef-4ec0-9dc5-c84181106640 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:09.128873 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2843a84f-61ef-4ec0-9dc5-c84181106640 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:09.137946 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2843a84f-61ef-4ec0-9dc5-c84181106640 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:09.138912 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2843a84f-61ef-4ec0-9dc5-c84181106640 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:09.140038 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2843a84f-61ef-4ec0-9dc5-c84181106640 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:09.140776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2843a84f-61ef-4ec0-9dc5-c84181106640 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:09.316974 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2843a84f-61ef-4ec0-9dc5-c84181106640 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:09.326738 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2843a84f-61ef-4ec0-9dc5-c84181106640 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1692 microversion: 2.1 time: 0.203684 Jul 25 14:59:09.341502 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2852/5930] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:09 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1692 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:10.078725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4118f4a6-c7a3-42fe-96fa-e26d142bb4d8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:10.080619 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4118f4a6-c7a3-42fe-96fa-e26d142bb4d8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:10.099198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4118f4a6-c7a3-42fe-96fa-e26d142bb4d8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:10.103185 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4118f4a6-c7a3-42fe-96fa-e26d142bb4d8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:10.106429 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4118f4a6-c7a3-42fe-96fa-e26d142bb4d8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:10.109515 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4118f4a6-c7a3-42fe-96fa-e26d142bb4d8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:10.680822 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-cd731d8a-5b4c-4a39-adce-955722290cff req-10c04cdf-4fee-4349-9169-84f2ea46ac37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56335d40-d6c2-4292-9547-16a55e66d2dc", "name": "network-vif-unplugged", "status": "completed", "tag": "f01e46b0-4607-4910-97dc-20a41f89640b"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:59:10.701753 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-cd731d8a-5b4c-4a39-adce-955722290cff req-10c04cdf-4fee-4349-9169-84f2ea46ac37 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:10.702207 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-cd731d8a-5b4c-4a39-adce-955722290cff req-10c04cdf-4fee-4349-9169-84f2ea46ac37 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:10.748809 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-cd731d8a-5b4c-4a39-adce-955722290cff req-10c04cdf-4fee-4349-9169-84f2ea46ac37 service nova] Creating event network-vif-unplugged:f01e46b0-4607-4910-97dc-20a41f89640b for instance 56335d40-d6c2-4292-9547-16a55e66d2dc on n-h1-846435-14 Jul 25 14:59:10.760882 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-cd731d8a-5b4c-4a39-adce-955722290cff req-10c04cdf-4fee-4349-9169-84f2ea46ac37 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.627230 Jul 25 14:59:10.762397 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2853/5931] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:59:10.779670 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1ff53912-7a6d-4707-acb4-54ff19d1faf5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:10.780952 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1ff53912-7a6d-4707-acb4-54ff19d1faf5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:10.795150 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ff53912-7a6d-4707-acb4-54ff19d1faf5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:10.795788 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ff53912-7a6d-4707-acb4-54ff19d1faf5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:10.796797 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ff53912-7a6d-4707-acb4-54ff19d1faf5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:10.804008 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ff53912-7a6d-4707-acb4-54ff19d1faf5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:11.248446 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1ff53912-7a6d-4707-acb4-54ff19d1faf5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:11.300274 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1ff53912-7a6d-4707-acb4-54ff19d1faf5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1692 microversion: 2.1 time: 0.532216 Jul 25 14:59:11.301149 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2854/5932] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:10 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1692 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:11.513569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4118f4a6-c7a3-42fe-96fa-e26d142bb4d8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:11.528397 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4118f4a6-c7a3-42fe-96fa-e26d142bb4d8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1511 microversion: 2.1 time: 1.455114 Jul 25 14:59:11.530840 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3079/5933] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:10 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1511 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:12.325765 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e311eeb5-7ab5-435f-bb03-f16cdaa27901 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:12.326577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e311eeb5-7ab5-435f-bb03-f16cdaa27901 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:12.343517 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e311eeb5-7ab5-435f-bb03-f16cdaa27901 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:12.348869 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e311eeb5-7ab5-435f-bb03-f16cdaa27901 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:12.350342 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e311eeb5-7ab5-435f-bb03-f16cdaa27901 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:12.351050 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e311eeb5-7ab5-435f-bb03-f16cdaa27901 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:12.552977 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f196b172-d7fb-41d8-8d63-605a17ed3b45 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:12.553673 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f196b172-d7fb-41d8-8d63-605a17ed3b45 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:12.572608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f196b172-d7fb-41d8-8d63-605a17ed3b45 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:12.573611 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f196b172-d7fb-41d8-8d63-605a17ed3b45 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:12.574528 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f196b172-d7fb-41d8-8d63-605a17ed3b45 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:12.575804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f196b172-d7fb-41d8-8d63-605a17ed3b45 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:12.836897 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f196b172-d7fb-41d8-8d63-605a17ed3b45 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:12.845749 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f196b172-d7fb-41d8-8d63-605a17ed3b45 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1532 microversion: 2.1 time: 0.297042 Jul 25 14:59:12.860851 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3080/5934] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:12 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1532 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:59:12.911704 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e311eeb5-7ab5-435f-bb03-f16cdaa27901 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:12.923533 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e311eeb5-7ab5-435f-bb03-f16cdaa27901 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1692 microversion: 2.1 time: 0.602059 Jul 25 14:59:12.937673 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2855/5935] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:12 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1692 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:13.373712 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-d5e89e2a-dfe1-494f-bf21-edcbf3d46a58 req-c4e800d8-8a1e-44d8-87d2-8264d56b1ebd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56335d40-d6c2-4292-9547-16a55e66d2dc", "tag": "f01e46b0-4607-4910-97dc-20a41f89640b"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:59:13.385762 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-d5e89e2a-dfe1-494f-bf21-edcbf3d46a58 req-c4e800d8-8a1e-44d8-87d2-8264d56b1ebd service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:13.386547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-d5e89e2a-dfe1-494f-bf21-edcbf3d46a58 req-c4e800d8-8a1e-44d8-87d2-8264d56b1ebd service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:13.400329 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-d5e89e2a-dfe1-494f-bf21-edcbf3d46a58 req-c4e800d8-8a1e-44d8-87d2-8264d56b1ebd service nova] Creating event network-changed:f01e46b0-4607-4910-97dc-20a41f89640b for instance 56335d40-d6c2-4292-9547-16a55e66d2dc on n-h1-846435-14 Jul 25 14:59:13.418724 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-d5e89e2a-dfe1-494f-bf21-edcbf3d46a58 req-c4e800d8-8a1e-44d8-87d2-8264d56b1ebd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048647 Jul 25 14:59:13.419618 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3081/5936] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:59:13.868320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-abfcbb45-a606-4287-9df9-d21e1d8d7ba3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:13.870818 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-abfcbb45-a606-4287-9df9-d21e1d8d7ba3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:13.877373 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-abfcbb45-a606-4287-9df9-d21e1d8d7ba3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:13.878186 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-abfcbb45-a606-4287-9df9-d21e1d8d7ba3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:13.879148 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-abfcbb45-a606-4287-9df9-d21e1d8d7ba3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:13.879738 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-abfcbb45-a606-4287-9df9-d21e1d8d7ba3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:13.948449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2918a14e-a250-4f31-8cdb-9f426d3ffe9c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:13.950792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2918a14e-a250-4f31-8cdb-9f426d3ffe9c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:13.954670 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=62 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:59:13.960170 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2918a14e-a250-4f31-8cdb-9f426d3ffe9c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:13.960721 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2918a14e-a250-4f31-8cdb-9f426d3ffe9c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:13.965984 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2918a14e-a250-4f31-8cdb-9f426d3ffe9c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:13.966710 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2918a14e-a250-4f31-8cdb-9f426d3ffe9c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:14.173326 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2918a14e-a250-4f31-8cdb-9f426d3ffe9c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:14.183799 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2918a14e-a250-4f31-8cdb-9f426d3ffe9c tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1692 microversion: 2.1 time: 0.239555 Jul 25 14:59:14.196401 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3082/5937] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:13 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1692 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:59:14.313233 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-abfcbb45-a606-4287-9df9-d21e1d8d7ba3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:14.343642 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-abfcbb45-a606-4287-9df9-d21e1d8d7ba3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1532 microversion: 2.1 time: 0.476928 Jul 25 14:59:14.356991 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2856/5938] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:13 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1532 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:14.913891 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-c2b83a45-8e1c-442c-afa5-58dcc132889f req-2ce60745-e097-40b0-976a-0a3658a31f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34bbd65c-a1e0-4f6c-a775-8c9f847eccec", "name": "network-vif-plugged", "status": "completed", "tag": "6bd9c9b1-8f44-48ec-8ace-8bfe7e29920e"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:59:14.941157 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c2b83a45-8e1c-442c-afa5-58dcc132889f req-2ce60745-e097-40b0-976a-0a3658a31f0d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:14.944078 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c2b83a45-8e1c-442c-afa5-58dcc132889f req-2ce60745-e097-40b0-976a-0a3658a31f0d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:14.988577 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-c2b83a45-8e1c-442c-afa5-58dcc132889f req-2ce60745-e097-40b0-976a-0a3658a31f0d service nova] Creating event network-vif-plugged:6bd9c9b1-8f44-48ec-8ace-8bfe7e29920e for instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec on n-h2-846435-14 Jul 25 14:59:15.003968 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-c2b83a45-8e1c-442c-afa5-58dcc132889f req-2ce60745-e097-40b0-976a-0a3658a31f0d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093189 Jul 25 14:59:15.006454 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3083/5939] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:59:15.206911 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-da6b22e7-53f0-4120-8242-37ced9f26ccc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:15.207302 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-da6b22e7-53f0-4120-8242-37ced9f26ccc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:15.214729 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da6b22e7-53f0-4120-8242-37ced9f26ccc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:15.223581 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da6b22e7-53f0-4120-8242-37ced9f26ccc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:15.230180 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da6b22e7-53f0-4120-8242-37ced9f26ccc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:15.231601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da6b22e7-53f0-4120-8242-37ced9f26ccc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:15.380626 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-142ef9bc-0881-4bbf-87d0-c4313944d2a8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:15.381608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-142ef9bc-0881-4bbf-87d0-c4313944d2a8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:15.391232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-142ef9bc-0881-4bbf-87d0-c4313944d2a8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:15.391908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-142ef9bc-0881-4bbf-87d0-c4313944d2a8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:15.392939 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-142ef9bc-0881-4bbf-87d0-c4313944d2a8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:15.393626 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-142ef9bc-0881-4bbf-87d0-c4313944d2a8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:15.570114 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-142ef9bc-0881-4bbf-87d0-c4313944d2a8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:15.578974 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-142ef9bc-0881-4bbf-87d0-c4313944d2a8 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1532 microversion: 2.1 time: 0.207876 Jul 25 14:59:15.580450 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3084/5940] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:15 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1532 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:59:15.597423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-da6b22e7-53f0-4120-8242-37ced9f26ccc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:15.606266 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-da6b22e7-53f0-4120-8242-37ced9f26ccc tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1692 microversion: 2.1 time: 0.404514 Jul 25 14:59:15.608758 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2857/5941] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:15 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1692 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:16.602528 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-872d6ce6-a5ef-4098-8035-1caf21173cd6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:16.603713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-872d6ce6-a5ef-4098-8035-1caf21173cd6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:16.612038 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-872d6ce6-a5ef-4098-8035-1caf21173cd6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:16.613503 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-872d6ce6-a5ef-4098-8035-1caf21173cd6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:16.614566 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-872d6ce6-a5ef-4098-8035-1caf21173cd6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:16.615618 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-872d6ce6-a5ef-4098-8035-1caf21173cd6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:16.629079 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-909c5334-9d6c-4d30-a585-fb235f7bd069 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:16.629703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-909c5334-9d6c-4d30-a585-fb235f7bd069 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:16.644393 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-909c5334-9d6c-4d30-a585-fb235f7bd069 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:16.644850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-909c5334-9d6c-4d30-a585-fb235f7bd069 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:16.645832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-909c5334-9d6c-4d30-a585-fb235f7bd069 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:16.646283 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-909c5334-9d6c-4d30-a585-fb235f7bd069 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:16.975349 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-909c5334-9d6c-4d30-a585-fb235f7bd069 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:16.988892 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-909c5334-9d6c-4d30-a585-fb235f7bd069 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1692 microversion: 2.1 time: 0.363535 Jul 25 14:59:16.993697 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2858/5942] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:16 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1692 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:17.228939 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-872d6ce6-a5ef-4098-8035-1caf21173cd6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:17.251207 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-872d6ce6-a5ef-4098-8035-1caf21173cd6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1532 microversion: 2.1 time: 0.648659 Jul 25 14:59:17.253717 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3085/5943] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:16 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1532 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:18.015742 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b59d17a0-9700-4395-90e0-7c4e9efa95ba tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:18.016637 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b59d17a0-9700-4395-90e0-7c4e9efa95ba tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:18.029455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b59d17a0-9700-4395-90e0-7c4e9efa95ba tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:18.033783 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b59d17a0-9700-4395-90e0-7c4e9efa95ba tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:18.037841 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b59d17a0-9700-4395-90e0-7c4e9efa95ba tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:18.039249 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b59d17a0-9700-4395-90e0-7c4e9efa95ba tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:18.279910 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-63dca4f3-720e-48d5-97d5-e5814d2de2a5 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:18.283403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-63dca4f3-720e-48d5-97d5-e5814d2de2a5 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:18.304714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b59d17a0-9700-4395-90e0-7c4e9efa95ba tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:18.305664 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63dca4f3-720e-48d5-97d5-e5814d2de2a5 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:18.306280 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63dca4f3-720e-48d5-97d5-e5814d2de2a5 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:18.307268 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63dca4f3-720e-48d5-97d5-e5814d2de2a5 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:18.313135 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63dca4f3-720e-48d5-97d5-e5814d2de2a5 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:18.313246 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b59d17a0-9700-4395-90e0-7c4e9efa95ba tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1692 microversion: 2.1 time: 0.302976 Jul 25 14:59:18.331860 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2859/5944] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:18 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1692 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:18.558616 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-63dca4f3-720e-48d5-97d5-e5814d2de2a5 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:18.573173 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-63dca4f3-720e-48d5-97d5-e5814d2de2a5 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1532 microversion: 2.1 time: 0.298216 Jul 25 14:59:18.588330 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3086/5945] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:18 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1532 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:59:19.340127 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a047131b-d7f0-4172-95f9-ca83991ffead tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:19.340747 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a047131b-d7f0-4172-95f9-ca83991ffead tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:19.359818 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a047131b-d7f0-4172-95f9-ca83991ffead tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:19.360593 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a047131b-d7f0-4172-95f9-ca83991ffead tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:19.361556 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a047131b-d7f0-4172-95f9-ca83991ffead tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:19.362186 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a047131b-d7f0-4172-95f9-ca83991ffead tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:19.367021 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:59:19.596955 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ab18caa4-08ec-4727-aa8a-7e1ca7f752b3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:19.598639 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ab18caa4-08ec-4727-aa8a-7e1ca7f752b3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:19.637573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ab18caa4-08ec-4727-aa8a-7e1ca7f752b3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:19.640414 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ab18caa4-08ec-4727-aa8a-7e1ca7f752b3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:19.641510 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ab18caa4-08ec-4727-aa8a-7e1ca7f752b3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:19.649181 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ab18caa4-08ec-4727-aa8a-7e1ca7f752b3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:19.799255 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a047131b-d7f0-4172-95f9-ca83991ffead tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:19.812833 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a047131b-d7f0-4172-95f9-ca83991ffead tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1692 microversion: 2.1 time: 0.476287 Jul 25 14:59:19.813635 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2860/5946] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:19 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1692 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:20.835161 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1b7b153f-3b6d-41d8-bbf8-458b32d681b3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:20.835813 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1b7b153f-3b6d-41d8-bbf8-458b32d681b3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:20.844453 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1b7b153f-3b6d-41d8-bbf8-458b32d681b3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:20.845127 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1b7b153f-3b6d-41d8-bbf8-458b32d681b3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:20.846092 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1b7b153f-3b6d-41d8-bbf8-458b32d681b3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:20.853293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1b7b153f-3b6d-41d8-bbf8-458b32d681b3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:20.917342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ab18caa4-08ec-4727-aa8a-7e1ca7f752b3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:20.933612 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ab18caa4-08ec-4727-aa8a-7e1ca7f752b3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1527 microversion: 2.1 time: 1.342076 Jul 25 14:59:20.934837 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3087/5947] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:19 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1527 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:21.251361 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1b7b153f-3b6d-41d8-bbf8-458b32d681b3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:21.275534 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1b7b153f-3b6d-41d8-bbf8-458b32d681b3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1692 microversion: 2.1 time: 0.444438 Jul 25 14:59:21.278956 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2861/5948] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:20 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1692 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:21.958520 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-412b5c28-f54e-4b29-b5ed-52e1e87edf98 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:21.959129 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-412b5c28-f54e-4b29-b5ed-52e1e87edf98 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:21.967109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-412b5c28-f54e-4b29-b5ed-52e1e87edf98 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:21.978626 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-412b5c28-f54e-4b29-b5ed-52e1e87edf98 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:21.979888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-412b5c28-f54e-4b29-b5ed-52e1e87edf98 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:21.980248 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-412b5c28-f54e-4b29-b5ed-52e1e87edf98 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:22.312657 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-23f8b321-6981-465a-88b0-32ffe6ff0885 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:22.313427 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-23f8b321-6981-465a-88b0-32ffe6ff0885 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:22.330029 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=58 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:59:22.365067 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-23f8b321-6981-465a-88b0-32ffe6ff0885 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:22.366076 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-23f8b321-6981-465a-88b0-32ffe6ff0885 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:22.377085 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-23f8b321-6981-465a-88b0-32ffe6ff0885 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:22.378107 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-23f8b321-6981-465a-88b0-32ffe6ff0885 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:22.485888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-412b5c28-f54e-4b29-b5ed-52e1e87edf98 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:22.508359 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-412b5c28-f54e-4b29-b5ed-52e1e87edf98 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1527 microversion: 2.1 time: 0.553702 Jul 25 14:59:22.513331 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3088/5949] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:21 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1527 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:22.811523 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-23f8b321-6981-465a-88b0-32ffe6ff0885 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:22.824729 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-23f8b321-6981-465a-88b0-32ffe6ff0885 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1692 microversion: 2.1 time: 0.526919 Jul 25 14:59:22.827919 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2862/5950] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:22 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1692 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:23.532287 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b88b9016-30e3-44dd-9062-2d612bc8433c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:23.533006 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b88b9016-30e3-44dd-9062-2d612bc8433c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:23.548213 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b88b9016-30e3-44dd-9062-2d612bc8433c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:23.549156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b88b9016-30e3-44dd-9062-2d612bc8433c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:23.553285 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b88b9016-30e3-44dd-9062-2d612bc8433c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:23.553285 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b88b9016-30e3-44dd-9062-2d612bc8433c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:23.625865 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-acaa1909-929a-42ec-a50f-fcf500419001 req-58e44bd9-9320-4b82-a762-c02110411264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56335d40-d6c2-4292-9547-16a55e66d2dc", "name": "network-vif-unplugged", "status": "completed", "tag": "f01e46b0-4607-4910-97dc-20a41f89640b"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:59:23.653974 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-acaa1909-929a-42ec-a50f-fcf500419001 req-58e44bd9-9320-4b82-a762-c02110411264 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:23.678553 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-acaa1909-929a-42ec-a50f-fcf500419001 req-58e44bd9-9320-4b82-a762-c02110411264 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:23.709096 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-acaa1909-929a-42ec-a50f-fcf500419001 req-58e44bd9-9320-4b82-a762-c02110411264 service nova] Creating event network-vif-unplugged:f01e46b0-4607-4910-97dc-20a41f89640b for instance 56335d40-d6c2-4292-9547-16a55e66d2dc on n-h1-846435-14 Jul 25 14:59:23.724682 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-acaa1909-929a-42ec-a50f-fcf500419001 req-58e44bd9-9320-4b82-a762-c02110411264 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103077 Jul 25 14:59:23.726037 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2863/5951] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:59:23.862770 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-01087a37-3a0e-4032-a7c4-ac4b71be287f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:23.864226 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-01087a37-3a0e-4032-a7c4-ac4b71be287f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:23.876466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-01087a37-3a0e-4032-a7c4-ac4b71be287f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:23.881832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-01087a37-3a0e-4032-a7c4-ac4b71be287f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:23.883708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-01087a37-3a0e-4032-a7c4-ac4b71be287f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:23.884537 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-01087a37-3a0e-4032-a7c4-ac4b71be287f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:24.138793 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b88b9016-30e3-44dd-9062-2d612bc8433c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:24.151005 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b88b9016-30e3-44dd-9062-2d612bc8433c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1527 microversion: 2.1 time: 0.623253 Jul 25 14:59:24.153512 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3089/5952] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:23 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1527 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:25.176604 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-909c8bb9-9468-4556-978e-76933362efe5 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:25.177387 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-909c8bb9-9468-4556-978e-76933362efe5 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:25.189875 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-909c8bb9-9468-4556-978e-76933362efe5 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:25.191529 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-909c8bb9-9468-4556-978e-76933362efe5 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:25.193060 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-909c8bb9-9468-4556-978e-76933362efe5 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:25.196979 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-909c8bb9-9468-4556-978e-76933362efe5 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:25.232909 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-01087a37-3a0e-4032-a7c4-ac4b71be287f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:25.243190 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-01087a37-3a0e-4032-a7c4-ac4b71be287f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1692 microversion: 2.1 time: 1.393822 Jul 25 14:59:25.256498 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2864/5953] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:23 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1692 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:59:25.276828 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:59:25.546765 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-909c8bb9-9468-4556-978e-76933362efe5 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:25.565125 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-909c8bb9-9468-4556-978e-76933362efe5 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1527 microversion: 2.1 time: 0.392366 Jul 25 14:59:25.577338 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3090/5954] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:25 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1527 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:59:25.660688 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-788ea34a-270f-47f1-89dc-0d20f2a2b735 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Action: 'create', calling method: .version_select at 0x7f4686c06ee0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1272211954", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcFRhKfKAcng4arOFSpWkAIMb0Sfdkhs/d/vexbOy0KKx+QF01/edbC4cS+u87ZgNyFddiC5sTHUtCfQaGGqMZnuhWxUPvr9h9a0XrO0jvdQsQ8HmKsoNdE4XHszo4D1w=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:59:25.692076 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-788ea34a-270f-47f1-89dc-0d20f2a2b735 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Getting quotas for project 3a1220781eb4456d9afaca1ebec42203. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:59:25.710302 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-788ea34a-270f-47f1-89dc-0d20f2a2b735 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Getting quotas for user dd3fdf21e7be4de2817a73d402a34c56 and project 3a1220781eb4456d9afaca1ebec42203. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:59:25.753739 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-788ea34a-270f-47f1-89dc-0d20f2a2b735 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.097685 Jul 25 14:59:25.762337 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2865/5955] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:59:25 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:59:26.273543 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c6e63460-4aac-48be-9f3a-10662318a9b5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:26.274816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c6e63460-4aac-48be-9f3a-10662318a9b5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:26.298550 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c6e63460-4aac-48be-9f3a-10662318a9b5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:26.300232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c6e63460-4aac-48be-9f3a-10662318a9b5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:26.301336 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c6e63460-4aac-48be-9f3a-10662318a9b5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:26.301948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c6e63460-4aac-48be-9f3a-10662318a9b5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:26.599044 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cf8f5fe2-320d-4b7a-9268-21269f93764f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:26.599665 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cf8f5fe2-320d-4b7a-9268-21269f93764f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:26.620976 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf8f5fe2-320d-4b7a-9268-21269f93764f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:26.623159 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf8f5fe2-320d-4b7a-9268-21269f93764f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:26.626330 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf8f5fe2-320d-4b7a-9268-21269f93764f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:26.629036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf8f5fe2-320d-4b7a-9268-21269f93764f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:27.098438 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cf8f5fe2-320d-4b7a-9268-21269f93764f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:27.118523 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cf8f5fe2-320d-4b7a-9268-21269f93764f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1527 microversion: 2.1 time: 0.524634 Jul 25 14:59:27.121962 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2866/5956] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:26 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1527 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:27.586636 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c6e63460-4aac-48be-9f3a-10662318a9b5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:27.604103 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c6e63460-4aac-48be-9f3a-10662318a9b5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1692 microversion: 2.1 time: 1.336781 Jul 25 14:59:27.607603 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3091/5957] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:26 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1692 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:28.147432 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f51ebc86-7667-4b2c-a1c5-2df7352e12a2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:28.149583 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f51ebc86-7667-4b2c-a1c5-2df7352e12a2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:28.189384 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f51ebc86-7667-4b2c-a1c5-2df7352e12a2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:28.192477 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f51ebc86-7667-4b2c-a1c5-2df7352e12a2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:28.197931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f51ebc86-7667-4b2c-a1c5-2df7352e12a2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:28.198664 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f51ebc86-7667-4b2c-a1c5-2df7352e12a2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:28.248478 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4a5b5a5a-6e76-4cd3-9b96-3c5443c6bf50 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-889858112", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "4bb48a82-8fff-4bb2-a642-2e304ab18176"}], "key_name": "tempest-TestNetworkBasicOps-1272211954", "security_groups": [{"name": "tempest-secgroup-smoke-489419843"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:59:28.540871 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-4a5b5a5a-6e76-4cd3-9b96-3c5443c6bf50 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] validate_networks() for [('4bb48a82-8fff-4bb2-a642-2e304ab18176', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 14:59:28.557530 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f51ebc86-7667-4b2c-a1c5-2df7352e12a2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:28.579255 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f51ebc86-7667-4b2c-a1c5-2df7352e12a2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1527 microversion: 2.1 time: 0.425926 Jul 25 14:59:28.582645 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2867/5958] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:28 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1527 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:28.629886 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1c55fa37-2475-4b56-af05-83cdefbf9e09 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:28.630910 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1c55fa37-2475-4b56-af05-83cdefbf9e09 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:28.650188 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1c55fa37-2475-4b56-af05-83cdefbf9e09 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:28.653070 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1c55fa37-2475-4b56-af05-83cdefbf9e09 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:28.658406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1c55fa37-2475-4b56-af05-83cdefbf9e09 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:28.661484 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1c55fa37-2475-4b56-af05-83cdefbf9e09 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:29.204760 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1c55fa37-2475-4b56-af05-83cdefbf9e09 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:29.220340 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1c55fa37-2475-4b56-af05-83cdefbf9e09 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1692 microversion: 2.1 time: 0.595354 Jul 25 14:59:29.220915 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2868/5959] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:28 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1692 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:29.481387 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-4a5b5a5a-6e76-4cd3-9b96-3c5443c6bf50 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 14:59:29.482913 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-4a5b5a5a-6e76-4cd3-9b96-3c5443c6bf50 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 14:59:29.483834 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-4a5b5a5a-6e76-4cd3-9b96-3c5443c6bf50 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 14:59:29.484558 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-4a5b5a5a-6e76-4cd3-9b96-3c5443c6bf50 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 14:59:29.485169 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-4a5b5a5a-6e76-4cd3-9b96-3c5443c6bf50 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 14:59:29.501990 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4a5b5a5a-6e76-4cd3-9b96-3c5443c6bf50 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:29.503918 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4a5b5a5a-6e76-4cd3-9b96-3c5443c6bf50 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:29.509062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4a5b5a5a-6e76-4cd3-9b96-3c5443c6bf50 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:29.509732 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4a5b5a5a-6e76-4cd3-9b96-3c5443c6bf50 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:29.586420 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-4a5b5a5a-6e76-4cd3-9b96-3c5443c6bf50 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Getting quotas for project 3a1220781eb4456d9afaca1ebec42203. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:59:29.603414 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1057fb83-7292-4fa5-b2db-d2a1d3cbc455 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:29.604127 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1057fb83-7292-4fa5-b2db-d2a1d3cbc455 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:29.612665 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1057fb83-7292-4fa5-b2db-d2a1d3cbc455 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:29.613246 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1057fb83-7292-4fa5-b2db-d2a1d3cbc455 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:29.614104 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1057fb83-7292-4fa5-b2db-d2a1d3cbc455 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:29.614611 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1057fb83-7292-4fa5-b2db-d2a1d3cbc455 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:29.624051 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-4a5b5a5a-6e76-4cd3-9b96-3c5443c6bf50 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Getting quotas for user dd3fdf21e7be4de2817a73d402a34c56 and project 3a1220781eb4456d9afaca1ebec42203. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:59:29.724064 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4a5b5a5a-6e76-4cd3-9b96-3c5443c6bf50 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 14:59:29.733081 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4a5b5a5a-6e76-4cd3-9b96-3c5443c6bf50 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: 5df3428f-90e1-4629-b613-aea056517fe0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 14:59:29.867067 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4a5b5a5a-6e76-4cd3-9b96-3c5443c6bf50 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.621759 Jul 25 14:59:29.869547 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3092/5960] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 14:59:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 1627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 14:59:29.910903 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e741493b-cbfd-4a5f-92c0-953ea5033fd3 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:29.913362 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e741493b-cbfd-4a5f-92c0-953ea5033fd3 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: 5df3428f-90e1-4629-b613-aea056517fe0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:30.150002 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e741493b-cbfd-4a5f-92c0-953ea5033fd3 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:30.175689 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e741493b-cbfd-4a5f-92c0-953ea5033fd3 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0" status: 200 len: 1248 microversion: 2.1 time: 0.278176 Jul 25 14:59:30.182981 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3093/5961] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:29 2022] GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0 => generated 1248 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:30.218370 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1057fb83-7292-4fa5-b2db-d2a1d3cbc455 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:30.238917 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1057fb83-7292-4fa5-b2db-d2a1d3cbc455 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1527 microversion: 2.1 time: 0.636752 Jul 25 14:59:30.239507 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2869/5962] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:29 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1527 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:59:30.258792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1298fa84-ac3f-46ff-8aeb-b6b309ce1fd5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:30.259324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1298fa84-ac3f-46ff-8aeb-b6b309ce1fd5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:30.275724 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1298fa84-ac3f-46ff-8aeb-b6b309ce1fd5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:30.277347 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1298fa84-ac3f-46ff-8aeb-b6b309ce1fd5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:30.278903 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1298fa84-ac3f-46ff-8aeb-b6b309ce1fd5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:30.284843 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1298fa84-ac3f-46ff-8aeb-b6b309ce1fd5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:30.494034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1298fa84-ac3f-46ff-8aeb-b6b309ce1fd5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:30.506859 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1298fa84-ac3f-46ff-8aeb-b6b309ce1fd5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1682 microversion: 2.1 time: 0.267199 Jul 25 14:59:30.520151 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3094/5963] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:30 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1682 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:30.536367 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-32f7e787-ae0f-4b15-b3db-acee1469aceb tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:30.537386 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-32f7e787-ae0f-4b15-b3db-acee1469aceb tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:30.545250 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-32f7e787-ae0f-4b15-b3db-acee1469aceb tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:30.545992 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-32f7e787-ae0f-4b15-b3db-acee1469aceb tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:30.547173 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-32f7e787-ae0f-4b15-b3db-acee1469aceb tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:30.547808 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-32f7e787-ae0f-4b15-b3db-acee1469aceb tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:30.835041 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-32f7e787-ae0f-4b15-b3db-acee1469aceb tempest-TestNetworkAdvancedServerOps-2115857428 tempest-TestNetworkAdvancedServerOps-2115857428-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1835 microversion: 2.1 time: 0.308141 Jul 25 14:59:30.836594 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2870/5964] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:30 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1835 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:59:30.859968 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-033732d1-a86f-4b91-9b6a-c7ca2e410a87 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:30.860960 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-033732d1-a86f-4b91-9b6a-c7ca2e410a87 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:30.868217 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-033732d1-a86f-4b91-9b6a-c7ca2e410a87 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:30.868673 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-033732d1-a86f-4b91-9b6a-c7ca2e410a87 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:30.878243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-033732d1-a86f-4b91-9b6a-c7ca2e410a87 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:30.878785 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-033732d1-a86f-4b91-9b6a-c7ca2e410a87 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:31.198841 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2cb20f30-ad2f-4e9c-a65a-91ade41d0bfe tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:31.204655 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2cb20f30-ad2f-4e9c-a65a-91ade41d0bfe tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: 5df3428f-90e1-4629-b613-aea056517fe0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:31.215406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2cb20f30-ad2f-4e9c-a65a-91ade41d0bfe tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:31.215868 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2cb20f30-ad2f-4e9c-a65a-91ade41d0bfe tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:31.216971 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2cb20f30-ad2f-4e9c-a65a-91ade41d0bfe tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:31.217733 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2cb20f30-ad2f-4e9c-a65a-91ade41d0bfe tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:31.359868 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2cb20f30-ad2f-4e9c-a65a-91ade41d0bfe tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:31.373237 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2cb20f30-ad2f-4e9c-a65a-91ade41d0bfe tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0" status: 200 len: 1244 microversion: 2.1 time: 0.178110 Jul 25 14:59:31.390254 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2871/5965] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:31 2022] GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0 => generated 1244 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:31.410539 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1ffe5afe-0a10-4a15-9cf0-dc26d05074ed tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:31.418630 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1ffe5afe-0a10-4a15-9cf0-dc26d05074ed tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:31.430712 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ffe5afe-0a10-4a15-9cf0-dc26d05074ed tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:31.434379 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ffe5afe-0a10-4a15-9cf0-dc26d05074ed tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:31.438759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-033732d1-a86f-4b91-9b6a-c7ca2e410a87 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:31.448495 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ffe5afe-0a10-4a15-9cf0-dc26d05074ed tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:31.452684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ffe5afe-0a10-4a15-9cf0-dc26d05074ed tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:31.454931 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-033732d1-a86f-4b91-9b6a-c7ca2e410a87 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1682 microversion: 2.1 time: 0.593684 Jul 25 14:59:31.462720 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3095/5966] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:30 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1682 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:31.680108 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7977fa1a-a304-4ad6-9574-8adff6916c53 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:59:31.684486 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7977fa1a-a304-4ad6-9574-8adff6916c53 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:31.698451 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7977fa1a-a304-4ad6-9574-8adff6916c53 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:31.700677 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7977fa1a-a304-4ad6-9574-8adff6916c53 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:31.703249 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7977fa1a-a304-4ad6-9574-8adff6916c53 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:31.704519 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7977fa1a-a304-4ad6-9574-8adff6916c53 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:31.803641 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1ffe5afe-0a10-4a15-9cf0-dc26d05074ed tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:31.813930 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7977fa1a-a304-4ad6-9574-8adff6916c53 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "POST /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc/action" status: 200 len: 38654 microversion: 2.1 time: 0.137381 Jul 25 14:59:31.815779 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3096/5967] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:59:31 2022] POST /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc/action => generated 38654 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 14:59:31.830172 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1ffe5afe-0a10-4a15-9cf0-dc26d05074ed tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1527 microversion: 2.1 time: 0.436367 Jul 25 14:59:31.831846 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2872/5968] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:31 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1527 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:32.395575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-61dd2207-7764-402d-b1d2-c1a59767b66f tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:32.396681 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-61dd2207-7764-402d-b1d2-c1a59767b66f tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: 5df3428f-90e1-4629-b613-aea056517fe0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:32.413800 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-61dd2207-7764-402d-b1d2-c1a59767b66f tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:32.419219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-61dd2207-7764-402d-b1d2-c1a59767b66f tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:32.420371 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-61dd2207-7764-402d-b1d2-c1a59767b66f tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:32.429465 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-61dd2207-7764-402d-b1d2-c1a59767b66f tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:32.842991 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-61dd2207-7764-402d-b1d2-c1a59767b66f tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:32.862294 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2801d912-0776-48f1-9091-5851f25e2493 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:32.862974 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2801d912-0776-48f1-9091-5851f25e2493 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:32.870654 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-61dd2207-7764-402d-b1d2-c1a59767b66f tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0" status: 200 len: 1306 microversion: 2.1 time: 0.479188 Jul 25 14:59:32.871252 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3097/5969] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:32 2022] GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0 => generated 1306 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:32.875139 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2801d912-0776-48f1-9091-5851f25e2493 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:32.875588 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2801d912-0776-48f1-9091-5851f25e2493 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:32.876420 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2801d912-0776-48f1-9091-5851f25e2493 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:32.876837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2801d912-0776-48f1-9091-5851f25e2493 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:33.247804 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2801d912-0776-48f1-9091-5851f25e2493 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:33.266086 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2801d912-0776-48f1-9091-5851f25e2493 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1527 microversion: 2.1 time: 0.398594 Jul 25 14:59:33.268708 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2873/5970] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:32 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1527 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:59:33.892656 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-99832350-bfd7-4e8d-a495-fdcbb07f8eb6 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:33.893275 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-99832350-bfd7-4e8d-a495-fdcbb07f8eb6 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: 5df3428f-90e1-4629-b613-aea056517fe0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:33.911070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-99832350-bfd7-4e8d-a495-fdcbb07f8eb6 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:33.923134 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-99832350-bfd7-4e8d-a495-fdcbb07f8eb6 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:33.923873 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-99832350-bfd7-4e8d-a495-fdcbb07f8eb6 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:33.930424 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-99832350-bfd7-4e8d-a495-fdcbb07f8eb6 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:34.290439 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4d9d9fdb-e342-41c7-b6a3-254112cf0620 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:34.291728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4d9d9fdb-e342-41c7-b6a3-254112cf0620 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:34.302574 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4d9d9fdb-e342-41c7-b6a3-254112cf0620 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:34.307684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4d9d9fdb-e342-41c7-b6a3-254112cf0620 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:34.310257 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4d9d9fdb-e342-41c7-b6a3-254112cf0620 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:34.310925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4d9d9fdb-e342-41c7-b6a3-254112cf0620 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:34.594852 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-99832350-bfd7-4e8d-a495-fdcbb07f8eb6 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:34.612679 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-99832350-bfd7-4e8d-a495-fdcbb07f8eb6 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0" status: 200 len: 1373 microversion: 2.1 time: 0.723956 Jul 25 14:59:34.622799 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3098/5971] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:33 2022] GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0 => generated 1373 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:35.448396 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4d9d9fdb-e342-41c7-b6a3-254112cf0620 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:35.460987 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4d9d9fdb-e342-41c7-b6a3-254112cf0620 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1527 microversion: 2.1 time: 1.175416 Jul 25 14:59:35.484188 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2874/5972] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:34 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1527 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:35.643333 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6438848b-b05d-45d1-afae-a77360ec2c1b tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:35.644118 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6438848b-b05d-45d1-afae-a77360ec2c1b tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: 5df3428f-90e1-4629-b613-aea056517fe0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:35.658967 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6438848b-b05d-45d1-afae-a77360ec2c1b tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:35.659421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6438848b-b05d-45d1-afae-a77360ec2c1b tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:35.660234 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6438848b-b05d-45d1-afae-a77360ec2c1b tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:35.660678 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6438848b-b05d-45d1-afae-a77360ec2c1b tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:36.358011 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-67676044-5135-476b-8097-e3c8361c0a6c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:59:36.360777 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-67676044-5135-476b-8097-e3c8361c0a6c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:36.377813 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:59:36.380910 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-67676044-5135-476b-8097-e3c8361c0a6c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:36.381577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-67676044-5135-476b-8097-e3c8361c0a6c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:36.382559 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-67676044-5135-476b-8097-e3c8361c0a6c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:36.383166 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-67676044-5135-476b-8097-e3c8361c0a6c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:36.560582 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-67676044-5135-476b-8097-e3c8361c0a6c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action" status: 202 len: 0 microversion: 2.1 time: 0.209440 Jul 25 14:59:36.562410 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2875/5973] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:59:36 2022] POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:59:36.569284 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6e9cfcc5-b9bb-4103-9f8f-c581ad9069f2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:36.570222 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6e9cfcc5-b9bb-4103-9f8f-c581ad9069f2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:36.580855 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e9cfcc5-b9bb-4103-9f8f-c581ad9069f2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:36.582237 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e9cfcc5-b9bb-4103-9f8f-c581ad9069f2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:36.583649 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e9cfcc5-b9bb-4103-9f8f-c581ad9069f2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:36.584420 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e9cfcc5-b9bb-4103-9f8f-c581ad9069f2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:36.849017 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6e9cfcc5-b9bb-4103-9f8f-c581ad9069f2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:36.865716 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6e9cfcc5-b9bb-4103-9f8f-c581ad9069f2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1527 microversion: 2.1 time: 0.301833 Jul 25 14:59:36.868841 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2876/5974] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:36 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1527 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:36.875278 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-71c35d70-5add-4b6f-9db3-24f179daf495 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:36.876028 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-71c35d70-5add-4b6f-9db3-24f179daf495 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:36.883135 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-71c35d70-5add-4b6f-9db3-24f179daf495 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:36.883735 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-71c35d70-5add-4b6f-9db3-24f179daf495 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:36.884673 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-71c35d70-5add-4b6f-9db3-24f179daf495 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:36.885437 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-71c35d70-5add-4b6f-9db3-24f179daf495 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:36.914068 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:59:36.920050 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6438848b-b05d-45d1-afae-a77360ec2c1b tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:36.932000 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6438848b-b05d-45d1-afae-a77360ec2c1b tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0" status: 200 len: 1373 microversion: 2.1 time: 1.292617 Jul 25 14:59:36.932995 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3099/5975] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:35 2022] GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0 => generated 1373 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:37.120673 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-71c35d70-5add-4b6f-9db3-24f179daf495 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:37.132260 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-71c35d70-5add-4b6f-9db3-24f179daf495 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1672 microversion: 2.1 time: 0.261629 Jul 25 14:59:37.134180 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2877/5976] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:36 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1672 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:37.704337 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-34aaa189-081b-43a6-8bdf-1b88cf0a93de tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:37.705079 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-34aaa189-081b-43a6-8bdf-1b88cf0a93de tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:37.719341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-34aaa189-081b-43a6-8bdf-1b88cf0a93de tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:37.720090 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-34aaa189-081b-43a6-8bdf-1b88cf0a93de tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:37.721138 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-34aaa189-081b-43a6-8bdf-1b88cf0a93de tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:37.721866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-34aaa189-081b-43a6-8bdf-1b88cf0a93de tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:37.758964 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-a10b79ef-d796-4fff-bffa-f2a65ee11bd4 req-7f757446-ff1c-4103-9cce-b0d1cc5329fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56335d40-d6c2-4292-9547-16a55e66d2dc", "tag": "f01e46b0-4607-4910-97dc-20a41f89640b"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:59:37.783067 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-a10b79ef-d796-4fff-bffa-f2a65ee11bd4 req-7f757446-ff1c-4103-9cce-b0d1cc5329fb service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:37.783594 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-a10b79ef-d796-4fff-bffa-f2a65ee11bd4 req-7f757446-ff1c-4103-9cce-b0d1cc5329fb service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:37.784701 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-34aaa189-081b-43a6-8bdf-1b88cf0a93de tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 14:59:37.799408 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-a10b79ef-d796-4fff-bffa-f2a65ee11bd4 req-7f757446-ff1c-4103-9cce-b0d1cc5329fb service nova] Creating event network-changed:f01e46b0-4607-4910-97dc-20a41f89640b for instance 56335d40-d6c2-4292-9547-16a55e66d2dc on n-h2-846435-14 Jul 25 14:59:37.823762 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-a10b79ef-d796-4fff-bffa-f2a65ee11bd4 req-7f757446-ff1c-4103-9cce-b0d1cc5329fb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068327 Jul 25 14:59:37.826844 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2878/5977] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:59:37.892127 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-41356330-392e-4d1f-94b1-279b6778340f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:37.892911 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-41356330-392e-4d1f-94b1-279b6778340f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:37.908848 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-41356330-392e-4d1f-94b1-279b6778340f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:37.910076 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-41356330-392e-4d1f-94b1-279b6778340f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:37.911066 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-41356330-392e-4d1f-94b1-279b6778340f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:37.911692 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-41356330-392e-4d1f-94b1-279b6778340f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:37.964710 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-34aaa189-081b-43a6-8bdf-1b88cf0a93de tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "DELETE /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 204 len: 0 microversion: 2.1 time: 0.264043 Jul 25 14:59:37.966215 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3100/5978] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 14:59:37 2022] DELETE /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 14:59:37.977062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f8e8abcf-dc49-4e9b-8162-eb15123b7bd7 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:37.979105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f8e8abcf-dc49-4e9b-8162-eb15123b7bd7 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: 5df3428f-90e1-4629-b613-aea056517fe0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:37.998771 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8e8abcf-dc49-4e9b-8162-eb15123b7bd7 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:37.999920 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8e8abcf-dc49-4e9b-8162-eb15123b7bd7 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:38.006938 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8e8abcf-dc49-4e9b-8162-eb15123b7bd7 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:38.007575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8e8abcf-dc49-4e9b-8162-eb15123b7bd7 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:38.399182 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-41356330-392e-4d1f-94b1-279b6778340f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:38.411238 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-41356330-392e-4d1f-94b1-279b6778340f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1527 microversion: 2.1 time: 0.521041 Jul 25 14:59:38.411886 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2879/5979] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:37 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1527 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:59:38.439266 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-86cae842-9a2c-4f74-aeec-6cb13f812289 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:38.439900 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-86cae842-9a2c-4f74-aeec-6cb13f812289 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:38.456648 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-86cae842-9a2c-4f74-aeec-6cb13f812289 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:38.457081 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-86cae842-9a2c-4f74-aeec-6cb13f812289 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:38.457903 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-86cae842-9a2c-4f74-aeec-6cb13f812289 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:38.458353 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-86cae842-9a2c-4f74-aeec-6cb13f812289 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:38.898808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f8e8abcf-dc49-4e9b-8162-eb15123b7bd7 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:38.925806 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f8e8abcf-dc49-4e9b-8162-eb15123b7bd7 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0" status: 200 len: 1373 microversion: 2.1 time: 0.940112 Jul 25 14:59:38.928654 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3101/5980] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:37 2022] GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0 => generated 1373 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:38.936198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cfe2796d-e095-45cf-9f76-eb065348deea tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:38.972343 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cfe2796d-e095-45cf-9f76-eb065348deea tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:39.006855 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cfe2796d-e095-45cf-9f76-eb065348deea tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:39.015087 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cfe2796d-e095-45cf-9f76-eb065348deea tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:39.017925 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cfe2796d-e095-45cf-9f76-eb065348deea tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:39.019745 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cfe2796d-e095-45cf-9f76-eb065348deea tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:39.257360 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-86cae842-9a2c-4f74-aeec-6cb13f812289 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:39.279330 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-86cae842-9a2c-4f74-aeec-6cb13f812289 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1688 microversion: 2.1 time: 0.845159 Jul 25 14:59:39.281542 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2880/5981] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:38 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1688 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:39.438205 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-518abf47-0417-4b5e-b80b-c738685ef6f3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:39.440711 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-518abf47-0417-4b5e-b80b-c738685ef6f3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:39.474085 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-518abf47-0417-4b5e-b80b-c738685ef6f3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:39.476075 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-518abf47-0417-4b5e-b80b-c738685ef6f3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:39.477099 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-518abf47-0417-4b5e-b80b-c738685ef6f3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:39.477708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-518abf47-0417-4b5e-b80b-c738685ef6f3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:39.540620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:59:39.877282 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-518abf47-0417-4b5e-b80b-c738685ef6f3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:39.890563 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-518abf47-0417-4b5e-b80b-c738685ef6f3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1527 microversion: 2.1 time: 0.456036 Jul 25 14:59:39.905926 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2881/5982] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:39 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1527 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:39.912908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cfe2796d-e095-45cf-9f76-eb065348deea tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:39.921909 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cfe2796d-e095-45cf-9f76-eb065348deea tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1672 microversion: 2.1 time: 0.989694 Jul 25 14:59:39.922496 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3102/5983] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:38 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1672 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:39.926158 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-fe8c0758-a2e7-4405-8b05-9ac9b7118b64 req-dd7d0f02-b6aa-4ad8-a772-2ed61f4d3981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5df3428f-90e1-4629-b613-aea056517fe0", "tag": "98d89e4c-d389-4e25-a0df-6934ef7fe40b"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:59:39.953124 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c19ef5d4-3d47-4de6-afb8-553acc122baf tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:39.954036 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c19ef5d4-3d47-4de6-afb8-553acc122baf tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: 5df3428f-90e1-4629-b613-aea056517fe0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:39.954167 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-fe8c0758-a2e7-4405-8b05-9ac9b7118b64 req-dd7d0f02-b6aa-4ad8-a772-2ed61f4d3981 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:39.960301 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-fe8c0758-a2e7-4405-8b05-9ac9b7118b64 req-dd7d0f02-b6aa-4ad8-a772-2ed61f4d3981 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:39.968379 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c19ef5d4-3d47-4de6-afb8-553acc122baf tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:39.969208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c19ef5d4-3d47-4de6-afb8-553acc122baf tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:39.970220 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c19ef5d4-3d47-4de6-afb8-553acc122baf tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:39.970797 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c19ef5d4-3d47-4de6-afb8-553acc122baf tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:40.017258 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-fe8c0758-a2e7-4405-8b05-9ac9b7118b64 req-dd7d0f02-b6aa-4ad8-a772-2ed61f4d3981 service nova] Creating event network-changed:98d89e4c-d389-4e25-a0df-6934ef7fe40b for instance 5df3428f-90e1-4629-b613-aea056517fe0 on n-h2-846435-14 Jul 25 14:59:40.039848 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-fe8c0758-a2e7-4405-8b05-9ac9b7118b64 req-dd7d0f02-b6aa-4ad8-a772-2ed61f4d3981 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118926 Jul 25 14:59:40.055486 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2882/5984] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:59:40.169805 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=8 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:59:40.303281 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-056a627a-a270-4732-9ffc-dfe4612cea0d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:40.304013 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-056a627a-a270-4732-9ffc-dfe4612cea0d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:40.315027 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-056a627a-a270-4732-9ffc-dfe4612cea0d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:40.315482 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-056a627a-a270-4732-9ffc-dfe4612cea0d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:40.316308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-056a627a-a270-4732-9ffc-dfe4612cea0d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:40.316749 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-056a627a-a270-4732-9ffc-dfe4612cea0d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:40.671698 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c19ef5d4-3d47-4de6-afb8-553acc122baf tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:40.681262 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c19ef5d4-3d47-4de6-afb8-553acc122baf tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0" status: 200 len: 1373 microversion: 2.1 time: 0.732099 Jul 25 14:59:40.683778 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3103/5985] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:39 2022] GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0 => generated 1373 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:59:40.864293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-056a627a-a270-4732-9ffc-dfe4612cea0d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:40.872884 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-056a627a-a270-4732-9ffc-dfe4612cea0d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1569 microversion: 2.1 time: 0.573847 Jul 25 14:59:40.881291 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2883/5986] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:40 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1569 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:40.924364 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-104f348b-3bcc-4a76-aa76-ad6106cb2e66 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:40.925269 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-104f348b-3bcc-4a76-aa76-ad6106cb2e66 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:40.934659 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-104f348b-3bcc-4a76-aa76-ad6106cb2e66 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:40.935433 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-104f348b-3bcc-4a76-aa76-ad6106cb2e66 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:40.936487 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-104f348b-3bcc-4a76-aa76-ad6106cb2e66 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:40.937141 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-104f348b-3bcc-4a76-aa76-ad6106cb2e66 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:40.946740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8ff8b304-dbe3-46d1-9592-8718aea4d432 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:40.947769 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8ff8b304-dbe3-46d1-9592-8718aea4d432 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:40.963256 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ff8b304-dbe3-46d1-9592-8718aea4d432 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:40.964050 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ff8b304-dbe3-46d1-9592-8718aea4d432 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:40.965079 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ff8b304-dbe3-46d1-9592-8718aea4d432 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:40.973601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ff8b304-dbe3-46d1-9592-8718aea4d432 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:41.381908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-104f348b-3bcc-4a76-aa76-ad6106cb2e66 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:41.405062 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-104f348b-3bcc-4a76-aa76-ad6106cb2e66 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1527 microversion: 2.1 time: 0.482099 Jul 25 14:59:41.422107 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3104/5987] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:40 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1527 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:41.520802 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8ff8b304-dbe3-46d1-9592-8718aea4d432 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:41.529771 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8ff8b304-dbe3-46d1-9592-8718aea4d432 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.590900 Jul 25 14:59:41.532705 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2884/5988] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:40 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:59:41.706046 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-48cf0b74-4056-4d43-a9b8-a03df0a9d5b5 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:41.706663 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-48cf0b74-4056-4d43-a9b8-a03df0a9d5b5 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: 5df3428f-90e1-4629-b613-aea056517fe0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:41.713595 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48cf0b74-4056-4d43-a9b8-a03df0a9d5b5 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:41.714040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48cf0b74-4056-4d43-a9b8-a03df0a9d5b5 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:41.714809 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48cf0b74-4056-4d43-a9b8-a03df0a9d5b5 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:41.715244 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-48cf0b74-4056-4d43-a9b8-a03df0a9d5b5 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:41.906268 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e0b10f87-4a0e-41c1-92fc-2bfc2a8911c7 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:41.906886 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e0b10f87-4a0e-41c1-92fc-2bfc2a8911c7 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:41.917679 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e0b10f87-4a0e-41c1-92fc-2bfc2a8911c7 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:41.926381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e0b10f87-4a0e-41c1-92fc-2bfc2a8911c7 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:41.927294 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e0b10f87-4a0e-41c1-92fc-2bfc2a8911c7 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:41.930890 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e0b10f87-4a0e-41c1-92fc-2bfc2a8911c7 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:41.961378 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-48cf0b74-4056-4d43-a9b8-a03df0a9d5b5 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:41.973166 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-48cf0b74-4056-4d43-a9b8-a03df0a9d5b5 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0" status: 200 len: 1373 microversion: 2.1 time: 0.270930 Jul 25 14:59:41.974800 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3105/5989] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:41 2022] GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0 => generated 1373 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:42.072839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e0b10f87-4a0e-41c1-92fc-2bfc2a8911c7 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:42.086165 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e0b10f87-4a0e-41c1-92fc-2bfc2a8911c7 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1502 microversion: 2.1 time: 0.180926 Jul 25 14:59:42.087050 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2885/5990] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:41 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1502 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:59:42.134878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-7a7abb10-23f7-49e2-b89b-7ace77347bb4 req-7cfda96f-4873-431a-8144-8b44c79f1338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56335d40-d6c2-4292-9547-16a55e66d2dc", "name": "network-vif-deleted", "tag": "f01e46b0-4607-4910-97dc-20a41f89640b"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:59:42.163047 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-7a7abb10-23f7-49e2-b89b-7ace77347bb4 req-7cfda96f-4873-431a-8144-8b44c79f1338 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:42.170198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-7a7abb10-23f7-49e2-b89b-7ace77347bb4 req-7cfda96f-4873-431a-8144-8b44c79f1338 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:42.207302 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-7a7abb10-23f7-49e2-b89b-7ace77347bb4 req-7cfda96f-4873-431a-8144-8b44c79f1338 service nova] Creating event network-vif-deleted:f01e46b0-4607-4910-97dc-20a41f89640b for instance 56335d40-d6c2-4292-9547-16a55e66d2dc on n-h2-846435-14 Jul 25 14:59:42.231435 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-7a7abb10-23f7-49e2-b89b-7ace77347bb4 req-7cfda96f-4873-431a-8144-8b44c79f1338 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100564 Jul 25 14:59:42.232685 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3106/5991] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:59:42.433807 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7dc78113-2865-42d1-9661-6f5eaee05433 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:42.433807 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7dc78113-2865-42d1-9661-6f5eaee05433 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:42.457397 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7dc78113-2865-42d1-9661-6f5eaee05433 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:42.457861 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7dc78113-2865-42d1-9661-6f5eaee05433 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:42.458697 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7dc78113-2865-42d1-9661-6f5eaee05433 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:42.459137 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7dc78113-2865-42d1-9661-6f5eaee05433 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:42.747754 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7dc78113-2865-42d1-9661-6f5eaee05433 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:42.757723 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7dc78113-2865-42d1-9661-6f5eaee05433 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1527 microversion: 2.1 time: 0.332421 Jul 25 14:59:42.759059 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2886/5992] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:42 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1527 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:42.997890 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2dd4dbcf-8cfd-4d56-913c-019c5d62affa tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:42.998590 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2dd4dbcf-8cfd-4d56-913c-019c5d62affa tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: 5df3428f-90e1-4629-b613-aea056517fe0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:43.016709 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2dd4dbcf-8cfd-4d56-913c-019c5d62affa tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:43.017427 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2dd4dbcf-8cfd-4d56-913c-019c5d62affa tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:43.018375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2dd4dbcf-8cfd-4d56-913c-019c5d62affa tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:43.026247 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2dd4dbcf-8cfd-4d56-913c-019c5d62affa tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:43.112296 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7ac48157-2698-43c8-b0a8-3cadcefe430b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:43.112955 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7ac48157-2698-43c8-b0a8-3cadcefe430b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:43.140451 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ac48157-2698-43c8-b0a8-3cadcefe430b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:43.141074 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ac48157-2698-43c8-b0a8-3cadcefe430b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:43.144862 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ac48157-2698-43c8-b0a8-3cadcefe430b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:43.145339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ac48157-2698-43c8-b0a8-3cadcefe430b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:43.350655 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7ac48157-2698-43c8-b0a8-3cadcefe430b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:43.379243 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7ac48157-2698-43c8-b0a8-3cadcefe430b tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 200 len: 1502 microversion: 2.1 time: 0.271455 Jul 25 14:59:43.383376 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2dd4dbcf-8cfd-4d56-913c-019c5d62affa tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:43.393146 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2dd4dbcf-8cfd-4d56-913c-019c5d62affa tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0" status: 200 len: 1373 microversion: 2.1 time: 0.400561 Jul 25 14:59:43.394084 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2887/5993] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:43 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 1502 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:59:43.406050 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3107/5994] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:42 2022] GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0 => generated 1373 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:43.785422 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-70775aa7-a541-4436-bfce-ba5678fb2b91 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:43.786805 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-70775aa7-a541-4436-bfce-ba5678fb2b91 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:43.806110 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70775aa7-a541-4436-bfce-ba5678fb2b91 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:43.810524 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70775aa7-a541-4436-bfce-ba5678fb2b91 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:43.814742 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70775aa7-a541-4436-bfce-ba5678fb2b91 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:43.815588 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70775aa7-a541-4436-bfce-ba5678fb2b91 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:44.291521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-70775aa7-a541-4436-bfce-ba5678fb2b91 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:44.302688 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-70775aa7-a541-4436-bfce-ba5678fb2b91 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1527 microversion: 2.1 time: 0.522295 Jul 25 14:59:44.307181 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2888/5995] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:43 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1527 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:44.414130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b9850c52-e4c3-4b31-a33d-e95d2da63ef3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:44.415369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b9850c52-e4c3-4b31-a33d-e95d2da63ef3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 56335d40-d6c2-4292-9547-16a55e66d2dc] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:44.421017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:59:44.426453 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b3276767-e65a-4f39-a020-832b6457e6db tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:44.427346 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b3276767-e65a-4f39-a020-832b6457e6db tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: 5df3428f-90e1-4629-b613-aea056517fe0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:44.451155 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b9850c52-e4c3-4b31-a33d-e95d2da63ef3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:44.451616 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b9850c52-e4c3-4b31-a33d-e95d2da63ef3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:44.452439 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b9850c52-e4c3-4b31-a33d-e95d2da63ef3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:44.452890 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b9850c52-e4c3-4b31-a33d-e95d2da63ef3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:44.459647 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3276767-e65a-4f39-a020-832b6457e6db tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:44.460598 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3276767-e65a-4f39-a020-832b6457e6db tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:44.461572 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3276767-e65a-4f39-a020-832b6457e6db tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:44.462172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3276767-e65a-4f39-a020-832b6457e6db tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:44.516705 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:59:44.518360 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-b9850c52-e4c3-4b31-a33d-e95d2da63ef3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] HTTP exception thrown: Instance 56335d40-d6c2-4292-9547-16a55e66d2dc could not be found. Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b9850c52-e4c3-4b31-a33d-e95d2da63ef3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Request method failure captured: Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc HTTP/1.1 Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q4DBDAuynnb9b8nJFNNex8XXIdUxDWuP-PEkAZMub_ZUkZMduVSsCJMD66yCrnruIywPy2lvVpDMBFR-BQiaLm_rcOzEza3QKBSQ9Q0j7zyfwq4sXID1DSbTq1QnPsc4nPy2BUSC17V5E20v3AYQkR2U7b_KL_5EYlXpiDz-Ll6u0Y Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 8dd09177faea4702992aaab182125b5a Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-919260591 Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8dd09177faea4702992aaab182125b5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8dd09177faea4702992aaab182125b5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8dd09177faea4702992aaab182125b5a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8dd09177faea4702992aaab182125b5a"}]}] Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-TestNetworkAdvancedServerOps-919260591 Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 8dd09177faea4702992aaab182125b5a Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-919260591 Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-TestNetworkAdvancedServerOps-919260591-project Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: ca46c8e84b8644b69937ec9c06cb0e9a Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-TestNetworkAdvancedServerOps-919260591-project Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 56335d40-d6c2-4292-9547-16a55e66d2dc could not be found. Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '56335d40-d6c2-4292-9547-16a55e66d2dc'} Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56335d40-d6c2-4292-9547-16a55e66d2dc could not be found. Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56335d40-d6c2-4292-9547-16a55e66d2dc could not be found. Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:59:44.521713 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:59:44.526900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:59:44.526900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:59:44.526900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:59:44.526900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:59:44.526900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:59:44.526900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56335d40-d6c2-4292-9547-16a55e66d2dc could not be found. Jul 25 14:59:44.526900 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:59:44.526900 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b9850c52-e4c3-4b31-a33d-e95d2da63ef3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Returning 404 to user: Instance 56335d40-d6c2-4292-9547-16a55e66d2dc could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:59:44.526900 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b9850c52-e4c3-4b31-a33d-e95d2da63ef3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc" status: 404 len: 111 microversion: 2.1 time: 0.113088 Jul 25 14:59:44.536669 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3108/5996] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:44 2022] GET /compute/v2.1/servers/56335d40-d6c2-4292-9547-16a55e66d2dc => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 14:59:45.086568 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b3276767-e65a-4f39-a020-832b6457e6db tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:45.104307 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b3276767-e65a-4f39-a020-832b6457e6db tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0" status: 200 len: 1373 microversion: 2.1 time: 0.681902 Jul 25 14:59:45.105205 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2889/5997] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:44 2022] GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0 => generated 1373 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:59:45.329056 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0b207273-4b16-423e-80da-87eb37422c5a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:45.329727 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0b207273-4b16-423e-80da-87eb37422c5a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:45.346688 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b207273-4b16-423e-80da-87eb37422c5a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:45.347437 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b207273-4b16-423e-80da-87eb37422c5a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:45.348289 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b207273-4b16-423e-80da-87eb37422c5a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:45.348699 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b207273-4b16-423e-80da-87eb37422c5a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:45.655274 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0b207273-4b16-423e-80da-87eb37422c5a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:45.682480 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0b207273-4b16-423e-80da-87eb37422c5a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1527 microversion: 2.1 time: 0.357384 Jul 25 14:59:45.694466 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3109/5998] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:45 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1527 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:46.127492 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1279539d-657f-4df5-8292-1a5026c38bce tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:46.128275 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1279539d-657f-4df5-8292-1a5026c38bce tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: 5df3428f-90e1-4629-b613-aea056517fe0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:46.138693 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1279539d-657f-4df5-8292-1a5026c38bce tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:46.139138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1279539d-657f-4df5-8292-1a5026c38bce tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:46.139951 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1279539d-657f-4df5-8292-1a5026c38bce tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:46.140425 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1279539d-657f-4df5-8292-1a5026c38bce tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:46.480434 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1279539d-657f-4df5-8292-1a5026c38bce tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:46.489374 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1279539d-657f-4df5-8292-1a5026c38bce tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0" status: 200 len: 1373 microversion: 2.1 time: 0.367313 Jul 25 14:59:46.492670 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2890/5999] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:46 2022] GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0 => generated 1373 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:46.717920 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ac8569a6-dad9-4d23-bb8a-50f7e4cafb08 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:46.719311 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ac8569a6-dad9-4d23-bb8a-50f7e4cafb08 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:46.735230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac8569a6-dad9-4d23-bb8a-50f7e4cafb08 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:46.744569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac8569a6-dad9-4d23-bb8a-50f7e4cafb08 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:46.751666 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac8569a6-dad9-4d23-bb8a-50f7e4cafb08 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:46.752245 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac8569a6-dad9-4d23-bb8a-50f7e4cafb08 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:47.001028 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ac8569a6-dad9-4d23-bb8a-50f7e4cafb08 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:47.014474 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ac8569a6-dad9-4d23-bb8a-50f7e4cafb08 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1509 microversion: 2.1 time: 0.302049 Jul 25 14:59:47.033563 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3110/6000] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:46 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1509 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:47.515344 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-739d32dc-bb2f-4988-8182-d969e207ac43 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:47.515344 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-739d32dc-bb2f-4988-8182-d969e207ac43 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: 5df3428f-90e1-4629-b613-aea056517fe0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:47.535153 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-739d32dc-bb2f-4988-8182-d969e207ac43 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:47.535867 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-739d32dc-bb2f-4988-8182-d969e207ac43 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:47.536860 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-739d32dc-bb2f-4988-8182-d969e207ac43 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:47.537471 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-739d32dc-bb2f-4988-8182-d969e207ac43 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:48.044241 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-31fc6a5c-f476-4642-bf76-f5f854da0268 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:48.045659 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-31fc6a5c-f476-4642-bf76-f5f854da0268 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:48.051560 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-739d32dc-bb2f-4988-8182-d969e207ac43 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:48.056365 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-31fc6a5c-f476-4642-bf76-f5f854da0268 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:48.057424 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-31fc6a5c-f476-4642-bf76-f5f854da0268 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:48.059326 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-31fc6a5c-f476-4642-bf76-f5f854da0268 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:48.060016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-31fc6a5c-f476-4642-bf76-f5f854da0268 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:48.066762 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-739d32dc-bb2f-4988-8182-d969e207ac43 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0" status: 200 len: 1373 microversion: 2.1 time: 0.552336 Jul 25 14:59:48.067521 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2891/6001] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:47 2022] GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0 => generated 1373 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:48.324651 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-31fc6a5c-f476-4642-bf76-f5f854da0268 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:48.337774 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-31fc6a5c-f476-4642-bf76-f5f854da0268 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1509 microversion: 2.1 time: 0.300793 Jul 25 14:59:48.352571 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3111/6002] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:48 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1509 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:59:48.533962 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-01b13109-912e-4f60-949e-f376c4c02b69 req-b04a0b70-f988-4611-8cbf-054e885abb0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5df3428f-90e1-4629-b613-aea056517fe0", "name": "network-vif-plugged", "status": "completed", "tag": "98d89e4c-d389-4e25-a0df-6934ef7fe40b"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:59:48.565170 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-01b13109-912e-4f60-949e-f376c4c02b69 req-b04a0b70-f988-4611-8cbf-054e885abb0f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:48.565921 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-01b13109-912e-4f60-949e-f376c4c02b69 req-b04a0b70-f988-4611-8cbf-054e885abb0f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:48.601420 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-01b13109-912e-4f60-949e-f376c4c02b69 req-b04a0b70-f988-4611-8cbf-054e885abb0f service nova] Creating event network-vif-plugged:98d89e4c-d389-4e25-a0df-6934ef7fe40b for instance 5df3428f-90e1-4629-b613-aea056517fe0 on n-h2-846435-14 Jul 25 14:59:48.610491 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-01b13109-912e-4f60-949e-f376c4c02b69 req-b04a0b70-f988-4611-8cbf-054e885abb0f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081501 Jul 25 14:59:48.611637 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2892/6003] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:59:49.096714 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d61afc81-1313-444e-b06e-fb544780bcd6 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:49.097984 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d61afc81-1313-444e-b06e-fb544780bcd6 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: 5df3428f-90e1-4629-b613-aea056517fe0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:49.105040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d61afc81-1313-444e-b06e-fb544780bcd6 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:49.105718 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d61afc81-1313-444e-b06e-fb544780bcd6 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:49.106656 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d61afc81-1313-444e-b06e-fb544780bcd6 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:49.107315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d61afc81-1313-444e-b06e-fb544780bcd6 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:49.365719 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-10bc7029-8d9a-4567-8296-c850770fd4d6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:49.366764 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-10bc7029-8d9a-4567-8296-c850770fd4d6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:49.379668 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-10bc7029-8d9a-4567-8296-c850770fd4d6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:49.382340 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-10bc7029-8d9a-4567-8296-c850770fd4d6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:49.383419 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-10bc7029-8d9a-4567-8296-c850770fd4d6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:49.384119 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-10bc7029-8d9a-4567-8296-c850770fd4d6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:49.651255 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-10bc7029-8d9a-4567-8296-c850770fd4d6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:49.660318 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-10bc7029-8d9a-4567-8296-c850770fd4d6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1509 microversion: 2.1 time: 0.304963 Jul 25 14:59:49.678419 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2893/6004] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:49 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1509 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:49.731293 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d61afc81-1313-444e-b06e-fb544780bcd6 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:49.749872 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d61afc81-1313-444e-b06e-fb544780bcd6 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0" status: 200 len: 1373 microversion: 2.1 time: 0.657258 Jul 25 14:59:49.753150 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3112/6005] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:49 2022] GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0 => generated 1373 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:50.650863 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-f07b6527-6ca1-4eb4-8237-c23c626e5d76 req-1962e025-66c0-49df-a9ea-8db19b49e9f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34bbd65c-a1e0-4f6c-a775-8c9f847eccec", "name": "network-vif-unplugged", "status": "completed", "tag": "6bd9c9b1-8f44-48ec-8ace-8bfe7e29920e"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:59:50.662225 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f07b6527-6ca1-4eb4-8237-c23c626e5d76 req-1962e025-66c0-49df-a9ea-8db19b49e9f7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:50.662914 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f07b6527-6ca1-4eb4-8237-c23c626e5d76 req-1962e025-66c0-49df-a9ea-8db19b49e9f7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:50.675294 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.compute.server_external_events [req-f07b6527-6ca1-4eb4-8237-c23c626e5d76 req-1962e025-66c0-49df-a9ea-8db19b49e9f7 service nova] Unable to find a host for instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec. Dropping event network-vif-unplugged {{(pid=119303) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 25 14:59:50.676346 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-f07b6527-6ca1-4eb4-8237-c23c626e5d76 req-1962e025-66c0-49df-a9ea-8db19b49e9f7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030848 Jul 25 14:59:50.677400 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2894/6006] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 25 14:59:50.691801 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-76255b2d-5fb2-4ec9-887a-60800620e69f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:50.693862 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-76255b2d-5fb2-4ec9-887a-60800620e69f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:50.704901 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-76255b2d-5fb2-4ec9-887a-60800620e69f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:50.705588 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-76255b2d-5fb2-4ec9-887a-60800620e69f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:50.706772 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-76255b2d-5fb2-4ec9-887a-60800620e69f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:50.707442 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-76255b2d-5fb2-4ec9-887a-60800620e69f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:50.774119 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-32c8561d-49ae-43f0-b83e-532b965ddb76 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:50.775050 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-32c8561d-49ae-43f0-b83e-532b965ddb76 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: 5df3428f-90e1-4629-b613-aea056517fe0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:50.782353 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-32c8561d-49ae-43f0-b83e-532b965ddb76 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:50.782538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-32c8561d-49ae-43f0-b83e-532b965ddb76 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:50.783533 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-32c8561d-49ae-43f0-b83e-532b965ddb76 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:50.784004 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-32c8561d-49ae-43f0-b83e-532b965ddb76 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:51.014158 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-32c8561d-49ae-43f0-b83e-532b965ddb76 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:51.024233 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-32c8561d-49ae-43f0-b83e-532b965ddb76 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0" status: 200 len: 1373 microversion: 2.1 time: 0.254282 Jul 25 14:59:51.025405 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2895/6007] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:50 2022] GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0 => generated 1373 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:59:51.169753 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-76255b2d-5fb2-4ec9-887a-60800620e69f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:51.195553 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-76255b2d-5fb2-4ec9-887a-60800620e69f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1452 microversion: 2.1 time: 0.511082 Jul 25 14:59:51.209753 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3113/6008] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:50 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1452 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:51.232413 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a8bbd2a7-8a79-46cc-a040-5e7f09843e72 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:51.233059 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a8bbd2a7-8a79-46cc-a040-5e7f09843e72 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:51.243172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a8bbd2a7-8a79-46cc-a040-5e7f09843e72 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:51.247557 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a8bbd2a7-8a79-46cc-a040-5e7f09843e72 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:51.264135 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a8bbd2a7-8a79-46cc-a040-5e7f09843e72 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:51.264835 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a8bbd2a7-8a79-46cc-a040-5e7f09843e72 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:51.719267 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a8bbd2a7-8a79-46cc-a040-5e7f09843e72 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:51.723293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=100 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:59:51.736532 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a8bbd2a7-8a79-46cc-a040-5e7f09843e72 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1452 microversion: 2.1 time: 0.507807 Jul 25 14:59:51.738416 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2896/6009] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:51 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1452 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:51.833334 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6516a9ac-4c95-4c8b-9edb-e7ab00163289 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:59:51.834328 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6516a9ac-4c95-4c8b-9edb-e7ab00163289 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:51.854928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6516a9ac-4c95-4c8b-9edb-e7ab00163289 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:51.857054 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6516a9ac-4c95-4c8b-9edb-e7ab00163289 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:51.861037 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6516a9ac-4c95-4c8b-9edb-e7ab00163289 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:51.862503 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6516a9ac-4c95-4c8b-9edb-e7ab00163289 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:51.896566 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-6516a9ac-4c95-4c8b-9edb-e7ab00163289 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lazy-loading 'flavor' on Instance uuid 34bbd65c-a1e0-4f6c-a775-8c9f847eccec {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 14:59:51.922925 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-6516a9ac-4c95-4c8b-9edb-e7ab00163289 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Cannot 'shelve' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state shelved_offloaded Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6516a9ac-4c95-4c8b-9edb-e7ab00163289 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action HTTP/1.1 Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 14 Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: {"shelve": {}} Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: exception: Cannot 'shelve' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state shelved_offloaded Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '34bbd65c-a1e0-4f6c-a775-8c9f847eccec', 'body': {'shelve': {}}} Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jul 25 14:59:51.924727 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 14:59:51.929807 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 14:59:51.929807 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 14:59:51.929807 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state shelved_offloaded Jul 25 14:59:51.929807 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:59:51.929807 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 14:59:51.929807 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:59:51.929807 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 14:59:51.929807 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 14:59:51.929807 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 14:59:51.929807 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 14:59:51.929807 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 14:59:51.929807 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state shelved_offloaded Jul 25 14:59:51.929807 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 14:59:51.929807 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6516a9ac-4c95-4c8b-9edb-e7ab00163289 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 409 to user: Cannot 'shelve' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state shelved_offloaded {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 14:59:51.929807 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6516a9ac-4c95-4c8b-9edb-e7ab00163289 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action" status: 409 len: 155 microversion: 2.1 time: 0.108245 Jul 25 14:59:51.929807 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3114/6010] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:59:51 2022] POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action => generated 155 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 14:59:51.937759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f1117b04-0094-4722-a9c1-5e05b3943249 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:59:51.938368 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f1117b04-0094-4722-a9c1-5e05b3943249 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:51.964458 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f1117b04-0094-4722-a9c1-5e05b3943249 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:51.964928 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f1117b04-0094-4722-a9c1-5e05b3943249 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:51.965751 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f1117b04-0094-4722-a9c1-5e05b3943249 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:51.966274 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f1117b04-0094-4722-a9c1-5e05b3943249 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:52.073403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0c4ee496-9562-4c92-bcc6-ebd7569f2af4 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:52.074750 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0c4ee496-9562-4c92-bcc6-ebd7569f2af4 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: 5df3428f-90e1-4629-b613-aea056517fe0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:52.090390 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c4ee496-9562-4c92-bcc6-ebd7569f2af4 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:52.090867 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c4ee496-9562-4c92-bcc6-ebd7569f2af4 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:52.096456 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c4ee496-9562-4c92-bcc6-ebd7569f2af4 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:52.098361 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c4ee496-9562-4c92-bcc6-ebd7569f2af4 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:52.380681 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f1117b04-0094-4722-a9c1-5e05b3943249 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action" status: 202 len: 0 microversion: 2.1 time: 0.447616 Jul 25 14:59:52.386382 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2897/6011] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 14:59:51 2022] POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 14:59:52.441636 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3870aac7-8f3f-4916-bfac-6b71ad4e5050 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:52.443805 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3870aac7-8f3f-4916-bfac-6b71ad4e5050 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:52.455938 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 14:59:52.461750 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3870aac7-8f3f-4916-bfac-6b71ad4e5050 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:52.463313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3870aac7-8f3f-4916-bfac-6b71ad4e5050 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:52.465018 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3870aac7-8f3f-4916-bfac-6b71ad4e5050 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:52.466489 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3870aac7-8f3f-4916-bfac-6b71ad4e5050 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:52.532414 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0c4ee496-9562-4c92-bcc6-ebd7569f2af4 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:52.549288 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0c4ee496-9562-4c92-bcc6-ebd7569f2af4 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0" status: 200 len: 1543 microversion: 2.1 time: 0.483494 Jul 25 14:59:52.560938 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3115/6012] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:52 2022] GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0 => generated 1543 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:52.575393 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9990fc8a-d4e9-4534-b3a3-b903a6f9cacc tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:52.582626 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9990fc8a-d4e9-4534-b3a3-b903a6f9cacc tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: 5df3428f-90e1-4629-b613-aea056517fe0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:52.603956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9990fc8a-d4e9-4534-b3a3-b903a6f9cacc tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:52.604982 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9990fc8a-d4e9-4534-b3a3-b903a6f9cacc tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:52.606297 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9990fc8a-d4e9-4534-b3a3-b903a6f9cacc tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:52.608878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9990fc8a-d4e9-4534-b3a3-b903a6f9cacc tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:52.898357 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9990fc8a-d4e9-4534-b3a3-b903a6f9cacc tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:52.907966 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9990fc8a-d4e9-4534-b3a3-b903a6f9cacc tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0" status: 200 len: 1543 microversion: 2.1 time: 0.338234 Jul 25 14:59:52.908863 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3116/6013] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:52 2022] GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0 => generated 1543 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 14:59:53.098488 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-560706ef-7c98-4559-9c3f-445d3b740a85 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '.version_select at 0x7f469893e790>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:53.143238 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-560706ef-7c98-4559-9c3f-445d3b740a85 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1430484760" status: 202 len: 0 microversion: 2.1 time: 0.050421 Jul 25 14:59:53.144312 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3117/6014] 10.222.0.88 () {58 vars in 1284 bytes} [Mon Jul 25 14:59:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1430484760 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 14:59:53.194019 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6681476a-05aa-4af4-b0c4-a60947b47564 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Action: 'create', calling method: .version_select at 0x7f4685fa0d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1100944553", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNAaeSW7cmIw825svYIwRMzW1nCiL/EJbZlvAvMUpEKy3Hk59Lb/bHAleSWb6aV1xvxp/s2axcfy26EeRQp8zJQus+sm/cq2EDceosVmkMiOmYwtWSn8YKFR4H35Z9urw=="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:59:53.246118 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-6681476a-05aa-4af4-b0c4-a60947b47564 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Getting quotas for project 8dd09177faea4702992aaab182125b5a. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 14:59:53.255664 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-6681476a-05aa-4af4-b0c4-a60947b47564 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Getting quotas for user ca46c8e84b8644b69937ec9c06cb0e9a and project 8dd09177faea4702992aaab182125b5a. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 14:59:53.303000 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6681476a-05aa-4af4-b0c4-a60947b47564 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.113739 Jul 25 14:59:53.305699 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3118/6015] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 14:59:53 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 14:59:53.318649 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3870aac7-8f3f-4916-bfac-6b71ad4e5050 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:53.330569 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3870aac7-8f3f-4916-bfac-6b71ad4e5050 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1460 microversion: 2.1 time: 0.919916 Jul 25 14:59:53.331279 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2898/6016] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:52 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1460 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:54.370377 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cb43c1f3-bdb3-43ab-a8d8-05e8937a1472 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:54.371649 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cb43c1f3-bdb3-43ab-a8d8-05e8937a1472 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:54.386461 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb43c1f3-bdb3-43ab-a8d8-05e8937a1472 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:54.388565 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb43c1f3-bdb3-43ab-a8d8-05e8937a1472 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:54.390139 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb43c1f3-bdb3-43ab-a8d8-05e8937a1472 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:54.393329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb43c1f3-bdb3-43ab-a8d8-05e8937a1472 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:54.910995 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cb43c1f3-bdb3-43ab-a8d8-05e8937a1472 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:54.922959 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cb43c1f3-bdb3-43ab-a8d8-05e8937a1472 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1460 microversion: 2.1 time: 0.557720 Jul 25 14:59:54.943204 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3119/6017] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:54 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1460 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:55.951576 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-88128359-fe17-4d9e-907d-eb85488f5bc0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:55.953198 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-88128359-fe17-4d9e-907d-eb85488f5bc0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:55.962226 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-88128359-fe17-4d9e-907d-eb85488f5bc0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:55.963449 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-88128359-fe17-4d9e-907d-eb85488f5bc0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:55.964483 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-88128359-fe17-4d9e-907d-eb85488f5bc0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:55.965096 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-88128359-fe17-4d9e-907d-eb85488f5bc0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:56.391810 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-88128359-fe17-4d9e-907d-eb85488f5bc0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:56.432354 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-88128359-fe17-4d9e-907d-eb85488f5bc0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1518 microversion: 2.1 time: 0.485412 Jul 25 14:59:56.434096 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2899/6018] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:55 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1518 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:56.841760 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-ef6d3afb-a448-4adf-8e76-56553c172719 req-7d79d3c3-dafb-46e8-be71-c1efda1299a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5df3428f-90e1-4629-b613-aea056517fe0", "tag": "98d89e4c-d389-4e25-a0df-6934ef7fe40b"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:59:56.864281 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ef6d3afb-a448-4adf-8e76-56553c172719 req-7d79d3c3-dafb-46e8-be71-c1efda1299a8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:56.864923 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ef6d3afb-a448-4adf-8e76-56553c172719 req-7d79d3c3-dafb-46e8-be71-c1efda1299a8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:56.901183 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-ef6d3afb-a448-4adf-8e76-56553c172719 req-7d79d3c3-dafb-46e8-be71-c1efda1299a8 service nova] Creating event network-changed:98d89e4c-d389-4e25-a0df-6934ef7fe40b for instance 5df3428f-90e1-4629-b613-aea056517fe0 on n-h2-846435-14 Jul 25 14:59:56.911287 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-ef6d3afb-a448-4adf-8e76-56553c172719 req-7d79d3c3-dafb-46e8-be71-c1efda1299a8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074973 Jul 25 14:59:56.914398 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3120/6019] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:59:57.342441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-ff7c4af7-1948-4e0e-8e7a-4f9a3956da08 req-1d7d2364-96b0-4ec7-be3f-743eab5b8451 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34bbd65c-a1e0-4f6c-a775-8c9f847eccec", "tag": "6bd9c9b1-8f44-48ec-8ace-8bfe7e29920e"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 14:59:57.371837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ff7c4af7-1948-4e0e-8e7a-4f9a3956da08 req-1d7d2364-96b0-4ec7-be3f-743eab5b8451 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:57.394451 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ff7c4af7-1948-4e0e-8e7a-4f9a3956da08 req-1d7d2364-96b0-4ec7-be3f-743eab5b8451 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:57.441373 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-ff7c4af7-1948-4e0e-8e7a-4f9a3956da08 req-1d7d2364-96b0-4ec7-be3f-743eab5b8451 service nova] Creating event network-changed:6bd9c9b1-8f44-48ec-8ace-8bfe7e29920e for instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec on n-h1-846435-14 Jul 25 14:59:57.457931 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-ff7c4af7-1948-4e0e-8e7a-4f9a3956da08 req-1d7d2364-96b0-4ec7-be3f-743eab5b8451 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123206 Jul 25 14:59:57.458170 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7d78701c-b4e0-4d3c-af59-06f14d01ab34 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:57.459740 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7d78701c-b4e0-4d3c-af59-06f14d01ab34 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:57.462596 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2900/6020] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 14:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 14:59:57.474640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d78701c-b4e0-4d3c-af59-06f14d01ab34 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:57.478992 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d78701c-b4e0-4d3c-af59-06f14d01ab34 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:57.479952 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d78701c-b4e0-4d3c-af59-06f14d01ab34 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:57.482318 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d78701c-b4e0-4d3c-af59-06f14d01ab34 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:58.254721 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7d78701c-b4e0-4d3c-af59-06f14d01ab34 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 14:59:58.269246 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7d78701c-b4e0-4d3c-af59-06f14d01ab34 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1518 microversion: 2.1 time: 0.817853 Jul 25 14:59:58.280382 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3121/6021] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:57 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1518 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 14:59:59.311033 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fcfb8329-2697-469f-a042-bcf42e6c4077 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 14:59:59.316631 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fcfb8329-2697-469f-a042-bcf42e6c4077 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 14:59:59.364832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fcfb8329-2697-469f-a042-bcf42e6c4077 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:59.372721 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fcfb8329-2697-469f-a042-bcf42e6c4077 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 14:59:59.373771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fcfb8329-2697-469f-a042-bcf42e6c4077 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 14:59:59.374282 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fcfb8329-2697-469f-a042-bcf42e6c4077 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:00.065794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fcfb8329-2697-469f-a042-bcf42e6c4077 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:00.080579 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fcfb8329-2697-469f-a042-bcf42e6c4077 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1518 microversion: 2.1 time: 0.772786 Jul 25 15:00:00.081710 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2901/6022] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 14:59:59 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1518 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:01.103169 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5d699ffa-9920-4aba-8455-7dd8d865491a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:01.105852 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5d699ffa-9920-4aba-8455-7dd8d865491a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:01.126122 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d699ffa-9920-4aba-8455-7dd8d865491a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:01.128618 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d699ffa-9920-4aba-8455-7dd8d865491a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:01.132405 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d699ffa-9920-4aba-8455-7dd8d865491a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:01.133252 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d699ffa-9920-4aba-8455-7dd8d865491a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:01.481558 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5d699ffa-9920-4aba-8455-7dd8d865491a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:01.493193 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5d699ffa-9920-4aba-8455-7dd8d865491a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1518 microversion: 2.1 time: 0.394444 Jul 25 15:00:01.494326 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3122/6023] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:01 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1518 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:02.522097 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e2de5d56-669b-44db-9490-4ccd57687978 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:02.522697 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e2de5d56-669b-44db-9490-4ccd57687978 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:02.542126 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e2de5d56-669b-44db-9490-4ccd57687978 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:02.547624 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e2de5d56-669b-44db-9490-4ccd57687978 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:02.548785 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e2de5d56-669b-44db-9490-4ccd57687978 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:02.549411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e2de5d56-669b-44db-9490-4ccd57687978 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:02.909062 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e2de5d56-669b-44db-9490-4ccd57687978 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:02.940701 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e2de5d56-669b-44db-9490-4ccd57687978 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1518 microversion: 2.1 time: 0.422669 Jul 25 15:00:02.946532 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2902/6024] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:02 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1518 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:03.971680 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a0a373fa-3c86-44a0-89b1-9d0c5d65c111 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:03.973088 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a0a373fa-3c86-44a0-89b1-9d0c5d65c111 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:03.983735 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=4 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:00:03.990631 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a0a373fa-3c86-44a0-89b1-9d0c5d65c111 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:03.991381 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a0a373fa-3c86-44a0-89b1-9d0c5d65c111 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:03.995737 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a0a373fa-3c86-44a0-89b1-9d0c5d65c111 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:03.997398 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a0a373fa-3c86-44a0-89b1-9d0c5d65c111 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:04.828682 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a0a373fa-3c86-44a0-89b1-9d0c5d65c111 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:04.845749 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a0a373fa-3c86-44a0-89b1-9d0c5d65c111 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1518 microversion: 2.1 time: 0.882491 Jul 25 15:00:04.846459 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3123/6025] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:03 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1518 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:05.875371 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-294d9f4c-dc27-4577-a5d5-a24d97b5a2ad tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:05.877000 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-294d9f4c-dc27-4577-a5d5-a24d97b5a2ad tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:05.890140 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-294d9f4c-dc27-4577-a5d5-a24d97b5a2ad tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:05.890591 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-294d9f4c-dc27-4577-a5d5-a24d97b5a2ad tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:05.891394 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-294d9f4c-dc27-4577-a5d5-a24d97b5a2ad tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:05.891830 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-294d9f4c-dc27-4577-a5d5-a24d97b5a2ad tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:06.791494 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-294d9f4c-dc27-4577-a5d5-a24d97b5a2ad tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:06.812437 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-294d9f4c-dc27-4577-a5d5-a24d97b5a2ad tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1518 microversion: 2.1 time: 0.934298 Jul 25 15:00:06.813430 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2903/6026] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:05 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1518 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:07.855218 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1b820b1e-6ae7-4b56-8cb9-ab640ca8b9c6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:07.856180 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1b820b1e-6ae7-4b56-8cb9-ab640ca8b9c6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:07.873533 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1b820b1e-6ae7-4b56-8cb9-ab640ca8b9c6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:07.882744 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1b820b1e-6ae7-4b56-8cb9-ab640ca8b9c6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:07.884675 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1b820b1e-6ae7-4b56-8cb9-ab640ca8b9c6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:07.886883 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1b820b1e-6ae7-4b56-8cb9-ab640ca8b9c6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:08.534118 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1b820b1e-6ae7-4b56-8cb9-ab640ca8b9c6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:08.546300 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1b820b1e-6ae7-4b56-8cb9-ab640ca8b9c6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1518 microversion: 2.1 time: 0.695800 Jul 25 15:00:08.549625 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3124/6027] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:07 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1518 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:09.592255 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-96573614-749a-4082-bae6-86e592ef8959 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:09.593076 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-96573614-749a-4082-bae6-86e592ef8959 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:09.621714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-96573614-749a-4082-bae6-86e592ef8959 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:09.622552 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-96573614-749a-4082-bae6-86e592ef8959 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:09.625724 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-96573614-749a-4082-bae6-86e592ef8959 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:09.626368 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-96573614-749a-4082-bae6-86e592ef8959 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:10.525142 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-96573614-749a-4082-bae6-86e592ef8959 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:10.544321 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-96573614-749a-4082-bae6-86e592ef8959 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1518 microversion: 2.1 time: 0.957893 Jul 25 15:00:10.556613 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2904/6028] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:09 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1518 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:00:11.581303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-89a5a5a6-333b-4a2a-8cd3-ff258a64cdb7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:11.582139 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-89a5a5a6-333b-4a2a-8cd3-ff258a64cdb7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:11.592040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-89a5a5a6-333b-4a2a-8cd3-ff258a64cdb7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:11.592493 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-89a5a5a6-333b-4a2a-8cd3-ff258a64cdb7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:11.593283 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-89a5a5a6-333b-4a2a-8cd3-ff258a64cdb7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:11.593707 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-89a5a5a6-333b-4a2a-8cd3-ff258a64cdb7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:11.946913 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-89a5a5a6-333b-4a2a-8cd3-ff258a64cdb7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:11.956728 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-89a5a5a6-333b-4a2a-8cd3-ff258a64cdb7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1518 microversion: 2.1 time: 0.379173 Jul 25 15:00:11.969449 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3125/6029] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:11 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1518 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:12.992871 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e4baffb5-8f9c-461a-b130-d4b29ba21f50 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:12.993749 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e4baffb5-8f9c-461a-b130-d4b29ba21f50 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:13.015337 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e4baffb5-8f9c-461a-b130-d4b29ba21f50 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:13.025869 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e4baffb5-8f9c-461a-b130-d4b29ba21f50 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:13.026978 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e4baffb5-8f9c-461a-b130-d4b29ba21f50 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:13.027542 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e4baffb5-8f9c-461a-b130-d4b29ba21f50 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:13.396581 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e4baffb5-8f9c-461a-b130-d4b29ba21f50 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:13.411693 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e4baffb5-8f9c-461a-b130-d4b29ba21f50 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1518 microversion: 2.1 time: 0.419950 Jul 25 15:00:13.432342 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2905/6030] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:12 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1518 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:13.796684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d9a8ba3e-c20f-476e-b47d-33eb0b5f8dff tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2112467071", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "bcfaf124-f0bc-48cb-b6bf-8e7861a97db7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1100944553", "security_groups": [{"name": "tempest-secgroup-smoke-1781866821"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:00:14.109776 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-d9a8ba3e-c20f-476e-b47d-33eb0b5f8dff tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] validate_networks() for [('bcfaf124-f0bc-48cb-b6bf-8e7861a97db7', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:00:14.476293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-47de3a90-2cae-47c4-b9f4-b0b246bf4601 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:14.477648 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-47de3a90-2cae-47c4-b9f4-b0b246bf4601 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:14.487383 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-47de3a90-2cae-47c4-b9f4-b0b246bf4601 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:14.491656 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-47de3a90-2cae-47c4-b9f4-b0b246bf4601 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:14.493988 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-47de3a90-2cae-47c4-b9f4-b0b246bf4601 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:14.496323 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-47de3a90-2cae-47c4-b9f4-b0b246bf4601 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:14.944061 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-47de3a90-2cae-47c4-b9f4-b0b246bf4601 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:14.974251 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-47de3a90-2cae-47c4-b9f4-b0b246bf4601 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1518 microversion: 2.1 time: 0.501441 Jul 25 15:00:14.992638 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2906/6031] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:14 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1518 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:15.203590 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-d9a8ba3e-c20f-476e-b47d-33eb0b5f8dff tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:00:15.205168 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-d9a8ba3e-c20f-476e-b47d-33eb0b5f8dff tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:00:15.205808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-d9a8ba3e-c20f-476e-b47d-33eb0b5f8dff tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:00:15.206526 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-d9a8ba3e-c20f-476e-b47d-33eb0b5f8dff tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:00:15.207114 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-d9a8ba3e-c20f-476e-b47d-33eb0b5f8dff tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:00:15.221090 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d9a8ba3e-c20f-476e-b47d-33eb0b5f8dff tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:15.221878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d9a8ba3e-c20f-476e-b47d-33eb0b5f8dff tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:15.222840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d9a8ba3e-c20f-476e-b47d-33eb0b5f8dff tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:15.224214 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d9a8ba3e-c20f-476e-b47d-33eb0b5f8dff tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:15.284701 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-d9a8ba3e-c20f-476e-b47d-33eb0b5f8dff tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Getting quotas for project 8dd09177faea4702992aaab182125b5a. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:00:15.300084 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-d9a8ba3e-c20f-476e-b47d-33eb0b5f8dff tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Getting quotas for user ca46c8e84b8644b69937ec9c06cb0e9a and project 8dd09177faea4702992aaab182125b5a. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:00:15.338589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:00:15.340725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d9a8ba3e-c20f-476e-b47d-33eb0b5f8dff tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:00:15.349370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d9a8ba3e-c20f-476e-b47d-33eb0b5f8dff tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:00:15.451391 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d9a8ba3e-c20f-476e-b47d-33eb0b5f8dff tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.661502 Jul 25 15:00:15.451885 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3126/6032] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:00:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:00:15.476338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-de1c2e25-615f-4fa3-8c17-afcf7b540542 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:15.477506 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-de1c2e25-615f-4fa3-8c17-afcf7b540542 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:15.591694 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-de1c2e25-615f-4fa3-8c17-afcf7b540542 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:15.617249 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-de1c2e25-615f-4fa3-8c17-afcf7b540542 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1267 microversion: 2.1 time: 0.148247 Jul 25 15:00:15.647576 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2907/6033] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:15 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:16.035461 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-77e957b5-432b-438c-a295-49661c686fcf tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:16.051900 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-77e957b5-432b-438c-a295-49661c686fcf tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:16.070186 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-77e957b5-432b-438c-a295-49661c686fcf tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:16.075134 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-77e957b5-432b-438c-a295-49661c686fcf tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:16.079147 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-77e957b5-432b-438c-a295-49661c686fcf tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:16.080297 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-77e957b5-432b-438c-a295-49661c686fcf tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:16.093932 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=90 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:00:16.608319 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-77e957b5-432b-438c-a295-49661c686fcf tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:16.649763 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-77e957b5-432b-438c-a295-49661c686fcf tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1518 microversion: 2.1 time: 0.621575 Jul 25 15:00:16.651486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6384c0ad-1db3-4cd6-b408-6cde16f8c219 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:16.652347 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6384c0ad-1db3-4cd6-b408-6cde16f8c219 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:16.658587 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3127/6034] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:16 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1518 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:16.670496 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6384c0ad-1db3-4cd6-b408-6cde16f8c219 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:16.670954 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6384c0ad-1db3-4cd6-b408-6cde16f8c219 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:16.671764 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6384c0ad-1db3-4cd6-b408-6cde16f8c219 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:16.672233 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6384c0ad-1db3-4cd6-b408-6cde16f8c219 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:16.817471 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6384c0ad-1db3-4cd6-b408-6cde16f8c219 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:16.830366 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6384c0ad-1db3-4cd6-b408-6cde16f8c219 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1263 microversion: 2.1 time: 0.182779 Jul 25 15:00:16.852089 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2908/6035] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:16 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1263 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:00:17.699614 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-41e979ed-680e-47dc-a21b-b1ec86db611d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:17.700975 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-41e979ed-680e-47dc-a21b-b1ec86db611d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:17.717171 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-41e979ed-680e-47dc-a21b-b1ec86db611d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:17.718819 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-41e979ed-680e-47dc-a21b-b1ec86db611d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:17.719867 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-41e979ed-680e-47dc-a21b-b1ec86db611d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:17.720517 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-41e979ed-680e-47dc-a21b-b1ec86db611d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:17.874839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a2c8bf63-e856-444d-a5eb-34d05dd72e03 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:17.875779 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a2c8bf63-e856-444d-a5eb-34d05dd72e03 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:17.887763 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a2c8bf63-e856-444d-a5eb-34d05dd72e03 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:17.888486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a2c8bf63-e856-444d-a5eb-34d05dd72e03 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:17.889703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a2c8bf63-e856-444d-a5eb-34d05dd72e03 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:17.890359 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a2c8bf63-e856-444d-a5eb-34d05dd72e03 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:17.987052 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a2c8bf63-e856-444d-a5eb-34d05dd72e03 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:18.001737 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a2c8bf63-e856-444d-a5eb-34d05dd72e03 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1325 microversion: 2.1 time: 0.132931 Jul 25 15:00:18.013003 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2909/6036] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:17 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1325 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:18.299231 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-41e979ed-680e-47dc-a21b-b1ec86db611d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:18.307158 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-41e979ed-680e-47dc-a21b-b1ec86db611d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1518 microversion: 2.1 time: 0.612592 Jul 25 15:00:18.320894 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3128/6037] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:17 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1518 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:18.918634 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-59fd158a-3b5e-4e70-b84b-190e032c767e req-91f01da0-1eb8-44d8-a207-8051cbd77be0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34bbd65c-a1e0-4f6c-a775-8c9f847eccec", "name": "network-vif-plugged", "status": "completed", "tag": "6bd9c9b1-8f44-48ec-8ace-8bfe7e29920e"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:00:18.937430 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-59fd158a-3b5e-4e70-b84b-190e032c767e req-91f01da0-1eb8-44d8-a207-8051cbd77be0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:18.937899 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-59fd158a-3b5e-4e70-b84b-190e032c767e req-91f01da0-1eb8-44d8-a207-8051cbd77be0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:18.968336 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-59fd158a-3b5e-4e70-b84b-190e032c767e req-91f01da0-1eb8-44d8-a207-8051cbd77be0 service nova] Creating event network-vif-plugged:6bd9c9b1-8f44-48ec-8ace-8bfe7e29920e for instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec on n-h1-846435-14 Jul 25 15:00:18.997928 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-59fd158a-3b5e-4e70-b84b-190e032c767e req-91f01da0-1eb8-44d8-a207-8051cbd77be0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082542 Jul 25 15:00:18.998175 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2910/6038] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:00:19.042849 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7570413d-1701-4f2e-a84a-92387e5ad9b4 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:19.043830 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7570413d-1701-4f2e-a84a-92387e5ad9b4 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:19.071726 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7570413d-1701-4f2e-a84a-92387e5ad9b4 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:19.085242 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7570413d-1701-4f2e-a84a-92387e5ad9b4 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:19.086797 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7570413d-1701-4f2e-a84a-92387e5ad9b4 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:19.087564 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7570413d-1701-4f2e-a84a-92387e5ad9b4 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:19.331674 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f1cfc951-0b85-4a2c-8487-542dc211ed66 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:19.332663 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f1cfc951-0b85-4a2c-8487-542dc211ed66 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:19.341703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f1cfc951-0b85-4a2c-8487-542dc211ed66 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:19.342438 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f1cfc951-0b85-4a2c-8487-542dc211ed66 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:19.343840 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f1cfc951-0b85-4a2c-8487-542dc211ed66 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:19.344522 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f1cfc951-0b85-4a2c-8487-542dc211ed66 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:19.699285 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7570413d-1701-4f2e-a84a-92387e5ad9b4 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:19.727038 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7570413d-1701-4f2e-a84a-92387e5ad9b4 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1393 microversion: 2.1 time: 0.695773 Jul 25 15:00:19.729952 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3129/6039] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:19 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1393 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:19.769161 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f1cfc951-0b85-4a2c-8487-542dc211ed66 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:19.779420 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f1cfc951-0b85-4a2c-8487-542dc211ed66 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1518 microversion: 2.1 time: 0.452120 Jul 25 15:00:19.780620 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2911/6040] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:19 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1518 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:00:20.262083 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-b764cb11-a193-41b4-9ac9-96af781865cf req-366adb2e-7ff6-4d5c-946a-1a3600de42ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ec74cda-74e2-4998-8f9a-942e980313c3", "tag": "66b36202-edd4-437d-abc1-1e5c0064323d"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:00:20.288883 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-b764cb11-a193-41b4-9ac9-96af781865cf req-366adb2e-7ff6-4d5c-946a-1a3600de42ac service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:20.289757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-b764cb11-a193-41b4-9ac9-96af781865cf req-366adb2e-7ff6-4d5c-946a-1a3600de42ac service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:20.306106 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-b764cb11-a193-41b4-9ac9-96af781865cf req-366adb2e-7ff6-4d5c-946a-1a3600de42ac service nova] Creating event network-changed:66b36202-edd4-437d-abc1-1e5c0064323d for instance 4ec74cda-74e2-4998-8f9a-942e980313c3 on n-h2-846435-14 Jul 25 15:00:20.315449 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-b764cb11-a193-41b4-9ac9-96af781865cf req-366adb2e-7ff6-4d5c-946a-1a3600de42ac service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100764 Jul 25 15:00:20.317319 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3130/6041] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:00:20.768353 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ebc019c1-50d6-44c9-b143-b703db810012 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:20.770172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ebc019c1-50d6-44c9-b143-b703db810012 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:20.798756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ebc019c1-50d6-44c9-b143-b703db810012 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:20.799666 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ebc019c1-50d6-44c9-b143-b703db810012 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:20.802480 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ebc019c1-50d6-44c9-b143-b703db810012 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:20.803159 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ebc019c1-50d6-44c9-b143-b703db810012 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:20.841318 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ba602f4d-b5a5-4acc-b7b6-23d19f196cec tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:20.843024 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ba602f4d-b5a5-4acc-b7b6-23d19f196cec tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:20.853388 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ba602f4d-b5a5-4acc-b7b6-23d19f196cec tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:20.858879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ba602f4d-b5a5-4acc-b7b6-23d19f196cec tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:20.860600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ba602f4d-b5a5-4acc-b7b6-23d19f196cec tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:20.861297 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ba602f4d-b5a5-4acc-b7b6-23d19f196cec tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:21.149071 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ebc019c1-50d6-44c9-b143-b703db810012 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:21.164613 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ebc019c1-50d6-44c9-b143-b703db810012 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1393 microversion: 2.1 time: 0.414994 Jul 25 15:00:21.167483 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2912/6042] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:20 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1393 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:21.307415 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ba602f4d-b5a5-4acc-b7b6-23d19f196cec tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:21.327619 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ba602f4d-b5a5-4acc-b7b6-23d19f196cec tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1518 microversion: 2.1 time: 0.495042 Jul 25 15:00:21.335895 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3131/6043] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:20 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1518 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:22.188950 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-366b20f9-d0c1-4d8a-8bbd-e296fa3393f2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:22.190330 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-366b20f9-d0c1-4d8a-8bbd-e296fa3393f2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:22.210256 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-366b20f9-d0c1-4d8a-8bbd-e296fa3393f2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:22.210256 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-366b20f9-d0c1-4d8a-8bbd-e296fa3393f2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:22.210256 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-366b20f9-d0c1-4d8a-8bbd-e296fa3393f2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:22.210256 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-366b20f9-d0c1-4d8a-8bbd-e296fa3393f2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:22.210256 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:00:22.357652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-10a8017d-61a8-4d1a-aa53-5d7a285df732 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:22.358549 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-10a8017d-61a8-4d1a-aa53-5d7a285df732 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:22.365865 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-10a8017d-61a8-4d1a-aa53-5d7a285df732 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:22.366552 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-10a8017d-61a8-4d1a-aa53-5d7a285df732 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:22.367493 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-10a8017d-61a8-4d1a-aa53-5d7a285df732 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:22.369010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-10a8017d-61a8-4d1a-aa53-5d7a285df732 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:22.409389 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-366b20f9-d0c1-4d8a-8bbd-e296fa3393f2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:22.423667 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-366b20f9-d0c1-4d8a-8bbd-e296fa3393f2 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1393 microversion: 2.1 time: 0.239956 Jul 25 15:00:22.429243 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2913/6044] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:22 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1393 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:00:22.588821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-10a8017d-61a8-4d1a-aa53-5d7a285df732 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:22.599850 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-10a8017d-61a8-4d1a-aa53-5d7a285df732 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.246097 Jul 25 15:00:22.612065 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3132/6045] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:22 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:22.623670 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5091bd48-5b60-4515-974b-d4e29a03c34f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:22.624648 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5091bd48-5b60-4515-974b-d4e29a03c34f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:22.627298 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=34 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:00:22.635560 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5091bd48-5b60-4515-974b-d4e29a03c34f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:22.636282 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5091bd48-5b60-4515-974b-d4e29a03c34f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:22.637436 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5091bd48-5b60-4515-974b-d4e29a03c34f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:22.638077 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5091bd48-5b60-4515-974b-d4e29a03c34f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:22.822831 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5091bd48-5b60-4515-974b-d4e29a03c34f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:22.833676 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5091bd48-5b60-4515-974b-d4e29a03c34f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.215943 Jul 25 15:00:22.834560 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2914/6046] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:22 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:22.874252 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ace221b2-c453-4d22-847e-7bba5b201a83 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:22.874775 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ace221b2-c453-4d22-847e-7bba5b201a83 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:22.888279 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ace221b2-c453-4d22-847e-7bba5b201a83 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:22.889032 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ace221b2-c453-4d22-847e-7bba5b201a83 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:22.890202 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ace221b2-c453-4d22-847e-7bba5b201a83 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:22.890816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ace221b2-c453-4d22-847e-7bba5b201a83 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:23.031947 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ace221b2-c453-4d22-847e-7bba5b201a83 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:23.048532 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ace221b2-c453-4d22-847e-7bba5b201a83 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.179173 Jul 25 15:00:23.049292 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3133/6047] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:22 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:23.081915 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d1be227f-4cbf-4ad4-9830-9fbaf961ef33 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:00:23.089443 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-d1be227f-4cbf-4ad4-9830-9fbaf961ef33 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Instance 27c24817-cb97-4d13-9df6-0a2d210c5157 has no mapping to a cell. Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d1be227f-4cbf-4ad4-9830-9fbaf961ef33 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/servers/27c24817-cb97-4d13-9df6-0a2d210c5157/action HTTP/1.1 Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 15 Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: {"os-stop": {}} Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 27c24817-cb97-4d13-9df6-0a2d210c5157 has no mapping to a cell. Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '27c24817-cb97-4d13-9df6-0a2d210c5157', 'body': {'os-stop': {}}} Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 27c24817-cb97-4d13-9df6-0a2d210c5157 has no mapping to a cell. Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:00:23.098024 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27c24817-cb97-4d13-9df6-0a2d210c5157 has no mapping to a cell. Jul 25 15:00:23.103710 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:23.103710 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:00:23.103710 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:23.103710 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:23.103710 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:00:23.103710 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:00:23.103710 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:00:23.103710 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:00:23.103710 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27c24817-cb97-4d13-9df6-0a2d210c5157 has no mapping to a cell. Jul 25 15:00:23.103710 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:23.103710 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d1be227f-4cbf-4ad4-9830-9fbaf961ef33 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 404 to user: Instance 27c24817-cb97-4d13-9df6-0a2d210c5157 has no mapping to a cell. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:00:23.103710 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d1be227f-4cbf-4ad4-9830-9fbaf961ef33 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers/27c24817-cb97-4d13-9df6-0a2d210c5157/action" status: 404 len: 117 microversion: 2.1 time: 0.024921 Jul 25 15:00:23.103710 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2915/6048] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:00:23 2022] POST /compute/v2.1/servers/27c24817-cb97-4d13-9df6-0a2d210c5157/action => generated 117 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 15:00:23.110286 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6e25f47b-574e-4acf-a340-cfa4cc451685 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:23.110898 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6e25f47b-574e-4acf-a340-cfa4cc451685 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:23.117049 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e25f47b-574e-4acf-a340-cfa4cc451685 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:23.117495 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e25f47b-574e-4acf-a340-cfa4cc451685 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:23.118258 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e25f47b-574e-4acf-a340-cfa4cc451685 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:23.118687 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e25f47b-574e-4acf-a340-cfa4cc451685 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:23.271506 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6e25f47b-574e-4acf-a340-cfa4cc451685 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:23.280352 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6e25f47b-574e-4acf-a340-cfa4cc451685 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.173933 Jul 25 15:00:23.281042 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3134/6049] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:23 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:23.304303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7120e9f2-a1d4-479c-b723-47ec39660e5d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:23.304925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7120e9f2-a1d4-479c-b723-47ec39660e5d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:23.313971 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7120e9f2-a1d4-479c-b723-47ec39660e5d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:23.314656 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7120e9f2-a1d4-479c-b723-47ec39660e5d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:23.315595 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7120e9f2-a1d4-479c-b723-47ec39660e5d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:23.316226 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7120e9f2-a1d4-479c-b723-47ec39660e5d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:23.463822 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7120e9f2-a1d4-479c-b723-47ec39660e5d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:23.476897 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-92c0f2e6-442d-417c-8940-fb1278f71652 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:23.478443 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-92c0f2e6-442d-417c-8940-fb1278f71652 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:23.483575 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7120e9f2-a1d4-479c-b723-47ec39660e5d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.182839 Jul 25 15:00:23.488318 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2916/6050] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:23 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:23.503874 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-92c0f2e6-442d-417c-8940-fb1278f71652 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:23.504358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-92c0f2e6-442d-417c-8940-fb1278f71652 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:23.504501 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8f93e526-3a68-47e2-8fb3-7926d9db4e2b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:00:23.505074 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8f93e526-3a68-47e2-8fb3-7926d9db4e2b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 4ad82125-10c7-4852-b65c-87c8829682df] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:23.505256 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-92c0f2e6-442d-417c-8940-fb1278f71652 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:23.505726 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-92c0f2e6-442d-417c-8940-fb1278f71652 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:23.511391 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-8f93e526-3a68-47e2-8fb3-7926d9db4e2b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Instance 4ad82125-10c7-4852-b65c-87c8829682df could not be found. Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8f93e526-3a68-47e2-8fb3-7926d9db4e2b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/servers/4ad82125-10c7-4852-b65c-87c8829682df/action HTTP/1.1 Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 15 Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: {"suspend": {}} Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 4ad82125-10c7-4852-b65c-87c8829682df could not be found. Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '4ad82125-10c7-4852-b65c-87c8829682df', 'body': {'suspend': {}}} Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ad82125-10c7-4852-b65c-87c8829682df could not be found. Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ad82125-10c7-4852-b65c-87c8829682df could not be found. Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:00:23.513256 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:00:23.518603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:00:23.518603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:00:23.518603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ad82125-10c7-4852-b65c-87c8829682df could not be found. Jul 25 15:00:23.518603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:23.520069 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8f93e526-3a68-47e2-8fb3-7926d9db4e2b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 404 to user: Instance 4ad82125-10c7-4852-b65c-87c8829682df could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:00:23.521131 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8f93e526-3a68-47e2-8fb3-7926d9db4e2b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers/4ad82125-10c7-4852-b65c-87c8829682df/action" status: 404 len: 111 microversion: 2.1 time: 0.020950 Jul 25 15:00:23.521915 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2917/6051] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:00:23 2022] POST /compute/v2.1/servers/4ad82125-10c7-4852-b65c-87c8829682df/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 15:00:23.530321 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0efd3b72-4380-4a73-8e65-8babc8495608 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:23.531192 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0efd3b72-4380-4a73-8e65-8babc8495608 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:23.538521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0efd3b72-4380-4a73-8e65-8babc8495608 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:23.539222 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0efd3b72-4380-4a73-8e65-8babc8495608 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:23.540406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0efd3b72-4380-4a73-8e65-8babc8495608 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:23.541052 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0efd3b72-4380-4a73-8e65-8babc8495608 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:23.668578 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-92c0f2e6-442d-417c-8940-fb1278f71652 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:23.682191 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-92c0f2e6-442d-417c-8940-fb1278f71652 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1393 microversion: 2.1 time: 0.212455 Jul 25 15:00:23.696955 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3135/6052] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:23 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1393 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:23.706976 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0efd3b72-4380-4a73-8e65-8babc8495608 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:23.714987 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0efd3b72-4380-4a73-8e65-8babc8495608 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.188569 Jul 25 15:00:23.715730 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2918/6053] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:23 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:23.735814 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-023a47fa-734e-4920-b1ad-c5737538335f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:23.738117 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-023a47fa-734e-4920-b1ad-c5737538335f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:23.749258 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-023a47fa-734e-4920-b1ad-c5737538335f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:23.760476 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-023a47fa-734e-4920-b1ad-c5737538335f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:23.761423 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-023a47fa-734e-4920-b1ad-c5737538335f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:23.766445 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-023a47fa-734e-4920-b1ad-c5737538335f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:23.902902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-023a47fa-734e-4920-b1ad-c5737538335f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:23.911092 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-023a47fa-734e-4920-b1ad-c5737538335f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.179165 Jul 25 15:00:23.911805 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3136/6054] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:23 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:23.931372 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f3470d13-de5e-4276-8ffc-a31936f89296 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:00:23.931823 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f3470d13-de5e-4276-8ffc-a31936f89296 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:23.938553 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3470d13-de5e-4276-8ffc-a31936f89296 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:23.939040 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3470d13-de5e-4276-8ffc-a31936f89296 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:23.939806 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3470d13-de5e-4276-8ffc-a31936f89296 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:23.940277 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3470d13-de5e-4276-8ffc-a31936f89296 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:23.965796 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-f3470d13-de5e-4276-8ffc-a31936f89296 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lazy-loading 'flavor' on Instance uuid 34bbd65c-a1e0-4f6c-a775-8c9f847eccec {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:00:24.080330 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f3470d13-de5e-4276-8ffc-a31936f89296 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action" status: 202 len: 0 microversion: 2.1 time: 0.152745 Jul 25 15:00:24.084085 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2919/6055] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:00:23 2022] POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:00:24.090894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-71046682-43eb-4259-a3a8-cbb4bb85f6a6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:24.091637 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-71046682-43eb-4259-a3a8-cbb4bb85f6a6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:24.099151 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71046682-43eb-4259-a3a8-cbb4bb85f6a6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:24.100068 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71046682-43eb-4259-a3a8-cbb4bb85f6a6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:24.101201 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71046682-43eb-4259-a3a8-cbb4bb85f6a6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:24.101891 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71046682-43eb-4259-a3a8-cbb4bb85f6a6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:24.359733 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-71046682-43eb-4259-a3a8-cbb4bb85f6a6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:24.396911 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-71046682-43eb-4259-a3a8-cbb4bb85f6a6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1513 microversion: 2.1 time: 0.310506 Jul 25 15:00:24.397818 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3137/6056] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:24 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1513 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:24.707616 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-92e457b5-57c1-40a8-ade0-6d7c6eeee2fb tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:24.709284 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-92e457b5-57c1-40a8-ade0-6d7c6eeee2fb tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:24.718981 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-92e457b5-57c1-40a8-ade0-6d7c6eeee2fb tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:24.719793 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-92e457b5-57c1-40a8-ade0-6d7c6eeee2fb tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:24.720776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-92e457b5-57c1-40a8-ade0-6d7c6eeee2fb tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:24.721420 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-92e457b5-57c1-40a8-ade0-6d7c6eeee2fb tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:24.883093 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-92e457b5-57c1-40a8-ade0-6d7c6eeee2fb tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:24.894370 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-92e457b5-57c1-40a8-ade0-6d7c6eeee2fb tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1393 microversion: 2.1 time: 0.191813 Jul 25 15:00:24.896737 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2920/6057] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:24 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1393 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:25.419520 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-aa23ea51-1da0-4c9c-afb8-ea4d1ce00f61 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:25.421034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-aa23ea51-1da0-4c9c-afb8-ea4d1ce00f61 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:25.423960 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:00:25.424664 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:00:25.431002 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aa23ea51-1da0-4c9c-afb8-ea4d1ce00f61 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:25.432442 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aa23ea51-1da0-4c9c-afb8-ea4d1ce00f61 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:25.433445 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aa23ea51-1da0-4c9c-afb8-ea4d1ce00f61 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:25.434125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aa23ea51-1da0-4c9c-afb8-ea4d1ce00f61 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:25.620934 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-aa23ea51-1da0-4c9c-afb8-ea4d1ce00f61 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:25.633266 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-aa23ea51-1da0-4c9c-afb8-ea4d1ce00f61 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1496 microversion: 2.1 time: 0.216858 Jul 25 15:00:25.634070 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3138/6058] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:25 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1496 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:25.655464 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-255f8a1c-820b-496e-85c6-7275db9ba916 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:00:25.656374 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-255f8a1c-820b-496e-85c6-7275db9ba916 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:25.662575 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:00:25.665240 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-255f8a1c-820b-496e-85c6-7275db9ba916 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:25.665900 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-255f8a1c-820b-496e-85c6-7275db9ba916 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:25.667049 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-255f8a1c-820b-496e-85c6-7275db9ba916 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:25.667686 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-255f8a1c-820b-496e-85c6-7275db9ba916 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:25.698430 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-255f8a1c-820b-496e-85c6-7275db9ba916 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lazy-loading 'flavor' on Instance uuid 34bbd65c-a1e0-4f6c-a775-8c9f847eccec {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:00:25.712879 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-255f8a1c-820b-496e-85c6-7275db9ba916 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Cannot 'suspend' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state suspended Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-255f8a1c-820b-496e-85c6-7275db9ba916 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action HTTP/1.1 Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 15 Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: {"suspend": {}} Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: exception: Cannot 'suspend' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state suspended Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '34bbd65c-a1e0-4f6c-a775-8c9f847eccec', 'body': {'suspend': {}}} Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec in vm_state suspended. Cannot suspend while the instance is in this state. Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jul 25 15:00:25.714865 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 15:00:25.720466 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 15:00:25.720466 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 15:00:25.720466 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state suspended Jul 25 15:00:25.720466 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:25.720466 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:00:25.720466 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:25.720466 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:25.720466 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:00:25.720466 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:00:25.720466 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:00:25.720466 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:00:25.720466 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state suspended Jul 25 15:00:25.720466 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:25.722498 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-255f8a1c-820b-496e-85c6-7275db9ba916 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 409 to user: Cannot 'suspend' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state suspended {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:00:25.723965 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-255f8a1c-820b-496e-85c6-7275db9ba916 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action" status: 409 len: 148 microversion: 2.1 time: 0.073000 Jul 25 15:00:25.724792 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2921/6059] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:00:25 2022] POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action => generated 148 bytes in 75 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 15:00:25.735174 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e95fe722-e5ac-4849-a23a-e3de16fcc96d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:00:25.736018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e95fe722-e5ac-4849-a23a-e3de16fcc96d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:25.744878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e95fe722-e5ac-4849-a23a-e3de16fcc96d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:25.745533 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e95fe722-e5ac-4849-a23a-e3de16fcc96d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:25.746818 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e95fe722-e5ac-4849-a23a-e3de16fcc96d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:25.747525 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e95fe722-e5ac-4849-a23a-e3de16fcc96d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:25.851812 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e95fe722-e5ac-4849-a23a-e3de16fcc96d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action" status: 202 len: 0 microversion: 2.1 time: 0.122147 Jul 25 15:00:25.855495 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3139/6060] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:00:25 2022] POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:00:25.864010 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2e67d1c7-5de5-4cd8-8986-9b959c10f8ac tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:25.864704 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2e67d1c7-5de5-4cd8-8986-9b959c10f8ac tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:25.877641 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2e67d1c7-5de5-4cd8-8986-9b959c10f8ac tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:25.878373 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2e67d1c7-5de5-4cd8-8986-9b959c10f8ac tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:25.880203 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2e67d1c7-5de5-4cd8-8986-9b959c10f8ac tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:25.881016 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2e67d1c7-5de5-4cd8-8986-9b959c10f8ac tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:25.922735 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1dbd6c06-90ac-46a1-ac3d-387b45835ab5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:25.924052 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1dbd6c06-90ac-46a1-ac3d-387b45835ab5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:25.941628 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1dbd6c06-90ac-46a1-ac3d-387b45835ab5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:25.943141 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1dbd6c06-90ac-46a1-ac3d-387b45835ab5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:25.944130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1dbd6c06-90ac-46a1-ac3d-387b45835ab5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:25.944781 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1dbd6c06-90ac-46a1-ac3d-387b45835ab5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:26.200913 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2e67d1c7-5de5-4cd8-8986-9b959c10f8ac tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:26.210421 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2e67d1c7-5de5-4cd8-8986-9b959c10f8ac tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1502 microversion: 2.1 time: 0.351452 Jul 25 15:00:26.225045 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2922/6061] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:25 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1502 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:00:26.226832 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1dbd6c06-90ac-46a1-ac3d-387b45835ab5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:26.284028 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1dbd6c06-90ac-46a1-ac3d-387b45835ab5 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1393 microversion: 2.1 time: 0.369908 Jul 25 15:00:26.286896 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3140/6062] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:25 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1393 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:27.234228 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f13c75f1-ce95-4a84-bb56-3599480f42b7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:27.236265 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f13c75f1-ce95-4a84-bb56-3599480f42b7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:27.250101 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f13c75f1-ce95-4a84-bb56-3599480f42b7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:27.250101 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f13c75f1-ce95-4a84-bb56-3599480f42b7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:27.250101 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f13c75f1-ce95-4a84-bb56-3599480f42b7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:27.250101 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f13c75f1-ce95-4a84-bb56-3599480f42b7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:27.309002 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-29bebd4e-370a-4752-ab85-b6a9b2a75ffb tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:27.309652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-29bebd4e-370a-4752-ab85-b6a9b2a75ffb tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:27.325711 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-29bebd4e-370a-4752-ab85-b6a9b2a75ffb tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:27.326173 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-29bebd4e-370a-4752-ab85-b6a9b2a75ffb tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:27.326966 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-29bebd4e-370a-4752-ab85-b6a9b2a75ffb tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:27.327391 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-29bebd4e-370a-4752-ab85-b6a9b2a75ffb tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:27.540376 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f13c75f1-ce95-4a84-bb56-3599480f42b7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:27.555167 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-29bebd4e-370a-4752-ab85-b6a9b2a75ffb tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:27.555361 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f13c75f1-ce95-4a84-bb56-3599480f42b7 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1502 microversion: 2.1 time: 0.327101 Jul 25 15:00:27.555941 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2923/6063] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:27 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1502 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:27.569685 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-29bebd4e-370a-4752-ab85-b6a9b2a75ffb tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1393 microversion: 2.1 time: 0.260052 Jul 25 15:00:27.569685 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3141/6064] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:27 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1393 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:00:28.577939 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a4f3f85d-9ffc-46e5-8ba2-e8c7c5b9632e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:28.578702 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a4f3f85d-9ffc-46e5-8ba2-e8c7c5b9632e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:28.595417 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4f3f85d-9ffc-46e5-8ba2-e8c7c5b9632e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:28.595818 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c2b456aa-06e1-4e17-a6f4-56e68f469829 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:28.596355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4f3f85d-9ffc-46e5-8ba2-e8c7c5b9632e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:28.596747 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c2b456aa-06e1-4e17-a6f4-56e68f469829 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:28.596997 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4f3f85d-9ffc-46e5-8ba2-e8c7c5b9632e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:28.597445 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4f3f85d-9ffc-46e5-8ba2-e8c7c5b9632e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:28.610493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c2b456aa-06e1-4e17-a6f4-56e68f469829 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:28.612246 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c2b456aa-06e1-4e17-a6f4-56e68f469829 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:28.613739 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c2b456aa-06e1-4e17-a6f4-56e68f469829 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:28.614795 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c2b456aa-06e1-4e17-a6f4-56e68f469829 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:28.786288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a4f3f85d-9ffc-46e5-8ba2-e8c7c5b9632e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:28.799914 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a4f3f85d-9ffc-46e5-8ba2-e8c7c5b9632e tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.226233 Jul 25 15:00:28.801025 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3142/6065] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:28 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:28.827556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-595cba04-fe58-449d-9c8d-31de2d904ec2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:28.830646 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-595cba04-fe58-449d-9c8d-31de2d904ec2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:28.839789 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-595cba04-fe58-449d-9c8d-31de2d904ec2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:28.840594 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-595cba04-fe58-449d-9c8d-31de2d904ec2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:28.842104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-595cba04-fe58-449d-9c8d-31de2d904ec2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:28.842652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-595cba04-fe58-449d-9c8d-31de2d904ec2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:28.873896 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:00:28.892546 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c2b456aa-06e1-4e17-a6f4-56e68f469829 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:28.902415 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c2b456aa-06e1-4e17-a6f4-56e68f469829 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1393 microversion: 2.1 time: 0.317538 Jul 25 15:00:28.906076 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2924/6066] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:28 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1393 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:29.138911 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-595cba04-fe58-449d-9c8d-31de2d904ec2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:29.148999 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-595cba04-fe58-449d-9c8d-31de2d904ec2 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.326879 Jul 25 15:00:29.150235 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3143/6067] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:28 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:29.170551 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-aacc511f-ccfc-4b4a-9bfe-5a1ce86075a9 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:00:29.171650 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-aacc511f-ccfc-4b4a-9bfe-5a1ce86075a9 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: c8661c0e-cb63-46ab-a7c3-8048748ac4cf] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:29.178135 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-aacc511f-ccfc-4b4a-9bfe-5a1ce86075a9 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Instance c8661c0e-cb63-46ab-a7c3-8048748ac4cf could not be found. Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-aacc511f-ccfc-4b4a-9bfe-5a1ce86075a9 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/servers/c8661c0e-cb63-46ab-a7c3-8048748ac4cf/action HTTP/1.1 Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 15 Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: {"unpause": {}} Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance c8661c0e-cb63-46ab-a7c3-8048748ac4cf could not be found. Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'c8661c0e-cb63-46ab-a7c3-8048748ac4cf', 'body': {'unpause': {}}} Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8661c0e-cb63-46ab-a7c3-8048748ac4cf could not be found. Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8661c0e-cb63-46ab-a7c3-8048748ac4cf could not be found. Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:00:29.180268 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:00:29.186117 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:00:29.186117 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:00:29.186117 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8661c0e-cb63-46ab-a7c3-8048748ac4cf could not be found. Jul 25 15:00:29.186117 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:29.188952 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-aacc511f-ccfc-4b4a-9bfe-5a1ce86075a9 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 404 to user: Instance c8661c0e-cb63-46ab-a7c3-8048748ac4cf could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:00:29.190066 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-aacc511f-ccfc-4b4a-9bfe-5a1ce86075a9 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers/c8661c0e-cb63-46ab-a7c3-8048748ac4cf/action" status: 404 len: 111 microversion: 2.1 time: 0.023421 Jul 25 15:00:29.195469 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2925/6068] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:00:29 2022] POST /compute/v2.1/servers/c8661c0e-cb63-46ab-a7c3-8048748ac4cf/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:00:29.202572 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6d47c973-f474-412b-8d70-edc084d4637a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:29.203067 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6d47c973-f474-412b-8d70-edc084d4637a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:29.210189 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d47c973-f474-412b-8d70-edc084d4637a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:29.210651 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d47c973-f474-412b-8d70-edc084d4637a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:29.211610 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d47c973-f474-412b-8d70-edc084d4637a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:29.212077 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d47c973-f474-412b-8d70-edc084d4637a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:29.400919 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-f4a638c1-7911-4558-9ca1-c7b4674e2f8a req-fd2e0629-d371-4d69-913e-137f47772893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ec74cda-74e2-4998-8f9a-942e980313c3", "name": "network-vif-plugged", "status": "completed", "tag": "66b36202-edd4-437d-abc1-1e5c0064323d"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:00:29.418471 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f4a638c1-7911-4558-9ca1-c7b4674e2f8a req-fd2e0629-d371-4d69-913e-137f47772893 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:29.419128 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f4a638c1-7911-4558-9ca1-c7b4674e2f8a req-fd2e0629-d371-4d69-913e-137f47772893 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:29.440428 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-f4a638c1-7911-4558-9ca1-c7b4674e2f8a req-fd2e0629-d371-4d69-913e-137f47772893 service nova] Creating event network-vif-plugged:66b36202-edd4-437d-abc1-1e5c0064323d for instance 4ec74cda-74e2-4998-8f9a-942e980313c3 on n-h2-846435-14 Jul 25 15:00:29.445109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6d47c973-f474-412b-8d70-edc084d4637a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:29.450115 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-f4a638c1-7911-4558-9ca1-c7b4674e2f8a req-fd2e0629-d371-4d69-913e-137f47772893 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053461 Jul 25 15:00:29.454820 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6d47c973-f474-412b-8d70-edc084d4637a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.256728 Jul 25 15:00:29.454996 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2926/6069] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:00:29.456087 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3144/6070] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:29 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:29.478848 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-602ee516-c373-41a3-9431-06c13a819d03 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:29.479837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-602ee516-c373-41a3-9431-06c13a819d03 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:29.487244 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-602ee516-c373-41a3-9431-06c13a819d03 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:29.487995 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-602ee516-c373-41a3-9431-06c13a819d03 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:29.489042 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-602ee516-c373-41a3-9431-06c13a819d03 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:29.489665 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-602ee516-c373-41a3-9431-06c13a819d03 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:29.736408 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-602ee516-c373-41a3-9431-06c13a819d03 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:29.746197 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-602ee516-c373-41a3-9431-06c13a819d03 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.273651 Jul 25 15:00:29.747548 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2927/6071] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:29 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:29.771195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-46d736de-99cd-4a7e-be44-a2e8b32a46c3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:00:29.772036 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-46d736de-99cd-4a7e-be44-a2e8b32a46c3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:29.783074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-46d736de-99cd-4a7e-be44-a2e8b32a46c3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:29.783774 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-46d736de-99cd-4a7e-be44-a2e8b32a46c3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:29.784816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-46d736de-99cd-4a7e-be44-a2e8b32a46c3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:29.785412 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-46d736de-99cd-4a7e-be44-a2e8b32a46c3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:29.811334 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-46d736de-99cd-4a7e-be44-a2e8b32a46c3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Cannot 'unpause' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state active Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-46d736de-99cd-4a7e-be44-a2e8b32a46c3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action HTTP/1.1 Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 15 Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: {"unpause": {}} Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: exception: Cannot 'unpause' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state active Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '34bbd65c-a1e0-4f6c-a775-8c9f847eccec', 'body': {'unpause': {}}} Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec in vm_state active. Cannot unpause while the instance is in this state. Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state active Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:29.813512 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:00:29.822105 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:00:29.822105 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:00:29.822105 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:00:29.822105 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state active Jul 25 15:00:29.822105 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:29.824410 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-46d736de-99cd-4a7e-be44-a2e8b32a46c3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 409 to user: Cannot 'unpause' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state active {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:00:29.825665 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-46d736de-99cd-4a7e-be44-a2e8b32a46c3 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action" status: 409 len: 145 microversion: 2.1 time: 0.060420 Jul 25 15:00:29.827211 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3145/6072] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:00:29 2022] POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action => generated 145 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 15:00:29.836663 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e0181d65-6a27-4e5a-ad34-ca31d9cdce4d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:29.836962 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e0181d65-6a27-4e5a-ad34-ca31d9cdce4d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:29.848905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e0181d65-6a27-4e5a-ad34-ca31d9cdce4d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:29.849663 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e0181d65-6a27-4e5a-ad34-ca31d9cdce4d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:29.850684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e0181d65-6a27-4e5a-ad34-ca31d9cdce4d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:29.851474 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e0181d65-6a27-4e5a-ad34-ca31d9cdce4d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:29.928261 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bfaa3388-53ad-4933-bc18-34eb079778cf tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:29.929043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bfaa3388-53ad-4933-bc18-34eb079778cf tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:29.935530 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bfaa3388-53ad-4933-bc18-34eb079778cf tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:29.936424 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bfaa3388-53ad-4933-bc18-34eb079778cf tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:29.937496 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bfaa3388-53ad-4933-bc18-34eb079778cf tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:29.938145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bfaa3388-53ad-4933-bc18-34eb079778cf tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:30.084572 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bfaa3388-53ad-4933-bc18-34eb079778cf tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:30.094904 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bfaa3388-53ad-4933-bc18-34eb079778cf tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1393 microversion: 2.1 time: 0.170800 Jul 25 15:00:30.095580 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3146/6073] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:29 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1393 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:30.152733 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e0181d65-6a27-4e5a-ad34-ca31d9cdce4d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:30.164070 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e0181d65-6a27-4e5a-ad34-ca31d9cdce4d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.332135 Jul 25 15:00:30.167405 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2928/6074] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:29 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:30.186695 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-054f851d-3cbd-4f46-97d3-4c73746ff9a4 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:30.187316 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-054f851d-3cbd-4f46-97d3-4c73746ff9a4 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:30.201353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-054f851d-3cbd-4f46-97d3-4c73746ff9a4 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:30.201805 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-054f851d-3cbd-4f46-97d3-4c73746ff9a4 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:30.202584 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-054f851d-3cbd-4f46-97d3-4c73746ff9a4 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:30.203010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-054f851d-3cbd-4f46-97d3-4c73746ff9a4 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:30.494713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-054f851d-3cbd-4f46-97d3-4c73746ff9a4 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:30.508609 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-054f851d-3cbd-4f46-97d3-4c73746ff9a4 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.320870 Jul 25 15:00:30.509987 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3147/6075] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:30 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:30.538186 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8250ed64-4500-423d-8224-e7aced4c3b0a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:00:30.538817 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8250ed64-4500-423d-8224-e7aced4c3b0a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 46f20b24-e88b-4757-9e97-68bcb980dfc7] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:30.549652 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-8250ed64-4500-423d-8224-e7aced4c3b0a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Instance 46f20b24-e88b-4757-9e97-68bcb980dfc7 could not be found. Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8250ed64-4500-423d-8224-e7aced4c3b0a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/servers/46f20b24-e88b-4757-9e97-68bcb980dfc7/action HTTP/1.1 Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 18 Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: {"unshelve": null} Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 46f20b24-e88b-4757-9e97-68bcb980dfc7 could not be found. Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '46f20b24-e88b-4757-9e97-68bcb980dfc7', 'body': {'unshelve': None}} Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46f20b24-e88b-4757-9e97-68bcb980dfc7 could not be found. Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46f20b24-e88b-4757-9e97-68bcb980dfc7 could not be found. Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:30.552075 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:30.557312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:00:30.557312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:00:30.557312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:00:30.557312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:00:30.557312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46f20b24-e88b-4757-9e97-68bcb980dfc7 could not be found. Jul 25 15:00:30.557312 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:30.560548 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8250ed64-4500-423d-8224-e7aced4c3b0a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 404 to user: Instance 46f20b24-e88b-4757-9e97-68bcb980dfc7 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:00:30.561827 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8250ed64-4500-423d-8224-e7aced4c3b0a tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers/46f20b24-e88b-4757-9e97-68bcb980dfc7/action" status: 404 len: 111 microversion: 2.1 time: 0.029618 Jul 25 15:00:30.566967 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2929/6076] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:00:30 2022] POST /compute/v2.1/servers/46f20b24-e88b-4757-9e97-68bcb980dfc7/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:00:30.582942 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cdf448f8-a478-4cf5-b51b-e9cf998d644c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:30.584536 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cdf448f8-a478-4cf5-b51b-e9cf998d644c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:30.601587 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cdf448f8-a478-4cf5-b51b-e9cf998d644c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:30.602182 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cdf448f8-a478-4cf5-b51b-e9cf998d644c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:30.604812 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cdf448f8-a478-4cf5-b51b-e9cf998d644c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:30.606066 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cdf448f8-a478-4cf5-b51b-e9cf998d644c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:30.908844 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cdf448f8-a478-4cf5-b51b-e9cf998d644c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:30.917658 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cdf448f8-a478-4cf5-b51b-e9cf998d644c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.349747 Jul 25 15:00:30.918917 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3148/6077] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:30 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:30.942100 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d0003c6d-3b71-45fb-b890-aad47a4cba95 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:30.944231 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d0003c6d-3b71-45fb-b890-aad47a4cba95 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:30.957994 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d0003c6d-3b71-45fb-b890-aad47a4cba95 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:30.958885 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d0003c6d-3b71-45fb-b890-aad47a4cba95 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:30.960014 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d0003c6d-3b71-45fb-b890-aad47a4cba95 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:30.960825 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d0003c6d-3b71-45fb-b890-aad47a4cba95 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:31.117400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d470c27f-3b26-4f73-9622-4ba40685a028 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:31.118611 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d470c27f-3b26-4f73-9622-4ba40685a028 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:31.130995 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d470c27f-3b26-4f73-9622-4ba40685a028 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:31.131452 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d470c27f-3b26-4f73-9622-4ba40685a028 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:31.132270 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d470c27f-3b26-4f73-9622-4ba40685a028 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:31.132700 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d470c27f-3b26-4f73-9622-4ba40685a028 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:31.184081 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d0003c6d-3b71-45fb-b890-aad47a4cba95 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:31.193059 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d0003c6d-3b71-45fb-b890-aad47a4cba95 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.255119 Jul 25 15:00:31.208204 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2930/6078] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:30 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:31.228374 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-59cfe778-b1ba-4122-8b1f-14dc69191920 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:00:31.228910 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-59cfe778-b1ba-4122-8b1f-14dc69191920 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:31.235824 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59cfe778-b1ba-4122-8b1f-14dc69191920 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:31.236294 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59cfe778-b1ba-4122-8b1f-14dc69191920 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:31.237072 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59cfe778-b1ba-4122-8b1f-14dc69191920 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:31.237506 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59cfe778-b1ba-4122-8b1f-14dc69191920 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:31.263169 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-59cfe778-b1ba-4122-8b1f-14dc69191920 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Cannot 'unshelve' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state active Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-59cfe778-b1ba-4122-8b1f-14dc69191920 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action HTTP/1.1 Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 18 Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: {"unshelve": null} Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: exception: Cannot 'unshelve' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state active Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '34bbd65c-a1e0-4f6c-a775-8c9f847eccec', 'body': {'unshelve': None}} Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec in vm_state active. Cannot unshelve while the instance is in this state. Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 15:00:31.264786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state active Jul 25 15:00:31.270242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:31.270242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:00:31.270242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:31.270242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:31.270242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:00:31.270242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:00:31.270242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:00:31.270242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:00:31.270242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state active Jul 25 15:00:31.270242 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:31.272286 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-59cfe778-b1ba-4122-8b1f-14dc69191920 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 409 to user: Cannot 'unshelve' instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec while it is in vm_state active {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:00:31.273151 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-59cfe778-b1ba-4122-8b1f-14dc69191920 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action" status: 409 len: 146 microversion: 2.1 time: 0.055977 Jul 25 15:00:31.273722 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2931/6079] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:00:31 2022] POST /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec/action => generated 146 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 15:00:31.281748 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9ed6a78a-29db-4acd-93f2-9db4ba223c59 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:31.282361 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9ed6a78a-29db-4acd-93f2-9db4ba223c59 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:31.288761 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9ed6a78a-29db-4acd-93f2-9db4ba223c59 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:31.289445 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9ed6a78a-29db-4acd-93f2-9db4ba223c59 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:31.290218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9ed6a78a-29db-4acd-93f2-9db4ba223c59 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:31.290860 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9ed6a78a-29db-4acd-93f2-9db4ba223c59 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:31.367558 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d470c27f-3b26-4f73-9622-4ba40685a028 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:31.379195 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d470c27f-3b26-4f73-9622-4ba40685a028 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1564 microversion: 2.1 time: 0.265560 Jul 25 15:00:31.392430 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3149/6080] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:31 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1564 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:00:31.406928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-462bee2f-f29c-4ddf-9d22-7a3972cde330 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:31.407547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-462bee2f-f29c-4ddf-9d22-7a3972cde330 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:31.417378 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-462bee2f-f29c-4ddf-9d22-7a3972cde330 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:31.417743 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-462bee2f-f29c-4ddf-9d22-7a3972cde330 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:31.423229 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-462bee2f-f29c-4ddf-9d22-7a3972cde330 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:31.427391 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-462bee2f-f29c-4ddf-9d22-7a3972cde330 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:31.505430 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9ed6a78a-29db-4acd-93f2-9db4ba223c59 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:31.516938 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9ed6a78a-29db-4acd-93f2-9db4ba223c59 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.238888 Jul 25 15:00:31.519537 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2932/6081] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:31 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:31.546904 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-208fcd23-eb59-4020-91fd-d08f16fc687f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:31.547825 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-208fcd23-eb59-4020-91fd-d08f16fc687f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:31.561164 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-208fcd23-eb59-4020-91fd-d08f16fc687f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:31.561498 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-208fcd23-eb59-4020-91fd-d08f16fc687f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:31.562515 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-208fcd23-eb59-4020-91fd-d08f16fc687f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:31.562724 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-208fcd23-eb59-4020-91fd-d08f16fc687f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:31.576867 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:00:31.726571 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-462bee2f-f29c-4ddf-9d22-7a3972cde330 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:31.737203 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-462bee2f-f29c-4ddf-9d22-7a3972cde330 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1564 microversion: 2.1 time: 0.334051 Jul 25 15:00:31.755737 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3150/6082] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:31 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1564 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:31.816050 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-208fcd23-eb59-4020-91fd-d08f16fc687f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:31.826228 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-208fcd23-eb59-4020-91fd-d08f16fc687f tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.285363 Jul 25 15:00:31.840468 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2933/6083] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:31 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:00:31.851367 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-190fc5c4-e202-4ff7-b7b1-fa6ca8051b1b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-472522695_updated"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:00:31.854133 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-190fc5c4-e202-4ff7-b7b1-fa6ca8051b1b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: ce152ebe-f5b1-4ae2-aee2-d7c867fe5f0a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:31.861822 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-190fc5c4-e202-4ff7-b7b1-fa6ca8051b1b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Instance ce152ebe-f5b1-4ae2-aee2-d7c867fe5f0a could not be found. Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-190fc5c4-e202-4ff7-b7b1-fa6ca8051b1b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: request: PUT /compute/v2.1/servers/ce152ebe-f5b1-4ae2-aee2-d7c867fe5f0a HTTP/1.1 Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 80 Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-472522695_updated"}} Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance ce152ebe-f5b1-4ae2-aee2-d7c867fe5f0a could not be found. Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'ce152ebe-f5b1-4ae2-aee2-d7c867fe5f0a', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-472522695_updated'}}} Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce152ebe-f5b1-4ae2-aee2-d7c867fe5f0a could not be found. Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 25 15:00:31.863530 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:00:31.868014 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:00:31.868014 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:00:31.868014 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:00:31.868014 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce152ebe-f5b1-4ae2-aee2-d7c867fe5f0a could not be found. Jul 25 15:00:31.868014 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:31.868014 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:00:31.868014 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:31.868014 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:31.868014 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:00:31.868014 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:00:31.868014 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:00:31.868014 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:00:31.868014 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce152ebe-f5b1-4ae2-aee2-d7c867fe5f0a could not be found. Jul 25 15:00:31.868014 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:31.868014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-190fc5c4-e202-4ff7-b7b1-fa6ca8051b1b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 404 to user: Instance ce152ebe-f5b1-4ae2-aee2-d7c867fe5f0a could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:00:31.868014 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-190fc5c4-e202-4ff7-b7b1-fa6ca8051b1b tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "PUT /compute/v2.1/servers/ce152ebe-f5b1-4ae2-aee2-d7c867fe5f0a" status: 404 len: 111 microversion: 2.1 time: 0.017937 Jul 25 15:00:31.875449 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-906a7711-1d09-41db-934c-cbd1afdf7536 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:31.876343 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-906a7711-1d09-41db-934c-cbd1afdf7536 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:31.879842 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3151/6084] 10.222.0.88 () {60 vars in 1256 bytes} [Mon Jul 25 15:00:31 2022] PUT /compute/v2.1/servers/ce152ebe-f5b1-4ae2-aee2-d7c867fe5f0a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:00:31.885899 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-906a7711-1d09-41db-934c-cbd1afdf7536 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:31.886109 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-906a7711-1d09-41db-934c-cbd1afdf7536 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:31.887908 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-906a7711-1d09-41db-934c-cbd1afdf7536 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:31.890392 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-906a7711-1d09-41db-934c-cbd1afdf7536 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:32.089743 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-906a7711-1d09-41db-934c-cbd1afdf7536 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:32.099749 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-906a7711-1d09-41db-934c-cbd1afdf7536 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.229195 Jul 25 15:00:32.101097 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2934/6085] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:31 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:32.124253 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-420f4b52-3491-4bf8-bd37-809e27a40895 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:32.125614 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-420f4b52-3491-4bf8-bd37-809e27a40895 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:32.152370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-420f4b52-3491-4bf8-bd37-809e27a40895 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:32.153280 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-420f4b52-3491-4bf8-bd37-809e27a40895 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:32.154381 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-420f4b52-3491-4bf8-bd37-809e27a40895 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:32.155756 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-420f4b52-3491-4bf8-bd37-809e27a40895 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:32.511108 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-420f4b52-3491-4bf8-bd37-809e27a40895 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:32.522090 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-420f4b52-3491-4bf8-bd37-809e27a40895 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.401754 Jul 25 15:00:32.523477 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3152/6086] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:32 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:32.540529 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-57ad3988-8932-4535-a902-b5d71a6ef5e9 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:00:32.542926 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-57ad3988-8932-4535-a902-b5d71a6ef5e9 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: 5df3428f-90e1-4629-b613-aea056517fe0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:32.543555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b74d91b7-6683-4e57-9318-8f3f7ef264f0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b74d91b7-6683-4e57-9318-8f3f7ef264f0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: request: PUT /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec HTTP/1.1 Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 280 Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '34bbd65c-a1e0-4f6c-a775-8c9f847eccec', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise error Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:32.547400 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:32.554690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:00:32.554690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:00:32.554690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:00:32.554690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:00:32.554690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:00:32.554690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:00:32.554690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 15:00:32.554690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 15:00:32.554690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 15:00:32.554690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 15:00:32.554690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 15:00:32.554690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 15:00:32.554690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 15:00:32.554690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 15:00:32.554690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 15:00:32.554690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:32.554690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:00:32.554690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:32.554690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:32.554690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:00:32.554690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:00:32.554690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 15:00:32.554690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 15:00:32.554690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 15:00:32.554690 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:32.554690 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b74d91b7-6683-4e57-9318-8f3f7ef264f0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:00:32.554690 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b74d91b7-6683-4e57-9318-8f3f7ef264f0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "PUT /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 400 len: 619 microversion: 2.1 time: 0.009648 Jul 25 15:00:32.554690 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3153/6087] 10.222.0.88 () {60 vars in 1257 bytes} [Mon Jul 25 15:00:32 2022] PUT /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 619 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 15:00:32.560251 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57ad3988-8932-4535-a902-b5d71a6ef5e9 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:32.560251 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57ad3988-8932-4535-a902-b5d71a6ef5e9 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:32.560251 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57ad3988-8932-4535-a902-b5d71a6ef5e9 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:32.560251 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57ad3988-8932-4535-a902-b5d71a6ef5e9 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:32.562814 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5c5f93cb-89bb-4fec-a2a3-9e5e4b0f86a1 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:32.565228 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5c5f93cb-89bb-4fec-a2a3-9e5e4b0f86a1 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:32.575852 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c5f93cb-89bb-4fec-a2a3-9e5e4b0f86a1 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:32.590730 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c5f93cb-89bb-4fec-a2a3-9e5e4b0f86a1 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:32.593444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c5f93cb-89bb-4fec-a2a3-9e5e4b0f86a1 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:32.595270 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c5f93cb-89bb-4fec-a2a3-9e5e4b0f86a1 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:32.662492 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-57ad3988-8932-4535-a902-b5d71a6ef5e9 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "POST /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0/action" status: 200 len: 24572 microversion: 2.1 time: 0.136864 Jul 25 15:00:32.663902 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2935/6088] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:00:32 2022] POST /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0/action => generated 24572 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 15:00:33.012139 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5c5f93cb-89bb-4fec-a2a3-9e5e4b0f86a1 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:33.042016 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5c5f93cb-89bb-4fec-a2a3-9e5e4b0f86a1 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.488053 Jul 25 15:00:33.042613 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3154/6089] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:32 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:33.067586 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e13203aa-2c54-40cd-b291-2290b9b578b4 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:33.068528 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e13203aa-2c54-40cd-b291-2290b9b578b4 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:33.081410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e13203aa-2c54-40cd-b291-2290b9b578b4 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:33.082189 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e13203aa-2c54-40cd-b291-2290b9b578b4 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:33.091679 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e13203aa-2c54-40cd-b291-2290b9b578b4 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:33.092876 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e13203aa-2c54-40cd-b291-2290b9b578b4 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:33.330058 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e13203aa-2c54-40cd-b291-2290b9b578b4 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:33.342556 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e13203aa-2c54-40cd-b291-2290b9b578b4 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.279406 Jul 25 15:00:33.343151 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2936/6090] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:33 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:33.362972 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-27bd3272-e82e-4da7-ac11-db97c516e0a0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-27bd3272-e82e-4da7-ac11-db97c516e0a0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: request: PUT /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec HTTP/1.1 Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 24 Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: {"server": {"name": ""}} Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '34bbd65c-a1e0-4f6c-a775-8c9f847eccec', 'body': {'server': {'name': ''}}} Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise error Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi '' Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 15:00:33.366724 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 25 15:00:33.372172 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:33.372172 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:00:33.372172 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:33.372172 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:33.372172 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:00:33.372172 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:00:33.372172 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 15:00:33.372172 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 15:00:33.372172 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 25 15:00:33.372172 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:33.373768 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-27bd3272-e82e-4da7-ac11-db97c516e0a0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:00:33.377230 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-27bd3272-e82e-4da7-ac11-db97c516e0a0 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "PUT /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 400 len: 108 microversion: 2.1 time: 0.018175 Jul 25 15:00:33.378506 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3155/6091] 10.222.0.88 () {60 vars in 1256 bytes} [Mon Jul 25 15:00:33 2022] PUT /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 108 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 15:00:33.387966 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1e37edf9-ff1c-462b-9d27-f609560b4cb6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:33.388596 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1e37edf9-ff1c-462b-9d27-f609560b4cb6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:33.401615 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e37edf9-ff1c-462b-9d27-f609560b4cb6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:33.402064 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e37edf9-ff1c-462b-9d27-f609560b4cb6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:33.402893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e37edf9-ff1c-462b-9d27-f609560b4cb6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:33.403330 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e37edf9-ff1c-462b-9d27-f609560b4cb6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:33.592001 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1e37edf9-ff1c-462b-9d27-f609560b4cb6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:33.601633 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1e37edf9-ff1c-462b-9d27-f609560b4cb6 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1505 microversion: 2.1 time: 0.218246 Jul 25 15:00:33.602605 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2937/6092] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:33 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1505 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:35.754306 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-99b8637e-810b-4047-9ddc-71273dacb621 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:35.755021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-99b8637e-810b-4047-9ddc-71273dacb621 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:35.778295 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-6c0d835d-a2ab-47e5-93f0-450ca25e1504 req-c79317cf-2132-4b60-bcb0-87e61b1ac1f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ec74cda-74e2-4998-8f9a-942e980313c3", "tag": "66b36202-edd4-437d-abc1-1e5c0064323d"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:00:35.785024 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-99b8637e-810b-4047-9ddc-71273dacb621 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:35.787535 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-99b8637e-810b-4047-9ddc-71273dacb621 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:35.789655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-99b8637e-810b-4047-9ddc-71273dacb621 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:35.792660 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-99b8637e-810b-4047-9ddc-71273dacb621 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:35.809042 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-6c0d835d-a2ab-47e5-93f0-450ca25e1504 req-c79317cf-2132-4b60-bcb0-87e61b1ac1f6 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:35.811907 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-6c0d835d-a2ab-47e5-93f0-450ca25e1504 req-c79317cf-2132-4b60-bcb0-87e61b1ac1f6 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:35.844080 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-6c0d835d-a2ab-47e5-93f0-450ca25e1504 req-c79317cf-2132-4b60-bcb0-87e61b1ac1f6 service nova] Creating event network-changed:66b36202-edd4-437d-abc1-1e5c0064323d for instance 4ec74cda-74e2-4998-8f9a-942e980313c3 on n-h2-846435-14 Jul 25 15:00:35.853179 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-6c0d835d-a2ab-47e5-93f0-450ca25e1504 req-c79317cf-2132-4b60-bcb0-87e61b1ac1f6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078910 Jul 25 15:00:35.854427 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2938/6093] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:00:36.278256 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-99b8637e-810b-4047-9ddc-71273dacb621 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:36.286506 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-99b8637e-810b-4047-9ddc-71273dacb621 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1564 microversion: 2.1 time: 0.536779 Jul 25 15:00:36.292768 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3156/6094] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:35 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1564 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:39.343905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2ce275d9-c920-4d65-bad8-1ca669476687 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:39.344523 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2ce275d9-c920-4d65-bad8-1ca669476687 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 667424b9-7b86-4204-9272-afd7ac83ff5e] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:39.352695 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ce275d9-c920-4d65-bad8-1ca669476687 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:39.364459 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ce275d9-c920-4d65-bad8-1ca669476687 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:39.365740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ce275d9-c920-4d65-bad8-1ca669476687 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:39.368077 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ce275d9-c920-4d65-bad8-1ca669476687 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:39.396572 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-2ce275d9-c920-4d65-bad8-1ca669476687 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Instance 667424b9-7b86-4204-9272-afd7ac83ff5e could not be found. Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2ce275d9-c920-4d65-bad8-1ca669476687 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e HTTP/1.1 Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 667424b9-7b86-4204-9272-afd7ac83ff5e could not be found. Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '667424b9-7b86-4204-9272-afd7ac83ff5e'} Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 667424b9-7b86-4204-9272-afd7ac83ff5e could not be found. Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:00:39.404480 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:00:39.409771 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 667424b9-7b86-4204-9272-afd7ac83ff5e could not be found. Jul 25 15:00:39.409771 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:39.409771 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:00:39.409771 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:39.409771 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:39.409771 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:00:39.409771 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:00:39.409771 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:00:39.409771 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:00:39.409771 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 667424b9-7b86-4204-9272-afd7ac83ff5e could not be found. Jul 25 15:00:39.409771 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:39.412847 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2ce275d9-c920-4d65-bad8-1ca669476687 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 404 to user: Instance 667424b9-7b86-4204-9272-afd7ac83ff5e could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:00:39.413783 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2ce275d9-c920-4d65-bad8-1ca669476687 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "DELETE /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e" status: 404 len: 111 microversion: 2.1 time: 0.074888 Jul 25 15:00:39.414377 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2939/6095] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:00:39 2022] DELETE /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:00:39.423305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-14512450-7d67-4497-9990-03fed114e22d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:39.424603 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-14512450-7d67-4497-9990-03fed114e22d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 667424b9-7b86-4204-9272-afd7ac83ff5e] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:39.439191 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-14512450-7d67-4497-9990-03fed114e22d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:39.439684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-14512450-7d67-4497-9990-03fed114e22d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:39.448225 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-14512450-7d67-4497-9990-03fed114e22d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:39.449709 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-14512450-7d67-4497-9990-03fed114e22d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:39.466641 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-14512450-7d67-4497-9990-03fed114e22d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Instance 667424b9-7b86-4204-9272-afd7ac83ff5e could not be found. Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-14512450-7d67-4497-9990-03fed114e22d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e HTTP/1.1 Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 667424b9-7b86-4204-9272-afd7ac83ff5e could not be found. Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '667424b9-7b86-4204-9272-afd7ac83ff5e'} Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 667424b9-7b86-4204-9272-afd7ac83ff5e could not be found. Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 667424b9-7b86-4204-9272-afd7ac83ff5e could not be found. Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:00:39.468919 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:39.475075 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:39.475075 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:00:39.475075 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:00:39.475075 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:00:39.475075 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:00:39.475075 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 667424b9-7b86-4204-9272-afd7ac83ff5e could not be found. Jul 25 15:00:39.475075 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:39.477012 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-14512450-7d67-4497-9990-03fed114e22d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 404 to user: Instance 667424b9-7b86-4204-9272-afd7ac83ff5e could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:00:39.478260 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-14512450-7d67-4497-9990-03fed114e22d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e" status: 404 len: 111 microversion: 2.1 time: 0.059628 Jul 25 15:00:39.479418 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3157/6096] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:39 2022] GET /compute/v2.1/servers/667424b9-7b86-4204-9272-afd7ac83ff5e => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:00:39.489687 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-988de49a-607c-4e30-9324-d9cdeb74fa3d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:39.490524 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-988de49a-607c-4e30-9324-d9cdeb74fa3d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:39.511607 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-988de49a-607c-4e30-9324-d9cdeb74fa3d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:39.512219 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-988de49a-607c-4e30-9324-d9cdeb74fa3d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:39.513124 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-988de49a-607c-4e30-9324-d9cdeb74fa3d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:39.513794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-988de49a-607c-4e30-9324-d9cdeb74fa3d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:39.550369 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-988de49a-607c-4e30-9324-d9cdeb74fa3d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:00:39.666961 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-988de49a-607c-4e30-9324-d9cdeb74fa3d tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "DELETE /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 204 len: 0 microversion: 2.1 time: 0.182794 Jul 25 15:00:39.668585 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2940/6097] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:00:39 2022] DELETE /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 15:00:39.677892 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-11d1cdd0-54e3-4c31-9feb-3cf8b85ad017 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:39.679080 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-11d1cdd0-54e3-4c31-9feb-3cf8b85ad017 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:39.696226 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11d1cdd0-54e3-4c31-9feb-3cf8b85ad017 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:39.697139 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11d1cdd0-54e3-4c31-9feb-3cf8b85ad017 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:39.698995 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11d1cdd0-54e3-4c31-9feb-3cf8b85ad017 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:39.699862 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11d1cdd0-54e3-4c31-9feb-3cf8b85ad017 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:39.968258 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-11d1cdd0-54e3-4c31-9feb-3cf8b85ad017 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:39.984300 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-11d1cdd0-54e3-4c31-9feb-3cf8b85ad017 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1511 microversion: 2.1 time: 0.311053 Jul 25 15:00:39.988784 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3158/6098] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:39 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1511 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:41.007029 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1573a5c6-dff8-4d16-a0a2-c0e5c7864712 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:41.008591 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1573a5c6-dff8-4d16-a0a2-c0e5c7864712 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:41.024283 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1573a5c6-dff8-4d16-a0a2-c0e5c7864712 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:41.025673 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1573a5c6-dff8-4d16-a0a2-c0e5c7864712 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:41.027701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1573a5c6-dff8-4d16-a0a2-c0e5c7864712 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:41.029879 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1573a5c6-dff8-4d16-a0a2-c0e5c7864712 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:41.624475 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1573a5c6-dff8-4d16-a0a2-c0e5c7864712 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:41.638263 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1573a5c6-dff8-4d16-a0a2-c0e5c7864712 tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1511 microversion: 2.1 time: 0.635436 Jul 25 15:00:41.639529 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2941/6099] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:41 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1511 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:42.344746 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-0fe6aca4-3876-4d73-8b14-4d45076dc481 req-095136da-4975-4cfb-9fe5-65202dd44053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34bbd65c-a1e0-4f6c-a775-8c9f847eccec", "name": "network-vif-deleted", "tag": "6bd9c9b1-8f44-48ec-8ace-8bfe7e29920e"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:00:42.362468 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-0fe6aca4-3876-4d73-8b14-4d45076dc481 req-095136da-4975-4cfb-9fe5-65202dd44053 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:42.363235 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-0fe6aca4-3876-4d73-8b14-4d45076dc481 req-095136da-4975-4cfb-9fe5-65202dd44053 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:42.389527 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-0fe6aca4-3876-4d73-8b14-4d45076dc481 req-095136da-4975-4cfb-9fe5-65202dd44053 service nova] Creating event network-vif-deleted:6bd9c9b1-8f44-48ec-8ace-8bfe7e29920e for instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec on n-h1-846435-14 Jul 25 15:00:42.437121 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-0fe6aca4-3876-4d73-8b14-4d45076dc481 req-095136da-4975-4cfb-9fe5-65202dd44053 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103806 Jul 25 15:00:42.438825 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3159/6100] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:00:42.660030 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-24fdde44-c32a-41e5-a2c3-c40db5aabf2c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:42.660941 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-24fdde44-c32a-41e5-a2c3-c40db5aabf2c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:42.670048 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-24fdde44-c32a-41e5-a2c3-c40db5aabf2c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:42.671004 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-24fdde44-c32a-41e5-a2c3-c40db5aabf2c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:42.671987 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-24fdde44-c32a-41e5-a2c3-c40db5aabf2c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:42.672601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-24fdde44-c32a-41e5-a2c3-c40db5aabf2c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:42.710135 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-24fdde44-c32a-41e5-a2c3-c40db5aabf2c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:42.710867 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-24fdde44-c32a-41e5-a2c3-c40db5aabf2c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:42.711763 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-24fdde44-c32a-41e5-a2c3-c40db5aabf2c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lazy-loading 'fault' on Instance uuid 34bbd65c-a1e0-4f6c-a775-8c9f847eccec {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:00:42.779458 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-24fdde44-c32a-41e5-a2c3-c40db5aabf2c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9cb3d7cefcf45b391fb35d61226bbf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b0b15d99804beb844e1dc74f2d5776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:42.787627 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-24fdde44-c32a-41e5-a2c3-c40db5aabf2c tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 200 len: 1306 microversion: 2.1 time: 0.131602 Jul 25 15:00:42.788279 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2942/6101] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:42 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 1306 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:43.809919 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3da03e0e-2cee-4ffd-94bf-bd8ef9c120fb tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:43.811707 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3da03e0e-2cee-4ffd-94bf-bd8ef9c120fb tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] [instance: 34bbd65c-a1e0-4f6c-a775-8c9f847eccec] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:43.819863 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3da03e0e-2cee-4ffd-94bf-bd8ef9c120fb tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:43.820684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3da03e0e-2cee-4ffd-94bf-bd8ef9c120fb tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:43.822109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3da03e0e-2cee-4ffd-94bf-bd8ef9c120fb tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:43.822724 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3da03e0e-2cee-4ffd-94bf-bd8ef9c120fb tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:43.840711 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-3da03e0e-2cee-4ffd-94bf-bd8ef9c120fb tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] HTTP exception thrown: Instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec could not be found. Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3da03e0e-2cee-4ffd-94bf-bd8ef9c120fb tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Request method failure captured: Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec HTTP/1.1 Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q9WSXaX-vCARo7rbIDMl0Ty8n45DE06L-GOddIAPGxmi2rr6K1OwrMvTberDOk0pKe9W_YroJyblwVmq8O3Zx3PN67eupdUE4R_Qt_5TuJNd3psu9FnW-dUTmI2e75snDaLlSwfXy_c8NwVL_FOCcE9XQ-uBdBvA6s0jJjt3XcMFKE Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/27b0b15d99804beb844e1dc74f2d5776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_27b0b15d99804beb844e1dc74f2d5776", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/27b0b15d99804beb844e1dc74f2d5776"}]}] Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 27b0b15d99804beb844e1dc74f2d5776 Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1361041104 Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: a9cb3d7cefcf45b391fb35d61226bbf4 Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersNegativeTestJSON-1361041104-project Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec could not be found. Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '34bbd65c-a1e0-4f6c-a775-8c9f847eccec'} Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec could not be found. Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec could not be found. Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:00:43.842888 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:43.848160 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:43.848160 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:00:43.848160 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:00:43.848160 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:00:43.848160 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:00:43.848160 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec could not be found. Jul 25 15:00:43.848160 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:00:43.849644 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3da03e0e-2cee-4ffd-94bf-bd8ef9c120fb tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] Returning 404 to user: Instance 34bbd65c-a1e0-4f6c-a775-8c9f847eccec could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:00:43.850748 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3da03e0e-2cee-4ffd-94bf-bd8ef9c120fb tempest-ServersNegativeTestJSON-1361041104 tempest-ServersNegativeTestJSON-1361041104-project] 10.222.0.88 "GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec" status: 404 len: 111 microversion: 2.1 time: 0.045366 Jul 25 15:00:43.851551 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3160/6102] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:43 2022] GET /compute/v2.1/servers/34bbd65c-a1e0-4f6c-a775-8c9f847eccec => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 15:00:45.206188 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a9cba9df-ce7f-4c1b-858c-3db1bb8a1681 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:45.206928 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a9cba9df-ce7f-4c1b-858c-3db1bb8a1681 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:45.216217 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a9cba9df-ce7f-4c1b-858c-3db1bb8a1681 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:45.217173 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a9cba9df-ce7f-4c1b-858c-3db1bb8a1681 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:45.218987 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a9cba9df-ce7f-4c1b-858c-3db1bb8a1681 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:45.219647 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a9cba9df-ce7f-4c1b-858c-3db1bb8a1681 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:45.613515 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a9cba9df-ce7f-4c1b-858c-3db1bb8a1681 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:45.622090 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a9cba9df-ce7f-4c1b-858c-3db1bb8a1681 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.419685 Jul 25 15:00:45.623418 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2943/6103] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:45 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:45.649067 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c507c6cb-5cc2-412d-8fc1-5c0a069a6f24 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:45.649697 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c507c6cb-5cc2-412d-8fc1-5c0a069a6f24 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:45.660336 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c507c6cb-5cc2-412d-8fc1-5c0a069a6f24 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:45.660788 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c507c6cb-5cc2-412d-8fc1-5c0a069a6f24 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:45.673968 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c507c6cb-5cc2-412d-8fc1-5c0a069a6f24 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:45.674476 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c507c6cb-5cc2-412d-8fc1-5c0a069a6f24 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:45.985885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c507c6cb-5cc2-412d-8fc1-5c0a069a6f24 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:45.994782 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c507c6cb-5cc2-412d-8fc1-5c0a069a6f24 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.349393 Jul 25 15:00:45.996132 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3161/6104] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:45 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:46.016610 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8cae1408-b9d9-4e95-99a1-276a5529433b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:46.017516 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8cae1408-b9d9-4e95-99a1-276a5529433b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:46.024465 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8cae1408-b9d9-4e95-99a1-276a5529433b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:46.025178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8cae1408-b9d9-4e95-99a1-276a5529433b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:46.026128 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8cae1408-b9d9-4e95-99a1-276a5529433b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:46.026727 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8cae1408-b9d9-4e95-99a1-276a5529433b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:46.543685 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8cae1408-b9d9-4e95-99a1-276a5529433b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:46.555405 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8cae1408-b9d9-4e95-99a1-276a5529433b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.542973 Jul 25 15:00:46.560677 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2944/6105] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:46 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:46.581124 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f63aee4b-f5ac-43a7-8ba5-9ae3d9849e2b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:46.581749 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f63aee4b-f5ac-43a7-8ba5-9ae3d9849e2b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:46.589267 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:00:46.591340 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f63aee4b-f5ac-43a7-8ba5-9ae3d9849e2b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:46.592012 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f63aee4b-f5ac-43a7-8ba5-9ae3d9849e2b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:46.593319 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f63aee4b-f5ac-43a7-8ba5-9ae3d9849e2b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:46.593926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f63aee4b-f5ac-43a7-8ba5-9ae3d9849e2b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:46.874957 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f63aee4b-f5ac-43a7-8ba5-9ae3d9849e2b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:46.884331 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f63aee4b-f5ac-43a7-8ba5-9ae3d9849e2b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.307122 Jul 25 15:00:46.904135 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3162/6106] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:46 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:47.091768 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-780246f8-e7da-49bb-a784-d3769c9df341 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1312233523", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "00285697-02be-4390-bafc-7b88de31480b"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:00:47.183003 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-780246f8-e7da-49bb-a784-d3769c9df341 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] validate_networks() for [('00285697-02be-4390-bafc-7b88de31480b', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:00:48.292554 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-780246f8-e7da-49bb-a784-d3769c9df341 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:00:48.293951 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-780246f8-e7da-49bb-a784-d3769c9df341 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:00:48.294678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-780246f8-e7da-49bb-a784-d3769c9df341 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:00:48.295483 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-780246f8-e7da-49bb-a784-d3769c9df341 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:00:48.296633 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-780246f8-e7da-49bb-a784-d3769c9df341 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:00:48.311362 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-780246f8-e7da-49bb-a784-d3769c9df341 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:48.313708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-780246f8-e7da-49bb-a784-d3769c9df341 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:48.316992 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-780246f8-e7da-49bb-a784-d3769c9df341 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:48.317710 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-780246f8-e7da-49bb-a784-d3769c9df341 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:48.343385 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-780246f8-e7da-49bb-a784-d3769c9df341 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Getting quotas for project 649465d992d749eca5d73d30e61ab62e. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:00:48.351144 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-780246f8-e7da-49bb-a784-d3769c9df341 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Getting quotas for user 72d5f52dd1ae4cf999f7df131b70223c and project 649465d992d749eca5d73d30e61ab62e. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:00:48.367566 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-780246f8-e7da-49bb-a784-d3769c9df341 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:00:48.371349 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-780246f8-e7da-49bb-a784-d3769c9df341 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:00:48.440794 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-780246f8-e7da-49bb-a784-d3769c9df341 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.352814 Jul 25 15:00:48.447803 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2945/6107] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:00:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:00:48.453587 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-65bfdeea-0fc5-478d-88fe-9c74007b819e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:48.454322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-65bfdeea-0fc5-478d-88fe-9c74007b819e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:48.698511 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-65bfdeea-0fc5-478d-88fe-9c74007b819e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:48.710974 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-65bfdeea-0fc5-478d-88fe-9c74007b819e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b" status: 200 len: 1215 microversion: 2.1 time: 0.261836 Jul 25 15:00:48.724170 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3163/6108] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:48 2022] GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b => generated 1215 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:49.733068 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-805240f8-e14d-4000-9550-7a7aaa35a682 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:49.733676 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-805240f8-e14d-4000-9550-7a7aaa35a682 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:49.754466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-805240f8-e14d-4000-9550-7a7aaa35a682 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:49.756398 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-805240f8-e14d-4000-9550-7a7aaa35a682 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:49.757420 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-805240f8-e14d-4000-9550-7a7aaa35a682 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:49.758023 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-805240f8-e14d-4000-9550-7a7aaa35a682 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:49.864149 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-805240f8-e14d-4000-9550-7a7aaa35a682 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:49.876722 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-805240f8-e14d-4000-9550-7a7aaa35a682 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b" status: 200 len: 1267 microversion: 2.1 time: 0.146412 Jul 25 15:00:49.888020 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2946/6109] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:49 2022] GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:50.899039 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-35124f65-8028-4164-9de3-405811637d18 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:50.899679 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-35124f65-8028-4164-9de3-405811637d18 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:50.911063 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35124f65-8028-4164-9de3-405811637d18 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:50.912646 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35124f65-8028-4164-9de3-405811637d18 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:50.923138 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35124f65-8028-4164-9de3-405811637d18 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:50.923301 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35124f65-8028-4164-9de3-405811637d18 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:51.063293 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-35124f65-8028-4164-9de3-405811637d18 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:51.074881 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-35124f65-8028-4164-9de3-405811637d18 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b" status: 200 len: 1273 microversion: 2.1 time: 0.179283 Jul 25 15:00:51.078425 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3164/6110] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:50 2022] GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b => generated 1273 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:51.521788 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6c91fc66-b6ef-4c7e-86ea-1cac4c579d12 tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] Action: 'create', calling method: .version_select at 0x7f46988ad550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-819537548"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:00:52.102355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b0c636a6-fc2f-4293-927c-5599ad022fb3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:52.103025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b0c636a6-fc2f-4293-927c-5599ad022fb3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:52.116372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0c636a6-fc2f-4293-927c-5599ad022fb3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:52.116911 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0c636a6-fc2f-4293-927c-5599ad022fb3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:52.122032 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0c636a6-fc2f-4293-927c-5599ad022fb3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:52.122628 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0c636a6-fc2f-4293-927c-5599ad022fb3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:52.140368 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6c91fc66-b6ef-4c7e-86ea-1cac4c579d12 tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.841271 Jul 25 15:00:52.145620 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2947/6111] 10.222.0.88 () {60 vars in 1155 bytes} [Mon Jul 25 15:00:51 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 846 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 25 15:00:52.157758 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-38bb5416-d476-4dee-bce0-4c50fd782d5c tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] Calling method '.version_select at 0x7f468675a700>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:52.280968 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-38bb5416-d476-4dee-bce0-4c50fd782d5c tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/305576b3-e35e-4210-99ee-95fc6dda6a33" status: 200 len: 344 microversion: 2.1 time: 0.130967 Jul 25 15:00:52.282064 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2948/6112] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Jul 25 15:00:52 2022] GET /compute/v2.1/os-volumes/305576b3-e35e-4210-99ee-95fc6dda6a33 => generated 344 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:00:52.396270 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b0c636a6-fc2f-4293-927c-5599ad022fb3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:52.404955 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b0c636a6-fc2f-4293-927c-5599ad022fb3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b" status: 200 len: 1315 microversion: 2.1 time: 0.307389 Jul 25 15:00:52.405579 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3165/6113] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:52 2022] GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:00:53.294790 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-020cd053-b9eb-480f-ad1f-911e7735523b tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] Calling method '.version_select at 0x7f4686763b80>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:53.412158 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-020cd053-b9eb-480f-ad1f-911e7735523b tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/305576b3-e35e-4210-99ee-95fc6dda6a33" status: 200 len: 344 microversion: 2.1 time: 0.121149 Jul 25 15:00:53.419105 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2949/6114] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Jul 25 15:00:53 2022] GET /compute/v2.1/os-volumes/305576b3-e35e-4210-99ee-95fc6dda6a33 => generated 344 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:00:53.431515 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cb5cbe65-7d8c-465b-8827-590aa0237910 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:53.432764 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cb5cbe65-7d8c-465b-8827-590aa0237910 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:53.451383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb5cbe65-7d8c-465b-8827-590aa0237910 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:53.452031 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb5cbe65-7d8c-465b-8827-590aa0237910 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:53.453000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb5cbe65-7d8c-465b-8827-590aa0237910 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:53.453592 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb5cbe65-7d8c-465b-8827-590aa0237910 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:53.483152 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:00:53.562260 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-1891f53d-37d1-4571-bd3c-e4172587c923 req-e2251abb-2273-4e73-92d9-37867fb19704 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b", "tag": "2097ad1a-8fb6-42db-9f65-5b02443b9e10"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:00:53.567634 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:00:53.601864 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-1891f53d-37d1-4571-bd3c-e4172587c923 req-e2251abb-2273-4e73-92d9-37867fb19704 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:53.602308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-1891f53d-37d1-4571-bd3c-e4172587c923 req-e2251abb-2273-4e73-92d9-37867fb19704 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:53.641050 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-1891f53d-37d1-4571-bd3c-e4172587c923 req-e2251abb-2273-4e73-92d9-37867fb19704 service nova] Creating event network-changed:2097ad1a-8fb6-42db-9f65-5b02443b9e10 for instance e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b on n-h1-846435-14 Jul 25 15:00:53.653622 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-1891f53d-37d1-4571-bd3c-e4172587c923 req-e2251abb-2273-4e73-92d9-37867fb19704 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095452 Jul 25 15:00:53.655330 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2950/6115] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:00:54.336201 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cb5cbe65-7d8c-465b-8827-590aa0237910 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:54.344818 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cb5cbe65-7d8c-465b-8827-590aa0237910 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b" status: 200 len: 1315 microversion: 2.1 time: 0.917249 Jul 25 15:00:54.345410 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3166/6116] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:53 2022] GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b => generated 1315 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:54.429275 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ce1174bc-fefe-4cb7-aea0-0c5f9631baa9 tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] Calling method '.version_select at 0x7f4686608820>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:54.519284 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ce1174bc-fefe-4cb7-aea0-0c5f9631baa9 tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/305576b3-e35e-4210-99ee-95fc6dda6a33" status: 200 len: 345 microversion: 2.1 time: 0.097133 Jul 25 15:00:54.520964 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2951/6117] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Jul 25 15:00:54 2022] GET /compute/v2.1/os-volumes/305576b3-e35e-4210-99ee-95fc6dda6a33 => generated 345 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:00:54.532839 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5e2a7be2-1041-4ee5-a64a-6e5e1842bd34 tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] Action: 'create', calling method: .version_select at 0x7f468601a700>, body: {"snapshot": {"volume_id": "305576b3-e35e-4210-99ee-95fc6dda6a33", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1088627710"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:00:54.788690 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5e2a7be2-1041-4ee5-a64a-6e5e1842bd34 tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] 10.222.0.88 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.259601 Jul 25 15:00:54.789288 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3167/6118] 10.222.0.88 () {60 vars in 1162 bytes} [Mon Jul 25 15:00:54 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:00:54.800780 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b24cb22e-7baf-446e-826f-70d9c04d8c5f tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] Calling method '.version_select at 0x7f46866083a0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:54.864085 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b24cb22e-7baf-446e-826f-70d9c04d8c5f tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/09aa0040-2125-4d12-8894-10a40361504f" status: 200 len: 287 microversion: 2.1 time: 0.067218 Jul 25 15:00:54.876574 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2952/6119] 10.222.0.88 () {58 vars in 1251 bytes} [Mon Jul 25 15:00:54 2022] GET /compute/v2.1/os-snapshots/09aa0040-2125-4d12-8894-10a40361504f => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:00:54.877476 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1283c506-c75b-4989-9f20-5369736bbfb5 tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] Calling method '.version_select at 0x7f4685fb15e0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:54.969588 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1283c506-c75b-4989-9f20-5369736bbfb5 tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.097009 Jul 25 15:00:54.984476 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3168/6120] 10.222.0.88 () {58 vars in 1140 bytes} [Mon Jul 25 15:00:54 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:00:54.984652 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d51bd77b-0f92-46ea-96f0-ac698cda51e5 tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] Calling method '.version_select at 0x7f46866080d0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:55.055181 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d51bd77b-0f92-46ea-96f0-ac698cda51e5 tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/09aa0040-2125-4d12-8894-10a40361504f" status: 200 len: 287 microversion: 2.1 time: 0.077342 Jul 25 15:00:55.055738 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2953/6121] 10.222.0.88 () {58 vars in 1251 bytes} [Mon Jul 25 15:00:54 2022] GET /compute/v2.1/os-snapshots/09aa0040-2125-4d12-8894-10a40361504f => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:00:55.368156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e1a77683-df92-4852-8974-c2294e95d302 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:55.369278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e1a77683-df92-4852-8974-c2294e95d302 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:55.376674 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e1a77683-df92-4852-8974-c2294e95d302 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:55.377294 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e1a77683-df92-4852-8974-c2294e95d302 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:55.378239 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e1a77683-df92-4852-8974-c2294e95d302 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:55.378842 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e1a77683-df92-4852-8974-c2294e95d302 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:55.594491 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e1a77683-df92-4852-8974-c2294e95d302 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:55.605129 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e1a77683-df92-4852-8974-c2294e95d302 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b" status: 200 len: 1315 microversion: 2.1 time: 0.240994 Jul 25 15:00:55.620349 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3169/6122] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:55 2022] GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:56.072618 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-606438d6-a50b-4d95-bf32-4acd37675642 tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] Calling method '.version_select at 0x7f4686701f70>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:56.127336 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-606438d6-a50b-4d95-bf32-4acd37675642 tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/09aa0040-2125-4d12-8894-10a40361504f" status: 200 len: 287 microversion: 2.1 time: 0.062467 Jul 25 15:00:56.132089 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2954/6123] 10.222.0.88 () {58 vars in 1251 bytes} [Mon Jul 25 15:00:56 2022] GET /compute/v2.1/os-snapshots/09aa0040-2125-4d12-8894-10a40361504f => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:00:56.632150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-45ea260f-bd95-41f6-b329-df233f0f4324 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:56.632850 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-45ea260f-bd95-41f6-b329-df233f0f4324 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:56.649575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45ea260f-bd95-41f6-b329-df233f0f4324 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:56.650027 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45ea260f-bd95-41f6-b329-df233f0f4324 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:56.650895 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45ea260f-bd95-41f6-b329-df233f0f4324 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:56.651336 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-45ea260f-bd95-41f6-b329-df233f0f4324 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:56.927363 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-45ea260f-bd95-41f6-b329-df233f0f4324 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:56.936299 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-45ea260f-bd95-41f6-b329-df233f0f4324 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b" status: 200 len: 1315 microversion: 2.1 time: 0.309913 Jul 25 15:00:56.936905 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3170/6124] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:56 2022] GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:57.148626 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fec9df49-2fa5-4d9b-8f3f-40a8d6876acb tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] Calling method '.version_select at 0x7f4686701280>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:57.214653 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fec9df49-2fa5-4d9b-8f3f-40a8d6876acb tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/09aa0040-2125-4d12-8894-10a40361504f" status: 200 len: 288 microversion: 2.1 time: 0.077877 Jul 25 15:00:57.222180 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2955/6125] 10.222.0.88 () {58 vars in 1251 bytes} [Mon Jul 25 15:00:57 2022] GET /compute/v2.1/os-snapshots/09aa0040-2125-4d12-8894-10a40361504f => generated 288 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:00:57.234280 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c16fe4b2-725e-469a-8d94-78bace8f138d tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] Calling method '.version_select at 0x7f468630dca0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:57.351533 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c16fe4b2-725e-469a-8d94-78bace8f138d tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] 10.222.0.88 "DELETE /compute/v2.1/os-snapshots/09aa0040-2125-4d12-8894-10a40361504f" status: 202 len: 0 microversion: 2.1 time: 0.121370 Jul 25 15:00:57.352545 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3171/6126] 10.222.0.88 () {58 vars in 1254 bytes} [Mon Jul 25 15:00:57 2022] DELETE /compute/v2.1/os-snapshots/09aa0040-2125-4d12-8894-10a40361504f => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:00:57.361740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-203cccf5-e764-4c68-9f7b-8f07ea7ce8b5 tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] Calling method '.version_select at 0x7f4686c21ca0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:57.418488 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-203cccf5-e764-4c68-9f7b-8f07ea7ce8b5 tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/09aa0040-2125-4d12-8894-10a40361504f" status: 200 len: 287 microversion: 2.1 time: 0.061396 Jul 25 15:00:57.419723 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2956/6127] 10.222.0.88 () {58 vars in 1251 bytes} [Mon Jul 25 15:00:57 2022] GET /compute/v2.1/os-snapshots/09aa0040-2125-4d12-8894-10a40361504f => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:00:57.957870 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-eba92c9f-9fca-4b43-ba1b-a5ccc725fb0d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:57.959728 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-eba92c9f-9fca-4b43-ba1b-a5ccc725fb0d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:57.971091 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eba92c9f-9fca-4b43-ba1b-a5ccc725fb0d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:57.971674 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eba92c9f-9fca-4b43-ba1b-a5ccc725fb0d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:57.972588 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eba92c9f-9fca-4b43-ba1b-a5ccc725fb0d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:57.973016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eba92c9f-9fca-4b43-ba1b-a5ccc725fb0d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:58.150332 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-eba92c9f-9fca-4b43-ba1b-a5ccc725fb0d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:58.177231 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-eba92c9f-9fca-4b43-ba1b-a5ccc725fb0d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b" status: 200 len: 1315 microversion: 2.1 time: 0.223986 Jul 25 15:00:58.181195 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3172/6128] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:57 2022] GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:58.432900 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0c66f236-f12d-4dba-b6e3-cfc786452482 tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] Calling method '.version_select at 0x7f4686608f70>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:58.441408 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:00:58.443848 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:00:58.496289 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0c66f236-f12d-4dba-b6e3-cfc786452482 tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/09aa0040-2125-4d12-8894-10a40361504f" status: 200 len: 287 microversion: 2.1 time: 0.068878 Jul 25 15:00:58.497253 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2957/6129] 10.222.0.88 () {58 vars in 1251 bytes} [Mon Jul 25 15:00:58 2022] GET /compute/v2.1/os-snapshots/09aa0040-2125-4d12-8894-10a40361504f => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:00:59.201945 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d8190fea-3659-4ee1-9533-865bb04f200d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:59.202478 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d8190fea-3659-4ee1-9533-865bb04f200d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:00:59.204467 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:00:59.211728 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d8190fea-3659-4ee1-9533-865bb04f200d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:59.212402 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d8190fea-3659-4ee1-9533-865bb04f200d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:59.213173 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d8190fea-3659-4ee1-9533-865bb04f200d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:00:59.213773 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d8190fea-3659-4ee1-9533-865bb04f200d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:00:59.394245 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d8190fea-3659-4ee1-9533-865bb04f200d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:00:59.410160 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d8190fea-3659-4ee1-9533-865bb04f200d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b" status: 200 len: 1315 microversion: 2.1 time: 0.211796 Jul 25 15:00:59.411404 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3173/6130] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:00:59 2022] GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:00:59.511355 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dabb7a45-9ce7-4cb1-a96d-ca5778cdb0cf tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] Calling method '.version_select at 0x7f4686738c10>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:59.538546 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-dabb7a45-9ce7-4cb1-a96d-ca5778cdb0cf tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] HTTP exception thrown: Snapshot 09aa0040-2125-4d12-8894-10a40361504f could not be found. Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dabb7a45-9ce7-4cb1-a96d-ca5778cdb0cf tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] Request method failure captured: Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/os-snapshots/09aa0040-2125-4d12-8894-10a40361504f HTTP/1.1 Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rAjerwVK-Ky2x-mf_r9hyxN_KweA4R9GiwuR9A4E7fOZKHjhIOlPQGOGzfP76Kd8RIXR9CQAG0hba1_cTfLM9rHe5bVZr1Z5rjDhEKKSY0DinqVGBeLKUMjBlAlFqmCq2c_ozNXyLjsA2RO5VPfOd1wWQbFLMk7dvW4V7ERpwmfneQ Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: d23de8a2860845efa4a0c2112d217d7d Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1020777797 Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d23de8a2860845efa4a0c2112d217d7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d23de8a2860845efa4a0c2112d217d7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_d23de8a2860845efa4a0c2112d217d7d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/d23de8a2860845efa4a0c2112d217d7d"}]}] Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1020777797 Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: d23de8a2860845efa4a0c2112d217d7d Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1020777797 Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-VolumesSnapshotsTestJSON-1020777797-project Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 4a36eba291ec4b0baa7624542e8697a7 Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1020777797-project Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: exception: Snapshot 09aa0040-2125-4d12-8894-10a40361504f could not be found. Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '09aa0040-2125-4d12-8894-10a40361504f'} Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 09aa0040-2125-4d12-8894-10a40361504f could not be found. (HTTP 404) (Request-ID: req-522f174f-3e9f-45a8-9edc-7a6b2e04e66f) Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 15:00:59.568683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 09aa0040-2125-4d12-8894-10a40361504f could not be found. Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 09aa0040-2125-4d12-8894-10a40361504f could not be found. Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 09aa0040-2125-4d12-8894-10a40361504f could not be found. Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dabb7a45-9ce7-4cb1-a96d-ca5778cdb0cf tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] Returning 404 to user: Snapshot 09aa0040-2125-4d12-8894-10a40361504f could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dabb7a45-9ce7-4cb1-a96d-ca5778cdb0cf tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/09aa0040-2125-4d12-8894-10a40361504f" status: 404 len: 111 microversion: 2.1 time: 0.066720 Jul 25 15:00:59.574664 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2958/6131] 10.222.0.88 () {58 vars in 1251 bytes} [Mon Jul 25 15:00:59 2022] GET /compute/v2.1/os-snapshots/09aa0040-2125-4d12-8894-10a40361504f => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:00:59.580853 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8f3e13b6-f24b-483f-b74e-e69eea5cb17c tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] Calling method '.version_select at 0x7f469890d160>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:59.664214 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8f3e13b6-f24b-483f-b74e-e69eea5cb17c tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/305576b3-e35e-4210-99ee-95fc6dda6a33" status: 202 len: 0 microversion: 2.1 time: 0.087078 Jul 25 15:00:59.664811 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3174/6132] 10.222.0.88 () {58 vars in 1248 bytes} [Mon Jul 25 15:00:59 2022] DELETE /compute/v2.1/os-volumes/305576b3-e35e-4210-99ee-95fc6dda6a33 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:00:59.674048 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0dbf5ac9-28ba-48e1-bd09-cdbe5c48e657 tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] Calling method '.version_select at 0x7f4686701ee0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:00:59.746491 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0dbf5ac9-28ba-48e1-bd09-cdbe5c48e657 tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/305576b3-e35e-4210-99ee-95fc6dda6a33" status: 200 len: 344 microversion: 2.1 time: 0.076686 Jul 25 15:00:59.747772 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2959/6133] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Jul 25 15:00:59 2022] GET /compute/v2.1/os-volumes/305576b3-e35e-4210-99ee-95fc6dda6a33 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:01:00.458868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7d2d1677-2706-487a-9674-c97da8badd14 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:00.461796 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7d2d1677-2706-487a-9674-c97da8badd14 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:00.480081 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d2d1677-2706-487a-9674-c97da8badd14 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:00.481008 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d2d1677-2706-487a-9674-c97da8badd14 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:00.483133 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d2d1677-2706-487a-9674-c97da8badd14 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:00.484575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d2d1677-2706-487a-9674-c97da8badd14 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:00.763958 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7d2d1677-2706-487a-9674-c97da8badd14 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:00.765099 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5c85207b-c26e-407b-90eb-770390691336 tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] Calling method '.version_select at 0x7f4686ba7e50>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:00.777511 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7d2d1677-2706-487a-9674-c97da8badd14 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b" status: 200 len: 1315 microversion: 2.1 time: 0.339609 Jul 25 15:01:00.795477 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3175/6134] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:00 2022] GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:00.830212 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5c85207b-c26e-407b-90eb-770390691336 tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/305576b3-e35e-4210-99ee-95fc6dda6a33" status: 200 len: 344 microversion: 2.1 time: 0.070978 Jul 25 15:01:00.833720 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2960/6135] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Jul 25 15:01:00 2022] GET /compute/v2.1/os-volumes/305576b3-e35e-4210-99ee-95fc6dda6a33 => generated 344 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:01:01.254579 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-fd3242e4-3ac0-46e7-8ce7-cb432bcc4149 req-36d5907e-6f17-4fd6-bbfa-0fe1fd84b8ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b", "name": "network-vif-plugged", "status": "completed", "tag": "2097ad1a-8fb6-42db-9f65-5b02443b9e10"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:01:01.280362 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-fd3242e4-3ac0-46e7-8ce7-cb432bcc4149 req-36d5907e-6f17-4fd6-bbfa-0fe1fd84b8ec service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:01.280797 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-fd3242e4-3ac0-46e7-8ce7-cb432bcc4149 req-36d5907e-6f17-4fd6-bbfa-0fe1fd84b8ec service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:01.293588 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-fd3242e4-3ac0-46e7-8ce7-cb432bcc4149 req-36d5907e-6f17-4fd6-bbfa-0fe1fd84b8ec service nova] Creating event network-vif-plugged:2097ad1a-8fb6-42db-9f65-5b02443b9e10 for instance e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b on n-h1-846435-14 Jul 25 15:01:01.317090 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-fd3242e4-3ac0-46e7-8ce7-cb432bcc4149 req-36d5907e-6f17-4fd6-bbfa-0fe1fd84b8ec service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063691 Jul 25 15:01:01.317999 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3176/6136] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:01:01.804872 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f4c42576-03c8-4103-b201-82dc081875a1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:01.805600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f4c42576-03c8-4103-b201-82dc081875a1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:01.826880 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f4c42576-03c8-4103-b201-82dc081875a1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:01.827335 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f4c42576-03c8-4103-b201-82dc081875a1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:01.828160 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f4c42576-03c8-4103-b201-82dc081875a1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:01.828595 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f4c42576-03c8-4103-b201-82dc081875a1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:01.853232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-58cee2e3-4da5-4255-a750-2fd344300cfd tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] Calling method '.version_select at 0x7f4685fb79d0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:01.893027 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:01:01.966889 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-58cee2e3-4da5-4255-a750-2fd344300cfd tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/305576b3-e35e-4210-99ee-95fc6dda6a33" status: 200 len: 344 microversion: 2.1 time: 0.122531 Jul 25 15:01:01.967463 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3177/6137] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Jul 25 15:01:01 2022] GET /compute/v2.1/os-volumes/305576b3-e35e-4210-99ee-95fc6dda6a33 => generated 344 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:01:02.197068 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f4c42576-03c8-4103-b201-82dc081875a1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:02.215891 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f4c42576-03c8-4103-b201-82dc081875a1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b" status: 200 len: 1315 microversion: 2.1 time: 0.415651 Jul 25 15:01:02.216843 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2961/6138] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:01 2022] GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:02.981903 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-338fa795-83b6-4b77-be7c-a006fabc3584 tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] Calling method '.version_select at 0x7f468600aee0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:03.030783 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-338fa795-83b6-4b77-be7c-a006fabc3584 tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] HTTP exception thrown: Volume 305576b3-e35e-4210-99ee-95fc6dda6a33 could not be found. Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-338fa795-83b6-4b77-be7c-a006fabc3584 tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] Request method failure captured: Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/os-volumes/305576b3-e35e-4210-99ee-95fc6dda6a33 HTTP/1.1 Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3rAjerwVK-Ky2x-mf_r9hyxN_KweA4R9GiwuR9A4E7fOZKHjhIOlPQGOGzfP76Kd8RIXR9CQAG0hba1_cTfLM9rHe5bVZr1Z5rjDhEKKSY0DinqVGBeLKUMjBlAlFqmCq2c_ozNXyLjsA2RO5VPfOd1wWQbFLMk7dvW4V7ERpwmfneQ Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: d23de8a2860845efa4a0c2112d217d7d Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1020777797 Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d23de8a2860845efa4a0c2112d217d7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d23de8a2860845efa4a0c2112d217d7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_d23de8a2860845efa4a0c2112d217d7d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/d23de8a2860845efa4a0c2112d217d7d"}]}] Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1020777797 Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: d23de8a2860845efa4a0c2112d217d7d Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1020777797 Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-VolumesSnapshotsTestJSON-1020777797-project Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 4a36eba291ec4b0baa7624542e8697a7 Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1020777797-project Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: exception: Volume 305576b3-e35e-4210-99ee-95fc6dda6a33 could not be found. Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '305576b3-e35e-4210-99ee-95fc6dda6a33'} Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 305576b3-e35e-4210-99ee-95fc6dda6a33 could not be found. (HTTP 404) (Request-ID: req-882dfcd6-bdeb-4de2-a18c-0fc831067519) Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 15:01:03.033780 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 305576b3-e35e-4210-99ee-95fc6dda6a33 could not be found. Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 305576b3-e35e-4210-99ee-95fc6dda6a33 could not be found. Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 305576b3-e35e-4210-99ee-95fc6dda6a33 could not be found. Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-338fa795-83b6-4b77-be7c-a006fabc3584 tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] Returning 404 to user: Volume 305576b3-e35e-4210-99ee-95fc6dda6a33 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-338fa795-83b6-4b77-be7c-a006fabc3584 tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/305576b3-e35e-4210-99ee-95fc6dda6a33" status: 404 len: 109 microversion: 2.1 time: 0.058301 Jul 25 15:01:03.041612 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3178/6139] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Jul 25 15:01:02 2022] GET /compute/v2.1/os-volumes/305576b3-e35e-4210-99ee-95fc6dda6a33 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:01:03.047435 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-beb63334-852c-4e3b-be43-29a69efc660c tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] Calling method '.version_select at 0x7f46866ded30>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:03.140852 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-beb63334-852c-4e3b-be43-29a69efc660c tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] HTTP exception thrown: Volume 305576b3-e35e-4210-99ee-95fc6dda6a33 could not be found. Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-beb63334-852c-4e3b-be43-29a69efc660c tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] Request method failure captured: Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/os-volumes/305576b3-e35e-4210-99ee-95fc6dda6a33 HTTP/1.1 Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rAjerwVK-Ky2x-mf_r9hyxN_KweA4R9GiwuR9A4E7fOZKHjhIOlPQGOGzfP76Kd8RIXR9CQAG0hba1_cTfLM9rHe5bVZr1Z5rjDhEKKSY0DinqVGBeLKUMjBlAlFqmCq2c_ozNXyLjsA2RO5VPfOd1wWQbFLMk7dvW4V7ERpwmfneQ Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: d23de8a2860845efa4a0c2112d217d7d Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1020777797 Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d23de8a2860845efa4a0c2112d217d7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d23de8a2860845efa4a0c2112d217d7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_d23de8a2860845efa4a0c2112d217d7d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/d23de8a2860845efa4a0c2112d217d7d"}]}] Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1020777797 Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: d23de8a2860845efa4a0c2112d217d7d Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1020777797 Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-VolumesSnapshotsTestJSON-1020777797-project Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 4a36eba291ec4b0baa7624542e8697a7 Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1020777797-project Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: method: Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: exception: Volume 305576b3-e35e-4210-99ee-95fc6dda6a33 could not be found. Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '305576b3-e35e-4210-99ee-95fc6dda6a33'} Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 305576b3-e35e-4210-99ee-95fc6dda6a33 could not be found. (HTTP 404) (Request-ID: req-7a87e7d1-30a5-4624-920c-f3462fa15af0) Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 15:01:03.149868 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 305576b3-e35e-4210-99ee-95fc6dda6a33 could not be found. Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 305576b3-e35e-4210-99ee-95fc6dda6a33 could not be found. Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 305576b3-e35e-4210-99ee-95fc6dda6a33 could not be found. Jul 25 15:01:03.156161 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:01:03.161290 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-beb63334-852c-4e3b-be43-29a69efc660c tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] Returning 404 to user: Volume 305576b3-e35e-4210-99ee-95fc6dda6a33 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:01:03.164430 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-beb63334-852c-4e3b-be43-29a69efc660c tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/305576b3-e35e-4210-99ee-95fc6dda6a33" status: 404 len: 109 microversion: 2.1 time: 0.120206 Jul 25 15:01:03.165124 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2962/6140] 10.222.0.88 () {58 vars in 1248 bytes} [Mon Jul 25 15:01:03 2022] DELETE /compute/v2.1/os-volumes/305576b3-e35e-4210-99ee-95fc6dda6a33 => generated 109 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 15:01:03.173998 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4a5f3a17-14a2-4594-b118-74d9bd1307b6 tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] Calling method '.version_select at 0x7f4686071280>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:03.223007 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-4a5f3a17-14a2-4594-b118-74d9bd1307b6 tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] HTTP exception thrown: Volume 305576b3-e35e-4210-99ee-95fc6dda6a33 could not be found. Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4a5f3a17-14a2-4594-b118-74d9bd1307b6 tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] Request method failure captured: Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/os-volumes/305576b3-e35e-4210-99ee-95fc6dda6a33 HTTP/1.1 Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3rAjerwVK-Ky2x-mf_r9hyxN_KweA4R9GiwuR9A4E7fOZKHjhIOlPQGOGzfP76Kd8RIXR9CQAG0hba1_cTfLM9rHe5bVZr1Z5rjDhEKKSY0DinqVGBeLKUMjBlAlFqmCq2c_ozNXyLjsA2RO5VPfOd1wWQbFLMk7dvW4V7ERpwmfneQ Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: d23de8a2860845efa4a0c2112d217d7d Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1020777797 Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d23de8a2860845efa4a0c2112d217d7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/d23de8a2860845efa4a0c2112d217d7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_d23de8a2860845efa4a0c2112d217d7d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/d23de8a2860845efa4a0c2112d217d7d"}]}] Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1020777797 Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: d23de8a2860845efa4a0c2112d217d7d Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1020777797 Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-VolumesSnapshotsTestJSON-1020777797-project Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 4a36eba291ec4b0baa7624542e8697a7 Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1020777797-project Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: method: Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: exception: Volume 305576b3-e35e-4210-99ee-95fc6dda6a33 could not be found. Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '305576b3-e35e-4210-99ee-95fc6dda6a33'} Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 305576b3-e35e-4210-99ee-95fc6dda6a33 could not be found. (HTTP 404) (Request-ID: req-f854d3ea-ffb0-49f2-93c0-660a5c6f001d) Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 15:01:03.225532 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 305576b3-e35e-4210-99ee-95fc6dda6a33 could not be found. Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 305576b3-e35e-4210-99ee-95fc6dda6a33 could not be found. Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 305576b3-e35e-4210-99ee-95fc6dda6a33 could not be found. Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4a5f3a17-14a2-4594-b118-74d9bd1307b6 tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] Returning 404 to user: Volume 305576b3-e35e-4210-99ee-95fc6dda6a33 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4a5f3a17-14a2-4594-b118-74d9bd1307b6 tempest-VolumesSnapshotsTestJSON-1020777797 tempest-VolumesSnapshotsTestJSON-1020777797-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/305576b3-e35e-4210-99ee-95fc6dda6a33" status: 404 len: 109 microversion: 2.1 time: 0.057565 Jul 25 15:01:03.233895 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3179/6141] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Jul 25 15:01:03 2022] GET /compute/v2.1/os-volumes/305576b3-e35e-4210-99ee-95fc6dda6a33 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:01:03.240637 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-27c98e6a-7bf4-417d-83a3-a6d1965f925d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:03.241065 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-27c98e6a-7bf4-417d-83a3-a6d1965f925d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:03.258854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27c98e6a-7bf4-417d-83a3-a6d1965f925d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:03.261615 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27c98e6a-7bf4-417d-83a3-a6d1965f925d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:03.263399 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27c98e6a-7bf4-417d-83a3-a6d1965f925d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:03.263845 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27c98e6a-7bf4-417d-83a3-a6d1965f925d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:03.626613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-27c98e6a-7bf4-417d-83a3-a6d1965f925d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:03.645011 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-27c98e6a-7bf4-417d-83a3-a6d1965f925d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b" status: 200 len: 1502 microversion: 2.1 time: 0.410527 Jul 25 15:01:03.663957 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2963/6142] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:03 2022] GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b => generated 1502 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:03.674980 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-757d38d4-bfbb-474e-8621-dfaa49108afc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:01:03.675657 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-757d38d4-bfbb-474e-8621-dfaa49108afc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:03.693347 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-757d38d4-bfbb-474e-8621-dfaa49108afc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:03.693807 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-757d38d4-bfbb-474e-8621-dfaa49108afc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:03.694612 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-757d38d4-bfbb-474e-8621-dfaa49108afc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:03.695053 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-757d38d4-bfbb-474e-8621-dfaa49108afc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:04.093513 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.network.security_group_api [None req-757d38d4-bfbb-474e-8621-dfaa49108afc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Removing security group 86780855-5cd7-4d47-81d8-da3031a8e9f1 from port 2097ad1a-8fb6-42db-9f65-5b02443b9e10 Jul 25 15:01:04.953485 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-757d38d4-bfbb-474e-8621-dfaa49108afc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b/action" status: 202 len: 0 microversion: 2.1 time: 1.283346 Jul 25 15:01:04.954617 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3180/6143] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:01:03 2022] POST /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b/action => generated 0 bytes in 1290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:01:04.963144 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a1590bc5-580f-4b10-ba53-1a509e0b1e53 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:04.964509 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a1590bc5-580f-4b10-ba53-1a509e0b1e53 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:04.978799 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a1590bc5-580f-4b10-ba53-1a509e0b1e53 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:04.979263 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a1590bc5-580f-4b10-ba53-1a509e0b1e53 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:04.988550 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a1590bc5-580f-4b10-ba53-1a509e0b1e53 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:04.989014 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a1590bc5-580f-4b10-ba53-1a509e0b1e53 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:05.119480 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-7f5a0353-602f-4589-8f42-0e1298872bc8 req-43abd9b1-d847-4742-be6c-53c56c45d499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b", "tag": "2097ad1a-8fb6-42db-9f65-5b02443b9e10"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:01:05.140548 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-7f5a0353-602f-4589-8f42-0e1298872bc8 req-43abd9b1-d847-4742-be6c-53c56c45d499 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:05.146749 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-7f5a0353-602f-4589-8f42-0e1298872bc8 req-43abd9b1-d847-4742-be6c-53c56c45d499 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:05.171286 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-7f5a0353-602f-4589-8f42-0e1298872bc8 req-43abd9b1-d847-4742-be6c-53c56c45d499 service nova] Creating event network-changed:2097ad1a-8fb6-42db-9f65-5b02443b9e10 for instance e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b on n-h1-846435-14 Jul 25 15:01:05.182962 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-7f5a0353-602f-4589-8f42-0e1298872bc8 req-43abd9b1-d847-4742-be6c-53c56c45d499 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073756 Jul 25 15:01:05.184293 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3181/6144] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:01:05.215311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a1590bc5-580f-4b10-ba53-1a509e0b1e53 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:05.226108 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a1590bc5-580f-4b10-ba53-1a509e0b1e53 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b" status: 200 len: 1460 microversion: 2.1 time: 0.265596 Jul 25 15:01:05.229598 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2964/6145] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:04 2022] GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b => generated 1460 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:05.255865 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f8f92f24-dfa9-4ed0-ac53-ae1563c30b39 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:05.256626 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f8f92f24-dfa9-4ed0-ac53-ae1563c30b39 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:05.274443 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8f92f24-dfa9-4ed0-ac53-ae1563c30b39 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:05.283221 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8f92f24-dfa9-4ed0-ac53-ae1563c30b39 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:05.284965 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8f92f24-dfa9-4ed0-ac53-ae1563c30b39 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:05.288087 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8f92f24-dfa9-4ed0-ac53-ae1563c30b39 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:06.251070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f8f92f24-dfa9-4ed0-ac53-ae1563c30b39 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:06.264475 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f8f92f24-dfa9-4ed0-ac53-ae1563c30b39 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 1.013631 Jul 25 15:01:06.266478 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3182/6146] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:05 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:01:06.291393 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ae89c43a-b603-4969-988b-957211cab287 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:06.293911 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ae89c43a-b603-4969-988b-957211cab287 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:06.313060 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae89c43a-b603-4969-988b-957211cab287 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:06.314066 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae89c43a-b603-4969-988b-957211cab287 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:06.315106 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae89c43a-b603-4969-988b-957211cab287 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:06.315722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae89c43a-b603-4969-988b-957211cab287 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:06.814047 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ae89c43a-b603-4969-988b-957211cab287 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:06.822077 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ae89c43a-b603-4969-988b-957211cab287 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.536240 Jul 25 15:01:06.822985 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2965/6147] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:06 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:06.845446 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bf59eae9-b06b-4cd5-92fb-d19722b4b647 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:06.846013 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bf59eae9-b06b-4cd5-92fb-d19722b4b647 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:06.854398 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bf59eae9-b06b-4cd5-92fb-d19722b4b647 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:06.855123 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bf59eae9-b06b-4cd5-92fb-d19722b4b647 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:06.858424 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bf59eae9-b06b-4cd5-92fb-d19722b4b647 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:06.860007 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bf59eae9-b06b-4cd5-92fb-d19722b4b647 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:07.108801 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bf59eae9-b06b-4cd5-92fb-d19722b4b647 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:07.118129 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bf59eae9-b06b-4cd5-92fb-d19722b4b647 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.277910 Jul 25 15:01:07.118723 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3183/6148] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:06 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:07.138972 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-00d92e40-8a7c-4e28-9d70-5d49a5666a0d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:07.139603 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-00d92e40-8a7c-4e28-9d70-5d49a5666a0d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:07.146671 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00d92e40-8a7c-4e28-9d70-5d49a5666a0d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:07.147470 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00d92e40-8a7c-4e28-9d70-5d49a5666a0d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:07.148506 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00d92e40-8a7c-4e28-9d70-5d49a5666a0d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:07.149588 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00d92e40-8a7c-4e28-9d70-5d49a5666a0d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:07.347600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-00d92e40-8a7c-4e28-9d70-5d49a5666a0d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:07.356546 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-00d92e40-8a7c-4e28-9d70-5d49a5666a0d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.221766 Jul 25 15:01:07.357036 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2966/6149] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:07 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:07.601174 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a42a57d5-fe9d-4724-b9e1-74915f2f2d6e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1534355500", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "00285697-02be-4390-bafc-7b88de31480b"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:01:07.685172 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-a42a57d5-fe9d-4724-b9e1-74915f2f2d6e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] validate_networks() for [('00285697-02be-4390-bafc-7b88de31480b', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:01:08.577379 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-a42a57d5-fe9d-4724-b9e1-74915f2f2d6e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:01:08.577807 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-a42a57d5-fe9d-4724-b9e1-74915f2f2d6e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:01:08.590874 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-a42a57d5-fe9d-4724-b9e1-74915f2f2d6e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:01:08.591321 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-a42a57d5-fe9d-4724-b9e1-74915f2f2d6e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:01:08.591748 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-a42a57d5-fe9d-4724-b9e1-74915f2f2d6e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:01:08.624765 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a42a57d5-fe9d-4724-b9e1-74915f2f2d6e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:08.626447 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a42a57d5-fe9d-4724-b9e1-74915f2f2d6e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:08.628350 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a42a57d5-fe9d-4724-b9e1-74915f2f2d6e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:08.629126 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a42a57d5-fe9d-4724-b9e1-74915f2f2d6e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:08.653031 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-a42a57d5-fe9d-4724-b9e1-74915f2f2d6e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Getting quotas for project 649465d992d749eca5d73d30e61ab62e. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:01:08.660419 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-a42a57d5-fe9d-4724-b9e1-74915f2f2d6e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Getting quotas for user 72d5f52dd1ae4cf999f7df131b70223c and project 649465d992d749eca5d73d30e61ab62e. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:01:08.675934 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a42a57d5-fe9d-4724-b9e1-74915f2f2d6e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:01:08.678406 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a42a57d5-fe9d-4724-b9e1-74915f2f2d6e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:01:08.741207 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a42a57d5-fe9d-4724-b9e1-74915f2f2d6e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.149367 Jul 25 15:01:08.753279 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3184/6150] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:01:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:01:08.754132 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-aaf6a099-af1a-4d80-a4ad-984db3e9ae8a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:08.754763 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-aaf6a099-af1a-4d80-a4ad-984db3e9ae8a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:08.919532 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-aaf6a099-af1a-4d80-a4ad-984db3e9ae8a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:08.932276 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-aaf6a099-af1a-4d80-a4ad-984db3e9ae8a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1215 microversion: 2.1 time: 0.182031 Jul 25 15:01:08.948571 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2967/6151] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:08 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1215 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:09.052880 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e1017f5f-9b3d-48a3-b98a-f6dd26f76a78 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:01:09.058186 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e1017f5f-9b3d-48a3-b98a-f6dd26f76a78 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:09.081946 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e1017f5f-9b3d-48a3-b98a-f6dd26f76a78 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:09.082434 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e1017f5f-9b3d-48a3-b98a-f6dd26f76a78 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:09.084980 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e1017f5f-9b3d-48a3-b98a-f6dd26f76a78 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:09.085659 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e1017f5f-9b3d-48a3-b98a-f6dd26f76a78 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:09.154488 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e1017f5f-9b3d-48a3-b98a-f6dd26f76a78 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "POST /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3/action" status: 200 len: 24573 microversion: 2.1 time: 0.108566 Jul 25 15:01:09.155431 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3185/6152] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:01:09 2022] POST /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3/action => generated 24573 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 15:01:09.954452 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b35e474c-67ea-4b9f-824f-971f1b771610 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:09.955075 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b35e474c-67ea-4b9f-824f-971f1b771610 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:09.965053 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b35e474c-67ea-4b9f-824f-971f1b771610 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:09.967297 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b35e474c-67ea-4b9f-824f-971f1b771610 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:09.968420 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b35e474c-67ea-4b9f-824f-971f1b771610 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:09.969120 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b35e474c-67ea-4b9f-824f-971f1b771610 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:10.084485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b35e474c-67ea-4b9f-824f-971f1b771610 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:10.107271 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b35e474c-67ea-4b9f-824f-971f1b771610 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1275 microversion: 2.1 time: 0.156848 Jul 25 15:01:10.108324 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2968/6153] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:09 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1275 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:11.131683 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-68918710-1b4b-4f80-abee-5e1b5d12e5d1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:11.133028 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-68918710-1b4b-4f80-abee-5e1b5d12e5d1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:11.145222 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68918710-1b4b-4f80-abee-5e1b5d12e5d1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:11.145673 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68918710-1b4b-4f80-abee-5e1b5d12e5d1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:11.147847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68918710-1b4b-4f80-abee-5e1b5d12e5d1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:11.149104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68918710-1b4b-4f80-abee-5e1b5d12e5d1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:11.303514 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-68918710-1b4b-4f80-abee-5e1b5d12e5d1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:11.312829 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-68918710-1b4b-4f80-abee-5e1b5d12e5d1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1273 microversion: 2.1 time: 0.184838 Jul 25 15:01:11.328655 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3186/6154] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:11 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1273 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:12.335701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ca60f47b-0797-436a-8881-3303fcc8eb00 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:12.336364 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ca60f47b-0797-436a-8881-3303fcc8eb00 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:12.347746 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ca60f47b-0797-436a-8881-3303fcc8eb00 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:12.348527 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ca60f47b-0797-436a-8881-3303fcc8eb00 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:12.350613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ca60f47b-0797-436a-8881-3303fcc8eb00 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:12.351557 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ca60f47b-0797-436a-8881-3303fcc8eb00 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:12.617426 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-c097dcdd-44aa-45d4-a417-78e1da1e0f52 req-f3394bb0-b7ad-484d-a236-722478db2941 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c", "tag": "a4966c7a-95a3-4d55-9f1b-bb3b5ede444a"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:01:12.646867 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c097dcdd-44aa-45d4-a417-78e1da1e0f52 req-f3394bb0-b7ad-484d-a236-722478db2941 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:12.653507 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c097dcdd-44aa-45d4-a417-78e1da1e0f52 req-f3394bb0-b7ad-484d-a236-722478db2941 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:12.690356 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-c097dcdd-44aa-45d4-a417-78e1da1e0f52 req-f3394bb0-b7ad-484d-a236-722478db2941 service nova] Creating event network-changed:a4966c7a-95a3-4d55-9f1b-bb3b5ede444a for instance cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c on n-h2-846435-14 Jul 25 15:01:12.712584 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-c097dcdd-44aa-45d4-a417-78e1da1e0f52 req-f3394bb0-b7ad-484d-a236-722478db2941 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099390 Jul 25 15:01:12.716522 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3187/6155] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:01:12.944114 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ca60f47b-0797-436a-8881-3303fcc8eb00 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:12.958296 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ca60f47b-0797-436a-8881-3303fcc8eb00 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1315 microversion: 2.1 time: 0.625832 Jul 25 15:01:12.970490 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2969/6156] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:12 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1315 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:13.981693 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a052004c-39ab-4c65-8244-ba0cf39448e0 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:13.983118 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a052004c-39ab-4c65-8244-ba0cf39448e0 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:13.991505 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a052004c-39ab-4c65-8244-ba0cf39448e0 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:13.992126 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a052004c-39ab-4c65-8244-ba0cf39448e0 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:13.993948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a052004c-39ab-4c65-8244-ba0cf39448e0 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:13.994624 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a052004c-39ab-4c65-8244-ba0cf39448e0 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:14.270680 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a052004c-39ab-4c65-8244-ba0cf39448e0 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:14.285237 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a052004c-39ab-4c65-8244-ba0cf39448e0 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1315 microversion: 2.1 time: 0.308388 Jul 25 15:01:14.287320 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3188/6157] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:13 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:15.313029 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b5a30680-3197-459f-abb5-07c992205a5d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:15.314420 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b5a30680-3197-459f-abb5-07c992205a5d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:15.324687 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b5a30680-3197-459f-abb5-07c992205a5d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:15.325518 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b5a30680-3197-459f-abb5-07c992205a5d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:15.327208 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b5a30680-3197-459f-abb5-07c992205a5d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:15.328334 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b5a30680-3197-459f-abb5-07c992205a5d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:15.764694 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b5a30680-3197-459f-abb5-07c992205a5d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:15.776613 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b5a30680-3197-459f-abb5-07c992205a5d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1315 microversion: 2.1 time: 0.469424 Jul 25 15:01:15.812378 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2970/6158] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:15 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1315 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:16.806662 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-844a3263-4f10-4f98-80db-34928fee40e2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:16.808618 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-844a3263-4f10-4f98-80db-34928fee40e2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:16.818326 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:01:16.824913 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-844a3263-4f10-4f98-80db-34928fee40e2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:16.825637 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-844a3263-4f10-4f98-80db-34928fee40e2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:16.826516 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-844a3263-4f10-4f98-80db-34928fee40e2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:16.827022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-844a3263-4f10-4f98-80db-34928fee40e2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:17.408427 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-844a3263-4f10-4f98-80db-34928fee40e2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:17.437039 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-844a3263-4f10-4f98-80db-34928fee40e2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1315 microversion: 2.1 time: 0.642038 Jul 25 15:01:17.437676 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3189/6159] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:16 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1315 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:17.585751 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-871e498d-0d69-4eb3-8ef8-3e036beb326b tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Action: 'create', calling method: .version_select at 0x7f4686738d30>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-729510145", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZz3P0AKRuFtuHYbElZn1nOaTDdAPeYJwFKALXcGEt7KpR/MS43sWd9k8N+nGDTgVLAjZ6vHUNh9mjom1Gjn5daA6YT954oguotZaLjtVx2D4/j7bTjY1fC+mMCbGGJlA=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:01:17.622606 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-871e498d-0d69-4eb3-8ef8-3e036beb326b tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Getting quotas for project 3a1220781eb4456d9afaca1ebec42203. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:01:17.636077 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-871e498d-0d69-4eb3-8ef8-3e036beb326b tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Getting quotas for user dd3fdf21e7be4de2817a73d402a34c56 and project 3a1220781eb4456d9afaca1ebec42203. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:01:17.708797 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-871e498d-0d69-4eb3-8ef8-3e036beb326b tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.124978 Jul 25 15:01:17.709734 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2971/6160] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 15:01:17 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:01:18.466022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-de7fc9fb-399f-4597-8814-78b3d101dfd9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:18.466756 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-de7fc9fb-399f-4597-8814-78b3d101dfd9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:18.476565 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-de7fc9fb-399f-4597-8814-78b3d101dfd9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:18.476948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-de7fc9fb-399f-4597-8814-78b3d101dfd9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:18.477745 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-de7fc9fb-399f-4597-8814-78b3d101dfd9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:18.479196 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-de7fc9fb-399f-4597-8814-78b3d101dfd9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:18.643318 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:01:18.670035 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:01:18.905986 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-de7fc9fb-399f-4597-8814-78b3d101dfd9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:18.916487 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-de7fc9fb-399f-4597-8814-78b3d101dfd9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1315 microversion: 2.1 time: 0.462381 Jul 25 15:01:18.917521 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3190/6161] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:18 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1315 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:19.704441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-558a46fc-f359-4aa0-9c56-252207a37536 req-984f3b57-63d5-4dbe-9901-de990c26654f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c", "name": "network-vif-plugged", "status": "completed", "tag": "a4966c7a-95a3-4d55-9f1b-bb3b5ede444a"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:01:19.733399 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-558a46fc-f359-4aa0-9c56-252207a37536 req-984f3b57-63d5-4dbe-9901-de990c26654f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:19.733866 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-558a46fc-f359-4aa0-9c56-252207a37536 req-984f3b57-63d5-4dbe-9901-de990c26654f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:19.767819 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-558a46fc-f359-4aa0-9c56-252207a37536 req-984f3b57-63d5-4dbe-9901-de990c26654f service nova] Creating event network-vif-plugged:a4966c7a-95a3-4d55-9f1b-bb3b5ede444a for instance cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c on n-h2-846435-14 Jul 25 15:01:19.773874 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-558a46fc-f359-4aa0-9c56-252207a37536 req-984f3b57-63d5-4dbe-9901-de990c26654f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074425 Jul 25 15:01:19.778662 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2972/6162] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:01:19.937856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6b7b2899-11b3-44b0-a917-5513bc39201f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:19.939119 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6b7b2899-11b3-44b0-a917-5513bc39201f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:19.963505 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6b7b2899-11b3-44b0-a917-5513bc39201f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:19.964008 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6b7b2899-11b3-44b0-a917-5513bc39201f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:19.967709 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6b7b2899-11b3-44b0-a917-5513bc39201f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:19.969317 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6b7b2899-11b3-44b0-a917-5513bc39201f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:20.097662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6b4f4405-d3a2-4b6b-885b-0da8342bd2d3 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1931475528", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "35986779-9c1b-40c0-9d53-27a785bb4a86"}], "key_name": "tempest-TestNetworkBasicOps-729510145", "security_groups": [{"name": "tempest-secgroup-smoke-2008870308"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:01:20.343935 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6b7b2899-11b3-44b0-a917-5513bc39201f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:20.347613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-6b4f4405-d3a2-4b6b-885b-0da8342bd2d3 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] validate_networks() for [('35986779-9c1b-40c0-9d53-27a785bb4a86', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:01:20.358011 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6b7b2899-11b3-44b0-a917-5513bc39201f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1315 microversion: 2.1 time: 0.424210 Jul 25 15:01:20.361423 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3191/6163] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:19 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1315 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:21.384918 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2a515e8f-315c-46eb-9406-2a6dc3457820 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:21.386688 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2a515e8f-315c-46eb-9406-2a6dc3457820 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:21.401822 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2a515e8f-315c-46eb-9406-2a6dc3457820 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:21.402290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2a515e8f-315c-46eb-9406-2a6dc3457820 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:21.403137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2a515e8f-315c-46eb-9406-2a6dc3457820 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:21.403571 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2a515e8f-315c-46eb-9406-2a6dc3457820 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:21.837717 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-6b4f4405-d3a2-4b6b-885b-0da8342bd2d3 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:01:21.839028 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-6b4f4405-d3a2-4b6b-885b-0da8342bd2d3 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:01:21.839906 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-6b4f4405-d3a2-4b6b-885b-0da8342bd2d3 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:01:21.840605 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-6b4f4405-d3a2-4b6b-885b-0da8342bd2d3 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:01:21.841195 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-6b4f4405-d3a2-4b6b-885b-0da8342bd2d3 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:01:21.871766 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6b4f4405-d3a2-4b6b-885b-0da8342bd2d3 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:21.873108 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6b4f4405-d3a2-4b6b-885b-0da8342bd2d3 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:21.875805 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6b4f4405-d3a2-4b6b-885b-0da8342bd2d3 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:21.878632 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6b4f4405-d3a2-4b6b-885b-0da8342bd2d3 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:21.890854 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2a515e8f-315c-46eb-9406-2a6dc3457820 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:21.903537 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2a515e8f-315c-46eb-9406-2a6dc3457820 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1315 microversion: 2.1 time: 0.523295 Jul 25 15:01:21.904994 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3192/6164] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:21 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1315 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:21.936428 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-6b4f4405-d3a2-4b6b-885b-0da8342bd2d3 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Getting quotas for project 3a1220781eb4456d9afaca1ebec42203. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:01:21.951763 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-6b4f4405-d3a2-4b6b-885b-0da8342bd2d3 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Getting quotas for user dd3fdf21e7be4de2817a73d402a34c56 and project 3a1220781eb4456d9afaca1ebec42203. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:01:21.989925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6b4f4405-d3a2-4b6b-885b-0da8342bd2d3 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:01:21.994017 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6b4f4405-d3a2-4b6b-885b-0da8342bd2d3 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: eb578778-5fa3-4449-9a17-8cab83ea2646] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:01:22.133058 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6b4f4405-d3a2-4b6b-885b-0da8342bd2d3 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.039772 Jul 25 15:01:22.138485 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2973/6165] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:01:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 2047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 15:01:22.149675 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4a490df3-c0d1-458c-9f28-78889e752a4f tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:22.157219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4a490df3-c0d1-458c-9f28-78889e752a4f tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: eb578778-5fa3-4449-9a17-8cab83ea2646] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:22.300679 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4a490df3-c0d1-458c-9f28-78889e752a4f tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:22.316804 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4a490df3-c0d1-458c-9f28-78889e752a4f tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646" status: 200 len: 1248 microversion: 2.1 time: 0.171104 Jul 25 15:01:22.318375 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3193/6166] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:22 2022] GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646 => generated 1248 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:22.935648 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2a410330-532f-41db-90ec-710fad8eca20 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:22.936438 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2a410330-532f-41db-90ec-710fad8eca20 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:22.956222 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a410330-532f-41db-90ec-710fad8eca20 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:22.956751 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a410330-532f-41db-90ec-710fad8eca20 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:22.957770 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a410330-532f-41db-90ec-710fad8eca20 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:22.958240 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a410330-532f-41db-90ec-710fad8eca20 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:23.223471 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2a410330-532f-41db-90ec-710fad8eca20 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:23.232968 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2a410330-532f-41db-90ec-710fad8eca20 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1502 microversion: 2.1 time: 0.311249 Jul 25 15:01:23.244751 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2974/6167] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:22 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1502 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:23.269584 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4a158577-6b4d-4281-b0ed-513c74a3be3b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:01:23.270321 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4a158577-6b4d-4281-b0ed-513c74a3be3b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:23.295701 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4a158577-6b4d-4281-b0ed-513c74a3be3b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:23.296230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4a158577-6b4d-4281-b0ed-513c74a3be3b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:23.303639 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4a158577-6b4d-4281-b0ed-513c74a3be3b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:23.303879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4a158577-6b4d-4281-b0ed-513c74a3be3b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:23.339181 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2ce52d33-b690-416d-a543-fc96eeb0a696 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:23.339996 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2ce52d33-b690-416d-a543-fc96eeb0a696 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: eb578778-5fa3-4449-9a17-8cab83ea2646] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:23.355343 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=100 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:01:23.364878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ce52d33-b690-416d-a543-fc96eeb0a696 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:23.369722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ce52d33-b690-416d-a543-fc96eeb0a696 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:23.372640 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ce52d33-b690-416d-a543-fc96eeb0a696 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:23.376336 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ce52d33-b690-416d-a543-fc96eeb0a696 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:23.484336 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4a158577-6b4d-4281-b0ed-513c74a3be3b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c/action" status: 202 len: 0 microversion: 2.1 time: 0.216560 Jul 25 15:01:23.486851 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3194/6168] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:01:23 2022] POST /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:01:23.499316 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2ce52d33-b690-416d-a543-fc96eeb0a696 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:23.507198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-94e59fb5-af9d-4a93-a128-49a604657794 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:23.508432 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-94e59fb5-af9d-4a93-a128-49a604657794 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:23.516016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94e59fb5-af9d-4a93-a128-49a604657794 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:23.516934 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94e59fb5-af9d-4a93-a128-49a604657794 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:23.518016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94e59fb5-af9d-4a93-a128-49a604657794 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:23.518688 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94e59fb5-af9d-4a93-a128-49a604657794 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:23.535727 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2ce52d33-b690-416d-a543-fc96eeb0a696 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646" status: 200 len: 1300 microversion: 2.1 time: 0.190591 Jul 25 15:01:23.538601 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2975/6169] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:23 2022] GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646 => generated 1300 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:23.898260 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-94e59fb5-af9d-4a93-a128-49a604657794 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:23.918610 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-94e59fb5-af9d-4a93-a128-49a604657794 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1507 microversion: 2.1 time: 0.427448 Jul 25 15:01:23.932341 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3195/6170] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:23 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1507 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:24.561017 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bbff0a60-2bca-46df-bafb-993c1c0ffe7f tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:24.562598 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bbff0a60-2bca-46df-bafb-993c1c0ffe7f tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: eb578778-5fa3-4449-9a17-8cab83ea2646] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:24.575803 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:01:24.587296 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bbff0a60-2bca-46df-bafb-993c1c0ffe7f tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:24.587756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bbff0a60-2bca-46df-bafb-993c1c0ffe7f tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:24.588604 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bbff0a60-2bca-46df-bafb-993c1c0ffe7f tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:24.589070 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bbff0a60-2bca-46df-bafb-993c1c0ffe7f tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:24.877381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bbff0a60-2bca-46df-bafb-993c1c0ffe7f tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:24.886437 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bbff0a60-2bca-46df-bafb-993c1c0ffe7f tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646" status: 200 len: 1306 microversion: 2.1 time: 0.330590 Jul 25 15:01:24.887570 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2976/6171] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:24 2022] GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646 => generated 1306 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:24.941248 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a4f6fa52-9f16-48f1-b804-30864f5eb9c3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:24.941882 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a4f6fa52-9f16-48f1-b804-30864f5eb9c3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:24.952215 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4f6fa52-9f16-48f1-b804-30864f5eb9c3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:24.952912 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4f6fa52-9f16-48f1-b804-30864f5eb9c3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:24.953910 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4f6fa52-9f16-48f1-b804-30864f5eb9c3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:24.955174 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4f6fa52-9f16-48f1-b804-30864f5eb9c3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:25.395429 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a4f6fa52-9f16-48f1-b804-30864f5eb9c3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:25.408608 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a4f6fa52-9f16-48f1-b804-30864f5eb9c3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1487 microversion: 2.1 time: 0.468958 Jul 25 15:01:25.424444 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3196/6172] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:24 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1487 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:25.439168 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0b6506aa-9ba9-466c-b759-9362cb8a3a7d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:01:25.439953 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0b6506aa-9ba9-466c-b759-9362cb8a3a7d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:25.460986 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b6506aa-9ba9-466c-b759-9362cb8a3a7d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:25.461890 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b6506aa-9ba9-466c-b759-9362cb8a3a7d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:25.462912 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b6506aa-9ba9-466c-b759-9362cb8a3a7d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:25.463732 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b6506aa-9ba9-466c-b759-9362cb8a3a7d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:25.508241 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-0b6506aa-9ba9-466c-b759-9362cb8a3a7d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lazy-loading 'flavor' on Instance uuid cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:01:25.840598 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0b6506aa-9ba9-466c-b759-9362cb8a3a7d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c/action" status: 202 len: 0 microversion: 2.1 time: 0.414169 Jul 25 15:01:25.842188 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2977/6173] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:01:25 2022] POST /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 15:01:25.852733 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f63bbc81-74e8-43b9-9508-831a55ffdba8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:25.853568 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f63bbc81-74e8-43b9-9508-831a55ffdba8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:25.860653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f63bbc81-74e8-43b9-9508-831a55ffdba8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:25.861965 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f63bbc81-74e8-43b9-9508-831a55ffdba8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:25.863347 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f63bbc81-74e8-43b9-9508-831a55ffdba8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:25.863950 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f63bbc81-74e8-43b9-9508-831a55ffdba8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:25.912648 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-04d49ca5-2a9e-48f3-9cb1-1eacfff3bb56 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:25.913670 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-04d49ca5-2a9e-48f3-9cb1-1eacfff3bb56 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: eb578778-5fa3-4449-9a17-8cab83ea2646] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:25.923965 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-04d49ca5-2a9e-48f3-9cb1-1eacfff3bb56 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:25.928661 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-04d49ca5-2a9e-48f3-9cb1-1eacfff3bb56 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:25.930250 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-04d49ca5-2a9e-48f3-9cb1-1eacfff3bb56 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:25.935694 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-04d49ca5-2a9e-48f3-9cb1-1eacfff3bb56 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:26.235936 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-04d49ca5-2a9e-48f3-9cb1-1eacfff3bb56 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:26.249153 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-04d49ca5-2a9e-48f3-9cb1-1eacfff3bb56 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646" status: 200 len: 1374 microversion: 2.1 time: 0.341414 Jul 25 15:01:26.249997 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2978/6174] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:25 2022] GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646 => generated 1374 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:01:26.271498 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f63bbc81-74e8-43b9-9508-831a55ffdba8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:26.288801 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f63bbc81-74e8-43b9-9508-831a55ffdba8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1493 microversion: 2.1 time: 0.441617 Jul 25 15:01:26.302709 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3197/6175] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:25 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1493 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:26.651448 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-ad5815b1-7af1-49cb-b274-326278e911fb req-04c6dd25-b294-401b-97e1-c1cf3f1dcb65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb578778-5fa3-4449-9a17-8cab83ea2646", "tag": "4de351fa-d5c5-4f30-a590-d4f34ba5e989"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:01:26.669215 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ad5815b1-7af1-49cb-b274-326278e911fb req-04c6dd25-b294-401b-97e1-c1cf3f1dcb65 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:26.670202 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ad5815b1-7af1-49cb-b274-326278e911fb req-04c6dd25-b294-401b-97e1-c1cf3f1dcb65 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:26.684020 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-ad5815b1-7af1-49cb-b274-326278e911fb req-04c6dd25-b294-401b-97e1-c1cf3f1dcb65 service nova] Creating event network-changed:4de351fa-d5c5-4f30-a590-d4f34ba5e989 for instance eb578778-5fa3-4449-9a17-8cab83ea2646 on n-h1-846435-14 Jul 25 15:01:26.692285 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-ad5815b1-7af1-49cb-b274-326278e911fb req-04c6dd25-b294-401b-97e1-c1cf3f1dcb65 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.320026 Jul 25 15:01:26.693744 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2979/6176] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:01:27.273465 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4e0772cd-6f13-4a04-ae4a-6041ec206fa1 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:27.277940 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4e0772cd-6f13-4a04-ae4a-6041ec206fa1 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: eb578778-5fa3-4449-9a17-8cab83ea2646] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:27.300914 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e0772cd-6f13-4a04-ae4a-6041ec206fa1 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:27.301682 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e0772cd-6f13-4a04-ae4a-6041ec206fa1 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:27.312175 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-299452a3-ced5-497d-9b0e-7840d436d196 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:27.313889 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-299452a3-ced5-497d-9b0e-7840d436d196 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:27.319113 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e0772cd-6f13-4a04-ae4a-6041ec206fa1 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:27.323485 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4e0772cd-6f13-4a04-ae4a-6041ec206fa1 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:27.342180 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-299452a3-ced5-497d-9b0e-7840d436d196 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:27.343652 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-299452a3-ced5-497d-9b0e-7840d436d196 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:27.345485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-299452a3-ced5-497d-9b0e-7840d436d196 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:27.345940 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-299452a3-ced5-497d-9b0e-7840d436d196 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:27.620323 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4e0772cd-6f13-4a04-ae4a-6041ec206fa1 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:27.630070 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4e0772cd-6f13-4a04-ae4a-6041ec206fa1 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646" status: 200 len: 1374 microversion: 2.1 time: 0.362802 Jul 25 15:01:27.636246 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3198/6177] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:27 2022] GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646 => generated 1374 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:27.722484 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-299452a3-ced5-497d-9b0e-7840d436d196 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:27.729455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:01:27.734891 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-299452a3-ced5-497d-9b0e-7840d436d196 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1514 microversion: 2.1 time: 0.428594 Jul 25 15:01:27.735494 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2980/6178] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:27 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1514 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:28.659884 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1418d088-8582-4b52-b08b-859968ba37a0 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:28.661182 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1418d088-8582-4b52-b08b-859968ba37a0 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: eb578778-5fa3-4449-9a17-8cab83ea2646] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:28.669949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1418d088-8582-4b52-b08b-859968ba37a0 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:28.670915 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1418d088-8582-4b52-b08b-859968ba37a0 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:28.671925 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1418d088-8582-4b52-b08b-859968ba37a0 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:28.672865 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1418d088-8582-4b52-b08b-859968ba37a0 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:28.759776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f1ecbb12-bdf5-4793-b074-5d8b820bdf7b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:28.761284 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f1ecbb12-bdf5-4793-b074-5d8b820bdf7b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:28.784743 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f1ecbb12-bdf5-4793-b074-5d8b820bdf7b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:28.785136 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f1ecbb12-bdf5-4793-b074-5d8b820bdf7b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:28.785980 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f1ecbb12-bdf5-4793-b074-5d8b820bdf7b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:28.786417 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f1ecbb12-bdf5-4793-b074-5d8b820bdf7b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:29.004332 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1418d088-8582-4b52-b08b-859968ba37a0 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:29.018106 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1418d088-8582-4b52-b08b-859968ba37a0 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646" status: 200 len: 1374 microversion: 2.1 time: 0.364865 Jul 25 15:01:29.020302 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3199/6179] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:28 2022] GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646 => generated 1374 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:29.065482 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f1ecbb12-bdf5-4793-b074-5d8b820bdf7b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:29.075151 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f1ecbb12-bdf5-4793-b074-5d8b820bdf7b tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1514 microversion: 2.1 time: 0.322005 Jul 25 15:01:29.075784 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2981/6180] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:28 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1514 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:01:30.041972 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fa06d23d-8764-43e3-8530-7f6a997a3635 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:30.042611 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fa06d23d-8764-43e3-8530-7f6a997a3635 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: eb578778-5fa3-4449-9a17-8cab83ea2646] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:30.066814 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fa06d23d-8764-43e3-8530-7f6a997a3635 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:30.067281 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fa06d23d-8764-43e3-8530-7f6a997a3635 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:30.068099 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fa06d23d-8764-43e3-8530-7f6a997a3635 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:30.068536 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fa06d23d-8764-43e3-8530-7f6a997a3635 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:30.099012 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5e2cafe2-3905-4b2b-99c0-7cd078dc3bd1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:30.099735 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5e2cafe2-3905-4b2b-99c0-7cd078dc3bd1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:30.117967 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5e2cafe2-3905-4b2b-99c0-7cd078dc3bd1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:30.120310 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5e2cafe2-3905-4b2b-99c0-7cd078dc3bd1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:30.122191 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5e2cafe2-3905-4b2b-99c0-7cd078dc3bd1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:30.125241 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5e2cafe2-3905-4b2b-99c0-7cd078dc3bd1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:30.355892 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5e2cafe2-3905-4b2b-99c0-7cd078dc3bd1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:30.367127 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5e2cafe2-3905-4b2b-99c0-7cd078dc3bd1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1514 microversion: 2.1 time: 0.271897 Jul 25 15:01:30.380369 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2982/6181] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:30 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1514 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:30.914587 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fa06d23d-8764-43e3-8530-7f6a997a3635 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:30.934124 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fa06d23d-8764-43e3-8530-7f6a997a3635 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646" status: 200 len: 1374 microversion: 2.1 time: 0.897331 Jul 25 15:01:30.951988 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3200/6182] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:30 2022] GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646 => generated 1374 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:31.416141 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d5089ca4-e8ec-4392-b1a3-132aa6a70bd1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:31.428738 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d5089ca4-e8ec-4392-b1a3-132aa6a70bd1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:31.435779 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d5089ca4-e8ec-4392-b1a3-132aa6a70bd1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:31.436995 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d5089ca4-e8ec-4392-b1a3-132aa6a70bd1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:31.438455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d5089ca4-e8ec-4392-b1a3-132aa6a70bd1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:31.440962 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d5089ca4-e8ec-4392-b1a3-132aa6a70bd1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:31.609563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-9c6547ea-33d4-4f10-8af6-990ca0cfdd81 req-8891f33e-34ff-4a9b-be92-179413711df1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c", "name": "network-vif-plugged", "status": "completed", "tag": "a4966c7a-95a3-4d55-9f1b-bb3b5ede444a"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:01:31.646145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-9c6547ea-33d4-4f10-8af6-990ca0cfdd81 req-8891f33e-34ff-4a9b-be92-179413711df1 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:31.646825 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-9c6547ea-33d4-4f10-8af6-990ca0cfdd81 req-8891f33e-34ff-4a9b-be92-179413711df1 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:31.693095 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-9c6547ea-33d4-4f10-8af6-990ca0cfdd81 req-8891f33e-34ff-4a9b-be92-179413711df1 service nova] Creating event network-vif-plugged:a4966c7a-95a3-4d55-9f1b-bb3b5ede444a for instance cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c on n-h2-846435-14 Jul 25 15:01:31.706773 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-9c6547ea-33d4-4f10-8af6-990ca0cfdd81 req-8891f33e-34ff-4a9b-be92-179413711df1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101040 Jul 25 15:01:31.711665 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3201/6183] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:01:31.721289 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d5089ca4-e8ec-4392-b1a3-132aa6a70bd1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:31.732524 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d5089ca4-e8ec-4392-b1a3-132aa6a70bd1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1514 microversion: 2.1 time: 0.322127 Jul 25 15:01:31.742510 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2983/6184] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:31 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1514 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:31.961638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-59bcda6b-7448-4059-a2aa-878858c208a9 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:31.965459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-59bcda6b-7448-4059-a2aa-878858c208a9 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: eb578778-5fa3-4449-9a17-8cab83ea2646] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:31.988900 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59bcda6b-7448-4059-a2aa-878858c208a9 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:31.989859 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59bcda6b-7448-4059-a2aa-878858c208a9 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:31.990890 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59bcda6b-7448-4059-a2aa-878858c208a9 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:31.994768 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59bcda6b-7448-4059-a2aa-878858c208a9 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:32.304443 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:01:32.693377 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-59bcda6b-7448-4059-a2aa-878858c208a9 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:32.716566 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-59bcda6b-7448-4059-a2aa-878858c208a9 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646" status: 200 len: 1374 microversion: 2.1 time: 0.758235 Jul 25 15:01:32.717109 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3202/6185] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:31 2022] GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646 => generated 1374 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:32.767645 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c3a07688-cfdd-4f5e-aacb-718d721fab70 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:32.770905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c3a07688-cfdd-4f5e-aacb-718d721fab70 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:32.774678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:01:32.775660 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=12 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:01:32.793238 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c3a07688-cfdd-4f5e-aacb-718d721fab70 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:32.797396 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c3a07688-cfdd-4f5e-aacb-718d721fab70 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:32.798443 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c3a07688-cfdd-4f5e-aacb-718d721fab70 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:32.801641 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c3a07688-cfdd-4f5e-aacb-718d721fab70 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:33.115576 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c3a07688-cfdd-4f5e-aacb-718d721fab70 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:33.131642 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c3a07688-cfdd-4f5e-aacb-718d721fab70 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1509 microversion: 2.1 time: 0.362234 Jul 25 15:01:33.137281 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2984/6186] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:32 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1509 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:33.743309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-de906c19-628d-43ad-806b-e9c99f84e225 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:33.744079 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-de906c19-628d-43ad-806b-e9c99f84e225 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: eb578778-5fa3-4449-9a17-8cab83ea2646] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:33.766659 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-de906c19-628d-43ad-806b-e9c99f84e225 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:33.767129 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-de906c19-628d-43ad-806b-e9c99f84e225 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:33.770167 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-de906c19-628d-43ad-806b-e9c99f84e225 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:33.782513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-00c42cb9-c3b6-458b-a9ad-92158b563e5c req-52da88d8-ca7d-4498-9df9-c7e2dba1084a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb578778-5fa3-4449-9a17-8cab83ea2646", "name": "network-vif-plugged", "status": "completed", "tag": "4de351fa-d5c5-4f30-a590-d4f34ba5e989"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:01:33.787045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-de906c19-628d-43ad-806b-e9c99f84e225 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:33.824858 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-00c42cb9-c3b6-458b-a9ad-92158b563e5c req-52da88d8-ca7d-4498-9df9-c7e2dba1084a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:33.826550 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-00c42cb9-c3b6-458b-a9ad-92158b563e5c req-52da88d8-ca7d-4498-9df9-c7e2dba1084a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:33.889065 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-00c42cb9-c3b6-458b-a9ad-92158b563e5c req-52da88d8-ca7d-4498-9df9-c7e2dba1084a service nova] Creating event network-vif-plugged:4de351fa-d5c5-4f30-a590-d4f34ba5e989 for instance eb578778-5fa3-4449-9a17-8cab83ea2646 on n-h1-846435-14 Jul 25 15:01:33.905565 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-00c42cb9-c3b6-458b-a9ad-92158b563e5c req-52da88d8-ca7d-4498-9df9-c7e2dba1084a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130472 Jul 25 15:01:33.906745 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2985/6187] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:01:34.163931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a3fed8b4-8476-4131-968c-4309d8998c3c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:34.165049 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a3fed8b4-8476-4131-968c-4309d8998c3c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:34.194245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a3fed8b4-8476-4131-968c-4309d8998c3c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:34.196271 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a3fed8b4-8476-4131-968c-4309d8998c3c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:34.201129 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a3fed8b4-8476-4131-968c-4309d8998c3c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:34.204360 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a3fed8b4-8476-4131-968c-4309d8998c3c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:34.269366 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-de906c19-628d-43ad-806b-e9c99f84e225 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:34.285637 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-de906c19-628d-43ad-806b-e9c99f84e225 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646" status: 200 len: 1374 microversion: 2.1 time: 0.546602 Jul 25 15:01:34.302555 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3203/6188] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:33 2022] GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646 => generated 1374 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:34.931901 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a3fed8b4-8476-4131-968c-4309d8998c3c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:34.950173 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a3fed8b4-8476-4131-968c-4309d8998c3c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1509 microversion: 2.1 time: 0.793316 Jul 25 15:01:34.968647 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2986/6189] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:34 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1509 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:35.324690 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1af24705-4332-484a-b50c-ef905bf91124 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:35.325341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1af24705-4332-484a-b50c-ef905bf91124 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: eb578778-5fa3-4449-9a17-8cab83ea2646] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:35.364178 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1af24705-4332-484a-b50c-ef905bf91124 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:35.366551 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1af24705-4332-484a-b50c-ef905bf91124 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:35.389631 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1af24705-4332-484a-b50c-ef905bf91124 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:35.392789 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1af24705-4332-484a-b50c-ef905bf91124 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:35.602650 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1af24705-4332-484a-b50c-ef905bf91124 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:35.612410 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1af24705-4332-484a-b50c-ef905bf91124 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646" status: 200 len: 1374 microversion: 2.1 time: 0.303829 Jul 25 15:01:35.631174 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3204/6190] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:35 2022] GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646 => generated 1374 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:35.977860 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d8863ff1-ae34-4663-a488-2d7b2554c97a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:35.981154 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d8863ff1-ae34-4663-a488-2d7b2554c97a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:35.999850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8863ff1-ae34-4663-a488-2d7b2554c97a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:36.002225 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8863ff1-ae34-4663-a488-2d7b2554c97a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:36.004322 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8863ff1-ae34-4663-a488-2d7b2554c97a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:36.007529 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8863ff1-ae34-4663-a488-2d7b2554c97a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:36.646221 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8174f39e-cc50-4f58-952e-e47e01ead09d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:36.646875 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8174f39e-cc50-4f58-952e-e47e01ead09d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: eb578778-5fa3-4449-9a17-8cab83ea2646] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:36.666600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8174f39e-cc50-4f58-952e-e47e01ead09d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:36.667935 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8174f39e-cc50-4f58-952e-e47e01ead09d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:36.671063 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8174f39e-cc50-4f58-952e-e47e01ead09d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:36.675711 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8174f39e-cc50-4f58-952e-e47e01ead09d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:36.911383 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d8863ff1-ae34-4663-a488-2d7b2554c97a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:36.927902 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d8863ff1-ae34-4663-a488-2d7b2554c97a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1509 microversion: 2.1 time: 0.955792 Jul 25 15:01:36.933766 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2987/6191] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:35 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1509 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:37.008209 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8174f39e-cc50-4f58-952e-e47e01ead09d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:37.020285 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8174f39e-cc50-4f58-952e-e47e01ead09d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646" status: 200 len: 1547 microversion: 2.1 time: 0.383942 Jul 25 15:01:37.036602 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3205/6192] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:36 2022] GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646 => generated 1547 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:37.044842 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-66d482c4-4920-4b99-a459-082eb0255979 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:37.044842 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-66d482c4-4920-4b99-a459-082eb0255979 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: eb578778-5fa3-4449-9a17-8cab83ea2646] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:37.052023 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-66d482c4-4920-4b99-a459-082eb0255979 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:37.052505 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-66d482c4-4920-4b99-a459-082eb0255979 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:37.053554 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-66d482c4-4920-4b99-a459-082eb0255979 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:37.054002 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-66d482c4-4920-4b99-a459-082eb0255979 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:37.384482 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-66d482c4-4920-4b99-a459-082eb0255979 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:37.397406 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-66d482c4-4920-4b99-a459-082eb0255979 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646" status: 200 len: 1547 microversion: 2.1 time: 0.358767 Jul 25 15:01:37.404120 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2988/6193] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:37 2022] GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646 => generated 1547 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:37.962478 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9fedd578-249d-4ae2-8406-3f0dfe74c5da tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:37.963878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9fedd578-249d-4ae2-8406-3f0dfe74c5da tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:38.007235 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9fedd578-249d-4ae2-8406-3f0dfe74c5da tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:38.008038 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9fedd578-249d-4ae2-8406-3f0dfe74c5da tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:38.010147 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9fedd578-249d-4ae2-8406-3f0dfe74c5da tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:38.012573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9fedd578-249d-4ae2-8406-3f0dfe74c5da tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:38.392735 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9fedd578-249d-4ae2-8406-3f0dfe74c5da tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:38.409926 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9fedd578-249d-4ae2-8406-3f0dfe74c5da tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1509 microversion: 2.1 time: 0.454529 Jul 25 15:01:38.414084 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3206/6194] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:37 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1509 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:39.451988 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b54cbf36-39c4-4b96-bdba-960c50066ad4 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:39.453068 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b54cbf36-39c4-4b96-bdba-960c50066ad4 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:39.462512 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b54cbf36-39c4-4b96-bdba-960c50066ad4 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:39.463183 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b54cbf36-39c4-4b96-bdba-960c50066ad4 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:39.464823 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b54cbf36-39c4-4b96-bdba-960c50066ad4 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:39.465638 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b54cbf36-39c4-4b96-bdba-960c50066ad4 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:40.456883 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b54cbf36-39c4-4b96-bdba-960c50066ad4 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:40.470632 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b54cbf36-39c4-4b96-bdba-960c50066ad4 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1509 microversion: 2.1 time: 1.024999 Jul 25 15:01:40.472313 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2989/6195] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:39 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1509 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:41.496193 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-30032962-220f-4358-8d2e-f8912f189eb1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:41.496979 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-30032962-220f-4358-8d2e-f8912f189eb1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:41.517612 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-30032962-220f-4358-8d2e-f8912f189eb1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:41.518783 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-30032962-220f-4358-8d2e-f8912f189eb1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:41.519763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-30032962-220f-4358-8d2e-f8912f189eb1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:41.525564 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-30032962-220f-4358-8d2e-f8912f189eb1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:42.145523 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-30032962-220f-4358-8d2e-f8912f189eb1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:42.168517 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-30032962-220f-4358-8d2e-f8912f189eb1 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1509 microversion: 2.1 time: 0.673095 Jul 25 15:01:42.169170 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3207/6196] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:41 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1509 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:43.193211 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ae49244b-6fcc-4a51-8651-b6236044355e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:43.194946 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ae49244b-6fcc-4a51-8651-b6236044355e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:43.207323 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae49244b-6fcc-4a51-8651-b6236044355e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:43.212852 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae49244b-6fcc-4a51-8651-b6236044355e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:43.214164 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae49244b-6fcc-4a51-8651-b6236044355e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:43.216149 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ae49244b-6fcc-4a51-8651-b6236044355e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:43.581065 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ae49244b-6fcc-4a51-8651-b6236044355e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:43.592800 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ae49244b-6fcc-4a51-8651-b6236044355e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1509 microversion: 2.1 time: 0.404362 Jul 25 15:01:43.609015 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2990/6197] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:43 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1509 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:44.638630 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d80690a3-b87c-4d48-84a5-5f175f81ad44 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:44.640190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d80690a3-b87c-4d48-84a5-5f175f81ad44 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:44.659722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d80690a3-b87c-4d48-84a5-5f175f81ad44 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:44.660408 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d80690a3-b87c-4d48-84a5-5f175f81ad44 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:44.661396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d80690a3-b87c-4d48-84a5-5f175f81ad44 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:44.662071 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d80690a3-b87c-4d48-84a5-5f175f81ad44 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:45.566717 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d80690a3-b87c-4d48-84a5-5f175f81ad44 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:45.579563 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d80690a3-b87c-4d48-84a5-5f175f81ad44 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1509 microversion: 2.1 time: 0.942748 Jul 25 15:01:45.583210 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3208/6198] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:44 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1509 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:46.605726 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-08c26db8-26c5-4276-86f0-6403d941540d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:46.609029 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-08c26db8-26c5-4276-86f0-6403d941540d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:46.630868 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08c26db8-26c5-4276-86f0-6403d941540d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:46.636235 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08c26db8-26c5-4276-86f0-6403d941540d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:46.637402 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08c26db8-26c5-4276-86f0-6403d941540d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:46.637930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08c26db8-26c5-4276-86f0-6403d941540d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:47.078359 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-08c26db8-26c5-4276-86f0-6403d941540d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:47.093859 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-08c26db8-26c5-4276-86f0-6403d941540d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1509 microversion: 2.1 time: 0.494231 Jul 25 15:01:47.096793 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2991/6199] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:46 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1509 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:48.122357 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c4659cb8-1ac1-48cf-a2c4-a4425837b5a2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:48.123214 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c4659cb8-1ac1-48cf-a2c4-a4425837b5a2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:48.136516 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=42 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:01:48.139592 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c4659cb8-1ac1-48cf-a2c4-a4425837b5a2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:48.140404 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c4659cb8-1ac1-48cf-a2c4-a4425837b5a2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:48.142133 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c4659cb8-1ac1-48cf-a2c4-a4425837b5a2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:48.142959 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c4659cb8-1ac1-48cf-a2c4-a4425837b5a2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:48.173252 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f30a95d9-292c-4ba8-9a8f-499d6d7b60f9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:01:48.177088 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f30a95d9-292c-4ba8-9a8f-499d6d7b60f9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:48.194916 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f30a95d9-292c-4ba8-9a8f-499d6d7b60f9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:48.199740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f30a95d9-292c-4ba8-9a8f-499d6d7b60f9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:48.201316 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f30a95d9-292c-4ba8-9a8f-499d6d7b60f9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:48.205817 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f30a95d9-292c-4ba8-9a8f-499d6d7b60f9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:48.390464 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c4659cb8-1ac1-48cf-a2c4-a4425837b5a2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:48.399445 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c4659cb8-1ac1-48cf-a2c4-a4425837b5a2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1509 microversion: 2.1 time: 0.281003 Jul 25 15:01:48.400085 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3209/6200] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:48 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1509 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:48.407888 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-f30a95d9-292c-4ba8-9a8f-499d6d7b60f9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:01:48.408348 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-f30a95d9-292c-4ba8-9a8f-499d6d7b60f9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:01:48.408837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-f30a95d9-292c-4ba8-9a8f-499d6d7b60f9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:01:48.409254 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-f30a95d9-292c-4ba8-9a8f-499d6d7b60f9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:01:48.409758 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-f30a95d9-292c-4ba8-9a8f-499d6d7b60f9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:01:48.556811 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f30a95d9-292c-4ba8-9a8f-499d6d7b60f9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:48.576112 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f30a95d9-292c-4ba8-9a8f-499d6d7b60f9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:48.576112 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f30a95d9-292c-4ba8-9a8f-499d6d7b60f9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:48.578069 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f30a95d9-292c-4ba8-9a8f-499d6d7b60f9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:48.579423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f30a95d9-292c-4ba8-9a8f-499d6d7b60f9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:48.672436 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f30a95d9-292c-4ba8-9a8f-499d6d7b60f9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "POST /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3/action" status: 202 len: 1137 microversion: 2.1 time: 0.503894 Jul 25 15:01:48.685070 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2992/6201] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:01:48 2022] POST /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3/action => generated 1137 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 25 15:01:49.150692 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-21607175-2471-4f23-a6bc-ed7b7e9f00a9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:49.152212 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-21607175-2471-4f23-a6bc-ed7b7e9f00a9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:49.170821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-21607175-2471-4f23-a6bc-ed7b7e9f00a9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:49.172034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-21607175-2471-4f23-a6bc-ed7b7e9f00a9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:49.174824 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-21607175-2471-4f23-a6bc-ed7b7e9f00a9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:49.177385 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-21607175-2471-4f23-a6bc-ed7b7e9f00a9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:49.422301 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f4fcf191-6877-45f2-bcbb-699a93a3802a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:49.424538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f4fcf191-6877-45f2-bcbb-699a93a3802a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:49.442281 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f4fcf191-6877-45f2-bcbb-699a93a3802a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:49.443019 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f4fcf191-6877-45f2-bcbb-699a93a3802a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:49.444105 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f4fcf191-6877-45f2-bcbb-699a93a3802a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:49.444840 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f4fcf191-6877-45f2-bcbb-699a93a3802a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:49.619174 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-21607175-2471-4f23-a6bc-ed7b7e9f00a9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:49.622061 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:01:49.632273 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-21607175-2471-4f23-a6bc-ed7b7e9f00a9 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1692 microversion: 2.1 time: 0.941896 Jul 25 15:01:49.639622 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3210/6202] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:48 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1692 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:49.925607 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f4fcf191-6877-45f2-bcbb-699a93a3802a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:49.938597 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f4fcf191-6877-45f2-bcbb-699a93a3802a tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1509 microversion: 2.1 time: 0.521063 Jul 25 15:01:49.941125 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2993/6203] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:49 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1509 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:01:50.664507 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ee2f11ec-4bc9-4421-9c61-9779e65dc653 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:50.665141 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ee2f11ec-4bc9-4421-9c61-9779e65dc653 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:50.679128 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee2f11ec-4bc9-4421-9c61-9779e65dc653 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:50.679577 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee2f11ec-4bc9-4421-9c61-9779e65dc653 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:50.683610 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee2f11ec-4bc9-4421-9c61-9779e65dc653 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:50.684320 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee2f11ec-4bc9-4421-9c61-9779e65dc653 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:50.971962 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-aa854df8-9714-4c74-a0f7-572d29c06286 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:50.973456 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-aa854df8-9714-4c74-a0f7-572d29c06286 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:50.989584 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aa854df8-9714-4c74-a0f7-572d29c06286 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:50.990374 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aa854df8-9714-4c74-a0f7-572d29c06286 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:50.994930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aa854df8-9714-4c74-a0f7-572d29c06286 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:50.995949 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aa854df8-9714-4c74-a0f7-572d29c06286 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:51.059043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ee2f11ec-4bc9-4421-9c61-9779e65dc653 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:51.070661 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ee2f11ec-4bc9-4421-9c61-9779e65dc653 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1692 microversion: 2.1 time: 0.410990 Jul 25 15:01:51.076736 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3211/6204] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:50 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1692 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:51.317722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-aa854df8-9714-4c74-a0f7-572d29c06286 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:51.336452 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-aa854df8-9714-4c74-a0f7-572d29c06286 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1509 microversion: 2.1 time: 0.367317 Jul 25 15:01:51.337958 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2994/6205] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:50 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1509 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:01:52.102285 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1815066a-461e-4009-8667-06f31f047d26 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:52.103125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1815066a-461e-4009-8667-06f31f047d26 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:52.123550 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1815066a-461e-4009-8667-06f31f047d26 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:52.124032 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1815066a-461e-4009-8667-06f31f047d26 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:52.124834 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1815066a-461e-4009-8667-06f31f047d26 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:52.125267 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1815066a-461e-4009-8667-06f31f047d26 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:52.365250 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-be79b5ee-6b62-48ec-9bd8-7c1e181b1a08 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:52.366547 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-be79b5ee-6b62-48ec-9bd8-7c1e181b1a08 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:52.377519 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-be79b5ee-6b62-48ec-9bd8-7c1e181b1a08 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:52.378574 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-be79b5ee-6b62-48ec-9bd8-7c1e181b1a08 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:52.383582 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-be79b5ee-6b62-48ec-9bd8-7c1e181b1a08 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:52.384891 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-be79b5ee-6b62-48ec-9bd8-7c1e181b1a08 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:52.792744 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-be79b5ee-6b62-48ec-9bd8-7c1e181b1a08 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:52.802271 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-be79b5ee-6b62-48ec-9bd8-7c1e181b1a08 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1509 microversion: 2.1 time: 0.442482 Jul 25 15:01:52.803206 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2995/6206] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:52 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1509 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:01:52.885833 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1815066a-461e-4009-8667-06f31f047d26 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:52.905195 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1815066a-461e-4009-8667-06f31f047d26 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1692 microversion: 2.1 time: 0.808580 Jul 25 15:01:52.922191 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3212/6207] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:52 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1692 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:53.823335 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-71afcc64-e9e4-4d95-8af5-83d473d12abc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:53.824011 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-71afcc64-e9e4-4d95-8af5-83d473d12abc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:53.841286 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-71afcc64-e9e4-4d95-8af5-83d473d12abc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:53.841747 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-71afcc64-e9e4-4d95-8af5-83d473d12abc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:53.842558 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-71afcc64-e9e4-4d95-8af5-83d473d12abc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:53.843000 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-71afcc64-e9e4-4d95-8af5-83d473d12abc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:53.868828 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:01:53.930993 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-63c1a844-c8ff-45dd-aa63-961f128d53d3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:53.932310 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-63c1a844-c8ff-45dd-aa63-961f128d53d3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:53.961285 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63c1a844-c8ff-45dd-aa63-961f128d53d3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:53.961879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63c1a844-c8ff-45dd-aa63-961f128d53d3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:53.962764 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63c1a844-c8ff-45dd-aa63-961f128d53d3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:53.963207 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63c1a844-c8ff-45dd-aa63-961f128d53d3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:54.515278 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-71afcc64-e9e4-4d95-8af5-83d473d12abc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:54.566398 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-71afcc64-e9e4-4d95-8af5-83d473d12abc tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1509 microversion: 2.1 time: 0.747003 Jul 25 15:01:54.586075 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2996/6208] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:53 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1509 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:54.790545 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-63c1a844-c8ff-45dd-aa63-961f128d53d3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:54.808045 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-63c1a844-c8ff-45dd-aa63-961f128d53d3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1692 microversion: 2.1 time: 0.881861 Jul 25 15:01:54.814596 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3213/6209] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:53 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1692 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:55.604773 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-407f4d43-bff5-41cb-982f-3c46b9b9f3ff tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:55.605764 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-407f4d43-bff5-41cb-982f-3c46b9b9f3ff tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:55.622315 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=46 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:01:55.634502 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-407f4d43-bff5-41cb-982f-3c46b9b9f3ff tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:55.640672 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-407f4d43-bff5-41cb-982f-3c46b9b9f3ff tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:55.650652 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-407f4d43-bff5-41cb-982f-3c46b9b9f3ff tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:55.651353 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-407f4d43-bff5-41cb-982f-3c46b9b9f3ff tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:55.856328 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c0e729ea-e59c-4c8b-96eb-430045839365 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:55.859323 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c0e729ea-e59c-4c8b-96eb-430045839365 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:55.882776 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c0e729ea-e59c-4c8b-96eb-430045839365 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:55.883586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c0e729ea-e59c-4c8b-96eb-430045839365 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:55.884381 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c0e729ea-e59c-4c8b-96eb-430045839365 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:55.903958 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c0e729ea-e59c-4c8b-96eb-430045839365 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:55.996886 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-407f4d43-bff5-41cb-982f-3c46b9b9f3ff tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:56.009022 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-407f4d43-bff5-41cb-982f-3c46b9b9f3ff tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1506 microversion: 2.1 time: 0.410733 Jul 25 15:01:56.009620 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2997/6210] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:55 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1506 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:56.162442 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c0e729ea-e59c-4c8b-96eb-430045839365 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:56.177869 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c0e729ea-e59c-4c8b-96eb-430045839365 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1692 microversion: 2.1 time: 0.325752 Jul 25 15:01:56.179676 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3214/6211] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:55 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1692 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:57.046744 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-eeb0bb81-2550-4658-9c35-0a9cedbaaf44 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:57.048779 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-eeb0bb81-2550-4658-9c35-0a9cedbaaf44 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:57.059100 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eeb0bb81-2550-4658-9c35-0a9cedbaaf44 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:57.059760 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eeb0bb81-2550-4658-9c35-0a9cedbaaf44 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:57.060727 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eeb0bb81-2550-4658-9c35-0a9cedbaaf44 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:57.061302 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eeb0bb81-2550-4658-9c35-0a9cedbaaf44 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:57.222772 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c5a633de-ace4-443b-bf1f-d20c27a13b7f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:57.223690 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c5a633de-ace4-443b-bf1f-d20c27a13b7f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:57.231915 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c5a633de-ace4-443b-bf1f-d20c27a13b7f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:57.232501 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c5a633de-ace4-443b-bf1f-d20c27a13b7f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:57.233409 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c5a633de-ace4-443b-bf1f-d20c27a13b7f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:57.233908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c5a633de-ace4-443b-bf1f-d20c27a13b7f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:57.395096 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-eeb0bb81-2550-4658-9c35-0a9cedbaaf44 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:57.408580 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-eeb0bb81-2550-4658-9c35-0a9cedbaaf44 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1506 microversion: 2.1 time: 0.368325 Jul 25 15:01:57.410886 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2998/6212] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:57 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1506 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:57.894636 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c5a633de-ace4-443b-bf1f-d20c27a13b7f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:57.903993 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c5a633de-ace4-443b-bf1f-d20c27a13b7f tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1692 microversion: 2.1 time: 0.685292 Jul 25 15:01:57.904629 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3215/6213] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:57 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1692 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:01:58.441421 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-14d742be-49f4-4af4-bc13-cb77601bc7ee tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:58.443401 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-14d742be-49f4-4af4-bc13-cb77601bc7ee tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:58.467061 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14d742be-49f4-4af4-bc13-cb77601bc7ee tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:58.468289 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14d742be-49f4-4af4-bc13-cb77601bc7ee tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:58.469962 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14d742be-49f4-4af4-bc13-cb77601bc7ee tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:58.471060 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14d742be-49f4-4af4-bc13-cb77601bc7ee tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:58.928816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b83b1864-441a-4738-abf7-3d788f4e6b34 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:58.931370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b83b1864-441a-4738-abf7-3d788f4e6b34 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:58.944371 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b83b1864-441a-4738-abf7-3d788f4e6b34 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:58.945982 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b83b1864-441a-4738-abf7-3d788f4e6b34 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:58.947037 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b83b1864-441a-4738-abf7-3d788f4e6b34 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:58.947856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b83b1864-441a-4738-abf7-3d788f4e6b34 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:59.061772 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-14d742be-49f4-4af4-bc13-cb77601bc7ee tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:59.105130 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-14d742be-49f4-4af4-bc13-cb77601bc7ee tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 200 len: 1509 microversion: 2.1 time: 0.674971 Jul 25 15:01:59.108848 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 2999/6214] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:58 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 1509 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:59.128793 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-83bff7f1-d870-4106-89b2-ceffeb261944 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:59.129412 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-83bff7f1-d870-4106-89b2-ceffeb261944 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:59.138678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-83bff7f1-d870-4106-89b2-ceffeb261944 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:59.141385 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-83bff7f1-d870-4106-89b2-ceffeb261944 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:59.142375 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-83bff7f1-d870-4106-89b2-ceffeb261944 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:59.144845 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-83bff7f1-d870-4106-89b2-ceffeb261944 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:59.171384 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b83b1864-441a-4738-abf7-3d788f4e6b34 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:59.187653 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b83b1864-441a-4738-abf7-3d788f4e6b34 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1692 microversion: 2.1 time: 0.264869 Jul 25 15:01:59.189286 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3216/6215] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:58 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1692 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:01:59.403314 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-83bff7f1-d870-4106-89b2-ceffeb261944 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:59.413290 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-83bff7f1-d870-4106-89b2-ceffeb261944 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.288310 Jul 25 15:01:59.413896 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3000/6216] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:59 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:59.459678 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-295ad1d2-1241-4880-904a-6b70ff9228b6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:59.460706 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-295ad1d2-1241-4880-904a-6b70ff9228b6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:59.471930 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-295ad1d2-1241-4880-904a-6b70ff9228b6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:59.472641 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-295ad1d2-1241-4880-904a-6b70ff9228b6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:59.474524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-295ad1d2-1241-4880-904a-6b70ff9228b6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:59.475224 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-295ad1d2-1241-4880-904a-6b70ff9228b6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:59.694483 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-7fcdfd08-169a-479e-9f9a-c32e96cc39dc req-60396257-7ea2-4b14-88fb-d520bd44973a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c", "name": "network-vif-unplugged", "status": "completed", "tag": "a4966c7a-95a3-4d55-9f1b-bb3b5ede444a"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:01:59.707767 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-7fcdfd08-169a-479e-9f9a-c32e96cc39dc req-60396257-7ea2-4b14-88fb-d520bd44973a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:59.708369 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-7fcdfd08-169a-479e-9f9a-c32e96cc39dc req-60396257-7ea2-4b14-88fb-d520bd44973a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:59.722345 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.compute.server_external_events [req-7fcdfd08-169a-479e-9f9a-c32e96cc39dc req-60396257-7ea2-4b14-88fb-d520bd44973a service nova] Unable to find a host for instance cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c. Dropping event network-vif-unplugged {{(pid=119303) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 25 15:01:59.723255 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-7fcdfd08-169a-479e-9f9a-c32e96cc39dc req-60396257-7ea2-4b14-88fb-d520bd44973a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.228335 Jul 25 15:01:59.724256 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3001/6217] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 231 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 25 15:01:59.864000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-295ad1d2-1241-4880-904a-6b70ff9228b6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:01:59.879555 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-295ad1d2-1241-4880-904a-6b70ff9228b6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.432361 Jul 25 15:01:59.880757 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3217/6218] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:59 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:01:59.915093 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4e121db0-b9ac-4810-81f9-b8da548e0acb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:01:59.919503 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4e121db0-b9ac-4810-81f9-b8da548e0acb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:01:59.929636 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4e121db0-b9ac-4810-81f9-b8da548e0acb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:59.930352 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4e121db0-b9ac-4810-81f9-b8da548e0acb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:01:59.931641 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4e121db0-b9ac-4810-81f9-b8da548e0acb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:01:59.932398 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4e121db0-b9ac-4810-81f9-b8da548e0acb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:00.109064 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4e121db0-b9ac-4810-81f9-b8da548e0acb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:00.134383 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4e121db0-b9ac-4810-81f9-b8da548e0acb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.224877 Jul 25 15:02:00.135757 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3002/6219] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:01:59 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:00.171342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f5b3189d-260d-47c3-abeb-94cf34071195 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:00.173224 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f5b3189d-260d-47c3-abeb-94cf34071195 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:00.188911 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5b3189d-260d-47c3-abeb-94cf34071195 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:00.189680 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5b3189d-260d-47c3-abeb-94cf34071195 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:00.191545 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5b3189d-260d-47c3-abeb-94cf34071195 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:00.192922 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5b3189d-260d-47c3-abeb-94cf34071195 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:00.221339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1d62288d-e4d4-4495-b033-46a64d3f9151 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:00.259754 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1d62288d-e4d4-4495-b033-46a64d3f9151 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:00.280674 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d62288d-e4d4-4495-b033-46a64d3f9151 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:00.281161 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d62288d-e4d4-4495-b033-46a64d3f9151 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:00.285120 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d62288d-e4d4-4495-b033-46a64d3f9151 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:00.292678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d62288d-e4d4-4495-b033-46a64d3f9151 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:00.477804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f5b3189d-260d-47c3-abeb-94cf34071195 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:00.488099 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f5b3189d-260d-47c3-abeb-94cf34071195 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.324781 Jul 25 15:02:00.489111 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3218/6220] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:00 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:00.517849 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-411e757f-2692-44bb-8e45-3e7340b9b36e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:02:00.526469 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-411e757f-2692-44bb-8e45-3e7340b9b36e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:00.527080 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-411e757f-2692-44bb-8e45-3e7340b9b36e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:00.557632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-411e757f-2692-44bb-8e45-3e7340b9b36e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Going to try to stop instance {{(pid=119304) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 15:02:00.661722 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-411e757f-2692-44bb-8e45-3e7340b9b36e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action" status: 202 len: 0 microversion: 2.1 time: 0.155849 Jul 25 15:02:00.662304 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3219/6221] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:02:00 2022] POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 15:02:00.684460 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7f072037-dece-4c78-bcbc-be59a2a51a23 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:00.685494 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7f072037-dece-4c78-bcbc-be59a2a51a23 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:00.701291 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7f072037-dece-4c78-bcbc-be59a2a51a23 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:00.701871 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7f072037-dece-4c78-bcbc-be59a2a51a23 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:00.702847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7f072037-dece-4c78-bcbc-be59a2a51a23 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:00.703479 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7f072037-dece-4c78-bcbc-be59a2a51a23 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:00.773371 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1d62288d-e4d4-4495-b033-46a64d3f9151 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:00.814465 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1d62288d-e4d4-4495-b033-46a64d3f9151 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1692 microversion: 2.1 time: 0.584128 Jul 25 15:02:00.820036 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3003/6222] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:00 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1692 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:01.070832 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7f072037-dece-4c78-bcbc-be59a2a51a23 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:01.105306 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7f072037-dece-4c78-bcbc-be59a2a51a23 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1680 microversion: 2.1 time: 0.424820 Jul 25 15:02:01.113698 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3220/6223] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:00 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1680 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:01.847214 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-aea667b3-03f0-465f-a76c-b616ec844336 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:01.847898 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-aea667b3-03f0-465f-a76c-b616ec844336 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:01.860343 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aea667b3-03f0-465f-a76c-b616ec844336 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:01.860828 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aea667b3-03f0-465f-a76c-b616ec844336 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:01.863057 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aea667b3-03f0-465f-a76c-b616ec844336 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:01.866091 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aea667b3-03f0-465f-a76c-b616ec844336 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:02.131988 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cf67bc91-fba5-4326-9988-52fa06a6777d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:02.132603 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cf67bc91-fba5-4326-9988-52fa06a6777d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:02.162346 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cf67bc91-fba5-4326-9988-52fa06a6777d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:02.163369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cf67bc91-fba5-4326-9988-52fa06a6777d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:02.164996 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cf67bc91-fba5-4326-9988-52fa06a6777d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:02.165577 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cf67bc91-fba5-4326-9988-52fa06a6777d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:02.388614 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-aea667b3-03f0-465f-a76c-b616ec844336 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:02.406470 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-aea667b3-03f0-465f-a76c-b616ec844336 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1692 microversion: 2.1 time: 0.566155 Jul 25 15:02:02.426613 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3004/6224] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:01 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1692 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:02.530148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cf67bc91-fba5-4326-9988-52fa06a6777d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:02.539572 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cf67bc91-fba5-4326-9988-52fa06a6777d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1680 microversion: 2.1 time: 0.411718 Jul 25 15:02:02.540951 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3221/6225] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:02 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1680 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:03.442406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2203e813-8ba0-4f37-8c26-19672d24cae0 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:03.443304 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2203e813-8ba0-4f37-8c26-19672d24cae0 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:03.469368 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2203e813-8ba0-4f37-8c26-19672d24cae0 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:03.470172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2203e813-8ba0-4f37-8c26-19672d24cae0 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:03.471543 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2203e813-8ba0-4f37-8c26-19672d24cae0 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:03.472363 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2203e813-8ba0-4f37-8c26-19672d24cae0 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:03.573696 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3f27ada3-8b05-413e-a1cb-31f098614541 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:03.575647 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3f27ada3-8b05-413e-a1cb-31f098614541 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:03.601239 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f27ada3-8b05-413e-a1cb-31f098614541 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:03.602247 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f27ada3-8b05-413e-a1cb-31f098614541 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:03.607172 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f27ada3-8b05-413e-a1cb-31f098614541 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:03.608254 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f27ada3-8b05-413e-a1cb-31f098614541 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:04.033238 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3f27ada3-8b05-413e-a1cb-31f098614541 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:04.047065 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3f27ada3-8b05-413e-a1cb-31f098614541 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1680 microversion: 2.1 time: 0.479470 Jul 25 15:02:04.048603 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3222/6226] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:03 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1680 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:02:04.408786 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2203e813-8ba0-4f37-8c26-19672d24cae0 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:04.513948 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2203e813-8ba0-4f37-8c26-19672d24cae0 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1692 microversion: 2.1 time: 1.077383 Jul 25 15:02:04.515655 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3005/6227] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:03 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1692 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:05.070171 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-98a6b90c-1f66-4b1e-86fd-7f44d16fdab6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:05.071425 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-98a6b90c-1f66-4b1e-86fd-7f44d16fdab6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:05.084727 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98a6b90c-1f66-4b1e-86fd-7f44d16fdab6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:05.087303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98a6b90c-1f66-4b1e-86fd-7f44d16fdab6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:05.092367 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98a6b90c-1f66-4b1e-86fd-7f44d16fdab6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:05.092977 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98a6b90c-1f66-4b1e-86fd-7f44d16fdab6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:05.303264 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-98a6b90c-1f66-4b1e-86fd-7f44d16fdab6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:05.312423 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-98a6b90c-1f66-4b1e-86fd-7f44d16fdab6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1680 microversion: 2.1 time: 0.246280 Jul 25 15:02:05.313789 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3223/6228] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:05 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1680 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:05.536475 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ee7486a6-151b-46a8-9671-d2f51ba2c9e3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:05.537182 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ee7486a6-151b-46a8-9671-d2f51ba2c9e3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:05.548376 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee7486a6-151b-46a8-9671-d2f51ba2c9e3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:05.551333 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee7486a6-151b-46a8-9671-d2f51ba2c9e3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:05.552311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee7486a6-151b-46a8-9671-d2f51ba2c9e3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:05.557191 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee7486a6-151b-46a8-9671-d2f51ba2c9e3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:06.384337 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-32b9d73b-3ccd-4580-a201-079fc513be46 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:06.385126 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-32b9d73b-3ccd-4580-a201-079fc513be46 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:06.402449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-32b9d73b-3ccd-4580-a201-079fc513be46 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:06.402891 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-32b9d73b-3ccd-4580-a201-079fc513be46 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:06.403696 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-32b9d73b-3ccd-4580-a201-079fc513be46 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:06.404715 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-32b9d73b-3ccd-4580-a201-079fc513be46 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:06.615432 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ee7486a6-151b-46a8-9671-d2f51ba2c9e3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:06.631575 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ee7486a6-151b-46a8-9671-d2f51ba2c9e3 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1692 microversion: 2.1 time: 1.099183 Jul 25 15:02:06.644179 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3006/6229] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:05 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1692 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:02:06.657313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-27823a59-dae7-44f5-870b-d86eae2e8fc8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:06.657313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-27823a59-dae7-44f5-870b-d86eae2e8fc8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: eb578778-5fa3-4449-9a17-8cab83ea2646] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:06.675967 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27823a59-dae7-44f5-870b-d86eae2e8fc8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:06.683607 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27823a59-dae7-44f5-870b-d86eae2e8fc8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:06.684630 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27823a59-dae7-44f5-870b-d86eae2e8fc8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:06.685085 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27823a59-dae7-44f5-870b-d86eae2e8fc8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:06.685406 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-32b9d73b-3ccd-4580-a201-079fc513be46 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:06.698591 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-32b9d73b-3ccd-4580-a201-079fc513be46 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1680 microversion: 2.1 time: 0.320443 Jul 25 15:02:06.699939 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3224/6230] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:06 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1680 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:02:06.740058 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-27823a59-dae7-44f5-870b-d86eae2e8fc8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: eb578778-5fa3-4449-9a17-8cab83ea2646] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:02:06.919823 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-27823a59-dae7-44f5-870b-d86eae2e8fc8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "DELETE /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646" status: 204 len: 0 microversion: 2.1 time: 0.274171 Jul 25 15:02:06.920902 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3007/6231] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:02:06 2022] DELETE /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:02:06.929638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-546db6f4-4a29-4f35-acc1-6134a4fd7b62 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:06.930269 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-546db6f4-4a29-4f35-acc1-6134a4fd7b62 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: eb578778-5fa3-4449-9a17-8cab83ea2646] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:06.950175 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-546db6f4-4a29-4f35-acc1-6134a4fd7b62 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:06.951466 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-546db6f4-4a29-4f35-acc1-6134a4fd7b62 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:06.952436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-546db6f4-4a29-4f35-acc1-6134a4fd7b62 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:06.953015 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-546db6f4-4a29-4f35-acc1-6134a4fd7b62 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:07.207600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-546db6f4-4a29-4f35-acc1-6134a4fd7b62 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:07.216613 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-546db6f4-4a29-4f35-acc1-6134a4fd7b62 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646" status: 200 len: 1553 microversion: 2.1 time: 0.291206 Jul 25 15:02:07.221424 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3225/6232] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:06 2022] GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646 => generated 1553 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:07.656164 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a9265a8a-e332-4cc0-9a66-86ef051ba6de tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:07.656935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a9265a8a-e332-4cc0-9a66-86ef051ba6de tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:07.684973 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a9265a8a-e332-4cc0-9a66-86ef051ba6de tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:07.686180 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a9265a8a-e332-4cc0-9a66-86ef051ba6de tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:07.687043 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a9265a8a-e332-4cc0-9a66-86ef051ba6de tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:07.687485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a9265a8a-e332-4cc0-9a66-86ef051ba6de tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:07.728471 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-02703031-fa0c-4bdb-9bf4-0fb237f48603 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:07.729283 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-02703031-fa0c-4bdb-9bf4-0fb237f48603 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:07.747131 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-02703031-fa0c-4bdb-9bf4-0fb237f48603 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:07.752387 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-02703031-fa0c-4bdb-9bf4-0fb237f48603 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:07.753695 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-02703031-fa0c-4bdb-9bf4-0fb237f48603 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:07.756572 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-02703031-fa0c-4bdb-9bf4-0fb237f48603 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:07.809410 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:02:07.997096 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a9265a8a-e332-4cc0-9a66-86ef051ba6de tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:08.005506 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a9265a8a-e332-4cc0-9a66-86ef051ba6de tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1698 microversion: 2.1 time: 0.354362 Jul 25 15:02:08.027373 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3008/6233] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:07 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1698 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:02:08.170092 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-02703031-fa0c-4bdb-9bf4-0fb237f48603 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:08.184454 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-02703031-fa0c-4bdb-9bf4-0fb237f48603 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1680 microversion: 2.1 time: 0.461407 Jul 25 15:02:08.190338 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3226/6234] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:07 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1680 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:08.238505 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-10b88cb0-3965-438c-ab88-aa7274a17efb tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:08.239389 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-10b88cb0-3965-438c-ab88-aa7274a17efb tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: eb578778-5fa3-4449-9a17-8cab83ea2646] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:08.249111 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-10b88cb0-3965-438c-ab88-aa7274a17efb tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:08.251621 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-10b88cb0-3965-438c-ab88-aa7274a17efb tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:08.253589 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-10b88cb0-3965-438c-ab88-aa7274a17efb tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:08.257105 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-10b88cb0-3965-438c-ab88-aa7274a17efb tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:08.536905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-10b88cb0-3965-438c-ab88-aa7274a17efb tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:08.549469 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-10b88cb0-3965-438c-ab88-aa7274a17efb tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646" status: 200 len: 1553 microversion: 2.1 time: 0.311284 Jul 25 15:02:08.550274 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3009/6235] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:08 2022] GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646 => generated 1553 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:02:09.036855 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3e0f65f2-7f49-4831-a931-833cfcf7cd7a tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:09.038113 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3e0f65f2-7f49-4831-a931-833cfcf7cd7a tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:09.061108 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e0f65f2-7f49-4831-a931-833cfcf7cd7a tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:09.062067 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e0f65f2-7f49-4831-a931-833cfcf7cd7a tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:09.063281 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e0f65f2-7f49-4831-a931-833cfcf7cd7a tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:09.063926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e0f65f2-7f49-4831-a931-833cfcf7cd7a tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:09.210197 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-86481ce5-16e9-4e2d-a1dd-cfcab7007981 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:09.211784 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-86481ce5-16e9-4e2d-a1dd-cfcab7007981 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:09.225273 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-86481ce5-16e9-4e2d-a1dd-cfcab7007981 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:09.227657 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-86481ce5-16e9-4e2d-a1dd-cfcab7007981 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:09.228845 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-86481ce5-16e9-4e2d-a1dd-cfcab7007981 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:09.231421 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-86481ce5-16e9-4e2d-a1dd-cfcab7007981 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:09.742999 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-86481ce5-16e9-4e2d-a1dd-cfcab7007981 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:09.752336 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-86481ce5-16e9-4e2d-a1dd-cfcab7007981 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1680 microversion: 2.1 time: 0.546267 Jul 25 15:02:09.760475 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3010/6236] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:09 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1680 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:09.773820 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-33356e36-e4fb-4bc8-8e05-45033d2bc70a req-d9834907-053f-4185-a259-be75265defaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb578778-5fa3-4449-9a17-8cab83ea2646", "name": "network-vif-deleted", "tag": "4de351fa-d5c5-4f30-a590-d4f34ba5e989"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:02:09.808615 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-33356e36-e4fb-4bc8-8e05-45033d2bc70a req-d9834907-053f-4185-a259-be75265defaf service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:09.809073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-33356e36-e4fb-4bc8-8e05-45033d2bc70a req-d9834907-053f-4185-a259-be75265defaf service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:09.861590 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-33356e36-e4fb-4bc8-8e05-45033d2bc70a req-d9834907-053f-4185-a259-be75265defaf service nova] Creating event network-vif-deleted:4de351fa-d5c5-4f30-a590-d4f34ba5e989 for instance eb578778-5fa3-4449-9a17-8cab83ea2646 on n-h1-846435-14 Jul 25 15:02:09.874350 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-33356e36-e4fb-4bc8-8e05-45033d2bc70a req-d9834907-053f-4185-a259-be75265defaf service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111337 Jul 25 15:02:09.877144 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3011/6237] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:02:09.906007 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c8a2260c-f865-4096-9848-a522830d6d2a tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:09.906729 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c8a2260c-f865-4096-9848-a522830d6d2a tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: eb578778-5fa3-4449-9a17-8cab83ea2646] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:09.937553 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c8a2260c-f865-4096-9848-a522830d6d2a tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:09.937994 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c8a2260c-f865-4096-9848-a522830d6d2a tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:09.938756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c8a2260c-f865-4096-9848-a522830d6d2a tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:09.939202 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c8a2260c-f865-4096-9848-a522830d6d2a tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:10.095252 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:02:10.112991 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c8a2260c-f865-4096-9848-a522830d6d2a tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:10.113603 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c8a2260c-f865-4096-9848-a522830d6d2a tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:10.114245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-c8a2260c-f865-4096-9848-a522830d6d2a tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lazy-loading 'fault' on Instance uuid eb578778-5fa3-4449-9a17-8cab83ea2646 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:02:10.213865 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c8a2260c-f865-4096-9848-a522830d6d2a tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:10.224435 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c8a2260c-f865-4096-9848-a522830d6d2a tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646" status: 200 len: 1338 microversion: 2.1 time: 0.346081 Jul 25 15:02:10.226614 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3012/6238] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:09 2022] GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646 => generated 1338 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:10.341215 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3e0f65f2-7f49-4831-a931-833cfcf7cd7a tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:10.350445 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3e0f65f2-7f49-4831-a931-833cfcf7cd7a tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1698 microversion: 2.1 time: 1.320060 Jul 25 15:02:10.355532 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3227/6239] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:09 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1698 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:10.783454 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4c8dd314-2515-4a1e-bd1b-11b0cd9cec7d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:10.784135 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4c8dd314-2515-4a1e-bd1b-11b0cd9cec7d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:10.797768 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c8dd314-2515-4a1e-bd1b-11b0cd9cec7d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:10.798243 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c8dd314-2515-4a1e-bd1b-11b0cd9cec7d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:10.801272 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c8dd314-2515-4a1e-bd1b-11b0cd9cec7d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:10.801732 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c8dd314-2515-4a1e-bd1b-11b0cd9cec7d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:11.065739 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4c8dd314-2515-4a1e-bd1b-11b0cd9cec7d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:11.074202 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4c8dd314-2515-4a1e-bd1b-11b0cd9cec7d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1680 microversion: 2.1 time: 0.294934 Jul 25 15:02:11.076982 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3013/6240] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:10 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1680 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:11.245630 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9f5ef4a0-a50d-40b6-be4f-02798e891518 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:11.246262 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9f5ef4a0-a50d-40b6-be4f-02798e891518 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: eb578778-5fa3-4449-9a17-8cab83ea2646] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:11.273358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f5ef4a0-a50d-40b6-be4f-02798e891518 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:11.274036 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f5ef4a0-a50d-40b6-be4f-02798e891518 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:11.274975 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f5ef4a0-a50d-40b6-be4f-02798e891518 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:11.275781 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f5ef4a0-a50d-40b6-be4f-02798e891518 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:11.326777 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-9f5ef4a0-a50d-40b6-be4f-02798e891518 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] HTTP exception thrown: Instance eb578778-5fa3-4449-9a17-8cab83ea2646 could not be found. Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9f5ef4a0-a50d-40b6-be4f-02798e891518 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Request method failure captured: Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646 HTTP/1.1 Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q-9vJcvk5DDA0KztYJD9u35CNyiUWIx1c_trHQChYsGk_qH9_Fz1rUnVFafgSzw_iIuCfnZRf236rj4sNIt2DW84zbvtC3tbZzYGH6UdVZzADFVFVy9_IwJQtYLmsH0cFTG9ivaFs7hJ8B93C9ALsqjN8m4mdVaogMMr1tDoFLIp68 Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 3a1220781eb4456d9afaca1ebec42203 Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-TestNetworkBasicOps-1276627206 Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3a1220781eb4456d9afaca1ebec42203"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3a1220781eb4456d9afaca1ebec42203"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3a1220781eb4456d9afaca1ebec42203", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3a1220781eb4456d9afaca1ebec42203"}]}] Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-TestNetworkBasicOps-1276627206 Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 3a1220781eb4456d9afaca1ebec42203 Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-TestNetworkBasicOps-1276627206 Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-TestNetworkBasicOps-1276627206-project Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: dd3fdf21e7be4de2817a73d402a34c56 Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-TestNetworkBasicOps-1276627206-project Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance eb578778-5fa3-4449-9a17-8cab83ea2646 could not be found. Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'eb578778-5fa3-4449-9a17-8cab83ea2646'} Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb578778-5fa3-4449-9a17-8cab83ea2646 could not be found. Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb578778-5fa3-4449-9a17-8cab83ea2646 could not be found. Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:02:11.328543 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:02:11.331854 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:02:11.331854 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:02:11.331854 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:02:11.331854 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:02:11.331854 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:02:11.331854 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb578778-5fa3-4449-9a17-8cab83ea2646 could not be found. Jul 25 15:02:11.331854 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:02:11.331854 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9f5ef4a0-a50d-40b6-be4f-02798e891518 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Returning 404 to user: Instance eb578778-5fa3-4449-9a17-8cab83ea2646 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:02:11.332469 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9f5ef4a0-a50d-40b6-be4f-02798e891518 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646" status: 404 len: 111 microversion: 2.1 time: 0.089059 Jul 25 15:02:11.335206 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3228/6241] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:11 2022] GET /compute/v2.1/servers/eb578778-5fa3-4449-9a17-8cab83ea2646 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:02:11.379796 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cfa93f83-7fac-46c0-90cc-343474991911 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:11.380710 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cfa93f83-7fac-46c0-90cc-343474991911 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:11.401036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cfa93f83-7fac-46c0-90cc-343474991911 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:11.406420 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cfa93f83-7fac-46c0-90cc-343474991911 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:11.407832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cfa93f83-7fac-46c0-90cc-343474991911 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:11.408305 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cfa93f83-7fac-46c0-90cc-343474991911 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:11.723296 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cfa93f83-7fac-46c0-90cc-343474991911 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:11.737519 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cfa93f83-7fac-46c0-90cc-343474991911 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1698 microversion: 2.1 time: 0.361935 Jul 25 15:02:11.754491 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3014/6242] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:11 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1698 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:11.951502 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e6ba628d-58d2-49ae-b71e-c98efcad320e tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '.version_select at 0x7f46860efca0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:12.005892 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e6ba628d-58d2-49ae-b71e-c98efcad320e tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-729510145" status: 202 len: 0 microversion: 2.1 time: 0.058610 Jul 25 15:02:12.007164 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3229/6243] 10.222.0.88 () {58 vars in 1254 bytes} [Mon Jul 25 15:02:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-729510145 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:02:12.101425 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-216ce534-cd6d-4f0f-821e-2f298f640112 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:12.102381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-216ce534-cd6d-4f0f-821e-2f298f640112 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:12.115997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-216ce534-cd6d-4f0f-821e-2f298f640112 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:12.116320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-216ce534-cd6d-4f0f-821e-2f298f640112 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:12.117269 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-216ce534-cd6d-4f0f-821e-2f298f640112 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:12.118096 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-216ce534-cd6d-4f0f-821e-2f298f640112 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:12.255574 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-2d700d39-cdbf-4df2-ac96-95d663b2d0b8 req-49783452-bd9d-413e-9a7e-c66501f6b8d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ec74cda-74e2-4998-8f9a-942e980313c3", "name": "network-vif-unplugged", "status": "completed", "tag": "66b36202-edd4-437d-abc1-1e5c0064323d"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:02:12.292864 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-2d700d39-cdbf-4df2-ac96-95d663b2d0b8 req-49783452-bd9d-413e-9a7e-c66501f6b8d0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:12.294573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-2d700d39-cdbf-4df2-ac96-95d663b2d0b8 req-49783452-bd9d-413e-9a7e-c66501f6b8d0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:12.329228 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-2d700d39-cdbf-4df2-ac96-95d663b2d0b8 req-49783452-bd9d-413e-9a7e-c66501f6b8d0 service nova] Creating event network-vif-unplugged:66b36202-edd4-437d-abc1-1e5c0064323d for instance 4ec74cda-74e2-4998-8f9a-942e980313c3 on n-h2-846435-14 Jul 25 15:02:12.344108 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-2d700d39-cdbf-4df2-ac96-95d663b2d0b8 req-49783452-bd9d-413e-9a7e-c66501f6b8d0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095193 Jul 25 15:02:12.350946 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3230/6244] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:02:12.668095 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-216ce534-cd6d-4f0f-821e-2f298f640112 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:12.685208 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-216ce534-cd6d-4f0f-821e-2f298f640112 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1657 microversion: 2.1 time: 0.590792 Jul 25 15:02:12.704345 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3015/6245] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:12 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1657 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:12.713291 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-37c3be3c-682a-4d49-9cc6-1b7b89f0863d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:02:12.720660 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37c3be3c-682a-4d49-9cc6-1b7b89f0863d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:12.721428 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37c3be3c-682a-4d49-9cc6-1b7b89f0863d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:12.750151 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-37c3be3c-682a-4d49-9cc6-1b7b89f0863d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Going to try to start instance {{(pid=119304) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 15:02:12.764671 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dd362c0d-58d8-4318-afdf-73186c7a94ff tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:12.765599 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-dd362c0d-58d8-4318-afdf-73186c7a94ff tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:12.794307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dd362c0d-58d8-4318-afdf-73186c7a94ff tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:12.795297 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dd362c0d-58d8-4318-afdf-73186c7a94ff tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:12.796948 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dd362c0d-58d8-4318-afdf-73186c7a94ff tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:12.799067 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dd362c0d-58d8-4318-afdf-73186c7a94ff tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:12.918902 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-37c3be3c-682a-4d49-9cc6-1b7b89f0863d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action" status: 202 len: 0 microversion: 2.1 time: 0.209400 Jul 25 15:02:12.920163 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3231/6246] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:02:12 2022] POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:02:12.929811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-26dbc501-d982-48a6-8995-e31595d6d09c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:12.931374 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-26dbc501-d982-48a6-8995-e31595d6d09c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:12.948751 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26dbc501-d982-48a6-8995-e31595d6d09c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:12.949774 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26dbc501-d982-48a6-8995-e31595d6d09c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:12.950785 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26dbc501-d982-48a6-8995-e31595d6d09c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:12.954156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26dbc501-d982-48a6-8995-e31595d6d09c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:13.345110 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-dd362c0d-58d8-4318-afdf-73186c7a94ff tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:13.359099 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dd362c0d-58d8-4318-afdf-73186c7a94ff tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1683 microversion: 2.1 time: 0.597111 Jul 25 15:02:13.360947 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3016/6247] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:12 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1683 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:13.556232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-26dbc501-d982-48a6-8995-e31595d6d09c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:13.578053 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-26dbc501-d982-48a6-8995-e31595d6d09c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1666 microversion: 2.1 time: 0.644390 Jul 25 15:02:13.579347 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3232/6248] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:12 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1666 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:02:14.602159 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1eeb6e37-d632-461b-808e-fd1bf359e89c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:14.602790 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1eeb6e37-d632-461b-808e-fd1bf359e89c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:14.617423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1eeb6e37-d632-461b-808e-fd1bf359e89c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:14.617913 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1eeb6e37-d632-461b-808e-fd1bf359e89c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:14.618724 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1eeb6e37-d632-461b-808e-fd1bf359e89c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:14.619239 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1eeb6e37-d632-461b-808e-fd1bf359e89c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:15.042437 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1eeb6e37-d632-461b-808e-fd1bf359e89c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:15.054449 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1eeb6e37-d632-461b-808e-fd1bf359e89c tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1666 microversion: 2.1 time: 0.456360 Jul 25 15:02:15.055887 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3017/6249] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:14 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1666 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:16.077751 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-55b48dc8-8cb5-4a1a-9932-3abffcbd37fb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:16.078385 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-55b48dc8-8cb5-4a1a-9932-3abffcbd37fb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:16.093061 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55b48dc8-8cb5-4a1a-9932-3abffcbd37fb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:16.093421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55b48dc8-8cb5-4a1a-9932-3abffcbd37fb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:16.094233 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55b48dc8-8cb5-4a1a-9932-3abffcbd37fb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:16.094664 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55b48dc8-8cb5-4a1a-9932-3abffcbd37fb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:16.414096 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a2c18da5-2ff6-4b19-9246-8ff7ef7ff816 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:16.415198 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a2c18da5-2ff6-4b19-9246-8ff7ef7ff816 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: 5df3428f-90e1-4629-b613-aea056517fe0] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:16.451906 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a2c18da5-2ff6-4b19-9246-8ff7ef7ff816 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:16.457663 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a2c18da5-2ff6-4b19-9246-8ff7ef7ff816 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:16.458710 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a2c18da5-2ff6-4b19-9246-8ff7ef7ff816 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:16.459361 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a2c18da5-2ff6-4b19-9246-8ff7ef7ff816 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:16.517496 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a2c18da5-2ff6-4b19-9246-8ff7ef7ff816 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: 5df3428f-90e1-4629-b613-aea056517fe0] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:02:16.554898 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-55b48dc8-8cb5-4a1a-9932-3abffcbd37fb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:16.570132 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-55b48dc8-8cb5-4a1a-9932-3abffcbd37fb tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1666 microversion: 2.1 time: 0.496264 Jul 25 15:02:16.572876 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3233/6250] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:16 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1666 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:16.581318 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-b14f7c11-14f6-4f5c-9522-b6a0e9a2d419 req-f132238d-7d15-4bc8-ba9f-31b88cf9b80a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5df3428f-90e1-4629-b613-aea056517fe0", "tag": "98d89e4c-d389-4e25-a0df-6934ef7fe40b"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:02:16.610145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-b14f7c11-14f6-4f5c-9522-b6a0e9a2d419 req-f132238d-7d15-4bc8-ba9f-31b88cf9b80a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:16.614090 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-b14f7c11-14f6-4f5c-9522-b6a0e9a2d419 req-f132238d-7d15-4bc8-ba9f-31b88cf9b80a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:16.641810 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-b14f7c11-14f6-4f5c-9522-b6a0e9a2d419 req-f132238d-7d15-4bc8-ba9f-31b88cf9b80a service nova] Creating event network-changed:98d89e4c-d389-4e25-a0df-6934ef7fe40b for instance 5df3428f-90e1-4629-b613-aea056517fe0 on n-h2-846435-14 Jul 25 15:02:16.658282 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-b14f7c11-14f6-4f5c-9522-b6a0e9a2d419 req-f132238d-7d15-4bc8-ba9f-31b88cf9b80a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083711 Jul 25 15:02:16.670043 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3234/6251] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:02:16.715551 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a2c18da5-2ff6-4b19-9246-8ff7ef7ff816 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "DELETE /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0" status: 204 len: 0 microversion: 2.1 time: 0.305362 Jul 25 15:02:16.716229 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3018/6252] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:02:16 2022] DELETE /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 15:02:16.733106 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ebed5703-baab-47b9-b5e6-924afcb9fe0c tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:16.734050 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ebed5703-baab-47b9-b5e6-924afcb9fe0c tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: 5df3428f-90e1-4629-b613-aea056517fe0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:16.747753 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ebed5703-baab-47b9-b5e6-924afcb9fe0c tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:16.749234 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ebed5703-baab-47b9-b5e6-924afcb9fe0c tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:16.750691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ebed5703-baab-47b9-b5e6-924afcb9fe0c tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:16.751290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ebed5703-baab-47b9-b5e6-924afcb9fe0c tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:16.948933 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-11446686-2557-4063-9457-08702efe6bcf req-fa7471c3-3426-42e9-9466-afd6356aa763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ec74cda-74e2-4998-8f9a-942e980313c3", "name": "network-vif-plugged", "status": "completed", "tag": "66b36202-edd4-437d-abc1-1e5c0064323d"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:02:16.980823 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-11446686-2557-4063-9457-08702efe6bcf req-fa7471c3-3426-42e9-9466-afd6356aa763 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:16.981282 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-11446686-2557-4063-9457-08702efe6bcf req-fa7471c3-3426-42e9-9466-afd6356aa763 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:17.006848 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-11446686-2557-4063-9457-08702efe6bcf req-fa7471c3-3426-42e9-9466-afd6356aa763 service nova] Creating event network-vif-plugged:66b36202-edd4-437d-abc1-1e5c0064323d for instance 4ec74cda-74e2-4998-8f9a-942e980313c3 on n-h2-846435-14 Jul 25 15:02:17.030837 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-11446686-2557-4063-9457-08702efe6bcf req-fa7471c3-3426-42e9-9466-afd6356aa763 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087343 Jul 25 15:02:17.031833 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3019/6253] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:02:17.135690 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ebed5703-baab-47b9-b5e6-924afcb9fe0c tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:17.144263 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ebed5703-baab-47b9-b5e6-924afcb9fe0c tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0" status: 200 len: 1667 microversion: 2.1 time: 0.422570 Jul 25 15:02:17.144873 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3235/6254] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:16 2022] GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0 => generated 1667 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:17.603113 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-45326c71-912c-4949-840e-9a67a53a2ad6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:17.604659 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-45326c71-912c-4949-840e-9a67a53a2ad6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:17.625067 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-45326c71-912c-4949-840e-9a67a53a2ad6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:17.625837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-45326c71-912c-4949-840e-9a67a53a2ad6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:17.627366 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-45326c71-912c-4949-840e-9a67a53a2ad6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:17.628054 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-45326c71-912c-4949-840e-9a67a53a2ad6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:18.168470 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c88b02ef-dec9-42af-b0e9-d777e56ea270 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:18.170149 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c88b02ef-dec9-42af-b0e9-d777e56ea270 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: 5df3428f-90e1-4629-b613-aea056517fe0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:18.178436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:02:18.181557 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c88b02ef-dec9-42af-b0e9-d777e56ea270 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:18.182356 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c88b02ef-dec9-42af-b0e9-d777e56ea270 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:18.183412 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c88b02ef-dec9-42af-b0e9-d777e56ea270 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:18.184159 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c88b02ef-dec9-42af-b0e9-d777e56ea270 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:18.579559 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-45326c71-912c-4949-840e-9a67a53a2ad6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:18.599488 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-45326c71-912c-4949-840e-9a67a53a2ad6 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 1.008347 Jul 25 15:02:18.615770 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3020/6255] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:17 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:18.624043 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2a0f6a68-2b34-408d-8081-d0fdc9257ea7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:18.624690 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2a0f6a68-2b34-408d-8081-d0fdc9257ea7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:18.631887 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a0f6a68-2b34-408d-8081-d0fdc9257ea7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:18.632410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a0f6a68-2b34-408d-8081-d0fdc9257ea7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:18.633699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a0f6a68-2b34-408d-8081-d0fdc9257ea7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:18.634322 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a0f6a68-2b34-408d-8081-d0fdc9257ea7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:18.639917 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c88b02ef-dec9-42af-b0e9-d777e56ea270 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:18.646764 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c88b02ef-dec9-42af-b0e9-d777e56ea270 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0" status: 200 len: 1667 microversion: 2.1 time: 0.483686 Jul 25 15:02:18.651569 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3236/6256] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:18 2022] GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0 => generated 1667 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:02:18.930583 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2a0f6a68-2b34-408d-8081-d0fdc9257ea7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:18.940038 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2a0f6a68-2b34-408d-8081-d0fdc9257ea7 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.320865 Jul 25 15:02:18.944373 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3021/6257] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:18 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:18.963427 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-68e12d0d-0a6e-4625-9388-baf5d4316d08 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:18.964410 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-68e12d0d-0a6e-4625-9388-baf5d4316d08 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:18.972009 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68e12d0d-0a6e-4625-9388-baf5d4316d08 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:18.973089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68e12d0d-0a6e-4625-9388-baf5d4316d08 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:18.974093 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68e12d0d-0a6e-4625-9388-baf5d4316d08 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:18.974721 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68e12d0d-0a6e-4625-9388-baf5d4316d08 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:19.455641 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-68e12d0d-0a6e-4625-9388-baf5d4316d08 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:19.468827 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-68e12d0d-0a6e-4625-9388-baf5d4316d08 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.509470 Jul 25 15:02:19.469507 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3237/6258] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:18 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:19.492722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e62062ff-4707-48b0-b5a8-0f71b4e2d2d0 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:19.496771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e62062ff-4707-48b0-b5a8-0f71b4e2d2d0 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:19.513888 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e62062ff-4707-48b0-b5a8-0f71b4e2d2d0 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:19.514539 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e62062ff-4707-48b0-b5a8-0f71b4e2d2d0 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:19.524135 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e62062ff-4707-48b0-b5a8-0f71b4e2d2d0 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:19.525352 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e62062ff-4707-48b0-b5a8-0f71b4e2d2d0 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:19.676810 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-882f619e-fcec-48e4-bfb8-4f4b0244d490 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:19.677638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-882f619e-fcec-48e4-bfb8-4f4b0244d490 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: 5df3428f-90e1-4629-b613-aea056517fe0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:19.687963 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-882f619e-fcec-48e4-bfb8-4f4b0244d490 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:19.690832 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-882f619e-fcec-48e4-bfb8-4f4b0244d490 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:19.693608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-882f619e-fcec-48e4-bfb8-4f4b0244d490 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:19.694062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-882f619e-fcec-48e4-bfb8-4f4b0244d490 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:19.836542 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-882f619e-fcec-48e4-bfb8-4f4b0244d490 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:19.887032 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-882f619e-fcec-48e4-bfb8-4f4b0244d490 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0" status: 200 len: 1482 microversion: 2.1 time: 0.215088 Jul 25 15:02:19.894211 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3238/6259] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:19 2022] GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0 => generated 1482 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:19.919137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-ea26dea3-93bd-4bbe-abf5-5007de7dd900 req-c3066136-6b64-470c-b90e-1671bef68b1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5df3428f-90e1-4629-b613-aea056517fe0", "name": "network-vif-deleted", "tag": "98d89e4c-d389-4e25-a0df-6934ef7fe40b"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:02:19.949645 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e62062ff-4707-48b0-b5a8-0f71b4e2d2d0 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:19.962528 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ea26dea3-93bd-4bbe-abf5-5007de7dd900 req-c3066136-6b64-470c-b90e-1671bef68b1b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:19.962946 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ea26dea3-93bd-4bbe-abf5-5007de7dd900 req-c3066136-6b64-470c-b90e-1671bef68b1b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:19.968319 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e62062ff-4707-48b0-b5a8-0f71b4e2d2d0 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.481162 Jul 25 15:02:19.971898 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3022/6260] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:19 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:20.001855 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8a961774-104d-4803-83e1-2adcbf19f8c2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:20.002479 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8a961774-104d-4803-83e1-2adcbf19f8c2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:20.016712 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8a961774-104d-4803-83e1-2adcbf19f8c2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:20.020264 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8a961774-104d-4803-83e1-2adcbf19f8c2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:20.021198 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8a961774-104d-4803-83e1-2adcbf19f8c2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:20.021643 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8a961774-104d-4803-83e1-2adcbf19f8c2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:20.021971 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-ea26dea3-93bd-4bbe-abf5-5007de7dd900 req-c3066136-6b64-470c-b90e-1671bef68b1b service nova] Creating event network-vif-deleted:98d89e4c-d389-4e25-a0df-6934ef7fe40b for instance 5df3428f-90e1-4629-b613-aea056517fe0 on n-h2-846435-14 Jul 25 15:02:20.040399 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-ea26dea3-93bd-4bbe-abf5-5007de7dd900 req-c3066136-6b64-470c-b90e-1671bef68b1b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137623 Jul 25 15:02:20.050161 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3239/6261] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:02:20.572419 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8a961774-104d-4803-83e1-2adcbf19f8c2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:20.588044 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8a961774-104d-4803-83e1-2adcbf19f8c2 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.595597 Jul 25 15:02:20.601150 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3023/6262] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:19 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:20.624197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b8105223-8106-4efe-b7e1-fcad92835a89 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:02:20.625669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b8105223-8106-4efe-b7e1-fcad92835a89 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:20.645747 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8105223-8106-4efe-b7e1-fcad92835a89 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:20.647780 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8105223-8106-4efe-b7e1-fcad92835a89 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:20.649571 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8105223-8106-4efe-b7e1-fcad92835a89 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:20.651577 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8105223-8106-4efe-b7e1-fcad92835a89 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:20.710749 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-b8105223-8106-4efe-b7e1-fcad92835a89 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lazy-loading 'flavor' on Instance uuid 9e054ea1-6a81-43c7-9746-25b466d4647b {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:02:20.812496 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b8105223-8106-4efe-b7e1-fcad92835a89 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action" status: 202 len: 0 microversion: 2.1 time: 0.194385 Jul 25 15:02:20.814658 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3240/6263] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:02:20 2022] POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:02:20.824465 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dea7deaa-2431-46ff-b940-235875c2f251 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:20.825335 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-dea7deaa-2431-46ff-b940-235875c2f251 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:20.845407 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dea7deaa-2431-46ff-b940-235875c2f251 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:20.846641 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dea7deaa-2431-46ff-b940-235875c2f251 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:20.848547 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dea7deaa-2431-46ff-b940-235875c2f251 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:20.849165 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dea7deaa-2431-46ff-b940-235875c2f251 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:20.915453 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9bd89456-5989-4178-8a47-0b8736dfb6c0 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:20.916686 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9bd89456-5989-4178-8a47-0b8736dfb6c0 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: 5df3428f-90e1-4629-b613-aea056517fe0] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:20.924369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9bd89456-5989-4178-8a47-0b8736dfb6c0 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:20.924997 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9bd89456-5989-4178-8a47-0b8736dfb6c0 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:20.926062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9bd89456-5989-4178-8a47-0b8736dfb6c0 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:20.926779 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9bd89456-5989-4178-8a47-0b8736dfb6c0 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:20.945792 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-9bd89456-5989-4178-8a47-0b8736dfb6c0 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] HTTP exception thrown: Instance 5df3428f-90e1-4629-b613-aea056517fe0 could not be found. Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9bd89456-5989-4178-8a47-0b8736dfb6c0 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Request method failure captured: Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0 HTTP/1.1 Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q-9vJcvk5DDA0KztYJD9u35CNyiUWIx1c_trHQChYsGk_qH9_Fz1rUnVFafgSzw_iIuCfnZRf236rj4sNIt2DW84zbvtC3tbZzYGH6UdVZzADFVFVy9_IwJQtYLmsH0cFTG9ivaFs7hJ8B93C9ALsqjN8m4mdVaogMMr1tDoFLIp68 Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 3a1220781eb4456d9afaca1ebec42203 Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-TestNetworkBasicOps-1276627206 Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3a1220781eb4456d9afaca1ebec42203"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3a1220781eb4456d9afaca1ebec42203"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3a1220781eb4456d9afaca1ebec42203", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3a1220781eb4456d9afaca1ebec42203"}]}] Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-TestNetworkBasicOps-1276627206 Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 3a1220781eb4456d9afaca1ebec42203 Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-TestNetworkBasicOps-1276627206 Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-TestNetworkBasicOps-1276627206-project Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: dd3fdf21e7be4de2817a73d402a34c56 Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-TestNetworkBasicOps-1276627206-project Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 5df3428f-90e1-4629-b613-aea056517fe0 could not be found. Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '5df3428f-90e1-4629-b613-aea056517fe0'} Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5df3428f-90e1-4629-b613-aea056517fe0 could not be found. Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5df3428f-90e1-4629-b613-aea056517fe0 could not be found. Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:02:20.948049 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:02:20.951226 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:02:20.951226 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:02:20.951226 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:02:20.951226 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:02:20.951226 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:02:20.951226 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5df3428f-90e1-4629-b613-aea056517fe0 could not be found. Jul 25 15:02:20.951226 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:02:20.953332 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9bd89456-5989-4178-8a47-0b8736dfb6c0 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Returning 404 to user: Instance 5df3428f-90e1-4629-b613-aea056517fe0 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:02:20.954408 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9bd89456-5989-4178-8a47-0b8736dfb6c0 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0" status: 404 len: 111 microversion: 2.1 time: 0.043327 Jul 25 15:02:20.955559 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3241/6264] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:20 2022] GET /compute/v2.1/servers/5df3428f-90e1-4629-b613-aea056517fe0 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:02:21.230625 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-de88b385-43ca-427f-ae09-e93d7679759e tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '.version_select at 0x7f4685f60820>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:21.268403 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-dea7deaa-2431-46ff-b940-235875c2f251 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:21.283024 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dea7deaa-2431-46ff-b940-235875c2f251 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1678 microversion: 2.1 time: 0.463341 Jul 25 15:02:21.296659 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-de88b385-43ca-427f-ae09-e93d7679759e tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1272211954" status: 202 len: 0 microversion: 2.1 time: 0.059462 Jul 25 15:02:21.296659 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3242/6265] 10.222.0.88 () {58 vars in 1257 bytes} [Mon Jul 25 15:02:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1272211954 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 15:02:21.296925 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3024/6266] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:20 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1678 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:22.309841 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-09a27968-10f0-413c-8016-15d5485131ce tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:22.311385 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-09a27968-10f0-413c-8016-15d5485131ce tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:22.332154 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09a27968-10f0-413c-8016-15d5485131ce tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:22.332612 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09a27968-10f0-413c-8016-15d5485131ce tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:22.333552 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09a27968-10f0-413c-8016-15d5485131ce tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:22.333969 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09a27968-10f0-413c-8016-15d5485131ce tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:22.654346 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-09a27968-10f0-413c-8016-15d5485131ce tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:22.666015 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-09a27968-10f0-413c-8016-15d5485131ce tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1661 microversion: 2.1 time: 0.361374 Jul 25 15:02:22.667896 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3243/6267] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:22 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1661 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:22.691381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1e8ec46a-2432-49e4-8ccb-e6ab50610562 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:02:22.691939 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1e8ec46a-2432-49e4-8ccb-e6ab50610562 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:22.700721 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e8ec46a-2432-49e4-8ccb-e6ab50610562 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:22.701499 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e8ec46a-2432-49e4-8ccb-e6ab50610562 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:22.702742 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e8ec46a-2432-49e4-8ccb-e6ab50610562 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:22.703370 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e8ec46a-2432-49e4-8ccb-e6ab50610562 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:22.900135 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1e8ec46a-2432-49e4-8ccb-e6ab50610562 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action" status: 202 len: 0 microversion: 2.1 time: 0.209378 Jul 25 15:02:22.906975 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3025/6268] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:02:22 2022] POST /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 15:02:22.909761 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ee0dc4cc-4a20-445c-988c-4a3b49df0423 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:22.910302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ee0dc4cc-4a20-445c-988c-4a3b49df0423 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:22.926109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee0dc4cc-4a20-445c-988c-4a3b49df0423 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:22.926882 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee0dc4cc-4a20-445c-988c-4a3b49df0423 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:22.928857 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee0dc4cc-4a20-445c-988c-4a3b49df0423 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:22.931311 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee0dc4cc-4a20-445c-988c-4a3b49df0423 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:24.744427 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ee0dc4cc-4a20-445c-988c-4a3b49df0423 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:24.772906 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ee0dc4cc-4a20-445c-988c-4a3b49df0423 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1667 microversion: 2.1 time: 1.860668 Jul 25 15:02:24.773972 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3244/6269] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:22 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1667 bytes in 1869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:02:26.237030 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f22cdc09-cdd5-4e45-a7ef-faf6b3af9fb4 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:26.238366 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f22cdc09-cdd5-4e45-a7ef-faf6b3af9fb4 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:26.242541 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:02:26.262630 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f22cdc09-cdd5-4e45-a7ef-faf6b3af9fb4 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:26.263360 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f22cdc09-cdd5-4e45-a7ef-faf6b3af9fb4 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:26.264395 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f22cdc09-cdd5-4e45-a7ef-faf6b3af9fb4 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:26.265080 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f22cdc09-cdd5-4e45-a7ef-faf6b3af9fb4 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:26.512666 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f22cdc09-cdd5-4e45-a7ef-faf6b3af9fb4 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:26.515171 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:02:26.529959 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f22cdc09-cdd5-4e45-a7ef-faf6b3af9fb4 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1667 microversion: 2.1 time: 0.735303 Jul 25 15:02:26.530569 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3026/6270] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:25 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1667 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:27.557806 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3ea57741-010d-4178-b48c-898c4a72144e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:27.558633 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3ea57741-010d-4178-b48c-898c4a72144e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:27.570298 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3ea57741-010d-4178-b48c-898c4a72144e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:27.570660 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3ea57741-010d-4178-b48c-898c4a72144e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:27.577899 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3ea57741-010d-4178-b48c-898c4a72144e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:27.578510 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3ea57741-010d-4178-b48c-898c4a72144e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:28.575800 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3ea57741-010d-4178-b48c-898c4a72144e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:28.585940 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:02:28.591075 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3ea57741-010d-4178-b48c-898c4a72144e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1667 microversion: 2.1 time: 1.037499 Jul 25 15:02:28.592468 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3245/6271] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:27 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1667 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:29.617697 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-52dd9d3a-1b23-4ad5-b153-326017d5d58f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:29.618577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-52dd9d3a-1b23-4ad5-b153-326017d5d58f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:29.640360 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-52dd9d3a-1b23-4ad5-b153-326017d5d58f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:29.641717 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-52dd9d3a-1b23-4ad5-b153-326017d5d58f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:29.641876 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-52dd9d3a-1b23-4ad5-b153-326017d5d58f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:29.642555 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-52dd9d3a-1b23-4ad5-b153-326017d5d58f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:30.130421 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-52dd9d3a-1b23-4ad5-b153-326017d5d58f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:30.139540 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-52dd9d3a-1b23-4ad5-b153-326017d5d58f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.526055 Jul 25 15:02:30.144684 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3027/6272] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:29 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:30.173078 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-54dc329a-700e-4504-bf3b-448e21e69dce tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:30.174413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-54dc329a-700e-4504-bf3b-448e21e69dce tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:30.218330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-54dc329a-700e-4504-bf3b-448e21e69dce tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:30.229500 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-54dc329a-700e-4504-bf3b-448e21e69dce tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:30.232403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-54dc329a-700e-4504-bf3b-448e21e69dce tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:30.233703 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-54dc329a-700e-4504-bf3b-448e21e69dce tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:30.560804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-54dc329a-700e-4504-bf3b-448e21e69dce tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:30.570923 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-54dc329a-700e-4504-bf3b-448e21e69dce tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1670 microversion: 2.1 time: 0.405658 Jul 25 15:02:30.571525 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3246/6273] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:30 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1670 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:30.597311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4c62da9b-da1f-4dcb-a4ce-177782b63e17 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:30.598158 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4c62da9b-da1f-4dcb-a4ce-177782b63e17 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:30.608561 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c62da9b-da1f-4dcb-a4ce-177782b63e17 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:30.609286 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c62da9b-da1f-4dcb-a4ce-177782b63e17 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:30.610381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c62da9b-da1f-4dcb-a4ce-177782b63e17 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:30.611840 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c62da9b-da1f-4dcb-a4ce-177782b63e17 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:30.695796 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4c62da9b-da1f-4dcb-a4ce-177782b63e17 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:02:30.724092 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.compute.api [None req-4c62da9b-da1f-4dcb-a4ce-177782b63e17 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Working on deleting snapshot 5e1a3ca9-0909-4cdc-bfc6-fe36a6e3bb77 from shelved instance... Jul 25 15:02:32.074719 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4c62da9b-da1f-4dcb-a4ce-177782b63e17 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Doing local delete in cell cadb07ed-5464-41eb-afb8-bf9dd92401b6(cell1) {{(pid=119303) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 25 15:02:32.076365 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c62da9b-da1f-4dcb-a4ce-177782b63e17 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:32.077590 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c62da9b-da1f-4dcb-a4ce-177782b63e17 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:32.078190 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.compute.api [None req-4c62da9b-da1f-4dcb-a4ce-177782b63e17 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 25 15:02:32.083206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-4c62da9b-da1f-4dcb-a4ce-177782b63e17 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] deallocate_for_instance() {{(pid=119303) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 25 15:02:33.361748 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-4c62da9b-da1f-4dcb-a4ce-177782b63e17 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Updating instance_info_cache with network_info: [] {{(pid=119303) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 15:02:33.480581 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-b600552c-e944-4032-847a-4eca0a38f93c req-3c5b1ee9-bb22-4d4d-a44a-6e5dd9a5ccb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c", "name": "network-vif-deleted", "tag": "a4966c7a-95a3-4d55-9f1b-bb3b5ede444a"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:02:33.537221 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-b600552c-e944-4032-847a-4eca0a38f93c req-3c5b1ee9-bb22-4d4d-a44a-6e5dd9a5ccb1 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:33.541523 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-b600552c-e944-4032-847a-4eca0a38f93c req-3c5b1ee9-bb22-4d4d-a44a-6e5dd9a5ccb1 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:33.592355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.compute.server_external_events [req-b600552c-e944-4032-847a-4eca0a38f93c req-3c5b1ee9-bb22-4d4d-a44a-6e5dd9a5ccb1 service nova] Unable to find a host for instance cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c. Dropping event network-vif-deleted {{(pid=119304) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 25 15:02:33.593683 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-b600552c-e944-4032-847a-4eca0a38f93c req-3c5b1ee9-bb22-4d4d-a44a-6e5dd9a5ccb1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.121388 Jul 25 15:02:33.603660 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3247/6274] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 129 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 25 15:02:33.973113 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4c62da9b-da1f-4dcb-a4ce-177782b63e17 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "DELETE /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 204 len: 0 microversion: 2.1 time: 3.382742 Jul 25 15:02:33.974329 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3028/6275] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:02:30 2022] DELETE /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 0 bytes in 3385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:02:33.982284 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-236074e9-f6e1-41bc-99b3-afd10412d0aa tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:33.983225 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-236074e9-f6e1-41bc-99b3-afd10412d0aa tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:33.997307 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-236074e9-f6e1-41bc-99b3-afd10412d0aa tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:34.004680 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-236074e9-f6e1-41bc-99b3-afd10412d0aa tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:34.005550 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-236074e9-f6e1-41bc-99b3-afd10412d0aa tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:34.005995 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-236074e9-f6e1-41bc-99b3-afd10412d0aa tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:34.036082 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-236074e9-f6e1-41bc-99b3-afd10412d0aa tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] HTTP exception thrown: Instance cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c could not be found. Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-236074e9-f6e1-41bc-99b3-afd10412d0aa tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Request method failure captured: Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c HTTP/1.1 Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q4n_GLv427uSoooHGGe9soSmjgDeZCGUQueNy_xefyEgT-hSczU2kL3hiXWGeYfdKN8k2BuCstNXM98_x-OYwwQ0qAirrTIoXCChnna0H4neT9udv1ZiUItYpB2Emh8V7JLfjmknmcgS6w8ksKxU_IdJSwJPWFMtYFf7L60cdnHC6o Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 649465d992d749eca5d73d30e61ab62e Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerActionsTestJSON-1540418270 Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/649465d992d749eca5d73d30e61ab62e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/649465d992d749eca5d73d30e61ab62e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_649465d992d749eca5d73d30e61ab62e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/649465d992d749eca5d73d30e61ab62e"}]}] Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerActionsTestJSON-1540418270 Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 649465d992d749eca5d73d30e61ab62e Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerActionsTestJSON-1540418270 Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerActionsTestJSON-1540418270-project Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 72d5f52dd1ae4cf999f7df131b70223c Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerActionsTestJSON-1540418270-project Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c could not be found. Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c'} Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c could not be found. Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c could not be found. Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:02:34.047867 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:02:34.051893 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:02:34.051893 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:02:34.051893 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:02:34.051893 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:02:34.051893 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:02:34.051893 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c could not be found. Jul 25 15:02:34.051893 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:02:34.051893 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-236074e9-f6e1-41bc-99b3-afd10412d0aa tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Returning 404 to user: Instance cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:02:34.051893 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-236074e9-f6e1-41bc-99b3-afd10412d0aa tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c" status: 404 len: 111 microversion: 2.1 time: 0.071229 Jul 25 15:02:34.051893 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3248/6276] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:33 2022] GET /compute/v2.1/servers/cd7cf5d1-2d60-48cc-9e0d-2c6e4e34be9c => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:02:34.063500 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cb06d7c1-e07e-4aea-8991-06000df30cbd tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:34.064236 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cb06d7c1-e07e-4aea-8991-06000df30cbd tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:34.075749 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cb06d7c1-e07e-4aea-8991-06000df30cbd tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:34.076969 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cb06d7c1-e07e-4aea-8991-06000df30cbd tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:34.081018 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cb06d7c1-e07e-4aea-8991-06000df30cbd tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:34.084788 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cb06d7c1-e07e-4aea-8991-06000df30cbd tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:34.161402 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cb06d7c1-e07e-4aea-8991-06000df30cbd tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:02:34.379402 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cb06d7c1-e07e-4aea-8991-06000df30cbd tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "DELETE /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b" status: 204 len: 0 microversion: 2.1 time: 0.323315 Jul 25 15:02:34.383000 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3029/6277] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:02:34 2022] DELETE /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:02:34.391967 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-01ef6d51-c4a3-4e93-b196-e5b86ab0c313 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:34.392862 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-01ef6d51-c4a3-4e93-b196-e5b86ab0c313 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:34.409642 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01ef6d51-c4a3-4e93-b196-e5b86ab0c313 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:34.410311 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01ef6d51-c4a3-4e93-b196-e5b86ab0c313 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:34.411491 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01ef6d51-c4a3-4e93-b196-e5b86ab0c313 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:34.412287 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01ef6d51-c4a3-4e93-b196-e5b86ab0c313 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:34.845349 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-01ef6d51-c4a3-4e93-b196-e5b86ab0c313 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:34.862427 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-01ef6d51-c4a3-4e93-b196-e5b86ab0c313 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b" status: 200 len: 1466 microversion: 2.1 time: 0.475069 Jul 25 15:02:34.879084 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3249/6278] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:34 2022] GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b => generated 1466 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:35.892003 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e257f8da-646d-4b95-88d6-b83765d3aab8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:35.892718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e257f8da-646d-4b95-88d6-b83765d3aab8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:35.910355 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e257f8da-646d-4b95-88d6-b83765d3aab8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:35.910802 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e257f8da-646d-4b95-88d6-b83765d3aab8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:35.912329 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e257f8da-646d-4b95-88d6-b83765d3aab8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:35.912782 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e257f8da-646d-4b95-88d6-b83765d3aab8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:36.153836 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e257f8da-646d-4b95-88d6-b83765d3aab8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:36.164911 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e257f8da-646d-4b95-88d6-b83765d3aab8 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b" status: 200 len: 1466 microversion: 2.1 time: 0.281161 Jul 25 15:02:36.165943 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3030/6279] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:35 2022] GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b => generated 1466 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:02:37.187130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-532e713a-8d9b-49cc-8d34-c1daab609c19 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:37.188323 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-532e713a-8d9b-49cc-8d34-c1daab609c19 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:37.205116 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-532e713a-8d9b-49cc-8d34-c1daab609c19 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:37.215467 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-532e713a-8d9b-49cc-8d34-c1daab609c19 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:37.216887 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-532e713a-8d9b-49cc-8d34-c1daab609c19 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:37.218699 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-532e713a-8d9b-49cc-8d34-c1daab609c19 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:37.445089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-532e713a-8d9b-49cc-8d34-c1daab609c19 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:37.456018 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-532e713a-8d9b-49cc-8d34-c1daab609c19 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b" status: 200 len: 1466 microversion: 2.1 time: 0.272899 Jul 25 15:02:37.456632 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3250/6280] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:37 2022] GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b => generated 1466 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:37.783122 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-83634de0-bf6e-4927-8ef7-d8f3a4b28163 req-e54b8574-26b9-4b15-9949-642d23f84c13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b", "name": "network-vif-deleted", "tag": "2097ad1a-8fb6-42db-9f65-5b02443b9e10"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:02:37.799745 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-83634de0-bf6e-4927-8ef7-d8f3a4b28163 req-e54b8574-26b9-4b15-9949-642d23f84c13 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:37.800409 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-83634de0-bf6e-4927-8ef7-d8f3a4b28163 req-e54b8574-26b9-4b15-9949-642d23f84c13 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:37.818143 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-83634de0-bf6e-4927-8ef7-d8f3a4b28163 req-e54b8574-26b9-4b15-9949-642d23f84c13 service nova] Creating event network-vif-deleted:2097ad1a-8fb6-42db-9f65-5b02443b9e10 for instance e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b on n-h1-846435-14 Jul 25 15:02:37.825388 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-83634de0-bf6e-4927-8ef7-d8f3a4b28163 req-e54b8574-26b9-4b15-9949-642d23f84c13 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054051 Jul 25 15:02:37.826594 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3031/6281] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:02:38.480485 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d0011e2e-765f-413e-af34-34827dbeb0aa tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:38.481162 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d0011e2e-765f-413e-af34-34827dbeb0aa tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:38.495985 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d0011e2e-765f-413e-af34-34827dbeb0aa tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:38.499670 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d0011e2e-765f-413e-af34-34827dbeb0aa tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:38.500585 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d0011e2e-765f-413e-af34-34827dbeb0aa tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:38.501015 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d0011e2e-765f-413e-af34-34827dbeb0aa tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:38.550612 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-d0011e2e-765f-413e-af34-34827dbeb0aa tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] HTTP exception thrown: Instance e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b could not be found. Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d0011e2e-765f-413e-af34-34827dbeb0aa tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Request method failure captured: Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b HTTP/1.1 Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q4n_GLv427uSoooHGGe9soSmjgDeZCGUQueNy_xefyEgT-hSczU2kL3hiXWGeYfdKN8k2BuCstNXM98_x-OYwwQ0qAirrTIoXCChnna0H4neT9udv1ZiUItYpB2Emh8V7JLfjmknmcgS6w8ksKxU_IdJSwJPWFMtYFf7L60cdnHC6o Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 649465d992d749eca5d73d30e61ab62e Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerActionsTestJSON-1540418270 Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/649465d992d749eca5d73d30e61ab62e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/649465d992d749eca5d73d30e61ab62e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_649465d992d749eca5d73d30e61ab62e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/649465d992d749eca5d73d30e61ab62e"}]}] Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerActionsTestJSON-1540418270 Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 649465d992d749eca5d73d30e61ab62e Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerActionsTestJSON-1540418270 Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerActionsTestJSON-1540418270-project Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 72d5f52dd1ae4cf999f7df131b70223c Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerActionsTestJSON-1540418270-project Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b could not be found. Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b'} Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b could not be found. Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b could not be found. Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:02:38.553678 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:02:38.558762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:02:38.558762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:02:38.558762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:02:38.558762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:02:38.558762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:02:38.558762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b could not be found. Jul 25 15:02:38.558762 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:02:38.564730 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d0011e2e-765f-413e-af34-34827dbeb0aa tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Returning 404 to user: Instance e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:02:38.565926 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d0011e2e-765f-413e-af34-34827dbeb0aa tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b" status: 404 len: 111 microversion: 2.1 time: 0.090671 Jul 25 15:02:38.579864 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c4dccf3b-60bf-4b80-a2d5-a173a8ad62af tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:38.580783 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c4dccf3b-60bf-4b80-a2d5-a173a8ad62af tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:38.594649 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3251/6282] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:38 2022] GET /compute/v2.1/servers/e3de21ec-8fb7-45ad-a0c8-0e17f0d7e74b => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:02:38.602312 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c4dccf3b-60bf-4b80-a2d5-a173a8ad62af tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:38.603699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c4dccf3b-60bf-4b80-a2d5-a173a8ad62af tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:38.605178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c4dccf3b-60bf-4b80-a2d5-a173a8ad62af tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:38.605820 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c4dccf3b-60bf-4b80-a2d5-a173a8ad62af tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:38.641265 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c4dccf3b-60bf-4b80-a2d5-a173a8ad62af tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:02:38.776536 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c4dccf3b-60bf-4b80-a2d5-a173a8ad62af tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "DELETE /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8" status: 204 len: 0 microversion: 2.1 time: 0.202998 Jul 25 15:02:38.777939 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3032/6283] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:02:38 2022] DELETE /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:02:38.787828 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-283e6130-5084-41c0-9735-97660691e8a9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:38.788627 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-283e6130-5084-41c0-9735-97660691e8a9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:38.804506 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-283e6130-5084-41c0-9735-97660691e8a9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:38.805063 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-283e6130-5084-41c0-9735-97660691e8a9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:38.805888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-283e6130-5084-41c0-9735-97660691e8a9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:38.806505 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-283e6130-5084-41c0-9735-97660691e8a9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:39.357767 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-283e6130-5084-41c0-9735-97660691e8a9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:39.369391 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-283e6130-5084-41c0-9735-97660691e8a9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8" status: 200 len: 1508 microversion: 2.1 time: 0.587130 Jul 25 15:02:39.372603 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3252/6284] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:38 2022] GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8 => generated 1508 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:02:40.398971 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e3be8b8f-26ff-44ec-895c-ae0747fbf147 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:40.399750 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e3be8b8f-26ff-44ec-895c-ae0747fbf147 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:40.413707 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3be8b8f-26ff-44ec-895c-ae0747fbf147 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:40.414168 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3be8b8f-26ff-44ec-895c-ae0747fbf147 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:40.414974 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3be8b8f-26ff-44ec-895c-ae0747fbf147 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:40.415455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3be8b8f-26ff-44ec-895c-ae0747fbf147 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:40.861296 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e3be8b8f-26ff-44ec-895c-ae0747fbf147 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:40.869991 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e3be8b8f-26ff-44ec-895c-ae0747fbf147 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8" status: 200 len: 1508 microversion: 2.1 time: 0.476571 Jul 25 15:02:40.871593 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3033/6285] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:40 2022] GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8 => generated 1508 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:41.622542 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-781728b3-3e91-41de-818e-b5498813cf9f req-af16c34e-638a-4499-983b-799192801415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c087d29-02f8-4ba4-b67e-33b4b7ad84c8", "name": "network-vif-deleted", "tag": "cf762bd4-1078-44cb-a494-b566822784ae"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:02:41.676104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-781728b3-3e91-41de-818e-b5498813cf9f req-af16c34e-638a-4499-983b-799192801415 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:41.679050 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-781728b3-3e91-41de-818e-b5498813cf9f req-af16c34e-638a-4499-983b-799192801415 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:41.700776 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-781728b3-3e91-41de-818e-b5498813cf9f req-af16c34e-638a-4499-983b-799192801415 service nova] Creating event network-vif-deleted:cf762bd4-1078-44cb-a494-b566822784ae for instance 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8 on n-h1-846435-14 Jul 25 15:02:41.707899 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-781728b3-3e91-41de-818e-b5498813cf9f req-af16c34e-638a-4499-983b-799192801415 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104865 Jul 25 15:02:41.708957 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3253/6286] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:02:41.892827 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-660480a3-ab8f-435a-bf40-4657898b26ee tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:41.898875 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-660480a3-ab8f-435a-bf40-4657898b26ee tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:41.917412 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-660480a3-ab8f-435a-bf40-4657898b26ee tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:41.917874 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-660480a3-ab8f-435a-bf40-4657898b26ee tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:41.918668 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-660480a3-ab8f-435a-bf40-4657898b26ee tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:41.919108 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-660480a3-ab8f-435a-bf40-4657898b26ee tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:41.994994 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=18,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:02:42.025421 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-660480a3-ab8f-435a-bf40-4657898b26ee tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:42.025893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-660480a3-ab8f-435a-bf40-4657898b26ee tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:42.026449 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-660480a3-ab8f-435a-bf40-4657898b26ee tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lazy-loading 'fault' on Instance uuid 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:02:42.748791 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-660480a3-ab8f-435a-bf40-4657898b26ee tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:42.766673 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-660480a3-ab8f-435a-bf40-4657898b26ee tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8" status: 200 len: 1304 microversion: 2.1 time: 0.877730 Jul 25 15:02:42.781587 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3034/6287] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:41 2022] GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8 => generated 1304 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:43.790830 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f1488ff3-afac-471b-b65b-ea0473735b98 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:43.792165 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f1488ff3-afac-471b-b65b-ea0473735b98 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:43.804679 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f1488ff3-afac-471b-b65b-ea0473735b98 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:43.811089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f1488ff3-afac-471b-b65b-ea0473735b98 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:43.812705 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f1488ff3-afac-471b-b65b-ea0473735b98 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:43.813605 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f1488ff3-afac-471b-b65b-ea0473735b98 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:43.855520 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-f1488ff3-afac-471b-b65b-ea0473735b98 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] HTTP exception thrown: Instance 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8 could not be found. Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f1488ff3-afac-471b-b65b-ea0473735b98 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Request method failure captured: Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8 HTTP/1.1 Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q4n_GLv427uSoooHGGe9soSmjgDeZCGUQueNy_xefyEgT-hSczU2kL3hiXWGeYfdKN8k2BuCstNXM98_x-OYwwQ0qAirrTIoXCChnna0H4neT9udv1ZiUItYpB2Emh8V7JLfjmknmcgS6w8ksKxU_IdJSwJPWFMtYFf7L60cdnHC6o Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 649465d992d749eca5d73d30e61ab62e Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerActionsTestJSON-1540418270 Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/649465d992d749eca5d73d30e61ab62e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/649465d992d749eca5d73d30e61ab62e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_649465d992d749eca5d73d30e61ab62e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/649465d992d749eca5d73d30e61ab62e"}]}] Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerActionsTestJSON-1540418270 Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 649465d992d749eca5d73d30e61ab62e Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerActionsTestJSON-1540418270 Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerActionsTestJSON-1540418270-project Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 72d5f52dd1ae4cf999f7df131b70223c Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerActionsTestJSON-1540418270-project Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8 could not be found. Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '7c087d29-02f8-4ba4-b67e-33b4b7ad84c8'} Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8 could not be found. Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8 could not be found. Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:02:43.857421 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:02:43.864058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:02:43.864058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:02:43.864058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:02:43.864058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:02:43.864058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:02:43.864058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8 could not be found. Jul 25 15:02:43.864058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:02:43.874808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f1488ff3-afac-471b-b65b-ea0473735b98 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Returning 404 to user: Instance 7c087d29-02f8-4ba4-b67e-33b4b7ad84c8 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:02:43.877242 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f1488ff3-afac-471b-b65b-ea0473735b98 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8" status: 404 len: 111 microversion: 2.1 time: 0.090426 Jul 25 15:02:43.883527 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3254/6288] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:43 2022] GET /compute/v2.1/servers/7c087d29-02f8-4ba4-b67e-33b4b7ad84c8 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:02:43.898182 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f9029a7e-ee73-469b-b7ec-c2d16382928d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:43.898818 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f9029a7e-ee73-469b-b7ec-c2d16382928d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:43.917933 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f9029a7e-ee73-469b-b7ec-c2d16382928d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:43.918681 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f9029a7e-ee73-469b-b7ec-c2d16382928d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:43.919515 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f9029a7e-ee73-469b-b7ec-c2d16382928d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:43.919954 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f9029a7e-ee73-469b-b7ec-c2d16382928d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:43.992075 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f9029a7e-ee73-469b-b7ec-c2d16382928d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:02:44.182743 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f9029a7e-ee73-469b-b7ec-c2d16382928d tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "DELETE /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 204 len: 0 microversion: 2.1 time: 0.293920 Jul 25 15:02:44.183688 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3035/6289] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:02:43 2022] DELETE /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:02:44.192550 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fd39ff53-44f5-4457-ba00-1df862993b50 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:44.193175 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fd39ff53-44f5-4457-ba00-1df862993b50 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:44.209024 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fd39ff53-44f5-4457-ba00-1df862993b50 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:44.209517 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fd39ff53-44f5-4457-ba00-1df862993b50 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:44.210762 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fd39ff53-44f5-4457-ba00-1df862993b50 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:44.211524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fd39ff53-44f5-4457-ba00-1df862993b50 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:44.610986 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ec1850ac-f084-4eab-9ba0-288e0ee6f84a tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Action: 'create', calling method: .version_select at 0x7f46864cc160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-102919637", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAs7wyk++RBnEYwAkpM3ljxb2PUDnY/GIiciXFxnqT9H4ZkXej0ERebhNJFBCJGEcG3x+wnyvo+do21db6lFEXyOlzm0Ls2kCUKUBKt3Ztz1zV2HPOIDCVbmR3QNLnOPyA=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:02:44.642670 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-ec1850ac-f084-4eab-9ba0-288e0ee6f84a tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Getting quotas for project 3a1220781eb4456d9afaca1ebec42203. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:02:44.649714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-ec1850ac-f084-4eab-9ba0-288e0ee6f84a tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Getting quotas for user dd3fdf21e7be4de2817a73d402a34c56 and project 3a1220781eb4456d9afaca1ebec42203. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:02:44.707270 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ec1850ac-f084-4eab-9ba0-288e0ee6f84a tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.100672 Jul 25 15:02:44.715383 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3036/6290] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 15:02:44 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:02:44.749571 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fd39ff53-44f5-4457-ba00-1df862993b50 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:44.758674 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fd39ff53-44f5-4457-ba00-1df862993b50 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 200 len: 1495 microversion: 2.1 time: 0.569965 Jul 25 15:02:44.763715 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3255/6291] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:44 2022] GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 1495 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:45.785428 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-762edbfe-7b68-4c75-b8f2-bf92d8878266 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:45.787461 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-762edbfe-7b68-4c75-b8f2-bf92d8878266 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:45.797290 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-762edbfe-7b68-4c75-b8f2-bf92d8878266 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:45.797964 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-762edbfe-7b68-4c75-b8f2-bf92d8878266 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:45.799454 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-762edbfe-7b68-4c75-b8f2-bf92d8878266 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:45.799736 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-762edbfe-7b68-4c75-b8f2-bf92d8878266 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:46.092294 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-762edbfe-7b68-4c75-b8f2-bf92d8878266 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:46.105892 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-762edbfe-7b68-4c75-b8f2-bf92d8878266 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 200 len: 1453 microversion: 2.1 time: 0.325204 Jul 25 15:02:46.116781 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3037/6292] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:45 2022] GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 1453 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:46.256733 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-242a9353-30cc-4d7a-b358-f9df65eb0112 req-12b57ba6-04ac-4585-b181-83773bbcaaf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb5bcc4-4054-4195-9e38-af9363c52a64", "name": "network-vif-deleted", "tag": "e9f7bebc-006c-4e01-866f-4ca11248affc"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:02:46.283231 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-242a9353-30cc-4d7a-b358-f9df65eb0112 req-12b57ba6-04ac-4585-b181-83773bbcaaf4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:46.283674 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-242a9353-30cc-4d7a-b358-f9df65eb0112 req-12b57ba6-04ac-4585-b181-83773bbcaaf4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:46.349850 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-242a9353-30cc-4d7a-b358-f9df65eb0112 req-12b57ba6-04ac-4585-b181-83773bbcaaf4 service nova] Creating event network-vif-deleted:e9f7bebc-006c-4e01-866f-4ca11248affc for instance 7eb5bcc4-4054-4195-9e38-af9363c52a64 on n-h1-846435-14 Jul 25 15:02:46.407290 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-242a9353-30cc-4d7a-b358-f9df65eb0112 req-12b57ba6-04ac-4585-b181-83773bbcaaf4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132407 Jul 25 15:02:46.408031 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3256/6293] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:02:47.143221 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e98ef706-a43c-4151-b33e-749dcf2ceaa9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:47.165702 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e98ef706-a43c-4151-b33e-749dcf2ceaa9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 7eb5bcc4-4054-4195-9e38-af9363c52a64] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:47.192708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e98ef706-a43c-4151-b33e-749dcf2ceaa9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:47.195316 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e98ef706-a43c-4151-b33e-749dcf2ceaa9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:47.197452 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e98ef706-a43c-4151-b33e-749dcf2ceaa9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:47.198071 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e98ef706-a43c-4151-b33e-749dcf2ceaa9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:47.269453 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-e98ef706-a43c-4151-b33e-749dcf2ceaa9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] HTTP exception thrown: Instance 7eb5bcc4-4054-4195-9e38-af9363c52a64 could not be found. Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e98ef706-a43c-4151-b33e-749dcf2ceaa9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Request method failure captured: Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 HTTP/1.1 Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q4n_GLv427uSoooHGGe9soSmjgDeZCGUQueNy_xefyEgT-hSczU2kL3hiXWGeYfdKN8k2BuCstNXM98_x-OYwwQ0qAirrTIoXCChnna0H4neT9udv1ZiUItYpB2Emh8V7JLfjmknmcgS6w8ksKxU_IdJSwJPWFMtYFf7L60cdnHC6o Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 649465d992d749eca5d73d30e61ab62e Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServerActionsTestJSON-1540418270 Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/649465d992d749eca5d73d30e61ab62e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/649465d992d749eca5d73d30e61ab62e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_649465d992d749eca5d73d30e61ab62e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/649465d992d749eca5d73d30e61ab62e"}]}] Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServerActionsTestJSON-1540418270 Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 649465d992d749eca5d73d30e61ab62e Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServerActionsTestJSON-1540418270 Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServerActionsTestJSON-1540418270-project Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 72d5f52dd1ae4cf999f7df131b70223c Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServerActionsTestJSON-1540418270-project Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 7eb5bcc4-4054-4195-9e38-af9363c52a64 could not be found. Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '7eb5bcc4-4054-4195-9e38-af9363c52a64'} Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7eb5bcc4-4054-4195-9e38-af9363c52a64 could not be found. Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eb5bcc4-4054-4195-9e38-af9363c52a64 could not be found. Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:02:47.271463 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:02:47.276073 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:02:47.276073 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:02:47.276073 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:02:47.276073 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:02:47.276073 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:02:47.276073 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eb5bcc4-4054-4195-9e38-af9363c52a64 could not be found. Jul 25 15:02:47.276073 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:02:47.276073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e98ef706-a43c-4151-b33e-749dcf2ceaa9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Returning 404 to user: Instance 7eb5bcc4-4054-4195-9e38-af9363c52a64 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:02:47.276600 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e98ef706-a43c-4151-b33e-749dcf2ceaa9 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64" status: 404 len: 111 microversion: 2.1 time: 0.137224 Jul 25 15:02:47.277613 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3038/6294] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:47 2022] GET /compute/v2.1/servers/7eb5bcc4-4054-4195-9e38-af9363c52a64 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:02:47.285933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a7c1a906-553d-436c-b389-f771ae913db3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:47.287717 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a7c1a906-553d-436c-b389-f771ae913db3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:47.299427 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a7c1a906-553d-436c-b389-f771ae913db3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:47.308587 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a7c1a906-553d-436c-b389-f771ae913db3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:47.309723 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a7c1a906-553d-436c-b389-f771ae913db3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:47.310352 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a7c1a906-553d-436c-b389-f771ae913db3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:47.363275 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a7c1a906-553d-436c-b389-f771ae913db3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:02:47.531520 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a7c1a906-553d-436c-b389-f771ae913db3 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "DELETE /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 204 len: 0 microversion: 2.1 time: 0.249578 Jul 25 15:02:47.535234 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3257/6295] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:02:47 2022] DELETE /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 15:02:47.544246 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-82266a76-eaae-43ea-99fa-b4561fbe6d3e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:47.545032 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-82266a76-eaae-43ea-99fa-b4561fbe6d3e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:47.552094 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-82266a76-eaae-43ea-99fa-b4561fbe6d3e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:47.552858 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-82266a76-eaae-43ea-99fa-b4561fbe6d3e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:47.553769 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-82266a76-eaae-43ea-99fa-b4561fbe6d3e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:47.554341 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-82266a76-eaae-43ea-99fa-b4561fbe6d3e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:47.988162 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-82266a76-eaae-43ea-99fa-b4561fbe6d3e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:48.007330 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-82266a76-eaae-43ea-99fa-b4561fbe6d3e tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1676 microversion: 2.1 time: 0.468790 Jul 25 15:02:48.008302 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3039/6296] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:47 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1676 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:48.741200 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9ebafe22-de9b-4308-8e71-bcb5078020c8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1735467368", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "f3acd132-924e-4ef0-93f3-dceaad541fcd"}], "key_name": "tempest-TestNetworkBasicOps-102919637", "security_groups": [{"name": "tempest-secgroup-smoke-1279629914"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:02:48.767660 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:02:49.037181 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-43c50478-5b62-43ce-b505-cb9fee9af3db tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:49.037889 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-43c50478-5b62-43ce-b505-cb9fee9af3db tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:49.048807 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43c50478-5b62-43ce-b505-cb9fee9af3db tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:49.054644 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43c50478-5b62-43ce-b505-cb9fee9af3db tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:49.055604 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43c50478-5b62-43ce-b505-cb9fee9af3db tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:49.057406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43c50478-5b62-43ce-b505-cb9fee9af3db tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:49.113494 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-9ebafe22-de9b-4308-8e71-bcb5078020c8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] validate_networks() for [('f3acd132-924e-4ef0-93f3-dceaad541fcd', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:02:49.668460 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-43c50478-5b62-43ce-b505-cb9fee9af3db tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:49.680772 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-43c50478-5b62-43ce-b505-cb9fee9af3db tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1676 microversion: 2.1 time: 0.644485 Jul 25 15:02:49.685319 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3040/6297] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:49 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1676 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:50.094147 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-37bfb489-92d6-4d7b-b928-ff628907b067 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:02:50.097371 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-37bfb489-92d6-4d7b-b928-ff628907b067 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:50.116211 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37bfb489-92d6-4d7b-b928-ff628907b067 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:50.116993 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37bfb489-92d6-4d7b-b928-ff628907b067 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:50.120010 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37bfb489-92d6-4d7b-b928-ff628907b067 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:50.122248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37bfb489-92d6-4d7b-b928-ff628907b067 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:50.205233 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-37bfb489-92d6-4d7b-b928-ff628907b067 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "POST /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3/action" status: 200 len: 24566 microversion: 2.1 time: 0.116306 Jul 25 15:02:50.207467 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3041/6298] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:02:50 2022] POST /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3/action => generated 24566 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 15:02:50.606473 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-9ebafe22-de9b-4308-8e71-bcb5078020c8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:02:50.607582 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-9ebafe22-de9b-4308-8e71-bcb5078020c8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:02:50.608288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-9ebafe22-de9b-4308-8e71-bcb5078020c8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:02:50.608869 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-9ebafe22-de9b-4308-8e71-bcb5078020c8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:02:50.609490 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-9ebafe22-de9b-4308-8e71-bcb5078020c8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:02:50.630162 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ebafe22-de9b-4308-8e71-bcb5078020c8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:50.631042 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ebafe22-de9b-4308-8e71-bcb5078020c8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:50.632411 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ebafe22-de9b-4308-8e71-bcb5078020c8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:50.633114 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ebafe22-de9b-4308-8e71-bcb5078020c8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:50.655822 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-9ebafe22-de9b-4308-8e71-bcb5078020c8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Getting quotas for project 3a1220781eb4456d9afaca1ebec42203. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:02:50.663152 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-9ebafe22-de9b-4308-8e71-bcb5078020c8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Getting quotas for user dd3fdf21e7be4de2817a73d402a34c56 and project 3a1220781eb4456d9afaca1ebec42203. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:02:50.680441 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9ebafe22-de9b-4308-8e71-bcb5078020c8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:02:50.683406 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9ebafe22-de9b-4308-8e71-bcb5078020c8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: bb39ac7e-36d6-4887-ab71-fe44f10ae983] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:02:50.708349 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c8206feb-fb8d-4ad4-9d63-69e22226a021 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:50.709081 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c8206feb-fb8d-4ad4-9d63-69e22226a021 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:50.724686 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c8206feb-fb8d-4ad4-9d63-69e22226a021 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:50.725155 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c8206feb-fb8d-4ad4-9d63-69e22226a021 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:50.728301 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c8206feb-fb8d-4ad4-9d63-69e22226a021 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:50.728872 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c8206feb-fb8d-4ad4-9d63-69e22226a021 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:50.778289 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9ebafe22-de9b-4308-8e71-bcb5078020c8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.046865 Jul 25 15:02:50.785792 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3258/6299] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:02:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 2054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:02:50.798623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-82773f85-8575-491b-8a43-c54eddf1b5ad tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:50.801415 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-82773f85-8575-491b-8a43-c54eddf1b5ad tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: bb39ac7e-36d6-4887-ab71-fe44f10ae983] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:50.939435 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-82773f85-8575-491b-8a43-c54eddf1b5ad tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:50.956386 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-82773f85-8575-491b-8a43-c54eddf1b5ad tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983" status: 200 len: 1248 microversion: 2.1 time: 0.153395 Jul 25 15:02:50.957639 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3259/6300] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:50 2022] GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983 => generated 1248 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:51.013766 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c8206feb-fb8d-4ad4-9d63-69e22226a021 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:51.026039 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c8206feb-fb8d-4ad4-9d63-69e22226a021 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1608 microversion: 2.1 time: 0.323497 Jul 25 15:02:51.026954 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3042/6301] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:50 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1608 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:02:51.405425 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-d4d93d32-f5a5-4b35-8d0b-567910488005 req-2fe06dc1-2755-4c6f-9218-a566225cbf16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e054ea1-6a81-43c7-9746-25b466d4647b", "name": "network-vif-deleted", "tag": "24859a24-8dd1-490f-b1c7-01178f7f59b2"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:02:51.430256 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-d4d93d32-f5a5-4b35-8d0b-567910488005 req-2fe06dc1-2755-4c6f-9218-a566225cbf16 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:51.431034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-d4d93d32-f5a5-4b35-8d0b-567910488005 req-2fe06dc1-2755-4c6f-9218-a566225cbf16 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:51.456736 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-d4d93d32-f5a5-4b35-8d0b-567910488005 req-2fe06dc1-2755-4c6f-9218-a566225cbf16 service nova] Creating event network-vif-deleted:24859a24-8dd1-490f-b1c7-01178f7f59b2 for instance 9e054ea1-6a81-43c7-9746-25b466d4647b on n-h2-846435-14 Jul 25 15:02:51.464550 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-d4d93d32-f5a5-4b35-8d0b-567910488005 req-2fe06dc1-2755-4c6f-9218-a566225cbf16 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062531 Jul 25 15:02:51.465396 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3260/6302] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:02:51.979429 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a5c7b84e-9edc-4d9b-8225-6152b8cc97a5 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:51.980739 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a5c7b84e-9edc-4d9b-8225-6152b8cc97a5 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: bb39ac7e-36d6-4887-ab71-fe44f10ae983] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:51.988016 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a5c7b84e-9edc-4d9b-8225-6152b8cc97a5 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:51.989452 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a5c7b84e-9edc-4d9b-8225-6152b8cc97a5 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:51.990448 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a5c7b84e-9edc-4d9b-8225-6152b8cc97a5 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:51.991280 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a5c7b84e-9edc-4d9b-8225-6152b8cc97a5 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:52.066906 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-22ed9f97-ae05-4830-b23c-f3837d941514 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:52.068556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-22ed9f97-ae05-4830-b23c-f3837d941514 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:52.083072 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-22ed9f97-ae05-4830-b23c-f3837d941514 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:52.085771 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-22ed9f97-ae05-4830-b23c-f3837d941514 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:52.086755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-22ed9f97-ae05-4830-b23c-f3837d941514 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:52.087378 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-22ed9f97-ae05-4830-b23c-f3837d941514 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:52.144197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-22ed9f97-ae05-4830-b23c-f3837d941514 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:52.144935 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-22ed9f97-ae05-4830-b23c-f3837d941514 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:52.145539 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-22ed9f97-ae05-4830-b23c-f3837d941514 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lazy-loading 'fault' on Instance uuid 9e054ea1-6a81-43c7-9746-25b466d4647b {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:02:52.264636 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a5c7b84e-9edc-4d9b-8225-6152b8cc97a5 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:52.293649 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a5c7b84e-9edc-4d9b-8225-6152b8cc97a5 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983" status: 200 len: 1252 microversion: 2.1 time: 0.316176 Jul 25 15:02:52.308565 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3043/6303] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:51 2022] GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983 => generated 1252 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:52.352849 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-22ed9f97-ae05-4830-b23c-f3837d941514 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5f52dd1ae4cf999f7df131b70223c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649465d992d749eca5d73d30e61ab62e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:52.368875 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-22ed9f97-ae05-4830-b23c-f3837d941514 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 200 len: 1327 microversion: 2.1 time: 0.311936 Jul 25 15:02:52.393154 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3261/6304] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:52 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 1327 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:53.323186 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b218d287-8a68-4cb9-817d-2b1254dd5233 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:53.324262 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b218d287-8a68-4cb9-817d-2b1254dd5233 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: bb39ac7e-36d6-4887-ab71-fe44f10ae983] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:53.347402 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b218d287-8a68-4cb9-817d-2b1254dd5233 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:53.348011 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b218d287-8a68-4cb9-817d-2b1254dd5233 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:53.349294 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b218d287-8a68-4cb9-817d-2b1254dd5233 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:53.349733 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b218d287-8a68-4cb9-817d-2b1254dd5233 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:53.393884 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b50b216e-ca3b-49f7-aed7-13aa84518059 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:53.404954 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b50b216e-ca3b-49f7-aed7-13aa84518059 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] [instance: 9e054ea1-6a81-43c7-9746-25b466d4647b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:53.414158 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b50b216e-ca3b-49f7-aed7-13aa84518059 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:53.460416 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b50b216e-ca3b-49f7-aed7-13aa84518059 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:53.464843 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b50b216e-ca3b-49f7-aed7-13aa84518059 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:53.467607 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b50b216e-ca3b-49f7-aed7-13aa84518059 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:53.491749 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-b50b216e-ca3b-49f7-aed7-13aa84518059 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] HTTP exception thrown: Instance 9e054ea1-6a81-43c7-9746-25b466d4647b could not be found. Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b50b216e-ca3b-49f7-aed7-13aa84518059 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Request method failure captured: Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b HTTP/1.1 Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3q4n_GLv427uSoooHGGe9soSmjgDeZCGUQueNy_xefyEgT-hSczU2kL3hiXWGeYfdKN8k2BuCstNXM98_x-OYwwQ0qAirrTIoXCChnna0H4neT9udv1ZiUItYpB2Emh8V7JLfjmknmcgS6w8ksKxU_IdJSwJPWFMtYFf7L60cdnHC6o Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 649465d992d749eca5d73d30e61ab62e Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerActionsTestJSON-1540418270 Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/649465d992d749eca5d73d30e61ab62e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/649465d992d749eca5d73d30e61ab62e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_649465d992d749eca5d73d30e61ab62e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/649465d992d749eca5d73d30e61ab62e"}]}] Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerActionsTestJSON-1540418270 Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 649465d992d749eca5d73d30e61ab62e Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerActionsTestJSON-1540418270 Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerActionsTestJSON-1540418270-project Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 72d5f52dd1ae4cf999f7df131b70223c Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerActionsTestJSON-1540418270-project Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 9e054ea1-6a81-43c7-9746-25b466d4647b could not be found. Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '9e054ea1-6a81-43c7-9746-25b466d4647b'} Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e054ea1-6a81-43c7-9746-25b466d4647b could not be found. Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e054ea1-6a81-43c7-9746-25b466d4647b could not be found. Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:02:53.498481 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:02:53.502198 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:02:53.502198 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:02:53.502198 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:02:53.502198 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:02:53.502198 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:02:53.502198 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e054ea1-6a81-43c7-9746-25b466d4647b could not be found. Jul 25 15:02:53.502198 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:02:53.502198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b50b216e-ca3b-49f7-aed7-13aa84518059 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Returning 404 to user: Instance 9e054ea1-6a81-43c7-9746-25b466d4647b could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:02:53.502635 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b50b216e-ca3b-49f7-aed7-13aa84518059 tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b" status: 404 len: 111 microversion: 2.1 time: 0.113294 Jul 25 15:02:53.508156 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3262/6305] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:53 2022] GET /compute/v2.1/servers/9e054ea1-6a81-43c7-9746-25b466d4647b => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:02:53.515031 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2f26a01f-b5a7-425d-8df9-670d6432372f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] Calling method '.version_select at 0x7f4685f609d0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:53.571191 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2f26a01f-b5a7-425d-8df9-670d6432372f tempest-ServerActionsTestJSON-1540418270 tempest-ServerActionsTestJSON-1540418270-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1648294775" status: 202 len: 0 microversion: 2.1 time: 0.055037 Jul 25 15:02:53.574578 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3263/6306] 10.222.0.88 () {58 vars in 1221 bytes} [Mon Jul 25 15:02:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1648294775 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:02:53.718716 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b218d287-8a68-4cb9-817d-2b1254dd5233 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:53.732995 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b218d287-8a68-4cb9-817d-2b1254dd5233 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983" status: 200 len: 1306 microversion: 2.1 time: 0.417243 Jul 25 15:02:53.733774 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3044/6307] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:53 2022] GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983 => generated 1306 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:54.763138 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a534f564-e437-4ca3-b9b5-31a1c6f9ee90 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:54.764457 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a534f564-e437-4ca3-b9b5-31a1c6f9ee90 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: bb39ac7e-36d6-4887-ab71-fe44f10ae983] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:54.791698 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a534f564-e437-4ca3-b9b5-31a1c6f9ee90 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:54.795428 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a534f564-e437-4ca3-b9b5-31a1c6f9ee90 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:54.796557 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a534f564-e437-4ca3-b9b5-31a1c6f9ee90 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:54.802736 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a534f564-e437-4ca3-b9b5-31a1c6f9ee90 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:55.260591 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a534f564-e437-4ca3-b9b5-31a1c6f9ee90 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:55.276270 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a534f564-e437-4ca3-b9b5-31a1c6f9ee90 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983" status: 200 len: 1374 microversion: 2.1 time: 0.521048 Jul 25 15:02:55.278382 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3264/6308] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:54 2022] GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983 => generated 1374 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:55.940706 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-81527295-808c-4c40-807f-1067b1c028ee req-489042d2-ade7-4739-88ca-941fa02cadd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb39ac7e-36d6-4887-ab71-fe44f10ae983", "tag": "72182f1a-15f1-483b-a1b7-e271ccd2cda5"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:02:55.947806 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:02:56.002128 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-81527295-808c-4c40-807f-1067b1c028ee req-489042d2-ade7-4739-88ca-941fa02cadd1 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:56.002860 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-81527295-808c-4c40-807f-1067b1c028ee req-489042d2-ade7-4739-88ca-941fa02cadd1 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:56.030747 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-81527295-808c-4c40-807f-1067b1c028ee req-489042d2-ade7-4739-88ca-941fa02cadd1 service nova] Creating event network-changed:72182f1a-15f1-483b-a1b7-e271ccd2cda5 for instance bb39ac7e-36d6-4887-ab71-fe44f10ae983 on n-h1-846435-14 Jul 25 15:02:56.037049 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-81527295-808c-4c40-807f-1067b1c028ee req-489042d2-ade7-4739-88ca-941fa02cadd1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099888 Jul 25 15:02:56.037995 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3045/6309] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:02:56.301692 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d99aaa6f-7a02-48ec-aae6-b8dcfd7ad0e6 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:56.302321 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d99aaa6f-7a02-48ec-aae6-b8dcfd7ad0e6 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: bb39ac7e-36d6-4887-ab71-fe44f10ae983] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:56.312259 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d99aaa6f-7a02-48ec-aae6-b8dcfd7ad0e6 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:56.312717 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d99aaa6f-7a02-48ec-aae6-b8dcfd7ad0e6 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:56.318813 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d99aaa6f-7a02-48ec-aae6-b8dcfd7ad0e6 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:56.319652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d99aaa6f-7a02-48ec-aae6-b8dcfd7ad0e6 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:57.039444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d99aaa6f-7a02-48ec-aae6-b8dcfd7ad0e6 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:57.047571 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d99aaa6f-7a02-48ec-aae6-b8dcfd7ad0e6 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983" status: 200 len: 1374 microversion: 2.1 time: 0.750669 Jul 25 15:02:57.049633 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3265/6310] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:56 2022] GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983 => generated 1374 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:58.072979 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5bdb6693-b55c-4e48-8bb1-b5cc3e5b4b9d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:58.073619 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5bdb6693-b55c-4e48-8bb1-b5cc3e5b4b9d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: bb39ac7e-36d6-4887-ab71-fe44f10ae983] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:58.080634 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=4,nova_api:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:02:58.084604 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5bdb6693-b55c-4e48-8bb1-b5cc3e5b4b9d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:58.085326 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5bdb6693-b55c-4e48-8bb1-b5cc3e5b4b9d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:58.086854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5bdb6693-b55c-4e48-8bb1-b5cc3e5b4b9d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:58.087607 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5bdb6693-b55c-4e48-8bb1-b5cc3e5b4b9d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:58.531754 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5bdb6693-b55c-4e48-8bb1-b5cc3e5b4b9d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:02:58.545618 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5bdb6693-b55c-4e48-8bb1-b5cc3e5b4b9d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983" status: 200 len: 1374 microversion: 2.1 time: 0.473686 Jul 25 15:02:58.557400 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3046/6311] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:58 2022] GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983 => generated 1374 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:02:59.574684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0f2cade1-0fd0-46d9-a913-2b649172ab8b tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:02:59.575297 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0f2cade1-0fd0-46d9-a913-2b649172ab8b tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: bb39ac7e-36d6-4887-ab71-fe44f10ae983] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:02:59.587327 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0f2cade1-0fd0-46d9-a913-2b649172ab8b tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:59.590249 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0f2cade1-0fd0-46d9-a913-2b649172ab8b tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:59.592389 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0f2cade1-0fd0-46d9-a913-2b649172ab8b tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:02:59.594425 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0f2cade1-0fd0-46d9-a913-2b649172ab8b tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:02:59.990382 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0f2cade1-0fd0-46d9-a913-2b649172ab8b tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:00.005720 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0f2cade1-0fd0-46d9-a913-2b649172ab8b tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983" status: 200 len: 1374 microversion: 2.1 time: 0.435836 Jul 25 15:03:00.012305 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3266/6312] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:02:59 2022] GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983 => generated 1374 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:03:01.037713 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3afc901b-58d6-4430-91b1-475b84b865be tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:01.038457 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3afc901b-58d6-4430-91b1-475b84b865be tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: bb39ac7e-36d6-4887-ab71-fe44f10ae983] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:01.051599 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3afc901b-58d6-4430-91b1-475b84b865be tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:01.051599 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3afc901b-58d6-4430-91b1-475b84b865be tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:01.051599 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3afc901b-58d6-4430-91b1-475b84b865be tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:01.051599 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3afc901b-58d6-4430-91b1-475b84b865be tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:01.658687 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3afc901b-58d6-4430-91b1-475b84b865be tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:01.667859 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3afc901b-58d6-4430-91b1-475b84b865be tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983" status: 200 len: 1374 microversion: 2.1 time: 0.634809 Jul 25 15:03:01.681329 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3047/6313] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:03:01 2022] GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983 => generated 1374 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:03:01.751431 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-66c8fa8b-6347-48bc-8d61-bf1994ec56c5 req-92445446-9107-4de8-a492-68922285765b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb39ac7e-36d6-4887-ab71-fe44f10ae983", "name": "network-vif-plugged", "status": "completed", "tag": "72182f1a-15f1-483b-a1b7-e271ccd2cda5"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:03:01.769776 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:03:01.775698 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=8 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:03:01.787468 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-66c8fa8b-6347-48bc-8d61-bf1994ec56c5 req-92445446-9107-4de8-a492-68922285765b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:01.788602 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-66c8fa8b-6347-48bc-8d61-bf1994ec56c5 req-92445446-9107-4de8-a492-68922285765b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:01.794679 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:03:01.831920 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-66c8fa8b-6347-48bc-8d61-bf1994ec56c5 req-92445446-9107-4de8-a492-68922285765b service nova] Creating event network-vif-plugged:72182f1a-15f1-483b-a1b7-e271ccd2cda5 for instance bb39ac7e-36d6-4887-ab71-fe44f10ae983 on n-h1-846435-14 Jul 25 15:03:01.849570 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-66c8fa8b-6347-48bc-8d61-bf1994ec56c5 req-92445446-9107-4de8-a492-68922285765b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103043 Jul 25 15:03:01.851171 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3267/6314] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:03:02.706716 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f5abff49-7cc7-4f1a-843d-4b2a93a29b6d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:02.707393 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f5abff49-7cc7-4f1a-843d-4b2a93a29b6d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: bb39ac7e-36d6-4887-ab71-fe44f10ae983] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:02.721300 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f5abff49-7cc7-4f1a-843d-4b2a93a29b6d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:02.722396 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f5abff49-7cc7-4f1a-843d-4b2a93a29b6d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:02.728162 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f5abff49-7cc7-4f1a-843d-4b2a93a29b6d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:02.728829 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f5abff49-7cc7-4f1a-843d-4b2a93a29b6d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:03.064231 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f5abff49-7cc7-4f1a-843d-4b2a93a29b6d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:03.073125 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f5abff49-7cc7-4f1a-843d-4b2a93a29b6d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983" status: 200 len: 1374 microversion: 2.1 time: 0.374537 Jul 25 15:03:03.082691 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3048/6315] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:03:02 2022] GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983 => generated 1374 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:03:04.106512 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-affcc080-9e7c-4334-bd20-18113cf82f33 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:04.107243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-affcc080-9e7c-4334-bd20-18113cf82f33 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: bb39ac7e-36d6-4887-ab71-fe44f10ae983] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:04.130326 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-affcc080-9e7c-4334-bd20-18113cf82f33 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:04.133018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-affcc080-9e7c-4334-bd20-18113cf82f33 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:04.134089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-affcc080-9e7c-4334-bd20-18113cf82f33 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:04.135657 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-affcc080-9e7c-4334-bd20-18113cf82f33 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:04.468145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-affcc080-9e7c-4334-bd20-18113cf82f33 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:04.477790 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-affcc080-9e7c-4334-bd20-18113cf82f33 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983" status: 200 len: 1546 microversion: 2.1 time: 0.376857 Jul 25 15:03:04.478513 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3268/6316] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:03:04 2022] GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983 => generated 1546 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:03:04.502994 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-421ca9ee-5e3b-4405-99d4-333a6809867d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:04.504929 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-421ca9ee-5e3b-4405-99d4-333a6809867d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: bb39ac7e-36d6-4887-ab71-fe44f10ae983] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:04.519139 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-421ca9ee-5e3b-4405-99d4-333a6809867d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:04.521738 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-421ca9ee-5e3b-4405-99d4-333a6809867d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:04.524540 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-421ca9ee-5e3b-4405-99d4-333a6809867d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:04.524997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-421ca9ee-5e3b-4405-99d4-333a6809867d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:04.815714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-421ca9ee-5e3b-4405-99d4-333a6809867d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:04.828018 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-421ca9ee-5e3b-4405-99d4-333a6809867d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983" status: 200 len: 1546 microversion: 2.1 time: 0.330480 Jul 25 15:03:04.828872 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3049/6317] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:03:04 2022] GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983 => generated 1546 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:03:05.653574 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ccb4523f-2667-44d2-bbf5-406b1aa8ed94 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1322454202", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": "none"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:03:05.740070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-ccb4523f-2667-44d2-bbf5-406b1aa8ed94 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:03:05.741573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-ccb4523f-2667-44d2-bbf5-406b1aa8ed94 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:03:05.742419 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-ccb4523f-2667-44d2-bbf5-406b1aa8ed94 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:03:05.743503 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-ccb4523f-2667-44d2-bbf5-406b1aa8ed94 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:03:05.744185 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-ccb4523f-2667-44d2-bbf5-406b1aa8ed94 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:03:05.756032 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ccb4523f-2667-44d2-bbf5-406b1aa8ed94 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:05.757209 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ccb4523f-2667-44d2-bbf5-406b1aa8ed94 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:05.758239 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ccb4523f-2667-44d2-bbf5-406b1aa8ed94 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:05.759008 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ccb4523f-2667-44d2-bbf5-406b1aa8ed94 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:05.781966 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-ccb4523f-2667-44d2-bbf5-406b1aa8ed94 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Getting quotas for project a4ef6b5f61074bc6aa362c42f5d0e80d. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:03:05.788469 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-ccb4523f-2667-44d2-bbf5-406b1aa8ed94 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Getting quotas for user 789a97673faf49779c8dca3aa7299ecc and project a4ef6b5f61074bc6aa362c42f5d0e80d. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:03:05.803747 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ccb4523f-2667-44d2-bbf5-406b1aa8ed94 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:03:05.806831 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ccb4523f-2667-44d2-bbf5-406b1aa8ed94 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:03:05.908593 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ccb4523f-2667-44d2-bbf5-406b1aa8ed94 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.491777 Jul 25 15:03:05.920760 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3921f2a9-072f-452d-9153-a678e69c0a15 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:05.921452 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3921f2a9-072f-452d-9153-a678e69c0a15 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:05.929198 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3269/6318] 10.222.0.88 () {62 vars in 1188 bytes} [Mon Jul 25 15:03:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 15:03:06.032352 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3921f2a9-072f-452d-9153-a678e69c0a15 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:06.042413 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3921f2a9-072f-452d-9153-a678e69c0a15 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:06.050610 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3921f2a9-072f-452d-9153-a678e69c0a15 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:06.053011 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3921f2a9-072f-452d-9153-a678e69c0a15 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1278 microversion: 2.57 time: 0.136525 Jul 25 15:03:06.057243 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3050/6319] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:05 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1278 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 15:03:07.082557 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-82fa1d2f-a96c-4025-8fd2-b6338b203444 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:07.083609 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-82fa1d2f-a96c-4025-8fd2-b6338b203444 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:07.100193 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-82fa1d2f-a96c-4025-8fd2-b6338b203444 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:07.102430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-82fa1d2f-a96c-4025-8fd2-b6338b203444 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:07.103556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-82fa1d2f-a96c-4025-8fd2-b6338b203444 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:07.104392 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-82fa1d2f-a96c-4025-8fd2-b6338b203444 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:07.386980 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-82fa1d2f-a96c-4025-8fd2-b6338b203444 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:07.421969 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-82fa1d2f-a96c-4025-8fd2-b6338b203444 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:07.450114 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-82fa1d2f-a96c-4025-8fd2-b6338b203444 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:07.456959 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-82fa1d2f-a96c-4025-8fd2-b6338b203444 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1330 microversion: 2.57 time: 0.378284 Jul 25 15:03:07.457683 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3270/6320] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:07 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1330 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:08.485148 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3c3b6146-bd2d-48d5-a832-599ebf8ff89f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:08.485771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3c3b6146-bd2d-48d5-a832-599ebf8ff89f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:08.503800 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c3b6146-bd2d-48d5-a832-599ebf8ff89f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:08.504304 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c3b6146-bd2d-48d5-a832-599ebf8ff89f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:08.505085 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c3b6146-bd2d-48d5-a832-599ebf8ff89f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:08.505520 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c3b6146-bd2d-48d5-a832-599ebf8ff89f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:08.659918 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3c3b6146-bd2d-48d5-a832-599ebf8ff89f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:08.672076 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3c3b6146-bd2d-48d5-a832-599ebf8ff89f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:08.673668 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3c3b6146-bd2d-48d5-a832-599ebf8ff89f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:08.674837 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3c3b6146-bd2d-48d5-a832-599ebf8ff89f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1336 microversion: 2.57 time: 0.194167 Jul 25 15:03:08.692723 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3051/6321] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:08 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1336 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:09.331910 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-2b547461-ae2f-455f-8c21-d38322c67e74 req-72e19455-6211-4ae4-9038-89fa0e841f52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb39ac7e-36d6-4887-ab71-fe44f10ae983", "tag": "72182f1a-15f1-483b-a1b7-e271ccd2cda5"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:03:09.343120 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-2b547461-ae2f-455f-8c21-d38322c67e74 req-72e19455-6211-4ae4-9038-89fa0e841f52 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:09.343856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-2b547461-ae2f-455f-8c21-d38322c67e74 req-72e19455-6211-4ae4-9038-89fa0e841f52 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:09.356557 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-2b547461-ae2f-455f-8c21-d38322c67e74 req-72e19455-6211-4ae4-9038-89fa0e841f52 service nova] Creating event network-changed:72182f1a-15f1-483b-a1b7-e271ccd2cda5 for instance bb39ac7e-36d6-4887-ab71-fe44f10ae983 on n-h1-846435-14 Jul 25 15:03:09.363058 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-2b547461-ae2f-455f-8c21-d38322c67e74 req-72e19455-6211-4ae4-9038-89fa0e841f52 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034642 Jul 25 15:03:09.364902 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3271/6322] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:03:09.705892 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0c57317c-83ca-4c66-abbb-0d79843da8d8 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:09.706932 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0c57317c-83ca-4c66-abbb-0d79843da8d8 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:09.716835 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0c57317c-83ca-4c66-abbb-0d79843da8d8 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:09.717626 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0c57317c-83ca-4c66-abbb-0d79843da8d8 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:09.718570 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0c57317c-83ca-4c66-abbb-0d79843da8d8 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:09.719339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0c57317c-83ca-4c66-abbb-0d79843da8d8 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:09.878694 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0c57317c-83ca-4c66-abbb-0d79843da8d8 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:09.888805 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:03:09.900214 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0c57317c-83ca-4c66-abbb-0d79843da8d8 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:09.902320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0c57317c-83ca-4c66-abbb-0d79843da8d8 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:09.904158 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0c57317c-83ca-4c66-abbb-0d79843da8d8 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1336 microversion: 2.57 time: 0.202382 Jul 25 15:03:09.905757 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3052/6323] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:09 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1336 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 15:03:10.929718 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b87e64c0-db3f-4026-8cc4-191f3b2783e7 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:10.930652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b87e64c0-db3f-4026-8cc4-191f3b2783e7 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:10.938220 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b87e64c0-db3f-4026-8cc4-191f3b2783e7 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:10.938677 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b87e64c0-db3f-4026-8cc4-191f3b2783e7 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:10.939717 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b87e64c0-db3f-4026-8cc4-191f3b2783e7 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:10.940185 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b87e64c0-db3f-4026-8cc4-191f3b2783e7 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:11.074131 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b87e64c0-db3f-4026-8cc4-191f3b2783e7 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:11.125323 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b87e64c0-db3f-4026-8cc4-191f3b2783e7 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:11.130300 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b87e64c0-db3f-4026-8cc4-191f3b2783e7 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:11.140779 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b87e64c0-db3f-4026-8cc4-191f3b2783e7 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1336 microversion: 2.57 time: 0.214916 Jul 25 15:03:11.144539 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3272/6324] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:10 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1336 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:12.166737 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b9d2a162-dbfa-45a2-8063-6075b1869022 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:12.167354 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b9d2a162-dbfa-45a2-8063-6075b1869022 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:12.191630 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b9d2a162-dbfa-45a2-8063-6075b1869022 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:12.192274 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b9d2a162-dbfa-45a2-8063-6075b1869022 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:12.193395 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b9d2a162-dbfa-45a2-8063-6075b1869022 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:12.193993 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b9d2a162-dbfa-45a2-8063-6075b1869022 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:12.369087 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b9d2a162-dbfa-45a2-8063-6075b1869022 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:12.381379 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b9d2a162-dbfa-45a2-8063-6075b1869022 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:12.389793 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b9d2a162-dbfa-45a2-8063-6075b1869022 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:12.392691 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b9d2a162-dbfa-45a2-8063-6075b1869022 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1357 microversion: 2.57 time: 0.229808 Jul 25 15:03:12.396600 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3053/6325] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:12 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1357 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:12.421623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-94d551f6-a60e-4bf1-88c9-97913591079b tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:03:12.424575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-94d551f6-a60e-4bf1-88c9-97913591079b tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:12.444539 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94d551f6-a60e-4bf1-88c9-97913591079b tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:12.445230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94d551f6-a60e-4bf1-88c9-97913591079b tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:12.446240 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94d551f6-a60e-4bf1-88c9-97913591079b tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:12.449314 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94d551f6-a60e-4bf1-88c9-97913591079b tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:12.604826 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-94d551f6-a60e-4bf1-88c9-97913591079b tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:03:12.605255 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-94d551f6-a60e-4bf1-88c9-97913591079b tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:03:12.606361 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-94d551f6-a60e-4bf1-88c9-97913591079b tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:03:12.606789 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-94d551f6-a60e-4bf1-88c9-97913591079b tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:03:12.607432 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-94d551f6-a60e-4bf1-88c9-97913591079b tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:03:12.723795 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-94d551f6-a60e-4bf1-88c9-97913591079b tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:12.731922 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94d551f6-a60e-4bf1-88c9-97913591079b tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:12.732730 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94d551f6-a60e-4bf1-88c9-97913591079b tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:12.734078 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94d551f6-a60e-4bf1-88c9-97913591079b tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:12.734716 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94d551f6-a60e-4bf1-88c9-97913591079b tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:12.771289 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-94d551f6-a60e-4bf1-88c9-97913591079b tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "POST /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03/action" status: 202 len: 1138 microversion: 2.57 time: 0.353172 Jul 25 15:03:12.773026 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3273/6326] 10.222.0.88 () {62 vars in 1320 bytes} [Mon Jul 25 15:03:12 2022] POST /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03/action => generated 1138 bytes in 356 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 25 15:03:12.840162 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-56e2a44e-a78d-4b58-bd71-e2a39351abb1 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:12.841247 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-56e2a44e-a78d-4b58-bd71-e2a39351abb1 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:12.878587 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56e2a44e-a78d-4b58-bd71-e2a39351abb1 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:12.886478 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56e2a44e-a78d-4b58-bd71-e2a39351abb1 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:12.897716 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56e2a44e-a78d-4b58-bd71-e2a39351abb1 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:12.916594 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56e2a44e-a78d-4b58-bd71-e2a39351abb1 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:13.328344 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-56e2a44e-a78d-4b58-bd71-e2a39351abb1 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:13.351258 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-56e2a44e-a78d-4b58-bd71-e2a39351abb1 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:13.358925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-56e2a44e-a78d-4b58-bd71-e2a39351abb1 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:13.385688 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-56e2a44e-a78d-4b58-bd71-e2a39351abb1 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1366 microversion: 2.57 time: 0.589927 Jul 25 15:03:13.390372 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3054/6327] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:12 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1366 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:14.415609 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c06d18ef-d7ea-45c9-a209-76aaf9ff2f29 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:14.417597 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c06d18ef-d7ea-45c9-a209-76aaf9ff2f29 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:14.427394 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c06d18ef-d7ea-45c9-a209-76aaf9ff2f29 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:14.428623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c06d18ef-d7ea-45c9-a209-76aaf9ff2f29 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:14.429620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c06d18ef-d7ea-45c9-a209-76aaf9ff2f29 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:14.430267 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c06d18ef-d7ea-45c9-a209-76aaf9ff2f29 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:14.562971 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c06d18ef-d7ea-45c9-a209-76aaf9ff2f29 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:14.573006 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c06d18ef-d7ea-45c9-a209-76aaf9ff2f29 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:14.574734 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c06d18ef-d7ea-45c9-a209-76aaf9ff2f29 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:14.576235 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c06d18ef-d7ea-45c9-a209-76aaf9ff2f29 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1366 microversion: 2.57 time: 0.166572 Jul 25 15:03:14.588732 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3274/6328] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:14 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:15.603353 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-76344777-ed1d-4361-b7af-368f89be0a93 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:15.604197 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-76344777-ed1d-4361-b7af-368f89be0a93 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:15.617178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-76344777-ed1d-4361-b7af-368f89be0a93 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:15.617813 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-76344777-ed1d-4361-b7af-368f89be0a93 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:15.618810 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-76344777-ed1d-4361-b7af-368f89be0a93 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:15.619513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-76344777-ed1d-4361-b7af-368f89be0a93 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:16.036338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:03:16.133871 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-76344777-ed1d-4361-b7af-368f89be0a93 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:16.150038 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-76344777-ed1d-4361-b7af-368f89be0a93 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:16.151684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-76344777-ed1d-4361-b7af-368f89be0a93 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:16.152950 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-76344777-ed1d-4361-b7af-368f89be0a93 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1366 microversion: 2.57 time: 0.554873 Jul 25 15:03:16.160528 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3055/6329] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:15 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1366 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:17.198581 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c0f41bbb-5c5d-4b1a-9d13-597fadd04c3d tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:17.203962 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c0f41bbb-5c5d-4b1a-9d13-597fadd04c3d tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:17.208629 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:03:17.209823 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:03:17.218185 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c0f41bbb-5c5d-4b1a-9d13-597fadd04c3d tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:17.219044 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c0f41bbb-5c5d-4b1a-9d13-597fadd04c3d tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:17.219831 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c0f41bbb-5c5d-4b1a-9d13-597fadd04c3d tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:17.220307 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c0f41bbb-5c5d-4b1a-9d13-597fadd04c3d tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:17.314716 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c0f41bbb-5c5d-4b1a-9d13-597fadd04c3d tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:17.323887 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c0f41bbb-5c5d-4b1a-9d13-597fadd04c3d tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:17.325502 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c0f41bbb-5c5d-4b1a-9d13-597fadd04c3d tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:17.326685 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c0f41bbb-5c5d-4b1a-9d13-597fadd04c3d tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1366 microversion: 2.57 time: 0.142678 Jul 25 15:03:17.340642 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3275/6330] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:17 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:18.355617 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-18e734ae-ad29-4028-96df-647b50feb10b tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:18.356383 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-18e734ae-ad29-4028-96df-647b50feb10b tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:18.364691 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-18e734ae-ad29-4028-96df-647b50feb10b tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:18.365250 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-18e734ae-ad29-4028-96df-647b50feb10b tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:18.365939 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-18e734ae-ad29-4028-96df-647b50feb10b tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:18.366801 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-18e734ae-ad29-4028-96df-647b50feb10b tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:18.491172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-18e734ae-ad29-4028-96df-647b50feb10b tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:18.518004 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-18e734ae-ad29-4028-96df-647b50feb10b tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:18.523755 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-18e734ae-ad29-4028-96df-647b50feb10b tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:18.532322 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-18e734ae-ad29-4028-96df-647b50feb10b tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1366 microversion: 2.57 time: 0.175913 Jul 25 15:03:18.534337 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3056/6331] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:18 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:19.577161 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-51861c5b-2058-4c7a-8180-93abf8e2d164 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:19.579865 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-51861c5b-2058-4c7a-8180-93abf8e2d164 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:19.596376 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:03:19.600946 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51861c5b-2058-4c7a-8180-93abf8e2d164 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:19.601966 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51861c5b-2058-4c7a-8180-93abf8e2d164 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:19.603922 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51861c5b-2058-4c7a-8180-93abf8e2d164 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:19.604961 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51861c5b-2058-4c7a-8180-93abf8e2d164 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:19.698625 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-51861c5b-2058-4c7a-8180-93abf8e2d164 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:19.712370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-51861c5b-2058-4c7a-8180-93abf8e2d164 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:19.719879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-51861c5b-2058-4c7a-8180-93abf8e2d164 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:19.722934 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-51861c5b-2058-4c7a-8180-93abf8e2d164 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1366 microversion: 2.57 time: 0.153079 Jul 25 15:03:19.724645 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3276/6332] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:19 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:20.758153 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e2266a2f-cc1c-48d7-a258-ac6fb3b5a845 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:20.758783 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e2266a2f-cc1c-48d7-a258-ac6fb3b5a845 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:20.771067 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e2266a2f-cc1c-48d7-a258-ac6fb3b5a845 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:20.772570 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e2266a2f-cc1c-48d7-a258-ac6fb3b5a845 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:20.773837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e2266a2f-cc1c-48d7-a258-ac6fb3b5a845 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:20.777360 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e2266a2f-cc1c-48d7-a258-ac6fb3b5a845 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:20.902404 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e2266a2f-cc1c-48d7-a258-ac6fb3b5a845 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:20.917522 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e2266a2f-cc1c-48d7-a258-ac6fb3b5a845 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:20.919789 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e2266a2f-cc1c-48d7-a258-ac6fb3b5a845 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:20.921436 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e2266a2f-cc1c-48d7-a258-ac6fb3b5a845 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1366 microversion: 2.57 time: 0.167825 Jul 25 15:03:20.938593 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3057/6333] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:20 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:21.945283 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-88360a82-cd1e-4321-bf59-8365afd1810f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:21.946054 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-88360a82-cd1e-4321-bf59-8365afd1810f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:21.958358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-88360a82-cd1e-4321-bf59-8365afd1810f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:21.959387 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-88360a82-cd1e-4321-bf59-8365afd1810f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:21.959805 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-88360a82-cd1e-4321-bf59-8365afd1810f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:21.965497 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-88360a82-cd1e-4321-bf59-8365afd1810f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:22.157850 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-88360a82-cd1e-4321-bf59-8365afd1810f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:22.174450 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-88360a82-cd1e-4321-bf59-8365afd1810f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:22.176599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-88360a82-cd1e-4321-bf59-8365afd1810f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:22.180269 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-88360a82-cd1e-4321-bf59-8365afd1810f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1366 microversion: 2.57 time: 0.236878 Jul 25 15:03:22.181122 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3277/6334] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:21 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 15:03:23.209989 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d54249e3-386f-407b-a29f-c4b4a62bbd79 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:23.211224 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d54249e3-386f-407b-a29f-c4b4a62bbd79 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:23.228067 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d54249e3-386f-407b-a29f-c4b4a62bbd79 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:23.228544 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d54249e3-386f-407b-a29f-c4b4a62bbd79 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:23.229355 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d54249e3-386f-407b-a29f-c4b4a62bbd79 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:23.229801 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d54249e3-386f-407b-a29f-c4b4a62bbd79 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:23.318672 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d54249e3-386f-407b-a29f-c4b4a62bbd79 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:23.333813 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d54249e3-386f-407b-a29f-c4b4a62bbd79 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:23.335585 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d54249e3-386f-407b-a29f-c4b4a62bbd79 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:23.337236 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d54249e3-386f-407b-a29f-c4b4a62bbd79 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1366 microversion: 2.57 time: 0.136225 Jul 25 15:03:23.355858 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3058/6335] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:23 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1366 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:24.364006 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-965fe452-43a3-454d-a822-8c85252d3b48 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:24.364616 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-965fe452-43a3-454d-a822-8c85252d3b48 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:24.379123 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-965fe452-43a3-454d-a822-8c85252d3b48 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:24.379593 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-965fe452-43a3-454d-a822-8c85252d3b48 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:24.380615 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-965fe452-43a3-454d-a822-8c85252d3b48 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:24.381195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-965fe452-43a3-454d-a822-8c85252d3b48 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:24.496236 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-965fe452-43a3-454d-a822-8c85252d3b48 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:24.507069 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-965fe452-43a3-454d-a822-8c85252d3b48 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:24.509046 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-965fe452-43a3-454d-a822-8c85252d3b48 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:24.511929 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-965fe452-43a3-454d-a822-8c85252d3b48 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1366 microversion: 2.57 time: 0.152829 Jul 25 15:03:24.528089 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3278/6336] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:24 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:25.537834 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1baf7a15-a93e-4edc-974f-37a8014c7541 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:25.539417 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1baf7a15-a93e-4edc-974f-37a8014c7541 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:25.548848 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1baf7a15-a93e-4edc-974f-37a8014c7541 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:25.549655 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1baf7a15-a93e-4edc-974f-37a8014c7541 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:25.550655 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1baf7a15-a93e-4edc-974f-37a8014c7541 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:25.551387 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1baf7a15-a93e-4edc-974f-37a8014c7541 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:25.870239 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1baf7a15-a93e-4edc-974f-37a8014c7541 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:25.881773 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1baf7a15-a93e-4edc-974f-37a8014c7541 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:25.884183 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1baf7a15-a93e-4edc-974f-37a8014c7541 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:25.886133 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1baf7a15-a93e-4edc-974f-37a8014c7541 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1366 microversion: 2.57 time: 0.351948 Jul 25 15:03:25.887318 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3059/6337] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:25 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1366 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:26.913543 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a563a89f-3b97-4e1b-b955-4c12408d3860 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:26.914825 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a563a89f-3b97-4e1b-b955-4c12408d3860 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:26.933351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a563a89f-3b97-4e1b-b955-4c12408d3860 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:26.934050 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a563a89f-3b97-4e1b-b955-4c12408d3860 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:26.935065 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a563a89f-3b97-4e1b-b955-4c12408d3860 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:26.936957 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a563a89f-3b97-4e1b-b955-4c12408d3860 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:27.121921 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a563a89f-3b97-4e1b-b955-4c12408d3860 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:27.135502 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a563a89f-3b97-4e1b-b955-4c12408d3860 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:27.137810 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a563a89f-3b97-4e1b-b955-4c12408d3860 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:27.139391 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a563a89f-3b97-4e1b-b955-4c12408d3860 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1366 microversion: 2.57 time: 0.230167 Jul 25 15:03:27.154108 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3279/6338] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:26 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:28.173941 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-91658bc4-8908-4ebf-811e-5fc6b2c2e95d tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:28.175094 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-91658bc4-8908-4ebf-811e-5fc6b2c2e95d tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:28.181299 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=30 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:03:28.183274 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-91658bc4-8908-4ebf-811e-5fc6b2c2e95d tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:28.183954 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-91658bc4-8908-4ebf-811e-5fc6b2c2e95d tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:28.184974 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-91658bc4-8908-4ebf-811e-5fc6b2c2e95d tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:28.185409 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-91658bc4-8908-4ebf-811e-5fc6b2c2e95d tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:28.303667 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-91658bc4-8908-4ebf-811e-5fc6b2c2e95d tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:28.313443 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-91658bc4-8908-4ebf-811e-5fc6b2c2e95d tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:28.315291 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-91658bc4-8908-4ebf-811e-5fc6b2c2e95d tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:28.316781 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-91658bc4-8908-4ebf-811e-5fc6b2c2e95d tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1366 microversion: 2.57 time: 0.146766 Jul 25 15:03:28.330106 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3060/6339] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:28 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:29.030573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1afcd8e1-8ec7-4516-b667-69e61058fbf7 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:03:29.061188 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1afcd8e1-8ec7-4516-b667-69e61058fbf7 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: bb39ac7e-36d6-4887-ab71-fe44f10ae983] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:29.116298 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1afcd8e1-8ec7-4516-b667-69e61058fbf7 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:29.120816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1afcd8e1-8ec7-4516-b667-69e61058fbf7 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:29.122204 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1afcd8e1-8ec7-4516-b667-69e61058fbf7 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:29.123653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1afcd8e1-8ec7-4516-b667-69e61058fbf7 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:29.249673 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1afcd8e1-8ec7-4516-b667-69e61058fbf7 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "POST /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983/action" status: 200 len: 24574 microversion: 2.1 time: 0.243556 Jul 25 15:03:29.255466 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3280/6340] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:03:29 2022] POST /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983/action => generated 24574 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 15:03:29.347145 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-102eaaf6-2ff6-45bf-b17d-16751b75ceaa tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:29.347759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-102eaaf6-2ff6-45bf-b17d-16751b75ceaa tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:29.361687 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-102eaaf6-2ff6-45bf-b17d-16751b75ceaa tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:29.362143 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-102eaaf6-2ff6-45bf-b17d-16751b75ceaa tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:29.368650 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-102eaaf6-2ff6-45bf-b17d-16751b75ceaa tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:29.369148 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-102eaaf6-2ff6-45bf-b17d-16751b75ceaa tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:29.716392 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-102eaaf6-2ff6-45bf-b17d-16751b75ceaa tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:29.725466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-102eaaf6-2ff6-45bf-b17d-16751b75ceaa tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:29.727059 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-102eaaf6-2ff6-45bf-b17d-16751b75ceaa tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:29.728299 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-102eaaf6-2ff6-45bf-b17d-16751b75ceaa tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1366 microversion: 2.57 time: 0.385323 Jul 25 15:03:29.751863 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3061/6341] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:29 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1366 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:30.755778 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ee7e75de-0257-48b5-82a5-6fc5c28e86f6 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:30.756824 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ee7e75de-0257-48b5-82a5-6fc5c28e86f6 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:30.778455 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee7e75de-0257-48b5-82a5-6fc5c28e86f6 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:30.781257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee7e75de-0257-48b5-82a5-6fc5c28e86f6 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:30.784646 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee7e75de-0257-48b5-82a5-6fc5c28e86f6 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:30.785931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee7e75de-0257-48b5-82a5-6fc5c28e86f6 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:30.954179 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ee7e75de-0257-48b5-82a5-6fc5c28e86f6 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:30.971949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ee7e75de-0257-48b5-82a5-6fc5c28e86f6 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:30.974991 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ee7e75de-0257-48b5-82a5-6fc5c28e86f6 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:30.982212 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ee7e75de-0257-48b5-82a5-6fc5c28e86f6 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1366 microversion: 2.57 time: 0.230052 Jul 25 15:03:30.983429 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3281/6342] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:30 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:31.165609 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-a7faa3d3-ab04-4f75-a827-c443d69ff539 req-c5ac9bcd-72ce-47b5-a8d4-a28a5ba2ce11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ec74cda-74e2-4998-8f9a-942e980313c3", "tag": "66b36202-edd4-437d-abc1-1e5c0064323d"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:03:31.166299 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-71bc9997-8c3a-4808-a06f-4a215d1fd4b0 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:31.170404 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-71bc9997-8c3a-4808-a06f-4a215d1fd4b0 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:31.182083 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-71bc9997-8c3a-4808-a06f-4a215d1fd4b0 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:31.186351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-71bc9997-8c3a-4808-a06f-4a215d1fd4b0 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:31.188337 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a7faa3d3-ab04-4f75-a827-c443d69ff539 req-c5ac9bcd-72ce-47b5-a8d4-a28a5ba2ce11 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:31.189430 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-71bc9997-8c3a-4808-a06f-4a215d1fd4b0 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:31.190108 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-71bc9997-8c3a-4808-a06f-4a215d1fd4b0 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:31.214879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a7faa3d3-ab04-4f75-a827-c443d69ff539 req-c5ac9bcd-72ce-47b5-a8d4-a28a5ba2ce11 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:31.260884 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-a7faa3d3-ab04-4f75-a827-c443d69ff539 req-c5ac9bcd-72ce-47b5-a8d4-a28a5ba2ce11 service nova] Creating event network-changed:66b36202-edd4-437d-abc1-1e5c0064323d for instance 4ec74cda-74e2-4998-8f9a-942e980313c3 on n-h2-846435-14 Jul 25 15:03:31.268515 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-a7faa3d3-ab04-4f75-a827-c443d69ff539 req-c5ac9bcd-72ce-47b5-a8d4-a28a5ba2ce11 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107465 Jul 25 15:03:31.269420 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3282/6343] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:03:31.302999 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-71bc9997-8c3a-4808-a06f-4a215d1fd4b0 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:03:31.464946 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-71bc9997-8c3a-4808-a06f-4a215d1fd4b0 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "DELETE /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 204 len: 0 microversion: 2.1 time: 0.309097 Jul 25 15:03:31.471865 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3062/6344] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:03:31 2022] DELETE /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:03:31.483091 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ed27f4bb-f787-4395-8b32-c543d2afb36d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:31.484637 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ed27f4bb-f787-4395-8b32-c543d2afb36d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:31.493989 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed27f4bb-f787-4395-8b32-c543d2afb36d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:31.495104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed27f4bb-f787-4395-8b32-c543d2afb36d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:31.496092 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed27f4bb-f787-4395-8b32-c543d2afb36d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:31.496767 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed27f4bb-f787-4395-8b32-c543d2afb36d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:31.793188 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ed27f4bb-f787-4395-8b32-c543d2afb36d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:31.809212 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ed27f4bb-f787-4395-8b32-c543d2afb36d tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1689 microversion: 2.1 time: 0.331794 Jul 25 15:03:31.821175 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3283/6345] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:03:31 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1689 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:03:32.006712 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-08ddb5fa-e988-456e-b1c7-6974d73f74a2 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:32.007411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-08ddb5fa-e988-456e-b1c7-6974d73f74a2 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:32.022722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08ddb5fa-e988-456e-b1c7-6974d73f74a2 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:32.023104 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08ddb5fa-e988-456e-b1c7-6974d73f74a2 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:32.024147 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08ddb5fa-e988-456e-b1c7-6974d73f74a2 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:32.026114 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08ddb5fa-e988-456e-b1c7-6974d73f74a2 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:32.186177 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-08ddb5fa-e988-456e-b1c7-6974d73f74a2 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:32.194649 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-08ddb5fa-e988-456e-b1c7-6974d73f74a2 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:32.198763 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-08ddb5fa-e988-456e-b1c7-6974d73f74a2 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:32.205302 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-08ddb5fa-e988-456e-b1c7-6974d73f74a2 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1366 microversion: 2.57 time: 0.203301 Jul 25 15:03:32.206575 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3063/6346] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:32 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:32.836427 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4600471b-d731-450a-b0de-b7c65a2d0edf tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:32.837580 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4600471b-d731-450a-b0de-b7c65a2d0edf tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:32.853237 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4600471b-d731-450a-b0de-b7c65a2d0edf tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:32.856948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4600471b-d731-450a-b0de-b7c65a2d0edf tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:32.858023 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4600471b-d731-450a-b0de-b7c65a2d0edf tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:32.858604 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4600471b-d731-450a-b0de-b7c65a2d0edf tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:33.232270 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ebf3264a-8d79-47f5-874a-5816f9133b64 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:33.232886 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ebf3264a-8d79-47f5-874a-5816f9133b64 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:33.236422 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4600471b-d731-450a-b0de-b7c65a2d0edf tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:33.239454 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:03:33.245360 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ebf3264a-8d79-47f5-874a-5816f9133b64 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:33.245753 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ebf3264a-8d79-47f5-874a-5816f9133b64 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:33.246590 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ebf3264a-8d79-47f5-874a-5816f9133b64 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:33.246998 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ebf3264a-8d79-47f5-874a-5816f9133b64 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:33.250666 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4600471b-d731-450a-b0de-b7c65a2d0edf tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1689 microversion: 2.1 time: 0.418727 Jul 25 15:03:33.257566 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3284/6347] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:03:32 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1689 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:03:33.374509 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ebf3264a-8d79-47f5-874a-5816f9133b64 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:33.398222 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ebf3264a-8d79-47f5-874a-5816f9133b64 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:33.402927 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ebf3264a-8d79-47f5-874a-5816f9133b64 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:33.407956 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ebf3264a-8d79-47f5-874a-5816f9133b64 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1366 microversion: 2.57 time: 0.175862 Jul 25 15:03:33.409630 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3064/6348] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:33 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 15:03:34.279292 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2ea3d7f2-ac97-48a7-ba8d-917986c9c4ca tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:34.279901 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2ea3d7f2-ac97-48a7-ba8d-917986c9c4ca tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:34.309507 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2ea3d7f2-ac97-48a7-ba8d-917986c9c4ca tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:34.311600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2ea3d7f2-ac97-48a7-ba8d-917986c9c4ca tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:34.312562 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2ea3d7f2-ac97-48a7-ba8d-917986c9c4ca tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:34.313001 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2ea3d7f2-ac97-48a7-ba8d-917986c9c4ca tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:34.432098 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0e68cb70-34dc-4047-a4ad-849f5a9413e6 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:34.433803 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0e68cb70-34dc-4047-a4ad-849f5a9413e6 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:34.448165 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e68cb70-34dc-4047-a4ad-849f5a9413e6 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:34.450244 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e68cb70-34dc-4047-a4ad-849f5a9413e6 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:34.452731 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e68cb70-34dc-4047-a4ad-849f5a9413e6 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:34.456170 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e68cb70-34dc-4047-a4ad-849f5a9413e6 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:34.588999 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0e68cb70-34dc-4047-a4ad-849f5a9413e6 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:34.609622 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0e68cb70-34dc-4047-a4ad-849f5a9413e6 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:34.614323 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0e68cb70-34dc-4047-a4ad-849f5a9413e6 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:34.618245 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0e68cb70-34dc-4047-a4ad-849f5a9413e6 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1366 microversion: 2.57 time: 0.191221 Jul 25 15:03:34.621066 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3065/6349] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:34 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:34.928090 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2ea3d7f2-ac97-48a7-ba8d-917986c9c4ca tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca46c8e84b8644b69937ec9c06cb0e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd09177faea4702992aaab182125b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:34.942351 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2ea3d7f2-ac97-48a7-ba8d-917986c9c4ca tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 200 len: 1621 microversion: 2.1 time: 0.667655 Jul 25 15:03:34.942958 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3285/6350] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:03:34 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 1621 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:03:35.091121 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-4cf84c04-44f7-478d-8124-d8ae6d5192f2 req-787d1304-a871-451c-acbd-6ee322cbb111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ec74cda-74e2-4998-8f9a-942e980313c3", "name": "network-vif-deleted", "tag": "66b36202-edd4-437d-abc1-1e5c0064323d"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:03:35.118243 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-4cf84c04-44f7-478d-8124-d8ae6d5192f2 req-787d1304-a871-451c-acbd-6ee322cbb111 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:35.121155 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-4cf84c04-44f7-478d-8124-d8ae6d5192f2 req-787d1304-a871-451c-acbd-6ee322cbb111 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:35.148866 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-4cf84c04-44f7-478d-8124-d8ae6d5192f2 req-787d1304-a871-451c-acbd-6ee322cbb111 service nova] Creating event network-vif-deleted:66b36202-edd4-437d-abc1-1e5c0064323d for instance 4ec74cda-74e2-4998-8f9a-942e980313c3 on n-h2-846435-14 Jul 25 15:03:35.154568 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-4cf84c04-44f7-478d-8124-d8ae6d5192f2 req-787d1304-a871-451c-acbd-6ee322cbb111 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067369 Jul 25 15:03:35.157366 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3066/6351] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:03:35.643340 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3b5e8291-f028-42ca-9138-4950990056a5 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:35.643909 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3b5e8291-f028-42ca-9138-4950990056a5 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:35.659967 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b5e8291-f028-42ca-9138-4950990056a5 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:35.663507 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b5e8291-f028-42ca-9138-4950990056a5 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:35.664629 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b5e8291-f028-42ca-9138-4950990056a5 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:35.665060 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b5e8291-f028-42ca-9138-4950990056a5 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:35.828821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3b5e8291-f028-42ca-9138-4950990056a5 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:35.844537 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3b5e8291-f028-42ca-9138-4950990056a5 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:35.847029 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3b5e8291-f028-42ca-9138-4950990056a5 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:35.848498 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3b5e8291-f028-42ca-9138-4950990056a5 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1366 microversion: 2.57 time: 0.209322 Jul 25 15:03:35.849655 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3286/6352] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:35 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:35.968154 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c6ed3169-0718-4a3a-b2b3-c7309974d493 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:35.969616 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c6ed3169-0718-4a3a-b2b3-c7309974d493 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] [instance: 4ec74cda-74e2-4998-8f9a-942e980313c3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:35.978038 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c6ed3169-0718-4a3a-b2b3-c7309974d493 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:35.978885 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c6ed3169-0718-4a3a-b2b3-c7309974d493 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:35.979888 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c6ed3169-0718-4a3a-b2b3-c7309974d493 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:35.980609 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c6ed3169-0718-4a3a-b2b3-c7309974d493 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:35.995631 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-c6ed3169-0718-4a3a-b2b3-c7309974d493 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] HTTP exception thrown: Instance 4ec74cda-74e2-4998-8f9a-942e980313c3 could not be found. Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c6ed3169-0718-4a3a-b2b3-c7309974d493 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Request method failure captured: Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 HTTP/1.1 Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q4DBDAuynnb9b8nJFNNex8XXIdUxDWuP-PEkAZMub_ZUkZMduVSsCJMD66yCrnruIywPy2lvVpDMBFR-BQiaLm_rcOzEza3QKBSQ9Q0j7zyfwq4sXID1DSbTq1QnPsc4nPy2BUSC17V5E20v3AYQkR2U7b_KL_5EYlXpiDz-Ll6u0Y Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 8dd09177faea4702992aaab182125b5a Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-919260591 Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8dd09177faea4702992aaab182125b5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/8dd09177faea4702992aaab182125b5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_8dd09177faea4702992aaab182125b5a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/8dd09177faea4702992aaab182125b5a"}]}] Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-TestNetworkAdvancedServerOps-919260591 Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 8dd09177faea4702992aaab182125b5a Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-919260591 Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-TestNetworkAdvancedServerOps-919260591-project Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: ca46c8e84b8644b69937ec9c06cb0e9a Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-TestNetworkAdvancedServerOps-919260591-project Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 4ec74cda-74e2-4998-8f9a-942e980313c3 could not be found. Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '4ec74cda-74e2-4998-8f9a-942e980313c3'} Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ec74cda-74e2-4998-8f9a-942e980313c3 could not be found. Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ec74cda-74e2-4998-8f9a-942e980313c3 could not be found. Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:03:35.997858 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:03:36.002009 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:03:36.002009 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:03:36.002009 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:03:36.002009 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:03:36.002009 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:03:36.002009 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ec74cda-74e2-4998-8f9a-942e980313c3 could not be found. Jul 25 15:03:36.002009 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:03:36.004850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c6ed3169-0718-4a3a-b2b3-c7309974d493 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Returning 404 to user: Instance 4ec74cda-74e2-4998-8f9a-942e980313c3 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:03:36.005945 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c6ed3169-0718-4a3a-b2b3-c7309974d493 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3" status: 404 len: 111 microversion: 2.1 time: 0.042057 Jul 25 15:03:36.007162 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3067/6353] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:03:35 2022] GET /compute/v2.1/servers/4ec74cda-74e2-4998-8f9a-942e980313c3 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:03:36.184782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0634dd74-41e3-481a-a68d-d92a7eaacdde tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:03:36.187160 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0634dd74-41e3-481a-a68d-d92a7eaacdde tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: bb39ac7e-36d6-4887-ab71-fe44f10ae983] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:36.194892 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0634dd74-41e3-481a-a68d-d92a7eaacdde tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:36.195427 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0634dd74-41e3-481a-a68d-d92a7eaacdde tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:36.196670 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0634dd74-41e3-481a-a68d-d92a7eaacdde tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:36.197396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0634dd74-41e3-481a-a68d-d92a7eaacdde tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:36.262163 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0634dd74-41e3-481a-a68d-d92a7eaacdde tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "POST /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983/action" status: 200 len: 32647 microversion: 2.1 time: 0.081029 Jul 25 15:03:36.263540 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3287/6354] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:03:36 2022] POST /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983/action => generated 32647 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 15:03:36.873688 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b9df7349-79f2-4c88-ab15-5c3761c68ade tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:36.874524 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b9df7349-79f2-4c88-ab15-5c3761c68ade tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:36.892288 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b9df7349-79f2-4c88-ab15-5c3761c68ade tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:36.892901 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b9df7349-79f2-4c88-ab15-5c3761c68ade tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:36.893911 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b9df7349-79f2-4c88-ab15-5c3761c68ade tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:36.894682 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b9df7349-79f2-4c88-ab15-5c3761c68ade tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:37.013696 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b9df7349-79f2-4c88-ab15-5c3761c68ade tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:37.025788 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b9df7349-79f2-4c88-ab15-5c3761c68ade tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:37.028694 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b9df7349-79f2-4c88-ab15-5c3761c68ade tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:37.030124 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b9df7349-79f2-4c88-ab15-5c3761c68ade tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1366 microversion: 2.57 time: 0.161306 Jul 25 15:03:37.031319 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3068/6355] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:36 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:38.061417 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cebe3189-a948-455a-8616-de1f3019d667 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:38.064779 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cebe3189-a948-455a-8616-de1f3019d667 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:38.089832 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cebe3189-a948-455a-8616-de1f3019d667 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:38.090554 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cebe3189-a948-455a-8616-de1f3019d667 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:38.096136 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cebe3189-a948-455a-8616-de1f3019d667 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:38.097020 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cebe3189-a948-455a-8616-de1f3019d667 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:38.316666 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cebe3189-a948-455a-8616-de1f3019d667 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:38.393784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cebe3189-a948-455a-8616-de1f3019d667 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:38.395597 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cebe3189-a948-455a-8616-de1f3019d667 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:38.398727 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cebe3189-a948-455a-8616-de1f3019d667 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1366 microversion: 2.57 time: 0.346018 Jul 25 15:03:38.400952 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3288/6356] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:38 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1366 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:39.426135 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2bf4353d-0ca6-46ec-8c72-f17e059ad6e1 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:39.437360 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2bf4353d-0ca6-46ec-8c72-f17e059ad6e1 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:39.459118 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2bf4353d-0ca6-46ec-8c72-f17e059ad6e1 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:39.459568 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2bf4353d-0ca6-46ec-8c72-f17e059ad6e1 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:39.461875 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2bf4353d-0ca6-46ec-8c72-f17e059ad6e1 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:39.462490 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2bf4353d-0ca6-46ec-8c72-f17e059ad6e1 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:39.478359 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:03:39.580817 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2bf4353d-0ca6-46ec-8c72-f17e059ad6e1 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:39.590004 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2bf4353d-0ca6-46ec-8c72-f17e059ad6e1 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:39.597850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2bf4353d-0ca6-46ec-8c72-f17e059ad6e1 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:39.601070 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2bf4353d-0ca6-46ec-8c72-f17e059ad6e1 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1366 microversion: 2.57 time: 0.180971 Jul 25 15:03:39.602356 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3069/6357] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:39 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:40.628831 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ce848683-c13d-4751-a606-a0c45ab06fdf tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:40.632303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ce848683-c13d-4751-a606-a0c45ab06fdf tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:40.655628 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce848683-c13d-4751-a606-a0c45ab06fdf tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:40.657053 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce848683-c13d-4751-a606-a0c45ab06fdf tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:40.658041 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce848683-c13d-4751-a606-a0c45ab06fdf tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:40.658633 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce848683-c13d-4751-a606-a0c45ab06fdf tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:40.792679 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ce848683-c13d-4751-a606-a0c45ab06fdf tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:40.809036 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ce848683-c13d-4751-a606-a0c45ab06fdf tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:40.814400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ce848683-c13d-4751-a606-a0c45ab06fdf tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:40.818488 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ce848683-c13d-4751-a606-a0c45ab06fdf tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1366 microversion: 2.57 time: 0.194947 Jul 25 15:03:40.824927 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3289/6358] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:40 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:40.941219 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-780f6519-22d6-433b-81db-390f82d1ee99 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:40.941872 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-780f6519-22d6-433b-81db-390f82d1ee99 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: bb39ac7e-36d6-4887-ab71-fe44f10ae983] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:40.953372 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-780f6519-22d6-433b-81db-390f82d1ee99 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:40.953818 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-780f6519-22d6-433b-81db-390f82d1ee99 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:40.955451 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-780f6519-22d6-433b-81db-390f82d1ee99 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:40.958819 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-780f6519-22d6-433b-81db-390f82d1ee99 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:40.969497 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-29dab7c9-7023-465b-8974-c5aa25d67254 req-f8f18d88-5fa2-40c8-8faf-e3d51bc48faf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb39ac7e-36d6-4887-ab71-fe44f10ae983", "tag": "72182f1a-15f1-483b-a1b7-e271ccd2cda5"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:03:41.002030 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-29dab7c9-7023-465b-8974-c5aa25d67254 req-f8f18d88-5fa2-40c8-8faf-e3d51bc48faf service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:41.010115 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-29dab7c9-7023-465b-8974-c5aa25d67254 req-f8f18d88-5fa2-40c8-8faf-e3d51bc48faf service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:41.015625 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-780f6519-22d6-433b-81db-390f82d1ee99 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: bb39ac7e-36d6-4887-ab71-fe44f10ae983] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:03:41.042394 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-29dab7c9-7023-465b-8974-c5aa25d67254 req-f8f18d88-5fa2-40c8-8faf-e3d51bc48faf service nova] Creating event network-changed:72182f1a-15f1-483b-a1b7-e271ccd2cda5 for instance bb39ac7e-36d6-4887-ab71-fe44f10ae983 on n-h1-846435-14 Jul 25 15:03:41.049179 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-29dab7c9-7023-465b-8974-c5aa25d67254 req-f8f18d88-5fa2-40c8-8faf-e3d51bc48faf service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083442 Jul 25 15:03:41.054580 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3290/6359] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:03:41.171298 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-780f6519-22d6-433b-81db-390f82d1ee99 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "DELETE /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983" status: 204 len: 0 microversion: 2.1 time: 0.233707 Jul 25 15:03:41.172671 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3070/6360] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:03:40 2022] DELETE /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:03:41.183536 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8842cabd-ef76-4e3c-958a-3bc9e2a5e540 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:41.184282 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8842cabd-ef76-4e3c-958a-3bc9e2a5e540 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: bb39ac7e-36d6-4887-ab71-fe44f10ae983] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:41.200933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8842cabd-ef76-4e3c-958a-3bc9e2a5e540 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:41.201433 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8842cabd-ef76-4e3c-958a-3bc9e2a5e540 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:41.205789 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8842cabd-ef76-4e3c-958a-3bc9e2a5e540 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:41.206257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8842cabd-ef76-4e3c-958a-3bc9e2a5e540 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:41.491534 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8842cabd-ef76-4e3c-958a-3bc9e2a5e540 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:41.523728 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8842cabd-ef76-4e3c-958a-3bc9e2a5e540 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983" status: 200 len: 1671 microversion: 2.1 time: 0.346633 Jul 25 15:03:41.543955 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3291/6361] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:03:41 2022] GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983 => generated 1671 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:03:41.854976 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c40597ad-7c25-484d-9c77-8063c6eee68a tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:41.857357 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c40597ad-7c25-484d-9c77-8063c6eee68a tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:41.875682 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c40597ad-7c25-484d-9c77-8063c6eee68a tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:41.879929 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c40597ad-7c25-484d-9c77-8063c6eee68a tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:41.884444 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c40597ad-7c25-484d-9c77-8063c6eee68a tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:41.885207 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c40597ad-7c25-484d-9c77-8063c6eee68a tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:42.015412 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c40597ad-7c25-484d-9c77-8063c6eee68a tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:42.033910 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c40597ad-7c25-484d-9c77-8063c6eee68a tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:42.039265 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c40597ad-7c25-484d-9c77-8063c6eee68a tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:42.044310 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c40597ad-7c25-484d-9c77-8063c6eee68a tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1366 microversion: 2.57 time: 0.200111 Jul 25 15:03:42.046882 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3071/6362] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:41 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:42.551367 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f0d88fe7-0524-4156-9a20-992bfae0f3b4 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:42.552655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f0d88fe7-0524-4156-9a20-992bfae0f3b4 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: bb39ac7e-36d6-4887-ab71-fe44f10ae983] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:42.570303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0d88fe7-0524-4156-9a20-992bfae0f3b4 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:42.571014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0d88fe7-0524-4156-9a20-992bfae0f3b4 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:42.572015 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0d88fe7-0524-4156-9a20-992bfae0f3b4 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:42.572610 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0d88fe7-0524-4156-9a20-992bfae0f3b4 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:43.073009 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-46c55ad6-1f88-4e22-8687-d830aab06c90 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:43.074288 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-46c55ad6-1f88-4e22-8687-d830aab06c90 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:43.085370 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46c55ad6-1f88-4e22-8687-d830aab06c90 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:43.096868 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46c55ad6-1f88-4e22-8687-d830aab06c90 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:43.098001 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46c55ad6-1f88-4e22-8687-d830aab06c90 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:43.098602 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46c55ad6-1f88-4e22-8687-d830aab06c90 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:43.201751 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f0d88fe7-0524-4156-9a20-992bfae0f3b4 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:43.209675 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f0d88fe7-0524-4156-9a20-992bfae0f3b4 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983" status: 200 len: 1671 microversion: 2.1 time: 0.662068 Jul 25 15:03:43.210928 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3292/6363] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:03:42 2022] GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983 => generated 1671 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:03:43.321712 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-46c55ad6-1f88-4e22-8687-d830aab06c90 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:43.336326 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-46c55ad6-1f88-4e22-8687-d830aab06c90 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:43.338960 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-46c55ad6-1f88-4e22-8687-d830aab06c90 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:43.341258 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-46c55ad6-1f88-4e22-8687-d830aab06c90 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1366 microversion: 2.57 time: 0.272299 Jul 25 15:03:43.343413 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3072/6364] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:43 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 15:03:44.238150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9991f4e0-acb3-4d6a-a48e-397ff9c7dfcc tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:44.239691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9991f4e0-acb3-4d6a-a48e-397ff9c7dfcc tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: bb39ac7e-36d6-4887-ab71-fe44f10ae983] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:44.257784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9991f4e0-acb3-4d6a-a48e-397ff9c7dfcc tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:44.258224 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9991f4e0-acb3-4d6a-a48e-397ff9c7dfcc tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:44.259025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9991f4e0-acb3-4d6a-a48e-397ff9c7dfcc tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:44.268275 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9991f4e0-acb3-4d6a-a48e-397ff9c7dfcc tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:44.373032 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-77d7c4e7-7b54-4945-8c32-51ccd7dce30c tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:44.374354 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-77d7c4e7-7b54-4945-8c32-51ccd7dce30c tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:44.390454 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77d7c4e7-7b54-4945-8c32-51ccd7dce30c tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:44.433230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77d7c4e7-7b54-4945-8c32-51ccd7dce30c tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:44.437626 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77d7c4e7-7b54-4945-8c32-51ccd7dce30c tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:44.451187 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77d7c4e7-7b54-4945-8c32-51ccd7dce30c tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:44.638372 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-77d7c4e7-7b54-4945-8c32-51ccd7dce30c tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:44.652638 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-77d7c4e7-7b54-4945-8c32-51ccd7dce30c tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:44.658544 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-77d7c4e7-7b54-4945-8c32-51ccd7dce30c tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:44.660018 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-77d7c4e7-7b54-4945-8c32-51ccd7dce30c tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1366 microversion: 2.57 time: 0.297936 Jul 25 15:03:44.671363 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3073/6365] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:44 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1366 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:45.055656 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9991f4e0-acb3-4d6a-a48e-397ff9c7dfcc tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:45.069594 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9991f4e0-acb3-4d6a-a48e-397ff9c7dfcc tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983" status: 200 len: 1671 microversion: 2.1 time: 0.841546 Jul 25 15:03:45.078325 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3293/6366] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:03:44 2022] GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983 => generated 1671 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:03:45.706367 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f49d15ff-06b4-42aa-b17a-5a775679d25d tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:45.707160 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f49d15ff-06b4-42aa-b17a-5a775679d25d tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:45.726403 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f49d15ff-06b4-42aa-b17a-5a775679d25d tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:45.727220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f49d15ff-06b4-42aa-b17a-5a775679d25d tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:45.728304 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f49d15ff-06b4-42aa-b17a-5a775679d25d tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:45.728953 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f49d15ff-06b4-42aa-b17a-5a775679d25d tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:45.796834 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-152fa4e3-0ee8-4386-929d-5baadba0a62e req-fc0e655f-d4e0-4dc1-aded-f3c4ad9d4549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb39ac7e-36d6-4887-ab71-fe44f10ae983", "name": "network-vif-deleted", "tag": "72182f1a-15f1-483b-a1b7-e271ccd2cda5"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:03:45.829012 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-152fa4e3-0ee8-4386-929d-5baadba0a62e req-fc0e655f-d4e0-4dc1-aded-f3c4ad9d4549 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:45.829820 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-152fa4e3-0ee8-4386-929d-5baadba0a62e req-fc0e655f-d4e0-4dc1-aded-f3c4ad9d4549 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:45.854693 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-152fa4e3-0ee8-4386-929d-5baadba0a62e req-fc0e655f-d4e0-4dc1-aded-f3c4ad9d4549 service nova] Creating event network-vif-deleted:72182f1a-15f1-483b-a1b7-e271ccd2cda5 for instance bb39ac7e-36d6-4887-ab71-fe44f10ae983 on n-h1-846435-14 Jul 25 15:03:45.865602 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-152fa4e3-0ee8-4386-929d-5baadba0a62e req-fc0e655f-d4e0-4dc1-aded-f3c4ad9d4549 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072624 Jul 25 15:03:45.872817 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3294/6367] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:03:46.019455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f49d15ff-06b4-42aa-b17a-5a775679d25d tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:46.041997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f49d15ff-06b4-42aa-b17a-5a775679d25d tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:46.048546 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f49d15ff-06b4-42aa-b17a-5a775679d25d tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:46.050082 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f49d15ff-06b4-42aa-b17a-5a775679d25d tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1372 microversion: 2.57 time: 0.347985 Jul 25 15:03:46.052269 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3074/6368] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:45 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1372 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:46.065092 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-349e0d7b-b301-40de-9d35-4db1566d7f70 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] Calling method '.version_select at 0x7f46861f3a60>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:46.102532 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-078650a4-400f-4d05-8d59-7f7494f1dfe8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:46.103248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-078650a4-400f-4d05-8d59-7f7494f1dfe8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: bb39ac7e-36d6-4887-ab71-fe44f10ae983] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:46.105949 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-349e0d7b-b301-40de-9d35-4db1566d7f70 tempest-TestNetworkAdvancedServerOps-919260591 tempest-TestNetworkAdvancedServerOps-919260591-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1100944553" status: 202 len: 0 microversion: 2.1 time: 0.046381 Jul 25 15:03:46.108999 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3295/6369] 10.222.0.88 () {58 vars in 1284 bytes} [Mon Jul 25 15:03:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1100944553 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:03:46.140012 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-078650a4-400f-4d05-8d59-7f7494f1dfe8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:46.140526 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-078650a4-400f-4d05-8d59-7f7494f1dfe8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:46.141311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-078650a4-400f-4d05-8d59-7f7494f1dfe8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:46.141750 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-078650a4-400f-4d05-8d59-7f7494f1dfe8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:46.246419 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-078650a4-400f-4d05-8d59-7f7494f1dfe8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:46.246875 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-078650a4-400f-4d05-8d59-7f7494f1dfe8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:46.247336 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-078650a4-400f-4d05-8d59-7f7494f1dfe8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lazy-loading 'fault' on Instance uuid bb39ac7e-36d6-4887-ab71-fe44f10ae983 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:03:46.891104 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-078650a4-400f-4d05-8d59-7f7494f1dfe8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3fdf21e7be4de2817a73d402a34c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1220781eb4456d9afaca1ebec42203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:46.898971 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-078650a4-400f-4d05-8d59-7f7494f1dfe8 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983" status: 200 len: 1338 microversion: 2.1 time: 0.801013 Jul 25 15:03:46.912132 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3075/6370] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:03:46 2022] GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983 => generated 1338 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:03:47.084018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d58b17c5-b29e-4b10-8c5a-8173b1fbadfd tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:47.085543 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d58b17c5-b29e-4b10-8c5a-8173b1fbadfd tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:47.103457 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d58b17c5-b29e-4b10-8c5a-8173b1fbadfd tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:47.103896 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d58b17c5-b29e-4b10-8c5a-8173b1fbadfd tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:47.107317 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d58b17c5-b29e-4b10-8c5a-8173b1fbadfd tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:47.108286 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d58b17c5-b29e-4b10-8c5a-8173b1fbadfd tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:47.305711 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d58b17c5-b29e-4b10-8c5a-8173b1fbadfd tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:47.314781 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d58b17c5-b29e-4b10-8c5a-8173b1fbadfd tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:47.316336 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d58b17c5-b29e-4b10-8c5a-8173b1fbadfd tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:47.331376 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d58b17c5-b29e-4b10-8c5a-8173b1fbadfd tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1372 microversion: 2.57 time: 0.256601 Jul 25 15:03:47.332065 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3296/6371] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:47 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1372 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:47.925807 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9f5f3409-1ce1-49f9-af48-f98bb1e7b759 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:47.927255 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9f5f3409-1ce1-49f9-af48-f98bb1e7b759 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] [instance: bb39ac7e-36d6-4887-ab71-fe44f10ae983] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:47.945878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f5f3409-1ce1-49f9-af48-f98bb1e7b759 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:47.946706 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f5f3409-1ce1-49f9-af48-f98bb1e7b759 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:47.951272 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f5f3409-1ce1-49f9-af48-f98bb1e7b759 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:47.951758 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f5f3409-1ce1-49f9-af48-f98bb1e7b759 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:47.986164 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-9f5f3409-1ce1-49f9-af48-f98bb1e7b759 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] HTTP exception thrown: Instance bb39ac7e-36d6-4887-ab71-fe44f10ae983 could not be found. Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9f5f3409-1ce1-49f9-af48-f98bb1e7b759 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Request method failure captured: Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983 HTTP/1.1 Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3q-9vJcvk5DDA0KztYJD9u35CNyiUWIx1c_trHQChYsGk_qH9_Fz1rUnVFafgSzw_iIuCfnZRf236rj4sNIt2DW84zbvtC3tbZzYGH6UdVZzADFVFVy9_IwJQtYLmsH0cFTG9ivaFs7hJ8B93C9ALsqjN8m4mdVaogMMr1tDoFLIp68 Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 3a1220781eb4456d9afaca1ebec42203 Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-TestNetworkBasicOps-1276627206 Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3a1220781eb4456d9afaca1ebec42203"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3a1220781eb4456d9afaca1ebec42203"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3a1220781eb4456d9afaca1ebec42203", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3a1220781eb4456d9afaca1ebec42203"}]}] Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-TestNetworkBasicOps-1276627206 Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 3a1220781eb4456d9afaca1ebec42203 Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-TestNetworkBasicOps-1276627206 Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-TestNetworkBasicOps-1276627206-project Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: dd3fdf21e7be4de2817a73d402a34c56 Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-TestNetworkBasicOps-1276627206-project Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance bb39ac7e-36d6-4887-ab71-fe44f10ae983 could not be found. Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'bb39ac7e-36d6-4887-ab71-fe44f10ae983'} Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb39ac7e-36d6-4887-ab71-fe44f10ae983 could not be found. Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb39ac7e-36d6-4887-ab71-fe44f10ae983 could not be found. Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:03:47.987889 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:03:47.992066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:03:47.992066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:03:47.992066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:03:47.992066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:03:47.992066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:03:47.992066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb39ac7e-36d6-4887-ab71-fe44f10ae983 could not be found. Jul 25 15:03:47.992066 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:03:47.992066 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9f5f3409-1ce1-49f9-af48-f98bb1e7b759 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Returning 404 to user: Instance bb39ac7e-36d6-4887-ab71-fe44f10ae983 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:03:47.992066 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9f5f3409-1ce1-49f9-af48-f98bb1e7b759 tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983" status: 404 len: 111 microversion: 2.1 time: 0.069380 Jul 25 15:03:47.992066 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3076/6372] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:03:47 2022] GET /compute/v2.1/servers/bb39ac7e-36d6-4887-ab71-fe44f10ae983 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:03:48.361109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-259293a3-37ca-41dc-ab4d-6b0d6b778381 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:48.363560 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-259293a3-37ca-41dc-ab4d-6b0d6b778381 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:48.379560 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-259293a3-37ca-41dc-ab4d-6b0d6b778381 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:48.383652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-259293a3-37ca-41dc-ab4d-6b0d6b778381 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:48.386263 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-259293a3-37ca-41dc-ab4d-6b0d6b778381 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:48.390465 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-259293a3-37ca-41dc-ab4d-6b0d6b778381 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:48.537407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-259293a3-37ca-41dc-ab4d-6b0d6b778381 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:48.556959 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-259293a3-37ca-41dc-ab4d-6b0d6b778381 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:48.558870 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-259293a3-37ca-41dc-ab4d-6b0d6b778381 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:48.560501 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-259293a3-37ca-41dc-ab4d-6b0d6b778381 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1372 microversion: 2.57 time: 0.205579 Jul 25 15:03:48.561659 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3297/6373] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:48 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1372 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:48.576531 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-af2a2961-7431-4f9a-a471-4da4ffd71f1d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] Calling method '.version_select at 0x7f46864cc3a0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:48.625433 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-af2a2961-7431-4f9a-a471-4da4ffd71f1d tempest-TestNetworkBasicOps-1276627206 tempest-TestNetworkBasicOps-1276627206-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-102919637" status: 202 len: 0 microversion: 2.1 time: 0.056656 Jul 25 15:03:48.626275 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3077/6374] 10.222.0.88 () {58 vars in 1254 bytes} [Mon Jul 25 15:03:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-102919637 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:03:49.595188 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ddc025d5-5426-4713-ad18-1c817077cd55 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:49.595876 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ddc025d5-5426-4713-ad18-1c817077cd55 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:49.611023 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ddc025d5-5426-4713-ad18-1c817077cd55 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:49.613824 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ddc025d5-5426-4713-ad18-1c817077cd55 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:49.621426 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ddc025d5-5426-4713-ad18-1c817077cd55 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:49.624511 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ddc025d5-5426-4713-ad18-1c817077cd55 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:49.905824 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ddc025d5-5426-4713-ad18-1c817077cd55 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:49.931897 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ddc025d5-5426-4713-ad18-1c817077cd55 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:49.934922 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ddc025d5-5426-4713-ad18-1c817077cd55 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:49.936778 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ddc025d5-5426-4713-ad18-1c817077cd55 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1357 microversion: 2.57 time: 0.346193 Jul 25 15:03:49.948996 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3298/6375] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:49 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1357 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:49.985603 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d307e71e-60a2-4581-8684-163b34b4581a tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:49.987679 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d307e71e-60a2-4581-8684-163b34b4581a tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:49.997172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d307e71e-60a2-4581-8684-163b34b4581a tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:49.998058 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d307e71e-60a2-4581-8684-163b34b4581a tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:50.001313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d307e71e-60a2-4581-8684-163b34b4581a tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:50.002422 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d307e71e-60a2-4581-8684-163b34b4581a tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:50.046860 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d307e71e-60a2-4581-8684-163b34b4581a tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:03:50.190388 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d307e71e-60a2-4581-8684-163b34b4581a tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "DELETE /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 204 len: 0 microversion: 2.57 time: 0.209449 Jul 25 15:03:50.195359 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3078/6376] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Jul 25 15:03:49 2022] DELETE /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 15:03:50.204986 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-894c0b8f-e453-41a0-9c4e-b3d77e29199f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:50.206107 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-894c0b8f-e453-41a0-9c4e-b3d77e29199f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:50.213281 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:03:50.240625 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-894c0b8f-e453-41a0-9c4e-b3d77e29199f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:50.241884 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-894c0b8f-e453-41a0-9c4e-b3d77e29199f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:50.243768 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-894c0b8f-e453-41a0-9c4e-b3d77e29199f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:50.246561 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-894c0b8f-e453-41a0-9c4e-b3d77e29199f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:50.485283 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-894c0b8f-e453-41a0-9c4e-b3d77e29199f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:50.498213 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-894c0b8f-e453-41a0-9c4e-b3d77e29199f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:50.502738 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-894c0b8f-e453-41a0-9c4e-b3d77e29199f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:50.504922 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-894c0b8f-e453-41a0-9c4e-b3d77e29199f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1363 microversion: 2.57 time: 0.304968 Jul 25 15:03:50.506870 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3299/6377] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:50 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1363 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:51.530722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-28fa569e-828e-4624-be33-8cc31ab32da4 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:51.531461 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-28fa569e-828e-4624-be33-8cc31ab32da4 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:51.540084 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-28fa569e-828e-4624-be33-8cc31ab32da4 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:51.546593 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-28fa569e-828e-4624-be33-8cc31ab32da4 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:51.547626 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-28fa569e-828e-4624-be33-8cc31ab32da4 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:51.552406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-28fa569e-828e-4624-be33-8cc31ab32da4 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:51.803590 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-28fa569e-828e-4624-be33-8cc31ab32da4 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:51.819158 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-28fa569e-828e-4624-be33-8cc31ab32da4 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:51.821225 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-28fa569e-828e-4624-be33-8cc31ab32da4 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:51.829115 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-28fa569e-828e-4624-be33-8cc31ab32da4 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1363 microversion: 2.57 time: 0.302682 Jul 25 15:03:51.841329 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3079/6378] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:51 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1363 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:52.864106 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a941265f-a820-4a79-96e3-dd7268bdea4f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:52.865383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a941265f-a820-4a79-96e3-dd7268bdea4f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:52.873451 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a941265f-a820-4a79-96e3-dd7268bdea4f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:52.874068 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a941265f-a820-4a79-96e3-dd7268bdea4f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:52.875109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a941265f-a820-4a79-96e3-dd7268bdea4f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:52.876233 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a941265f-a820-4a79-96e3-dd7268bdea4f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:52.924179 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a941265f-a820-4a79-96e3-dd7268bdea4f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:52.927524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a941265f-a820-4a79-96e3-dd7268bdea4f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:52.928193 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-a941265f-a820-4a79-96e3-dd7268bdea4f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lazy-loading 'fault' on Instance uuid b1c209d4-722e-4157-9428-6db5b4eafd03 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:03:53.006800 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a941265f-a820-4a79-96e3-dd7268bdea4f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:53.016150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a941265f-a820-4a79-96e3-dd7268bdea4f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:53.017703 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a941265f-a820-4a79-96e3-dd7268bdea4f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789a97673faf49779c8dca3aa7299ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ef6b5f61074bc6aa362c42f5d0e80d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:03:53.018947 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a941265f-a820-4a79-96e3-dd7268bdea4f tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 200 len: 1368 microversion: 2.57 time: 0.159003 Jul 25 15:03:53.020037 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3300/6379] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:52 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 15:03:54.043224 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-24c58bd0-e78b-4a62-9c7d-d6a539e60d43 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:03:54.043808 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-24c58bd0-e78b-4a62-9c7d-d6a539e60d43 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] [instance: b1c209d4-722e-4157-9428-6db5b4eafd03] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:03:54.051539 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-24c58bd0-e78b-4a62-9c7d-d6a539e60d43 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:54.051992 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-24c58bd0-e78b-4a62-9c7d-d6a539e60d43 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:54.052989 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-24c58bd0-e78b-4a62-9c7d-d6a539e60d43 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:03:54.053451 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-24c58bd0-e78b-4a62-9c7d-d6a539e60d43 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:03:54.068637 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-24c58bd0-e78b-4a62-9c7d-d6a539e60d43 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] HTTP exception thrown: Instance b1c209d4-722e-4157-9428-6db5b4eafd03 could not be found. Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-24c58bd0-e78b-4a62-9c7d-d6a539e60d43 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Request method failure captured: Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 HTTP/1.1 Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rCp5YGQsUf16URBiEErImzGDwngJCdbQEx5b7ExlWnl1yONCAnt9edk-i2EszNLUsOgmzKzAIwJ7chc_vy1vbgxXTNfyaUxdx4GPRkwqAf3qweQoerv_6l0-FqghNXj3gtr9cPEzLq_uVlmr7CEm4N33lPQlvWiXYqlIjtD45G-Zo8 Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: X-Openstack-Nova-Api-Version: 2.57 Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: a4ef6b5f61074bc6aa362c42f5d0e80d Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServerShowV257Test-850297033 Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a4ef6b5f61074bc6aa362c42f5d0e80d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a4ef6b5f61074bc6aa362c42f5d0e80d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a4ef6b5f61074bc6aa362c42f5d0e80d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a4ef6b5f61074bc6aa362c42f5d0e80d"}]}] Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServerShowV257Test-850297033 Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: a4ef6b5f61074bc6aa362c42f5d0e80d Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServerShowV257Test-850297033 Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServerShowV257Test-850297033-project Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 789a97673faf49779c8dca3aa7299ecc Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServerShowV257Test-850297033-project Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance b1c209d4-722e-4157-9428-6db5b4eafd03 could not be found. Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'b1c209d4-722e-4157-9428-6db5b4eafd03'} Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1c209d4-722e-4157-9428-6db5b4eafd03 could not be found. Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1c209d4-722e-4157-9428-6db5b4eafd03 could not be found. Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:03:54.070426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:03:54.074867 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:03:54.074867 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:03:54.074867 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:03:54.074867 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:03:54.074867 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:03:54.074867 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1c209d4-722e-4157-9428-6db5b4eafd03 could not be found. Jul 25 15:03:54.074867 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:03:54.074867 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-24c58bd0-e78b-4a62-9c7d-d6a539e60d43 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] Returning 404 to user: Instance b1c209d4-722e-4157-9428-6db5b4eafd03 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:03:54.074867 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-24c58bd0-e78b-4a62-9c7d-d6a539e60d43 tempest-ServerShowV257Test-850297033 tempest-ServerShowV257Test-850297033-project] 10.222.0.88 "GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03" status: 404 len: 111 microversion: 2.57 time: 0.032725 Jul 25 15:03:54.074867 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3080/6380] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Jul 25 15:03:54 2022] GET /compute/v2.1/servers/b1c209d4-722e-4157-9428-6db5b4eafd03 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 15:04:05.685854 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=5 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:04:05.686506 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=83 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:04:06.098447 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7660a1d9-d2c5-44a9-ae49-bf50010d5beb tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Action: 'create', calling method: .version_select at 0x7f4685f59ca0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-387715417", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsPB3J/hFDyfXEU7AiRf22oo4zHOPxp1amsKuEY7GFbM6wk4k2AyuAw5SwR5QfxBCV349pIuTp/nhURrmdneLPcCD/nnVPxyV7kVZ4t8IXO7nDcw1hvDzEN2HmAbp9tGQ=="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:04:06.138600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-7660a1d9-d2c5-44a9-ae49-bf50010d5beb tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Getting quotas for project 9af0bc56481f46cd81075f11f3847b0f. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:04:06.152647 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-7660a1d9-d2c5-44a9-ae49-bf50010d5beb tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Getting quotas for user 5e37de6a1cc54f739651bb6eee4a25f4 and project 9af0bc56481f46cd81075f11f3847b0f. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:04:06.203566 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7660a1d9-d2c5-44a9-ae49-bf50010d5beb tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.523968 Jul 25 15:04:06.204238 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3301/6381] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 15:04:05 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:04:25.701715 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4768f4c4-e6ab-429d-a14c-ca77b520f628 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1432973399-access_point-1681468927", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "5d5fb01e-fd61-4891-8fac-d645e1327e69"}], "key_name": "tempest-TestSecurityGroupsBasicOps-387715417", "security_groups": [{"name": "tempest-secgroup_access--1601821874"}, {"name": "tempest-secgroup_general--920844609"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:04:25.749463 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:04:25.752108 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:04:26.189364 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-4768f4c4-e6ab-429d-a14c-ca77b520f628 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] validate_networks() for [('5d5fb01e-fd61-4891-8fac-d645e1327e69', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:04:27.485838 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-4768f4c4-e6ab-429d-a14c-ca77b520f628 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:04:27.486983 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-4768f4c4-e6ab-429d-a14c-ca77b520f628 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:04:27.487645 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-4768f4c4-e6ab-429d-a14c-ca77b520f628 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:04:27.488784 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-4768f4c4-e6ab-429d-a14c-ca77b520f628 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:04:27.489375 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-4768f4c4-e6ab-429d-a14c-ca77b520f628 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:04:27.526997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4768f4c4-e6ab-429d-a14c-ca77b520f628 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:27.528107 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4768f4c4-e6ab-429d-a14c-ca77b520f628 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:27.531501 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4768f4c4-e6ab-429d-a14c-ca77b520f628 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:27.531772 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4768f4c4-e6ab-429d-a14c-ca77b520f628 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:27.594591 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-4768f4c4-e6ab-429d-a14c-ca77b520f628 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Getting quotas for project 9af0bc56481f46cd81075f11f3847b0f. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:04:27.612317 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-4768f4c4-e6ab-429d-a14c-ca77b520f628 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Getting quotas for user 5e37de6a1cc54f739651bb6eee4a25f4 and project 9af0bc56481f46cd81075f11f3847b0f. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:04:27.659111 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4768f4c4-e6ab-429d-a14c-ca77b520f628 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:04:27.666846 n-d-846435-14 devstack@n-api.service[119303]: WARNING nova.utils [None req-4768f4c4-e6ab-429d-a14c-ca77b520f628 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1432973399-access_point-1681468927 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1432973399-ac Jul 25 15:04:27.679102 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4768f4c4-e6ab-429d-a14c-ca77b520f628 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: 4408231b-9845-46be-9d90-99f9729da913] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:04:27.819409 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4768f4c4-e6ab-429d-a14c-ca77b520f628 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 2.132037 Jul 25 15:04:27.828098 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3081/6382] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:04:25 2022] POST /compute/v2.1/servers => generated 457 bytes in 2141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:04:27.832452 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4bf213ef-8531-4d14-abab-ca1f12e42ead tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:04:27.833088 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4bf213ef-8531-4d14-abab-ca1f12e42ead tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: 4408231b-9845-46be-9d90-99f9729da913] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:04:27.856895 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=4 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:04:27.858030 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:04:28.002515 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4bf213ef-8531-4d14-abab-ca1f12e42ead tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:04:28.024751 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4bf213ef-8531-4d14-abab-ca1f12e42ead tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913" status: 200 len: 1294 microversion: 2.1 time: 0.196157 Jul 25 15:04:28.042408 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3302/6383] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:04:27 2022] GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913 => generated 1294 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:04:29.048415 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e7f19714-71e0-4f2e-ac63-56a4329aba4d tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:04:29.049730 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e7f19714-71e0-4f2e-ac63-56a4329aba4d tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: 4408231b-9845-46be-9d90-99f9729da913] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:04:29.072521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e7f19714-71e0-4f2e-ac63-56a4329aba4d tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:29.072978 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e7f19714-71e0-4f2e-ac63-56a4329aba4d tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:29.073763 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e7f19714-71e0-4f2e-ac63-56a4329aba4d tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:29.074194 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e7f19714-71e0-4f2e-ac63-56a4329aba4d tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:29.284734 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e7f19714-71e0-4f2e-ac63-56a4329aba4d tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:04:29.305976 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e7f19714-71e0-4f2e-ac63-56a4329aba4d tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913" status: 200 len: 1290 microversion: 2.1 time: 0.261520 Jul 25 15:04:29.307387 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3082/6384] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:04:29 2022] GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913 => generated 1290 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:04:30.340547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-49f3f795-9dbf-41ed-bae5-a92f4a54d382 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:04:30.341695 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-49f3f795-9dbf-41ed-bae5-a92f4a54d382 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: 4408231b-9845-46be-9d90-99f9729da913] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:04:30.350000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-49f3f795-9dbf-41ed-bae5-a92f4a54d382 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:30.351338 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-49f3f795-9dbf-41ed-bae5-a92f4a54d382 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:30.353576 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-49f3f795-9dbf-41ed-bae5-a92f4a54d382 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:30.354846 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-49f3f795-9dbf-41ed-bae5-a92f4a54d382 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:30.747309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-49f3f795-9dbf-41ed-bae5-a92f4a54d382 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:04:30.760695 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-49f3f795-9dbf-41ed-bae5-a92f4a54d382 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913" status: 200 len: 1352 microversion: 2.1 time: 0.437496 Jul 25 15:04:30.761297 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3303/6385] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:04:30 2022] GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913 => generated 1352 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:04:31.783572 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-55b909ea-db24-43ce-ae53-72b10bf1fe49 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:04:31.785341 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-55b909ea-db24-43ce-ae53-72b10bf1fe49 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: 4408231b-9845-46be-9d90-99f9729da913] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:04:31.799429 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-55b909ea-db24-43ce-ae53-72b10bf1fe49 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:31.805565 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-55b909ea-db24-43ce-ae53-72b10bf1fe49 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:31.806930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-55b909ea-db24-43ce-ae53-72b10bf1fe49 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:31.809491 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-55b909ea-db24-43ce-ae53-72b10bf1fe49 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:32.524892 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-55b909ea-db24-43ce-ae53-72b10bf1fe49 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:04:32.542121 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-55b909ea-db24-43ce-ae53-72b10bf1fe49 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913" status: 200 len: 1471 microversion: 2.1 time: 0.759609 Jul 25 15:04:32.561100 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3083/6386] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:04:31 2022] GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913 => generated 1471 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:04:33.568798 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c36d45d8-822b-4878-aa78-a6316e219d68 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:04:33.569928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c36d45d8-822b-4878-aa78-a6316e219d68 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: 4408231b-9845-46be-9d90-99f9729da913] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:04:33.601369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c36d45d8-822b-4878-aa78-a6316e219d68 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:33.601369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c36d45d8-822b-4878-aa78-a6316e219d68 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:33.607723 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c36d45d8-822b-4878-aa78-a6316e219d68 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:33.610966 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c36d45d8-822b-4878-aa78-a6316e219d68 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:34.683224 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c36d45d8-822b-4878-aa78-a6316e219d68 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:04:34.693282 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c36d45d8-822b-4878-aa78-a6316e219d68 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913" status: 200 len: 1471 microversion: 2.1 time: 1.128527 Jul 25 15:04:34.702892 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3304/6387] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:04:33 2022] GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913 => generated 1471 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:04:35.730648 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1ba5bde8-0ae0-49a3-a0aa-3a5768660a16 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:04:35.748684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1ba5bde8-0ae0-49a3-a0aa-3a5768660a16 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: 4408231b-9845-46be-9d90-99f9729da913] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:04:35.760643 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ba5bde8-0ae0-49a3-a0aa-3a5768660a16 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:35.761472 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ba5bde8-0ae0-49a3-a0aa-3a5768660a16 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:35.763264 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ba5bde8-0ae0-49a3-a0aa-3a5768660a16 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:35.763935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ba5bde8-0ae0-49a3-a0aa-3a5768660a16 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:35.922482 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-4e97c7af-73ca-453d-b6ae-cc4d7596a01f req-0c5fd77b-b1f3-4ae1-b614-5d98d2c932ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4408231b-9845-46be-9d90-99f9729da913", "tag": "75058a25-ea5a-47d4-9567-b3ea7f11ca58"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:04:35.966473 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-4e97c7af-73ca-453d-b6ae-cc4d7596a01f req-0c5fd77b-b1f3-4ae1-b614-5d98d2c932ef service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:35.969112 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-4e97c7af-73ca-453d-b6ae-cc4d7596a01f req-0c5fd77b-b1f3-4ae1-b614-5d98d2c932ef service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:36.000807 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-4e97c7af-73ca-453d-b6ae-cc4d7596a01f req-0c5fd77b-b1f3-4ae1-b614-5d98d2c932ef service nova] Creating event network-changed:75058a25-ea5a-47d4-9567-b3ea7f11ca58 for instance 4408231b-9845-46be-9d90-99f9729da913 on n-h1-846435-14 Jul 25 15:04:36.020777 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-4e97c7af-73ca-453d-b6ae-cc4d7596a01f req-0c5fd77b-b1f3-4ae1-b614-5d98d2c932ef service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103729 Jul 25 15:04:36.029852 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3305/6388] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:04:36.495635 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1ba5bde8-0ae0-49a3-a0aa-3a5768660a16 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:04:36.510451 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1ba5bde8-0ae0-49a3-a0aa-3a5768660a16 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913" status: 200 len: 1471 microversion: 2.1 time: 0.786923 Jul 25 15:04:36.533885 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3084/6389] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:04:35 2022] GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913 => generated 1471 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:04:37.549519 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-25662954-c00a-4b38-a269-fc37762cf8e9 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:04:37.550496 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-25662954-c00a-4b38-a269-fc37762cf8e9 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: 4408231b-9845-46be-9d90-99f9729da913] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:04:37.590180 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25662954-c00a-4b38-a269-fc37762cf8e9 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:37.591933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25662954-c00a-4b38-a269-fc37762cf8e9 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:37.609330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25662954-c00a-4b38-a269-fc37762cf8e9 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:37.618379 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25662954-c00a-4b38-a269-fc37762cf8e9 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:37.995614 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-25662954-c00a-4b38-a269-fc37762cf8e9 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:04:38.008434 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-25662954-c00a-4b38-a269-fc37762cf8e9 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913" status: 200 len: 1471 microversion: 2.1 time: 0.470912 Jul 25 15:04:38.009821 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3306/6390] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:04:37 2022] GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913 => generated 1471 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:04:38.255728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-59c10f8f-91d1-47dd-bfdc-82110fe24421 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1838778671", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "13bdf389-a76d-4fd9-9392-85951bda6bf2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c376c71f-de2b-4e80-ab75-8e710f8505df"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:04:38.266923 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:04:38.268287 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:04:38.362220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-59c10f8f-91d1-47dd-bfdc-82110fe24421 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] validate_networks() for [('c376c71f-de2b-4e80-ab75-8e710f8505df', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:04:39.041484 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0d86a06f-841a-4f2f-8be7-413f51f14817 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:04:39.043676 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0d86a06f-841a-4f2f-8be7-413f51f14817 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: 4408231b-9845-46be-9d90-99f9729da913] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:04:39.080344 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:04:39.092406 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0d86a06f-841a-4f2f-8be7-413f51f14817 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:39.096165 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0d86a06f-841a-4f2f-8be7-413f51f14817 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:39.097176 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0d86a06f-841a-4f2f-8be7-413f51f14817 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:39.099481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0d86a06f-841a-4f2f-8be7-413f51f14817 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:39.321109 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-59c10f8f-91d1-47dd-bfdc-82110fe24421 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:04:39.322166 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-59c10f8f-91d1-47dd-bfdc-82110fe24421 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:04:39.322823 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-59c10f8f-91d1-47dd-bfdc-82110fe24421 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:04:39.323540 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-59c10f8f-91d1-47dd-bfdc-82110fe24421 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:04:39.324146 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-59c10f8f-91d1-47dd-bfdc-82110fe24421 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:04:39.335642 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59c10f8f-91d1-47dd-bfdc-82110fe24421 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:39.338508 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59c10f8f-91d1-47dd-bfdc-82110fe24421 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:39.339990 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59c10f8f-91d1-47dd-bfdc-82110fe24421 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:39.342453 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59c10f8f-91d1-47dd-bfdc-82110fe24421 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:39.395847 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-59c10f8f-91d1-47dd-bfdc-82110fe24421 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Getting quotas for project 450a632353eb4912a87bd5efc3bf2907. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:04:39.408389 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-59c10f8f-91d1-47dd-bfdc-82110fe24421 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Getting quotas for user e4eae2927eb943e9ab2bb78b6b555404 and project 450a632353eb4912a87bd5efc3bf2907. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:04:39.542753 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-59c10f8f-91d1-47dd-bfdc-82110fe24421 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:04:39.544967 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-59c10f8f-91d1-47dd-bfdc-82110fe24421 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='13bdf389-a76d-4fd9-9392-85951bda6bf2',volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:04:39.592428 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0d86a06f-841a-4f2f-8be7-413f51f14817 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:04:39.600425 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0d86a06f-841a-4f2f-8be7-413f51f14817 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913" status: 200 len: 1471 microversion: 2.1 time: 0.570020 Jul 25 15:04:39.617059 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3307/6391] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:04:39 2022] GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913 => generated 1471 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:04:39.798850 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-59c10f8f-91d1-47dd-bfdc-82110fe24421 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.547534 Jul 25 15:04:39.808008 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3085/6392] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:04:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:04:39.812560 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e9c76b18-01b5-4e6d-bd50-01fe8ffea38a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:04:39.814481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e9c76b18-01b5-4e6d-bd50-01fe8ffea38a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:04:39.983245 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e9c76b18-01b5-4e6d-bd50-01fe8ffea38a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:04:39.990547 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e9c76b18-01b5-4e6d-bd50-01fe8ffea38a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374" status: 200 len: 1057 microversion: 2.1 time: 0.181942 Jul 25 15:04:39.991154 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3308/6393] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:04:39 2022] GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 => generated 1057 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:04:40.621116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-55901fc3-6edf-4383-a81e-7322053b7b81 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:04:40.622240 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-55901fc3-6edf-4383-a81e-7322053b7b81 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: 4408231b-9845-46be-9d90-99f9729da913] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:04:40.632428 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-55901fc3-6edf-4383-a81e-7322053b7b81 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:40.633148 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-55901fc3-6edf-4383-a81e-7322053b7b81 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:40.634135 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-55901fc3-6edf-4383-a81e-7322053b7b81 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:40.634722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-55901fc3-6edf-4383-a81e-7322053b7b81 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:40.978942 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-55901fc3-6edf-4383-a81e-7322053b7b81 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:04:41.000502 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-55901fc3-6edf-4383-a81e-7322053b7b81 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913" status: 200 len: 1471 microversion: 2.1 time: 0.383022 Jul 25 15:04:41.003401 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3086/6394] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:04:40 2022] GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913 => generated 1471 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:04:41.021861 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ccac216e-72c4-466c-bef5-92cece6c7b8b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:04:41.022598 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ccac216e-72c4-466c-bef5-92cece6c7b8b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:04:41.043707 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ccac216e-72c4-466c-bef5-92cece6c7b8b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:41.046233 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ccac216e-72c4-466c-bef5-92cece6c7b8b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:41.049095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ccac216e-72c4-466c-bef5-92cece6c7b8b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:41.049802 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ccac216e-72c4-466c-bef5-92cece6c7b8b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:41.212544 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ccac216e-72c4-466c-bef5-92cece6c7b8b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:04:41.223279 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ccac216e-72c4-466c-bef5-92cece6c7b8b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374" status: 200 len: 1155 microversion: 2.1 time: 0.205502 Jul 25 15:04:41.227759 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3309/6395] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:04:41 2022] GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 => generated 1155 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:04:42.044145 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a071276a-d83f-45ee-807e-d26d4b99dde4 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:04:42.049147 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a071276a-d83f-45ee-807e-d26d4b99dde4 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: 4408231b-9845-46be-9d90-99f9729da913] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:04:42.081306 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a071276a-d83f-45ee-807e-d26d4b99dde4 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:42.087880 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a071276a-d83f-45ee-807e-d26d4b99dde4 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:42.089408 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a071276a-d83f-45ee-807e-d26d4b99dde4 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:42.090019 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a071276a-d83f-45ee-807e-d26d4b99dde4 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:42.247543 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8762c046-14e6-4edd-84c9-6198e7acb15c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:04:42.248372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8762c046-14e6-4edd-84c9-6198e7acb15c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:04:42.289645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8762c046-14e6-4edd-84c9-6198e7acb15c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:42.290591 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8762c046-14e6-4edd-84c9-6198e7acb15c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:42.303128 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8762c046-14e6-4edd-84c9-6198e7acb15c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:42.304151 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8762c046-14e6-4edd-84c9-6198e7acb15c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:42.473102 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a071276a-d83f-45ee-807e-d26d4b99dde4 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:04:42.490577 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a071276a-d83f-45ee-807e-d26d4b99dde4 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913" status: 200 len: 1471 microversion: 2.1 time: 0.461788 Jul 25 15:04:42.496788 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3087/6396] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:04:42 2022] GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913 => generated 1471 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:04:42.587213 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8762c046-14e6-4edd-84c9-6198e7acb15c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:04:42.603430 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8762c046-14e6-4edd-84c9-6198e7acb15c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374" status: 200 len: 1173 microversion: 2.1 time: 0.360254 Jul 25 15:04:42.604321 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3310/6397] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:04:42 2022] GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 => generated 1173 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:04:43.521256 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bc618bca-1e23-4dd3-bfa6-7bd078ed5e64 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:04:43.521943 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bc618bca-1e23-4dd3-bfa6-7bd078ed5e64 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: 4408231b-9845-46be-9d90-99f9729da913] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:04:43.529945 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bc618bca-1e23-4dd3-bfa6-7bd078ed5e64 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:43.530312 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bc618bca-1e23-4dd3-bfa6-7bd078ed5e64 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:43.531101 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bc618bca-1e23-4dd3-bfa6-7bd078ed5e64 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:43.531537 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bc618bca-1e23-4dd3-bfa6-7bd078ed5e64 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:43.628623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6fbb6dce-5f1e-4c31-8072-c93682d66e05 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:04:43.629868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6fbb6dce-5f1e-4c31-8072-c93682d66e05 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:04:43.669989 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6fbb6dce-5f1e-4c31-8072-c93682d66e05 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:43.670723 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6fbb6dce-5f1e-4c31-8072-c93682d66e05 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:43.673851 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6fbb6dce-5f1e-4c31-8072-c93682d66e05 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:43.674588 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6fbb6dce-5f1e-4c31-8072-c93682d66e05 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:43.875132 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bc618bca-1e23-4dd3-bfa6-7bd078ed5e64 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:04:43.885987 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bc618bca-1e23-4dd3-bfa6-7bd078ed5e64 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913" status: 200 len: 1471 microversion: 2.1 time: 0.370852 Jul 25 15:04:43.890370 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3088/6398] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:04:43 2022] GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913 => generated 1471 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:04:44.137938 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6fbb6dce-5f1e-4c31-8072-c93682d66e05 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:04:44.148954 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6fbb6dce-5f1e-4c31-8072-c93682d66e05 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374" status: 200 len: 1173 microversion: 2.1 time: 0.525721 Jul 25 15:04:44.149899 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3311/6399] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:04:43 2022] GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 => generated 1173 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:04:44.911076 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d2d355a0-d1cc-4b7d-af4b-077864fefdc3 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:04:44.912698 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d2d355a0-d1cc-4b7d-af4b-077864fefdc3 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: 4408231b-9845-46be-9d90-99f9729da913] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:04:44.920685 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d2d355a0-d1cc-4b7d-af4b-077864fefdc3 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:44.921489 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d2d355a0-d1cc-4b7d-af4b-077864fefdc3 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:44.922551 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d2d355a0-d1cc-4b7d-af4b-077864fefdc3 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:44.923134 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d2d355a0-d1cc-4b7d-af4b-077864fefdc3 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:45.170813 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c1691173-3239-4940-a95f-b480dca4e4e3 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:04:45.171719 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c1691173-3239-4940-a95f-b480dca4e4e3 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:04:45.192736 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c1691173-3239-4940-a95f-b480dca4e4e3 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:45.193531 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c1691173-3239-4940-a95f-b480dca4e4e3 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:45.194498 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c1691173-3239-4940-a95f-b480dca4e4e3 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:45.196457 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c1691173-3239-4940-a95f-b480dca4e4e3 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:45.540473 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d2d355a0-d1cc-4b7d-af4b-077864fefdc3 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:04:45.553469 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d2d355a0-d1cc-4b7d-af4b-077864fefdc3 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913" status: 200 len: 1471 microversion: 2.1 time: 0.644421 Jul 25 15:04:45.554389 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3089/6400] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:04:44 2022] GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913 => generated 1471 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:04:46.022862 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-5c80d0e1-5922-4635-b57c-3391bab22ee1 req-411d09eb-e0bf-4705-9737-d0cea547153e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4408231b-9845-46be-9d90-99f9729da913", "name": "network-vif-plugged", "status": "completed", "tag": "75058a25-ea5a-47d4-9567-b3ea7f11ca58"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:04:46.063633 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-5c80d0e1-5922-4635-b57c-3391bab22ee1 req-411d09eb-e0bf-4705-9737-d0cea547153e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:46.066502 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-5c80d0e1-5922-4635-b57c-3391bab22ee1 req-411d09eb-e0bf-4705-9737-d0cea547153e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:46.111748 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-5c80d0e1-5922-4635-b57c-3391bab22ee1 req-411d09eb-e0bf-4705-9737-d0cea547153e service nova] Creating event network-vif-plugged:75058a25-ea5a-47d4-9567-b3ea7f11ca58 for instance 4408231b-9845-46be-9d90-99f9729da913 on n-h1-846435-14 Jul 25 15:04:46.138278 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-5c80d0e1-5922-4635-b57c-3391bab22ee1 req-411d09eb-e0bf-4705-9737-d0cea547153e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114629 Jul 25 15:04:46.141992 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3090/6401] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:04:46.319672 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c1691173-3239-4940-a95f-b480dca4e4e3 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:04:46.336044 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c1691173-3239-4940-a95f-b480dca4e4e3 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374" status: 200 len: 1215 microversion: 2.1 time: 1.169761 Jul 25 15:04:46.338254 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3312/6402] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:04:45 2022] GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 => generated 1215 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:04:46.577872 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-668c4d18-1321-41dd-a8e5-a2f5f531b837 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:04:46.578649 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-668c4d18-1321-41dd-a8e5-a2f5f531b837 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: 4408231b-9845-46be-9d90-99f9729da913] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:04:46.594914 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-668c4d18-1321-41dd-a8e5-a2f5f531b837 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:46.595409 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-668c4d18-1321-41dd-a8e5-a2f5f531b837 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:46.604041 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-668c4d18-1321-41dd-a8e5-a2f5f531b837 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:46.604524 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-668c4d18-1321-41dd-a8e5-a2f5f531b837 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:46.910114 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-668c4d18-1321-41dd-a8e5-a2f5f531b837 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:04:46.922858 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-668c4d18-1321-41dd-a8e5-a2f5f531b837 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913" status: 200 len: 1471 microversion: 2.1 time: 0.349309 Jul 25 15:04:46.936422 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3091/6403] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:04:46 2022] GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913 => generated 1471 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:04:47.357593 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1d957dee-e82b-4110-9704-b0a1d9289408 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:04:47.358971 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1d957dee-e82b-4110-9704-b0a1d9289408 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:04:47.369382 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1d957dee-e82b-4110-9704-b0a1d9289408 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:47.370098 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1d957dee-e82b-4110-9704-b0a1d9289408 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:47.371096 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1d957dee-e82b-4110-9704-b0a1d9289408 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:47.371718 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1d957dee-e82b-4110-9704-b0a1d9289408 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:47.950100 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bff59550-b448-4a3d-8552-609e8b2182b7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:04:47.950806 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bff59550-b448-4a3d-8552-609e8b2182b7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: 4408231b-9845-46be-9d90-99f9729da913] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:04:47.977474 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1d957dee-e82b-4110-9704-b0a1d9289408 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:04:47.984765 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bff59550-b448-4a3d-8552-609e8b2182b7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:47.985259 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bff59550-b448-4a3d-8552-609e8b2182b7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:47.988226 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1d957dee-e82b-4110-9704-b0a1d9289408 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374" status: 200 len: 1215 microversion: 2.1 time: 0.634496 Jul 25 15:04:47.990494 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bff59550-b448-4a3d-8552-609e8b2182b7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:47.995120 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bff59550-b448-4a3d-8552-609e8b2182b7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:48.005887 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3313/6404] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:04:47 2022] GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 => generated 1215 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:04:48.739844 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bff59550-b448-4a3d-8552-609e8b2182b7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:04:48.748560 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bff59550-b448-4a3d-8552-609e8b2182b7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913" status: 200 len: 1471 microversion: 2.1 time: 0.803039 Jul 25 15:04:48.753706 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3092/6405] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:04:47 2022] GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913 => generated 1471 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:04:49.013745 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-35f5dda3-02ae-4c86-b6aa-23a52cf412a8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:04:49.014358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-35f5dda3-02ae-4c86-b6aa-23a52cf412a8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:04:49.027700 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35f5dda3-02ae-4c86-b6aa-23a52cf412a8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:49.028172 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35f5dda3-02ae-4c86-b6aa-23a52cf412a8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:49.028944 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35f5dda3-02ae-4c86-b6aa-23a52cf412a8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:49.029370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35f5dda3-02ae-4c86-b6aa-23a52cf412a8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:49.782142 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ac9f7558-315e-48a5-a91f-983833de5bcc tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:04:49.783786 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ac9f7558-315e-48a5-a91f-983833de5bcc tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: 4408231b-9845-46be-9d90-99f9729da913] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:04:49.787430 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:04:49.789883 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:04:49.825739 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ac9f7558-315e-48a5-a91f-983833de5bcc tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:49.826866 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ac9f7558-315e-48a5-a91f-983833de5bcc tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:49.828566 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ac9f7558-315e-48a5-a91f-983833de5bcc tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:49.830311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ac9f7558-315e-48a5-a91f-983833de5bcc tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:49.987564 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:04:50.103106 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-35f5dda3-02ae-4c86-b6aa-23a52cf412a8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:04:50.122442 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-35f5dda3-02ae-4c86-b6aa-23a52cf412a8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374" status: 200 len: 1215 microversion: 2.1 time: 1.112919 Jul 25 15:04:50.130597 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3314/6406] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:04:49 2022] GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 => generated 1215 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:04:50.248672 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ac9f7558-315e-48a5-a91f-983833de5bcc tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:04:50.259310 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ac9f7558-315e-48a5-a91f-983833de5bcc tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913" status: 200 len: 1642 microversion: 2.1 time: 0.485330 Jul 25 15:04:50.266956 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3093/6407] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:04:49 2022] GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913 => generated 1642 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:04:50.286505 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9e1fff80-dc35-4d31-80ab-20de47b3c1e0 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:04:50.288684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9e1fff80-dc35-4d31-80ab-20de47b3c1e0 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: 4408231b-9845-46be-9d90-99f9729da913] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:04:50.328662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9e1fff80-dc35-4d31-80ab-20de47b3c1e0 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:50.328817 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9e1fff80-dc35-4d31-80ab-20de47b3c1e0 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:50.330027 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9e1fff80-dc35-4d31-80ab-20de47b3c1e0 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:50.330467 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9e1fff80-dc35-4d31-80ab-20de47b3c1e0 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:50.501410 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-611119fa-137e-4ec3-83f5-14e0c6008caa req-2e870737-ed73-44fb-8be3-b9dd71c2159d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "226b13b5-e6f3-45d5-88eb-4e2fd9cd5374", "tag": "b814efba-3335-4e1b-b170-83468628790f"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:04:50.523608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-611119fa-137e-4ec3-83f5-14e0c6008caa req-2e870737-ed73-44fb-8be3-b9dd71c2159d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:50.526642 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-611119fa-137e-4ec3-83f5-14e0c6008caa req-2e870737-ed73-44fb-8be3-b9dd71c2159d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:50.555202 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-611119fa-137e-4ec3-83f5-14e0c6008caa req-2e870737-ed73-44fb-8be3-b9dd71c2159d service nova] Creating event network-changed:b814efba-3335-4e1b-b170-83468628790f for instance 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 on n-h2-846435-14 Jul 25 15:04:50.576005 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-611119fa-137e-4ec3-83f5-14e0c6008caa req-2e870737-ed73-44fb-8be3-b9dd71c2159d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.435590 Jul 25 15:04:50.580275 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3315/6408] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:04:50.735084 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9e1fff80-dc35-4d31-80ab-20de47b3c1e0 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:04:50.745835 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9e1fff80-dc35-4d31-80ab-20de47b3c1e0 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913" status: 200 len: 1642 microversion: 2.1 time: 0.462520 Jul 25 15:04:50.752073 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3094/6409] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:04:50 2022] GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913 => generated 1642 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:04:50.770843 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b0870a0f-c905-4519-9ed2-8690853d552b tempest-TestSecurityGroupsBasicOps-443340023 tempest-TestSecurityGroupsBasicOps-443340023-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:04:50.773604 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b0870a0f-c905-4519-9ed2-8690853d552b tempest-TestSecurityGroupsBasicOps-443340023 tempest-TestSecurityGroupsBasicOps-443340023-project-admin] [instance: 4408231b-9845-46be-9d90-99f9729da913] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:04:50.788702 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0870a0f-c905-4519-9ed2-8690853d552b tempest-TestSecurityGroupsBasicOps-443340023 tempest-TestSecurityGroupsBasicOps-443340023-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:50.789851 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0870a0f-c905-4519-9ed2-8690853d552b tempest-TestSecurityGroupsBasicOps-443340023 tempest-TestSecurityGroupsBasicOps-443340023-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:50.792057 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0870a0f-c905-4519-9ed2-8690853d552b tempest-TestSecurityGroupsBasicOps-443340023 tempest-TestSecurityGroupsBasicOps-443340023-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:50.794565 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0870a0f-c905-4519-9ed2-8690853d552b tempest-TestSecurityGroupsBasicOps-443340023 tempest-TestSecurityGroupsBasicOps-443340023-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:51.151552 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-10da6595-37bf-446d-9b0a-caf397368572 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:04:51.152866 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-10da6595-37bf-446d-9b0a-caf397368572 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:04:51.160430 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-10da6595-37bf-446d-9b0a-caf397368572 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:51.161196 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-10da6595-37bf-446d-9b0a-caf397368572 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:51.162229 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-10da6595-37bf-446d-9b0a-caf397368572 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:51.162880 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-10da6595-37bf-446d-9b0a-caf397368572 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:51.457634 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-10da6595-37bf-446d-9b0a-caf397368572 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:04:51.472812 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-10da6595-37bf-446d-9b0a-caf397368572 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374" status: 200 len: 1215 microversion: 2.1 time: 0.324543 Jul 25 15:04:51.473946 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3095/6410] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:04:51 2022] GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 => generated 1215 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:04:51.867137 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b0870a0f-c905-4519-9ed2-8690853d552b tempest-TestSecurityGroupsBasicOps-443340023 tempest-TestSecurityGroupsBasicOps-443340023-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913" status: 200 len: 1795 microversion: 2.1 time: 1.101600 Jul 25 15:04:51.878726 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3316/6411] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:04:50 2022] GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913 => generated 1795 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:04:52.500203 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dc722b96-2005-4521-b12b-34f4c7f054cd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:04:52.501803 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-dc722b96-2005-4521-b12b-34f4c7f054cd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:04:52.511116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dc722b96-2005-4521-b12b-34f4c7f054cd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:52.511887 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dc722b96-2005-4521-b12b-34f4c7f054cd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:52.513214 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dc722b96-2005-4521-b12b-34f4c7f054cd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:52.513839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dc722b96-2005-4521-b12b-34f4c7f054cd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:52.962906 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-dc722b96-2005-4521-b12b-34f4c7f054cd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:04:52.976306 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dc722b96-2005-4521-b12b-34f4c7f054cd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374" status: 200 len: 1203 microversion: 2.1 time: 0.480466 Jul 25 15:04:52.986136 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3096/6412] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:04:52 2022] GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 => generated 1203 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:04:54.009344 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c1339d4a-ea15-48bc-9cb8-e668664eb549 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:04:54.009967 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c1339d4a-ea15-48bc-9cb8-e668664eb549 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:04:54.025589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c1339d4a-ea15-48bc-9cb8-e668664eb549 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:54.026047 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c1339d4a-ea15-48bc-9cb8-e668664eb549 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:54.026837 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c1339d4a-ea15-48bc-9cb8-e668664eb549 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:54.027279 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c1339d4a-ea15-48bc-9cb8-e668664eb549 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:54.392548 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c1339d4a-ea15-48bc-9cb8-e668664eb549 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:04:54.402062 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c1339d4a-ea15-48bc-9cb8-e668664eb549 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374" status: 200 len: 1203 microversion: 2.1 time: 0.396914 Jul 25 15:04:54.404813 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3317/6413] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:04:54 2022] GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 => generated 1203 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:04:55.426054 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b927fd21-b8b8-4e5d-a75b-646936d4d7ea tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:04:55.426670 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b927fd21-b8b8-4e5d-a75b-646936d4d7ea tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:04:55.441032 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b927fd21-b8b8-4e5d-a75b-646936d4d7ea tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:55.442052 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b927fd21-b8b8-4e5d-a75b-646936d4d7ea tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:55.443395 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b927fd21-b8b8-4e5d-a75b-646936d4d7ea tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:55.444043 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b927fd21-b8b8-4e5d-a75b-646936d4d7ea tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:55.659315 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b927fd21-b8b8-4e5d-a75b-646936d4d7ea tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:04:55.678421 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b927fd21-b8b8-4e5d-a75b-646936d4d7ea tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374" status: 200 len: 1203 microversion: 2.1 time: 0.256188 Jul 25 15:04:55.688871 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3097/6414] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:04:55 2022] GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 => generated 1203 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:04:55.724924 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-13d98d5d-fc6c-4646-975f-c6b0dbbcb812 req-cb353fb2-811d-40b7-9e4c-70f426099fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4408231b-9845-46be-9d90-99f9729da913", "tag": "75058a25-ea5a-47d4-9567-b3ea7f11ca58"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:04:55.748107 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-13d98d5d-fc6c-4646-975f-c6b0dbbcb812 req-cb353fb2-811d-40b7-9e4c-70f426099fd1 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:55.748556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-13d98d5d-fc6c-4646-975f-c6b0dbbcb812 req-cb353fb2-811d-40b7-9e4c-70f426099fd1 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:55.769739 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-13d98d5d-fc6c-4646-975f-c6b0dbbcb812 req-cb353fb2-811d-40b7-9e4c-70f426099fd1 service nova] Creating event network-changed:75058a25-ea5a-47d4-9567-b3ea7f11ca58 for instance 4408231b-9845-46be-9d90-99f9729da913 on n-h1-846435-14 Jul 25 15:04:55.775850 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-13d98d5d-fc6c-4646-975f-c6b0dbbcb812 req-cb353fb2-811d-40b7-9e4c-70f426099fd1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060454 Jul 25 15:04:55.777152 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3318/6415] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:04:56.702559 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-da349e1f-8e4f-49de-848f-b2457dd31659 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:04:56.703933 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-da349e1f-8e4f-49de-848f-b2457dd31659 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:04:56.711899 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:04:56.713982 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da349e1f-8e4f-49de-848f-b2457dd31659 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:56.715376 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da349e1f-8e4f-49de-848f-b2457dd31659 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:56.716771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da349e1f-8e4f-49de-848f-b2457dd31659 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:56.717591 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da349e1f-8e4f-49de-848f-b2457dd31659 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:56.754917 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=91 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:04:57.162751 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-da349e1f-8e4f-49de-848f-b2457dd31659 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:04:57.179397 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-da349e1f-8e4f-49de-848f-b2457dd31659 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374" status: 200 len: 1203 microversion: 2.1 time: 0.481061 Jul 25 15:04:57.186232 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3098/6416] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:04:56 2022] GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 => generated 1203 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:04:58.201516 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6c89e738-ed7f-41ba-ac22-4f225928f2b5 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:04:58.203186 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6c89e738-ed7f-41ba-ac22-4f225928f2b5 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:04:58.224164 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=39 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:04:58.230947 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6c89e738-ed7f-41ba-ac22-4f225928f2b5 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:58.231790 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6c89e738-ed7f-41ba-ac22-4f225928f2b5 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:58.233801 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6c89e738-ed7f-41ba-ac22-4f225928f2b5 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:58.234258 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6c89e738-ed7f-41ba-ac22-4f225928f2b5 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:58.252013 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=79 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:04:58.529977 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6c89e738-ed7f-41ba-ac22-4f225928f2b5 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:04:58.540891 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6c89e738-ed7f-41ba-ac22-4f225928f2b5 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374" status: 200 len: 1203 microversion: 2.1 time: 0.343876 Jul 25 15:04:58.549278 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3319/6417] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:04:58 2022] GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 => generated 1203 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:04:59.563804 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1951b40f-4fd0-4cb4-8b75-acf8f01dcc54 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:04:59.564471 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1951b40f-4fd0-4cb4-8b75-acf8f01dcc54 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:04:59.572133 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1951b40f-4fd0-4cb4-8b75-acf8f01dcc54 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:59.572584 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1951b40f-4fd0-4cb4-8b75-acf8f01dcc54 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:59.573373 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1951b40f-4fd0-4cb4-8b75-acf8f01dcc54 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:04:59.573813 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1951b40f-4fd0-4cb4-8b75-acf8f01dcc54 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:04:59.746595 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1951b40f-4fd0-4cb4-8b75-acf8f01dcc54 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:04:59.757459 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1951b40f-4fd0-4cb4-8b75-acf8f01dcc54 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374" status: 200 len: 1203 microversion: 2.1 time: 0.197803 Jul 25 15:04:59.759174 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3099/6418] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:04:59 2022] GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 => generated 1203 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:05:00.780758 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-eb43eed5-cc4e-4b55-9ec4-6caca4907294 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:00.781378 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-eb43eed5-cc4e-4b55-9ec4-6caca4907294 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:00.804112 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eb43eed5-cc4e-4b55-9ec4-6caca4907294 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:00.805039 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eb43eed5-cc4e-4b55-9ec4-6caca4907294 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:00.806589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eb43eed5-cc4e-4b55-9ec4-6caca4907294 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:00.807461 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eb43eed5-cc4e-4b55-9ec4-6caca4907294 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:01.100316 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-eb43eed5-cc4e-4b55-9ec4-6caca4907294 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:05:01.109657 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-eb43eed5-cc4e-4b55-9ec4-6caca4907294 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374" status: 200 len: 1203 microversion: 2.1 time: 0.333476 Jul 25 15:05:01.110421 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3320/6419] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:00 2022] GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 => generated 1203 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:05:02.131339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1b3bde1a-6d9b-4490-a0d6-90335a3548f2 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:02.131953 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1b3bde1a-6d9b-4490-a0d6-90335a3548f2 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:02.145486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1b3bde1a-6d9b-4490-a0d6-90335a3548f2 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:02.148338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1b3bde1a-6d9b-4490-a0d6-90335a3548f2 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:02.152033 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1b3bde1a-6d9b-4490-a0d6-90335a3548f2 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:02.155114 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1b3bde1a-6d9b-4490-a0d6-90335a3548f2 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:02.647364 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1b3bde1a-6d9b-4490-a0d6-90335a3548f2 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:05:02.655948 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1b3bde1a-6d9b-4490-a0d6-90335a3548f2 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374" status: 200 len: 1203 microversion: 2.1 time: 0.528802 Jul 25 15:05:02.668751 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3100/6420] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:02 2022] GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 => generated 1203 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:05:02.826135 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-f7080e9b-8585-4943-8523-675cc315e723 req-c7028388-1fac-4c9b-84d6-cb5446888970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "226b13b5-e6f3-45d5-88eb-4e2fd9cd5374", "name": "network-vif-plugged", "status": "completed", "tag": "b814efba-3335-4e1b-b170-83468628790f"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:05:02.838786 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-f7080e9b-8585-4943-8523-675cc315e723 req-c7028388-1fac-4c9b-84d6-cb5446888970 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:02.839498 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-f7080e9b-8585-4943-8523-675cc315e723 req-c7028388-1fac-4c9b-84d6-cb5446888970 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:02.852638 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-f7080e9b-8585-4943-8523-675cc315e723 req-c7028388-1fac-4c9b-84d6-cb5446888970 service nova] Creating event network-vif-plugged:b814efba-3335-4e1b-b170-83468628790f for instance 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 on n-h2-846435-14 Jul 25 15:05:02.857788 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-f7080e9b-8585-4943-8523-675cc315e723 req-c7028388-1fac-4c9b-84d6-cb5446888970 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037011 Jul 25 15:05:02.858886 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3321/6421] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:05:03.678062 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a9d12a42-0db5-4e35-8933-00860c85b2b3 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:03.679324 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a9d12a42-0db5-4e35-8933-00860c85b2b3 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:03.692704 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a9d12a42-0db5-4e35-8933-00860c85b2b3 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:03.693530 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a9d12a42-0db5-4e35-8933-00860c85b2b3 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:03.695031 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a9d12a42-0db5-4e35-8933-00860c85b2b3 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:03.695656 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a9d12a42-0db5-4e35-8933-00860c85b2b3 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:03.905796 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a9d12a42-0db5-4e35-8933-00860c85b2b3 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:05:03.918867 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a9d12a42-0db5-4e35-8933-00860c85b2b3 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374" status: 200 len: 1203 microversion: 2.1 time: 0.245458 Jul 25 15:05:03.927423 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3101/6422] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:03 2022] GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 => generated 1203 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:05:04.940019 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b9ea10b8-aeac-435f-b0a9-24c80b323ccb tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:04.940720 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b9ea10b8-aeac-435f-b0a9-24c80b323ccb tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:04.949831 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b9ea10b8-aeac-435f-b0a9-24c80b323ccb tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:04.950478 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b9ea10b8-aeac-435f-b0a9-24c80b323ccb tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:04.951881 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b9ea10b8-aeac-435f-b0a9-24c80b323ccb tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:04.952489 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b9ea10b8-aeac-435f-b0a9-24c80b323ccb tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:05.222742 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b9ea10b8-aeac-435f-b0a9-24c80b323ccb tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:05:05.243436 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b9ea10b8-aeac-435f-b0a9-24c80b323ccb tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374" status: 200 len: 1390 microversion: 2.1 time: 0.307807 Jul 25 15:05:05.244344 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3322/6423] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:04 2022] GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 => generated 1390 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:05:05.268130 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-288e2292-19d0-4cf2-9151-2240b51b0d8a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:05.270191 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-288e2292-19d0-4cf2-9151-2240b51b0d8a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:05.285509 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-288e2292-19d0-4cf2-9151-2240b51b0d8a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:05.288383 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-288e2292-19d0-4cf2-9151-2240b51b0d8a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:05.290498 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-288e2292-19d0-4cf2-9151-2240b51b0d8a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:05.292924 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-288e2292-19d0-4cf2-9151-2240b51b0d8a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:05.572347 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-288e2292-19d0-4cf2-9151-2240b51b0d8a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:05:05.582060 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-288e2292-19d0-4cf2-9151-2240b51b0d8a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374" status: 200 len: 1390 microversion: 2.1 time: 0.318306 Jul 25 15:05:05.582690 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3102/6424] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:05 2022] GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 => generated 1390 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:05:05.605589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-16ef838c-c898-4b18-9418-853ebc1a10e6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:05.606251 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-16ef838c-c898-4b18-9418-853ebc1a10e6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:05.625748 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-16ef838c-c898-4b18-9418-853ebc1a10e6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:05.626401 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-16ef838c-c898-4b18-9418-853ebc1a10e6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:05.627368 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-16ef838c-c898-4b18-9418-853ebc1a10e6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:05.628181 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-16ef838c-c898-4b18-9418-853ebc1a10e6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:05.899445 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-16ef838c-c898-4b18-9418-853ebc1a10e6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:05:05.909916 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-16ef838c-c898-4b18-9418-853ebc1a10e6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374" status: 200 len: 1390 microversion: 2.1 time: 0.308443 Jul 25 15:05:05.911492 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3323/6425] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:05 2022] GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 => generated 1390 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:05:05.937520 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7b35edf9-b7d1-4cfe-aa05-4a025e4553ec tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:05.938173 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7b35edf9-b7d1-4cfe-aa05-4a025e4553ec tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:05.945033 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b35edf9-b7d1-4cfe-aa05-4a025e4553ec tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:05.945482 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b35edf9-b7d1-4cfe-aa05-4a025e4553ec tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:05.946256 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b35edf9-b7d1-4cfe-aa05-4a025e4553ec tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:05.946701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b35edf9-b7d1-4cfe-aa05-4a025e4553ec tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:05.999095 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7b35edf9-b7d1-4cfe-aa05-4a025e4553ec tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:05:06.133149 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7b35edf9-b7d1-4cfe-aa05-4a025e4553ec tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "DELETE /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374" status: 204 len: 0 microversion: 2.1 time: 0.199100 Jul 25 15:05:06.134272 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3103/6426] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:05:05 2022] DELETE /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:05:06.142658 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-77eecdf8-bf69-4115-9b91-157c8a677b00 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:06.143269 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-77eecdf8-bf69-4115-9b91-157c8a677b00 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:06.157491 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-77eecdf8-bf69-4115-9b91-157c8a677b00 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:06.158189 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-77eecdf8-bf69-4115-9b91-157c8a677b00 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:06.159157 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-77eecdf8-bf69-4115-9b91-157c8a677b00 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:06.159740 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-77eecdf8-bf69-4115-9b91-157c8a677b00 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:06.596116 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-77eecdf8-bf69-4115-9b91-157c8a677b00 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:05:06.625230 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-77eecdf8-bf69-4115-9b91-157c8a677b00 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374" status: 200 len: 1396 microversion: 2.1 time: 0.486669 Jul 25 15:05:06.641975 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3324/6427] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:06 2022] GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 => generated 1396 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:05:07.663782 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0507b410-0886-42e0-af3d-b45abee8f036 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:07.664557 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0507b410-0886-42e0-af3d-b45abee8f036 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:07.677125 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0507b410-0886-42e0-af3d-b45abee8f036 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:07.677731 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0507b410-0886-42e0-af3d-b45abee8f036 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:07.689283 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0507b410-0886-42e0-af3d-b45abee8f036 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:07.689828 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0507b410-0886-42e0-af3d-b45abee8f036 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:08.006628 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0507b410-0886-42e0-af3d-b45abee8f036 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:05:08.019570 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0507b410-0886-42e0-af3d-b45abee8f036 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374" status: 200 len: 1396 microversion: 2.1 time: 0.359987 Jul 25 15:05:08.020979 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3104/6428] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:07 2022] GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 => generated 1396 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:05:09.043375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a945a4ae-8c18-4a6e-9f6d-46c6973aee1e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:09.044871 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a945a4ae-8c18-4a6e-9f6d-46c6973aee1e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:09.058493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-e7bc37a8-8427-44ee-943a-3adec60d17e0 req-d5bc0512-f2e5-4aab-bc89-c51088b3aeac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "226b13b5-e6f3-45d5-88eb-4e2fd9cd5374", "name": "network-vif-deleted", "tag": "b814efba-3335-4e1b-b170-83468628790f"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:05:09.066772 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a945a4ae-8c18-4a6e-9f6d-46c6973aee1e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:09.067493 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a945a4ae-8c18-4a6e-9f6d-46c6973aee1e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:09.068521 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a945a4ae-8c18-4a6e-9f6d-46c6973aee1e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:09.069154 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a945a4ae-8c18-4a6e-9f6d-46c6973aee1e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:09.079438 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-e7bc37a8-8427-44ee-943a-3adec60d17e0 req-d5bc0512-f2e5-4aab-bc89-c51088b3aeac service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:09.079891 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-e7bc37a8-8427-44ee-943a-3adec60d17e0 req-d5bc0512-f2e5-4aab-bc89-c51088b3aeac service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:09.116963 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-e7bc37a8-8427-44ee-943a-3adec60d17e0 req-d5bc0512-f2e5-4aab-bc89-c51088b3aeac service nova] Creating event network-vif-deleted:b814efba-3335-4e1b-b170-83468628790f for instance 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 on n-h2-846435-14 Jul 25 15:05:09.128323 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-e7bc37a8-8427-44ee-943a-3adec60d17e0 req-d5bc0512-f2e5-4aab-bc89-c51088b3aeac service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073637 Jul 25 15:05:09.129983 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3105/6429] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:05:09.193494 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a945a4ae-8c18-4a6e-9f6d-46c6973aee1e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:05:09.203087 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a945a4ae-8c18-4a6e-9f6d-46c6973aee1e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374" status: 200 len: 1354 microversion: 2.1 time: 0.164793 Jul 25 15:05:09.203707 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3325/6430] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:09 2022] GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 => generated 1354 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:05:10.227817 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-965720f9-bb15-4db1-a6be-31c387619dd1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:10.228486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-965720f9-bb15-4db1-a6be-31c387619dd1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:10.246283 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-965720f9-bb15-4db1-a6be-31c387619dd1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:10.246743 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-965720f9-bb15-4db1-a6be-31c387619dd1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:10.247546 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-965720f9-bb15-4db1-a6be-31c387619dd1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:10.248003 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-965720f9-bb15-4db1-a6be-31c387619dd1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:10.476036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-965720f9-bb15-4db1-a6be-31c387619dd1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:05:10.488275 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-965720f9-bb15-4db1-a6be-31c387619dd1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374" status: 200 len: 1188 microversion: 2.1 time: 0.268201 Jul 25 15:05:10.492338 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3106/6431] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:10 2022] GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 => generated 1188 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:05:11.522460 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7de0f8ec-07d6-4c50-b737-8bd81960148b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:11.523766 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7de0f8ec-07d6-4c50-b737-8bd81960148b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:11.548885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7de0f8ec-07d6-4c50-b737-8bd81960148b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:11.549792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7de0f8ec-07d6-4c50-b737-8bd81960148b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:11.550861 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7de0f8ec-07d6-4c50-b737-8bd81960148b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:11.551517 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7de0f8ec-07d6-4c50-b737-8bd81960148b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:11.681842 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7de0f8ec-07d6-4c50-b737-8bd81960148b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:05:11.690312 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7de0f8ec-07d6-4c50-b737-8bd81960148b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374" status: 200 len: 1188 microversion: 2.1 time: 0.174119 Jul 25 15:05:11.692443 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3326/6432] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:11 2022] GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 => generated 1188 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:05:12.716270 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b33682ae-2096-4e7d-8105-37ad8932bb2c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:12.716808 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b33682ae-2096-4e7d-8105-37ad8932bb2c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:12.729428 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b33682ae-2096-4e7d-8105-37ad8932bb2c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:12.729898 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b33682ae-2096-4e7d-8105-37ad8932bb2c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:12.730693 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b33682ae-2096-4e7d-8105-37ad8932bb2c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:12.731141 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b33682ae-2096-4e7d-8105-37ad8932bb2c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:12.865703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b33682ae-2096-4e7d-8105-37ad8932bb2c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:05:12.877088 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b33682ae-2096-4e7d-8105-37ad8932bb2c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374" status: 200 len: 1188 microversion: 2.1 time: 0.164726 Jul 25 15:05:12.878193 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3107/6433] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:12 2022] GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 => generated 1188 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:05:13.899043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8d96df12-d2e8-4c82-a28f-13a0aabfcc3d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:13.899555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8d96df12-d2e8-4c82-a28f-13a0aabfcc3d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:13.910405 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d96df12-d2e8-4c82-a28f-13a0aabfcc3d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:13.910929 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d96df12-d2e8-4c82-a28f-13a0aabfcc3d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:13.912231 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d96df12-d2e8-4c82-a28f-13a0aabfcc3d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:13.913060 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8d96df12-d2e8-4c82-a28f-13a0aabfcc3d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:14.254627 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8d96df12-d2e8-4c82-a28f-13a0aabfcc3d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:05:14.264185 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8d96df12-d2e8-4c82-a28f-13a0aabfcc3d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374" status: 200 len: 1188 microversion: 2.1 time: 0.369027 Jul 25 15:05:14.280364 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3327/6434] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:13 2022] GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 => generated 1188 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:05:15.286465 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-220c8887-b288-44d3-a9ef-3de2ead171b9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:15.287900 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-220c8887-b288-44d3-a9ef-3de2ead171b9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:15.299144 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-220c8887-b288-44d3-a9ef-3de2ead171b9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:15.299923 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-220c8887-b288-44d3-a9ef-3de2ead171b9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:15.301214 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-220c8887-b288-44d3-a9ef-3de2ead171b9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:15.302348 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-220c8887-b288-44d3-a9ef-3de2ead171b9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:15.453762 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-220c8887-b288-44d3-a9ef-3de2ead171b9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:15.456214 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-220c8887-b288-44d3-a9ef-3de2ead171b9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:15.457441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-220c8887-b288-44d3-a9ef-3de2ead171b9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lazy-loading 'fault' on Instance uuid 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:05:15.598950 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-220c8887-b288-44d3-a9ef-3de2ead171b9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:05:15.607735 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-220c8887-b288-44d3-a9ef-3de2ead171b9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374" status: 200 len: 1147 microversion: 2.1 time: 0.327065 Jul 25 15:05:15.613454 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3108/6435] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:15 2022] GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 => generated 1147 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:05:16.642935 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c408e9df-a25a-47ea-a599-a8f6f6c29376 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:16.645463 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c408e9df-a25a-47ea-a599-a8f6f6c29376 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:16.656537 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c408e9df-a25a-47ea-a599-a8f6f6c29376 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:16.657274 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c408e9df-a25a-47ea-a599-a8f6f6c29376 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:16.658975 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c408e9df-a25a-47ea-a599-a8f6f6c29376 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:16.659610 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c408e9df-a25a-47ea-a599-a8f6f6c29376 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:16.683851 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-c408e9df-a25a-47ea-a599-a8f6f6c29376 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] HTTP exception thrown: Instance 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 could not be found. Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c408e9df-a25a-47ea-a599-a8f6f6c29376 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Request method failure captured: Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 HTTP/1.1 Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3rDtvHLNADQM-uJ_J3klWg0FTy_E0qH1hvwasDYrxKDHzDvpYuxQ-thmFamK-Qma_d-RBIPBhjFabpJL3iCa_0TXRcnv8VILXYJZ82EcknBbgye7z_bTamQlAxPZ4RYdd06oyEONGUiMQFVcfd19pQtHuauUAFexddlrbqczpvEqs-4 Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 450a632353eb4912a87bd5efc3bf2907 Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/450a632353eb4912a87bd5efc3bf2907"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/450a632353eb4912a87bd5efc3bf2907"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_450a632353eb4912a87bd5efc3bf2907", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/450a632353eb4912a87bd5efc3bf2907"}]}] Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 450a632353eb4912a87bd5efc3bf2907 Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-TestVolumeBootPattern-1790932632-project Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: e4eae2927eb943e9ab2bb78b6b555404 Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-TestVolumeBootPattern-1790932632-project Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 could not be found. Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '226b13b5-e6f3-45d5-88eb-4e2fd9cd5374'} Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 could not be found. Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 could not be found. Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:05:16.687150 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:05:16.692626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:05:16.692626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:05:16.692626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:05:16.692626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:05:16.692626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:05:16.692626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 could not be found. Jul 25 15:05:16.692626 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:05:16.694760 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c408e9df-a25a-47ea-a599-a8f6f6c29376 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Returning 404 to user: Instance 226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:05:16.695654 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c408e9df-a25a-47ea-a599-a8f6f6c29376 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374" status: 404 len: 111 microversion: 2.1 time: 0.059554 Jul 25 15:05:16.699893 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3328/6436] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:16 2022] GET /compute/v2.1/servers/226b13b5-e6f3-45d5-88eb-4e2fd9cd5374 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:05:37.638433 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5f70e00c-83f2-4a3e-b405-32a14ad107b7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-976947414", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "ddfa1c06-dae8-4703-830c-3375470b79cf"}], "key_name": "tempest-TestSecurityGroupsBasicOps-387715417", "security_groups": []}, "os:scheduler_hints": {"different_host": ["4408231b-9845-46be-9d90-99f9729da913"]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:05:37.672693 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:05:37.675380 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:05:37.792290 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-5f70e00c-83f2-4a3e-b405-32a14ad107b7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] validate_networks() for [('ddfa1c06-dae8-4703-830c-3375470b79cf', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:05:39.196383 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-5f70e00c-83f2-4a3e-b405-32a14ad107b7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:05:39.197063 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-5f70e00c-83f2-4a3e-b405-32a14ad107b7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:05:39.197859 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-5f70e00c-83f2-4a3e-b405-32a14ad107b7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:05:39.198278 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-5f70e00c-83f2-4a3e-b405-32a14ad107b7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:05:39.198697 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-5f70e00c-83f2-4a3e-b405-32a14ad107b7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:05:39.216646 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f70e00c-83f2-4a3e-b405-32a14ad107b7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:39.217828 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f70e00c-83f2-4a3e-b405-32a14ad107b7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:39.221174 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f70e00c-83f2-4a3e-b405-32a14ad107b7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:39.222085 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f70e00c-83f2-4a3e-b405-32a14ad107b7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:39.287905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-5f70e00c-83f2-4a3e-b405-32a14ad107b7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Getting quotas for project 9af0bc56481f46cd81075f11f3847b0f. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:05:39.305298 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-5f70e00c-83f2-4a3e-b405-32a14ad107b7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Getting quotas for user 5e37de6a1cc54f739651bb6eee4a25f4 and project 9af0bc56481f46cd81075f11f3847b0f. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:05:39.337616 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5f70e00c-83f2-4a3e-b405-32a14ad107b7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:05:39.344866 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5f70e00c-83f2-4a3e-b405-32a14ad107b7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: d2ec354e-832b-45b8-addf-c2ac8245f3a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:05:39.507525 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5f70e00c-83f2-4a3e-b405-32a14ad107b7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.873485 Jul 25 15:05:39.508246 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3109/6437] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:05:37 2022] POST /compute/v2.1/servers => generated 361 bytes in 1876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:05:39.520241 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8482449f-eb67-42ea-887f-a55cadae8592 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:39.522470 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8482449f-eb67-42ea-887f-a55cadae8592 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: d2ec354e-832b-45b8-addf-c2ac8245f3a9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:39.526549 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=19 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:05:39.530088 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=51 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:05:39.698772 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8482449f-eb67-42ea-887f-a55cadae8592 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:05:39.712070 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8482449f-eb67-42ea-887f-a55cadae8592 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9" status: 200 len: 1240 microversion: 2.1 time: 0.196112 Jul 25 15:05:39.716302 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3329/6438] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:39 2022] GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9 => generated 1240 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:05:40.734615 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5850f5cb-93dd-496d-b3d0-ca6dc1d66872 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:40.735921 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5850f5cb-93dd-496d-b3d0-ca6dc1d66872 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: d2ec354e-832b-45b8-addf-c2ac8245f3a9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:40.751473 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5850f5cb-93dd-496d-b3d0-ca6dc1d66872 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:40.754176 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5850f5cb-93dd-496d-b3d0-ca6dc1d66872 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:40.756164 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5850f5cb-93dd-496d-b3d0-ca6dc1d66872 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:40.757972 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5850f5cb-93dd-496d-b3d0-ca6dc1d66872 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:41.763346 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5850f5cb-93dd-496d-b3d0-ca6dc1d66872 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:05:41.786187 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5850f5cb-93dd-496d-b3d0-ca6dc1d66872 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9" status: 200 len: 1244 microversion: 2.1 time: 1.056697 Jul 25 15:05:41.787102 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3110/6439] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:40 2022] GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9 => generated 1244 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:05:42.815189 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1b037132-d785-44fc-b59e-59c86949f135 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:42.816255 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1b037132-d785-44fc-b59e-59c86949f135 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: d2ec354e-832b-45b8-addf-c2ac8245f3a9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:42.852113 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1b037132-d785-44fc-b59e-59c86949f135 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:42.856139 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1b037132-d785-44fc-b59e-59c86949f135 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:42.859633 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1b037132-d785-44fc-b59e-59c86949f135 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:42.860152 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1b037132-d785-44fc-b59e-59c86949f135 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:43.108420 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1b037132-d785-44fc-b59e-59c86949f135 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:05:43.123179 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1b037132-d785-44fc-b59e-59c86949f135 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9" status: 200 len: 1298 microversion: 2.1 time: 0.313533 Jul 25 15:05:43.139059 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3330/6440] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:42 2022] GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9 => generated 1298 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:05:44.150791 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-089a5ac5-e553-4658-b433-bed4a1593ab7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:44.151635 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-089a5ac5-e553-4658-b433-bed4a1593ab7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: d2ec354e-832b-45b8-addf-c2ac8245f3a9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:44.163811 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-089a5ac5-e553-4658-b433-bed4a1593ab7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:44.166074 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-089a5ac5-e553-4658-b433-bed4a1593ab7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:44.171186 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-089a5ac5-e553-4658-b433-bed4a1593ab7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:44.171779 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-089a5ac5-e553-4658-b433-bed4a1593ab7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:44.332559 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-089a5ac5-e553-4658-b433-bed4a1593ab7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:05:44.349977 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-089a5ac5-e553-4658-b433-bed4a1593ab7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9" status: 200 len: 1298 microversion: 2.1 time: 0.199762 Jul 25 15:05:44.352426 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3111/6441] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:44 2022] GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9 => generated 1298 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:05:45.372652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-880ea122-3b15-4edd-8e8b-4480c95b4ae5 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:45.373937 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-880ea122-3b15-4edd-8e8b-4480c95b4ae5 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: d2ec354e-832b-45b8-addf-c2ac8245f3a9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:45.383933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-880ea122-3b15-4edd-8e8b-4480c95b4ae5 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:45.384883 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-880ea122-3b15-4edd-8e8b-4480c95b4ae5 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:45.386632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-880ea122-3b15-4edd-8e8b-4480c95b4ae5 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:45.387703 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-880ea122-3b15-4edd-8e8b-4480c95b4ae5 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:45.710064 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-880ea122-3b15-4edd-8e8b-4480c95b4ae5 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:05:45.722252 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-880ea122-3b15-4edd-8e8b-4480c95b4ae5 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9" status: 200 len: 1298 microversion: 2.1 time: 0.355081 Jul 25 15:05:45.722838 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3331/6442] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:45 2022] GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9 => generated 1298 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:05:46.504722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-a2f714e0-3e26-44a1-901b-ed0b59dfbeb0 req-ddee8e25-e614-46da-9d15-8f4b84fbdfc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2ec354e-832b-45b8-addf-c2ac8245f3a9", "tag": "43588d12-dfe0-4c82-9a47-adc99db49d95"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:05:46.550745 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-a2f714e0-3e26-44a1-901b-ed0b59dfbeb0 req-ddee8e25-e614-46da-9d15-8f4b84fbdfc3 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:46.551756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-a2f714e0-3e26-44a1-901b-ed0b59dfbeb0 req-ddee8e25-e614-46da-9d15-8f4b84fbdfc3 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:46.575593 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-a2f714e0-3e26-44a1-901b-ed0b59dfbeb0 req-ddee8e25-e614-46da-9d15-8f4b84fbdfc3 service nova] Creating event network-changed:43588d12-dfe0-4c82-9a47-adc99db49d95 for instance d2ec354e-832b-45b8-addf-c2ac8245f3a9 on n-h2-846435-14 Jul 25 15:05:46.591898 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-a2f714e0-3e26-44a1-901b-ed0b59dfbeb0 req-ddee8e25-e614-46da-9d15-8f4b84fbdfc3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091130 Jul 25 15:05:46.592589 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3112/6443] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:05:46.750002 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-872cf0f3-c38d-4e7c-b46b-f2879b5049d0 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:46.750616 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-872cf0f3-c38d-4e7c-b46b-f2879b5049d0 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: d2ec354e-832b-45b8-addf-c2ac8245f3a9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:46.778150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-872cf0f3-c38d-4e7c-b46b-f2879b5049d0 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:46.779103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-872cf0f3-c38d-4e7c-b46b-f2879b5049d0 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:46.781497 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-872cf0f3-c38d-4e7c-b46b-f2879b5049d0 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:46.781964 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-872cf0f3-c38d-4e7c-b46b-f2879b5049d0 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:47.423442 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-872cf0f3-c38d-4e7c-b46b-f2879b5049d0 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:05:47.445932 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-872cf0f3-c38d-4e7c-b46b-f2879b5049d0 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9" status: 200 len: 1298 microversion: 2.1 time: 0.699438 Jul 25 15:05:47.446738 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3332/6444] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:46 2022] GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9 => generated 1298 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:05:48.469693 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cdbd0bcf-9e8d-4d94-9670-dcfe3625c385 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:48.471303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cdbd0bcf-9e8d-4d94-9670-dcfe3625c385 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: d2ec354e-832b-45b8-addf-c2ac8245f3a9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:48.504532 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cdbd0bcf-9e8d-4d94-9670-dcfe3625c385 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:48.504532 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cdbd0bcf-9e8d-4d94-9670-dcfe3625c385 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:48.505734 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cdbd0bcf-9e8d-4d94-9670-dcfe3625c385 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:48.506871 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cdbd0bcf-9e8d-4d94-9670-dcfe3625c385 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:48.798382 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cdbd0bcf-9e8d-4d94-9670-dcfe3625c385 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:05:48.837097 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cdbd0bcf-9e8d-4d94-9670-dcfe3625c385 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9" status: 200 len: 1298 microversion: 2.1 time: 0.368674 Jul 25 15:05:48.839548 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3113/6445] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:48 2022] GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9 => generated 1298 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:05:49.860103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-268cd7da-709b-498d-bc91-40d9ffdd3f52 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:49.860741 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-268cd7da-709b-498d-bc91-40d9ffdd3f52 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: d2ec354e-832b-45b8-addf-c2ac8245f3a9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:49.871154 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:05:49.877161 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-268cd7da-709b-498d-bc91-40d9ffdd3f52 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:49.877611 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-268cd7da-709b-498d-bc91-40d9ffdd3f52 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:49.878747 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-268cd7da-709b-498d-bc91-40d9ffdd3f52 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:49.879179 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-268cd7da-709b-498d-bc91-40d9ffdd3f52 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:50.451301 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-268cd7da-709b-498d-bc91-40d9ffdd3f52 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:05:50.462416 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-268cd7da-709b-498d-bc91-40d9ffdd3f52 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9" status: 200 len: 1298 microversion: 2.1 time: 0.606160 Jul 25 15:05:50.477584 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3333/6446] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:49 2022] GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9 => generated 1298 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:05:51.482954 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3902fa6c-a844-49fc-9ded-f492efccef3a tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:51.483441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3902fa6c-a844-49fc-9ded-f492efccef3a tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: d2ec354e-832b-45b8-addf-c2ac8245f3a9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:51.486714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:05:51.488471 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:05:51.502238 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3902fa6c-a844-49fc-9ded-f492efccef3a tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:51.503518 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3902fa6c-a844-49fc-9ded-f492efccef3a tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:51.504908 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3902fa6c-a844-49fc-9ded-f492efccef3a tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:51.505551 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3902fa6c-a844-49fc-9ded-f492efccef3a tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:51.658707 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3902fa6c-a844-49fc-9ded-f492efccef3a tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:05:51.679295 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3902fa6c-a844-49fc-9ded-f492efccef3a tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9" status: 200 len: 1298 microversion: 2.1 time: 0.200306 Jul 25 15:05:51.680946 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3114/6447] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:51 2022] GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9 => generated 1298 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:05:52.701700 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-06ee497f-b459-4209-8f7b-c8f27f1bac5e tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:52.702306 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-06ee497f-b459-4209-8f7b-c8f27f1bac5e tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: d2ec354e-832b-45b8-addf-c2ac8245f3a9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:52.714918 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-06ee497f-b459-4209-8f7b-c8f27f1bac5e tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:52.715610 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-06ee497f-b459-4209-8f7b-c8f27f1bac5e tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:52.718638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-06ee497f-b459-4209-8f7b-c8f27f1bac5e tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:52.720110 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-06ee497f-b459-4209-8f7b-c8f27f1bac5e tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:53.046808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-06ee497f-b459-4209-8f7b-c8f27f1bac5e tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:05:53.048170 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-6353be84-775d-418d-b714-11a35228fe34 req-0586b3ea-2164-455a-babe-43219965a4bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2ec354e-832b-45b8-addf-c2ac8245f3a9", "name": "network-vif-plugged", "status": "completed", "tag": "43588d12-dfe0-4c82-9a47-adc99db49d95"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:05:53.068775 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-06ee497f-b459-4209-8f7b-c8f27f1bac5e tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9" status: 200 len: 1298 microversion: 2.1 time: 0.370927 Jul 25 15:05:53.069370 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3334/6448] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:52 2022] GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9 => generated 1298 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:05:53.093299 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-6353be84-775d-418d-b714-11a35228fe34 req-0586b3ea-2164-455a-babe-43219965a4bd service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:53.093822 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-6353be84-775d-418d-b714-11a35228fe34 req-0586b3ea-2164-455a-babe-43219965a4bd service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:53.124797 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-6353be84-775d-418d-b714-11a35228fe34 req-0586b3ea-2164-455a-babe-43219965a4bd service nova] Creating event network-vif-plugged:43588d12-dfe0-4c82-9a47-adc99db49d95 for instance d2ec354e-832b-45b8-addf-c2ac8245f3a9 on n-h2-846435-14 Jul 25 15:05:53.130941 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-6353be84-775d-418d-b714-11a35228fe34 req-0586b3ea-2164-455a-babe-43219965a4bd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088308 Jul 25 15:05:53.131923 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3115/6449] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:05:54.090056 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-34b8b0ad-83d9-4a6c-8afb-dccd9d20ccfa tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:54.090677 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-34b8b0ad-83d9-4a6c-8afb-dccd9d20ccfa tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: d2ec354e-832b-45b8-addf-c2ac8245f3a9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:54.101370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-34b8b0ad-83d9-4a6c-8afb-dccd9d20ccfa tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:54.101821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-34b8b0ad-83d9-4a6c-8afb-dccd9d20ccfa tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:54.102609 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-34b8b0ad-83d9-4a6c-8afb-dccd9d20ccfa tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:54.103043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-34b8b0ad-83d9-4a6c-8afb-dccd9d20ccfa tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:54.269074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-34b8b0ad-83d9-4a6c-8afb-dccd9d20ccfa tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:05:54.277534 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-34b8b0ad-83d9-4a6c-8afb-dccd9d20ccfa tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9" status: 200 len: 1298 microversion: 2.1 time: 0.191699 Jul 25 15:05:54.293562 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3335/6450] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:54 2022] GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9 => generated 1298 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:05:55.196091 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-81572b95-9a85-417b-a93b-6ef513dfd72a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1617472565", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b2e4cad5-c2ff-43ec-98d8-29b72a2f2bfc", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "c376c71f-de2b-4e80-ab75-8e710f8505df"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:05:55.315754 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7e673301-dfc3-46f8-8ce1-d7e714003c54 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:55.316437 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7e673301-dfc3-46f8-8ce1-d7e714003c54 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: d2ec354e-832b-45b8-addf-c2ac8245f3a9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:55.333845 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7e673301-dfc3-46f8-8ce1-d7e714003c54 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:55.337520 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7e673301-dfc3-46f8-8ce1-d7e714003c54 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:55.340184 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7e673301-dfc3-46f8-8ce1-d7e714003c54 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:55.340578 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7e673301-dfc3-46f8-8ce1-d7e714003c54 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:55.595086 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7e673301-dfc3-46f8-8ce1-d7e714003c54 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:05:55.610926 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7e673301-dfc3-46f8-8ce1-d7e714003c54 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9" status: 200 len: 1471 microversion: 2.1 time: 0.301304 Jul 25 15:05:55.611615 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3336/6451] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:55 2022] GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9 => generated 1471 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:05:55.643175 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c7e67a69-4089-4fd2-ac2e-10b9248b664d tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:55.643803 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c7e67a69-4089-4fd2-ac2e-10b9248b664d tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: d2ec354e-832b-45b8-addf-c2ac8245f3a9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:55.668687 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c7e67a69-4089-4fd2-ac2e-10b9248b664d tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:55.669133 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c7e67a69-4089-4fd2-ac2e-10b9248b664d tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:55.669918 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c7e67a69-4089-4fd2-ac2e-10b9248b664d tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:55.673164 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c7e67a69-4089-4fd2-ac2e-10b9248b664d tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:55.891051 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-81572b95-9a85-417b-a93b-6ef513dfd72a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] validate_networks() for [('c376c71f-de2b-4e80-ab75-8e710f8505df', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:05:56.034697 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c7e67a69-4089-4fd2-ac2e-10b9248b664d tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:05:56.047942 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c7e67a69-4089-4fd2-ac2e-10b9248b664d tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9" status: 200 len: 1471 microversion: 2.1 time: 0.416442 Jul 25 15:05:56.064532 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3337/6452] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:55 2022] GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9 => generated 1471 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:05:56.074291 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2510c6bb-e3d8-44c4-9c71-edc2dad8e9ef tempest-TestSecurityGroupsBasicOps-443340023 tempest-TestSecurityGroupsBasicOps-443340023-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:56.080017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2510c6bb-e3d8-44c4-9c71-edc2dad8e9ef tempest-TestSecurityGroupsBasicOps-443340023 tempest-TestSecurityGroupsBasicOps-443340023-project-admin] [instance: d2ec354e-832b-45b8-addf-c2ac8245f3a9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:56.094030 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2510c6bb-e3d8-44c4-9c71-edc2dad8e9ef tempest-TestSecurityGroupsBasicOps-443340023 tempest-TestSecurityGroupsBasicOps-443340023-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:56.094718 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2510c6bb-e3d8-44c4-9c71-edc2dad8e9ef tempest-TestSecurityGroupsBasicOps-443340023 tempest-TestSecurityGroupsBasicOps-443340023-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:56.095658 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2510c6bb-e3d8-44c4-9c71-edc2dad8e9ef tempest-TestSecurityGroupsBasicOps-443340023 tempest-TestSecurityGroupsBasicOps-443340023-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:56.096367 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2510c6bb-e3d8-44c4-9c71-edc2dad8e9ef tempest-TestSecurityGroupsBasicOps-443340023 tempest-TestSecurityGroupsBasicOps-443340023-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:57.022592 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-81572b95-9a85-417b-a93b-6ef513dfd72a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:05:57.023214 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-81572b95-9a85-417b-a93b-6ef513dfd72a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:05:57.023926 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-81572b95-9a85-417b-a93b-6ef513dfd72a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:05:57.024882 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-81572b95-9a85-417b-a93b-6ef513dfd72a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:05:57.025589 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-81572b95-9a85-417b-a93b-6ef513dfd72a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:05:57.074230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-81572b95-9a85-417b-a93b-6ef513dfd72a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:57.075775 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-81572b95-9a85-417b-a93b-6ef513dfd72a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:57.079016 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-81572b95-9a85-417b-a93b-6ef513dfd72a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:57.081063 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-81572b95-9a85-417b-a93b-6ef513dfd72a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:57.134425 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-81572b95-9a85-417b-a93b-6ef513dfd72a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Getting quotas for project 450a632353eb4912a87bd5efc3bf2907. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:05:57.134425 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-81572b95-9a85-417b-a93b-6ef513dfd72a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Getting quotas for user e4eae2927eb943e9ab2bb78b6b555404 and project 450a632353eb4912a87bd5efc3bf2907. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:05:57.171110 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-81572b95-9a85-417b-a93b-6ef513dfd72a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:05:57.173536 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-81572b95-9a85-417b-a93b-6ef513dfd72a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='b2e4cad5-c2ff-43ec-98d8-29b72a2f2bfc',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:05:57.327533 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2510c6bb-e3d8-44c4-9c71-edc2dad8e9ef tempest-TestSecurityGroupsBasicOps-443340023 tempest-TestSecurityGroupsBasicOps-443340023-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9" status: 200 len: 1624 microversion: 2.1 time: 1.261448 Jul 25 15:05:57.328304 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3338/6453] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:56 2022] GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9 => generated 1624 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:05:57.375204 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8bf77f52-7ffa-4bef-80dd-9a5979e82248 tempest-TestSecurityGroupsBasicOps-443340023 tempest-TestSecurityGroupsBasicOps-443340023-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:57.384709 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8bf77f52-7ffa-4bef-80dd-9a5979e82248 tempest-TestSecurityGroupsBasicOps-443340023 tempest-TestSecurityGroupsBasicOps-443340023-project-admin] [instance: 4408231b-9845-46be-9d90-99f9729da913] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:57.403931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8bf77f52-7ffa-4bef-80dd-9a5979e82248 tempest-TestSecurityGroupsBasicOps-443340023 tempest-TestSecurityGroupsBasicOps-443340023-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:57.409687 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-81572b95-9a85-417b-a93b-6ef513dfd72a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.224241 Jul 25 15:05:57.411008 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3116/6454] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:05:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:05:57.413649 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8bf77f52-7ffa-4bef-80dd-9a5979e82248 tempest-TestSecurityGroupsBasicOps-443340023 tempest-TestSecurityGroupsBasicOps-443340023-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:57.415097 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8bf77f52-7ffa-4bef-80dd-9a5979e82248 tempest-TestSecurityGroupsBasicOps-443340023 tempest-TestSecurityGroupsBasicOps-443340023-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:57.415858 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8bf77f52-7ffa-4bef-80dd-9a5979e82248 tempest-TestSecurityGroupsBasicOps-443340023 tempest-TestSecurityGroupsBasicOps-443340023-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:57.425065 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ff17e3f4-962f-4cff-ac6f-ab4a7b8da48e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:57.426194 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ff17e3f4-962f-4cff-ac6f-ab4a7b8da48e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:57.833850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ff17e3f4-962f-4cff-ac6f-ab4a7b8da48e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:05:57.842628 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ff17e3f4-962f-4cff-ac6f-ab4a7b8da48e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1057 microversion: 2.1 time: 0.423331 Jul 25 15:05:57.843278 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3117/6455] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:57 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1057 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:05:58.173313 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8bf77f52-7ffa-4bef-80dd-9a5979e82248 tempest-TestSecurityGroupsBasicOps-443340023 tempest-TestSecurityGroupsBasicOps-443340023-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913" status: 200 len: 1913 microversion: 2.1 time: 0.823501 Jul 25 15:05:58.184510 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3339/6456] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:57 2022] GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913 => generated 1913 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:05:58.305504 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3560d280-7fce-463e-aa65-cf0a23be3e31 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:58.306180 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3560d280-7fce-463e-aa65-cf0a23be3e31 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: d2ec354e-832b-45b8-addf-c2ac8245f3a9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:58.337400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3560d280-7fce-463e-aa65-cf0a23be3e31 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:58.339260 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3560d280-7fce-463e-aa65-cf0a23be3e31 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:58.342023 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3560d280-7fce-463e-aa65-cf0a23be3e31 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:58.342980 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3560d280-7fce-463e-aa65-cf0a23be3e31 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:58.400933 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3560d280-7fce-463e-aa65-cf0a23be3e31 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: d2ec354e-832b-45b8-addf-c2ac8245f3a9] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:05:58.566240 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3560d280-7fce-463e-aa65-cf0a23be3e31 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "DELETE /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9" status: 204 len: 0 microversion: 2.1 time: 0.268503 Jul 25 15:05:58.568320 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3118/6457] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:05:58 2022] DELETE /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:05:58.580749 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e064001f-5f97-477f-897b-2e60a46835a3 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:58.582901 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e064001f-5f97-477f-897b-2e60a46835a3 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: d2ec354e-832b-45b8-addf-c2ac8245f3a9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:58.604592 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e064001f-5f97-477f-897b-2e60a46835a3 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:58.606701 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e064001f-5f97-477f-897b-2e60a46835a3 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:58.608328 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e064001f-5f97-477f-897b-2e60a46835a3 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:58.610148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e064001f-5f97-477f-897b-2e60a46835a3 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:58.866401 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1c6be54e-3da1-4362-b3b4-7d24d46cbddd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:05:58.868285 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1c6be54e-3da1-4362-b3b4-7d24d46cbddd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:05:58.881562 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1c6be54e-3da1-4362-b3b4-7d24d46cbddd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:58.884093 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1c6be54e-3da1-4362-b3b4-7d24d46cbddd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:58.885369 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1c6be54e-3da1-4362-b3b4-7d24d46cbddd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:05:58.886795 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1c6be54e-3da1-4362-b3b4-7d24d46cbddd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:05:58.957278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e064001f-5f97-477f-897b-2e60a46835a3 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:05:58.972549 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e064001f-5f97-477f-897b-2e60a46835a3 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9" status: 200 len: 1477 microversion: 2.1 time: 0.398791 Jul 25 15:05:58.979433 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3340/6458] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:58 2022] GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9 => generated 1477 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:05:59.054659 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1c6be54e-3da1-4362-b3b4-7d24d46cbddd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:05:59.067345 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1c6be54e-3da1-4362-b3b4-7d24d46cbddd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1109 microversion: 2.1 time: 0.203497 Jul 25 15:05:59.069453 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3119/6459] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:58 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1109 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:06:00.002533 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-788296c3-3dae-4cb4-9568-e5a179a43fb7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:00.003261 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-788296c3-3dae-4cb4-9568-e5a179a43fb7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: d2ec354e-832b-45b8-addf-c2ac8245f3a9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:00.022999 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-788296c3-3dae-4cb4-9568-e5a179a43fb7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:00.023456 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-788296c3-3dae-4cb4-9568-e5a179a43fb7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:00.024272 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-788296c3-3dae-4cb4-9568-e5a179a43fb7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:00.024713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-788296c3-3dae-4cb4-9568-e5a179a43fb7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:00.090309 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a15f7eb4-7440-4aea-a6d5-51588c00b19a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:00.090980 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a15f7eb4-7440-4aea-a6d5-51588c00b19a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:00.118691 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a15f7eb4-7440-4aea-a6d5-51588c00b19a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:00.119469 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a15f7eb4-7440-4aea-a6d5-51588c00b19a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:00.126035 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a15f7eb4-7440-4aea-a6d5-51588c00b19a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:00.128806 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a15f7eb4-7440-4aea-a6d5-51588c00b19a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:00.373157 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a15f7eb4-7440-4aea-a6d5-51588c00b19a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:00.389815 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a15f7eb4-7440-4aea-a6d5-51588c00b19a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1127 microversion: 2.1 time: 0.303618 Jul 25 15:06:00.411558 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3120/6460] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:00 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1127 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:06:00.918263 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-788296c3-3dae-4cb4-9568-e5a179a43fb7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:00.927505 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-788296c3-3dae-4cb4-9568-e5a179a43fb7 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9" status: 200 len: 1477 microversion: 2.1 time: 0.930434 Jul 25 15:06:00.930852 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3341/6461] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:05:59 2022] GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9 => generated 1477 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:01.411827 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-044459e1-2ac5-44fc-ba63-349cb2ca17af tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:01.412479 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-044459e1-2ac5-44fc-ba63-349cb2ca17af tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:01.432308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-044459e1-2ac5-44fc-ba63-349cb2ca17af tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:01.433770 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-044459e1-2ac5-44fc-ba63-349cb2ca17af tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:01.435931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-044459e1-2ac5-44fc-ba63-349cb2ca17af tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:01.436768 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-044459e1-2ac5-44fc-ba63-349cb2ca17af tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:01.590379 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-a16ca8c0-1a53-46f7-93d7-8d588fe5a153 req-7162b289-83aa-4512-810c-c51d718733a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2ec354e-832b-45b8-addf-c2ac8245f3a9", "name": "network-vif-deleted", "tag": "43588d12-dfe0-4c82-9a47-adc99db49d95"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:06:01.632171 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a16ca8c0-1a53-46f7-93d7-8d588fe5a153 req-7162b289-83aa-4512-810c-c51d718733a2 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:01.635040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a16ca8c0-1a53-46f7-93d7-8d588fe5a153 req-7162b289-83aa-4512-810c-c51d718733a2 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:01.685632 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-a16ca8c0-1a53-46f7-93d7-8d588fe5a153 req-7162b289-83aa-4512-810c-c51d718733a2 service nova] Creating event network-vif-deleted:43588d12-dfe0-4c82-9a47-adc99db49d95 for instance d2ec354e-832b-45b8-addf-c2ac8245f3a9 on n-h2-846435-14 Jul 25 15:06:01.719777 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-a16ca8c0-1a53-46f7-93d7-8d588fe5a153 req-7162b289-83aa-4512-810c-c51d718733a2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125444 Jul 25 15:06:01.720885 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3342/6462] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:06:01.955584 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9d81a23b-5d08-4019-ac54-5668fa1f8224 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:01.956375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9d81a23b-5d08-4019-ac54-5668fa1f8224 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: d2ec354e-832b-45b8-addf-c2ac8245f3a9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:01.975023 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d81a23b-5d08-4019-ac54-5668fa1f8224 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:01.976009 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d81a23b-5d08-4019-ac54-5668fa1f8224 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:01.979602 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d81a23b-5d08-4019-ac54-5668fa1f8224 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:01.980144 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d81a23b-5d08-4019-ac54-5668fa1f8224 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:02.135561 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d81a23b-5d08-4019-ac54-5668fa1f8224 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:02.136858 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d81a23b-5d08-4019-ac54-5668fa1f8224 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:02.137339 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-9d81a23b-5d08-4019-ac54-5668fa1f8224 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lazy-loading 'fault' on Instance uuid d2ec354e-832b-45b8-addf-c2ac8245f3a9 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:06:02.317907 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9d81a23b-5d08-4019-ac54-5668fa1f8224 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:02.333761 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9d81a23b-5d08-4019-ac54-5668fa1f8224 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9" status: 200 len: 1330 microversion: 2.1 time: 0.378228 Jul 25 15:06:02.334352 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3343/6463] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:01 2022] GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9 => generated 1330 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:06:02.645771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-044459e1-2ac5-44fc-ba63-349cb2ca17af tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:02.659035 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-044459e1-2ac5-44fc-ba63-349cb2ca17af tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1169 microversion: 2.1 time: 1.251671 Jul 25 15:06:02.662789 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3121/6464] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:01 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1169 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:03.358385 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b166f6e0-c1b2-47b7-be82-14eecbed4fbd tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:03.359008 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b166f6e0-c1b2-47b7-be82-14eecbed4fbd tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: d2ec354e-832b-45b8-addf-c2ac8245f3a9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:03.384720 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b166f6e0-c1b2-47b7-be82-14eecbed4fbd tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:03.385299 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b166f6e0-c1b2-47b7-be82-14eecbed4fbd tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:03.392931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b166f6e0-c1b2-47b7-be82-14eecbed4fbd tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:03.393481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b166f6e0-c1b2-47b7-be82-14eecbed4fbd tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:03.433597 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-b166f6e0-c1b2-47b7-be82-14eecbed4fbd tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] HTTP exception thrown: Instance d2ec354e-832b-45b8-addf-c2ac8245f3a9 could not be found. Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b166f6e0-c1b2-47b7-be82-14eecbed4fbd tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Request method failure captured: Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9 HTTP/1.1 Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3rDjGlUmN7iQ6jidjiXs6Y72eItGoM-yvm77yslXFu6bdhNQK7m5ZRGXXGGJfoZp9gjg0JuBeUmU0ajq9_l7qKMob_argdJz0lU11miuiYoG8cDhCBSNkx6dfNw16ngH6qUpM9TgTy0lGl5RsiDtSpHkBpJaX5TtAcDmwCFJ3FS-AmE Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 9af0bc56481f46cd81075f11f3847b0f Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1432973399 Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9af0bc56481f46cd81075f11f3847b0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9af0bc56481f46cd81075f11f3847b0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9af0bc56481f46cd81075f11f3847b0f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9af0bc56481f46cd81075f11f3847b0f"}]}] Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1432973399 Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 9af0bc56481f46cd81075f11f3847b0f Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1432973399 Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-TestSecurityGroupsBasicOps-1432973399-project Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 5e37de6a1cc54f739651bb6eee4a25f4 Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1432973399-project Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance d2ec354e-832b-45b8-addf-c2ac8245f3a9 could not be found. Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'd2ec354e-832b-45b8-addf-c2ac8245f3a9'} Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2ec354e-832b-45b8-addf-c2ac8245f3a9 could not be found. Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2ec354e-832b-45b8-addf-c2ac8245f3a9 could not be found. Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:06:03.441130 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:06:03.445948 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:06:03.445948 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:06:03.445948 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:06:03.445948 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:06:03.445948 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:06:03.445948 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2ec354e-832b-45b8-addf-c2ac8245f3a9 could not be found. Jul 25 15:06:03.445948 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:06:03.450137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b166f6e0-c1b2-47b7-be82-14eecbed4fbd tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Returning 404 to user: Instance d2ec354e-832b-45b8-addf-c2ac8245f3a9 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:06:03.451276 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b166f6e0-c1b2-47b7-be82-14eecbed4fbd tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9" status: 404 len: 111 microversion: 2.1 time: 0.097208 Jul 25 15:06:03.454524 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3344/6465] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:03 2022] GET /compute/v2.1/servers/d2ec354e-832b-45b8-addf-c2ac8245f3a9 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:06:03.683446 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9d824f5a-de26-4ad4-a41e-baeeab5378c6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:03.684103 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9d824f5a-de26-4ad4-a41e-baeeab5378c6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:03.705232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-90c5eca9-fbde-4bd5-9f83-7b25726975b9 req-3f0a816a-7505-41ca-8823-e133ee3ac04e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e658c6d4-82b6-4f6c-bb4c-401058dca309", "tag": "b64ba2cb-f3fd-41da-a19e-ae4333541fea"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:06:03.710950 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d824f5a-de26-4ad4-a41e-baeeab5378c6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:03.711599 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d824f5a-de26-4ad4-a41e-baeeab5378c6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:03.720928 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d824f5a-de26-4ad4-a41e-baeeab5378c6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:03.721584 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d824f5a-de26-4ad4-a41e-baeeab5378c6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:03.729984 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-90c5eca9-fbde-4bd5-9f83-7b25726975b9 req-3f0a816a-7505-41ca-8823-e133ee3ac04e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:03.730438 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-90c5eca9-fbde-4bd5-9f83-7b25726975b9 req-3f0a816a-7505-41ca-8823-e133ee3ac04e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:03.763823 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-90c5eca9-fbde-4bd5-9f83-7b25726975b9 req-3f0a816a-7505-41ca-8823-e133ee3ac04e service nova] Creating event network-changed:b64ba2cb-f3fd-41da-a19e-ae4333541fea for instance e658c6d4-82b6-4f6c-bb4c-401058dca309 on n-h1-846435-14 Jul 25 15:06:03.785200 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-90c5eca9-fbde-4bd5-9f83-7b25726975b9 req-3f0a816a-7505-41ca-8823-e133ee3ac04e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085161 Jul 25 15:06:03.787246 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3345/6466] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:06:04.258386 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9d824f5a-de26-4ad4-a41e-baeeab5378c6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:04.270954 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9d824f5a-de26-4ad4-a41e-baeeab5378c6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1169 microversion: 2.1 time: 0.591717 Jul 25 15:06:04.272887 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3122/6467] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:03 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1169 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:05.295145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ca97849f-e89e-4702-89ab-5b9382bbfd9f tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:05.295939 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ca97849f-e89e-4702-89ab-5b9382bbfd9f tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:05.312868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ca97849f-e89e-4702-89ab-5b9382bbfd9f tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:05.313536 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ca97849f-e89e-4702-89ab-5b9382bbfd9f tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:05.314440 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ca97849f-e89e-4702-89ab-5b9382bbfd9f tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:05.314950 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ca97849f-e89e-4702-89ab-5b9382bbfd9f tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:05.704873 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ca97849f-e89e-4702-89ab-5b9382bbfd9f tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:05.713522 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ca97849f-e89e-4702-89ab-5b9382bbfd9f tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1169 microversion: 2.1 time: 0.423231 Jul 25 15:06:05.718971 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3346/6468] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:05 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1169 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:06.767112 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6d7f29a2-5914-4b6d-a951-ad4bcde8a043 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:06.773664 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6d7f29a2-5914-4b6d-a951-ad4bcde8a043 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:06.810704 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6d7f29a2-5914-4b6d-a951-ad4bcde8a043 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:06.815856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6d7f29a2-5914-4b6d-a951-ad4bcde8a043 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:06.821813 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6d7f29a2-5914-4b6d-a951-ad4bcde8a043 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:06.836273 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6d7f29a2-5914-4b6d-a951-ad4bcde8a043 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:07.108942 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:06:07.296941 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6d7f29a2-5914-4b6d-a951-ad4bcde8a043 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:07.310215 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6d7f29a2-5914-4b6d-a951-ad4bcde8a043 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1169 microversion: 2.1 time: 0.571662 Jul 25 15:06:07.319639 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3123/6469] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:06 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1169 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:06:08.347960 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-24e4ba6a-7d5a-44da-906b-10d58d8d7e7b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:08.348973 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-24e4ba6a-7d5a-44da-906b-10d58d8d7e7b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:08.372284 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-24e4ba6a-7d5a-44da-906b-10d58d8d7e7b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:08.373235 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-24e4ba6a-7d5a-44da-906b-10d58d8d7e7b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:08.377022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-24e4ba6a-7d5a-44da-906b-10d58d8d7e7b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:08.379656 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-24e4ba6a-7d5a-44da-906b-10d58d8d7e7b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:08.864491 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-24e4ba6a-7d5a-44da-906b-10d58d8d7e7b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:08.875290 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-24e4ba6a-7d5a-44da-906b-10d58d8d7e7b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1169 microversion: 2.1 time: 0.535505 Jul 25 15:06:08.884334 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3347/6470] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:08 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1169 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:09.900500 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-898baf23-1ec5-488c-a972-3313d386502e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:09.901138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-898baf23-1ec5-488c-a972-3313d386502e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:09.906083 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=8 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:06:09.907485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:06:09.915209 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-898baf23-1ec5-488c-a972-3313d386502e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:09.916322 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-898baf23-1ec5-488c-a972-3313d386502e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:09.917769 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-898baf23-1ec5-488c-a972-3313d386502e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:09.919052 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-898baf23-1ec5-488c-a972-3313d386502e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:10.019554 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:06:10.332726 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-898baf23-1ec5-488c-a972-3313d386502e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:10.343058 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-898baf23-1ec5-488c-a972-3313d386502e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1169 microversion: 2.1 time: 0.447243 Jul 25 15:06:10.357223 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3124/6471] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:09 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1169 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:11.367739 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8bd4f68b-e9b2-4e4b-a80a-2bb6175df06d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:11.368402 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8bd4f68b-e9b2-4e4b-a80a-2bb6175df06d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:11.397559 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=43 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:06:11.406741 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8bd4f68b-e9b2-4e4b-a80a-2bb6175df06d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:11.411400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8bd4f68b-e9b2-4e4b-a80a-2bb6175df06d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:11.412552 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8bd4f68b-e9b2-4e4b-a80a-2bb6175df06d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:11.412999 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8bd4f68b-e9b2-4e4b-a80a-2bb6175df06d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:11.448689 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=99 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:06:12.043674 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8bd4f68b-e9b2-4e4b-a80a-2bb6175df06d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:12.062336 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8bd4f68b-e9b2-4e4b-a80a-2bb6175df06d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1169 microversion: 2.1 time: 0.699559 Jul 25 15:06:12.076682 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3348/6472] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:11 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1169 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:13.082976 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5602c629-7f9e-45e4-8b4d-cae0dca93dd1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:13.084981 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5602c629-7f9e-45e4-8b4d-cae0dca93dd1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:13.103121 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5602c629-7f9e-45e4-8b4d-cae0dca93dd1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:13.104013 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5602c629-7f9e-45e4-8b4d-cae0dca93dd1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:13.105089 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5602c629-7f9e-45e4-8b4d-cae0dca93dd1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:13.105773 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5602c629-7f9e-45e4-8b4d-cae0dca93dd1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:13.554735 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5602c629-7f9e-45e4-8b4d-cae0dca93dd1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:13.574151 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5602c629-7f9e-45e4-8b4d-cae0dca93dd1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1169 microversion: 2.1 time: 0.494983 Jul 25 15:06:13.587319 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3125/6473] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:13 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1169 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:13.952693 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e2ed34cc-149a-4c6d-93f0-dc69f65237b4 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:13.953219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e2ed34cc-149a-4c6d-93f0-dc69f65237b4 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: 4408231b-9845-46be-9d90-99f9729da913] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:13.965659 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2ed34cc-149a-4c6d-93f0-dc69f65237b4 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:13.966110 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2ed34cc-149a-4c6d-93f0-dc69f65237b4 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:13.974320 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2ed34cc-149a-4c6d-93f0-dc69f65237b4 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:13.974925 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2ed34cc-149a-4c6d-93f0-dc69f65237b4 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:13.983647 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-2a527646-ed08-4ab3-a8e6-def62ecce857 req-09ac0ac4-c26e-4619-b067-27fc8b733d37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4408231b-9845-46be-9d90-99f9729da913", "tag": "75058a25-ea5a-47d4-9567-b3ea7f11ca58"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:06:14.013821 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-2a527646-ed08-4ab3-a8e6-def62ecce857 req-09ac0ac4-c26e-4619-b067-27fc8b733d37 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:14.015798 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-2a527646-ed08-4ab3-a8e6-def62ecce857 req-09ac0ac4-c26e-4619-b067-27fc8b733d37 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:14.041003 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-2a527646-ed08-4ab3-a8e6-def62ecce857 req-09ac0ac4-c26e-4619-b067-27fc8b733d37 service nova] Creating event network-changed:75058a25-ea5a-47d4-9567-b3ea7f11ca58 for instance 4408231b-9845-46be-9d90-99f9729da913 on n-h1-846435-14 Jul 25 15:06:14.054415 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-2a527646-ed08-4ab3-a8e6-def62ecce857 req-09ac0ac4-c26e-4619-b067-27fc8b733d37 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079464 Jul 25 15:06:14.055074 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3126/6474] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:06:14.059396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e2ed34cc-149a-4c6d-93f0-dc69f65237b4 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: 4408231b-9845-46be-9d90-99f9729da913] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:06:14.235711 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e2ed34cc-149a-4c6d-93f0-dc69f65237b4 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "DELETE /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913" status: 204 len: 0 microversion: 2.1 time: 0.286762 Jul 25 15:06:14.236564 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3349/6475] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:06:13 2022] DELETE /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:06:14.246723 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-47e7d624-3264-463f-a86a-325d65e413d3 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:14.247527 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-47e7d624-3264-463f-a86a-325d65e413d3 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: 4408231b-9845-46be-9d90-99f9729da913] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:14.259416 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-47e7d624-3264-463f-a86a-325d65e413d3 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:14.268305 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-47e7d624-3264-463f-a86a-325d65e413d3 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:14.269280 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-47e7d624-3264-463f-a86a-325d65e413d3 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:14.276422 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-47e7d624-3264-463f-a86a-325d65e413d3 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:14.596608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-84aeb374-e9c8-4504-8908-6b530f726d63 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:14.597314 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-84aeb374-e9c8-4504-8908-6b530f726d63 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:14.607599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-84aeb374-e9c8-4504-8908-6b530f726d63 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:14.616605 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-84aeb374-e9c8-4504-8908-6b530f726d63 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:14.617887 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-84aeb374-e9c8-4504-8908-6b530f726d63 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:14.620344 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-84aeb374-e9c8-4504-8908-6b530f726d63 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:14.693980 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-47e7d624-3264-463f-a86a-325d65e413d3 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:14.716334 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-47e7d624-3264-463f-a86a-325d65e413d3 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913" status: 200 len: 1766 microversion: 2.1 time: 0.474596 Jul 25 15:06:14.735000 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3127/6476] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:14 2022] GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913 => generated 1766 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:14.863385 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-84aeb374-e9c8-4504-8908-6b530f726d63 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:14.872805 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-84aeb374-e9c8-4504-8908-6b530f726d63 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1169 microversion: 2.1 time: 0.280524 Jul 25 15:06:14.885582 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3350/6477] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:14 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1169 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:06:15.738799 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6221c192-9627-4bff-9a3a-f5e8dc848c3c tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:15.739708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6221c192-9627-4bff-9a3a-f5e8dc848c3c tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: 4408231b-9845-46be-9d90-99f9729da913] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:15.779789 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6221c192-9627-4bff-9a3a-f5e8dc848c3c tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:15.783160 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6221c192-9627-4bff-9a3a-f5e8dc848c3c tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:15.784495 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6221c192-9627-4bff-9a3a-f5e8dc848c3c tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:15.786580 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6221c192-9627-4bff-9a3a-f5e8dc848c3c tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:15.896895 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1cde671e-50ae-402f-b5fd-d46492593162 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:15.897665 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1cde671e-50ae-402f-b5fd-d46492593162 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:15.920929 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1cde671e-50ae-402f-b5fd-d46492593162 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:15.921395 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1cde671e-50ae-402f-b5fd-d46492593162 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:15.922219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1cde671e-50ae-402f-b5fd-d46492593162 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:15.922648 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1cde671e-50ae-402f-b5fd-d46492593162 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:16.263725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1cde671e-50ae-402f-b5fd-d46492593162 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:16.271816 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1cde671e-50ae-402f-b5fd-d46492593162 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1169 microversion: 2.1 time: 0.379370 Jul 25 15:06:16.276453 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3351/6478] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:15 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1169 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:16.517702 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6221c192-9627-4bff-9a3a-f5e8dc848c3c tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:16.532495 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6221c192-9627-4bff-9a3a-f5e8dc848c3c tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913" status: 200 len: 1766 microversion: 2.1 time: 0.793855 Jul 25 15:06:16.547874 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3128/6479] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:15 2022] GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913 => generated 1766 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:17.297655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-09bfb27a-9dcf-48b0-9b33-3083459fd68e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:17.298332 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-09bfb27a-9dcf-48b0-9b33-3083459fd68e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:17.312395 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09bfb27a-9dcf-48b0-9b33-3083459fd68e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:17.313353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09bfb27a-9dcf-48b0-9b33-3083459fd68e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:17.316808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09bfb27a-9dcf-48b0-9b33-3083459fd68e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:17.317618 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-09bfb27a-9dcf-48b0-9b33-3083459fd68e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:17.486191 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-53bfe11e-f423-4943-9001-df6be59a4b46 req-0866e858-0fc2-430a-a647-397aa97f7a7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4408231b-9845-46be-9d90-99f9729da913", "name": "network-vif-deleted", "tag": "75058a25-ea5a-47d4-9567-b3ea7f11ca58"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:06:17.518752 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-53bfe11e-f423-4943-9001-df6be59a4b46 req-0866e858-0fc2-430a-a647-397aa97f7a7e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:17.519636 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-53bfe11e-f423-4943-9001-df6be59a4b46 req-0866e858-0fc2-430a-a647-397aa97f7a7e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:17.551823 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-53bfe11e-f423-4943-9001-df6be59a4b46 req-0866e858-0fc2-430a-a647-397aa97f7a7e service nova] Creating event network-vif-deleted:75058a25-ea5a-47d4-9567-b3ea7f11ca58 for instance 4408231b-9845-46be-9d90-99f9729da913 on n-h1-846435-14 Jul 25 15:06:17.568397 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-53bfe11e-f423-4943-9001-df6be59a4b46 req-0866e858-0fc2-430a-a647-397aa97f7a7e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084713 Jul 25 15:06:17.569324 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3129/6480] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:06:17.577884 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b4d3d0c5-e417-4319-aa6b-5d26d1a08f6e tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:17.578827 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b4d3d0c5-e417-4319-aa6b-5d26d1a08f6e tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: 4408231b-9845-46be-9d90-99f9729da913] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:17.594256 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b4d3d0c5-e417-4319-aa6b-5d26d1a08f6e tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:17.600791 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b4d3d0c5-e417-4319-aa6b-5d26d1a08f6e tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:17.621019 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b4d3d0c5-e417-4319-aa6b-5d26d1a08f6e tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:17.621933 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b4d3d0c5-e417-4319-aa6b-5d26d1a08f6e tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:17.819151 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b4d3d0c5-e417-4319-aa6b-5d26d1a08f6e tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37de6a1cc54f739651bb6eee4a25f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af0bc56481f46cd81075f11f3847b0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:17.831010 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b4d3d0c5-e417-4319-aa6b-5d26d1a08f6e tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913" status: 200 len: 1379 microversion: 2.1 time: 0.258179 Jul 25 15:06:17.838681 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3130/6481] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:17 2022] GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913 => generated 1379 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:18.405788 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-09bfb27a-9dcf-48b0-9b33-3083459fd68e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:18.419848 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-09bfb27a-9dcf-48b0-9b33-3083459fd68e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1169 microversion: 2.1 time: 1.126882 Jul 25 15:06:18.421885 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3352/6482] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:17 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1169 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:18.865882 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bd1dddfa-bb19-48ad-9cd8-e8882144aa87 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:18.867654 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bd1dddfa-bb19-48ad-9cd8-e8882144aa87 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] [instance: 4408231b-9845-46be-9d90-99f9729da913] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:18.882680 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd1dddfa-bb19-48ad-9cd8-e8882144aa87 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:18.883292 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd1dddfa-bb19-48ad-9cd8-e8882144aa87 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:18.884396 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd1dddfa-bb19-48ad-9cd8-e8882144aa87 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:18.889235 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd1dddfa-bb19-48ad-9cd8-e8882144aa87 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:18.919180 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-bd1dddfa-bb19-48ad-9cd8-e8882144aa87 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] HTTP exception thrown: Instance 4408231b-9845-46be-9d90-99f9729da913 could not be found. Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bd1dddfa-bb19-48ad-9cd8-e8882144aa87 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Request method failure captured: Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913 HTTP/1.1 Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rDjGlUmN7iQ6jidjiXs6Y72eItGoM-yvm77yslXFu6bdhNQK7m5ZRGXXGGJfoZp9gjg0JuBeUmU0ajq9_l7qKMob_argdJz0lU11miuiYoG8cDhCBSNkx6dfNw16ngH6qUpM9TgTy0lGl5RsiDtSpHkBpJaX5TtAcDmwCFJ3FS-AmE Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 9af0bc56481f46cd81075f11f3847b0f Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1432973399 Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9af0bc56481f46cd81075f11f3847b0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/9af0bc56481f46cd81075f11f3847b0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_9af0bc56481f46cd81075f11f3847b0f", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/9af0bc56481f46cd81075f11f3847b0f"}]}] Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1432973399 Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 9af0bc56481f46cd81075f11f3847b0f Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1432973399 Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-TestSecurityGroupsBasicOps-1432973399-project Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 5e37de6a1cc54f739651bb6eee4a25f4 Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1432973399-project Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 4408231b-9845-46be-9d90-99f9729da913 could not be found. Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '4408231b-9845-46be-9d90-99f9729da913'} Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4408231b-9845-46be-9d90-99f9729da913 could not be found. Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4408231b-9845-46be-9d90-99f9729da913 could not be found. Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:06:18.921204 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:06:18.925840 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:06:18.925840 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:06:18.925840 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:06:18.925840 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:06:18.925840 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:06:18.925840 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4408231b-9845-46be-9d90-99f9729da913 could not be found. Jul 25 15:06:18.925840 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:06:18.927512 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bd1dddfa-bb19-48ad-9cd8-e8882144aa87 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Returning 404 to user: Instance 4408231b-9845-46be-9d90-99f9729da913 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:06:18.929240 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bd1dddfa-bb19-48ad-9cd8-e8882144aa87 tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913" status: 404 len: 111 microversion: 2.1 time: 0.067547 Jul 25 15:06:18.934610 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3131/6483] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:18 2022] GET /compute/v2.1/servers/4408231b-9845-46be-9d90-99f9729da913 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:06:19.444395 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-34904bdc-6a83-41c8-b9a7-8268d44e26f3 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:19.445620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-34904bdc-6a83-41c8-b9a7-8268d44e26f3 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:19.469084 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-34904bdc-6a83-41c8-b9a7-8268d44e26f3 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:19.469758 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-34904bdc-6a83-41c8-b9a7-8268d44e26f3 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:19.470725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-34904bdc-6a83-41c8-b9a7-8268d44e26f3 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:19.471856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-34904bdc-6a83-41c8-b9a7-8268d44e26f3 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:19.885106 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-34904bdc-6a83-41c8-b9a7-8268d44e26f3 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:19.900334 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-34904bdc-6a83-41c8-b9a7-8268d44e26f3 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1169 microversion: 2.1 time: 0.463037 Jul 25 15:06:19.901558 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3353/6484] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:19 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1169 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:20.922119 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-38719440-9a88-45a6-a508-f54ddc402de0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:20.923405 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-38719440-9a88-45a6-a508-f54ddc402de0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:20.936564 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-38719440-9a88-45a6-a508-f54ddc402de0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:20.938783 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-38719440-9a88-45a6-a508-f54ddc402de0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:20.940936 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-38719440-9a88-45a6-a508-f54ddc402de0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:20.944792 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-38719440-9a88-45a6-a508-f54ddc402de0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:21.364813 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-38719440-9a88-45a6-a508-f54ddc402de0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:21.379959 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-38719440-9a88-45a6-a508-f54ddc402de0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1169 microversion: 2.1 time: 0.460102 Jul 25 15:06:21.384567 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3132/6485] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:20 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1169 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:22.403960 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-709bad66-0758-40ee-b5b4-94b2f2b83328 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:22.404605 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-709bad66-0758-40ee-b5b4-94b2f2b83328 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:22.445120 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-709bad66-0758-40ee-b5b4-94b2f2b83328 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:22.445859 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-709bad66-0758-40ee-b5b4-94b2f2b83328 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:22.446804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-709bad66-0758-40ee-b5b4-94b2f2b83328 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:22.447391 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-709bad66-0758-40ee-b5b4-94b2f2b83328 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:22.946208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-709bad66-0758-40ee-b5b4-94b2f2b83328 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:22.978849 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-709bad66-0758-40ee-b5b4-94b2f2b83328 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1169 microversion: 2.1 time: 0.578816 Jul 25 15:06:22.985344 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3354/6486] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:22 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1169 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:24.003587 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-46b87c44-0a0d-456f-acf1-ecfaec85c1ec tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:24.004276 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-46b87c44-0a0d-456f-acf1-ecfaec85c1ec tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:24.022757 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46b87c44-0a0d-456f-acf1-ecfaec85c1ec tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:24.023391 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46b87c44-0a0d-456f-acf1-ecfaec85c1ec tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:24.024483 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46b87c44-0a0d-456f-acf1-ecfaec85c1ec tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:24.025148 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46b87c44-0a0d-456f-acf1-ecfaec85c1ec tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:24.509393 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-46b87c44-0a0d-456f-acf1-ecfaec85c1ec tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:24.521375 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-46b87c44-0a0d-456f-acf1-ecfaec85c1ec tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1169 microversion: 2.1 time: 0.520341 Jul 25 15:06:24.523268 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3133/6487] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:23 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1169 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:25.557511 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0c4c55e8-a8e4-4cf1-b8f9-cc1955d8c6ca tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:25.561231 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0c4c55e8-a8e4-4cf1-b8f9-cc1955d8c6ca tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:25.577963 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c4c55e8-a8e4-4cf1-b8f9-cc1955d8c6ca tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:25.582195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c4c55e8-a8e4-4cf1-b8f9-cc1955d8c6ca tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:25.587160 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c4c55e8-a8e4-4cf1-b8f9-cc1955d8c6ca tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:25.587766 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c4c55e8-a8e4-4cf1-b8f9-cc1955d8c6ca tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:26.005201 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0c4c55e8-a8e4-4cf1-b8f9-cc1955d8c6ca tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:26.016214 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0c4c55e8-a8e4-4cf1-b8f9-cc1955d8c6ca tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1215 microversion: 2.1 time: 0.473799 Jul 25 15:06:26.016983 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3355/6488] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:25 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1215 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:26.226638 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7a29609a-edc3-4949-840e-2a1a785e5bfd tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] Calling method '.version_select at 0x7f46864dd790>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:26.259680 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7a29609a-edc3-4949-840e-2a1a785e5bfd tempest-TestSecurityGroupsBasicOps-1432973399 tempest-TestSecurityGroupsBasicOps-1432973399-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-387715417" status: 202 len: 0 microversion: 2.1 time: 0.036798 Jul 25 15:06:26.261158 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3134/6489] 10.222.0.88 () {58 vars in 1275 bytes} [Mon Jul 25 15:06:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-387715417 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:06:27.050871 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7966a873-22bb-461a-b23d-6ab5b5c3f954 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:27.050871 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7966a873-22bb-461a-b23d-6ab5b5c3f954 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:27.065687 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7966a873-22bb-461a-b23d-6ab5b5c3f954 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:27.066669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7966a873-22bb-461a-b23d-6ab5b5c3f954 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:27.067716 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7966a873-22bb-461a-b23d-6ab5b5c3f954 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:27.069912 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7966a873-22bb-461a-b23d-6ab5b5c3f954 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:27.253751 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7966a873-22bb-461a-b23d-6ab5b5c3f954 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:27.263142 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7966a873-22bb-461a-b23d-6ab5b5c3f954 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1203 microversion: 2.1 time: 0.222205 Jul 25 15:06:27.263955 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3356/6490] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:27 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1203 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:28.286491 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-54a4430f-817e-4029-95d7-e2897224d8ad tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:28.287152 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-54a4430f-817e-4029-95d7-e2897224d8ad tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:28.302090 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-54a4430f-817e-4029-95d7-e2897224d8ad tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:28.305320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-54a4430f-817e-4029-95d7-e2897224d8ad tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:28.306348 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-54a4430f-817e-4029-95d7-e2897224d8ad tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:28.307205 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-54a4430f-817e-4029-95d7-e2897224d8ad tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:28.502627 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-54a4430f-817e-4029-95d7-e2897224d8ad tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:28.515511 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-54a4430f-817e-4029-95d7-e2897224d8ad tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1203 microversion: 2.1 time: 0.234027 Jul 25 15:06:28.516253 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3135/6491] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:28 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1203 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:29.537858 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ac1d5a89-be2a-4444-9329-08764372c97d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:29.538893 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ac1d5a89-be2a-4444-9329-08764372c97d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:29.546875 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac1d5a89-be2a-4444-9329-08764372c97d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:29.547336 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac1d5a89-be2a-4444-9329-08764372c97d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:29.548350 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac1d5a89-be2a-4444-9329-08764372c97d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:29.548988 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac1d5a89-be2a-4444-9329-08764372c97d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:29.756742 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ac1d5a89-be2a-4444-9329-08764372c97d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:29.764885 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ac1d5a89-be2a-4444-9329-08764372c97d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1203 microversion: 2.1 time: 0.231353 Jul 25 15:06:29.765601 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3357/6492] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:29 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1203 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:30.785664 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-49124db1-0946-4d85-8872-bf540edbfeea tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:30.786283 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-49124db1-0946-4d85-8872-bf540edbfeea tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:30.794059 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-49124db1-0946-4d85-8872-bf540edbfeea tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:30.794547 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-49124db1-0946-4d85-8872-bf540edbfeea tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:30.795312 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-49124db1-0946-4d85-8872-bf540edbfeea tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:30.795739 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-49124db1-0946-4d85-8872-bf540edbfeea tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:31.003199 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-49124db1-0946-4d85-8872-bf540edbfeea tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:31.011280 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-49124db1-0946-4d85-8872-bf540edbfeea tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1203 microversion: 2.1 time: 0.229533 Jul 25 15:06:31.012053 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3136/6493] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:30 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1203 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:32.033980 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4033068c-8f0d-4f2e-a3c4-1c662cd1d55b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:32.034605 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4033068c-8f0d-4f2e-a3c4-1c662cd1d55b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:32.046293 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4033068c-8f0d-4f2e-a3c4-1c662cd1d55b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:32.046741 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4033068c-8f0d-4f2e-a3c4-1c662cd1d55b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:32.047519 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4033068c-8f0d-4f2e-a3c4-1c662cd1d55b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:32.047955 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4033068c-8f0d-4f2e-a3c4-1c662cd1d55b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:32.221681 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4033068c-8f0d-4f2e-a3c4-1c662cd1d55b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:32.230286 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4033068c-8f0d-4f2e-a3c4-1c662cd1d55b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1203 microversion: 2.1 time: 0.200645 Jul 25 15:06:32.231536 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3358/6494] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:32 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1203 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:06:33.250825 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f98a9fd7-43e0-4406-b186-71bcad888049 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:33.251524 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f98a9fd7-43e0-4406-b186-71bcad888049 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:33.264525 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f98a9fd7-43e0-4406-b186-71bcad888049 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:33.265423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f98a9fd7-43e0-4406-b186-71bcad888049 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:33.266704 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f98a9fd7-43e0-4406-b186-71bcad888049 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:33.267167 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f98a9fd7-43e0-4406-b186-71bcad888049 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:33.489938 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f98a9fd7-43e0-4406-b186-71bcad888049 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:33.498085 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f98a9fd7-43e0-4406-b186-71bcad888049 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1203 microversion: 2.1 time: 0.250944 Jul 25 15:06:33.499076 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3137/6495] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:33 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1203 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:34.520719 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a1d0a300-5f07-4ac8-a99a-9c563d6f56fe tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:34.521086 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a1d0a300-5f07-4ac8-a99a-9c563d6f56fe tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:34.530443 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1d0a300-5f07-4ac8-a99a-9c563d6f56fe tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:34.531232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1d0a300-5f07-4ac8-a99a-9c563d6f56fe tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:34.532251 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1d0a300-5f07-4ac8-a99a-9c563d6f56fe tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:34.532879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1d0a300-5f07-4ac8-a99a-9c563d6f56fe tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:34.683764 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a1d0a300-5f07-4ac8-a99a-9c563d6f56fe tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:34.692467 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a1d0a300-5f07-4ac8-a99a-9c563d6f56fe tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1203 microversion: 2.1 time: 0.176302 Jul 25 15:06:34.693083 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3359/6496] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:34 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1203 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:35.713569 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-852ad5b3-20c7-43d3-bf31-58f89f504e74 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:35.714680 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-852ad5b3-20c7-43d3-bf31-58f89f504e74 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:35.721728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-852ad5b3-20c7-43d3-bf31-58f89f504e74 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:35.722378 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-852ad5b3-20c7-43d3-bf31-58f89f504e74 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:35.723237 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-852ad5b3-20c7-43d3-bf31-58f89f504e74 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:35.723902 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-852ad5b3-20c7-43d3-bf31-58f89f504e74 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:35.873716 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-852ad5b3-20c7-43d3-bf31-58f89f504e74 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:35.883038 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-852ad5b3-20c7-43d3-bf31-58f89f504e74 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1203 microversion: 2.1 time: 0.173345 Jul 25 15:06:35.883622 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3138/6497] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:35 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1203 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:36.473796 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-7b184982-40d4-4d13-bfde-c370d8bd9492 req-d537c198-bbc3-4d1b-8041-e97848d9247c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e658c6d4-82b6-4f6c-bb4c-401058dca309", "name": "network-vif-plugged", "status": "completed", "tag": "b64ba2cb-f3fd-41da-a19e-ae4333541fea"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:06:36.494888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-7b184982-40d4-4d13-bfde-c370d8bd9492 req-d537c198-bbc3-4d1b-8041-e97848d9247c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:36.495437 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-7b184982-40d4-4d13-bfde-c370d8bd9492 req-d537c198-bbc3-4d1b-8041-e97848d9247c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:36.512675 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-7b184982-40d4-4d13-bfde-c370d8bd9492 req-d537c198-bbc3-4d1b-8041-e97848d9247c service nova] Creating event network-vif-plugged:b64ba2cb-f3fd-41da-a19e-ae4333541fea for instance e658c6d4-82b6-4f6c-bb4c-401058dca309 on n-h1-846435-14 Jul 25 15:06:36.520260 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-7b184982-40d4-4d13-bfde-c370d8bd9492 req-d537c198-bbc3-4d1b-8041-e97848d9247c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052786 Jul 25 15:06:36.521648 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3360/6498] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:06:36.905682 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1d42a42b-e39c-49ed-bb09-45ff634e406b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:36.907068 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1d42a42b-e39c-49ed-bb09-45ff634e406b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:36.914610 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d42a42b-e39c-49ed-bb09-45ff634e406b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:36.915401 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d42a42b-e39c-49ed-bb09-45ff634e406b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:36.916468 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d42a42b-e39c-49ed-bb09-45ff634e406b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:36.917124 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d42a42b-e39c-49ed-bb09-45ff634e406b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:37.070191 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1d42a42b-e39c-49ed-bb09-45ff634e406b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:37.079696 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1d42a42b-e39c-49ed-bb09-45ff634e406b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1203 microversion: 2.1 time: 0.177825 Jul 25 15:06:37.080705 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3139/6499] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:36 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1203 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:38.101836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f2da3bdb-751f-4144-b5ba-fa4b6d6cc32e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:38.102729 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f2da3bdb-751f-4144-b5ba-fa4b6d6cc32e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:38.109310 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f2da3bdb-751f-4144-b5ba-fa4b6d6cc32e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:38.109767 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f2da3bdb-751f-4144-b5ba-fa4b6d6cc32e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:38.110629 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f2da3bdb-751f-4144-b5ba-fa4b6d6cc32e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:38.111070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f2da3bdb-751f-4144-b5ba-fa4b6d6cc32e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:38.258632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f2da3bdb-751f-4144-b5ba-fa4b6d6cc32e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:38.270733 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f2da3bdb-751f-4144-b5ba-fa4b6d6cc32e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1390 microversion: 2.1 time: 0.173986 Jul 25 15:06:38.272149 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3361/6500] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:38 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1390 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:38.291384 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-833e0c53-93c9-43e4-a0e1-914992d4491e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:38.291930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-833e0c53-93c9-43e4-a0e1-914992d4491e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:38.300139 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-833e0c53-93c9-43e4-a0e1-914992d4491e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:38.300654 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-833e0c53-93c9-43e4-a0e1-914992d4491e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:38.301426 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-833e0c53-93c9-43e4-a0e1-914992d4491e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:38.301830 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-833e0c53-93c9-43e4-a0e1-914992d4491e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:38.459343 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-833e0c53-93c9-43e4-a0e1-914992d4491e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:38.468301 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-833e0c53-93c9-43e4-a0e1-914992d4491e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1390 microversion: 2.1 time: 0.180855 Jul 25 15:06:38.468898 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3140/6501] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:38 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1390 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:38.488742 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-18e5a405-f4d6-41eb-ac4d-531f9c57248d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:38.489679 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-18e5a405-f4d6-41eb-ac4d-531f9c57248d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:38.496431 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-18e5a405-f4d6-41eb-ac4d-531f9c57248d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:38.497087 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-18e5a405-f4d6-41eb-ac4d-531f9c57248d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:38.498034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-18e5a405-f4d6-41eb-ac4d-531f9c57248d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:38.498624 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-18e5a405-f4d6-41eb-ac4d-531f9c57248d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:38.693185 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-18e5a405-f4d6-41eb-ac4d-531f9c57248d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:38.703463 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-18e5a405-f4d6-41eb-ac4d-531f9c57248d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1390 microversion: 2.1 time: 0.218931 Jul 25 15:06:38.704295 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3362/6502] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:38 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1390 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:38.794315 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d98fe285-1ccc-419c-af49-c77a9084f23d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:38.794824 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d98fe285-1ccc-419c-af49-c77a9084f23d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:38.801287 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d98fe285-1ccc-419c-af49-c77a9084f23d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:38.802165 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d98fe285-1ccc-419c-af49-c77a9084f23d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:38.803206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d98fe285-1ccc-419c-af49-c77a9084f23d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:38.803647 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d98fe285-1ccc-419c-af49-c77a9084f23d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:38.836961 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d98fe285-1ccc-419c-af49-c77a9084f23d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:06:38.945679 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d98fe285-1ccc-419c-af49-c77a9084f23d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "DELETE /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 204 len: 0 microversion: 2.1 time: 0.154909 Jul 25 15:06:38.947244 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3141/6503] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:06:38 2022] DELETE /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:06:38.957782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-98880464-54b2-4c71-a443-b058e0f81c33 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:38.963341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-98880464-54b2-4c71-a443-b058e0f81c33 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:38.985909 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98880464-54b2-4c71-a443-b058e0f81c33 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:38.986307 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98880464-54b2-4c71-a443-b058e0f81c33 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:38.987181 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98880464-54b2-4c71-a443-b058e0f81c33 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:38.987545 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98880464-54b2-4c71-a443-b058e0f81c33 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:39.158275 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-98880464-54b2-4c71-a443-b058e0f81c33 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:39.160694 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:06:39.167376 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-98880464-54b2-4c71-a443-b058e0f81c33 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1396 microversion: 2.1 time: 0.215940 Jul 25 15:06:39.167988 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3363/6504] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:38 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1396 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:40.189630 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2d11b31d-4881-49f2-9064-63ebefebf088 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:40.190606 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2d11b31d-4881-49f2-9064-63ebefebf088 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:40.193955 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:06:40.199519 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2d11b31d-4881-49f2-9064-63ebefebf088 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:40.199965 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2d11b31d-4881-49f2-9064-63ebefebf088 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:40.200982 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2d11b31d-4881-49f2-9064-63ebefebf088 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:40.201418 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2d11b31d-4881-49f2-9064-63ebefebf088 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:40.205107 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:06:40.368939 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2d11b31d-4881-49f2-9064-63ebefebf088 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:40.378567 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2d11b31d-4881-49f2-9064-63ebefebf088 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1396 microversion: 2.1 time: 0.193192 Jul 25 15:06:40.379277 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3142/6505] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:40 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1396 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:41.232448 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-8a67e1b8-f3f0-461f-9b61-dea69946f78c req-e73f1026-f743-4705-9807-86753c531eeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e658c6d4-82b6-4f6c-bb4c-401058dca309", "name": "network-vif-deleted", "tag": "b64ba2cb-f3fd-41da-a19e-ae4333541fea"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:06:41.244282 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-8a67e1b8-f3f0-461f-9b61-dea69946f78c req-e73f1026-f743-4705-9807-86753c531eeb service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:41.247804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-8a67e1b8-f3f0-461f-9b61-dea69946f78c req-e73f1026-f743-4705-9807-86753c531eeb service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:41.265113 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-8a67e1b8-f3f0-461f-9b61-dea69946f78c req-e73f1026-f743-4705-9807-86753c531eeb service nova] Creating event network-vif-deleted:b64ba2cb-f3fd-41da-a19e-ae4333541fea for instance e658c6d4-82b6-4f6c-bb4c-401058dca309 on n-h1-846435-14 Jul 25 15:06:41.270605 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-8a67e1b8-f3f0-461f-9b61-dea69946f78c req-e73f1026-f743-4705-9807-86753c531eeb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.325331 Jul 25 15:06:41.271512 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3364/6506] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:06:41.400570 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0ebf0958-c20e-4bdb-9a2a-861dd1e413da tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:41.401452 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0ebf0958-c20e-4bdb-9a2a-861dd1e413da tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:41.414475 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0ebf0958-c20e-4bdb-9a2a-861dd1e413da tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:41.414953 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0ebf0958-c20e-4bdb-9a2a-861dd1e413da tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:41.416536 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0ebf0958-c20e-4bdb-9a2a-861dd1e413da tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:41.419091 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0ebf0958-c20e-4bdb-9a2a-861dd1e413da tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:41.520883 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0ebf0958-c20e-4bdb-9a2a-861dd1e413da tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:41.530400 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0ebf0958-c20e-4bdb-9a2a-861dd1e413da tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1188 microversion: 2.1 time: 0.133569 Jul 25 15:06:41.532150 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3143/6507] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:41 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1188 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:42.555457 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-10e5a4f2-20b3-4ae1-b9ef-5e7d19afccb0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:42.556850 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-10e5a4f2-20b3-4ae1-b9ef-5e7d19afccb0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:42.560935 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:06:42.569726 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-10e5a4f2-20b3-4ae1-b9ef-5e7d19afccb0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:42.570191 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-10e5a4f2-20b3-4ae1-b9ef-5e7d19afccb0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:42.570999 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-10e5a4f2-20b3-4ae1-b9ef-5e7d19afccb0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:42.571441 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-10e5a4f2-20b3-4ae1-b9ef-5e7d19afccb0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:42.676144 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-10e5a4f2-20b3-4ae1-b9ef-5e7d19afccb0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:42.687131 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-10e5a4f2-20b3-4ae1-b9ef-5e7d19afccb0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1188 microversion: 2.1 time: 0.137022 Jul 25 15:06:42.697638 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3365/6508] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:42 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1188 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:43.707553 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6329f6ff-69a5-42db-b76d-fa018cdc5265 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:43.708998 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6329f6ff-69a5-42db-b76d-fa018cdc5265 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:43.717216 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6329f6ff-69a5-42db-b76d-fa018cdc5265 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:43.717958 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6329f6ff-69a5-42db-b76d-fa018cdc5265 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:43.719136 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6329f6ff-69a5-42db-b76d-fa018cdc5265 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:43.719733 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6329f6ff-69a5-42db-b76d-fa018cdc5265 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:43.809497 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6329f6ff-69a5-42db-b76d-fa018cdc5265 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:43.821730 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6329f6ff-69a5-42db-b76d-fa018cdc5265 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1188 microversion: 2.1 time: 0.118223 Jul 25 15:06:43.833293 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3144/6509] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:43 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1188 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:44.844593 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c6829517-d3ba-4cb4-9785-bf7fb564edf2 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:44.846140 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c6829517-d3ba-4cb4-9785-bf7fb564edf2 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:44.859816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c6829517-d3ba-4cb4-9785-bf7fb564edf2 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:44.860504 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c6829517-d3ba-4cb4-9785-bf7fb564edf2 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:44.862114 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c6829517-d3ba-4cb4-9785-bf7fb564edf2 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:44.862927 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c6829517-d3ba-4cb4-9785-bf7fb564edf2 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:44.935627 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c6829517-d3ba-4cb4-9785-bf7fb564edf2 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:44.945517 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c6829517-d3ba-4cb4-9785-bf7fb564edf2 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1188 microversion: 2.1 time: 0.104566 Jul 25 15:06:44.959676 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3366/6510] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:44 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1188 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:45.968213 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bd672ade-08f2-4406-a3e5-4eacc091b190 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:45.969671 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bd672ade-08f2-4406-a3e5-4eacc091b190 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:45.979476 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd672ade-08f2-4406-a3e5-4eacc091b190 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:45.980507 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd672ade-08f2-4406-a3e5-4eacc091b190 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:45.981615 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd672ade-08f2-4406-a3e5-4eacc091b190 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:45.982542 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd672ade-08f2-4406-a3e5-4eacc091b190 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:46.048899 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd672ade-08f2-4406-a3e5-4eacc091b190 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:46.049908 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bd672ade-08f2-4406-a3e5-4eacc091b190 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:46.051067 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-bd672ade-08f2-4406-a3e5-4eacc091b190 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lazy-loading 'fault' on Instance uuid e658c6d4-82b6-4f6c-bb4c-401058dca309 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:06:46.181207 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bd672ade-08f2-4406-a3e5-4eacc091b190 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:06:46.204878 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bd672ade-08f2-4406-a3e5-4eacc091b190 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 200 len: 1193 microversion: 2.1 time: 0.241416 Jul 25 15:06:46.207161 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3145/6511] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:45 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 1193 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:06:47.228770 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-465cac3f-a14b-4f6b-a27f-be0360841593 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:47.229406 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-465cac3f-a14b-4f6b-a27f-be0360841593 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:47.236599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-465cac3f-a14b-4f6b-a27f-be0360841593 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:47.246391 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-465cac3f-a14b-4f6b-a27f-be0360841593 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:47.247370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-465cac3f-a14b-4f6b-a27f-be0360841593 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:47.247820 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-465cac3f-a14b-4f6b-a27f-be0360841593 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:47.286369 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-465cac3f-a14b-4f6b-a27f-be0360841593 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] HTTP exception thrown: Instance e658c6d4-82b6-4f6c-bb4c-401058dca309 could not be found. Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-465cac3f-a14b-4f6b-a27f-be0360841593 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Request method failure captured: Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 HTTP/1.1 Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3rDtvHLNADQM-uJ_J3klWg0FTy_E0qH1hvwasDYrxKDHzDvpYuxQ-thmFamK-Qma_d-RBIPBhjFabpJL3iCa_0TXRcnv8VILXYJZ82EcknBbgye7z_bTamQlAxPZ4RYdd06oyEONGUiMQFVcfd19pQtHuauUAFexddlrbqczpvEqs-4 Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 450a632353eb4912a87bd5efc3bf2907 Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/450a632353eb4912a87bd5efc3bf2907"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/450a632353eb4912a87bd5efc3bf2907"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_450a632353eb4912a87bd5efc3bf2907", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/450a632353eb4912a87bd5efc3bf2907"}]}] Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 450a632353eb4912a87bd5efc3bf2907 Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-TestVolumeBootPattern-1790932632-project Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: e4eae2927eb943e9ab2bb78b6b555404 Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-TestVolumeBootPattern-1790932632-project Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance e658c6d4-82b6-4f6c-bb4c-401058dca309 could not be found. Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'e658c6d4-82b6-4f6c-bb4c-401058dca309'} Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e658c6d4-82b6-4f6c-bb4c-401058dca309 could not be found. Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e658c6d4-82b6-4f6c-bb4c-401058dca309 could not be found. Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:06:47.288461 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:06:47.292571 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:06:47.292571 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:06:47.292571 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:06:47.292571 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:06:47.292571 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:06:47.292571 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e658c6d4-82b6-4f6c-bb4c-401058dca309 could not be found. Jul 25 15:06:47.292571 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:06:47.294585 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-465cac3f-a14b-4f6b-a27f-be0360841593 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Returning 404 to user: Instance e658c6d4-82b6-4f6c-bb4c-401058dca309 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:06:47.295965 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-465cac3f-a14b-4f6b-a27f-be0360841593 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 404 len: 111 microversion: 2.1 time: 0.071249 Jul 25 15:06:47.297919 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3367/6512] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:47 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:06:49.510613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-54d5c855-4f6e-466c-ae3e-49533b19b8b8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:49.512022 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-54d5c855-4f6e-466c-ae3e-49533b19b8b8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:49.520150 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-54d5c855-4f6e-466c-ae3e-49533b19b8b8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:49.520980 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-54d5c855-4f6e-466c-ae3e-49533b19b8b8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:49.521815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-54d5c855-4f6e-466c-ae3e-49533b19b8b8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:49.522262 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-54d5c855-4f6e-466c-ae3e-49533b19b8b8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:49.537104 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-54d5c855-4f6e-466c-ae3e-49533b19b8b8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] HTTP exception thrown: Instance e658c6d4-82b6-4f6c-bb4c-401058dca309 could not be found. Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-54d5c855-4f6e-466c-ae3e-49533b19b8b8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Request method failure captured: Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 HTTP/1.1 Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rDtvHLNADQM-uJ_J3klWg0FTy_E0qH1hvwasDYrxKDHzDvpYuxQ-thmFamK-Qma_d-RBIPBhjFabpJL3iCa_0TXRcnv8VILXYJZ82EcknBbgye7z_bTamQlAxPZ4RYdd06oyEONGUiMQFVcfd19pQtHuauUAFexddlrbqczpvEqs-4 Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 450a632353eb4912a87bd5efc3bf2907 Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/450a632353eb4912a87bd5efc3bf2907"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/450a632353eb4912a87bd5efc3bf2907"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_450a632353eb4912a87bd5efc3bf2907", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/450a632353eb4912a87bd5efc3bf2907"}]}] Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 450a632353eb4912a87bd5efc3bf2907 Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-TestVolumeBootPattern-1790932632-project Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: e4eae2927eb943e9ab2bb78b6b555404 Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-TestVolumeBootPattern-1790932632-project Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance e658c6d4-82b6-4f6c-bb4c-401058dca309 could not be found. Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'e658c6d4-82b6-4f6c-bb4c-401058dca309'} Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e658c6d4-82b6-4f6c-bb4c-401058dca309 could not be found. Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:06:49.538774 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:06:49.543251 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e658c6d4-82b6-4f6c-bb4c-401058dca309 could not be found. Jul 25 15:06:49.543251 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:06:49.543251 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:06:49.543251 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:06:49.543251 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:06:49.543251 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:06:49.543251 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:06:49.543251 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:06:49.543251 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:06:49.543251 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e658c6d4-82b6-4f6c-bb4c-401058dca309 could not be found. Jul 25 15:06:49.543251 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:06:49.545761 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-54d5c855-4f6e-466c-ae3e-49533b19b8b8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Returning 404 to user: Instance e658c6d4-82b6-4f6c-bb4c-401058dca309 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:06:49.546626 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-54d5c855-4f6e-466c-ae3e-49533b19b8b8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "DELETE /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 404 len: 111 microversion: 2.1 time: 0.041078 Jul 25 15:06:49.547209 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3146/6513] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:06:49 2022] DELETE /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:06:49.557440 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9a5ba00b-c213-4a3b-af8d-008c895c8236 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:06:49.558193 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9a5ba00b-c213-4a3b-af8d-008c895c8236 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: e658c6d4-82b6-4f6c-bb4c-401058dca309] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:06:49.565898 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9a5ba00b-c213-4a3b-af8d-008c895c8236 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:49.566189 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9a5ba00b-c213-4a3b-af8d-008c895c8236 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:49.566971 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9a5ba00b-c213-4a3b-af8d-008c895c8236 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:06:49.567407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9a5ba00b-c213-4a3b-af8d-008c895c8236 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:06:49.584497 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-9a5ba00b-c213-4a3b-af8d-008c895c8236 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] HTTP exception thrown: Instance e658c6d4-82b6-4f6c-bb4c-401058dca309 could not be found. Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9a5ba00b-c213-4a3b-af8d-008c895c8236 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Request method failure captured: Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 HTTP/1.1 Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3rDtvHLNADQM-uJ_J3klWg0FTy_E0qH1hvwasDYrxKDHzDvpYuxQ-thmFamK-Qma_d-RBIPBhjFabpJL3iCa_0TXRcnv8VILXYJZ82EcknBbgye7z_bTamQlAxPZ4RYdd06oyEONGUiMQFVcfd19pQtHuauUAFexddlrbqczpvEqs-4 Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 450a632353eb4912a87bd5efc3bf2907 Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/450a632353eb4912a87bd5efc3bf2907"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/450a632353eb4912a87bd5efc3bf2907"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_450a632353eb4912a87bd5efc3bf2907", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/450a632353eb4912a87bd5efc3bf2907"}]}] Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 450a632353eb4912a87bd5efc3bf2907 Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-TestVolumeBootPattern-1790932632-project Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: e4eae2927eb943e9ab2bb78b6b555404 Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-TestVolumeBootPattern-1790932632-project Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance e658c6d4-82b6-4f6c-bb4c-401058dca309 could not be found. Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'e658c6d4-82b6-4f6c-bb4c-401058dca309'} Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e658c6d4-82b6-4f6c-bb4c-401058dca309 could not be found. Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e658c6d4-82b6-4f6c-bb4c-401058dca309 could not be found. Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:06:49.586209 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:06:49.590447 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:06:49.590447 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:06:49.590447 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:06:49.590447 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:06:49.590447 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:06:49.590447 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e658c6d4-82b6-4f6c-bb4c-401058dca309 could not be found. Jul 25 15:06:49.590447 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:06:49.590447 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9a5ba00b-c213-4a3b-af8d-008c895c8236 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Returning 404 to user: Instance e658c6d4-82b6-4f6c-bb4c-401058dca309 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:06:49.590447 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9a5ba00b-c213-4a3b-af8d-008c895c8236 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309" status: 404 len: 111 microversion: 2.1 time: 0.035665 Jul 25 15:06:49.590447 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3368/6514] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:06:49 2022] GET /compute/v2.1/servers/e658c6d4-82b6-4f6c-bb4c-401058dca309 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:07:12.977365 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 15:07:12.977365 n-d-846435-14 devstack@n-api.service[119304]: Mon Jul 25 15:07:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 15:07:16.262489 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4043ca01-efca-429c-b51f-0c79609e4747 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-27336315", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "9b662cff-09b7-4d9e-85be-e847c5fea871", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "c376c71f-de2b-4e80-ab75-8e710f8505df"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:07:16.272347 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=11 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:07:16.272984 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=27 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:07:16.333640 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-4043ca01-efca-429c-b51f-0c79609e4747 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] validate_networks() for [('c376c71f-de2b-4e80-ab75-8e710f8505df', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:07:16.782321 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-4043ca01-efca-429c-b51f-0c79609e4747 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:07:16.782740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-4043ca01-efca-429c-b51f-0c79609e4747 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:07:16.783434 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-4043ca01-efca-429c-b51f-0c79609e4747 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:07:16.783844 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-4043ca01-efca-429c-b51f-0c79609e4747 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:07:16.784280 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-4043ca01-efca-429c-b51f-0c79609e4747 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:07:16.794697 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4043ca01-efca-429c-b51f-0c79609e4747 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:16.795206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4043ca01-efca-429c-b51f-0c79609e4747 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:16.796085 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4043ca01-efca-429c-b51f-0c79609e4747 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:16.796514 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4043ca01-efca-429c-b51f-0c79609e4747 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:16.814757 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-4043ca01-efca-429c-b51f-0c79609e4747 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Getting quotas for project 450a632353eb4912a87bd5efc3bf2907. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:07:16.821118 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-4043ca01-efca-429c-b51f-0c79609e4747 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Getting quotas for user e4eae2927eb943e9ab2bb78b6b555404 and project 450a632353eb4912a87bd5efc3bf2907. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:07:16.882786 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4043ca01-efca-429c-b51f-0c79609e4747 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:07:16.884714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4043ca01-efca-429c-b51f-0c79609e4747 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9b662cff-09b7-4d9e-85be-e847c5fea871',volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:07:17.022879 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4043ca01-efca-429c-b51f-0c79609e4747 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.764451 Jul 25 15:07:17.023459 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3147/6515] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:07:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:07:17.034888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dcf4f047-8494-480e-abcb-3fc559d67b50 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:17.035447 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dcf4f047-8494-480e-abcb-3fc559d67b50 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:17.037773 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=7 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:07:17.038382 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=19 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:07:17.094389 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dcf4f047-8494-480e-abcb-3fc559d67b50 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:17.101806 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dcf4f047-8494-480e-abcb-3fc559d67b50 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f" status: 200 len: 1069 microversion: 2.1 time: 0.071147 Jul 25 15:07:17.102442 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3369/6516] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:17 2022] GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f => generated 1069 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:07:18.126349 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-56f96548-a857-43a3-b147-3b08247bbcfc tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:18.128098 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-56f96548-a857-43a3-b147-3b08247bbcfc tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:18.136395 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56f96548-a857-43a3-b147-3b08247bbcfc tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:18.136937 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56f96548-a857-43a3-b147-3b08247bbcfc tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:18.137838 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56f96548-a857-43a3-b147-3b08247bbcfc tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:18.138385 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56f96548-a857-43a3-b147-3b08247bbcfc tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:18.261649 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-56f96548-a857-43a3-b147-3b08247bbcfc tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:18.270230 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-56f96548-a857-43a3-b147-3b08247bbcfc tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f" status: 200 len: 1175 microversion: 2.1 time: 0.150168 Jul 25 15:07:18.271427 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3148/6517] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:18 2022] GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f => generated 1175 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:07:19.293904 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b54d55a0-ff95-4cbe-ba2e-e94df2bb149f tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:19.294568 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b54d55a0-ff95-4cbe-ba2e-e94df2bb149f tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:19.303665 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b54d55a0-ff95-4cbe-ba2e-e94df2bb149f tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:19.304468 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b54d55a0-ff95-4cbe-ba2e-e94df2bb149f tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:19.305443 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b54d55a0-ff95-4cbe-ba2e-e94df2bb149f tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:19.306043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b54d55a0-ff95-4cbe-ba2e-e94df2bb149f tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:19.533319 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b54d55a0-ff95-4cbe-ba2e-e94df2bb149f tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:19.543650 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b54d55a0-ff95-4cbe-ba2e-e94df2bb149f tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f" status: 200 len: 1227 microversion: 2.1 time: 0.253629 Jul 25 15:07:19.544984 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3370/6518] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:19 2022] GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f => generated 1227 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:07:20.129797 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-521b0777-26ef-441e-abb0-8b72b2ec0f9e req-450452a0-2d46-4621-92e6-a998defdf8ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7262f7d8-0fc3-4997-acf7-159a2f90cd5f", "tag": "9a12c92b-c6f0-402c-ba8c-57116d7acfe1"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:07:20.169164 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-521b0777-26ef-441e-abb0-8b72b2ec0f9e req-450452a0-2d46-4621-92e6-a998defdf8ba service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:20.173978 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-521b0777-26ef-441e-abb0-8b72b2ec0f9e req-450452a0-2d46-4621-92e6-a998defdf8ba service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:20.568958 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f9add3de-21d0-4f36-a0b3-837af65a2bcc tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:20.570242 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f9add3de-21d0-4f36-a0b3-837af65a2bcc tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:20.579768 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f9add3de-21d0-4f36-a0b3-837af65a2bcc tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:20.580818 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f9add3de-21d0-4f36-a0b3-837af65a2bcc tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:20.581976 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f9add3de-21d0-4f36-a0b3-837af65a2bcc tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:20.582797 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f9add3de-21d0-4f36-a0b3-837af65a2bcc tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:20.697093 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-521b0777-26ef-441e-abb0-8b72b2ec0f9e req-450452a0-2d46-4621-92e6-a998defdf8ba service nova] Creating event network-changed:9a12c92b-c6f0-402c-ba8c-57116d7acfe1 for instance 7262f7d8-0fc3-4997-acf7-159a2f90cd5f on n-h1-846435-14 Jul 25 15:07:20.706111 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-521b0777-26ef-441e-abb0-8b72b2ec0f9e req-450452a0-2d46-4621-92e6-a998defdf8ba service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.582707 Jul 25 15:07:20.706794 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3149/6519] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:07:20.768318 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f9add3de-21d0-4f36-a0b3-837af65a2bcc tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:20.778551 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f9add3de-21d0-4f36-a0b3-837af65a2bcc tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f" status: 200 len: 1227 microversion: 2.1 time: 0.215511 Jul 25 15:07:20.779945 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3371/6520] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:20 2022] GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f => generated 1227 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:07:21.801357 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a0615663-f987-46ad-916f-5520e9fd5c52 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:21.802277 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a0615663-f987-46ad-916f-5520e9fd5c52 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:21.809230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a0615663-f987-46ad-916f-5520e9fd5c52 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:21.810716 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a0615663-f987-46ad-916f-5520e9fd5c52 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:21.810919 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a0615663-f987-46ad-916f-5520e9fd5c52 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:21.811591 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a0615663-f987-46ad-916f-5520e9fd5c52 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:21.957923 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a0615663-f987-46ad-916f-5520e9fd5c52 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:21.966001 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a0615663-f987-46ad-916f-5520e9fd5c52 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f" status: 200 len: 1227 microversion: 2.1 time: 0.170475 Jul 25 15:07:21.966669 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3150/6521] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:21 2022] GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f => generated 1227 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:07:22.993315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c2c2e641-ac7b-4e7b-b6bc-9cc1af7d6462 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:22.993889 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c2c2e641-ac7b-4e7b-b6bc-9cc1af7d6462 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:23.001333 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c2c2e641-ac7b-4e7b-b6bc-9cc1af7d6462 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:23.001783 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c2c2e641-ac7b-4e7b-b6bc-9cc1af7d6462 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:23.002907 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c2c2e641-ac7b-4e7b-b6bc-9cc1af7d6462 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:23.003343 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c2c2e641-ac7b-4e7b-b6bc-9cc1af7d6462 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:23.145863 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c2c2e641-ac7b-4e7b-b6bc-9cc1af7d6462 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:23.155175 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c2c2e641-ac7b-4e7b-b6bc-9cc1af7d6462 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f" status: 200 len: 1227 microversion: 2.1 time: 0.165766 Jul 25 15:07:23.156484 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3372/6522] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:22 2022] GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f => generated 1227 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:07:24.177246 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-efc86536-dc9d-4a4f-8775-417ae6ee216a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:24.177782 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-efc86536-dc9d-4a4f-8775-417ae6ee216a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:24.185144 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-efc86536-dc9d-4a4f-8775-417ae6ee216a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:24.185623 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-efc86536-dc9d-4a4f-8775-417ae6ee216a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:24.186415 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-efc86536-dc9d-4a4f-8775-417ae6ee216a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:24.186916 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-efc86536-dc9d-4a4f-8775-417ae6ee216a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:24.343193 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-efc86536-dc9d-4a4f-8775-417ae6ee216a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:24.351648 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-efc86536-dc9d-4a4f-8775-417ae6ee216a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f" status: 200 len: 1227 microversion: 2.1 time: 0.178466 Jul 25 15:07:24.352249 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3151/6523] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:24 2022] GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f => generated 1227 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:07:25.372956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ca780d98-8e92-4a32-8951-e6ec57535548 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:25.373541 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ca780d98-8e92-4a32-8951-e6ec57535548 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:25.381629 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ca780d98-8e92-4a32-8951-e6ec57535548 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:25.382064 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ca780d98-8e92-4a32-8951-e6ec57535548 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:25.382882 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ca780d98-8e92-4a32-8951-e6ec57535548 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:25.383305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ca780d98-8e92-4a32-8951-e6ec57535548 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:25.530762 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ca780d98-8e92-4a32-8951-e6ec57535548 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:25.539089 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ca780d98-8e92-4a32-8951-e6ec57535548 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f" status: 200 len: 1227 microversion: 2.1 time: 0.170066 Jul 25 15:07:25.539692 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3373/6524] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:25 2022] GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f => generated 1227 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:07:26.562400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4118320c-53b1-4d65-a89e-9b3161046fcc tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:26.564134 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4118320c-53b1-4d65-a89e-9b3161046fcc tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:26.577339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4118320c-53b1-4d65-a89e-9b3161046fcc tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:26.577947 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4118320c-53b1-4d65-a89e-9b3161046fcc tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:26.582387 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4118320c-53b1-4d65-a89e-9b3161046fcc tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:26.583249 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4118320c-53b1-4d65-a89e-9b3161046fcc tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:26.760490 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4118320c-53b1-4d65-a89e-9b3161046fcc tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:26.769245 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4118320c-53b1-4d65-a89e-9b3161046fcc tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f" status: 200 len: 1227 microversion: 2.1 time: 0.212757 Jul 25 15:07:26.777846 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3152/6525] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:26 2022] GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f => generated 1227 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:07:27.797248 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-55aba77d-f722-4693-b231-ade2c6dec655 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:27.798023 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-55aba77d-f722-4693-b231-ade2c6dec655 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:27.800814 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:07:27.806571 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55aba77d-f722-4693-b231-ade2c6dec655 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:27.807018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55aba77d-f722-4693-b231-ade2c6dec655 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:27.808129 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55aba77d-f722-4693-b231-ade2c6dec655 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:27.808489 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55aba77d-f722-4693-b231-ade2c6dec655 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:27.954767 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-55aba77d-f722-4693-b231-ade2c6dec655 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:27.964605 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-55aba77d-f722-4693-b231-ade2c6dec655 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f" status: 200 len: 1215 microversion: 2.1 time: 0.171373 Jul 25 15:07:27.966137 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3374/6526] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:27 2022] GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f => generated 1215 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:07:28.986581 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ddc6dcee-33ab-430c-b062-b849cf6f0273 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:28.988138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ddc6dcee-33ab-430c-b062-b849cf6f0273 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:28.990388 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:07:28.991469 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:07:29.001117 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ddc6dcee-33ab-430c-b062-b849cf6f0273 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:29.001577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ddc6dcee-33ab-430c-b062-b849cf6f0273 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:29.002695 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ddc6dcee-33ab-430c-b062-b849cf6f0273 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:29.003137 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ddc6dcee-33ab-430c-b062-b849cf6f0273 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:29.149906 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ddc6dcee-33ab-430c-b062-b849cf6f0273 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:29.158443 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ddc6dcee-33ab-430c-b062-b849cf6f0273 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f" status: 200 len: 1215 microversion: 2.1 time: 0.175770 Jul 25 15:07:29.159376 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3153/6527] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:28 2022] GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f => generated 1215 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:07:30.187767 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-793d54dc-9851-4952-8653-a3d737ae2a3b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:30.189037 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-793d54dc-9851-4952-8653-a3d737ae2a3b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:30.198864 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-793d54dc-9851-4952-8653-a3d737ae2a3b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:30.199625 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-793d54dc-9851-4952-8653-a3d737ae2a3b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:30.200615 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-793d54dc-9851-4952-8653-a3d737ae2a3b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:30.201227 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-793d54dc-9851-4952-8653-a3d737ae2a3b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:30.397383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-793d54dc-9851-4952-8653-a3d737ae2a3b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:30.407196 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-793d54dc-9851-4952-8653-a3d737ae2a3b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f" status: 200 len: 1215 microversion: 2.1 time: 0.223051 Jul 25 15:07:30.421773 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3375/6528] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:30 2022] GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f => generated 1215 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:07:31.429855 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fdf6588f-c118-43b1-949c-4c4655562a77 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:31.431101 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fdf6588f-c118-43b1-949c-4c4655562a77 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:31.439070 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fdf6588f-c118-43b1-949c-4c4655562a77 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:31.439828 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fdf6588f-c118-43b1-949c-4c4655562a77 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:31.441720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fdf6588f-c118-43b1-949c-4c4655562a77 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:31.442182 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fdf6588f-c118-43b1-949c-4c4655562a77 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:31.615859 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fdf6588f-c118-43b1-949c-4c4655562a77 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:31.639748 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fdf6588f-c118-43b1-949c-4c4655562a77 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f" status: 200 len: 1215 microversion: 2.1 time: 0.214912 Jul 25 15:07:31.640725 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3154/6529] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:31 2022] GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f => generated 1215 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:07:32.664772 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5bce1980-9b25-4f63-9af3-920998edd8f6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:32.666512 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5bce1980-9b25-4f63-9af3-920998edd8f6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:32.675691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5bce1980-9b25-4f63-9af3-920998edd8f6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:32.676756 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5bce1980-9b25-4f63-9af3-920998edd8f6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:32.677802 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5bce1980-9b25-4f63-9af3-920998edd8f6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:32.678470 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5bce1980-9b25-4f63-9af3-920998edd8f6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:32.858628 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5bce1980-9b25-4f63-9af3-920998edd8f6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:32.882171 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5bce1980-9b25-4f63-9af3-920998edd8f6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f" status: 200 len: 1215 microversion: 2.1 time: 0.221708 Jul 25 15:07:32.883556 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3376/6530] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:32 2022] GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f => generated 1215 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:07:33.903881 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8adf1f31-2b5b-4bba-9a7c-5b6754cfbe50 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:33.905458 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8adf1f31-2b5b-4bba-9a7c-5b6754cfbe50 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:33.914808 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8adf1f31-2b5b-4bba-9a7c-5b6754cfbe50 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:33.915708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8adf1f31-2b5b-4bba-9a7c-5b6754cfbe50 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:33.916694 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8adf1f31-2b5b-4bba-9a7c-5b6754cfbe50 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:33.917310 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8adf1f31-2b5b-4bba-9a7c-5b6754cfbe50 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:34.419260 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8adf1f31-2b5b-4bba-9a7c-5b6754cfbe50 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:34.429036 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8adf1f31-2b5b-4bba-9a7c-5b6754cfbe50 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f" status: 200 len: 1215 microversion: 2.1 time: 0.529109 Jul 25 15:07:34.444857 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3155/6531] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:33 2022] GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f => generated 1215 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:07:35.453338 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fc2b71f6-9a00-416f-9a0f-6444be158f33 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:35.453958 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fc2b71f6-9a00-416f-9a0f-6444be158f33 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:35.468456 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fc2b71f6-9a00-416f-9a0f-6444be158f33 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:35.468916 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fc2b71f6-9a00-416f-9a0f-6444be158f33 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:35.469732 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fc2b71f6-9a00-416f-9a0f-6444be158f33 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:35.470139 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fc2b71f6-9a00-416f-9a0f-6444be158f33 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:35.652910 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fc2b71f6-9a00-416f-9a0f-6444be158f33 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:35.661275 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fc2b71f6-9a00-416f-9a0f-6444be158f33 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f" status: 200 len: 1215 microversion: 2.1 time: 0.211864 Jul 25 15:07:35.661863 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3377/6532] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:35 2022] GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f => generated 1215 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:07:36.682323 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9d54139d-5e14-4aab-9fa6-d015f3ad82f4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:36.682941 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9d54139d-5e14-4aab-9fa6-d015f3ad82f4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:36.700833 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d54139d-5e14-4aab-9fa6-d015f3ad82f4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:36.701483 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d54139d-5e14-4aab-9fa6-d015f3ad82f4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:36.702571 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d54139d-5e14-4aab-9fa6-d015f3ad82f4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:36.703166 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d54139d-5e14-4aab-9fa6-d015f3ad82f4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:36.914529 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9d54139d-5e14-4aab-9fa6-d015f3ad82f4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:36.923841 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9d54139d-5e14-4aab-9fa6-d015f3ad82f4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f" status: 200 len: 1215 microversion: 2.1 time: 0.245296 Jul 25 15:07:36.924540 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3156/6533] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:36 2022] GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f => generated 1215 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:07:36.951759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-6d6cb51d-b953-4e81-8730-c73921fdf51e req-a922ae67-7e41-4b8b-8eb9-6bc4ff35a2ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7262f7d8-0fc3-4997-acf7-159a2f90cd5f", "name": "network-vif-plugged", "status": "completed", "tag": "9a12c92b-c6f0-402c-ba8c-57116d7acfe1"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:07:36.965760 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-6d6cb51d-b953-4e81-8730-c73921fdf51e req-a922ae67-7e41-4b8b-8eb9-6bc4ff35a2ae service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:36.966381 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-6d6cb51d-b953-4e81-8730-c73921fdf51e req-a922ae67-7e41-4b8b-8eb9-6bc4ff35a2ae service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:36.980966 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-6d6cb51d-b953-4e81-8730-c73921fdf51e req-a922ae67-7e41-4b8b-8eb9-6bc4ff35a2ae service nova] Creating event network-vif-plugged:9a12c92b-c6f0-402c-ba8c-57116d7acfe1 for instance 7262f7d8-0fc3-4997-acf7-159a2f90cd5f on n-h1-846435-14 Jul 25 15:07:36.987487 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-6d6cb51d-b953-4e81-8730-c73921fdf51e req-a922ae67-7e41-4b8b-8eb9-6bc4ff35a2ae service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.258790 Jul 25 15:07:36.988209 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3378/6534] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:07:37.946266 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-00723348-6228-4086-bede-e581cdd55923 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:37.947419 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-00723348-6228-4086-bede-e581cdd55923 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:37.957043 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00723348-6228-4086-bede-e581cdd55923 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:37.957736 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00723348-6228-4086-bede-e581cdd55923 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:37.958727 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00723348-6228-4086-bede-e581cdd55923 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:37.959369 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00723348-6228-4086-bede-e581cdd55923 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:38.113611 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-00723348-6228-4086-bede-e581cdd55923 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:38.121754 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-00723348-6228-4086-bede-e581cdd55923 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f" status: 200 len: 1215 microversion: 2.1 time: 0.179297 Jul 25 15:07:38.127406 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3157/6535] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:37 2022] GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f => generated 1215 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:07:39.143315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-40ca3020-0bad-4df1-bf2a-dab86f1763bf tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:39.144101 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-40ca3020-0bad-4df1-bf2a-dab86f1763bf tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:39.152460 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-40ca3020-0bad-4df1-bf2a-dab86f1763bf tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:39.153271 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-40ca3020-0bad-4df1-bf2a-dab86f1763bf tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:39.154528 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-40ca3020-0bad-4df1-bf2a-dab86f1763bf tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:39.155151 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-40ca3020-0bad-4df1-bf2a-dab86f1763bf tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:39.322752 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-40ca3020-0bad-4df1-bf2a-dab86f1763bf tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:39.332511 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-40ca3020-0bad-4df1-bf2a-dab86f1763bf tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f" status: 200 len: 1402 microversion: 2.1 time: 0.192991 Jul 25 15:07:39.339389 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3379/6536] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:39 2022] GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f => generated 1402 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:07:39.355433 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9a1e3710-e417-4a2a-afd3-a0635abf3b6e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:39.356457 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9a1e3710-e417-4a2a-afd3-a0635abf3b6e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:39.380645 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9a1e3710-e417-4a2a-afd3-a0635abf3b6e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:39.381495 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9a1e3710-e417-4a2a-afd3-a0635abf3b6e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:39.382376 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9a1e3710-e417-4a2a-afd3-a0635abf3b6e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:39.382877 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9a1e3710-e417-4a2a-afd3-a0635abf3b6e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:39.600583 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9a1e3710-e417-4a2a-afd3-a0635abf3b6e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:39.612332 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9a1e3710-e417-4a2a-afd3-a0635abf3b6e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f" status: 200 len: 1402 microversion: 2.1 time: 0.260655 Jul 25 15:07:39.617183 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3158/6537] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:39 2022] GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f => generated 1402 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:07:39.633076 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6aff8615-b3be-46db-a5fc-aa86d5ece43b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-659092317"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:07:39.635713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6aff8615-b3be-46db-a5fc-aa86d5ece43b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:39.642267 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6aff8615-b3be-46db-a5fc-aa86d5ece43b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:39.643045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6aff8615-b3be-46db-a5fc-aa86d5ece43b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:39.644117 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6aff8615-b3be-46db-a5fc-aa86d5ece43b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:39.644757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6aff8615-b3be-46db-a5fc-aa86d5ece43b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:39.764407 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.compute.api [None req-6aff8615-b3be-46db-a5fc-aa86d5ece43b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Attempting to quiesce instance before volume snapshot. Jul 25 15:07:39.837243 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.compute.api [None req-6aff8615-b3be-46db-a5fc-aa86d5ece43b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jul 25 15:07:39.961082 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6aff8615-b3be-46db-a5fc-aa86d5ece43b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Creating snapshot from volume 9b662cff-09b7-4d9e-85be-e847c5fea871. {{(pid=119304) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} Jul 25 15:07:41.346192 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6aff8615-b3be-46db-a5fc-aa86d5ece43b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "POST /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f/action" status: 202 len: 0 microversion: 2.1 time: 1.717010 Jul 25 15:07:41.349030 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3380/6538] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:07:39 2022] POST /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f/action => generated 0 bytes in 1720 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 15:07:42.586762 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6df75a30-02ee-4077-89c0-319c2ba281ab tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1431782952", "imageRef": "0bdb7119-e96b-4853-bedc-b26f440476b7", "flavorRef": "452", "networks": [{"uuid": "c376c71f-de2b-4e80-ab75-8e710f8505df"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:07:42.650590 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-6df75a30-02ee-4077-89c0-319c2ba281ab tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] validate_networks() for [('c376c71f-de2b-4e80-ab75-8e710f8505df', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:07:43.065385 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-6df75a30-02ee-4077-89c0-319c2ba281ab tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:07:43.065805 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-6df75a30-02ee-4077-89c0-319c2ba281ab tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:07:43.066346 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-6df75a30-02ee-4077-89c0-319c2ba281ab tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:07:43.066750 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-6df75a30-02ee-4077-89c0-319c2ba281ab tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:07:43.067156 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-6df75a30-02ee-4077-89c0-319c2ba281ab tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:07:43.077151 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6df75a30-02ee-4077-89c0-319c2ba281ab tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:43.077699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6df75a30-02ee-4077-89c0-319c2ba281ab tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:43.078572 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6df75a30-02ee-4077-89c0-319c2ba281ab tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:43.079102 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6df75a30-02ee-4077-89c0-319c2ba281ab tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:43.097260 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-6df75a30-02ee-4077-89c0-319c2ba281ab tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Getting quotas for project 450a632353eb4912a87bd5efc3bf2907. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:07:43.102872 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-6df75a30-02ee-4077-89c0-319c2ba281ab tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Getting quotas for user e4eae2927eb943e9ab2bb78b6b555404 and project 450a632353eb4912a87bd5efc3bf2907. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:07:43.117684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6df75a30-02ee-4077-89c0-319c2ba281ab tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:07:43.120264 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6df75a30-02ee-4077-89c0-319c2ba281ab tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='69f613d2-0772-4c99-9b7d-31b1037dc4cd',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:07:43.208396 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6df75a30-02ee-4077-89c0-319c2ba281ab tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626389 Jul 25 15:07:43.209287 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3159/6539] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:07:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:07:43.222680 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-efcfd60b-76dd-41af-99d9-5b96f2608264 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:43.224781 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-efcfd60b-76dd-41af-99d9-5b96f2608264 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:43.311014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-efcfd60b-76dd-41af-99d9-5b96f2608264 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:43.319085 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-efcfd60b-76dd-41af-99d9-5b96f2608264 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1230 microversion: 2.1 time: 0.102489 Jul 25 15:07:43.319662 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3381/6540] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:43 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1230 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:07:44.343204 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ed30e512-4647-4adf-9b06-e15a377dc62e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:44.344511 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ed30e512-4647-4adf-9b06-e15a377dc62e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:44.363078 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ed30e512-4647-4adf-9b06-e15a377dc62e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:44.363553 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ed30e512-4647-4adf-9b06-e15a377dc62e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:44.364389 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ed30e512-4647-4adf-9b06-e15a377dc62e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:44.367055 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ed30e512-4647-4adf-9b06-e15a377dc62e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:44.481185 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ed30e512-4647-4adf-9b06-e15a377dc62e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:44.492086 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ed30e512-4647-4adf-9b06-e15a377dc62e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1300 microversion: 2.1 time: 0.154892 Jul 25 15:07:44.507682 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3160/6541] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:44 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1300 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:07:45.514401 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d5a3c98f-89f7-43f2-b644-6d695019de21 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:45.515769 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d5a3c98f-89f7-43f2-b644-6d695019de21 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:45.528621 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5a3c98f-89f7-43f2-b644-6d695019de21 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:45.530227 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5a3c98f-89f7-43f2-b644-6d695019de21 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:45.533848 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5a3c98f-89f7-43f2-b644-6d695019de21 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:45.534484 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5a3c98f-89f7-43f2-b644-6d695019de21 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:45.845555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d5a3c98f-89f7-43f2-b644-6d695019de21 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:45.854337 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d5a3c98f-89f7-43f2-b644-6d695019de21 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1342 microversion: 2.1 time: 0.343901 Jul 25 15:07:45.860011 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3382/6542] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:45 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1342 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:07:46.838693 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-98080664-787b-4548-94bf-853026f9a3f4 req-e1d7015c-61cd-4232-9996-780f39bfd98f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a649918a-668f-4ebb-8dff-e8106bde600d", "tag": "f2d639fd-a38a-4e1e-b3fb-3be84e21b381"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:07:46.854657 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:07:46.861904 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-98080664-787b-4548-94bf-853026f9a3f4 req-e1d7015c-61cd-4232-9996-780f39bfd98f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:46.862689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-98080664-787b-4548-94bf-853026f9a3f4 req-e1d7015c-61cd-4232-9996-780f39bfd98f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:46.873509 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=73 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:07:46.884464 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3c7ffe8a-1f0d-4881-9d7a-4c537a2b7ba0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:46.885194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3c7ffe8a-1f0d-4881-9d7a-4c537a2b7ba0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:46.895836 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-98080664-787b-4548-94bf-853026f9a3f4 req-e1d7015c-61cd-4232-9996-780f39bfd98f service nova] Creating event network-changed:f2d639fd-a38a-4e1e-b3fb-3be84e21b381 for instance a649918a-668f-4ebb-8dff-e8106bde600d on n-h2-846435-14 Jul 25 15:07:46.899776 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c7ffe8a-1f0d-4881-9d7a-4c537a2b7ba0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:46.900268 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c7ffe8a-1f0d-4881-9d7a-4c537a2b7ba0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:46.901129 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c7ffe8a-1f0d-4881-9d7a-4c537a2b7ba0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:46.901580 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c7ffe8a-1f0d-4881-9d7a-4c537a2b7ba0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:46.910111 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-98080664-787b-4548-94bf-853026f9a3f4 req-e1d7015c-61cd-4232-9996-780f39bfd98f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076361 Jul 25 15:07:46.915412 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3161/6543] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:07:47.400304 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3c7ffe8a-1f0d-4881-9d7a-4c537a2b7ba0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:47.421177 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:07:47.424254 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3c7ffe8a-1f0d-4881-9d7a-4c537a2b7ba0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1342 microversion: 2.1 time: 0.544626 Jul 25 15:07:47.439015 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3383/6544] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:46 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1342 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:07:48.454286 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-190c6d04-9c7d-47f4-b997-bcd77a6def42 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:48.455254 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-190c6d04-9c7d-47f4-b997-bcd77a6def42 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:48.464283 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-190c6d04-9c7d-47f4-b997-bcd77a6def42 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:48.464927 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-190c6d04-9c7d-47f4-b997-bcd77a6def42 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:48.466454 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-190c6d04-9c7d-47f4-b997-bcd77a6def42 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:48.467781 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-190c6d04-9c7d-47f4-b997-bcd77a6def42 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:48.683130 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-190c6d04-9c7d-47f4-b997-bcd77a6def42 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:48.696671 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-190c6d04-9c7d-47f4-b997-bcd77a6def42 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1342 microversion: 2.1 time: 0.248029 Jul 25 15:07:48.700049 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3162/6545] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:48 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1342 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:07:49.723804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e298cf97-64d4-4009-8d1c-0e5333cf7cfd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:49.725221 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e298cf97-64d4-4009-8d1c-0e5333cf7cfd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:49.737373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=35 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:07:49.739565 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e298cf97-64d4-4009-8d1c-0e5333cf7cfd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:49.740207 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e298cf97-64d4-4009-8d1c-0e5333cf7cfd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:49.741572 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e298cf97-64d4-4009-8d1c-0e5333cf7cfd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:49.742190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e298cf97-64d4-4009-8d1c-0e5333cf7cfd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:49.982339 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e298cf97-64d4-4009-8d1c-0e5333cf7cfd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:49.997239 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e298cf97-64d4-4009-8d1c-0e5333cf7cfd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1342 microversion: 2.1 time: 0.278282 Jul 25 15:07:50.013781 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3384/6546] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:49 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1342 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:07:51.028419 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5056d4cb-ed08-4063-bc0b-202bf796337e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:51.029733 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5056d4cb-ed08-4063-bc0b-202bf796337e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:51.037970 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5056d4cb-ed08-4063-bc0b-202bf796337e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:51.038522 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5056d4cb-ed08-4063-bc0b-202bf796337e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:51.039641 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5056d4cb-ed08-4063-bc0b-202bf796337e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:51.040211 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5056d4cb-ed08-4063-bc0b-202bf796337e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:51.350989 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5056d4cb-ed08-4063-bc0b-202bf796337e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:51.360108 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5056d4cb-ed08-4063-bc0b-202bf796337e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1342 microversion: 2.1 time: 0.335733 Jul 25 15:07:51.372457 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3163/6547] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:51 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1342 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:07:52.392806 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0c5f34bb-8ecd-418e-80b5-060e4d973472 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:52.393447 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0c5f34bb-8ecd-418e-80b5-060e4d973472 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:52.405857 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c5f34bb-8ecd-418e-80b5-060e4d973472 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:52.406533 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c5f34bb-8ecd-418e-80b5-060e4d973472 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:52.407463 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c5f34bb-8ecd-418e-80b5-060e4d973472 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:52.408106 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c5f34bb-8ecd-418e-80b5-060e4d973472 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:52.674467 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0c5f34bb-8ecd-418e-80b5-060e4d973472 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:52.686885 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0c5f34bb-8ecd-418e-80b5-060e4d973472 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1342 microversion: 2.1 time: 0.301347 Jul 25 15:07:52.687503 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3385/6548] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:52 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1342 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:07:53.723832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-46d85c0b-4605-455f-9851-6d99c6934284 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:53.732932 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-46d85c0b-4605-455f-9851-6d99c6934284 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:53.735729 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:07:53.739649 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:07:53.741729 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46d85c0b-4605-455f-9851-6d99c6934284 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:53.743274 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46d85c0b-4605-455f-9851-6d99c6934284 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:53.744384 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46d85c0b-4605-455f-9851-6d99c6934284 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:53.746340 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46d85c0b-4605-455f-9851-6d99c6934284 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:54.004112 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-46d85c0b-4605-455f-9851-6d99c6934284 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:54.015463 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-46d85c0b-4605-455f-9851-6d99c6934284 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1342 microversion: 2.1 time: 0.296617 Jul 25 15:07:54.029177 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3164/6549] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:53 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1342 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:07:55.039375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f0e80755-a83e-483d-89df-d2e9ef0e32c2 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:55.041130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f0e80755-a83e-483d-89df-d2e9ef0e32c2 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:55.047717 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:07:55.051794 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0e80755-a83e-483d-89df-d2e9ef0e32c2 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:55.052570 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0e80755-a83e-483d-89df-d2e9ef0e32c2 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:55.053451 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0e80755-a83e-483d-89df-d2e9ef0e32c2 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:55.053962 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0e80755-a83e-483d-89df-d2e9ef0e32c2 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:55.231228 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f0e80755-a83e-483d-89df-d2e9ef0e32c2 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:55.240840 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f0e80755-a83e-483d-89df-d2e9ef0e32c2 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1342 microversion: 2.1 time: 0.205696 Jul 25 15:07:55.250266 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3386/6550] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:55 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1342 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:07:56.262687 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5e4e1542-ab3f-4e98-a635-98a2d9272d54 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:56.263432 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5e4e1542-ab3f-4e98-a635-98a2d9272d54 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:56.271287 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5e4e1542-ab3f-4e98-a635-98a2d9272d54 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:56.271797 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5e4e1542-ab3f-4e98-a635-98a2d9272d54 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:56.272603 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5e4e1542-ab3f-4e98-a635-98a2d9272d54 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:56.273039 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5e4e1542-ab3f-4e98-a635-98a2d9272d54 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:56.426557 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5e4e1542-ab3f-4e98-a635-98a2d9272d54 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:56.435756 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5e4e1542-ab3f-4e98-a635-98a2d9272d54 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1342 microversion: 2.1 time: 0.177424 Jul 25 15:07:56.437328 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3165/6551] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:56 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1342 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:07:57.460050 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2897a81f-c909-4dc2-95bd-1b9ef9ba38d0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:57.461263 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2897a81f-c909-4dc2-95bd-1b9ef9ba38d0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:57.468144 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2897a81f-c909-4dc2-95bd-1b9ef9ba38d0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:57.468688 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2897a81f-c909-4dc2-95bd-1b9ef9ba38d0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:57.469554 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2897a81f-c909-4dc2-95bd-1b9ef9ba38d0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:57.470074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2897a81f-c909-4dc2-95bd-1b9ef9ba38d0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:57.642015 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2897a81f-c909-4dc2-95bd-1b9ef9ba38d0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:57.651938 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2897a81f-c909-4dc2-95bd-1b9ef9ba38d0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1342 microversion: 2.1 time: 0.195690 Jul 25 15:07:57.665364 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3387/6552] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:57 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1342 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:07:58.673909 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9c799df9-60f8-464d-94f5-7955c2ee4f7c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:58.674491 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9c799df9-60f8-464d-94f5-7955c2ee4f7c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:58.682546 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9c799df9-60f8-464d-94f5-7955c2ee4f7c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:58.683010 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9c799df9-60f8-464d-94f5-7955c2ee4f7c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:58.683809 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9c799df9-60f8-464d-94f5-7955c2ee4f7c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:58.684272 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9c799df9-60f8-464d-94f5-7955c2ee4f7c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:58.830942 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9c799df9-60f8-464d-94f5-7955c2ee4f7c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:07:58.840396 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9c799df9-60f8-464d-94f5-7955c2ee4f7c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1342 microversion: 2.1 time: 0.170898 Jul 25 15:07:58.841640 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3166/6553] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:58 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1342 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:07:59.862189 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ab118cdb-ea05-41fd-aa8f-9eee2b9ae336 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:07:59.863646 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ab118cdb-ea05-41fd-aa8f-9eee2b9ae336 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:07:59.871125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ab118cdb-ea05-41fd-aa8f-9eee2b9ae336 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:59.871938 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ab118cdb-ea05-41fd-aa8f-9eee2b9ae336 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:07:59.873133 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ab118cdb-ea05-41fd-aa8f-9eee2b9ae336 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:07:59.873581 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ab118cdb-ea05-41fd-aa8f-9eee2b9ae336 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:00.041104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ab118cdb-ea05-41fd-aa8f-9eee2b9ae336 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:00.049349 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ab118cdb-ea05-41fd-aa8f-9eee2b9ae336 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1342 microversion: 2.1 time: 0.191045 Jul 25 15:08:00.050055 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3388/6554] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:07:59 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1342 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:08:01.074412 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1ce37622-de9d-4ba8-9f28-98ff5f6ef03e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:01.075913 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1ce37622-de9d-4ba8-9f28-98ff5f6ef03e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:01.085848 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ce37622-de9d-4ba8-9f28-98ff5f6ef03e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:01.086601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ce37622-de9d-4ba8-9f28-98ff5f6ef03e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:01.087865 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ce37622-de9d-4ba8-9f28-98ff5f6ef03e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:01.088563 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ce37622-de9d-4ba8-9f28-98ff5f6ef03e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:01.262536 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1ce37622-de9d-4ba8-9f28-98ff5f6ef03e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:01.273026 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1ce37622-de9d-4ba8-9f28-98ff5f6ef03e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1342 microversion: 2.1 time: 0.205192 Jul 25 15:08:01.273604 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3167/6555] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:01 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1342 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:08:02.295454 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-010511a1-4ae5-47be-941d-727637bb5752 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:02.296226 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-010511a1-4ae5-47be-941d-727637bb5752 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:02.303814 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-010511a1-4ae5-47be-941d-727637bb5752 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:02.307637 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-010511a1-4ae5-47be-941d-727637bb5752 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:02.307637 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-010511a1-4ae5-47be-941d-727637bb5752 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:02.307637 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-010511a1-4ae5-47be-941d-727637bb5752 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:02.481610 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-010511a1-4ae5-47be-941d-727637bb5752 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:02.491094 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-010511a1-4ae5-47be-941d-727637bb5752 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1342 microversion: 2.1 time: 0.199843 Jul 25 15:08:02.491923 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3389/6556] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:02 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1342 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:08:03.514662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fa3579fa-3970-4b41-abf0-96c2c806df4c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:03.515436 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fa3579fa-3970-4b41-abf0-96c2c806df4c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:03.527602 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa3579fa-3970-4b41-abf0-96c2c806df4c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:03.528646 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa3579fa-3970-4b41-abf0-96c2c806df4c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:03.529635 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa3579fa-3970-4b41-abf0-96c2c806df4c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:03.530332 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa3579fa-3970-4b41-abf0-96c2c806df4c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:03.713294 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fa3579fa-3970-4b41-abf0-96c2c806df4c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:03.724400 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fa3579fa-3970-4b41-abf0-96c2c806df4c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1342 microversion: 2.1 time: 0.214458 Jul 25 15:08:03.740145 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3168/6557] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:03 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1342 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:08:04.750449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-86206f00-a17e-4e26-b89f-12df6f79434d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:04.751364 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-86206f00-a17e-4e26-b89f-12df6f79434d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:04.760220 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-86206f00-a17e-4e26-b89f-12df6f79434d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:04.761246 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-86206f00-a17e-4e26-b89f-12df6f79434d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:04.762363 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-86206f00-a17e-4e26-b89f-12df6f79434d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:04.763079 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-86206f00-a17e-4e26-b89f-12df6f79434d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:04.946801 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-86206f00-a17e-4e26-b89f-12df6f79434d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:04.959872 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-86206f00-a17e-4e26-b89f-12df6f79434d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1342 microversion: 2.1 time: 0.213693 Jul 25 15:08:04.960720 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3390/6558] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:04 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1342 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:08:05.982608 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-216e67d0-747f-47e2-9ef6-fdf3423d18c9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:05.983381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-216e67d0-747f-47e2-9ef6-fdf3423d18c9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:05.991141 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-216e67d0-747f-47e2-9ef6-fdf3423d18c9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:05.991735 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-216e67d0-747f-47e2-9ef6-fdf3423d18c9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:05.992640 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-216e67d0-747f-47e2-9ef6-fdf3423d18c9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:05.993320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-216e67d0-747f-47e2-9ef6-fdf3423d18c9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:06.176464 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-216e67d0-747f-47e2-9ef6-fdf3423d18c9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:06.187134 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-216e67d0-747f-47e2-9ef6-fdf3423d18c9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1342 microversion: 2.1 time: 0.209213 Jul 25 15:08:06.188267 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3169/6559] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:05 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1342 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:08:07.211475 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8015fd3d-47c4-4737-a2f3-f3d2a41733b4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:07.213283 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8015fd3d-47c4-4737-a2f3-f3d2a41733b4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:07.224278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8015fd3d-47c4-4737-a2f3-f3d2a41733b4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:07.224970 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8015fd3d-47c4-4737-a2f3-f3d2a41733b4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:07.225775 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8015fd3d-47c4-4737-a2f3-f3d2a41733b4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:07.226256 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8015fd3d-47c4-4737-a2f3-f3d2a41733b4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:07.411185 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8015fd3d-47c4-4737-a2f3-f3d2a41733b4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:07.422316 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8015fd3d-47c4-4737-a2f3-f3d2a41733b4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1376 microversion: 2.1 time: 0.216351 Jul 25 15:08:07.423358 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3391/6560] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:07 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1376 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:08:08.458986 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b75f8746-0272-44b6-b445-2ccae7d7f217 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:08.458986 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b75f8746-0272-44b6-b445-2ccae7d7f217 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:08.461464 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b75f8746-0272-44b6-b445-2ccae7d7f217 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:08.461962 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b75f8746-0272-44b6-b445-2ccae7d7f217 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:08.462848 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b75f8746-0272-44b6-b445-2ccae7d7f217 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:08.463381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b75f8746-0272-44b6-b445-2ccae7d7f217 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:08.657730 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b75f8746-0272-44b6-b445-2ccae7d7f217 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:08.666615 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b75f8746-0272-44b6-b445-2ccae7d7f217 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1376 microversion: 2.1 time: 0.220877 Jul 25 15:08:08.667232 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3170/6561] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:08 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1376 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:08:09.689211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3decb1cb-3a27-4b47-a337-7dd4e860a7ce tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:09.690537 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3decb1cb-3a27-4b47-a337-7dd4e860a7ce tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:09.698370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3decb1cb-3a27-4b47-a337-7dd4e860a7ce tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:09.698910 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3decb1cb-3a27-4b47-a337-7dd4e860a7ce tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:09.699853 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3decb1cb-3a27-4b47-a337-7dd4e860a7ce tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:09.700322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3decb1cb-3a27-4b47-a337-7dd4e860a7ce tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:09.868651 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3decb1cb-3a27-4b47-a337-7dd4e860a7ce tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:09.886726 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3decb1cb-3a27-4b47-a337-7dd4e860a7ce tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1376 microversion: 2.1 time: 0.201568 Jul 25 15:08:09.887352 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3392/6562] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:09 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1376 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:08:10.910465 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-46af757e-24ee-462d-9ee4-45d0c600e5d7 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:10.911838 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-46af757e-24ee-462d-9ee4-45d0c600e5d7 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:10.921291 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46af757e-24ee-462d-9ee4-45d0c600e5d7 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:10.922143 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46af757e-24ee-462d-9ee4-45d0c600e5d7 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:10.923268 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46af757e-24ee-462d-9ee4-45d0c600e5d7 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:10.924522 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46af757e-24ee-462d-9ee4-45d0c600e5d7 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:11.134006 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-46af757e-24ee-462d-9ee4-45d0c600e5d7 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:11.145469 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-46af757e-24ee-462d-9ee4-45d0c600e5d7 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1376 microversion: 2.1 time: 0.240859 Jul 25 15:08:11.146731 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3171/6563] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:10 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1376 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:08:12.167774 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e9c33214-4d48-4a31-94c0-b3b42b8ba53c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:12.169105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e9c33214-4d48-4a31-94c0-b3b42b8ba53c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:12.176701 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e9c33214-4d48-4a31-94c0-b3b42b8ba53c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:12.177165 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e9c33214-4d48-4a31-94c0-b3b42b8ba53c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:12.177957 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e9c33214-4d48-4a31-94c0-b3b42b8ba53c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:12.178405 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e9c33214-4d48-4a31-94c0-b3b42b8ba53c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:12.356328 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e9c33214-4d48-4a31-94c0-b3b42b8ba53c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:12.365468 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e9c33214-4d48-4a31-94c0-b3b42b8ba53c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1376 microversion: 2.1 time: 0.202178 Jul 25 15:08:12.366161 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3393/6564] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:12 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1376 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:08:13.389344 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-172cf806-af45-4008-8ebd-c86854ddf5f1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:13.393792 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-172cf806-af45-4008-8ebd-c86854ddf5f1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:13.404969 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-172cf806-af45-4008-8ebd-c86854ddf5f1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:13.405707 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-172cf806-af45-4008-8ebd-c86854ddf5f1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:13.406790 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-172cf806-af45-4008-8ebd-c86854ddf5f1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:13.417321 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-172cf806-af45-4008-8ebd-c86854ddf5f1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:13.565125 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-172cf806-af45-4008-8ebd-c86854ddf5f1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:13.572750 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-172cf806-af45-4008-8ebd-c86854ddf5f1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1376 microversion: 2.1 time: 0.189784 Jul 25 15:08:13.573924 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3172/6565] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:13 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1376 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:08:14.600819 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9fe26a39-5831-433c-9e5f-61d1dfa4a45d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:14.601497 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9fe26a39-5831-433c-9e5f-61d1dfa4a45d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:14.609501 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9fe26a39-5831-433c-9e5f-61d1dfa4a45d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:14.610568 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9fe26a39-5831-433c-9e5f-61d1dfa4a45d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:14.613580 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9fe26a39-5831-433c-9e5f-61d1dfa4a45d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:14.614446 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9fe26a39-5831-433c-9e5f-61d1dfa4a45d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:14.780947 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9fe26a39-5831-433c-9e5f-61d1dfa4a45d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:14.790813 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9fe26a39-5831-433c-9e5f-61d1dfa4a45d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1376 microversion: 2.1 time: 0.193942 Jul 25 15:08:14.799361 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3394/6566] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:14 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1376 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:08:15.815673 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d2e4378d-d5c9-4ba7-b1fe-0f9145c163a7 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:15.816626 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d2e4378d-d5c9-4ba7-b1fe-0f9145c163a7 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:15.839519 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d2e4378d-d5c9-4ba7-b1fe-0f9145c163a7 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:15.840642 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d2e4378d-d5c9-4ba7-b1fe-0f9145c163a7 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:15.841886 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d2e4378d-d5c9-4ba7-b1fe-0f9145c163a7 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:15.842640 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d2e4378d-d5c9-4ba7-b1fe-0f9145c163a7 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:16.018784 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d2e4378d-d5c9-4ba7-b1fe-0f9145c163a7 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:16.028720 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d2e4378d-d5c9-4ba7-b1fe-0f9145c163a7 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1376 microversion: 2.1 time: 0.217952 Jul 25 15:08:16.029886 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3173/6567] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:15 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1376 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:08:17.050263 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ba9b56b4-b7e6-4f6c-b537-18c314567d3f tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:17.051181 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ba9b56b4-b7e6-4f6c-b537-18c314567d3f tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:17.058703 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ba9b56b4-b7e6-4f6c-b537-18c314567d3f tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:17.059291 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ba9b56b4-b7e6-4f6c-b537-18c314567d3f tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:17.060211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ba9b56b4-b7e6-4f6c-b537-18c314567d3f tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:17.060783 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ba9b56b4-b7e6-4f6c-b537-18c314567d3f tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:17.204132 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ba9b56b4-b7e6-4f6c-b537-18c314567d3f tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:17.213140 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ba9b56b4-b7e6-4f6c-b537-18c314567d3f tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1376 microversion: 2.1 time: 0.166933 Jul 25 15:08:17.214325 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3395/6568] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:17 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1376 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:08:17.432342 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-bb231a71-5b7f-4c43-b6f6-b8e66b02f9e5 req-094d201e-0fb7-48ba-a06b-d73a6bc7f87e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a649918a-668f-4ebb-8dff-e8106bde600d", "name": "network-vif-plugged", "status": "completed", "tag": "f2d639fd-a38a-4e1e-b3fb-3be84e21b381"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:08:17.455283 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-bb231a71-5b7f-4c43-b6f6-b8e66b02f9e5 req-094d201e-0fb7-48ba-a06b-d73a6bc7f87e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:17.457844 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-bb231a71-5b7f-4c43-b6f6-b8e66b02f9e5 req-094d201e-0fb7-48ba-a06b-d73a6bc7f87e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:17.467402 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=74 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:08:17.511389 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-bb231a71-5b7f-4c43-b6f6-b8e66b02f9e5 req-094d201e-0fb7-48ba-a06b-d73a6bc7f87e service nova] Creating event network-vif-plugged:f2d639fd-a38a-4e1e-b3fb-3be84e21b381 for instance a649918a-668f-4ebb-8dff-e8106bde600d on n-h2-846435-14 Jul 25 15:08:17.520016 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-bb231a71-5b7f-4c43-b6f6-b8e66b02f9e5 req-094d201e-0fb7-48ba-a06b-d73a6bc7f87e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098113 Jul 25 15:08:17.520016 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3174/6569] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:08:18.235686 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5aa9928f-55b3-4e1e-bb60-59eb6463896c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:18.236328 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5aa9928f-55b3-4e1e-bb60-59eb6463896c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:18.243954 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5aa9928f-55b3-4e1e-bb60-59eb6463896c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:18.244517 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5aa9928f-55b3-4e1e-bb60-59eb6463896c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:18.245388 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5aa9928f-55b3-4e1e-bb60-59eb6463896c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:18.245896 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5aa9928f-55b3-4e1e-bb60-59eb6463896c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:18.394781 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5aa9928f-55b3-4e1e-bb60-59eb6463896c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:18.404496 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5aa9928f-55b3-4e1e-bb60-59eb6463896c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1376 microversion: 2.1 time: 0.173166 Jul 25 15:08:18.405662 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3396/6570] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:18 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1376 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:08:19.466935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d8bd26be-4d91-4047-9b19-cab538525f2e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:19.467931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d8bd26be-4d91-4047-9b19-cab538525f2e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:19.475101 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=28 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:08:19.476837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8bd26be-4d91-4047-9b19-cab538525f2e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:19.477316 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8bd26be-4d91-4047-9b19-cab538525f2e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:19.478305 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8bd26be-4d91-4047-9b19-cab538525f2e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:19.478746 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8bd26be-4d91-4047-9b19-cab538525f2e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:19.698217 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d8bd26be-4d91-4047-9b19-cab538525f2e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:19.708230 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d8bd26be-4d91-4047-9b19-cab538525f2e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1376 microversion: 2.1 time: 0.267737 Jul 25 15:08:19.717087 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3175/6571] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:19 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1376 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:08:20.731093 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e352e318-84eb-438a-8a61-f4f8da57a5b9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:20.731916 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e352e318-84eb-438a-8a61-f4f8da57a5b9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:20.736288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=26 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:08:20.744135 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e352e318-84eb-438a-8a61-f4f8da57a5b9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:20.744889 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e352e318-84eb-438a-8a61-f4f8da57a5b9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:20.745472 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e352e318-84eb-438a-8a61-f4f8da57a5b9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:20.745942 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e352e318-84eb-438a-8a61-f4f8da57a5b9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:20.749977 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=80 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:08:20.924849 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e352e318-84eb-438a-8a61-f4f8da57a5b9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:20.934672 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e352e318-84eb-438a-8a61-f4f8da57a5b9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1563 microversion: 2.1 time: 0.208773 Jul 25 15:08:20.937967 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3397/6572] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:20 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1563 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:08:20.964246 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-31ff31b7-7a7f-45cc-89e2-d80c013617fd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:20.966174 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-31ff31b7-7a7f-45cc-89e2-d80c013617fd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:20.976037 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-31ff31b7-7a7f-45cc-89e2-d80c013617fd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:20.976885 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-31ff31b7-7a7f-45cc-89e2-d80c013617fd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:20.977932 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-31ff31b7-7a7f-45cc-89e2-d80c013617fd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:20.979312 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-31ff31b7-7a7f-45cc-89e2-d80c013617fd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:21.175149 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-31ff31b7-7a7f-45cc-89e2-d80c013617fd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:21.184770 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-31ff31b7-7a7f-45cc-89e2-d80c013617fd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1563 microversion: 2.1 time: 0.224980 Jul 25 15:08:21.185779 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3176/6573] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:20 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1563 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:08:21.275370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6db354e5-41a1-4943-a99b-a6ed5d866f0b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:21.275370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6db354e5-41a1-4943-a99b-a6ed5d866f0b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:21.280443 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6db354e5-41a1-4943-a99b-a6ed5d866f0b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:21.280907 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6db354e5-41a1-4943-a99b-a6ed5d866f0b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:21.281707 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6db354e5-41a1-4943-a99b-a6ed5d866f0b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:21.282356 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6db354e5-41a1-4943-a99b-a6ed5d866f0b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:21.312671 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6db354e5-41a1-4943-a99b-a6ed5d866f0b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:08:21.413502 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6db354e5-41a1-4943-a99b-a6ed5d866f0b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 204 len: 0 microversion: 2.1 time: 0.144332 Jul 25 15:08:21.414559 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3398/6574] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:08:21 2022] DELETE /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:08:21.423226 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-56dcaddf-268f-48f6-a5e2-b8c68359fbeb tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:21.423844 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-56dcaddf-268f-48f6-a5e2-b8c68359fbeb tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:21.433867 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56dcaddf-268f-48f6-a5e2-b8c68359fbeb tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:21.434316 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56dcaddf-268f-48f6-a5e2-b8c68359fbeb tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:21.437609 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56dcaddf-268f-48f6-a5e2-b8c68359fbeb tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:21.438482 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56dcaddf-268f-48f6-a5e2-b8c68359fbeb tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:21.614116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-56dcaddf-268f-48f6-a5e2-b8c68359fbeb tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:21.623706 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-56dcaddf-268f-48f6-a5e2-b8c68359fbeb tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1569 microversion: 2.1 time: 0.204349 Jul 25 15:08:21.624614 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3177/6575] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:21 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:08:22.651294 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3a02d272-c81b-4377-951b-5e61467515ef tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:22.652241 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3a02d272-c81b-4377-951b-5e61467515ef tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:22.661847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a02d272-c81b-4377-951b-5e61467515ef tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:22.662403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a02d272-c81b-4377-951b-5e61467515ef tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:22.663363 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a02d272-c81b-4377-951b-5e61467515ef tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:22.663934 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a02d272-c81b-4377-951b-5e61467515ef tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:22.844448 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3a02d272-c81b-4377-951b-5e61467515ef tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:22.853738 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3a02d272-c81b-4377-951b-5e61467515ef tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1569 microversion: 2.1 time: 0.211097 Jul 25 15:08:22.855024 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3399/6576] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:22 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1569 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:08:23.747585 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-f0000d7b-ea1d-4e9a-b008-b4182bb68314 req-fb0d93a2-44ff-4df3-9780-6ad018f4006f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a649918a-668f-4ebb-8dff-e8106bde600d", "name": "network-vif-deleted", "tag": "f2d639fd-a38a-4e1e-b3fb-3be84e21b381"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:08:23.774101 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f0000d7b-ea1d-4e9a-b008-b4182bb68314 req-fb0d93a2-44ff-4df3-9780-6ad018f4006f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:23.774581 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f0000d7b-ea1d-4e9a-b008-b4182bb68314 req-fb0d93a2-44ff-4df3-9780-6ad018f4006f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:23.799588 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-f0000d7b-ea1d-4e9a-b008-b4182bb68314 req-fb0d93a2-44ff-4df3-9780-6ad018f4006f service nova] Creating event network-vif-deleted:f2d639fd-a38a-4e1e-b3fb-3be84e21b381 for instance a649918a-668f-4ebb-8dff-e8106bde600d on n-h2-846435-14 Jul 25 15:08:23.810599 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-f0000d7b-ea1d-4e9a-b008-b4182bb68314 req-fb0d93a2-44ff-4df3-9780-6ad018f4006f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067664 Jul 25 15:08:23.817396 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3178/6577] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:08:23.879465 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6a43279f-37d1-4a99-94c5-5095fd062b43 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:23.880285 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6a43279f-37d1-4a99-94c5-5095fd062b43 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:23.898064 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6a43279f-37d1-4a99-94c5-5095fd062b43 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:23.898948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6a43279f-37d1-4a99-94c5-5095fd062b43 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:23.900027 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6a43279f-37d1-4a99-94c5-5095fd062b43 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:23.900717 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6a43279f-37d1-4a99-94c5-5095fd062b43 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:24.010332 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6a43279f-37d1-4a99-94c5-5095fd062b43 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:24.021723 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6a43279f-37d1-4a99-94c5-5095fd062b43 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1361 microversion: 2.1 time: 0.148552 Jul 25 15:08:24.032031 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3400/6578] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:23 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:08:25.044013 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-117419b1-e4f2-48d5-bb4a-1d73e9a4ded4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:25.044841 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-117419b1-e4f2-48d5-bb4a-1d73e9a4ded4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:25.052887 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-117419b1-e4f2-48d5-bb4a-1d73e9a4ded4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:25.053435 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-117419b1-e4f2-48d5-bb4a-1d73e9a4ded4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:25.054286 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-117419b1-e4f2-48d5-bb4a-1d73e9a4ded4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:25.054808 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-117419b1-e4f2-48d5-bb4a-1d73e9a4ded4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:25.128185 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-117419b1-e4f2-48d5-bb4a-1d73e9a4ded4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:25.138891 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-117419b1-e4f2-48d5-bb4a-1d73e9a4ded4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1361 microversion: 2.1 time: 0.099069 Jul 25 15:08:25.139716 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3179/6579] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:25 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1361 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:08:26.160431 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-37eb4ee2-0771-47d7-97fd-66c7e28bbeae tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:26.161786 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-37eb4ee2-0771-47d7-97fd-66c7e28bbeae tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:26.169501 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37eb4ee2-0771-47d7-97fd-66c7e28bbeae tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:26.170190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37eb4ee2-0771-47d7-97fd-66c7e28bbeae tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:26.171185 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37eb4ee2-0771-47d7-97fd-66c7e28bbeae tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:26.171796 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37eb4ee2-0771-47d7-97fd-66c7e28bbeae tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:26.252731 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-37eb4ee2-0771-47d7-97fd-66c7e28bbeae tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:26.261741 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-37eb4ee2-0771-47d7-97fd-66c7e28bbeae tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1361 microversion: 2.1 time: 0.105299 Jul 25 15:08:26.262892 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3401/6580] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:26 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1361 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:08:27.294429 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bcb22fa7-754e-4ce1-b166-15a5480ac922 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:27.295134 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bcb22fa7-754e-4ce1-b166-15a5480ac922 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:27.302848 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bcb22fa7-754e-4ce1-b166-15a5480ac922 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:27.303413 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bcb22fa7-754e-4ce1-b166-15a5480ac922 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:27.304290 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bcb22fa7-754e-4ce1-b166-15a5480ac922 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:27.304802 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bcb22fa7-754e-4ce1-b166-15a5480ac922 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:27.386036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bcb22fa7-754e-4ce1-b166-15a5480ac922 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:27.398327 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bcb22fa7-754e-4ce1-b166-15a5480ac922 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1361 microversion: 2.1 time: 0.110762 Jul 25 15:08:27.399588 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3180/6581] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:27 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1361 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:08:28.421154 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-72bb2530-ff0d-4c39-a194-39274f3f4029 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:28.421705 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-72bb2530-ff0d-4c39-a194-39274f3f4029 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:28.434129 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72bb2530-ff0d-4c39-a194-39274f3f4029 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:28.434598 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72bb2530-ff0d-4c39-a194-39274f3f4029 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:28.435406 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72bb2530-ff0d-4c39-a194-39274f3f4029 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:28.435921 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72bb2530-ff0d-4c39-a194-39274f3f4029 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:28.570908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-72bb2530-ff0d-4c39-a194-39274f3f4029 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:28.585876 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-72bb2530-ff0d-4c39-a194-39274f3f4029 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 200 len: 1361 microversion: 2.1 time: 0.169235 Jul 25 15:08:28.586464 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3402/6582] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:28 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:08:29.609493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-860756b8-91a3-4da2-addd-fec2fb55328a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:29.611206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-860756b8-91a3-4da2-addd-fec2fb55328a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:29.624865 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-860756b8-91a3-4da2-addd-fec2fb55328a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:29.625839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-860756b8-91a3-4da2-addd-fec2fb55328a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:29.627082 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-860756b8-91a3-4da2-addd-fec2fb55328a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:29.630126 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-860756b8-91a3-4da2-addd-fec2fb55328a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:29.654683 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-860756b8-91a3-4da2-addd-fec2fb55328a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] HTTP exception thrown: Instance a649918a-668f-4ebb-8dff-e8106bde600d could not be found. Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-860756b8-91a3-4da2-addd-fec2fb55328a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Request method failure captured: Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d HTTP/1.1 Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rDtvHLNADQM-uJ_J3klWg0FTy_E0qH1hvwasDYrxKDHzDvpYuxQ-thmFamK-Qma_d-RBIPBhjFabpJL3iCa_0TXRcnv8VILXYJZ82EcknBbgye7z_bTamQlAxPZ4RYdd06oyEONGUiMQFVcfd19pQtHuauUAFexddlrbqczpvEqs-4 Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 450a632353eb4912a87bd5efc3bf2907 Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/450a632353eb4912a87bd5efc3bf2907"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/450a632353eb4912a87bd5efc3bf2907"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_450a632353eb4912a87bd5efc3bf2907", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/450a632353eb4912a87bd5efc3bf2907"}]}] Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 450a632353eb4912a87bd5efc3bf2907 Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-TestVolumeBootPattern-1790932632-project Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: e4eae2927eb943e9ab2bb78b6b555404 Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-TestVolumeBootPattern-1790932632-project Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance a649918a-668f-4ebb-8dff-e8106bde600d could not be found. Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'a649918a-668f-4ebb-8dff-e8106bde600d'} Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a649918a-668f-4ebb-8dff-e8106bde600d could not be found. Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a649918a-668f-4ebb-8dff-e8106bde600d could not be found. Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:08:29.656493 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:08:29.661726 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:08:29.661726 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:08:29.661726 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:08:29.661726 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:08:29.661726 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:08:29.661726 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a649918a-668f-4ebb-8dff-e8106bde600d could not be found. Jul 25 15:08:29.661726 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:08:29.661726 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-860756b8-91a3-4da2-addd-fec2fb55328a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Returning 404 to user: Instance a649918a-668f-4ebb-8dff-e8106bde600d could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:08:29.661726 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-860756b8-91a3-4da2-addd-fec2fb55328a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 404 len: 111 microversion: 2.1 time: 0.054659 Jul 25 15:08:29.674206 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3181/6583] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:29 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:08:35.165542 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6fdc0532-a8ab-477f-ab6d-9e86edb4fdc0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:35.166063 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6fdc0532-a8ab-477f-ab6d-9e86edb4fdc0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:35.174422 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6fdc0532-a8ab-477f-ab6d-9e86edb4fdc0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:35.174899 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6fdc0532-a8ab-477f-ab6d-9e86edb4fdc0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:35.176175 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6fdc0532-a8ab-477f-ab6d-9e86edb4fdc0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:35.176822 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6fdc0532-a8ab-477f-ab6d-9e86edb4fdc0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:35.204742 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6fdc0532-a8ab-477f-ab6d-9e86edb4fdc0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:08:35.352569 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6fdc0532-a8ab-477f-ab6d-9e86edb4fdc0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "DELETE /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f" status: 204 len: 0 microversion: 2.1 time: 0.192440 Jul 25 15:08:35.353542 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3403/6584] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:08:35 2022] DELETE /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:08:35.363809 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d461e2a1-570f-405e-98aa-0e1e6b0a54e1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:35.364572 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d461e2a1-570f-405e-98aa-0e1e6b0a54e1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:35.372995 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d461e2a1-570f-405e-98aa-0e1e6b0a54e1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:35.373495 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d461e2a1-570f-405e-98aa-0e1e6b0a54e1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:35.374273 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d461e2a1-570f-405e-98aa-0e1e6b0a54e1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:35.374753 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d461e2a1-570f-405e-98aa-0e1e6b0a54e1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:35.535748 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d461e2a1-570f-405e-98aa-0e1e6b0a54e1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:35.553649 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d461e2a1-570f-405e-98aa-0e1e6b0a54e1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f" status: 200 len: 1408 microversion: 2.1 time: 0.194260 Jul 25 15:08:35.554655 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3182/6585] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:35 2022] GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f => generated 1408 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:08:36.577411 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3c3bbe8a-a565-4e65-8cf9-99615f4c8cfd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:36.578109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3c3bbe8a-a565-4e65-8cf9-99615f4c8cfd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:36.586106 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c3bbe8a-a565-4e65-8cf9-99615f4c8cfd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:36.586655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c3bbe8a-a565-4e65-8cf9-99615f4c8cfd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:36.587500 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c3bbe8a-a565-4e65-8cf9-99615f4c8cfd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:36.588182 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c3bbe8a-a565-4e65-8cf9-99615f4c8cfd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:36.824493 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3c3bbe8a-a565-4e65-8cf9-99615f4c8cfd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:36.837076 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3c3bbe8a-a565-4e65-8cf9-99615f4c8cfd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f" status: 200 len: 1408 microversion: 2.1 time: 0.264396 Jul 25 15:08:36.838399 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3404/6586] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:36 2022] GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f => generated 1408 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:08:37.654459 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-702f00f7-d4d3-4a1e-8f6d-6f0eb400b895 req-abf1902f-a75c-465a-8419-5c1b262da975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7262f7d8-0fc3-4997-acf7-159a2f90cd5f", "name": "network-vif-deleted", "tag": "9a12c92b-c6f0-402c-ba8c-57116d7acfe1"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:08:37.670728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-702f00f7-d4d3-4a1e-8f6d-6f0eb400b895 req-abf1902f-a75c-465a-8419-5c1b262da975 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:37.672018 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-702f00f7-d4d3-4a1e-8f6d-6f0eb400b895 req-abf1902f-a75c-465a-8419-5c1b262da975 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:37.702608 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-702f00f7-d4d3-4a1e-8f6d-6f0eb400b895 req-abf1902f-a75c-465a-8419-5c1b262da975 service nova] Creating event network-vif-deleted:9a12c92b-c6f0-402c-ba8c-57116d7acfe1 for instance 7262f7d8-0fc3-4997-acf7-159a2f90cd5f on n-h1-846435-14 Jul 25 15:08:37.711524 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-702f00f7-d4d3-4a1e-8f6d-6f0eb400b895 req-abf1902f-a75c-465a-8419-5c1b262da975 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060150 Jul 25 15:08:37.712827 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3183/6587] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:08:37.863486 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7b7da448-5a95-4529-91d8-88b9f399ad6e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:37.864428 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7b7da448-5a95-4529-91d8-88b9f399ad6e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:37.886379 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7b7da448-5a95-4529-91d8-88b9f399ad6e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:37.887164 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7b7da448-5a95-4529-91d8-88b9f399ad6e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:37.892536 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7b7da448-5a95-4529-91d8-88b9f399ad6e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:37.894661 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7b7da448-5a95-4529-91d8-88b9f399ad6e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:38.091699 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7b7da448-5a95-4529-91d8-88b9f399ad6e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:38.121220 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7b7da448-5a95-4529-91d8-88b9f399ad6e tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f" status: 200 len: 1200 microversion: 2.1 time: 0.265922 Jul 25 15:08:38.122991 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3405/6588] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:37 2022] GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f => generated 1200 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:08:39.144554 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8d1a5397-f501-479b-bf0f-a85b558e6180 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:39.145360 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8d1a5397-f501-479b-bf0f-a85b558e6180 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:39.152041 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8d1a5397-f501-479b-bf0f-a85b558e6180 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:39.152745 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8d1a5397-f501-479b-bf0f-a85b558e6180 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:39.153533 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8d1a5397-f501-479b-bf0f-a85b558e6180 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:39.153976 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8d1a5397-f501-479b-bf0f-a85b558e6180 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:39.237928 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8d1a5397-f501-479b-bf0f-a85b558e6180 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:39.248681 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8d1a5397-f501-479b-bf0f-a85b558e6180 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f" status: 200 len: 1200 microversion: 2.1 time: 0.109017 Jul 25 15:08:39.249694 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3184/6589] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:39 2022] GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f => generated 1200 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:08:40.271087 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8a2aca7f-e4cb-4826-a128-9000fc19fabc tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:40.272351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8a2aca7f-e4cb-4826-a128-9000fc19fabc tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:40.280174 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8a2aca7f-e4cb-4826-a128-9000fc19fabc tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:40.280907 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8a2aca7f-e4cb-4826-a128-9000fc19fabc tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:40.281878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8a2aca7f-e4cb-4826-a128-9000fc19fabc tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:40.282482 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8a2aca7f-e4cb-4826-a128-9000fc19fabc tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:40.394417 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8a2aca7f-e4cb-4826-a128-9000fc19fabc tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:40.419624 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8a2aca7f-e4cb-4826-a128-9000fc19fabc tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f" status: 200 len: 1200 microversion: 2.1 time: 0.152452 Jul 25 15:08:40.421445 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3406/6590] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:40 2022] GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f => generated 1200 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:08:41.444769 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2d26e9ea-bad8-4a27-836a-750a8ee85c69 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:41.445393 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2d26e9ea-bad8-4a27-836a-750a8ee85c69 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:41.455080 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2d26e9ea-bad8-4a27-836a-750a8ee85c69 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:41.455726 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2d26e9ea-bad8-4a27-836a-750a8ee85c69 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:41.457288 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2d26e9ea-bad8-4a27-836a-750a8ee85c69 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:41.457897 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2d26e9ea-bad8-4a27-836a-750a8ee85c69 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:41.553658 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2d26e9ea-bad8-4a27-836a-750a8ee85c69 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:41.564759 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2d26e9ea-bad8-4a27-836a-750a8ee85c69 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f" status: 200 len: 1200 microversion: 2.1 time: 0.124556 Jul 25 15:08:41.566388 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3185/6591] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:41 2022] GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f => generated 1200 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:08:42.586622 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d0e73865-18aa-4e43-bbef-96f416792b43 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:42.588956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d0e73865-18aa-4e43-bbef-96f416792b43 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:42.599551 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d0e73865-18aa-4e43-bbef-96f416792b43 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:42.600704 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d0e73865-18aa-4e43-bbef-96f416792b43 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:42.603888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d0e73865-18aa-4e43-bbef-96f416792b43 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:42.605691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d0e73865-18aa-4e43-bbef-96f416792b43 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:42.694082 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d0e73865-18aa-4e43-bbef-96f416792b43 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:42.704473 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d0e73865-18aa-4e43-bbef-96f416792b43 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f" status: 200 len: 1200 microversion: 2.1 time: 0.123101 Jul 25 15:08:42.718516 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3407/6592] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:42 2022] GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f => generated 1200 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:08:43.729608 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a8d41f86-7324-4738-a890-3f51729e510a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:43.731422 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a8d41f86-7324-4738-a890-3f51729e510a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:43.746407 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a8d41f86-7324-4738-a890-3f51729e510a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:43.747259 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a8d41f86-7324-4738-a890-3f51729e510a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:43.749315 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a8d41f86-7324-4738-a890-3f51729e510a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:43.750174 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a8d41f86-7324-4738-a890-3f51729e510a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:43.825354 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a8d41f86-7324-4738-a890-3f51729e510a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:43.827467 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a8d41f86-7324-4738-a890-3f51729e510a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:43.828858 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-a8d41f86-7324-4738-a890-3f51729e510a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lazy-loading 'fault' on Instance uuid 7262f7d8-0fc3-4997-acf7-159a2f90cd5f {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:08:43.907129 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a8d41f86-7324-4738-a890-3f51729e510a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:08:43.915787 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a8d41f86-7324-4738-a890-3f51729e510a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f" status: 200 len: 1205 microversion: 2.1 time: 0.192750 Jul 25 15:08:43.933282 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3186/6593] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:43 2022] GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f => generated 1205 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:08:44.956464 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3d360a04-0c57-439f-a04d-3ab2d0f9e568 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:44.957490 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3d360a04-0c57-439f-a04d-3ab2d0f9e568 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:44.968924 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3d360a04-0c57-439f-a04d-3ab2d0f9e568 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:44.969494 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3d360a04-0c57-439f-a04d-3ab2d0f9e568 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:44.970412 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3d360a04-0c57-439f-a04d-3ab2d0f9e568 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:44.971296 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3d360a04-0c57-439f-a04d-3ab2d0f9e568 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:45.010407 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-3d360a04-0c57-439f-a04d-3ab2d0f9e568 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] HTTP exception thrown: Instance 7262f7d8-0fc3-4997-acf7-159a2f90cd5f could not be found. Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3d360a04-0c57-439f-a04d-3ab2d0f9e568 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Request method failure captured: Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f HTTP/1.1 Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3rDtvHLNADQM-uJ_J3klWg0FTy_E0qH1hvwasDYrxKDHzDvpYuxQ-thmFamK-Qma_d-RBIPBhjFabpJL3iCa_0TXRcnv8VILXYJZ82EcknBbgye7z_bTamQlAxPZ4RYdd06oyEONGUiMQFVcfd19pQtHuauUAFexddlrbqczpvEqs-4 Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 450a632353eb4912a87bd5efc3bf2907 Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/450a632353eb4912a87bd5efc3bf2907"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/450a632353eb4912a87bd5efc3bf2907"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_450a632353eb4912a87bd5efc3bf2907", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/450a632353eb4912a87bd5efc3bf2907"}]}] Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 450a632353eb4912a87bd5efc3bf2907 Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-TestVolumeBootPattern-1790932632-project Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: e4eae2927eb943e9ab2bb78b6b555404 Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-TestVolumeBootPattern-1790932632-project Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 7262f7d8-0fc3-4997-acf7-159a2f90cd5f could not be found. Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '7262f7d8-0fc3-4997-acf7-159a2f90cd5f'} Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7262f7d8-0fc3-4997-acf7-159a2f90cd5f could not be found. Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7262f7d8-0fc3-4997-acf7-159a2f90cd5f could not be found. Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:08:45.014271 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:08:45.019284 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:08:45.019284 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:08:45.019284 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:08:45.019284 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:08:45.019284 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:08:45.019284 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7262f7d8-0fc3-4997-acf7-159a2f90cd5f could not be found. Jul 25 15:08:45.019284 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:08:45.021995 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3d360a04-0c57-439f-a04d-3ab2d0f9e568 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Returning 404 to user: Instance 7262f7d8-0fc3-4997-acf7-159a2f90cd5f could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:08:45.023785 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3d360a04-0c57-439f-a04d-3ab2d0f9e568 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f" status: 404 len: 111 microversion: 2.1 time: 0.071667 Jul 25 15:08:45.029613 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3408/6594] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:44 2022] GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:08:48.930331 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bbebf6e7-107b-4538-a13c-09caca057a35 tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-106280434", "availability_zone": "foo_zone"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:08:48.933984 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 15:08:48.933984 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 15:08:48.935165 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.aggregate [None req-bbebf6e7-107b-4538-a13c-09caca057a35 tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] Generated uuid 64ebb2d2-cbad-46ed-9b0a-4ad066300781 for aggregate {{(pid=119303) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 15:08:48.937347 n-d-846435-14 devstack@n-api.service[119303]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bbebf6e7-107b-4538-a13c-09caca057a35 tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] [2c2acd86-cda7-44eb-a5d9-ff251265bcd2] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 15:08:49.950507 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [None req-bbebf6e7-107b-4538-a13c-09caca057a35 tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] [2c2acd86-cda7-44eb-a5d9-ff251265bcd2] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 44894. Jul 25 15:08:49.965939 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=26 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:08:50.019949 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bbebf6e7-107b-4538-a13c-09caca057a35 tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 1.272145 Jul 25 15:08:50.021006 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3187/6595] 10.222.0.88 () {60 vars in 1164 bytes} [Mon Jul 25 15:08:48 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:08:50.039759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9d29a539-fdf3-4460-9702-6d9923d79e09 tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:08:50.052571 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 15:08:50.052571 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 15:08:50.096324 n-d-846435-14 devstack@n-api.service[119304]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9d29a539-fdf3-4460-9702-6d9923d79e09 tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] [5d85163f-80e6-4395-b352-227aabfe882f] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 15:08:50.578090 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9f58a0e8-1d00-4580-a121-a24ff9fcc447 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:50.578853 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9f58a0e8-1d00-4580-a121-a24ff9fcc447 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:50.589331 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f58a0e8-1d00-4580-a121-a24ff9fcc447 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:50.590317 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f58a0e8-1d00-4580-a121-a24ff9fcc447 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:50.592131 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f58a0e8-1d00-4580-a121-a24ff9fcc447 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:50.592833 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9f58a0e8-1d00-4580-a121-a24ff9fcc447 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:50.600345 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=64 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:08:50.614475 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-9f58a0e8-1d00-4580-a121-a24ff9fcc447 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] HTTP exception thrown: Instance a649918a-668f-4ebb-8dff-e8106bde600d could not be found. Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9f58a0e8-1d00-4580-a121-a24ff9fcc447 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Request method failure captured: Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d HTTP/1.1 Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rDtvHLNADQM-uJ_J3klWg0FTy_E0qH1hvwasDYrxKDHzDvpYuxQ-thmFamK-Qma_d-RBIPBhjFabpJL3iCa_0TXRcnv8VILXYJZ82EcknBbgye7z_bTamQlAxPZ4RYdd06oyEONGUiMQFVcfd19pQtHuauUAFexddlrbqczpvEqs-4 Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 450a632353eb4912a87bd5efc3bf2907 Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/450a632353eb4912a87bd5efc3bf2907"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/450a632353eb4912a87bd5efc3bf2907"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_450a632353eb4912a87bd5efc3bf2907", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/450a632353eb4912a87bd5efc3bf2907"}]}] Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 450a632353eb4912a87bd5efc3bf2907 Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-TestVolumeBootPattern-1790932632-project Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: e4eae2927eb943e9ab2bb78b6b555404 Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-TestVolumeBootPattern-1790932632-project Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance a649918a-668f-4ebb-8dff-e8106bde600d could not be found. Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'a649918a-668f-4ebb-8dff-e8106bde600d'} Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a649918a-668f-4ebb-8dff-e8106bde600d could not be found. Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:08:50.616851 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:08:50.621410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a649918a-668f-4ebb-8dff-e8106bde600d could not be found. Jul 25 15:08:50.621410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:08:50.621410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:08:50.621410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:08:50.621410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:08:50.621410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:08:50.621410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:08:50.621410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:08:50.621410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:08:50.621410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a649918a-668f-4ebb-8dff-e8106bde600d could not be found. Jul 25 15:08:50.621410 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:08:50.621410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9f58a0e8-1d00-4580-a121-a24ff9fcc447 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Returning 404 to user: Instance a649918a-668f-4ebb-8dff-e8106bde600d could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:08:50.621410 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9f58a0e8-1d00-4580-a121-a24ff9fcc447 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 404 len: 111 microversion: 2.1 time: 0.049830 Jul 25 15:08:50.621410 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3188/6596] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:08:50 2022] DELETE /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:08:50.630308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b492cae0-9fa2-44f8-a5d2-153c35ae3cd4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:50.631939 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b492cae0-9fa2-44f8-a5d2-153c35ae3cd4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: a649918a-668f-4ebb-8dff-e8106bde600d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:50.642932 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b492cae0-9fa2-44f8-a5d2-153c35ae3cd4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:50.644020 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b492cae0-9fa2-44f8-a5d2-153c35ae3cd4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:50.645324 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b492cae0-9fa2-44f8-a5d2-153c35ae3cd4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:50.646121 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b492cae0-9fa2-44f8-a5d2-153c35ae3cd4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:50.667013 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-b492cae0-9fa2-44f8-a5d2-153c35ae3cd4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] HTTP exception thrown: Instance a649918a-668f-4ebb-8dff-e8106bde600d could not be found. Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b492cae0-9fa2-44f8-a5d2-153c35ae3cd4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Request method failure captured: Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d HTTP/1.1 Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rDtvHLNADQM-uJ_J3klWg0FTy_E0qH1hvwasDYrxKDHzDvpYuxQ-thmFamK-Qma_d-RBIPBhjFabpJL3iCa_0TXRcnv8VILXYJZ82EcknBbgye7z_bTamQlAxPZ4RYdd06oyEONGUiMQFVcfd19pQtHuauUAFexddlrbqczpvEqs-4 Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 450a632353eb4912a87bd5efc3bf2907 Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/450a632353eb4912a87bd5efc3bf2907"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/450a632353eb4912a87bd5efc3bf2907"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_450a632353eb4912a87bd5efc3bf2907", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/450a632353eb4912a87bd5efc3bf2907"}]}] Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 450a632353eb4912a87bd5efc3bf2907 Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-TestVolumeBootPattern-1790932632-project Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: e4eae2927eb943e9ab2bb78b6b555404 Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-TestVolumeBootPattern-1790932632-project Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance a649918a-668f-4ebb-8dff-e8106bde600d could not be found. Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'a649918a-668f-4ebb-8dff-e8106bde600d'} Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a649918a-668f-4ebb-8dff-e8106bde600d could not be found. Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a649918a-668f-4ebb-8dff-e8106bde600d could not be found. Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:08:50.668962 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:08:50.673765 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:08:50.673765 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:08:50.673765 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:08:50.673765 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:08:50.673765 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:08:50.673765 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a649918a-668f-4ebb-8dff-e8106bde600d could not be found. Jul 25 15:08:50.673765 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:08:50.673765 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b492cae0-9fa2-44f8-a5d2-153c35ae3cd4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Returning 404 to user: Instance a649918a-668f-4ebb-8dff-e8106bde600d could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:08:50.673765 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b492cae0-9fa2-44f8-a5d2-153c35ae3cd4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d" status: 404 len: 111 microversion: 2.1 time: 0.047594 Jul 25 15:08:50.673765 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3189/6597] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:50 2022] GET /compute/v2.1/servers/a649918a-668f-4ebb-8dff-e8106bde600d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:08:51.106750 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [None req-9d29a539-fdf3-4460-9702-6d9923d79e09 tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] [5d85163f-80e6-4395-b352-227aabfe882f] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 44934. Jul 25 15:08:51.111755 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9d29a539-fdf3-4460-9702-6d9923d79e09 tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 1.078721 Jul 25 15:08:51.114585 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3409/6598] 10.222.0.88 () {60 vars in 1194 bytes} [Mon Jul 25 15:08:50 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:08:51.126558 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b4f5debf-6d68-4522-a0f4-79d407034981 tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:51.130137 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 15:08:51.130137 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 15:08:51.131474 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b4f5debf-6d68-4522-a0f4-79d407034981 tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:51.132147 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b4f5debf-6d68-4522-a0f4-79d407034981 tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:51.133236 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b4f5debf-6d68-4522-a0f4-79d407034981 tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:51.133622 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b4f5debf-6d68-4522-a0f4-79d407034981 tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:51.163450 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b4f5debf-6d68-4522-a0f4-79d407034981 tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] 10.222.0.88 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.040658 Jul 25 15:08:51.164590 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3190/6599] 10.222.0.88 () {58 vars in 1176 bytes} [Mon Jul 25 15:08:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:08:51.176416 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-122fc17a-fe87-490c-99c5-fb7f3911b506 tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:51.177222 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 15:08:51.177222 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 15:08:51.179250 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:08:51.187239 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-122fc17a-fe87-490c-99c5-fb7f3911b506 tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] 10.222.0.88 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.015264 Jul 25 15:08:51.192629 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3410/6600] 10.222.0.88 () {58 vars in 1143 bytes} [Mon Jul 25 15:08:51 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:08:51.200051 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9ab99ea4-98b5-4aec-9e27-ebfb25827dbf tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-846435-14"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:08:51.202658 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 15:08:51.202658 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 15:08:51.213690 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9ab99ea4-98b5-4aec-9e27-ebfb25827dbf tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:51.213690 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9ab99ea4-98b5-4aec-9e27-ebfb25827dbf tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:51.365039 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6ddf236e-585c-4bc6-b25a-6c9999a4d263 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:51.365684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6ddf236e-585c-4bc6-b25a-6c9999a4d263 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:51.373363 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6ddf236e-585c-4bc6-b25a-6c9999a4d263 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:51.375217 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6ddf236e-585c-4bc6-b25a-6c9999a4d263 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:51.376150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6ddf236e-585c-4bc6-b25a-6c9999a4d263 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:51.376802 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6ddf236e-585c-4bc6-b25a-6c9999a4d263 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:51.382731 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:08:51.401728 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-6ddf236e-585c-4bc6-b25a-6c9999a4d263 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] HTTP exception thrown: Instance 7262f7d8-0fc3-4997-acf7-159a2f90cd5f could not be found. Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6ddf236e-585c-4bc6-b25a-6c9999a4d263 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Request method failure captured: Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f HTTP/1.1 Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3rDtvHLNADQM-uJ_J3klWg0FTy_E0qH1hvwasDYrxKDHzDvpYuxQ-thmFamK-Qma_d-RBIPBhjFabpJL3iCa_0TXRcnv8VILXYJZ82EcknBbgye7z_bTamQlAxPZ4RYdd06oyEONGUiMQFVcfd19pQtHuauUAFexddlrbqczpvEqs-4 Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 450a632353eb4912a87bd5efc3bf2907 Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/450a632353eb4912a87bd5efc3bf2907"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/450a632353eb4912a87bd5efc3bf2907"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_450a632353eb4912a87bd5efc3bf2907", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/450a632353eb4912a87bd5efc3bf2907"}]}] Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 450a632353eb4912a87bd5efc3bf2907 Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-TestVolumeBootPattern-1790932632-project Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: e4eae2927eb943e9ab2bb78b6b555404 Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-TestVolumeBootPattern-1790932632-project Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 7262f7d8-0fc3-4997-acf7-159a2f90cd5f could not be found. Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '7262f7d8-0fc3-4997-acf7-159a2f90cd5f'} Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7262f7d8-0fc3-4997-acf7-159a2f90cd5f could not be found. Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:08:51.403372 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:08:51.411945 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7262f7d8-0fc3-4997-acf7-159a2f90cd5f could not be found. Jul 25 15:08:51.411945 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:08:51.411945 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:08:51.411945 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:08:51.411945 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:08:51.411945 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:08:51.411945 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:08:51.411945 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:08:51.411945 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:08:51.411945 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7262f7d8-0fc3-4997-acf7-159a2f90cd5f could not be found. Jul 25 15:08:51.411945 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:08:51.411945 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6ddf236e-585c-4bc6-b25a-6c9999a4d263 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Returning 404 to user: Instance 7262f7d8-0fc3-4997-acf7-159a2f90cd5f could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:08:51.411945 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6ddf236e-585c-4bc6-b25a-6c9999a4d263 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "DELETE /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f" status: 404 len: 111 microversion: 2.1 time: 0.044455 Jul 25 15:08:51.411945 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3411/6601] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:08:51 2022] DELETE /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:08:51.417068 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-01b61434-7945-47d4-8275-40d45f82e54a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:51.417709 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-01b61434-7945-47d4-8275-40d45f82e54a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 7262f7d8-0fc3-4997-acf7-159a2f90cd5f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:08:51.426065 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01b61434-7945-47d4-8275-40d45f82e54a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:51.426851 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01b61434-7945-47d4-8275-40d45f82e54a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:51.427792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01b61434-7945-47d4-8275-40d45f82e54a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:51.428498 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01b61434-7945-47d4-8275-40d45f82e54a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:51.448339 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-01b61434-7945-47d4-8275-40d45f82e54a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] HTTP exception thrown: Instance 7262f7d8-0fc3-4997-acf7-159a2f90cd5f could not be found. Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-01b61434-7945-47d4-8275-40d45f82e54a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Request method failure captured: Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f HTTP/1.1 Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3rDtvHLNADQM-uJ_J3klWg0FTy_E0qH1hvwasDYrxKDHzDvpYuxQ-thmFamK-Qma_d-RBIPBhjFabpJL3iCa_0TXRcnv8VILXYJZ82EcknBbgye7z_bTamQlAxPZ4RYdd06oyEONGUiMQFVcfd19pQtHuauUAFexddlrbqczpvEqs-4 Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 450a632353eb4912a87bd5efc3bf2907 Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/450a632353eb4912a87bd5efc3bf2907"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/450a632353eb4912a87bd5efc3bf2907"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_450a632353eb4912a87bd5efc3bf2907", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/450a632353eb4912a87bd5efc3bf2907"}]}] Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 450a632353eb4912a87bd5efc3bf2907 Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-TestVolumeBootPattern-1790932632-project Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: e4eae2927eb943e9ab2bb78b6b555404 Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-TestVolumeBootPattern-1790932632-project Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 7262f7d8-0fc3-4997-acf7-159a2f90cd5f could not be found. Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '7262f7d8-0fc3-4997-acf7-159a2f90cd5f'} Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7262f7d8-0fc3-4997-acf7-159a2f90cd5f could not be found. Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7262f7d8-0fc3-4997-acf7-159a2f90cd5f could not be found. Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:08:51.449972 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:08:51.454804 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:08:51.454804 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:08:51.454804 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:08:51.454804 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:08:51.454804 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:08:51.454804 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7262f7d8-0fc3-4997-acf7-159a2f90cd5f could not be found. Jul 25 15:08:51.454804 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:08:51.456293 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-01b61434-7945-47d4-8275-40d45f82e54a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Returning 404 to user: Instance 7262f7d8-0fc3-4997-acf7-159a2f90cd5f could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:08:51.461143 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-01b61434-7945-47d4-8275-40d45f82e54a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f" status: 404 len: 111 microversion: 2.1 time: 0.049994 Jul 25 15:08:51.461462 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9ab99ea4-98b5-4aec-9e27-ebfb25827dbf tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.265394 Jul 25 15:08:51.461887 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3412/6602] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:08:51 2022] GET /compute/v2.1/servers/7262f7d8-0fc3-4997-acf7-159a2f90cd5f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:08:51.462076 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3191/6603] 10.222.0.88 () {60 vars in 1194 bytes} [Mon Jul 25 15:08:51 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:08:51.476557 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cd903909-9071-4b92-ba39-1659182f6e79 tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:51.478262 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 15:08:51.478262 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 15:08:51.492195 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cd903909-9071-4b92-ba39-1659182f6e79 tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] 10.222.0.88 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.020507 Jul 25 15:08:51.493333 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3413/6604] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jul 25 15:08:51 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:08:51.507771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2d5594d9-6c89-4592-adb7-447e3db85fe9 tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1245374369", "availability_zone": "foo_zone"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:08:51.514309 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 15:08:51.514309 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 15:08:51.564530 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4be898f9-a465-459c-8ef8-512c331adad3 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Action: 'create', calling method: .version_select at 0x7f4685f5f430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1785943681", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6mOfQ2MBSNBH4Efovsxs2sfpifa2hK9G9xU5Pg147d4jExv+Fq8tUtOVGVOlbMKPs0rU9pybenyShMjy2wFrZQRbikoBvPbDwnWtmWyRjnEx3leD41Ao7weQUDRne//w=="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:08:51.573010 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2d5594d9-6c89-4592-adb7-447e3db85fe9 tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] 10.222.0.88 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.069088 Jul 25 15:08:51.574123 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3192/6605] 10.222.0.88 () {60 vars in 1173 bytes} [Mon Jul 25 15:08:51 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:08:51.586906 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-764f6966-c94d-4092-a150-db55e88acb0f tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:08:51.587931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-4be898f9-a465-459c-8ef8-512c331adad3 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Getting quotas for project 450a632353eb4912a87bd5efc3bf2907. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:08:51.589560 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 15:08:51.589560 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 15:08:51.595298 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-4be898f9-a465-459c-8ef8-512c331adad3 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Getting quotas for user e4eae2927eb943e9ab2bb78b6b555404 and project 450a632353eb4912a87bd5efc3bf2907. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:08:51.618116 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-764f6966-c94d-4092-a150-db55e88acb0f tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.035053 Jul 25 15:08:51.619884 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3193/6606] 10.222.0.88 () {60 vars in 1194 bytes} [Mon Jul 25 15:08:51 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:08:51.628847 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4be898f9-a465-459c-8ef8-512c331adad3 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.073166 Jul 25 15:08:51.632058 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3414/6607] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 15:08:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:08:51.644217 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-da4c0e55-6686-4853-893f-de03f1cf79a8 tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:51.645485 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 15:08:51.645485 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 15:08:51.655153 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-da4c0e55-6686-4853-893f-de03f1cf79a8 tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] 10.222.0.88 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.028048 Jul 25 15:08:51.656069 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3194/6608] 10.222.0.88 () {58 vars in 1152 bytes} [Mon Jul 25 15:08:51 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:08:51.668337 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-11141418-2a2d-4c83-a780-93049c423662 tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-846435-14"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:08:51.671261 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 15:08:51.671261 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 15:08:51.680851 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11141418-2a2d-4c83-a780-93049c423662 tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:08:51.681379 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11141418-2a2d-4c83-a780-93049c423662 tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:08:51.949536 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-11141418-2a2d-4c83-a780-93049c423662 tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] 10.222.0.88 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.286091 Jul 25 15:08:51.950188 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3415/6609] 10.222.0.88 () {60 vars in 1194 bytes} [Mon Jul 25 15:08:51 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:08:51.962893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3a526f8b-d230-42cc-acd9-00da0ecdb4c1 tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:08:51.963727 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 15:08:51.963727 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 15:08:51.992547 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3a526f8b-d230-42cc-acd9-00da0ecdb4c1 tempest-TestAggregatesBasicOps-1730517102 tempest-TestAggregatesBasicOps-1730517102-project-admin] 10.222.0.88 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.033555 Jul 25 15:08:51.993331 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3195/6610] 10.222.0.88 () {58 vars in 1155 bytes} [Mon Jul 25 15:08:51 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 15:09:14.504005 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=4 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:09:14.504811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=7 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:09:14.505455 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:09:14.510378 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f572c008-8c00-43e5-baf4-90618a0acad4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-887620092", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1785943681", "security_groups": [{"name": "tempest-secgroup-smoke-576149646"}], "block_device_mapping_v2": [{"uuid": "ca728e74-2168-4586-b83e-6b2dc2a0d425", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c376c71f-de2b-4e80-ab75-8e710f8505df"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:09:14.639494 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-f572c008-8c00-43e5-baf4-90618a0acad4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] validate_networks() for [('c376c71f-de2b-4e80-ab75-8e710f8505df', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:09:15.172682 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f572c008-8c00-43e5-baf4-90618a0acad4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:09:15.173256 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f572c008-8c00-43e5-baf4-90618a0acad4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:09:15.174045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f572c008-8c00-43e5-baf4-90618a0acad4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:09:15.174710 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f572c008-8c00-43e5-baf4-90618a0acad4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:09:15.175251 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f572c008-8c00-43e5-baf4-90618a0acad4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:09:15.186483 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f572c008-8c00-43e5-baf4-90618a0acad4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:15.186975 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f572c008-8c00-43e5-baf4-90618a0acad4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:15.187751 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f572c008-8c00-43e5-baf4-90618a0acad4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:15.188249 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f572c008-8c00-43e5-baf4-90618a0acad4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:15.205373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-f572c008-8c00-43e5-baf4-90618a0acad4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Getting quotas for project 450a632353eb4912a87bd5efc3bf2907. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:09:15.211410 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-f572c008-8c00-43e5-baf4-90618a0acad4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Getting quotas for user e4eae2927eb943e9ab2bb78b6b555404 and project 450a632353eb4912a87bd5efc3bf2907. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:09:15.272904 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f572c008-8c00-43e5-baf4-90618a0acad4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:09:15.275052 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f572c008-8c00-43e5-baf4-90618a0acad4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ca728e74-2168-4586-b83e-6b2dc2a0d425',volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:09:15.423061 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f572c008-8c00-43e5-baf4-90618a0acad4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.921044 Jul 25 15:09:15.423633 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3416/6611] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:09:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:09:15.433399 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:09:15.434668 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=9 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:09:15.435969 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:09:15.441244 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0b885e6c-be7b-4db0-8ccf-11afa89078b8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:09:15.441929 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0b885e6c-be7b-4db0-8ccf-11afa89078b8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:09:15.507995 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0b885e6c-be7b-4db0-8ccf-11afa89078b8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:09:15.516128 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0b885e6c-be7b-4db0-8ccf-11afa89078b8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4" status: 200 len: 1094 microversion: 2.1 time: 0.084793 Jul 25 15:09:15.516740 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3196/6612] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:09:15 2022] GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 => generated 1094 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:09:16.541822 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6951aa85-8d25-45b6-b834-04ee60123e73 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:09:16.542779 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6951aa85-8d25-45b6-b834-04ee60123e73 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:09:16.550256 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6951aa85-8d25-45b6-b834-04ee60123e73 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:16.550756 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6951aa85-8d25-45b6-b834-04ee60123e73 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:16.551937 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6951aa85-8d25-45b6-b834-04ee60123e73 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:16.552441 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6951aa85-8d25-45b6-b834-04ee60123e73 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:16.645703 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6951aa85-8d25-45b6-b834-04ee60123e73 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:09:16.657298 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6951aa85-8d25-45b6-b834-04ee60123e73 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4" status: 200 len: 1192 microversion: 2.1 time: 0.123893 Jul 25 15:09:16.658592 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3417/6613] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:09:16 2022] GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 => generated 1192 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:09:17.691874 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-30952d02-e162-4d87-8548-5c6ef841c30d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:09:17.693275 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-30952d02-e162-4d87-8548-5c6ef841c30d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:09:17.701188 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-30952d02-e162-4d87-8548-5c6ef841c30d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:17.702363 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-30952d02-e162-4d87-8548-5c6ef841c30d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:17.703623 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-30952d02-e162-4d87-8548-5c6ef841c30d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:17.704311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-30952d02-e162-4d87-8548-5c6ef841c30d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:18.038365 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-30952d02-e162-4d87-8548-5c6ef841c30d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:09:18.048514 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-30952d02-e162-4d87-8548-5c6ef841c30d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4" status: 200 len: 1277 microversion: 2.1 time: 0.361015 Jul 25 15:09:18.050070 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3197/6614] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:09:17 2022] GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 => generated 1277 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:09:18.524630 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-aafcb182-ba12-475a-af06-ab35f5a326e6 req-fd155ede-3fdb-4977-acd7-a52e83234dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4", "tag": "07e25e24-2571-49bd-b1ec-c1da154a2bac"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:09:18.555681 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-aafcb182-ba12-475a-af06-ab35f5a326e6 req-fd155ede-3fdb-4977-acd7-a52e83234dc2 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:18.556770 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-aafcb182-ba12-475a-af06-ab35f5a326e6 req-fd155ede-3fdb-4977-acd7-a52e83234dc2 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:18.583228 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-aafcb182-ba12-475a-af06-ab35f5a326e6 req-fd155ede-3fdb-4977-acd7-a52e83234dc2 service nova] Creating event network-changed:07e25e24-2571-49bd-b1ec-c1da154a2bac for instance 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 on n-h1-846435-14 Jul 25 15:09:18.594836 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-aafcb182-ba12-475a-af06-ab35f5a326e6 req-fd155ede-3fdb-4977-acd7-a52e83234dc2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082198 Jul 25 15:09:18.599515 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3418/6615] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:09:19.078434 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c288ae8f-0569-449b-9781-530ce735b72b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:09:19.079048 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c288ae8f-0569-449b-9781-530ce735b72b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:09:19.089475 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c288ae8f-0569-449b-9781-530ce735b72b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:19.090360 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c288ae8f-0569-449b-9781-530ce735b72b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:19.091898 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c288ae8f-0569-449b-9781-530ce735b72b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:19.095686 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c288ae8f-0569-449b-9781-530ce735b72b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:19.354142 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c288ae8f-0569-449b-9781-530ce735b72b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:09:19.368321 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c288ae8f-0569-449b-9781-530ce735b72b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4" status: 200 len: 1277 microversion: 2.1 time: 0.293744 Jul 25 15:09:19.378440 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3198/6616] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:09:19 2022] GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 => generated 1277 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:09:20.392928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b11dda1a-b1cb-4331-bd4b-b9d2ae4f225b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:09:20.394113 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b11dda1a-b1cb-4331-bd4b-b9d2ae4f225b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:09:20.402935 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b11dda1a-b1cb-4331-bd4b-b9d2ae4f225b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:20.403583 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b11dda1a-b1cb-4331-bd4b-b9d2ae4f225b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:20.404481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b11dda1a-b1cb-4331-bd4b-b9d2ae4f225b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:20.404914 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b11dda1a-b1cb-4331-bd4b-b9d2ae4f225b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:20.554462 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b11dda1a-b1cb-4331-bd4b-b9d2ae4f225b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:09:20.562567 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b11dda1a-b1cb-4331-bd4b-b9d2ae4f225b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4" status: 200 len: 1277 microversion: 2.1 time: 0.174673 Jul 25 15:09:20.576302 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3419/6617] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:09:20 2022] GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 => generated 1277 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:09:21.586275 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-40c301ed-f49c-4cae-8b1e-76b58bcf48c0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:09:21.587354 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-40c301ed-f49c-4cae-8b1e-76b58bcf48c0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:09:21.598171 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-40c301ed-f49c-4cae-8b1e-76b58bcf48c0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:21.598899 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-40c301ed-f49c-4cae-8b1e-76b58bcf48c0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:21.599707 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-40c301ed-f49c-4cae-8b1e-76b58bcf48c0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:21.600207 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-40c301ed-f49c-4cae-8b1e-76b58bcf48c0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:21.753662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-40c301ed-f49c-4cae-8b1e-76b58bcf48c0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:09:21.762888 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-40c301ed-f49c-4cae-8b1e-76b58bcf48c0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4" status: 200 len: 1277 microversion: 2.1 time: 0.183332 Jul 25 15:09:21.763480 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3199/6618] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:09:21 2022] GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 => generated 1277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:09:22.786459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1187bfd4-3946-46f7-b54a-4aa1b8ad74af tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:09:22.787114 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1187bfd4-3946-46f7-b54a-4aa1b8ad74af tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:09:22.795442 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1187bfd4-3946-46f7-b54a-4aa1b8ad74af tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:22.795886 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1187bfd4-3946-46f7-b54a-4aa1b8ad74af tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:22.796709 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1187bfd4-3946-46f7-b54a-4aa1b8ad74af tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:22.797149 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1187bfd4-3946-46f7-b54a-4aa1b8ad74af tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:22.968944 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1187bfd4-3946-46f7-b54a-4aa1b8ad74af tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:09:22.977224 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1187bfd4-3946-46f7-b54a-4aa1b8ad74af tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4" status: 200 len: 1265 microversion: 2.1 time: 0.195848 Jul 25 15:09:22.977913 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3420/6619] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:09:22 2022] GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:09:23.999032 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-feb2964f-575b-4bbd-b8c6-4b8b86f85ce0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:09:23.999701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-feb2964f-575b-4bbd-b8c6-4b8b86f85ce0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:09:24.008197 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-feb2964f-575b-4bbd-b8c6-4b8b86f85ce0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:24.008655 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-feb2964f-575b-4bbd-b8c6-4b8b86f85ce0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:24.009453 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-feb2964f-575b-4bbd-b8c6-4b8b86f85ce0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:24.009926 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-feb2964f-575b-4bbd-b8c6-4b8b86f85ce0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:24.153563 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-feb2964f-575b-4bbd-b8c6-4b8b86f85ce0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:09:24.163785 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-feb2964f-575b-4bbd-b8c6-4b8b86f85ce0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4" status: 200 len: 1265 microversion: 2.1 time: 0.168508 Jul 25 15:09:24.164302 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3200/6620] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:09:23 2022] GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:09:25.184941 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6f4f3ca1-8f70-4844-8050-013ab0ea2379 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:09:25.185494 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6f4f3ca1-8f70-4844-8050-013ab0ea2379 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:09:25.193733 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f4f3ca1-8f70-4844-8050-013ab0ea2379 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:25.194189 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f4f3ca1-8f70-4844-8050-013ab0ea2379 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:25.194986 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f4f3ca1-8f70-4844-8050-013ab0ea2379 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:25.195429 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f4f3ca1-8f70-4844-8050-013ab0ea2379 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:25.196061 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:09:25.219868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:09:25.351808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6f4f3ca1-8f70-4844-8050-013ab0ea2379 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:09:25.360254 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6f4f3ca1-8f70-4844-8050-013ab0ea2379 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4" status: 200 len: 1265 microversion: 2.1 time: 0.179273 Jul 25 15:09:25.360795 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3421/6621] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:09:25 2022] GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:09:26.382360 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-075eb15f-725f-476c-a197-298fb5284dcf tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:09:26.383095 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-075eb15f-725f-476c-a197-298fb5284dcf tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:09:26.386218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:09:26.392270 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-075eb15f-725f-476c-a197-298fb5284dcf tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:26.392725 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-075eb15f-725f-476c-a197-298fb5284dcf tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:26.393521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-075eb15f-725f-476c-a197-298fb5284dcf tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:26.393960 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-075eb15f-725f-476c-a197-298fb5284dcf tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:26.538184 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-075eb15f-725f-476c-a197-298fb5284dcf tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:09:26.546656 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-075eb15f-725f-476c-a197-298fb5284dcf tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4" status: 200 len: 1265 microversion: 2.1 time: 0.168792 Jul 25 15:09:26.547283 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3201/6622] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:09:26 2022] GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:09:27.573100 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b599d84e-af04-402f-a789-b2f663113921 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:09:27.575275 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b599d84e-af04-402f-a789-b2f663113921 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:09:27.588021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b599d84e-af04-402f-a789-b2f663113921 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:27.588882 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b599d84e-af04-402f-a789-b2f663113921 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:27.590860 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b599d84e-af04-402f-a789-b2f663113921 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:27.591638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b599d84e-af04-402f-a789-b2f663113921 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:27.754495 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b599d84e-af04-402f-a789-b2f663113921 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:09:27.762737 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b599d84e-af04-402f-a789-b2f663113921 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4" status: 200 len: 1265 microversion: 2.1 time: 0.197140 Jul 25 15:09:27.763329 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3422/6623] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:09:27 2022] GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:09:28.784196 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2c2e0cef-2385-4a87-b3d8-f911b91c0cc7 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:09:28.785039 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2c2e0cef-2385-4a87-b3d8-f911b91c0cc7 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:09:28.793922 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c2e0cef-2385-4a87-b3d8-f911b91c0cc7 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:28.794445 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c2e0cef-2385-4a87-b3d8-f911b91c0cc7 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:28.795409 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c2e0cef-2385-4a87-b3d8-f911b91c0cc7 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:28.796210 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2c2e0cef-2385-4a87-b3d8-f911b91c0cc7 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:28.943858 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2c2e0cef-2385-4a87-b3d8-f911b91c0cc7 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:09:28.952594 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2c2e0cef-2385-4a87-b3d8-f911b91c0cc7 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4" status: 200 len: 1265 microversion: 2.1 time: 0.172121 Jul 25 15:09:28.953170 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3202/6624] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:09:28 2022] GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:09:29.973637 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-019b1948-73e6-465a-9b1e-ed9988e570be tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:09:29.974240 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-019b1948-73e6-465a-9b1e-ed9988e570be tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:09:29.981873 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-019b1948-73e6-465a-9b1e-ed9988e570be tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:29.982333 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-019b1948-73e6-465a-9b1e-ed9988e570be tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:29.983119 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-019b1948-73e6-465a-9b1e-ed9988e570be tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:29.983567 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-019b1948-73e6-465a-9b1e-ed9988e570be tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:30.132510 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-019b1948-73e6-465a-9b1e-ed9988e570be tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:09:30.140713 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-019b1948-73e6-465a-9b1e-ed9988e570be tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4" status: 200 len: 1265 microversion: 2.1 time: 0.171388 Jul 25 15:09:30.141300 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3423/6625] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:09:29 2022] GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:09:31.161537 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7a853c69-75f7-4e26-90c4-fd7b6cf8985f tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:09:31.162343 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7a853c69-75f7-4e26-90c4-fd7b6cf8985f tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:09:31.170030 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7a853c69-75f7-4e26-90c4-fd7b6cf8985f tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:31.170686 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7a853c69-75f7-4e26-90c4-fd7b6cf8985f tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:31.171582 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7a853c69-75f7-4e26-90c4-fd7b6cf8985f tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:31.172164 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7a853c69-75f7-4e26-90c4-fd7b6cf8985f tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:31.282794 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-2da61c3f-8f93-4ff0-89b8-04887afa684d req-7844e5bb-4c61-4bab-be5e-62e6636619a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4", "name": "network-vif-plugged", "status": "completed", "tag": "07e25e24-2571-49bd-b1ec-c1da154a2bac"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:09:31.297675 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-2da61c3f-8f93-4ff0-89b8-04887afa684d req-7844e5bb-4c61-4bab-be5e-62e6636619a3 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:31.298130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-2da61c3f-8f93-4ff0-89b8-04887afa684d req-7844e5bb-4c61-4bab-be5e-62e6636619a3 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:31.313978 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-2da61c3f-8f93-4ff0-89b8-04887afa684d req-7844e5bb-4c61-4bab-be5e-62e6636619a3 service nova] Creating event network-vif-plugged:07e25e24-2571-49bd-b1ec-c1da154a2bac for instance 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 on n-h1-846435-14 Jul 25 15:09:31.321456 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-2da61c3f-8f93-4ff0-89b8-04887afa684d req-7844e5bb-4c61-4bab-be5e-62e6636619a3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042654 Jul 25 15:09:31.322728 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3424/6626] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:09:31.341763 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7a853c69-75f7-4e26-90c4-fd7b6cf8985f tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:09:31.351171 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7a853c69-75f7-4e26-90c4-fd7b6cf8985f tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4" status: 200 len: 1265 microversion: 2.1 time: 0.193594 Jul 25 15:09:31.352831 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3203/6627] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:09:31 2022] GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:09:32.374607 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a9e14967-bfb8-4f9e-b113-a2f2c1ce0165 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:09:32.376907 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a9e14967-bfb8-4f9e-b113-a2f2c1ce0165 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:09:32.398154 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a9e14967-bfb8-4f9e-b113-a2f2c1ce0165 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:32.398678 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a9e14967-bfb8-4f9e-b113-a2f2c1ce0165 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:32.399582 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a9e14967-bfb8-4f9e-b113-a2f2c1ce0165 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:32.400188 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a9e14967-bfb8-4f9e-b113-a2f2c1ce0165 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:32.566575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a9e14967-bfb8-4f9e-b113-a2f2c1ce0165 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:09:32.576217 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a9e14967-bfb8-4f9e-b113-a2f2c1ce0165 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4" status: 200 len: 1265 microversion: 2.1 time: 0.206133 Jul 25 15:09:32.577118 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3425/6628] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:09:32 2022] GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:09:33.739339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0f2dab11-16cf-4b08-bd15-17bee47dd75a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:09:33.739967 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0f2dab11-16cf-4b08-bd15-17bee47dd75a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:09:33.751399 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f2dab11-16cf-4b08-bd15-17bee47dd75a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:33.752157 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f2dab11-16cf-4b08-bd15-17bee47dd75a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:33.754835 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f2dab11-16cf-4b08-bd15-17bee47dd75a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:33.755467 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f2dab11-16cf-4b08-bd15-17bee47dd75a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:33.942866 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0f2dab11-16cf-4b08-bd15-17bee47dd75a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:09:33.963338 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0f2dab11-16cf-4b08-bd15-17bee47dd75a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4" status: 200 len: 1452 microversion: 2.1 time: 0.366765 Jul 25 15:09:33.966227 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3204/6629] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:09:33 2022] GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 => generated 1452 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:09:33.991800 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3376f0de-8887-4eeb-a5a1-d497b6a2cc74 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:09:33.992829 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3376f0de-8887-4eeb-a5a1-d497b6a2cc74 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:09:34.000404 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3376f0de-8887-4eeb-a5a1-d497b6a2cc74 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:34.000839 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3376f0de-8887-4eeb-a5a1-d497b6a2cc74 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:34.001831 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3376f0de-8887-4eeb-a5a1-d497b6a2cc74 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:34.003574 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3376f0de-8887-4eeb-a5a1-d497b6a2cc74 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:34.197994 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3376f0de-8887-4eeb-a5a1-d497b6a2cc74 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:09:34.210565 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3376f0de-8887-4eeb-a5a1-d497b6a2cc74 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4" status: 200 len: 1452 microversion: 2.1 time: 0.224304 Jul 25 15:09:34.211516 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3426/6630] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:09:33 2022] GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 => generated 1452 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:09:36.920307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-5af71673-5288-445b-97ee-0374db0cfcbf req-78dff7ab-b6d3-46ba-8c32-4a146412f2aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4", "tag": "07e25e24-2571-49bd-b1ec-c1da154a2bac"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:09:36.940545 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-5af71673-5288-445b-97ee-0374db0cfcbf req-78dff7ab-b6d3-46ba-8c32-4a146412f2aa service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:09:36.941209 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-5af71673-5288-445b-97ee-0374db0cfcbf req-78dff7ab-b6d3-46ba-8c32-4a146412f2aa service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:09:36.966400 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-5af71673-5288-445b-97ee-0374db0cfcbf req-78dff7ab-b6d3-46ba-8c32-4a146412f2aa service nova] Creating event network-changed:07e25e24-2571-49bd-b1ec-c1da154a2bac for instance 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 on n-h1-846435-14 Jul 25 15:09:36.974771 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-5af71673-5288-445b-97ee-0374db0cfcbf req-78dff7ab-b6d3-46ba-8c32-4a146412f2aa service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059449 Jul 25 15:09:36.976053 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3205/6631] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:10:10.907059 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-963629bc-fad6-4128-ae6b-027e5b14099d tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-712871600", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:10:10.914336 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:10:10.915157 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=54 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:10:10.963967 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-963629bc-fad6-4128-ae6b-027e5b14099d tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] validate_networks() for None {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:10:11.289570 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-963629bc-fad6-4128-ae6b-027e5b14099d tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:10:11.289985 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-963629bc-fad6-4128-ae6b-027e5b14099d tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:10:11.290466 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-963629bc-fad6-4128-ae6b-027e5b14099d tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:10:11.290914 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-963629bc-fad6-4128-ae6b-027e5b14099d tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:10:11.291330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-963629bc-fad6-4128-ae6b-027e5b14099d tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:10:11.301188 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-963629bc-fad6-4128-ae6b-027e5b14099d tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:11.301643 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-963629bc-fad6-4128-ae6b-027e5b14099d tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:11.302856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-963629bc-fad6-4128-ae6b-027e5b14099d tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:11.303295 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-963629bc-fad6-4128-ae6b-027e5b14099d tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:11.322291 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-963629bc-fad6-4128-ae6b-027e5b14099d tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Getting quotas for project 426f467659dd43c2bcdec383e102f6d5. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:10:11.328075 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-963629bc-fad6-4128-ae6b-027e5b14099d tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Getting quotas for user ab09a560bb1d400cb6a4646881bf60ba and project 426f467659dd43c2bcdec383e102f6d5. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:10:11.342163 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-963629bc-fad6-4128-ae6b-027e5b14099d tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:10:11.344486 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-963629bc-fad6-4128-ae6b-027e5b14099d tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] [instance: bfc99724-365e-44de-8f5d-5d117148dff1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:10:11.400115 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-963629bc-fad6-4128-ae6b-027e5b14099d tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.496844 Jul 25 15:10:11.401256 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3427/6632] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:10:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:10:11.416907 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=22 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:10:11.418805 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=50 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:10:11.426018 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6bd8c721-ca50-476c-9c08-1f5b2c5c8899 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:11.427625 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6bd8c721-ca50-476c-9c08-1f5b2c5c8899 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] [instance: bfc99724-365e-44de-8f5d-5d117148dff1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:10:11.497723 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6bd8c721-ca50-476c-9c08-1f5b2c5c8899 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab09a560bb1d400cb6a4646881bf60ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426f467659dd43c2bcdec383e102f6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:10:11.505557 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6bd8c721-ca50-476c-9c08-1f5b2c5c8899 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] 10.222.0.88 "GET /compute/v2.1/servers/bfc99724-365e-44de-8f5d-5d117148dff1" status: 200 len: 1214 microversion: 2.1 time: 0.092579 Jul 25 15:10:11.506364 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3206/6633] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:10:11 2022] GET /compute/v2.1/servers/bfc99724-365e-44de-8f5d-5d117148dff1 => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:10:12.528555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bdb4786e-ef78-43aa-a4e0-cdd01885055a tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:12.529178 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bdb4786e-ef78-43aa-a4e0-cdd01885055a tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] [instance: bfc99724-365e-44de-8f5d-5d117148dff1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:10:12.536887 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bdb4786e-ef78-43aa-a4e0-cdd01885055a tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:12.537627 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bdb4786e-ef78-43aa-a4e0-cdd01885055a tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:12.538957 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bdb4786e-ef78-43aa-a4e0-cdd01885055a tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:12.539599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bdb4786e-ef78-43aa-a4e0-cdd01885055a tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:12.622707 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bdb4786e-ef78-43aa-a4e0-cdd01885055a tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab09a560bb1d400cb6a4646881bf60ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426f467659dd43c2bcdec383e102f6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:10:12.631528 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bdb4786e-ef78-43aa-a4e0-cdd01885055a tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] 10.222.0.88 "GET /compute/v2.1/servers/bfc99724-365e-44de-8f5d-5d117148dff1" status: 200 len: 1284 microversion: 2.1 time: 0.108428 Jul 25 15:10:12.632251 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3428/6634] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:10:12 2022] GET /compute/v2.1/servers/bfc99724-365e-44de-8f5d-5d117148dff1 => generated 1284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:10:13.654851 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b443470e-a5b1-424c-addf-ec7f7a4c3044 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:13.655709 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b443470e-a5b1-424c-addf-ec7f7a4c3044 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] [instance: bfc99724-365e-44de-8f5d-5d117148dff1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:10:13.664753 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b443470e-a5b1-424c-addf-ec7f7a4c3044 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:13.665173 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b443470e-a5b1-424c-addf-ec7f7a4c3044 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:13.666542 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b443470e-a5b1-424c-addf-ec7f7a4c3044 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:13.667119 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b443470e-a5b1-424c-addf-ec7f7a4c3044 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:13.811464 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b443470e-a5b1-424c-addf-ec7f7a4c3044 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab09a560bb1d400cb6a4646881bf60ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426f467659dd43c2bcdec383e102f6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:10:13.820997 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b443470e-a5b1-424c-addf-ec7f7a4c3044 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] 10.222.0.88 "GET /compute/v2.1/servers/bfc99724-365e-44de-8f5d-5d117148dff1" status: 200 len: 1314 microversion: 2.1 time: 0.171459 Jul 25 15:10:13.821606 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3207/6635] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:10:13 2022] GET /compute/v2.1/servers/bfc99724-365e-44de-8f5d-5d117148dff1 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:10:14.294990 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-58fb3535-3ee4-4d35-a6d4-6e9df55e3f0e req-c2b298c8-37ea-4186-90fe-af3dbacea1ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfc99724-365e-44de-8f5d-5d117148dff1", "tag": "4defe671-f30d-47ec-a3cf-2dfb1c840882"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:10:14.307968 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-58fb3535-3ee4-4d35-a6d4-6e9df55e3f0e req-c2b298c8-37ea-4186-90fe-af3dbacea1ce service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:14.317189 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-58fb3535-3ee4-4d35-a6d4-6e9df55e3f0e req-c2b298c8-37ea-4186-90fe-af3dbacea1ce service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:14.323811 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-58fb3535-3ee4-4d35-a6d4-6e9df55e3f0e req-c2b298c8-37ea-4186-90fe-af3dbacea1ce service nova] Creating event network-changed:4defe671-f30d-47ec-a3cf-2dfb1c840882 for instance bfc99724-365e-44de-8f5d-5d117148dff1 on n-h2-846435-14 Jul 25 15:10:14.329875 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-58fb3535-3ee4-4d35-a6d4-6e9df55e3f0e req-c2b298c8-37ea-4186-90fe-af3dbacea1ce service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215886 Jul 25 15:10:14.330637 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3429/6636] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:10:14.843188 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4293aa75-778d-4e03-bfb3-005ffc1b1e9c tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:14.844093 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4293aa75-778d-4e03-bfb3-005ffc1b1e9c tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] [instance: bfc99724-365e-44de-8f5d-5d117148dff1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:10:14.853855 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4293aa75-778d-4e03-bfb3-005ffc1b1e9c tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:14.854311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4293aa75-778d-4e03-bfb3-005ffc1b1e9c tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:14.855101 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4293aa75-778d-4e03-bfb3-005ffc1b1e9c tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:14.855534 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4293aa75-778d-4e03-bfb3-005ffc1b1e9c tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:15.002745 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4293aa75-778d-4e03-bfb3-005ffc1b1e9c tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab09a560bb1d400cb6a4646881bf60ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426f467659dd43c2bcdec383e102f6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:10:15.013028 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4293aa75-778d-4e03-bfb3-005ffc1b1e9c tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] 10.222.0.88 "GET /compute/v2.1/servers/bfc99724-365e-44de-8f5d-5d117148dff1" status: 200 len: 1314 microversion: 2.1 time: 0.173692 Jul 25 15:10:15.013631 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3208/6637] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:10:14 2022] GET /compute/v2.1/servers/bfc99724-365e-44de-8f5d-5d117148dff1 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:10:16.038646 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9a087033-d324-43cd-9f24-6d44433f8d08 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:16.039827 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9a087033-d324-43cd-9f24-6d44433f8d08 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] [instance: bfc99724-365e-44de-8f5d-5d117148dff1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:10:16.047692 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9a087033-d324-43cd-9f24-6d44433f8d08 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:16.048191 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9a087033-d324-43cd-9f24-6d44433f8d08 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:16.048987 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9a087033-d324-43cd-9f24-6d44433f8d08 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:16.049460 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9a087033-d324-43cd-9f24-6d44433f8d08 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:16.207194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9a087033-d324-43cd-9f24-6d44433f8d08 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab09a560bb1d400cb6a4646881bf60ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426f467659dd43c2bcdec383e102f6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:10:16.215433 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9a087033-d324-43cd-9f24-6d44433f8d08 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] 10.222.0.88 "GET /compute/v2.1/servers/bfc99724-365e-44de-8f5d-5d117148dff1" status: 200 len: 1314 microversion: 2.1 time: 0.184257 Jul 25 15:10:16.216026 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3430/6638] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:10:16 2022] GET /compute/v2.1/servers/bfc99724-365e-44de-8f5d-5d117148dff1 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:10:17.236856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-73106bef-406f-4986-9697-b2daedb7457b tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:17.237560 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-73106bef-406f-4986-9697-b2daedb7457b tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] [instance: bfc99724-365e-44de-8f5d-5d117148dff1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:10:17.244930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-73106bef-406f-4986-9697-b2daedb7457b tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:17.245400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-73106bef-406f-4986-9697-b2daedb7457b tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:17.246161 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-73106bef-406f-4986-9697-b2daedb7457b tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:17.246600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-73106bef-406f-4986-9697-b2daedb7457b tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:17.386931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-73106bef-406f-4986-9697-b2daedb7457b tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab09a560bb1d400cb6a4646881bf60ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426f467659dd43c2bcdec383e102f6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:10:17.394899 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-73106bef-406f-4986-9697-b2daedb7457b tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] 10.222.0.88 "GET /compute/v2.1/servers/bfc99724-365e-44de-8f5d-5d117148dff1" status: 200 len: 1314 microversion: 2.1 time: 0.162191 Jul 25 15:10:17.395486 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3209/6639] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:10:17 2022] GET /compute/v2.1/servers/bfc99724-365e-44de-8f5d-5d117148dff1 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:10:18.422060 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a96cf4a5-af9a-40af-a905-41b3a21e4d94 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:18.422624 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a96cf4a5-af9a-40af-a905-41b3a21e4d94 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] [instance: bfc99724-365e-44de-8f5d-5d117148dff1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:10:18.431059 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a96cf4a5-af9a-40af-a905-41b3a21e4d94 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:18.431531 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a96cf4a5-af9a-40af-a905-41b3a21e4d94 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:18.432347 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a96cf4a5-af9a-40af-a905-41b3a21e4d94 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:18.432794 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a96cf4a5-af9a-40af-a905-41b3a21e4d94 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:18.581135 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a96cf4a5-af9a-40af-a905-41b3a21e4d94 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab09a560bb1d400cb6a4646881bf60ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426f467659dd43c2bcdec383e102f6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:10:18.589006 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a96cf4a5-af9a-40af-a905-41b3a21e4d94 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] 10.222.0.88 "GET /compute/v2.1/servers/bfc99724-365e-44de-8f5d-5d117148dff1" status: 200 len: 1314 microversion: 2.1 time: 0.171139 Jul 25 15:10:18.589595 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3431/6640] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:10:18 2022] GET /compute/v2.1/servers/bfc99724-365e-44de-8f5d-5d117148dff1 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:10:19.610538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5b00459e-ef6e-4494-bf9e-340515ac33ce tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:19.611151 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5b00459e-ef6e-4494-bf9e-340515ac33ce tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] [instance: bfc99724-365e-44de-8f5d-5d117148dff1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:10:19.618812 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5b00459e-ef6e-4494-bf9e-340515ac33ce tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:19.619275 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5b00459e-ef6e-4494-bf9e-340515ac33ce tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:19.620077 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5b00459e-ef6e-4494-bf9e-340515ac33ce tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:19.620582 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5b00459e-ef6e-4494-bf9e-340515ac33ce tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:19.759161 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5b00459e-ef6e-4494-bf9e-340515ac33ce tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab09a560bb1d400cb6a4646881bf60ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426f467659dd43c2bcdec383e102f6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:10:19.767062 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5b00459e-ef6e-4494-bf9e-340515ac33ce tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] 10.222.0.88 "GET /compute/v2.1/servers/bfc99724-365e-44de-8f5d-5d117148dff1" status: 200 len: 1314 microversion: 2.1 time: 0.160424 Jul 25 15:10:19.767646 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3210/6641] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:10:19 2022] GET /compute/v2.1/servers/bfc99724-365e-44de-8f5d-5d117148dff1 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:10:20.044858 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-e12a84ec-ee10-40e9-bd84-2542a9fed93e req-074b6e2e-1d61-4349-89b8-83a5c1d2bf78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfc99724-365e-44de-8f5d-5d117148dff1", "name": "network-vif-plugged", "status": "completed", "tag": "4defe671-f30d-47ec-a3cf-2dfb1c840882"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:10:20.056358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-e12a84ec-ee10-40e9-bd84-2542a9fed93e req-074b6e2e-1d61-4349-89b8-83a5c1d2bf78 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:20.056816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-e12a84ec-ee10-40e9-bd84-2542a9fed93e req-074b6e2e-1d61-4349-89b8-83a5c1d2bf78 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:20.070797 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-e12a84ec-ee10-40e9-bd84-2542a9fed93e req-074b6e2e-1d61-4349-89b8-83a5c1d2bf78 service nova] Creating event network-vif-plugged:4defe671-f30d-47ec-a3cf-2dfb1c840882 for instance bfc99724-365e-44de-8f5d-5d117148dff1 on n-h2-846435-14 Jul 25 15:10:20.076447 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-e12a84ec-ee10-40e9-bd84-2542a9fed93e req-074b6e2e-1d61-4349-89b8-83a5c1d2bf78 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036386 Jul 25 15:10:20.077405 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3432/6642] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:10:20.790411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9fc2b34a-02fb-4270-aaa8-af60a8eab202 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:20.791049 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9fc2b34a-02fb-4270-aaa8-af60a8eab202 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] [instance: bfc99724-365e-44de-8f5d-5d117148dff1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:10:20.798837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9fc2b34a-02fb-4270-aaa8-af60a8eab202 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:20.799882 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9fc2b34a-02fb-4270-aaa8-af60a8eab202 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:20.800709 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9fc2b34a-02fb-4270-aaa8-af60a8eab202 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:20.801145 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9fc2b34a-02fb-4270-aaa8-af60a8eab202 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:20.940765 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9fc2b34a-02fb-4270-aaa8-af60a8eab202 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab09a560bb1d400cb6a4646881bf60ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426f467659dd43c2bcdec383e102f6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:10:20.949280 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9fc2b34a-02fb-4270-aaa8-af60a8eab202 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] 10.222.0.88 "GET /compute/v2.1/servers/bfc99724-365e-44de-8f5d-5d117148dff1" status: 200 len: 1314 microversion: 2.1 time: 0.164423 Jul 25 15:10:20.949875 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3211/6643] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:10:20 2022] GET /compute/v2.1/servers/bfc99724-365e-44de-8f5d-5d117148dff1 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:10:21.973197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6d90dfaf-74cb-4621-ac34-0e05427cd5c2 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:21.973829 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6d90dfaf-74cb-4621-ac34-0e05427cd5c2 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] [instance: bfc99724-365e-44de-8f5d-5d117148dff1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:10:21.976785 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:10:21.977510 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:10:21.983936 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d90dfaf-74cb-4621-ac34-0e05427cd5c2 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:21.984495 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d90dfaf-74cb-4621-ac34-0e05427cd5c2 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:21.985282 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d90dfaf-74cb-4621-ac34-0e05427cd5c2 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:21.985729 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d90dfaf-74cb-4621-ac34-0e05427cd5c2 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:22.508757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6d90dfaf-74cb-4621-ac34-0e05427cd5c2 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab09a560bb1d400cb6a4646881bf60ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426f467659dd43c2bcdec383e102f6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:10:22.517286 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6d90dfaf-74cb-4621-ac34-0e05427cd5c2 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] 10.222.0.88 "GET /compute/v2.1/servers/bfc99724-365e-44de-8f5d-5d117148dff1" status: 200 len: 1464 microversion: 2.1 time: 0.549330 Jul 25 15:10:22.518204 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3433/6644] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:10:21 2022] GET /compute/v2.1/servers/bfc99724-365e-44de-8f5d-5d117148dff1 => generated 1464 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:10:22.569512 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-794bde1c-c143-455f-84cf-2d59b82c6f71 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:22.570050 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-794bde1c-c143-455f-84cf-2d59b82c6f71 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] [instance: bfc99724-365e-44de-8f5d-5d117148dff1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:10:22.572011 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:10:22.578685 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-794bde1c-c143-455f-84cf-2d59b82c6f71 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:22.579155 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-794bde1c-c143-455f-84cf-2d59b82c6f71 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:22.579944 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-794bde1c-c143-455f-84cf-2d59b82c6f71 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:22.580414 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-794bde1c-c143-455f-84cf-2d59b82c6f71 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:22.607711 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-794bde1c-c143-455f-84cf-2d59b82c6f71 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] [instance: bfc99724-365e-44de-8f5d-5d117148dff1] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:10:22.687958 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-794bde1c-c143-455f-84cf-2d59b82c6f71 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] 10.222.0.88 "DELETE /compute/v2.1/servers/bfc99724-365e-44de-8f5d-5d117148dff1" status: 204 len: 0 microversion: 2.1 time: 0.122051 Jul 25 15:10:22.688676 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3212/6645] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:10:22 2022] DELETE /compute/v2.1/servers/bfc99724-365e-44de-8f5d-5d117148dff1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:10:22.697468 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d5d1403f-3334-46be-a7fd-46c178cc7a2f tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:22.698047 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d5d1403f-3334-46be-a7fd-46c178cc7a2f tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] [instance: bfc99724-365e-44de-8f5d-5d117148dff1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:10:22.704370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5d1403f-3334-46be-a7fd-46c178cc7a2f tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:22.704831 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5d1403f-3334-46be-a7fd-46c178cc7a2f tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:22.705609 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5d1403f-3334-46be-a7fd-46c178cc7a2f tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:22.706056 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d5d1403f-3334-46be-a7fd-46c178cc7a2f tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:22.842033 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d5d1403f-3334-46be-a7fd-46c178cc7a2f tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab09a560bb1d400cb6a4646881bf60ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426f467659dd43c2bcdec383e102f6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:10:22.850579 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d5d1403f-3334-46be-a7fd-46c178cc7a2f tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] 10.222.0.88 "GET /compute/v2.1/servers/bfc99724-365e-44de-8f5d-5d117148dff1" status: 200 len: 1470 microversion: 2.1 time: 0.157053 Jul 25 15:10:22.851221 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3434/6646] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:10:22 2022] GET /compute/v2.1/servers/bfc99724-365e-44de-8f5d-5d117148dff1 => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:10:23.873103 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9de56d22-8ac7-4d5d-9bb8-e9e25ecdf907 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:23.873893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9de56d22-8ac7-4d5d-9bb8-e9e25ecdf907 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] [instance: bfc99724-365e-44de-8f5d-5d117148dff1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:10:23.883351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9de56d22-8ac7-4d5d-9bb8-e9e25ecdf907 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:23.884292 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9de56d22-8ac7-4d5d-9bb8-e9e25ecdf907 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:23.884888 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9de56d22-8ac7-4d5d-9bb8-e9e25ecdf907 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:23.885322 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9de56d22-8ac7-4d5d-9bb8-e9e25ecdf907 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:24.028723 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9de56d22-8ac7-4d5d-9bb8-e9e25ecdf907 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab09a560bb1d400cb6a4646881bf60ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426f467659dd43c2bcdec383e102f6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:10:24.036869 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9de56d22-8ac7-4d5d-9bb8-e9e25ecdf907 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] 10.222.0.88 "GET /compute/v2.1/servers/bfc99724-365e-44de-8f5d-5d117148dff1" status: 200 len: 1470 microversion: 2.1 time: 0.168152 Jul 25 15:10:24.037445 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3213/6647] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:10:23 2022] GET /compute/v2.1/servers/bfc99724-365e-44de-8f5d-5d117148dff1 => generated 1470 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:10:24.649757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-4822cf4b-e010-49e8-9f43-a830894256c5 req-c467f3fc-bc7c-4af8-8b1a-048e1662f277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfc99724-365e-44de-8f5d-5d117148dff1", "name": "network-vif-deleted", "tag": "4defe671-f30d-47ec-a3cf-2dfb1c840882"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:10:24.674144 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-4822cf4b-e010-49e8-9f43-a830894256c5 req-c467f3fc-bc7c-4af8-8b1a-048e1662f277 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:24.674276 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-4822cf4b-e010-49e8-9f43-a830894256c5 req-c467f3fc-bc7c-4af8-8b1a-048e1662f277 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:24.686895 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-4822cf4b-e010-49e8-9f43-a830894256c5 req-c467f3fc-bc7c-4af8-8b1a-048e1662f277 service nova] Creating event network-vif-deleted:4defe671-f30d-47ec-a3cf-2dfb1c840882 for instance bfc99724-365e-44de-8f5d-5d117148dff1 on n-h2-846435-14 Jul 25 15:10:24.693173 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-4822cf4b-e010-49e8-9f43-a830894256c5 req-c467f3fc-bc7c-4af8-8b1a-048e1662f277 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050259 Jul 25 15:10:24.693801 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3435/6648] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:10:25.057741 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-065b9b6a-e7aa-4601-a0ee-7706cf2ce4f6 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:25.058379 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-065b9b6a-e7aa-4601-a0ee-7706cf2ce4f6 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] [instance: bfc99724-365e-44de-8f5d-5d117148dff1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:10:25.065900 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-065b9b6a-e7aa-4601-a0ee-7706cf2ce4f6 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:25.066356 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-065b9b6a-e7aa-4601-a0ee-7706cf2ce4f6 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:25.067149 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-065b9b6a-e7aa-4601-a0ee-7706cf2ce4f6 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:25.067580 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-065b9b6a-e7aa-4601-a0ee-7706cf2ce4f6 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:25.103655 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-065b9b6a-e7aa-4601-a0ee-7706cf2ce4f6 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:25.104129 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-065b9b6a-e7aa-4601-a0ee-7706cf2ce4f6 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:25.104631 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-065b9b6a-e7aa-4601-a0ee-7706cf2ce4f6 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lazy-loading 'fault' on Instance uuid bfc99724-365e-44de-8f5d-5d117148dff1 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:10:25.148333 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-065b9b6a-e7aa-4601-a0ee-7706cf2ce4f6 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab09a560bb1d400cb6a4646881bf60ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426f467659dd43c2bcdec383e102f6d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:10:25.156786 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-065b9b6a-e7aa-4601-a0ee-7706cf2ce4f6 tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] 10.222.0.88 "GET /compute/v2.1/servers/bfc99724-365e-44de-8f5d-5d117148dff1" status: 200 len: 1304 microversion: 2.1 time: 0.102963 Jul 25 15:10:25.157388 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3214/6649] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:10:25 2022] GET /compute/v2.1/servers/bfc99724-365e-44de-8f5d-5d117148dff1 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:10:26.180135 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b6819079-df43-4460-9e2b-5fbb4de99c9b tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:26.180829 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b6819079-df43-4460-9e2b-5fbb4de99c9b tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] [instance: bfc99724-365e-44de-8f5d-5d117148dff1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:10:26.187674 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b6819079-df43-4460-9e2b-5fbb4de99c9b tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:26.188165 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b6819079-df43-4460-9e2b-5fbb4de99c9b tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:26.188934 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b6819079-df43-4460-9e2b-5fbb4de99c9b tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:26.189372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b6819079-df43-4460-9e2b-5fbb4de99c9b tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:26.206410 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-b6819079-df43-4460-9e2b-5fbb4de99c9b tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] HTTP exception thrown: Instance bfc99724-365e-44de-8f5d-5d117148dff1 could not be found. Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b6819079-df43-4460-9e2b-5fbb4de99c9b tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Request method failure captured: Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/bfc99724-365e-44de-8f5d-5d117148dff1 HTTP/1.1 Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3rJRwZrOg1Da71HNqGSiLwkre1UpsZsfPB1JWZE61SUD3cFqkPUiPfLKe2FtB1Vin0PbK03xzW7Koiy2xyGaSh-s4ZFgjuyg17OOjh2FF-GokS-MMv7L6jkG2WxYlp_6W748RFLnjsDLS3LovzVRfFzvR9m7MLItRVC0pJCMny4aw8k Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 426f467659dd43c2bcdec383e102f6d5 Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-VolumesNegativeTest-592371045 Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/426f467659dd43c2bcdec383e102f6d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/426f467659dd43c2bcdec383e102f6d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_426f467659dd43c2bcdec383e102f6d5", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/426f467659dd43c2bcdec383e102f6d5"}]}] Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-VolumesNegativeTest-592371045 Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 426f467659dd43c2bcdec383e102f6d5 Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-VolumesNegativeTest-592371045 Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-VolumesNegativeTest-592371045-project Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: ab09a560bb1d400cb6a4646881bf60ba Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-VolumesNegativeTest-592371045-project Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance bfc99724-365e-44de-8f5d-5d117148dff1 could not be found. Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'bfc99724-365e-44de-8f5d-5d117148dff1'} Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfc99724-365e-44de-8f5d-5d117148dff1 could not be found. Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfc99724-365e-44de-8f5d-5d117148dff1 could not be found. Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:10:26.208316 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:10:26.213319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:10:26.213319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:10:26.213319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:10:26.213319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:10:26.213319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:10:26.213319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfc99724-365e-44de-8f5d-5d117148dff1 could not be found. Jul 25 15:10:26.213319 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:10:26.213319 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b6819079-df43-4460-9e2b-5fbb4de99c9b tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] Returning 404 to user: Instance bfc99724-365e-44de-8f5d-5d117148dff1 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:10:26.213319 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b6819079-df43-4460-9e2b-5fbb4de99c9b tempest-VolumesNegativeTest-592371045 tempest-VolumesNegativeTest-592371045-project] 10.222.0.88 "GET /compute/v2.1/servers/bfc99724-365e-44de-8f5d-5d117148dff1" status: 404 len: 111 microversion: 2.1 time: 0.034847 Jul 25 15:10:26.213319 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3436/6650] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:10:26 2022] GET /compute/v2.1/servers/bfc99724-365e-44de-8f5d-5d117148dff1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:10:41.869084 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:10:41.871130 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:10:42.008776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-24602f36-1989-4c7b-b252-99d1e156d29e tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:42.009633 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 15:10:42.009633 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 15:10:42.010783 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-24602f36-1989-4c7b-b252-99d1e156d29e tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:42.011229 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-24602f36-1989-4c7b-b252-99d1e156d29e tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:42.012064 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-24602f36-1989-4c7b-b252-99d1e156d29e tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:42.012501 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-24602f36-1989-4c7b-b252-99d1e156d29e tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:42.037914 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-24602f36-1989-4c7b-b252-99d1e156d29e tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.177153 Jul 25 15:10:42.038521 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3215/6651] 10.222.0.88 () {58 vars in 1185 bytes} [Mon Jul 25 15:10:41 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:10:42.165716 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ecae0a60-89f9-4320-bfd9-0516fc65748b tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1002939357", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "availability_zone": "nova:n-h2-846435-14", "networks": [{"uuid": "8ad2b119-cbc4-449c-986f-04ab4f18becf"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:10:42.174309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:10:42.175102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=40 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:10:42.237979 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-ecae0a60-89f9-4320-bfd9-0516fc65748b tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] validate_networks() for [('8ad2b119-cbc4-449c-986f-04ab4f18becf', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:10:42.927951 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-ecae0a60-89f9-4320-bfd9-0516fc65748b tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:10:42.928520 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-ecae0a60-89f9-4320-bfd9-0516fc65748b tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:10:42.929033 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-ecae0a60-89f9-4320-bfd9-0516fc65748b tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:10:42.929436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-ecae0a60-89f9-4320-bfd9-0516fc65748b tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:10:42.929849 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-ecae0a60-89f9-4320-bfd9-0516fc65748b tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:10:42.940016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ecae0a60-89f9-4320-bfd9-0516fc65748b tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:42.940495 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ecae0a60-89f9-4320-bfd9-0516fc65748b tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:42.941294 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ecae0a60-89f9-4320-bfd9-0516fc65748b tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:42.941734 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ecae0a60-89f9-4320-bfd9-0516fc65748b tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:42.959921 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-ecae0a60-89f9-4320-bfd9-0516fc65748b tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Getting quotas for project f31c20c5d5aa411bb3f89938a637a275. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:10:42.966079 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-ecae0a60-89f9-4320-bfd9-0516fc65748b tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Getting quotas for user 0bef25884f144ba2914b43a46d434e7b and project f31c20c5d5aa411bb3f89938a637a275. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:10:42.979389 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ecae0a60-89f9-4320-bfd9-0516fc65748b tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:10:42.981926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ecae0a60-89f9-4320-bfd9-0516fc65748b tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: ba88e394-2498-482d-bc2f-5c8f90b0b5e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:10:43.028124 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ecae0a60-89f9-4320-bfd9-0516fc65748b tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.866486 Jul 25 15:10:43.028770 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3437/6652] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:10:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:10:43.039702 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c73819b6-5448-4ee2-b28e-8d3ae25be934 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:43.040334 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c73819b6-5448-4ee2-b28e-8d3ae25be934 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: ba88e394-2498-482d-bc2f-5c8f90b0b5e9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:10:43.212192 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c73819b6-5448-4ee2-b28e-8d3ae25be934 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9" status: 200 len: 1329 microversion: 2.1 time: 0.176097 Jul 25 15:10:43.213457 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3216/6653] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:10:43 2022] GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9 => generated 1329 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:10:44.232048 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fe9aed42-d2ab-4d1e-8d72-6352eedce6c3 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:44.232693 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fe9aed42-d2ab-4d1e-8d72-6352eedce6c3 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: ba88e394-2498-482d-bc2f-5c8f90b0b5e9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:10:44.242838 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fe9aed42-d2ab-4d1e-8d72-6352eedce6c3 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:44.243371 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fe9aed42-d2ab-4d1e-8d72-6352eedce6c3 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:44.244883 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fe9aed42-d2ab-4d1e-8d72-6352eedce6c3 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:44.245551 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fe9aed42-d2ab-4d1e-8d72-6352eedce6c3 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:44.368259 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fe9aed42-d2ab-4d1e-8d72-6352eedce6c3 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9" status: 200 len: 1436 microversion: 2.1 time: 0.139882 Jul 25 15:10:44.368849 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3438/6654] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:10:44 2022] GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9 => generated 1436 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:10:45.390690 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b1a13a67-7f4b-4bfc-b6c2-98e89a552e3d tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:45.391557 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b1a13a67-7f4b-4bfc-b6c2-98e89a552e3d tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: ba88e394-2498-482d-bc2f-5c8f90b0b5e9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:10:45.400839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b1a13a67-7f4b-4bfc-b6c2-98e89a552e3d tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:45.401613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b1a13a67-7f4b-4bfc-b6c2-98e89a552e3d tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:45.402696 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b1a13a67-7f4b-4bfc-b6c2-98e89a552e3d tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:45.403230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b1a13a67-7f4b-4bfc-b6c2-98e89a552e3d tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:45.419825 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-3d37f46d-fbb8-4e9d-85c6-54aa99a6472d req-cffa09df-ea89-4492-bf39-1698cd6feec3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba88e394-2498-482d-bc2f-5c8f90b0b5e9", "tag": "bc4ffbd4-6564-41d6-b8f6-ecfdeb9cd201"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:10:45.454309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-3d37f46d-fbb8-4e9d-85c6-54aa99a6472d req-cffa09df-ea89-4492-bf39-1698cd6feec3 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:45.463943 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-3d37f46d-fbb8-4e9d-85c6-54aa99a6472d req-cffa09df-ea89-4492-bf39-1698cd6feec3 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:45.503987 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-3d37f46d-fbb8-4e9d-85c6-54aa99a6472d req-cffa09df-ea89-4492-bf39-1698cd6feec3 service nova] Creating event network-changed:bc4ffbd4-6564-41d6-b8f6-ecfdeb9cd201 for instance ba88e394-2498-482d-bc2f-5c8f90b0b5e9 on n-h2-846435-14 Jul 25 15:10:45.513061 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-3d37f46d-fbb8-4e9d-85c6-54aa99a6472d req-cffa09df-ea89-4492-bf39-1698cd6feec3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100219 Jul 25 15:10:45.514064 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3439/6655] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:10:45.634155 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b1a13a67-7f4b-4bfc-b6c2-98e89a552e3d tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9" status: 200 len: 1466 microversion: 2.1 time: 0.247386 Jul 25 15:10:45.635173 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3217/6656] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:10:45 2022] GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9 => generated 1466 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:10:46.657968 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f7093591-528b-4f59-8895-6c106def64e7 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:46.658761 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f7093591-528b-4f59-8895-6c106def64e7 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: ba88e394-2498-482d-bc2f-5c8f90b0b5e9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:10:46.666105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f7093591-528b-4f59-8895-6c106def64e7 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:46.666664 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f7093591-528b-4f59-8895-6c106def64e7 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:46.667510 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f7093591-528b-4f59-8895-6c106def64e7 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:46.668107 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f7093591-528b-4f59-8895-6c106def64e7 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:46.802380 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f7093591-528b-4f59-8895-6c106def64e7 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9" status: 200 len: 1466 microversion: 2.1 time: 0.149193 Jul 25 15:10:46.802958 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3440/6657] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:10:46 2022] GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9 => generated 1466 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:10:47.824926 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9e93e651-ff1f-49aa-8218-c1e85cdea961 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:47.826130 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9e93e651-ff1f-49aa-8218-c1e85cdea961 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: ba88e394-2498-482d-bc2f-5c8f90b0b5e9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:10:47.837700 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9e93e651-ff1f-49aa-8218-c1e85cdea961 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:47.838147 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9e93e651-ff1f-49aa-8218-c1e85cdea961 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:47.838932 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9e93e651-ff1f-49aa-8218-c1e85cdea961 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:47.839362 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9e93e651-ff1f-49aa-8218-c1e85cdea961 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:47.979357 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9e93e651-ff1f-49aa-8218-c1e85cdea961 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9" status: 200 len: 1466 microversion: 2.1 time: 0.159523 Jul 25 15:10:47.979940 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3218/6658] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:10:47 2022] GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9 => generated 1466 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:10:49.000255 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-62f85ad0-f03c-4853-beba-4df91827dee0 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:49.000888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-62f85ad0-f03c-4853-beba-4df91827dee0 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: ba88e394-2498-482d-bc2f-5c8f90b0b5e9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:10:49.008751 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-62f85ad0-f03c-4853-beba-4df91827dee0 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:49.009208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-62f85ad0-f03c-4853-beba-4df91827dee0 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:49.009987 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-62f85ad0-f03c-4853-beba-4df91827dee0 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:49.010438 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-62f85ad0-f03c-4853-beba-4df91827dee0 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:49.206478 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-62f85ad0-f03c-4853-beba-4df91827dee0 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9" status: 200 len: 1466 microversion: 2.1 time: 0.209926 Jul 25 15:10:49.207069 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3441/6659] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:10:48 2022] GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9 => generated 1466 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:10:50.227741 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1bb4f087-9bf7-4cd0-ad48-e764c914f152 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:50.228419 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1bb4f087-9bf7-4cd0-ad48-e764c914f152 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: ba88e394-2498-482d-bc2f-5c8f90b0b5e9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:10:50.235775 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1bb4f087-9bf7-4cd0-ad48-e764c914f152 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:50.236223 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1bb4f087-9bf7-4cd0-ad48-e764c914f152 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:50.237011 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1bb4f087-9bf7-4cd0-ad48-e764c914f152 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:50.237459 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1bb4f087-9bf7-4cd0-ad48-e764c914f152 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:50.370063 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1bb4f087-9bf7-4cd0-ad48-e764c914f152 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9" status: 200 len: 1466 microversion: 2.1 time: 0.146798 Jul 25 15:10:50.370636 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3219/6660] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:10:50 2022] GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9 => generated 1466 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:10:51.390980 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ece20165-5b3f-4a13-a368-75469cf811f3 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:51.391541 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ece20165-5b3f-4a13-a368-75469cf811f3 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: ba88e394-2498-482d-bc2f-5c8f90b0b5e9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:10:51.398837 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ece20165-5b3f-4a13-a368-75469cf811f3 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:51.399300 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ece20165-5b3f-4a13-a368-75469cf811f3 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:51.400103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ece20165-5b3f-4a13-a368-75469cf811f3 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:51.400541 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ece20165-5b3f-4a13-a368-75469cf811f3 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:51.535528 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ece20165-5b3f-4a13-a368-75469cf811f3 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9" status: 200 len: 1466 microversion: 2.1 time: 0.148283 Jul 25 15:10:51.536115 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3442/6661] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:10:51 2022] GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9 => generated 1466 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:10:52.170886 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-fff92a52-fb2e-4cdf-a91e-0dd423346b3c req-e3e7bced-1095-40eb-a4ed-913707a832c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba88e394-2498-482d-bc2f-5c8f90b0b5e9", "name": "network-vif-plugged", "status": "completed", "tag": "bc4ffbd4-6564-41d6-b8f6-ecfdeb9cd201"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:10:52.177446 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:10:52.185250 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-fff92a52-fb2e-4cdf-a91e-0dd423346b3c req-e3e7bced-1095-40eb-a4ed-913707a832c3 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:52.185703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-fff92a52-fb2e-4cdf-a91e-0dd423346b3c req-e3e7bced-1095-40eb-a4ed-913707a832c3 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:52.197690 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-fff92a52-fb2e-4cdf-a91e-0dd423346b3c req-e3e7bced-1095-40eb-a4ed-913707a832c3 service nova] Creating event network-vif-plugged:bc4ffbd4-6564-41d6-b8f6-ecfdeb9cd201 for instance ba88e394-2498-482d-bc2f-5c8f90b0b5e9 on n-h2-846435-14 Jul 25 15:10:52.202886 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-fff92a52-fb2e-4cdf-a91e-0dd423346b3c req-e3e7bced-1095-40eb-a4ed-913707a832c3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036057 Jul 25 15:10:52.203491 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3220/6662] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:10:52.557439 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7434a065-1d12-455e-86fa-57e9a4173742 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:52.558019 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7434a065-1d12-455e-86fa-57e9a4173742 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: ba88e394-2498-482d-bc2f-5c8f90b0b5e9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:10:52.565281 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7434a065-1d12-455e-86fa-57e9a4173742 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:52.565750 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7434a065-1d12-455e-86fa-57e9a4173742 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:52.566546 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7434a065-1d12-455e-86fa-57e9a4173742 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:52.566998 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7434a065-1d12-455e-86fa-57e9a4173742 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:52.702895 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7434a065-1d12-455e-86fa-57e9a4173742 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9" status: 200 len: 1466 microversion: 2.1 time: 0.149340 Jul 25 15:10:52.703500 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3443/6663] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:10:52 2022] GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9 => generated 1466 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:10:53.724900 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c080ae5e-b7a8-433b-99bb-fd9cbb03d564 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:53.725636 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c080ae5e-b7a8-433b-99bb-fd9cbb03d564 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: ba88e394-2498-482d-bc2f-5c8f90b0b5e9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:10:53.728497 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:10:53.735694 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c080ae5e-b7a8-433b-99bb-fd9cbb03d564 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:53.736248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c080ae5e-b7a8-433b-99bb-fd9cbb03d564 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:53.737104 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c080ae5e-b7a8-433b-99bb-fd9cbb03d564 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:53.737550 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c080ae5e-b7a8-433b-99bb-fd9cbb03d564 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:53.879734 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c080ae5e-b7a8-433b-99bb-fd9cbb03d564 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9" status: 200 len: 1652 microversion: 2.1 time: 0.159298 Jul 25 15:10:53.880748 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3221/6664] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:10:53 2022] GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9 => generated 1652 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:10:53.902890 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-efeaa93f-f6a8-4b88-afa5-afac46771049 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:53.903446 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-efeaa93f-f6a8-4b88-afa5-afac46771049 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: ba88e394-2498-482d-bc2f-5c8f90b0b5e9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:10:53.905513 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:10:53.906202 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:10:53.913549 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-efeaa93f-f6a8-4b88-afa5-afac46771049 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:53.914007 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-efeaa93f-f6a8-4b88-afa5-afac46771049 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:53.914786 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-efeaa93f-f6a8-4b88-afa5-afac46771049 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:53.915222 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-efeaa93f-f6a8-4b88-afa5-afac46771049 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:54.056626 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-efeaa93f-f6a8-4b88-afa5-afac46771049 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9" status: 200 len: 1652 microversion: 2.1 time: 0.159101 Jul 25 15:10:54.057209 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3444/6665] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:10:53 2022] GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9 => generated 1652 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:10:54.076509 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d063d98e-c0f5-4efe-8849-bd679dc3a996 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:54.077143 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d063d98e-c0f5-4efe-8849-bd679dc3a996 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: ba88e394-2498-482d-bc2f-5c8f90b0b5e9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:10:54.084279 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d063d98e-c0f5-4efe-8849-bd679dc3a996 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:54.084742 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d063d98e-c0f5-4efe-8849-bd679dc3a996 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:54.085496 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d063d98e-c0f5-4efe-8849-bd679dc3a996 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:54.085930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d063d98e-c0f5-4efe-8849-bd679dc3a996 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:54.219344 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d063d98e-c0f5-4efe-8849-bd679dc3a996 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9" status: 200 len: 1652 microversion: 2.1 time: 0.146405 Jul 25 15:10:54.219931 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3222/6666] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:10:54 2022] GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9 => generated 1652 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:10:54.284597 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f7001303-88c9-494e-b842-0c07828aa915 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1375681085", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "availability_zone": "nova:n-h1-846435-14", "networks": [{"uuid": "8ad2b119-cbc4-449c-986f-04ab4f18becf"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:10:54.343900 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-f7001303-88c9-494e-b842-0c07828aa915 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] validate_networks() for [('8ad2b119-cbc4-449c-986f-04ab4f18becf', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:10:54.707405 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f7001303-88c9-494e-b842-0c07828aa915 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:10:54.707838 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f7001303-88c9-494e-b842-0c07828aa915 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:10:54.708400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f7001303-88c9-494e-b842-0c07828aa915 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:10:54.708813 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f7001303-88c9-494e-b842-0c07828aa915 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:10:54.709231 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-f7001303-88c9-494e-b842-0c07828aa915 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:10:54.718462 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f7001303-88c9-494e-b842-0c07828aa915 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:54.718917 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f7001303-88c9-494e-b842-0c07828aa915 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:54.719713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f7001303-88c9-494e-b842-0c07828aa915 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:54.720193 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f7001303-88c9-494e-b842-0c07828aa915 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:54.737462 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-f7001303-88c9-494e-b842-0c07828aa915 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Getting quotas for project f31c20c5d5aa411bb3f89938a637a275. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:10:54.743086 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-f7001303-88c9-494e-b842-0c07828aa915 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Getting quotas for user 0bef25884f144ba2914b43a46d434e7b and project f31c20c5d5aa411bb3f89938a637a275. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:10:54.756677 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f7001303-88c9-494e-b842-0c07828aa915 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:10:54.758999 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f7001303-88c9-494e-b842-0c07828aa915 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: f02c070c-8abf-4ee2-b228-e8f004001001] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:10:54.805377 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f7001303-88c9-494e-b842-0c07828aa915 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524574 Jul 25 15:10:54.806034 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3445/6667] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:10:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:10:54.816770 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-76d3f4b5-a27e-47ee-8921-182862591de2 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:54.817414 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-76d3f4b5-a27e-47ee-8921-182862591de2 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: f02c070c-8abf-4ee2-b228-e8f004001001] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:10:54.878294 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-76d3f4b5-a27e-47ee-8921-182862591de2 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/f02c070c-8abf-4ee2-b228-e8f004001001" status: 200 len: 1329 microversion: 2.1 time: 0.064883 Jul 25 15:10:54.879094 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3223/6668] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:10:54 2022] GET /compute/v2.1/servers/f02c070c-8abf-4ee2-b228-e8f004001001 => generated 1329 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:10:55.900451 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3f3ed544-9a69-422a-8331-908cdb7242fd tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:55.901098 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3f3ed544-9a69-422a-8331-908cdb7242fd tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: f02c070c-8abf-4ee2-b228-e8f004001001] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:10:55.908364 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f3ed544-9a69-422a-8331-908cdb7242fd tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:55.908817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f3ed544-9a69-422a-8331-908cdb7242fd tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:55.909601 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f3ed544-9a69-422a-8331-908cdb7242fd tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:55.910045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f3ed544-9a69-422a-8331-908cdb7242fd tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:55.980137 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3f3ed544-9a69-422a-8331-908cdb7242fd tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/f02c070c-8abf-4ee2-b228-e8f004001001" status: 200 len: 1424 microversion: 2.1 time: 0.084924 Jul 25 15:10:55.980715 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3446/6669] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:10:55 2022] GET /compute/v2.1/servers/f02c070c-8abf-4ee2-b228-e8f004001001 => generated 1424 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:10:56.947155 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-c3235361-b71e-4146-a52e-be2935a97901 req-93c98cbc-7ff4-4251-a9af-1770d6c3240b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f02c070c-8abf-4ee2-b228-e8f004001001", "tag": "4528b232-bf18-416d-8e63-9ebba43cd813"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:10:56.962144 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c3235361-b71e-4146-a52e-be2935a97901 req-93c98cbc-7ff4-4251-a9af-1770d6c3240b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:56.962892 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c3235361-b71e-4146-a52e-be2935a97901 req-93c98cbc-7ff4-4251-a9af-1770d6c3240b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:56.977272 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-c3235361-b71e-4146-a52e-be2935a97901 req-93c98cbc-7ff4-4251-a9af-1770d6c3240b service nova] Creating event network-changed:4528b232-bf18-416d-8e63-9ebba43cd813 for instance f02c070c-8abf-4ee2-b228-e8f004001001 on n-h1-846435-14 Jul 25 15:10:56.984915 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-c3235361-b71e-4146-a52e-be2935a97901 req-93c98cbc-7ff4-4251-a9af-1770d6c3240b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041779 Jul 25 15:10:56.986094 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3224/6670] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:10:57.003444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f639e6ec-8d1d-405b-aba8-ac0b6bf547fb tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:57.004856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f639e6ec-8d1d-405b-aba8-ac0b6bf547fb tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: f02c070c-8abf-4ee2-b228-e8f004001001] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:10:57.015795 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f639e6ec-8d1d-405b-aba8-ac0b6bf547fb tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:57.016661 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f639e6ec-8d1d-405b-aba8-ac0b6bf547fb tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:57.017545 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f639e6ec-8d1d-405b-aba8-ac0b6bf547fb tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:57.018100 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f639e6ec-8d1d-405b-aba8-ac0b6bf547fb tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:57.184704 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f639e6ec-8d1d-405b-aba8-ac0b6bf547fb tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/f02c070c-8abf-4ee2-b228-e8f004001001" status: 200 len: 1466 microversion: 2.1 time: 0.187177 Jul 25 15:10:57.185297 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3447/6671] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:10:56 2022] GET /compute/v2.1/servers/f02c070c-8abf-4ee2-b228-e8f004001001 => generated 1466 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:10:58.207261 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-75426de8-1609-4c85-acdd-9a9d21df4341 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:58.207954 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-75426de8-1609-4c85-acdd-9a9d21df4341 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: f02c070c-8abf-4ee2-b228-e8f004001001] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:10:58.214842 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-75426de8-1609-4c85-acdd-9a9d21df4341 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:58.215296 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-75426de8-1609-4c85-acdd-9a9d21df4341 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:58.216100 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-75426de8-1609-4c85-acdd-9a9d21df4341 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:58.216540 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-75426de8-1609-4c85-acdd-9a9d21df4341 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:58.771272 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-75426de8-1609-4c85-acdd-9a9d21df4341 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/f02c070c-8abf-4ee2-b228-e8f004001001" status: 200 len: 1466 microversion: 2.1 time: 0.569200 Jul 25 15:10:58.771869 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3225/6672] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:10:58 2022] GET /compute/v2.1/servers/f02c070c-8abf-4ee2-b228-e8f004001001 => generated 1466 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:10:59.792652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0a62f4ba-e4e7-4750-9b80-d94dc69fb9a7 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:10:59.793301 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0a62f4ba-e4e7-4750-9b80-d94dc69fb9a7 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: f02c070c-8abf-4ee2-b228-e8f004001001] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:10:59.800796 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0a62f4ba-e4e7-4750-9b80-d94dc69fb9a7 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:59.801305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0a62f4ba-e4e7-4750-9b80-d94dc69fb9a7 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:59.802198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0a62f4ba-e4e7-4750-9b80-d94dc69fb9a7 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:10:59.802635 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0a62f4ba-e4e7-4750-9b80-d94dc69fb9a7 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:10:59.942133 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0a62f4ba-e4e7-4750-9b80-d94dc69fb9a7 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/f02c070c-8abf-4ee2-b228-e8f004001001" status: 200 len: 1466 microversion: 2.1 time: 0.153519 Jul 25 15:10:59.943009 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3448/6673] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:10:59 2022] GET /compute/v2.1/servers/f02c070c-8abf-4ee2-b228-e8f004001001 => generated 1466 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:11:00.963045 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7ecb2d4d-ea1a-41a1-acf7-559de7f27669 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:00.963671 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7ecb2d4d-ea1a-41a1-acf7-559de7f27669 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: f02c070c-8abf-4ee2-b228-e8f004001001] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:00.971104 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ecb2d4d-ea1a-41a1-acf7-559de7f27669 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:00.971562 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ecb2d4d-ea1a-41a1-acf7-559de7f27669 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:00.972396 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ecb2d4d-ea1a-41a1-acf7-559de7f27669 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:00.972837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ecb2d4d-ea1a-41a1-acf7-559de7f27669 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:01.102401 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7ecb2d4d-ea1a-41a1-acf7-559de7f27669 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/f02c070c-8abf-4ee2-b228-e8f004001001" status: 200 len: 1466 microversion: 2.1 time: 0.143122 Jul 25 15:11:01.102977 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3226/6674] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:00 2022] GET /compute/v2.1/servers/f02c070c-8abf-4ee2-b228-e8f004001001 => generated 1466 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:11:01.777375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-b02e8a28-817e-4317-9a22-24b6975d97cf req-1aa178b0-62cd-4089-928c-6eb3ad82f1aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f02c070c-8abf-4ee2-b228-e8f004001001", "name": "network-vif-plugged", "status": "completed", "tag": "4528b232-bf18-416d-8e63-9ebba43cd813"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:11:01.790216 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-b02e8a28-817e-4317-9a22-24b6975d97cf req-1aa178b0-62cd-4089-928c-6eb3ad82f1aa service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:01.790779 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-b02e8a28-817e-4317-9a22-24b6975d97cf req-1aa178b0-62cd-4089-928c-6eb3ad82f1aa service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:01.803103 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-b02e8a28-817e-4317-9a22-24b6975d97cf req-1aa178b0-62cd-4089-928c-6eb3ad82f1aa service nova] Creating event network-vif-plugged:4528b232-bf18-416d-8e63-9ebba43cd813 for instance f02c070c-8abf-4ee2-b228-e8f004001001 on n-h1-846435-14 Jul 25 15:11:01.808905 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-b02e8a28-817e-4317-9a22-24b6975d97cf req-1aa178b0-62cd-4089-928c-6eb3ad82f1aa service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035491 Jul 25 15:11:01.810223 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3449/6675] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:11:02.122974 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ef04be2d-a8db-4aff-a166-a266cd8cca20 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:02.123679 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ef04be2d-a8db-4aff-a166-a266cd8cca20 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: f02c070c-8abf-4ee2-b228-e8f004001001] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:02.131758 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ef04be2d-a8db-4aff-a166-a266cd8cca20 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:02.132235 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ef04be2d-a8db-4aff-a166-a266cd8cca20 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:02.133037 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ef04be2d-a8db-4aff-a166-a266cd8cca20 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:02.133479 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ef04be2d-a8db-4aff-a166-a266cd8cca20 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:02.272165 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ef04be2d-a8db-4aff-a166-a266cd8cca20 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/f02c070c-8abf-4ee2-b228-e8f004001001" status: 200 len: 1466 microversion: 2.1 time: 0.152958 Jul 25 15:11:02.273034 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3227/6676] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:02 2022] GET /compute/v2.1/servers/f02c070c-8abf-4ee2-b228-e8f004001001 => generated 1466 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:11:03.294556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e8931065-b6be-4349-9d69-2863fd284024 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:03.295270 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e8931065-b6be-4349-9d69-2863fd284024 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: f02c070c-8abf-4ee2-b228-e8f004001001] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:03.302451 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e8931065-b6be-4349-9d69-2863fd284024 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:03.302916 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e8931065-b6be-4349-9d69-2863fd284024 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:03.303760 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e8931065-b6be-4349-9d69-2863fd284024 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:03.304245 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e8931065-b6be-4349-9d69-2863fd284024 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:03.443310 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e8931065-b6be-4349-9d69-2863fd284024 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/f02c070c-8abf-4ee2-b228-e8f004001001" status: 200 len: 1651 microversion: 2.1 time: 0.153717 Jul 25 15:11:03.443900 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3450/6677] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:03 2022] GET /compute/v2.1/servers/f02c070c-8abf-4ee2-b228-e8f004001001 => generated 1651 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:11:03.463647 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e1f69b07-6c20-4a7f-8a1e-b6b71258019c tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:03.464394 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e1f69b07-6c20-4a7f-8a1e-b6b71258019c tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: f02c070c-8abf-4ee2-b228-e8f004001001] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:03.472008 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e1f69b07-6c20-4a7f-8a1e-b6b71258019c tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:03.472510 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e1f69b07-6c20-4a7f-8a1e-b6b71258019c tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:03.473310 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e1f69b07-6c20-4a7f-8a1e-b6b71258019c tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:03.473824 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e1f69b07-6c20-4a7f-8a1e-b6b71258019c tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:03.610676 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e1f69b07-6c20-4a7f-8a1e-b6b71258019c tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/f02c070c-8abf-4ee2-b228-e8f004001001" status: 200 len: 1651 microversion: 2.1 time: 0.150873 Jul 25 15:11:03.611274 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3228/6678] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:03 2022] GET /compute/v2.1/servers/f02c070c-8abf-4ee2-b228-e8f004001001 => generated 1651 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:11:03.631381 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ae1ca242-2212-40a8-80a2-af33fa4a75cc tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:03.632022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ae1ca242-2212-40a8-80a2-af33fa4a75cc tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: f02c070c-8abf-4ee2-b228-e8f004001001] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:03.638596 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ae1ca242-2212-40a8-80a2-af33fa4a75cc tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:03.639062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ae1ca242-2212-40a8-80a2-af33fa4a75cc tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:03.639845 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ae1ca242-2212-40a8-80a2-af33fa4a75cc tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:03.640342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ae1ca242-2212-40a8-80a2-af33fa4a75cc tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:03.769462 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ae1ca242-2212-40a8-80a2-af33fa4a75cc tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/f02c070c-8abf-4ee2-b228-e8f004001001" status: 200 len: 1651 microversion: 2.1 time: 0.142224 Jul 25 15:11:03.770046 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3451/6679] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:03 2022] GET /compute/v2.1/servers/f02c070c-8abf-4ee2-b228-e8f004001001 => generated 1651 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:11:03.792602 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-98ce7626-ae8f-4e2d-b733-458673368a12 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:03.793254 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-98ce7626-ae8f-4e2d-b733-458673368a12 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: f02c070c-8abf-4ee2-b228-e8f004001001] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:03.802700 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-98ce7626-ae8f-4e2d-b733-458673368a12 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:03.803138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-98ce7626-ae8f-4e2d-b733-458673368a12 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:03.803896 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-98ce7626-ae8f-4e2d-b733-458673368a12 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:03.804351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-98ce7626-ae8f-4e2d-b733-458673368a12 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:03.831088 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-98ce7626-ae8f-4e2d-b733-458673368a12 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: f02c070c-8abf-4ee2-b228-e8f004001001] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:11:03.912656 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-98ce7626-ae8f-4e2d-b733-458673368a12 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "DELETE /compute/v2.1/servers/f02c070c-8abf-4ee2-b228-e8f004001001" status: 204 len: 0 microversion: 2.1 time: 0.125998 Jul 25 15:11:03.913549 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3229/6680] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:11:03 2022] DELETE /compute/v2.1/servers/f02c070c-8abf-4ee2-b228-e8f004001001 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:11:03.926760 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-925dd64e-4dad-4f73-92bb-40a8a975f1a7 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:03.927525 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-925dd64e-4dad-4f73-92bb-40a8a975f1a7 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: f02c070c-8abf-4ee2-b228-e8f004001001] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:03.935121 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-925dd64e-4dad-4f73-92bb-40a8a975f1a7 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:03.935586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-925dd64e-4dad-4f73-92bb-40a8a975f1a7 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:03.936422 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-925dd64e-4dad-4f73-92bb-40a8a975f1a7 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:03.936904 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-925dd64e-4dad-4f73-92bb-40a8a975f1a7 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:04.069290 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-925dd64e-4dad-4f73-92bb-40a8a975f1a7 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/f02c070c-8abf-4ee2-b228-e8f004001001" status: 200 len: 1657 microversion: 2.1 time: 0.147600 Jul 25 15:11:04.069930 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3452/6681] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:03 2022] GET /compute/v2.1/servers/f02c070c-8abf-4ee2-b228-e8f004001001 => generated 1657 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:11:05.091425 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d4fd5ab6-77cd-4e46-ad9b-95327569d78d tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:05.092068 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d4fd5ab6-77cd-4e46-ad9b-95327569d78d tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: f02c070c-8abf-4ee2-b228-e8f004001001] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:05.094491 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:11:05.100645 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d4fd5ab6-77cd-4e46-ad9b-95327569d78d tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:05.101103 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d4fd5ab6-77cd-4e46-ad9b-95327569d78d tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:05.101898 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d4fd5ab6-77cd-4e46-ad9b-95327569d78d tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:05.102353 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d4fd5ab6-77cd-4e46-ad9b-95327569d78d tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:05.238278 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d4fd5ab6-77cd-4e46-ad9b-95327569d78d tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/f02c070c-8abf-4ee2-b228-e8f004001001" status: 200 len: 1657 microversion: 2.1 time: 0.151238 Jul 25 15:11:05.238880 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3230/6682] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:05 2022] GET /compute/v2.1/servers/f02c070c-8abf-4ee2-b228-e8f004001001 => generated 1657 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:11:06.023025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-99c3023b-0e17-4e15-be9a-ff05980e7d0e req-ef8fb4e8-6632-4465-92ea-beb8a1a2cb19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f02c070c-8abf-4ee2-b228-e8f004001001", "name": "network-vif-deleted", "tag": "4528b232-bf18-416d-8e63-9ebba43cd813"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:11:06.031017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:11:06.031723 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:11:06.036784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-99c3023b-0e17-4e15-be9a-ff05980e7d0e req-ef8fb4e8-6632-4465-92ea-beb8a1a2cb19 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:06.037243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-99c3023b-0e17-4e15-be9a-ff05980e7d0e req-ef8fb4e8-6632-4465-92ea-beb8a1a2cb19 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:06.056777 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-99c3023b-0e17-4e15-be9a-ff05980e7d0e req-ef8fb4e8-6632-4465-92ea-beb8a1a2cb19 service nova] Creating event network-vif-deleted:4528b232-bf18-416d-8e63-9ebba43cd813 for instance f02c070c-8abf-4ee2-b228-e8f004001001 on n-h1-846435-14 Jul 25 15:11:06.063196 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-99c3023b-0e17-4e15-be9a-ff05980e7d0e req-ef8fb4e8-6632-4465-92ea-beb8a1a2cb19 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043958 Jul 25 15:11:06.063854 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3453/6683] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:11:06.259261 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1d78416f-388e-4509-ae58-df11d6dec184 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:06.259840 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1d78416f-388e-4509-ae58-df11d6dec184 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: f02c070c-8abf-4ee2-b228-e8f004001001] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:06.267316 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d78416f-388e-4509-ae58-df11d6dec184 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:06.267779 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d78416f-388e-4509-ae58-df11d6dec184 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:06.268593 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d78416f-388e-4509-ae58-df11d6dec184 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:06.269037 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d78416f-388e-4509-ae58-df11d6dec184 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:06.301759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d78416f-388e-4509-ae58-df11d6dec184 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:06.302258 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d78416f-388e-4509-ae58-df11d6dec184 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:06.302726 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-1d78416f-388e-4509-ae58-df11d6dec184 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lazy-loading 'fault' on Instance uuid f02c070c-8abf-4ee2-b228-e8f004001001 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:11:06.354281 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1d78416f-388e-4509-ae58-df11d6dec184 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/f02c070c-8abf-4ee2-b228-e8f004001001" status: 200 len: 1456 microversion: 2.1 time: 0.098765 Jul 25 15:11:06.354874 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3231/6684] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:06 2022] GET /compute/v2.1/servers/f02c070c-8abf-4ee2-b228-e8f004001001 => generated 1456 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:11:07.378178 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-035ef6e1-34bc-4733-8759-20dc6de766e4 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:07.378873 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-035ef6e1-34bc-4733-8759-20dc6de766e4 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: f02c070c-8abf-4ee2-b228-e8f004001001] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:07.386469 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-035ef6e1-34bc-4733-8759-20dc6de766e4 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:07.386966 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-035ef6e1-34bc-4733-8759-20dc6de766e4 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:07.387792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-035ef6e1-34bc-4733-8759-20dc6de766e4 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:07.388273 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-035ef6e1-34bc-4733-8759-20dc6de766e4 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:07.402948 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-035ef6e1-34bc-4733-8759-20dc6de766e4 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] HTTP exception thrown: Instance f02c070c-8abf-4ee2-b228-e8f004001001 could not be found. Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-035ef6e1-34bc-4733-8759-20dc6de766e4 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Request method failure captured: Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/f02c070c-8abf-4ee2-b228-e8f004001001 HTTP/1.1 Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3rJxV1yy-66Lc6nqmLwW8Qe8PYfpZ8bn9S29-Ibqc6J2Dx0rry2uaU17tIhgCelSpr3p6G-aCRyqWqjIg92zbDkCTvAE7hk1-1UCrTuAy3am3YfKS7NLz7nV1Rng049amz_CpQ2duHlWoOi60tYDr3Wz4fX4snMcNmh4BfJ4OnwTxCg Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: f31c20c5d5aa411bb3f89938a637a275 Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-TestServerMultinode-1919981496 Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: X-Role: admin,reader,member Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: admin,reader,member Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f31c20c5d5aa411bb3f89938a637a275"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f31c20c5d5aa411bb3f89938a637a275"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f31c20c5d5aa411bb3f89938a637a275", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f31c20c5d5aa411bb3f89938a637a275"}]}] Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-TestServerMultinode-1919981496 Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: f31c20c5d5aa411bb3f89938a637a275 Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-TestServerMultinode-1919981496 Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-TestServerMultinode-1919981496-project-admin Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 0bef25884f144ba2914b43a46d434e7b Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-TestServerMultinode-1919981496-project-admin Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance f02c070c-8abf-4ee2-b228-e8f004001001 could not be found. Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'f02c070c-8abf-4ee2-b228-e8f004001001'} Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f02c070c-8abf-4ee2-b228-e8f004001001 could not be found. Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f02c070c-8abf-4ee2-b228-e8f004001001 could not be found. Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:11:07.404694 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:11:07.409685 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:11:07.409685 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:11:07.409685 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:11:07.409685 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:11:07.409685 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:11:07.409685 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f02c070c-8abf-4ee2-b228-e8f004001001 could not be found. Jul 25 15:11:07.409685 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:11:07.409685 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-035ef6e1-34bc-4733-8759-20dc6de766e4 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Returning 404 to user: Instance f02c070c-8abf-4ee2-b228-e8f004001001 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:11:07.409685 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-035ef6e1-34bc-4733-8759-20dc6de766e4 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/f02c070c-8abf-4ee2-b228-e8f004001001" status: 404 len: 111 microversion: 2.1 time: 0.033255 Jul 25 15:11:07.409685 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3454/6685] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:07 2022] GET /compute/v2.1/servers/f02c070c-8abf-4ee2-b228-e8f004001001 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:11:07.415395 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3acbef6e-8c07-42fc-95d6-6eaa2179aae2 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:07.415939 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3acbef6e-8c07-42fc-95d6-6eaa2179aae2 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: ba88e394-2498-482d-bc2f-5c8f90b0b5e9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:07.423424 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3acbef6e-8c07-42fc-95d6-6eaa2179aae2 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:07.423890 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3acbef6e-8c07-42fc-95d6-6eaa2179aae2 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:07.424702 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3acbef6e-8c07-42fc-95d6-6eaa2179aae2 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:07.425187 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3acbef6e-8c07-42fc-95d6-6eaa2179aae2 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:07.452635 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3acbef6e-8c07-42fc-95d6-6eaa2179aae2 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: ba88e394-2498-482d-bc2f-5c8f90b0b5e9] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:11:07.480399 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:11:07.535750 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3acbef6e-8c07-42fc-95d6-6eaa2179aae2 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "DELETE /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9" status: 204 len: 0 microversion: 2.1 time: 0.123844 Jul 25 15:11:07.536492 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3232/6686] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:11:07 2022] DELETE /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:11:07.545411 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-42eb96dd-d153-436a-b6ce-e2e89c8d1edd tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:07.546099 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-42eb96dd-d153-436a-b6ce-e2e89c8d1edd tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: ba88e394-2498-482d-bc2f-5c8f90b0b5e9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:07.553051 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-42eb96dd-d153-436a-b6ce-e2e89c8d1edd tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:07.553599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-42eb96dd-d153-436a-b6ce-e2e89c8d1edd tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:07.554430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-42eb96dd-d153-436a-b6ce-e2e89c8d1edd tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:07.554958 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-42eb96dd-d153-436a-b6ce-e2e89c8d1edd tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:07.698142 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-42eb96dd-d153-436a-b6ce-e2e89c8d1edd tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9" status: 200 len: 1658 microversion: 2.1 time: 0.156787 Jul 25 15:11:07.698738 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3455/6687] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:07 2022] GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9 => generated 1658 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:11:08.719798 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-02f1a5b8-6174-4b72-bd16-34fa649a7af8 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:08.720436 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-02f1a5b8-6174-4b72-bd16-34fa649a7af8 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: ba88e394-2498-482d-bc2f-5c8f90b0b5e9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:08.728322 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-02f1a5b8-6174-4b72-bd16-34fa649a7af8 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:08.728790 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-02f1a5b8-6174-4b72-bd16-34fa649a7af8 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:08.729577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-02f1a5b8-6174-4b72-bd16-34fa649a7af8 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:08.730013 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-02f1a5b8-6174-4b72-bd16-34fa649a7af8 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:08.867692 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-02f1a5b8-6174-4b72-bd16-34fa649a7af8 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9" status: 200 len: 1658 microversion: 2.1 time: 0.152273 Jul 25 15:11:08.868343 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3233/6688] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:08 2022] GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9 => generated 1658 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:11:09.498270 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-140c7de7-835f-426f-a8ef-fe973cacbee2 req-80f22d2c-eb6d-4715-9605-839cc9157b92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba88e394-2498-482d-bc2f-5c8f90b0b5e9", "name": "network-vif-deleted", "tag": "bc4ffbd4-6564-41d6-b8f6-ecfdeb9cd201"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:11:09.512908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-140c7de7-835f-426f-a8ef-fe973cacbee2 req-80f22d2c-eb6d-4715-9605-839cc9157b92 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:09.513445 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-140c7de7-835f-426f-a8ef-fe973cacbee2 req-80f22d2c-eb6d-4715-9605-839cc9157b92 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:09.528373 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-140c7de7-835f-426f-a8ef-fe973cacbee2 req-80f22d2c-eb6d-4715-9605-839cc9157b92 service nova] Creating event network-vif-deleted:bc4ffbd4-6564-41d6-b8f6-ecfdeb9cd201 for instance ba88e394-2498-482d-bc2f-5c8f90b0b5e9 on n-h2-846435-14 Jul 25 15:11:09.535476 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-140c7de7-835f-426f-a8ef-fe973cacbee2 req-80f22d2c-eb6d-4715-9605-839cc9157b92 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041023 Jul 25 15:11:09.536552 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3456/6689] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:11:09.890295 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c4567bfd-bfb9-4500-bba9-89e9d602f1bb tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:09.890913 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c4567bfd-bfb9-4500-bba9-89e9d602f1bb tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: ba88e394-2498-482d-bc2f-5c8f90b0b5e9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:09.899715 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c4567bfd-bfb9-4500-bba9-89e9d602f1bb tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:09.900199 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c4567bfd-bfb9-4500-bba9-89e9d602f1bb tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:09.900999 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c4567bfd-bfb9-4500-bba9-89e9d602f1bb tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:09.901430 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c4567bfd-bfb9-4500-bba9-89e9d602f1bb tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:09.935072 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c4567bfd-bfb9-4500-bba9-89e9d602f1bb tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:09.935516 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c4567bfd-bfb9-4500-bba9-89e9d602f1bb tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:09.936099 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-c4567bfd-bfb9-4500-bba9-89e9d602f1bb tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lazy-loading 'fault' on Instance uuid ba88e394-2498-482d-bc2f-5c8f90b0b5e9 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:11:09.992777 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c4567bfd-bfb9-4500-bba9-89e9d602f1bb tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9" status: 200 len: 1456 microversion: 2.1 time: 0.107271 Jul 25 15:11:09.993797 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3234/6690] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:09 2022] GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9 => generated 1456 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:11:11.015276 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bc4fdbb1-f158-4d62-8680-4e255bf61cf5 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:11.015947 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bc4fdbb1-f158-4d62-8680-4e255bf61cf5 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] [instance: ba88e394-2498-482d-bc2f-5c8f90b0b5e9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:11.023593 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bc4fdbb1-f158-4d62-8680-4e255bf61cf5 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:11.024051 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bc4fdbb1-f158-4d62-8680-4e255bf61cf5 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:11.024857 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bc4fdbb1-f158-4d62-8680-4e255bf61cf5 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:11.025300 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bc4fdbb1-f158-4d62-8680-4e255bf61cf5 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:11.040265 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-bc4fdbb1-f158-4d62-8680-4e255bf61cf5 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] HTTP exception thrown: Instance ba88e394-2498-482d-bc2f-5c8f90b0b5e9 could not be found. Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bc4fdbb1-f158-4d62-8680-4e255bf61cf5 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Request method failure captured: Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9 HTTP/1.1 Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3rJxV1yy-66Lc6nqmLwW8Qe8PYfpZ8bn9S29-Ibqc6J2Dx0rry2uaU17tIhgCelSpr3p6G-aCRyqWqjIg92zbDkCTvAE7hk1-1UCrTuAy3am3YfKS7NLz7nV1Rng049amz_CpQ2duHlWoOi60tYDr3Wz4fX4snMcNmh4BfJ4OnwTxCg Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: f31c20c5d5aa411bb3f89938a637a275 Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-TestServerMultinode-1919981496 Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: X-Role: admin,reader,member Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: admin,reader,member Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f31c20c5d5aa411bb3f89938a637a275"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/f31c20c5d5aa411bb3f89938a637a275"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_f31c20c5d5aa411bb3f89938a637a275", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/f31c20c5d5aa411bb3f89938a637a275"}]}] Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-TestServerMultinode-1919981496 Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: f31c20c5d5aa411bb3f89938a637a275 Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-TestServerMultinode-1919981496 Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-TestServerMultinode-1919981496-project-admin Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 0bef25884f144ba2914b43a46d434e7b Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-TestServerMultinode-1919981496-project-admin Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance ba88e394-2498-482d-bc2f-5c8f90b0b5e9 could not be found. Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'ba88e394-2498-482d-bc2f-5c8f90b0b5e9'} Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba88e394-2498-482d-bc2f-5c8f90b0b5e9 could not be found. Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba88e394-2498-482d-bc2f-5c8f90b0b5e9 could not be found. Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:11:11.041968 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:11:11.046770 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:11:11.046770 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:11:11.046770 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:11:11.046770 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:11:11.046770 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:11:11.046770 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba88e394-2498-482d-bc2f-5c8f90b0b5e9 could not be found. Jul 25 15:11:11.046770 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:11:11.046770 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bc4fdbb1-f158-4d62-8680-4e255bf61cf5 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] Returning 404 to user: Instance ba88e394-2498-482d-bc2f-5c8f90b0b5e9 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:11:11.046770 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bc4fdbb1-f158-4d62-8680-4e255bf61cf5 tempest-TestServerMultinode-1919981496 tempest-TestServerMultinode-1919981496-project-admin] 10.222.0.88 "GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9" status: 404 len: 111 microversion: 2.1 time: 0.032359 Jul 25 15:11:11.046770 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3457/6691] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:11 2022] GET /compute/v2.1/servers/ba88e394-2498-482d-bc2f-5c8f90b0b5e9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:11:34.567680 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c3fb62c3-6a11-40b9-9f13-e09075194765 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:34.568717 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c3fb62c3-6a11-40b9-9f13-e09075194765 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:34.572472 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:11:34.573637 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=18,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:11:34.581045 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c3fb62c3-6a11-40b9-9f13-e09075194765 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:34.581506 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c3fb62c3-6a11-40b9-9f13-e09075194765 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:34.582310 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c3fb62c3-6a11-40b9-9f13-e09075194765 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:34.583412 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c3fb62c3-6a11-40b9-9f13-e09075194765 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:34.624137 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c3fb62c3-6a11-40b9-9f13-e09075194765 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:11:34.710901 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c3fb62c3-6a11-40b9-9f13-e09075194765 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "DELETE /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4" status: 204 len: 0 microversion: 2.1 time: 0.146987 Jul 25 15:11:34.711808 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3235/6692] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:11:34 2022] DELETE /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:11:34.722257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-55197930-6b0e-4a38-a650-07ba87b4f55c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:34.723843 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-55197930-6b0e-4a38-a650-07ba87b4f55c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:34.727089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:11:34.728930 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=94 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:11:34.740039 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55197930-6b0e-4a38-a650-07ba87b4f55c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:34.740536 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55197930-6b0e-4a38-a650-07ba87b4f55c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:34.741340 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55197930-6b0e-4a38-a650-07ba87b4f55c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:34.741788 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55197930-6b0e-4a38-a650-07ba87b4f55c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:34.894725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-55197930-6b0e-4a38-a650-07ba87b4f55c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:11:34.903162 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-55197930-6b0e-4a38-a650-07ba87b4f55c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4" status: 200 len: 1577 microversion: 2.1 time: 0.184886 Jul 25 15:11:34.904050 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3458/6693] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:34 2022] GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 => generated 1577 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:11:35.925731 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-88b45520-a92b-43db-908b-6e38e9b1ea2a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:35.926949 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-88b45520-a92b-43db-908b-6e38e9b1ea2a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:35.934526 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-88b45520-a92b-43db-908b-6e38e9b1ea2a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:35.934984 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-88b45520-a92b-43db-908b-6e38e9b1ea2a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:35.935764 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-88b45520-a92b-43db-908b-6e38e9b1ea2a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:35.936414 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-88b45520-a92b-43db-908b-6e38e9b1ea2a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:36.094567 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-88b45520-a92b-43db-908b-6e38e9b1ea2a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:11:36.105714 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-88b45520-a92b-43db-908b-6e38e9b1ea2a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4" status: 200 len: 1577 microversion: 2.1 time: 0.184176 Jul 25 15:11:36.106653 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3236/6694] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:35 2022] GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 => generated 1577 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:11:37.128594 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-627e2e63-2706-4cb6-a912-12b833d0a968 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:37.130319 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-627e2e63-2706-4cb6-a912-12b833d0a968 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:37.138996 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-627e2e63-2706-4cb6-a912-12b833d0a968 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:37.139761 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-627e2e63-2706-4cb6-a912-12b833d0a968 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:37.140904 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-627e2e63-2706-4cb6-a912-12b833d0a968 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:37.141361 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-627e2e63-2706-4cb6-a912-12b833d0a968 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:37.233115 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-627e2e63-2706-4cb6-a912-12b833d0a968 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:11:37.244198 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-627e2e63-2706-4cb6-a912-12b833d0a968 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4" status: 200 len: 1510 microversion: 2.1 time: 0.119873 Jul 25 15:11:37.246025 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3459/6695] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:37 2022] GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 => generated 1510 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:11:37.259303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-1ebf5fca-7cfa-414d-a231-800730049b73 req-3558c8fa-c41d-488b-aff6-74ec9e7bbc34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4", "name": "network-vif-deleted", "tag": "07e25e24-2571-49bd-b1ec-c1da154a2bac"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:11:37.295455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-1ebf5fca-7cfa-414d-a231-800730049b73 req-3558c8fa-c41d-488b-aff6-74ec9e7bbc34 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:37.296022 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-1ebf5fca-7cfa-414d-a231-800730049b73 req-3558c8fa-c41d-488b-aff6-74ec9e7bbc34 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:37.342196 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-1ebf5fca-7cfa-414d-a231-800730049b73 req-3558c8fa-c41d-488b-aff6-74ec9e7bbc34 service nova] Creating event network-vif-deleted:07e25e24-2571-49bd-b1ec-c1da154a2bac for instance 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 on n-h1-846435-14 Jul 25 15:11:37.358387 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-1ebf5fca-7cfa-414d-a231-800730049b73 req-3558c8fa-c41d-488b-aff6-74ec9e7bbc34 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103046 Jul 25 15:11:37.360097 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3237/6696] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:11:38.281630 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ee51f36b-5c6a-4d1c-8e34-68d1a376ab35 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:38.282256 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ee51f36b-5c6a-4d1c-8e34-68d1a376ab35 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:38.299329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee51f36b-5c6a-4d1c-8e34-68d1a376ab35 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:38.299931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee51f36b-5c6a-4d1c-8e34-68d1a376ab35 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:38.300950 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee51f36b-5c6a-4d1c-8e34-68d1a376ab35 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:38.301441 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee51f36b-5c6a-4d1c-8e34-68d1a376ab35 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:38.373980 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ee51f36b-5c6a-4d1c-8e34-68d1a376ab35 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:11:38.383050 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ee51f36b-5c6a-4d1c-8e34-68d1a376ab35 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4" status: 200 len: 1225 microversion: 2.1 time: 0.105404 Jul 25 15:11:38.383649 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3460/6697] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:38 2022] GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:11:39.406042 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-84373e96-7351-4f71-a84a-28c1e2964249 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:39.407405 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-84373e96-7351-4f71-a84a-28c1e2964249 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:39.414771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-84373e96-7351-4f71-a84a-28c1e2964249 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:39.415216 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-84373e96-7351-4f71-a84a-28c1e2964249 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:39.416033 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-84373e96-7351-4f71-a84a-28c1e2964249 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:39.416467 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-84373e96-7351-4f71-a84a-28c1e2964249 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:39.503877 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-84373e96-7351-4f71-a84a-28c1e2964249 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:11:39.512963 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-84373e96-7351-4f71-a84a-28c1e2964249 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4" status: 200 len: 1225 microversion: 2.1 time: 0.112424 Jul 25 15:11:39.514297 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3238/6698] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:39 2022] GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:11:40.535487 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7ccf3d97-d323-4011-bace-12292f4f4a3b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:40.537317 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7ccf3d97-d323-4011-bace-12292f4f4a3b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:40.546951 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7ccf3d97-d323-4011-bace-12292f4f4a3b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:40.547414 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7ccf3d97-d323-4011-bace-12292f4f4a3b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:40.548928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7ccf3d97-d323-4011-bace-12292f4f4a3b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:40.549710 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7ccf3d97-d323-4011-bace-12292f4f4a3b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:40.625644 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7ccf3d97-d323-4011-bace-12292f4f4a3b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:11:40.635233 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7ccf3d97-d323-4011-bace-12292f4f4a3b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4" status: 200 len: 1225 microversion: 2.1 time: 0.104618 Jul 25 15:11:40.636359 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3461/6699] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:40 2022] GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:11:41.659182 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-517d642c-d08b-450f-86f5-0f2b4e7fa1c1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:41.659821 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-517d642c-d08b-450f-86f5-0f2b4e7fa1c1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:41.669200 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-517d642c-d08b-450f-86f5-0f2b4e7fa1c1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:41.669848 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-517d642c-d08b-450f-86f5-0f2b4e7fa1c1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:41.671080 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-517d642c-d08b-450f-86f5-0f2b4e7fa1c1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:41.671735 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-517d642c-d08b-450f-86f5-0f2b4e7fa1c1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:41.744256 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-517d642c-d08b-450f-86f5-0f2b4e7fa1c1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:11:41.753257 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-517d642c-d08b-450f-86f5-0f2b4e7fa1c1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4" status: 200 len: 1225 microversion: 2.1 time: 0.100121 Jul 25 15:11:41.754792 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3239/6700] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:41 2022] GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:11:42.776799 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7bc13fa6-2877-42b0-a828-8ea124d260c8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:42.777477 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7bc13fa6-2877-42b0-a828-8ea124d260c8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:42.785575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7bc13fa6-2877-42b0-a828-8ea124d260c8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:42.786125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7bc13fa6-2877-42b0-a828-8ea124d260c8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:42.787236 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7bc13fa6-2877-42b0-a828-8ea124d260c8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:42.787685 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7bc13fa6-2877-42b0-a828-8ea124d260c8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:42.802926 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-7bc13fa6-2877-42b0-a828-8ea124d260c8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] HTTP exception thrown: Instance 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 could not be found. Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7bc13fa6-2877-42b0-a828-8ea124d260c8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Request method failure captured: Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 HTTP/1.1 Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3rDtvHLNADQM-uJ_J3klWg0FTy_E0qH1hvwasDYrxKDHzDvpYuxQ-thmFamK-Qma_d-RBIPBhjFabpJL3iCa_0TXRcnv8VILXYJZ82EcknBbgye7z_bTamQlAxPZ4RYdd06oyEONGUiMQFVcfd19pQtHuauUAFexddlrbqczpvEqs-4 Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 450a632353eb4912a87bd5efc3bf2907 Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/450a632353eb4912a87bd5efc3bf2907"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/450a632353eb4912a87bd5efc3bf2907"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_450a632353eb4912a87bd5efc3bf2907", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/450a632353eb4912a87bd5efc3bf2907"}]}] Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 450a632353eb4912a87bd5efc3bf2907 Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-TestVolumeBootPattern-1790932632-project Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: e4eae2927eb943e9ab2bb78b6b555404 Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-TestVolumeBootPattern-1790932632-project Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 could not be found. Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4'} Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 could not be found. Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 could not be found. Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:11:42.804545 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:11:42.809402 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:11:42.809402 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:11:42.809402 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:11:42.809402 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:11:42.809402 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:11:42.809402 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 could not be found. Jul 25 15:11:42.809402 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:11:42.809402 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7bc13fa6-2877-42b0-a828-8ea124d260c8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Returning 404 to user: Instance 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:11:42.809402 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7bc13fa6-2877-42b0-a828-8ea124d260c8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4" status: 404 len: 111 microversion: 2.1 time: 0.033612 Jul 25 15:11:42.809402 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3462/6701] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:42 2022] GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:11:42.919035 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fe9400ef-b549-46f9-af89-88d062de078d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-446227559", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1785943681", "security_groups": [{"name": "tempest-secgroup-smoke-576149646"}], "block_device_mapping_v2": [{"uuid": "ca728e74-2168-4586-b83e-6b2dc2a0d425", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c376c71f-de2b-4e80-ab75-8e710f8505df"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:11:43.042130 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-fe9400ef-b549-46f9-af89-88d062de078d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] validate_networks() for [('c376c71f-de2b-4e80-ab75-8e710f8505df', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:11:43.613977 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-fe9400ef-b549-46f9-af89-88d062de078d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:11:43.614525 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-fe9400ef-b549-46f9-af89-88d062de078d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:11:43.617109 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-fe9400ef-b549-46f9-af89-88d062de078d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:11:43.617109 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-fe9400ef-b549-46f9-af89-88d062de078d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:11:43.617109 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-fe9400ef-b549-46f9-af89-88d062de078d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:11:43.625541 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fe9400ef-b549-46f9-af89-88d062de078d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:43.625992 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fe9400ef-b549-46f9-af89-88d062de078d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:43.626805 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fe9400ef-b549-46f9-af89-88d062de078d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:43.627415 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fe9400ef-b549-46f9-af89-88d062de078d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:43.646173 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-fe9400ef-b549-46f9-af89-88d062de078d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Getting quotas for project 450a632353eb4912a87bd5efc3bf2907. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:11:43.652747 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-fe9400ef-b549-46f9-af89-88d062de078d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Getting quotas for user e4eae2927eb943e9ab2bb78b6b555404 and project 450a632353eb4912a87bd5efc3bf2907. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:11:43.723206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fe9400ef-b549-46f9-af89-88d062de078d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:11:43.725497 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fe9400ef-b549-46f9-af89-88d062de078d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: c787ab81-7b36-4fc3-ab2e-91bce435dbc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ca728e74-2168-4586-b83e-6b2dc2a0d425',volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:11:43.877118 n-d-846435-14 devstack@n-api.service[119303]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fe9400ef-b549-46f9-af89-88d062de078d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [65f5083c-1ce0-4f62-b916-2c16af617d4d] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 15:11:44.886385 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [None req-fe9400ef-b549-46f9-af89-88d062de078d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [65f5083c-1ce0-4f62-b916-2c16af617d4d] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 46924. Jul 25 15:11:44.891481 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fe9400ef-b549-46f9-af89-88d062de078d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.976508 Jul 25 15:11:44.898253 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3240/6702] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:11:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 1984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:11:44.903556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d206dc5f-71e7-4dfa-b55e-1106f09775da tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:44.904231 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d206dc5f-71e7-4dfa-b55e-1106f09775da tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: c787ab81-7b36-4fc3-ab2e-91bce435dbc5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:44.965440 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d206dc5f-71e7-4dfa-b55e-1106f09775da tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:11:44.975555 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d206dc5f-71e7-4dfa-b55e-1106f09775da tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5" status: 200 len: 1094 microversion: 2.1 time: 0.075827 Jul 25 15:11:44.976373 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3463/6703] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:44 2022] GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:11:45.998208 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-aba68322-3add-47fd-b5d8-2b61120a199c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:45.998897 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-aba68322-3add-47fd-b5d8-2b61120a199c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: c787ab81-7b36-4fc3-ab2e-91bce435dbc5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:46.020010 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aba68322-3add-47fd-b5d8-2b61120a199c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:46.020766 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aba68322-3add-47fd-b5d8-2b61120a199c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:46.021989 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aba68322-3add-47fd-b5d8-2b61120a199c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:46.022588 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aba68322-3add-47fd-b5d8-2b61120a199c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:46.129790 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-aba68322-3add-47fd-b5d8-2b61120a199c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:11:46.140727 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-aba68322-3add-47fd-b5d8-2b61120a199c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5" status: 200 len: 1200 microversion: 2.1 time: 0.147898 Jul 25 15:11:46.141421 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3241/6704] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:45 2022] GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5 => generated 1200 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:11:47.167536 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-efbc10f5-ee27-405f-96a1-0888a06a88d4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:47.168834 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-efbc10f5-ee27-405f-96a1-0888a06a88d4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: c787ab81-7b36-4fc3-ab2e-91bce435dbc5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:47.182515 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-efbc10f5-ee27-405f-96a1-0888a06a88d4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:47.184004 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-efbc10f5-ee27-405f-96a1-0888a06a88d4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:47.185322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-efbc10f5-ee27-405f-96a1-0888a06a88d4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:47.186804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-efbc10f5-ee27-405f-96a1-0888a06a88d4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:47.407836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-efbc10f5-ee27-405f-96a1-0888a06a88d4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:11:47.417437 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-efbc10f5-ee27-405f-96a1-0888a06a88d4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5" status: 200 len: 1277 microversion: 2.1 time: 0.257499 Jul 25 15:11:47.428392 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3464/6705] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:47 2022] GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5 => generated 1277 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:11:47.855937 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-50c02bbd-b8d8-4dc9-aacc-1b2e435ed59d req-df00560e-7074-40bb-a1e8-c13d7a148787 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c787ab81-7b36-4fc3-ab2e-91bce435dbc5", "tag": "d64621cf-2d1c-402f-ba0a-ca2e0e66f40f"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:11:47.868834 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-50c02bbd-b8d8-4dc9-aacc-1b2e435ed59d req-df00560e-7074-40bb-a1e8-c13d7a148787 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:47.869412 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-50c02bbd-b8d8-4dc9-aacc-1b2e435ed59d req-df00560e-7074-40bb-a1e8-c13d7a148787 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:47.886442 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-50c02bbd-b8d8-4dc9-aacc-1b2e435ed59d req-df00560e-7074-40bb-a1e8-c13d7a148787 service nova] Creating event network-changed:d64621cf-2d1c-402f-ba0a-ca2e0e66f40f for instance c787ab81-7b36-4fc3-ab2e-91bce435dbc5 on n-h1-846435-14 Jul 25 15:11:47.892152 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-50c02bbd-b8d8-4dc9-aacc-1b2e435ed59d req-df00560e-7074-40bb-a1e8-c13d7a148787 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.230509 Jul 25 15:11:47.893617 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3242/6706] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:11:48.442599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a0a9fdde-b982-4cce-ad46-6672d535d813 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:48.443912 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a0a9fdde-b982-4cce-ad46-6672d535d813 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: c787ab81-7b36-4fc3-ab2e-91bce435dbc5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:48.453718 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a0a9fdde-b982-4cce-ad46-6672d535d813 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:48.454184 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a0a9fdde-b982-4cce-ad46-6672d535d813 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:48.455161 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a0a9fdde-b982-4cce-ad46-6672d535d813 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:48.455884 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a0a9fdde-b982-4cce-ad46-6672d535d813 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:48.609467 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a0a9fdde-b982-4cce-ad46-6672d535d813 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:11:48.619969 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a0a9fdde-b982-4cce-ad46-6672d535d813 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5" status: 200 len: 1277 microversion: 2.1 time: 0.181629 Jul 25 15:11:48.632002 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3465/6707] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:48 2022] GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5 => generated 1277 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:11:49.643802 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-58902d0a-7862-4d3b-afcc-5835e78e6155 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:49.644620 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-58902d0a-7862-4d3b-afcc-5835e78e6155 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: c787ab81-7b36-4fc3-ab2e-91bce435dbc5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:49.651800 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-58902d0a-7862-4d3b-afcc-5835e78e6155 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:49.652454 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-58902d0a-7862-4d3b-afcc-5835e78e6155 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:49.653310 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-58902d0a-7862-4d3b-afcc-5835e78e6155 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:49.653880 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-58902d0a-7862-4d3b-afcc-5835e78e6155 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:49.792274 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-58902d0a-7862-4d3b-afcc-5835e78e6155 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:11:49.800464 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-58902d0a-7862-4d3b-afcc-5835e78e6155 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5" status: 200 len: 1277 microversion: 2.1 time: 0.161746 Jul 25 15:11:49.801058 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3243/6708] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:49 2022] GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5 => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:11:50.821418 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0d1c9283-bf38-4685-bebc-b6ba728e78a1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:50.822043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0d1c9283-bf38-4685-bebc-b6ba728e78a1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: c787ab81-7b36-4fc3-ab2e-91bce435dbc5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:50.829295 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0d1c9283-bf38-4685-bebc-b6ba728e78a1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:50.829753 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0d1c9283-bf38-4685-bebc-b6ba728e78a1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:50.830594 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0d1c9283-bf38-4685-bebc-b6ba728e78a1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:50.831031 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0d1c9283-bf38-4685-bebc-b6ba728e78a1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:50.977567 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0d1c9283-bf38-4685-bebc-b6ba728e78a1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:11:50.987166 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0d1c9283-bf38-4685-bebc-b6ba728e78a1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5" status: 200 len: 1277 microversion: 2.1 time: 0.169721 Jul 25 15:11:50.988007 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3466/6709] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:50 2022] GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5 => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:11:52.008878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8ca83157-562b-4d2f-8a2a-451ef2a9681a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:52.009495 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8ca83157-562b-4d2f-8a2a-451ef2a9681a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: c787ab81-7b36-4fc3-ab2e-91bce435dbc5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:52.017017 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ca83157-562b-4d2f-8a2a-451ef2a9681a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:52.017484 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ca83157-562b-4d2f-8a2a-451ef2a9681a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:52.018263 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ca83157-562b-4d2f-8a2a-451ef2a9681a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:52.018772 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ca83157-562b-4d2f-8a2a-451ef2a9681a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:52.153770 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8ca83157-562b-4d2f-8a2a-451ef2a9681a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:11:52.162387 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8ca83157-562b-4d2f-8a2a-451ef2a9681a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5" status: 200 len: 1277 microversion: 2.1 time: 0.157373 Jul 25 15:11:52.163163 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3244/6710] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:52 2022] GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5 => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:11:53.185341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e191857b-64c0-4919-9046-46b3956c4c32 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:53.185897 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e191857b-64c0-4919-9046-46b3956c4c32 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: c787ab81-7b36-4fc3-ab2e-91bce435dbc5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:53.193184 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e191857b-64c0-4919-9046-46b3956c4c32 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:53.193636 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e191857b-64c0-4919-9046-46b3956c4c32 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:53.194413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e191857b-64c0-4919-9046-46b3956c4c32 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:53.194854 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e191857b-64c0-4919-9046-46b3956c4c32 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:53.340505 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e191857b-64c0-4919-9046-46b3956c4c32 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:11:53.348632 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e191857b-64c0-4919-9046-46b3956c4c32 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5" status: 200 len: 1277 microversion: 2.1 time: 0.167230 Jul 25 15:11:53.349229 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3467/6711] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:53 2022] GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:11:54.370238 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7a33165b-3963-4962-8f55-42238f4ab763 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:54.370839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7a33165b-3963-4962-8f55-42238f4ab763 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: c787ab81-7b36-4fc3-ab2e-91bce435dbc5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:54.373745 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:11:54.374600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:11:54.381443 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7a33165b-3963-4962-8f55-42238f4ab763 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:54.381902 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7a33165b-3963-4962-8f55-42238f4ab763 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:54.382664 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7a33165b-3963-4962-8f55-42238f4ab763 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:54.383107 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7a33165b-3963-4962-8f55-42238f4ab763 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:54.531017 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7a33165b-3963-4962-8f55-42238f4ab763 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:11:54.539061 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7a33165b-3963-4962-8f55-42238f4ab763 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5" status: 200 len: 1265 microversion: 2.1 time: 0.172854 Jul 25 15:11:54.539718 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3245/6712] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:54 2022] GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:11:55.561262 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-daa5e34f-fc6f-4c11-90d1-f58df8d04fba tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:55.561940 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-daa5e34f-fc6f-4c11-90d1-f58df8d04fba tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: c787ab81-7b36-4fc3-ab2e-91bce435dbc5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:55.565314 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:11:55.571330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-daa5e34f-fc6f-4c11-90d1-f58df8d04fba tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:55.571788 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-daa5e34f-fc6f-4c11-90d1-f58df8d04fba tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:55.572705 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-daa5e34f-fc6f-4c11-90d1-f58df8d04fba tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:55.573198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-daa5e34f-fc6f-4c11-90d1-f58df8d04fba tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:55.715351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-daa5e34f-fc6f-4c11-90d1-f58df8d04fba tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:11:55.723032 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-daa5e34f-fc6f-4c11-90d1-f58df8d04fba tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5" status: 200 len: 1265 microversion: 2.1 time: 0.165935 Jul 25 15:11:55.723670 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3468/6713] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:55 2022] GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:11:56.744412 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6526d79a-ff00-4304-93a6-629ef8772726 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:56.745043 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6526d79a-ff00-4304-93a6-629ef8772726 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: c787ab81-7b36-4fc3-ab2e-91bce435dbc5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:56.753881 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6526d79a-ff00-4304-93a6-629ef8772726 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:56.754346 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6526d79a-ff00-4304-93a6-629ef8772726 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:56.755453 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6526d79a-ff00-4304-93a6-629ef8772726 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:56.755899 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6526d79a-ff00-4304-93a6-629ef8772726 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:56.907034 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6526d79a-ff00-4304-93a6-629ef8772726 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:11:56.919415 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6526d79a-ff00-4304-93a6-629ef8772726 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5" status: 200 len: 1265 microversion: 2.1 time: 0.179294 Jul 25 15:11:56.933280 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3246/6714] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:56 2022] GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:11:57.941148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8ea9accf-a933-44ff-83d4-96b9f97e21d5 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:57.941733 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8ea9accf-a933-44ff-83d4-96b9f97e21d5 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: c787ab81-7b36-4fc3-ab2e-91bce435dbc5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:57.948964 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8ea9accf-a933-44ff-83d4-96b9f97e21d5 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:57.949426 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8ea9accf-a933-44ff-83d4-96b9f97e21d5 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:57.950202 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8ea9accf-a933-44ff-83d4-96b9f97e21d5 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:57.950619 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8ea9accf-a933-44ff-83d4-96b9f97e21d5 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:58.085838 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8ea9accf-a933-44ff-83d4-96b9f97e21d5 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:11:58.093885 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8ea9accf-a933-44ff-83d4-96b9f97e21d5 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5" status: 200 len: 1265 microversion: 2.1 time: 0.156976 Jul 25 15:11:58.094432 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3469/6715] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:57 2022] GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:11:59.115485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3b8f8bdc-fcfe-4107-90a7-4f7fa4581f94 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:11:59.116169 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3b8f8bdc-fcfe-4107-90a7-4f7fa4581f94 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: c787ab81-7b36-4fc3-ab2e-91bce435dbc5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:11:59.123291 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b8f8bdc-fcfe-4107-90a7-4f7fa4581f94 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:59.123749 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b8f8bdc-fcfe-4107-90a7-4f7fa4581f94 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:59.124552 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b8f8bdc-fcfe-4107-90a7-4f7fa4581f94 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:11:59.125003 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b8f8bdc-fcfe-4107-90a7-4f7fa4581f94 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:11:59.262673 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3b8f8bdc-fcfe-4107-90a7-4f7fa4581f94 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:11:59.270885 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3b8f8bdc-fcfe-4107-90a7-4f7fa4581f94 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5" status: 200 len: 1265 microversion: 2.1 time: 0.159539 Jul 25 15:11:59.271469 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3247/6716] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:11:59 2022] GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:12:00.291885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9f8a2018-68b2-439d-9349-a7f3b434ef46 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:12:00.292530 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9f8a2018-68b2-439d-9349-a7f3b434ef46 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: c787ab81-7b36-4fc3-ab2e-91bce435dbc5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:12:00.300005 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f8a2018-68b2-439d-9349-a7f3b434ef46 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:12:00.300517 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f8a2018-68b2-439d-9349-a7f3b434ef46 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:12:00.301299 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f8a2018-68b2-439d-9349-a7f3b434ef46 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:12:00.301774 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f8a2018-68b2-439d-9349-a7f3b434ef46 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:12:00.448011 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9f8a2018-68b2-439d-9349-a7f3b434ef46 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:12:00.456035 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9f8a2018-68b2-439d-9349-a7f3b434ef46 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5" status: 200 len: 1265 microversion: 2.1 time: 0.168157 Jul 25 15:12:00.456900 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3470/6717] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:12:00 2022] GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:12:01.477569 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7bb24f9d-aea2-43e3-acc1-3aae21f5897a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:12:01.478307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7bb24f9d-aea2-43e3-acc1-3aae21f5897a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: c787ab81-7b36-4fc3-ab2e-91bce435dbc5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:12:01.485776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7bb24f9d-aea2-43e3-acc1-3aae21f5897a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:12:01.486237 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7bb24f9d-aea2-43e3-acc1-3aae21f5897a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:12:01.487017 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7bb24f9d-aea2-43e3-acc1-3aae21f5897a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:12:01.487678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7bb24f9d-aea2-43e3-acc1-3aae21f5897a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:12:01.632288 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7bb24f9d-aea2-43e3-acc1-3aae21f5897a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:12:01.640941 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7bb24f9d-aea2-43e3-acc1-3aae21f5897a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5" status: 200 len: 1265 microversion: 2.1 time: 0.167440 Jul 25 15:12:01.641651 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3248/6718] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:12:01 2022] GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:12:02.662845 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-479b0133-3ab7-4725-864e-3cf0a9e0dde7 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:12:02.663455 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-479b0133-3ab7-4725-864e-3cf0a9e0dde7 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: c787ab81-7b36-4fc3-ab2e-91bce435dbc5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:12:02.672343 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-479b0133-3ab7-4725-864e-3cf0a9e0dde7 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:12:02.672988 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-479b0133-3ab7-4725-864e-3cf0a9e0dde7 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:12:02.673836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-479b0133-3ab7-4725-864e-3cf0a9e0dde7 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:12:02.674353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-479b0133-3ab7-4725-864e-3cf0a9e0dde7 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:12:02.827018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-479b0133-3ab7-4725-864e-3cf0a9e0dde7 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:12:02.835241 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-479b0133-3ab7-4725-864e-3cf0a9e0dde7 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5" status: 200 len: 1265 microversion: 2.1 time: 0.176870 Jul 25 15:12:02.835803 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3471/6719] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:12:02 2022] GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:12:03.857072 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9611cb76-7cd7-42a6-8d8c-2446a13c8976 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:12:03.857970 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9611cb76-7cd7-42a6-8d8c-2446a13c8976 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: c787ab81-7b36-4fc3-ab2e-91bce435dbc5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:12:03.865450 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9611cb76-7cd7-42a6-8d8c-2446a13c8976 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:12:03.865909 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9611cb76-7cd7-42a6-8d8c-2446a13c8976 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:12:03.866684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9611cb76-7cd7-42a6-8d8c-2446a13c8976 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:12:03.867125 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9611cb76-7cd7-42a6-8d8c-2446a13c8976 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:12:04.004386 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9611cb76-7cd7-42a6-8d8c-2446a13c8976 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:12:04.013443 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9611cb76-7cd7-42a6-8d8c-2446a13c8976 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5" status: 200 len: 1265 microversion: 2.1 time: 0.160384 Jul 25 15:12:04.019147 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3249/6720] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:12:03 2022] GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:12:04.152957 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-c390c87f-2124-4835-80e5-9233c050e01d req-8a2974dd-26c8-4f8c-9374-186f0e34f7b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c787ab81-7b36-4fc3-ab2e-91bce435dbc5", "name": "network-vif-plugged", "status": "completed", "tag": "d64621cf-2d1c-402f-ba0a-ca2e0e66f40f"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:12:04.164599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c390c87f-2124-4835-80e5-9233c050e01d req-8a2974dd-26c8-4f8c-9374-186f0e34f7b5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:12:04.165058 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c390c87f-2124-4835-80e5-9233c050e01d req-8a2974dd-26c8-4f8c-9374-186f0e34f7b5 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:12:04.176822 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-c390c87f-2124-4835-80e5-9233c050e01d req-8a2974dd-26c8-4f8c-9374-186f0e34f7b5 service nova] Creating event network-vif-plugged:d64621cf-2d1c-402f-ba0a-ca2e0e66f40f for instance c787ab81-7b36-4fc3-ab2e-91bce435dbc5 on n-h1-846435-14 Jul 25 15:12:04.182099 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-c390c87f-2124-4835-80e5-9233c050e01d req-8a2974dd-26c8-4f8c-9374-186f0e34f7b5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033208 Jul 25 15:12:04.183100 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3472/6721] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:12:05.037757 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b878e13a-3760-4b24-aba8-a327203d1915 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:12:05.038358 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b878e13a-3760-4b24-aba8-a327203d1915 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: c787ab81-7b36-4fc3-ab2e-91bce435dbc5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:12:05.041160 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:12:05.049361 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b878e13a-3760-4b24-aba8-a327203d1915 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:12:05.049813 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b878e13a-3760-4b24-aba8-a327203d1915 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:12:05.050768 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b878e13a-3760-4b24-aba8-a327203d1915 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:12:05.051291 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b878e13a-3760-4b24-aba8-a327203d1915 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:12:05.057376 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:12:05.200366 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b878e13a-3760-4b24-aba8-a327203d1915 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:12:05.208248 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b878e13a-3760-4b24-aba8-a327203d1915 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5" status: 200 len: 1265 microversion: 2.1 time: 0.174614 Jul 25 15:12:05.208852 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3250/6722] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:12:05 2022] GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:12:06.230969 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ee6dc3c8-76ff-4bb4-adba-5145d95a0c7b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:12:06.231687 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ee6dc3c8-76ff-4bb4-adba-5145d95a0c7b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: c787ab81-7b36-4fc3-ab2e-91bce435dbc5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:12:06.233741 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=33 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:12:06.239777 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee6dc3c8-76ff-4bb4-adba-5145d95a0c7b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:12:06.240331 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee6dc3c8-76ff-4bb4-adba-5145d95a0c7b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:12:06.241129 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee6dc3c8-76ff-4bb4-adba-5145d95a0c7b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:12:06.241577 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee6dc3c8-76ff-4bb4-adba-5145d95a0c7b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:12:06.244529 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=77 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:12:06.403166 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ee6dc3c8-76ff-4bb4-adba-5145d95a0c7b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:12:06.411685 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ee6dc3c8-76ff-4bb4-adba-5145d95a0c7b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5" status: 200 len: 1452 microversion: 2.1 time: 0.186020 Jul 25 15:12:06.412539 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3473/6723] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:12:06 2022] GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5 => generated 1452 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:12:06.432930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0fabadc4-95a3-4925-89de-f013548d1558 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:12:06.434283 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0fabadc4-95a3-4925-89de-f013548d1558 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: c787ab81-7b36-4fc3-ab2e-91bce435dbc5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:12:06.442538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0fabadc4-95a3-4925-89de-f013548d1558 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:12:06.443404 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0fabadc4-95a3-4925-89de-f013548d1558 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:12:06.444460 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0fabadc4-95a3-4925-89de-f013548d1558 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:12:06.445150 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0fabadc4-95a3-4925-89de-f013548d1558 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:12:07.027077 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0fabadc4-95a3-4925-89de-f013548d1558 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:12:07.037471 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0fabadc4-95a3-4925-89de-f013548d1558 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5" status: 200 len: 1452 microversion: 2.1 time: 0.608193 Jul 25 15:12:07.048071 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3251/6724] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:12:06 2022] GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5 => generated 1452 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:12:08.742447 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-4534c4ed-71a6-45f7-ae55-3cf9d203002d req-8b4c33ec-f88e-472f-baee-29316fac2473 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c787ab81-7b36-4fc3-ab2e-91bce435dbc5", "tag": "d64621cf-2d1c-402f-ba0a-ca2e0e66f40f"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:12:08.753637 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-4534c4ed-71a6-45f7-ae55-3cf9d203002d req-8b4c33ec-f88e-472f-baee-29316fac2473 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:12:08.754094 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-4534c4ed-71a6-45f7-ae55-3cf9d203002d req-8b4c33ec-f88e-472f-baee-29316fac2473 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:12:08.766364 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-4534c4ed-71a6-45f7-ae55-3cf9d203002d req-8b4c33ec-f88e-472f-baee-29316fac2473 service nova] Creating event network-changed:d64621cf-2d1c-402f-ba0a-ca2e0e66f40f for instance c787ab81-7b36-4fc3-ab2e-91bce435dbc5 on n-h1-846435-14 Jul 25 15:12:08.776657 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-4534c4ed-71a6-45f7-ae55-3cf9d203002d req-8b4c33ec-f88e-472f-baee-29316fac2473 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037751 Jul 25 15:12:08.778010 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3474/6725] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:12:11.158326 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 15:12:11.159014 n-d-846435-14 devstack@n-api.service[119303]: Mon Jul 25 15:12:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 15:13:24.885311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:13:24.886072 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=11 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:13:24.890083 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d4f431c3-7791-4dd3-bfe3-6e7979d5839d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Action: 'create', calling method: .version_select at 0x7f46866de430>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-335662555", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzRXdcBfXk/PjewA+pERb2ZagYUcLYQNDmHKBiFUW71dgd1854RTSlZXvevIP7AGAW/m3UbXOZQA/FjguIDRxdeWk7YXAMBdAlzbxs1NOUPIJ90eaJNpFbv+3p8jIQ3VQ=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:13:24.907701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-d4f431c3-7791-4dd3-bfe3-6e7979d5839d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Getting quotas for project cdffd04e586c40ed82dc9d8bfccf8793. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:13:24.914012 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-d4f431c3-7791-4dd3-bfe3-6e7979d5839d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Getting quotas for user bb5707b95e3c466ea81154319bff7cc4 and project cdffd04e586c40ed82dc9d8bfccf8793. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:13:24.944542 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d4f431c3-7791-4dd3-bfe3-6e7979d5839d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.061001 Jul 25 15:13:24.945096 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3252/6726] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 15:13:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:13:26.036883 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:13:26.037775 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=7 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:13:26.042620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a5368f0f-7ccd-4932-a28e-a43fabc5fb79 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1111538072", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "bffc159d-58ec-4b60-8ae0-b4c71825f734", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-335662555", "security_groups": [{"name": "tempest-secgroup-smoke-2109967767"}], "networks": [{"uuid": "c0885a50-87ed-417c-b014-1c263941537c"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:13:26.164931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-a5368f0f-7ccd-4932-a28e-a43fabc5fb79 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] validate_networks() for [('c0885a50-87ed-417c-b014-1c263941537c', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:13:26.803177 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-a5368f0f-7ccd-4932-a28e-a43fabc5fb79 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:13:26.803642 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-a5368f0f-7ccd-4932-a28e-a43fabc5fb79 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:13:26.804155 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-a5368f0f-7ccd-4932-a28e-a43fabc5fb79 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:13:26.804573 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-a5368f0f-7ccd-4932-a28e-a43fabc5fb79 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:13:26.805023 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-a5368f0f-7ccd-4932-a28e-a43fabc5fb79 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:13:26.814866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5368f0f-7ccd-4932-a28e-a43fabc5fb79 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:26.815312 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5368f0f-7ccd-4932-a28e-a43fabc5fb79 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:26.816143 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5368f0f-7ccd-4932-a28e-a43fabc5fb79 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:26.816660 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5368f0f-7ccd-4932-a28e-a43fabc5fb79 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:26.834600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-a5368f0f-7ccd-4932-a28e-a43fabc5fb79 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Getting quotas for project cdffd04e586c40ed82dc9d8bfccf8793. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:13:26.840147 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-a5368f0f-7ccd-4932-a28e-a43fabc5fb79 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Getting quotas for user bb5707b95e3c466ea81154319bff7cc4 and project cdffd04e586c40ed82dc9d8bfccf8793. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:13:26.902330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a5368f0f-7ccd-4932-a28e-a43fabc5fb79 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:13:26.904631 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a5368f0f-7ccd-4932-a28e-a43fabc5fb79 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] [instance: c4bb2ec6-be38-4758-9b7f-fbb6cadded43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bffc159d-58ec-4b60-8ae0-b4c71825f734',volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:13:27.049643 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a5368f0f-7ccd-4932-a28e-a43fabc5fb79 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.016670 Jul 25 15:13:27.050410 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3475/6727] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:13:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:13:27.063413 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-23ddcaab-fd18-4972-b2e2-0f36d72c2cc4 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:13:27.064179 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-23ddcaab-fd18-4972-b2e2-0f36d72c2cc4 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] [instance: c4bb2ec6-be38-4758-9b7f-fbb6cadded43] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:13:27.126389 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-23ddcaab-fd18-4972-b2e2-0f36d72c2cc4 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5707b95e3c466ea81154319bff7cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdffd04e586c40ed82dc9d8bfccf8793', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:13:27.133816 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-23ddcaab-fd18-4972-b2e2-0f36d72c2cc4 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] 10.222.0.88 "GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43" status: 200 len: 1098 microversion: 2.1 time: 0.076120 Jul 25 15:13:27.134392 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3253/6728] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:13:27 2022] GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43 => generated 1098 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:13:28.155457 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ff350f54-e8ab-43de-9634-52e0eaa3525f tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:13:28.156115 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ff350f54-e8ab-43de-9634-52e0eaa3525f tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] [instance: c4bb2ec6-be38-4758-9b7f-fbb6cadded43] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:13:28.164904 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff350f54-e8ab-43de-9634-52e0eaa3525f tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:28.165373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff350f54-e8ab-43de-9634-52e0eaa3525f tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:28.166166 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff350f54-e8ab-43de-9634-52e0eaa3525f tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:28.166803 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ff350f54-e8ab-43de-9634-52e0eaa3525f tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:28.250273 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ff350f54-e8ab-43de-9634-52e0eaa3525f tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5707b95e3c466ea81154319bff7cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdffd04e586c40ed82dc9d8bfccf8793', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:13:28.261035 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ff350f54-e8ab-43de-9634-52e0eaa3525f tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] 10.222.0.88 "GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43" status: 200 len: 1214 microversion: 2.1 time: 0.109827 Jul 25 15:13:28.262199 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3476/6729] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:13:28 2022] GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43 => generated 1214 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:13:29.282083 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e8faa49c-a5ae-4b50-a529-63356abf3456 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:13:29.283371 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e8faa49c-a5ae-4b50-a529-63356abf3456 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] [instance: c4bb2ec6-be38-4758-9b7f-fbb6cadded43] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:13:29.291394 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e8faa49c-a5ae-4b50-a529-63356abf3456 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:29.291845 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e8faa49c-a5ae-4b50-a529-63356abf3456 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:29.292664 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e8faa49c-a5ae-4b50-a529-63356abf3456 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:29.293292 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e8faa49c-a5ae-4b50-a529-63356abf3456 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:29.447765 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e8faa49c-a5ae-4b50-a529-63356abf3456 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5707b95e3c466ea81154319bff7cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdffd04e586c40ed82dc9d8bfccf8793', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:13:29.456234 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e8faa49c-a5ae-4b50-a529-63356abf3456 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] 10.222.0.88 "GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43" status: 200 len: 1282 microversion: 2.1 time: 0.178164 Jul 25 15:13:29.460883 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3254/6730] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:13:29 2022] GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43 => generated 1282 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:13:29.710775 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-4ac4885f-d3aa-46ee-b100-5b2556ed7f38 req-03fddf79-5e98-48f1-91e3-7d8842414641 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4bb2ec6-be38-4758-9b7f-fbb6cadded43", "tag": "6bc1b18b-8cfd-4665-8c37-195905a9e757"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:13:29.734104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-4ac4885f-d3aa-46ee-b100-5b2556ed7f38 req-03fddf79-5e98-48f1-91e3-7d8842414641 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:29.734868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-4ac4885f-d3aa-46ee-b100-5b2556ed7f38 req-03fddf79-5e98-48f1-91e3-7d8842414641 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:29.754776 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-4ac4885f-d3aa-46ee-b100-5b2556ed7f38 req-03fddf79-5e98-48f1-91e3-7d8842414641 service nova] Creating event network-changed:6bc1b18b-8cfd-4665-8c37-195905a9e757 for instance c4bb2ec6-be38-4758-9b7f-fbb6cadded43 on n-h2-846435-14 Jul 25 15:13:29.769832 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-4ac4885f-d3aa-46ee-b100-5b2556ed7f38 req-03fddf79-5e98-48f1-91e3-7d8842414641 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064325 Jul 25 15:13:29.771466 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3477/6731] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:13:30.477259 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-27b6946f-130b-41fd-baae-eab4d808b08c tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:13:30.478172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-27b6946f-130b-41fd-baae-eab4d808b08c tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] [instance: c4bb2ec6-be38-4758-9b7f-fbb6cadded43] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:13:30.486316 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27b6946f-130b-41fd-baae-eab4d808b08c tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:30.486759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27b6946f-130b-41fd-baae-eab4d808b08c tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:30.487600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27b6946f-130b-41fd-baae-eab4d808b08c tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:30.488212 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-27b6946f-130b-41fd-baae-eab4d808b08c tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:30.653146 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-27b6946f-130b-41fd-baae-eab4d808b08c tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5707b95e3c466ea81154319bff7cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdffd04e586c40ed82dc9d8bfccf8793', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:13:30.661154 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-27b6946f-130b-41fd-baae-eab4d808b08c tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] 10.222.0.88 "GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43" status: 200 len: 1282 microversion: 2.1 time: 0.187882 Jul 25 15:13:30.661772 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3255/6732] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:13:30 2022] GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43 => generated 1282 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:13:31.683910 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2a948a54-353b-49df-b61d-6034c8b925bf tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:13:31.684539 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2a948a54-353b-49df-b61d-6034c8b925bf tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] [instance: c4bb2ec6-be38-4758-9b7f-fbb6cadded43] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:13:31.691524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2a948a54-353b-49df-b61d-6034c8b925bf tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:31.691997 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2a948a54-353b-49df-b61d-6034c8b925bf tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:31.692811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2a948a54-353b-49df-b61d-6034c8b925bf tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:31.693260 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2a948a54-353b-49df-b61d-6034c8b925bf tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:31.836890 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2a948a54-353b-49df-b61d-6034c8b925bf tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5707b95e3c466ea81154319bff7cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdffd04e586c40ed82dc9d8bfccf8793', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:13:31.844909 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2a948a54-353b-49df-b61d-6034c8b925bf tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] 10.222.0.88 "GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43" status: 200 len: 1282 microversion: 2.1 time: 0.166288 Jul 25 15:13:31.845453 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3478/6733] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:13:31 2022] GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43 => generated 1282 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:13:32.867032 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d507ea08-d99f-45ee-994e-7e705ce3ff2b tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:13:32.868676 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d507ea08-d99f-45ee-994e-7e705ce3ff2b tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] [instance: c4bb2ec6-be38-4758-9b7f-fbb6cadded43] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:13:32.877145 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d507ea08-d99f-45ee-994e-7e705ce3ff2b tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:32.877903 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d507ea08-d99f-45ee-994e-7e705ce3ff2b tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:32.878692 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d507ea08-d99f-45ee-994e-7e705ce3ff2b tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:32.879121 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d507ea08-d99f-45ee-994e-7e705ce3ff2b tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:33.028080 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d507ea08-d99f-45ee-994e-7e705ce3ff2b tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5707b95e3c466ea81154319bff7cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdffd04e586c40ed82dc9d8bfccf8793', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:13:33.035766 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d507ea08-d99f-45ee-994e-7e705ce3ff2b tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] 10.222.0.88 "GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43" status: 200 len: 1282 microversion: 2.1 time: 0.173239 Jul 25 15:13:33.045515 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3256/6734] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:13:32 2022] GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43 => generated 1282 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:13:34.056003 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-58510105-3750-4255-847b-54922a998caf tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:13:34.056652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-58510105-3750-4255-847b-54922a998caf tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] [instance: c4bb2ec6-be38-4758-9b7f-fbb6cadded43] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:13:34.064255 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-58510105-3750-4255-847b-54922a998caf tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:34.064715 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-58510105-3750-4255-847b-54922a998caf tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:34.065485 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-58510105-3750-4255-847b-54922a998caf tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:34.065921 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-58510105-3750-4255-847b-54922a998caf tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:34.207047 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-58510105-3750-4255-847b-54922a998caf tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5707b95e3c466ea81154319bff7cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdffd04e586c40ed82dc9d8bfccf8793', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:13:34.215342 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-58510105-3750-4255-847b-54922a998caf tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] 10.222.0.88 "GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43" status: 200 len: 1270 microversion: 2.1 time: 0.163346 Jul 25 15:13:34.215926 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3479/6735] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:13:34 2022] GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43 => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:13:35.236599 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-55dd4685-493f-4031-bbe8-8ed2bde13d7d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:13:35.237269 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-55dd4685-493f-4031-bbe8-8ed2bde13d7d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] [instance: c4bb2ec6-be38-4758-9b7f-fbb6cadded43] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:13:35.244684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-55dd4685-493f-4031-bbe8-8ed2bde13d7d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:35.245142 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-55dd4685-493f-4031-bbe8-8ed2bde13d7d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:35.245925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-55dd4685-493f-4031-bbe8-8ed2bde13d7d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:35.246404 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-55dd4685-493f-4031-bbe8-8ed2bde13d7d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:35.381110 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-55dd4685-493f-4031-bbe8-8ed2bde13d7d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5707b95e3c466ea81154319bff7cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdffd04e586c40ed82dc9d8bfccf8793', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:13:35.388947 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-55dd4685-493f-4031-bbe8-8ed2bde13d7d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] 10.222.0.88 "GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43" status: 200 len: 1270 microversion: 2.1 time: 0.156476 Jul 25 15:13:35.389524 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3257/6736] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:13:35 2022] GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43 => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:13:36.410104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-61fa61e1-a8c4-4251-9527-355066618729 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:13:36.410894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-61fa61e1-a8c4-4251-9527-355066618729 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] [instance: c4bb2ec6-be38-4758-9b7f-fbb6cadded43] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:13:36.418180 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-61fa61e1-a8c4-4251-9527-355066618729 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:36.418640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-61fa61e1-a8c4-4251-9527-355066618729 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:36.419429 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-61fa61e1-a8c4-4251-9527-355066618729 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:36.419875 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-61fa61e1-a8c4-4251-9527-355066618729 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:36.561509 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-61fa61e1-a8c4-4251-9527-355066618729 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5707b95e3c466ea81154319bff7cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdffd04e586c40ed82dc9d8bfccf8793', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:13:36.570007 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-61fa61e1-a8c4-4251-9527-355066618729 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] 10.222.0.88 "GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43" status: 200 len: 1270 microversion: 2.1 time: 0.163878 Jul 25 15:13:36.570625 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3480/6737] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:13:36 2022] GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43 => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:13:37.590930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-835d402d-4add-4d64-a5ce-fd1b7edf0078 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:13:37.591621 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-835d402d-4add-4d64-a5ce-fd1b7edf0078 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] [instance: c4bb2ec6-be38-4758-9b7f-fbb6cadded43] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:13:37.594376 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:13:37.600136 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-835d402d-4add-4d64-a5ce-fd1b7edf0078 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:37.600576 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-835d402d-4add-4d64-a5ce-fd1b7edf0078 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:37.601362 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-835d402d-4add-4d64-a5ce-fd1b7edf0078 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:37.601806 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-835d402d-4add-4d64-a5ce-fd1b7edf0078 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:37.753933 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-835d402d-4add-4d64-a5ce-fd1b7edf0078 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5707b95e3c466ea81154319bff7cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdffd04e586c40ed82dc9d8bfccf8793', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:13:37.762023 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-835d402d-4add-4d64-a5ce-fd1b7edf0078 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] 10.222.0.88 "GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43" status: 200 len: 1270 microversion: 2.1 time: 0.175081 Jul 25 15:13:37.762570 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3258/6738] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:13:37 2022] GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43 => generated 1270 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:13:38.783059 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-eda4aea8-9b55-4266-9590-ff001675b42d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:13:38.783624 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-eda4aea8-9b55-4266-9590-ff001675b42d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] [instance: c4bb2ec6-be38-4758-9b7f-fbb6cadded43] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:13:38.785620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:13:38.786350 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:13:38.792986 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eda4aea8-9b55-4266-9590-ff001675b42d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:38.793443 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eda4aea8-9b55-4266-9590-ff001675b42d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:38.794218 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eda4aea8-9b55-4266-9590-ff001675b42d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:38.794660 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eda4aea8-9b55-4266-9590-ff001675b42d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:38.934814 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-eda4aea8-9b55-4266-9590-ff001675b42d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5707b95e3c466ea81154319bff7cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdffd04e586c40ed82dc9d8bfccf8793', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:13:38.942975 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-eda4aea8-9b55-4266-9590-ff001675b42d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] 10.222.0.88 "GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43" status: 200 len: 1270 microversion: 2.1 time: 0.163987 Jul 25 15:13:38.943572 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3481/6739] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:13:38 2022] GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43 => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:13:39.964540 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b2d2ea78-1c2f-48fd-b727-9ec60755e967 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:13:39.965629 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b2d2ea78-1c2f-48fd-b727-9ec60755e967 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] [instance: c4bb2ec6-be38-4758-9b7f-fbb6cadded43] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:13:39.971811 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b2d2ea78-1c2f-48fd-b727-9ec60755e967 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:39.972302 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b2d2ea78-1c2f-48fd-b727-9ec60755e967 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:39.973164 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b2d2ea78-1c2f-48fd-b727-9ec60755e967 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:39.973599 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b2d2ea78-1c2f-48fd-b727-9ec60755e967 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:40.108269 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b2d2ea78-1c2f-48fd-b727-9ec60755e967 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5707b95e3c466ea81154319bff7cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdffd04e586c40ed82dc9d8bfccf8793', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:13:40.116364 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b2d2ea78-1c2f-48fd-b727-9ec60755e967 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] 10.222.0.88 "GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43" status: 200 len: 1270 microversion: 2.1 time: 0.156526 Jul 25 15:13:40.116940 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3259/6740] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:13:39 2022] GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43 => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:13:41.139685 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-20d4d154-63d8-46b6-8dc8-370649f1935d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:13:41.140558 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-20d4d154-63d8-46b6-8dc8-370649f1935d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] [instance: c4bb2ec6-be38-4758-9b7f-fbb6cadded43] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:13:41.148014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-20d4d154-63d8-46b6-8dc8-370649f1935d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:41.148509 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-20d4d154-63d8-46b6-8dc8-370649f1935d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:41.149331 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-20d4d154-63d8-46b6-8dc8-370649f1935d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:41.149780 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-20d4d154-63d8-46b6-8dc8-370649f1935d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:41.288131 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-20d4d154-63d8-46b6-8dc8-370649f1935d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5707b95e3c466ea81154319bff7cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdffd04e586c40ed82dc9d8bfccf8793', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:13:41.296500 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-20d4d154-63d8-46b6-8dc8-370649f1935d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] 10.222.0.88 "GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43" status: 200 len: 1270 microversion: 2.1 time: 0.162448 Jul 25 15:13:41.297088 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3482/6741] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:13:41 2022] GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:13:42.317952 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-56f8ec07-72db-4935-a7c8-ce8e4b84364d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:13:42.318626 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-56f8ec07-72db-4935-a7c8-ce8e4b84364d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] [instance: c4bb2ec6-be38-4758-9b7f-fbb6cadded43] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:13:42.326288 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56f8ec07-72db-4935-a7c8-ce8e4b84364d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:42.326739 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56f8ec07-72db-4935-a7c8-ce8e4b84364d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:42.327526 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56f8ec07-72db-4935-a7c8-ce8e4b84364d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:42.327963 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56f8ec07-72db-4935-a7c8-ce8e4b84364d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:42.470682 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-56f8ec07-72db-4935-a7c8-ce8e4b84364d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5707b95e3c466ea81154319bff7cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdffd04e586c40ed82dc9d8bfccf8793', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:13:42.479214 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-56f8ec07-72db-4935-a7c8-ce8e4b84364d tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] 10.222.0.88 "GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43" status: 200 len: 1270 microversion: 2.1 time: 0.165479 Jul 25 15:13:42.479805 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3260/6742] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:13:42 2022] GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43 => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:13:43.238827 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-1a3bceeb-b6fc-436e-abf8-8cb2b5b4d673 req-2958945e-2521-4615-bb57-61c2dc6aae69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4bb2ec6-be38-4758-9b7f-fbb6cadded43", "name": "network-vif-plugged", "status": "completed", "tag": "6bc1b18b-8cfd-4665-8c37-195905a9e757"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:13:43.249199 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-1a3bceeb-b6fc-436e-abf8-8cb2b5b4d673 req-2958945e-2521-4615-bb57-61c2dc6aae69 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:43.249647 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-1a3bceeb-b6fc-436e-abf8-8cb2b5b4d673 req-2958945e-2521-4615-bb57-61c2dc6aae69 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:43.262538 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-1a3bceeb-b6fc-436e-abf8-8cb2b5b4d673 req-2958945e-2521-4615-bb57-61c2dc6aae69 service nova] Creating event network-vif-plugged:6bc1b18b-8cfd-4665-8c37-195905a9e757 for instance c4bb2ec6-be38-4758-9b7f-fbb6cadded43 on n-h2-846435-14 Jul 25 15:13:43.267900 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-1a3bceeb-b6fc-436e-abf8-8cb2b5b4d673 req-2958945e-2521-4615-bb57-61c2dc6aae69 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119418 Jul 25 15:13:43.268540 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3483/6743] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:13:43.500246 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-742154bc-4854-41fe-84c0-bc7b8c2a26a9 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:13:43.500816 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-742154bc-4854-41fe-84c0-bc7b8c2a26a9 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] [instance: c4bb2ec6-be38-4758-9b7f-fbb6cadded43] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:13:43.508686 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-742154bc-4854-41fe-84c0-bc7b8c2a26a9 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:43.509139 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-742154bc-4854-41fe-84c0-bc7b8c2a26a9 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:43.509918 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-742154bc-4854-41fe-84c0-bc7b8c2a26a9 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:43.510359 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-742154bc-4854-41fe-84c0-bc7b8c2a26a9 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:43.651316 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-742154bc-4854-41fe-84c0-bc7b8c2a26a9 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5707b95e3c466ea81154319bff7cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdffd04e586c40ed82dc9d8bfccf8793', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:13:43.661650 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-742154bc-4854-41fe-84c0-bc7b8c2a26a9 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] 10.222.0.88 "GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43" status: 200 len: 1270 microversion: 2.1 time: 0.163854 Jul 25 15:13:43.666706 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3261/6744] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:13:43 2022] GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43 => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:13:44.684633 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e88e5333-af63-4a34-b9d2-c7384d3163c9 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:13:44.685350 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e88e5333-af63-4a34-b9d2-c7384d3163c9 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] [instance: c4bb2ec6-be38-4758-9b7f-fbb6cadded43] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:13:44.692727 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e88e5333-af63-4a34-b9d2-c7384d3163c9 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:44.693236 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e88e5333-af63-4a34-b9d2-c7384d3163c9 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:44.694102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e88e5333-af63-4a34-b9d2-c7384d3163c9 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:44.694606 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e88e5333-af63-4a34-b9d2-c7384d3163c9 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:44.847083 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e88e5333-af63-4a34-b9d2-c7384d3163c9 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5707b95e3c466ea81154319bff7cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdffd04e586c40ed82dc9d8bfccf8793', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:13:44.861516 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e88e5333-af63-4a34-b9d2-c7384d3163c9 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] 10.222.0.88 "GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43" status: 200 len: 1270 microversion: 2.1 time: 0.181787 Jul 25 15:13:44.862548 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3484/6745] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:13:44 2022] GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43 => generated 1270 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:13:45.886503 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d98fe6fe-37e6-4bfa-b55b-4265714abf9b tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:13:45.887210 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d98fe6fe-37e6-4bfa-b55b-4265714abf9b tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] [instance: c4bb2ec6-be38-4758-9b7f-fbb6cadded43] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:13:45.895538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d98fe6fe-37e6-4bfa-b55b-4265714abf9b tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:45.896038 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d98fe6fe-37e6-4bfa-b55b-4265714abf9b tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:45.896836 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d98fe6fe-37e6-4bfa-b55b-4265714abf9b tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:45.897286 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d98fe6fe-37e6-4bfa-b55b-4265714abf9b tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:46.042336 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d98fe6fe-37e6-4bfa-b55b-4265714abf9b tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5707b95e3c466ea81154319bff7cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdffd04e586c40ed82dc9d8bfccf8793', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:13:46.050804 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d98fe6fe-37e6-4bfa-b55b-4265714abf9b tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] 10.222.0.88 "GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43" status: 200 len: 1459 microversion: 2.1 time: 0.168462 Jul 25 15:13:46.051776 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3262/6746] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:13:45 2022] GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43 => generated 1459 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:13:46.071472 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-26b86458-5bf2-4f6e-91f7-4fc900a62346 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:13:46.072105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-26b86458-5bf2-4f6e-91f7-4fc900a62346 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] [instance: c4bb2ec6-be38-4758-9b7f-fbb6cadded43] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:13:46.079558 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26b86458-5bf2-4f6e-91f7-4fc900a62346 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:46.080047 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26b86458-5bf2-4f6e-91f7-4fc900a62346 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:46.080869 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26b86458-5bf2-4f6e-91f7-4fc900a62346 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:46.081317 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26b86458-5bf2-4f6e-91f7-4fc900a62346 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:46.219095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-26b86458-5bf2-4f6e-91f7-4fc900a62346 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5707b95e3c466ea81154319bff7cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdffd04e586c40ed82dc9d8bfccf8793', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:13:46.227245 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-26b86458-5bf2-4f6e-91f7-4fc900a62346 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] 10.222.0.88 "GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43" status: 200 len: 1459 microversion: 2.1 time: 0.159778 Jul 25 15:13:46.227813 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3485/6747] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:13:46 2022] GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43 => generated 1459 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:13:47.977302 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-d066e79d-6e81-441e-83c5-ae3385e1431e req-2543e8d0-90f7-4700-89c2-3907b961026e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4bb2ec6-be38-4758-9b7f-fbb6cadded43", "tag": "6bc1b18b-8cfd-4665-8c37-195905a9e757"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:13:47.989372 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-d066e79d-6e81-441e-83c5-ae3385e1431e req-2543e8d0-90f7-4700-89c2-3907b961026e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:47.989820 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-d066e79d-6e81-441e-83c5-ae3385e1431e req-2543e8d0-90f7-4700-89c2-3907b961026e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:48.005575 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-d066e79d-6e81-441e-83c5-ae3385e1431e req-2543e8d0-90f7-4700-89c2-3907b961026e service nova] Creating event network-changed:6bc1b18b-8cfd-4665-8c37-195905a9e757 for instance c4bb2ec6-be38-4758-9b7f-fbb6cadded43 on n-h2-846435-14 Jul 25 15:13:48.011470 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-d066e79d-6e81-441e-83c5-ae3385e1431e req-2543e8d0-90f7-4700-89c2-3907b961026e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037948 Jul 25 15:13:48.012613 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3263/6748] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:13:50.030014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-d11acbe7-9a17-4235-82df-36d8916a38ac req-76cd3c89-74c3-441a-9da7-5cefea2f8d6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4bb2ec6-be38-4758-9b7f-fbb6cadded43", "tag": "6bc1b18b-8cfd-4665-8c37-195905a9e757"}, {"name": "network-changed", "server_uuid": "c4bb2ec6-be38-4758-9b7f-fbb6cadded43", "tag": "6bc1b18b-8cfd-4665-8c37-195905a9e757"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:13:50.046733 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-d11acbe7-9a17-4235-82df-36d8916a38ac req-76cd3c89-74c3-441a-9da7-5cefea2f8d6e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:13:50.047322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-d11acbe7-9a17-4235-82df-36d8916a38ac req-76cd3c89-74c3-441a-9da7-5cefea2f8d6e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:13:50.062286 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-d11acbe7-9a17-4235-82df-36d8916a38ac req-76cd3c89-74c3-441a-9da7-5cefea2f8d6e service nova] Creating event network-changed:6bc1b18b-8cfd-4665-8c37-195905a9e757 for instance c4bb2ec6-be38-4758-9b7f-fbb6cadded43 on n-h2-846435-14 Jul 25 15:13:50.062993 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-d11acbe7-9a17-4235-82df-36d8916a38ac req-76cd3c89-74c3-441a-9da7-5cefea2f8d6e service nova] Creating event network-changed:6bc1b18b-8cfd-4665-8c37-195905a9e757 for instance c4bb2ec6-be38-4758-9b7f-fbb6cadded43 on n-h2-846435-14 Jul 25 15:13:50.071644 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-d11acbe7-9a17-4235-82df-36d8916a38ac req-76cd3c89-74c3-441a-9da7-5cefea2f8d6e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.045876 Jul 25 15:13:50.072309 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3486/6749] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:13:53.002144 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 15:13:53.003401 n-d-846435-14 devstack@n-api.service[119304]: Mon Jul 25 15:13:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 15:13:59.511199 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:13:59.512006 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=56 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:13:59.516651 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5190753e-cfe2-4c17-8409-478d6cb8f2b6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1121061865", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1785943681", "security_groups": [{"name": "tempest-secgroup-smoke-576149646"}], "block_device_mapping_v2": [{"uuid": "cfc0d3e0-cfa6-445d-9a62-e4622cb8d841", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c376c71f-de2b-4e80-ab75-8e710f8505df"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:13:59.639482 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-5190753e-cfe2-4c17-8409-478d6cb8f2b6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] validate_networks() for [('c376c71f-de2b-4e80-ab75-8e710f8505df', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:14:00.033340 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-5190753e-cfe2-4c17-8409-478d6cb8f2b6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:14:00.033806 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-5190753e-cfe2-4c17-8409-478d6cb8f2b6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:14:00.034320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-5190753e-cfe2-4c17-8409-478d6cb8f2b6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:14:00.034736 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-5190753e-cfe2-4c17-8409-478d6cb8f2b6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:14:00.035155 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-5190753e-cfe2-4c17-8409-478d6cb8f2b6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:14:00.045699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5190753e-cfe2-4c17-8409-478d6cb8f2b6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:00.046165 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5190753e-cfe2-4c17-8409-478d6cb8f2b6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:00.046975 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5190753e-cfe2-4c17-8409-478d6cb8f2b6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:00.047421 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5190753e-cfe2-4c17-8409-478d6cb8f2b6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:00.065436 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-5190753e-cfe2-4c17-8409-478d6cb8f2b6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Getting quotas for project 450a632353eb4912a87bd5efc3bf2907. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:14:00.071220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-5190753e-cfe2-4c17-8409-478d6cb8f2b6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Getting quotas for user e4eae2927eb943e9ab2bb78b6b555404 and project 450a632353eb4912a87bd5efc3bf2907. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:14:00.134477 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5190753e-cfe2-4c17-8409-478d6cb8f2b6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:14:00.136779 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5190753e-cfe2-4c17-8409-478d6cb8f2b6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cfc0d3e0-cfa6-445d-9a62-e4622cb8d841',volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:14:00.278978 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5190753e-cfe2-4c17-8409-478d6cb8f2b6 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.769621 Jul 25 15:14:00.279673 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3264/6750] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:13:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:14:00.289646 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:14:00.290332 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=56 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:14:00.295658 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b78cdbe9-d13f-4ca4-be2e-6609f9a6cc3c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:00.296181 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b78cdbe9-d13f-4ca4-be2e-6609f9a6cc3c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:14:00.355551 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b78cdbe9-d13f-4ca4-be2e-6609f9a6cc3c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:14:00.362705 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b78cdbe9-d13f-4ca4-be2e-6609f9a6cc3c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a" status: 200 len: 1095 microversion: 2.1 time: 0.075460 Jul 25 15:14:00.363289 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3487/6751] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:14:00 2022] GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:14:01.384900 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-20d829eb-8c62-4ab7-ac84-8e781b8e90d5 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:01.385578 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-20d829eb-8c62-4ab7-ac84-8e781b8e90d5 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:14:01.449847 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-20d829eb-8c62-4ab7-ac84-8e781b8e90d5 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:14:01.458508 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-20d829eb-8c62-4ab7-ac84-8e781b8e90d5 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a" status: 200 len: 1095 microversion: 2.1 time: 0.078738 Jul 25 15:14:01.459136 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3265/6752] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:14:01 2022] GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a => generated 1095 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:14:02.479390 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3b950844-6534-4cb2-b246-47eb43f81f3b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:02.480049 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3b950844-6534-4cb2-b246-47eb43f81f3b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:14:02.543106 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3b950844-6534-4cb2-b246-47eb43f81f3b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:14:02.550276 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3b950844-6534-4cb2-b246-47eb43f81f3b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a" status: 200 len: 1095 microversion: 2.1 time: 0.075035 Jul 25 15:14:02.558165 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3488/6753] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:14:02 2022] GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:14:03.571716 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7b2f2bed-7c62-401e-bed8-f996d61e7175 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:03.572392 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7b2f2bed-7c62-401e-bed8-f996d61e7175 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:14:03.630818 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7b2f2bed-7c62-401e-bed8-f996d61e7175 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:14:03.638133 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7b2f2bed-7c62-401e-bed8-f996d61e7175 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a" status: 200 len: 1095 microversion: 2.1 time: 0.070640 Jul 25 15:14:03.638776 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3266/6754] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:14:03 2022] GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:14:04.660599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f26348e0-3c7d-4114-8f44-6c661793563c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:04.661705 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f26348e0-3c7d-4114-8f44-6c661793563c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:14:04.669887 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f26348e0-3c7d-4114-8f44-6c661793563c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:04.670355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f26348e0-3c7d-4114-8f44-6c661793563c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:04.671228 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f26348e0-3c7d-4114-8f44-6c661793563c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:04.671723 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f26348e0-3c7d-4114-8f44-6c661793563c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:04.735332 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f26348e0-3c7d-4114-8f44-6c661793563c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:14:04.744011 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f26348e0-3c7d-4114-8f44-6c661793563c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a" status: 200 len: 1145 microversion: 2.1 time: 0.087527 Jul 25 15:14:04.744618 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3489/6755] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:14:04 2022] GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:14:05.765941 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9b3f2093-c700-49e9-a5b6-d12acee21f95 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:05.766801 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9b3f2093-c700-49e9-a5b6-d12acee21f95 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:14:05.774882 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9b3f2093-c700-49e9-a5b6-d12acee21f95 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:05.775623 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9b3f2093-c700-49e9-a5b6-d12acee21f95 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:05.776640 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9b3f2093-c700-49e9-a5b6-d12acee21f95 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:05.777239 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9b3f2093-c700-49e9-a5b6-d12acee21f95 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:05.867160 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9b3f2093-c700-49e9-a5b6-d12acee21f95 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:14:05.880459 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9b3f2093-c700-49e9-a5b6-d12acee21f95 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a" status: 200 len: 1211 microversion: 2.1 time: 0.118382 Jul 25 15:14:05.881409 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3267/6756] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:14:05 2022] GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a => generated 1211 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:14:06.904049 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-55748aad-965e-455e-92d5-c0d072cbe810 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:06.904682 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-55748aad-965e-455e-92d5-c0d072cbe810 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:14:06.912196 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55748aad-965e-455e-92d5-c0d072cbe810 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:06.912712 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55748aad-965e-455e-92d5-c0d072cbe810 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:06.913498 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55748aad-965e-455e-92d5-c0d072cbe810 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:06.913926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55748aad-965e-455e-92d5-c0d072cbe810 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:07.073180 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-55748aad-965e-455e-92d5-c0d072cbe810 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:14:07.081780 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-55748aad-965e-455e-92d5-c0d072cbe810 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a" status: 200 len: 1278 microversion: 2.1 time: 0.181930 Jul 25 15:14:07.082617 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3490/6757] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:14:06 2022] GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a => generated 1278 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:14:07.434178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-1a8360d4-4f0d-4101-945d-87c1cfa1a5dd req-7dc5210a-7fd8-433a-a253-b1551c172ddf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54309a94-c5a2-4bfa-9f69-f45ed394b71a", "tag": "08a08121-e532-49ad-afd6-418960d4ae01"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:14:07.462145 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-1a8360d4-4f0d-4101-945d-87c1cfa1a5dd req-7dc5210a-7fd8-433a-a253-b1551c172ddf service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:07.462926 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-1a8360d4-4f0d-4101-945d-87c1cfa1a5dd req-7dc5210a-7fd8-433a-a253-b1551c172ddf service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:07.477020 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-1a8360d4-4f0d-4101-945d-87c1cfa1a5dd req-7dc5210a-7fd8-433a-a253-b1551c172ddf service nova] Creating event network-changed:08a08121-e532-49ad-afd6-418960d4ae01 for instance 54309a94-c5a2-4bfa-9f69-f45ed394b71a on n-h1-846435-14 Jul 25 15:14:07.483059 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-1a8360d4-4f0d-4101-945d-87c1cfa1a5dd req-7dc5210a-7fd8-433a-a253-b1551c172ddf service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054945 Jul 25 15:14:07.483855 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3268/6758] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:14:08.106109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0afdf319-d125-49a8-ac94-7890eaae637a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:08.106755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0afdf319-d125-49a8-ac94-7890eaae637a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:14:08.115280 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0afdf319-d125-49a8-ac94-7890eaae637a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:08.115752 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0afdf319-d125-49a8-ac94-7890eaae637a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:08.116593 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0afdf319-d125-49a8-ac94-7890eaae637a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:08.117295 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0afdf319-d125-49a8-ac94-7890eaae637a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:08.296914 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0afdf319-d125-49a8-ac94-7890eaae637a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:14:08.307235 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0afdf319-d125-49a8-ac94-7890eaae637a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a" status: 200 len: 1278 microversion: 2.1 time: 0.205424 Jul 25 15:14:08.308060 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3491/6759] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:14:08 2022] GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a => generated 1278 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:14:09.330267 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fe81a646-9ed4-4a18-a82e-8beea8a8a764 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:09.331039 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fe81a646-9ed4-4a18-a82e-8beea8a8a764 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:14:09.338121 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fe81a646-9ed4-4a18-a82e-8beea8a8a764 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:09.338513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fe81a646-9ed4-4a18-a82e-8beea8a8a764 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:09.339423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fe81a646-9ed4-4a18-a82e-8beea8a8a764 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:09.340073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fe81a646-9ed4-4a18-a82e-8beea8a8a764 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:09.508348 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fe81a646-9ed4-4a18-a82e-8beea8a8a764 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:14:09.516544 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fe81a646-9ed4-4a18-a82e-8beea8a8a764 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a" status: 200 len: 1278 microversion: 2.1 time: 0.191598 Jul 25 15:14:09.517068 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3269/6760] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:14:09 2022] GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a => generated 1278 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:14:10.538476 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-efb196ca-0afa-4511-b5c3-88c571a2a73a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:10.539800 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-efb196ca-0afa-4511-b5c3-88c571a2a73a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:14:10.547543 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-efb196ca-0afa-4511-b5c3-88c571a2a73a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:10.548023 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-efb196ca-0afa-4511-b5c3-88c571a2a73a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:10.548827 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-efb196ca-0afa-4511-b5c3-88c571a2a73a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:10.549266 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-efb196ca-0afa-4511-b5c3-88c571a2a73a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:10.696586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-efb196ca-0afa-4511-b5c3-88c571a2a73a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:14:10.705589 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-efb196ca-0afa-4511-b5c3-88c571a2a73a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a" status: 200 len: 1278 microversion: 2.1 time: 0.171290 Jul 25 15:14:10.706694 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3492/6761] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:14:10 2022] GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a => generated 1278 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:14:11.727751 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e433b0c2-f712-4808-a78d-03c1f88a74fd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:11.728376 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e433b0c2-f712-4808-a78d-03c1f88a74fd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:14:11.730513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:14:11.737351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e433b0c2-f712-4808-a78d-03c1f88a74fd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:11.737791 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e433b0c2-f712-4808-a78d-03c1f88a74fd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:11.738559 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e433b0c2-f712-4808-a78d-03c1f88a74fd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:11.738983 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e433b0c2-f712-4808-a78d-03c1f88a74fd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:11.883324 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e433b0c2-f712-4808-a78d-03c1f88a74fd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:14:11.891366 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e433b0c2-f712-4808-a78d-03c1f88a74fd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a" status: 200 len: 1266 microversion: 2.1 time: 0.167856 Jul 25 15:14:11.891991 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3270/6762] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:14:11 2022] GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:14:12.915129 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-62be4adc-b0fd-47f4-8aef-ca3fabec7357 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:12.915869 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-62be4adc-b0fd-47f4-8aef-ca3fabec7357 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:14:12.919945 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=4 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:14:12.927469 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-62be4adc-b0fd-47f4-8aef-ca3fabec7357 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:12.928228 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-62be4adc-b0fd-47f4-8aef-ca3fabec7357 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:12.929255 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-62be4adc-b0fd-47f4-8aef-ca3fabec7357 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:12.929836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-62be4adc-b0fd-47f4-8aef-ca3fabec7357 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:13.111908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-62be4adc-b0fd-47f4-8aef-ca3fabec7357 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:14:13.120726 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-62be4adc-b0fd-47f4-8aef-ca3fabec7357 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a" status: 200 len: 1266 microversion: 2.1 time: 0.211507 Jul 25 15:14:13.121313 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3493/6763] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:14:12 2022] GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:14:14.143799 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-09f9d53b-be63-4c0e-9a01-7f7e128e809d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:14.144710 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-09f9d53b-be63-4c0e-9a01-7f7e128e809d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:14:14.147287 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=10 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:14:14.154492 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-09f9d53b-be63-4c0e-9a01-7f7e128e809d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:14.155025 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-09f9d53b-be63-4c0e-9a01-7f7e128e809d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:14.156633 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-09f9d53b-be63-4c0e-9a01-7f7e128e809d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:14.156633 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-09f9d53b-be63-4c0e-9a01-7f7e128e809d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:14.324283 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-09f9d53b-be63-4c0e-9a01-7f7e128e809d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:14:14.336337 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-09f9d53b-be63-4c0e-9a01-7f7e128e809d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a" status: 200 len: 1266 microversion: 2.1 time: 0.196902 Jul 25 15:14:14.337202 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3271/6764] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:14:14 2022] GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:14:15.358461 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-75f0d9d5-a43c-4cde-aaa9-f1e513ceb77d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:15.359114 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-75f0d9d5-a43c-4cde-aaa9-f1e513ceb77d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:14:15.367014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75f0d9d5-a43c-4cde-aaa9-f1e513ceb77d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:15.367503 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75f0d9d5-a43c-4cde-aaa9-f1e513ceb77d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:15.368332 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75f0d9d5-a43c-4cde-aaa9-f1e513ceb77d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:15.368800 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75f0d9d5-a43c-4cde-aaa9-f1e513ceb77d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:15.524104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-75f0d9d5-a43c-4cde-aaa9-f1e513ceb77d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:14:15.533323 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-75f0d9d5-a43c-4cde-aaa9-f1e513ceb77d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a" status: 200 len: 1266 microversion: 2.1 time: 0.179148 Jul 25 15:14:15.533928 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3494/6765] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:14:15 2022] GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:14:16.554055 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-75a532ec-f7eb-4caf-bea2-795a8bbc8a8a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:16.554711 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-75a532ec-f7eb-4caf-bea2-795a8bbc8a8a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:14:16.562555 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-75a532ec-f7eb-4caf-bea2-795a8bbc8a8a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:16.563073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-75a532ec-f7eb-4caf-bea2-795a8bbc8a8a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:16.563881 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-75a532ec-f7eb-4caf-bea2-795a8bbc8a8a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:16.564346 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-75a532ec-f7eb-4caf-bea2-795a8bbc8a8a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:16.711629 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-75a532ec-f7eb-4caf-bea2-795a8bbc8a8a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:14:16.719665 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-75a532ec-f7eb-4caf-bea2-795a8bbc8a8a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a" status: 200 len: 1266 microversion: 2.1 time: 0.169569 Jul 25 15:14:16.720286 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3272/6766] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:14:16 2022] GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:14:17.742408 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-706b4a46-8588-4b29-aea3-901b88f1fca1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:17.743030 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-706b4a46-8588-4b29-aea3-901b88f1fca1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:14:17.750819 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-706b4a46-8588-4b29-aea3-901b88f1fca1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:17.751301 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-706b4a46-8588-4b29-aea3-901b88f1fca1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:17.752123 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-706b4a46-8588-4b29-aea3-901b88f1fca1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:17.752895 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-706b4a46-8588-4b29-aea3-901b88f1fca1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:17.898807 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-706b4a46-8588-4b29-aea3-901b88f1fca1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:14:17.907704 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-706b4a46-8588-4b29-aea3-901b88f1fca1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a" status: 200 len: 1266 microversion: 2.1 time: 0.169442 Jul 25 15:14:17.908432 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3495/6767] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:14:17 2022] GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:14:18.929140 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ca00f462-6f54-44c9-9e58-0f4a39797969 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:18.929894 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ca00f462-6f54-44c9-9e58-0f4a39797969 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:14:18.937531 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ca00f462-6f54-44c9-9e58-0f4a39797969 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:18.938026 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ca00f462-6f54-44c9-9e58-0f4a39797969 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:18.938828 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ca00f462-6f54-44c9-9e58-0f4a39797969 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:18.939286 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ca00f462-6f54-44c9-9e58-0f4a39797969 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:19.097493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ca00f462-6f54-44c9-9e58-0f4a39797969 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:14:19.106023 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ca00f462-6f54-44c9-9e58-0f4a39797969 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a" status: 200 len: 1266 microversion: 2.1 time: 0.180827 Jul 25 15:14:19.106586 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3273/6768] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:14:18 2022] GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:14:20.127059 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-29baff89-c315-4816-a12b-6cfd78fae67b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:20.128029 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-29baff89-c315-4816-a12b-6cfd78fae67b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:14:20.135464 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-29baff89-c315-4816-a12b-6cfd78fae67b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:20.135933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-29baff89-c315-4816-a12b-6cfd78fae67b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:20.136763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-29baff89-c315-4816-a12b-6cfd78fae67b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:20.137210 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-29baff89-c315-4816-a12b-6cfd78fae67b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:20.287690 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-29baff89-c315-4816-a12b-6cfd78fae67b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:14:20.295675 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-29baff89-c315-4816-a12b-6cfd78fae67b tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a" status: 200 len: 1266 microversion: 2.1 time: 0.172628 Jul 25 15:14:20.296272 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3496/6769] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:14:20 2022] GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:14:20.681033 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-431a0257-fbbc-4601-b3eb-003d608e5422 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:20.681638 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-431a0257-fbbc-4601-b3eb-003d608e5422 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] [instance: c4bb2ec6-be38-4758-9b7f-fbb6cadded43] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:14:20.683511 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-196c7c1b-8465-4fd4-a3e1-c6eb4ecf1b1c req-43e0a1a1-8d25-4e24-b8ef-ef6743838dde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4bb2ec6-be38-4758-9b7f-fbb6cadded43", "tag": "6bc1b18b-8cfd-4665-8c37-195905a9e757"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:14:20.693968 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-196c7c1b-8465-4fd4-a3e1-c6eb4ecf1b1c req-43e0a1a1-8d25-4e24-b8ef-ef6743838dde service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:20.694426 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-196c7c1b-8465-4fd4-a3e1-c6eb4ecf1b1c req-43e0a1a1-8d25-4e24-b8ef-ef6743838dde service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:20.697543 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-431a0257-fbbc-4601-b3eb-003d608e5422 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:20.698009 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-431a0257-fbbc-4601-b3eb-003d608e5422 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:20.698848 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-431a0257-fbbc-4601-b3eb-003d608e5422 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:20.699544 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-431a0257-fbbc-4601-b3eb-003d608e5422 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:20.710039 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-196c7c1b-8465-4fd4-a3e1-c6eb4ecf1b1c req-43e0a1a1-8d25-4e24-b8ef-ef6743838dde service nova] Creating event network-changed:6bc1b18b-8cfd-4665-8c37-195905a9e757 for instance c4bb2ec6-be38-4758-9b7f-fbb6cadded43 on n-h2-846435-14 Jul 25 15:14:20.717878 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-196c7c1b-8465-4fd4-a3e1-c6eb4ecf1b1c req-43e0a1a1-8d25-4e24-b8ef-ef6743838dde service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037957 Jul 25 15:14:20.720402 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3497/6770] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:14:20.728192 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-431a0257-fbbc-4601-b3eb-003d608e5422 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] [instance: c4bb2ec6-be38-4758-9b7f-fbb6cadded43] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:14:20.836875 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-431a0257-fbbc-4601-b3eb-003d608e5422 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43" status: 204 len: 0 microversion: 2.1 time: 0.158773 Jul 25 15:14:20.837839 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3274/6771] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:14:20 2022] DELETE /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:14:20.846544 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-482a9194-a814-4722-93ad-9ae47b314f0b tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:20.847274 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-482a9194-a814-4722-93ad-9ae47b314f0b tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] [instance: c4bb2ec6-be38-4758-9b7f-fbb6cadded43] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:14:20.855853 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-482a9194-a814-4722-93ad-9ae47b314f0b tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:20.856426 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-482a9194-a814-4722-93ad-9ae47b314f0b tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:20.857227 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-482a9194-a814-4722-93ad-9ae47b314f0b tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:20.857670 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-482a9194-a814-4722-93ad-9ae47b314f0b tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:21.035138 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-482a9194-a814-4722-93ad-9ae47b314f0b tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5707b95e3c466ea81154319bff7cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdffd04e586c40ed82dc9d8bfccf8793', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:14:21.043418 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-482a9194-a814-4722-93ad-9ae47b314f0b tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] 10.222.0.88 "GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43" status: 200 len: 1584 microversion: 2.1 time: 0.201150 Jul 25 15:14:21.044683 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3498/6772] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:14:20 2022] GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43 => generated 1584 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:14:21.319047 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7d648ec7-20ab-4c4f-ad3f-3a88565e055c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:21.319778 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7d648ec7-20ab-4c4f-ad3f-3a88565e055c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:14:21.326906 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7d648ec7-20ab-4c4f-ad3f-3a88565e055c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:21.327380 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7d648ec7-20ab-4c4f-ad3f-3a88565e055c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:21.328235 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7d648ec7-20ab-4c4f-ad3f-3a88565e055c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:21.328688 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7d648ec7-20ab-4c4f-ad3f-3a88565e055c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:21.474629 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7d648ec7-20ab-4c4f-ad3f-3a88565e055c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:14:21.482649 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7d648ec7-20ab-4c4f-ad3f-3a88565e055c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a" status: 200 len: 1266 microversion: 2.1 time: 0.168726 Jul 25 15:14:21.483241 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3275/6773] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:14:21 2022] GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:14:22.066209 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-688316bb-bc0b-430f-8021-70681d25895f tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:22.066799 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-688316bb-bc0b-430f-8021-70681d25895f tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] [instance: c4bb2ec6-be38-4758-9b7f-fbb6cadded43] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:14:22.075399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-688316bb-bc0b-430f-8021-70681d25895f tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:22.075865 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-688316bb-bc0b-430f-8021-70681d25895f tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:22.076699 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-688316bb-bc0b-430f-8021-70681d25895f tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:22.077121 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-688316bb-bc0b-430f-8021-70681d25895f tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:22.259935 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-688316bb-bc0b-430f-8021-70681d25895f tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5707b95e3c466ea81154319bff7cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdffd04e586c40ed82dc9d8bfccf8793', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:14:22.268260 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-688316bb-bc0b-430f-8021-70681d25895f tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] 10.222.0.88 "GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43" status: 200 len: 1584 microversion: 2.1 time: 0.206101 Jul 25 15:14:22.268808 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3499/6774] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:14:22 2022] GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43 => generated 1584 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:14:22.505136 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ea478f78-2c3d-4c9f-868c-8d1a0fb840a1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:22.505717 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ea478f78-2c3d-4c9f-868c-8d1a0fb840a1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:14:22.513238 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ea478f78-2c3d-4c9f-868c-8d1a0fb840a1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:22.513689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ea478f78-2c3d-4c9f-868c-8d1a0fb840a1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:22.514465 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ea478f78-2c3d-4c9f-868c-8d1a0fb840a1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:22.514903 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ea478f78-2c3d-4c9f-868c-8d1a0fb840a1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:22.657977 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ea478f78-2c3d-4c9f-868c-8d1a0fb840a1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:14:22.667708 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ea478f78-2c3d-4c9f-868c-8d1a0fb840a1 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a" status: 200 len: 1266 microversion: 2.1 time: 0.166947 Jul 25 15:14:22.672016 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3276/6775] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:14:22 2022] GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:14:22.798730 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-3a9157c0-2d9d-4028-967b-3a44b0302b3a req-904f2fca-d47d-4d77-a2c9-6ba86b25602c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54309a94-c5a2-4bfa-9f69-f45ed394b71a", "name": "network-vif-plugged", "status": "completed", "tag": "08a08121-e532-49ad-afd6-418960d4ae01"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:14:22.810160 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-3a9157c0-2d9d-4028-967b-3a44b0302b3a req-904f2fca-d47d-4d77-a2c9-6ba86b25602c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:22.811109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-3a9157c0-2d9d-4028-967b-3a44b0302b3a req-904f2fca-d47d-4d77-a2c9-6ba86b25602c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:22.824612 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-3a9157c0-2d9d-4028-967b-3a44b0302b3a req-904f2fca-d47d-4d77-a2c9-6ba86b25602c service nova] Creating event network-vif-plugged:08a08121-e532-49ad-afd6-418960d4ae01 for instance 54309a94-c5a2-4bfa-9f69-f45ed394b71a on n-h1-846435-14 Jul 25 15:14:22.830772 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-3a9157c0-2d9d-4028-967b-3a44b0302b3a req-904f2fca-d47d-4d77-a2c9-6ba86b25602c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035993 Jul 25 15:14:22.831733 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3500/6776] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:14:23.071209 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-1ede607f-d6d3-4f82-90ae-35d922a2c60c req-59e26954-b995-40cf-ab40-6e7e3c3b4da6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4bb2ec6-be38-4758-9b7f-fbb6cadded43", "name": "network-vif-deleted", "tag": "6bc1b18b-8cfd-4665-8c37-195905a9e757"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:14:23.082706 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-1ede607f-d6d3-4f82-90ae-35d922a2c60c req-59e26954-b995-40cf-ab40-6e7e3c3b4da6 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:23.083150 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-1ede607f-d6d3-4f82-90ae-35d922a2c60c req-59e26954-b995-40cf-ab40-6e7e3c3b4da6 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:23.096030 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-1ede607f-d6d3-4f82-90ae-35d922a2c60c req-59e26954-b995-40cf-ab40-6e7e3c3b4da6 service nova] Creating event network-vif-deleted:6bc1b18b-8cfd-4665-8c37-195905a9e757 for instance c4bb2ec6-be38-4758-9b7f-fbb6cadded43 on n-h2-846435-14 Jul 25 15:14:23.101534 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-1ede607f-d6d3-4f82-90ae-35d922a2c60c req-59e26954-b995-40cf-ab40-6e7e3c3b4da6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034292 Jul 25 15:14:23.102272 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3277/6777] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:14:23.292021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-698ceba5-3eca-4307-96c1-5a6fcec722f7 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:23.292634 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-698ceba5-3eca-4307-96c1-5a6fcec722f7 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] [instance: c4bb2ec6-be38-4758-9b7f-fbb6cadded43] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:14:23.305280 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-698ceba5-3eca-4307-96c1-5a6fcec722f7 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:23.305741 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-698ceba5-3eca-4307-96c1-5a6fcec722f7 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:23.306688 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-698ceba5-3eca-4307-96c1-5a6fcec722f7 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:23.307145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-698ceba5-3eca-4307-96c1-5a6fcec722f7 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:23.383490 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-698ceba5-3eca-4307-96c1-5a6fcec722f7 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5707b95e3c466ea81154319bff7cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdffd04e586c40ed82dc9d8bfccf8793', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:14:23.398606 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-698ceba5-3eca-4307-96c1-5a6fcec722f7 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] 10.222.0.88 "GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43" status: 200 len: 1229 microversion: 2.1 time: 0.112194 Jul 25 15:14:23.399241 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3501/6778] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:14:23 2022] GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43 => generated 1229 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:14:23.693474 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-816a689c-1988-4e55-aea1-fc2cb1c64705 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:23.694396 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-816a689c-1988-4e55-aea1-fc2cb1c64705 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:14:23.701997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-816a689c-1988-4e55-aea1-fc2cb1c64705 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:23.702543 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-816a689c-1988-4e55-aea1-fc2cb1c64705 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:23.703405 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-816a689c-1988-4e55-aea1-fc2cb1c64705 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:23.703926 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-816a689c-1988-4e55-aea1-fc2cb1c64705 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:23.844074 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-816a689c-1988-4e55-aea1-fc2cb1c64705 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:14:23.852235 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-816a689c-1988-4e55-aea1-fc2cb1c64705 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a" status: 200 len: 1266 microversion: 2.1 time: 0.165039 Jul 25 15:14:23.852805 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3278/6779] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:14:23 2022] GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:14:24.419635 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-968c7a85-81f5-40af-95c7-473841f2b0d0 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:24.420356 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-968c7a85-81f5-40af-95c7-473841f2b0d0 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] [instance: c4bb2ec6-be38-4758-9b7f-fbb6cadded43] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:14:24.428129 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-968c7a85-81f5-40af-95c7-473841f2b0d0 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:24.428751 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-968c7a85-81f5-40af-95c7-473841f2b0d0 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:24.429679 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-968c7a85-81f5-40af-95c7-473841f2b0d0 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:24.430257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-968c7a85-81f5-40af-95c7-473841f2b0d0 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:24.497209 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-968c7a85-81f5-40af-95c7-473841f2b0d0 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5707b95e3c466ea81154319bff7cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdffd04e586c40ed82dc9d8bfccf8793', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:14:24.505731 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-968c7a85-81f5-40af-95c7-473841f2b0d0 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] 10.222.0.88 "GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43" status: 200 len: 1229 microversion: 2.1 time: 0.090457 Jul 25 15:14:24.506320 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3502/6780] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:14:24 2022] GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43 => generated 1229 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:14:24.874376 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-958c1e99-a2f0-48c3-a14f-fcb257fa6c56 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:24.875004 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-958c1e99-a2f0-48c3-a14f-fcb257fa6c56 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:14:24.883044 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-958c1e99-a2f0-48c3-a14f-fcb257fa6c56 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:24.883492 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-958c1e99-a2f0-48c3-a14f-fcb257fa6c56 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:24.884325 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-958c1e99-a2f0-48c3-a14f-fcb257fa6c56 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:24.884894 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-958c1e99-a2f0-48c3-a14f-fcb257fa6c56 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:25.035866 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-958c1e99-a2f0-48c3-a14f-fcb257fa6c56 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:14:25.044145 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-958c1e99-a2f0-48c3-a14f-fcb257fa6c56 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a" status: 200 len: 1454 microversion: 2.1 time: 0.174107 Jul 25 15:14:25.044759 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3279/6781] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:14:24 2022] GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a => generated 1454 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:14:25.064879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7fda5281-787b-4211-88d9-8a3bcc0304af tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:25.065650 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7fda5281-787b-4211-88d9-8a3bcc0304af tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:14:25.072374 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7fda5281-787b-4211-88d9-8a3bcc0304af tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:25.072949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7fda5281-787b-4211-88d9-8a3bcc0304af tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:25.074160 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7fda5281-787b-4211-88d9-8a3bcc0304af tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:25.074702 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7fda5281-787b-4211-88d9-8a3bcc0304af tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:25.230466 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7fda5281-787b-4211-88d9-8a3bcc0304af tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:14:25.238509 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7fda5281-787b-4211-88d9-8a3bcc0304af tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a" status: 200 len: 1454 microversion: 2.1 time: 0.177800 Jul 25 15:14:25.239328 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3503/6782] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:14:25 2022] GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a => generated 1454 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:14:25.527134 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a0a6fa77-125e-4c0a-abbb-401ad431b44b tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:25.527912 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a0a6fa77-125e-4c0a-abbb-401ad431b44b tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] [instance: c4bb2ec6-be38-4758-9b7f-fbb6cadded43] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:14:25.534883 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a0a6fa77-125e-4c0a-abbb-401ad431b44b tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:25.535690 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a0a6fa77-125e-4c0a-abbb-401ad431b44b tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:25.536829 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a0a6fa77-125e-4c0a-abbb-401ad431b44b tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:25.537332 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a0a6fa77-125e-4c0a-abbb-401ad431b44b tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:25.606492 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a0a6fa77-125e-4c0a-abbb-401ad431b44b tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5707b95e3c466ea81154319bff7cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdffd04e586c40ed82dc9d8bfccf8793', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:14:25.615144 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a0a6fa77-125e-4c0a-abbb-401ad431b44b tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] 10.222.0.88 "GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43" status: 200 len: 1229 microversion: 2.1 time: 0.092010 Jul 25 15:14:25.628622 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3280/6783] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:14:25 2022] GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43 => generated 1229 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:14:26.638574 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e7d12a65-1c21-4954-93e1-8db2d7f7913a tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:26.640017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e7d12a65-1c21-4954-93e1-8db2d7f7913a tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] [instance: c4bb2ec6-be38-4758-9b7f-fbb6cadded43] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:14:26.648354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e7d12a65-1c21-4954-93e1-8db2d7f7913a tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:26.649167 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e7d12a65-1c21-4954-93e1-8db2d7f7913a tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:26.650005 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e7d12a65-1c21-4954-93e1-8db2d7f7913a tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:26.650450 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e7d12a65-1c21-4954-93e1-8db2d7f7913a tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:26.886600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e7d12a65-1c21-4954-93e1-8db2d7f7913a tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5707b95e3c466ea81154319bff7cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdffd04e586c40ed82dc9d8bfccf8793', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:14:26.895347 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e7d12a65-1c21-4954-93e1-8db2d7f7913a tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] 10.222.0.88 "GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43" status: 200 len: 1229 microversion: 2.1 time: 0.261359 Jul 25 15:14:26.896057 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3504/6784] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:14:26 2022] GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43 => generated 1229 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:14:27.291309 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-c07a0e23-cc9f-476f-b864-73147a0cdd0e req-7c16d878-08eb-4413-8889-2a86c0463476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54309a94-c5a2-4bfa-9f69-f45ed394b71a", "tag": "08a08121-e532-49ad-afd6-418960d4ae01"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:14:27.302606 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c07a0e23-cc9f-476f-b864-73147a0cdd0e req-7c16d878-08eb-4413-8889-2a86c0463476 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:27.303038 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c07a0e23-cc9f-476f-b864-73147a0cdd0e req-7c16d878-08eb-4413-8889-2a86c0463476 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:27.315883 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-c07a0e23-cc9f-476f-b864-73147a0cdd0e req-7c16d878-08eb-4413-8889-2a86c0463476 service nova] Creating event network-changed:08a08121-e532-49ad-afd6-418960d4ae01 for instance 54309a94-c5a2-4bfa-9f69-f45ed394b71a on n-h1-846435-14 Jul 25 15:14:27.321630 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-c07a0e23-cc9f-476f-b864-73147a0cdd0e req-7c16d878-08eb-4413-8889-2a86c0463476 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034143 Jul 25 15:14:27.322816 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3281/6785] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:14:27.917714 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-28886432-c805-40ba-92c5-69f42bde0e34 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:27.919151 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-28886432-c805-40ba-92c5-69f42bde0e34 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] [instance: c4bb2ec6-be38-4758-9b7f-fbb6cadded43] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:14:27.927761 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28886432-c805-40ba-92c5-69f42bde0e34 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:27.928248 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28886432-c805-40ba-92c5-69f42bde0e34 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:27.929923 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28886432-c805-40ba-92c5-69f42bde0e34 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:27.930401 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28886432-c805-40ba-92c5-69f42bde0e34 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:27.965648 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28886432-c805-40ba-92c5-69f42bde0e34 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:27.966107 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28886432-c805-40ba-92c5-69f42bde0e34 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:27.966575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-28886432-c805-40ba-92c5-69f42bde0e34 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lazy-loading 'fault' on Instance uuid c4bb2ec6-be38-4758-9b7f-fbb6cadded43 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:14:28.013188 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-28886432-c805-40ba-92c5-69f42bde0e34 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5707b95e3c466ea81154319bff7cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdffd04e586c40ed82dc9d8bfccf8793', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:14:28.022212 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-28886432-c805-40ba-92c5-69f42bde0e34 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] 10.222.0.88 "GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43" status: 200 len: 1234 microversion: 2.1 time: 0.108826 Jul 25 15:14:28.028109 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3505/6786] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:14:27 2022] GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43 => generated 1234 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:14:29.044968 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-967e66d0-1a39-4e3b-a767-1790713e03cf tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:29.045681 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-967e66d0-1a39-4e3b-a767-1790713e03cf tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] [instance: c4bb2ec6-be38-4758-9b7f-fbb6cadded43] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:14:29.052714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-967e66d0-1a39-4e3b-a767-1790713e03cf tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:29.053168 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-967e66d0-1a39-4e3b-a767-1790713e03cf tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:29.053934 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-967e66d0-1a39-4e3b-a767-1790713e03cf tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:14:29.054376 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-967e66d0-1a39-4e3b-a767-1790713e03cf tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:14:29.069370 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-967e66d0-1a39-4e3b-a767-1790713e03cf tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] HTTP exception thrown: Instance c4bb2ec6-be38-4758-9b7f-fbb6cadded43 could not be found. Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-967e66d0-1a39-4e3b-a767-1790713e03cf tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Request method failure captured: Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43 HTTP/1.1 Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rKblcpxkXEtm0PE3upYuJYNNp1Tap5nXRDW2mUm2zQRDP9XKIagiksN6M2g8nJIlxUsqvLHKsM2J7DnqAcnSfXIsB_pPkIgiVNvGX2zuUFup2gf10CX3AfA0-JAcPYkga3SmvXHVo5gWMVGwf9HZyV40e-kZ4aeWY7WtsjbroqnmcM Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: cdffd04e586c40ed82dc9d8bfccf8793 Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-TestVolumeBackupRestore-182327414 Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/cdffd04e586c40ed82dc9d8bfccf8793"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/cdffd04e586c40ed82dc9d8bfccf8793"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_cdffd04e586c40ed82dc9d8bfccf8793", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/cdffd04e586c40ed82dc9d8bfccf8793"}]}] Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-TestVolumeBackupRestore-182327414 Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: cdffd04e586c40ed82dc9d8bfccf8793 Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-TestVolumeBackupRestore-182327414 Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-TestVolumeBackupRestore-182327414-project Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: bb5707b95e3c466ea81154319bff7cc4 Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-TestVolumeBackupRestore-182327414-project Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance c4bb2ec6-be38-4758-9b7f-fbb6cadded43 could not be found. Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'c4bb2ec6-be38-4758-9b7f-fbb6cadded43'} Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4bb2ec6-be38-4758-9b7f-fbb6cadded43 could not be found. Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4bb2ec6-be38-4758-9b7f-fbb6cadded43 could not be found. Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:14:29.071098 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:14:29.076737 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:14:29.076737 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:14:29.076737 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:14:29.076737 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:14:29.076737 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:14:29.076737 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4bb2ec6-be38-4758-9b7f-fbb6cadded43 could not be found. Jul 25 15:14:29.076737 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:14:29.076737 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-967e66d0-1a39-4e3b-a767-1790713e03cf tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Returning 404 to user: Instance c4bb2ec6-be38-4758-9b7f-fbb6cadded43 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:14:29.076737 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-967e66d0-1a39-4e3b-a767-1790713e03cf tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] 10.222.0.88 "GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43" status: 404 len: 111 microversion: 2.1 time: 0.032989 Jul 25 15:14:29.076737 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3282/6787] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:14:29 2022] GET /compute/v2.1/servers/c4bb2ec6-be38-4758-9b7f-fbb6cadded43 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:14:29.260362 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d05796c3-662d-4683-b062-e16451aca159 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] Calling method '.version_select at 0x7f46988f0b80>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:14:29.290591 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d05796c3-662d-4683-b062-e16451aca159 tempest-TestVolumeBackupRestore-182327414 tempest-TestVolumeBackupRestore-182327414-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-335662555" status: 202 len: 0 microversion: 2.1 time: 0.034086 Jul 25 15:14:29.291109 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3506/6788] 10.222.0.88 () {58 vars in 1266 bytes} [Mon Jul 25 15:14:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-335662555 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:15:59.567271 n-d-846435-14 devstack@n-api.service[119303]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c17eba8c-cddd-4f98-b66f-c71ea3b6f89c] AMQP server on 10.222.0.88:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 15:15:59.568128 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:15:59.568993 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:15:59.570552 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=96 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:15:59.571678 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:15:59.574432 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b489403e-e451-4411-a3e5-cf0a5835e875 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:15:59.575024 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b489403e-e451-4411-a3e5-cf0a5835e875 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:15:59.576300 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-32c5f4b9-c9df-4d3f-b658-da7dfd0acacc req-0625bb15-a46d-4557-a675-f857ebc15155 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54309a94-c5a2-4bfa-9f69-f45ed394b71a", "tag": "08a08121-e532-49ad-afd6-418960d4ae01"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:15:59.584520 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b489403e-e451-4411-a3e5-cf0a5835e875 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:15:59.585035 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b489403e-e451-4411-a3e5-cf0a5835e875 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:15:59.585889 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b489403e-e451-4411-a3e5-cf0a5835e875 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:15:59.586307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b489403e-e451-4411-a3e5-cf0a5835e875 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:15:59.590725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-32c5f4b9-c9df-4d3f-b658-da7dfd0acacc req-0625bb15-a46d-4557-a675-f857ebc15155 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:15:59.592525 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-32c5f4b9-c9df-4d3f-b658-da7dfd0acacc req-0625bb15-a46d-4557-a675-f857ebc15155 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:15:59.602934 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-32c5f4b9-c9df-4d3f-b658-da7dfd0acacc req-0625bb15-a46d-4557-a675-f857ebc15155 service nova] Creating event network-changed:08a08121-e532-49ad-afd6-418960d4ae01 for instance 54309a94-c5a2-4bfa-9f69-f45ed394b71a on n-h1-846435-14 Jul 25 15:15:59.608428 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-32c5f4b9-c9df-4d3f-b658-da7dfd0acacc req-0625bb15-a46d-4557-a675-f857ebc15155 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040807 Jul 25 15:15:59.609515 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3507/6789] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:15:59.615943 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b489403e-e451-4411-a3e5-cf0a5835e875 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:15:59.704669 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b489403e-e451-4411-a3e5-cf0a5835e875 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "DELETE /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a" status: 204 len: 0 microversion: 2.1 time: 0.139697 Jul 25 15:15:59.708896 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3283/6790] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:15:59 2022] DELETE /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:15:59.716778 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ac587623-0b1b-4ce2-8000-e43fa9927524 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:15:59.717688 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ac587623-0b1b-4ce2-8000-e43fa9927524 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:15:59.725324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac587623-0b1b-4ce2-8000-e43fa9927524 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:15:59.725874 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac587623-0b1b-4ce2-8000-e43fa9927524 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:15:59.726785 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac587623-0b1b-4ce2-8000-e43fa9927524 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:15:59.728125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ac587623-0b1b-4ce2-8000-e43fa9927524 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:00.052153 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ac587623-0b1b-4ce2-8000-e43fa9927524 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:16:00.060662 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ac587623-0b1b-4ce2-8000-e43fa9927524 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a" status: 200 len: 1579 microversion: 2.1 time: 0.349907 Jul 25 15:16:00.061320 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3508/6791] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:15:59 2022] GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a => generated 1579 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:16:01.083259 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0f9abf51-ff88-42d5-9b04-98e2cc8020fd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:16:01.083998 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0f9abf51-ff88-42d5-9b04-98e2cc8020fd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:16:01.092381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f9abf51-ff88-42d5-9b04-98e2cc8020fd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:01.092846 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f9abf51-ff88-42d5-9b04-98e2cc8020fd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:01.093629 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f9abf51-ff88-42d5-9b04-98e2cc8020fd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:01.094073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f9abf51-ff88-42d5-9b04-98e2cc8020fd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:01.111219 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [-] [c17eba8c-cddd-4f98-b66f-c71ea3b6f89c] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 48724. Jul 25 15:16:01.448491 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0f9abf51-ff88-42d5-9b04-98e2cc8020fd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:16:01.459123 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0f9abf51-ff88-42d5-9b04-98e2cc8020fd tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a" status: 200 len: 1579 microversion: 2.1 time: 0.380282 Jul 25 15:16:01.459733 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3284/6792] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:16:01 2022] GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a => generated 1579 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:16:01.825798 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-73cd69e1-370c-426f-97bb-0f8dddc24927 req-4773bee8-27b4-485b-95d0-cee9b04804d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54309a94-c5a2-4bfa-9f69-f45ed394b71a", "name": "network-vif-deleted", "tag": "08a08121-e532-49ad-afd6-418960d4ae01"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:16:01.836843 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-73cd69e1-370c-426f-97bb-0f8dddc24927 req-4773bee8-27b4-485b-95d0-cee9b04804d2 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:01.837218 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-73cd69e1-370c-426f-97bb-0f8dddc24927 req-4773bee8-27b4-485b-95d0-cee9b04804d2 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:01.849463 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-73cd69e1-370c-426f-97bb-0f8dddc24927 req-4773bee8-27b4-485b-95d0-cee9b04804d2 service nova] Creating event network-vif-deleted:08a08121-e532-49ad-afd6-418960d4ae01 for instance 54309a94-c5a2-4bfa-9f69-f45ed394b71a on n-h1-846435-14 Jul 25 15:16:01.854970 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-73cd69e1-370c-426f-97bb-0f8dddc24927 req-4773bee8-27b4-485b-95d0-cee9b04804d2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032838 Jul 25 15:16:01.855562 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3509/6793] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:16:02.481317 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-da0bb305-57ae-4f8a-89c6-1991cc9172b9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:16:02.481888 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-da0bb305-57ae-4f8a-89c6-1991cc9172b9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:16:02.489718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da0bb305-57ae-4f8a-89c6-1991cc9172b9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:02.490171 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da0bb305-57ae-4f8a-89c6-1991cc9172b9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:02.490940 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da0bb305-57ae-4f8a-89c6-1991cc9172b9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:02.491377 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da0bb305-57ae-4f8a-89c6-1991cc9172b9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:02.556873 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-da0bb305-57ae-4f8a-89c6-1991cc9172b9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:16:02.565228 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-da0bb305-57ae-4f8a-89c6-1991cc9172b9 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a" status: 200 len: 1226 microversion: 2.1 time: 0.087990 Jul 25 15:16:02.565783 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3285/6794] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:16:02 2022] GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:16:03.588627 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-af9981a6-f8a8-498f-a470-60439ab4b9d0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:16:03.589345 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-af9981a6-f8a8-498f-a470-60439ab4b9d0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:16:03.596954 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af9981a6-f8a8-498f-a470-60439ab4b9d0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:03.597423 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af9981a6-f8a8-498f-a470-60439ab4b9d0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:03.598231 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af9981a6-f8a8-498f-a470-60439ab4b9d0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:03.598728 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af9981a6-f8a8-498f-a470-60439ab4b9d0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:03.669515 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-af9981a6-f8a8-498f-a470-60439ab4b9d0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:16:03.678018 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-af9981a6-f8a8-498f-a470-60439ab4b9d0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a" status: 200 len: 1226 microversion: 2.1 time: 0.094953 Jul 25 15:16:03.678622 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3510/6795] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:16:03 2022] GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:16:04.700976 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4c3ef1b6-e0a1-478c-86b3-0e78cd5eba3c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:16:04.701506 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4c3ef1b6-e0a1-478c-86b3-0e78cd5eba3c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:16:04.709213 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c3ef1b6-e0a1-478c-86b3-0e78cd5eba3c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:04.709649 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c3ef1b6-e0a1-478c-86b3-0e78cd5eba3c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:04.710431 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c3ef1b6-e0a1-478c-86b3-0e78cd5eba3c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:04.710877 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4c3ef1b6-e0a1-478c-86b3-0e78cd5eba3c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:04.778686 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4c3ef1b6-e0a1-478c-86b3-0e78cd5eba3c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:16:04.787186 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4c3ef1b6-e0a1-478c-86b3-0e78cd5eba3c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a" status: 200 len: 1226 microversion: 2.1 time: 0.090492 Jul 25 15:16:04.787760 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3286/6796] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:16:04 2022] GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:16:05.807686 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7e1fe756-cad3-4114-a2c3-b82cf3acccd5 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:16:05.808326 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7e1fe756-cad3-4114-a2c3-b82cf3acccd5 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:16:05.815830 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7e1fe756-cad3-4114-a2c3-b82cf3acccd5 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:05.816306 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7e1fe756-cad3-4114-a2c3-b82cf3acccd5 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:05.817073 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7e1fe756-cad3-4114-a2c3-b82cf3acccd5 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:05.817682 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7e1fe756-cad3-4114-a2c3-b82cf3acccd5 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:05.886512 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7e1fe756-cad3-4114-a2c3-b82cf3acccd5 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:16:05.895011 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7e1fe756-cad3-4114-a2c3-b82cf3acccd5 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a" status: 200 len: 1226 microversion: 2.1 time: 0.091226 Jul 25 15:16:05.895642 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3511/6797] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:16:05 2022] GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:16:06.916958 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4a0f6d8b-aae8-451f-b77a-ce9fbbc22c80 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:16:06.917542 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4a0f6d8b-aae8-451f-b77a-ce9fbbc22c80 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 54309a94-c5a2-4bfa-9f69-f45ed394b71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:16:06.925732 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4a0f6d8b-aae8-451f-b77a-ce9fbbc22c80 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:06.926187 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4a0f6d8b-aae8-451f-b77a-ce9fbbc22c80 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:06.926974 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4a0f6d8b-aae8-451f-b77a-ce9fbbc22c80 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:06.927441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4a0f6d8b-aae8-451f-b77a-ce9fbbc22c80 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:06.942191 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-4a0f6d8b-aae8-451f-b77a-ce9fbbc22c80 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] HTTP exception thrown: Instance 54309a94-c5a2-4bfa-9f69-f45ed394b71a could not be found. Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4a0f6d8b-aae8-451f-b77a-ce9fbbc22c80 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Request method failure captured: Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a HTTP/1.1 Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rDtvHLNADQM-uJ_J3klWg0FTy_E0qH1hvwasDYrxKDHzDvpYuxQ-thmFamK-Qma_d-RBIPBhjFabpJL3iCa_0TXRcnv8VILXYJZ82EcknBbgye7z_bTamQlAxPZ4RYdd06oyEONGUiMQFVcfd19pQtHuauUAFexddlrbqczpvEqs-4 Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 450a632353eb4912a87bd5efc3bf2907 Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/450a632353eb4912a87bd5efc3bf2907"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/450a632353eb4912a87bd5efc3bf2907"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_450a632353eb4912a87bd5efc3bf2907", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/450a632353eb4912a87bd5efc3bf2907"}]}] Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 450a632353eb4912a87bd5efc3bf2907 Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-TestVolumeBootPattern-1790932632-project Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: e4eae2927eb943e9ab2bb78b6b555404 Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-TestVolumeBootPattern-1790932632-project Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 54309a94-c5a2-4bfa-9f69-f45ed394b71a could not be found. Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '54309a94-c5a2-4bfa-9f69-f45ed394b71a'} Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54309a94-c5a2-4bfa-9f69-f45ed394b71a could not be found. Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54309a94-c5a2-4bfa-9f69-f45ed394b71a could not be found. Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:16:06.943881 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:16:06.949614 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:16:06.949614 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:16:06.949614 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:16:06.949614 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:16:06.949614 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:16:06.949614 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54309a94-c5a2-4bfa-9f69-f45ed394b71a could not be found. Jul 25 15:16:06.949614 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:16:06.949614 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4a0f6d8b-aae8-451f-b77a-ce9fbbc22c80 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Returning 404 to user: Instance 54309a94-c5a2-4bfa-9f69-f45ed394b71a could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:16:06.949614 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4a0f6d8b-aae8-451f-b77a-ce9fbbc22c80 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a" status: 404 len: 111 microversion: 2.1 time: 0.032452 Jul 25 15:16:06.949614 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3287/6798] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:16:06 2022] GET /compute/v2.1/servers/54309a94-c5a2-4bfa-9f69-f45ed394b71a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:16:13.382393 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-37a93256-da6c-4928-80c9-fbe7138c44df tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:16:13.383235 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-37a93256-da6c-4928-80c9-fbe7138c44df tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: c787ab81-7b36-4fc3-ab2e-91bce435dbc5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:16:13.391230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37a93256-da6c-4928-80c9-fbe7138c44df tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:13.391475 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37a93256-da6c-4928-80c9-fbe7138c44df tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:13.392222 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37a93256-da6c-4928-80c9-fbe7138c44df tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:13.393124 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37a93256-da6c-4928-80c9-fbe7138c44df tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:13.434052 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-37a93256-da6c-4928-80c9-fbe7138c44df tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: c787ab81-7b36-4fc3-ab2e-91bce435dbc5] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:16:13.469642 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-6c7d2efe-1a1f-473c-898c-da3e47e44b3a req-3ecd67a0-966a-44a7-aca5-b298b8396658 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c787ab81-7b36-4fc3-ab2e-91bce435dbc5", "tag": "d64621cf-2d1c-402f-ba0a-ca2e0e66f40f"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:16:13.480875 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-6c7d2efe-1a1f-473c-898c-da3e47e44b3a req-3ecd67a0-966a-44a7-aca5-b298b8396658 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:13.481800 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-6c7d2efe-1a1f-473c-898c-da3e47e44b3a req-3ecd67a0-966a-44a7-aca5-b298b8396658 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:13.495652 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-6c7d2efe-1a1f-473c-898c-da3e47e44b3a req-3ecd67a0-966a-44a7-aca5-b298b8396658 service nova] Creating event network-changed:d64621cf-2d1c-402f-ba0a-ca2e0e66f40f for instance c787ab81-7b36-4fc3-ab2e-91bce435dbc5 on n-h1-846435-14 Jul 25 15:16:13.502965 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-6c7d2efe-1a1f-473c-898c-da3e47e44b3a req-3ecd67a0-966a-44a7-aca5-b298b8396658 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118753 Jul 25 15:16:13.504296 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3288/6799] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:16:13.532535 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-37a93256-da6c-4928-80c9-fbe7138c44df tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5" status: 204 len: 0 microversion: 2.1 time: 0.153651 Jul 25 15:16:13.533677 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3512/6800] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:16:13 2022] DELETE /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:16:13.542982 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-aff2282c-5361-4915-8adc-093b544f6255 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:16:13.543761 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-aff2282c-5361-4915-8adc-093b544f6255 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: c787ab81-7b36-4fc3-ab2e-91bce435dbc5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:16:13.551707 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aff2282c-5361-4915-8adc-093b544f6255 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:13.552822 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aff2282c-5361-4915-8adc-093b544f6255 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:13.553005 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aff2282c-5361-4915-8adc-093b544f6255 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:13.553991 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aff2282c-5361-4915-8adc-093b544f6255 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:13.704289 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-aff2282c-5361-4915-8adc-093b544f6255 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:16:13.712857 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-aff2282c-5361-4915-8adc-093b544f6255 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5" status: 200 len: 1576 microversion: 2.1 time: 0.174524 Jul 25 15:16:13.713465 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3289/6801] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:16:13 2022] GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:16:14.736614 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-68a7149b-d221-4149-b70b-1cb69c475fc4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:16:14.737464 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-68a7149b-d221-4149-b70b-1cb69c475fc4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: c787ab81-7b36-4fc3-ab2e-91bce435dbc5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:16:14.745258 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68a7149b-d221-4149-b70b-1cb69c475fc4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:14.745835 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68a7149b-d221-4149-b70b-1cb69c475fc4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:14.746714 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68a7149b-d221-4149-b70b-1cb69c475fc4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:14.747210 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68a7149b-d221-4149-b70b-1cb69c475fc4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:14.909763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-68a7149b-d221-4149-b70b-1cb69c475fc4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:16:14.918018 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-68a7149b-d221-4149-b70b-1cb69c475fc4 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5" status: 200 len: 1576 microversion: 2.1 time: 0.185830 Jul 25 15:16:14.919008 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3513/6802] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:16:14 2022] GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5 => generated 1576 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:16:15.939527 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-be9e272c-24ab-4e0b-a5ea-751c80d5d8b0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:16:15.940411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-be9e272c-24ab-4e0b-a5ea-751c80d5d8b0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: c787ab81-7b36-4fc3-ab2e-91bce435dbc5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:16:15.947535 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-be9e272c-24ab-4e0b-a5ea-751c80d5d8b0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:15.948053 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-be9e272c-24ab-4e0b-a5ea-751c80d5d8b0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:15.948842 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-be9e272c-24ab-4e0b-a5ea-751c80d5d8b0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:15.949267 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-be9e272c-24ab-4e0b-a5ea-751c80d5d8b0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:16.209757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-bf121757-e53c-4ce2-ac85-a106ee000314 req-41894b90-7cfb-4a77-a5a7-5562f734d25b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c787ab81-7b36-4fc3-ab2e-91bce435dbc5", "name": "network-vif-deleted", "tag": "d64621cf-2d1c-402f-ba0a-ca2e0e66f40f"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:16:16.212083 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-be9e272c-24ab-4e0b-a5ea-751c80d5d8b0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:16:16.221967 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-be9e272c-24ab-4e0b-a5ea-751c80d5d8b0 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5" status: 200 len: 1458 microversion: 2.1 time: 0.286508 Jul 25 15:16:16.223094 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3290/6803] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:16:15 2022] GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5 => generated 1458 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:16:16.227251 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-bf121757-e53c-4ce2-ac85-a106ee000314 req-41894b90-7cfb-4a77-a5a7-5562f734d25b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:16.227956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-bf121757-e53c-4ce2-ac85-a106ee000314 req-41894b90-7cfb-4a77-a5a7-5562f734d25b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:16.243393 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-bf121757-e53c-4ce2-ac85-a106ee000314 req-41894b90-7cfb-4a77-a5a7-5562f734d25b service nova] Creating event network-vif-deleted:d64621cf-2d1c-402f-ba0a-ca2e0e66f40f for instance c787ab81-7b36-4fc3-ab2e-91bce435dbc5 on n-h1-846435-14 Jul 25 15:16:16.248923 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-bf121757-e53c-4ce2-ac85-a106ee000314 req-41894b90-7cfb-4a77-a5a7-5562f734d25b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043353 Jul 25 15:16:16.250239 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3514/6804] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:16:17.246134 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7bc41deb-4472-406c-a688-362eb165e258 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:16:17.246819 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7bc41deb-4472-406c-a688-362eb165e258 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: c787ab81-7b36-4fc3-ab2e-91bce435dbc5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:16:17.255994 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7bc41deb-4472-406c-a688-362eb165e258 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:17.256470 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7bc41deb-4472-406c-a688-362eb165e258 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:17.257313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7bc41deb-4472-406c-a688-362eb165e258 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:17.257803 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7bc41deb-4472-406c-a688-362eb165e258 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:17.329288 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7bc41deb-4472-406c-a688-362eb165e258 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:16:17.338136 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7bc41deb-4472-406c-a688-362eb165e258 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5" status: 200 len: 1225 microversion: 2.1 time: 0.096893 Jul 25 15:16:17.338733 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3291/6805] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:16:17 2022] GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:16:18.361222 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-603eaa5c-4d85-46ba-a82c-34fd5018bb9a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:16:18.361918 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-603eaa5c-4d85-46ba-a82c-34fd5018bb9a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: c787ab81-7b36-4fc3-ab2e-91bce435dbc5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:16:18.370056 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-603eaa5c-4d85-46ba-a82c-34fd5018bb9a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:18.370522 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-603eaa5c-4d85-46ba-a82c-34fd5018bb9a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:18.371311 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-603eaa5c-4d85-46ba-a82c-34fd5018bb9a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:18.371757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-603eaa5c-4d85-46ba-a82c-34fd5018bb9a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:18.447190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-603eaa5c-4d85-46ba-a82c-34fd5018bb9a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:16:18.456586 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-603eaa5c-4d85-46ba-a82c-34fd5018bb9a tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5" status: 200 len: 1225 microversion: 2.1 time: 0.099739 Jul 25 15:16:18.457415 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3515/6806] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:16:18 2022] GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:16:19.479180 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4b72e315-7f3f-42dd-a02c-97b0521a1e3c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:16:19.479909 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4b72e315-7f3f-42dd-a02c-97b0521a1e3c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: c787ab81-7b36-4fc3-ab2e-91bce435dbc5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:16:19.488341 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4b72e315-7f3f-42dd-a02c-97b0521a1e3c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:19.488795 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4b72e315-7f3f-42dd-a02c-97b0521a1e3c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:19.489610 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4b72e315-7f3f-42dd-a02c-97b0521a1e3c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:19.490074 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4b72e315-7f3f-42dd-a02c-97b0521a1e3c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:19.557527 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4b72e315-7f3f-42dd-a02c-97b0521a1e3c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:16:19.566272 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4b72e315-7f3f-42dd-a02c-97b0521a1e3c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5" status: 200 len: 1225 microversion: 2.1 time: 0.091273 Jul 25 15:16:19.566871 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3292/6807] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:16:19 2022] GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:16:20.588586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8ffd9495-590a-4b78-bad8-950b8c714553 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:16:20.589232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8ffd9495-590a-4b78-bad8-950b8c714553 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: c787ab81-7b36-4fc3-ab2e-91bce435dbc5] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:16:20.597087 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8ffd9495-590a-4b78-bad8-950b8c714553 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:20.597548 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8ffd9495-590a-4b78-bad8-950b8c714553 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:20.598390 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8ffd9495-590a-4b78-bad8-950b8c714553 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:20.599131 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8ffd9495-590a-4b78-bad8-950b8c714553 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:20.635408 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8ffd9495-590a-4b78-bad8-950b8c714553 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:20.635756 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8ffd9495-590a-4b78-bad8-950b8c714553 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:20.636253 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-8ffd9495-590a-4b78-bad8-950b8c714553 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lazy-loading 'fault' on Instance uuid c787ab81-7b36-4fc3-ab2e-91bce435dbc5 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:16:20.678441 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8ffd9495-590a-4b78-bad8-950b8c714553 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4eae2927eb943e9ab2bb78b6b555404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450a632353eb4912a87bd5efc3bf2907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:16:20.686388 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8ffd9495-590a-4b78-bad8-950b8c714553 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5" status: 200 len: 1230 microversion: 2.1 time: 0.102243 Jul 25 15:16:20.686965 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3516/6808] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:16:20 2022] GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5 => generated 1230 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:16:21.708001 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-255e128d-1ed6-425c-a15d-ec4e0b6428d8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:16:21.708623 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-255e128d-1ed6-425c-a15d-ec4e0b6428d8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: c787ab81-7b36-4fc3-ab2e-91bce435dbc5] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:16:21.716192 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-255e128d-1ed6-425c-a15d-ec4e0b6428d8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:21.716647 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-255e128d-1ed6-425c-a15d-ec4e0b6428d8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:21.717438 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-255e128d-1ed6-425c-a15d-ec4e0b6428d8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:21.717883 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-255e128d-1ed6-425c-a15d-ec4e0b6428d8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:21.732246 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-255e128d-1ed6-425c-a15d-ec4e0b6428d8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] HTTP exception thrown: Instance c787ab81-7b36-4fc3-ab2e-91bce435dbc5 could not be found. Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-255e128d-1ed6-425c-a15d-ec4e0b6428d8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Request method failure captured: Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5 HTTP/1.1 Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rDtvHLNADQM-uJ_J3klWg0FTy_E0qH1hvwasDYrxKDHzDvpYuxQ-thmFamK-Qma_d-RBIPBhjFabpJL3iCa_0TXRcnv8VILXYJZ82EcknBbgye7z_bTamQlAxPZ4RYdd06oyEONGUiMQFVcfd19pQtHuauUAFexddlrbqczpvEqs-4 Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 450a632353eb4912a87bd5efc3bf2907 Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/450a632353eb4912a87bd5efc3bf2907"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/450a632353eb4912a87bd5efc3bf2907"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_450a632353eb4912a87bd5efc3bf2907", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/450a632353eb4912a87bd5efc3bf2907"}]}] Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 450a632353eb4912a87bd5efc3bf2907 Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-TestVolumeBootPattern-1790932632-project Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: e4eae2927eb943e9ab2bb78b6b555404 Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-TestVolumeBootPattern-1790932632-project Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance c787ab81-7b36-4fc3-ab2e-91bce435dbc5 could not be found. Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'c787ab81-7b36-4fc3-ab2e-91bce435dbc5'} Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c787ab81-7b36-4fc3-ab2e-91bce435dbc5 could not be found. Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c787ab81-7b36-4fc3-ab2e-91bce435dbc5 could not be found. Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:16:21.733942 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:16:21.737361 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:16:21.737361 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:16:21.737361 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:16:21.737361 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:16:21.737361 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:16:21.737361 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c787ab81-7b36-4fc3-ab2e-91bce435dbc5 could not be found. Jul 25 15:16:21.737361 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:16:21.737361 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-255e128d-1ed6-425c-a15d-ec4e0b6428d8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Returning 404 to user: Instance c787ab81-7b36-4fc3-ab2e-91bce435dbc5 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:16:21.737361 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-255e128d-1ed6-425c-a15d-ec4e0b6428d8 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5" status: 404 len: 111 microversion: 2.1 time: 0.031586 Jul 25 15:16:21.737361 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3293/6809] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:16:21 2022] GET /compute/v2.1/servers/c787ab81-7b36-4fc3-ab2e-91bce435dbc5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:16:22.220236 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0ee2306a-5137-42d9-ad4b-56618cd3bd25 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:16:22.220827 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0ee2306a-5137-42d9-ad4b-56618cd3bd25 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:16:22.228171 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0ee2306a-5137-42d9-ad4b-56618cd3bd25 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:22.228631 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0ee2306a-5137-42d9-ad4b-56618cd3bd25 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:22.229409 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0ee2306a-5137-42d9-ad4b-56618cd3bd25 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:22.229847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0ee2306a-5137-42d9-ad4b-56618cd3bd25 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:22.245764 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-0ee2306a-5137-42d9-ad4b-56618cd3bd25 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] HTTP exception thrown: Instance 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 could not be found. Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0ee2306a-5137-42d9-ad4b-56618cd3bd25 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Request method failure captured: Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 HTTP/1.1 Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3rDtvHLNADQM-uJ_J3klWg0FTy_E0qH1hvwasDYrxKDHzDvpYuxQ-thmFamK-Qma_d-RBIPBhjFabpJL3iCa_0TXRcnv8VILXYJZ82EcknBbgye7z_bTamQlAxPZ4RYdd06oyEONGUiMQFVcfd19pQtHuauUAFexddlrbqczpvEqs-4 Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 450a632353eb4912a87bd5efc3bf2907 Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/450a632353eb4912a87bd5efc3bf2907"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/450a632353eb4912a87bd5efc3bf2907"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_450a632353eb4912a87bd5efc3bf2907", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/450a632353eb4912a87bd5efc3bf2907"}]}] Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 450a632353eb4912a87bd5efc3bf2907 Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-TestVolumeBootPattern-1790932632-project Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: e4eae2927eb943e9ab2bb78b6b555404 Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-TestVolumeBootPattern-1790932632-project Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 could not be found. Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4'} Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 could not be found. Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:16:22.247452 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:16:22.250917 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 could not be found. Jul 25 15:16:22.250917 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:16:22.250917 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:16:22.250917 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:16:22.250917 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:16:22.250917 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:16:22.250917 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:16:22.250917 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:16:22.250917 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:16:22.250917 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 could not be found. Jul 25 15:16:22.250917 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:16:22.250917 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0ee2306a-5137-42d9-ad4b-56618cd3bd25 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Returning 404 to user: Instance 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:16:22.250917 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0ee2306a-5137-42d9-ad4b-56618cd3bd25 tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "DELETE /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4" status: 404 len: 111 microversion: 2.1 time: 0.033248 Jul 25 15:16:22.253044 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3517/6810] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:16:22 2022] DELETE /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:16:22.258382 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cacca577-4f8a-4f1e-8807-90826d18be0d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:16:22.259039 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cacca577-4f8a-4f1e-8807-90826d18be0d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] [instance: 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:16:22.265605 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cacca577-4f8a-4f1e-8807-90826d18be0d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:22.266076 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cacca577-4f8a-4f1e-8807-90826d18be0d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:22.266874 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cacca577-4f8a-4f1e-8807-90826d18be0d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:22.267339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cacca577-4f8a-4f1e-8807-90826d18be0d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:22.281761 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-cacca577-4f8a-4f1e-8807-90826d18be0d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] HTTP exception thrown: Instance 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 could not be found. Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cacca577-4f8a-4f1e-8807-90826d18be0d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Request method failure captured: Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 HTTP/1.1 Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rDtvHLNADQM-uJ_J3klWg0FTy_E0qH1hvwasDYrxKDHzDvpYuxQ-thmFamK-Qma_d-RBIPBhjFabpJL3iCa_0TXRcnv8VILXYJZ82EcknBbgye7z_bTamQlAxPZ4RYdd06oyEONGUiMQFVcfd19pQtHuauUAFexddlrbqczpvEqs-4 Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 450a632353eb4912a87bd5efc3bf2907 Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/450a632353eb4912a87bd5efc3bf2907"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/450a632353eb4912a87bd5efc3bf2907"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_450a632353eb4912a87bd5efc3bf2907", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/450a632353eb4912a87bd5efc3bf2907"}]}] Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 450a632353eb4912a87bd5efc3bf2907 Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-TestVolumeBootPattern-1790932632 Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-TestVolumeBootPattern-1790932632-project Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: e4eae2927eb943e9ab2bb78b6b555404 Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-TestVolumeBootPattern-1790932632-project Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 could not be found. Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4'} Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 could not be found. Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 could not be found. Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:16:22.283327 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:16:22.287285 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:16:22.287285 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:16:22.287285 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:16:22.287285 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:16:22.287285 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:16:22.287285 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 could not be found. Jul 25 15:16:22.287285 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:16:22.287285 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cacca577-4f8a-4f1e-8807-90826d18be0d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Returning 404 to user: Instance 6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:16:22.287285 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cacca577-4f8a-4f1e-8807-90826d18be0d tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4" status: 404 len: 111 microversion: 2.1 time: 0.030449 Jul 25 15:16:22.287285 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3294/6811] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:16:22 2022] GET /compute/v2.1/servers/6fd6d0b3-1e4e-4e54-a423-e6769fbf2cd4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:16:25.737088 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dc41e505-d914-4dcf-a455-d89714bb924c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] Calling method '.version_select at 0x7f46878314c0>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:16:25.768941 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dc41e505-d914-4dcf-a455-d89714bb924c tempest-TestVolumeBootPattern-1790932632 tempest-TestVolumeBootPattern-1790932632-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1785943681" status: 202 len: 0 microversion: 2.1 time: 0.035900 Jul 25 15:16:25.772596 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3518/6812] 10.222.0.88 () {58 vars in 1263 bytes} [Mon Jul 25 15:16:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1785943681 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:16:45.303594 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:16:45.304817 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:16:45.434054 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c2355648-ae99-4e1a-a0ca-1072b43cf2e9 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1365672468", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:16:45.491239 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-c2355648-ae99-4e1a-a0ca-1072b43cf2e9 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] validate_networks() for None {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:16:46.131714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-c2355648-ae99-4e1a-a0ca-1072b43cf2e9 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:16:46.132182 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-c2355648-ae99-4e1a-a0ca-1072b43cf2e9 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:16:46.132768 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-c2355648-ae99-4e1a-a0ca-1072b43cf2e9 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:16:46.133080 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-c2355648-ae99-4e1a-a0ca-1072b43cf2e9 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:16:46.133529 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-c2355648-ae99-4e1a-a0ca-1072b43cf2e9 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:16:46.143193 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c2355648-ae99-4e1a-a0ca-1072b43cf2e9 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:46.143653 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c2355648-ae99-4e1a-a0ca-1072b43cf2e9 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:46.144548 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c2355648-ae99-4e1a-a0ca-1072b43cf2e9 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:46.144986 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c2355648-ae99-4e1a-a0ca-1072b43cf2e9 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:46.172868 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-c2355648-ae99-4e1a-a0ca-1072b43cf2e9 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Getting quotas for project 541412e3cb51432f845b190ab6f037a1. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:16:46.178421 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-c2355648-ae99-4e1a-a0ca-1072b43cf2e9 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Getting quotas for user 96343e1a2b514765b721a6a206ea9231 and project 541412e3cb51432f845b190ab6f037a1. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:16:46.214076 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c2355648-ae99-4e1a-a0ca-1072b43cf2e9 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:16:46.216348 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c2355648-ae99-4e1a-a0ca-1072b43cf2e9 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] [instance: ef44081a-708b-436e-ad6a-0ab3452637f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:16:46.259818 n-d-846435-14 devstack@n-api.service[119303]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c2355648-ae99-4e1a-a0ca-1072b43cf2e9 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] [65f5083c-1ce0-4f62-b916-2c16af617d4d] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 15:16:47.269642 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [None req-c2355648-ae99-4e1a-a0ca-1072b43cf2e9 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] [65f5083c-1ce0-4f62-b916-2c16af617d4d] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 48922. Jul 25 15:16:47.276174 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c2355648-ae99-4e1a-a0ca-1072b43cf2e9 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.978244 Jul 25 15:16:47.277325 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3295/6813] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:16:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:16:47.287963 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:16:47.289152 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:16:47.294387 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2422756f-a2f5-49be-9b6b-053de991e108 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:16:47.295037 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2422756f-a2f5-49be-9b6b-053de991e108 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] [instance: ef44081a-708b-436e-ad6a-0ab3452637f1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:16:47.362494 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2422756f-a2f5-49be-9b6b-053de991e108 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96343e1a2b514765b721a6a206ea9231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541412e3cb51432f845b190ab6f037a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:16:47.371458 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2422756f-a2f5-49be-9b6b-053de991e108 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] 10.222.0.88 "GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1" status: 200 len: 1222 microversion: 2.1 time: 0.084903 Jul 25 15:16:47.372771 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3519/6814] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:16:47 2022] GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:16:48.396064 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c64af621-43a2-411c-852d-9adcbb8f1040 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:16:48.396817 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c64af621-43a2-411c-852d-9adcbb8f1040 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] [instance: ef44081a-708b-436e-ad6a-0ab3452637f1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:16:48.404364 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c64af621-43a2-411c-852d-9adcbb8f1040 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:48.404830 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c64af621-43a2-411c-852d-9adcbb8f1040 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:48.405644 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c64af621-43a2-411c-852d-9adcbb8f1040 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:48.406085 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c64af621-43a2-411c-852d-9adcbb8f1040 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:48.476763 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c64af621-43a2-411c-852d-9adcbb8f1040 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96343e1a2b514765b721a6a206ea9231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541412e3cb51432f845b190ab6f037a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:16:48.484918 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c64af621-43a2-411c-852d-9adcbb8f1040 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] 10.222.0.88 "GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1" status: 200 len: 1274 microversion: 2.1 time: 0.094077 Jul 25 15:16:48.485721 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3296/6815] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:16:48 2022] GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1 => generated 1274 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:16:49.506364 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e4ec3ec4-5382-4c1a-aba3-234d4128da37 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:16:49.506908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e4ec3ec4-5382-4c1a-aba3-234d4128da37 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] [instance: ef44081a-708b-436e-ad6a-0ab3452637f1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:16:49.513982 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e4ec3ec4-5382-4c1a-aba3-234d4128da37 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:49.514430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e4ec3ec4-5382-4c1a-aba3-234d4128da37 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:49.515209 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e4ec3ec4-5382-4c1a-aba3-234d4128da37 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:49.515655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e4ec3ec4-5382-4c1a-aba3-234d4128da37 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:49.979540 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e4ec3ec4-5382-4c1a-aba3-234d4128da37 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96343e1a2b514765b721a6a206ea9231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541412e3cb51432f845b190ab6f037a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:16:49.988018 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e4ec3ec4-5382-4c1a-aba3-234d4128da37 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] 10.222.0.88 "GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1" status: 200 len: 1322 microversion: 2.1 time: 0.485699 Jul 25 15:16:49.988676 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3520/6816] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:16:49 2022] GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1 => generated 1322 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:16:50.289822 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-e1adb313-720e-4a32-b85d-70639e061e91 req-23061757-1868-4913-a982-ee2cddb4584c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef44081a-708b-436e-ad6a-0ab3452637f1", "tag": "5cdb6b62-959f-4965-a549-5d4f53dff8e4"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:16:50.302126 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-e1adb313-720e-4a32-b85d-70639e061e91 req-23061757-1868-4913-a982-ee2cddb4584c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:50.302572 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-e1adb313-720e-4a32-b85d-70639e061e91 req-23061757-1868-4913-a982-ee2cddb4584c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:50.321709 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-e1adb313-720e-4a32-b85d-70639e061e91 req-23061757-1868-4913-a982-ee2cddb4584c service nova] Creating event network-changed:5cdb6b62-959f-4965-a549-5d4f53dff8e4 for instance ef44081a-708b-436e-ad6a-0ab3452637f1 on n-h2-846435-14 Jul 25 15:16:50.327720 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-e1adb313-720e-4a32-b85d-70639e061e91 req-23061757-1868-4913-a982-ee2cddb4584c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041656 Jul 25 15:16:50.328533 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3297/6817] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:16:51.018495 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4b64be8e-6c7e-4e25-ae82-0203df46d237 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:16:51.019336 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4b64be8e-6c7e-4e25-ae82-0203df46d237 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] [instance: ef44081a-708b-436e-ad6a-0ab3452637f1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:16:51.027258 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4b64be8e-6c7e-4e25-ae82-0203df46d237 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:51.027746 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4b64be8e-6c7e-4e25-ae82-0203df46d237 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:51.028543 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4b64be8e-6c7e-4e25-ae82-0203df46d237 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:51.028984 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4b64be8e-6c7e-4e25-ae82-0203df46d237 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:51.174555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4b64be8e-6c7e-4e25-ae82-0203df46d237 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96343e1a2b514765b721a6a206ea9231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541412e3cb51432f845b190ab6f037a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:16:51.183692 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4b64be8e-6c7e-4e25-ae82-0203df46d237 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] 10.222.0.88 "GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1" status: 200 len: 1322 microversion: 2.1 time: 0.171993 Jul 25 15:16:51.184719 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3521/6818] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:16:51 2022] GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:16:52.215229 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ea63dce1-03b8-45b7-884a-b8ef2382ffaf tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:16:52.216419 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ea63dce1-03b8-45b7-884a-b8ef2382ffaf tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] [instance: ef44081a-708b-436e-ad6a-0ab3452637f1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:16:52.226337 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ea63dce1-03b8-45b7-884a-b8ef2382ffaf tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:52.226801 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ea63dce1-03b8-45b7-884a-b8ef2382ffaf tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:52.227577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ea63dce1-03b8-45b7-884a-b8ef2382ffaf tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:52.228016 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ea63dce1-03b8-45b7-884a-b8ef2382ffaf tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:52.377691 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ea63dce1-03b8-45b7-884a-b8ef2382ffaf tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96343e1a2b514765b721a6a206ea9231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541412e3cb51432f845b190ab6f037a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:16:52.387203 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ea63dce1-03b8-45b7-884a-b8ef2382ffaf tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] 10.222.0.88 "GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1" status: 200 len: 1322 microversion: 2.1 time: 0.181042 Jul 25 15:16:52.387827 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3298/6819] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:16:52 2022] GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:16:53.413139 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e6d09472-a59b-4d2b-82de-f097bfcf700b tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:16:53.413754 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e6d09472-a59b-4d2b-82de-f097bfcf700b tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] [instance: ef44081a-708b-436e-ad6a-0ab3452637f1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:16:53.421703 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6d09472-a59b-4d2b-82de-f097bfcf700b tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:53.422149 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6d09472-a59b-4d2b-82de-f097bfcf700b tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:53.422988 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6d09472-a59b-4d2b-82de-f097bfcf700b tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:53.423646 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6d09472-a59b-4d2b-82de-f097bfcf700b tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:53.563132 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e6d09472-a59b-4d2b-82de-f097bfcf700b tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96343e1a2b514765b721a6a206ea9231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541412e3cb51432f845b190ab6f037a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:16:53.571533 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e6d09472-a59b-4d2b-82de-f097bfcf700b tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] 10.222.0.88 "GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1" status: 200 len: 1322 microversion: 2.1 time: 0.163572 Jul 25 15:16:53.572156 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3522/6820] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:16:53 2022] GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:16:54.599254 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4e3953cc-54b5-4ace-888a-60b40e6142f5 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:16:54.599884 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4e3953cc-54b5-4ace-888a-60b40e6142f5 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] [instance: ef44081a-708b-436e-ad6a-0ab3452637f1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:16:54.607555 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4e3953cc-54b5-4ace-888a-60b40e6142f5 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:54.608018 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4e3953cc-54b5-4ace-888a-60b40e6142f5 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:54.608851 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4e3953cc-54b5-4ace-888a-60b40e6142f5 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:54.609313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4e3953cc-54b5-4ace-888a-60b40e6142f5 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:54.770132 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4e3953cc-54b5-4ace-888a-60b40e6142f5 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96343e1a2b514765b721a6a206ea9231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541412e3cb51432f845b190ab6f037a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:16:54.778575 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4e3953cc-54b5-4ace-888a-60b40e6142f5 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] 10.222.0.88 "GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1" status: 200 len: 1322 microversion: 2.1 time: 0.183510 Jul 25 15:16:54.779142 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3299/6821] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:16:54 2022] GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:16:55.804126 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-619a0d0a-7c8d-4371-b20a-bb53c2e0cb54 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:16:55.805182 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-619a0d0a-7c8d-4371-b20a-bb53c2e0cb54 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] [instance: ef44081a-708b-436e-ad6a-0ab3452637f1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:16:55.817383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-619a0d0a-7c8d-4371-b20a-bb53c2e0cb54 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:55.818143 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-619a0d0a-7c8d-4371-b20a-bb53c2e0cb54 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:55.819443 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-619a0d0a-7c8d-4371-b20a-bb53c2e0cb54 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:55.820246 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-619a0d0a-7c8d-4371-b20a-bb53c2e0cb54 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:55.964714 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-619a0d0a-7c8d-4371-b20a-bb53c2e0cb54 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96343e1a2b514765b721a6a206ea9231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541412e3cb51432f845b190ab6f037a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:16:55.973061 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-619a0d0a-7c8d-4371-b20a-bb53c2e0cb54 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] 10.222.0.88 "GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1" status: 200 len: 1322 microversion: 2.1 time: 0.175689 Jul 25 15:16:55.973671 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3523/6822] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:16:55 2022] GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:16:56.996819 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7b0efba4-90e9-4712-b922-e27cfe645c11 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:16:56.997537 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7b0efba4-90e9-4712-b922-e27cfe645c11 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] [instance: ef44081a-708b-436e-ad6a-0ab3452637f1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:16:57.000747 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:16:57.001839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:16:57.008369 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b0efba4-90e9-4712-b922-e27cfe645c11 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:57.008824 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b0efba4-90e9-4712-b922-e27cfe645c11 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:57.009608 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b0efba4-90e9-4712-b922-e27cfe645c11 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:57.010164 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b0efba4-90e9-4712-b922-e27cfe645c11 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:57.160321 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7b0efba4-90e9-4712-b922-e27cfe645c11 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96343e1a2b514765b721a6a206ea9231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541412e3cb51432f845b190ab6f037a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:16:57.168443 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7b0efba4-90e9-4712-b922-e27cfe645c11 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] 10.222.0.88 "GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1" status: 200 len: 1322 microversion: 2.1 time: 0.176541 Jul 25 15:16:57.169057 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3300/6823] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:16:56 2022] GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:16:58.088369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-33d6196f-4984-4fa0-924f-c860e81d36a5 req-04c68aa5-7c25-4205-9988-2a0ad1e428cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef44081a-708b-436e-ad6a-0ab3452637f1", "name": "network-vif-plugged", "status": "completed", "tag": "5cdb6b62-959f-4965-a549-5d4f53dff8e4"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:16:58.094565 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:16:58.102505 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-33d6196f-4984-4fa0-924f-c860e81d36a5 req-04c68aa5-7c25-4205-9988-2a0ad1e428cf service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:58.102975 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-33d6196f-4984-4fa0-924f-c860e81d36a5 req-04c68aa5-7c25-4205-9988-2a0ad1e428cf service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:58.115116 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-33d6196f-4984-4fa0-924f-c860e81d36a5 req-04c68aa5-7c25-4205-9988-2a0ad1e428cf service nova] Creating event network-vif-plugged:5cdb6b62-959f-4965-a549-5d4f53dff8e4 for instance ef44081a-708b-436e-ad6a-0ab3452637f1 on n-h2-846435-14 Jul 25 15:16:58.120663 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-33d6196f-4984-4fa0-924f-c860e81d36a5 req-04c68aa5-7c25-4205-9988-2a0ad1e428cf service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036831 Jul 25 15:16:58.121470 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3524/6824] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:16:58.190388 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7c913a52-2c48-4a18-8d8a-3cada12a6cd5 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:16:58.191008 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7c913a52-2c48-4a18-8d8a-3cada12a6cd5 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] [instance: ef44081a-708b-436e-ad6a-0ab3452637f1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:16:58.198171 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7c913a52-2c48-4a18-8d8a-3cada12a6cd5 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:58.198654 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7c913a52-2c48-4a18-8d8a-3cada12a6cd5 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:58.199440 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7c913a52-2c48-4a18-8d8a-3cada12a6cd5 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:58.199887 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7c913a52-2c48-4a18-8d8a-3cada12a6cd5 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:58.338823 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7c913a52-2c48-4a18-8d8a-3cada12a6cd5 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96343e1a2b514765b721a6a206ea9231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541412e3cb51432f845b190ab6f037a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:16:58.346956 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7c913a52-2c48-4a18-8d8a-3cada12a6cd5 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] 10.222.0.88 "GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1" status: 200 len: 1322 microversion: 2.1 time: 0.161020 Jul 25 15:16:58.347448 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3301/6825] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:16:58 2022] GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:16:59.373012 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-db0e6fba-aaf1-448c-b60f-6e1725fa0cc6 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:16:59.374201 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-db0e6fba-aaf1-448c-b60f-6e1725fa0cc6 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] [instance: ef44081a-708b-436e-ad6a-0ab3452637f1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:16:59.386630 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db0e6fba-aaf1-448c-b60f-6e1725fa0cc6 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:59.388419 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db0e6fba-aaf1-448c-b60f-6e1725fa0cc6 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:59.388419 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db0e6fba-aaf1-448c-b60f-6e1725fa0cc6 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:16:59.388822 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db0e6fba-aaf1-448c-b60f-6e1725fa0cc6 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:16:59.533118 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-db0e6fba-aaf1-448c-b60f-6e1725fa0cc6 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96343e1a2b514765b721a6a206ea9231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541412e3cb51432f845b190ab6f037a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:16:59.541275 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-db0e6fba-aaf1-448c-b60f-6e1725fa0cc6 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] 10.222.0.88 "GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1" status: 200 len: 1322 microversion: 2.1 time: 0.175394 Jul 25 15:16:59.541836 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3525/6826] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:16:59 2022] GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:00.563266 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-84d997a7-fc15-4183-bef7-9ecd8a33acac tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:00.564022 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-84d997a7-fc15-4183-bef7-9ecd8a33acac tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] [instance: ef44081a-708b-436e-ad6a-0ab3452637f1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:00.571653 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-84d997a7-fc15-4183-bef7-9ecd8a33acac tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:00.572150 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-84d997a7-fc15-4183-bef7-9ecd8a33acac tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:00.572939 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-84d997a7-fc15-4183-bef7-9ecd8a33acac tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:00.573363 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-84d997a7-fc15-4183-bef7-9ecd8a33acac tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:00.709976 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-84d997a7-fc15-4183-bef7-9ecd8a33acac tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96343e1a2b514765b721a6a206ea9231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541412e3cb51432f845b190ab6f037a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:00.718187 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-84d997a7-fc15-4183-bef7-9ecd8a33acac tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] 10.222.0.88 "GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1" status: 200 len: 1472 microversion: 2.1 time: 0.159137 Jul 25 15:17:00.718766 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3302/6827] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:00 2022] GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1 => generated 1472 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:00.799048 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f6410998-b2f8-4887-ad8a-23f40d760cf8 tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Calling method '.version_select at 0x7f4685ec5b80>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:00.870214 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f6410998-b2f8-4887-ad8a-23f40d760cf8 tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/39a633cf25be4060aee49133e60c142a" status: 200 len: 371 microversion: 2.1 time: 0.133193 Jul 25 15:17:00.870805 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3526/6828] 10.222.0.88 () {58 vars in 1242 bytes} [Mon Jul 25 15:17:00 2022] GET /compute/v2.1/os-quota-sets/39a633cf25be4060aee49133e60c142a => generated 371 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:17:00.883429 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cdd02368-3421-4102-9f3c-47eb1bc6fdef tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1345117489", "id": 318123886, "os-flavor-access:is_public": "True"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:17:00.886512 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 15:17:00.886512 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 15:17:00.903283 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cdd02368-3421-4102-9f3c-47eb1bc6fdef tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.023701 Jul 25 15:17:00.903894 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3303/6829] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:17:00 2022] POST /compute/v2.1/flavors => generated 435 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:17:00.917477 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8afc19f3-d77f-45a7-aa43-65c0bfe97e71 tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "318123886"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:17:00.920077 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8afc19f3-d77f-45a7-aa43-65c0bfe97e71 tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] [instance: ef44081a-708b-436e-ad6a-0ab3452637f1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:00.927391 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8afc19f3-d77f-45a7-aa43-65c0bfe97e71 tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:00.927845 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8afc19f3-d77f-45a7-aa43-65c0bfe97e71 tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:00.928656 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8afc19f3-d77f-45a7-aa43-65c0bfe97e71 tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:00.929107 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8afc19f3-d77f-45a7-aa43-65c0bfe97e71 tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:01.118065 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8afc19f3-d77f-45a7-aa43-65c0bfe97e71 tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9b2504c53e514ef0afdabe0779acea38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a633cf25be4060aee49133e60c142a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:01.125084 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8afc19f3-d77f-45a7-aa43-65c0bfe97e71 tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] [instance: ef44081a-708b-436e-ad6a-0ab3452637f1] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1345117489 {{(pid=119304) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 15:17:01.132134 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8afc19f3-d77f-45a7-aa43-65c0bfe97e71 tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:01.132603 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8afc19f3-d77f-45a7-aa43-65c0bfe97e71 tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:01.133429 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8afc19f3-d77f-45a7-aa43-65c0bfe97e71 tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:01.133909 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8afc19f3-d77f-45a7-aa43-65c0bfe97e71 tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:01.154742 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-8afc19f3-d77f-45a7-aa43-65c0bfe97e71 tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Getting quotas for project 541412e3cb51432f845b190ab6f037a1. Resources: {'cores', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:17:01.160023 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-8afc19f3-d77f-45a7-aa43-65c0bfe97e71 tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Getting quotas for user 96343e1a2b514765b721a6a206ea9231 and project 541412e3cb51432f845b190ab6f037a1. Resources: {'cores', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:17:01.172337 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.compute.api [None req-8afc19f3-d77f-45a7-aa43-65c0bfe97e71 tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] ram quota exceeded for 39a633cf25be4060aee49133e60c142a, tried to resize instance. Jul 25 15:17:01.172915 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-8afc19f3-d77f-45a7-aa43-65c0bfe97e71 tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8afc19f3-d77f-45a7-aa43-65c0bfe97e71 tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Request method failure captured: Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1/action HTTP/1.1 Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 38 Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3rPdV5lL1CG46QiAb8sQfBCVfBHExT5uXNi9SERcdzg1NDXXFa2GaJgLqXRgLcVcYd3tfpzIgccmBZeXMDRdtS5c3wxY6eM9xnOr-1ZP35BCB10ZJef-oF8TltbbSW55qvcq_qQafSsecU1sLCoPlbee51lhNakIJpuRLNHvEKMGprc Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 39a633cf25be4060aee49133e60c142a Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-460204793 Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: X-Role: admin,reader,member Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: admin,reader,member Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/39a633cf25be4060aee49133e60c142a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/39a633cf25be4060aee49133e60c142a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_39a633cf25be4060aee49133e60c142a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/39a633cf25be4060aee49133e60c142a"}]}] Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersAdminNegativeTestJSON-460204793 Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 39a633cf25be4060aee49133e60c142a Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-460204793 Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersAdminNegativeTestJSON-460204793-project-admin Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 9b2504c53e514ef0afdabe0779acea38 Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersAdminNegativeTestJSON-460204793-project-admin Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: {"resize": {"flavorRef": "318123886"}} Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'ef44081a-708b-436e-ad6a-0ab3452637f1', 'body': {'resize': {'flavorRef': '318123886'}}} Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 15:17:01.175112 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8afc19f3-d77f-45a7-aa43-65c0bfe97e71 tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8afc19f3-d77f-45a7-aa43-65c0bfe97e71 tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1/action" status: 403 len: 118 microversion: 2.1 time: 0.263393 Jul 25 15:17:01.179445 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3527/6830] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:17:00 2022] POST /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1/action => generated 118 bytes in 265 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:17:01.187844 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-13e80016-520f-4bc6-9989-e808bf1f8b29 tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:01.188644 n-d-846435-14 devstack@n-api.service[119303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 15:17:01.188644 n-d-846435-14 devstack@n-api.service[119303]: warnings.warn(msg) Jul 25 15:17:01.207572 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-13e80016-520f-4bc6-9989-e808bf1f8b29 tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/318123886" status: 202 len: 0 microversion: 2.1 time: 0.023631 Jul 25 15:17:01.208201 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3304/6831] 10.222.0.88 () {58 vars in 1158 bytes} [Mon Jul 25 15:17:01 2022] DELETE /compute/v2.1/flavors/318123886 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:17:01.216753 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4d4a5a44-56ee-493b-b95f-dd99093b4c1b tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:01.237977 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4d4a5a44-56ee-493b-b95f-dd99093b4c1b tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025281 Jul 25 15:17:01.238559 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3528/6832] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 15:17:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:01.258888 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-334e4906-aea0-4ca6-8767-79cf24799707 tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Calling method '.version_select at 0x7f46866a1820>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:01.336807 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-334e4906-aea0-4ca6-8767-79cf24799707 tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] 10.222.0.88 "GET /compute/v2.1/os-quota-sets/39a633cf25be4060aee49133e60c142a" status: 200 len: 371 microversion: 2.1 time: 0.081621 Jul 25 15:17:01.337311 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3305/6833] 10.222.0.88 () {58 vars in 1242 bytes} [Mon Jul 25 15:17:01 2022] GET /compute/v2.1/os-quota-sets/39a633cf25be4060aee49133e60c142a => generated 371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:17:01.349507 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b6253768-4e73-469b-a097-c1c296e3618f tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-393894156", "id": 10839980, "os-flavor-access:is_public": "True"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:17:01.352605 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 15:17:01.352605 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 15:17:01.369201 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b6253768-4e73-469b-a097-c1c296e3618f tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.023551 Jul 25 15:17:01.369802 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3529/6834] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:17:01 2022] POST /compute/v2.1/flavors => generated 430 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:17:01.383366 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-36e7b42e-7124-4840-a2b4-3ac08b0f44ac tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "10839980"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:17:01.385852 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-36e7b42e-7124-4840-a2b4-3ac08b0f44ac tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] [instance: ef44081a-708b-436e-ad6a-0ab3452637f1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:01.392629 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-36e7b42e-7124-4840-a2b4-3ac08b0f44ac tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:01.393090 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-36e7b42e-7124-4840-a2b4-3ac08b0f44ac tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:01.393899 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-36e7b42e-7124-4840-a2b4-3ac08b0f44ac tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:01.394339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-36e7b42e-7124-4840-a2b4-3ac08b0f44ac tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:01.543736 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-36e7b42e-7124-4840-a2b4-3ac08b0f44ac tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9b2504c53e514ef0afdabe0779acea38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a633cf25be4060aee49133e60c142a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:01.550901 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-36e7b42e-7124-4840-a2b4-3ac08b0f44ac tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] [instance: ef44081a-708b-436e-ad6a-0ab3452637f1] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-393894156 {{(pid=119303) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 15:17:01.557827 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-36e7b42e-7124-4840-a2b4-3ac08b0f44ac tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:01.558281 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-36e7b42e-7124-4840-a2b4-3ac08b0f44ac tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:01.559084 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-36e7b42e-7124-4840-a2b4-3ac08b0f44ac tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:01.559516 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-36e7b42e-7124-4840-a2b4-3ac08b0f44ac tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:01.583762 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-36e7b42e-7124-4840-a2b4-3ac08b0f44ac tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Getting quotas for project 541412e3cb51432f845b190ab6f037a1. Resources: {'cores', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:17:01.589538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-36e7b42e-7124-4840-a2b4-3ac08b0f44ac tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Getting quotas for user 96343e1a2b514765b721a6a206ea9231 and project 541412e3cb51432f845b190ab6f037a1. Resources: {'cores', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:17:01.606237 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.compute.api [None req-36e7b42e-7124-4840-a2b4-3ac08b0f44ac tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] cores quota exceeded for 39a633cf25be4060aee49133e60c142a, tried to resize instance. Jul 25 15:17:01.606853 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-36e7b42e-7124-4840-a2b4-3ac08b0f44ac tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-36e7b42e-7124-4840-a2b4-3ac08b0f44ac tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Request method failure captured: Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1/action HTTP/1.1 Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 37 Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rPdV5lL1CG46QiAb8sQfBCVfBHExT5uXNi9SERcdzg1NDXXFa2GaJgLqXRgLcVcYd3tfpzIgccmBZeXMDRdtS5c3wxY6eM9xnOr-1ZP35BCB10ZJef-oF8TltbbSW55qvcq_qQafSsecU1sLCoPlbee51lhNakIJpuRLNHvEKMGprc Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 39a633cf25be4060aee49133e60c142a Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-460204793 Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: X-Role: admin,reader,member Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: admin,reader,member Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/39a633cf25be4060aee49133e60c142a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/39a633cf25be4060aee49133e60c142a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_39a633cf25be4060aee49133e60c142a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/39a633cf25be4060aee49133e60c142a"}]}] Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersAdminNegativeTestJSON-460204793 Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 39a633cf25be4060aee49133e60c142a Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-460204793 Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersAdminNegativeTestJSON-460204793-project-admin Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 9b2504c53e514ef0afdabe0779acea38 Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersAdminNegativeTestJSON-460204793-project-admin Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: {"resize": {"flavorRef": "10839980"}} Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'ef44081a-708b-436e-ad6a-0ab3452637f1', 'body': {'resize': {'flavorRef': '10839980'}}} Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 15:17:01.609192 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-36e7b42e-7124-4840-a2b4-3ac08b0f44ac tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-36e7b42e-7124-4840-a2b4-3ac08b0f44ac tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] 10.222.0.88 "POST /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1/action" status: 403 len: 113 microversion: 2.1 time: 0.231756 Jul 25 15:17:01.613158 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3306/6835] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:17:01 2022] POST /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1/action => generated 113 bytes in 233 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:17:01.621486 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-87ae4386-431f-439b-9c3f-b7cdcc58a1ed tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:01.622379 n-d-846435-14 devstack@n-api.service[119304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 15:17:01.622379 n-d-846435-14 devstack@n-api.service[119304]: warnings.warn(msg) Jul 25 15:17:01.641560 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-87ae4386-431f-439b-9c3f-b7cdcc58a1ed tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] 10.222.0.88 "DELETE /compute/v2.1/flavors/10839980" status: 202 len: 0 microversion: 2.1 time: 0.023507 Jul 25 15:17:01.642146 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3530/6836] 10.222.0.88 () {58 vars in 1155 bytes} [Mon Jul 25 15:17:01 2022] DELETE /compute/v2.1/flavors/10839980 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 15:17:01.650540 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ced794d6-a4ad-445d-a85c-1a70f2e5666a tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:01.671723 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ced794d6-a4ad-445d-a85c-1a70f2e5666a tempest-ServersAdminNegativeTestJSON-460204793 tempest-ServersAdminNegativeTestJSON-460204793-project-admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024882 Jul 25 15:17:01.672357 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3307/6837] 10.222.0.88 () {58 vars in 1146 bytes} [Mon Jul 25 15:17:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:01.692337 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bf3e04cb-f8d9-431b-b0f0-5b4ab060721e tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:01.692858 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bf3e04cb-f8d9-431b-b0f0-5b4ab060721e tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] [instance: ef44081a-708b-436e-ad6a-0ab3452637f1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:01.699558 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bf3e04cb-f8d9-431b-b0f0-5b4ab060721e tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:01.700082 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bf3e04cb-f8d9-431b-b0f0-5b4ab060721e tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:01.700928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bf3e04cb-f8d9-431b-b0f0-5b4ab060721e tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:01.701376 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bf3e04cb-f8d9-431b-b0f0-5b4ab060721e tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:01.726402 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bf3e04cb-f8d9-431b-b0f0-5b4ab060721e tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] [instance: ef44081a-708b-436e-ad6a-0ab3452637f1] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:17:01.806788 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bf3e04cb-f8d9-431b-b0f0-5b4ab060721e tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] 10.222.0.88 "DELETE /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1" status: 204 len: 0 microversion: 2.1 time: 0.117937 Jul 25 15:17:01.807534 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3531/6838] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:17:01 2022] DELETE /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:17:01.816828 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dfb65445-1e22-43fc-8037-1004a15a2801 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:01.817475 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-dfb65445-1e22-43fc-8037-1004a15a2801 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] [instance: ef44081a-708b-436e-ad6a-0ab3452637f1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:01.824115 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dfb65445-1e22-43fc-8037-1004a15a2801 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:01.824532 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dfb65445-1e22-43fc-8037-1004a15a2801 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:01.825440 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dfb65445-1e22-43fc-8037-1004a15a2801 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:01.825880 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dfb65445-1e22-43fc-8037-1004a15a2801 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:01.965162 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-dfb65445-1e22-43fc-8037-1004a15a2801 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96343e1a2b514765b721a6a206ea9231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541412e3cb51432f845b190ab6f037a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:01.973554 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dfb65445-1e22-43fc-8037-1004a15a2801 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] 10.222.0.88 "GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1" status: 200 len: 1478 microversion: 2.1 time: 0.161215 Jul 25 15:17:01.974138 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3308/6839] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:01 2022] GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1 => generated 1478 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:02.995440 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-da318038-2432-44b2-b87b-10b85fc4f728 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:02.996197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-da318038-2432-44b2-b87b-10b85fc4f728 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] [instance: ef44081a-708b-436e-ad6a-0ab3452637f1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:03.004038 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-da318038-2432-44b2-b87b-10b85fc4f728 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:03.004520 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-da318038-2432-44b2-b87b-10b85fc4f728 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:03.005300 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-da318038-2432-44b2-b87b-10b85fc4f728 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:03.005748 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-da318038-2432-44b2-b87b-10b85fc4f728 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:03.157099 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-da318038-2432-44b2-b87b-10b85fc4f728 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96343e1a2b514765b721a6a206ea9231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541412e3cb51432f845b190ab6f037a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:03.165752 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-da318038-2432-44b2-b87b-10b85fc4f728 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] 10.222.0.88 "GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1" status: 200 len: 1478 microversion: 2.1 time: 0.174525 Jul 25 15:17:03.166366 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3532/6840] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:02 2022] GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1 => generated 1478 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:03.886047 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-2fd827a5-763d-43e3-80ca-da93a9c7af1b req-d6e9275b-7149-49df-8840-68616bc7bb8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef44081a-708b-436e-ad6a-0ab3452637f1", "name": "network-vif-deleted", "tag": "5cdb6b62-959f-4965-a549-5d4f53dff8e4"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:17:03.900170 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-2fd827a5-763d-43e3-80ca-da93a9c7af1b req-d6e9275b-7149-49df-8840-68616bc7bb8b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:03.900621 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-2fd827a5-763d-43e3-80ca-da93a9c7af1b req-d6e9275b-7149-49df-8840-68616bc7bb8b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:03.912941 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-2fd827a5-763d-43e3-80ca-da93a9c7af1b req-d6e9275b-7149-49df-8840-68616bc7bb8b service nova] Creating event network-vif-deleted:5cdb6b62-959f-4965-a549-5d4f53dff8e4 for instance ef44081a-708b-436e-ad6a-0ab3452637f1 on n-h2-846435-14 Jul 25 15:17:03.918719 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-2fd827a5-763d-43e3-80ca-da93a9c7af1b req-d6e9275b-7149-49df-8840-68616bc7bb8b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036818 Jul 25 15:17:03.919491 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3309/6841] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:17:04.188011 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6839b04c-04d6-4e35-acfc-fee4479d74a6 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:04.188620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6839b04c-04d6-4e35-acfc-fee4479d74a6 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] [instance: ef44081a-708b-436e-ad6a-0ab3452637f1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:04.196365 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6839b04c-04d6-4e35-acfc-fee4479d74a6 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:04.196834 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6839b04c-04d6-4e35-acfc-fee4479d74a6 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:04.197631 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6839b04c-04d6-4e35-acfc-fee4479d74a6 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:04.198088 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6839b04c-04d6-4e35-acfc-fee4479d74a6 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:04.233117 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6839b04c-04d6-4e35-acfc-fee4479d74a6 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:04.233689 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6839b04c-04d6-4e35-acfc-fee4479d74a6 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:04.234162 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-6839b04c-04d6-4e35-acfc-fee4479d74a6 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lazy-loading 'fault' on Instance uuid ef44081a-708b-436e-ad6a-0ab3452637f1 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:17:04.280374 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6839b04c-04d6-4e35-acfc-fee4479d74a6 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96343e1a2b514765b721a6a206ea9231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541412e3cb51432f845b190ab6f037a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:04.289076 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6839b04c-04d6-4e35-acfc-fee4479d74a6 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] 10.222.0.88 "GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1" status: 200 len: 1312 microversion: 2.1 time: 0.105290 Jul 25 15:17:04.289734 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3533/6842] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:04 2022] GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1 => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:05.312624 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-16e2e7fe-9dd8-4d2a-91fd-22166afdbb12 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:05.313316 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-16e2e7fe-9dd8-4d2a-91fd-22166afdbb12 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] [instance: ef44081a-708b-436e-ad6a-0ab3452637f1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:05.323198 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-16e2e7fe-9dd8-4d2a-91fd-22166afdbb12 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:05.323752 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-16e2e7fe-9dd8-4d2a-91fd-22166afdbb12 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:05.324990 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-16e2e7fe-9dd8-4d2a-91fd-22166afdbb12 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:05.325539 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-16e2e7fe-9dd8-4d2a-91fd-22166afdbb12 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:05.339735 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-16e2e7fe-9dd8-4d2a-91fd-22166afdbb12 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] HTTP exception thrown: Instance ef44081a-708b-436e-ad6a-0ab3452637f1 could not be found. Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-16e2e7fe-9dd8-4d2a-91fd-22166afdbb12 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Request method failure captured: Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1 HTTP/1.1 Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rPc_HIj4MwzwGcmnWIEkVfvMi5KULUwk2kzod7m53ME-WKH7RPCv-Sm0rIgm9T7_MKsxeCAhlPd9DBSg4M5aQ41pEnJ2oH_xiVBza18CAmjilZaMUqZIizol7EUGNIqtZF5_lRzYOCtKcDAmfiCnSrqgQtGmxooKgfYFV-ViPCpx5w Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 541412e3cb51432f845b190ab6f037a1 Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-227953351 Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/541412e3cb51432f845b190ab6f037a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/541412e3cb51432f845b190ab6f037a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_541412e3cb51432f845b190ab6f037a1", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/541412e3cb51432f845b190ab6f037a1"}]}] Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersAdminNegativeTestJSON-227953351 Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 541412e3cb51432f845b190ab6f037a1 Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-227953351 Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersAdminNegativeTestJSON-227953351-project Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 96343e1a2b514765b721a6a206ea9231 Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersAdminNegativeTestJSON-227953351-project Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance ef44081a-708b-436e-ad6a-0ab3452637f1 could not be found. Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'ef44081a-708b-436e-ad6a-0ab3452637f1'} Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef44081a-708b-436e-ad6a-0ab3452637f1 could not be found. Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef44081a-708b-436e-ad6a-0ab3452637f1 could not be found. Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:17:05.341603 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:17:05.345538 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:17:05.345538 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:17:05.345538 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:17:05.345538 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:17:05.345538 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:17:05.345538 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef44081a-708b-436e-ad6a-0ab3452637f1 could not be found. Jul 25 15:17:05.345538 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:17:05.345538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-16e2e7fe-9dd8-4d2a-91fd-22166afdbb12 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] Returning 404 to user: Instance ef44081a-708b-436e-ad6a-0ab3452637f1 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:17:05.345538 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-16e2e7fe-9dd8-4d2a-91fd-22166afdbb12 tempest-ServersAdminNegativeTestJSON-227953351 tempest-ServersAdminNegativeTestJSON-227953351-project] 10.222.0.88 "GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1" status: 404 len: 111 microversion: 2.1 time: 0.036443 Jul 25 15:17:05.345538 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3310/6843] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:05 2022] GET /compute/v2.1/servers/ef44081a-708b-436e-ad6a-0ab3452637f1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:17:11.439133 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:17:11.440508 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:17:11.563082 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-32966751-5a85-4beb-8889-8eaf7965a810 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1617737577", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "e47dd1e0-1c24-4263-b09d-37f55e4b2ce6"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:17:11.618689 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-32966751-5a85-4beb-8889-8eaf7965a810 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] validate_networks() for [('e47dd1e0-1c24-4263-b09d-37f55e4b2ce6', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:17:12.024137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-32966751-5a85-4beb-8889-8eaf7965a810 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:17:12.024605 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-32966751-5a85-4beb-8889-8eaf7965a810 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:17:12.025128 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-32966751-5a85-4beb-8889-8eaf7965a810 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:17:12.025519 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-32966751-5a85-4beb-8889-8eaf7965a810 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:17:12.025942 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-32966751-5a85-4beb-8889-8eaf7965a810 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:17:12.037656 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-32966751-5a85-4beb-8889-8eaf7965a810 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:12.037885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-32966751-5a85-4beb-8889-8eaf7965a810 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:12.038967 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-32966751-5a85-4beb-8889-8eaf7965a810 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:12.039195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-32966751-5a85-4beb-8889-8eaf7965a810 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:12.059667 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-32966751-5a85-4beb-8889-8eaf7965a810 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Getting quotas for project cce7ca57e87848f4913891286f4d4596. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:17:12.067574 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-32966751-5a85-4beb-8889-8eaf7965a810 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Getting quotas for user 8611f4e8c43b452db8ee6335dce164e4 and project cce7ca57e87848f4913891286f4d4596. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:17:12.081981 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-32966751-5a85-4beb-8889-8eaf7965a810 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:17:12.084342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-32966751-5a85-4beb-8889-8eaf7965a810 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:17:12.130338 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-32966751-5a85-4beb-8889-8eaf7965a810 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.696819 Jul 25 15:17:12.131191 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3534/6844] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:17:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:17:12.143222 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:17:12.145568 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:17:12.152848 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-31164429-816b-4687-b578-a236b5aa5c9e tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:12.153691 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-31164429-816b-4687-b578-a236b5aa5c9e tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:12.222741 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-31164429-816b-4687-b578-a236b5aa5c9e tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:12.230514 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-31164429-816b-4687-b578-a236b5aa5c9e tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1215 microversion: 2.1 time: 0.089259 Jul 25 15:17:12.231711 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3311/6845] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:12 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1215 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:13.252616 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-07232141-61e5-4c59-9210-6e9b86504f0c tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:13.254117 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-07232141-61e5-4c59-9210-6e9b86504f0c tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:13.261885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-07232141-61e5-4c59-9210-6e9b86504f0c tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:13.262792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-07232141-61e5-4c59-9210-6e9b86504f0c tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:13.263824 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-07232141-61e5-4c59-9210-6e9b86504f0c tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:13.264519 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-07232141-61e5-4c59-9210-6e9b86504f0c tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:13.356979 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-07232141-61e5-4c59-9210-6e9b86504f0c tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:13.367139 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-07232141-61e5-4c59-9210-6e9b86504f0c tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1275 microversion: 2.1 time: 0.119581 Jul 25 15:17:13.367768 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3535/6846] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:13 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1275 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:14.392589 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7512431d-9b4a-4e8a-bf42-468a7b82ff4b tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:14.393556 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7512431d-9b4a-4e8a-bf42-468a7b82ff4b tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:14.403512 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7512431d-9b4a-4e8a-bf42-468a7b82ff4b tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:14.404365 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7512431d-9b4a-4e8a-bf42-468a7b82ff4b tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:14.405169 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7512431d-9b4a-4e8a-bf42-468a7b82ff4b tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:14.405772 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7512431d-9b4a-4e8a-bf42-468a7b82ff4b tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:14.688251 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7512431d-9b4a-4e8a-bf42-468a7b82ff4b tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:14.698859 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7512431d-9b4a-4e8a-bf42-468a7b82ff4b tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1315 microversion: 2.1 time: 0.310371 Jul 25 15:17:14.699788 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3312/6847] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:14 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:15.124597 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-dd1649b7-f2e9-4237-944a-93db4fb49bc3 req-53255d11-d1f5-46dc-b28b-1f32deaf77fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6bd28d8-ab9f-4741-aeb7-f7868a049b54", "tag": "a8f59299-80e6-4ddc-839d-9cb0c434bf56"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:17:15.140613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-dd1649b7-f2e9-4237-944a-93db4fb49bc3 req-53255d11-d1f5-46dc-b28b-1f32deaf77fa service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:15.141342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-dd1649b7-f2e9-4237-944a-93db4fb49bc3 req-53255d11-d1f5-46dc-b28b-1f32deaf77fa service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:15.155035 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-dd1649b7-f2e9-4237-944a-93db4fb49bc3 req-53255d11-d1f5-46dc-b28b-1f32deaf77fa service nova] Creating event network-changed:a8f59299-80e6-4ddc-839d-9cb0c434bf56 for instance e6bd28d8-ab9f-4741-aeb7-f7868a049b54 on n-h1-846435-14 Jul 25 15:17:15.163694 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-dd1649b7-f2e9-4237-944a-93db4fb49bc3 req-53255d11-d1f5-46dc-b28b-1f32deaf77fa service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163124 Jul 25 15:17:15.164385 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3536/6848] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:17:15.721659 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-938bda80-f8f7-4a14-a354-84ba228d272e tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:15.722429 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-938bda80-f8f7-4a14-a354-84ba228d272e tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:15.725290 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:17:15.730870 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-938bda80-f8f7-4a14-a354-84ba228d272e tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:15.731318 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-938bda80-f8f7-4a14-a354-84ba228d272e tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:15.732260 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-938bda80-f8f7-4a14-a354-84ba228d272e tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:15.732710 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-938bda80-f8f7-4a14-a354-84ba228d272e tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:15.737650 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=70 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:17:16.224726 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-938bda80-f8f7-4a14-a354-84ba228d272e tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:16.232864 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-938bda80-f8f7-4a14-a354-84ba228d272e tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1315 microversion: 2.1 time: 0.515282 Jul 25 15:17:16.233420 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3313/6849] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:15 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1315 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:17:17.255186 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3ef759ab-e802-4b02-8601-4eaa5e772ad1 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:17.255912 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3ef759ab-e802-4b02-8601-4eaa5e772ad1 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:17.263861 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3ef759ab-e802-4b02-8601-4eaa5e772ad1 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:17.264386 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3ef759ab-e802-4b02-8601-4eaa5e772ad1 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:17.265173 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3ef759ab-e802-4b02-8601-4eaa5e772ad1 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:17.265622 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3ef759ab-e802-4b02-8601-4eaa5e772ad1 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:17.404743 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3ef759ab-e802-4b02-8601-4eaa5e772ad1 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:17.407211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:17:17.414326 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3ef759ab-e802-4b02-8601-4eaa5e772ad1 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1315 microversion: 2.1 time: 0.163941 Jul 25 15:17:17.414909 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3537/6850] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:17 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:18.435897 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b80e8acf-cbcd-4969-a4f1-0889188c7406 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:18.436530 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b80e8acf-cbcd-4969-a4f1-0889188c7406 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:18.444067 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b80e8acf-cbcd-4969-a4f1-0889188c7406 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:18.444523 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b80e8acf-cbcd-4969-a4f1-0889188c7406 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:18.445307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b80e8acf-cbcd-4969-a4f1-0889188c7406 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:18.445743 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b80e8acf-cbcd-4969-a4f1-0889188c7406 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:18.584822 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b80e8acf-cbcd-4969-a4f1-0889188c7406 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:18.593137 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b80e8acf-cbcd-4969-a4f1-0889188c7406 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1315 microversion: 2.1 time: 0.161507 Jul 25 15:17:18.593798 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3314/6851] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:18 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:19.615278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bfc0495f-7167-446d-b9a9-d07b7232089f tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:19.615900 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bfc0495f-7167-446d-b9a9-d07b7232089f tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:19.618555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:17:19.626214 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bfc0495f-7167-446d-b9a9-d07b7232089f tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:19.626694 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bfc0495f-7167-446d-b9a9-d07b7232089f tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:19.627524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bfc0495f-7167-446d-b9a9-d07b7232089f tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:19.627953 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bfc0495f-7167-446d-b9a9-d07b7232089f tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:19.771556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bfc0495f-7167-446d-b9a9-d07b7232089f tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:19.779784 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bfc0495f-7167-446d-b9a9-d07b7232089f tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1315 microversion: 2.1 time: 0.169048 Jul 25 15:17:19.780418 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3538/6852] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:19 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:19.801381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-a6f05a3d-f831-49ea-9618-e4f23c408c2b req-975597a4-dac4-47ba-9422-38f66f6805f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6bd28d8-ab9f-4741-aeb7-f7868a049b54", "name": "network-vif-plugged", "status": "completed", "tag": "a8f59299-80e6-4ddc-839d-9cb0c434bf56"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:17:19.812981 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-a6f05a3d-f831-49ea-9618-e4f23c408c2b req-975597a4-dac4-47ba-9422-38f66f6805f9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:19.813689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-a6f05a3d-f831-49ea-9618-e4f23c408c2b req-975597a4-dac4-47ba-9422-38f66f6805f9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:19.825624 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-a6f05a3d-f831-49ea-9618-e4f23c408c2b req-975597a4-dac4-47ba-9422-38f66f6805f9 service nova] Creating event network-vif-plugged:a8f59299-80e6-4ddc-839d-9cb0c434bf56 for instance e6bd28d8-ab9f-4741-aeb7-f7868a049b54 on n-h1-846435-14 Jul 25 15:17:19.830790 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-a6f05a3d-f831-49ea-9618-e4f23c408c2b req-975597a4-dac4-47ba-9422-38f66f6805f9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033614 Jul 25 15:17:19.831401 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3315/6853] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:17:20.804966 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ddfe3346-6b59-45e9-ae2f-7ede4d186017 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:20.806040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ddfe3346-6b59-45e9-ae2f-7ede4d186017 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:20.817327 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ddfe3346-6b59-45e9-ae2f-7ede4d186017 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:20.818055 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ddfe3346-6b59-45e9-ae2f-7ede4d186017 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:20.819293 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ddfe3346-6b59-45e9-ae2f-7ede4d186017 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:20.820082 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ddfe3346-6b59-45e9-ae2f-7ede4d186017 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:20.987293 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ddfe3346-6b59-45e9-ae2f-7ede4d186017 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:20.995528 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ddfe3346-6b59-45e9-ae2f-7ede4d186017 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1315 microversion: 2.1 time: 0.197587 Jul 25 15:17:20.996984 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3539/6854] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:20 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:22.020060 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0344c920-e7fc-494e-a25f-d9a8587f6c1c tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:22.020721 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0344c920-e7fc-494e-a25f-d9a8587f6c1c tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:22.027693 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0344c920-e7fc-494e-a25f-d9a8587f6c1c tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:22.028184 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0344c920-e7fc-494e-a25f-d9a8587f6c1c tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:22.028968 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0344c920-e7fc-494e-a25f-d9a8587f6c1c tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:22.029411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0344c920-e7fc-494e-a25f-d9a8587f6c1c tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:22.169914 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0344c920-e7fc-494e-a25f-d9a8587f6c1c tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:22.178226 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0344c920-e7fc-494e-a25f-d9a8587f6c1c tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1501 microversion: 2.1 time: 0.163489 Jul 25 15:17:22.178783 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3316/6855] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:22 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1501 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:22.200018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5c693c04-ffeb-44f9-ae83-30f49d64dc9d tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:17:22.202355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5c693c04-ffeb-44f9-ae83-30f49d64dc9d tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:22.205310 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:17:22.206015 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:17:22.212589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c693c04-ffeb-44f9-ae83-30f49d64dc9d tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:22.213053 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c693c04-ffeb-44f9-ae83-30f49d64dc9d tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:22.213863 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c693c04-ffeb-44f9-ae83-30f49d64dc9d tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:22.214304 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5c693c04-ffeb-44f9-ae83-30f49d64dc9d tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:22.293211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5c693c04-ffeb-44f9-ae83-30f49d64dc9d tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:22.299634 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5c693c04-ffeb-44f9-ae83-30f49d64dc9d tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Old instance type m1.heat2, new instance type m1.heat {{(pid=119304) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 15:17:22.306479 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-5c693c04-ffeb-44f9-ae83-30f49d64dc9d tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:17:22.306912 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-5c693c04-ffeb-44f9-ae83-30f49d64dc9d tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:17:22.307396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-5c693c04-ffeb-44f9-ae83-30f49d64dc9d tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:17:22.307815 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-5c693c04-ffeb-44f9-ae83-30f49d64dc9d tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:17:22.308279 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-5c693c04-ffeb-44f9-ae83-30f49d64dc9d tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:17:22.423325 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5c693c04-ffeb-44f9-ae83-30f49d64dc9d tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "POST /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54/action" status: 202 len: 0 microversion: 2.1 time: 0.227578 Jul 25 15:17:22.424060 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3540/6856] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:17:22 2022] POST /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:17:22.433325 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f3096e7c-9bd6-4221-ad76-44f1940532d6 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:22.434437 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f3096e7c-9bd6-4221-ad76-44f1940532d6 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:22.439769 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:17:22.446095 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3096e7c-9bd6-4221-ad76-44f1940532d6 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:22.446620 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3096e7c-9bd6-4221-ad76-44f1940532d6 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:22.447417 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3096e7c-9bd6-4221-ad76-44f1940532d6 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:22.448023 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f3096e7c-9bd6-4221-ad76-44f1940532d6 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:22.657559 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f3096e7c-9bd6-4221-ad76-44f1940532d6 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:22.670326 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f3096e7c-9bd6-4221-ad76-44f1940532d6 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1510 microversion: 2.1 time: 0.241242 Jul 25 15:17:22.673583 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3317/6857] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:22 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1510 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:23.699270 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-984276eb-bdf0-4b93-a673-c2056148fa55 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:23.700468 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-984276eb-bdf0-4b93-a673-c2056148fa55 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:23.710984 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-984276eb-bdf0-4b93-a673-c2056148fa55 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:23.711563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-984276eb-bdf0-4b93-a673-c2056148fa55 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:23.712781 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-984276eb-bdf0-4b93-a673-c2056148fa55 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:23.713426 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-984276eb-bdf0-4b93-a673-c2056148fa55 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:23.919807 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-984276eb-bdf0-4b93-a673-c2056148fa55 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:23.929127 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-984276eb-bdf0-4b93-a673-c2056148fa55 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1510 microversion: 2.1 time: 0.235966 Jul 25 15:17:23.929759 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3541/6858] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:23 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1510 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:24.953464 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-02f28c8b-8565-4496-8b42-635eef211e77 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:24.954368 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-02f28c8b-8565-4496-8b42-635eef211e77 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:24.963291 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-02f28c8b-8565-4496-8b42-635eef211e77 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:24.963732 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-02f28c8b-8565-4496-8b42-635eef211e77 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:24.964570 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-02f28c8b-8565-4496-8b42-635eef211e77 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:24.965013 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-02f28c8b-8565-4496-8b42-635eef211e77 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:25.126517 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-02f28c8b-8565-4496-8b42-635eef211e77 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:25.135026 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-02f28c8b-8565-4496-8b42-635eef211e77 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1515 microversion: 2.1 time: 0.186695 Jul 25 15:17:25.135644 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3318/6859] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:24 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:26.157473 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e0185cb4-8525-4f81-9855-6680dc22996d tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:26.158103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e0185cb4-8525-4f81-9855-6680dc22996d tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:26.165465 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e0185cb4-8525-4f81-9855-6680dc22996d tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:26.165949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e0185cb4-8525-4f81-9855-6680dc22996d tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:26.166816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e0185cb4-8525-4f81-9855-6680dc22996d tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:26.167310 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e0185cb4-8525-4f81-9855-6680dc22996d tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:26.608293 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e0185cb4-8525-4f81-9855-6680dc22996d tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:26.616977 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e0185cb4-8525-4f81-9855-6680dc22996d tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1515 microversion: 2.1 time: 0.463938 Jul 25 15:17:26.617713 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3542/6860] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:26 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1515 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:27.639874 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-77b2076b-d4e6-49a1-96a4-c385bc3ad335 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:27.640779 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-77b2076b-d4e6-49a1-96a4-c385bc3ad335 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:27.649572 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77b2076b-d4e6-49a1-96a4-c385bc3ad335 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:27.650035 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77b2076b-d4e6-49a1-96a4-c385bc3ad335 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:27.650858 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77b2076b-d4e6-49a1-96a4-c385bc3ad335 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:27.651321 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-77b2076b-d4e6-49a1-96a4-c385bc3ad335 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:27.806417 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-77b2076b-d4e6-49a1-96a4-c385bc3ad335 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:27.818925 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-77b2076b-d4e6-49a1-96a4-c385bc3ad335 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1515 microversion: 2.1 time: 0.183268 Jul 25 15:17:27.819846 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3319/6861] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:27 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:28.851606 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6ce49887-0d0e-4b97-a1de-cba505cf7653 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:28.852507 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6ce49887-0d0e-4b97-a1de-cba505cf7653 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:28.860533 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6ce49887-0d0e-4b97-a1de-cba505cf7653 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:28.860988 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6ce49887-0d0e-4b97-a1de-cba505cf7653 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:28.861774 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6ce49887-0d0e-4b97-a1de-cba505cf7653 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:28.862211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6ce49887-0d0e-4b97-a1de-cba505cf7653 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:29.005926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6ce49887-0d0e-4b97-a1de-cba505cf7653 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:29.014283 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6ce49887-0d0e-4b97-a1de-cba505cf7653 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1515 microversion: 2.1 time: 0.166765 Jul 25 15:17:29.014894 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3543/6862] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:28 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:30.035903 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d899f169-72ed-48ed-9c52-428e98bf98c1 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:30.036545 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d899f169-72ed-48ed-9c52-428e98bf98c1 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:30.044399 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d899f169-72ed-48ed-9c52-428e98bf98c1 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:30.044852 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d899f169-72ed-48ed-9c52-428e98bf98c1 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:30.045638 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d899f169-72ed-48ed-9c52-428e98bf98c1 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:30.046072 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d899f169-72ed-48ed-9c52-428e98bf98c1 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:30.194055 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d899f169-72ed-48ed-9c52-428e98bf98c1 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:30.202669 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d899f169-72ed-48ed-9c52-428e98bf98c1 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1515 microversion: 2.1 time: 0.170761 Jul 25 15:17:30.203282 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3320/6863] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:30 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:31.225125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3ab8d8a2-9099-4477-ae35-c8374177fa93 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:31.225806 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3ab8d8a2-9099-4477-ae35-c8374177fa93 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:31.233723 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3ab8d8a2-9099-4477-ae35-c8374177fa93 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:31.234190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3ab8d8a2-9099-4477-ae35-c8374177fa93 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:31.234994 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3ab8d8a2-9099-4477-ae35-c8374177fa93 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:31.235442 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3ab8d8a2-9099-4477-ae35-c8374177fa93 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:31.408349 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3ab8d8a2-9099-4477-ae35-c8374177fa93 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:31.417354 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3ab8d8a2-9099-4477-ae35-c8374177fa93 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1515 microversion: 2.1 time: 0.196144 Jul 25 15:17:31.417954 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3544/6864] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:31 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1515 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:32.443303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-baa0cc7c-02d1-42a1-ae7d-510bc1bee95a tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:32.444742 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-baa0cc7c-02d1-42a1-ae7d-510bc1bee95a tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:32.457138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-baa0cc7c-02d1-42a1-ae7d-510bc1bee95a tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:32.458024 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-baa0cc7c-02d1-42a1-ae7d-510bc1bee95a tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:32.459400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-baa0cc7c-02d1-42a1-ae7d-510bc1bee95a tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:32.460267 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-baa0cc7c-02d1-42a1-ae7d-510bc1bee95a tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:32.635218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-baa0cc7c-02d1-42a1-ae7d-510bc1bee95a tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:32.646927 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-baa0cc7c-02d1-42a1-ae7d-510bc1bee95a tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1515 microversion: 2.1 time: 0.211055 Jul 25 15:17:32.647927 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3321/6865] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:32 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1515 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:33.680569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4149ecda-7a47-4614-b216-b401769388a7 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:33.681201 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4149ecda-7a47-4614-b216-b401769388a7 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:33.689074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4149ecda-7a47-4614-b216-b401769388a7 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:33.689536 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4149ecda-7a47-4614-b216-b401769388a7 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:33.690312 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4149ecda-7a47-4614-b216-b401769388a7 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:33.690759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4149ecda-7a47-4614-b216-b401769388a7 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:33.830777 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4149ecda-7a47-4614-b216-b401769388a7 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:33.838989 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4149ecda-7a47-4614-b216-b401769388a7 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1515 microversion: 2.1 time: 0.162513 Jul 25 15:17:33.839580 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3545/6866] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:33 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:34.861205 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b3237c16-b18b-404f-ace4-7e772ed77382 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:34.861782 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b3237c16-b18b-404f-ace4-7e772ed77382 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:34.869042 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3237c16-b18b-404f-ace4-7e772ed77382 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:34.869500 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3237c16-b18b-404f-ace4-7e772ed77382 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:34.870270 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3237c16-b18b-404f-ace4-7e772ed77382 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:34.870706 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3237c16-b18b-404f-ace4-7e772ed77382 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:35.057827 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b3237c16-b18b-404f-ace4-7e772ed77382 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:35.066700 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b3237c16-b18b-404f-ace4-7e772ed77382 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1515 microversion: 2.1 time: 0.209565 Jul 25 15:17:35.067310 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3322/6867] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:34 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1515 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:36.102075 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a5500511-ba27-4dfe-8f81-74def399ff5f tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:36.102779 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a5500511-ba27-4dfe-8f81-74def399ff5f tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:36.110563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5500511-ba27-4dfe-8f81-74def399ff5f tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:36.111039 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5500511-ba27-4dfe-8f81-74def399ff5f tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:36.111837 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5500511-ba27-4dfe-8f81-74def399ff5f tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:36.112330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5500511-ba27-4dfe-8f81-74def399ff5f tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:36.251348 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a5500511-ba27-4dfe-8f81-74def399ff5f tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:36.259560 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a5500511-ba27-4dfe-8f81-74def399ff5f tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1515 microversion: 2.1 time: 0.161669 Jul 25 15:17:36.260182 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3546/6868] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:36 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:17:37.281417 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9c910e5a-35d6-46cf-ab7f-3cd626444fd9 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:37.282049 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9c910e5a-35d6-46cf-ab7f-3cd626444fd9 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:37.289759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9c910e5a-35d6-46cf-ab7f-3cd626444fd9 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:37.290200 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9c910e5a-35d6-46cf-ab7f-3cd626444fd9 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:37.290989 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9c910e5a-35d6-46cf-ab7f-3cd626444fd9 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:37.291422 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9c910e5a-35d6-46cf-ab7f-3cd626444fd9 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:37.435491 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9c910e5a-35d6-46cf-ab7f-3cd626444fd9 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:37.444254 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9c910e5a-35d6-46cf-ab7f-3cd626444fd9 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1515 microversion: 2.1 time: 0.166935 Jul 25 15:17:37.444858 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3323/6869] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:37 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:38.469535 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-541942a5-4e0b-41eb-b86a-f8edddeb9f52 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:38.470682 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-541942a5-4e0b-41eb-b86a-f8edddeb9f52 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:38.478803 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-541942a5-4e0b-41eb-b86a-f8edddeb9f52 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:38.479271 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-541942a5-4e0b-41eb-b86a-f8edddeb9f52 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:38.480103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-541942a5-4e0b-41eb-b86a-f8edddeb9f52 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:38.480557 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-541942a5-4e0b-41eb-b86a-f8edddeb9f52 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:38.618650 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-541942a5-4e0b-41eb-b86a-f8edddeb9f52 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:38.626982 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-541942a5-4e0b-41eb-b86a-f8edddeb9f52 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1515 microversion: 2.1 time: 0.163801 Jul 25 15:17:38.627572 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3547/6870] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:38 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:39.648745 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ee992870-3a9e-421e-b1d4-8313075b2800 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:39.649368 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ee992870-3a9e-421e-b1d4-8313075b2800 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:39.657393 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee992870-3a9e-421e-b1d4-8313075b2800 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:39.657853 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee992870-3a9e-421e-b1d4-8313075b2800 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:39.658675 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee992870-3a9e-421e-b1d4-8313075b2800 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:39.659112 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee992870-3a9e-421e-b1d4-8313075b2800 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:39.801056 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ee992870-3a9e-421e-b1d4-8313075b2800 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:39.809285 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ee992870-3a9e-421e-b1d4-8313075b2800 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1515 microversion: 2.1 time: 0.164508 Jul 25 15:17:39.809877 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3324/6871] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:39 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:40.831283 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6c2caaed-6dcd-4d83-892e-096d98ae390e tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:40.831941 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6c2caaed-6dcd-4d83-892e-096d98ae390e tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:40.839520 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6c2caaed-6dcd-4d83-892e-096d98ae390e tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:40.840022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6c2caaed-6dcd-4d83-892e-096d98ae390e tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:40.840973 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6c2caaed-6dcd-4d83-892e-096d98ae390e tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:40.841424 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6c2caaed-6dcd-4d83-892e-096d98ae390e tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:40.982919 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6c2caaed-6dcd-4d83-892e-096d98ae390e tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:40.990836 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6c2caaed-6dcd-4d83-892e-096d98ae390e tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1515 microversion: 2.1 time: 0.163608 Jul 25 15:17:40.991440 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3548/6872] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:40 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:42.012279 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7cf6fa73-74dd-4a75-bd72-08b73a918d0a tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:42.012947 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7cf6fa73-74dd-4a75-bd72-08b73a918d0a tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:42.020736 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7cf6fa73-74dd-4a75-bd72-08b73a918d0a tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:42.021216 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7cf6fa73-74dd-4a75-bd72-08b73a918d0a tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:42.022007 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7cf6fa73-74dd-4a75-bd72-08b73a918d0a tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:42.022453 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7cf6fa73-74dd-4a75-bd72-08b73a918d0a tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:42.164015 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7cf6fa73-74dd-4a75-bd72-08b73a918d0a tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:42.172530 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7cf6fa73-74dd-4a75-bd72-08b73a918d0a tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1515 microversion: 2.1 time: 0.164346 Jul 25 15:17:42.173127 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3325/6873] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:42 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:43.194088 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a5498621-165b-4f19-93f0-3deb52aeb39a tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:43.194726 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a5498621-165b-4f19-93f0-3deb52aeb39a tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:43.202260 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5498621-165b-4f19-93f0-3deb52aeb39a tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:43.202707 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5498621-165b-4f19-93f0-3deb52aeb39a tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:43.203491 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5498621-165b-4f19-93f0-3deb52aeb39a tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:43.203930 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5498621-165b-4f19-93f0-3deb52aeb39a tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:43.344438 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a5498621-165b-4f19-93f0-3deb52aeb39a tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:43.352380 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a5498621-165b-4f19-93f0-3deb52aeb39a tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1515 microversion: 2.1 time: 0.162251 Jul 25 15:17:43.352964 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3549/6874] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:43 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:44.374695 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f2e76ab9-5c9a-436b-9e35-01033bee4f32 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:44.375880 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f2e76ab9-5c9a-436b-9e35-01033bee4f32 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:44.383467 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f2e76ab9-5c9a-436b-9e35-01033bee4f32 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:44.383922 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f2e76ab9-5c9a-436b-9e35-01033bee4f32 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:44.384754 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f2e76ab9-5c9a-436b-9e35-01033bee4f32 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:44.385188 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f2e76ab9-5c9a-436b-9e35-01033bee4f32 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:44.531142 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f2e76ab9-5c9a-436b-9e35-01033bee4f32 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:44.539242 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f2e76ab9-5c9a-436b-9e35-01033bee4f32 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1515 microversion: 2.1 time: 0.168734 Jul 25 15:17:44.539768 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3326/6875] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:44 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:45.561019 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fc1d32e3-4d54-4054-926e-75a2411f7d63 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:45.561609 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fc1d32e3-4d54-4054-926e-75a2411f7d63 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:45.569188 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fc1d32e3-4d54-4054-926e-75a2411f7d63 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:45.569654 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fc1d32e3-4d54-4054-926e-75a2411f7d63 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:45.570436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fc1d32e3-4d54-4054-926e-75a2411f7d63 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:45.570878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fc1d32e3-4d54-4054-926e-75a2411f7d63 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:45.707373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fc1d32e3-4d54-4054-926e-75a2411f7d63 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:45.715415 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fc1d32e3-4d54-4054-926e-75a2411f7d63 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1515 microversion: 2.1 time: 0.158465 Jul 25 15:17:45.716278 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3550/6876] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:45 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:46.738080 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-74605411-154c-497f-885e-8b0d7bddf139 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:46.738716 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-74605411-154c-497f-885e-8b0d7bddf139 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:46.740642 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=28 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:17:46.746537 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-74605411-154c-497f-885e-8b0d7bddf139 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:46.747001 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-74605411-154c-497f-885e-8b0d7bddf139 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:46.747792 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-74605411-154c-497f-885e-8b0d7bddf139 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:46.748261 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-74605411-154c-497f-885e-8b0d7bddf139 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:46.751551 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=80 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:17:46.884406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-74605411-154c-497f-885e-8b0d7bddf139 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:46.893151 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-74605411-154c-497f-885e-8b0d7bddf139 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1515 microversion: 2.1 time: 0.159850 Jul 25 15:17:46.894011 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3327/6877] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:46 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:47.915085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e6b73b86-11ea-433f-a59c-5137a9b277c0 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:47.915708 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e6b73b86-11ea-433f-a59c-5137a9b277c0 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:47.923759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6b73b86-11ea-433f-a59c-5137a9b277c0 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:47.924272 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6b73b86-11ea-433f-a59c-5137a9b277c0 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:47.925092 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6b73b86-11ea-433f-a59c-5137a9b277c0 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:47.925550 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6b73b86-11ea-433f-a59c-5137a9b277c0 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:48.060393 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e6b73b86-11ea-433f-a59c-5137a9b277c0 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:48.068168 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e6b73b86-11ea-433f-a59c-5137a9b277c0 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1515 microversion: 2.1 time: 0.157084 Jul 25 15:17:48.068758 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3551/6878] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:47 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:49.091073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-de9af461-5067-4cc6-b02e-511942b51387 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:49.091714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-de9af461-5067-4cc6-b02e-511942b51387 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:49.099221 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-de9af461-5067-4cc6-b02e-511942b51387 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:49.099673 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-de9af461-5067-4cc6-b02e-511942b51387 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:49.100481 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-de9af461-5067-4cc6-b02e-511942b51387 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:49.100918 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-de9af461-5067-4cc6-b02e-511942b51387 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:49.240787 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-de9af461-5067-4cc6-b02e-511942b51387 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:49.248953 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-de9af461-5067-4cc6-b02e-511942b51387 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1515 microversion: 2.1 time: 0.162360 Jul 25 15:17:49.249592 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3328/6879] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:49 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:50.270975 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ab223c15-f1c9-4ec8-9d8d-b1443c89749b tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:50.271629 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ab223c15-f1c9-4ec8-9d8d-b1443c89749b tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:50.274465 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=32 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:17:50.280554 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ab223c15-f1c9-4ec8-9d8d-b1443c89749b tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:50.281021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ab223c15-f1c9-4ec8-9d8d-b1443c89749b tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:50.281815 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ab223c15-f1c9-4ec8-9d8d-b1443c89749b tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:50.282267 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ab223c15-f1c9-4ec8-9d8d-b1443c89749b tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:50.285661 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:17:50.431581 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ab223c15-f1c9-4ec8-9d8d-b1443c89749b tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:50.440141 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ab223c15-f1c9-4ec8-9d8d-b1443c89749b tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1515 microversion: 2.1 time: 0.173091 Jul 25 15:17:50.440966 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3552/6880] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:50 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:51.467016 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2d717454-6ce9-405d-939b-6228d44433ba tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:51.467580 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2d717454-6ce9-405d-939b-6228d44433ba tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:51.475247 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2d717454-6ce9-405d-939b-6228d44433ba tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:51.475698 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2d717454-6ce9-405d-939b-6228d44433ba tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:51.476498 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2d717454-6ce9-405d-939b-6228d44433ba tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:51.476936 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2d717454-6ce9-405d-939b-6228d44433ba tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:51.617924 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2d717454-6ce9-405d-939b-6228d44433ba tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:51.626780 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2d717454-6ce9-405d-939b-6228d44433ba tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1515 microversion: 2.1 time: 0.163806 Jul 25 15:17:51.627383 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3329/6881] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:51 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:52.352638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-46d8ed9b-575d-4ccf-824c-102ee8bc6d09 req-4508b046-df34-4edf-ad05-ceeb62b4aac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6bd28d8-ab9f-4741-aeb7-f7868a049b54", "name": "network-vif-unplugged", "status": "completed", "tag": "a8f59299-80e6-4ddc-839d-9cb0c434bf56"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:17:52.364838 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-46d8ed9b-575d-4ccf-824c-102ee8bc6d09 req-4508b046-df34-4edf-ad05-ceeb62b4aac0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:52.365355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-46d8ed9b-575d-4ccf-824c-102ee8bc6d09 req-4508b046-df34-4edf-ad05-ceeb62b4aac0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:52.378334 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-46d8ed9b-575d-4ccf-824c-102ee8bc6d09 req-4508b046-df34-4edf-ad05-ceeb62b4aac0 service nova] Creating event network-vif-unplugged:a8f59299-80e6-4ddc-839d-9cb0c434bf56 for instance e6bd28d8-ab9f-4741-aeb7-f7868a049b54 on n-h2-846435-14 Jul 25 15:17:52.384028 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [req-46d8ed9b-575d-4ccf-824c-102ee8bc6d09 req-4508b046-df34-4edf-ad05-ceeb62b4aac0 service nova] Instance e6bd28d8-ab9f-4741-aeb7-f7868a049b54 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119304) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 15:17:52.396377 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-46d8ed9b-575d-4ccf-824c-102ee8bc6d09 req-4508b046-df34-4edf-ad05-ceeb62b4aac0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047843 Jul 25 15:17:52.397060 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3553/6882] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:17:52.650513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b84a4d43-8684-4355-b10d-2edb139bdec9 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:52.650513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b84a4d43-8684-4355-b10d-2edb139bdec9 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:52.665945 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b84a4d43-8684-4355-b10d-2edb139bdec9 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:52.666421 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b84a4d43-8684-4355-b10d-2edb139bdec9 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:52.667290 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b84a4d43-8684-4355-b10d-2edb139bdec9 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:52.667733 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b84a4d43-8684-4355-b10d-2edb139bdec9 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:52.862302 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b84a4d43-8684-4355-b10d-2edb139bdec9 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:52.870758 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b84a4d43-8684-4355-b10d-2edb139bdec9 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1514 microversion: 2.1 time: 0.225641 Jul 25 15:17:52.872152 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3330/6883] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:52 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1514 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:53.895114 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5a9942a9-f19e-4928-8fb1-83f36646201a tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:53.895996 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5a9942a9-f19e-4928-8fb1-83f36646201a tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:53.904028 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5a9942a9-f19e-4928-8fb1-83f36646201a tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:53.904508 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5a9942a9-f19e-4928-8fb1-83f36646201a tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:53.905300 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5a9942a9-f19e-4928-8fb1-83f36646201a tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:53.905745 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5a9942a9-f19e-4928-8fb1-83f36646201a tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:54.050018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5a9942a9-f19e-4928-8fb1-83f36646201a tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:54.058228 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5a9942a9-f19e-4928-8fb1-83f36646201a tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1512 microversion: 2.1 time: 0.167894 Jul 25 15:17:54.058809 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3554/6884] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:53 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:17:54.417039 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-6f817597-6723-492e-bccd-85ab85e8a6b6 req-76c3c9e1-1704-4bab-a8c9-48631df4059f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6bd28d8-ab9f-4741-aeb7-f7868a049b54", "tag": "a8f59299-80e6-4ddc-839d-9cb0c434bf56"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:17:54.429141 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-6f817597-6723-492e-bccd-85ab85e8a6b6 req-76c3c9e1-1704-4bab-a8c9-48631df4059f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:54.429592 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-6f817597-6723-492e-bccd-85ab85e8a6b6 req-76c3c9e1-1704-4bab-a8c9-48631df4059f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:54.445038 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-6f817597-6723-492e-bccd-85ab85e8a6b6 req-76c3c9e1-1704-4bab-a8c9-48631df4059f service nova] Creating event network-changed:a8f59299-80e6-4ddc-839d-9cb0c434bf56 for instance e6bd28d8-ab9f-4741-aeb7-f7868a049b54 on n-h2-846435-14 Jul 25 15:17:54.452709 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [req-6f817597-6723-492e-bccd-85ab85e8a6b6 req-76c3c9e1-1704-4bab-a8c9-48631df4059f service nova] Instance e6bd28d8-ab9f-4741-aeb7-f7868a049b54 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119303) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 15:17:54.464867 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-6f817597-6723-492e-bccd-85ab85e8a6b6 req-76c3c9e1-1704-4bab-a8c9-48631df4059f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051813 Jul 25 15:17:54.465871 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3331/6885] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:17:55.079469 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-30345c05-4deb-4d13-80b4-03208988f957 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:55.080095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-30345c05-4deb-4d13-80b4-03208988f957 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:55.087574 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-30345c05-4deb-4d13-80b4-03208988f957 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:55.088062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-30345c05-4deb-4d13-80b4-03208988f957 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:55.088852 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-30345c05-4deb-4d13-80b4-03208988f957 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:55.089302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-30345c05-4deb-4d13-80b4-03208988f957 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:55.229775 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-30345c05-4deb-4d13-80b4-03208988f957 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:55.237872 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-30345c05-4deb-4d13-80b4-03208988f957 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1512 microversion: 2.1 time: 0.162684 Jul 25 15:17:55.238462 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3555/6886] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:55 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:56.262566 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2ddbe704-34ef-4f17-a3c0-923e7dd2bc79 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:56.264114 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2ddbe704-34ef-4f17-a3c0-923e7dd2bc79 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:56.270986 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ddbe704-34ef-4f17-a3c0-923e7dd2bc79 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:56.271460 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ddbe704-34ef-4f17-a3c0-923e7dd2bc79 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:56.272264 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ddbe704-34ef-4f17-a3c0-923e7dd2bc79 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:56.272699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2ddbe704-34ef-4f17-a3c0-923e7dd2bc79 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:56.414164 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2ddbe704-34ef-4f17-a3c0-923e7dd2bc79 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:56.422565 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2ddbe704-34ef-4f17-a3c0-923e7dd2bc79 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1509 microversion: 2.1 time: 0.165990 Jul 25 15:17:56.423136 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3332/6887] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:56 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:56.443909 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-337b2db8-0ea5-403d-9102-2e23987146e7 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:56.444543 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-337b2db8-0ea5-403d-9102-2e23987146e7 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:56.456384 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-337b2db8-0ea5-403d-9102-2e23987146e7 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:56.456856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-337b2db8-0ea5-403d-9102-2e23987146e7 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:56.457665 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-337b2db8-0ea5-403d-9102-2e23987146e7 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:56.458110 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-337b2db8-0ea5-403d-9102-2e23987146e7 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:56.498922 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-337b2db8-0ea5-403d-9102-2e23987146e7 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:17:56.564518 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.compute.api [None req-337b2db8-0ea5-403d-9102-2e23987146e7 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Found an unconfirmed migration during delete, id: 16, status: finished Jul 25 15:17:58.022218 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-337b2db8-0ea5-403d-9102-2e23987146e7 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "DELETE /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 204 len: 0 microversion: 2.1 time: 1.582116 Jul 25 15:17:58.023183 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3556/6888] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:17:56 2022] DELETE /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 0 bytes in 1584 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:17:58.031513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6daedfe4-7bf9-407e-bb0e-3d5e040f3043 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:58.032179 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6daedfe4-7bf9-407e-bb0e-3d5e040f3043 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:58.039418 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6daedfe4-7bf9-407e-bb0e-3d5e040f3043 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:58.039882 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6daedfe4-7bf9-407e-bb0e-3d5e040f3043 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:58.040697 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6daedfe4-7bf9-407e-bb0e-3d5e040f3043 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:58.041128 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6daedfe4-7bf9-407e-bb0e-3d5e040f3043 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:58.189192 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6daedfe4-7bf9-407e-bb0e-3d5e040f3043 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:58.197425 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6daedfe4-7bf9-407e-bb0e-3d5e040f3043 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1501 microversion: 2.1 time: 0.169896 Jul 25 15:17:58.198035 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3333/6889] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:58 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1501 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:17:59.219579 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-88197d54-8510-458d-b39b-e37d46a29d29 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:17:59.220351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-88197d54-8510-458d-b39b-e37d46a29d29 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:17:59.229806 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-88197d54-8510-458d-b39b-e37d46a29d29 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:59.230268 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-88197d54-8510-458d-b39b-e37d46a29d29 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:59.231168 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-88197d54-8510-458d-b39b-e37d46a29d29 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:17:59.231613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-88197d54-8510-458d-b39b-e37d46a29d29 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:17:59.372264 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-88197d54-8510-458d-b39b-e37d46a29d29 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8611f4e8c43b452db8ee6335dce164e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7ca57e87848f4913891286f4d4596', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:17:59.380918 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-88197d54-8510-458d-b39b-e37d46a29d29 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 200 len: 1501 microversion: 2.1 time: 0.165711 Jul 25 15:17:59.381515 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3557/6890] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:17:59 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 1501 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:00.048698 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-23a0aad9-fa82-4171-bd35-8297e71ed1f2 req-6a97be34-33a9-4b04-9831-ec31d4321d12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6bd28d8-ab9f-4741-aeb7-f7868a049b54", "name": "network-vif-deleted", "tag": "a8f59299-80e6-4ddc-839d-9cb0c434bf56"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:18:00.063882 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-23a0aad9-fa82-4171-bd35-8297e71ed1f2 req-6a97be34-33a9-4b04-9831-ec31d4321d12 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:00.064754 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-23a0aad9-fa82-4171-bd35-8297e71ed1f2 req-6a97be34-33a9-4b04-9831-ec31d4321d12 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:00.078493 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-23a0aad9-fa82-4171-bd35-8297e71ed1f2 req-6a97be34-33a9-4b04-9831-ec31d4321d12 service nova] Creating event network-vif-deleted:a8f59299-80e6-4ddc-839d-9cb0c434bf56 for instance e6bd28d8-ab9f-4741-aeb7-f7868a049b54 on n-h2-846435-14 Jul 25 15:18:00.085388 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-23a0aad9-fa82-4171-bd35-8297e71ed1f2 req-6a97be34-33a9-4b04-9831-ec31d4321d12 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042141 Jul 25 15:18:00.086013 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3334/6891] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:18:00.401782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-55bee800-09d4-4328-9f46-d99786426dd1 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:00.402668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-55bee800-09d4-4328-9f46-d99786426dd1 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:00.410291 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55bee800-09d4-4328-9f46-d99786426dd1 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:00.410754 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55bee800-09d4-4328-9f46-d99786426dd1 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:00.411535 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55bee800-09d4-4328-9f46-d99786426dd1 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:00.412005 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-55bee800-09d4-4328-9f46-d99786426dd1 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:00.426210 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-55bee800-09d4-4328-9f46-d99786426dd1 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] HTTP exception thrown: Instance e6bd28d8-ab9f-4741-aeb7-f7868a049b54 could not be found. Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-55bee800-09d4-4328-9f46-d99786426dd1 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Request method failure captured: Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 HTTP/1.1 Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3rP39uqHqPn-BdPecUFVULMOR69xdWyVrGJ8gczBpYH2P8SHuSFTaKEWjlTFaVvyL9q-3UfbgivV00h7b6vDXvEE0klpz4MkUkDDBzTf72XheKhrCTlaqQvqrTRmtHSXvJ04HC7dWnlU6Onw-_DpHG2Yt0-ApACURFfWVvNg64lx2ec Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: cce7ca57e87848f4913891286f4d4596 Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-DeleteServersTestJSON-591746428 Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/cce7ca57e87848f4913891286f4d4596"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/cce7ca57e87848f4913891286f4d4596"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_cce7ca57e87848f4913891286f4d4596", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/cce7ca57e87848f4913891286f4d4596"}]}] Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-DeleteServersTestJSON-591746428 Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: cce7ca57e87848f4913891286f4d4596 Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-DeleteServersTestJSON-591746428 Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-DeleteServersTestJSON-591746428-project Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 8611f4e8c43b452db8ee6335dce164e4 Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-DeleteServersTestJSON-591746428-project Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance e6bd28d8-ab9f-4741-aeb7-f7868a049b54 could not be found. Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'e6bd28d8-ab9f-4741-aeb7-f7868a049b54'} Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6bd28d8-ab9f-4741-aeb7-f7868a049b54 could not be found. Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6bd28d8-ab9f-4741-aeb7-f7868a049b54 could not be found. Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:18:00.427965 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:18:00.432351 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:18:00.432351 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:18:00.432351 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:18:00.432351 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:18:00.432351 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:18:00.432351 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6bd28d8-ab9f-4741-aeb7-f7868a049b54 could not be found. Jul 25 15:18:00.432351 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:18:00.432351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-55bee800-09d4-4328-9f46-d99786426dd1 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Returning 404 to user: Instance e6bd28d8-ab9f-4741-aeb7-f7868a049b54 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:18:00.432351 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-55bee800-09d4-4328-9f46-d99786426dd1 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 404 len: 111 microversion: 2.1 time: 0.031708 Jul 25 15:18:00.432351 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3558/6892] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:00 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:18:00.447500 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-332fed3d-6660-4be2-8e0e-ab7ab3bc58fd tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:00.448222 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-332fed3d-6660-4be2-8e0e-ab7ab3bc58fd tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:00.454968 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-332fed3d-6660-4be2-8e0e-ab7ab3bc58fd tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:00.455421 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-332fed3d-6660-4be2-8e0e-ab7ab3bc58fd tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:00.456230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-332fed3d-6660-4be2-8e0e-ab7ab3bc58fd tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:00.456669 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-332fed3d-6660-4be2-8e0e-ab7ab3bc58fd tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:00.470675 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-332fed3d-6660-4be2-8e0e-ab7ab3bc58fd tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] HTTP exception thrown: Instance e6bd28d8-ab9f-4741-aeb7-f7868a049b54 could not be found. Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-332fed3d-6660-4be2-8e0e-ab7ab3bc58fd tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Request method failure captured: Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 HTTP/1.1 Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rP39uqHqPn-BdPecUFVULMOR69xdWyVrGJ8gczBpYH2P8SHuSFTaKEWjlTFaVvyL9q-3UfbgivV00h7b6vDXvEE0klpz4MkUkDDBzTf72XheKhrCTlaqQvqrTRmtHSXvJ04HC7dWnlU6Onw-_DpHG2Yt0-ApACURFfWVvNg64lx2ec Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: cce7ca57e87848f4913891286f4d4596 Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-DeleteServersTestJSON-591746428 Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/cce7ca57e87848f4913891286f4d4596"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/cce7ca57e87848f4913891286f4d4596"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_cce7ca57e87848f4913891286f4d4596", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/cce7ca57e87848f4913891286f4d4596"}]}] Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-DeleteServersTestJSON-591746428 Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: cce7ca57e87848f4913891286f4d4596 Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-DeleteServersTestJSON-591746428 Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-DeleteServersTestJSON-591746428-project Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 8611f4e8c43b452db8ee6335dce164e4 Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-DeleteServersTestJSON-591746428-project Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance e6bd28d8-ab9f-4741-aeb7-f7868a049b54 could not be found. Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'e6bd28d8-ab9f-4741-aeb7-f7868a049b54'} Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6bd28d8-ab9f-4741-aeb7-f7868a049b54 could not be found. Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:18:00.472344 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:18:00.475712 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6bd28d8-ab9f-4741-aeb7-f7868a049b54 could not be found. Jul 25 15:18:00.475712 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:18:00.475712 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:18:00.475712 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:18:00.475712 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:18:00.475712 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:18:00.475712 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:18:00.475712 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:18:00.475712 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:18:00.475712 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6bd28d8-ab9f-4741-aeb7-f7868a049b54 could not be found. Jul 25 15:18:00.475712 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:18:00.475712 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-332fed3d-6660-4be2-8e0e-ab7ab3bc58fd tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Returning 404 to user: Instance e6bd28d8-ab9f-4741-aeb7-f7868a049b54 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:18:00.475712 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-332fed3d-6660-4be2-8e0e-ab7ab3bc58fd tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "DELETE /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 404 len: 111 microversion: 2.1 time: 0.030763 Jul 25 15:18:00.475712 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3335/6893] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:18:00 2022] DELETE /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:18:00.483002 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-992d84e0-596d-49b9-ac79-53fedfcacad0 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:00.483640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-992d84e0-596d-49b9-ac79-53fedfcacad0 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] [instance: e6bd28d8-ab9f-4741-aeb7-f7868a049b54] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:00.490223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-992d84e0-596d-49b9-ac79-53fedfcacad0 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:00.490684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-992d84e0-596d-49b9-ac79-53fedfcacad0 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:00.491467 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-992d84e0-596d-49b9-ac79-53fedfcacad0 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:00.491912 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-992d84e0-596d-49b9-ac79-53fedfcacad0 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:00.508008 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-992d84e0-596d-49b9-ac79-53fedfcacad0 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] HTTP exception thrown: Instance e6bd28d8-ab9f-4741-aeb7-f7868a049b54 could not be found. Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-992d84e0-596d-49b9-ac79-53fedfcacad0 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Request method failure captured: Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 HTTP/1.1 Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3rP39uqHqPn-BdPecUFVULMOR69xdWyVrGJ8gczBpYH2P8SHuSFTaKEWjlTFaVvyL9q-3UfbgivV00h7b6vDXvEE0klpz4MkUkDDBzTf72XheKhrCTlaqQvqrTRmtHSXvJ04HC7dWnlU6Onw-_DpHG2Yt0-ApACURFfWVvNg64lx2ec Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: cce7ca57e87848f4913891286f4d4596 Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-DeleteServersTestJSON-591746428 Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/cce7ca57e87848f4913891286f4d4596"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/cce7ca57e87848f4913891286f4d4596"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_cce7ca57e87848f4913891286f4d4596", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/cce7ca57e87848f4913891286f4d4596"}]}] Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-DeleteServersTestJSON-591746428 Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: cce7ca57e87848f4913891286f4d4596 Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-DeleteServersTestJSON-591746428 Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-DeleteServersTestJSON-591746428-project Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 8611f4e8c43b452db8ee6335dce164e4 Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-DeleteServersTestJSON-591746428-project Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance e6bd28d8-ab9f-4741-aeb7-f7868a049b54 could not be found. Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'e6bd28d8-ab9f-4741-aeb7-f7868a049b54'} Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6bd28d8-ab9f-4741-aeb7-f7868a049b54 could not be found. Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6bd28d8-ab9f-4741-aeb7-f7868a049b54 could not be found. Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:18:00.509632 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:18:00.513590 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:18:00.513590 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:18:00.513590 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:18:00.513590 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:18:00.513590 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:18:00.513590 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6bd28d8-ab9f-4741-aeb7-f7868a049b54 could not be found. Jul 25 15:18:00.513590 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:18:00.513590 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-992d84e0-596d-49b9-ac79-53fedfcacad0 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] Returning 404 to user: Instance e6bd28d8-ab9f-4741-aeb7-f7868a049b54 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:18:00.513590 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-992d84e0-596d-49b9-ac79-53fedfcacad0 tempest-DeleteServersTestJSON-591746428 tempest-DeleteServersTestJSON-591746428-project] 10.222.0.88 "GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54" status: 404 len: 111 microversion: 2.1 time: 0.032208 Jul 25 15:18:00.513590 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3559/6894] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:00 2022] GET /compute/v2.1/servers/e6bd28d8-ab9f-4741-aeb7-f7868a049b54 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:18:09.904728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b52ab97c-21ec-486b-90a9-2b7b4bd196af tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1231126414", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "d9a158a2-79f2-438d-9d39-651f57f246bf"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:18:09.968803 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-b52ab97c-21ec-486b-90a9-2b7b4bd196af tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] validate_networks() for [('d9a158a2-79f2-438d-9d39-651f57f246bf', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:18:10.446471 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-b52ab97c-21ec-486b-90a9-2b7b4bd196af tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:18:10.446911 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-b52ab97c-21ec-486b-90a9-2b7b4bd196af tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:18:10.447675 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-b52ab97c-21ec-486b-90a9-2b7b4bd196af tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:18:10.448291 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-b52ab97c-21ec-486b-90a9-2b7b4bd196af tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:18:10.449553 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-b52ab97c-21ec-486b-90a9-2b7b4bd196af tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:18:10.461992 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b52ab97c-21ec-486b-90a9-2b7b4bd196af tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:10.462707 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b52ab97c-21ec-486b-90a9-2b7b4bd196af tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:10.463521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b52ab97c-21ec-486b-90a9-2b7b4bd196af tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:10.464033 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b52ab97c-21ec-486b-90a9-2b7b4bd196af tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:10.464601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=43 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:18:10.486833 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-b52ab97c-21ec-486b-90a9-2b7b4bd196af tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Getting quotas for project 1e4896360a0c4e8d98f338cbf797ca76. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:18:10.493341 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-b52ab97c-21ec-486b-90a9-2b7b4bd196af tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Getting quotas for user c98a3018dc3c404ca7aad5c311390793 and project 1e4896360a0c4e8d98f338cbf797ca76. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:18:10.510816 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b52ab97c-21ec-486b-90a9-2b7b4bd196af tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:18:10.513968 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b52ab97c-21ec-486b-90a9-2b7b4bd196af tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:18:10.570437 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b52ab97c-21ec-486b-90a9-2b7b4bd196af tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.831394 Jul 25 15:18:10.571338 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3336/6895] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:18:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:18:10.582597 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3c7fc1c4-f559-4052-8c4e-ba30a3f64c53 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:10.583247 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3c7fc1c4-f559-4052-8c4e-ba30a3f64c53 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:10.588605 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:18:10.591476 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:18:10.658435 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3c7fc1c4-f559-4052-8c4e-ba30a3f64c53 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:10.672377 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3c7fc1c4-f559-4052-8c4e-ba30a3f64c53 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1218 microversion: 2.1 time: 0.093724 Jul 25 15:18:10.678154 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3560/6896] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:10 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:11.700930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8268f411-42d7-458c-b2d7-dd09fdd01822 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:11.702913 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8268f411-42d7-458c-b2d7-dd09fdd01822 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:11.709774 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8268f411-42d7-458c-b2d7-dd09fdd01822 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:11.710232 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8268f411-42d7-458c-b2d7-dd09fdd01822 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:11.711036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8268f411-42d7-458c-b2d7-dd09fdd01822 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:11.711479 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8268f411-42d7-458c-b2d7-dd09fdd01822 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:11.801237 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8268f411-42d7-458c-b2d7-dd09fdd01822 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:11.815027 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8268f411-42d7-458c-b2d7-dd09fdd01822 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1278 microversion: 2.1 time: 0.119619 Jul 25 15:18:11.816295 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3337/6897] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:11 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1278 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:12.847571 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2a7e7a0f-0ac3-47b1-9391-2a0c21748651 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:12.848984 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2a7e7a0f-0ac3-47b1-9391-2a0c21748651 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:12.860621 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2a7e7a0f-0ac3-47b1-9391-2a0c21748651 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:12.862043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2a7e7a0f-0ac3-47b1-9391-2a0c21748651 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:12.863142 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2a7e7a0f-0ac3-47b1-9391-2a0c21748651 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:12.863864 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2a7e7a0f-0ac3-47b1-9391-2a0c21748651 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:13.056531 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2a7e7a0f-0ac3-47b1-9391-2a0c21748651 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:13.066806 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2a7e7a0f-0ac3-47b1-9391-2a0c21748651 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1318 microversion: 2.1 time: 0.224590 Jul 25 15:18:13.067771 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3561/6898] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:12 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:13.459102 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-d61af80e-4991-4f3b-a6a4-b69f7120807b req-4354450d-929c-46e4-b284-ac19746ad0fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0cecc96-b223-4404-90f0-374b6aee9423", "tag": "70b4a91c-79de-4829-8efc-bd3aa33c8095"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:18:13.471556 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-d61af80e-4991-4f3b-a6a4-b69f7120807b req-4354450d-929c-46e4-b284-ac19746ad0fd service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:13.472375 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-d61af80e-4991-4f3b-a6a4-b69f7120807b req-4354450d-929c-46e4-b284-ac19746ad0fd service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:13.486361 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-d61af80e-4991-4f3b-a6a4-b69f7120807b req-4354450d-929c-46e4-b284-ac19746ad0fd service nova] Creating event network-changed:70b4a91c-79de-4829-8efc-bd3aa33c8095 for instance c0cecc96-b223-4404-90f0-374b6aee9423 on n-h1-846435-14 Jul 25 15:18:13.504621 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-d61af80e-4991-4f3b-a6a4-b69f7120807b req-4354450d-929c-46e4-b284-ac19746ad0fd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049248 Jul 25 15:18:13.505247 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3338/6899] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:18:14.091343 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3a65f6bb-1244-4d4e-bd57-53dae2b481d8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:14.091938 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3a65f6bb-1244-4d4e-bd57-53dae2b481d8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:14.099421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a65f6bb-1244-4d4e-bd57-53dae2b481d8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:14.099902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a65f6bb-1244-4d4e-bd57-53dae2b481d8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:14.100694 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a65f6bb-1244-4d4e-bd57-53dae2b481d8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:14.101167 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a65f6bb-1244-4d4e-bd57-53dae2b481d8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:14.241232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3a65f6bb-1244-4d4e-bd57-53dae2b481d8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:14.249335 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3a65f6bb-1244-4d4e-bd57-53dae2b481d8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1318 microversion: 2.1 time: 0.162289 Jul 25 15:18:14.249951 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3562/6900] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:14 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:15.272262 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-74f4393d-8a08-4b17-9043-3b1c0c5bf465 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:15.273692 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-74f4393d-8a08-4b17-9043-3b1c0c5bf465 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:15.280988 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-74f4393d-8a08-4b17-9043-3b1c0c5bf465 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:15.281439 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-74f4393d-8a08-4b17-9043-3b1c0c5bf465 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:15.282223 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-74f4393d-8a08-4b17-9043-3b1c0c5bf465 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:15.282659 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-74f4393d-8a08-4b17-9043-3b1c0c5bf465 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:15.423106 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-74f4393d-8a08-4b17-9043-3b1c0c5bf465 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:15.430927 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-74f4393d-8a08-4b17-9043-3b1c0c5bf465 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1318 microversion: 2.1 time: 0.163901 Jul 25 15:18:15.431528 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3339/6901] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:15 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:16.452294 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-251152fd-4f59-41f4-b8e7-91ec9a02be49 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:16.452925 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-251152fd-4f59-41f4-b8e7-91ec9a02be49 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:16.460669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-251152fd-4f59-41f4-b8e7-91ec9a02be49 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:16.461132 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-251152fd-4f59-41f4-b8e7-91ec9a02be49 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:16.461922 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-251152fd-4f59-41f4-b8e7-91ec9a02be49 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:16.462364 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-251152fd-4f59-41f4-b8e7-91ec9a02be49 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:16.601750 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-251152fd-4f59-41f4-b8e7-91ec9a02be49 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:16.609891 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-251152fd-4f59-41f4-b8e7-91ec9a02be49 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1318 microversion: 2.1 time: 0.161677 Jul 25 15:18:16.610481 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3563/6902] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:16 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:17.632296 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7ad53a15-541b-42cd-8817-b07d74fb2b95 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:17.633117 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7ad53a15-541b-42cd-8817-b07d74fb2b95 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:17.635961 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:18:17.641963 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ad53a15-541b-42cd-8817-b07d74fb2b95 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:17.642417 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ad53a15-541b-42cd-8817-b07d74fb2b95 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:17.643196 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ad53a15-541b-42cd-8817-b07d74fb2b95 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:17.643639 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7ad53a15-541b-42cd-8817-b07d74fb2b95 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:17.779597 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7ad53a15-541b-42cd-8817-b07d74fb2b95 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:17.787658 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7ad53a15-541b-42cd-8817-b07d74fb2b95 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1318 microversion: 2.1 time: 0.160085 Jul 25 15:18:17.788279 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3340/6903] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:17 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:18.072872 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-b70ca95c-ba54-4f4b-9fca-0fbf799428b6 req-a2eff661-fb48-456f-9609-2f6bf10a41b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0cecc96-b223-4404-90f0-374b6aee9423", "name": "network-vif-plugged", "status": "completed", "tag": "70b4a91c-79de-4829-8efc-bd3aa33c8095"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:18:18.086374 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-b70ca95c-ba54-4f4b-9fca-0fbf799428b6 req-a2eff661-fb48-456f-9609-2f6bf10a41b4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:18.086909 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-b70ca95c-ba54-4f4b-9fca-0fbf799428b6 req-a2eff661-fb48-456f-9609-2f6bf10a41b4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:18.098989 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-b70ca95c-ba54-4f4b-9fca-0fbf799428b6 req-a2eff661-fb48-456f-9609-2f6bf10a41b4 service nova] Creating event network-vif-plugged:70b4a91c-79de-4829-8efc-bd3aa33c8095 for instance c0cecc96-b223-4404-90f0-374b6aee9423 on n-h1-846435-14 Jul 25 15:18:18.104238 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-b70ca95c-ba54-4f4b-9fca-0fbf799428b6 req-a2eff661-fb48-456f-9609-2f6bf10a41b4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035793 Jul 25 15:18:18.105154 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3564/6904] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:18:18.808352 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-63987c81-17be-40ee-b48b-6aa13fca5bf8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:18.809055 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-63987c81-17be-40ee-b48b-6aa13fca5bf8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:18.816354 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-63987c81-17be-40ee-b48b-6aa13fca5bf8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:18.816812 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-63987c81-17be-40ee-b48b-6aa13fca5bf8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:18.817616 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-63987c81-17be-40ee-b48b-6aa13fca5bf8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:18.818062 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-63987c81-17be-40ee-b48b-6aa13fca5bf8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:18.954597 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-63987c81-17be-40ee-b48b-6aa13fca5bf8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:18.962415 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-63987c81-17be-40ee-b48b-6aa13fca5bf8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1318 microversion: 2.1 time: 0.158024 Jul 25 15:18:18.963005 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3341/6905] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:18 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:19.984950 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-12a3b9b4-330d-4c57-b026-f2a517d29172 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:19.985653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-12a3b9b4-330d-4c57-b026-f2a517d29172 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:19.992497 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-12a3b9b4-330d-4c57-b026-f2a517d29172 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:19.992957 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-12a3b9b4-330d-4c57-b026-f2a517d29172 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:19.993732 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-12a3b9b4-330d-4c57-b026-f2a517d29172 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:19.994175 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-12a3b9b4-330d-4c57-b026-f2a517d29172 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:20.134350 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-12a3b9b4-330d-4c57-b026-f2a517d29172 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:20.142527 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-12a3b9b4-330d-4c57-b026-f2a517d29172 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1509 microversion: 2.1 time: 0.163119 Jul 25 15:18:20.143124 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3565/6906] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:19 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:20.163497 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-95676850-11c8-482a-8a91-5b78cae05a5b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:20.164059 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-95676850-11c8-482a-8a91-5b78cae05a5b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:20.171340 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-95676850-11c8-482a-8a91-5b78cae05a5b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:20.171801 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-95676850-11c8-482a-8a91-5b78cae05a5b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:20.172617 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-95676850-11c8-482a-8a91-5b78cae05a5b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:20.173070 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-95676850-11c8-482a-8a91-5b78cae05a5b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:20.308559 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-95676850-11c8-482a-8a91-5b78cae05a5b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:20.318324 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-95676850-11c8-482a-8a91-5b78cae05a5b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1509 microversion: 2.1 time: 0.158152 Jul 25 15:18:20.319345 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3342/6907] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:20 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:20.340133 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-26db9448-1f3b-48a0-9671-d49b2ca4d684 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:18:20.342568 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-26db9448-1f3b-48a0-9671-d49b2ca4d684 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:20.348842 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26db9448-1f3b-48a0-9671-d49b2ca4d684 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:20.349297 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26db9448-1f3b-48a0-9671-d49b2ca4d684 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:20.350065 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26db9448-1f3b-48a0-9671-d49b2ca4d684 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:20.350493 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26db9448-1f3b-48a0-9671-d49b2ca4d684 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:20.414309 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-26db9448-1f3b-48a0-9671-d49b2ca4d684 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "PUT /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1081 microversion: 2.1 time: 0.078177 Jul 25 15:18:20.416242 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3566/6908] 10.222.0.88 () {60 vars in 1256 bytes} [Mon Jul 25 15:18:20 2022] PUT /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1081 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:18:20.431946 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-57b7a1b4-1021-4673-8b2a-657598a40b05 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:20.432582 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-57b7a1b4-1021-4673-8b2a-657598a40b05 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:20.439364 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57b7a1b4-1021-4673-8b2a-657598a40b05 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:20.439815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57b7a1b4-1021-4673-8b2a-657598a40b05 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:20.440607 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57b7a1b4-1021-4673-8b2a-657598a40b05 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:20.441042 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57b7a1b4-1021-4673-8b2a-657598a40b05 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:20.473661 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:18:20.503178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:18:20.577638 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-57b7a1b4-1021-4673-8b2a-657598a40b05 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:20.585496 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-57b7a1b4-1021-4673-8b2a-657598a40b05 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1507 microversion: 2.1 time: 0.157460 Jul 25 15:18:20.586063 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3343/6909] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:20 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:20.605206 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bef3b5a2-cf64-47c4-a71f-941ff86fe1b8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:20.605861 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bef3b5a2-cf64-47c4-a71f-941ff86fe1b8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:20.612496 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bef3b5a2-cf64-47c4-a71f-941ff86fe1b8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:20.612957 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bef3b5a2-cf64-47c4-a71f-941ff86fe1b8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:20.613728 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bef3b5a2-cf64-47c4-a71f-941ff86fe1b8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:20.614166 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bef3b5a2-cf64-47c4-a71f-941ff86fe1b8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:20.666417 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:18:20.751272 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bef3b5a2-cf64-47c4-a71f-941ff86fe1b8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:20.759413 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bef3b5a2-cf64-47c4-a71f-941ff86fe1b8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1507 microversion: 2.1 time: 0.158061 Jul 25 15:18:20.759991 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3567/6910] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:20 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:20.780390 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4f692ef2-1d4e-4b35-a3bd-40014107adc1 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:18:20.782715 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4f692ef2-1d4e-4b35-a3bd-40014107adc1 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:20.789089 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4f692ef2-1d4e-4b35-a3bd-40014107adc1 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:20.789552 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4f692ef2-1d4e-4b35-a3bd-40014107adc1 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:20.790338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4f692ef2-1d4e-4b35-a3bd-40014107adc1 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:20.790775 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4f692ef2-1d4e-4b35-a3bd-40014107adc1 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:20.819707 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4f692ef2-1d4e-4b35-a3bd-40014107adc1 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:20.826219 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4f692ef2-1d4e-4b35-a3bd-40014107adc1 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Old instance type m1.heat2, new instance type m1.heat {{(pid=119303) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 15:18:20.832920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-4f692ef2-1d4e-4b35-a3bd-40014107adc1 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:18:20.833347 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-4f692ef2-1d4e-4b35-a3bd-40014107adc1 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:18:20.833828 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-4f692ef2-1d4e-4b35-a3bd-40014107adc1 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:18:20.834239 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-4f692ef2-1d4e-4b35-a3bd-40014107adc1 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:18:20.834655 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-4f692ef2-1d4e-4b35-a3bd-40014107adc1 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:18:20.900904 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4f692ef2-1d4e-4b35-a3bd-40014107adc1 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "POST /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423/action" status: 202 len: 0 microversion: 2.1 time: 0.125129 Jul 25 15:18:20.901532 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3344/6911] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:18:20 2022] POST /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:18:20.909882 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f0f621bf-2b8d-40b4-a9e4-3d21e18ec511 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:20.910507 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f0f621bf-2b8d-40b4-a9e4-3d21e18ec511 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:20.916688 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0f621bf-2b8d-40b4-a9e4-3d21e18ec511 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:20.917087 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0f621bf-2b8d-40b4-a9e4-3d21e18ec511 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:20.917866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0f621bf-2b8d-40b4-a9e4-3d21e18ec511 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:20.918348 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f0f621bf-2b8d-40b4-a9e4-3d21e18ec511 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:21.096243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f0f621bf-2b8d-40b4-a9e4-3d21e18ec511 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:21.104502 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f0f621bf-2b8d-40b4-a9e4-3d21e18ec511 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1518 microversion: 2.1 time: 0.198425 Jul 25 15:18:21.105086 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3568/6912] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:20 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1518 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:22.127422 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-57a3044d-8d27-4f9b-9ced-ace312616c54 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:22.128000 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-57a3044d-8d27-4f9b-9ced-ace312616c54 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:22.134751 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57a3044d-8d27-4f9b-9ced-ace312616c54 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:22.135212 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57a3044d-8d27-4f9b-9ced-ace312616c54 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:22.136024 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57a3044d-8d27-4f9b-9ced-ace312616c54 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:22.136495 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-57a3044d-8d27-4f9b-9ced-ace312616c54 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:22.312416 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-57a3044d-8d27-4f9b-9ced-ace312616c54 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:22.320252 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-57a3044d-8d27-4f9b-9ced-ace312616c54 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1518 microversion: 2.1 time: 0.197976 Jul 25 15:18:22.320838 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3345/6913] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:22 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1518 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:23.341577 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-10e3d54a-6448-4a68-8e6f-d2678c4027ee tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:23.342169 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-10e3d54a-6448-4a68-8e6f-d2678c4027ee tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:23.349763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-10e3d54a-6448-4a68-8e6f-d2678c4027ee tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:23.350219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-10e3d54a-6448-4a68-8e6f-d2678c4027ee tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:23.350986 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-10e3d54a-6448-4a68-8e6f-d2678c4027ee tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:23.351452 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-10e3d54a-6448-4a68-8e6f-d2678c4027ee tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:23.510413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-10e3d54a-6448-4a68-8e6f-d2678c4027ee tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:23.518669 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-10e3d54a-6448-4a68-8e6f-d2678c4027ee tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1523 microversion: 2.1 time: 0.180964 Jul 25 15:18:23.519267 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3569/6914] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:23 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:24.540398 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-30e7bcd6-11c1-45ed-a465-29cfff38822c tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:24.540966 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-30e7bcd6-11c1-45ed-a465-29cfff38822c tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:24.548774 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-30e7bcd6-11c1-45ed-a465-29cfff38822c tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:24.549233 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-30e7bcd6-11c1-45ed-a465-29cfff38822c tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:24.550060 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-30e7bcd6-11c1-45ed-a465-29cfff38822c tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:24.550494 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-30e7bcd6-11c1-45ed-a465-29cfff38822c tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:24.692217 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-30e7bcd6-11c1-45ed-a465-29cfff38822c tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:24.700650 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-30e7bcd6-11c1-45ed-a465-29cfff38822c tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1523 microversion: 2.1 time: 0.164352 Jul 25 15:18:24.701233 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3346/6915] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:24 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:25.722130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f2f8b575-71df-4b86-b224-142beff0d1e7 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:25.722681 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f2f8b575-71df-4b86-b224-142beff0d1e7 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:25.730151 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f2f8b575-71df-4b86-b224-142beff0d1e7 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:25.730731 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f2f8b575-71df-4b86-b224-142beff0d1e7 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:25.731547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f2f8b575-71df-4b86-b224-142beff0d1e7 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:25.732006 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f2f8b575-71df-4b86-b224-142beff0d1e7 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:25.868966 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f2f8b575-71df-4b86-b224-142beff0d1e7 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:25.877926 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f2f8b575-71df-4b86-b224-142beff0d1e7 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1523 microversion: 2.1 time: 0.159712 Jul 25 15:18:25.878535 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3570/6916] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:25 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:26.899957 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fdbf92f0-3b25-4a59-9dca-e93102311e65 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:26.900606 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fdbf92f0-3b25-4a59-9dca-e93102311e65 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:26.908175 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fdbf92f0-3b25-4a59-9dca-e93102311e65 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:26.908615 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fdbf92f0-3b25-4a59-9dca-e93102311e65 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:26.909383 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fdbf92f0-3b25-4a59-9dca-e93102311e65 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:26.909817 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fdbf92f0-3b25-4a59-9dca-e93102311e65 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:27.045403 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fdbf92f0-3b25-4a59-9dca-e93102311e65 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:27.053214 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fdbf92f0-3b25-4a59-9dca-e93102311e65 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1523 microversion: 2.1 time: 0.157720 Jul 25 15:18:27.053829 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3347/6917] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:26 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:28.076065 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-084f2e72-1100-464a-be9b-35e8583193c8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:28.076612 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-084f2e72-1100-464a-be9b-35e8583193c8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:28.083720 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-084f2e72-1100-464a-be9b-35e8583193c8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:28.084208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-084f2e72-1100-464a-be9b-35e8583193c8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:28.085014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-084f2e72-1100-464a-be9b-35e8583193c8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:28.085498 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-084f2e72-1100-464a-be9b-35e8583193c8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:28.221196 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-084f2e72-1100-464a-be9b-35e8583193c8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:28.230773 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-084f2e72-1100-464a-be9b-35e8583193c8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1523 microversion: 2.1 time: 0.159065 Jul 25 15:18:28.231350 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3571/6918] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:28 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:29.252903 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1a4ee570-63c4-46f1-8cfe-776de8a07518 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:29.253691 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1a4ee570-63c4-46f1-8cfe-776de8a07518 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:29.261700 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1a4ee570-63c4-46f1-8cfe-776de8a07518 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:29.262218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1a4ee570-63c4-46f1-8cfe-776de8a07518 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:29.263007 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1a4ee570-63c4-46f1-8cfe-776de8a07518 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:29.263449 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1a4ee570-63c4-46f1-8cfe-776de8a07518 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:29.406987 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1a4ee570-63c4-46f1-8cfe-776de8a07518 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:29.416699 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1a4ee570-63c4-46f1-8cfe-776de8a07518 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1523 microversion: 2.1 time: 0.168186 Jul 25 15:18:29.417620 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3348/6919] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:29 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:30.438318 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-60c906a8-993c-4a87-945e-bcd1b11b4f21 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:30.438910 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-60c906a8-993c-4a87-945e-bcd1b11b4f21 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:30.446556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60c906a8-993c-4a87-945e-bcd1b11b4f21 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:30.447057 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60c906a8-993c-4a87-945e-bcd1b11b4f21 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:30.447811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60c906a8-993c-4a87-945e-bcd1b11b4f21 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:30.448286 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60c906a8-993c-4a87-945e-bcd1b11b4f21 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:30.590799 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-60c906a8-993c-4a87-945e-bcd1b11b4f21 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:30.598911 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-60c906a8-993c-4a87-945e-bcd1b11b4f21 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1523 microversion: 2.1 time: 0.164640 Jul 25 15:18:30.599507 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3572/6920] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:30 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:31.620856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0b61834f-7c8d-48de-bcb9-36a1c3a8102f tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:31.621471 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0b61834f-7c8d-48de-bcb9-36a1c3a8102f tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:31.629255 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b61834f-7c8d-48de-bcb9-36a1c3a8102f tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:31.629711 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b61834f-7c8d-48de-bcb9-36a1c3a8102f tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:31.630493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b61834f-7c8d-48de-bcb9-36a1c3a8102f tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:31.630930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b61834f-7c8d-48de-bcb9-36a1c3a8102f tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:31.767816 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0b61834f-7c8d-48de-bcb9-36a1c3a8102f tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:31.775902 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0b61834f-7c8d-48de-bcb9-36a1c3a8102f tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1523 microversion: 2.1 time: 0.159090 Jul 25 15:18:31.776522 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3349/6921] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:31 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:32.797337 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-453fdf1d-5d22-4a6f-a619-797d5a56377c tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:32.797987 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-453fdf1d-5d22-4a6f-a619-797d5a56377c tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:32.806046 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-453fdf1d-5d22-4a6f-a619-797d5a56377c tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:32.806550 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-453fdf1d-5d22-4a6f-a619-797d5a56377c tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:32.807342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-453fdf1d-5d22-4a6f-a619-797d5a56377c tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:32.807787 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-453fdf1d-5d22-4a6f-a619-797d5a56377c tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:32.946311 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-453fdf1d-5d22-4a6f-a619-797d5a56377c tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:32.954443 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-453fdf1d-5d22-4a6f-a619-797d5a56377c tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1523 microversion: 2.1 time: 0.161124 Jul 25 15:18:32.955271 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3573/6922] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:32 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:33.976907 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e84343b8-507d-4e23-9875-d3332c886afc tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:33.977518 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e84343b8-507d-4e23-9875-d3332c886afc tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:33.985212 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e84343b8-507d-4e23-9875-d3332c886afc tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:33.985671 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e84343b8-507d-4e23-9875-d3332c886afc tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:33.986455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e84343b8-507d-4e23-9875-d3332c886afc tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:33.986908 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e84343b8-507d-4e23-9875-d3332c886afc tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:34.126730 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e84343b8-507d-4e23-9875-d3332c886afc tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:34.135086 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e84343b8-507d-4e23-9875-d3332c886afc tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1523 microversion: 2.1 time: 0.162048 Jul 25 15:18:34.135882 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3350/6923] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:33 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:35.156070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d018ad91-71bd-4fdf-bede-fb61369b5396 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:35.156706 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d018ad91-71bd-4fdf-bede-fb61369b5396 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:35.164861 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d018ad91-71bd-4fdf-bede-fb61369b5396 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:35.165322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d018ad91-71bd-4fdf-bede-fb61369b5396 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:35.166146 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d018ad91-71bd-4fdf-bede-fb61369b5396 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:35.166582 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d018ad91-71bd-4fdf-bede-fb61369b5396 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:35.313650 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d018ad91-71bd-4fdf-bede-fb61369b5396 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:35.324441 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d018ad91-71bd-4fdf-bede-fb61369b5396 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1523 microversion: 2.1 time: 0.172012 Jul 25 15:18:35.324966 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3574/6924] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:35 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:36.347022 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3c1d8382-e235-46cb-9f84-cbf3de388d3e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:36.347649 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3c1d8382-e235-46cb-9f84-cbf3de388d3e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:36.355210 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c1d8382-e235-46cb-9f84-cbf3de388d3e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:36.355703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c1d8382-e235-46cb-9f84-cbf3de388d3e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:36.356535 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c1d8382-e235-46cb-9f84-cbf3de388d3e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:36.356979 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c1d8382-e235-46cb-9f84-cbf3de388d3e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:36.497010 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3c1d8382-e235-46cb-9f84-cbf3de388d3e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:36.505339 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3c1d8382-e235-46cb-9f84-cbf3de388d3e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1523 microversion: 2.1 time: 0.162311 Jul 25 15:18:36.505982 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3351/6925] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:36 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:37.527184 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b2af100b-797e-4933-95a3-4fd8276d96f2 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:37.527838 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b2af100b-797e-4933-95a3-4fd8276d96f2 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:37.535591 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b2af100b-797e-4933-95a3-4fd8276d96f2 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:37.536083 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b2af100b-797e-4933-95a3-4fd8276d96f2 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:37.536957 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b2af100b-797e-4933-95a3-4fd8276d96f2 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:37.537406 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b2af100b-797e-4933-95a3-4fd8276d96f2 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:37.675225 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b2af100b-797e-4933-95a3-4fd8276d96f2 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:37.683594 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b2af100b-797e-4933-95a3-4fd8276d96f2 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1523 microversion: 2.1 time: 0.160374 Jul 25 15:18:37.684296 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3575/6926] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:37 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:38.709948 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6ab9f28a-4582-4ee4-8d94-a74ed17aef2a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:38.711039 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6ab9f28a-4582-4ee4-8d94-a74ed17aef2a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:38.724734 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ab9f28a-4582-4ee4-8d94-a74ed17aef2a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:38.725531 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ab9f28a-4582-4ee4-8d94-a74ed17aef2a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:38.726930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ab9f28a-4582-4ee4-8d94-a74ed17aef2a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:38.727688 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6ab9f28a-4582-4ee4-8d94-a74ed17aef2a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:38.767093 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:18:38.906505 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6ab9f28a-4582-4ee4-8d94-a74ed17aef2a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:38.919674 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6ab9f28a-4582-4ee4-8d94-a74ed17aef2a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1523 microversion: 2.1 time: 0.217008 Jul 25 15:18:38.920729 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3352/6927] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:38 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:39.954877 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-35485e12-6d61-4a69-a9dc-6f8535a07c24 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:39.955556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-35485e12-6d61-4a69-a9dc-6f8535a07c24 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:39.963344 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35485e12-6d61-4a69-a9dc-6f8535a07c24 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:39.963802 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35485e12-6d61-4a69-a9dc-6f8535a07c24 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:39.964602 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35485e12-6d61-4a69-a9dc-6f8535a07c24 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:39.965076 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35485e12-6d61-4a69-a9dc-6f8535a07c24 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:40.124656 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-35485e12-6d61-4a69-a9dc-6f8535a07c24 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:40.133023 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-35485e12-6d61-4a69-a9dc-6f8535a07c24 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1523 microversion: 2.1 time: 0.182310 Jul 25 15:18:40.133616 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3576/6928] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:39 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:41.155112 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b33f2261-3b86-4146-8e34-20b99c0629df tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:41.155775 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b33f2261-3b86-4146-8e34-20b99c0629df tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:41.163760 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b33f2261-3b86-4146-8e34-20b99c0629df tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:41.164240 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b33f2261-3b86-4146-8e34-20b99c0629df tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:41.165048 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b33f2261-3b86-4146-8e34-20b99c0629df tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:41.165485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b33f2261-3b86-4146-8e34-20b99c0629df tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:41.315819 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b33f2261-3b86-4146-8e34-20b99c0629df tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:41.324442 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b33f2261-3b86-4146-8e34-20b99c0629df tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1523 microversion: 2.1 time: 0.173912 Jul 25 15:18:41.325057 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3353/6929] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:41 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:42.346430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1b00cde0-82d3-46a3-aa2f-e23afbfe8781 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:42.347043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1b00cde0-82d3-46a3-aa2f-e23afbfe8781 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:42.349941 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=37 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:18:42.355541 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1b00cde0-82d3-46a3-aa2f-e23afbfe8781 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:42.356014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1b00cde0-82d3-46a3-aa2f-e23afbfe8781 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:42.356805 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1b00cde0-82d3-46a3-aa2f-e23afbfe8781 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:42.357247 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1b00cde0-82d3-46a3-aa2f-e23afbfe8781 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:42.360358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:18:42.503010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1b00cde0-82d3-46a3-aa2f-e23afbfe8781 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:42.511242 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1b00cde0-82d3-46a3-aa2f-e23afbfe8781 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1523 microversion: 2.1 time: 0.168809 Jul 25 15:18:42.511833 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3577/6930] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:42 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:43.536263 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cc74e855-001d-4723-af96-2163459c2d85 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:43.536854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cc74e855-001d-4723-af96-2163459c2d85 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:43.545330 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cc74e855-001d-4723-af96-2163459c2d85 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:43.545908 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cc74e855-001d-4723-af96-2163459c2d85 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:43.546800 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cc74e855-001d-4723-af96-2163459c2d85 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:43.547379 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cc74e855-001d-4723-af96-2163459c2d85 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:43.683636 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cc74e855-001d-4723-af96-2163459c2d85 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:43.692754 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cc74e855-001d-4723-af96-2163459c2d85 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1523 microversion: 2.1 time: 0.160606 Jul 25 15:18:43.693248 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3354/6931] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:43 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:44.714956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-54324971-6e5c-4ae5-851d-2e654b009806 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:44.715578 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-54324971-6e5c-4ae5-851d-2e654b009806 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:44.723517 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-54324971-6e5c-4ae5-851d-2e654b009806 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:44.724012 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-54324971-6e5c-4ae5-851d-2e654b009806 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:44.724810 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-54324971-6e5c-4ae5-851d-2e654b009806 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:44.725262 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-54324971-6e5c-4ae5-851d-2e654b009806 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:44.870000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-54324971-6e5c-4ae5-851d-2e654b009806 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:44.878257 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-54324971-6e5c-4ae5-851d-2e654b009806 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1523 microversion: 2.1 time: 0.167398 Jul 25 15:18:44.878837 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3578/6932] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:44 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:45.900075 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0f7cff48-cb73-4451-bc61-ed840bc1b964 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:45.901031 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0f7cff48-cb73-4451-bc61-ed840bc1b964 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:45.908066 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f7cff48-cb73-4451-bc61-ed840bc1b964 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:45.908527 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f7cff48-cb73-4451-bc61-ed840bc1b964 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:45.909298 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f7cff48-cb73-4451-bc61-ed840bc1b964 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:45.909736 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0f7cff48-cb73-4451-bc61-ed840bc1b964 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:46.043601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0f7cff48-cb73-4451-bc61-ed840bc1b964 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:46.051579 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0f7cff48-cb73-4451-bc61-ed840bc1b964 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1523 microversion: 2.1 time: 0.155535 Jul 25 15:18:46.052194 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3355/6933] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:45 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:47.073799 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9f5556cb-7f63-44f6-9696-1ddd41aa404d tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:47.074399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9f5556cb-7f63-44f6-9696-1ddd41aa404d tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:47.081808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f5556cb-7f63-44f6-9696-1ddd41aa404d tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:47.082263 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f5556cb-7f63-44f6-9696-1ddd41aa404d tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:47.083046 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f5556cb-7f63-44f6-9696-1ddd41aa404d tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:47.083493 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9f5556cb-7f63-44f6-9696-1ddd41aa404d tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:47.219219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9f5556cb-7f63-44f6-9696-1ddd41aa404d tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:47.226977 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9f5556cb-7f63-44f6-9696-1ddd41aa404d tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1523 microversion: 2.1 time: 0.157451 Jul 25 15:18:47.227562 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3579/6934] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:47 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:48.248928 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fb1127b0-cc79-4c6c-bab0-1b363c751a8e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:48.249544 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fb1127b0-cc79-4c6c-bab0-1b363c751a8e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:48.252872 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=36 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:18:48.258841 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fb1127b0-cc79-4c6c-bab0-1b363c751a8e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:48.259292 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fb1127b0-cc79-4c6c-bab0-1b363c751a8e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:48.260192 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fb1127b0-cc79-4c6c-bab0-1b363c751a8e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:48.260626 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fb1127b0-cc79-4c6c-bab0-1b363c751a8e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:48.402611 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fb1127b0-cc79-4c6c-bab0-1b363c751a8e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:48.410778 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fb1127b0-cc79-4c6c-bab0-1b363c751a8e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1523 microversion: 2.1 time: 0.165945 Jul 25 15:18:48.411361 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3356/6935] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:48 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:49.434634 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bd1ae28c-66f7-4b5a-8149-dec3d03e53d8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:49.435782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bd1ae28c-66f7-4b5a-8149-dec3d03e53d8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:49.444713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bd1ae28c-66f7-4b5a-8149-dec3d03e53d8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:49.445465 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bd1ae28c-66f7-4b5a-8149-dec3d03e53d8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:49.446378 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bd1ae28c-66f7-4b5a-8149-dec3d03e53d8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:49.446928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bd1ae28c-66f7-4b5a-8149-dec3d03e53d8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:49.595141 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bd1ae28c-66f7-4b5a-8149-dec3d03e53d8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:49.604852 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bd1ae28c-66f7-4b5a-8149-dec3d03e53d8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1523 microversion: 2.1 time: 0.174864 Jul 25 15:18:49.605507 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3580/6936] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:49 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:18:50.506708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-04a98a2c-98fe-4fc2-b92e-f931cdfac7fe req-38356a13-ab2b-4609-9707-f1fdde02eb18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0cecc96-b223-4404-90f0-374b6aee9423", "name": "network-vif-unplugged", "status": "completed", "tag": "70b4a91c-79de-4829-8efc-bd3aa33c8095"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:18:50.521475 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-04a98a2c-98fe-4fc2-b92e-f931cdfac7fe req-38356a13-ab2b-4609-9707-f1fdde02eb18 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:50.521930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-04a98a2c-98fe-4fc2-b92e-f931cdfac7fe req-38356a13-ab2b-4609-9707-f1fdde02eb18 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:50.536291 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-04a98a2c-98fe-4fc2-b92e-f931cdfac7fe req-38356a13-ab2b-4609-9707-f1fdde02eb18 service nova] Creating event network-vif-unplugged:70b4a91c-79de-4829-8efc-bd3aa33c8095 for instance c0cecc96-b223-4404-90f0-374b6aee9423 on n-h2-846435-14 Jul 25 15:18:50.543440 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [req-04a98a2c-98fe-4fc2-b92e-f931cdfac7fe req-38356a13-ab2b-4609-9707-f1fdde02eb18 service nova] Instance c0cecc96-b223-4404-90f0-374b6aee9423 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119303) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 15:18:50.557498 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-04a98a2c-98fe-4fc2-b92e-f931cdfac7fe req-38356a13-ab2b-4609-9707-f1fdde02eb18 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056583 Jul 25 15:18:50.558796 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3357/6937] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:18:50.631728 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-144d639e-a42c-4d29-a748-d1adfd3fa918 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:50.632827 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-144d639e-a42c-4d29-a748-d1adfd3fa918 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:50.642481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-144d639e-a42c-4d29-a748-d1adfd3fa918 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:50.643589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-144d639e-a42c-4d29-a748-d1adfd3fa918 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:50.644843 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-144d639e-a42c-4d29-a748-d1adfd3fa918 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:50.645365 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-144d639e-a42c-4d29-a748-d1adfd3fa918 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:51.173206 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 15:18:51.173998 n-d-846435-14 devstack@n-api.service[119303]: Mon Jul 25 15:18:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 15:18:51.215219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-144d639e-a42c-4d29-a748-d1adfd3fa918 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:51.230955 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-144d639e-a42c-4d29-a748-d1adfd3fa918 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1522 microversion: 2.1 time: 0.606437 Jul 25 15:18:51.241893 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3581/6938] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:50 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1522 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:52.269573 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d88c8987-638e-4ab4-9e56-dcad3aa5a3e4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:52.270272 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d88c8987-638e-4ab4-9e56-dcad3aa5a3e4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:52.277268 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d88c8987-638e-4ab4-9e56-dcad3aa5a3e4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:52.277711 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d88c8987-638e-4ab4-9e56-dcad3aa5a3e4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:52.278570 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d88c8987-638e-4ab4-9e56-dcad3aa5a3e4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:52.279009 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d88c8987-638e-4ab4-9e56-dcad3aa5a3e4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:52.429128 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d88c8987-638e-4ab4-9e56-dcad3aa5a3e4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:52.437728 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d88c8987-638e-4ab4-9e56-dcad3aa5a3e4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1520 microversion: 2.1 time: 0.173525 Jul 25 15:18:52.438406 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3358/6939] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:52 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:52.577844 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-32f317c6-0439-4eaa-99f5-750ebfe19cbf req-5b48f60b-0fe8-4ea8-9544-a0646187f086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0cecc96-b223-4404-90f0-374b6aee9423", "tag": "70b4a91c-79de-4829-8efc-bd3aa33c8095"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:18:52.588590 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-32f317c6-0439-4eaa-99f5-750ebfe19cbf req-5b48f60b-0fe8-4ea8-9544-a0646187f086 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:52.589040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-32f317c6-0439-4eaa-99f5-750ebfe19cbf req-5b48f60b-0fe8-4ea8-9544-a0646187f086 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:52.602515 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-32f317c6-0439-4eaa-99f5-750ebfe19cbf req-5b48f60b-0fe8-4ea8-9544-a0646187f086 service nova] Creating event network-changed:70b4a91c-79de-4829-8efc-bd3aa33c8095 for instance c0cecc96-b223-4404-90f0-374b6aee9423 on n-h2-846435-14 Jul 25 15:18:52.608859 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [req-32f317c6-0439-4eaa-99f5-750ebfe19cbf req-5b48f60b-0fe8-4ea8-9544-a0646187f086 service nova] Instance c0cecc96-b223-4404-90f0-374b6aee9423 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119304) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 15:18:52.621039 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-32f317c6-0439-4eaa-99f5-750ebfe19cbf req-5b48f60b-0fe8-4ea8-9544-a0646187f086 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047102 Jul 25 15:18:52.621694 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3582/6940] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:18:53.014074 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 15:18:53.014670 n-d-846435-14 devstack@n-api.service[119304]: Mon Jul 25 15:18:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 15:18:53.462828 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1c2c9b7c-0da9-46d0-9277-81db8c4f41b8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:53.463662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1c2c9b7c-0da9-46d0-9277-81db8c4f41b8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:53.471952 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1c2c9b7c-0da9-46d0-9277-81db8c4f41b8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:53.472436 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1c2c9b7c-0da9-46d0-9277-81db8c4f41b8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:53.473233 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1c2c9b7c-0da9-46d0-9277-81db8c4f41b8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:53.473674 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1c2c9b7c-0da9-46d0-9277-81db8c4f41b8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:53.643036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1c2c9b7c-0da9-46d0-9277-81db8c4f41b8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:53.652670 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1c2c9b7c-0da9-46d0-9277-81db8c4f41b8 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1520 microversion: 2.1 time: 0.196018 Jul 25 15:18:53.653287 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3359/6941] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:53 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:54.677047 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c51874a0-8b69-4a43-b481-0a2f083f30c4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:54.678122 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c51874a0-8b69-4a43-b481-0a2f083f30c4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:54.687329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c51874a0-8b69-4a43-b481-0a2f083f30c4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:54.688237 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c51874a0-8b69-4a43-b481-0a2f083f30c4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:54.689388 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c51874a0-8b69-4a43-b481-0a2f083f30c4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:54.689962 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c51874a0-8b69-4a43-b481-0a2f083f30c4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:54.959180 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c51874a0-8b69-4a43-b481-0a2f083f30c4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:54.971775 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c51874a0-8b69-4a43-b481-0a2f083f30c4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1520 microversion: 2.1 time: 0.300027 Jul 25 15:18:54.972486 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3583/6942] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:54 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1520 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:18:56.006471 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f7bee33e-caef-4ad9-88db-c63ba12bb602 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:56.007107 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f7bee33e-caef-4ad9-88db-c63ba12bb602 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:56.015173 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f7bee33e-caef-4ad9-88db-c63ba12bb602 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:56.015627 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f7bee33e-caef-4ad9-88db-c63ba12bb602 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:56.016424 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f7bee33e-caef-4ad9-88db-c63ba12bb602 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:56.016881 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f7bee33e-caef-4ad9-88db-c63ba12bb602 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:56.177036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f7bee33e-caef-4ad9-88db-c63ba12bb602 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:56.185757 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f7bee33e-caef-4ad9-88db-c63ba12bb602 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1517 microversion: 2.1 time: 0.183426 Jul 25 15:18:56.186381 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3360/6943] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:56 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1517 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:56.207729 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-28cf80c3-01ed-4550-8491-0a12f687f937 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:18:56.208407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-28cf80c3-01ed-4550-8491-0a12f687f937 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:56.216279 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28cf80c3-01ed-4550-8491-0a12f687f937 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:56.216863 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28cf80c3-01ed-4550-8491-0a12f687f937 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:56.217792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28cf80c3-01ed-4550-8491-0a12f687f937 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:56.218350 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28cf80c3-01ed-4550-8491-0a12f687f937 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:56.292746 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-28cf80c3-01ed-4550-8491-0a12f687f937 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "POST /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423/action" status: 204 len: 0 microversion: 2.1 time: 0.088964 Jul 25 15:18:56.293530 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3584/6944] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:18:56 2022] POST /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423/action => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:18:56.303268 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0587a793-cd4e-49f4-8d5d-5cae22390249 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:56.304105 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0587a793-cd4e-49f4-8d5d-5cae22390249 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:56.314426 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0587a793-cd4e-49f4-8d5d-5cae22390249 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:56.315204 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0587a793-cd4e-49f4-8d5d-5cae22390249 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:56.316704 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0587a793-cd4e-49f4-8d5d-5cae22390249 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:56.317537 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0587a793-cd4e-49f4-8d5d-5cae22390249 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:56.682338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0587a793-cd4e-49f4-8d5d-5cae22390249 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:56.696173 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0587a793-cd4e-49f4-8d5d-5cae22390249 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1517 microversion: 2.1 time: 0.398021 Jul 25 15:18:56.696792 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3361/6945] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:56 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1517 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:57.727822 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-00a23dc9-d88b-49db-864d-d6fbacfb8d36 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:57.728619 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-00a23dc9-d88b-49db-864d-d6fbacfb8d36 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:57.736402 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-00a23dc9-d88b-49db-864d-d6fbacfb8d36 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:57.742281 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-00a23dc9-d88b-49db-864d-d6fbacfb8d36 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:57.742281 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-00a23dc9-d88b-49db-864d-d6fbacfb8d36 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:57.742281 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-00a23dc9-d88b-49db-864d-d6fbacfb8d36 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:57.896057 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-00a23dc9-d88b-49db-864d-d6fbacfb8d36 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:57.905883 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-00a23dc9-d88b-49db-864d-d6fbacfb8d36 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1517 microversion: 2.1 time: 0.185130 Jul 25 15:18:57.906494 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3585/6946] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:57 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1517 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:58.711942 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-fa459869-ed12-4d06-adbf-8eb3f2d1e380 req-f6f85047-85de-4202-983f-60497bd1fbc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0cecc96-b223-4404-90f0-374b6aee9423", "name": "network-vif-plugged", "status": "completed", "tag": "70b4a91c-79de-4829-8efc-bd3aa33c8095"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:18:58.726863 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-fa459869-ed12-4d06-adbf-8eb3f2d1e380 req-f6f85047-85de-4202-983f-60497bd1fbc7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:58.727582 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-fa459869-ed12-4d06-adbf-8eb3f2d1e380 req-f6f85047-85de-4202-983f-60497bd1fbc7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:58.747377 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-fa459869-ed12-4d06-adbf-8eb3f2d1e380 req-f6f85047-85de-4202-983f-60497bd1fbc7 service nova] Creating event network-vif-plugged:70b4a91c-79de-4829-8efc-bd3aa33c8095 for instance c0cecc96-b223-4404-90f0-374b6aee9423 on n-h2-846435-14 Jul 25 15:18:58.759480 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-fa459869-ed12-4d06-adbf-8eb3f2d1e380 req-f6f85047-85de-4202-983f-60497bd1fbc7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149387 Jul 25 15:18:58.761315 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3362/6947] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:18:58.927585 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9dc579d8-a5c4-4743-82dc-cf76998177e9 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:58.928237 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9dc579d8-a5c4-4743-82dc-cf76998177e9 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:58.936230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9dc579d8-a5c4-4743-82dc-cf76998177e9 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:58.936831 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9dc579d8-a5c4-4743-82dc-cf76998177e9 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:58.937797 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9dc579d8-a5c4-4743-82dc-cf76998177e9 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:58.938287 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9dc579d8-a5c4-4743-82dc-cf76998177e9 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:59.110503 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9dc579d8-a5c4-4743-82dc-cf76998177e9 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:59.119699 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9dc579d8-a5c4-4743-82dc-cf76998177e9 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1509 microversion: 2.1 time: 0.196095 Jul 25 15:18:59.120347 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3586/6948] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:58 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1509 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:18:59.145705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-22de5e76-90f8-4342-b5da-944250a5e2c2 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:18:59.147031 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-22de5e76-90f8-4342-b5da-944250a5e2c2 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:18:59.158926 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-22de5e76-90f8-4342-b5da-944250a5e2c2 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:59.159703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-22de5e76-90f8-4342-b5da-944250a5e2c2 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:59.161052 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-22de5e76-90f8-4342-b5da-944250a5e2c2 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:18:59.161788 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-22de5e76-90f8-4342-b5da-944250a5e2c2 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:18:59.362282 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-22de5e76-90f8-4342-b5da-944250a5e2c2 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:18:59.370830 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-22de5e76-90f8-4342-b5da-944250a5e2c2 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1509 microversion: 2.1 time: 0.232867 Jul 25 15:18:59.371415 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3363/6949] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:18:59 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1509 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:18:59.395693 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cbc51bbc-7b6b-48f0-b08f-fc010e764989 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Action: 'create', calling method: .version_select at 0x7f468640f5e0>, body: {"keypair": {"name": "tempest-keypair-2049225115", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdeaDLtD0+Ari4gdCD40HYH58fwgBAiKaxKeYaLclaPYV4yEVFieapv4SLSiaw12aT/IuVNPxyKzTf+XQ+G2pEZ2hZ86a/dU+qU12yMON2o0k9qpDt4VV8KtKXP9yGanQ=="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:18:59.413444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-cbc51bbc-7b6b-48f0-b08f-fc010e764989 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Getting quotas for project 1e4896360a0c4e8d98f338cbf797ca76. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:18:59.420253 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-cbc51bbc-7b6b-48f0-b08f-fc010e764989 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Getting quotas for user c98a3018dc3c404ca7aad5c311390793 and project 1e4896360a0c4e8d98f338cbf797ca76. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:18:59.456162 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cbc51bbc-7b6b-48f0-b08f-fc010e764989 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.064111 Jul 25 15:18:59.457252 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3587/6950] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 15:18:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:19:01.013315 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e9515588-95d4-48a2-869f-307637c0ab58 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:01.013953 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e9515588-95d4-48a2-869f-307637c0ab58 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:01.021771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e9515588-95d4-48a2-869f-307637c0ab58 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:01.022316 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e9515588-95d4-48a2-869f-307637c0ab58 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:01.023159 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e9515588-95d4-48a2-869f-307637c0ab58 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:01.023654 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e9515588-95d4-48a2-869f-307637c0ab58 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:01.194404 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e9515588-95d4-48a2-869f-307637c0ab58 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:01.203521 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e9515588-95d4-48a2-869f-307637c0ab58 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 200 len: 1509 microversion: 2.1 time: 0.194559 Jul 25 15:19:01.204146 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3364/6951] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:01 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 1509 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:01.226157 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-951c7569-09ad-4b2b-997b-dd6f51692d7a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:01.226933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-951c7569-09ad-4b2b-997b-dd6f51692d7a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:01.233947 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-951c7569-09ad-4b2b-997b-dd6f51692d7a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:01.234407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-951c7569-09ad-4b2b-997b-dd6f51692d7a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:01.235184 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-951c7569-09ad-4b2b-997b-dd6f51692d7a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:01.235620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-951c7569-09ad-4b2b-997b-dd6f51692d7a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:01.262538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-951c7569-09ad-4b2b-997b-dd6f51692d7a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:19:01.351708 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-951c7569-09ad-4b2b-997b-dd6f51692d7a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 204 len: 0 microversion: 2.1 time: 0.130080 Jul 25 15:19:01.352616 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3588/6952] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:19:01 2022] DELETE /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:19:01.413949 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e34abf43-2849-4006-bcc1-3ab8e3ff7b05 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-119275720", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "d9a158a2-79f2-438d-9d39-651f57f246bf"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:19:01.475995 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-e34abf43-2849-4006-bcc1-3ab8e3ff7b05 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] validate_networks() for [('d9a158a2-79f2-438d-9d39-651f57f246bf', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:19:01.937800 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-e34abf43-2849-4006-bcc1-3ab8e3ff7b05 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:19:01.938287 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-e34abf43-2849-4006-bcc1-3ab8e3ff7b05 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:19:01.938771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-e34abf43-2849-4006-bcc1-3ab8e3ff7b05 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:19:01.939183 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-e34abf43-2849-4006-bcc1-3ab8e3ff7b05 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:19:01.939603 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-e34abf43-2849-4006-bcc1-3ab8e3ff7b05 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:19:01.950437 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e34abf43-2849-4006-bcc1-3ab8e3ff7b05 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:01.950866 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e34abf43-2849-4006-bcc1-3ab8e3ff7b05 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:01.951716 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e34abf43-2849-4006-bcc1-3ab8e3ff7b05 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:01.952215 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e34abf43-2849-4006-bcc1-3ab8e3ff7b05 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:01.971241 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-e34abf43-2849-4006-bcc1-3ab8e3ff7b05 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Getting quotas for project 1e4896360a0c4e8d98f338cbf797ca76. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:19:01.977406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-e34abf43-2849-4006-bcc1-3ab8e3ff7b05 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Getting quotas for user c98a3018dc3c404ca7aad5c311390793 and project 1e4896360a0c4e8d98f338cbf797ca76. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:19:01.992471 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e34abf43-2849-4006-bcc1-3ab8e3ff7b05 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:19:01.994849 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e34abf43-2849-4006-bcc1-3ab8e3ff7b05 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:19:02.048947 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e34abf43-2849-4006-bcc1-3ab8e3ff7b05 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.639883 Jul 25 15:19:02.050032 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3365/6953] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:19:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:19:02.068019 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2336483b-2970-4746-b488-4554dcae0bb2 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:02.069513 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2336483b-2970-4746-b488-4554dcae0bb2 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:02.157960 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2336483b-2970-4746-b488-4554dcae0bb2 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:02.167297 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2336483b-2970-4746-b488-4554dcae0bb2 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1217 microversion: 2.1 time: 0.108449 Jul 25 15:19:02.170001 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3589/6954] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:02 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1217 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:19:03.195017 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-35cda6f4-fcb6-4785-afbc-556ef5ca8602 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:03.196097 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-35cda6f4-fcb6-4785-afbc-556ef5ca8602 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:03.221864 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-35cda6f4-fcb6-4785-afbc-556ef5ca8602 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:03.226543 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-35cda6f4-fcb6-4785-afbc-556ef5ca8602 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:03.227604 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-35cda6f4-fcb6-4785-afbc-556ef5ca8602 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:03.231714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-35cda6f4-fcb6-4785-afbc-556ef5ca8602 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:03.368225 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-35cda6f4-fcb6-4785-afbc-556ef5ca8602 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:03.387182 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-35cda6f4-fcb6-4785-afbc-556ef5ca8602 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1277 microversion: 2.1 time: 0.200286 Jul 25 15:19:03.389481 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3366/6955] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:03 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1277 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:03.637304 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-8f5fc09a-7bc0-4510-a644-d0a11e567e14 req-83597884-727f-48e7-9560-d3a9b8296e30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0cecc96-b223-4404-90f0-374b6aee9423", "name": "network-vif-deleted", "tag": "70b4a91c-79de-4829-8efc-bd3aa33c8095"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:19:03.654923 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-8f5fc09a-7bc0-4510-a644-d0a11e567e14 req-83597884-727f-48e7-9560-d3a9b8296e30 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:03.656146 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-8f5fc09a-7bc0-4510-a644-d0a11e567e14 req-83597884-727f-48e7-9560-d3a9b8296e30 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:03.673600 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-8f5fc09a-7bc0-4510-a644-d0a11e567e14 req-83597884-727f-48e7-9560-d3a9b8296e30 service nova] Creating event network-vif-deleted:70b4a91c-79de-4829-8efc-bd3aa33c8095 for instance c0cecc96-b223-4404-90f0-374b6aee9423 on n-h2-846435-14 Jul 25 15:19:03.680504 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-8f5fc09a-7bc0-4510-a644-d0a11e567e14 req-83597884-727f-48e7-9560-d3a9b8296e30 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046897 Jul 25 15:19:03.681479 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3590/6956] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:19:04.422473 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5e3ebfa3-638c-4209-87fa-cd67eb4d2a49 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:04.423773 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5e3ebfa3-638c-4209-87fa-cd67eb4d2a49 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:04.445926 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5e3ebfa3-638c-4209-87fa-cd67eb4d2a49 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:04.446754 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5e3ebfa3-638c-4209-87fa-cd67eb4d2a49 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:04.447766 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5e3ebfa3-638c-4209-87fa-cd67eb4d2a49 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:04.448398 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5e3ebfa3-638c-4209-87fa-cd67eb4d2a49 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:04.718931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5e3ebfa3-638c-4209-87fa-cd67eb4d2a49 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:04.727815 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5e3ebfa3-638c-4209-87fa-cd67eb4d2a49 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1317 microversion: 2.1 time: 0.309995 Jul 25 15:19:04.728712 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3367/6957] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:04 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1317 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:05.212121 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-29e4d629-bb87-4a0d-bd6b-5aa2103eb03a req-659705f9-2950-4efe-a68f-c7d420883786 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79ba8622-4141-44af-bd35-40b106e1290c", "tag": "6eec6124-c463-4850-b2d2-7e558cfb2528"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:19:05.226674 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-29e4d629-bb87-4a0d-bd6b-5aa2103eb03a req-659705f9-2950-4efe-a68f-c7d420883786 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:05.227427 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-29e4d629-bb87-4a0d-bd6b-5aa2103eb03a req-659705f9-2950-4efe-a68f-c7d420883786 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:05.246212 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-29e4d629-bb87-4a0d-bd6b-5aa2103eb03a req-659705f9-2950-4efe-a68f-c7d420883786 service nova] Creating event network-changed:6eec6124-c463-4850-b2d2-7e558cfb2528 for instance 79ba8622-4141-44af-bd35-40b106e1290c on n-h1-846435-14 Jul 25 15:19:05.252886 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-29e4d629-bb87-4a0d-bd6b-5aa2103eb03a req-659705f9-2950-4efe-a68f-c7d420883786 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046231 Jul 25 15:19:05.253500 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3591/6958] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:19:05.750617 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1c19aec3-cd2f-4bd3-b491-bd8d49c6845e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:05.751286 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1c19aec3-cd2f-4bd3-b491-bd8d49c6845e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:05.759049 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1c19aec3-cd2f-4bd3-b491-bd8d49c6845e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:05.759498 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1c19aec3-cd2f-4bd3-b491-bd8d49c6845e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:05.760338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1c19aec3-cd2f-4bd3-b491-bd8d49c6845e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:05.760771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1c19aec3-cd2f-4bd3-b491-bd8d49c6845e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:05.912879 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1c19aec3-cd2f-4bd3-b491-bd8d49c6845e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:05.921968 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1c19aec3-cd2f-4bd3-b491-bd8d49c6845e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1317 microversion: 2.1 time: 0.175855 Jul 25 15:19:05.922589 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3368/6959] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:05 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:06.945324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f733a38a-079e-4fd0-80ba-16f2d66f8440 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:06.946047 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f733a38a-079e-4fd0-80ba-16f2d66f8440 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:06.953762 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f733a38a-079e-4fd0-80ba-16f2d66f8440 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:06.954227 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f733a38a-079e-4fd0-80ba-16f2d66f8440 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:06.955063 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f733a38a-079e-4fd0-80ba-16f2d66f8440 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:06.955526 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f733a38a-079e-4fd0-80ba-16f2d66f8440 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:07.115916 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f733a38a-079e-4fd0-80ba-16f2d66f8440 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:07.129400 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f733a38a-079e-4fd0-80ba-16f2d66f8440 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1317 microversion: 2.1 time: 0.189545 Jul 25 15:19:07.129950 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3592/6960] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:06 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:08.152109 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2b81ae55-ba39-4a95-a279-2cb44794740b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:08.155306 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2b81ae55-ba39-4a95-a279-2cb44794740b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:08.163093 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2b81ae55-ba39-4a95-a279-2cb44794740b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:08.163715 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2b81ae55-ba39-4a95-a279-2cb44794740b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:08.164901 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2b81ae55-ba39-4a95-a279-2cb44794740b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:08.165451 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2b81ae55-ba39-4a95-a279-2cb44794740b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:08.384838 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2b81ae55-ba39-4a95-a279-2cb44794740b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:08.397508 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2b81ae55-ba39-4a95-a279-2cb44794740b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1317 microversion: 2.1 time: 0.249582 Jul 25 15:19:08.398964 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3369/6961] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:08 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:19:09.431716 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-242a26a1-a34e-416a-994d-06898991f100 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:09.432791 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-242a26a1-a34e-416a-994d-06898991f100 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:09.441425 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-242a26a1-a34e-416a-994d-06898991f100 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:09.442040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-242a26a1-a34e-416a-994d-06898991f100 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:09.442951 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-242a26a1-a34e-416a-994d-06898991f100 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:09.443491 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-242a26a1-a34e-416a-994d-06898991f100 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:09.599248 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-242a26a1-a34e-416a-994d-06898991f100 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:09.608128 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-242a26a1-a34e-416a-994d-06898991f100 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1317 microversion: 2.1 time: 0.180504 Jul 25 15:19:09.608741 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3593/6962] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:09 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:10.310851 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-4322384b-0298-412f-a577-27075f8bfb87 req-e211a2e6-d3b5-47e5-b7fd-ac0351712c76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ba8622-4141-44af-bd35-40b106e1290c", "name": "network-vif-plugged", "status": "completed", "tag": "6eec6124-c463-4850-b2d2-7e558cfb2528"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:19:10.325964 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-4322384b-0298-412f-a577-27075f8bfb87 req-e211a2e6-d3b5-47e5-b7fd-ac0351712c76 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:10.326454 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-4322384b-0298-412f-a577-27075f8bfb87 req-e211a2e6-d3b5-47e5-b7fd-ac0351712c76 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:10.333052 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=95 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:19:10.342561 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-4322384b-0298-412f-a577-27075f8bfb87 req-e211a2e6-d3b5-47e5-b7fd-ac0351712c76 service nova] Creating event network-vif-plugged:6eec6124-c463-4850-b2d2-7e558cfb2528 for instance 79ba8622-4141-44af-bd35-40b106e1290c on n-h1-846435-14 Jul 25 15:19:10.348111 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-4322384b-0298-412f-a577-27075f8bfb87 req-e211a2e6-d3b5-47e5-b7fd-ac0351712c76 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042707 Jul 25 15:19:10.349786 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3370/6963] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:19:10.630355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6d526cf6-a2cb-4737-8598-b199a6997253 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:10.631007 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6d526cf6-a2cb-4737-8598-b199a6997253 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:10.639126 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d526cf6-a2cb-4737-8598-b199a6997253 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:10.639570 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d526cf6-a2cb-4737-8598-b199a6997253 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:10.640474 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d526cf6-a2cb-4737-8598-b199a6997253 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:10.640926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6d526cf6-a2cb-4737-8598-b199a6997253 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:10.665913 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:19:10.792185 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6d526cf6-a2cb-4737-8598-b199a6997253 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:10.800493 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6d526cf6-a2cb-4737-8598-b199a6997253 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1317 microversion: 2.1 time: 0.174069 Jul 25 15:19:10.801070 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3594/6964] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:10 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:11.823821 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ec5c96b7-a216-4ea1-aefa-7083bcea078a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:11.824786 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ec5c96b7-a216-4ea1-aefa-7083bcea078a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:11.832207 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec5c96b7-a216-4ea1-aefa-7083bcea078a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:11.832657 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec5c96b7-a216-4ea1-aefa-7083bcea078a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:11.833465 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec5c96b7-a216-4ea1-aefa-7083bcea078a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:11.833897 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec5c96b7-a216-4ea1-aefa-7083bcea078a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:11.959807 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:19:11.986242 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:19:11.994748 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ec5c96b7-a216-4ea1-aefa-7083bcea078a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:12.003570 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ec5c96b7-a216-4ea1-aefa-7083bcea078a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1508 microversion: 2.1 time: 0.185038 Jul 25 15:19:12.004233 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3371/6965] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:11 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1508 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:12.025238 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b69ad28c-3094-45e6-ba14-27b67412eb9b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:12.025885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b69ad28c-3094-45e6-ba14-27b67412eb9b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:12.033831 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b69ad28c-3094-45e6-ba14-27b67412eb9b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:12.034287 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b69ad28c-3094-45e6-ba14-27b67412eb9b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:12.035085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b69ad28c-3094-45e6-ba14-27b67412eb9b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:12.035535 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b69ad28c-3094-45e6-ba14-27b67412eb9b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:12.164635 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:19:12.212747 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b69ad28c-3094-45e6-ba14-27b67412eb9b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:12.222265 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b69ad28c-3094-45e6-ba14-27b67412eb9b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1508 microversion: 2.1 time: 0.201144 Jul 25 15:19:12.222886 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3595/6966] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:12 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1508 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:19:12.257796 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-14bcc810-e900-4349-a3f0-73e69f83decd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:19:12.260313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-14bcc810-e900-4349-a3f0-73e69f83decd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:12.267048 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14bcc810-e900-4349-a3f0-73e69f83decd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:12.267527 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14bcc810-e900-4349-a3f0-73e69f83decd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:12.268365 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14bcc810-e900-4349-a3f0-73e69f83decd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:12.268806 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14bcc810-e900-4349-a3f0-73e69f83decd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:12.300403 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-14bcc810-e900-4349-a3f0-73e69f83decd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:12.307259 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-14bcc810-e900-4349-a3f0-73e69f83decd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Old instance type m1.heat2, new instance type m1.heat {{(pid=119303) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 15:19:12.314794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-14bcc810-e900-4349-a3f0-73e69f83decd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:19:12.315221 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-14bcc810-e900-4349-a3f0-73e69f83decd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:19:12.315697 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-14bcc810-e900-4349-a3f0-73e69f83decd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:19:12.316146 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-14bcc810-e900-4349-a3f0-73e69f83decd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:19:12.316565 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-14bcc810-e900-4349-a3f0-73e69f83decd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:19:12.423160 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-14bcc810-e900-4349-a3f0-73e69f83decd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "POST /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c/action" status: 202 len: 0 microversion: 2.1 time: 0.169470 Jul 25 15:19:12.423802 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3372/6967] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:19:12 2022] POST /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:19:12.434625 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-49b06d34-1362-4c93-9c50-5c9d10a316ad tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:12.435918 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-49b06d34-1362-4c93-9c50-5c9d10a316ad tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:12.440411 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:19:12.447392 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-49b06d34-1362-4c93-9c50-5c9d10a316ad tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:12.448751 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-49b06d34-1362-4c93-9c50-5c9d10a316ad tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:12.450569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-49b06d34-1362-4c93-9c50-5c9d10a316ad tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:12.451705 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-49b06d34-1362-4c93-9c50-5c9d10a316ad tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:12.725391 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-49b06d34-1362-4c93-9c50-5c9d10a316ad tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:12.736972 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-49b06d34-1362-4c93-9c50-5c9d10a316ad tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1515 microversion: 2.1 time: 0.308244 Jul 25 15:19:12.737908 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3596/6968] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:12 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1515 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:19:13.772459 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7283e56c-9dcc-41db-ba27-5b3529be96e3 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:13.773639 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7283e56c-9dcc-41db-ba27-5b3529be96e3 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:13.781644 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7283e56c-9dcc-41db-ba27-5b3529be96e3 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:13.782175 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7283e56c-9dcc-41db-ba27-5b3529be96e3 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:13.783002 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7283e56c-9dcc-41db-ba27-5b3529be96e3 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:13.783484 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7283e56c-9dcc-41db-ba27-5b3529be96e3 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:13.955041 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7283e56c-9dcc-41db-ba27-5b3529be96e3 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:13.965293 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7283e56c-9dcc-41db-ba27-5b3529be96e3 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1515 microversion: 2.1 time: 0.198694 Jul 25 15:19:13.966269 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3373/6969] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:13 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1515 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:14.993352 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-03e68a3c-e215-44df-a753-a3e04d5796cd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:14.994112 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-03e68a3c-e215-44df-a753-a3e04d5796cd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:15.003342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-03e68a3c-e215-44df-a753-a3e04d5796cd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:15.003779 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-03e68a3c-e215-44df-a753-a3e04d5796cd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:15.004620 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-03e68a3c-e215-44df-a753-a3e04d5796cd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:15.005110 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-03e68a3c-e215-44df-a753-a3e04d5796cd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:15.208394 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-03e68a3c-e215-44df-a753-a3e04d5796cd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:15.218403 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-03e68a3c-e215-44df-a753-a3e04d5796cd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1520 microversion: 2.1 time: 0.228870 Jul 25 15:19:15.219209 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3597/6970] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:14 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:16.243256 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a51f325c-59a8-443d-84b7-3b159855b255 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:16.243878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a51f325c-59a8-443d-84b7-3b159855b255 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:16.252809 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a51f325c-59a8-443d-84b7-3b159855b255 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:16.253288 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a51f325c-59a8-443d-84b7-3b159855b255 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:16.254056 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a51f325c-59a8-443d-84b7-3b159855b255 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:16.254519 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a51f325c-59a8-443d-84b7-3b159855b255 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:16.434706 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a51f325c-59a8-443d-84b7-3b159855b255 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:16.449647 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a51f325c-59a8-443d-84b7-3b159855b255 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1520 microversion: 2.1 time: 0.209999 Jul 25 15:19:16.450692 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3374/6971] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:16 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:17.486392 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e44f331d-40d3-469d-b2be-d2378622684b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:17.487077 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e44f331d-40d3-469d-b2be-d2378622684b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:17.494823 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e44f331d-40d3-469d-b2be-d2378622684b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:17.495524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e44f331d-40d3-469d-b2be-d2378622684b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:17.496565 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e44f331d-40d3-469d-b2be-d2378622684b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:17.497157 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e44f331d-40d3-469d-b2be-d2378622684b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:17.650196 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e44f331d-40d3-469d-b2be-d2378622684b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:17.660150 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e44f331d-40d3-469d-b2be-d2378622684b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1520 microversion: 2.1 time: 0.177864 Jul 25 15:19:17.660772 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3598/6972] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:17 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:19:18.682586 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-04babec5-7ada-4c0c-a0dc-a41ff96a8a28 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:18.683521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-04babec5-7ada-4c0c-a0dc-a41ff96a8a28 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:18.686050 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:19:18.694643 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-04babec5-7ada-4c0c-a0dc-a41ff96a8a28 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:18.695454 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-04babec5-7ada-4c0c-a0dc-a41ff96a8a28 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:18.696671 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-04babec5-7ada-4c0c-a0dc-a41ff96a8a28 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:18.697464 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-04babec5-7ada-4c0c-a0dc-a41ff96a8a28 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:18.894771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-04babec5-7ada-4c0c-a0dc-a41ff96a8a28 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:18.903965 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-04babec5-7ada-4c0c-a0dc-a41ff96a8a28 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1520 microversion: 2.1 time: 0.225531 Jul 25 15:19:18.904661 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3375/6973] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:18 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:19.926022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9d28bb81-cf8e-4e01-95be-575399474098 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:19.926760 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9d28bb81-cf8e-4e01-95be-575399474098 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:19.935076 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d28bb81-cf8e-4e01-95be-575399474098 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:19.935693 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d28bb81-cf8e-4e01-95be-575399474098 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:19.936626 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d28bb81-cf8e-4e01-95be-575399474098 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:19.937156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d28bb81-cf8e-4e01-95be-575399474098 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:20.097745 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9d28bb81-cf8e-4e01-95be-575399474098 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:20.106347 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9d28bb81-cf8e-4e01-95be-575399474098 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1520 microversion: 2.1 time: 0.184429 Jul 25 15:19:20.106961 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3599/6974] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:19 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:21.129357 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8a0fc97b-9204-418c-8d41-8d4989213631 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:21.130144 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8a0fc97b-9204-418c-8d41-8d4989213631 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:21.138125 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8a0fc97b-9204-418c-8d41-8d4989213631 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:21.138689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8a0fc97b-9204-418c-8d41-8d4989213631 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:21.140007 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8a0fc97b-9204-418c-8d41-8d4989213631 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:21.140577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8a0fc97b-9204-418c-8d41-8d4989213631 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:21.290159 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8a0fc97b-9204-418c-8d41-8d4989213631 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:21.299079 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8a0fc97b-9204-418c-8d41-8d4989213631 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1520 microversion: 2.1 time: 0.174183 Jul 25 15:19:21.299736 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3376/6975] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:21 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:22.321522 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-42ec1100-f3e9-4b30-b701-ec851c1dda60 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:22.322193 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-42ec1100-f3e9-4b30-b701-ec851c1dda60 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:22.330671 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-42ec1100-f3e9-4b30-b701-ec851c1dda60 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:22.331136 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-42ec1100-f3e9-4b30-b701-ec851c1dda60 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:22.331937 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-42ec1100-f3e9-4b30-b701-ec851c1dda60 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:22.332410 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-42ec1100-f3e9-4b30-b701-ec851c1dda60 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:22.518555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-42ec1100-f3e9-4b30-b701-ec851c1dda60 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:22.527417 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-42ec1100-f3e9-4b30-b701-ec851c1dda60 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1520 microversion: 2.1 time: 0.210015 Jul 25 15:19:22.528093 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3600/6976] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:22 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:23.549996 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-302ef77e-5c15-4d39-9143-d26b9f4a46d2 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:23.550651 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-302ef77e-5c15-4d39-9143-d26b9f4a46d2 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:23.559072 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-302ef77e-5c15-4d39-9143-d26b9f4a46d2 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:23.559531 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-302ef77e-5c15-4d39-9143-d26b9f4a46d2 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:23.560411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-302ef77e-5c15-4d39-9143-d26b9f4a46d2 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:23.560824 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-302ef77e-5c15-4d39-9143-d26b9f4a46d2 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:23.732785 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-302ef77e-5c15-4d39-9143-d26b9f4a46d2 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:23.746887 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-302ef77e-5c15-4d39-9143-d26b9f4a46d2 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1520 microversion: 2.1 time: 0.200723 Jul 25 15:19:23.747952 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3377/6977] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:23 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:24.770447 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f2a5ac06-9144-4280-8f14-0e36744d72b6 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:24.770999 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f2a5ac06-9144-4280-8f14-0e36744d72b6 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:24.778647 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f2a5ac06-9144-4280-8f14-0e36744d72b6 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:24.779139 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f2a5ac06-9144-4280-8f14-0e36744d72b6 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:24.779942 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f2a5ac06-9144-4280-8f14-0e36744d72b6 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:24.780678 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f2a5ac06-9144-4280-8f14-0e36744d72b6 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:24.946989 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f2a5ac06-9144-4280-8f14-0e36744d72b6 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:24.958290 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f2a5ac06-9144-4280-8f14-0e36744d72b6 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1520 microversion: 2.1 time: 0.191851 Jul 25 15:19:24.958900 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3601/6978] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:24 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:25.983095 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f5768399-312f-4381-89ae-1507f1a050db tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:25.984178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f5768399-312f-4381-89ae-1507f1a050db tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:25.992767 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f5768399-312f-4381-89ae-1507f1a050db tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:25.993370 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f5768399-312f-4381-89ae-1507f1a050db tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:25.994280 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f5768399-312f-4381-89ae-1507f1a050db tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:25.994818 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f5768399-312f-4381-89ae-1507f1a050db tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:26.159481 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f5768399-312f-4381-89ae-1507f1a050db tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:26.169878 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f5768399-312f-4381-89ae-1507f1a050db tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1520 microversion: 2.1 time: 0.192480 Jul 25 15:19:26.170638 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3378/6979] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:25 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:27.198496 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-713ce252-fd50-484f-bccd-e4285161e0de tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:27.199677 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-713ce252-fd50-484f-bccd-e4285161e0de tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:27.212018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-713ce252-fd50-484f-bccd-e4285161e0de tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:27.212841 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-713ce252-fd50-484f-bccd-e4285161e0de tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:27.214392 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-713ce252-fd50-484f-bccd-e4285161e0de tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:27.215145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-713ce252-fd50-484f-bccd-e4285161e0de tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:27.392697 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-713ce252-fd50-484f-bccd-e4285161e0de tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:27.401036 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-713ce252-fd50-484f-bccd-e4285161e0de tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1520 microversion: 2.1 time: 0.209948 Jul 25 15:19:27.401918 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3602/6980] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:27 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:28.424152 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-240857fd-bdd7-48d0-a456-3330f3cfd0af tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:28.424815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-240857fd-bdd7-48d0-a456-3330f3cfd0af tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:28.432905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-240857fd-bdd7-48d0-a456-3330f3cfd0af tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:28.433513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-240857fd-bdd7-48d0-a456-3330f3cfd0af tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:28.434457 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-240857fd-bdd7-48d0-a456-3330f3cfd0af tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:28.435009 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-240857fd-bdd7-48d0-a456-3330f3cfd0af tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:28.616702 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-240857fd-bdd7-48d0-a456-3330f3cfd0af tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:28.625707 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-240857fd-bdd7-48d0-a456-3330f3cfd0af tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1520 microversion: 2.1 time: 0.205695 Jul 25 15:19:28.626322 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3379/6981] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:28 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:29.649305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-80ec8f37-c5a0-4400-a184-5349fe192899 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:29.650319 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-80ec8f37-c5a0-4400-a184-5349fe192899 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:29.660269 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-80ec8f37-c5a0-4400-a184-5349fe192899 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:29.660804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-80ec8f37-c5a0-4400-a184-5349fe192899 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:29.661956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-80ec8f37-c5a0-4400-a184-5349fe192899 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:29.662776 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-80ec8f37-c5a0-4400-a184-5349fe192899 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:29.816328 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-80ec8f37-c5a0-4400-a184-5349fe192899 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:29.826043 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-80ec8f37-c5a0-4400-a184-5349fe192899 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1520 microversion: 2.1 time: 0.182753 Jul 25 15:19:29.826687 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3603/6982] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:29 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:30.850825 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5be8556b-ec42-4024-8839-fec7748f45cd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:30.851665 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5be8556b-ec42-4024-8839-fec7748f45cd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:30.859911 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5be8556b-ec42-4024-8839-fec7748f45cd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:30.860571 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5be8556b-ec42-4024-8839-fec7748f45cd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:30.861507 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5be8556b-ec42-4024-8839-fec7748f45cd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:30.862020 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5be8556b-ec42-4024-8839-fec7748f45cd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:31.014185 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5be8556b-ec42-4024-8839-fec7748f45cd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:31.024731 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5be8556b-ec42-4024-8839-fec7748f45cd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1520 microversion: 2.1 time: 0.178447 Jul 25 15:19:31.025563 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3380/6983] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:30 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:32.047230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-69e859f9-687b-4e74-9da7-f0b28967fc4a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:32.047965 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-69e859f9-687b-4e74-9da7-f0b28967fc4a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:32.056795 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69e859f9-687b-4e74-9da7-f0b28967fc4a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:32.057282 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69e859f9-687b-4e74-9da7-f0b28967fc4a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:32.058072 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69e859f9-687b-4e74-9da7-f0b28967fc4a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:32.058670 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69e859f9-687b-4e74-9da7-f0b28967fc4a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:32.274069 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-69e859f9-687b-4e74-9da7-f0b28967fc4a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:32.283482 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-69e859f9-687b-4e74-9da7-f0b28967fc4a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1520 microversion: 2.1 time: 0.240469 Jul 25 15:19:32.284104 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3604/6984] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:32 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:33.318750 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1717abe4-8b20-4051-a9f3-e2c480d8800f tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:33.319454 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1717abe4-8b20-4051-a9f3-e2c480d8800f tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:33.327823 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1717abe4-8b20-4051-a9f3-e2c480d8800f tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:33.328451 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1717abe4-8b20-4051-a9f3-e2c480d8800f tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:33.329311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1717abe4-8b20-4051-a9f3-e2c480d8800f tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:33.330039 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1717abe4-8b20-4051-a9f3-e2c480d8800f tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:33.509930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1717abe4-8b20-4051-a9f3-e2c480d8800f tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:33.519324 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1717abe4-8b20-4051-a9f3-e2c480d8800f tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1520 microversion: 2.1 time: 0.204743 Jul 25 15:19:33.519933 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3381/6985] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:33 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:34.541497 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-50952e71-4344-49a5-87df-d64c58da7ad4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:34.542265 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-50952e71-4344-49a5-87df-d64c58da7ad4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:34.551208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50952e71-4344-49a5-87df-d64c58da7ad4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:34.551763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50952e71-4344-49a5-87df-d64c58da7ad4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:34.552815 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50952e71-4344-49a5-87df-d64c58da7ad4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:34.553247 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-50952e71-4344-49a5-87df-d64c58da7ad4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:34.715081 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-50952e71-4344-49a5-87df-d64c58da7ad4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:34.724172 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-50952e71-4344-49a5-87df-d64c58da7ad4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1520 microversion: 2.1 time: 0.186700 Jul 25 15:19:34.724846 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3605/6986] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:34 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:35.758419 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8cdfb56e-9fb7-43f4-8706-1d5f4dbc062e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:35.759041 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8cdfb56e-9fb7-43f4-8706-1d5f4dbc062e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:35.767624 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8cdfb56e-9fb7-43f4-8706-1d5f4dbc062e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:35.768266 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8cdfb56e-9fb7-43f4-8706-1d5f4dbc062e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:35.769182 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8cdfb56e-9fb7-43f4-8706-1d5f4dbc062e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:35.769733 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8cdfb56e-9fb7-43f4-8706-1d5f4dbc062e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:35.930666 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8cdfb56e-9fb7-43f4-8706-1d5f4dbc062e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:35.939288 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8cdfb56e-9fb7-43f4-8706-1d5f4dbc062e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1520 microversion: 2.1 time: 0.185596 Jul 25 15:19:35.939924 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3382/6987] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:35 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:36.961524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-eb7926f8-5adb-4073-a32e-5d1e1ee5a56e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:36.962264 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-eb7926f8-5adb-4073-a32e-5d1e1ee5a56e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:36.970203 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eb7926f8-5adb-4073-a32e-5d1e1ee5a56e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:36.970642 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eb7926f8-5adb-4073-a32e-5d1e1ee5a56e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:36.971461 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eb7926f8-5adb-4073-a32e-5d1e1ee5a56e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:36.971904 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eb7926f8-5adb-4073-a32e-5d1e1ee5a56e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:37.131096 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-eb7926f8-5adb-4073-a32e-5d1e1ee5a56e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:37.139862 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-eb7926f8-5adb-4073-a32e-5d1e1ee5a56e tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1520 microversion: 2.1 time: 0.182485 Jul 25 15:19:37.140517 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3606/6988] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:36 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:38.174942 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f39f754f-4f52-4681-b3d0-0408ae3037ee tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:38.175770 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f39f754f-4f52-4681-b3d0-0408ae3037ee tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:38.183489 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f39f754f-4f52-4681-b3d0-0408ae3037ee tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:38.184138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f39f754f-4f52-4681-b3d0-0408ae3037ee tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:38.184942 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f39f754f-4f52-4681-b3d0-0408ae3037ee tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:38.185494 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f39f754f-4f52-4681-b3d0-0408ae3037ee tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:38.351402 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f39f754f-4f52-4681-b3d0-0408ae3037ee tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:38.368626 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f39f754f-4f52-4681-b3d0-0408ae3037ee tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1520 microversion: 2.1 time: 0.197614 Jul 25 15:19:38.369544 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3383/6989] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:38 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:39.398938 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9387cc16-4158-485d-81ba-3b792dce3ca6 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:39.399602 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9387cc16-4158-485d-81ba-3b792dce3ca6 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:39.407667 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9387cc16-4158-485d-81ba-3b792dce3ca6 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:39.408280 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9387cc16-4158-485d-81ba-3b792dce3ca6 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:39.409089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9387cc16-4158-485d-81ba-3b792dce3ca6 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:39.409537 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9387cc16-4158-485d-81ba-3b792dce3ca6 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:39.559835 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9387cc16-4158-485d-81ba-3b792dce3ca6 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:39.568271 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9387cc16-4158-485d-81ba-3b792dce3ca6 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1520 microversion: 2.1 time: 0.173248 Jul 25 15:19:39.568877 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3607/6990] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:39 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:40.591449 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5e480507-a8bb-4f55-8002-5238ed4714cc tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:40.592155 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5e480507-a8bb-4f55-8002-5238ed4714cc tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:40.600032 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5e480507-a8bb-4f55-8002-5238ed4714cc tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:40.600504 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5e480507-a8bb-4f55-8002-5238ed4714cc tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:40.601337 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5e480507-a8bb-4f55-8002-5238ed4714cc tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:40.601777 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5e480507-a8bb-4f55-8002-5238ed4714cc tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:40.605224 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:19:40.752168 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5e480507-a8bb-4f55-8002-5238ed4714cc tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:40.761431 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5e480507-a8bb-4f55-8002-5238ed4714cc tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1520 microversion: 2.1 time: 0.174351 Jul 25 15:19:40.762137 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3384/6991] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:40 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:41.784070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8edc20db-4cd7-4c03-bf25-c8effa72d74b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:41.784903 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8edc20db-4cd7-4c03-bf25-c8effa72d74b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:41.792435 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8edc20db-4cd7-4c03-bf25-c8effa72d74b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:41.793095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8edc20db-4cd7-4c03-bf25-c8effa72d74b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:41.794877 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8edc20db-4cd7-4c03-bf25-c8effa72d74b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:41.795083 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8edc20db-4cd7-4c03-bf25-c8effa72d74b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:41.800724 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=81 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:19:42.098364 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8edc20db-4cd7-4c03-bf25-c8effa72d74b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:42.108392 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8edc20db-4cd7-4c03-bf25-c8effa72d74b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1519 microversion: 2.1 time: 0.328301 Jul 25 15:19:42.109691 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3608/6992] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:41 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1519 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:42.312549 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-2fdc1d4c-8045-49b7-988f-34e8a649406d req-9960690e-f103-4ab6-b443-94502d93860d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ba8622-4141-44af-bd35-40b106e1290c", "name": "network-vif-unplugged", "status": "completed", "tag": "6eec6124-c463-4850-b2d2-7e558cfb2528"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:19:42.323227 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-2fdc1d4c-8045-49b7-988f-34e8a649406d req-9960690e-f103-4ab6-b443-94502d93860d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:42.323667 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-2fdc1d4c-8045-49b7-988f-34e8a649406d req-9960690e-f103-4ab6-b443-94502d93860d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:42.340022 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-2fdc1d4c-8045-49b7-988f-34e8a649406d req-9960690e-f103-4ab6-b443-94502d93860d service nova] Creating event network-vif-unplugged:6eec6124-c463-4850-b2d2-7e558cfb2528 for instance 79ba8622-4141-44af-bd35-40b106e1290c on n-h2-846435-14 Jul 25 15:19:42.346185 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [req-2fdc1d4c-8045-49b7-988f-34e8a649406d req-9960690e-f103-4ab6-b443-94502d93860d service nova] Instance 79ba8622-4141-44af-bd35-40b106e1290c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119303) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 15:19:42.357744 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-2fdc1d4c-8045-49b7-988f-34e8a649406d req-9960690e-f103-4ab6-b443-94502d93860d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049098 Jul 25 15:19:42.362619 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3385/6993] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:19:43.136222 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b0d6045d-a50e-477a-adff-da95a2d0cdb4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:43.137260 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b0d6045d-a50e-477a-adff-da95a2d0cdb4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:43.141832 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=26 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:19:43.151413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0d6045d-a50e-477a-adff-da95a2d0cdb4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:43.152239 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0d6045d-a50e-477a-adff-da95a2d0cdb4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:43.153588 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0d6045d-a50e-477a-adff-da95a2d0cdb4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:43.154418 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0d6045d-a50e-477a-adff-da95a2d0cdb4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:43.395912 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b0d6045d-a50e-477a-adff-da95a2d0cdb4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:43.404776 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b0d6045d-a50e-477a-adff-da95a2d0cdb4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1519 microversion: 2.1 time: 0.276190 Jul 25 15:19:43.406482 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3609/6994] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:43 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1519 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:44.398674 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-8c3c0c70-5699-4299-8cb7-27e2d790769b req-3d0d29ff-2bf6-4681-b3ef-bb7e7346fa55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79ba8622-4141-44af-bd35-40b106e1290c", "tag": "6eec6124-c463-4850-b2d2-7e558cfb2528"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:19:44.409293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-8c3c0c70-5699-4299-8cb7-27e2d790769b req-3d0d29ff-2bf6-4681-b3ef-bb7e7346fa55 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:44.409745 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-8c3c0c70-5699-4299-8cb7-27e2d790769b req-3d0d29ff-2bf6-4681-b3ef-bb7e7346fa55 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:44.423775 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-8c3c0c70-5699-4299-8cb7-27e2d790769b req-3d0d29ff-2bf6-4681-b3ef-bb7e7346fa55 service nova] Creating event network-changed:6eec6124-c463-4850-b2d2-7e558cfb2528 for instance 79ba8622-4141-44af-bd35-40b106e1290c on n-h2-846435-14 Jul 25 15:19:44.429121 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-51e0cbeb-fcf3-4a43-839c-1f20b053e0b3 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:44.429976 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-51e0cbeb-fcf3-4a43-839c-1f20b053e0b3 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:44.431528 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [req-8c3c0c70-5699-4299-8cb7-27e2d790769b req-3d0d29ff-2bf6-4681-b3ef-bb7e7346fa55 service nova] Instance 79ba8622-4141-44af-bd35-40b106e1290c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119303) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 15:19:44.438350 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51e0cbeb-fcf3-4a43-839c-1f20b053e0b3 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:44.438802 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51e0cbeb-fcf3-4a43-839c-1f20b053e0b3 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:44.439806 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51e0cbeb-fcf3-4a43-839c-1f20b053e0b3 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:44.440443 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51e0cbeb-fcf3-4a43-839c-1f20b053e0b3 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:44.444557 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-8c3c0c70-5699-4299-8cb7-27e2d790769b req-3d0d29ff-2bf6-4681-b3ef-bb7e7346fa55 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050918 Jul 25 15:19:44.447059 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3386/6995] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:19:44.618736 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-51e0cbeb-fcf3-4a43-839c-1f20b053e0b3 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:44.632396 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-51e0cbeb-fcf3-4a43-839c-1f20b053e0b3 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1517 microversion: 2.1 time: 0.207236 Jul 25 15:19:44.633010 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3610/6996] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:44 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1517 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:19:45.656528 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-50a4f9d4-1316-41c5-b3d4-aabd9c4bf59d tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:45.657307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-50a4f9d4-1316-41c5-b3d4-aabd9c4bf59d tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:45.664714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-50a4f9d4-1316-41c5-b3d4-aabd9c4bf59d tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:45.665160 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-50a4f9d4-1316-41c5-b3d4-aabd9c4bf59d tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:45.665948 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-50a4f9d4-1316-41c5-b3d4-aabd9c4bf59d tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:45.666381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-50a4f9d4-1316-41c5-b3d4-aabd9c4bf59d tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:45.814662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-50a4f9d4-1316-41c5-b3d4-aabd9c4bf59d tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:45.822965 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-50a4f9d4-1316-41c5-b3d4-aabd9c4bf59d tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1517 microversion: 2.1 time: 0.172125 Jul 25 15:19:45.823649 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3387/6997] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:45 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:46.845586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-de14f097-c054-4253-bfcf-0bac321144cd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:46.846190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-de14f097-c054-4253-bfcf-0bac321144cd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:46.853558 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-de14f097-c054-4253-bfcf-0bac321144cd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:46.855788 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-de14f097-c054-4253-bfcf-0bac321144cd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:46.856687 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-de14f097-c054-4253-bfcf-0bac321144cd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:46.857191 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-de14f097-c054-4253-bfcf-0bac321144cd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:47.040184 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-de14f097-c054-4253-bfcf-0bac321144cd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:47.049452 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-de14f097-c054-4253-bfcf-0bac321144cd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1514 microversion: 2.1 time: 0.207863 Jul 25 15:19:47.050159 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3611/6998] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:46 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1514 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:47.071793 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-992a3e0f-b2b4-43f8-8ba2-37c48ba99222 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:19:47.072542 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-992a3e0f-b2b4-43f8-8ba2-37c48ba99222 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:47.080671 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-992a3e0f-b2b4-43f8-8ba2-37c48ba99222 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:47.081177 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-992a3e0f-b2b4-43f8-8ba2-37c48ba99222 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:47.082084 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-992a3e0f-b2b4-43f8-8ba2-37c48ba99222 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:47.082517 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-992a3e0f-b2b4-43f8-8ba2-37c48ba99222 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:47.158307 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-992a3e0f-b2b4-43f8-8ba2-37c48ba99222 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "POST /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c/action" status: 204 len: 0 microversion: 2.1 time: 0.090423 Jul 25 15:19:47.158919 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3388/6999] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:19:47 2022] POST /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c/action => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:19:47.168095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ee27fc92-97fd-496c-aadc-18050ec352ff tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:47.168723 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ee27fc92-97fd-496c-aadc-18050ec352ff tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:47.175613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee27fc92-97fd-496c-aadc-18050ec352ff tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:47.176105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee27fc92-97fd-496c-aadc-18050ec352ff tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:47.176899 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee27fc92-97fd-496c-aadc-18050ec352ff tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:47.177338 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee27fc92-97fd-496c-aadc-18050ec352ff tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:47.356845 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ee27fc92-97fd-496c-aadc-18050ec352ff tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:47.365297 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ee27fc92-97fd-496c-aadc-18050ec352ff tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1514 microversion: 2.1 time: 0.201602 Jul 25 15:19:47.365915 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3612/7000] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:47 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1514 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:48.401708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2536af9b-c342-44ce-b60a-e9b81a502136 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:48.402725 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2536af9b-c342-44ce-b60a-e9b81a502136 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:48.410165 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2536af9b-c342-44ce-b60a-e9b81a502136 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:48.410606 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2536af9b-c342-44ce-b60a-e9b81a502136 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:48.411426 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2536af9b-c342-44ce-b60a-e9b81a502136 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:48.411846 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2536af9b-c342-44ce-b60a-e9b81a502136 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:48.567924 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2536af9b-c342-44ce-b60a-e9b81a502136 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:48.577949 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2536af9b-c342-44ce-b60a-e9b81a502136 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1506 microversion: 2.1 time: 0.182942 Jul 25 15:19:48.578407 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3389/7001] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:48 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:19:48.599918 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4c957f1d-95f9-448a-8d6e-d8846d1dc1b1 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:48.600791 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4c957f1d-95f9-448a-8d6e-d8846d1dc1b1 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:48.609402 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4c957f1d-95f9-448a-8d6e-d8846d1dc1b1 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:48.609858 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4c957f1d-95f9-448a-8d6e-d8846d1dc1b1 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:48.610678 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4c957f1d-95f9-448a-8d6e-d8846d1dc1b1 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:48.611125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4c957f1d-95f9-448a-8d6e-d8846d1dc1b1 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:49.107423 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4c957f1d-95f9-448a-8d6e-d8846d1dc1b1 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:49.115486 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4c957f1d-95f9-448a-8d6e-d8846d1dc1b1 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1506 microversion: 2.1 time: 0.519842 Jul 25 15:19:49.116121 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3613/7002] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:48 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1506 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:49.136639 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cf35eef4-8b48-42d3-bedd-26da8839f18a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:49.137263 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cf35eef4-8b48-42d3-bedd-26da8839f18a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:49.139352 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=30 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:19:49.146514 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf35eef4-8b48-42d3-bedd-26da8839f18a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:49.146951 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf35eef4-8b48-42d3-bedd-26da8839f18a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:49.147764 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf35eef4-8b48-42d3-bedd-26da8839f18a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:49.148234 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cf35eef4-8b48-42d3-bedd-26da8839f18a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:49.300404 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cf35eef4-8b48-42d3-bedd-26da8839f18a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:49.311576 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cf35eef4-8b48-42d3-bedd-26da8839f18a tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1506 microversion: 2.1 time: 0.178862 Jul 25 15:19:49.312324 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3390/7003] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:49 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1506 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:19:49.332591 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dbc55e8e-5e94-45e0-a871-10ce99eef49b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:49.333104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dbc55e8e-5e94-45e0-a871-10ce99eef49b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:49.339621 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dbc55e8e-5e94-45e0-a871-10ce99eef49b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:49.340132 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dbc55e8e-5e94-45e0-a871-10ce99eef49b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:49.340943 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dbc55e8e-5e94-45e0-a871-10ce99eef49b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:49.341396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dbc55e8e-5e94-45e0-a871-10ce99eef49b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:49.368938 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dbc55e8e-5e94-45e0-a871-10ce99eef49b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:19:49.465981 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dbc55e8e-5e94-45e0-a871-10ce99eef49b tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "DELETE /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 204 len: 0 microversion: 2.1 time: 0.137278 Jul 25 15:19:49.467366 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3614/7004] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:19:49 2022] DELETE /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:19:49.485507 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-96814b90-bfba-47f9-bce5-639fc4f705a4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:49.486131 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-96814b90-bfba-47f9-bce5-639fc4f705a4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:49.493464 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-96814b90-bfba-47f9-bce5-639fc4f705a4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:49.493894 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-96814b90-bfba-47f9-bce5-639fc4f705a4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:49.494730 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-96814b90-bfba-47f9-bce5-639fc4f705a4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:49.495170 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-96814b90-bfba-47f9-bce5-639fc4f705a4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:49.528495 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-96814b90-bfba-47f9-bce5-639fc4f705a4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:19:49.589490 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.compute.api [None req-96814b90-bfba-47f9-bce5-639fc4f705a4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Instance is already in deleting state, ignoring this request Jul 25 15:19:49.590185 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-96814b90-bfba-47f9-bce5-639fc4f705a4 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "DELETE /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 204 len: 0 microversion: 2.1 time: 0.108803 Jul 25 15:19:49.590834 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3391/7005] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:19:49 2022] DELETE /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:19:49.600160 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6e0f5a10-e2a4-42f2-ab4f-6a682aa1a5eb tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:49.600884 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6e0f5a10-e2a4-42f2-ab4f-6a682aa1a5eb tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:49.607767 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e0f5a10-e2a4-42f2-ab4f-6a682aa1a5eb tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:49.608252 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e0f5a10-e2a4-42f2-ab4f-6a682aa1a5eb tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:49.609041 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e0f5a10-e2a4-42f2-ab4f-6a682aa1a5eb tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:49.609493 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e0f5a10-e2a4-42f2-ab4f-6a682aa1a5eb tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:49.746302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6e0f5a10-e2a4-42f2-ab4f-6a682aa1a5eb tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:49.754498 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6e0f5a10-e2a4-42f2-ab4f-6a682aa1a5eb tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1512 microversion: 2.1 time: 0.158895 Jul 25 15:19:49.755089 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3615/7006] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:49 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:50.779188 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-26fb76a9-f3ff-4154-b36d-88625b90cbed tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:50.780446 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-26fb76a9-f3ff-4154-b36d-88625b90cbed tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:50.790434 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-26fb76a9-f3ff-4154-b36d-88625b90cbed tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:50.790878 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-26fb76a9-f3ff-4154-b36d-88625b90cbed tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:50.791785 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-26fb76a9-f3ff-4154-b36d-88625b90cbed tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:50.792764 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-26fb76a9-f3ff-4154-b36d-88625b90cbed tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:50.925956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-c686caf4-3394-4c8f-a70a-d163a927e9c7 req-32950485-efe3-404d-a8e0-6fea35161848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ba8622-4141-44af-bd35-40b106e1290c", "name": "network-vif-plugged", "status": "completed", "tag": "6eec6124-c463-4850-b2d2-7e558cfb2528"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:19:50.951543 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c686caf4-3394-4c8f-a70a-d163a927e9c7 req-32950485-efe3-404d-a8e0-6fea35161848 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:50.952688 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c686caf4-3394-4c8f-a70a-d163a927e9c7 req-32950485-efe3-404d-a8e0-6fea35161848 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:50.969010 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-26fb76a9-f3ff-4154-b36d-88625b90cbed tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a3018dc3c404ca7aad5c311390793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4896360a0c4e8d98f338cbf797ca76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:19:50.973892 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-c686caf4-3394-4c8f-a70a-d163a927e9c7 req-32950485-efe3-404d-a8e0-6fea35161848 service nova] Creating event network-vif-plugged:6eec6124-c463-4850-b2d2-7e558cfb2528 for instance 79ba8622-4141-44af-bd35-40b106e1290c on n-h2-846435-14 Jul 25 15:19:50.979601 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-c686caf4-3394-4c8f-a70a-d163a927e9c7 req-32950485-efe3-404d-a8e0-6fea35161848 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063890 Jul 25 15:19:50.980801 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3616/7007] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:19:50.982109 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-26fb76a9-f3ff-4154-b36d-88625b90cbed tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 200 len: 1512 microversion: 2.1 time: 0.208434 Jul 25 15:19:50.982716 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3392/7008] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:50 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 1512 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:19:51.533172 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-3221c17a-cba9-46e6-ad78-6aef5f08f931 req-b37ea9d7-ee87-4a1d-a2e9-f7183446355d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ba8622-4141-44af-bd35-40b106e1290c", "name": "network-vif-deleted", "tag": "6eec6124-c463-4850-b2d2-7e558cfb2528"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:19:51.546850 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-3221c17a-cba9-46e6-ad78-6aef5f08f931 req-b37ea9d7-ee87-4a1d-a2e9-f7183446355d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:51.547524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-3221c17a-cba9-46e6-ad78-6aef5f08f931 req-b37ea9d7-ee87-4a1d-a2e9-f7183446355d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:51.567032 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-3221c17a-cba9-46e6-ad78-6aef5f08f931 req-b37ea9d7-ee87-4a1d-a2e9-f7183446355d service nova] Creating event network-vif-deleted:6eec6124-c463-4850-b2d2-7e558cfb2528 for instance 79ba8622-4141-44af-bd35-40b106e1290c on n-h2-846435-14 Jul 25 15:19:51.573471 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-3221c17a-cba9-46e6-ad78-6aef5f08f931 req-b37ea9d7-ee87-4a1d-a2e9-f7183446355d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044201 Jul 25 15:19:51.574143 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3617/7009] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:19:52.003857 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b8b18f65-05e3-43c0-8596-32347c0bbecd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:52.004651 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b8b18f65-05e3-43c0-8596-32347c0bbecd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: 79ba8622-4141-44af-bd35-40b106e1290c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:52.012549 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8b18f65-05e3-43c0-8596-32347c0bbecd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:52.013001 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8b18f65-05e3-43c0-8596-32347c0bbecd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:52.013807 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8b18f65-05e3-43c0-8596-32347c0bbecd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:52.014236 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8b18f65-05e3-43c0-8596-32347c0bbecd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:52.037554 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-b8b18f65-05e3-43c0-8596-32347c0bbecd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] HTTP exception thrown: Instance 79ba8622-4141-44af-bd35-40b106e1290c could not be found. Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b8b18f65-05e3-43c0-8596-32347c0bbecd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Request method failure captured: Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c HTTP/1.1 Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rQx-JhVh-raTaFEVB5EnQDfe8dh_Kup5WwMr8q0g2uSPeqLqCYDItwVqE_Ci-xrhaY4ULSqTvogPC9XqJ-tXDXzX0b9OYirzm0-w_j2x34lgJyHwUx3-axvjejl7tCOWxloIFijxF89RlfZi_-WXZtiQXDl0K12WQCnklvrhtZvSgg Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 1e4896360a0c4e8d98f338cbf797ca76 Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1697592539 Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1e4896360a0c4e8d98f338cbf797ca76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1e4896360a0c4e8d98f338cbf797ca76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1e4896360a0c4e8d98f338cbf797ca76", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1e4896360a0c4e8d98f338cbf797ca76"}]}] Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServerDiskConfigTestJSON-1697592539 Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 1e4896360a0c4e8d98f338cbf797ca76 Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1697592539 Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServerDiskConfigTestJSON-1697592539-project Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: c98a3018dc3c404ca7aad5c311390793 Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServerDiskConfigTestJSON-1697592539-project Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 79ba8622-4141-44af-bd35-40b106e1290c could not be found. Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '79ba8622-4141-44af-bd35-40b106e1290c'} Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79ba8622-4141-44af-bd35-40b106e1290c could not be found. Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79ba8622-4141-44af-bd35-40b106e1290c could not be found. Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:19:52.040320 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:19:52.044915 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:19:52.044915 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:19:52.044915 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:19:52.044915 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:19:52.044915 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:19:52.044915 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79ba8622-4141-44af-bd35-40b106e1290c could not be found. Jul 25 15:19:52.044915 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:19:52.044915 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b8b18f65-05e3-43c0-8596-32347c0bbecd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Returning 404 to user: Instance 79ba8622-4141-44af-bd35-40b106e1290c could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:19:52.044915 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b8b18f65-05e3-43c0-8596-32347c0bbecd tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c" status: 404 len: 111 microversion: 2.1 time: 0.043319 Jul 25 15:19:52.044915 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3393/7010] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:51 2022] GET /compute/v2.1/servers/79ba8622-4141-44af-bd35-40b106e1290c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:19:52.061089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4a21e6f0-7d61-407f-b64a-db5e9edbace1 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '.version_select at 0x7f46861ed670>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:52.089154 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4a21e6f0-7d61-407f-b64a-db5e9edbace1 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2049225115" status: 202 len: 0 microversion: 2.1 time: 0.037233 Jul 25 15:19:52.089796 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3618/7011] 10.222.0.88 () {58 vars in 1221 bytes} [Mon Jul 25 15:19:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2049225115 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:19:52.864574 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-53994ca9-581b-48c8-8b8c-65e9ae33275c tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:52.865146 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-53994ca9-581b-48c8-8b8c-65e9ae33275c tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:52.872634 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-53994ca9-581b-48c8-8b8c-65e9ae33275c tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:52.873377 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-53994ca9-581b-48c8-8b8c-65e9ae33275c tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:52.874695 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-53994ca9-581b-48c8-8b8c-65e9ae33275c tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:52.875138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-53994ca9-581b-48c8-8b8c-65e9ae33275c tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:52.890815 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-53994ca9-581b-48c8-8b8c-65e9ae33275c tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] HTTP exception thrown: Instance c0cecc96-b223-4404-90f0-374b6aee9423 could not be found. Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-53994ca9-581b-48c8-8b8c-65e9ae33275c tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Request method failure captured: Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 HTTP/1.1 Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rQx-JhVh-raTaFEVB5EnQDfe8dh_Kup5WwMr8q0g2uSPeqLqCYDItwVqE_Ci-xrhaY4ULSqTvogPC9XqJ-tXDXzX0b9OYirzm0-w_j2x34lgJyHwUx3-axvjejl7tCOWxloIFijxF89RlfZi_-WXZtiQXDl0K12WQCnklvrhtZvSgg Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 1e4896360a0c4e8d98f338cbf797ca76 Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1697592539 Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1e4896360a0c4e8d98f338cbf797ca76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1e4896360a0c4e8d98f338cbf797ca76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1e4896360a0c4e8d98f338cbf797ca76", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1e4896360a0c4e8d98f338cbf797ca76"}]}] Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServerDiskConfigTestJSON-1697592539 Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 1e4896360a0c4e8d98f338cbf797ca76 Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1697592539 Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServerDiskConfigTestJSON-1697592539-project Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: c98a3018dc3c404ca7aad5c311390793 Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServerDiskConfigTestJSON-1697592539-project Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance c0cecc96-b223-4404-90f0-374b6aee9423 could not be found. Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'c0cecc96-b223-4404-90f0-374b6aee9423'} Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0cecc96-b223-4404-90f0-374b6aee9423 could not be found. Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:19:52.892786 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:19:52.899431 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0cecc96-b223-4404-90f0-374b6aee9423 could not be found. Jul 25 15:19:52.899431 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:19:52.899431 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:19:52.899431 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:19:52.899431 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:19:52.899431 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:19:52.899431 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:19:52.899431 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:19:52.899431 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:19:52.899431 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0cecc96-b223-4404-90f0-374b6aee9423 could not be found. Jul 25 15:19:52.899431 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:19:52.899431 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-53994ca9-581b-48c8-8b8c-65e9ae33275c tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Returning 404 to user: Instance c0cecc96-b223-4404-90f0-374b6aee9423 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:19:52.899431 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-53994ca9-581b-48c8-8b8c-65e9ae33275c tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 404 len: 111 microversion: 2.1 time: 0.034681 Jul 25 15:19:52.899431 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3394/7012] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:19:52 2022] DELETE /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:19:52.907018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f5dbc895-6daf-4224-a3c9-d50fa5b39758 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:19:52.908125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f5dbc895-6daf-4224-a3c9-d50fa5b39758 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] [instance: c0cecc96-b223-4404-90f0-374b6aee9423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:19:52.916395 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5dbc895-6daf-4224-a3c9-d50fa5b39758 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:52.917130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5dbc895-6daf-4224-a3c9-d50fa5b39758 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:52.918033 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5dbc895-6daf-4224-a3c9-d50fa5b39758 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:19:52.918577 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5dbc895-6daf-4224-a3c9-d50fa5b39758 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:19:52.933526 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-f5dbc895-6daf-4224-a3c9-d50fa5b39758 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] HTTP exception thrown: Instance c0cecc96-b223-4404-90f0-374b6aee9423 could not be found. Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f5dbc895-6daf-4224-a3c9-d50fa5b39758 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Request method failure captured: Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 HTTP/1.1 Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3rQx-JhVh-raTaFEVB5EnQDfe8dh_Kup5WwMr8q0g2uSPeqLqCYDItwVqE_Ci-xrhaY4ULSqTvogPC9XqJ-tXDXzX0b9OYirzm0-w_j2x34lgJyHwUx3-axvjejl7tCOWxloIFijxF89RlfZi_-WXZtiQXDl0K12WQCnklvrhtZvSgg Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 1e4896360a0c4e8d98f338cbf797ca76 Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1697592539 Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1e4896360a0c4e8d98f338cbf797ca76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/1e4896360a0c4e8d98f338cbf797ca76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_1e4896360a0c4e8d98f338cbf797ca76", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/1e4896360a0c4e8d98f338cbf797ca76"}]}] Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerDiskConfigTestJSON-1697592539 Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 1e4896360a0c4e8d98f338cbf797ca76 Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1697592539 Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerDiskConfigTestJSON-1697592539-project Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: c98a3018dc3c404ca7aad5c311390793 Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerDiskConfigTestJSON-1697592539-project Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance c0cecc96-b223-4404-90f0-374b6aee9423 could not be found. Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'c0cecc96-b223-4404-90f0-374b6aee9423'} Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0cecc96-b223-4404-90f0-374b6aee9423 could not be found. Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0cecc96-b223-4404-90f0-374b6aee9423 could not be found. Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:19:52.935560 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:19:52.940655 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:19:52.940655 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:19:52.940655 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:19:52.940655 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:19:52.940655 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:19:52.940655 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0cecc96-b223-4404-90f0-374b6aee9423 could not be found. Jul 25 15:19:52.940655 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:19:52.940655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f5dbc895-6daf-4224-a3c9-d50fa5b39758 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] Returning 404 to user: Instance c0cecc96-b223-4404-90f0-374b6aee9423 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:19:52.940655 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f5dbc895-6daf-4224-a3c9-d50fa5b39758 tempest-ServerDiskConfigTestJSON-1697592539 tempest-ServerDiskConfigTestJSON-1697592539-project] 10.222.0.88 "GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423" status: 404 len: 111 microversion: 2.1 time: 0.035493 Jul 25 15:19:52.940655 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3619/7013] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:19:52 2022] GET /compute/v2.1/servers/c0cecc96-b223-4404-90f0-374b6aee9423 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:20:03.766733 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=9 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:20:03.772144 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:20:03.947395 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-63811697-810c-462a-b2c2-e42b6844c030 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Action: 'create', calling method: .version_select at 0x7f468685cf70>, body: {"keypair": {"name": "tempest-keypair-720982627", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJdXZVaixJ2Q0JC5HtIdZUsfL53qeF8laAZR1xBPeov0ONbakbL5p8wb6t2m4cyApC9sA6s8WN2Qo/QZ7zjnJJC62XoC6s/3neVRmYJrWnui2zDWQmsnITN6YtHYawoAQ=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:20:03.968030 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-63811697-810c-462a-b2c2-e42b6844c030 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Getting quotas for project 90120379bd914d71996458c1e2a3e25a. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:20:03.975989 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-63811697-810c-462a-b2c2-e42b6844c030 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Getting quotas for user 6a742410e1794902a11125c6369dadcc and project 90120379bd914d71996458c1e2a3e25a. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:20:04.021049 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-63811697-810c-462a-b2c2-e42b6844c030 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.269375 Jul 25 15:20:04.021940 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3395/7014] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 15:20:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:20:05.977810 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d3186ada-efc3-4c59-b455-5713eecdb026 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-704765003", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4e47936-6173-467e-b28c-3bb5bcb99e64"}], "security_groups": [{"name": "tempest-securitygroup--395729731"}], "key_name": "tempest-keypair-720982627", "user_data": "}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:20:05.994070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:20:05.996092 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:20:06.192725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-d3186ada-efc3-4c59-b455-5713eecdb026 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] validate_networks() for [('b4e47936-6173-467e-b28c-3bb5bcb99e64', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:20:06.746511 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-d3186ada-efc3-4c59-b455-5713eecdb026 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:20:06.747347 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-d3186ada-efc3-4c59-b455-5713eecdb026 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:20:06.748251 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-d3186ada-efc3-4c59-b455-5713eecdb026 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:20:06.749300 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-d3186ada-efc3-4c59-b455-5713eecdb026 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:20:06.750036 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-d3186ada-efc3-4c59-b455-5713eecdb026 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:20:06.765789 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d3186ada-efc3-4c59-b455-5713eecdb026 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:06.766598 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d3186ada-efc3-4c59-b455-5713eecdb026 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:06.768084 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d3186ada-efc3-4c59-b455-5713eecdb026 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:06.768900 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d3186ada-efc3-4c59-b455-5713eecdb026 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:06.800019 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-d3186ada-efc3-4c59-b455-5713eecdb026 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Getting quotas for project 90120379bd914d71996458c1e2a3e25a. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:20:06.809113 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-d3186ada-efc3-4c59-b455-5713eecdb026 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Getting quotas for user 6a742410e1794902a11125c6369dadcc and project 90120379bd914d71996458c1e2a3e25a. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:20:06.825671 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d3186ada-efc3-4c59-b455-5713eecdb026 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:20:06.828158 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d3186ada-efc3-4c59-b455-5713eecdb026 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:20:06.878302 n-d-846435-14 devstack@n-api.service[119304]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d3186ada-efc3-4c59-b455-5713eecdb026 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [5d85163f-80e6-4395-b352-227aabfe882f] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 15:20:07.888091 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [None req-d3186ada-efc3-4c59-b455-5713eecdb026 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [5d85163f-80e6-4395-b352-227aabfe882f] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 49696. Jul 25 15:20:07.893577 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d3186ada-efc3-4c59-b455-5713eecdb026 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.920520 Jul 25 15:20:07.894235 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3620/7015] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:20:05 2022] POST /compute/v2.1/servers => generated 408 bytes in 1922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:20:07.915536 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b6f463a6-bd74-45fa-b862-81587372755e tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:20:07.917287 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b6f463a6-bd74-45fa-b862-81587372755e tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:20:07.984681 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b6f463a6-bd74-45fa-b862-81587372755e tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:20:07.997302 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b6f463a6-bd74-45fa-b862-81587372755e tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1237 microversion: 2.1 time: 0.090596 Jul 25 15:20:07.998332 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3396/7016] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:20:07 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1237 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:20:09.021699 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e3332c77-380a-455a-a299-605db51212bf tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:20:09.022273 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e3332c77-380a-455a-a299-605db51212bf tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:20:09.030863 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3332c77-380a-455a-a299-605db51212bf tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:09.031296 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3332c77-380a-455a-a299-605db51212bf tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:09.032123 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3332c77-380a-455a-a299-605db51212bf tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:09.032569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3332c77-380a-455a-a299-605db51212bf tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:09.124486 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e3332c77-380a-455a-a299-605db51212bf tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:20:09.132927 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e3332c77-380a-455a-a299-605db51212bf tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1289 microversion: 2.1 time: 0.116225 Jul 25 15:20:09.133503 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3621/7017] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:20:09 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1289 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:20:10.159500 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e31d1956-1077-49ef-824d-8b210fded9b5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:20:10.161736 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e31d1956-1077-49ef-824d-8b210fded9b5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:20:10.176024 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e31d1956-1077-49ef-824d-8b210fded9b5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:10.177053 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e31d1956-1077-49ef-824d-8b210fded9b5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:10.178572 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e31d1956-1077-49ef-824d-8b210fded9b5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:10.179552 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e31d1956-1077-49ef-824d-8b210fded9b5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:10.486634 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e31d1956-1077-49ef-824d-8b210fded9b5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:20:10.498135 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e31d1956-1077-49ef-824d-8b210fded9b5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1362 microversion: 2.1 time: 0.345383 Jul 25 15:20:10.499470 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3397/7018] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:20:10 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1362 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:20:11.041066 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-119b0d06-256c-4704-b7aa-994f90506af4 req-b533a661-ebd4-403c-98c3-c1cca5fe0a2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bc09e50-a11b-4c53-8d48-099363bc606d", "tag": "e5fb582a-9856-4684-8180-a93764ec2f73"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:20:11.065474 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-119b0d06-256c-4704-b7aa-994f90506af4 req-b533a661-ebd4-403c-98c3-c1cca5fe0a2f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:11.066240 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-119b0d06-256c-4704-b7aa-994f90506af4 req-b533a661-ebd4-403c-98c3-c1cca5fe0a2f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:11.085014 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-119b0d06-256c-4704-b7aa-994f90506af4 req-b533a661-ebd4-403c-98c3-c1cca5fe0a2f service nova] Creating event network-changed:e5fb582a-9856-4684-8180-a93764ec2f73 for instance 0bc09e50-a11b-4c53-8d48-099363bc606d on n-h1-846435-14 Jul 25 15:20:11.092209 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-119b0d06-256c-4704-b7aa-994f90506af4 req-b533a661-ebd4-403c-98c3-c1cca5fe0a2f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066839 Jul 25 15:20:11.093159 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3622/7019] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:20:11.526976 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6a2eaace-cb25-416c-8e4d-9038cd490a16 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:20:11.528029 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6a2eaace-cb25-416c-8e4d-9038cd490a16 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:20:11.536335 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6a2eaace-cb25-416c-8e4d-9038cd490a16 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:11.536819 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6a2eaace-cb25-416c-8e4d-9038cd490a16 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:11.537597 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6a2eaace-cb25-416c-8e4d-9038cd490a16 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:11.538041 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6a2eaace-cb25-416c-8e4d-9038cd490a16 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:11.684199 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6a2eaace-cb25-416c-8e4d-9038cd490a16 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:20:11.693218 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6a2eaace-cb25-416c-8e4d-9038cd490a16 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1362 microversion: 2.1 time: 0.170333 Jul 25 15:20:11.694052 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3398/7020] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:20:11 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:20:12.722010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-63e05c8a-eb3b-416e-a476-7f99f355d512 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:20:12.723342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-63e05c8a-eb3b-416e-a476-7f99f355d512 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:20:12.735540 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63e05c8a-eb3b-416e-a476-7f99f355d512 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:12.736397 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63e05c8a-eb3b-416e-a476-7f99f355d512 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:12.737801 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63e05c8a-eb3b-416e-a476-7f99f355d512 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:12.738598 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63e05c8a-eb3b-416e-a476-7f99f355d512 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:12.938752 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-63e05c8a-eb3b-416e-a476-7f99f355d512 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:20:12.947308 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-63e05c8a-eb3b-416e-a476-7f99f355d512 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1362 microversion: 2.1 time: 0.235175 Jul 25 15:20:12.948544 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3623/7021] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:20:12 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:20:13.969546 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d8fd4b55-ed39-441a-88a8-afa6aa2c8b08 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:20:13.970221 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d8fd4b55-ed39-441a-88a8-afa6aa2c8b08 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:20:13.978159 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8fd4b55-ed39-441a-88a8-afa6aa2c8b08 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:13.978513 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8fd4b55-ed39-441a-88a8-afa6aa2c8b08 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:13.979425 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8fd4b55-ed39-441a-88a8-afa6aa2c8b08 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:13.979866 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8fd4b55-ed39-441a-88a8-afa6aa2c8b08 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:14.135598 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d8fd4b55-ed39-441a-88a8-afa6aa2c8b08 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:20:14.144440 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d8fd4b55-ed39-441a-88a8-afa6aa2c8b08 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1362 microversion: 2.1 time: 0.178842 Jul 25 15:20:14.145063 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3399/7022] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:20:13 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:20:15.175275 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a74f97f7-e5b4-47f1-a492-94f6b1fc3b5f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:20:15.176374 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a74f97f7-e5b4-47f1-a492-94f6b1fc3b5f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:20:15.184621 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a74f97f7-e5b4-47f1-a492-94f6b1fc3b5f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:15.185137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a74f97f7-e5b4-47f1-a492-94f6b1fc3b5f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:15.186040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a74f97f7-e5b4-47f1-a492-94f6b1fc3b5f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:15.186572 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a74f97f7-e5b4-47f1-a492-94f6b1fc3b5f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:15.350779 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a74f97f7-e5b4-47f1-a492-94f6b1fc3b5f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:20:15.359599 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a74f97f7-e5b4-47f1-a492-94f6b1fc3b5f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1362 microversion: 2.1 time: 0.188271 Jul 25 15:20:15.360372 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3624/7023] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:20:15 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:20:16.382270 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1a9a9587-8094-4d5a-ac8f-02aaa900c915 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:20:16.383138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1a9a9587-8094-4d5a-ac8f-02aaa900c915 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:20:16.393426 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1a9a9587-8094-4d5a-ac8f-02aaa900c915 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:16.394932 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1a9a9587-8094-4d5a-ac8f-02aaa900c915 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:16.395439 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1a9a9587-8094-4d5a-ac8f-02aaa900c915 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:16.396278 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1a9a9587-8094-4d5a-ac8f-02aaa900c915 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:16.567673 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-87a33127-83fa-44bb-a1b4-215940c60843 req-98a029ef-d23b-4797-a66d-fe53722e8606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bc09e50-a11b-4c53-8d48-099363bc606d", "name": "network-vif-plugged", "status": "completed", "tag": "e5fb582a-9856-4684-8180-a93764ec2f73"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:20:16.584221 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-87a33127-83fa-44bb-a1b4-215940c60843 req-98a029ef-d23b-4797-a66d-fe53722e8606 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:16.584996 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-87a33127-83fa-44bb-a1b4-215940c60843 req-98a029ef-d23b-4797-a66d-fe53722e8606 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:16.602291 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-87a33127-83fa-44bb-a1b4-215940c60843 req-98a029ef-d23b-4797-a66d-fe53722e8606 service nova] Creating event network-vif-plugged:e5fb582a-9856-4684-8180-a93764ec2f73 for instance 0bc09e50-a11b-4c53-8d48-099363bc606d on n-h1-846435-14 Jul 25 15:20:16.610245 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-87a33127-83fa-44bb-a1b4-215940c60843 req-98a029ef-d23b-4797-a66d-fe53722e8606 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046700 Jul 25 15:20:16.611366 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3625/7024] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:20:16.612236 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1a9a9587-8094-4d5a-ac8f-02aaa900c915 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:20:16.623307 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1a9a9587-8094-4d5a-ac8f-02aaa900c915 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1362 microversion: 2.1 time: 0.245318 Jul 25 15:20:16.625620 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3400/7025] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:20:16 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:20:17.643708 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:20:17.644527 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:20:17.651491 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-025b9b59-e7ca-46dd-83df-bb848844286b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:20:17.652876 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-025b9b59-e7ca-46dd-83df-bb848844286b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:20:17.662862 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-025b9b59-e7ca-46dd-83df-bb848844286b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:17.663352 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-025b9b59-e7ca-46dd-83df-bb848844286b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:17.664210 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-025b9b59-e7ca-46dd-83df-bb848844286b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:17.664631 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-025b9b59-e7ca-46dd-83df-bb848844286b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:17.821578 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-025b9b59-e7ca-46dd-83df-bb848844286b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:20:17.830988 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-025b9b59-e7ca-46dd-83df-bb848844286b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1362 microversion: 2.1 time: 0.188234 Jul 25 15:20:17.831590 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3626/7026] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:20:17 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:20:18.852729 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6e16af45-b016-4b5b-a727-559118c41578 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:20:18.853330 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6e16af45-b016-4b5b-a727-559118c41578 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:20:18.856198 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:20:18.862428 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e16af45-b016-4b5b-a727-559118c41578 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:18.862883 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e16af45-b016-4b5b-a727-559118c41578 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:18.863676 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e16af45-b016-4b5b-a727-559118c41578 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:18.864160 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e16af45-b016-4b5b-a727-559118c41578 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:19.035055 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6e16af45-b016-4b5b-a727-559118c41578 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:20:19.049014 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6e16af45-b016-4b5b-a727-559118c41578 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1549 microversion: 2.1 time: 0.199882 Jul 25 15:20:19.050045 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3401/7027] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:20:18 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1549 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:20:19.089709 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a60dd402-dc75-4be8-9e5d-277680e563ff tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:20:19.090936 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a60dd402-dc75-4be8-9e5d-277680e563ff tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:20:19.104354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a60dd402-dc75-4be8-9e5d-277680e563ff tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:19.105183 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a60dd402-dc75-4be8-9e5d-277680e563ff tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:19.107406 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a60dd402-dc75-4be8-9e5d-277680e563ff tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:19.107890 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a60dd402-dc75-4be8-9e5d-277680e563ff tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:19.210150 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a60dd402-dc75-4be8-9e5d-277680e563ff tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.127684 Jul 25 15:20:19.211218 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3627/7028] 10.222.0.88 () {58 vars in 1275 bytes} [Mon Jul 25 15:20:19 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d/os-interface => generated 285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:20:20.472018 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-46b6af7b-ea00-4b36-b085-c526fb669457 req-88d5480b-e95d-45d6-8af3-dd805ed2faa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bc09e50-a11b-4c53-8d48-099363bc606d", "tag": "e5fb582a-9856-4684-8180-a93764ec2f73"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:20:20.485925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-46b6af7b-ea00-4b36-b085-c526fb669457 req-88d5480b-e95d-45d6-8af3-dd805ed2faa1 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:20.486391 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-46b6af7b-ea00-4b36-b085-c526fb669457 req-88d5480b-e95d-45d6-8af3-dd805ed2faa1 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:20.499699 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-46b6af7b-ea00-4b36-b085-c526fb669457 req-88d5480b-e95d-45d6-8af3-dd805ed2faa1 service nova] Creating event network-changed:e5fb582a-9856-4684-8180-a93764ec2f73 for instance 0bc09e50-a11b-4c53-8d48-099363bc606d on n-h1-846435-14 Jul 25 15:20:20.505532 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-46b6af7b-ea00-4b36-b085-c526fb669457 req-88d5480b-e95d-45d6-8af3-dd805ed2faa1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037615 Jul 25 15:20:20.506164 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3402/7029] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:20:56.514739 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:20:56.515588 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=34 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:20:56.520471 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6dadbcb6-98aa-4e49-9109-bfc999093fed tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:20:56.521112 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6dadbcb6-98aa-4e49-9109-bfc999093fed tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:20:56.528967 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6dadbcb6-98aa-4e49-9109-bfc999093fed tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:56.529430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6dadbcb6-98aa-4e49-9109-bfc999093fed tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:56.530217 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6dadbcb6-98aa-4e49-9109-bfc999093fed tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:56.530666 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6dadbcb6-98aa-4e49-9109-bfc999093fed tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:56.681667 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6dadbcb6-98aa-4e49-9109-bfc999093fed tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:20:56.690411 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6dadbcb6-98aa-4e49-9109-bfc999093fed tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1668 microversion: 2.1 time: 0.177659 Jul 25 15:20:56.691029 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3628/7030] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:20:56 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1668 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:20:56.714246 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:20:56.715066 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=32 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:20:56.720048 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f8dc9c2f-98f7-4bd5-bdd0-aca6765786fa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:20:56.720795 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f8dc9c2f-98f7-4bd5-bdd0-aca6765786fa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:20:56.729931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8dc9c2f-98f7-4bd5-bdd0-aca6765786fa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:56.730407 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8dc9c2f-98f7-4bd5-bdd0-aca6765786fa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:56.731182 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8dc9c2f-98f7-4bd5-bdd0-aca6765786fa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:56.731625 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8dc9c2f-98f7-4bd5-bdd0-aca6765786fa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:56.872331 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f8dc9c2f-98f7-4bd5-bdd0-aca6765786fa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:20:56.880918 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f8dc9c2f-98f7-4bd5-bdd0-aca6765786fa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1668 microversion: 2.1 time: 0.168895 Jul 25 15:20:56.881519 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3403/7031] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:20:56 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1668 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:20:56.902617 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1bf05f70-9ad7-4fb8-b07a-0933fbbf0897 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:20:56.903247 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1bf05f70-9ad7-4fb8-b07a-0933fbbf0897 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:20:56.909697 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1bf05f70-9ad7-4fb8-b07a-0933fbbf0897 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:56.910166 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1bf05f70-9ad7-4fb8-b07a-0933fbbf0897 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:56.911169 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1bf05f70-9ad7-4fb8-b07a-0933fbbf0897 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:56.911622 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1bf05f70-9ad7-4fb8-b07a-0933fbbf0897 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:57.071683 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1bf05f70-9ad7-4fb8-b07a-0933fbbf0897 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:20:57.080461 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1bf05f70-9ad7-4fb8-b07a-0933fbbf0897 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1668 microversion: 2.1 time: 0.181763 Jul 25 15:20:57.081053 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3629/7032] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:20:56 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1668 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:20:57.101319 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-16d6f20e-abd4-4d63-b525-d9748f1c5cff tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:20:57.103670 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-16d6f20e-abd4-4d63-b525-d9748f1c5cff tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:20:57.110403 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-16d6f20e-abd4-4d63-b525-d9748f1c5cff tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:57.110853 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-16d6f20e-abd4-4d63-b525-d9748f1c5cff tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:57.111645 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-16d6f20e-abd4-4d63-b525-d9748f1c5cff tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:57.112109 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-16d6f20e-abd4-4d63-b525-d9748f1c5cff tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:57.143621 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-16d6f20e-abd4-4d63-b525-d9748f1c5cff tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:20:57.150735 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-16d6f20e-abd4-4d63-b525-d9748f1c5cff tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Old instance type m1.heat2, new instance type m1.heat {{(pid=119303) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 15:20:57.158026 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-16d6f20e-abd4-4d63-b525-d9748f1c5cff tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:20:57.158448 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-16d6f20e-abd4-4d63-b525-d9748f1c5cff tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:20:57.158911 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-16d6f20e-abd4-4d63-b525-d9748f1c5cff tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:20:57.159310 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-16d6f20e-abd4-4d63-b525-d9748f1c5cff tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:20:57.159717 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-16d6f20e-abd4-4d63-b525-d9748f1c5cff tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:20:57.231536 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-16d6f20e-abd4-4d63-b525-d9748f1c5cff tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "POST /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d/action" status: 202 len: 0 microversion: 2.1 time: 0.134255 Jul 25 15:20:57.232408 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3404/7033] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:20:57 2022] POST /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:20:57.243633 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e678e7d9-c06a-4112-b85e-dd6a9f935caa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:20:57.244527 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e678e7d9-c06a-4112-b85e-dd6a9f935caa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:20:57.254308 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e678e7d9-c06a-4112-b85e-dd6a9f935caa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:57.254807 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e678e7d9-c06a-4112-b85e-dd6a9f935caa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:57.256351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e678e7d9-c06a-4112-b85e-dd6a9f935caa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:57.257232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e678e7d9-c06a-4112-b85e-dd6a9f935caa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:57.462315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e678e7d9-c06a-4112-b85e-dd6a9f935caa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:20:57.476177 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e678e7d9-c06a-4112-b85e-dd6a9f935caa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1677 microversion: 2.1 time: 0.232322 Jul 25 15:20:57.476177 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3630/7034] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:20:57 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1677 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:20:58.500719 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a3fa722d-c027-4a0b-afcf-b256aa5fbd72 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:20:58.502455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a3fa722d-c027-4a0b-afcf-b256aa5fbd72 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:20:58.510742 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a3fa722d-c027-4a0b-afcf-b256aa5fbd72 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:58.511197 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a3fa722d-c027-4a0b-afcf-b256aa5fbd72 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:58.512005 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a3fa722d-c027-4a0b-afcf-b256aa5fbd72 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:58.512734 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a3fa722d-c027-4a0b-afcf-b256aa5fbd72 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:58.658642 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a3fa722d-c027-4a0b-afcf-b256aa5fbd72 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:20:58.673130 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a3fa722d-c027-4a0b-afcf-b256aa5fbd72 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1677 microversion: 2.1 time: 0.181719 Jul 25 15:20:58.674083 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3405/7035] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:20:58 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1677 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:20:59.695591 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-72cb77cf-4c28-4cff-a8ff-c11a5542beca tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:20:59.696235 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-72cb77cf-4c28-4cff-a8ff-c11a5542beca tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:20:59.704173 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72cb77cf-4c28-4cff-a8ff-c11a5542beca tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:59.704642 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72cb77cf-4c28-4cff-a8ff-c11a5542beca tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:59.705447 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72cb77cf-4c28-4cff-a8ff-c11a5542beca tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:20:59.705898 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72cb77cf-4c28-4cff-a8ff-c11a5542beca tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:20:59.906922 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-72cb77cf-4c28-4cff-a8ff-c11a5542beca tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:20:59.915103 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-72cb77cf-4c28-4cff-a8ff-c11a5542beca tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1682 microversion: 2.1 time: 0.223452 Jul 25 15:20:59.915720 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3631/7036] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:20:59 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1682 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:00.936806 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4934043a-ad13-4f7c-b512-6df64355c19d tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:00.937453 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4934043a-ad13-4f7c-b512-6df64355c19d tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:00.944836 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4934043a-ad13-4f7c-b512-6df64355c19d tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:00.945952 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4934043a-ad13-4f7c-b512-6df64355c19d tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:00.946082 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4934043a-ad13-4f7c-b512-6df64355c19d tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:00.946518 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4934043a-ad13-4f7c-b512-6df64355c19d tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:01.171522 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4934043a-ad13-4f7c-b512-6df64355c19d tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:01.180572 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4934043a-ad13-4f7c-b512-6df64355c19d tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1682 microversion: 2.1 time: 0.247743 Jul 25 15:21:01.181184 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3406/7037] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:00 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1682 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:02.202942 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-18b305ed-3cc6-48ed-917b-12ecaa0a20b7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:02.203554 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-18b305ed-3cc6-48ed-917b-12ecaa0a20b7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:02.211273 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-18b305ed-3cc6-48ed-917b-12ecaa0a20b7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:02.211729 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-18b305ed-3cc6-48ed-917b-12ecaa0a20b7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:02.212592 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-18b305ed-3cc6-48ed-917b-12ecaa0a20b7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:02.212992 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-18b305ed-3cc6-48ed-917b-12ecaa0a20b7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:02.360147 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-18b305ed-3cc6-48ed-917b-12ecaa0a20b7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:02.368246 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-18b305ed-3cc6-48ed-917b-12ecaa0a20b7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1682 microversion: 2.1 time: 0.169450 Jul 25 15:21:02.368847 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3632/7038] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:02 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:03.390516 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5fb0359f-bdf6-4bd9-9f0c-a2681d40b388 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:03.391197 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5fb0359f-bdf6-4bd9-9f0c-a2681d40b388 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:03.398656 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5fb0359f-bdf6-4bd9-9f0c-a2681d40b388 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:03.399130 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5fb0359f-bdf6-4bd9-9f0c-a2681d40b388 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:03.399914 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5fb0359f-bdf6-4bd9-9f0c-a2681d40b388 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:03.400383 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5fb0359f-bdf6-4bd9-9f0c-a2681d40b388 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:03.552434 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5fb0359f-bdf6-4bd9-9f0c-a2681d40b388 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:03.561779 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5fb0359f-bdf6-4bd9-9f0c-a2681d40b388 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1682 microversion: 2.1 time: 0.175177 Jul 25 15:21:03.562377 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3407/7039] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:03 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:04.583218 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-95ed4133-54cd-4fe8-b409-1d23829e6cee tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:04.583842 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-95ed4133-54cd-4fe8-b409-1d23829e6cee tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:04.592916 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-95ed4133-54cd-4fe8-b409-1d23829e6cee tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:04.593379 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-95ed4133-54cd-4fe8-b409-1d23829e6cee tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:04.594161 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-95ed4133-54cd-4fe8-b409-1d23829e6cee tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:04.594604 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-95ed4133-54cd-4fe8-b409-1d23829e6cee tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:04.733375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-95ed4133-54cd-4fe8-b409-1d23829e6cee tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:04.741308 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-95ed4133-54cd-4fe8-b409-1d23829e6cee tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1682 microversion: 2.1 time: 0.162093 Jul 25 15:21:04.741882 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3633/7040] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:04 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:05.763384 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9787fab5-4fdd-4593-a560-72a6278fdf75 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:05.763947 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9787fab5-4fdd-4593-a560-72a6278fdf75 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:05.771464 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9787fab5-4fdd-4593-a560-72a6278fdf75 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:05.771924 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9787fab5-4fdd-4593-a560-72a6278fdf75 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:05.772737 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9787fab5-4fdd-4593-a560-72a6278fdf75 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:05.773171 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9787fab5-4fdd-4593-a560-72a6278fdf75 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:05.909807 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9787fab5-4fdd-4593-a560-72a6278fdf75 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:05.918729 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9787fab5-4fdd-4593-a560-72a6278fdf75 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1682 microversion: 2.1 time: 0.159644 Jul 25 15:21:05.919375 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3408/7041] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:05 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:06.942665 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d7f7423e-d0b1-4204-abac-bbb324849225 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:06.943725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d7f7423e-d0b1-4204-abac-bbb324849225 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:06.952403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d7f7423e-d0b1-4204-abac-bbb324849225 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:06.952975 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d7f7423e-d0b1-4204-abac-bbb324849225 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:06.953933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d7f7423e-d0b1-4204-abac-bbb324849225 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:06.954712 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d7f7423e-d0b1-4204-abac-bbb324849225 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:07.097647 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d7f7423e-d0b1-4204-abac-bbb324849225 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:07.107180 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d7f7423e-d0b1-4204-abac-bbb324849225 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1682 microversion: 2.1 time: 0.169394 Jul 25 15:21:07.107775 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3634/7042] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:06 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:08.129281 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c4f8caa6-f614-489a-abe0-5ef8ad331a54 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:08.129858 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c4f8caa6-f614-489a-abe0-5ef8ad331a54 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:08.137769 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c4f8caa6-f614-489a-abe0-5ef8ad331a54 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:08.138224 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c4f8caa6-f614-489a-abe0-5ef8ad331a54 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:08.139030 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c4f8caa6-f614-489a-abe0-5ef8ad331a54 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:08.139469 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c4f8caa6-f614-489a-abe0-5ef8ad331a54 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:08.277047 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c4f8caa6-f614-489a-abe0-5ef8ad331a54 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:08.285283 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c4f8caa6-f614-489a-abe0-5ef8ad331a54 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1682 microversion: 2.1 time: 0.160012 Jul 25 15:21:08.286184 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3409/7043] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:08 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:09.307258 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7dc41cdc-1254-4083-bf3c-b004fb88fba6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:09.307855 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7dc41cdc-1254-4083-bf3c-b004fb88fba6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:09.316522 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7dc41cdc-1254-4083-bf3c-b004fb88fba6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:09.316989 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7dc41cdc-1254-4083-bf3c-b004fb88fba6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:09.317791 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7dc41cdc-1254-4083-bf3c-b004fb88fba6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:09.318250 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7dc41cdc-1254-4083-bf3c-b004fb88fba6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:09.456583 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7dc41cdc-1254-4083-bf3c-b004fb88fba6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:09.464658 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7dc41cdc-1254-4083-bf3c-b004fb88fba6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1682 microversion: 2.1 time: 0.161483 Jul 25 15:21:09.465272 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3635/7044] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:09 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:10.487338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3f65a0ed-20de-4fa4-b428-625f6a64b620 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:10.488019 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3f65a0ed-20de-4fa4-b428-625f6a64b620 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:10.496123 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3f65a0ed-20de-4fa4-b428-625f6a64b620 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:10.496644 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3f65a0ed-20de-4fa4-b428-625f6a64b620 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:10.497449 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3f65a0ed-20de-4fa4-b428-625f6a64b620 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:10.497895 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3f65a0ed-20de-4fa4-b428-625f6a64b620 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:10.648537 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3f65a0ed-20de-4fa4-b428-625f6a64b620 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:10.656732 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3f65a0ed-20de-4fa4-b428-625f6a64b620 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1682 microversion: 2.1 time: 0.173549 Jul 25 15:21:10.657318 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3410/7045] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:10 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:11.677897 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d7aaa0b8-6b7a-4b57-b94a-0c5b7326174d tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:11.678495 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d7aaa0b8-6b7a-4b57-b94a-0c5b7326174d tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:11.686302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d7aaa0b8-6b7a-4b57-b94a-0c5b7326174d tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:11.686782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d7aaa0b8-6b7a-4b57-b94a-0c5b7326174d tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:11.687556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d7aaa0b8-6b7a-4b57-b94a-0c5b7326174d tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:11.688021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d7aaa0b8-6b7a-4b57-b94a-0c5b7326174d tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:11.827223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d7aaa0b8-6b7a-4b57-b94a-0c5b7326174d tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:11.835390 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d7aaa0b8-6b7a-4b57-b94a-0c5b7326174d tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1682 microversion: 2.1 time: 0.161484 Jul 25 15:21:11.836008 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3636/7046] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:11 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:12.858432 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-73f04381-0793-414d-923e-0c47c64601a2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:12.859452 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-73f04381-0793-414d-923e-0c47c64601a2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:12.870293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-73f04381-0793-414d-923e-0c47c64601a2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:12.870755 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-73f04381-0793-414d-923e-0c47c64601a2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:12.871536 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-73f04381-0793-414d-923e-0c47c64601a2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:12.872004 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-73f04381-0793-414d-923e-0c47c64601a2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:13.013416 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-73f04381-0793-414d-923e-0c47c64601a2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:13.025705 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-73f04381-0793-414d-923e-0c47c64601a2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1682 microversion: 2.1 time: 0.172488 Jul 25 15:21:13.026350 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3411/7047] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:12 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:14.047155 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-83983049-677f-45cb-a061-a4c1f7da46e6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:14.047746 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-83983049-677f-45cb-a061-a4c1f7da46e6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:14.055383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83983049-677f-45cb-a061-a4c1f7da46e6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:14.055847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83983049-677f-45cb-a061-a4c1f7da46e6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:14.056695 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83983049-677f-45cb-a061-a4c1f7da46e6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:14.057150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83983049-677f-45cb-a061-a4c1f7da46e6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:14.196553 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-83983049-677f-45cb-a061-a4c1f7da46e6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:14.204736 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-83983049-677f-45cb-a061-a4c1f7da46e6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1682 microversion: 2.1 time: 0.161562 Jul 25 15:21:14.205321 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3637/7048] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:14 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:15.227127 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dc173a6b-39b3-49bb-b09c-7239fe23a0a9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:15.227715 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-dc173a6b-39b3-49bb-b09c-7239fe23a0a9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:15.235488 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dc173a6b-39b3-49bb-b09c-7239fe23a0a9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:15.236013 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dc173a6b-39b3-49bb-b09c-7239fe23a0a9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:15.236839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dc173a6b-39b3-49bb-b09c-7239fe23a0a9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:15.237277 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dc173a6b-39b3-49bb-b09c-7239fe23a0a9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:15.375884 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-dc173a6b-39b3-49bb-b09c-7239fe23a0a9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:15.383796 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dc173a6b-39b3-49bb-b09c-7239fe23a0a9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1682 microversion: 2.1 time: 0.160862 Jul 25 15:21:15.384415 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3412/7049] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:15 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:16.405565 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-727cd08b-ca49-4dec-8e9b-55af2cf4c37a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:16.406188 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-727cd08b-ca49-4dec-8e9b-55af2cf4c37a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:16.413715 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-727cd08b-ca49-4dec-8e9b-55af2cf4c37a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:16.414176 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-727cd08b-ca49-4dec-8e9b-55af2cf4c37a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:16.414992 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-727cd08b-ca49-4dec-8e9b-55af2cf4c37a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:16.415438 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-727cd08b-ca49-4dec-8e9b-55af2cf4c37a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:16.559605 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-727cd08b-ca49-4dec-8e9b-55af2cf4c37a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:16.568808 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-727cd08b-ca49-4dec-8e9b-55af2cf4c37a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1682 microversion: 2.1 time: 0.167254 Jul 25 15:21:16.569433 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3638/7050] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:16 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:17.052557 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-118a6bde-1cb1-42ac-a792-58f8a56b9983 req-9d1eb992-2695-48cf-bd24-be3b670c11f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bc09e50-a11b-4c53-8d48-099363bc606d", "name": "network-vif-unplugged", "status": "completed", "tag": "e5fb582a-9856-4684-8180-a93764ec2f73"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:21:17.066320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-118a6bde-1cb1-42ac-a792-58f8a56b9983 req-9d1eb992-2695-48cf-bd24-be3b670c11f4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:17.066767 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-118a6bde-1cb1-42ac-a792-58f8a56b9983 req-9d1eb992-2695-48cf-bd24-be3b670c11f4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:17.081012 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-118a6bde-1cb1-42ac-a792-58f8a56b9983 req-9d1eb992-2695-48cf-bd24-be3b670c11f4 service nova] Creating event network-vif-unplugged:e5fb582a-9856-4684-8180-a93764ec2f73 for instance 0bc09e50-a11b-4c53-8d48-099363bc606d on n-h2-846435-14 Jul 25 15:21:17.087464 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [req-118a6bde-1cb1-42ac-a792-58f8a56b9983 req-9d1eb992-2695-48cf-bd24-be3b670c11f4 service nova] Instance 0bc09e50-a11b-4c53-8d48-099363bc606d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119303) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 15:21:17.099458 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-118a6bde-1cb1-42ac-a792-58f8a56b9983 req-9d1eb992-2695-48cf-bd24-be3b670c11f4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117736 Jul 25 15:21:17.100715 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3413/7051] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:21:17.591089 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b8e0169d-a101-49de-8964-8068c7353450 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:17.591718 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b8e0169d-a101-49de-8964-8068c7353450 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:17.599529 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8e0169d-a101-49de-8964-8068c7353450 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:17.600013 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8e0169d-a101-49de-8964-8068c7353450 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:17.600797 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8e0169d-a101-49de-8964-8068c7353450 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:17.601239 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8e0169d-a101-49de-8964-8068c7353450 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:17.819429 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b8e0169d-a101-49de-8964-8068c7353450 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:17.829146 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b8e0169d-a101-49de-8964-8068c7353450 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1681 microversion: 2.1 time: 0.242585 Jul 25 15:21:17.830101 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3639/7052] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:17 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1681 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:18.854248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-14161a00-4cc2-426c-8767-3dd84c558998 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:18.855265 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-14161a00-4cc2-426c-8767-3dd84c558998 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:18.865357 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14161a00-4cc2-426c-8767-3dd84c558998 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:18.866010 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14161a00-4cc2-426c-8767-3dd84c558998 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:18.867245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14161a00-4cc2-426c-8767-3dd84c558998 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:18.867850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-14161a00-4cc2-426c-8767-3dd84c558998 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:19.007944 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-14161a00-4cc2-426c-8767-3dd84c558998 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:19.016200 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-14161a00-4cc2-426c-8767-3dd84c558998 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1679 microversion: 2.1 time: 0.168454 Jul 25 15:21:19.016844 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3414/7053] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:18 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:19.117436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-579efcf6-8a17-4e4c-84b5-7b7eb6fbeee9 req-72bc8657-1211-4d21-a733-bdf184a86925 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bc09e50-a11b-4c53-8d48-099363bc606d", "tag": "e5fb582a-9856-4684-8180-a93764ec2f73"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:21:19.128871 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-579efcf6-8a17-4e4c-84b5-7b7eb6fbeee9 req-72bc8657-1211-4d21-a733-bdf184a86925 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:19.129329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-579efcf6-8a17-4e4c-84b5-7b7eb6fbeee9 req-72bc8657-1211-4d21-a733-bdf184a86925 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:19.142575 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-579efcf6-8a17-4e4c-84b5-7b7eb6fbeee9 req-72bc8657-1211-4d21-a733-bdf184a86925 service nova] Creating event network-changed:e5fb582a-9856-4684-8180-a93764ec2f73 for instance 0bc09e50-a11b-4c53-8d48-099363bc606d on n-h2-846435-14 Jul 25 15:21:19.148388 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [req-579efcf6-8a17-4e4c-84b5-7b7eb6fbeee9 req-72bc8657-1211-4d21-a733-bdf184a86925 service nova] Instance 0bc09e50-a11b-4c53-8d48-099363bc606d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119304) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 15:21:19.159576 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-579efcf6-8a17-4e4c-84b5-7b7eb6fbeee9 req-72bc8657-1211-4d21-a733-bdf184a86925 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045901 Jul 25 15:21:19.160299 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3640/7054] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:21:20.038797 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-225b86f6-f76c-4c0b-af1e-98c9de812723 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:20.039428 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-225b86f6-f76c-4c0b-af1e-98c9de812723 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:20.047528 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-225b86f6-f76c-4c0b-af1e-98c9de812723 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:20.047968 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-225b86f6-f76c-4c0b-af1e-98c9de812723 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:20.048793 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-225b86f6-f76c-4c0b-af1e-98c9de812723 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:20.049233 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-225b86f6-f76c-4c0b-af1e-98c9de812723 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:20.187279 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-225b86f6-f76c-4c0b-af1e-98c9de812723 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:20.196096 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-225b86f6-f76c-4c0b-af1e-98c9de812723 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1679 microversion: 2.1 time: 0.161377 Jul 25 15:21:20.196705 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3415/7055] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:20 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:21.219228 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2066f4fa-cc4d-47f6-9e80-d4da1003cbe2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:21.220034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2066f4fa-cc4d-47f6-9e80-d4da1003cbe2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:21.228799 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2066f4fa-cc4d-47f6-9e80-d4da1003cbe2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:21.229256 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2066f4fa-cc4d-47f6-9e80-d4da1003cbe2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:21.230109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2066f4fa-cc4d-47f6-9e80-d4da1003cbe2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:21.230469 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2066f4fa-cc4d-47f6-9e80-d4da1003cbe2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:21.460993 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2066f4fa-cc4d-47f6-9e80-d4da1003cbe2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:21.469787 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2066f4fa-cc4d-47f6-9e80-d4da1003cbe2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1679 microversion: 2.1 time: 0.254565 Jul 25 15:21:21.470307 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3641/7056] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:21 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1679 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:22.491263 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bb28c104-00bc-4973-88bc-a39cd964c908 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:22.491854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bb28c104-00bc-4973-88bc-a39cd964c908 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:22.499818 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bb28c104-00bc-4973-88bc-a39cd964c908 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:22.500340 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bb28c104-00bc-4973-88bc-a39cd964c908 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:22.501128 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bb28c104-00bc-4973-88bc-a39cd964c908 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:22.501570 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bb28c104-00bc-4973-88bc-a39cd964c908 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:22.642622 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bb28c104-00bc-4973-88bc-a39cd964c908 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:22.650561 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bb28c104-00bc-4973-88bc-a39cd964c908 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1676 microversion: 2.1 time: 0.163325 Jul 25 15:21:22.651207 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3416/7057] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:22 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:22.671524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cb0ed7d8-762c-4ae4-b69b-9a97ff875ba0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:21:22.672132 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cb0ed7d8-762c-4ae4-b69b-9a97ff875ba0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:22.679478 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb0ed7d8-762c-4ae4-b69b-9a97ff875ba0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:22.679935 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb0ed7d8-762c-4ae4-b69b-9a97ff875ba0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:22.680758 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb0ed7d8-762c-4ae4-b69b-9a97ff875ba0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:22.681341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb0ed7d8-762c-4ae4-b69b-9a97ff875ba0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:22.749073 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cb0ed7d8-762c-4ae4-b69b-9a97ff875ba0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "POST /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d/action" status: 204 len: 0 microversion: 2.1 time: 0.080889 Jul 25 15:21:22.749624 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3642/7058] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:21:22 2022] POST /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d/action => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:21:22.759162 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d7eec175-4df3-4c07-bea9-35ccf62c07fb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:22.760377 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d7eec175-4df3-4c07-bea9-35ccf62c07fb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:22.766645 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d7eec175-4df3-4c07-bea9-35ccf62c07fb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:22.767132 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d7eec175-4df3-4c07-bea9-35ccf62c07fb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:22.768107 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d7eec175-4df3-4c07-bea9-35ccf62c07fb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:22.768611 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d7eec175-4df3-4c07-bea9-35ccf62c07fb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:22.981279 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d7eec175-4df3-4c07-bea9-35ccf62c07fb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:22.989349 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d7eec175-4df3-4c07-bea9-35ccf62c07fb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1676 microversion: 2.1 time: 0.234320 Jul 25 15:21:22.989954 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3417/7059] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:22 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1676 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:24.014357 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a3516712-0d62-4ada-a0aa-4d7e49ee77c4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:24.015094 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a3516712-0d62-4ada-a0aa-4d7e49ee77c4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:24.022136 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3516712-0d62-4ada-a0aa-4d7e49ee77c4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:24.022525 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3516712-0d62-4ada-a0aa-4d7e49ee77c4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:24.023383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3516712-0d62-4ada-a0aa-4d7e49ee77c4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:24.023829 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3516712-0d62-4ada-a0aa-4d7e49ee77c4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:24.173531 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a3516712-0d62-4ada-a0aa-4d7e49ee77c4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:24.176140 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:21:24.183530 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a3516712-0d62-4ada-a0aa-4d7e49ee77c4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1668 microversion: 2.1 time: 0.174658 Jul 25 15:21:24.185142 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3643/7060] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:24 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1668 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:24.206291 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c6ec32b1-a409-434b-a02c-21f6bf473dd7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:24.207323 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c6ec32b1-a409-434b-a02c-21f6bf473dd7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:24.220049 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c6ec32b1-a409-434b-a02c-21f6bf473dd7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:24.220933 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c6ec32b1-a409-434b-a02c-21f6bf473dd7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:24.222354 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c6ec32b1-a409-434b-a02c-21f6bf473dd7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:24.223197 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c6ec32b1-a409-434b-a02c-21f6bf473dd7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:24.250546 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:21:24.379399 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c6ec32b1-a409-434b-a02c-21f6bf473dd7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:24.388094 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c6ec32b1-a409-434b-a02c-21f6bf473dd7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1668 microversion: 2.1 time: 0.186335 Jul 25 15:21:24.388692 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3418/7061] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:24 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1668 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:24.409656 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-af62448c-4fd4-43af-907a-463a9bc4679d tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:24.410276 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-af62448c-4fd4-43af-907a-463a9bc4679d tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:24.418056 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af62448c-4fd4-43af-907a-463a9bc4679d tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:24.418512 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af62448c-4fd4-43af-907a-463a9bc4679d tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:24.419292 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af62448c-4fd4-43af-907a-463a9bc4679d tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:24.419721 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af62448c-4fd4-43af-907a-463a9bc4679d tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:24.570278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-af62448c-4fd4-43af-907a-463a9bc4679d tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:24.578751 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-af62448c-4fd4-43af-907a-463a9bc4679d tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1668 microversion: 2.1 time: 0.173861 Jul 25 15:21:24.579361 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3644/7062] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:24 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1668 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:24.599301 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7bcf536a-5c07-4a78-a6ea-9f84eeae2855 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:24.599803 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7bcf536a-5c07-4a78-a6ea-9f84eeae2855 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:24.607679 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7bcf536a-5c07-4a78-a6ea-9f84eeae2855 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:24.608169 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7bcf536a-5c07-4a78-a6ea-9f84eeae2855 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:24.608979 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7bcf536a-5c07-4a78-a6ea-9f84eeae2855 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:24.609413 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7bcf536a-5c07-4a78-a6ea-9f84eeae2855 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:24.636749 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7bcf536a-5c07-4a78-a6ea-9f84eeae2855 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:21:24.720058 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7bcf536a-5c07-4a78-a6ea-9f84eeae2855 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "DELETE /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 204 len: 0 microversion: 2.1 time: 0.124559 Jul 25 15:21:24.720680 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3419/7063] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:21:24 2022] DELETE /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:21:24.730818 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fa85dcc3-7693-4b68-90a5-f951b4de4649 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:24.731035 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fa85dcc3-7693-4b68-90a5-f951b4de4649 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:24.737333 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fa85dcc3-7693-4b68-90a5-f951b4de4649 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:24.737795 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fa85dcc3-7693-4b68-90a5-f951b4de4649 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:24.738576 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fa85dcc3-7693-4b68-90a5-f951b4de4649 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:24.739025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fa85dcc3-7693-4b68-90a5-f951b4de4649 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:24.891465 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fa85dcc3-7693-4b68-90a5-f951b4de4649 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:24.902382 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fa85dcc3-7693-4b68-90a5-f951b4de4649 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1674 microversion: 2.1 time: 0.176930 Jul 25 15:21:24.902973 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3645/7064] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:24 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1674 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:25.402399 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-bcc0ede5-7b2c-4b54-8af0-667f207a9a42 req-f792f7bf-489e-4d29-bd93-8a5c8baa30ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bc09e50-a11b-4c53-8d48-099363bc606d", "name": "network-vif-plugged", "status": "completed", "tag": "e5fb582a-9856-4684-8180-a93764ec2f73"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:21:25.414018 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-bcc0ede5-7b2c-4b54-8af0-667f207a9a42 req-f792f7bf-489e-4d29-bd93-8a5c8baa30ba service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:25.414539 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-bcc0ede5-7b2c-4b54-8af0-667f207a9a42 req-f792f7bf-489e-4d29-bd93-8a5c8baa30ba service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:25.427713 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-bcc0ede5-7b2c-4b54-8af0-667f207a9a42 req-f792f7bf-489e-4d29-bd93-8a5c8baa30ba service nova] Creating event network-vif-plugged:e5fb582a-9856-4684-8180-a93764ec2f73 for instance 0bc09e50-a11b-4c53-8d48-099363bc606d on n-h2-846435-14 Jul 25 15:21:25.432967 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-bcc0ede5-7b2c-4b54-8af0-667f207a9a42 req-f792f7bf-489e-4d29-bd93-8a5c8baa30ba service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034890 Jul 25 15:21:25.433598 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3420/7065] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:21:25.925888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f8c5e086-5b3a-42c9-b604-f37cf9dea6f9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:25.926539 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f8c5e086-5b3a-42c9-b604-f37cf9dea6f9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:25.934856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8c5e086-5b3a-42c9-b604-f37cf9dea6f9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:25.935325 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8c5e086-5b3a-42c9-b604-f37cf9dea6f9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:25.936138 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8c5e086-5b3a-42c9-b604-f37cf9dea6f9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:25.936579 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f8c5e086-5b3a-42c9-b604-f37cf9dea6f9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:26.070725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f8c5e086-5b3a-42c9-b604-f37cf9dea6f9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:26.079067 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f8c5e086-5b3a-42c9-b604-f37cf9dea6f9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1674 microversion: 2.1 time: 0.157308 Jul 25 15:21:26.079693 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3646/7066] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:25 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:27.107499 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-4421d27d-9778-4b80-8967-b26fe2f9f4cf req-e875bec6-733c-44ba-ac84-412a5288bbc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bc09e50-a11b-4c53-8d48-099363bc606d", "name": "network-vif-deleted", "tag": "e5fb582a-9856-4684-8180-a93764ec2f73"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:21:27.110629 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-63091735-eaeb-4f19-a97b-14afbaef9c7f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:27.111363 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-63091735-eaeb-4f19-a97b-14afbaef9c7f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:27.113590 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:21:27.119339 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=39 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:21:27.129302 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-63091735-eaeb-4f19-a97b-14afbaef9c7f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:27.129759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-63091735-eaeb-4f19-a97b-14afbaef9c7f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:27.130550 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-63091735-eaeb-4f19-a97b-14afbaef9c7f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:27.130995 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-63091735-eaeb-4f19-a97b-14afbaef9c7f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:27.139161 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-4421d27d-9778-4b80-8967-b26fe2f9f4cf req-e875bec6-733c-44ba-ac84-412a5288bbc4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:27.139615 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-4421d27d-9778-4b80-8967-b26fe2f9f4cf req-e875bec6-733c-44ba-ac84-412a5288bbc4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:27.154841 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-4421d27d-9778-4b80-8967-b26fe2f9f4cf req-e875bec6-733c-44ba-ac84-412a5288bbc4 service nova] Creating event network-vif-deleted:e5fb582a-9856-4684-8180-a93764ec2f73 for instance 0bc09e50-a11b-4c53-8d48-099363bc606d on n-h2-846435-14 Jul 25 15:21:27.161990 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-4421d27d-9778-4b80-8967-b26fe2f9f4cf req-e875bec6-733c-44ba-ac84-412a5288bbc4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057984 Jul 25 15:21:27.168935 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3647/7067] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:21:27.214883 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-63091735-eaeb-4f19-a97b-14afbaef9c7f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:27.223623 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-63091735-eaeb-4f19-a97b-14afbaef9c7f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 200 len: 1322 microversion: 2.1 time: 0.125665 Jul 25 15:21:27.224275 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3421/7068] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:27 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 1322 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:28.246870 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9809caff-bf1c-4b62-8caf-6446ad579a90 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:28.247589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9809caff-bf1c-4b62-8caf-6446ad579a90 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:28.256408 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9809caff-bf1c-4b62-8caf-6446ad579a90 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:28.256879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9809caff-bf1c-4b62-8caf-6446ad579a90 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:28.257669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9809caff-bf1c-4b62-8caf-6446ad579a90 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:28.258119 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9809caff-bf1c-4b62-8caf-6446ad579a90 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:28.272512 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-9809caff-bf1c-4b62-8caf-6446ad579a90 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] HTTP exception thrown: Instance 0bc09e50-a11b-4c53-8d48-099363bc606d could not be found. Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9809caff-bf1c-4b62-8caf-6446ad579a90 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Request method failure captured: Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d HTTP/1.1 Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3rSjEyisMD8DvTH7b56ad3M9V4r9Z2oHgANxXbb97f0WFMCsa1v0ECdPWSwcD3bin0DxN2VyKMiUlFTU-JUG9Ua6IQiCvvNBHc0-kGj7SnhEHtthZB_ln1XXzCzW_WOLiNqJwI6WQfWOze_2VM1L7b9fm_wuF4gcUsql3_EhcnWK2us Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 90120379bd914d71996458c1e2a3e25a Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerActionsTestJSON-741053275 Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90120379bd914d71996458c1e2a3e25a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90120379bd914d71996458c1e2a3e25a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_90120379bd914d71996458c1e2a3e25a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/90120379bd914d71996458c1e2a3e25a"}]}] Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerActionsTestJSON-741053275 Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 90120379bd914d71996458c1e2a3e25a Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerActionsTestJSON-741053275 Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerActionsTestJSON-741053275-project Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 6a742410e1794902a11125c6369dadcc Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerActionsTestJSON-741053275-project Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 0bc09e50-a11b-4c53-8d48-099363bc606d could not be found. Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '0bc09e50-a11b-4c53-8d48-099363bc606d'} Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bc09e50-a11b-4c53-8d48-099363bc606d could not be found. Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bc09e50-a11b-4c53-8d48-099363bc606d could not be found. Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:21:28.274199 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:21:28.278214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:21:28.278214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:21:28.278214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:21:28.278214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:21:28.278214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:21:28.278214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bc09e50-a11b-4c53-8d48-099363bc606d could not be found. Jul 25 15:21:28.278214 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:21:28.278214 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9809caff-bf1c-4b62-8caf-6446ad579a90 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Returning 404 to user: Instance 0bc09e50-a11b-4c53-8d48-099363bc606d could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:21:28.278214 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9809caff-bf1c-4b62-8caf-6446ad579a90 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 404 len: 111 microversion: 2.1 time: 0.035007 Jul 25 15:21:28.278214 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3648/7069] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:28 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:21:28.289172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ab140526-6a98-485f-b3b1-905426c26a9c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:28.289784 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ab140526-6a98-485f-b3b1-905426c26a9c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:28.297444 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab140526-6a98-485f-b3b1-905426c26a9c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:28.297980 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab140526-6a98-485f-b3b1-905426c26a9c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:28.298695 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab140526-6a98-485f-b3b1-905426c26a9c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:28.299133 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab140526-6a98-485f-b3b1-905426c26a9c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:28.314019 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-ab140526-6a98-485f-b3b1-905426c26a9c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] HTTP exception thrown: Instance 0bc09e50-a11b-4c53-8d48-099363bc606d could not be found. Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ab140526-6a98-485f-b3b1-905426c26a9c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Request method failure captured: Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d HTTP/1.1 Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rSjEyisMD8DvTH7b56ad3M9V4r9Z2oHgANxXbb97f0WFMCsa1v0ECdPWSwcD3bin0DxN2VyKMiUlFTU-JUG9Ua6IQiCvvNBHc0-kGj7SnhEHtthZB_ln1XXzCzW_WOLiNqJwI6WQfWOze_2VM1L7b9fm_wuF4gcUsql3_EhcnWK2us Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 90120379bd914d71996458c1e2a3e25a Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServerActionsTestJSON-741053275 Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90120379bd914d71996458c1e2a3e25a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90120379bd914d71996458c1e2a3e25a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_90120379bd914d71996458c1e2a3e25a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/90120379bd914d71996458c1e2a3e25a"}]}] Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServerActionsTestJSON-741053275 Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 90120379bd914d71996458c1e2a3e25a Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServerActionsTestJSON-741053275 Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServerActionsTestJSON-741053275-project Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 6a742410e1794902a11125c6369dadcc Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServerActionsTestJSON-741053275-project Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 0bc09e50-a11b-4c53-8d48-099363bc606d could not be found. Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '0bc09e50-a11b-4c53-8d48-099363bc606d'} Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bc09e50-a11b-4c53-8d48-099363bc606d could not be found. Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bc09e50-a11b-4c53-8d48-099363bc606d could not be found. Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:21:28.315702 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:21:28.319485 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:21:28.319485 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:21:28.319485 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:21:28.319485 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:21:28.319485 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:21:28.319485 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bc09e50-a11b-4c53-8d48-099363bc606d could not be found. Jul 25 15:21:28.319485 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:21:28.319485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ab140526-6a98-485f-b3b1-905426c26a9c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Returning 404 to user: Instance 0bc09e50-a11b-4c53-8d48-099363bc606d could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:21:28.319485 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ab140526-6a98-485f-b3b1-905426c26a9c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 404 len: 111 microversion: 2.1 time: 0.032188 Jul 25 15:21:28.319485 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3422/7070] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:28 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:21:28.373470 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-72a62c85-4622-480b-9752-d7414d2118b6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-491765781", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "b4e47936-6173-467e-b28c-3bb5bcb99e64"}], "security_groups": [{"name": "tempest-securitygroup--395729731"}], "key_name": "tempest-keypair-720982627", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:21:28.492225 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-72a62c85-4622-480b-9752-d7414d2118b6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] validate_networks() for [('b4e47936-6173-467e-b28c-3bb5bcb99e64', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:21:28.878472 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-72a62c85-4622-480b-9752-d7414d2118b6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:21:28.878873 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-72a62c85-4622-480b-9752-d7414d2118b6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:21:28.879374 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-72a62c85-4622-480b-9752-d7414d2118b6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:21:28.879763 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-72a62c85-4622-480b-9752-d7414d2118b6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:21:28.880216 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-72a62c85-4622-480b-9752-d7414d2118b6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:21:28.890642 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72a62c85-4622-480b-9752-d7414d2118b6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:28.891078 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72a62c85-4622-480b-9752-d7414d2118b6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:28.891874 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72a62c85-4622-480b-9752-d7414d2118b6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:28.892353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72a62c85-4622-480b-9752-d7414d2118b6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:28.909826 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-72a62c85-4622-480b-9752-d7414d2118b6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Getting quotas for project 90120379bd914d71996458c1e2a3e25a. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:21:28.915906 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-72a62c85-4622-480b-9752-d7414d2118b6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Getting quotas for user 6a742410e1794902a11125c6369dadcc and project 90120379bd914d71996458c1e2a3e25a. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:21:28.929182 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-72a62c85-4622-480b-9752-d7414d2118b6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:21:28.931498 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-72a62c85-4622-480b-9752-d7414d2118b6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:21:28.978783 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-72a62c85-4622-480b-9752-d7414d2118b6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.609764 Jul 25 15:21:28.979613 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3649/7071] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:21:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:21:28.991941 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4162e782-6b26-45af-8903-a0570d1a2305 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:28.992602 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4162e782-6b26-45af-8903-a0570d1a2305 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:29.047655 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4162e782-6b26-45af-8903-a0570d1a2305 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:29.055350 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4162e782-6b26-45af-8903-a0570d1a2305 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1237 microversion: 2.1 time: 0.067595 Jul 25 15:21:29.055936 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3423/7072] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:28 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:30.077618 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-83ff0473-1831-42d5-8e59-5b8161097bd0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:30.078267 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-83ff0473-1831-42d5-8e59-5b8161097bd0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:30.086587 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83ff0473-1831-42d5-8e59-5b8161097bd0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:30.087052 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83ff0473-1831-42d5-8e59-5b8161097bd0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:30.087921 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83ff0473-1831-42d5-8e59-5b8161097bd0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:30.088407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83ff0473-1831-42d5-8e59-5b8161097bd0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:30.171847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-83ff0473-1831-42d5-8e59-5b8161097bd0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:30.180101 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-83ff0473-1831-42d5-8e59-5b8161097bd0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1295 microversion: 2.1 time: 0.107415 Jul 25 15:21:30.180946 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3650/7073] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:30 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1295 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:31.202792 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4877e97d-a621-4bcb-8870-af1ae2c04f36 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:31.204113 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4877e97d-a621-4bcb-8870-af1ae2c04f36 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:31.212448 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4877e97d-a621-4bcb-8870-af1ae2c04f36 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:31.213208 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4877e97d-a621-4bcb-8870-af1ae2c04f36 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:31.214969 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4877e97d-a621-4bcb-8870-af1ae2c04f36 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:31.215414 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4877e97d-a621-4bcb-8870-af1ae2c04f36 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:31.417997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4877e97d-a621-4bcb-8870-af1ae2c04f36 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:31.420976 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-0afe9d28-375b-4645-8c62-7eb4d843ea5c req-cc9c483e-6bd5-4e56-b2ad-1ace806268b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f277bed-5ae8-4688-a2ca-9be78f6cc3c8", "tag": "d42fbd73-d33a-4a72-8331-26a27efb3f6c"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:21:31.426813 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4877e97d-a621-4bcb-8870-af1ae2c04f36 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1362 microversion: 2.1 time: 0.227850 Jul 25 15:21:31.428927 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3424/7074] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:31 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:21:31.453315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-0afe9d28-375b-4645-8c62-7eb4d843ea5c req-cc9c483e-6bd5-4e56-b2ad-1ace806268b8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:31.462809 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-0afe9d28-375b-4645-8c62-7eb4d843ea5c req-cc9c483e-6bd5-4e56-b2ad-1ace806268b8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:31.477272 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-0afe9d28-375b-4645-8c62-7eb4d843ea5c req-cc9c483e-6bd5-4e56-b2ad-1ace806268b8 service nova] Creating event network-changed:d42fbd73-d33a-4a72-8331-26a27efb3f6c for instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 on n-h2-846435-14 Jul 25 15:21:31.483091 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-0afe9d28-375b-4645-8c62-7eb4d843ea5c req-cc9c483e-6bd5-4e56-b2ad-1ace806268b8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070811 Jul 25 15:21:31.483902 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3651/7075] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:21:32.452457 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ec5e8a53-8626-4dba-adab-caa2c69a1a57 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:32.453054 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ec5e8a53-8626-4dba-adab-caa2c69a1a57 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:32.460912 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec5e8a53-8626-4dba-adab-caa2c69a1a57 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:32.461454 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec5e8a53-8626-4dba-adab-caa2c69a1a57 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:32.462482 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec5e8a53-8626-4dba-adab-caa2c69a1a57 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:32.463002 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec5e8a53-8626-4dba-adab-caa2c69a1a57 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:32.604977 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ec5e8a53-8626-4dba-adab-caa2c69a1a57 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:32.613527 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ec5e8a53-8626-4dba-adab-caa2c69a1a57 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1362 microversion: 2.1 time: 0.164960 Jul 25 15:21:32.614094 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3425/7076] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:32 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:33.636519 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-42226cdd-721d-4ee3-bf94-55b065862362 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:33.637252 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-42226cdd-721d-4ee3-bf94-55b065862362 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:33.645499 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-42226cdd-721d-4ee3-bf94-55b065862362 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:33.645960 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-42226cdd-721d-4ee3-bf94-55b065862362 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:33.646787 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-42226cdd-721d-4ee3-bf94-55b065862362 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:33.647230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-42226cdd-721d-4ee3-bf94-55b065862362 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:33.795399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-42226cdd-721d-4ee3-bf94-55b065862362 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:33.804579 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-42226cdd-721d-4ee3-bf94-55b065862362 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1362 microversion: 2.1 time: 0.172910 Jul 25 15:21:33.805190 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3652/7077] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:33 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:34.826582 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-66484e46-9315-4b49-9c78-4e4f5806ceb1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:34.827222 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-66484e46-9315-4b49-9c78-4e4f5806ceb1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:34.835126 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-66484e46-9315-4b49-9c78-4e4f5806ceb1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:34.835583 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-66484e46-9315-4b49-9c78-4e4f5806ceb1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:34.836388 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-66484e46-9315-4b49-9c78-4e4f5806ceb1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:34.836828 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-66484e46-9315-4b49-9c78-4e4f5806ceb1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:34.973629 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-66484e46-9315-4b49-9c78-4e4f5806ceb1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:34.982025 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-66484e46-9315-4b49-9c78-4e4f5806ceb1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1362 microversion: 2.1 time: 0.159516 Jul 25 15:21:34.982612 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3426/7078] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:34 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:36.004058 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-feb04b19-3f4e-49d9-a736-c4ce5a757fb4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:36.004689 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-feb04b19-3f4e-49d9-a736-c4ce5a757fb4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:36.012183 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-feb04b19-3f4e-49d9-a736-c4ce5a757fb4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:36.012646 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-feb04b19-3f4e-49d9-a736-c4ce5a757fb4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:36.013430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-feb04b19-3f4e-49d9-a736-c4ce5a757fb4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:36.013868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-feb04b19-3f4e-49d9-a736-c4ce5a757fb4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:36.166774 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-feb04b19-3f4e-49d9-a736-c4ce5a757fb4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:36.175278 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-feb04b19-3f4e-49d9-a736-c4ce5a757fb4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1362 microversion: 2.1 time: 0.175155 Jul 25 15:21:36.175868 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3653/7079] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:35 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:37.197756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-89a54b8f-64e3-4e27-a465-05a5f3a8f024 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:37.198394 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-89a54b8f-64e3-4e27-a465-05a5f3a8f024 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:37.206316 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89a54b8f-64e3-4e27-a465-05a5f3a8f024 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:37.206776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89a54b8f-64e3-4e27-a465-05a5f3a8f024 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:37.207556 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89a54b8f-64e3-4e27-a465-05a5f3a8f024 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:37.208011 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-89a54b8f-64e3-4e27-a465-05a5f3a8f024 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:37.347613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-89a54b8f-64e3-4e27-a465-05a5f3a8f024 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:37.356508 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-89a54b8f-64e3-4e27-a465-05a5f3a8f024 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1362 microversion: 2.1 time: 0.162372 Jul 25 15:21:37.356721 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3427/7080] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:37 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:37.442482 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-c3f6b966-c6b5-4cd7-80b7-42088f04f18c req-0b86b00d-ea70-43b3-882f-0604d1c88636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f277bed-5ae8-4688-a2ca-9be78f6cc3c8", "name": "network-vif-plugged", "status": "completed", "tag": "d42fbd73-d33a-4a72-8331-26a27efb3f6c"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:21:37.456311 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c3f6b966-c6b5-4cd7-80b7-42088f04f18c req-0b86b00d-ea70-43b3-882f-0604d1c88636 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:37.456933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c3f6b966-c6b5-4cd7-80b7-42088f04f18c req-0b86b00d-ea70-43b3-882f-0604d1c88636 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:37.474933 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-c3f6b966-c6b5-4cd7-80b7-42088f04f18c req-0b86b00d-ea70-43b3-882f-0604d1c88636 service nova] Creating event network-vif-plugged:d42fbd73-d33a-4a72-8331-26a27efb3f6c for instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 on n-h2-846435-14 Jul 25 15:21:37.480748 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-c3f6b966-c6b5-4cd7-80b7-42088f04f18c req-0b86b00d-ea70-43b3-882f-0604d1c88636 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042292 Jul 25 15:21:37.481394 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3654/7081] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:21:38.377764 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-630c71f8-1569-45c8-9314-ed4a2906bdfa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:38.378373 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-630c71f8-1569-45c8-9314-ed4a2906bdfa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:38.385916 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-630c71f8-1569-45c8-9314-ed4a2906bdfa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:38.386378 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-630c71f8-1569-45c8-9314-ed4a2906bdfa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:38.387163 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-630c71f8-1569-45c8-9314-ed4a2906bdfa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:38.387600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-630c71f8-1569-45c8-9314-ed4a2906bdfa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:38.527012 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-630c71f8-1569-45c8-9314-ed4a2906bdfa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:38.535622 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-630c71f8-1569-45c8-9314-ed4a2906bdfa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1362 microversion: 2.1 time: 0.161789 Jul 25 15:21:38.536388 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3428/7082] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:38 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:39.556389 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:21:39.557212 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:21:39.561675 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ad9b3101-5d88-4554-b10d-efa3e9e1ee73 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:39.562413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ad9b3101-5d88-4554-b10d-efa3e9e1ee73 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:39.569859 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad9b3101-5d88-4554-b10d-efa3e9e1ee73 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:39.570319 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad9b3101-5d88-4554-b10d-efa3e9e1ee73 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:39.571103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad9b3101-5d88-4554-b10d-efa3e9e1ee73 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:39.571671 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad9b3101-5d88-4554-b10d-efa3e9e1ee73 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:39.707964 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ad9b3101-5d88-4554-b10d-efa3e9e1ee73 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:21:39.716091 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ad9b3101-5d88-4554-b10d-efa3e9e1ee73 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1548 microversion: 2.1 time: 0.161628 Jul 25 15:21:39.716698 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3655/7083] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:21:39 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:21:39.737285 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f2c0521a-1aa8-43f7-839e-f67ac5ecf60a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:21:39.737856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f2c0521a-1aa8-43f7-839e-f67ac5ecf60a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:21:39.739785 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:21:39.746700 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f2c0521a-1aa8-43f7-839e-f67ac5ecf60a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:39.747160 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f2c0521a-1aa8-43f7-839e-f67ac5ecf60a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:39.748347 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f2c0521a-1aa8-43f7-839e-f67ac5ecf60a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:39.748771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f2c0521a-1aa8-43f7-839e-f67ac5ecf60a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:39.830120 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f2c0521a-1aa8-43f7-839e-f67ac5ecf60a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096982 Jul 25 15:21:39.830734 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3429/7084] 10.222.0.88 () {58 vars in 1275 bytes} [Mon Jul 25 15:21:39 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:21:41.207154 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-8e013ea5-9506-467f-9bf3-e3b6d6fe6e2b req-2ebda83a-7856-49c0-ab70-0fe64425fd1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f277bed-5ae8-4688-a2ca-9be78f6cc3c8", "tag": "d42fbd73-d33a-4a72-8331-26a27efb3f6c"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:21:41.218140 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-8e013ea5-9506-467f-9bf3-e3b6d6fe6e2b req-2ebda83a-7856-49c0-ab70-0fe64425fd1b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:21:41.218636 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-8e013ea5-9506-467f-9bf3-e3b6d6fe6e2b req-2ebda83a-7856-49c0-ab70-0fe64425fd1b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:21:41.231177 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-8e013ea5-9506-467f-9bf3-e3b6d6fe6e2b req-2ebda83a-7856-49c0-ab70-0fe64425fd1b service nova] Creating event network-changed:d42fbd73-d33a-4a72-8331-26a27efb3f6c for instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 on n-h2-846435-14 Jul 25 15:21:41.236492 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-8e013ea5-9506-467f-9bf3-e3b6d6fe6e2b req-2ebda83a-7856-49c0-ab70-0fe64425fd1b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033068 Jul 25 15:21:41.237188 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3656/7085] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:22:13.024423 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 15:22:13.025191 n-d-846435-14 devstack@n-api.service[119304]: Mon Jul 25 15:22:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 15:22:53.217274 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=19 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:22:53.218191 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:22:53.222993 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-73018986-ca64-4dc6-8eb9-6e1c446ceb05 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:22:53.231242 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-73018986-ca64-4dc6-8eb9-6e1c446ceb05 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:22:53.231742 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-73018986-ca64-4dc6-8eb9-6e1c446ceb05 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:22:53.258663 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-73018986-ca64-4dc6-8eb9-6e1c446ceb05 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Going to try to stop instance {{(pid=119303) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 15:22:53.303391 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-73018986-ca64-4dc6-8eb9-6e1c446ceb05 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "POST /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8/action" status: 202 len: 0 microversion: 2.1 time: 0.088474 Jul 25 15:22:53.304069 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3430/7086] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:22:53 2022] POST /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:22:53.312841 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:22:53.313797 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=55 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:22:53.319605 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-22089b2f-c685-41a1-95b3-10a962c7dda4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:22:53.320354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-22089b2f-c685-41a1-95b3-10a962c7dda4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:22:53.334812 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-22089b2f-c685-41a1-95b3-10a962c7dda4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:22:53.335356 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-22089b2f-c685-41a1-95b3-10a962c7dda4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:22:53.336261 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-22089b2f-c685-41a1-95b3-10a962c7dda4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:22:53.336788 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-22089b2f-c685-41a1-95b3-10a962c7dda4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:22:53.487238 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-22089b2f-c685-41a1-95b3-10a962c7dda4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:22:53.496310 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-22089b2f-c685-41a1-95b3-10a962c7dda4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1677 microversion: 2.1 time: 0.186762 Jul 25 15:22:53.497308 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3657/7087] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:22:53 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1677 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:22:54.521586 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ff4f0b6d-b04c-4c86-8b64-4347f84b2c41 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:22:54.522699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ff4f0b6d-b04c-4c86-8b64-4347f84b2c41 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:22:54.535036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ff4f0b6d-b04c-4c86-8b64-4347f84b2c41 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:22:54.535496 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ff4f0b6d-b04c-4c86-8b64-4347f84b2c41 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:22:54.536330 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ff4f0b6d-b04c-4c86-8b64-4347f84b2c41 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:22:54.536776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ff4f0b6d-b04c-4c86-8b64-4347f84b2c41 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:22:54.705043 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ff4f0b6d-b04c-4c86-8b64-4347f84b2c41 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:22:54.714513 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ff4f0b6d-b04c-4c86-8b64-4347f84b2c41 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1677 microversion: 2.1 time: 0.199585 Jul 25 15:22:54.715403 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3431/7088] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:22:54 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1677 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:22:55.739014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f45cd4bc-8c88-404f-b100-906b1fde27e3 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:22:55.739586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f45cd4bc-8c88-404f-b100-906b1fde27e3 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:22:55.748563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f45cd4bc-8c88-404f-b100-906b1fde27e3 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:22:55.749342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f45cd4bc-8c88-404f-b100-906b1fde27e3 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:22:55.750243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f45cd4bc-8c88-404f-b100-906b1fde27e3 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:22:55.750920 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f45cd4bc-8c88-404f-b100-906b1fde27e3 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:22:55.912607 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f45cd4bc-8c88-404f-b100-906b1fde27e3 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:22:55.921288 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f45cd4bc-8c88-404f-b100-906b1fde27e3 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1677 microversion: 2.1 time: 0.186323 Jul 25 15:22:55.922119 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3658/7089] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:22:55 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1677 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:22:56.945945 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5c80fe77-757e-4150-bdd7-a2917ed365ea tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:22:56.946653 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5c80fe77-757e-4150-bdd7-a2917ed365ea tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:22:56.954443 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5c80fe77-757e-4150-bdd7-a2917ed365ea tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:22:56.954904 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5c80fe77-757e-4150-bdd7-a2917ed365ea tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:22:56.955714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5c80fe77-757e-4150-bdd7-a2917ed365ea tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:22:56.956182 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5c80fe77-757e-4150-bdd7-a2917ed365ea tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:22:57.096029 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5c80fe77-757e-4150-bdd7-a2917ed365ea tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:22:57.104590 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5c80fe77-757e-4150-bdd7-a2917ed365ea tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1677 microversion: 2.1 time: 0.162606 Jul 25 15:22:57.105228 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3432/7090] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:22:56 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:22:58.128790 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d754816d-7b40-4748-8c4c-e400e6672b08 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:22:58.129447 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d754816d-7b40-4748-8c4c-e400e6672b08 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:22:58.138034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d754816d-7b40-4748-8c4c-e400e6672b08 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:22:58.138855 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d754816d-7b40-4748-8c4c-e400e6672b08 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:22:58.140259 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d754816d-7b40-4748-8c4c-e400e6672b08 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:22:58.140997 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d754816d-7b40-4748-8c4c-e400e6672b08 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:22:58.306489 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d754816d-7b40-4748-8c4c-e400e6672b08 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:22:58.316619 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d754816d-7b40-4748-8c4c-e400e6672b08 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1677 microversion: 2.1 time: 0.193304 Jul 25 15:22:58.317223 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3659/7091] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:22:58 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1677 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:22:59.338816 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4d063abd-9fa1-4c00-8d14-5a28084c5eb8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:22:59.339452 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4d063abd-9fa1-4c00-8d14-5a28084c5eb8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:22:59.347702 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4d063abd-9fa1-4c00-8d14-5a28084c5eb8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:22:59.348253 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4d063abd-9fa1-4c00-8d14-5a28084c5eb8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:22:59.349153 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4d063abd-9fa1-4c00-8d14-5a28084c5eb8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:22:59.349672 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4d063abd-9fa1-4c00-8d14-5a28084c5eb8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:22:59.514783 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4d063abd-9fa1-4c00-8d14-5a28084c5eb8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:22:59.525996 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4d063abd-9fa1-4c00-8d14-5a28084c5eb8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1677 microversion: 2.1 time: 0.190966 Jul 25 15:22:59.526659 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3433/7092] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:22:59 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1677 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:23:00.558215 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-04afe738-cf94-4979-bd50-01b6248a26f9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:00.558969 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-04afe738-cf94-4979-bd50-01b6248a26f9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:00.567585 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-04afe738-cf94-4979-bd50-01b6248a26f9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:00.568069 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-04afe738-cf94-4979-bd50-01b6248a26f9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:00.568860 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-04afe738-cf94-4979-bd50-01b6248a26f9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:00.569300 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-04afe738-cf94-4979-bd50-01b6248a26f9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:00.733680 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-04afe738-cf94-4979-bd50-01b6248a26f9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:23:00.741986 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-04afe738-cf94-4979-bd50-01b6248a26f9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1677 microversion: 2.1 time: 0.187783 Jul 25 15:23:00.742640 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3660/7093] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:23:00 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1677 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:23:01.765386 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6dfc38a2-cba7-4cdc-925a-d171c5c23fba tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:01.765942 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6dfc38a2-cba7-4cdc-925a-d171c5c23fba tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:01.773540 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6dfc38a2-cba7-4cdc-925a-d171c5c23fba tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:01.773995 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6dfc38a2-cba7-4cdc-925a-d171c5c23fba tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:01.774815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6dfc38a2-cba7-4cdc-925a-d171c5c23fba tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:01.775307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6dfc38a2-cba7-4cdc-925a-d171c5c23fba tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:01.938187 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6dfc38a2-cba7-4cdc-925a-d171c5c23fba tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:23:01.951165 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6dfc38a2-cba7-4cdc-925a-d171c5c23fba tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1677 microversion: 2.1 time: 0.189926 Jul 25 15:23:01.951763 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3434/7094] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:23:01 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1677 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:23:02.975091 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dd2fbe2d-ccea-404a-b7e8-ea526af99e98 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:02.975778 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dd2fbe2d-ccea-404a-b7e8-ea526af99e98 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:02.983815 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd2fbe2d-ccea-404a-b7e8-ea526af99e98 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:02.984359 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd2fbe2d-ccea-404a-b7e8-ea526af99e98 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:02.985141 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd2fbe2d-ccea-404a-b7e8-ea526af99e98 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:02.985634 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd2fbe2d-ccea-404a-b7e8-ea526af99e98 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:03.138662 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dd2fbe2d-ccea-404a-b7e8-ea526af99e98 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:23:03.147075 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dd2fbe2d-ccea-404a-b7e8-ea526af99e98 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1677 microversion: 2.1 time: 0.176068 Jul 25 15:23:03.147675 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3661/7095] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:23:02 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:23:04.170130 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e97e18be-8d78-466f-8fc6-996f0c56d66e tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:04.170735 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e97e18be-8d78-466f-8fc6-996f0c56d66e tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:04.178474 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e97e18be-8d78-466f-8fc6-996f0c56d66e tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:04.178954 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e97e18be-8d78-466f-8fc6-996f0c56d66e tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:04.179860 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e97e18be-8d78-466f-8fc6-996f0c56d66e tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:04.180367 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e97e18be-8d78-466f-8fc6-996f0c56d66e tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:04.357582 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e97e18be-8d78-466f-8fc6-996f0c56d66e tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:23:04.366756 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e97e18be-8d78-466f-8fc6-996f0c56d66e tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1654 microversion: 2.1 time: 0.200533 Jul 25 15:23:04.367477 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3435/7096] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:23:04 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1654 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:23:04.391770 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b5ff0ea9-4d59-45d7-9cff-5a73d8ea5fa1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:23:04.394967 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b5ff0ea9-4d59-45d7-9cff-5a73d8ea5fa1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:04.413257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b5ff0ea9-4d59-45d7-9cff-5a73d8ea5fa1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:04.413721 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b5ff0ea9-4d59-45d7-9cff-5a73d8ea5fa1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:04.414524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b5ff0ea9-4d59-45d7-9cff-5a73d8ea5fa1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:04.414978 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b5ff0ea9-4d59-45d7-9cff-5a73d8ea5fa1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:04.451737 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b5ff0ea9-4d59-45d7-9cff-5a73d8ea5fa1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:23:04.461903 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b5ff0ea9-4d59-45d7-9cff-5a73d8ea5fa1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Old instance type m1.heat2, new instance type m1.heat {{(pid=119304) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 15:23:04.470516 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-b5ff0ea9-4d59-45d7-9cff-5a73d8ea5fa1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:23:04.471043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-b5ff0ea9-4d59-45d7-9cff-5a73d8ea5fa1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:23:04.471612 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-b5ff0ea9-4d59-45d7-9cff-5a73d8ea5fa1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:23:04.472199 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-b5ff0ea9-4d59-45d7-9cff-5a73d8ea5fa1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:23:04.472668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-b5ff0ea9-4d59-45d7-9cff-5a73d8ea5fa1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:23:04.560589 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b5ff0ea9-4d59-45d7-9cff-5a73d8ea5fa1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "POST /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8/action" status: 202 len: 0 microversion: 2.1 time: 0.172769 Jul 25 15:23:04.565133 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3662/7097] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:23:04 2022] POST /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:23:04.570737 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1068b62c-8b3c-4e14-8ddf-abec4df1e551 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:04.571401 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1068b62c-8b3c-4e14-8ddf-abec4df1e551 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:04.578372 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1068b62c-8b3c-4e14-8ddf-abec4df1e551 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:04.579489 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1068b62c-8b3c-4e14-8ddf-abec4df1e551 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:04.580397 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1068b62c-8b3c-4e14-8ddf-abec4df1e551 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:04.580883 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1068b62c-8b3c-4e14-8ddf-abec4df1e551 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:04.759426 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1068b62c-8b3c-4e14-8ddf-abec4df1e551 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:23:04.768815 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1068b62c-8b3c-4e14-8ddf-abec4df1e551 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1677 microversion: 2.1 time: 0.202334 Jul 25 15:23:04.769412 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3436/7098] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:23:04 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1677 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:23:05.791212 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3f30ce50-8655-420c-9e02-9bcc94bee720 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:05.791850 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3f30ce50-8655-420c-9e02-9bcc94bee720 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:05.799236 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f30ce50-8655-420c-9e02-9bcc94bee720 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:05.799707 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f30ce50-8655-420c-9e02-9bcc94bee720 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:05.800559 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f30ce50-8655-420c-9e02-9bcc94bee720 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:05.801006 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f30ce50-8655-420c-9e02-9bcc94bee720 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:05.954193 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3f30ce50-8655-420c-9e02-9bcc94bee720 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:23:05.962395 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3f30ce50-8655-420c-9e02-9bcc94bee720 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1677 microversion: 2.1 time: 0.175269 Jul 25 15:23:05.962973 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3663/7099] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:23:05 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:23:06.983107 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8743760d-50ae-41ab-af4d-1425363f85a7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:06.983875 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8743760d-50ae-41ab-af4d-1425363f85a7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:06.991245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8743760d-50ae-41ab-af4d-1425363f85a7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:06.991700 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8743760d-50ae-41ab-af4d-1425363f85a7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:06.993758 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8743760d-50ae-41ab-af4d-1425363f85a7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:06.994213 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8743760d-50ae-41ab-af4d-1425363f85a7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:07.129988 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8743760d-50ae-41ab-af4d-1425363f85a7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:23:07.138927 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8743760d-50ae-41ab-af4d-1425363f85a7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1682 microversion: 2.1 time: 0.159889 Jul 25 15:23:07.139635 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3437/7100] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:23:06 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:23:08.161326 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3524e11a-1bd8-4829-b0ef-2dd52e76a155 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:08.162039 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3524e11a-1bd8-4829-b0ef-2dd52e76a155 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:08.171483 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3524e11a-1bd8-4829-b0ef-2dd52e76a155 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:08.172107 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3524e11a-1bd8-4829-b0ef-2dd52e76a155 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:08.173354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3524e11a-1bd8-4829-b0ef-2dd52e76a155 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:08.173950 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3524e11a-1bd8-4829-b0ef-2dd52e76a155 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:08.317569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3524e11a-1bd8-4829-b0ef-2dd52e76a155 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:23:08.326328 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3524e11a-1bd8-4829-b0ef-2dd52e76a155 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1682 microversion: 2.1 time: 0.169285 Jul 25 15:23:08.326912 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3664/7101] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:23:08 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:23:09.348090 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4bf51cc6-7288-437e-a86d-d6f809fa3647 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:09.348708 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4bf51cc6-7288-437e-a86d-d6f809fa3647 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:09.356064 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4bf51cc6-7288-437e-a86d-d6f809fa3647 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:09.356524 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4bf51cc6-7288-437e-a86d-d6f809fa3647 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:09.357301 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4bf51cc6-7288-437e-a86d-d6f809fa3647 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:09.357740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4bf51cc6-7288-437e-a86d-d6f809fa3647 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:09.560194 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4bf51cc6-7288-437e-a86d-d6f809fa3647 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:23:09.568368 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4bf51cc6-7288-437e-a86d-d6f809fa3647 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1681 microversion: 2.1 time: 0.224295 Jul 25 15:23:09.568974 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3438/7102] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:23:09 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1681 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:23:09.687932 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-839ecaff-4f57-4998-b07f-852f1abd21b2 req-19041f9e-b7d5-4f59-8091-88f405e8504c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f277bed-5ae8-4688-a2ca-9be78f6cc3c8", "name": "network-vif-unplugged", "status": "completed", "tag": "d42fbd73-d33a-4a72-8331-26a27efb3f6c"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:23:09.704036 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-839ecaff-4f57-4998-b07f-852f1abd21b2 req-19041f9e-b7d5-4f59-8091-88f405e8504c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:09.704825 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-839ecaff-4f57-4998-b07f-852f1abd21b2 req-19041f9e-b7d5-4f59-8091-88f405e8504c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:09.718215 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-839ecaff-4f57-4998-b07f-852f1abd21b2 req-19041f9e-b7d5-4f59-8091-88f405e8504c service nova] Creating event network-vif-unplugged:d42fbd73-d33a-4a72-8331-26a27efb3f6c for instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 on n-h1-846435-14 Jul 25 15:23:09.727336 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [req-839ecaff-4f57-4998-b07f-852f1abd21b2 req-19041f9e-b7d5-4f59-8091-88f405e8504c service nova] Instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119304) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 15:23:09.739457 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-839ecaff-4f57-4998-b07f-852f1abd21b2 req-19041f9e-b7d5-4f59-8091-88f405e8504c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.134188 Jul 25 15:23:09.740142 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3665/7103] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:23:10.591554 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5d0a7026-ee61-4243-a932-dc67ef557897 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:10.592259 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5d0a7026-ee61-4243-a932-dc67ef557897 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:10.599852 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5d0a7026-ee61-4243-a932-dc67ef557897 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:10.600357 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5d0a7026-ee61-4243-a932-dc67ef557897 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:10.601167 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5d0a7026-ee61-4243-a932-dc67ef557897 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:10.601607 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5d0a7026-ee61-4243-a932-dc67ef557897 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:10.785837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5d0a7026-ee61-4243-a932-dc67ef557897 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:23:10.794506 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5d0a7026-ee61-4243-a932-dc67ef557897 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1681 microversion: 2.1 time: 0.207638 Jul 25 15:23:10.795105 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3439/7104] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:23:10 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1681 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:23:11.785920 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-51e24a05-39d9-4790-8906-335351c403b7 req-9c7788a0-f2da-4b72-978a-fbd5d73e13d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f277bed-5ae8-4688-a2ca-9be78f6cc3c8", "tag": "d42fbd73-d33a-4a72-8331-26a27efb3f6c"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:23:11.796455 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-51e24a05-39d9-4790-8906-335351c403b7 req-9c7788a0-f2da-4b72-978a-fbd5d73e13d4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:11.796915 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-51e24a05-39d9-4790-8906-335351c403b7 req-9c7788a0-f2da-4b72-978a-fbd5d73e13d4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:11.809204 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-51e24a05-39d9-4790-8906-335351c403b7 req-9c7788a0-f2da-4b72-978a-fbd5d73e13d4 service nova] Creating event network-changed:d42fbd73-d33a-4a72-8331-26a27efb3f6c for instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 on n-h1-846435-14 Jul 25 15:23:11.815364 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [req-51e24a05-39d9-4790-8906-335351c403b7 req-9c7788a0-f2da-4b72-978a-fbd5d73e13d4 service nova] Instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119304) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 15:23:11.816810 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-519164b4-8440-4a2c-a82c-6971be708e64 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:11.817445 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-519164b4-8440-4a2c-a82c-6971be708e64 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:11.826314 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-519164b4-8440-4a2c-a82c-6971be708e64 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:11.826701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-519164b4-8440-4a2c-a82c-6971be708e64 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:11.826827 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-51e24a05-39d9-4790-8906-335351c403b7 req-9c7788a0-f2da-4b72-978a-fbd5d73e13d4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045797 Jul 25 15:23:11.827391 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3666/7105] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:23:11.827556 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-519164b4-8440-4a2c-a82c-6971be708e64 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:11.827924 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-519164b4-8440-4a2c-a82c-6971be708e64 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:11.966007 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-519164b4-8440-4a2c-a82c-6971be708e64 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:23:11.974098 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-519164b4-8440-4a2c-a82c-6971be708e64 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1679 microversion: 2.1 time: 0.161135 Jul 25 15:23:11.974744 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3440/7106] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:23:11 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:23:12.998058 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-98f7ba82-49bb-4acb-a3f4-f55e91fc5f2c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:12.998720 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-98f7ba82-49bb-4acb-a3f4-f55e91fc5f2c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:13.005744 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98f7ba82-49bb-4acb-a3f4-f55e91fc5f2c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:13.006201 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98f7ba82-49bb-4acb-a3f4-f55e91fc5f2c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:13.006969 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98f7ba82-49bb-4acb-a3f4-f55e91fc5f2c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:13.007408 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98f7ba82-49bb-4acb-a3f4-f55e91fc5f2c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:13.163624 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-98f7ba82-49bb-4acb-a3f4-f55e91fc5f2c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:23:13.177290 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-98f7ba82-49bb-4acb-a3f4-f55e91fc5f2c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1675 microversion: 2.1 time: 0.184483 Jul 25 15:23:13.178205 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3667/7107] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:23:12 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1675 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:23:13.199532 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-18d13653-e35e-421c-ab00-f7b82b54a752 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:23:13.200173 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-18d13653-e35e-421c-ab00-f7b82b54a752 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:13.207462 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-18d13653-e35e-421c-ab00-f7b82b54a752 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:13.207916 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-18d13653-e35e-421c-ab00-f7b82b54a752 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:13.208765 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-18d13653-e35e-421c-ab00-f7b82b54a752 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:13.209318 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-18d13653-e35e-421c-ab00-f7b82b54a752 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:13.274149 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-18d13653-e35e-421c-ab00-f7b82b54a752 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "POST /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8/action" status: 204 len: 0 microversion: 2.1 time: 0.078921 Jul 25 15:23:13.274826 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3441/7108] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:23:13 2022] POST /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:23:13.283374 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5b9d5637-fef0-4566-a4c9-c3f44ec152cd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:13.284572 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5b9d5637-fef0-4566-a4c9-c3f44ec152cd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:13.291789 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b9d5637-fef0-4566-a4c9-c3f44ec152cd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:13.292294 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b9d5637-fef0-4566-a4c9-c3f44ec152cd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:13.293095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b9d5637-fef0-4566-a4c9-c3f44ec152cd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:13.293541 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b9d5637-fef0-4566-a4c9-c3f44ec152cd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:13.563396 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5b9d5637-fef0-4566-a4c9-c3f44ec152cd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:23:13.572267 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5b9d5637-fef0-4566-a4c9-c3f44ec152cd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1675 microversion: 2.1 time: 0.292732 Jul 25 15:23:13.572776 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3668/7109] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:23:13 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1675 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:23:14.594577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d159d2e0-e352-4d73-ba88-53d60843ddcb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:14.595252 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d159d2e0-e352-4d73-ba88-53d60843ddcb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:14.604352 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d159d2e0-e352-4d73-ba88-53d60843ddcb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:14.604855 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d159d2e0-e352-4d73-ba88-53d60843ddcb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:14.605674 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d159d2e0-e352-4d73-ba88-53d60843ddcb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:14.606118 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d159d2e0-e352-4d73-ba88-53d60843ddcb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:14.758410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d159d2e0-e352-4d73-ba88-53d60843ddcb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:23:14.766729 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d159d2e0-e352-4d73-ba88-53d60843ddcb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1654 microversion: 2.1 time: 0.176625 Jul 25 15:23:14.767334 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3442/7110] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:23:14 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1654 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:23:14.787948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5aec0dec-650b-4150-b0df-a5d1a381f0de tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:14.788600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5aec0dec-650b-4150-b0df-a5d1a381f0de tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:14.796441 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5aec0dec-650b-4150-b0df-a5d1a381f0de tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:14.796931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5aec0dec-650b-4150-b0df-a5d1a381f0de tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:14.797716 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5aec0dec-650b-4150-b0df-a5d1a381f0de tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:14.798156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5aec0dec-650b-4150-b0df-a5d1a381f0de tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:14.939815 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5aec0dec-650b-4150-b0df-a5d1a381f0de tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:23:14.948407 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5aec0dec-650b-4150-b0df-a5d1a381f0de tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1654 microversion: 2.1 time: 0.164366 Jul 25 15:23:14.949654 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3669/7111] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:23:14 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1654 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:23:14.978378 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6026b1e6-60be-434d-8708-b571c261f1e3 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:23:14.987907 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6026b1e6-60be-434d-8708-b571c261f1e3 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:14.988392 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6026b1e6-60be-434d-8708-b571c261f1e3 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:15.017615 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6026b1e6-60be-434d-8708-b571c261f1e3 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Going to try to start instance {{(pid=119303) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 15:23:15.044157 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:23:15.065230 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6026b1e6-60be-434d-8708-b571c261f1e3 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "POST /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8/action" status: 202 len: 0 microversion: 2.1 time: 0.092784 Jul 25 15:23:15.065860 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3443/7112] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:23:14 2022] POST /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:23:15.074473 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1e7dd210-c32f-4adc-8bf5-2808aa6ca13f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:15.075364 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1e7dd210-c32f-4adc-8bf5-2808aa6ca13f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:15.082496 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1e7dd210-c32f-4adc-8bf5-2808aa6ca13f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:15.082943 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1e7dd210-c32f-4adc-8bf5-2808aa6ca13f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:15.083816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1e7dd210-c32f-4adc-8bf5-2808aa6ca13f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:15.084250 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1e7dd210-c32f-4adc-8bf5-2808aa6ca13f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:15.261713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1e7dd210-c32f-4adc-8bf5-2808aa6ca13f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:23:15.270215 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1e7dd210-c32f-4adc-8bf5-2808aa6ca13f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1663 microversion: 2.1 time: 0.199618 Jul 25 15:23:15.270813 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3670/7113] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:23:15 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1663 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:23:15.331175 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-e08625bf-fa96-4094-a0af-f2db25f72185 req-6b4de2fa-70bc-4248-87d8-5248c979bf8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f277bed-5ae8-4688-a2ca-9be78f6cc3c8", "name": "network-vif-plugged", "status": "completed", "tag": "d42fbd73-d33a-4a72-8331-26a27efb3f6c"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:23:15.342639 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-e08625bf-fa96-4094-a0af-f2db25f72185 req-6b4de2fa-70bc-4248-87d8-5248c979bf8e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:15.343427 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-e08625bf-fa96-4094-a0af-f2db25f72185 req-6b4de2fa-70bc-4248-87d8-5248c979bf8e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:15.360245 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-e08625bf-fa96-4094-a0af-f2db25f72185 req-6b4de2fa-70bc-4248-87d8-5248c979bf8e service nova] Creating event network-vif-plugged:d42fbd73-d33a-4a72-8331-26a27efb3f6c for instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 on n-h1-846435-14 Jul 25 15:23:15.368287 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-e08625bf-fa96-4094-a0af-f2db25f72185 req-6b4de2fa-70bc-4248-87d8-5248c979bf8e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045080 Jul 25 15:23:15.369282 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3444/7114] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:23:16.291243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-77c76e7f-b626-4a2e-8f13-d9661872b1ee tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:16.291905 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-77c76e7f-b626-4a2e-8f13-d9661872b1ee tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:16.299115 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-77c76e7f-b626-4a2e-8f13-d9661872b1ee tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:16.299583 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-77c76e7f-b626-4a2e-8f13-d9661872b1ee tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:16.300435 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-77c76e7f-b626-4a2e-8f13-d9661872b1ee tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:16.300992 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-77c76e7f-b626-4a2e-8f13-d9661872b1ee tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:16.443257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-77c76e7f-b626-4a2e-8f13-d9661872b1ee tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:23:16.451879 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-77c76e7f-b626-4a2e-8f13-d9661872b1ee tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1667 microversion: 2.1 time: 0.164804 Jul 25 15:23:16.452616 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3671/7115] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:23:16 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1667 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:23:16.474037 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-52489a89-074f-412a-9e3a-a11a6fe69ee0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:16.474608 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-52489a89-074f-412a-9e3a-a11a6fe69ee0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:16.481583 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-52489a89-074f-412a-9e3a-a11a6fe69ee0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:16.482032 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-52489a89-074f-412a-9e3a-a11a6fe69ee0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:16.482796 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-52489a89-074f-412a-9e3a-a11a6fe69ee0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:16.483232 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-52489a89-074f-412a-9e3a-a11a6fe69ee0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:16.511623 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-52489a89-074f-412a-9e3a-a11a6fe69ee0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:23:16.598047 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-52489a89-074f-412a-9e3a-a11a6fe69ee0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "DELETE /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 204 len: 0 microversion: 2.1 time: 0.128893 Jul 25 15:23:16.598718 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3445/7116] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:23:16 2022] DELETE /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:23:16.607341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5ac0e9b9-cccf-4210-8a45-e53687e300d9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:16.607987 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5ac0e9b9-cccf-4210-8a45-e53687e300d9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:16.614296 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ac0e9b9-cccf-4210-8a45-e53687e300d9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:16.614761 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ac0e9b9-cccf-4210-8a45-e53687e300d9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:16.615524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ac0e9b9-cccf-4210-8a45-e53687e300d9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:16.615960 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ac0e9b9-cccf-4210-8a45-e53687e300d9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:16.746292 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5ac0e9b9-cccf-4210-8a45-e53687e300d9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:23:16.750203 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:23:16.755354 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5ac0e9b9-cccf-4210-8a45-e53687e300d9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1673 microversion: 2.1 time: 0.151980 Jul 25 15:23:16.755950 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3672/7117] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:23:16 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:23:17.780743 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-12bf61f7-5202-432b-aedd-ef48df05e130 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:17.781454 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-12bf61f7-5202-432b-aedd-ef48df05e130 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:17.790023 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-12bf61f7-5202-432b-aedd-ef48df05e130 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:17.790585 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-12bf61f7-5202-432b-aedd-ef48df05e130 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:17.791386 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-12bf61f7-5202-432b-aedd-ef48df05e130 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:17.792809 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-12bf61f7-5202-432b-aedd-ef48df05e130 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:17.942540 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-12bf61f7-5202-432b-aedd-ef48df05e130 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:23:17.950487 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-12bf61f7-5202-432b-aedd-ef48df05e130 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1673 microversion: 2.1 time: 0.175629 Jul 25 15:23:17.951062 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3446/7118] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:23:17 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1673 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:23:18.972360 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a00b2b76-ec71-4d57-858b-4cd70989145a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:18.973159 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a00b2b76-ec71-4d57-858b-4cd70989145a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:18.982141 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a00b2b76-ec71-4d57-858b-4cd70989145a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:18.982722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a00b2b76-ec71-4d57-858b-4cd70989145a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:18.983589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a00b2b76-ec71-4d57-858b-4cd70989145a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:18.984139 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a00b2b76-ec71-4d57-858b-4cd70989145a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:19.052522 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a00b2b76-ec71-4d57-858b-4cd70989145a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:23:19.061387 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a00b2b76-ec71-4d57-858b-4cd70989145a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 200 len: 1606 microversion: 2.1 time: 0.093261 Jul 25 15:23:19.061991 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3673/7119] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:23:18 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 1606 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:23:19.408562 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-3929dc37-e9d4-494d-9644-990436d4e987 req-aa59a8db-27a9-4f02-952d-01470dcc43af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f277bed-5ae8-4688-a2ca-9be78f6cc3c8", "name": "network-vif-deleted", "tag": "d42fbd73-d33a-4a72-8331-26a27efb3f6c"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:23:19.421131 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-3929dc37-e9d4-494d-9644-990436d4e987 req-aa59a8db-27a9-4f02-952d-01470dcc43af service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:19.421582 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-3929dc37-e9d4-494d-9644-990436d4e987 req-aa59a8db-27a9-4f02-952d-01470dcc43af service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:19.434146 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-3929dc37-e9d4-494d-9644-990436d4e987 req-aa59a8db-27a9-4f02-952d-01470dcc43af service nova] Creating event network-vif-deleted:d42fbd73-d33a-4a72-8331-26a27efb3f6c for instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 on n-h1-846435-14 Jul 25 15:23:19.441235 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-3929dc37-e9d4-494d-9644-990436d4e987 req-aa59a8db-27a9-4f02-952d-01470dcc43af service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036370 Jul 25 15:23:19.442270 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3447/7120] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:23:20.083383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ad87303b-a165-421a-918a-4eb41a189f51 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:20.084009 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ad87303b-a165-421a-918a-4eb41a189f51 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:20.091195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad87303b-a165-421a-918a-4eb41a189f51 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:20.091660 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad87303b-a165-421a-918a-4eb41a189f51 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:20.092489 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad87303b-a165-421a-918a-4eb41a189f51 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:20.092941 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad87303b-a165-421a-918a-4eb41a189f51 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:20.108093 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-ad87303b-a165-421a-918a-4eb41a189f51 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] HTTP exception thrown: Instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 could not be found. Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ad87303b-a165-421a-918a-4eb41a189f51 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Request method failure captured: Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 HTTP/1.1 Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3rSjEyisMD8DvTH7b56ad3M9V4r9Z2oHgANxXbb97f0WFMCsa1v0ECdPWSwcD3bin0DxN2VyKMiUlFTU-JUG9Ua6IQiCvvNBHc0-kGj7SnhEHtthZB_ln1XXzCzW_WOLiNqJwI6WQfWOze_2VM1L7b9fm_wuF4gcUsql3_EhcnWK2us Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 90120379bd914d71996458c1e2a3e25a Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerActionsTestJSON-741053275 Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90120379bd914d71996458c1e2a3e25a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90120379bd914d71996458c1e2a3e25a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_90120379bd914d71996458c1e2a3e25a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/90120379bd914d71996458c1e2a3e25a"}]}] Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerActionsTestJSON-741053275 Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 90120379bd914d71996458c1e2a3e25a Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerActionsTestJSON-741053275 Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerActionsTestJSON-741053275-project Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 6a742410e1794902a11125c6369dadcc Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerActionsTestJSON-741053275-project Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 could not be found. Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '0f277bed-5ae8-4688-a2ca-9be78f6cc3c8'} Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 could not be found. Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 could not be found. Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:23:20.109870 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:23:20.117016 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:23:20.117016 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:23:20.117016 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:23:20.117016 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:23:20.117016 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:23:20.117016 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 could not be found. Jul 25 15:23:20.117016 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:23:20.117016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ad87303b-a165-421a-918a-4eb41a189f51 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Returning 404 to user: Instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:23:20.117016 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ad87303b-a165-421a-918a-4eb41a189f51 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 404 len: 111 microversion: 2.1 time: 0.032101 Jul 25 15:23:20.117016 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3674/7121] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:23:20 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:23:20.132291 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-08c87369-0573-484a-8da2-5e65798b6053 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:20.132972 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-08c87369-0573-484a-8da2-5e65798b6053 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:20.140442 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08c87369-0573-484a-8da2-5e65798b6053 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:20.140898 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08c87369-0573-484a-8da2-5e65798b6053 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:20.141679 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08c87369-0573-484a-8da2-5e65798b6053 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:20.142119 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08c87369-0573-484a-8da2-5e65798b6053 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:20.159438 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-08c87369-0573-484a-8da2-5e65798b6053 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] HTTP exception thrown: Instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 could not be found. Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-08c87369-0573-484a-8da2-5e65798b6053 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Request method failure captured: Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 HTTP/1.1 Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rSjEyisMD8DvTH7b56ad3M9V4r9Z2oHgANxXbb97f0WFMCsa1v0ECdPWSwcD3bin0DxN2VyKMiUlFTU-JUG9Ua6IQiCvvNBHc0-kGj7SnhEHtthZB_ln1XXzCzW_WOLiNqJwI6WQfWOze_2VM1L7b9fm_wuF4gcUsql3_EhcnWK2us Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 90120379bd914d71996458c1e2a3e25a Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServerActionsTestJSON-741053275 Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90120379bd914d71996458c1e2a3e25a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90120379bd914d71996458c1e2a3e25a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_90120379bd914d71996458c1e2a3e25a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/90120379bd914d71996458c1e2a3e25a"}]}] Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServerActionsTestJSON-741053275 Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 90120379bd914d71996458c1e2a3e25a Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServerActionsTestJSON-741053275 Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServerActionsTestJSON-741053275-project Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 6a742410e1794902a11125c6369dadcc Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServerActionsTestJSON-741053275-project Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 could not be found. Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '0f277bed-5ae8-4688-a2ca-9be78f6cc3c8'} Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 could not be found. Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 could not be found. Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:23:20.161413 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:23:20.169976 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:23:20.169976 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:23:20.169976 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:23:20.169976 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:23:20.169976 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:23:20.169976 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 could not be found. Jul 25 15:23:20.169976 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:23:20.169976 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-08c87369-0573-484a-8da2-5e65798b6053 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Returning 404 to user: Instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:23:20.169976 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-08c87369-0573-484a-8da2-5e65798b6053 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 404 len: 111 microversion: 2.1 time: 0.036182 Jul 25 15:23:20.169976 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3448/7122] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:23:20 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:23:20.217327 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9ec06073-3255-4f8c-9b2c-df804ffa6767 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-735224558", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "b4e47936-6173-467e-b28c-3bb5bcb99e64"}], "security_groups": [{"name": "tempest-securitygroup--395729731"}], "key_name": "tempest-keypair-720982627", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:23:20.332148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-9ec06073-3255-4f8c-9b2c-df804ffa6767 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] validate_networks() for [('b4e47936-6173-467e-b28c-3bb5bcb99e64', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:23:21.128142 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-9ec06073-3255-4f8c-9b2c-df804ffa6767 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:23:21.128741 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-9ec06073-3255-4f8c-9b2c-df804ffa6767 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:23:21.129037 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-9ec06073-3255-4f8c-9b2c-df804ffa6767 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:23:21.129442 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-9ec06073-3255-4f8c-9b2c-df804ffa6767 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:23:21.129856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-9ec06073-3255-4f8c-9b2c-df804ffa6767 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:23:21.139266 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ec06073-3255-4f8c-9b2c-df804ffa6767 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:21.139716 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ec06073-3255-4f8c-9b2c-df804ffa6767 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:21.140527 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ec06073-3255-4f8c-9b2c-df804ffa6767 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:21.140964 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9ec06073-3255-4f8c-9b2c-df804ffa6767 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:21.158895 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-9ec06073-3255-4f8c-9b2c-df804ffa6767 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Getting quotas for project 90120379bd914d71996458c1e2a3e25a. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:23:21.165373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-9ec06073-3255-4f8c-9b2c-df804ffa6767 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Getting quotas for user 6a742410e1794902a11125c6369dadcc and project 90120379bd914d71996458c1e2a3e25a. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:23:21.181211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9ec06073-3255-4f8c-9b2c-df804ffa6767 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:23:21.183590 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9ec06073-3255-4f8c-9b2c-df804ffa6767 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:23:21.233622 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9ec06073-3255-4f8c-9b2c-df804ffa6767 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.020338 Jul 25 15:23:21.234272 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3675/7123] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:23:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 1022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:23:21.246165 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-56e725ba-b5b3-42dd-979d-8e6928a7b3a2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:21.247433 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-56e725ba-b5b3-42dd-979d-8e6928a7b3a2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:21.317815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-56e725ba-b5b3-42dd-979d-8e6928a7b3a2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:23:21.326150 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-56e725ba-b5b3-42dd-979d-8e6928a7b3a2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1237 microversion: 2.1 time: 0.084440 Jul 25 15:23:21.326869 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3449/7124] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:23:21 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1237 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:23:22.348352 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0c0dd6c2-cd0f-4a2e-abcb-96441c11c954 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:22.348926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0c0dd6c2-cd0f-4a2e-abcb-96441c11c954 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:22.356170 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c0dd6c2-cd0f-4a2e-abcb-96441c11c954 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:22.356684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c0dd6c2-cd0f-4a2e-abcb-96441c11c954 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:22.357494 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c0dd6c2-cd0f-4a2e-abcb-96441c11c954 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:22.357990 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c0dd6c2-cd0f-4a2e-abcb-96441c11c954 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:22.425904 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0c0dd6c2-cd0f-4a2e-abcb-96441c11c954 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:23:22.434012 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0c0dd6c2-cd0f-4a2e-abcb-96441c11c954 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1295 microversion: 2.1 time: 0.090813 Jul 25 15:23:22.434891 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3676/7125] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:23:22 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1295 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:23:23.458532 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-51b1b73f-7cd3-4253-8712-1d8e931f2b03 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:23.459147 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-51b1b73f-7cd3-4253-8712-1d8e931f2b03 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:23.463257 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:23:23.471342 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-51b1b73f-7cd3-4253-8712-1d8e931f2b03 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:23.472275 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-51b1b73f-7cd3-4253-8712-1d8e931f2b03 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:23.473279 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-51b1b73f-7cd3-4253-8712-1d8e931f2b03 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:23.474221 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-51b1b73f-7cd3-4253-8712-1d8e931f2b03 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:23.690055 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-51b1b73f-7cd3-4253-8712-1d8e931f2b03 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:23:23.698847 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-51b1b73f-7cd3-4253-8712-1d8e931f2b03 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1362 microversion: 2.1 time: 0.244219 Jul 25 15:23:23.699629 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3450/7126] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:23:23 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:23:23.772642 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-c0af3307-dddb-4a04-b8c3-422c6842f898 req-426b0b79-e2a4-42f6-887f-830f737427ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ccda193-9fa9-4bde-94d1-3071131ed567", "tag": "40e4d031-7043-4995-b2d8-264b680a3398"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:23:23.780720 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:23:23.788911 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c0af3307-dddb-4a04-b8c3-422c6842f898 req-426b0b79-e2a4-42f6-887f-830f737427ce service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:23.789377 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c0af3307-dddb-4a04-b8c3-422c6842f898 req-426b0b79-e2a4-42f6-887f-830f737427ce service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:23.807719 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-c0af3307-dddb-4a04-b8c3-422c6842f898 req-426b0b79-e2a4-42f6-887f-830f737427ce service nova] Creating event network-changed:40e4d031-7043-4995-b2d8-264b680a3398 for instance 8ccda193-9fa9-4bde-94d1-3071131ed567 on n-h1-846435-14 Jul 25 15:23:23.814324 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-c0af3307-dddb-4a04-b8c3-422c6842f898 req-426b0b79-e2a4-42f6-887f-830f737427ce service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045402 Jul 25 15:23:23.815106 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3677/7127] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:23:24.725042 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-698a05ba-7a39-4302-a9a9-49b54f07d1ab tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:24.725740 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-698a05ba-7a39-4302-a9a9-49b54f07d1ab tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:24.736328 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-698a05ba-7a39-4302-a9a9-49b54f07d1ab tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:24.737058 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-698a05ba-7a39-4302-a9a9-49b54f07d1ab tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:24.738152 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-698a05ba-7a39-4302-a9a9-49b54f07d1ab tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:24.738932 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-698a05ba-7a39-4302-a9a9-49b54f07d1ab tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:24.884705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-698a05ba-7a39-4302-a9a9-49b54f07d1ab tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:23:24.892671 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-698a05ba-7a39-4302-a9a9-49b54f07d1ab tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1362 microversion: 2.1 time: 0.174160 Jul 25 15:23:24.893345 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3451/7128] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:23:24 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:23:25.916489 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d4121758-1115-43cc-b414-ccaf8fef2a3c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:25.917212 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d4121758-1115-43cc-b414-ccaf8fef2a3c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:25.924165 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d4121758-1115-43cc-b414-ccaf8fef2a3c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:25.924634 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d4121758-1115-43cc-b414-ccaf8fef2a3c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:25.925444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d4121758-1115-43cc-b414-ccaf8fef2a3c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:25.925893 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d4121758-1115-43cc-b414-ccaf8fef2a3c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:26.066518 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d4121758-1115-43cc-b414-ccaf8fef2a3c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:23:26.074679 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d4121758-1115-43cc-b414-ccaf8fef2a3c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1362 microversion: 2.1 time: 0.163894 Jul 25 15:23:26.075244 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3678/7129] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:23:25 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:23:27.096832 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-80b30841-5bc4-4656-b436-b4798d3530b9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:27.097578 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-80b30841-5bc4-4656-b436-b4798d3530b9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:27.105429 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-80b30841-5bc4-4656-b436-b4798d3530b9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:27.105893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-80b30841-5bc4-4656-b436-b4798d3530b9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:27.106683 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-80b30841-5bc4-4656-b436-b4798d3530b9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:27.107107 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-80b30841-5bc4-4656-b436-b4798d3530b9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:27.256138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-80b30841-5bc4-4656-b436-b4798d3530b9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:23:27.265832 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-80b30841-5bc4-4656-b436-b4798d3530b9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1362 microversion: 2.1 time: 0.173018 Jul 25 15:23:27.266451 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3452/7130] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:23:27 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:23:28.289791 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5cb08241-a405-47ec-8e55-e8e3b146bd27 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:28.290475 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5cb08241-a405-47ec-8e55-e8e3b146bd27 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:28.298631 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5cb08241-a405-47ec-8e55-e8e3b146bd27 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:28.299095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5cb08241-a405-47ec-8e55-e8e3b146bd27 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:28.299885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5cb08241-a405-47ec-8e55-e8e3b146bd27 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:28.300365 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5cb08241-a405-47ec-8e55-e8e3b146bd27 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:28.563034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5cb08241-a405-47ec-8e55-e8e3b146bd27 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:23:28.571147 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5cb08241-a405-47ec-8e55-e8e3b146bd27 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1362 microversion: 2.1 time: 0.285655 Jul 25 15:23:28.571775 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3679/7131] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:23:28 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1362 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:23:29.427968 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-87697747-474a-4de8-8e91-f0f617ba1778 req-7aaf3a88-7714-4531-a40e-4f778eef4c76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ccda193-9fa9-4bde-94d1-3071131ed567", "name": "network-vif-plugged", "status": "completed", "tag": "40e4d031-7043-4995-b2d8-264b680a3398"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:23:29.451963 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-87697747-474a-4de8-8e91-f0f617ba1778 req-7aaf3a88-7714-4531-a40e-4f778eef4c76 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:29.452706 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-87697747-474a-4de8-8e91-f0f617ba1778 req-7aaf3a88-7714-4531-a40e-4f778eef4c76 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:29.471355 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-87697747-474a-4de8-8e91-f0f617ba1778 req-7aaf3a88-7714-4531-a40e-4f778eef4c76 service nova] Creating event network-vif-plugged:40e4d031-7043-4995-b2d8-264b680a3398 for instance 8ccda193-9fa9-4bde-94d1-3071131ed567 on n-h1-846435-14 Jul 25 15:23:29.478632 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-87697747-474a-4de8-8e91-f0f617ba1778 req-7aaf3a88-7714-4531-a40e-4f778eef4c76 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054544 Jul 25 15:23:29.479298 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3453/7132] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:23:29.593931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5d82b757-f535-4841-8a40-35db5ad7fcdd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:29.595432 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5d82b757-f535-4841-8a40-35db5ad7fcdd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:29.603118 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d82b757-f535-4841-8a40-35db5ad7fcdd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:29.603515 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d82b757-f535-4841-8a40-35db5ad7fcdd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:29.604345 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d82b757-f535-4841-8a40-35db5ad7fcdd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:29.604789 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d82b757-f535-4841-8a40-35db5ad7fcdd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:29.764240 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5d82b757-f535-4841-8a40-35db5ad7fcdd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:23:29.772582 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5d82b757-f535-4841-8a40-35db5ad7fcdd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1362 microversion: 2.1 time: 0.182508 Jul 25 15:23:29.773182 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3680/7133] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:23:29 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:23:30.796932 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cc6cbc78-dd61-47e2-9074-3b4298a0eb6b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:30.797849 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cc6cbc78-dd61-47e2-9074-3b4298a0eb6b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:30.808144 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cc6cbc78-dd61-47e2-9074-3b4298a0eb6b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:30.808732 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cc6cbc78-dd61-47e2-9074-3b4298a0eb6b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:30.809585 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cc6cbc78-dd61-47e2-9074-3b4298a0eb6b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:30.810028 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cc6cbc78-dd61-47e2-9074-3b4298a0eb6b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:31.040813 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cc6cbc78-dd61-47e2-9074-3b4298a0eb6b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:23:31.049399 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cc6cbc78-dd61-47e2-9074-3b4298a0eb6b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1362 microversion: 2.1 time: 0.257615 Jul 25 15:23:31.049901 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3454/7134] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:23:30 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:23:32.082427 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-be744dbf-49e9-460c-abd5-27bfa9a77700 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:32.083299 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-be744dbf-49e9-460c-abd5-27bfa9a77700 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:32.086748 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:23:32.087829 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:23:32.095110 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be744dbf-49e9-460c-abd5-27bfa9a77700 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:32.095563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be744dbf-49e9-460c-abd5-27bfa9a77700 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:32.096386 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be744dbf-49e9-460c-abd5-27bfa9a77700 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:32.096852 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-be744dbf-49e9-460c-abd5-27bfa9a77700 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:32.294334 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-be744dbf-49e9-460c-abd5-27bfa9a77700 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:23:32.305780 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-be744dbf-49e9-460c-abd5-27bfa9a77700 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1548 microversion: 2.1 time: 0.228033 Jul 25 15:23:32.306667 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3681/7135] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:23:32 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1548 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:23:32.337581 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-29082096-3e71-49aa-809c-4a6943efa857 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:23:32.338446 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-29082096-3e71-49aa-809c-4a6943efa857 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:23:32.342049 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:23:32.350895 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-29082096-3e71-49aa-809c-4a6943efa857 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:32.351440 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-29082096-3e71-49aa-809c-4a6943efa857 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:32.352465 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-29082096-3e71-49aa-809c-4a6943efa857 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:32.353082 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-29082096-3e71-49aa-809c-4a6943efa857 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:32.472095 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-29082096-3e71-49aa-809c-4a6943efa857 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.140714 Jul 25 15:23:32.473350 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3455/7136] 10.222.0.88 () {58 vars in 1275 bytes} [Mon Jul 25 15:23:32 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:23:33.984366 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-2b98bb26-481d-4caa-8275-6974fe7374d6 req-4fa25631-e090-491a-ab01-3072e6ffa98c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ccda193-9fa9-4bde-94d1-3071131ed567", "tag": "40e4d031-7043-4995-b2d8-264b680a3398"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:23:33.998650 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-2b98bb26-481d-4caa-8275-6974fe7374d6 req-4fa25631-e090-491a-ab01-3072e6ffa98c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:23:33.999258 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-2b98bb26-481d-4caa-8275-6974fe7374d6 req-4fa25631-e090-491a-ab01-3072e6ffa98c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:23:34.014191 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-2b98bb26-481d-4caa-8275-6974fe7374d6 req-4fa25631-e090-491a-ab01-3072e6ffa98c service nova] Creating event network-changed:40e4d031-7043-4995-b2d8-264b680a3398 for instance 8ccda193-9fa9-4bde-94d1-3071131ed567 on n-h1-846435-14 Jul 25 15:23:34.020800 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-2b98bb26-481d-4caa-8275-6974fe7374d6 req-4fa25631-e090-491a-ab01-3072e6ffa98c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040693 Jul 25 15:23:34.021631 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3682/7137] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:23:51.255409 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 15:23:51.255962 n-d-846435-14 devstack@n-api.service[119303]: Mon Jul 25 15:23:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 15:24:08.933723 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=11 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:24:08.934742 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=58,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:24:08.938757 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-58cfbc6e-8235-404a-8376-5e85f3954521 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:24:08.941183 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-58cfbc6e-8235-404a-8376-5e85f3954521 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:08.949826 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-58cfbc6e-8235-404a-8376-5e85f3954521 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:08.950269 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-58cfbc6e-8235-404a-8376-5e85f3954521 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:08.951105 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-58cfbc6e-8235-404a-8376-5e85f3954521 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:08.951537 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-58cfbc6e-8235-404a-8376-5e85f3954521 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:08.980701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-58cfbc6e-8235-404a-8376-5e85f3954521 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:08.987064 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-58cfbc6e-8235-404a-8376-5e85f3954521 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Old instance type m1.heat2, new instance type m1.heat {{(pid=119303) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 15:24:08.993784 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-58cfbc6e-8235-404a-8376-5e85f3954521 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:24:08.994351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-58cfbc6e-8235-404a-8376-5e85f3954521 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:24:08.994839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-58cfbc6e-8235-404a-8376-5e85f3954521 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:24:08.995270 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-58cfbc6e-8235-404a-8376-5e85f3954521 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:24:08.996083 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-58cfbc6e-8235-404a-8376-5e85f3954521 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:24:09.064230 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-58cfbc6e-8235-404a-8376-5e85f3954521 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "POST /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567/action" status: 202 len: 0 microversion: 2.1 time: 0.132617 Jul 25 15:24:09.064862 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3456/7138] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:24:08 2022] POST /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:24:09.072965 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=11 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:24:09.074000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=44 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:24:09.078673 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-998374fd-56b6-4d40-8f24-2a4eb09f4aeb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:09.079676 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-998374fd-56b6-4d40-8f24-2a4eb09f4aeb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:09.087661 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-998374fd-56b6-4d40-8f24-2a4eb09f4aeb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:09.088266 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-998374fd-56b6-4d40-8f24-2a4eb09f4aeb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:09.089133 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-998374fd-56b6-4d40-8f24-2a4eb09f4aeb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:09.089608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-998374fd-56b6-4d40-8f24-2a4eb09f4aeb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:09.346878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-998374fd-56b6-4d40-8f24-2a4eb09f4aeb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:09.354857 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-998374fd-56b6-4d40-8f24-2a4eb09f4aeb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1676 microversion: 2.1 time: 0.285126 Jul 25 15:24:09.355428 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3683/7139] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:09 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1676 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:10.378318 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1e5cd085-a58e-425d-b171-c2147e00c3ad tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:10.378987 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1e5cd085-a58e-425d-b171-c2147e00c3ad tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:10.387380 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e5cd085-a58e-425d-b171-c2147e00c3ad tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:10.387829 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e5cd085-a58e-425d-b171-c2147e00c3ad tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:10.388747 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e5cd085-a58e-425d-b171-c2147e00c3ad tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:10.389273 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1e5cd085-a58e-425d-b171-c2147e00c3ad tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:10.714306 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1e5cd085-a58e-425d-b171-c2147e00c3ad tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:10.722822 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1e5cd085-a58e-425d-b171-c2147e00c3ad tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1676 microversion: 2.1 time: 0.349733 Jul 25 15:24:10.723434 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3457/7140] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:10 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1676 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:11.744817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b8b35cee-a6bb-43b7-9707-f3628f484c54 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:11.745375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b8b35cee-a6bb-43b7-9707-f3628f484c54 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:11.754661 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8b35cee-a6bb-43b7-9707-f3628f484c54 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:11.755128 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8b35cee-a6bb-43b7-9707-f3628f484c54 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:11.755920 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8b35cee-a6bb-43b7-9707-f3628f484c54 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:11.756398 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8b35cee-a6bb-43b7-9707-f3628f484c54 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:11.895288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b8b35cee-a6bb-43b7-9707-f3628f484c54 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:11.903152 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b8b35cee-a6bb-43b7-9707-f3628f484c54 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1681 microversion: 2.1 time: 0.162505 Jul 25 15:24:11.903747 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3684/7141] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:11 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:12.925293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0bcfc77e-1084-48f7-a1eb-2eae79703586 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:12.925928 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0bcfc77e-1084-48f7-a1eb-2eae79703586 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:12.934294 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0bcfc77e-1084-48f7-a1eb-2eae79703586 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:12.934812 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0bcfc77e-1084-48f7-a1eb-2eae79703586 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:12.935849 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0bcfc77e-1084-48f7-a1eb-2eae79703586 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:12.936556 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0bcfc77e-1084-48f7-a1eb-2eae79703586 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:13.076590 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0bcfc77e-1084-48f7-a1eb-2eae79703586 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:13.084745 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0bcfc77e-1084-48f7-a1eb-2eae79703586 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1681 microversion: 2.1 time: 0.163452 Jul 25 15:24:13.085337 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3458/7142] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:12 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:14.106824 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e684a91f-393f-4597-9e81-ec5d68252227 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:14.107404 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e684a91f-393f-4597-9e81-ec5d68252227 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:14.115045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e684a91f-393f-4597-9e81-ec5d68252227 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:14.115506 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e684a91f-393f-4597-9e81-ec5d68252227 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:14.116319 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e684a91f-393f-4597-9e81-ec5d68252227 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:14.116756 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e684a91f-393f-4597-9e81-ec5d68252227 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:14.260279 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e684a91f-393f-4597-9e81-ec5d68252227 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:14.268136 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e684a91f-393f-4597-9e81-ec5d68252227 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1681 microversion: 2.1 time: 0.165398 Jul 25 15:24:14.268710 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3685/7143] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:14 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:15.289701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-96f2a0ab-cbad-4e3d-ac0e-59fefb169ac7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:15.290255 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-96f2a0ab-cbad-4e3d-ac0e-59fefb169ac7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:15.306479 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-96f2a0ab-cbad-4e3d-ac0e-59fefb169ac7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:15.310979 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-96f2a0ab-cbad-4e3d-ac0e-59fefb169ac7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:15.311791 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-96f2a0ab-cbad-4e3d-ac0e-59fefb169ac7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:15.312307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-96f2a0ab-cbad-4e3d-ac0e-59fefb169ac7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:15.459137 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-96f2a0ab-cbad-4e3d-ac0e-59fefb169ac7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:15.467140 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-96f2a0ab-cbad-4e3d-ac0e-59fefb169ac7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1681 microversion: 2.1 time: 0.181510 Jul 25 15:24:15.467732 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3459/7144] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:15 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1681 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:16.488846 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-badf683e-901f-442c-a713-aaa94dc16dcd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:16.489444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-badf683e-901f-442c-a713-aaa94dc16dcd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:16.497740 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-badf683e-901f-442c-a713-aaa94dc16dcd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:16.498196 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-badf683e-901f-442c-a713-aaa94dc16dcd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:16.498969 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-badf683e-901f-442c-a713-aaa94dc16dcd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:16.499409 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-badf683e-901f-442c-a713-aaa94dc16dcd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:16.637033 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-badf683e-901f-442c-a713-aaa94dc16dcd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:16.645357 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-badf683e-901f-442c-a713-aaa94dc16dcd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1681 microversion: 2.1 time: 0.160413 Jul 25 15:24:16.646005 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3686/7145] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:16 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:17.667575 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-99c5662f-e3c7-4d3e-8d0e-e85aecc9b0dd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:17.668330 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-99c5662f-e3c7-4d3e-8d0e-e85aecc9b0dd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:17.675624 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99c5662f-e3c7-4d3e-8d0e-e85aecc9b0dd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:17.676107 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99c5662f-e3c7-4d3e-8d0e-e85aecc9b0dd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:17.676881 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99c5662f-e3c7-4d3e-8d0e-e85aecc9b0dd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:17.677320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99c5662f-e3c7-4d3e-8d0e-e85aecc9b0dd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:17.808997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-99c5662f-e3c7-4d3e-8d0e-e85aecc9b0dd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:17.817199 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-99c5662f-e3c7-4d3e-8d0e-e85aecc9b0dd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1681 microversion: 2.1 time: 0.153682 Jul 25 15:24:17.817792 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3460/7146] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:17 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:18.838866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-eca2ead0-e910-467d-8c46-3f604916db25 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:18.839478 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-eca2ead0-e910-467d-8c46-3f604916db25 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:18.849149 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eca2ead0-e910-467d-8c46-3f604916db25 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:18.849612 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eca2ead0-e910-467d-8c46-3f604916db25 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:18.850404 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eca2ead0-e910-467d-8c46-3f604916db25 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:18.850850 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eca2ead0-e910-467d-8c46-3f604916db25 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:19.000206 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-eca2ead0-e910-467d-8c46-3f604916db25 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:19.010029 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-eca2ead0-e910-467d-8c46-3f604916db25 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1681 microversion: 2.1 time: 0.175060 Jul 25 15:24:19.010765 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3687/7147] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:18 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:20.033275 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b584afea-1e72-4d6e-be78-b310e9351f7e tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:20.034039 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b584afea-1e72-4d6e-be78-b310e9351f7e tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:20.041881 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b584afea-1e72-4d6e-be78-b310e9351f7e tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:20.042338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b584afea-1e72-4d6e-be78-b310e9351f7e tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:20.043123 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b584afea-1e72-4d6e-be78-b310e9351f7e tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:20.043561 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b584afea-1e72-4d6e-be78-b310e9351f7e tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:20.190616 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b584afea-1e72-4d6e-be78-b310e9351f7e tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:20.198707 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b584afea-1e72-4d6e-be78-b310e9351f7e tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1681 microversion: 2.1 time: 0.169565 Jul 25 15:24:20.199283 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3461/7148] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:20 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:24:21.220605 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-30835762-69f7-443d-8995-d826bda3abc1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:21.221219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-30835762-69f7-443d-8995-d826bda3abc1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:21.228546 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-30835762-69f7-443d-8995-d826bda3abc1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:21.229008 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-30835762-69f7-443d-8995-d826bda3abc1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:21.229802 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-30835762-69f7-443d-8995-d826bda3abc1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:21.230244 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-30835762-69f7-443d-8995-d826bda3abc1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:21.369438 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-30835762-69f7-443d-8995-d826bda3abc1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:21.377549 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-30835762-69f7-443d-8995-d826bda3abc1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1681 microversion: 2.1 time: 0.161082 Jul 25 15:24:21.378167 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3688/7149] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:21 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:22.399397 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b2f2fa8f-c923-40a2-9704-653021b8b2e5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:22.400207 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b2f2fa8f-c923-40a2-9704-653021b8b2e5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:22.407769 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b2f2fa8f-c923-40a2-9704-653021b8b2e5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:22.408269 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b2f2fa8f-c923-40a2-9704-653021b8b2e5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:22.409128 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b2f2fa8f-c923-40a2-9704-653021b8b2e5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:22.409608 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b2f2fa8f-c923-40a2-9704-653021b8b2e5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:22.547047 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b2f2fa8f-c923-40a2-9704-653021b8b2e5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:22.555469 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b2f2fa8f-c923-40a2-9704-653021b8b2e5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1681 microversion: 2.1 time: 0.159986 Jul 25 15:24:22.556110 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3462/7150] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:22 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:23.578256 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-28f8d1ed-87e6-4c57-ba08-9cf3359bda03 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:23.578944 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-28f8d1ed-87e6-4c57-ba08-9cf3359bda03 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:23.586635 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28f8d1ed-87e6-4c57-ba08-9cf3359bda03 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:23.587095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28f8d1ed-87e6-4c57-ba08-9cf3359bda03 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:23.587898 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28f8d1ed-87e6-4c57-ba08-9cf3359bda03 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:23.588519 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28f8d1ed-87e6-4c57-ba08-9cf3359bda03 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:23.734776 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-28f8d1ed-87e6-4c57-ba08-9cf3359bda03 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:23.743217 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-28f8d1ed-87e6-4c57-ba08-9cf3359bda03 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1681 microversion: 2.1 time: 0.169252 Jul 25 15:24:23.743817 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3689/7151] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:23 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:24.766684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-af7160bd-b915-44c9-a069-849b23191e0b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:24.767409 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-af7160bd-b915-44c9-a069-849b23191e0b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:24.775774 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-af7160bd-b915-44c9-a069-849b23191e0b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:24.776325 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-af7160bd-b915-44c9-a069-849b23191e0b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:24.777382 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-af7160bd-b915-44c9-a069-849b23191e0b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:24.777882 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-af7160bd-b915-44c9-a069-849b23191e0b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:24.955801 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-af7160bd-b915-44c9-a069-849b23191e0b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:24.964726 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-af7160bd-b915-44c9-a069-849b23191e0b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1681 microversion: 2.1 time: 0.202201 Jul 25 15:24:24.965342 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3463/7152] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:24 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1681 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:25.986545 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8e7dfa47-80be-4bb9-8e41-a6cd71f616e0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:25.987170 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8e7dfa47-80be-4bb9-8e41-a6cd71f616e0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:25.994648 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e7dfa47-80be-4bb9-8e41-a6cd71f616e0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:25.995111 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e7dfa47-80be-4bb9-8e41-a6cd71f616e0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:25.996244 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e7dfa47-80be-4bb9-8e41-a6cd71f616e0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:25.996692 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8e7dfa47-80be-4bb9-8e41-a6cd71f616e0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:26.144989 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8e7dfa47-80be-4bb9-8e41-a6cd71f616e0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:26.153658 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8e7dfa47-80be-4bb9-8e41-a6cd71f616e0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1681 microversion: 2.1 time: 0.171105 Jul 25 15:24:26.154258 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3690/7153] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:25 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:27.176193 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b8fa8a67-5827-4f92-a07c-3f548bb6a138 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:27.177029 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b8fa8a67-5827-4f92-a07c-3f548bb6a138 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:27.184917 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8fa8a67-5827-4f92-a07c-3f548bb6a138 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:27.185376 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8fa8a67-5827-4f92-a07c-3f548bb6a138 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:27.186158 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8fa8a67-5827-4f92-a07c-3f548bb6a138 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:27.186601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b8fa8a67-5827-4f92-a07c-3f548bb6a138 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:27.332554 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b8fa8a67-5827-4f92-a07c-3f548bb6a138 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:27.340714 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b8fa8a67-5827-4f92-a07c-3f548bb6a138 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1681 microversion: 2.1 time: 0.169112 Jul 25 15:24:27.341300 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3464/7154] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:27 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:28.382074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2350f143-5e8c-4a8f-858d-1e7b42f4e5b1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:28.383293 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2350f143-5e8c-4a8f-858d-1e7b42f4e5b1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:28.397385 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2350f143-5e8c-4a8f-858d-1e7b42f4e5b1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:28.398184 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2350f143-5e8c-4a8f-858d-1e7b42f4e5b1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:28.399905 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2350f143-5e8c-4a8f-858d-1e7b42f4e5b1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:28.400821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2350f143-5e8c-4a8f-858d-1e7b42f4e5b1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:28.607464 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2350f143-5e8c-4a8f-858d-1e7b42f4e5b1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:28.618255 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2350f143-5e8c-4a8f-858d-1e7b42f4e5b1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1681 microversion: 2.1 time: 0.244349 Jul 25 15:24:28.619686 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3691/7155] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:28 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1681 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:29.293565 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-79def1b5-695b-4c6e-8b3c-57297a86e062 req-3f7857dc-5320-45a2-b4f3-991df115f799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ccda193-9fa9-4bde-94d1-3071131ed567", "name": "network-vif-unplugged", "status": "completed", "tag": "40e4d031-7043-4995-b2d8-264b680a3398"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:24:29.312682 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-79def1b5-695b-4c6e-8b3c-57297a86e062 req-3f7857dc-5320-45a2-b4f3-991df115f799 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:29.313140 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-79def1b5-695b-4c6e-8b3c-57297a86e062 req-3f7857dc-5320-45a2-b4f3-991df115f799 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:29.327150 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-79def1b5-695b-4c6e-8b3c-57297a86e062 req-3f7857dc-5320-45a2-b4f3-991df115f799 service nova] Creating event network-vif-unplugged:40e4d031-7043-4995-b2d8-264b680a3398 for instance 8ccda193-9fa9-4bde-94d1-3071131ed567 on n-h2-846435-14 Jul 25 15:24:29.334728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [req-79def1b5-695b-4c6e-8b3c-57297a86e062 req-3f7857dc-5320-45a2-b4f3-991df115f799 service nova] Instance 8ccda193-9fa9-4bde-94d1-3071131ed567 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119303) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 15:24:29.348799 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-79def1b5-695b-4c6e-8b3c-57297a86e062 req-3f7857dc-5320-45a2-b4f3-991df115f799 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132045 Jul 25 15:24:29.349559 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3465/7156] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:24:29.644497 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6ea957f0-f85c-4d4e-a1f0-37cc2e6295aa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:29.645340 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6ea957f0-f85c-4d4e-a1f0-37cc2e6295aa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:29.654289 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6ea957f0-f85c-4d4e-a1f0-37cc2e6295aa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:29.654777 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6ea957f0-f85c-4d4e-a1f0-37cc2e6295aa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:29.655691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6ea957f0-f85c-4d4e-a1f0-37cc2e6295aa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:29.656205 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6ea957f0-f85c-4d4e-a1f0-37cc2e6295aa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:29.976259 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6ea957f0-f85c-4d4e-a1f0-37cc2e6295aa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:29.990314 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6ea957f0-f85c-4d4e-a1f0-37cc2e6295aa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1680 microversion: 2.1 time: 0.349576 Jul 25 15:24:29.991276 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3692/7157] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:29 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1680 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:24:31.027704 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a8dcf699-cb14-456f-a920-e1df8d1b5ed3 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:31.028457 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a8dcf699-cb14-456f-a920-e1df8d1b5ed3 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:31.036144 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a8dcf699-cb14-456f-a920-e1df8d1b5ed3 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:31.036614 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a8dcf699-cb14-456f-a920-e1df8d1b5ed3 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:31.037459 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a8dcf699-cb14-456f-a920-e1df8d1b5ed3 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:31.037905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a8dcf699-cb14-456f-a920-e1df8d1b5ed3 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:31.187501 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a8dcf699-cb14-456f-a920-e1df8d1b5ed3 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:31.195713 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a8dcf699-cb14-456f-a920-e1df8d1b5ed3 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1678 microversion: 2.1 time: 0.173853 Jul 25 15:24:31.196361 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3466/7158] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:31 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:31.385227 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-14c1088e-5fc2-461a-87c0-23cb9f637541 req-9570f981-a9f1-469f-a467-dd0855fa6fac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ccda193-9fa9-4bde-94d1-3071131ed567", "tag": "40e4d031-7043-4995-b2d8-264b680a3398"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:24:31.396353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-14c1088e-5fc2-461a-87c0-23cb9f637541 req-9570f981-a9f1-469f-a467-dd0855fa6fac service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:31.396897 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-14c1088e-5fc2-461a-87c0-23cb9f637541 req-9570f981-a9f1-469f-a467-dd0855fa6fac service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:31.410875 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-14c1088e-5fc2-461a-87c0-23cb9f637541 req-9570f981-a9f1-469f-a467-dd0855fa6fac service nova] Creating event network-changed:40e4d031-7043-4995-b2d8-264b680a3398 for instance 8ccda193-9fa9-4bde-94d1-3071131ed567 on n-h2-846435-14 Jul 25 15:24:31.417126 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [req-14c1088e-5fc2-461a-87c0-23cb9f637541 req-9570f981-a9f1-469f-a467-dd0855fa6fac service nova] Instance 8ccda193-9fa9-4bde-94d1-3071131ed567 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119304) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 15:24:31.428160 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-14c1088e-5fc2-461a-87c0-23cb9f637541 req-9570f981-a9f1-469f-a467-dd0855fa6fac service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046684 Jul 25 15:24:31.428796 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3693/7159] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:24:32.219017 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-211166a8-0e20-4432-922b-c2fe8a055740 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:32.219750 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-211166a8-0e20-4432-922b-c2fe8a055740 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:32.227607 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-211166a8-0e20-4432-922b-c2fe8a055740 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:32.228078 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-211166a8-0e20-4432-922b-c2fe8a055740 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:32.229211 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-211166a8-0e20-4432-922b-c2fe8a055740 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:32.229634 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-211166a8-0e20-4432-922b-c2fe8a055740 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:32.381095 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-211166a8-0e20-4432-922b-c2fe8a055740 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:32.389811 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-211166a8-0e20-4432-922b-c2fe8a055740 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1678 microversion: 2.1 time: 0.174923 Jul 25 15:24:32.390409 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3467/7160] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:32 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:33.413863 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-377b5d02-0978-45d3-a3cb-82425d5573c7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:33.413863 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-377b5d02-0978-45d3-a3cb-82425d5573c7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:33.420738 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-377b5d02-0978-45d3-a3cb-82425d5573c7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:33.421232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-377b5d02-0978-45d3-a3cb-82425d5573c7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:33.422228 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-377b5d02-0978-45d3-a3cb-82425d5573c7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:33.422669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-377b5d02-0978-45d3-a3cb-82425d5573c7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:33.630648 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-377b5d02-0978-45d3-a3cb-82425d5573c7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:33.640077 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-377b5d02-0978-45d3-a3cb-82425d5573c7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1675 microversion: 2.1 time: 0.232629 Jul 25 15:24:33.640683 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3694/7161] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:33 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1675 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:33.661229 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bdfcb593-53e5-4cbf-ac19-c6eba31f09a4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:24:33.661803 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bdfcb593-53e5-4cbf-ac19-c6eba31f09a4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:33.669209 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bdfcb593-53e5-4cbf-ac19-c6eba31f09a4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:33.669671 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bdfcb593-53e5-4cbf-ac19-c6eba31f09a4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:33.670505 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bdfcb593-53e5-4cbf-ac19-c6eba31f09a4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:33.670953 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bdfcb593-53e5-4cbf-ac19-c6eba31f09a4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:33.711890 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bdfcb593-53e5-4cbf-ac19-c6eba31f09a4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:33.712442 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bdfcb593-53e5-4cbf-ac19-c6eba31f09a4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:33.713222 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bdfcb593-53e5-4cbf-ac19-c6eba31f09a4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:33.713648 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bdfcb593-53e5-4cbf-ac19-c6eba31f09a4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:33.734564 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-bdfcb593-53e5-4cbf-ac19-c6eba31f09a4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Getting quotas for project 90120379bd914d71996458c1e2a3e25a. Resources: {'cores', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:24:33.739856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-bdfcb593-53e5-4cbf-ac19-c6eba31f09a4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Getting quotas for user 6a742410e1794902a11125c6369dadcc and project 90120379bd914d71996458c1e2a3e25a. Resources: {'cores', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:24:33.825360 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:24:33.850715 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bdfcb593-53e5-4cbf-ac19-c6eba31f09a4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "POST /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567/action" status: 202 len: 0 microversion: 2.1 time: 0.193419 Jul 25 15:24:33.851392 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3468/7162] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:24:33 2022] POST /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:24:33.861413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-db11de2b-e5cf-4c14-b44f-1a52d9625216 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:33.861957 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-db11de2b-e5cf-4c14-b44f-1a52d9625216 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:33.870139 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db11de2b-e5cf-4c14-b44f-1a52d9625216 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:33.871105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db11de2b-e5cf-4c14-b44f-1a52d9625216 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:33.872202 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db11de2b-e5cf-4c14-b44f-1a52d9625216 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:33.872806 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-db11de2b-e5cf-4c14-b44f-1a52d9625216 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:34.069831 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-db11de2b-e5cf-4c14-b44f-1a52d9625216 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:34.078829 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-db11de2b-e5cf-4c14-b44f-1a52d9625216 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1674 microversion: 2.1 time: 0.221716 Jul 25 15:24:34.080012 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3695/7163] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:33 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1674 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:35.103131 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-34ebf2df-e24e-4169-9d97-dd3cc8ac9271 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:35.103929 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-34ebf2df-e24e-4169-9d97-dd3cc8ac9271 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:35.113502 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-34ebf2df-e24e-4169-9d97-dd3cc8ac9271 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:35.114018 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-34ebf2df-e24e-4169-9d97-dd3cc8ac9271 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:35.114972 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-34ebf2df-e24e-4169-9d97-dd3cc8ac9271 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:35.115426 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-34ebf2df-e24e-4169-9d97-dd3cc8ac9271 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:35.278689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-34ebf2df-e24e-4169-9d97-dd3cc8ac9271 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:35.286543 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-34ebf2df-e24e-4169-9d97-dd3cc8ac9271 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1674 microversion: 2.1 time: 0.189106 Jul 25 15:24:35.287126 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3469/7164] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:35 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1674 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:36.268023 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-27038e76-331e-4f36-a63f-880c32a14aec req-04523fba-055e-4a9d-be75-3513fe43464e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ccda193-9fa9-4bde-94d1-3071131ed567", "name": "network-vif-plugged", "status": "completed", "tag": "40e4d031-7043-4995-b2d8-264b680a3398"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:24:36.278074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-27038e76-331e-4f36-a63f-880c32a14aec req-04523fba-055e-4a9d-be75-3513fe43464e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:36.278518 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-27038e76-331e-4f36-a63f-880c32a14aec req-04523fba-055e-4a9d-be75-3513fe43464e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:36.290961 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-27038e76-331e-4f36-a63f-880c32a14aec req-04523fba-055e-4a9d-be75-3513fe43464e service nova] Creating event network-vif-plugged:40e4d031-7043-4995-b2d8-264b680a3398 for instance 8ccda193-9fa9-4bde-94d1-3071131ed567 on n-h2-846435-14 Jul 25 15:24:36.297745 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [req-27038e76-331e-4f36-a63f-880c32a14aec req-04523fba-055e-4a9d-be75-3513fe43464e service nova] Instance 8ccda193-9fa9-4bde-94d1-3071131ed567 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119304) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 15:24:36.306936 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0fae78c0-d51f-44a4-badf-fedd9934c699 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:36.307618 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0fae78c0-d51f-44a4-badf-fedd9934c699 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:36.309441 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-27038e76-331e-4f36-a63f-880c32a14aec req-04523fba-055e-4a9d-be75-3513fe43464e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097018 Jul 25 15:24:36.310097 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3696/7165] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:24:36.315212 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0fae78c0-d51f-44a4-badf-fedd9934c699 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:36.315674 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0fae78c0-d51f-44a4-badf-fedd9934c699 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:36.316492 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0fae78c0-d51f-44a4-badf-fedd9934c699 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:36.317103 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0fae78c0-d51f-44a4-badf-fedd9934c699 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:36.469984 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0fae78c0-d51f-44a4-badf-fedd9934c699 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:36.478888 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0fae78c0-d51f-44a4-badf-fedd9934c699 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1674 microversion: 2.1 time: 0.175767 Jul 25 15:24:36.479523 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3470/7166] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:36 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1674 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:37.282010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-aa49cfc9-f800-49dd-b622-f11d94820dc8 req-36dac3be-28ec-447b-afb6-759732e87630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ccda193-9fa9-4bde-94d1-3071131ed567", "name": "network-vif-unplugged", "status": "completed", "tag": "40e4d031-7043-4995-b2d8-264b680a3398"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:24:37.297088 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-aa49cfc9-f800-49dd-b622-f11d94820dc8 req-36dac3be-28ec-447b-afb6-759732e87630 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:37.297493 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-aa49cfc9-f800-49dd-b622-f11d94820dc8 req-36dac3be-28ec-447b-afb6-759732e87630 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:37.311262 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-aa49cfc9-f800-49dd-b622-f11d94820dc8 req-36dac3be-28ec-447b-afb6-759732e87630 service nova] Creating event network-vif-unplugged:40e4d031-7043-4995-b2d8-264b680a3398 for instance 8ccda193-9fa9-4bde-94d1-3071131ed567 on n-h1-846435-14 Jul 25 15:24:37.317940 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [req-aa49cfc9-f800-49dd-b622-f11d94820dc8 req-36dac3be-28ec-447b-afb6-759732e87630 service nova] Instance 8ccda193-9fa9-4bde-94d1-3071131ed567 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119304) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 15:24:37.329617 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-aa49cfc9-f800-49dd-b622-f11d94820dc8 req-36dac3be-28ec-447b-afb6-759732e87630 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107605 Jul 25 15:24:37.330484 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3697/7167] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:24:37.501391 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-45ae5903-e42a-481f-859d-534dfcdb8bc4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:37.501933 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-45ae5903-e42a-481f-859d-534dfcdb8bc4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:37.509081 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-45ae5903-e42a-481f-859d-534dfcdb8bc4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:37.509534 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-45ae5903-e42a-481f-859d-534dfcdb8bc4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:37.510364 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-45ae5903-e42a-481f-859d-534dfcdb8bc4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:37.510792 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-45ae5903-e42a-481f-859d-534dfcdb8bc4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:37.764773 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-45ae5903-e42a-481f-859d-534dfcdb8bc4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:37.773070 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-45ae5903-e42a-481f-859d-534dfcdb8bc4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1674 microversion: 2.1 time: 0.275609 Jul 25 15:24:37.773655 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3471/7168] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:37 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1674 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:38.797403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6e140224-b1da-4d01-99c5-c79d5e71eaff tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:38.798150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6e140224-b1da-4d01-99c5-c79d5e71eaff tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:38.805014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e140224-b1da-4d01-99c5-c79d5e71eaff tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:38.805470 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e140224-b1da-4d01-99c5-c79d5e71eaff tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:38.806245 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e140224-b1da-4d01-99c5-c79d5e71eaff tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:38.806742 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6e140224-b1da-4d01-99c5-c79d5e71eaff tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:38.947984 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6e140224-b1da-4d01-99c5-c79d5e71eaff tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:38.956758 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6e140224-b1da-4d01-99c5-c79d5e71eaff tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1674 microversion: 2.1 time: 0.164442 Jul 25 15:24:38.957466 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3698/7169] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:38 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:39.355517 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-81b5de39-1afc-4796-9564-f6beeaa82e43 req-bd95f0fe-0233-40be-9810-8b9b680660e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ccda193-9fa9-4bde-94d1-3071131ed567", "tag": "40e4d031-7043-4995-b2d8-264b680a3398"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:24:39.361065 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:24:39.370532 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-81b5de39-1afc-4796-9564-f6beeaa82e43 req-bd95f0fe-0233-40be-9810-8b9b680660e8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:39.371012 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-81b5de39-1afc-4796-9564-f6beeaa82e43 req-bd95f0fe-0233-40be-9810-8b9b680660e8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:39.384658 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-81b5de39-1afc-4796-9564-f6beeaa82e43 req-bd95f0fe-0233-40be-9810-8b9b680660e8 service nova] Creating event network-changed:40e4d031-7043-4995-b2d8-264b680a3398 for instance 8ccda193-9fa9-4bde-94d1-3071131ed567 on n-h1-846435-14 Jul 25 15:24:39.390695 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [req-81b5de39-1afc-4796-9564-f6beeaa82e43 req-bd95f0fe-0233-40be-9810-8b9b680660e8 service nova] Instance 8ccda193-9fa9-4bde-94d1-3071131ed567 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119303) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 15:24:39.401761 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-81b5de39-1afc-4796-9564-f6beeaa82e43 req-bd95f0fe-0233-40be-9810-8b9b680660e8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052403 Jul 25 15:24:39.402394 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3472/7170] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:24:39.979948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-75724522-02a2-44ec-abe9-1ad304bfe27a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:39.980594 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-75724522-02a2-44ec-abe9-1ad304bfe27a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:39.983677 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=33 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:24:40.001050 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75724522-02a2-44ec-abe9-1ad304bfe27a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:40.001864 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75724522-02a2-44ec-abe9-1ad304bfe27a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:40.003750 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75724522-02a2-44ec-abe9-1ad304bfe27a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:40.006606 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75724522-02a2-44ec-abe9-1ad304bfe27a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:40.014278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=91 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:24:40.224380 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-75724522-02a2-44ec-abe9-1ad304bfe27a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:40.233166 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-75724522-02a2-44ec-abe9-1ad304bfe27a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1667 microversion: 2.1 time: 0.257358 Jul 25 15:24:40.233928 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3699/7171] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:39 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1667 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:40.275254 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1131cd55-24f6-4f50-923a-c395f3c23fdf tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:40.277456 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1131cd55-24f6-4f50-923a-c395f3c23fdf tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:40.290917 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1131cd55-24f6-4f50-923a-c395f3c23fdf tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:40.292142 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1131cd55-24f6-4f50-923a-c395f3c23fdf tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:40.294847 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1131cd55-24f6-4f50-923a-c395f3c23fdf tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:40.295644 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1131cd55-24f6-4f50-923a-c395f3c23fdf tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:40.449148 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1131cd55-24f6-4f50-923a-c395f3c23fdf tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:40.457499 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1131cd55-24f6-4f50-923a-c395f3c23fdf tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1667 microversion: 2.1 time: 0.190763 Jul 25 15:24:40.458102 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3473/7172] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:40 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1667 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:40.479685 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-355a47c0-6f38-47e1-9f93-6d5e32f1ce77 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:40.480387 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-355a47c0-6f38-47e1-9f93-6d5e32f1ce77 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:40.487085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-355a47c0-6f38-47e1-9f93-6d5e32f1ce77 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:40.487521 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-355a47c0-6f38-47e1-9f93-6d5e32f1ce77 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:40.488352 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-355a47c0-6f38-47e1-9f93-6d5e32f1ce77 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:40.488809 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-355a47c0-6f38-47e1-9f93-6d5e32f1ce77 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:40.635904 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-355a47c0-6f38-47e1-9f93-6d5e32f1ce77 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:40.644872 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-355a47c0-6f38-47e1-9f93-6d5e32f1ce77 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1667 microversion: 2.1 time: 0.169412 Jul 25 15:24:40.645397 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3700/7173] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:40 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1667 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:40.665738 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d89faf18-e281-4d32-ae97-6509a8202663 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:40.666362 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d89faf18-e281-4d32-ae97-6509a8202663 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:40.673215 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d89faf18-e281-4d32-ae97-6509a8202663 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:40.673677 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d89faf18-e281-4d32-ae97-6509a8202663 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:40.674480 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d89faf18-e281-4d32-ae97-6509a8202663 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:40.674918 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d89faf18-e281-4d32-ae97-6509a8202663 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:40.702922 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d89faf18-e281-4d32-ae97-6509a8202663 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:24:40.787501 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d89faf18-e281-4d32-ae97-6509a8202663 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "DELETE /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 204 len: 0 microversion: 2.1 time: 0.125372 Jul 25 15:24:40.788186 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3474/7174] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:24:40 2022] DELETE /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:24:40.797475 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a9f0b13a-6883-4b9b-b5ba-c7a1a037879c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:40.798112 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a9f0b13a-6883-4b9b-b5ba-c7a1a037879c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:40.805077 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a9f0b13a-6883-4b9b-b5ba-c7a1a037879c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:40.805545 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a9f0b13a-6883-4b9b-b5ba-c7a1a037879c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:40.806331 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a9f0b13a-6883-4b9b-b5ba-c7a1a037879c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:40.806856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a9f0b13a-6883-4b9b-b5ba-c7a1a037879c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:40.948218 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a9f0b13a-6883-4b9b-b5ba-c7a1a037879c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:40.956435 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a9f0b13a-6883-4b9b-b5ba-c7a1a037879c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1673 microversion: 2.1 time: 0.162889 Jul 25 15:24:40.957053 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3701/7175] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:40 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:41.785505 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-100c7a1c-491d-44b7-8eed-d28ba1a81d58 req-6779f82f-6610-4d21-97ce-76d91f216109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ccda193-9fa9-4bde-94d1-3071131ed567", "name": "network-vif-plugged", "status": "completed", "tag": "40e4d031-7043-4995-b2d8-264b680a3398"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:24:41.806333 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-100c7a1c-491d-44b7-8eed-d28ba1a81d58 req-6779f82f-6610-4d21-97ce-76d91f216109 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:41.806846 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-100c7a1c-491d-44b7-8eed-d28ba1a81d58 req-6779f82f-6610-4d21-97ce-76d91f216109 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:41.822410 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-100c7a1c-491d-44b7-8eed-d28ba1a81d58 req-6779f82f-6610-4d21-97ce-76d91f216109 service nova] Creating event network-vif-plugged:40e4d031-7043-4995-b2d8-264b680a3398 for instance 8ccda193-9fa9-4bde-94d1-3071131ed567 on n-h1-846435-14 Jul 25 15:24:41.827823 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-100c7a1c-491d-44b7-8eed-d28ba1a81d58 req-6779f82f-6610-4d21-97ce-76d91f216109 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046436 Jul 25 15:24:41.828638 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3475/7176] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:24:41.982013 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fe5a4832-2a20-447c-91b2-0a2cbdf00980 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:41.983181 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fe5a4832-2a20-447c-91b2-0a2cbdf00980 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:41.995584 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fe5a4832-2a20-447c-91b2-0a2cbdf00980 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:41.996451 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fe5a4832-2a20-447c-91b2-0a2cbdf00980 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:41.997840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fe5a4832-2a20-447c-91b2-0a2cbdf00980 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:41.998551 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fe5a4832-2a20-447c-91b2-0a2cbdf00980 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:42.162750 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fe5a4832-2a20-447c-91b2-0a2cbdf00980 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:42.178741 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fe5a4832-2a20-447c-91b2-0a2cbdf00980 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1673 microversion: 2.1 time: 0.203730 Jul 25 15:24:42.180038 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3702/7177] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:41 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1673 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:43.003311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-2873dda4-fbb7-45fb-acc7-55baaf4e8ce7 req-fd118528-f33c-45a8-bc09-bb8268281188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ccda193-9fa9-4bde-94d1-3071131ed567", "name": "network-vif-deleted", "tag": "40e4d031-7043-4995-b2d8-264b680a3398"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:24:43.013768 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-2873dda4-fbb7-45fb-acc7-55baaf4e8ce7 req-fd118528-f33c-45a8-bc09-bb8268281188 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:43.014219 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-2873dda4-fbb7-45fb-acc7-55baaf4e8ce7 req-fd118528-f33c-45a8-bc09-bb8268281188 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:43.026933 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-2873dda4-fbb7-45fb-acc7-55baaf4e8ce7 req-fd118528-f33c-45a8-bc09-bb8268281188 service nova] Creating event network-vif-deleted:40e4d031-7043-4995-b2d8-264b680a3398 for instance 8ccda193-9fa9-4bde-94d1-3071131ed567 on n-h1-846435-14 Jul 25 15:24:43.033755 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-2873dda4-fbb7-45fb-acc7-55baaf4e8ce7 req-fd118528-f33c-45a8-bc09-bb8268281188 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035717 Jul 25 15:24:43.034404 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3476/7178] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:24:43.203637 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-89e2932a-eb27-4928-a971-91b9601259ae tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:43.204333 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-89e2932a-eb27-4928-a971-91b9601259ae tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:43.216536 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-89e2932a-eb27-4928-a971-91b9601259ae tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:43.217009 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-89e2932a-eb27-4928-a971-91b9601259ae tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:43.217818 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-89e2932a-eb27-4928-a971-91b9601259ae tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:43.218313 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-89e2932a-eb27-4928-a971-91b9601259ae tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:43.252679 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-89e2932a-eb27-4928-a971-91b9601259ae tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:43.253120 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-89e2932a-eb27-4928-a971-91b9601259ae tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:43.253597 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-89e2932a-eb27-4928-a971-91b9601259ae tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lazy-loading 'fault' on Instance uuid 8ccda193-9fa9-4bde-94d1-3071131ed567 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:24:43.296504 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-89e2932a-eb27-4928-a971-91b9601259ae tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:43.304685 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-89e2932a-eb27-4928-a971-91b9601259ae tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 200 len: 1327 microversion: 2.1 time: 0.105530 Jul 25 15:24:43.305327 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3703/7179] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:43 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 1327 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:44.324275 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:24:44.330097 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-60e86587-f2e3-4b22-be57-1221dcc794fa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:44.330833 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-60e86587-f2e3-4b22-be57-1221dcc794fa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:44.338597 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-60e86587-f2e3-4b22-be57-1221dcc794fa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:44.339079 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-60e86587-f2e3-4b22-be57-1221dcc794fa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:44.339873 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-60e86587-f2e3-4b22-be57-1221dcc794fa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:44.340315 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-60e86587-f2e3-4b22-be57-1221dcc794fa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:44.356276 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-60e86587-f2e3-4b22-be57-1221dcc794fa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] HTTP exception thrown: Instance 8ccda193-9fa9-4bde-94d1-3071131ed567 could not be found. Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-60e86587-f2e3-4b22-be57-1221dcc794fa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Request method failure captured: Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 HTTP/1.1 Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rSjEyisMD8DvTH7b56ad3M9V4r9Z2oHgANxXbb97f0WFMCsa1v0ECdPWSwcD3bin0DxN2VyKMiUlFTU-JUG9Ua6IQiCvvNBHc0-kGj7SnhEHtthZB_ln1XXzCzW_WOLiNqJwI6WQfWOze_2VM1L7b9fm_wuF4gcUsql3_EhcnWK2us Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 90120379bd914d71996458c1e2a3e25a Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServerActionsTestJSON-741053275 Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90120379bd914d71996458c1e2a3e25a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90120379bd914d71996458c1e2a3e25a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_90120379bd914d71996458c1e2a3e25a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/90120379bd914d71996458c1e2a3e25a"}]}] Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServerActionsTestJSON-741053275 Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 90120379bd914d71996458c1e2a3e25a Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServerActionsTestJSON-741053275 Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServerActionsTestJSON-741053275-project Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 6a742410e1794902a11125c6369dadcc Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServerActionsTestJSON-741053275-project Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 8ccda193-9fa9-4bde-94d1-3071131ed567 could not be found. Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '8ccda193-9fa9-4bde-94d1-3071131ed567'} Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ccda193-9fa9-4bde-94d1-3071131ed567 could not be found. Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ccda193-9fa9-4bde-94d1-3071131ed567 could not be found. Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:24:44.358000 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:24:44.362478 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:24:44.362478 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:24:44.362478 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:24:44.362478 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:24:44.362478 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:24:44.362478 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ccda193-9fa9-4bde-94d1-3071131ed567 could not be found. Jul 25 15:24:44.362478 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:24:44.362478 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-60e86587-f2e3-4b22-be57-1221dcc794fa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Returning 404 to user: Instance 8ccda193-9fa9-4bde-94d1-3071131ed567 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:24:44.362478 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-60e86587-f2e3-4b22-be57-1221dcc794fa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 404 len: 111 microversion: 2.1 time: 0.036402 Jul 25 15:24:44.362478 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3477/7180] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:44 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:24:44.380112 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0823a7b7-9667-42c1-bddc-1ef53f47755f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:44.380838 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0823a7b7-9667-42c1-bddc-1ef53f47755f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:44.389035 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0823a7b7-9667-42c1-bddc-1ef53f47755f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:44.389510 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0823a7b7-9667-42c1-bddc-1ef53f47755f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:44.390305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0823a7b7-9667-42c1-bddc-1ef53f47755f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:44.390745 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0823a7b7-9667-42c1-bddc-1ef53f47755f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:44.406557 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-0823a7b7-9667-42c1-bddc-1ef53f47755f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] HTTP exception thrown: Instance 8ccda193-9fa9-4bde-94d1-3071131ed567 could not be found. Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0823a7b7-9667-42c1-bddc-1ef53f47755f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Request method failure captured: Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 HTTP/1.1 Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3rSjEyisMD8DvTH7b56ad3M9V4r9Z2oHgANxXbb97f0WFMCsa1v0ECdPWSwcD3bin0DxN2VyKMiUlFTU-JUG9Ua6IQiCvvNBHc0-kGj7SnhEHtthZB_ln1XXzCzW_WOLiNqJwI6WQfWOze_2VM1L7b9fm_wuF4gcUsql3_EhcnWK2us Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 90120379bd914d71996458c1e2a3e25a Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerActionsTestJSON-741053275 Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90120379bd914d71996458c1e2a3e25a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90120379bd914d71996458c1e2a3e25a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_90120379bd914d71996458c1e2a3e25a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/90120379bd914d71996458c1e2a3e25a"}]}] Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerActionsTestJSON-741053275 Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 90120379bd914d71996458c1e2a3e25a Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerActionsTestJSON-741053275 Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerActionsTestJSON-741053275-project Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 6a742410e1794902a11125c6369dadcc Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerActionsTestJSON-741053275-project Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 8ccda193-9fa9-4bde-94d1-3071131ed567 could not be found. Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '8ccda193-9fa9-4bde-94d1-3071131ed567'} Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ccda193-9fa9-4bde-94d1-3071131ed567 could not be found. Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ccda193-9fa9-4bde-94d1-3071131ed567 could not be found. Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:24:44.408358 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:24:44.413053 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:24:44.413053 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:24:44.413053 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:24:44.413053 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:24:44.413053 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:24:44.413053 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ccda193-9fa9-4bde-94d1-3071131ed567 could not be found. Jul 25 15:24:44.413053 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:24:44.413053 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0823a7b7-9667-42c1-bddc-1ef53f47755f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Returning 404 to user: Instance 8ccda193-9fa9-4bde-94d1-3071131ed567 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:24:44.413053 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0823a7b7-9667-42c1-bddc-1ef53f47755f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 404 len: 111 microversion: 2.1 time: 0.033858 Jul 25 15:24:44.413053 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3704/7181] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:44 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:24:44.529074 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e88554e6-ea2a-4e6b-83e8-5202646762d8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1469557695", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "b4e47936-6173-467e-b28c-3bb5bcb99e64"}], "security_groups": [{"name": "tempest-securitygroup--395729731"}], "key_name": "tempest-keypair-720982627", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:24:44.658343 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-e88554e6-ea2a-4e6b-83e8-5202646762d8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] validate_networks() for [('b4e47936-6173-467e-b28c-3bb5bcb99e64', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:24:45.156054 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-e88554e6-ea2a-4e6b-83e8-5202646762d8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:24:45.157175 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-e88554e6-ea2a-4e6b-83e8-5202646762d8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:24:45.158217 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-e88554e6-ea2a-4e6b-83e8-5202646762d8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:24:45.160037 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-e88554e6-ea2a-4e6b-83e8-5202646762d8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:24:45.162072 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-e88554e6-ea2a-4e6b-83e8-5202646762d8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:24:45.180326 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e88554e6-ea2a-4e6b-83e8-5202646762d8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:45.180893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e88554e6-ea2a-4e6b-83e8-5202646762d8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:45.181758 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e88554e6-ea2a-4e6b-83e8-5202646762d8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:45.182196 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e88554e6-ea2a-4e6b-83e8-5202646762d8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:45.203810 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-e88554e6-ea2a-4e6b-83e8-5202646762d8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Getting quotas for project 90120379bd914d71996458c1e2a3e25a. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:24:45.209389 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-e88554e6-ea2a-4e6b-83e8-5202646762d8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Getting quotas for user 6a742410e1794902a11125c6369dadcc and project 90120379bd914d71996458c1e2a3e25a. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:24:45.225292 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e88554e6-ea2a-4e6b-83e8-5202646762d8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:24:45.227719 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e88554e6-ea2a-4e6b-83e8-5202646762d8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:24:45.276941 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e88554e6-ea2a-4e6b-83e8-5202646762d8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.751969 Jul 25 15:24:45.277933 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3478/7182] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:24:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:24:45.290028 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e4eb1234-309b-478c-8354-c0e54294062a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:45.290579 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e4eb1234-309b-478c-8354-c0e54294062a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:45.349778 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e4eb1234-309b-478c-8354-c0e54294062a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:45.361310 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e4eb1234-309b-478c-8354-c0e54294062a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1238 microversion: 2.1 time: 0.076141 Jul 25 15:24:45.362147 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3705/7183] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:45 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1238 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:46.387718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d9299a20-7b21-4131-abc5-5deebd47b276 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:46.389119 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d9299a20-7b21-4131-abc5-5deebd47b276 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:46.399460 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d9299a20-7b21-4131-abc5-5deebd47b276 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:46.400729 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d9299a20-7b21-4131-abc5-5deebd47b276 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:46.402174 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d9299a20-7b21-4131-abc5-5deebd47b276 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:46.402902 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d9299a20-7b21-4131-abc5-5deebd47b276 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:46.481735 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d9299a20-7b21-4131-abc5-5deebd47b276 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:46.491874 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d9299a20-7b21-4131-abc5-5deebd47b276 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1308 microversion: 2.1 time: 0.111694 Jul 25 15:24:46.492625 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3479/7184] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:46 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1308 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:47.514955 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6235eafe-1ff4-4285-a740-e149f3bc8924 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:47.516600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6235eafe-1ff4-4285-a740-e149f3bc8924 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:47.528916 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6235eafe-1ff4-4285-a740-e149f3bc8924 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:47.529386 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6235eafe-1ff4-4285-a740-e149f3bc8924 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:47.530197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6235eafe-1ff4-4285-a740-e149f3bc8924 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:47.530866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6235eafe-1ff4-4285-a740-e149f3bc8924 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:47.807109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6235eafe-1ff4-4285-a740-e149f3bc8924 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:47.815248 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6235eafe-1ff4-4285-a740-e149f3bc8924 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1363 microversion: 2.1 time: 0.304470 Jul 25 15:24:47.815846 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3706/7185] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:47 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1363 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:48.228965 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-e0d5c6c1-b73b-4f8b-95f6-f961f3806b30 req-6598cec0-f254-418c-91b5-026f6b6f31d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bade690-6b63-482c-a463-652f8c56268f", "tag": "955f63b4-e29d-4710-911c-c902791af379"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:24:48.246322 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-e0d5c6c1-b73b-4f8b-95f6-f961f3806b30 req-6598cec0-f254-418c-91b5-026f6b6f31d0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:48.246768 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-e0d5c6c1-b73b-4f8b-95f6-f961f3806b30 req-6598cec0-f254-418c-91b5-026f6b6f31d0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:48.261575 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-e0d5c6c1-b73b-4f8b-95f6-f961f3806b30 req-6598cec0-f254-418c-91b5-026f6b6f31d0 service nova] Creating event network-changed:955f63b4-e29d-4710-911c-c902791af379 for instance 8bade690-6b63-482c-a463-652f8c56268f on n-h2-846435-14 Jul 25 15:24:48.266723 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-e0d5c6c1-b73b-4f8b-95f6-f961f3806b30 req-6598cec0-f254-418c-91b5-026f6b6f31d0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047177 Jul 25 15:24:48.267910 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3480/7186] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:24:48.841874 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7a414a65-a629-4129-adf7-de4d648ad155 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:48.843046 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7a414a65-a629-4129-adf7-de4d648ad155 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:48.855144 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a414a65-a629-4129-adf7-de4d648ad155 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:48.855841 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a414a65-a629-4129-adf7-de4d648ad155 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:48.857708 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a414a65-a629-4129-adf7-de4d648ad155 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:48.858627 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a414a65-a629-4129-adf7-de4d648ad155 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:49.025426 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7a414a65-a629-4129-adf7-de4d648ad155 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:49.033270 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7a414a65-a629-4129-adf7-de4d648ad155 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1363 microversion: 2.1 time: 0.199421 Jul 25 15:24:49.033859 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3707/7187] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:48 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:50.056766 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-905cb654-eda1-4d48-b4ab-cb062a0a54b0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:50.057435 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-905cb654-eda1-4d48-b4ab-cb062a0a54b0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:50.064839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-905cb654-eda1-4d48-b4ab-cb062a0a54b0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:50.065293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-905cb654-eda1-4d48-b4ab-cb062a0a54b0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:50.066093 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-905cb654-eda1-4d48-b4ab-cb062a0a54b0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:50.066586 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-905cb654-eda1-4d48-b4ab-cb062a0a54b0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:50.208073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-905cb654-eda1-4d48-b4ab-cb062a0a54b0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:50.216328 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-905cb654-eda1-4d48-b4ab-cb062a0a54b0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1363 microversion: 2.1 time: 0.164807 Jul 25 15:24:50.216893 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3481/7188] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:50 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:51.238236 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a2b5f41c-ed3a-4f56-9da7-4df471b6302a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:51.238904 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a2b5f41c-ed3a-4f56-9da7-4df471b6302a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:51.246623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a2b5f41c-ed3a-4f56-9da7-4df471b6302a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:51.246988 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a2b5f41c-ed3a-4f56-9da7-4df471b6302a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:51.247792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a2b5f41c-ed3a-4f56-9da7-4df471b6302a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:51.248257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a2b5f41c-ed3a-4f56-9da7-4df471b6302a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:51.411922 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a2b5f41c-ed3a-4f56-9da7-4df471b6302a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:51.420147 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a2b5f41c-ed3a-4f56-9da7-4df471b6302a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1363 microversion: 2.1 time: 0.186079 Jul 25 15:24:51.420739 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3708/7189] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:51 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:52.442219 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6e08407c-ea96-4395-9d98-aaee49f983f4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:52.442811 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6e08407c-ea96-4395-9d98-aaee49f983f4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:52.451329 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e08407c-ea96-4395-9d98-aaee49f983f4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:52.451855 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e08407c-ea96-4395-9d98-aaee49f983f4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:52.452691 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e08407c-ea96-4395-9d98-aaee49f983f4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:52.453107 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e08407c-ea96-4395-9d98-aaee49f983f4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:52.595704 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6e08407c-ea96-4395-9d98-aaee49f983f4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:52.603635 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6e08407c-ea96-4395-9d98-aaee49f983f4 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1363 microversion: 2.1 time: 0.165303 Jul 25 15:24:52.604311 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3482/7190] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:52 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:53.625000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2981918e-1bb9-4b4f-98df-d8c25b8c6f53 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:53.625998 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2981918e-1bb9-4b4f-98df-d8c25b8c6f53 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:53.634228 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2981918e-1bb9-4b4f-98df-d8c25b8c6f53 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:53.634848 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2981918e-1bb9-4b4f-98df-d8c25b8c6f53 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:53.635661 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2981918e-1bb9-4b4f-98df-d8c25b8c6f53 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:53.636145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2981918e-1bb9-4b4f-98df-d8c25b8c6f53 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:53.787171 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2981918e-1bb9-4b4f-98df-d8c25b8c6f53 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:53.795259 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2981918e-1bb9-4b4f-98df-d8c25b8c6f53 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1363 microversion: 2.1 time: 0.174203 Jul 25 15:24:53.795837 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3709/7191] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:53 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:54.208614 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-b97115ea-fef1-4ade-a1b3-2b7c99dae3c4 req-0504e476-7153-4751-8903-c1dad5b2cdc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bade690-6b63-482c-a463-652f8c56268f", "name": "network-vif-plugged", "status": "completed", "tag": "955f63b4-e29d-4710-911c-c902791af379"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:24:54.221969 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b97115ea-fef1-4ade-a1b3-2b7c99dae3c4 req-0504e476-7153-4751-8903-c1dad5b2cdc4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:54.222877 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b97115ea-fef1-4ade-a1b3-2b7c99dae3c4 req-0504e476-7153-4751-8903-c1dad5b2cdc4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:54.236160 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-b97115ea-fef1-4ade-a1b3-2b7c99dae3c4 req-0504e476-7153-4751-8903-c1dad5b2cdc4 service nova] Creating event network-vif-plugged:955f63b4-e29d-4710-911c-c902791af379 for instance 8bade690-6b63-482c-a463-652f8c56268f on n-h2-846435-14 Jul 25 15:24:54.243222 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-b97115ea-fef1-4ade-a1b3-2b7c99dae3c4 req-0504e476-7153-4751-8903-c1dad5b2cdc4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037781 Jul 25 15:24:54.243550 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3483/7192] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:24:54.816999 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-90f2b0e3-663c-403e-be09-59bac2817865 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:54.817541 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-90f2b0e3-663c-403e-be09-59bac2817865 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:54.824949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-90f2b0e3-663c-403e-be09-59bac2817865 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:54.825424 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-90f2b0e3-663c-403e-be09-59bac2817865 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:54.826194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-90f2b0e3-663c-403e-be09-59bac2817865 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:54.826636 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-90f2b0e3-663c-403e-be09-59bac2817865 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:54.961125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-90f2b0e3-663c-403e-be09-59bac2817865 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:54.969260 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-90f2b0e3-663c-403e-be09-59bac2817865 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1363 microversion: 2.1 time: 0.156286 Jul 25 15:24:54.969835 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3710/7193] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:54 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:55.988135 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:24:55.989685 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:24:55.993727 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8bcaba97-e271-4326-a993-d8ae4d82b567 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:55.994438 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8bcaba97-e271-4326-a993-d8ae4d82b567 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:56.001963 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8bcaba97-e271-4326-a993-d8ae4d82b567 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:56.002410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8bcaba97-e271-4326-a993-d8ae4d82b567 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:56.003174 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8bcaba97-e271-4326-a993-d8ae4d82b567 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:56.003606 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8bcaba97-e271-4326-a993-d8ae4d82b567 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:56.138558 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8bcaba97-e271-4326-a993-d8ae4d82b567 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:24:56.146645 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8bcaba97-e271-4326-a993-d8ae4d82b567 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1550 microversion: 2.1 time: 0.159572 Jul 25 15:24:56.147235 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3484/7194] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:24:55 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1550 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:24:56.167617 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-504c96a1-b1ea-4ab9-8dac-b09a043e9ce2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:24:56.168218 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-504c96a1-b1ea-4ab9-8dac-b09a043e9ce2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:24:56.170232 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:24:56.176539 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-504c96a1-b1ea-4ab9-8dac-b09a043e9ce2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:56.177042 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-504c96a1-b1ea-4ab9-8dac-b09a043e9ce2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:56.177915 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-504c96a1-b1ea-4ab9-8dac-b09a043e9ce2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:56.178532 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-504c96a1-b1ea-4ab9-8dac-b09a043e9ce2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:56.264955 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-504c96a1-b1ea-4ab9-8dac-b09a043e9ce2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101299 Jul 25 15:24:56.265554 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3711/7195] 10.222.0.88 () {58 vars in 1275 bytes} [Mon Jul 25 15:24:56 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:24:57.511783 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-58be00d8-52a2-4857-b27f-414af7632243 req-8fb8a5e6-c8b8-4ef1-ae40-70bfe10572e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bade690-6b63-482c-a463-652f8c56268f", "tag": "955f63b4-e29d-4710-911c-c902791af379"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:24:57.521864 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-58be00d8-52a2-4857-b27f-414af7632243 req-8fb8a5e6-c8b8-4ef1-ae40-70bfe10572e8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:24:57.522311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-58be00d8-52a2-4857-b27f-414af7632243 req-8fb8a5e6-c8b8-4ef1-ae40-70bfe10572e8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:24:57.534310 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-58be00d8-52a2-4857-b27f-414af7632243 req-8fb8a5e6-c8b8-4ef1-ae40-70bfe10572e8 service nova] Creating event network-changed:955f63b4-e29d-4710-911c-c902791af379 for instance 8bade690-6b63-482c-a463-652f8c56268f on n-h2-846435-14 Jul 25 15:24:57.539258 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-58be00d8-52a2-4857-b27f-414af7632243 req-8fb8a5e6-c8b8-4ef1-ae40-70bfe10572e8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032439 Jul 25 15:24:57.539964 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3485/7196] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:25:31.189228 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 15:25:31.190608 n-d-846435-14 devstack@n-api.service[119303]: Mon Jul 25 15:25:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 15:25:33.034260 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 15:25:33.034260 n-d-846435-14 devstack@n-api.service[119304]: Mon Jul 25 15:25:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 15:26:11.952819 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=29 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:26:11.953640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=67 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:26:11.958727 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b3ae8342-de90-45a8-abdb-a2a8c7119a52 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:11.959371 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b3ae8342-de90-45a8-abdb-a2a8c7119a52 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:11.969502 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b3ae8342-de90-45a8-abdb-a2a8c7119a52 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:11.969967 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b3ae8342-de90-45a8-abdb-a2a8c7119a52 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:11.970765 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b3ae8342-de90-45a8-abdb-a2a8c7119a52 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:11.971207 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b3ae8342-de90-45a8-abdb-a2a8c7119a52 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:12.124487 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b3ae8342-de90-45a8-abdb-a2a8c7119a52 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:12.132994 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b3ae8342-de90-45a8-abdb-a2a8c7119a52 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1669 microversion: 2.1 time: 0.182654 Jul 25 15:26:12.133633 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3712/7197] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:11 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1669 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:26:12.161240 n-d-846435-14 devstack@n-api.service[119303]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b24320cd-02fe-4cda-9e22-8ff297cb0d9a] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 15:26:12.163009 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:26:12.164102 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:26:12.169643 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3f9fcbeb-fe9a-42ae-81ab-2b4fde7250cc tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5861a19f-a0b2-476c-95cf-848c86a96456"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:26:12.173330 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3f9fcbeb-fe9a-42ae-81ab-2b4fde7250cc tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:12.185859 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3f9fcbeb-fe9a-42ae-81ab-2b4fde7250cc tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:12.186483 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3f9fcbeb-fe9a-42ae-81ab-2b4fde7250cc tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:12.187598 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3f9fcbeb-fe9a-42ae-81ab-2b4fde7250cc tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:12.188204 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3f9fcbeb-fe9a-42ae-81ab-2b4fde7250cc tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:12.478074 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3f9fcbeb-fe9a-42ae-81ab-2b4fde7250cc tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "POST /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318949 Jul 25 15:26:12.478784 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3486/7198] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Jul 25 15:26:12 2022] POST /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:26:23.247916 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-73dcb1fb-aee1-4725-b458-52a24d1e27c9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:26:23.250274 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-73dcb1fb-aee1-4725-b458-52a24d1e27c9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:23.252814 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:26:23.253501 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:26:23.259782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-73dcb1fb-aee1-4725-b458-52a24d1e27c9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:23.260324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-73dcb1fb-aee1-4725-b458-52a24d1e27c9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:23.261122 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-73dcb1fb-aee1-4725-b458-52a24d1e27c9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:23.261574 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-73dcb1fb-aee1-4725-b458-52a24d1e27c9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:23.291044 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-73dcb1fb-aee1-4725-b458-52a24d1e27c9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:23.298708 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-73dcb1fb-aee1-4725-b458-52a24d1e27c9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Old instance type m1.heat2, new instance type m1.heat {{(pid=119304) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 15:26:23.306436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-73dcb1fb-aee1-4725-b458-52a24d1e27c9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:26:23.306932 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-73dcb1fb-aee1-4725-b458-52a24d1e27c9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:26:23.307440 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-73dcb1fb-aee1-4725-b458-52a24d1e27c9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:26:23.307850 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-73dcb1fb-aee1-4725-b458-52a24d1e27c9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:26:23.308296 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-73dcb1fb-aee1-4725-b458-52a24d1e27c9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:26:23.378886 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-73dcb1fb-aee1-4725-b458-52a24d1e27c9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "POST /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f/action" status: 202 len: 0 microversion: 2.1 time: 0.135451 Jul 25 15:26:23.379474 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3713/7199] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:26:23 2022] POST /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:26:23.386989 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:26:23.387937 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:26:23.393338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-35234e09-6f05-43bd-8c74-11b42ab9d1bb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:23.394045 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-35234e09-6f05-43bd-8c74-11b42ab9d1bb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:23.406129 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [-] [b24320cd-02fe-4cda-9e22-8ff297cb0d9a] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 50450. Jul 25 15:26:23.410836 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-35234e09-6f05-43bd-8c74-11b42ab9d1bb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:23.411292 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-35234e09-6f05-43bd-8c74-11b42ab9d1bb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:23.412112 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-35234e09-6f05-43bd-8c74-11b42ab9d1bb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:23.412550 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-35234e09-6f05-43bd-8c74-11b42ab9d1bb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:23.567178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-35234e09-6f05-43bd-8c74-11b42ab9d1bb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:23.576700 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-35234e09-6f05-43bd-8c74-11b42ab9d1bb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1724 microversion: 2.1 time: 0.192316 Jul 25 15:26:23.577295 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3487/7200] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:23 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:26:24.600640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-98851491-82c7-4eb6-899a-f2b077ff4514 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:24.601288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-98851491-82c7-4eb6-899a-f2b077ff4514 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:24.608158 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98851491-82c7-4eb6-899a-f2b077ff4514 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:24.608641 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98851491-82c7-4eb6-899a-f2b077ff4514 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:24.609454 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98851491-82c7-4eb6-899a-f2b077ff4514 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:24.610066 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98851491-82c7-4eb6-899a-f2b077ff4514 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:24.754234 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-98851491-82c7-4eb6-899a-f2b077ff4514 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:24.762856 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-98851491-82c7-4eb6-899a-f2b077ff4514 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1724 microversion: 2.1 time: 0.167490 Jul 25 15:26:24.763562 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3714/7201] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:24 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:26:25.784045 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-08111f0e-1f54-4fbc-9f85-41124f8c3c5d tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:25.784617 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-08111f0e-1f54-4fbc-9f85-41124f8c3c5d tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:25.791966 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08111f0e-1f54-4fbc-9f85-41124f8c3c5d tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:25.792537 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08111f0e-1f54-4fbc-9f85-41124f8c3c5d tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:25.793313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08111f0e-1f54-4fbc-9f85-41124f8c3c5d tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:25.793750 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08111f0e-1f54-4fbc-9f85-41124f8c3c5d tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:25.936791 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-08111f0e-1f54-4fbc-9f85-41124f8c3c5d tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:25.945603 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-08111f0e-1f54-4fbc-9f85-41124f8c3c5d tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1729 microversion: 2.1 time: 0.165650 Jul 25 15:26:25.946265 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3488/7202] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:25 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:26:26.968725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a26ceedd-55f9-462f-981c-0f5b16eabcb5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:26.969395 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a26ceedd-55f9-462f-981c-0f5b16eabcb5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:26.976562 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a26ceedd-55f9-462f-981c-0f5b16eabcb5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:26.977027 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a26ceedd-55f9-462f-981c-0f5b16eabcb5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:26.977845 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a26ceedd-55f9-462f-981c-0f5b16eabcb5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:26.978297 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a26ceedd-55f9-462f-981c-0f5b16eabcb5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:27.133184 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a26ceedd-55f9-462f-981c-0f5b16eabcb5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:27.142954 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a26ceedd-55f9-462f-981c-0f5b16eabcb5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1729 microversion: 2.1 time: 0.178214 Jul 25 15:26:27.143561 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3715/7203] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:26 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:26:28.165274 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-317cfa25-c0f4-4fa8-be2e-54fe37ccee56 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:28.165923 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-317cfa25-c0f4-4fa8-be2e-54fe37ccee56 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:28.173530 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-317cfa25-c0f4-4fa8-be2e-54fe37ccee56 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:28.173979 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-317cfa25-c0f4-4fa8-be2e-54fe37ccee56 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:28.174777 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-317cfa25-c0f4-4fa8-be2e-54fe37ccee56 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:28.175206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-317cfa25-c0f4-4fa8-be2e-54fe37ccee56 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:28.318623 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-317cfa25-c0f4-4fa8-be2e-54fe37ccee56 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:28.327448 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-317cfa25-c0f4-4fa8-be2e-54fe37ccee56 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1729 microversion: 2.1 time: 0.166169 Jul 25 15:26:28.328058 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3489/7204] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:28 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:26:29.349343 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-750f3c5c-153e-48cf-b082-ef15ed59b8b7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:29.350074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-750f3c5c-153e-48cf-b082-ef15ed59b8b7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:29.357691 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-750f3c5c-153e-48cf-b082-ef15ed59b8b7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:29.358148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-750f3c5c-153e-48cf-b082-ef15ed59b8b7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:29.358908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-750f3c5c-153e-48cf-b082-ef15ed59b8b7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:29.359319 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-750f3c5c-153e-48cf-b082-ef15ed59b8b7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:29.501558 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-750f3c5c-153e-48cf-b082-ef15ed59b8b7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:29.509961 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-750f3c5c-153e-48cf-b082-ef15ed59b8b7 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1729 microversion: 2.1 time: 0.164809 Jul 25 15:26:29.510537 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3716/7205] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:29 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:26:30.532288 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d8c668da-1032-4200-80e0-e7da89e44e1b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:30.533194 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d8c668da-1032-4200-80e0-e7da89e44e1b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:30.543108 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8c668da-1032-4200-80e0-e7da89e44e1b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:30.543589 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8c668da-1032-4200-80e0-e7da89e44e1b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:30.544389 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8c668da-1032-4200-80e0-e7da89e44e1b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:30.544844 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8c668da-1032-4200-80e0-e7da89e44e1b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:30.686889 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d8c668da-1032-4200-80e0-e7da89e44e1b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:30.695730 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d8c668da-1032-4200-80e0-e7da89e44e1b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1729 microversion: 2.1 time: 0.167513 Jul 25 15:26:30.696373 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3490/7206] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:30 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:26:31.717376 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e29ecc02-6ef8-4d1b-9501-75497eb60f42 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:31.718008 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e29ecc02-6ef8-4d1b-9501-75497eb60f42 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:31.725816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e29ecc02-6ef8-4d1b-9501-75497eb60f42 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:31.726288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e29ecc02-6ef8-4d1b-9501-75497eb60f42 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:31.727093 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e29ecc02-6ef8-4d1b-9501-75497eb60f42 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:31.727540 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e29ecc02-6ef8-4d1b-9501-75497eb60f42 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:31.869080 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e29ecc02-6ef8-4d1b-9501-75497eb60f42 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:31.877673 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e29ecc02-6ef8-4d1b-9501-75497eb60f42 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1729 microversion: 2.1 time: 0.164507 Jul 25 15:26:31.878261 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3717/7207] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:31 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:26:32.899642 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a136caaa-2040-4a1b-bbe8-c98a6956e2e2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:32.900276 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a136caaa-2040-4a1b-bbe8-c98a6956e2e2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:32.908645 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a136caaa-2040-4a1b-bbe8-c98a6956e2e2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:32.909092 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a136caaa-2040-4a1b-bbe8-c98a6956e2e2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:32.909948 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a136caaa-2040-4a1b-bbe8-c98a6956e2e2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:32.910387 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a136caaa-2040-4a1b-bbe8-c98a6956e2e2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:33.062507 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a136caaa-2040-4a1b-bbe8-c98a6956e2e2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:33.072373 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a136caaa-2040-4a1b-bbe8-c98a6956e2e2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1729 microversion: 2.1 time: 0.176895 Jul 25 15:26:33.072968 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3491/7208] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:32 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:26:34.094655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e08c2fb0-6fdd-4551-a921-ab9a58348117 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:34.095344 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e08c2fb0-6fdd-4551-a921-ab9a58348117 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:34.103268 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e08c2fb0-6fdd-4551-a921-ab9a58348117 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:34.103745 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e08c2fb0-6fdd-4551-a921-ab9a58348117 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:34.104597 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e08c2fb0-6fdd-4551-a921-ab9a58348117 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:34.105050 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e08c2fb0-6fdd-4551-a921-ab9a58348117 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:34.249431 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e08c2fb0-6fdd-4551-a921-ab9a58348117 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:34.258137 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e08c2fb0-6fdd-4551-a921-ab9a58348117 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1729 microversion: 2.1 time: 0.167503 Jul 25 15:26:34.258705 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3718/7209] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:34 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:26:35.281365 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-48b43277-db0e-42cc-b89e-ac2a5ff59730 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:35.282071 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-48b43277-db0e-42cc-b89e-ac2a5ff59730 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:35.289521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-48b43277-db0e-42cc-b89e-ac2a5ff59730 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:35.289974 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-48b43277-db0e-42cc-b89e-ac2a5ff59730 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:35.290758 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-48b43277-db0e-42cc-b89e-ac2a5ff59730 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:35.291191 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-48b43277-db0e-42cc-b89e-ac2a5ff59730 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:35.443146 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-48b43277-db0e-42cc-b89e-ac2a5ff59730 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:35.452026 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-48b43277-db0e-42cc-b89e-ac2a5ff59730 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1729 microversion: 2.1 time: 0.175340 Jul 25 15:26:35.452645 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3492/7210] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:35 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:26:36.474146 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e087675a-3ec0-447f-b292-8260185f02f2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:36.474777 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e087675a-3ec0-447f-b292-8260185f02f2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:36.482531 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e087675a-3ec0-447f-b292-8260185f02f2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:36.482994 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e087675a-3ec0-447f-b292-8260185f02f2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:36.483772 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e087675a-3ec0-447f-b292-8260185f02f2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:36.484260 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e087675a-3ec0-447f-b292-8260185f02f2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:36.627210 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e087675a-3ec0-447f-b292-8260185f02f2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:36.636468 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e087675a-3ec0-447f-b292-8260185f02f2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1729 microversion: 2.1 time: 0.166194 Jul 25 15:26:36.637055 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3719/7211] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:36 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:26:37.658698 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-484d1f7e-a665-4ea8-9376-5484de88a353 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:37.659400 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-484d1f7e-a665-4ea8-9376-5484de88a353 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:37.666804 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-484d1f7e-a665-4ea8-9376-5484de88a353 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:37.667260 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-484d1f7e-a665-4ea8-9376-5484de88a353 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:37.668066 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-484d1f7e-a665-4ea8-9376-5484de88a353 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:37.668507 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-484d1f7e-a665-4ea8-9376-5484de88a353 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:37.816799 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-484d1f7e-a665-4ea8-9376-5484de88a353 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:37.825696 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-484d1f7e-a665-4ea8-9376-5484de88a353 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1729 microversion: 2.1 time: 0.171134 Jul 25 15:26:37.826325 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3493/7212] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:37 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:26:38.849413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-53eaaf2e-1084-45f4-b51e-b41612a64afa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:38.850152 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-53eaaf2e-1084-45f4-b51e-b41612a64afa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:38.858070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-53eaaf2e-1084-45f4-b51e-b41612a64afa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:38.858618 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-53eaaf2e-1084-45f4-b51e-b41612a64afa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:38.859501 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-53eaaf2e-1084-45f4-b51e-b41612a64afa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:38.860033 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-53eaaf2e-1084-45f4-b51e-b41612a64afa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:39.009324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-53eaaf2e-1084-45f4-b51e-b41612a64afa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:39.018421 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-53eaaf2e-1084-45f4-b51e-b41612a64afa tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1729 microversion: 2.1 time: 0.174223 Jul 25 15:26:39.018995 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3720/7213] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:38 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:26:40.040410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ba9f4ee7-61c8-48d1-9e1e-cd35551e5dc2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:40.041148 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ba9f4ee7-61c8-48d1-9e1e-cd35551e5dc2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:40.048736 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ba9f4ee7-61c8-48d1-9e1e-cd35551e5dc2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:40.049065 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ba9f4ee7-61c8-48d1-9e1e-cd35551e5dc2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:40.049718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ba9f4ee7-61c8-48d1-9e1e-cd35551e5dc2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:40.050090 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ba9f4ee7-61c8-48d1-9e1e-cd35551e5dc2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:40.230442 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-dba948ac-e4ee-4421-bc3d-00f5d0851f68 req-8ad4a1cf-379b-41ac-9a6b-3f36d12d22d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bade690-6b63-482c-a463-652f8c56268f", "name": "network-vif-unplugged", "status": "completed", "tag": "955f63b4-e29d-4710-911c-c902791af379"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:26:40.242613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-dba948ac-e4ee-4421-bc3d-00f5d0851f68 req-8ad4a1cf-379b-41ac-9a6b-3f36d12d22d8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:40.243729 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-dba948ac-e4ee-4421-bc3d-00f5d0851f68 req-8ad4a1cf-379b-41ac-9a6b-3f36d12d22d8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:40.256866 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-dba948ac-e4ee-4421-bc3d-00f5d0851f68 req-8ad4a1cf-379b-41ac-9a6b-3f36d12d22d8 service nova] Creating event network-vif-unplugged:955f63b4-e29d-4710-911c-c902791af379 for instance 8bade690-6b63-482c-a463-652f8c56268f on n-h1-846435-14 Jul 25 15:26:40.263488 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [req-dba948ac-e4ee-4421-bc3d-00f5d0851f68 req-8ad4a1cf-379b-41ac-9a6b-3f36d12d22d8 service nova] Instance 8bade690-6b63-482c-a463-652f8c56268f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119304) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 15:26:40.265298 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ba9f4ee7-61c8-48d1-9e1e-cd35551e5dc2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:40.275614 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ba9f4ee7-61c8-48d1-9e1e-cd35551e5dc2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1728 microversion: 2.1 time: 0.239110 Jul 25 15:26:40.284631 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3494/7214] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:40 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1728 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:26:40.284847 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-dba948ac-e4ee-4421-bc3d-00f5d0851f68 req-8ad4a1cf-379b-41ac-9a6b-3f36d12d22d8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051040 Jul 25 15:26:40.284847 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3721/7215] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:26:41.298558 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8b05954c-49aa-40cd-b97e-8ae03698c9d9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:41.299177 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8b05954c-49aa-40cd-b97e-8ae03698c9d9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:41.306536 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b05954c-49aa-40cd-b97e-8ae03698c9d9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:41.306987 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b05954c-49aa-40cd-b97e-8ae03698c9d9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:41.307769 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b05954c-49aa-40cd-b97e-8ae03698c9d9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:41.308238 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b05954c-49aa-40cd-b97e-8ae03698c9d9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:41.451679 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8b05954c-49aa-40cd-b97e-8ae03698c9d9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:41.461229 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8b05954c-49aa-40cd-b97e-8ae03698c9d9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1728 microversion: 2.1 time: 0.166485 Jul 25 15:26:41.461895 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3495/7216] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:41 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:26:42.312354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-8081c476-fd25-438b-9f29-3b82b87cefe9 req-0130a22b-edef-45ee-ba61-26da7d07414f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bade690-6b63-482c-a463-652f8c56268f", "tag": "955f63b4-e29d-4710-911c-c902791af379"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:26:42.322789 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-8081c476-fd25-438b-9f29-3b82b87cefe9 req-0130a22b-edef-45ee-ba61-26da7d07414f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:42.323140 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-8081c476-fd25-438b-9f29-3b82b87cefe9 req-0130a22b-edef-45ee-ba61-26da7d07414f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:42.335528 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-8081c476-fd25-438b-9f29-3b82b87cefe9 req-0130a22b-edef-45ee-ba61-26da7d07414f service nova] Creating event network-changed:955f63b4-e29d-4710-911c-c902791af379 for instance 8bade690-6b63-482c-a463-652f8c56268f on n-h1-846435-14 Jul 25 15:26:42.341681 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [req-8081c476-fd25-438b-9f29-3b82b87cefe9 req-0130a22b-edef-45ee-ba61-26da7d07414f service nova] Instance 8bade690-6b63-482c-a463-652f8c56268f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119304) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 15:26:42.353158 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-8081c476-fd25-438b-9f29-3b82b87cefe9 req-0130a22b-edef-45ee-ba61-26da7d07414f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045851 Jul 25 15:26:42.353756 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3722/7217] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:26:42.486112 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3efed41a-6516-416a-bbe2-ac7a88306718 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:42.487495 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3efed41a-6516-416a-bbe2-ac7a88306718 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:42.498754 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3efed41a-6516-416a-bbe2-ac7a88306718 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:42.499386 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3efed41a-6516-416a-bbe2-ac7a88306718 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:42.500351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3efed41a-6516-416a-bbe2-ac7a88306718 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:42.501854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3efed41a-6516-416a-bbe2-ac7a88306718 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:42.757847 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3efed41a-6516-416a-bbe2-ac7a88306718 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:42.769002 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3efed41a-6516-416a-bbe2-ac7a88306718 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1726 microversion: 2.1 time: 0.288866 Jul 25 15:26:42.770341 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3496/7218] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:42 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1726 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:26:43.793996 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-811777ae-f6b4-443e-8e6c-34a0b9aa2d70 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:43.794719 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-811777ae-f6b4-443e-8e6c-34a0b9aa2d70 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:43.802285 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-811777ae-f6b4-443e-8e6c-34a0b9aa2d70 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:43.802755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-811777ae-f6b4-443e-8e6c-34a0b9aa2d70 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:43.803777 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-811777ae-f6b4-443e-8e6c-34a0b9aa2d70 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:43.804260 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-811777ae-f6b4-443e-8e6c-34a0b9aa2d70 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:43.951910 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-811777ae-f6b4-443e-8e6c-34a0b9aa2d70 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:43.960465 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-811777ae-f6b4-443e-8e6c-34a0b9aa2d70 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1726 microversion: 2.1 time: 0.171932 Jul 25 15:26:43.961066 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3723/7219] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:43 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:26:44.983269 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9a9ddbbf-2a6d-426c-bbae-5bf05db525a5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:44.983888 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9a9ddbbf-2a6d-426c-bbae-5bf05db525a5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:44.992593 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9a9ddbbf-2a6d-426c-bbae-5bf05db525a5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:44.993102 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9a9ddbbf-2a6d-426c-bbae-5bf05db525a5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:44.994284 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9a9ddbbf-2a6d-426c-bbae-5bf05db525a5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:44.994725 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9a9ddbbf-2a6d-426c-bbae-5bf05db525a5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:45.150194 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9a9ddbbf-2a6d-426c-bbae-5bf05db525a5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:45.162236 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9a9ddbbf-2a6d-426c-bbae-5bf05db525a5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1726 microversion: 2.1 time: 0.183023 Jul 25 15:26:45.172133 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3497/7220] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:44 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1726 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:26:46.197300 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-eb459299-e6c2-42a3-bc62-2dbd9805a8a2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:46.198218 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-eb459299-e6c2-42a3-bc62-2dbd9805a8a2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:46.206220 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eb459299-e6c2-42a3-bc62-2dbd9805a8a2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:46.206688 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eb459299-e6c2-42a3-bc62-2dbd9805a8a2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:46.207507 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eb459299-e6c2-42a3-bc62-2dbd9805a8a2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:46.207947 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eb459299-e6c2-42a3-bc62-2dbd9805a8a2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:46.356017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-eb459299-e6c2-42a3-bc62-2dbd9805a8a2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:46.365453 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-eb459299-e6c2-42a3-bc62-2dbd9805a8a2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1726 microversion: 2.1 time: 0.172048 Jul 25 15:26:46.366053 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3724/7221] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:46 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:26:47.387578 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a0f0873a-ee92-4309-b187-7627feb8ab97 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:47.388266 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a0f0873a-ee92-4309-b187-7627feb8ab97 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:47.396666 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a0f0873a-ee92-4309-b187-7627feb8ab97 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:47.397153 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a0f0873a-ee92-4309-b187-7627feb8ab97 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:47.397945 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a0f0873a-ee92-4309-b187-7627feb8ab97 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:47.398449 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a0f0873a-ee92-4309-b187-7627feb8ab97 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:47.550218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a0f0873a-ee92-4309-b187-7627feb8ab97 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:47.559082 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a0f0873a-ee92-4309-b187-7627feb8ab97 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1726 microversion: 2.1 time: 0.175483 Jul 25 15:26:47.559795 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3498/7222] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:47 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1726 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:26:48.582360 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e59e3868-00e7-4be6-b633-2dfc6f55fe13 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:48.583012 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e59e3868-00e7-4be6-b633-2dfc6f55fe13 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:48.590636 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e59e3868-00e7-4be6-b633-2dfc6f55fe13 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:48.591113 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e59e3868-00e7-4be6-b633-2dfc6f55fe13 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:48.591910 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e59e3868-00e7-4be6-b633-2dfc6f55fe13 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:48.592402 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e59e3868-00e7-4be6-b633-2dfc6f55fe13 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:48.739511 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e59e3868-00e7-4be6-b633-2dfc6f55fe13 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:48.750325 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e59e3868-00e7-4be6-b633-2dfc6f55fe13 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1726 microversion: 2.1 time: 0.172117 Jul 25 15:26:48.750939 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3725/7223] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:48 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:26:49.771650 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fe9ea127-aefe-464b-a29a-996ecc4f4671 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:49.772247 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fe9ea127-aefe-464b-a29a-996ecc4f4671 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:49.780001 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fe9ea127-aefe-464b-a29a-996ecc4f4671 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:49.780438 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fe9ea127-aefe-464b-a29a-996ecc4f4671 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:49.781239 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fe9ea127-aefe-464b-a29a-996ecc4f4671 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:49.781684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fe9ea127-aefe-464b-a29a-996ecc4f4671 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:49.921047 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fe9ea127-aefe-464b-a29a-996ecc4f4671 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:49.930057 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fe9ea127-aefe-464b-a29a-996ecc4f4671 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1726 microversion: 2.1 time: 0.162531 Jul 25 15:26:49.930641 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3499/7224] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:49 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:26:50.951809 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e4aa43aa-7451-4c32-827b-376f417689f2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:50.952472 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e4aa43aa-7451-4c32-827b-376f417689f2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:50.959401 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e4aa43aa-7451-4c32-827b-376f417689f2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:50.959857 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e4aa43aa-7451-4c32-827b-376f417689f2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:50.960664 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e4aa43aa-7451-4c32-827b-376f417689f2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:50.961102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e4aa43aa-7451-4c32-827b-376f417689f2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:51.115225 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e4aa43aa-7451-4c32-827b-376f417689f2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:51.124534 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e4aa43aa-7451-4c32-827b-376f417689f2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1726 microversion: 2.1 time: 0.177198 Jul 25 15:26:51.125135 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3726/7225] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:50 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1726 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:26:52.147440 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f22dd2e9-8b25-4b50-b860-64f1cf76553b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:52.148084 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f22dd2e9-8b25-4b50-b860-64f1cf76553b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:52.155601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f22dd2e9-8b25-4b50-b860-64f1cf76553b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:52.156079 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f22dd2e9-8b25-4b50-b860-64f1cf76553b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:52.156872 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f22dd2e9-8b25-4b50-b860-64f1cf76553b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:52.157305 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f22dd2e9-8b25-4b50-b860-64f1cf76553b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:52.293688 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f22dd2e9-8b25-4b50-b860-64f1cf76553b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:52.302509 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f22dd2e9-8b25-4b50-b860-64f1cf76553b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1726 microversion: 2.1 time: 0.159177 Jul 25 15:26:52.303070 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3500/7226] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:52 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:26:53.325475 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-71e39702-8169-40a0-9bfc-39dcbd7d56de tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:53.326501 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-71e39702-8169-40a0-9bfc-39dcbd7d56de tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:53.333725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=33 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:26:53.335628 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71e39702-8169-40a0-9bfc-39dcbd7d56de tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:53.336267 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71e39702-8169-40a0-9bfc-39dcbd7d56de tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:53.337223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71e39702-8169-40a0-9bfc-39dcbd7d56de tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:53.337787 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71e39702-8169-40a0-9bfc-39dcbd7d56de tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:53.342359 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:26:53.490511 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-71e39702-8169-40a0-9bfc-39dcbd7d56de tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:53.501150 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-71e39702-8169-40a0-9bfc-39dcbd7d56de tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1726 microversion: 2.1 time: 0.180685 Jul 25 15:26:53.501745 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3727/7227] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:53 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1726 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:26:54.522402 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-920960ff-7ae4-4ed4-b185-d8292e1f92a2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:54.523017 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-920960ff-7ae4-4ed4-b185-d8292e1f92a2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:54.525605 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=29 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:26:54.531306 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-920960ff-7ae4-4ed4-b185-d8292e1f92a2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:54.531737 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-920960ff-7ae4-4ed4-b185-d8292e1f92a2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:54.532544 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-920960ff-7ae4-4ed4-b185-d8292e1f92a2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:54.532977 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-920960ff-7ae4-4ed4-b185-d8292e1f92a2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:54.537098 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=85 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:26:54.677294 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-920960ff-7ae4-4ed4-b185-d8292e1f92a2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:54.686409 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-920960ff-7ae4-4ed4-b185-d8292e1f92a2 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1723 microversion: 2.1 time: 0.168054 Jul 25 15:26:54.687065 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3501/7228] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:54 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:26:54.707476 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d31184cb-9bdf-471e-962f-06ee75677749 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:26:54.708616 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d31184cb-9bdf-471e-962f-06ee75677749 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:54.715669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d31184cb-9bdf-471e-962f-06ee75677749 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:54.716166 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d31184cb-9bdf-471e-962f-06ee75677749 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:54.717013 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d31184cb-9bdf-471e-962f-06ee75677749 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:54.717439 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d31184cb-9bdf-471e-962f-06ee75677749 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:54.756594 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d31184cb-9bdf-471e-962f-06ee75677749 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:54.757105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d31184cb-9bdf-471e-962f-06ee75677749 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:54.757948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d31184cb-9bdf-471e-962f-06ee75677749 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:54.758407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d31184cb-9bdf-471e-962f-06ee75677749 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:54.784123 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-d31184cb-9bdf-471e-962f-06ee75677749 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Getting quotas for project 90120379bd914d71996458c1e2a3e25a. Resources: {'cores', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:26:54.790197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-d31184cb-9bdf-471e-962f-06ee75677749 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Getting quotas for user 6a742410e1794902a11125c6369dadcc and project 90120379bd914d71996458c1e2a3e25a. Resources: {'cores', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:26:54.903107 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d31184cb-9bdf-471e-962f-06ee75677749 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "POST /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f/action" status: 202 len: 0 microversion: 2.1 time: 0.199349 Jul 25 15:26:54.903698 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3728/7229] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:26:54 2022] POST /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:26:54.912370 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-79be387d-5e76-4c66-8fb9-3ef61a5867cd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:54.913078 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-79be387d-5e76-4c66-8fb9-3ef61a5867cd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:54.919768 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-79be387d-5e76-4c66-8fb9-3ef61a5867cd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:54.920359 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-79be387d-5e76-4c66-8fb9-3ef61a5867cd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:54.921218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-79be387d-5e76-4c66-8fb9-3ef61a5867cd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:54.921680 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-79be387d-5e76-4c66-8fb9-3ef61a5867cd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:55.129916 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-79be387d-5e76-4c66-8fb9-3ef61a5867cd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:55.138486 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-79be387d-5e76-4c66-8fb9-3ef61a5867cd tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1722 microversion: 2.1 time: 0.230110 Jul 25 15:26:55.139108 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3502/7230] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:54 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:26:56.160978 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7302a05d-96b2-43d4-a003-e0d98cd1b376 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:56.161640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7302a05d-96b2-43d4-a003-e0d98cd1b376 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:56.169456 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7302a05d-96b2-43d4-a003-e0d98cd1b376 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:56.170048 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7302a05d-96b2-43d4-a003-e0d98cd1b376 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:56.170825 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7302a05d-96b2-43d4-a003-e0d98cd1b376 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:56.171264 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7302a05d-96b2-43d4-a003-e0d98cd1b376 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:56.323905 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7302a05d-96b2-43d4-a003-e0d98cd1b376 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:56.332820 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7302a05d-96b2-43d4-a003-e0d98cd1b376 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1722 microversion: 2.1 time: 0.177133 Jul 25 15:26:56.333687 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3729/7231] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:56 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:26:56.476408 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-9dcc8350-59d9-46bf-8feb-ed13212b80b2 req-e7f9654e-c37e-4116-9f1b-25d99e116d22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bade690-6b63-482c-a463-652f8c56268f", "name": "network-vif-plugged", "status": "completed", "tag": "955f63b4-e29d-4710-911c-c902791af379"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:26:56.488493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-9dcc8350-59d9-46bf-8feb-ed13212b80b2 req-e7f9654e-c37e-4116-9f1b-25d99e116d22 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:56.489156 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-9dcc8350-59d9-46bf-8feb-ed13212b80b2 req-e7f9654e-c37e-4116-9f1b-25d99e116d22 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:56.503855 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-9dcc8350-59d9-46bf-8feb-ed13212b80b2 req-e7f9654e-c37e-4116-9f1b-25d99e116d22 service nova] Creating event network-vif-plugged:955f63b4-e29d-4710-911c-c902791af379 for instance 8bade690-6b63-482c-a463-652f8c56268f on n-h1-846435-14 Jul 25 15:26:56.511258 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [req-9dcc8350-59d9-46bf-8feb-ed13212b80b2 req-e7f9654e-c37e-4116-9f1b-25d99e116d22 service nova] Instance 8bade690-6b63-482c-a463-652f8c56268f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119303) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 15:26:56.528358 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-9dcc8350-59d9-46bf-8feb-ed13212b80b2 req-e7f9654e-c37e-4116-9f1b-25d99e116d22 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052110 Jul 25 15:26:56.528358 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3503/7232] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:26:57.355038 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-77b634d5-4d7b-46e4-a070-89e669c51125 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:57.355694 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-77b634d5-4d7b-46e4-a070-89e669c51125 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:57.363042 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-77b634d5-4d7b-46e4-a070-89e669c51125 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:57.363715 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-77b634d5-4d7b-46e4-a070-89e669c51125 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:57.364577 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-77b634d5-4d7b-46e4-a070-89e669c51125 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:57.365029 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-77b634d5-4d7b-46e4-a070-89e669c51125 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:57.514875 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-77b634d5-4d7b-46e4-a070-89e669c51125 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:57.523724 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-77b634d5-4d7b-46e4-a070-89e669c51125 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1722 microversion: 2.1 time: 0.172654 Jul 25 15:26:57.524481 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3730/7233] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:57 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:26:58.548159 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-00c7f6b7-2ed2-4854-b86b-aaa4078277e9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:58.548903 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-00c7f6b7-2ed2-4854-b86b-aaa4078277e9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:58.555705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00c7f6b7-2ed2-4854-b86b-aaa4078277e9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:58.556184 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00c7f6b7-2ed2-4854-b86b-aaa4078277e9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:58.556979 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00c7f6b7-2ed2-4854-b86b-aaa4078277e9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:58.557459 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00c7f6b7-2ed2-4854-b86b-aaa4078277e9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:58.708104 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-00c7f6b7-2ed2-4854-b86b-aaa4078277e9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:58.717443 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-00c7f6b7-2ed2-4854-b86b-aaa4078277e9 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1722 microversion: 2.1 time: 0.174724 Jul 25 15:26:58.718397 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3504/7234] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:58 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:26:59.739029 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-68187c92-30a1-4098-9b41-ae317df4ef2e tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:26:59.739649 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-68187c92-30a1-4098-9b41-ae317df4ef2e tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:26:59.747120 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68187c92-30a1-4098-9b41-ae317df4ef2e tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:59.747586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68187c92-30a1-4098-9b41-ae317df4ef2e tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:59.748479 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68187c92-30a1-4098-9b41-ae317df4ef2e tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:26:59.748924 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68187c92-30a1-4098-9b41-ae317df4ef2e tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:26:59.974163 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-68187c92-30a1-4098-9b41-ae317df4ef2e tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:26:59.982927 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-68187c92-30a1-4098-9b41-ae317df4ef2e tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1722 microversion: 2.1 time: 0.247608 Jul 25 15:26:59.983577 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3731/7235] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:26:59 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:00.279169 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-ebd92f81-b5c3-41d7-8caf-bdfda9e5f86e req-b7a431a8-840c-4f03-b2e5-519a91965cca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bade690-6b63-482c-a463-652f8c56268f", "name": "network-vif-unplugged", "status": "completed", "tag": "955f63b4-e29d-4710-911c-c902791af379"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:27:00.290307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ebd92f81-b5c3-41d7-8caf-bdfda9e5f86e req-b7a431a8-840c-4f03-b2e5-519a91965cca service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:00.290854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ebd92f81-b5c3-41d7-8caf-bdfda9e5f86e req-b7a431a8-840c-4f03-b2e5-519a91965cca service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:00.304805 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-ebd92f81-b5c3-41d7-8caf-bdfda9e5f86e req-b7a431a8-840c-4f03-b2e5-519a91965cca service nova] Creating event network-vif-unplugged:955f63b4-e29d-4710-911c-c902791af379 for instance 8bade690-6b63-482c-a463-652f8c56268f on n-h2-846435-14 Jul 25 15:27:00.311588 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [req-ebd92f81-b5c3-41d7-8caf-bdfda9e5f86e req-b7a431a8-840c-4f03-b2e5-519a91965cca service nova] Instance 8bade690-6b63-482c-a463-652f8c56268f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119303) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 15:27:00.323085 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-ebd92f81-b5c3-41d7-8caf-bdfda9e5f86e req-b7a431a8-840c-4f03-b2e5-519a91965cca service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048022 Jul 25 15:27:00.324552 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3505/7236] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:27:01.005666 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4f9162d7-9b1c-4e49-8e78-5904e594fabb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:01.006276 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4f9162d7-9b1c-4e49-8e78-5904e594fabb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:01.013865 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4f9162d7-9b1c-4e49-8e78-5904e594fabb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:01.014333 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4f9162d7-9b1c-4e49-8e78-5904e594fabb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:01.015249 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4f9162d7-9b1c-4e49-8e78-5904e594fabb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:01.015679 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4f9162d7-9b1c-4e49-8e78-5904e594fabb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:01.220715 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4f9162d7-9b1c-4e49-8e78-5904e594fabb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:01.230309 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4f9162d7-9b1c-4e49-8e78-5904e594fabb tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1722 microversion: 2.1 time: 0.228696 Jul 25 15:27:01.231120 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3732/7237] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:01 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:02.254925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0c23bd78-7ac4-47e5-ae40-375d015b103c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:02.255675 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0c23bd78-7ac4-47e5-ae40-375d015b103c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:02.263509 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0c23bd78-7ac4-47e5-ae40-375d015b103c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:02.263988 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0c23bd78-7ac4-47e5-ae40-375d015b103c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:02.264815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0c23bd78-7ac4-47e5-ae40-375d015b103c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:02.265242 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0c23bd78-7ac4-47e5-ae40-375d015b103c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:02.345623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-dbd07d15-c88c-4ec7-ad6a-61b3b0935a45 req-07d25db2-3ac4-4e65-9b2d-851c20c210a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bade690-6b63-482c-a463-652f8c56268f", "tag": "955f63b4-e29d-4710-911c-c902791af379"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:27:02.359854 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-dbd07d15-c88c-4ec7-ad6a-61b3b0935a45 req-07d25db2-3ac4-4e65-9b2d-851c20c210a7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:02.360538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-dbd07d15-c88c-4ec7-ad6a-61b3b0935a45 req-07d25db2-3ac4-4e65-9b2d-851c20c210a7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:02.376740 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-dbd07d15-c88c-4ec7-ad6a-61b3b0935a45 req-07d25db2-3ac4-4e65-9b2d-851c20c210a7 service nova] Creating event network-changed:955f63b4-e29d-4710-911c-c902791af379 for instance 8bade690-6b63-482c-a463-652f8c56268f on n-h2-846435-14 Jul 25 15:27:02.385552 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [req-dbd07d15-c88c-4ec7-ad6a-61b3b0935a45 req-07d25db2-3ac4-4e65-9b2d-851c20c210a7 service nova] Instance 8bade690-6b63-482c-a463-652f8c56268f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119304) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 15:27:02.397958 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-dbd07d15-c88c-4ec7-ad6a-61b3b0935a45 req-07d25db2-3ac4-4e65-9b2d-851c20c210a7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057804 Jul 25 15:27:02.398582 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3733/7238] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:27:02.419043 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0c23bd78-7ac4-47e5-ae40-375d015b103c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:02.428743 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0c23bd78-7ac4-47e5-ae40-375d015b103c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1722 microversion: 2.1 time: 0.178124 Jul 25 15:27:02.430029 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3506/7239] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:02 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:03.452402 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-63eff9b4-b66f-471f-b277-3aab81bef6cf tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:03.453149 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-63eff9b4-b66f-471f-b277-3aab81bef6cf tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:03.460188 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63eff9b4-b66f-471f-b277-3aab81bef6cf tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:03.460651 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63eff9b4-b66f-471f-b277-3aab81bef6cf tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:03.461443 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63eff9b4-b66f-471f-b277-3aab81bef6cf tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:03.461892 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-63eff9b4-b66f-471f-b277-3aab81bef6cf tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:03.611699 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-63eff9b4-b66f-471f-b277-3aab81bef6cf tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:03.621140 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-63eff9b4-b66f-471f-b277-3aab81bef6cf tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1722 microversion: 2.1 time: 0.173783 Jul 25 15:27:03.622192 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3734/7240] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:03 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:04.642767 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0e815086-a293-460d-ba12-92ee929b8898 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:04.643347 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0e815086-a293-460d-ba12-92ee929b8898 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:04.651205 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e815086-a293-460d-ba12-92ee929b8898 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:04.651649 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e815086-a293-460d-ba12-92ee929b8898 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:04.652470 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e815086-a293-460d-ba12-92ee929b8898 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:04.652911 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0e815086-a293-460d-ba12-92ee929b8898 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:04.830820 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0e815086-a293-460d-ba12-92ee929b8898 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:04.839561 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0e815086-a293-460d-ba12-92ee929b8898 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1722 microversion: 2.1 time: 0.201039 Jul 25 15:27:04.840186 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3507/7241] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:04 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:05.861870 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-86c72831-25d3-4552-8a7c-5ae72b0bae46 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:05.862546 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-86c72831-25d3-4552-8a7c-5ae72b0bae46 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:05.865517 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:27:05.872109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-86c72831-25d3-4552-8a7c-5ae72b0bae46 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:05.872506 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-86c72831-25d3-4552-8a7c-5ae72b0bae46 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:05.873294 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-86c72831-25d3-4552-8a7c-5ae72b0bae46 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:05.873742 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-86c72831-25d3-4552-8a7c-5ae72b0bae46 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:06.018947 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-86c72831-25d3-4552-8a7c-5ae72b0bae46 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:06.028199 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-86c72831-25d3-4552-8a7c-5ae72b0bae46 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1722 microversion: 2.1 time: 0.170119 Jul 25 15:27:06.028782 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3735/7242] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:05 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:07.051549 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a06ab4cd-8fec-4aff-b0ed-935c0b6042b1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:07.052215 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a06ab4cd-8fec-4aff-b0ed-935c0b6042b1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:07.059779 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a06ab4cd-8fec-4aff-b0ed-935c0b6042b1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:07.060357 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a06ab4cd-8fec-4aff-b0ed-935c0b6042b1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:07.061146 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a06ab4cd-8fec-4aff-b0ed-935c0b6042b1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:07.061607 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a06ab4cd-8fec-4aff-b0ed-935c0b6042b1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:07.193801 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a06ab4cd-8fec-4aff-b0ed-935c0b6042b1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:07.202437 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a06ab4cd-8fec-4aff-b0ed-935c0b6042b1 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1722 microversion: 2.1 time: 0.154982 Jul 25 15:27:07.203016 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3508/7243] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:07 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:08.223260 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f58ecce3-3b6a-4e0a-b361-f1158a47562b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:08.223869 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f58ecce3-3b6a-4e0a-b361-f1158a47562b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:08.231458 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f58ecce3-3b6a-4e0a-b361-f1158a47562b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:08.231923 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f58ecce3-3b6a-4e0a-b361-f1158a47562b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:08.232813 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f58ecce3-3b6a-4e0a-b361-f1158a47562b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:08.233264 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f58ecce3-3b6a-4e0a-b361-f1158a47562b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:08.367315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f58ecce3-3b6a-4e0a-b361-f1158a47562b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:08.376362 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f58ecce3-3b6a-4e0a-b361-f1158a47562b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1722 microversion: 2.1 time: 0.157061 Jul 25 15:27:08.376948 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3736/7244] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:08 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:09.397979 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-15eb06b7-0a3e-49a3-9ad6-5d180baf13f6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:09.398607 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-15eb06b7-0a3e-49a3-9ad6-5d180baf13f6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:09.407007 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-15eb06b7-0a3e-49a3-9ad6-5d180baf13f6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:09.407896 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-15eb06b7-0a3e-49a3-9ad6-5d180baf13f6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:09.408468 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-15eb06b7-0a3e-49a3-9ad6-5d180baf13f6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:09.408873 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-15eb06b7-0a3e-49a3-9ad6-5d180baf13f6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:09.548949 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-15eb06b7-0a3e-49a3-9ad6-5d180baf13f6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:09.558143 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-15eb06b7-0a3e-49a3-9ad6-5d180baf13f6 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1722 microversion: 2.1 time: 0.163963 Jul 25 15:27:09.559322 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3509/7245] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:09 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:10.581970 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1638557e-fb5c-4d50-84ea-cc5cccdaa977 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:10.582636 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1638557e-fb5c-4d50-84ea-cc5cccdaa977 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:10.590696 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1638557e-fb5c-4d50-84ea-cc5cccdaa977 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:10.591172 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1638557e-fb5c-4d50-84ea-cc5cccdaa977 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:10.592044 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1638557e-fb5c-4d50-84ea-cc5cccdaa977 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:10.592549 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1638557e-fb5c-4d50-84ea-cc5cccdaa977 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:10.748465 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1638557e-fb5c-4d50-84ea-cc5cccdaa977 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:10.757669 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1638557e-fb5c-4d50-84ea-cc5cccdaa977 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1722 microversion: 2.1 time: 0.179838 Jul 25 15:27:10.758329 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3737/7246] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:10 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:11.264732 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 15:27:11.265307 n-d-846435-14 devstack@n-api.service[119303]: Mon Jul 25 15:27:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 15:27:11.779458 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bff7a4b6-7d02-4e66-8abb-e044a8cc711b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:11.780499 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bff7a4b6-7d02-4e66-8abb-e044a8cc711b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:11.787773 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bff7a4b6-7d02-4e66-8abb-e044a8cc711b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:11.788245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bff7a4b6-7d02-4e66-8abb-e044a8cc711b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:11.789051 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bff7a4b6-7d02-4e66-8abb-e044a8cc711b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:11.789492 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bff7a4b6-7d02-4e66-8abb-e044a8cc711b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:11.924466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bff7a4b6-7d02-4e66-8abb-e044a8cc711b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:11.932797 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bff7a4b6-7d02-4e66-8abb-e044a8cc711b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1722 microversion: 2.1 time: 0.157691 Jul 25 15:27:11.933381 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3510/7247] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:11 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:12.954008 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-504bfa5f-dbd9-448f-ab27-c43985424717 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:12.954637 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-504bfa5f-dbd9-448f-ab27-c43985424717 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:12.961789 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-504bfa5f-dbd9-448f-ab27-c43985424717 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:12.962252 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-504bfa5f-dbd9-448f-ab27-c43985424717 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:12.963033 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-504bfa5f-dbd9-448f-ab27-c43985424717 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:12.963478 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-504bfa5f-dbd9-448f-ab27-c43985424717 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:13.107600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-504bfa5f-dbd9-448f-ab27-c43985424717 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:13.115806 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-504bfa5f-dbd9-448f-ab27-c43985424717 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1722 microversion: 2.1 time: 0.166173 Jul 25 15:27:13.116410 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3738/7248] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:12 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:14.139850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8c558bf9-cfe0-4b8b-b434-7c5601818251 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:14.140501 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8c558bf9-cfe0-4b8b-b434-7c5601818251 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:14.148159 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8c558bf9-cfe0-4b8b-b434-7c5601818251 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:14.148621 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8c558bf9-cfe0-4b8b-b434-7c5601818251 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:14.149403 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8c558bf9-cfe0-4b8b-b434-7c5601818251 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:14.149847 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8c558bf9-cfe0-4b8b-b434-7c5601818251 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:14.294859 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8c558bf9-cfe0-4b8b-b434-7c5601818251 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:14.303532 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8c558bf9-cfe0-4b8b-b434-7c5601818251 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1722 microversion: 2.1 time: 0.167706 Jul 25 15:27:14.304148 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3511/7249] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:14 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:15.325372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cf88a9d3-91f5-4325-8888-66907f3d6281 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:15.325966 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cf88a9d3-91f5-4325-8888-66907f3d6281 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:15.333782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cf88a9d3-91f5-4325-8888-66907f3d6281 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:15.334236 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cf88a9d3-91f5-4325-8888-66907f3d6281 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:15.335021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cf88a9d3-91f5-4325-8888-66907f3d6281 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:15.335487 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cf88a9d3-91f5-4325-8888-66907f3d6281 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:15.470437 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cf88a9d3-91f5-4325-8888-66907f3d6281 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:15.478972 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cf88a9d3-91f5-4325-8888-66907f3d6281 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1715 microversion: 2.1 time: 0.157556 Jul 25 15:27:15.479557 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3739/7250] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:15 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1715 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:15.500320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b3461cf1-9734-4378-a547-83b89e896e7f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:15.500940 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b3461cf1-9734-4378-a547-83b89e896e7f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:15.508885 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3461cf1-9734-4378-a547-83b89e896e7f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:15.509349 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3461cf1-9734-4378-a547-83b89e896e7f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:15.510376 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3461cf1-9734-4378-a547-83b89e896e7f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:15.510981 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3461cf1-9734-4378-a547-83b89e896e7f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:15.645186 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b3461cf1-9734-4378-a547-83b89e896e7f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:15.653628 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b3461cf1-9734-4378-a547-83b89e896e7f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1715 microversion: 2.1 time: 0.157352 Jul 25 15:27:15.654172 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3512/7251] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:15 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1715 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:15.674172 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a3bac842-144f-4644-b3eb-df3413f8bf28 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:15.674824 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a3bac842-144f-4644-b3eb-df3413f8bf28 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:15.681473 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3bac842-144f-4644-b3eb-df3413f8bf28 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:15.681929 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3bac842-144f-4644-b3eb-df3413f8bf28 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:15.682699 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3bac842-144f-4644-b3eb-df3413f8bf28 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:15.683166 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a3bac842-144f-4644-b3eb-df3413f8bf28 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:15.842623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a3bac842-144f-4644-b3eb-df3413f8bf28 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:15.854889 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a3bac842-144f-4644-b3eb-df3413f8bf28 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1715 microversion: 2.1 time: 0.184344 Jul 25 15:27:15.855781 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3740/7252] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:15 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1715 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:15.876406 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-70539260-9a0c-4e13-ad33-d1cb4bc2fb3f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:15.876901 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-70539260-9a0c-4e13-ad33-d1cb4bc2fb3f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:15.884197 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70539260-9a0c-4e13-ad33-d1cb4bc2fb3f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:15.884664 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70539260-9a0c-4e13-ad33-d1cb4bc2fb3f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:15.885416 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70539260-9a0c-4e13-ad33-d1cb4bc2fb3f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:15.885846 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70539260-9a0c-4e13-ad33-d1cb4bc2fb3f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:15.912675 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-70539260-9a0c-4e13-ad33-d1cb4bc2fb3f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:27:16.000317 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-70539260-9a0c-4e13-ad33-d1cb4bc2fb3f tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "DELETE /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 204 len: 0 microversion: 2.1 time: 0.127627 Jul 25 15:27:16.000934 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3513/7253] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:27:15 2022] DELETE /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:27:16.009219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-23802717-691d-4293-954d-9f1107c8beab tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:16.009834 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-23802717-691d-4293-954d-9f1107c8beab tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:16.016146 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23802717-691d-4293-954d-9f1107c8beab tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:16.016597 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23802717-691d-4293-954d-9f1107c8beab tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:16.017364 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23802717-691d-4293-954d-9f1107c8beab tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:16.017799 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-23802717-691d-4293-954d-9f1107c8beab tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:16.020333 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:27:16.156541 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-23802717-691d-4293-954d-9f1107c8beab tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:16.164847 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-23802717-691d-4293-954d-9f1107c8beab tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1721 microversion: 2.1 time: 0.159476 Jul 25 15:27:16.165424 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3741/7254] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:16 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:16.934390 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-f1851b50-db41-42d2-a09b-6f50d42244ed req-c5abe093-9b4c-4144-b5db-abbcbe0e828d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bade690-6b63-482c-a463-652f8c56268f", "name": "network-vif-plugged", "status": "completed", "tag": "955f63b4-e29d-4710-911c-c902791af379"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:27:16.946957 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f1851b50-db41-42d2-a09b-6f50d42244ed req-c5abe093-9b4c-4144-b5db-abbcbe0e828d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:16.947422 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f1851b50-db41-42d2-a09b-6f50d42244ed req-c5abe093-9b4c-4144-b5db-abbcbe0e828d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:16.959451 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-f1851b50-db41-42d2-a09b-6f50d42244ed req-c5abe093-9b4c-4144-b5db-abbcbe0e828d service nova] Creating event network-vif-plugged:955f63b4-e29d-4710-911c-c902791af379 for instance 8bade690-6b63-482c-a463-652f8c56268f on n-h2-846435-14 Jul 25 15:27:16.964907 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-f1851b50-db41-42d2-a09b-6f50d42244ed req-c5abe093-9b4c-4144-b5db-abbcbe0e828d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034686 Jul 25 15:27:16.965544 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3514/7255] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:27:17.187035 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3730d7c2-72a2-40f4-beca-0979d9c2d908 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:17.187630 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3730d7c2-72a2-40f4-beca-0979d9c2d908 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:17.195038 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3730d7c2-72a2-40f4-beca-0979d9c2d908 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:17.195499 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3730d7c2-72a2-40f4-beca-0979d9c2d908 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:17.196325 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3730d7c2-72a2-40f4-beca-0979d9c2d908 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:17.196774 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3730d7c2-72a2-40f4-beca-0979d9c2d908 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:17.340207 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3730d7c2-72a2-40f4-beca-0979d9c2d908 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:17.349919 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3730d7c2-72a2-40f4-beca-0979d9c2d908 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1721 microversion: 2.1 time: 0.166603 Jul 25 15:27:17.350555 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3742/7256] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:17 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:18.374422 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2b003f34-0302-43f9-a57e-39c9b32446ae tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:18.375239 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2b003f34-0302-43f9-a57e-39c9b32446ae tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:18.381897 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2b003f34-0302-43f9-a57e-39c9b32446ae tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:18.382458 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2b003f34-0302-43f9-a57e-39c9b32446ae tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:18.383246 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2b003f34-0302-43f9-a57e-39c9b32446ae tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:18.383688 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2b003f34-0302-43f9-a57e-39c9b32446ae tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:18.532341 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2b003f34-0302-43f9-a57e-39c9b32446ae tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:18.540908 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2b003f34-0302-43f9-a57e-39c9b32446ae tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1721 microversion: 2.1 time: 0.171797 Jul 25 15:27:18.541511 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3515/7257] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:18 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:18.790795 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-f09b6c9b-b4be-4938-abda-e5387890d8ae req-50b49815-0078-4942-9b57-7ee43c3ce200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bade690-6b63-482c-a463-652f8c56268f", "name": "network-vif-deleted", "tag": "955f63b4-e29d-4710-911c-c902791af379"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:27:18.801996 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-f09b6c9b-b4be-4938-abda-e5387890d8ae req-50b49815-0078-4942-9b57-7ee43c3ce200 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:18.802571 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-f09b6c9b-b4be-4938-abda-e5387890d8ae req-50b49815-0078-4942-9b57-7ee43c3ce200 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:18.819852 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-f09b6c9b-b4be-4938-abda-e5387890d8ae req-50b49815-0078-4942-9b57-7ee43c3ce200 service nova] Creating event network-vif-deleted:955f63b4-e29d-4710-911c-c902791af379 for instance 8bade690-6b63-482c-a463-652f8c56268f on n-h2-846435-14 Jul 25 15:27:18.826174 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-f09b6c9b-b4be-4938-abda-e5387890d8ae req-50b49815-0078-4942-9b57-7ee43c3ce200 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039560 Jul 25 15:27:18.827465 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3743/7258] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:27:19.562344 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-68a39618-7981-4939-8ae8-a009737cd810 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:19.565757 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-68a39618-7981-4939-8ae8-a009737cd810 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:19.572896 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-68a39618-7981-4939-8ae8-a009737cd810 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:19.573361 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-68a39618-7981-4939-8ae8-a009737cd810 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:19.574157 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-68a39618-7981-4939-8ae8-a009737cd810 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:19.574626 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-68a39618-7981-4939-8ae8-a009737cd810 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:19.649530 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-68a39618-7981-4939-8ae8-a009737cd810 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:19.658906 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-68a39618-7981-4939-8ae8-a009737cd810 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1369 microversion: 2.1 time: 0.100208 Jul 25 15:27:19.659292 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3516/7259] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:19 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:20.682267 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dd16b8f0-34e1-46dd-945e-56b463050ad5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:20.682956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dd16b8f0-34e1-46dd-945e-56b463050ad5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:20.689767 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd16b8f0-34e1-46dd-945e-56b463050ad5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:20.690224 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd16b8f0-34e1-46dd-945e-56b463050ad5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:20.691003 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd16b8f0-34e1-46dd-945e-56b463050ad5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:20.691640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dd16b8f0-34e1-46dd-945e-56b463050ad5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:20.758697 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-dd16b8f0-34e1-46dd-945e-56b463050ad5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:20.767220 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dd16b8f0-34e1-46dd-945e-56b463050ad5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1369 microversion: 2.1 time: 0.090205 Jul 25 15:27:20.767790 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3744/7260] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:20 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:21.789640 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c0d61ca0-d995-4a29-b4bd-bb8729bd1c79 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:21.790384 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c0d61ca0-d995-4a29-b4bd-bb8729bd1c79 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:21.797991 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c0d61ca0-d995-4a29-b4bd-bb8729bd1c79 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:21.798479 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c0d61ca0-d995-4a29-b4bd-bb8729bd1c79 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:21.799235 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c0d61ca0-d995-4a29-b4bd-bb8729bd1c79 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:21.799674 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c0d61ca0-d995-4a29-b4bd-bb8729bd1c79 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:21.818979 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:27:22.136756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c0d61ca0-d995-4a29-b4bd-bb8729bd1c79 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:22.145697 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c0d61ca0-d995-4a29-b4bd-bb8729bd1c79 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1369 microversion: 2.1 time: 0.360130 Jul 25 15:27:22.146326 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3517/7261] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:21 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1369 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:23.168124 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-deb51048-ebfd-464a-ae01-0f8c1283719a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:23.168803 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-deb51048-ebfd-464a-ae01-0f8c1283719a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:23.176280 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-deb51048-ebfd-464a-ae01-0f8c1283719a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:23.176722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-deb51048-ebfd-464a-ae01-0f8c1283719a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:23.177461 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-deb51048-ebfd-464a-ae01-0f8c1283719a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:23.177936 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-deb51048-ebfd-464a-ae01-0f8c1283719a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:23.210143 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-deb51048-ebfd-464a-ae01-0f8c1283719a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:23.210600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-deb51048-ebfd-464a-ae01-0f8c1283719a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:23.211073 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-deb51048-ebfd-464a-ae01-0f8c1283719a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lazy-loading 'fault' on Instance uuid 8bade690-6b63-482c-a463-652f8c56268f {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:27:23.257757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-deb51048-ebfd-464a-ae01-0f8c1283719a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a742410e1794902a11125c6369dadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90120379bd914d71996458c1e2a3e25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:23.266403 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-deb51048-ebfd-464a-ae01-0f8c1283719a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 200 len: 1374 microversion: 2.1 time: 0.102311 Jul 25 15:27:23.266989 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3745/7262] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:23 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 1374 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:24.287593 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1ee6b159-700c-4cfc-8344-8382f42d6c07 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:24.288312 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1ee6b159-700c-4cfc-8344-8382f42d6c07 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:24.295129 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ee6b159-700c-4cfc-8344-8382f42d6c07 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:24.295586 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ee6b159-700c-4cfc-8344-8382f42d6c07 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:24.296408 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ee6b159-700c-4cfc-8344-8382f42d6c07 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:24.296844 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ee6b159-700c-4cfc-8344-8382f42d6c07 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:24.311381 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-1ee6b159-700c-4cfc-8344-8382f42d6c07 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] HTTP exception thrown: Instance 8bade690-6b63-482c-a463-652f8c56268f could not be found. Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1ee6b159-700c-4cfc-8344-8382f42d6c07 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Request method failure captured: Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f HTTP/1.1 Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rSjEyisMD8DvTH7b56ad3M9V4r9Z2oHgANxXbb97f0WFMCsa1v0ECdPWSwcD3bin0DxN2VyKMiUlFTU-JUG9Ua6IQiCvvNBHc0-kGj7SnhEHtthZB_ln1XXzCzW_WOLiNqJwI6WQfWOze_2VM1L7b9fm_wuF4gcUsql3_EhcnWK2us Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 90120379bd914d71996458c1e2a3e25a Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServerActionsTestJSON-741053275 Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90120379bd914d71996458c1e2a3e25a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90120379bd914d71996458c1e2a3e25a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_90120379bd914d71996458c1e2a3e25a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/90120379bd914d71996458c1e2a3e25a"}]}] Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServerActionsTestJSON-741053275 Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 90120379bd914d71996458c1e2a3e25a Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServerActionsTestJSON-741053275 Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServerActionsTestJSON-741053275-project Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 6a742410e1794902a11125c6369dadcc Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServerActionsTestJSON-741053275-project Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 8bade690-6b63-482c-a463-652f8c56268f could not be found. Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '8bade690-6b63-482c-a463-652f8c56268f'} Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bade690-6b63-482c-a463-652f8c56268f could not be found. Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bade690-6b63-482c-a463-652f8c56268f could not be found. Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:27:24.313215 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:27:24.318014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:27:24.318014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:27:24.318014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:27:24.318014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:27:24.318014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:27:24.318014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bade690-6b63-482c-a463-652f8c56268f could not be found. Jul 25 15:27:24.318014 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:27:24.318014 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1ee6b159-700c-4cfc-8344-8382f42d6c07 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Returning 404 to user: Instance 8bade690-6b63-482c-a463-652f8c56268f could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:27:24.318014 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1ee6b159-700c-4cfc-8344-8382f42d6c07 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 404 len: 111 microversion: 2.1 time: 0.031124 Jul 25 15:27:24.318800 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3518/7263] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:24 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:27:24.377401 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3f320e9f-2af6-46df-b6ee-9e8f0073b13b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:24.379781 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3f320e9f-2af6-46df-b6ee-9e8f0073b13b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:24.382696 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:27:24.387894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f320e9f-2af6-46df-b6ee-9e8f0073b13b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:24.388437 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f320e9f-2af6-46df-b6ee-9e8f0073b13b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:24.389208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f320e9f-2af6-46df-b6ee-9e8f0073b13b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:24.389644 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3f320e9f-2af6-46df-b6ee-9e8f0073b13b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:24.403857 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-3f320e9f-2af6-46df-b6ee-9e8f0073b13b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] HTTP exception thrown: Instance 8bade690-6b63-482c-a463-652f8c56268f could not be found. Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3f320e9f-2af6-46df-b6ee-9e8f0073b13b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Request method failure captured: Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f/os-volume_attachments HTTP/1.1 Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3rSjEyisMD8DvTH7b56ad3M9V4r9Z2oHgANxXbb97f0WFMCsa1v0ECdPWSwcD3bin0DxN2VyKMiUlFTU-JUG9Ua6IQiCvvNBHc0-kGj7SnhEHtthZB_ln1XXzCzW_WOLiNqJwI6WQfWOze_2VM1L7b9fm_wuF4gcUsql3_EhcnWK2us Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 90120379bd914d71996458c1e2a3e25a Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerActionsTestJSON-741053275 Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90120379bd914d71996458c1e2a3e25a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90120379bd914d71996458c1e2a3e25a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_90120379bd914d71996458c1e2a3e25a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/90120379bd914d71996458c1e2a3e25a"}]}] Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerActionsTestJSON-741053275 Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 90120379bd914d71996458c1e2a3e25a Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerActionsTestJSON-741053275 Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerActionsTestJSON-741053275-project Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 6a742410e1794902a11125c6369dadcc Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerActionsTestJSON-741053275-project Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 8bade690-6b63-482c-a463-652f8c56268f could not be found. Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'server_id': '8bade690-6b63-482c-a463-652f8c56268f'} Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bade690-6b63-482c-a463-652f8c56268f could not be found. Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:27:24.405597 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bade690-6b63-482c-a463-652f8c56268f could not be found. Jul 25 15:27:24.410012 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:27:24.410012 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:27:24.410012 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:27:24.410012 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:27:24.410012 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:27:24.410012 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:27:24.410012 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:27:24.410012 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:27:24.410012 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bade690-6b63-482c-a463-652f8c56268f could not be found. Jul 25 15:27:24.410012 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:27:24.410012 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3f320e9f-2af6-46df-b6ee-9e8f0073b13b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Returning 404 to user: Instance 8bade690-6b63-482c-a463-652f8c56268f could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:27:24.410012 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3f320e9f-2af6-46df-b6ee-9e8f0073b13b tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033926 Jul 25 15:27:24.410012 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3746/7264] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 15:27:24 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:27:27.744681 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-203eb0d4-5861-44d2-b898-73e45893afed tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:27.745321 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-203eb0d4-5861-44d2-b898-73e45893afed tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:27.748205 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:27:27.753719 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-203eb0d4-5861-44d2-b898-73e45893afed tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:27.754133 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-203eb0d4-5861-44d2-b898-73e45893afed tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:27.754900 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-203eb0d4-5861-44d2-b898-73e45893afed tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:27.755334 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-203eb0d4-5861-44d2-b898-73e45893afed tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:27.770920 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-203eb0d4-5861-44d2-b898-73e45893afed tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] HTTP exception thrown: Instance 8bade690-6b63-482c-a463-652f8c56268f could not be found. Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-203eb0d4-5861-44d2-b898-73e45893afed tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Request method failure captured: Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f HTTP/1.1 Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rSjEyisMD8DvTH7b56ad3M9V4r9Z2oHgANxXbb97f0WFMCsa1v0ECdPWSwcD3bin0DxN2VyKMiUlFTU-JUG9Ua6IQiCvvNBHc0-kGj7SnhEHtthZB_ln1XXzCzW_WOLiNqJwI6WQfWOze_2VM1L7b9fm_wuF4gcUsql3_EhcnWK2us Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 90120379bd914d71996458c1e2a3e25a Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServerActionsTestJSON-741053275 Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90120379bd914d71996458c1e2a3e25a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90120379bd914d71996458c1e2a3e25a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_90120379bd914d71996458c1e2a3e25a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/90120379bd914d71996458c1e2a3e25a"}]}] Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServerActionsTestJSON-741053275 Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 90120379bd914d71996458c1e2a3e25a Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServerActionsTestJSON-741053275 Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServerActionsTestJSON-741053275-project Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 6a742410e1794902a11125c6369dadcc Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServerActionsTestJSON-741053275-project Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 8bade690-6b63-482c-a463-652f8c56268f could not be found. Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '8bade690-6b63-482c-a463-652f8c56268f'} Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bade690-6b63-482c-a463-652f8c56268f could not be found. Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:27:27.772517 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:27:27.776094 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bade690-6b63-482c-a463-652f8c56268f could not be found. Jul 25 15:27:27.776094 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.776094 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:27:27.776094 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.776094 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:27:27.776094 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:27:27.776094 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:27:27.776094 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:27:27.776094 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:27:27.776094 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bade690-6b63-482c-a463-652f8c56268f could not be found. Jul 25 15:27:27.776094 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.776094 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-203eb0d4-5861-44d2-b898-73e45893afed tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Returning 404 to user: Instance 8bade690-6b63-482c-a463-652f8c56268f could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:27:27.776094 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-203eb0d4-5861-44d2-b898-73e45893afed tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "DELETE /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 404 len: 111 microversion: 2.1 time: 0.033813 Jul 25 15:27:27.776094 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3519/7265] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:27:27 2022] DELETE /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:27:27.783680 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0140e604-1d8d-4722-8524-2c10c3e48a3a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:27.784332 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0140e604-1d8d-4722-8524-2c10c3e48a3a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8bade690-6b63-482c-a463-652f8c56268f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:27.792044 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0140e604-1d8d-4722-8524-2c10c3e48a3a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:27.792525 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0140e604-1d8d-4722-8524-2c10c3e48a3a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:27.793338 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0140e604-1d8d-4722-8524-2c10c3e48a3a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:27.793784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0140e604-1d8d-4722-8524-2c10c3e48a3a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:27.807829 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-0140e604-1d8d-4722-8524-2c10c3e48a3a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] HTTP exception thrown: Instance 8bade690-6b63-482c-a463-652f8c56268f could not be found. Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0140e604-1d8d-4722-8524-2c10c3e48a3a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Request method failure captured: Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f HTTP/1.1 Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3rSjEyisMD8DvTH7b56ad3M9V4r9Z2oHgANxXbb97f0WFMCsa1v0ECdPWSwcD3bin0DxN2VyKMiUlFTU-JUG9Ua6IQiCvvNBHc0-kGj7SnhEHtthZB_ln1XXzCzW_WOLiNqJwI6WQfWOze_2VM1L7b9fm_wuF4gcUsql3_EhcnWK2us Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 90120379bd914d71996458c1e2a3e25a Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerActionsTestJSON-741053275 Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90120379bd914d71996458c1e2a3e25a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90120379bd914d71996458c1e2a3e25a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_90120379bd914d71996458c1e2a3e25a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/90120379bd914d71996458c1e2a3e25a"}]}] Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerActionsTestJSON-741053275 Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 90120379bd914d71996458c1e2a3e25a Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerActionsTestJSON-741053275 Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerActionsTestJSON-741053275-project Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 6a742410e1794902a11125c6369dadcc Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerActionsTestJSON-741053275-project Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 8bade690-6b63-482c-a463-652f8c56268f could not be found. Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '8bade690-6b63-482c-a463-652f8c56268f'} Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bade690-6b63-482c-a463-652f8c56268f could not be found. Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bade690-6b63-482c-a463-652f8c56268f could not be found. Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:27:27.809408 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.814238 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:27:27.814238 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:27:27.814238 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:27:27.814238 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:27:27.814238 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:27:27.814238 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bade690-6b63-482c-a463-652f8c56268f could not be found. Jul 25 15:27:27.814238 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.814238 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0140e604-1d8d-4722-8524-2c10c3e48a3a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Returning 404 to user: Instance 8bade690-6b63-482c-a463-652f8c56268f could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:27:27.814238 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0140e604-1d8d-4722-8524-2c10c3e48a3a tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f" status: 404 len: 111 microversion: 2.1 time: 0.031512 Jul 25 15:27:27.814238 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3747/7266] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:27 2022] GET /compute/v2.1/servers/8bade690-6b63-482c-a463-652f8c56268f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:27:27.820266 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-09008b6c-b767-41f0-b3d6-1930bcb85eb5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:27.820774 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-09008b6c-b767-41f0-b3d6-1930bcb85eb5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:27.827231 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-09008b6c-b767-41f0-b3d6-1930bcb85eb5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:27.827676 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-09008b6c-b767-41f0-b3d6-1930bcb85eb5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:27.828476 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-09008b6c-b767-41f0-b3d6-1930bcb85eb5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:27.828910 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-09008b6c-b767-41f0-b3d6-1930bcb85eb5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:27.844219 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-09008b6c-b767-41f0-b3d6-1930bcb85eb5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] HTTP exception thrown: Instance 8ccda193-9fa9-4bde-94d1-3071131ed567 could not be found. Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-09008b6c-b767-41f0-b3d6-1930bcb85eb5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Request method failure captured: Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 HTTP/1.1 Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rSjEyisMD8DvTH7b56ad3M9V4r9Z2oHgANxXbb97f0WFMCsa1v0ECdPWSwcD3bin0DxN2VyKMiUlFTU-JUG9Ua6IQiCvvNBHc0-kGj7SnhEHtthZB_ln1XXzCzW_WOLiNqJwI6WQfWOze_2VM1L7b9fm_wuF4gcUsql3_EhcnWK2us Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 90120379bd914d71996458c1e2a3e25a Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServerActionsTestJSON-741053275 Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90120379bd914d71996458c1e2a3e25a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90120379bd914d71996458c1e2a3e25a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_90120379bd914d71996458c1e2a3e25a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/90120379bd914d71996458c1e2a3e25a"}]}] Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServerActionsTestJSON-741053275 Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 90120379bd914d71996458c1e2a3e25a Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServerActionsTestJSON-741053275 Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServerActionsTestJSON-741053275-project Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 6a742410e1794902a11125c6369dadcc Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServerActionsTestJSON-741053275-project Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 8ccda193-9fa9-4bde-94d1-3071131ed567 could not be found. Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '8ccda193-9fa9-4bde-94d1-3071131ed567'} Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ccda193-9fa9-4bde-94d1-3071131ed567 could not be found. Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:27:27.845782 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:27:27.849983 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ccda193-9fa9-4bde-94d1-3071131ed567 could not be found. Jul 25 15:27:27.849983 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.849983 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:27:27.849983 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.849983 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:27:27.849983 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:27:27.849983 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:27:27.849983 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:27:27.849983 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:27:27.849983 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ccda193-9fa9-4bde-94d1-3071131ed567 could not be found. Jul 25 15:27:27.849983 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.849983 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-09008b6c-b767-41f0-b3d6-1930bcb85eb5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Returning 404 to user: Instance 8ccda193-9fa9-4bde-94d1-3071131ed567 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:27:27.849983 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-09008b6c-b767-41f0-b3d6-1930bcb85eb5 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "DELETE /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 404 len: 111 microversion: 2.1 time: 0.031078 Jul 25 15:27:27.849983 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3520/7267] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:27:27 2022] DELETE /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:27:27.856299 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fffa8842-8ca0-4721-800b-dc0c0f4a7a12 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:27.857125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fffa8842-8ca0-4721-800b-dc0c0f4a7a12 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 8ccda193-9fa9-4bde-94d1-3071131ed567] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:27.863269 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fffa8842-8ca0-4721-800b-dc0c0f4a7a12 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:27.863731 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fffa8842-8ca0-4721-800b-dc0c0f4a7a12 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:27.864552 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fffa8842-8ca0-4721-800b-dc0c0f4a7a12 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:27.865001 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fffa8842-8ca0-4721-800b-dc0c0f4a7a12 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:27.879578 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-fffa8842-8ca0-4721-800b-dc0c0f4a7a12 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] HTTP exception thrown: Instance 8ccda193-9fa9-4bde-94d1-3071131ed567 could not be found. Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fffa8842-8ca0-4721-800b-dc0c0f4a7a12 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Request method failure captured: Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 HTTP/1.1 Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3rSjEyisMD8DvTH7b56ad3M9V4r9Z2oHgANxXbb97f0WFMCsa1v0ECdPWSwcD3bin0DxN2VyKMiUlFTU-JUG9Ua6IQiCvvNBHc0-kGj7SnhEHtthZB_ln1XXzCzW_WOLiNqJwI6WQfWOze_2VM1L7b9fm_wuF4gcUsql3_EhcnWK2us Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 90120379bd914d71996458c1e2a3e25a Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerActionsTestJSON-741053275 Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90120379bd914d71996458c1e2a3e25a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90120379bd914d71996458c1e2a3e25a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_90120379bd914d71996458c1e2a3e25a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/90120379bd914d71996458c1e2a3e25a"}]}] Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerActionsTestJSON-741053275 Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 90120379bd914d71996458c1e2a3e25a Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerActionsTestJSON-741053275 Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerActionsTestJSON-741053275-project Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 6a742410e1794902a11125c6369dadcc Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerActionsTestJSON-741053275-project Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 8ccda193-9fa9-4bde-94d1-3071131ed567 could not be found. Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '8ccda193-9fa9-4bde-94d1-3071131ed567'} Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ccda193-9fa9-4bde-94d1-3071131ed567 could not be found. Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ccda193-9fa9-4bde-94d1-3071131ed567 could not be found. Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:27:27.881188 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.885504 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:27:27.885504 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:27:27.885504 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:27:27.885504 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:27:27.885504 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:27:27.885504 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ccda193-9fa9-4bde-94d1-3071131ed567 could not be found. Jul 25 15:27:27.885504 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.885504 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fffa8842-8ca0-4721-800b-dc0c0f4a7a12 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Returning 404 to user: Instance 8ccda193-9fa9-4bde-94d1-3071131ed567 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:27:27.885504 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fffa8842-8ca0-4721-800b-dc0c0f4a7a12 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567" status: 404 len: 111 microversion: 2.1 time: 0.030455 Jul 25 15:27:27.886879 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3748/7268] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:27 2022] GET /compute/v2.1/servers/8ccda193-9fa9-4bde-94d1-3071131ed567 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:27:27.892210 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a3fd5c20-8819-4f87-9fc5-00033268d3e8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:27.892709 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a3fd5c20-8819-4f87-9fc5-00033268d3e8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:27.899606 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a3fd5c20-8819-4f87-9fc5-00033268d3e8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:27.900058 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a3fd5c20-8819-4f87-9fc5-00033268d3e8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:27.900851 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a3fd5c20-8819-4f87-9fc5-00033268d3e8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:27.901280 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a3fd5c20-8819-4f87-9fc5-00033268d3e8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:27.916892 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-a3fd5c20-8819-4f87-9fc5-00033268d3e8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] HTTP exception thrown: Instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 could not be found. Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a3fd5c20-8819-4f87-9fc5-00033268d3e8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Request method failure captured: Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 HTTP/1.1 Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rSjEyisMD8DvTH7b56ad3M9V4r9Z2oHgANxXbb97f0WFMCsa1v0ECdPWSwcD3bin0DxN2VyKMiUlFTU-JUG9Ua6IQiCvvNBHc0-kGj7SnhEHtthZB_ln1XXzCzW_WOLiNqJwI6WQfWOze_2VM1L7b9fm_wuF4gcUsql3_EhcnWK2us Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 90120379bd914d71996458c1e2a3e25a Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServerActionsTestJSON-741053275 Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90120379bd914d71996458c1e2a3e25a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90120379bd914d71996458c1e2a3e25a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_90120379bd914d71996458c1e2a3e25a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/90120379bd914d71996458c1e2a3e25a"}]}] Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServerActionsTestJSON-741053275 Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 90120379bd914d71996458c1e2a3e25a Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServerActionsTestJSON-741053275 Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServerActionsTestJSON-741053275-project Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 6a742410e1794902a11125c6369dadcc Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServerActionsTestJSON-741053275-project Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 could not be found. Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '0f277bed-5ae8-4688-a2ca-9be78f6cc3c8'} Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 could not be found. Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:27:27.918763 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:27:27.922801 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 could not be found. Jul 25 15:27:27.922801 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.922801 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:27:27.922801 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.922801 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:27:27.922801 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:27:27.922801 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:27:27.922801 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:27:27.922801 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:27:27.922801 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 could not be found. Jul 25 15:27:27.922801 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.922801 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a3fd5c20-8819-4f87-9fc5-00033268d3e8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Returning 404 to user: Instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:27:27.922801 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a3fd5c20-8819-4f87-9fc5-00033268d3e8 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "DELETE /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 404 len: 111 microversion: 2.1 time: 0.032082 Jul 25 15:27:27.927560 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3521/7269] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:27:27 2022] DELETE /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:27:27.929197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cf581064-54a7-40f9-9c6b-a70f3a83d14c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:27.929895 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cf581064-54a7-40f9-9c6b-a70f3a83d14c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:27.936391 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cf581064-54a7-40f9-9c6b-a70f3a83d14c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:27.936827 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cf581064-54a7-40f9-9c6b-a70f3a83d14c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:27.937758 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cf581064-54a7-40f9-9c6b-a70f3a83d14c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:27.938067 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cf581064-54a7-40f9-9c6b-a70f3a83d14c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:27.953035 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-cf581064-54a7-40f9-9c6b-a70f3a83d14c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] HTTP exception thrown: Instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 could not be found. Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cf581064-54a7-40f9-9c6b-a70f3a83d14c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Request method failure captured: Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 HTTP/1.1 Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3rSjEyisMD8DvTH7b56ad3M9V4r9Z2oHgANxXbb97f0WFMCsa1v0ECdPWSwcD3bin0DxN2VyKMiUlFTU-JUG9Ua6IQiCvvNBHc0-kGj7SnhEHtthZB_ln1XXzCzW_WOLiNqJwI6WQfWOze_2VM1L7b9fm_wuF4gcUsql3_EhcnWK2us Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 90120379bd914d71996458c1e2a3e25a Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerActionsTestJSON-741053275 Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90120379bd914d71996458c1e2a3e25a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90120379bd914d71996458c1e2a3e25a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_90120379bd914d71996458c1e2a3e25a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/90120379bd914d71996458c1e2a3e25a"}]}] Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerActionsTestJSON-741053275 Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 90120379bd914d71996458c1e2a3e25a Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerActionsTestJSON-741053275 Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerActionsTestJSON-741053275-project Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 6a742410e1794902a11125c6369dadcc Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerActionsTestJSON-741053275-project Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 could not be found. Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '0f277bed-5ae8-4688-a2ca-9be78f6cc3c8'} Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 could not be found. Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 could not be found. Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:27:27.954864 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.959181 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:27:27.959181 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:27:27.959181 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:27:27.959181 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:27:27.959181 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:27:27.959181 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 could not be found. Jul 25 15:27:27.959181 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.959181 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cf581064-54a7-40f9-9c6b-a70f3a83d14c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Returning 404 to user: Instance 0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:27:27.959181 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cf581064-54a7-40f9-9c6b-a70f3a83d14c tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8" status: 404 len: 111 microversion: 2.1 time: 0.031104 Jul 25 15:27:27.960085 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3749/7270] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:27 2022] GET /compute/v2.1/servers/0f277bed-5ae8-4688-a2ca-9be78f6cc3c8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:27:27.965147 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-84b19c21-9f40-4e1a-add0-477e1880e8e0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:27.965655 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-84b19c21-9f40-4e1a-add0-477e1880e8e0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:27.972112 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-84b19c21-9f40-4e1a-add0-477e1880e8e0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:27.972524 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-84b19c21-9f40-4e1a-add0-477e1880e8e0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:27.973278 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-84b19c21-9f40-4e1a-add0-477e1880e8e0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:27.973763 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-84b19c21-9f40-4e1a-add0-477e1880e8e0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:27.989677 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-84b19c21-9f40-4e1a-add0-477e1880e8e0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] HTTP exception thrown: Instance 0bc09e50-a11b-4c53-8d48-099363bc606d could not be found. Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-84b19c21-9f40-4e1a-add0-477e1880e8e0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Request method failure captured: Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d HTTP/1.1 Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rSjEyisMD8DvTH7b56ad3M9V4r9Z2oHgANxXbb97f0WFMCsa1v0ECdPWSwcD3bin0DxN2VyKMiUlFTU-JUG9Ua6IQiCvvNBHc0-kGj7SnhEHtthZB_ln1XXzCzW_WOLiNqJwI6WQfWOze_2VM1L7b9fm_wuF4gcUsql3_EhcnWK2us Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 90120379bd914d71996458c1e2a3e25a Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServerActionsTestJSON-741053275 Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90120379bd914d71996458c1e2a3e25a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90120379bd914d71996458c1e2a3e25a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_90120379bd914d71996458c1e2a3e25a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/90120379bd914d71996458c1e2a3e25a"}]}] Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServerActionsTestJSON-741053275 Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 90120379bd914d71996458c1e2a3e25a Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServerActionsTestJSON-741053275 Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServerActionsTestJSON-741053275-project Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 6a742410e1794902a11125c6369dadcc Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServerActionsTestJSON-741053275-project Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 0bc09e50-a11b-4c53-8d48-099363bc606d could not be found. Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '0bc09e50-a11b-4c53-8d48-099363bc606d'} Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bc09e50-a11b-4c53-8d48-099363bc606d could not be found. Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:27:27.991272 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:27:27.995683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bc09e50-a11b-4c53-8d48-099363bc606d could not be found. Jul 25 15:27:27.995683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.995683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:27:27.995683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.995683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:27:27.995683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:27:27.995683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:27:27.995683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:27:27.995683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:27:27.995683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bc09e50-a11b-4c53-8d48-099363bc606d could not be found. Jul 25 15:27:27.995683 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:27:27.995683 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-84b19c21-9f40-4e1a-add0-477e1880e8e0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Returning 404 to user: Instance 0bc09e50-a11b-4c53-8d48-099363bc606d could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:27:27.995683 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-84b19c21-9f40-4e1a-add0-477e1880e8e0 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "DELETE /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 404 len: 111 microversion: 2.1 time: 0.031500 Jul 25 15:27:27.995683 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3522/7271] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:27:27 2022] DELETE /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:27:28.001860 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a4198523-3065-4f01-bc77-a3a9c3e1b089 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:28.002484 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a4198523-3065-4f01-bc77-a3a9c3e1b089 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] [instance: 0bc09e50-a11b-4c53-8d48-099363bc606d] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:28.009257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4198523-3065-4f01-bc77-a3a9c3e1b089 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:28.009727 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4198523-3065-4f01-bc77-a3a9c3e1b089 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:28.010510 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4198523-3065-4f01-bc77-a3a9c3e1b089 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:28.010955 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a4198523-3065-4f01-bc77-a3a9c3e1b089 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:28.025520 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-a4198523-3065-4f01-bc77-a3a9c3e1b089 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] HTTP exception thrown: Instance 0bc09e50-a11b-4c53-8d48-099363bc606d could not be found. Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a4198523-3065-4f01-bc77-a3a9c3e1b089 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Request method failure captured: Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d HTTP/1.1 Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3rSjEyisMD8DvTH7b56ad3M9V4r9Z2oHgANxXbb97f0WFMCsa1v0ECdPWSwcD3bin0DxN2VyKMiUlFTU-JUG9Ua6IQiCvvNBHc0-kGj7SnhEHtthZB_ln1XXzCzW_WOLiNqJwI6WQfWOze_2VM1L7b9fm_wuF4gcUsql3_EhcnWK2us Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 90120379bd914d71996458c1e2a3e25a Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServerActionsTestJSON-741053275 Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90120379bd914d71996458c1e2a3e25a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/90120379bd914d71996458c1e2a3e25a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_90120379bd914d71996458c1e2a3e25a", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/90120379bd914d71996458c1e2a3e25a"}]}] Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServerActionsTestJSON-741053275 Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 90120379bd914d71996458c1e2a3e25a Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServerActionsTestJSON-741053275 Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServerActionsTestJSON-741053275-project Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 6a742410e1794902a11125c6369dadcc Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServerActionsTestJSON-741053275-project Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 0bc09e50-a11b-4c53-8d48-099363bc606d could not be found. Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '0bc09e50-a11b-4c53-8d48-099363bc606d'} Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bc09e50-a11b-4c53-8d48-099363bc606d could not be found. Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bc09e50-a11b-4c53-8d48-099363bc606d could not be found. Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:27:28.027191 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:27:28.031449 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:27:28.031449 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:27:28.031449 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:27:28.031449 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:27:28.031449 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:27:28.031449 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bc09e50-a11b-4c53-8d48-099363bc606d could not be found. Jul 25 15:27:28.031449 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:27:28.031449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a4198523-3065-4f01-bc77-a3a9c3e1b089 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Returning 404 to user: Instance 0bc09e50-a11b-4c53-8d48-099363bc606d could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:27:28.031449 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a4198523-3065-4f01-bc77-a3a9c3e1b089 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d" status: 404 len: 111 microversion: 2.1 time: 0.030689 Jul 25 15:27:28.031449 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3750/7272] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:27 2022] GET /compute/v2.1/servers/0bc09e50-a11b-4c53-8d48-099363bc606d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:27:28.037724 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d23200bf-d528-4a45-bee0-5e9b99c76c70 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] Calling method '.version_select at 0x7f4686992a60>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:28.063807 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d23200bf-d528-4a45-bee0-5e9b99c76c70 tempest-ServerActionsTestJSON-741053275 tempest-ServerActionsTestJSON-741053275-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-720982627" status: 202 len: 0 microversion: 2.1 time: 0.029958 Jul 25 15:27:28.064446 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3523/7273] 10.222.0.88 () {58 vars in 1218 bytes} [Mon Jul 25 15:27:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-720982627 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:27:38.062715 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=9 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:27:38.063513 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=37 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:27:38.257736 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bc3ad53b-f730-4c1e-870b-0ee0d7e5ca7b tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1769912452", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "8358c271-1a24-4788-9e3e-2b24acca691b"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:27:38.317664 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-bc3ad53b-f730-4c1e-870b-0ee0d7e5ca7b tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] validate_networks() for [('8358c271-1a24-4788-9e3e-2b24acca691b', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:27:38.843324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-bc3ad53b-f730-4c1e-870b-0ee0d7e5ca7b tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:27:38.843762 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-bc3ad53b-f730-4c1e-870b-0ee0d7e5ca7b tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:27:38.844282 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-bc3ad53b-f730-4c1e-870b-0ee0d7e5ca7b tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:27:38.844687 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-bc3ad53b-f730-4c1e-870b-0ee0d7e5ca7b tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:27:38.845115 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-bc3ad53b-f730-4c1e-870b-0ee0d7e5ca7b tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:27:38.866387 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bc3ad53b-f730-4c1e-870b-0ee0d7e5ca7b tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:38.866858 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bc3ad53b-f730-4c1e-870b-0ee0d7e5ca7b tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:38.868285 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bc3ad53b-f730-4c1e-870b-0ee0d7e5ca7b tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:38.868897 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bc3ad53b-f730-4c1e-870b-0ee0d7e5ca7b tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:38.888409 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-bc3ad53b-f730-4c1e-870b-0ee0d7e5ca7b tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Getting quotas for project b09ca3f76d264303aaaf6f0e34251449. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:27:38.894938 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-bc3ad53b-f730-4c1e-870b-0ee0d7e5ca7b tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Getting quotas for user c6acfac146f6436c8119b095599bfe81 and project b09ca3f76d264303aaaf6f0e34251449. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:27:38.910016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bc3ad53b-f730-4c1e-870b-0ee0d7e5ca7b tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:27:38.912452 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bc3ad53b-f730-4c1e-870b-0ee0d7e5ca7b tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: 4238d8ed-b8be-422d-a92e-7006fd5fb148] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:27:38.961563 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bc3ad53b-f730-4c1e-870b-0ee0d7e5ca7b tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.904439 Jul 25 15:27:38.962528 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3751/7274] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:27:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:27:38.971916 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=13 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:27:38.972799 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:27:38.977525 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b6fd9013-5e2e-4e05-a564-a489a043bc19 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:38.978150 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b6fd9013-5e2e-4e05-a564-a489a043bc19 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: 4238d8ed-b8be-422d-a92e-7006fd5fb148] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:39.044520 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b6fd9013-5e2e-4e05-a564-a489a043bc19 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:39.052542 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b6fd9013-5e2e-4e05-a564-a489a043bc19 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148" status: 200 len: 1217 microversion: 2.1 time: 0.082991 Jul 25 15:27:39.053260 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3524/7275] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:38 2022] GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:40.075914 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f20eef0d-28de-4398-af1c-aaee622e106d tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:40.076756 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f20eef0d-28de-4398-af1c-aaee622e106d tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: 4238d8ed-b8be-422d-a92e-7006fd5fb148] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:40.089696 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f20eef0d-28de-4398-af1c-aaee622e106d tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:40.090601 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f20eef0d-28de-4398-af1c-aaee622e106d tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:40.091895 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f20eef0d-28de-4398-af1c-aaee622e106d tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:40.092365 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f20eef0d-28de-4398-af1c-aaee622e106d tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:40.195227 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f20eef0d-28de-4398-af1c-aaee622e106d tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:40.204174 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f20eef0d-28de-4398-af1c-aaee622e106d tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148" status: 200 len: 1287 microversion: 2.1 time: 0.133482 Jul 25 15:27:40.204881 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3752/7276] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:40 2022] GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148 => generated 1287 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:41.235802 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6c1eafb9-2de6-4016-87e4-a7492b71ea7c tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:41.237755 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6c1eafb9-2de6-4016-87e4-a7492b71ea7c tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: 4238d8ed-b8be-422d-a92e-7006fd5fb148] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:41.247232 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6c1eafb9-2de6-4016-87e4-a7492b71ea7c tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:41.248319 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6c1eafb9-2de6-4016-87e4-a7492b71ea7c tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:41.250003 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6c1eafb9-2de6-4016-87e4-a7492b71ea7c tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:41.250622 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6c1eafb9-2de6-4016-87e4-a7492b71ea7c tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:41.491896 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6c1eafb9-2de6-4016-87e4-a7492b71ea7c tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:41.503572 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6c1eafb9-2de6-4016-87e4-a7492b71ea7c tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148" status: 200 len: 1317 microversion: 2.1 time: 0.273099 Jul 25 15:27:41.504429 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3525/7277] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:41 2022] GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148 => generated 1317 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:27:41.830670 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-4f3031d4-5514-4e4a-8a32-cb7c7dd108c6 req-7cd39b7b-ebac-4801-8822-da587df5e3ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4238d8ed-b8be-422d-a92e-7006fd5fb148", "tag": "56888ecb-68ee-4659-b473-e91abf75119e"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:27:41.843821 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-4f3031d4-5514-4e4a-8a32-cb7c7dd108c6 req-7cd39b7b-ebac-4801-8822-da587df5e3ec service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:41.844314 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-4f3031d4-5514-4e4a-8a32-cb7c7dd108c6 req-7cd39b7b-ebac-4801-8822-da587df5e3ec service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:41.885104 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-4f3031d4-5514-4e4a-8a32-cb7c7dd108c6 req-7cd39b7b-ebac-4801-8822-da587df5e3ec service nova] Creating event network-changed:56888ecb-68ee-4659-b473-e91abf75119e for instance 4238d8ed-b8be-422d-a92e-7006fd5fb148 on n-h1-846435-14 Jul 25 15:27:41.894221 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-4f3031d4-5514-4e4a-8a32-cb7c7dd108c6 req-7cd39b7b-ebac-4801-8822-da587df5e3ec service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067266 Jul 25 15:27:41.894849 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3753/7278] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:27:42.526090 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cc6a6d5b-55d1-41ca-bb05-ef07a104c159 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:42.526687 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cc6a6d5b-55d1-41ca-bb05-ef07a104c159 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: 4238d8ed-b8be-422d-a92e-7006fd5fb148] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:42.534553 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cc6a6d5b-55d1-41ca-bb05-ef07a104c159 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:42.535067 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cc6a6d5b-55d1-41ca-bb05-ef07a104c159 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:42.535844 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cc6a6d5b-55d1-41ca-bb05-ef07a104c159 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:42.536318 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cc6a6d5b-55d1-41ca-bb05-ef07a104c159 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:42.679024 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cc6a6d5b-55d1-41ca-bb05-ef07a104c159 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:42.687380 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cc6a6d5b-55d1-41ca-bb05-ef07a104c159 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148" status: 200 len: 1317 microversion: 2.1 time: 0.165154 Jul 25 15:27:42.687949 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3526/7279] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:42 2022] GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:43.709840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1d73383e-b82e-43b7-8c18-f0dd45fa93e5 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:43.710611 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1d73383e-b82e-43b7-8c18-f0dd45fa93e5 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: 4238d8ed-b8be-422d-a92e-7006fd5fb148] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:43.718701 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1d73383e-b82e-43b7-8c18-f0dd45fa93e5 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:43.719158 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1d73383e-b82e-43b7-8c18-f0dd45fa93e5 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:43.719943 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1d73383e-b82e-43b7-8c18-f0dd45fa93e5 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:43.720407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1d73383e-b82e-43b7-8c18-f0dd45fa93e5 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:43.865675 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1d73383e-b82e-43b7-8c18-f0dd45fa93e5 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:43.875478 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1d73383e-b82e-43b7-8c18-f0dd45fa93e5 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148" status: 200 len: 1317 microversion: 2.1 time: 0.169971 Jul 25 15:27:43.876105 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3754/7280] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:43 2022] GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:44.897157 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-04eabcd4-88ba-4751-af06-01737a8ebab1 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:44.897783 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-04eabcd4-88ba-4751-af06-01737a8ebab1 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: 4238d8ed-b8be-422d-a92e-7006fd5fb148] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:44.905626 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-04eabcd4-88ba-4751-af06-01737a8ebab1 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:44.906083 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-04eabcd4-88ba-4751-af06-01737a8ebab1 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:44.906903 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-04eabcd4-88ba-4751-af06-01737a8ebab1 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:44.907360 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-04eabcd4-88ba-4751-af06-01737a8ebab1 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:45.053492 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-04eabcd4-88ba-4751-af06-01737a8ebab1 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:45.066913 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-04eabcd4-88ba-4751-af06-01737a8ebab1 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148" status: 200 len: 1317 microversion: 2.1 time: 0.174058 Jul 25 15:27:45.067529 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3527/7281] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:44 2022] GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:46.090313 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-69dfecc8-2679-4801-aa61-db65ef811206 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:46.091069 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-69dfecc8-2679-4801-aa61-db65ef811206 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: 4238d8ed-b8be-422d-a92e-7006fd5fb148] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:46.098730 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69dfecc8-2679-4801-aa61-db65ef811206 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:46.099195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69dfecc8-2679-4801-aa61-db65ef811206 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:46.100002 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69dfecc8-2679-4801-aa61-db65ef811206 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:46.100466 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-69dfecc8-2679-4801-aa61-db65ef811206 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:46.257983 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-69dfecc8-2679-4801-aa61-db65ef811206 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:46.266232 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-69dfecc8-2679-4801-aa61-db65ef811206 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148" status: 200 len: 1317 microversion: 2.1 time: 0.180661 Jul 25 15:27:46.266845 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3755/7282] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:46 2022] GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:27:47.287735 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5658be3e-d6ef-4341-9347-70c7560fb02b tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:47.288325 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5658be3e-d6ef-4341-9347-70c7560fb02b tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: 4238d8ed-b8be-422d-a92e-7006fd5fb148] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:47.295965 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5658be3e-d6ef-4341-9347-70c7560fb02b tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:47.296550 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5658be3e-d6ef-4341-9347-70c7560fb02b tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:47.297358 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5658be3e-d6ef-4341-9347-70c7560fb02b tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:47.297802 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5658be3e-d6ef-4341-9347-70c7560fb02b tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:47.450234 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5658be3e-d6ef-4341-9347-70c7560fb02b tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:47.458965 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5658be3e-d6ef-4341-9347-70c7560fb02b tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148" status: 200 len: 1317 microversion: 2.1 time: 0.175411 Jul 25 15:27:47.459543 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3528/7283] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:47 2022] GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:48.480612 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a1684dea-e552-44e9-a381-e8bf7f5802b2 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:48.481197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a1684dea-e552-44e9-a381-e8bf7f5802b2 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: 4238d8ed-b8be-422d-a92e-7006fd5fb148] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:48.489028 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1684dea-e552-44e9-a381-e8bf7f5802b2 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:48.489460 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1684dea-e552-44e9-a381-e8bf7f5802b2 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:48.490276 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1684dea-e552-44e9-a381-e8bf7f5802b2 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:48.490714 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a1684dea-e552-44e9-a381-e8bf7f5802b2 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:48.641726 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a1684dea-e552-44e9-a381-e8bf7f5802b2 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:48.650631 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a1684dea-e552-44e9-a381-e8bf7f5802b2 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148" status: 200 len: 1317 microversion: 2.1 time: 0.174190 Jul 25 15:27:48.651502 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3756/7284] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:48 2022] GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:48.699867 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-9723ca95-f950-44da-96c4-c833d5e8a543 req-9031f084-9fe8-4265-8e26-cf15a717f068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4238d8ed-b8be-422d-a92e-7006fd5fb148", "name": "network-vif-plugged", "status": "completed", "tag": "56888ecb-68ee-4659-b473-e91abf75119e"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:27:48.710953 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-9723ca95-f950-44da-96c4-c833d5e8a543 req-9031f084-9fe8-4265-8e26-cf15a717f068 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:48.711404 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-9723ca95-f950-44da-96c4-c833d5e8a543 req-9031f084-9fe8-4265-8e26-cf15a717f068 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:48.724148 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-9723ca95-f950-44da-96c4-c833d5e8a543 req-9031f084-9fe8-4265-8e26-cf15a717f068 service nova] Creating event network-vif-plugged:56888ecb-68ee-4659-b473-e91abf75119e for instance 4238d8ed-b8be-422d-a92e-7006fd5fb148 on n-h1-846435-14 Jul 25 15:27:48.729433 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-9723ca95-f950-44da-96c4-c833d5e8a543 req-9031f084-9fe8-4265-8e26-cf15a717f068 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033454 Jul 25 15:27:48.730054 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3529/7285] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:27:49.672876 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-361c9148-db12-4e03-8549-16ecab1cac21 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:49.673476 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-361c9148-db12-4e03-8549-16ecab1cac21 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: 4238d8ed-b8be-422d-a92e-7006fd5fb148] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:49.675538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:27:49.676297 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:27:49.683451 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-361c9148-db12-4e03-8549-16ecab1cac21 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:49.683911 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-361c9148-db12-4e03-8549-16ecab1cac21 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:49.684733 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-361c9148-db12-4e03-8549-16ecab1cac21 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:49.685400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-361c9148-db12-4e03-8549-16ecab1cac21 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:49.824726 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-361c9148-db12-4e03-8549-16ecab1cac21 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:49.832870 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-361c9148-db12-4e03-8549-16ecab1cac21 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148" status: 200 len: 1317 microversion: 2.1 time: 0.164175 Jul 25 15:27:49.833462 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3757/7286] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:49 2022] GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:50.851749 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:27:50.857204 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9cc7e16c-e78e-486a-ac1d-8daf25657cc8 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:50.857918 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9cc7e16c-e78e-486a-ac1d-8daf25657cc8 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: 4238d8ed-b8be-422d-a92e-7006fd5fb148] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:50.865041 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9cc7e16c-e78e-486a-ac1d-8daf25657cc8 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:50.865491 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9cc7e16c-e78e-486a-ac1d-8daf25657cc8 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:50.866238 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9cc7e16c-e78e-486a-ac1d-8daf25657cc8 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:50.866697 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9cc7e16c-e78e-486a-ac1d-8daf25657cc8 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:51.017343 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9cc7e16c-e78e-486a-ac1d-8daf25657cc8 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:51.025932 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9cc7e16c-e78e-486a-ac1d-8daf25657cc8 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148" status: 200 len: 1506 microversion: 2.1 time: 0.175211 Jul 25 15:27:51.026515 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3530/7287] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:50 2022] GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148 => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:51.092187 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-81783564-c26d-411f-8832-ea2d32effdfa tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1565787664", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "8358c271-1a24-4788-9e3e-2b24acca691b"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:27:51.147836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-81783564-c26d-411f-8832-ea2d32effdfa tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] validate_networks() for [('8358c271-1a24-4788-9e3e-2b24acca691b', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:27:51.540166 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-81783564-c26d-411f-8832-ea2d32effdfa tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:27:51.540610 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-81783564-c26d-411f-8832-ea2d32effdfa tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:27:51.541111 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-81783564-c26d-411f-8832-ea2d32effdfa tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:27:51.541532 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-81783564-c26d-411f-8832-ea2d32effdfa tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:27:51.541981 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-81783564-c26d-411f-8832-ea2d32effdfa tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:27:51.553808 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-81783564-c26d-411f-8832-ea2d32effdfa tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:51.554524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-81783564-c26d-411f-8832-ea2d32effdfa tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:51.555801 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-81783564-c26d-411f-8832-ea2d32effdfa tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:51.556552 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-81783564-c26d-411f-8832-ea2d32effdfa tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:51.583803 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-81783564-c26d-411f-8832-ea2d32effdfa tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Getting quotas for project b09ca3f76d264303aaaf6f0e34251449. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:27:51.590140 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-81783564-c26d-411f-8832-ea2d32effdfa tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Getting quotas for user c6acfac146f6436c8119b095599bfe81 and project b09ca3f76d264303aaaf6f0e34251449. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:27:51.605088 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-81783564-c26d-411f-8832-ea2d32effdfa tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:27:51.607526 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-81783564-c26d-411f-8832-ea2d32effdfa tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: de9aa182-67f8-45f2-9392-c8d9b0ad312f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:27:51.661041 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-81783564-c26d-411f-8832-ea2d32effdfa tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573155 Jul 25 15:27:51.661745 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3758/7288] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:27:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:27:51.675335 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ab6f582e-311c-45ed-8ec1-fb63d4d7b6b9 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:51.676009 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ab6f582e-311c-45ed-8ec1-fb63d4d7b6b9 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: de9aa182-67f8-45f2-9392-c8d9b0ad312f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:51.737178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ab6f582e-311c-45ed-8ec1-fb63d4d7b6b9 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:51.744905 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ab6f582e-311c-45ed-8ec1-fb63d4d7b6b9 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f" status: 200 len: 1217 microversion: 2.1 time: 0.073765 Jul 25 15:27:51.745503 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3531/7289] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:51 2022] GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:52.766519 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-986100df-853d-4cb8-b87a-2fc3d7b396ed tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:52.767146 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-986100df-853d-4cb8-b87a-2fc3d7b396ed tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: de9aa182-67f8-45f2-9392-c8d9b0ad312f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:52.774848 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-986100df-853d-4cb8-b87a-2fc3d7b396ed tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:52.775309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-986100df-853d-4cb8-b87a-2fc3d7b396ed tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:52.776134 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-986100df-853d-4cb8-b87a-2fc3d7b396ed tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:52.776580 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-986100df-853d-4cb8-b87a-2fc3d7b396ed tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:52.853316 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-986100df-853d-4cb8-b87a-2fc3d7b396ed tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:52.861479 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-986100df-853d-4cb8-b87a-2fc3d7b396ed tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f" status: 200 len: 1275 microversion: 2.1 time: 0.099918 Jul 25 15:27:52.862102 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3759/7290] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:52 2022] GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f => generated 1275 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:53.885110 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d8a4b140-a945-418f-805b-5c04b9fad26e tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:53.886206 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d8a4b140-a945-418f-805b-5c04b9fad26e tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: de9aa182-67f8-45f2-9392-c8d9b0ad312f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:53.894353 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8a4b140-a945-418f-805b-5c04b9fad26e tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:53.895107 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8a4b140-a945-418f-805b-5c04b9fad26e tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:53.895996 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8a4b140-a945-418f-805b-5c04b9fad26e tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:53.896442 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8a4b140-a945-418f-805b-5c04b9fad26e tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:54.043214 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d8a4b140-a945-418f-805b-5c04b9fad26e tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:54.051953 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d8a4b140-a945-418f-805b-5c04b9fad26e tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f" status: 200 len: 1317 microversion: 2.1 time: 0.171144 Jul 25 15:27:54.052512 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3532/7291] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:53 2022] GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:54.404687 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-f7621599-b773-4ff2-9797-eb97adface1c req-ecd36850-fb76-4c72-9a37-c5a83f407be7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de9aa182-67f8-45f2-9392-c8d9b0ad312f", "tag": "1a24f66b-1499-4350-8004-579cfe02390c"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:27:54.422165 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-f7621599-b773-4ff2-9797-eb97adface1c req-ecd36850-fb76-4c72-9a37-c5a83f407be7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:54.422625 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-f7621599-b773-4ff2-9797-eb97adface1c req-ecd36850-fb76-4c72-9a37-c5a83f407be7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:54.451711 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-f7621599-b773-4ff2-9797-eb97adface1c req-ecd36850-fb76-4c72-9a37-c5a83f407be7 service nova] Creating event network-changed:1a24f66b-1499-4350-8004-579cfe02390c for instance de9aa182-67f8-45f2-9392-c8d9b0ad312f on n-h2-846435-14 Jul 25 15:27:54.457002 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-f7621599-b773-4ff2-9797-eb97adface1c req-ecd36850-fb76-4c72-9a37-c5a83f407be7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056849 Jul 25 15:27:54.458147 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3760/7292] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:27:55.076764 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-43419007-79fb-4b05-8c75-a35e395bf254 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:55.077917 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-43419007-79fb-4b05-8c75-a35e395bf254 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: de9aa182-67f8-45f2-9392-c8d9b0ad312f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:55.091260 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43419007-79fb-4b05-8c75-a35e395bf254 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:55.091709 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43419007-79fb-4b05-8c75-a35e395bf254 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:55.092627 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43419007-79fb-4b05-8c75-a35e395bf254 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:55.092981 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-43419007-79fb-4b05-8c75-a35e395bf254 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:55.241790 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-43419007-79fb-4b05-8c75-a35e395bf254 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:55.250392 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-43419007-79fb-4b05-8c75-a35e395bf254 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f" status: 200 len: 1317 microversion: 2.1 time: 0.180327 Jul 25 15:27:55.251051 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3533/7293] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:55 2022] GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:56.273427 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-18ea1821-cbec-44ff-b97c-1c92293ddb4d tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:56.274153 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-18ea1821-cbec-44ff-b97c-1c92293ddb4d tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: de9aa182-67f8-45f2-9392-c8d9b0ad312f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:56.280907 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-18ea1821-cbec-44ff-b97c-1c92293ddb4d tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:56.281355 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-18ea1821-cbec-44ff-b97c-1c92293ddb4d tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:56.282150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-18ea1821-cbec-44ff-b97c-1c92293ddb4d tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:56.282663 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-18ea1821-cbec-44ff-b97c-1c92293ddb4d tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:56.440249 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-18ea1821-cbec-44ff-b97c-1c92293ddb4d tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:56.448716 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-18ea1821-cbec-44ff-b97c-1c92293ddb4d tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f" status: 200 len: 1317 microversion: 2.1 time: 0.180278 Jul 25 15:27:56.449084 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3761/7294] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:56 2022] GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:57.474097 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cae58898-2613-465e-8eec-7784ef4ed17b tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:57.474801 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cae58898-2613-465e-8eec-7784ef4ed17b tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: de9aa182-67f8-45f2-9392-c8d9b0ad312f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:57.482278 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cae58898-2613-465e-8eec-7784ef4ed17b tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:57.482633 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cae58898-2613-465e-8eec-7784ef4ed17b tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:57.483436 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cae58898-2613-465e-8eec-7784ef4ed17b tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:57.483907 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cae58898-2613-465e-8eec-7784ef4ed17b tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:57.624901 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cae58898-2613-465e-8eec-7784ef4ed17b tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:57.633132 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cae58898-2613-465e-8eec-7784ef4ed17b tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f" status: 200 len: 1317 microversion: 2.1 time: 0.163220 Jul 25 15:27:57.633780 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3534/7295] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:57 2022] GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:58.655242 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0c8547d8-f59b-47ca-bf62-436334905847 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:58.655901 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0c8547d8-f59b-47ca-bf62-436334905847 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: de9aa182-67f8-45f2-9392-c8d9b0ad312f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:58.663812 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c8547d8-f59b-47ca-bf62-436334905847 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:58.664307 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c8547d8-f59b-47ca-bf62-436334905847 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:58.665115 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c8547d8-f59b-47ca-bf62-436334905847 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:58.665606 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c8547d8-f59b-47ca-bf62-436334905847 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:58.805985 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0c8547d8-f59b-47ca-bf62-436334905847 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:58.814501 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0c8547d8-f59b-47ca-bf62-436334905847 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f" status: 200 len: 1317 microversion: 2.1 time: 0.163488 Jul 25 15:27:58.815108 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3762/7296] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:58 2022] GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:27:59.836298 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d63cc159-c5d5-4ca8-875a-f5a9d465f725 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:27:59.836957 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d63cc159-c5d5-4ca8-875a-f5a9d465f725 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: de9aa182-67f8-45f2-9392-c8d9b0ad312f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:27:59.844440 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d63cc159-c5d5-4ca8-875a-f5a9d465f725 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:59.844893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d63cc159-c5d5-4ca8-875a-f5a9d465f725 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:59.845715 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d63cc159-c5d5-4ca8-875a-f5a9d465f725 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:27:59.846183 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d63cc159-c5d5-4ca8-875a-f5a9d465f725 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:27:59.984679 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d63cc159-c5d5-4ca8-875a-f5a9d465f725 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:27:59.993248 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d63cc159-c5d5-4ca8-875a-f5a9d465f725 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f" status: 200 len: 1317 microversion: 2.1 time: 0.161029 Jul 25 15:27:59.993834 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3535/7297] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:27:59 2022] GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:28:01.014788 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7fb6f354-b9d5-4433-bf28-0335fe8f2973 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:28:01.015636 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7fb6f354-b9d5-4433-bf28-0335fe8f2973 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: de9aa182-67f8-45f2-9392-c8d9b0ad312f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:01.027351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7fb6f354-b9d5-4433-bf28-0335fe8f2973 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:01.027829 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7fb6f354-b9d5-4433-bf28-0335fe8f2973 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:01.028744 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7fb6f354-b9d5-4433-bf28-0335fe8f2973 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:01.029190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7fb6f354-b9d5-4433-bf28-0335fe8f2973 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:01.171626 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-fc371774-31b3-4e1c-83bc-885c5a108bfd req-6a263a8f-8caf-46b8-bcd2-c52a3d486db2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de9aa182-67f8-45f2-9392-c8d9b0ad312f", "name": "network-vif-plugged", "status": "completed", "tag": "1a24f66b-1499-4350-8004-579cfe02390c"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:28:01.173102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7fb6f354-b9d5-4433-bf28-0335fe8f2973 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:28:01.181826 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7fb6f354-b9d5-4433-bf28-0335fe8f2973 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f" status: 200 len: 1317 microversion: 2.1 time: 0.170893 Jul 25 15:28:01.183321 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3763/7298] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:28:01 2022] GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:28:01.183925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-fc371774-31b3-4e1c-83bc-885c5a108bfd req-6a263a8f-8caf-46b8-bcd2-c52a3d486db2 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:01.184408 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-fc371774-31b3-4e1c-83bc-885c5a108bfd req-6a263a8f-8caf-46b8-bcd2-c52a3d486db2 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:01.198572 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-fc371774-31b3-4e1c-83bc-885c5a108bfd req-6a263a8f-8caf-46b8-bcd2-c52a3d486db2 service nova] Creating event network-vif-plugged:1a24f66b-1499-4350-8004-579cfe02390c for instance de9aa182-67f8-45f2-9392-c8d9b0ad312f on n-h2-846435-14 Jul 25 15:28:01.204546 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-fc371774-31b3-4e1c-83bc-885c5a108bfd req-6a263a8f-8caf-46b8-bcd2-c52a3d486db2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037258 Jul 25 15:28:01.205171 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3536/7299] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:28:02.205309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d30a9148-da8a-4dc0-aa50-8934383770a1 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:28:02.206023 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d30a9148-da8a-4dc0-aa50-8934383770a1 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: de9aa182-67f8-45f2-9392-c8d9b0ad312f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:02.208037 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:28:02.208744 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:28:02.216313 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d30a9148-da8a-4dc0-aa50-8934383770a1 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:02.216785 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d30a9148-da8a-4dc0-aa50-8934383770a1 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:02.217618 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d30a9148-da8a-4dc0-aa50-8934383770a1 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:02.218053 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d30a9148-da8a-4dc0-aa50-8934383770a1 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:02.356669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d30a9148-da8a-4dc0-aa50-8934383770a1 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:28:02.364977 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d30a9148-da8a-4dc0-aa50-8934383770a1 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f" status: 200 len: 1317 microversion: 2.1 time: 0.163774 Jul 25 15:28:02.365570 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3764/7300] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:28:02 2022] GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:28:03.383835 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:28:03.389841 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-868bbfb9-187d-49d9-b5ac-315a13800409 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:28:03.390548 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-868bbfb9-187d-49d9-b5ac-315a13800409 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: de9aa182-67f8-45f2-9392-c8d9b0ad312f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:03.397765 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-868bbfb9-187d-49d9-b5ac-315a13800409 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:03.398220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-868bbfb9-187d-49d9-b5ac-315a13800409 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:03.399111 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-868bbfb9-187d-49d9-b5ac-315a13800409 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:03.399561 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-868bbfb9-187d-49d9-b5ac-315a13800409 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:03.541310 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-868bbfb9-187d-49d9-b5ac-315a13800409 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:28:03.550514 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-868bbfb9-187d-49d9-b5ac-315a13800409 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f" status: 200 len: 1506 microversion: 2.1 time: 0.167538 Jul 25 15:28:03.551190 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3537/7301] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:28:03 2022] GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:28:03.582370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3e6ba014-5829-42f2-af6e-af0e9cfa61e1 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:28:03.583066 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3e6ba014-5829-42f2-af6e-af0e9cfa61e1 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: de9aa182-67f8-45f2-9392-c8d9b0ad312f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:03.590385 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e6ba014-5829-42f2-af6e-af0e9cfa61e1 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:03.590858 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e6ba014-5829-42f2-af6e-af0e9cfa61e1 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:03.591700 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e6ba014-5829-42f2-af6e-af0e9cfa61e1 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:03.592860 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e6ba014-5829-42f2-af6e-af0e9cfa61e1 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:03.620576 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3e6ba014-5829-42f2-af6e-af0e9cfa61e1 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: de9aa182-67f8-45f2-9392-c8d9b0ad312f] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:28:03.710595 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3e6ba014-5829-42f2-af6e-af0e9cfa61e1 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "DELETE /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f" status: 204 len: 0 microversion: 2.1 time: 0.134716 Jul 25 15:28:03.711195 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3765/7302] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:28:03 2022] DELETE /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:28:03.720948 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cac46311-235e-4eb3-83b0-55945af1ca4d tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:28:03.721614 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cac46311-235e-4eb3-83b0-55945af1ca4d tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: de9aa182-67f8-45f2-9392-c8d9b0ad312f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:03.728972 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cac46311-235e-4eb3-83b0-55945af1ca4d tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:03.729529 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cac46311-235e-4eb3-83b0-55945af1ca4d tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:03.730297 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cac46311-235e-4eb3-83b0-55945af1ca4d tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:03.730750 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cac46311-235e-4eb3-83b0-55945af1ca4d tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:03.872411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cac46311-235e-4eb3-83b0-55945af1ca4d tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:28:03.880957 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cac46311-235e-4eb3-83b0-55945af1ca4d tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f" status: 200 len: 1512 microversion: 2.1 time: 0.164500 Jul 25 15:28:03.881591 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3538/7303] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:28:03 2022] GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:28:04.903632 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3cfcaae6-41bf-4056-b264-5b5e592d998d tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:28:04.904387 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3cfcaae6-41bf-4056-b264-5b5e592d998d tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: de9aa182-67f8-45f2-9392-c8d9b0ad312f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:04.911581 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3cfcaae6-41bf-4056-b264-5b5e592d998d tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:04.912071 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3cfcaae6-41bf-4056-b264-5b5e592d998d tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:04.912865 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3cfcaae6-41bf-4056-b264-5b5e592d998d tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:04.913314 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3cfcaae6-41bf-4056-b264-5b5e592d998d tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:05.059350 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3cfcaae6-41bf-4056-b264-5b5e592d998d tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:28:05.067829 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3cfcaae6-41bf-4056-b264-5b5e592d998d tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f" status: 200 len: 1512 microversion: 2.1 time: 0.168600 Jul 25 15:28:05.068455 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3766/7304] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:28:04 2022] GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:28:05.755001 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-b53e9b6d-59ae-4d2c-8deb-6e2a5c6f8da6 req-df36ba95-d252-4183-b43d-a0eb4653c618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de9aa182-67f8-45f2-9392-c8d9b0ad312f", "name": "network-vif-deleted", "tag": "1a24f66b-1499-4350-8004-579cfe02390c"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:28:05.774331 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b53e9b6d-59ae-4d2c-8deb-6e2a5c6f8da6 req-df36ba95-d252-4183-b43d-a0eb4653c618 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:05.774331 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b53e9b6d-59ae-4d2c-8deb-6e2a5c6f8da6 req-df36ba95-d252-4183-b43d-a0eb4653c618 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:05.795513 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-b53e9b6d-59ae-4d2c-8deb-6e2a5c6f8da6 req-df36ba95-d252-4183-b43d-a0eb4653c618 service nova] Creating event network-vif-deleted:1a24f66b-1499-4350-8004-579cfe02390c for instance de9aa182-67f8-45f2-9392-c8d9b0ad312f on n-h2-846435-14 Jul 25 15:28:05.819359 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-b53e9b6d-59ae-4d2c-8deb-6e2a5c6f8da6 req-df36ba95-d252-4183-b43d-a0eb4653c618 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069937 Jul 25 15:28:05.824487 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3539/7305] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:28:06.089323 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d70e669b-d039-43b1-a6f7-35ad877677d3 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:28:06.089897 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d70e669b-d039-43b1-a6f7-35ad877677d3 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: de9aa182-67f8-45f2-9392-c8d9b0ad312f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:06.097609 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d70e669b-d039-43b1-a6f7-35ad877677d3 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:06.098074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d70e669b-d039-43b1-a6f7-35ad877677d3 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:06.098844 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d70e669b-d039-43b1-a6f7-35ad877677d3 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:06.099287 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d70e669b-d039-43b1-a6f7-35ad877677d3 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:06.132449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d70e669b-d039-43b1-a6f7-35ad877677d3 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:06.132812 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d70e669b-d039-43b1-a6f7-35ad877677d3 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:06.133315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-d70e669b-d039-43b1-a6f7-35ad877677d3 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lazy-loading 'fault' on Instance uuid de9aa182-67f8-45f2-9392-c8d9b0ad312f {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:28:06.177018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d70e669b-d039-43b1-a6f7-35ad877677d3 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:28:06.185820 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d70e669b-d039-43b1-a6f7-35ad877677d3 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f" status: 200 len: 1307 microversion: 2.1 time: 0.100371 Jul 25 15:28:06.186425 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3767/7306] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:28:06 2022] GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:28:07.208836 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8d2c0794-b77b-4cad-bed7-f43e2ad16cac tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:28:07.209525 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8d2c0794-b77b-4cad-bed7-f43e2ad16cac tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: de9aa182-67f8-45f2-9392-c8d9b0ad312f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:07.216402 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8d2c0794-b77b-4cad-bed7-f43e2ad16cac tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:07.216827 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8d2c0794-b77b-4cad-bed7-f43e2ad16cac tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:07.217627 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8d2c0794-b77b-4cad-bed7-f43e2ad16cac tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:07.218059 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8d2c0794-b77b-4cad-bed7-f43e2ad16cac tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:07.232455 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-8d2c0794-b77b-4cad-bed7-f43e2ad16cac tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] HTTP exception thrown: Instance de9aa182-67f8-45f2-9392-c8d9b0ad312f could not be found. Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8d2c0794-b77b-4cad-bed7-f43e2ad16cac tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Request method failure captured: Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f HTTP/1.1 Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rZpPpPC7OPBmJTKYaA-meN-cgb_LVh7VqSk6zQ1dONZ360aqoJFDCrhvwRu_S4Ie5srwrqajyGCwPsLmpesm-ZBVRmXUP2qAfJyLukHJH9ffY9u000ybo_Em6vZRM_OltrlndhNRZKmzYTuZyqeRaCJrw-3dnDP3inkwtr2dlglaO8 Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: b09ca3f76d264303aaaf6f0e34251449 Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersNegativeTestJSON-1949662257 Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b09ca3f76d264303aaaf6f0e34251449"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b09ca3f76d264303aaaf6f0e34251449"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b09ca3f76d264303aaaf6f0e34251449", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b09ca3f76d264303aaaf6f0e34251449"}]}] Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersNegativeTestJSON-1949662257 Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: b09ca3f76d264303aaaf6f0e34251449 Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1949662257 Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersNegativeTestJSON-1949662257-project Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: c6acfac146f6436c8119b095599bfe81 Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersNegativeTestJSON-1949662257-project Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance de9aa182-67f8-45f2-9392-c8d9b0ad312f could not be found. Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'de9aa182-67f8-45f2-9392-c8d9b0ad312f'} Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de9aa182-67f8-45f2-9392-c8d9b0ad312f could not be found. Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de9aa182-67f8-45f2-9392-c8d9b0ad312f could not be found. Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:28:07.234132 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:28:07.238645 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:28:07.238645 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:28:07.238645 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:28:07.238645 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:28:07.238645 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:28:07.238645 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de9aa182-67f8-45f2-9392-c8d9b0ad312f could not be found. Jul 25 15:28:07.238645 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:28:07.238645 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8d2c0794-b77b-4cad-bed7-f43e2ad16cac tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Returning 404 to user: Instance de9aa182-67f8-45f2-9392-c8d9b0ad312f could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:28:07.238645 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8d2c0794-b77b-4cad-bed7-f43e2ad16cac tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f" status: 404 len: 111 microversion: 2.1 time: 0.031952 Jul 25 15:28:07.238645 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3540/7307] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:28:07 2022] GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:28:07.246419 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-13285d8d-6c6d-46f8-bb13-362cc6f5343c tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:28:07.247102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-13285d8d-6c6d-46f8-bb13-362cc6f5343c tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: 4238d8ed-b8be-422d-a92e-7006fd5fb148] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:07.254317 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-13285d8d-6c6d-46f8-bb13-362cc6f5343c tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:07.254787 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-13285d8d-6c6d-46f8-bb13-362cc6f5343c tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:07.255569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-13285d8d-6c6d-46f8-bb13-362cc6f5343c tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:07.256019 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-13285d8d-6c6d-46f8-bb13-362cc6f5343c tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:07.260391 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:28:07.398031 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-13285d8d-6c6d-46f8-bb13-362cc6f5343c tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:28:07.406154 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-13285d8d-6c6d-46f8-bb13-362cc6f5343c tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148" status: 200 len: 1506 microversion: 2.1 time: 0.164238 Jul 25 15:28:07.406747 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3768/7308] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:28:07 2022] GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:28:07.426767 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-366e6719-a330-459f-a804-38ff0ee953fd tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:28:07.429044 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-366e6719-a330-459f-a804-38ff0ee953fd tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: 46412b61-a05d-4e43-a2f9-3f77ba6e5199] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:07.434777 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-366e6719-a330-459f-a804-38ff0ee953fd tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] HTTP exception thrown: Instance 46412b61-a05d-4e43-a2f9-3f77ba6e5199 could not be found. Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-366e6719-a330-459f-a804-38ff0ee953fd tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Request method failure captured: Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/servers/46412b61-a05d-4e43-a2f9-3f77ba6e5199/action HTTP/1.1 Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 32 Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rZpPpPC7OPBmJTKYaA-meN-cgb_LVh7VqSk6zQ1dONZ360aqoJFDCrhvwRu_S4Ie5srwrqajyGCwPsLmpesm-ZBVRmXUP2qAfJyLukHJH9ffY9u000ybo_Em6vZRM_OltrlndhNRZKmzYTuZyqeRaCJrw-3dnDP3inkwtr2dlglaO8 Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: b09ca3f76d264303aaaf6f0e34251449 Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersNegativeTestJSON-1949662257 Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b09ca3f76d264303aaaf6f0e34251449"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b09ca3f76d264303aaaf6f0e34251449"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b09ca3f76d264303aaaf6f0e34251449", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b09ca3f76d264303aaaf6f0e34251449"}]}] Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersNegativeTestJSON-1949662257 Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: b09ca3f76d264303aaaf6f0e34251449 Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1949662257 Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersNegativeTestJSON-1949662257-project Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: c6acfac146f6436c8119b095599bfe81 Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersNegativeTestJSON-1949662257-project Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: {"resize": {"flavorRef": "452"}} Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 46412b61-a05d-4e43-a2f9-3f77ba6e5199 could not be found. Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '46412b61-a05d-4e43-a2f9-3f77ba6e5199', 'body': {'resize': {'flavorRef': '452'}}} Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46412b61-a05d-4e43-a2f9-3f77ba6e5199 could not be found. Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:28:07.436388 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:28:07.440765 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46412b61-a05d-4e43-a2f9-3f77ba6e5199 could not be found. Jul 25 15:28:07.440765 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:28:07.440765 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:28:07.440765 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:28:07.440765 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:28:07.440765 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:28:07.440765 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:28:07.440765 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:28:07.440765 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:28:07.440765 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46412b61-a05d-4e43-a2f9-3f77ba6e5199 could not be found. Jul 25 15:28:07.440765 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:28:07.440765 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-366e6719-a330-459f-a804-38ff0ee953fd tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Returning 404 to user: Instance 46412b61-a05d-4e43-a2f9-3f77ba6e5199 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:28:07.440765 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-366e6719-a330-459f-a804-38ff0ee953fd tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "POST /compute/v2.1/servers/46412b61-a05d-4e43-a2f9-3f77ba6e5199/action" status: 404 len: 111 microversion: 2.1 time: 0.015079 Jul 25 15:28:07.440765 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3541/7309] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:28:07 2022] POST /compute/v2.1/servers/46412b61-a05d-4e43-a2f9-3f77ba6e5199/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:28:07.447004 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-897aca40-3c68-439f-8d3e-4deb477e5eb4 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:28:07.447751 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-897aca40-3c68-439f-8d3e-4deb477e5eb4 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: 4238d8ed-b8be-422d-a92e-7006fd5fb148] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:07.454436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-897aca40-3c68-439f-8d3e-4deb477e5eb4 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:07.454904 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-897aca40-3c68-439f-8d3e-4deb477e5eb4 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:07.455645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-897aca40-3c68-439f-8d3e-4deb477e5eb4 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:07.456122 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-897aca40-3c68-439f-8d3e-4deb477e5eb4 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:07.605337 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-897aca40-3c68-439f-8d3e-4deb477e5eb4 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:28:07.615162 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-897aca40-3c68-439f-8d3e-4deb477e5eb4 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148" status: 200 len: 1506 microversion: 2.1 time: 0.171784 Jul 25 15:28:07.615814 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3769/7310] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:28:07 2022] GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148 => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:28:07.652883 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ea976faa-5ff5-44e2-9b45-eb553e0ab42a tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:28:07.654066 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ea976faa-5ff5-44e2-9b45-eb553e0ab42a tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: 4238d8ed-b8be-422d-a92e-7006fd5fb148] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:07.665654 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ea976faa-5ff5-44e2-9b45-eb553e0ab42a tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:07.666453 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ea976faa-5ff5-44e2-9b45-eb553e0ab42a tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:07.667723 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ea976faa-5ff5-44e2-9b45-eb553e0ab42a tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:07.668473 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ea976faa-5ff5-44e2-9b45-eb553e0ab42a tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:07.829913 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ea976faa-5ff5-44e2-9b45-eb553e0ab42a tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:28:07.837765 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ea976faa-5ff5-44e2-9b45-eb553e0ab42a tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148" status: 200 len: 1506 microversion: 2.1 time: 0.191913 Jul 25 15:28:07.838344 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3542/7311] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:28:07 2022] GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148 => generated 1506 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:28:07.858772 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e43d8bc4-9255-4a32-ab4a-459c003bfe57 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "b9f29964-d955-4e99-945a-1cbaf0a6cb95"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:28:07.861185 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e43d8bc4-9255-4a32-ab4a-459c003bfe57 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: 4238d8ed-b8be-422d-a92e-7006fd5fb148] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:07.867851 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e43d8bc4-9255-4a32-ab4a-459c003bfe57 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:07.868347 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e43d8bc4-9255-4a32-ab4a-459c003bfe57 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:07.869124 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e43d8bc4-9255-4a32-ab4a-459c003bfe57 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:07.869569 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e43d8bc4-9255-4a32-ab4a-459c003bfe57 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:07.909963 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e43d8bc4-9255-4a32-ab4a-459c003bfe57 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:28:07.916677 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-e43d8bc4-9255-4a32-ab4a-459c003bfe57 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] HTTP exception thrown: Flavor b9f29964-d955-4e99-945a-1cbaf0a6cb95 could not be found. Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e43d8bc4-9255-4a32-ab4a-459c003bfe57 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Request method failure captured: Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: request: POST /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148/action HTTP/1.1 Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 65 Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3rZpPpPC7OPBmJTKYaA-meN-cgb_LVh7VqSk6zQ1dONZ360aqoJFDCrhvwRu_S4Ie5srwrqajyGCwPsLmpesm-ZBVRmXUP2qAfJyLukHJH9ffY9u000ybo_Em6vZRM_OltrlndhNRZKmzYTuZyqeRaCJrw-3dnDP3inkwtr2dlglaO8 Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: b09ca3f76d264303aaaf6f0e34251449 Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersNegativeTestJSON-1949662257 Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b09ca3f76d264303aaaf6f0e34251449"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b09ca3f76d264303aaaf6f0e34251449"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b09ca3f76d264303aaaf6f0e34251449", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b09ca3f76d264303aaaf6f0e34251449"}]}] Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersNegativeTestJSON-1949662257 Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: b09ca3f76d264303aaaf6f0e34251449 Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1949662257 Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersNegativeTestJSON-1949662257-project Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: c6acfac146f6436c8119b095599bfe81 Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersNegativeTestJSON-1949662257-project Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: {"resize": {"flavorRef": "b9f29964-d955-4e99-945a-1cbaf0a6cb95"}} Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: exception: Flavor b9f29964-d955-4e99-945a-1cbaf0a6cb95 could not be found. Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '4238d8ed-b8be-422d-a92e-7006fd5fb148', 'body': {'resize': {'flavorRef': 'b9f29964-d955-4e99-945a-1cbaf0a6cb95'}}} Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 15:28:07.918633 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor b9f29964-d955-4e99-945a-1cbaf0a6cb95 could not be found. Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor b9f29964-d955-4e99-945a-1cbaf0a6cb95 could not be found. Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor b9f29964-d955-4e99-945a-1cbaf0a6cb95 could not be found. Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e43d8bc4-9255-4a32-ab4a-459c003bfe57 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Returning 400 to user: Flavor b9f29964-d955-4e99-945a-1cbaf0a6cb95 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e43d8bc4-9255-4a32-ab4a-459c003bfe57 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "POST /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148/action" status: 400 len: 107 microversion: 2.1 time: 0.065448 Jul 25 15:28:07.923061 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3770/7312] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:28:07 2022] POST /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148/action => generated 107 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 15:28:07.929114 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-59ab8193-52e1-48c4-a9b9-d8528affe0a1 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:28:07.929737 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-59ab8193-52e1-48c4-a9b9-d8528affe0a1 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: 4238d8ed-b8be-422d-a92e-7006fd5fb148] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:07.936131 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59ab8193-52e1-48c4-a9b9-d8528affe0a1 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:07.936586 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59ab8193-52e1-48c4-a9b9-d8528affe0a1 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:07.937355 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59ab8193-52e1-48c4-a9b9-d8528affe0a1 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:07.937785 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-59ab8193-52e1-48c4-a9b9-d8528affe0a1 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:08.077036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-59ab8193-52e1-48c4-a9b9-d8528affe0a1 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:28:08.085579 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-59ab8193-52e1-48c4-a9b9-d8528affe0a1 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148" status: 200 len: 1506 microversion: 2.1 time: 0.160270 Jul 25 15:28:08.086187 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3543/7313] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:28:07 2022] GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:28:08.106647 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-65d51394-96a3-4264-82d8-120908dfb8df tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:28:08.107287 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-65d51394-96a3-4264-82d8-120908dfb8df tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: 4238d8ed-b8be-422d-a92e-7006fd5fb148] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:08.109275 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:28:08.115421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-65d51394-96a3-4264-82d8-120908dfb8df tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:08.115928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-65d51394-96a3-4264-82d8-120908dfb8df tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:08.116741 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-65d51394-96a3-4264-82d8-120908dfb8df tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:08.117521 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-65d51394-96a3-4264-82d8-120908dfb8df tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:08.256445 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-65d51394-96a3-4264-82d8-120908dfb8df tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:28:08.264665 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-65d51394-96a3-4264-82d8-120908dfb8df tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148" status: 200 len: 1506 microversion: 2.1 time: 0.162127 Jul 25 15:28:08.265256 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3771/7314] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:28:08 2022] GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:28:08.285244 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-60bae436-d3e3-4b87-a529-4449bb195192 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-60bae436-d3e3-4b87-a529-4449bb195192 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Request method failure captured: Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: request: POST /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148/action HTTP/1.1 Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 29 Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rZpPpPC7OPBmJTKYaA-meN-cgb_LVh7VqSk6zQ1dONZ360aqoJFDCrhvwRu_S4Ie5srwrqajyGCwPsLmpesm-ZBVRmXUP2qAfJyLukHJH9ffY9u000ybo_Em6vZRM_OltrlndhNRZKmzYTuZyqeRaCJrw-3dnDP3inkwtr2dlglaO8 Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: b09ca3f76d264303aaaf6f0e34251449 Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersNegativeTestJSON-1949662257 Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b09ca3f76d264303aaaf6f0e34251449"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b09ca3f76d264303aaaf6f0e34251449"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b09ca3f76d264303aaaf6f0e34251449", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b09ca3f76d264303aaaf6f0e34251449"}]}] Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersNegativeTestJSON-1949662257 Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: b09ca3f76d264303aaaf6f0e34251449 Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1949662257 Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersNegativeTestJSON-1949662257-project Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: c6acfac146f6436c8119b095599bfe81 Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersNegativeTestJSON-1949662257-project Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: {"resize": {"flavorRef": ""}} Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '4238d8ed-b8be-422d-a92e-7006fd5fb148', 'body': {'resize': {'flavorRef': ''}}} Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise error Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi On instance['resize']: Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi '' Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:28:08.288873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:28:08.293633 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:28:08.293633 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:28:08.293633 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:28:08.293633 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:28:08.293633 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 15:28:08.293633 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 15:28:08.293633 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 25 15:28:08.293633 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:28:08.293633 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-60bae436-d3e3-4b87-a529-4449bb195192 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:28:08.293633 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-60bae436-d3e3-4b87-a529-4449bb195192 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "POST /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148/action" status: 400 len: 113 microversion: 2.1 time: 0.009039 Jul 25 15:28:08.293633 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3544/7315] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:28:08 2022] POST /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 15:28:08.299994 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f6c027ee-3618-4b3c-81ef-40afb78c1c84 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:28:08.300653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f6c027ee-3618-4b3c-81ef-40afb78c1c84 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: 4238d8ed-b8be-422d-a92e-7006fd5fb148] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:08.307048 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6c027ee-3618-4b3c-81ef-40afb78c1c84 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:08.307506 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6c027ee-3618-4b3c-81ef-40afb78c1c84 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:08.308305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6c027ee-3618-4b3c-81ef-40afb78c1c84 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:08.308746 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f6c027ee-3618-4b3c-81ef-40afb78c1c84 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:08.441427 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f6c027ee-3618-4b3c-81ef-40afb78c1c84 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:28:08.449731 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f6c027ee-3618-4b3c-81ef-40afb78c1c84 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148" status: 200 len: 1506 microversion: 2.1 time: 0.153564 Jul 25 15:28:08.450326 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3772/7316] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:28:08 2022] GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:28:08.475235 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9e86c26d-3dc7-46d4-b3b3-19b5ea3ea4ad tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:28:08.475733 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9e86c26d-3dc7-46d4-b3b3-19b5ea3ea4ad tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: de9aa182-67f8-45f2-9392-c8d9b0ad312f] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:08.483500 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9e86c26d-3dc7-46d4-b3b3-19b5ea3ea4ad tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:08.483962 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9e86c26d-3dc7-46d4-b3b3-19b5ea3ea4ad tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:08.484788 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9e86c26d-3dc7-46d4-b3b3-19b5ea3ea4ad tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:08.485233 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9e86c26d-3dc7-46d4-b3b3-19b5ea3ea4ad tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:08.501321 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-9e86c26d-3dc7-46d4-b3b3-19b5ea3ea4ad tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] HTTP exception thrown: Instance de9aa182-67f8-45f2-9392-c8d9b0ad312f could not be found. Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9e86c26d-3dc7-46d4-b3b3-19b5ea3ea4ad tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Request method failure captured: Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f HTTP/1.1 Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rZpPpPC7OPBmJTKYaA-meN-cgb_LVh7VqSk6zQ1dONZ360aqoJFDCrhvwRu_S4Ie5srwrqajyGCwPsLmpesm-ZBVRmXUP2qAfJyLukHJH9ffY9u000ybo_Em6vZRM_OltrlndhNRZKmzYTuZyqeRaCJrw-3dnDP3inkwtr2dlglaO8 Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: b09ca3f76d264303aaaf6f0e34251449 Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersNegativeTestJSON-1949662257 Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b09ca3f76d264303aaaf6f0e34251449"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b09ca3f76d264303aaaf6f0e34251449"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b09ca3f76d264303aaaf6f0e34251449", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b09ca3f76d264303aaaf6f0e34251449"}]}] Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersNegativeTestJSON-1949662257 Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: b09ca3f76d264303aaaf6f0e34251449 Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1949662257 Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersNegativeTestJSON-1949662257-project Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: c6acfac146f6436c8119b095599bfe81 Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersNegativeTestJSON-1949662257-project Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance de9aa182-67f8-45f2-9392-c8d9b0ad312f could not be found. Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'de9aa182-67f8-45f2-9392-c8d9b0ad312f'} Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de9aa182-67f8-45f2-9392-c8d9b0ad312f could not be found. Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:28:08.502978 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:28:08.507341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de9aa182-67f8-45f2-9392-c8d9b0ad312f could not be found. Jul 25 15:28:08.507341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:28:08.507341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:28:08.507341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:28:08.507341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:28:08.507341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:28:08.507341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:28:08.507341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:28:08.507341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:28:08.507341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de9aa182-67f8-45f2-9392-c8d9b0ad312f could not be found. Jul 25 15:28:08.507341 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:28:08.507341 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9e86c26d-3dc7-46d4-b3b3-19b5ea3ea4ad tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Returning 404 to user: Instance de9aa182-67f8-45f2-9392-c8d9b0ad312f could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:28:08.507341 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9e86c26d-3dc7-46d4-b3b3-19b5ea3ea4ad tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "DELETE /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f" status: 404 len: 111 microversion: 2.1 time: 0.034212 Jul 25 15:28:08.507341 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3545/7317] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:28:08 2022] DELETE /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:28:08.513676 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a5f2fc43-1b0c-4386-958c-972a4e81c186 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:28:08.514315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a5f2fc43-1b0c-4386-958c-972a4e81c186 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: de9aa182-67f8-45f2-9392-c8d9b0ad312f] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:08.520784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5f2fc43-1b0c-4386-958c-972a4e81c186 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:08.521245 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5f2fc43-1b0c-4386-958c-972a4e81c186 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:08.522008 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5f2fc43-1b0c-4386-958c-972a4e81c186 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:08.522441 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5f2fc43-1b0c-4386-958c-972a4e81c186 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:08.536384 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-a5f2fc43-1b0c-4386-958c-972a4e81c186 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] HTTP exception thrown: Instance de9aa182-67f8-45f2-9392-c8d9b0ad312f could not be found. Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a5f2fc43-1b0c-4386-958c-972a4e81c186 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Request method failure captured: Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f HTTP/1.1 Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3rZpPpPC7OPBmJTKYaA-meN-cgb_LVh7VqSk6zQ1dONZ360aqoJFDCrhvwRu_S4Ie5srwrqajyGCwPsLmpesm-ZBVRmXUP2qAfJyLukHJH9ffY9u000ybo_Em6vZRM_OltrlndhNRZKmzYTuZyqeRaCJrw-3dnDP3inkwtr2dlglaO8 Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: b09ca3f76d264303aaaf6f0e34251449 Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-ServersNegativeTestJSON-1949662257 Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b09ca3f76d264303aaaf6f0e34251449"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b09ca3f76d264303aaaf6f0e34251449"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b09ca3f76d264303aaaf6f0e34251449", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b09ca3f76d264303aaaf6f0e34251449"}]}] Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-ServersNegativeTestJSON-1949662257 Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: b09ca3f76d264303aaaf6f0e34251449 Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1949662257 Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-ServersNegativeTestJSON-1949662257-project Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: c6acfac146f6436c8119b095599bfe81 Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-ServersNegativeTestJSON-1949662257-project Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance de9aa182-67f8-45f2-9392-c8d9b0ad312f could not be found. Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'de9aa182-67f8-45f2-9392-c8d9b0ad312f'} Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de9aa182-67f8-45f2-9392-c8d9b0ad312f could not be found. Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de9aa182-67f8-45f2-9392-c8d9b0ad312f could not be found. Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:28:08.537922 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:28:08.542252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:28:08.542252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:28:08.542252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:28:08.542252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:28:08.542252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:28:08.542252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de9aa182-67f8-45f2-9392-c8d9b0ad312f could not be found. Jul 25 15:28:08.542252 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:28:08.542252 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a5f2fc43-1b0c-4386-958c-972a4e81c186 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Returning 404 to user: Instance de9aa182-67f8-45f2-9392-c8d9b0ad312f could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:28:08.542252 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a5f2fc43-1b0c-4386-958c-972a4e81c186 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f" status: 404 len: 111 microversion: 2.1 time: 0.029711 Jul 25 15:28:08.542252 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3773/7318] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:28:08 2022] GET /compute/v2.1/servers/de9aa182-67f8-45f2-9392-c8d9b0ad312f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 15:28:08.548308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cc2ede37-afe7-4500-99ba-a3250d996893 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:28:08.548814 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cc2ede37-afe7-4500-99ba-a3250d996893 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: 4238d8ed-b8be-422d-a92e-7006fd5fb148] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:08.555399 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cc2ede37-afe7-4500-99ba-a3250d996893 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:08.555843 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cc2ede37-afe7-4500-99ba-a3250d996893 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:08.556691 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cc2ede37-afe7-4500-99ba-a3250d996893 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:08.557063 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cc2ede37-afe7-4500-99ba-a3250d996893 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:08.583615 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cc2ede37-afe7-4500-99ba-a3250d996893 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: 4238d8ed-b8be-422d-a92e-7006fd5fb148] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:28:08.620323 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:28:08.665749 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cc2ede37-afe7-4500-99ba-a3250d996893 tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "DELETE /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148" status: 204 len: 0 microversion: 2.1 time: 0.121110 Jul 25 15:28:08.666383 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3546/7319] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:28:08 2022] DELETE /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:28:08.674570 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5105cc60-fb2b-48ee-b404-3a4c0489944c tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:28:08.675200 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5105cc60-fb2b-48ee-b404-3a4c0489944c tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: 4238d8ed-b8be-422d-a92e-7006fd5fb148] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:08.681582 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5105cc60-fb2b-48ee-b404-3a4c0489944c tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:08.682038 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5105cc60-fb2b-48ee-b404-3a4c0489944c tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:08.682825 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5105cc60-fb2b-48ee-b404-3a4c0489944c tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:08.683270 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5105cc60-fb2b-48ee-b404-3a4c0489944c tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:08.822711 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5105cc60-fb2b-48ee-b404-3a4c0489944c tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:28:08.831393 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5105cc60-fb2b-48ee-b404-3a4c0489944c tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148" status: 200 len: 1512 microversion: 2.1 time: 0.160709 Jul 25 15:28:08.832005 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3774/7320] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:28:08 2022] GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:28:09.854959 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-be08e7af-89d7-4986-8bd2-513e57f9840a tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:28:09.855687 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-be08e7af-89d7-4986-8bd2-513e57f9840a tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: 4238d8ed-b8be-422d-a92e-7006fd5fb148] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:09.858821 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:28:09.864624 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-be08e7af-89d7-4986-8bd2-513e57f9840a tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:09.865064 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-be08e7af-89d7-4986-8bd2-513e57f9840a tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:09.865851 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-be08e7af-89d7-4986-8bd2-513e57f9840a tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:09.866282 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-be08e7af-89d7-4986-8bd2-513e57f9840a tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:10.030397 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-be08e7af-89d7-4986-8bd2-513e57f9840a tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6acfac146f6436c8119b095599bfe81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ca3f76d264303aaaf6f0e34251449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:28:10.038403 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-be08e7af-89d7-4986-8bd2-513e57f9840a tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148" status: 200 len: 1512 microversion: 2.1 time: 0.187760 Jul 25 15:28:10.039007 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3547/7321] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:28:09 2022] GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148 => generated 1512 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:28:10.519840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-6b46b3c9-6707-40aa-989e-c47765a0c19e req-fb590b36-186f-46b1-971f-c347e5709581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4238d8ed-b8be-422d-a92e-7006fd5fb148", "name": "network-vif-deleted", "tag": "56888ecb-68ee-4659-b473-e91abf75119e"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:28:10.540462 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-6b46b3c9-6707-40aa-989e-c47765a0c19e req-fb590b36-186f-46b1-971f-c347e5709581 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:10.540927 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-6b46b3c9-6707-40aa-989e-c47765a0c19e req-fb590b36-186f-46b1-971f-c347e5709581 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:10.554146 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-6b46b3c9-6707-40aa-989e-c47765a0c19e req-fb590b36-186f-46b1-971f-c347e5709581 service nova] Creating event network-vif-deleted:56888ecb-68ee-4659-b473-e91abf75119e for instance 4238d8ed-b8be-422d-a92e-7006fd5fb148 on n-h1-846435-14 Jul 25 15:28:10.560778 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-6b46b3c9-6707-40aa-989e-c47765a0c19e req-fb590b36-186f-46b1-971f-c347e5709581 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044021 Jul 25 15:28:10.561424 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3775/7322] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:28:11.060323 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6141851c-1835-4693-855d-a4c9c4ca2b9f tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:28:11.060980 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6141851c-1835-4693-855d-a4c9c4ca2b9f tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] [instance: 4238d8ed-b8be-422d-a92e-7006fd5fb148] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:11.068964 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6141851c-1835-4693-855d-a4c9c4ca2b9f tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:11.069424 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6141851c-1835-4693-855d-a4c9c4ca2b9f tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:11.070235 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6141851c-1835-4693-855d-a4c9c4ca2b9f tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:11.070678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6141851c-1835-4693-855d-a4c9c4ca2b9f tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:11.085462 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-6141851c-1835-4693-855d-a4c9c4ca2b9f tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] HTTP exception thrown: Instance 4238d8ed-b8be-422d-a92e-7006fd5fb148 could not be found. Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6141851c-1835-4693-855d-a4c9c4ca2b9f tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Request method failure captured: Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148 HTTP/1.1 Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rZpPpPC7OPBmJTKYaA-meN-cgb_LVh7VqSk6zQ1dONZ360aqoJFDCrhvwRu_S4Ie5srwrqajyGCwPsLmpesm-ZBVRmXUP2qAfJyLukHJH9ffY9u000ybo_Em6vZRM_OltrlndhNRZKmzYTuZyqeRaCJrw-3dnDP3inkwtr2dlglaO8 Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: b09ca3f76d264303aaaf6f0e34251449 Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-ServersNegativeTestJSON-1949662257 Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b09ca3f76d264303aaaf6f0e34251449"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b09ca3f76d264303aaaf6f0e34251449"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b09ca3f76d264303aaaf6f0e34251449", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b09ca3f76d264303aaaf6f0e34251449"}]}] Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-ServersNegativeTestJSON-1949662257 Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: b09ca3f76d264303aaaf6f0e34251449 Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1949662257 Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-ServersNegativeTestJSON-1949662257-project Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: c6acfac146f6436c8119b095599bfe81 Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-ServersNegativeTestJSON-1949662257-project Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 4238d8ed-b8be-422d-a92e-7006fd5fb148 could not be found. Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '4238d8ed-b8be-422d-a92e-7006fd5fb148'} Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4238d8ed-b8be-422d-a92e-7006fd5fb148 could not be found. Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4238d8ed-b8be-422d-a92e-7006fd5fb148 could not be found. Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:28:11.087151 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:28:11.090866 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:28:11.090866 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:28:11.090866 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:28:11.090866 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:28:11.090866 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:28:11.090866 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4238d8ed-b8be-422d-a92e-7006fd5fb148 could not be found. Jul 25 15:28:11.090866 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:28:11.090866 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6141851c-1835-4693-855d-a4c9c4ca2b9f tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] Returning 404 to user: Instance 4238d8ed-b8be-422d-a92e-7006fd5fb148 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:28:11.090866 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6141851c-1835-4693-855d-a4c9c4ca2b9f tempest-ServersNegativeTestJSON-1949662257 tempest-ServersNegativeTestJSON-1949662257-project] 10.222.0.88 "GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148" status: 404 len: 111 microversion: 2.1 time: 0.032456 Jul 25 15:28:11.090866 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3548/7323] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:28:11 2022] GET /compute/v2.1/servers/4238d8ed-b8be-422d-a92e-7006fd5fb148 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:28:44.515547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=9 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:28:44.517904 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=36 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:28:44.740944 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-05832855-aa6d-42e5-9bf8-da384619fe7b tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Action: 'create', calling method: .version_select at 0x7f468612c4c0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1807010490", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFs8NezZBgbM9Ok22ht1i3yUEVyMtHJxsyQFEVu6ccFPiQoQxBl2o0uSW1GYeesjIw5WS7B50PBpS6g3NyHTxOY53LDkZpOWLP+jVtbLnDV9UpWHrlun+Bu+tnxxcPXooA=="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:28:44.759791 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-05832855-aa6d-42e5-9bf8-da384619fe7b tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Getting quotas for project bf818da68ca643a1a1e5b7a05f33a0dc. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:28:44.766423 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-05832855-aa6d-42e5-9bf8-da384619fe7b tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Getting quotas for user 8e96d386c6964cb1bd8626aca1bfdd8b and project bf818da68ca643a1a1e5b7a05f33a0dc. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:28:44.784973 n-d-846435-14 devstack@n-api.service[119304]: ERROR oslo.messaging._drivers.impl_rabbit [None req-05832855-aa6d-42e5-9bf8-da384619fe7b tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [56f6bbb3-d79b-419b-8d71-b05e55801b63] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 15:28:45.794200 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [None req-05832855-aa6d-42e5-9bf8-da384619fe7b tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [56f6bbb3-d79b-419b-8d71-b05e55801b63] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 51156. Jul 25 15:28:45.812777 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-05832855-aa6d-42e5-9bf8-da384619fe7b tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 1.299715 Jul 25 15:28:45.813386 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3776/7324] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 15:28:44 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:28:45.869678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-37762893-a5b4-448d-b5d0-dc78e68f8393 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-140118416", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1807010490", "networks": [{"uuid": "bcf502c2-507c-4568-bbc8-e3a1b97ef89b"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:28:45.878496 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:28:45.879148 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:28:45.929434 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-37762893-a5b4-448d-b5d0-dc78e68f8393 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] validate_networks() for [('bcf502c2-507c-4568-bbc8-e3a1b97ef89b', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:28:46.368951 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-37762893-a5b4-448d-b5d0-dc78e68f8393 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:28:46.369376 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-37762893-a5b4-448d-b5d0-dc78e68f8393 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:28:46.369856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-37762893-a5b4-448d-b5d0-dc78e68f8393 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:28:46.370275 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-37762893-a5b4-448d-b5d0-dc78e68f8393 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:28:46.370687 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-37762893-a5b4-448d-b5d0-dc78e68f8393 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:28:46.379670 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37762893-a5b4-448d-b5d0-dc78e68f8393 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:46.380154 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37762893-a5b4-448d-b5d0-dc78e68f8393 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:46.380958 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37762893-a5b4-448d-b5d0-dc78e68f8393 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:46.381397 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-37762893-a5b4-448d-b5d0-dc78e68f8393 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:46.403689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-37762893-a5b4-448d-b5d0-dc78e68f8393 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Getting quotas for project bf818da68ca643a1a1e5b7a05f33a0dc. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:28:46.409349 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-37762893-a5b4-448d-b5d0-dc78e68f8393 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Getting quotas for user 8e96d386c6964cb1bd8626aca1bfdd8b and project bf818da68ca643a1a1e5b7a05f33a0dc. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:28:46.423011 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-37762893-a5b4-448d-b5d0-dc78e68f8393 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:28:46.425507 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-37762893-a5b4-448d-b5d0-dc78e68f8393 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:28:46.486041 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-37762893-a5b4-448d-b5d0-dc78e68f8393 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.621183 Jul 25 15:28:46.486722 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3549/7325] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:28:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:28:46.497951 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4c260c9c-bb10-4ab2-999a-eb5830d51ec1 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:28:46.498932 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4c260c9c-bb10-4ab2-999a-eb5830d51ec1 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:46.558725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4c260c9c-bb10-4ab2-999a-eb5830d51ec1 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e96d386c6964cb1bd8626aca1bfdd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf818da68ca643a1a1e5b7a05f33a0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:28:46.567329 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4c260c9c-bb10-4ab2-999a-eb5830d51ec1 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9" status: 200 len: 1262 microversion: 2.1 time: 0.073215 Jul 25 15:28:46.568444 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3777/7326] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:28:46 2022] GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 => generated 1262 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:28:47.589302 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-aed21a1a-8d0e-429f-a11e-520bdbaf4560 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:28:47.589909 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-aed21a1a-8d0e-429f-a11e-520bdbaf4560 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:47.607815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aed21a1a-8d0e-429f-a11e-520bdbaf4560 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:47.608593 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aed21a1a-8d0e-429f-a11e-520bdbaf4560 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:47.609647 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aed21a1a-8d0e-429f-a11e-520bdbaf4560 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:47.610829 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aed21a1a-8d0e-429f-a11e-520bdbaf4560 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:47.712043 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-aed21a1a-8d0e-429f-a11e-520bdbaf4560 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e96d386c6964cb1bd8626aca1bfdd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf818da68ca643a1a1e5b7a05f33a0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:28:47.721848 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-aed21a1a-8d0e-429f-a11e-520bdbaf4560 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9" status: 200 len: 1332 microversion: 2.1 time: 0.136642 Jul 25 15:28:47.722454 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3550/7327] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:28:47 2022] GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 => generated 1332 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:28:48.743328 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-487a01fb-4f77-4d89-8d41-6763c1f84eda tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:28:48.744081 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-487a01fb-4f77-4d89-8d41-6763c1f84eda tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:48.751811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-487a01fb-4f77-4d89-8d41-6763c1f84eda tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:48.752811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-487a01fb-4f77-4d89-8d41-6763c1f84eda tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:48.753872 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-487a01fb-4f77-4d89-8d41-6763c1f84eda tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:48.754359 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-487a01fb-4f77-4d89-8d41-6763c1f84eda tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:49.012922 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-487a01fb-4f77-4d89-8d41-6763c1f84eda tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e96d386c6964cb1bd8626aca1bfdd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf818da68ca643a1a1e5b7a05f33a0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:28:49.021641 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-487a01fb-4f77-4d89-8d41-6763c1f84eda tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9" status: 200 len: 1362 microversion: 2.1 time: 0.282626 Jul 25 15:28:49.022656 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3778/7328] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:28:48 2022] GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 => generated 1362 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:28:49.454837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-0617188c-c49d-4aaf-af6e-4a73a7f3e5a5 req-6d6b373c-876e-40ec-8e09-4fde1395c754 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e259d7f-02d7-49c5-8f10-d181ed3b5dc9", "tag": "5f287cb1-342b-4547-ba34-c19c2f57c312"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:28:49.468113 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-0617188c-c49d-4aaf-af6e-4a73a7f3e5a5 req-6d6b373c-876e-40ec-8e09-4fde1395c754 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:49.468565 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-0617188c-c49d-4aaf-af6e-4a73a7f3e5a5 req-6d6b373c-876e-40ec-8e09-4fde1395c754 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:49.483543 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-0617188c-c49d-4aaf-af6e-4a73a7f3e5a5 req-6d6b373c-876e-40ec-8e09-4fde1395c754 service nova] Creating event network-changed:5f287cb1-342b-4547-ba34-c19c2f57c312 for instance 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 on n-h2-846435-14 Jul 25 15:28:49.489311 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-0617188c-c49d-4aaf-af6e-4a73a7f3e5a5 req-6d6b373c-876e-40ec-8e09-4fde1395c754 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038063 Jul 25 15:28:49.489928 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3551/7329] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:28:50.043011 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-60be36c1-bb1c-42de-bc7e-d3cf91449e51 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:28:50.043809 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-60be36c1-bb1c-42de-bc7e-d3cf91449e51 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:50.052433 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60be36c1-bb1c-42de-bc7e-d3cf91449e51 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:50.052744 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60be36c1-bb1c-42de-bc7e-d3cf91449e51 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:50.053540 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60be36c1-bb1c-42de-bc7e-d3cf91449e51 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:50.053989 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-60be36c1-bb1c-42de-bc7e-d3cf91449e51 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:50.189963 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-60be36c1-bb1c-42de-bc7e-d3cf91449e51 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e96d386c6964cb1bd8626aca1bfdd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf818da68ca643a1a1e5b7a05f33a0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:28:50.198247 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-60be36c1-bb1c-42de-bc7e-d3cf91449e51 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9" status: 200 len: 1362 microversion: 2.1 time: 0.159095 Jul 25 15:28:50.199135 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3779/7330] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:28:50 2022] GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:28:51.220666 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-553a810c-b746-436f-8c44-8e2b86188f7e tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:28:51.221343 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-553a810c-b746-436f-8c44-8e2b86188f7e tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:51.228374 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-553a810c-b746-436f-8c44-8e2b86188f7e tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:51.228821 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-553a810c-b746-436f-8c44-8e2b86188f7e tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:51.229609 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-553a810c-b746-436f-8c44-8e2b86188f7e tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:51.230045 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-553a810c-b746-436f-8c44-8e2b86188f7e tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:51.370273 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-553a810c-b746-436f-8c44-8e2b86188f7e tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e96d386c6964cb1bd8626aca1bfdd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf818da68ca643a1a1e5b7a05f33a0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:28:51.378738 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-553a810c-b746-436f-8c44-8e2b86188f7e tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9" status: 200 len: 1362 microversion: 2.1 time: 0.163291 Jul 25 15:28:51.379295 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3552/7331] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:28:51 2022] GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:28:52.399063 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-239f8483-51a6-4fed-97b8-7d4491911cee tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:28:52.399664 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-239f8483-51a6-4fed-97b8-7d4491911cee tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:52.407317 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-239f8483-51a6-4fed-97b8-7d4491911cee tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:52.407780 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-239f8483-51a6-4fed-97b8-7d4491911cee tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:52.408581 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-239f8483-51a6-4fed-97b8-7d4491911cee tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:52.409016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-239f8483-51a6-4fed-97b8-7d4491911cee tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:52.552297 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-239f8483-51a6-4fed-97b8-7d4491911cee tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e96d386c6964cb1bd8626aca1bfdd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf818da68ca643a1a1e5b7a05f33a0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:28:52.560348 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-239f8483-51a6-4fed-97b8-7d4491911cee tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9" status: 200 len: 1362 microversion: 2.1 time: 0.165122 Jul 25 15:28:52.560891 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3780/7332] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:28:52 2022] GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:28:53.581054 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-63dbe1dd-6223-494a-974e-185f0ab3d74a tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:28:53.581624 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-63dbe1dd-6223-494a-974e-185f0ab3d74a tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:53.589292 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-63dbe1dd-6223-494a-974e-185f0ab3d74a tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:53.589738 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-63dbe1dd-6223-494a-974e-185f0ab3d74a tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:53.590595 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-63dbe1dd-6223-494a-974e-185f0ab3d74a tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:53.591024 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-63dbe1dd-6223-494a-974e-185f0ab3d74a tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:53.728599 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-63dbe1dd-6223-494a-974e-185f0ab3d74a tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e96d386c6964cb1bd8626aca1bfdd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf818da68ca643a1a1e5b7a05f33a0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:28:53.736447 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-63dbe1dd-6223-494a-974e-185f0ab3d74a tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9" status: 200 len: 1362 microversion: 2.1 time: 0.159349 Jul 25 15:28:53.737022 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3553/7333] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:28:53 2022] GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:28:54.758097 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-aa63bd73-9648-40e7-af21-8ce6d2c5c912 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:28:54.758747 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-aa63bd73-9648-40e7-af21-8ce6d2c5c912 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:54.766268 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aa63bd73-9648-40e7-af21-8ce6d2c5c912 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:54.766728 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aa63bd73-9648-40e7-af21-8ce6d2c5c912 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:54.767504 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aa63bd73-9648-40e7-af21-8ce6d2c5c912 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:54.767991 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-aa63bd73-9648-40e7-af21-8ce6d2c5c912 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:54.920067 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-aa63bd73-9648-40e7-af21-8ce6d2c5c912 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e96d386c6964cb1bd8626aca1bfdd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf818da68ca643a1a1e5b7a05f33a0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:28:54.931965 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-aa63bd73-9648-40e7-af21-8ce6d2c5c912 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9" status: 200 len: 1362 microversion: 2.1 time: 0.177358 Jul 25 15:28:54.932770 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3781/7334] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:28:54 2022] GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:28:55.397986 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-5f39578d-ba2b-4a96-80ac-13a2da0ed02b req-9b4dac66-1a22-4a5d-b984-6bf3e82e9c7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e259d7f-02d7-49c5-8f10-d181ed3b5dc9", "name": "network-vif-plugged", "status": "completed", "tag": "5f287cb1-342b-4547-ba34-c19c2f57c312"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:28:55.409045 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-5f39578d-ba2b-4a96-80ac-13a2da0ed02b req-9b4dac66-1a22-4a5d-b984-6bf3e82e9c7e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:55.409688 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-5f39578d-ba2b-4a96-80ac-13a2da0ed02b req-9b4dac66-1a22-4a5d-b984-6bf3e82e9c7e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:55.423143 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-5f39578d-ba2b-4a96-80ac-13a2da0ed02b req-9b4dac66-1a22-4a5d-b984-6bf3e82e9c7e service nova] Creating event network-vif-plugged:5f287cb1-342b-4547-ba34-c19c2f57c312 for instance 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 on n-h2-846435-14 Jul 25 15:28:55.433469 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-5f39578d-ba2b-4a96-80ac-13a2da0ed02b req-9b4dac66-1a22-4a5d-b984-6bf3e82e9c7e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035703 Jul 25 15:28:55.433469 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3554/7335] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:28:55.960613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8f42b37a-2fc4-4cf8-a26d-6faecbe123a1 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:28:55.961321 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8f42b37a-2fc4-4cf8-a26d-6faecbe123a1 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:55.969170 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f42b37a-2fc4-4cf8-a26d-6faecbe123a1 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:55.969976 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f42b37a-2fc4-4cf8-a26d-6faecbe123a1 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:55.970735 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f42b37a-2fc4-4cf8-a26d-6faecbe123a1 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:55.971208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8f42b37a-2fc4-4cf8-a26d-6faecbe123a1 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:56.106025 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8f42b37a-2fc4-4cf8-a26d-6faecbe123a1 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e96d386c6964cb1bd8626aca1bfdd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf818da68ca643a1a1e5b7a05f33a0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:28:56.114014 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8f42b37a-2fc4-4cf8-a26d-6faecbe123a1 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9" status: 200 len: 1362 microversion: 2.1 time: 0.157409 Jul 25 15:28:56.114594 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3782/7336] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:28:55 2022] GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:28:57.132333 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:28:57.133950 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:28:57.138459 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c7eb7a06-cde0-4575-b962-cf50e6354e18 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:28:57.139174 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c7eb7a06-cde0-4575-b962-cf50e6354e18 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:57.146682 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c7eb7a06-cde0-4575-b962-cf50e6354e18 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:57.147138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c7eb7a06-cde0-4575-b962-cf50e6354e18 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:57.147914 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c7eb7a06-cde0-4575-b962-cf50e6354e18 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:57.148382 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c7eb7a06-cde0-4575-b962-cf50e6354e18 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:57.290547 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c7eb7a06-cde0-4575-b962-cf50e6354e18 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e96d386c6964cb1bd8626aca1bfdd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf818da68ca643a1a1e5b7a05f33a0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:28:57.298733 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c7eb7a06-cde0-4575-b962-cf50e6354e18 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9" status: 200 len: 1554 microversion: 2.1 time: 0.167402 Jul 25 15:28:57.299317 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3555/7337] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:28:57 2022] GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:28:57.319163 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7fe12b5f-ed29-4856-b746-6afbd9f83530 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:28:57.319786 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7fe12b5f-ed29-4856-b746-6afbd9f83530 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:57.321782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:28:57.328244 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7fe12b5f-ed29-4856-b746-6afbd9f83530 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:57.328704 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7fe12b5f-ed29-4856-b746-6afbd9f83530 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:57.329480 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7fe12b5f-ed29-4856-b746-6afbd9f83530 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:57.329925 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7fe12b5f-ed29-4856-b746-6afbd9f83530 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:57.466026 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7fe12b5f-ed29-4856-b746-6afbd9f83530 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e96d386c6964cb1bd8626aca1bfdd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf818da68ca643a1a1e5b7a05f33a0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:28:57.479162 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7fe12b5f-ed29-4856-b746-6afbd9f83530 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9" status: 200 len: 1554 microversion: 2.1 time: 0.163798 Jul 25 15:28:57.479792 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3783/7338] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:28:57 2022] GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:28:59.149508 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a3f9433e-760c-4828-aefb-bc6a39a7d270 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "026ae917-f0df-4f30-94a6-c89e4619d00b"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:28:59.152423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a3f9433e-760c-4828-aefb-bc6a39a7d270 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:28:59.160113 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a3f9433e-760c-4828-aefb-bc6a39a7d270 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:59.160567 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a3f9433e-760c-4828-aefb-bc6a39a7d270 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:59.161374 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a3f9433e-760c-4828-aefb-bc6a39a7d270 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:28:59.161809 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a3f9433e-760c-4828-aefb-bc6a39a7d270 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:28:59.417488 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a3f9433e-760c-4828-aefb-bc6a39a7d270 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "POST /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271566 Jul 25 15:28:59.418107 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3556/7339] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Jul 25 15:28:59 2022] POST /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:29:10.151292 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-235ca598-1703-422a-b6a8-57bf031bd3df tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:10.151934 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-235ca598-1703-422a-b6a8-57bf031bd3df tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:10.154806 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:29:10.155560 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=36 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:29:10.162459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-235ca598-1703-422a-b6a8-57bf031bd3df tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:10.162921 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-235ca598-1703-422a-b6a8-57bf031bd3df tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:10.163750 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-235ca598-1703-422a-b6a8-57bf031bd3df tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:10.164229 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-235ca598-1703-422a-b6a8-57bf031bd3df tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:10.312970 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-235ca598-1703-422a-b6a8-57bf031bd3df tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lazy-loading 'services' on Instance uuid 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:29:10.391241 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-235ca598-1703-422a-b6a8-57bf031bd3df tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "DELETE /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9/os-volume_attachments/026ae917-f0df-4f30-94a6-c89e4619d00b" status: 202 len: 0 microversion: 2.1 time: 0.243980 Jul 25 15:29:10.391844 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3784/7340] 10.222.0.88 () {58 vars in 1416 bytes} [Mon Jul 25 15:29:10 2022] DELETE /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9/os-volume_attachments/026ae917-f0df-4f30-94a6-c89e4619d00b => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 15:29:10.403260 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-057ce38b-3bd2-4743-9400-06624dd3733f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:10.406580 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-057ce38b-3bd2-4743-9400-06624dd3733f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:10.411477 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:29:10.412540 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:29:10.421966 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-057ce38b-3bd2-4743-9400-06624dd3733f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:10.422364 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-057ce38b-3bd2-4743-9400-06624dd3733f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:10.423311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-057ce38b-3bd2-4743-9400-06624dd3733f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:10.423585 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-057ce38b-3bd2-4743-9400-06624dd3733f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:10.470847 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-057ce38b-3bd2-4743-9400-06624dd3733f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073900 Jul 25 15:29:10.471636 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3557/7341] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 15:29:10 2022] GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:29:11.484561 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b3acd9cd-da57-4d2a-bf0e-3ac8844aca6f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:11.487068 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b3acd9cd-da57-4d2a-bf0e-3ac8844aca6f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:11.494193 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b3acd9cd-da57-4d2a-bf0e-3ac8844aca6f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:11.494652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b3acd9cd-da57-4d2a-bf0e-3ac8844aca6f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:11.495418 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b3acd9cd-da57-4d2a-bf0e-3ac8844aca6f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:11.495873 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b3acd9cd-da57-4d2a-bf0e-3ac8844aca6f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:11.530823 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b3acd9cd-da57-4d2a-bf0e-3ac8844aca6f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051546 Jul 25 15:29:11.531439 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3785/7342] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 15:29:11 2022] GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:29:12.543826 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5c03d10c-27d1-43ab-9ccb-f24cc9274bfe tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:12.546945 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5c03d10c-27d1-43ab-9ccb-f24cc9274bfe tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:12.555210 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5c03d10c-27d1-43ab-9ccb-f24cc9274bfe tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:12.555684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5c03d10c-27d1-43ab-9ccb-f24cc9274bfe tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:12.556498 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5c03d10c-27d1-43ab-9ccb-f24cc9274bfe tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:12.556945 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5c03d10c-27d1-43ab-9ccb-f24cc9274bfe tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:12.590257 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5c03d10c-27d1-43ab-9ccb-f24cc9274bfe tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050638 Jul 25 15:29:12.591128 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3558/7343] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 15:29:12 2022] GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:29:13.603401 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3e8176eb-88e2-44d0-a254-d9653523849d tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:13.606154 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3e8176eb-88e2-44d0-a254-d9653523849d tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:13.613981 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e8176eb-88e2-44d0-a254-d9653523849d tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:13.614459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e8176eb-88e2-44d0-a254-d9653523849d tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:13.615278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e8176eb-88e2-44d0-a254-d9653523849d tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:13.615719 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e8176eb-88e2-44d0-a254-d9653523849d tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:13.650771 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3e8176eb-88e2-44d0-a254-d9653523849d tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051449 Jul 25 15:29:13.651438 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3786/7344] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 15:29:13 2022] GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:29:14.663667 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5f55fc40-b5e8-4838-8380-6a7de9cf6ed5 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:14.665894 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5f55fc40-b5e8-4838-8380-6a7de9cf6ed5 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:14.673941 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f55fc40-b5e8-4838-8380-6a7de9cf6ed5 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:14.674244 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f55fc40-b5e8-4838-8380-6a7de9cf6ed5 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:14.675187 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f55fc40-b5e8-4838-8380-6a7de9cf6ed5 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:14.675599 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f55fc40-b5e8-4838-8380-6a7de9cf6ed5 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:14.713277 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5f55fc40-b5e8-4838-8380-6a7de9cf6ed5 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053690 Jul 25 15:29:14.713878 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3559/7345] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 15:29:14 2022] GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:29:15.726555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9182a968-b762-49fc-a588-4502bc440ccc tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:15.728692 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9182a968-b762-49fc-a588-4502bc440ccc tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:15.736539 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9182a968-b762-49fc-a588-4502bc440ccc tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:15.736992 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9182a968-b762-49fc-a588-4502bc440ccc tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:15.737772 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9182a968-b762-49fc-a588-4502bc440ccc tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:15.738213 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9182a968-b762-49fc-a588-4502bc440ccc tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:15.772114 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9182a968-b762-49fc-a588-4502bc440ccc tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049711 Jul 25 15:29:15.772725 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3787/7346] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 15:29:15 2022] GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 15:29:15.787161 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a2e9cdae-2336-4b5b-bb15-1555d7a4581f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:15.787734 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a2e9cdae-2336-4b5b-bb15-1555d7a4581f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:15.797182 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a2e9cdae-2336-4b5b-bb15-1555d7a4581f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:15.797650 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a2e9cdae-2336-4b5b-bb15-1555d7a4581f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:15.798438 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a2e9cdae-2336-4b5b-bb15-1555d7a4581f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:15.798884 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a2e9cdae-2336-4b5b-bb15-1555d7a4581f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:15.936635 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-a2e9cdae-2336-4b5b-bb15-1555d7a4581f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] HTTP exception thrown: Instance 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 is not attached to volume 026ae917-f0df-4f30-94a6-c89e4619d00b Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a2e9cdae-2336-4b5b-bb15-1555d7a4581f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Request method failure captured: Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9/os-volume_attachments/026ae917-f0df-4f30-94a6-c89e4619d00b HTTP/1.1 Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3ram3OMrjFnDeYcjFPH7HwCi19-n1a_DngW61-zaCOR9PzfFk_XSjgZQWQ-pmyWbhARANlcMVJxfm9AXhrpwY0TEE5CdcvuV4UZSdsGZrg4-AWxCpXpJdiqmpct2w61r4hYUUNZG7dE48hiQRacuYOMgPpgHhQ5qrIvddhq9BMiYdME Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: bf818da68ca643a1a1e5b7a05f33a0dc Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1133684484 Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/bf818da68ca643a1a1e5b7a05f33a0dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/bf818da68ca643a1a1e5b7a05f33a0dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_bf818da68ca643a1a1e5b7a05f33a0dc", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/bf818da68ca643a1a1e5b7a05f33a0dc"}]}] Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-TestEncryptedCinderVolumes-1133684484 Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: bf818da68ca643a1a1e5b7a05f33a0dc Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1133684484 Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-TestEncryptedCinderVolumes-1133684484-project Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 8e96d386c6964cb1bd8626aca1bfdd8b Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-TestEncryptedCinderVolumes-1133684484-project Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 is not attached to volume 026ae917-f0df-4f30-94a6-c89e4619d00b Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'server_id': '3e259d7f-02d7-49c5-8f10-d181ed3b5dc9', 'id': '026ae917-f0df-4f30-94a6-c89e4619d00b'} Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 026ae917-f0df-4f30-94a6-c89e4619d00b. Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 is not attached to volume 026ae917-f0df-4f30-94a6-c89e4619d00b Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:29:15.945178 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:29:15.949818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:29:15.949818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:29:15.949818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 is not attached to volume 026ae917-f0df-4f30-94a6-c89e4619d00b Jul 25 15:29:15.949818 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:29:15.949818 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a2e9cdae-2336-4b5b-bb15-1555d7a4581f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Returning 404 to user: Instance 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 is not attached to volume 026ae917-f0df-4f30-94a6-c89e4619d00b {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:29:15.949818 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a2e9cdae-2336-4b5b-bb15-1555d7a4581f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "DELETE /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9/os-volume_attachments/026ae917-f0df-4f30-94a6-c89e4619d00b" status: 404 len: 154 microversion: 2.1 time: 0.166363 Jul 25 15:29:15.949818 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3560/7347] 10.222.0.88 () {58 vars in 1416 bytes} [Mon Jul 25 15:29:15 2022] DELETE /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9/os-volume_attachments/026ae917-f0df-4f30-94a6-c89e4619d00b => generated 154 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 15:29:19.329423 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2831c856-a5f0-4a83-ae2b-1a87e304aef6 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:19.329963 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2831c856-a5f0-4a83-ae2b-1a87e304aef6 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:19.337162 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2831c856-a5f0-4a83-ae2b-1a87e304aef6 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:19.337621 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2831c856-a5f0-4a83-ae2b-1a87e304aef6 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:19.338394 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2831c856-a5f0-4a83-ae2b-1a87e304aef6 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:19.338828 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2831c856-a5f0-4a83-ae2b-1a87e304aef6 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:19.364613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2831c856-a5f0-4a83-ae2b-1a87e304aef6 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:29:19.457161 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2831c856-a5f0-4a83-ae2b-1a87e304aef6 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "DELETE /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9" status: 204 len: 0 microversion: 2.1 time: 0.131313 Jul 25 15:29:19.457781 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3788/7348] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:29:19 2022] DELETE /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:29:19.467077 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5e4e089b-afc0-42f8-ad43-b4f8b9c623cf tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:19.467873 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5e4e089b-afc0-42f8-ad43-b4f8b9c623cf tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:19.475739 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5e4e089b-afc0-42f8-ad43-b4f8b9c623cf tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:19.476310 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5e4e089b-afc0-42f8-ad43-b4f8b9c623cf tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:19.477014 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5e4e089b-afc0-42f8-ad43-b4f8b9c623cf tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:19.477455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5e4e089b-afc0-42f8-ad43-b4f8b9c623cf tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:19.616568 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5e4e089b-afc0-42f8-ad43-b4f8b9c623cf tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e96d386c6964cb1bd8626aca1bfdd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf818da68ca643a1a1e5b7a05f33a0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:29:19.624697 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5e4e089b-afc0-42f8-ad43-b4f8b9c623cf tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9" status: 200 len: 1560 microversion: 2.1 time: 0.162063 Jul 25 15:29:19.625288 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3561/7349] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:29:19 2022] GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:29:20.647122 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c71c247f-f2fb-4b8e-a352-bdb8352f42c6 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:20.647988 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c71c247f-f2fb-4b8e-a352-bdb8352f42c6 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:20.655484 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c71c247f-f2fb-4b8e-a352-bdb8352f42c6 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:20.655950 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c71c247f-f2fb-4b8e-a352-bdb8352f42c6 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:20.656761 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c71c247f-f2fb-4b8e-a352-bdb8352f42c6 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:20.657207 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c71c247f-f2fb-4b8e-a352-bdb8352f42c6 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:20.810622 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c71c247f-f2fb-4b8e-a352-bdb8352f42c6 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e96d386c6964cb1bd8626aca1bfdd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf818da68ca643a1a1e5b7a05f33a0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:29:20.821441 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c71c247f-f2fb-4b8e-a352-bdb8352f42c6 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9" status: 200 len: 1560 microversion: 2.1 time: 0.178645 Jul 25 15:29:20.822221 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3789/7350] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:29:20 2022] GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:29:21.628163 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-8e9ab884-379f-4897-be05-673a0b683375 req-5a6e9a5f-4008-490d-9047-4302b7f047ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e259d7f-02d7-49c5-8f10-d181ed3b5dc9", "name": "network-vif-deleted", "tag": "5f287cb1-342b-4547-ba34-c19c2f57c312"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:29:21.642031 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-8e9ab884-379f-4897-be05-673a0b683375 req-5a6e9a5f-4008-490d-9047-4302b7f047ef service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:21.642487 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-8e9ab884-379f-4897-be05-673a0b683375 req-5a6e9a5f-4008-490d-9047-4302b7f047ef service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:21.656584 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-8e9ab884-379f-4897-be05-673a0b683375 req-5a6e9a5f-4008-490d-9047-4302b7f047ef service nova] Creating event network-vif-deleted:5f287cb1-342b-4547-ba34-c19c2f57c312 for instance 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 on n-h2-846435-14 Jul 25 15:29:21.662279 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-8e9ab884-379f-4897-be05-673a0b683375 req-5a6e9a5f-4008-490d-9047-4302b7f047ef service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038235 Jul 25 15:29:21.662926 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3562/7351] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:29:21.846078 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-75a23121-da4c-429f-82d2-fc5472becf0f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:21.846638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-75a23121-da4c-429f-82d2-fc5472becf0f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:21.856622 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75a23121-da4c-429f-82d2-fc5472becf0f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:21.857086 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75a23121-da4c-429f-82d2-fc5472becf0f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:21.857872 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75a23121-da4c-429f-82d2-fc5472becf0f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:21.858330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75a23121-da4c-429f-82d2-fc5472becf0f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:21.891299 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75a23121-da4c-429f-82d2-fc5472becf0f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:21.891762 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75a23121-da4c-429f-82d2-fc5472becf0f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:21.892265 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-75a23121-da4c-429f-82d2-fc5472becf0f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lazy-loading 'fault' on Instance uuid 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:29:21.933873 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-75a23121-da4c-429f-82d2-fc5472becf0f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e96d386c6964cb1bd8626aca1bfdd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf818da68ca643a1a1e5b7a05f33a0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:29:21.943172 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-75a23121-da4c-429f-82d2-fc5472becf0f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9" status: 200 len: 1352 microversion: 2.1 time: 0.103342 Jul 25 15:29:21.943762 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3790/7352] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:29:21 2022] GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 => generated 1352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:29:22.968479 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5f415023-4173-4483-9f7c-16f5e2bb153f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:22.969114 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5f415023-4173-4483-9f7c-16f5e2bb153f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:22.975968 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f415023-4173-4483-9f7c-16f5e2bb153f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:22.976460 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f415023-4173-4483-9f7c-16f5e2bb153f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:22.977263 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f415023-4173-4483-9f7c-16f5e2bb153f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:22.977713 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f415023-4173-4483-9f7c-16f5e2bb153f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:22.992504 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-5f415023-4173-4483-9f7c-16f5e2bb153f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] HTTP exception thrown: Instance 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 could not be found. Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5f415023-4173-4483-9f7c-16f5e2bb153f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Request method failure captured: Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 HTTP/1.1 Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3ram3OMrjFnDeYcjFPH7HwCi19-n1a_DngW61-zaCOR9PzfFk_XSjgZQWQ-pmyWbhARANlcMVJxfm9AXhrpwY0TEE5CdcvuV4UZSdsGZrg4-AWxCpXpJdiqmpct2w61r4hYUUNZG7dE48hiQRacuYOMgPpgHhQ5qrIvddhq9BMiYdME Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: bf818da68ca643a1a1e5b7a05f33a0dc Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1133684484 Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/bf818da68ca643a1a1e5b7a05f33a0dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/bf818da68ca643a1a1e5b7a05f33a0dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_bf818da68ca643a1a1e5b7a05f33a0dc", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/bf818da68ca643a1a1e5b7a05f33a0dc"}]}] Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-TestEncryptedCinderVolumes-1133684484 Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: bf818da68ca643a1a1e5b7a05f33a0dc Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1133684484 Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-TestEncryptedCinderVolumes-1133684484-project Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 8e96d386c6964cb1bd8626aca1bfdd8b Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-TestEncryptedCinderVolumes-1133684484-project Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 could not be found. Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '3e259d7f-02d7-49c5-8f10-d181ed3b5dc9'} Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 could not be found. Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 could not be found. Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:29:22.994194 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:29:22.998677 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:29:22.998677 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:29:22.998677 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:29:22.998677 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:29:22.998677 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:29:22.998677 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 could not be found. Jul 25 15:29:22.998677 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:29:22.998677 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5f415023-4173-4483-9f7c-16f5e2bb153f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Returning 404 to user: Instance 3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:29:22.998677 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5f415023-4173-4483-9f7c-16f5e2bb153f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9" status: 404 len: 111 microversion: 2.1 time: 0.033796 Jul 25 15:29:22.999493 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3563/7353] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:29:22 2022] GET /compute/v2.1/servers/3e259d7f-02d7-49c5-8f10-d181ed3b5dc9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:29:23.004830 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-45afef10-1b3e-44df-9693-13de1b07637a tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '.version_select at 0x7f46860f1280>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:23.028533 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-45afef10-1b3e-44df-9693-13de1b07637a tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1807010490" status: 202 len: 0 microversion: 2.1 time: 0.027306 Jul 25 15:29:23.029278 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3791/7354] 10.222.0.88 () {58 vars in 1278 bytes} [Mon Jul 25 15:29:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1807010490 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 15:29:23.052378 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-05a9fd16-0342-4fee-bb08-dffc0511bd53 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Action: 'create', calling method: .version_select at 0x7f4686c06b80>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1841251071", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBmKrGDWlD+hOavg/RLSVOaPmBFa9gTxhsdKs1ftjcOou4gNuKi6No2I4ZqHtwqpJsAtGjem57nvgEKBg1b6Z3CzmBhPPyXHA+ArbdgJ8aC268sqbblUiEO/gMpa0HoTg=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:29:23.069007 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-05a9fd16-0342-4fee-bb08-dffc0511bd53 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Getting quotas for project bf818da68ca643a1a1e5b7a05f33a0dc. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:29:23.075535 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-05a9fd16-0342-4fee-bb08-dffc0511bd53 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Getting quotas for user 8e96d386c6964cb1bd8626aca1bfdd8b and project bf818da68ca643a1a1e5b7a05f33a0dc. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:29:23.104378 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-05a9fd16-0342-4fee-bb08-dffc0511bd53 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.055324 Jul 25 15:29:23.105057 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3564/7355] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 15:29:23 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:29:23.158503 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1be56c06-5fda-46a7-bf94-5fe7bb0dc306 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1026952180", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1841251071", "networks": [{"uuid": "bcf502c2-507c-4568-bbc8-e3a1b97ef89b"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:29:23.222623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-1be56c06-5fda-46a7-bf94-5fe7bb0dc306 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] validate_networks() for [('bcf502c2-507c-4568-bbc8-e3a1b97ef89b', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:29:23.616803 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-1be56c06-5fda-46a7-bf94-5fe7bb0dc306 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:29:23.617458 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-1be56c06-5fda-46a7-bf94-5fe7bb0dc306 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:29:23.618193 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-1be56c06-5fda-46a7-bf94-5fe7bb0dc306 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:29:23.618810 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-1be56c06-5fda-46a7-bf94-5fe7bb0dc306 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:29:23.619486 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-1be56c06-5fda-46a7-bf94-5fe7bb0dc306 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:29:23.630344 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1be56c06-5fda-46a7-bf94-5fe7bb0dc306 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:23.630806 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1be56c06-5fda-46a7-bf94-5fe7bb0dc306 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:23.631641 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1be56c06-5fda-46a7-bf94-5fe7bb0dc306 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:23.632113 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1be56c06-5fda-46a7-bf94-5fe7bb0dc306 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:23.650435 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-1be56c06-5fda-46a7-bf94-5fe7bb0dc306 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Getting quotas for project bf818da68ca643a1a1e5b7a05f33a0dc. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:29:23.656496 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-1be56c06-5fda-46a7-bf94-5fe7bb0dc306 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Getting quotas for user 8e96d386c6964cb1bd8626aca1bfdd8b and project bf818da68ca643a1a1e5b7a05f33a0dc. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:29:23.670362 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1be56c06-5fda-46a7-bf94-5fe7bb0dc306 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:29:23.672947 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1be56c06-5fda-46a7-bf94-5fe7bb0dc306 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:29:23.722722 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1be56c06-5fda-46a7-bf94-5fe7bb0dc306 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.568178 Jul 25 15:29:23.726454 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3792/7356] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:29:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:29:23.735047 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0f0de316-8bee-4bf8-83fd-6d0d11b95544 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:23.735764 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0f0de316-8bee-4bf8-83fd-6d0d11b95544 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:23.792961 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0f0de316-8bee-4bf8-83fd-6d0d11b95544 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e96d386c6964cb1bd8626aca1bfdd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf818da68ca643a1a1e5b7a05f33a0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:29:23.803081 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0f0de316-8bee-4bf8-83fd-6d0d11b95544 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b" status: 200 len: 1263 microversion: 2.1 time: 0.071491 Jul 25 15:29:23.803679 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3565/7357] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:29:23 2022] GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b => generated 1263 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:29:24.835904 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3bf4f551-d662-4d1d-972f-49cd2dae9976 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:24.836598 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3bf4f551-d662-4d1d-972f-49cd2dae9976 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:24.843932 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3bf4f551-d662-4d1d-972f-49cd2dae9976 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:24.845008 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3bf4f551-d662-4d1d-972f-49cd2dae9976 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:24.846014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3bf4f551-d662-4d1d-972f-49cd2dae9976 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:24.846474 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3bf4f551-d662-4d1d-972f-49cd2dae9976 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:24.918694 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3bf4f551-d662-4d1d-972f-49cd2dae9976 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e96d386c6964cb1bd8626aca1bfdd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf818da68ca643a1a1e5b7a05f33a0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:29:24.926845 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3bf4f551-d662-4d1d-972f-49cd2dae9976 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b" status: 200 len: 1323 microversion: 2.1 time: 0.096213 Jul 25 15:29:24.927500 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3793/7358] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:29:24 2022] GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b => generated 1323 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:29:25.948901 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-530921c9-d5a2-4029-9163-e488adb41edc tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:25.949480 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-530921c9-d5a2-4029-9163-e488adb41edc tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:25.957225 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-530921c9-d5a2-4029-9163-e488adb41edc tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:25.957675 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-530921c9-d5a2-4029-9163-e488adb41edc tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:25.958485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-530921c9-d5a2-4029-9163-e488adb41edc tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:25.958932 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-530921c9-d5a2-4029-9163-e488adb41edc tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:26.157423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-530921c9-d5a2-4029-9163-e488adb41edc tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e96d386c6964cb1bd8626aca1bfdd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf818da68ca643a1a1e5b7a05f33a0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:29:26.166482 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-530921c9-d5a2-4029-9163-e488adb41edc tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b" status: 200 len: 1363 microversion: 2.1 time: 0.221641 Jul 25 15:29:26.167308 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3566/7359] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:29:25 2022] GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:29:26.458497 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-b9a98e16-b8e4-4a25-8ba6-f0f3c71bf0c3 req-8f05c668-4124-4d7b-a00c-6df7e8a7ecf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b", "tag": "1c023b45-1285-4afb-9cfd-65ec5d83a381"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:29:26.470173 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-b9a98e16-b8e4-4a25-8ba6-f0f3c71bf0c3 req-8f05c668-4124-4d7b-a00c-6df7e8a7ecf6 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:26.470857 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-b9a98e16-b8e4-4a25-8ba6-f0f3c71bf0c3 req-8f05c668-4124-4d7b-a00c-6df7e8a7ecf6 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:26.795408 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-b9a98e16-b8e4-4a25-8ba6-f0f3c71bf0c3 req-8f05c668-4124-4d7b-a00c-6df7e8a7ecf6 service nova] Creating event network-changed:1c023b45-1285-4afb-9cfd-65ec5d83a381 for instance ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b on n-h1-846435-14 Jul 25 15:29:26.801078 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-b9a98e16-b8e4-4a25-8ba6-f0f3c71bf0c3 req-8f05c668-4124-4d7b-a00c-6df7e8a7ecf6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.346847 Jul 25 15:29:26.801706 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3794/7360] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:29:27.188756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-da6b7e61-432b-4076-a5f9-5ecc697aa541 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:27.189330 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-da6b7e61-432b-4076-a5f9-5ecc697aa541 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:27.198035 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da6b7e61-432b-4076-a5f9-5ecc697aa541 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:27.198577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da6b7e61-432b-4076-a5f9-5ecc697aa541 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:27.199395 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da6b7e61-432b-4076-a5f9-5ecc697aa541 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:27.200126 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-da6b7e61-432b-4076-a5f9-5ecc697aa541 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:27.399759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-da6b7e61-432b-4076-a5f9-5ecc697aa541 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e96d386c6964cb1bd8626aca1bfdd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf818da68ca643a1a1e5b7a05f33a0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:29:27.408590 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-da6b7e61-432b-4076-a5f9-5ecc697aa541 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b" status: 200 len: 1363 microversion: 2.1 time: 0.223905 Jul 25 15:29:27.409250 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3567/7361] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:29:27 2022] GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:29:28.436612 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ffa3ea08-be9a-4d04-b0b5-858a07239f8f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:28.437737 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ffa3ea08-be9a-4d04-b0b5-858a07239f8f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:28.447485 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ffa3ea08-be9a-4d04-b0b5-858a07239f8f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:28.448166 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ffa3ea08-be9a-4d04-b0b5-858a07239f8f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:28.448993 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ffa3ea08-be9a-4d04-b0b5-858a07239f8f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:28.449493 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ffa3ea08-be9a-4d04-b0b5-858a07239f8f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:28.587614 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ffa3ea08-be9a-4d04-b0b5-858a07239f8f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e96d386c6964cb1bd8626aca1bfdd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf818da68ca643a1a1e5b7a05f33a0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:29:28.598173 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ffa3ea08-be9a-4d04-b0b5-858a07239f8f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b" status: 200 len: 1363 microversion: 2.1 time: 0.169633 Jul 25 15:29:28.598746 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3795/7362] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:29:28 2022] GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:29:29.619385 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-78cf7a01-e044-4469-8d42-06a9618a4a32 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:29.619962 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-78cf7a01-e044-4469-8d42-06a9618a4a32 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:29.627776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-78cf7a01-e044-4469-8d42-06a9618a4a32 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:29.628259 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-78cf7a01-e044-4469-8d42-06a9618a4a32 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:29.629032 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-78cf7a01-e044-4469-8d42-06a9618a4a32 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:29.629470 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-78cf7a01-e044-4469-8d42-06a9618a4a32 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:29.783339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-78cf7a01-e044-4469-8d42-06a9618a4a32 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e96d386c6964cb1bd8626aca1bfdd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf818da68ca643a1a1e5b7a05f33a0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:29:29.795649 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-78cf7a01-e044-4469-8d42-06a9618a4a32 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b" status: 200 len: 1363 microversion: 2.1 time: 0.180208 Jul 25 15:29:29.796608 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3568/7363] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:29:29 2022] GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:29:30.817644 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-028d5dc5-7e4e-41a7-9eb4-3fda33ad8438 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:30.818231 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-028d5dc5-7e4e-41a7-9eb4-3fda33ad8438 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:30.826091 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-028d5dc5-7e4e-41a7-9eb4-3fda33ad8438 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:30.826577 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-028d5dc5-7e4e-41a7-9eb4-3fda33ad8438 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:30.827372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-028d5dc5-7e4e-41a7-9eb4-3fda33ad8438 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:30.827877 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-028d5dc5-7e4e-41a7-9eb4-3fda33ad8438 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:30.975474 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-028d5dc5-7e4e-41a7-9eb4-3fda33ad8438 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e96d386c6964cb1bd8626aca1bfdd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf818da68ca643a1a1e5b7a05f33a0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:29:30.986656 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-028d5dc5-7e4e-41a7-9eb4-3fda33ad8438 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b" status: 200 len: 1363 microversion: 2.1 time: 0.172913 Jul 25 15:29:30.987417 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3796/7364] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:29:30 2022] GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:29:32.008903 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ab05feac-a53d-4e4b-aacc-612504d80eac tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:32.009496 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ab05feac-a53d-4e4b-aacc-612504d80eac tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:32.018286 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab05feac-a53d-4e4b-aacc-612504d80eac tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:32.019247 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab05feac-a53d-4e4b-aacc-612504d80eac tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:32.019910 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab05feac-a53d-4e4b-aacc-612504d80eac tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:32.019910 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab05feac-a53d-4e4b-aacc-612504d80eac tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:32.172875 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ab05feac-a53d-4e4b-aacc-612504d80eac tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e96d386c6964cb1bd8626aca1bfdd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf818da68ca643a1a1e5b7a05f33a0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:29:32.181008 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ab05feac-a53d-4e4b-aacc-612504d80eac tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b" status: 200 len: 1363 microversion: 2.1 time: 0.176294 Jul 25 15:29:32.181768 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3569/7365] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:29:32 2022] GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:29:33.189845 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-2b59e22a-9271-49f6-afe7-8adb89d50b8f req-5f612f9f-0e3a-426d-92fc-6b22c8bf4e33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b", "name": "network-vif-plugged", "status": "completed", "tag": "1c023b45-1285-4afb-9cfd-65ec5d83a381"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:29:33.202417 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6f8ce60d-4916-4d7d-a25f-d1eb138880c4 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:33.203271 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6f8ce60d-4916-4d7d-a25f-d1eb138880c4 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:33.216337 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-2b59e22a-9271-49f6-afe7-8adb89d50b8f req-5f612f9f-0e3a-426d-92fc-6b22c8bf4e33 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:33.216847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-2b59e22a-9271-49f6-afe7-8adb89d50b8f req-5f612f9f-0e3a-426d-92fc-6b22c8bf4e33 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:33.219237 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6f8ce60d-4916-4d7d-a25f-d1eb138880c4 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:33.219958 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6f8ce60d-4916-4d7d-a25f-d1eb138880c4 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:33.225407 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6f8ce60d-4916-4d7d-a25f-d1eb138880c4 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:33.225883 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6f8ce60d-4916-4d7d-a25f-d1eb138880c4 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:33.242572 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-2b59e22a-9271-49f6-afe7-8adb89d50b8f req-5f612f9f-0e3a-426d-92fc-6b22c8bf4e33 service nova] Creating event network-vif-plugged:1c023b45-1285-4afb-9cfd-65ec5d83a381 for instance ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b on n-h1-846435-14 Jul 25 15:29:33.249647 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-2b59e22a-9271-49f6-afe7-8adb89d50b8f req-5f612f9f-0e3a-426d-92fc-6b22c8bf4e33 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063933 Jul 25 15:29:33.251540 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3797/7366] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:29:33.455691 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6f8ce60d-4916-4d7d-a25f-d1eb138880c4 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e96d386c6964cb1bd8626aca1bfdd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf818da68ca643a1a1e5b7a05f33a0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:29:33.463531 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6f8ce60d-4916-4d7d-a25f-d1eb138880c4 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b" status: 200 len: 1363 microversion: 2.1 time: 0.265417 Jul 25 15:29:33.464129 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3570/7367] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:29:33 2022] GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b => generated 1363 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:29:34.482192 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:29:34.483068 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:29:34.488694 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9d0b8a9e-4bed-44cf-9955-815c144ed510 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:34.489463 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9d0b8a9e-4bed-44cf-9955-815c144ed510 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:34.497126 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d0b8a9e-4bed-44cf-9955-815c144ed510 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:34.497598 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d0b8a9e-4bed-44cf-9955-815c144ed510 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:34.498384 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d0b8a9e-4bed-44cf-9955-815c144ed510 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:34.498832 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9d0b8a9e-4bed-44cf-9955-815c144ed510 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:34.638572 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9d0b8a9e-4bed-44cf-9955-815c144ed510 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e96d386c6964cb1bd8626aca1bfdd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf818da68ca643a1a1e5b7a05f33a0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:29:34.650307 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9d0b8a9e-4bed-44cf-9955-815c144ed510 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b" status: 200 len: 1556 microversion: 2.1 time: 0.168739 Jul 25 15:29:34.651111 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3798/7368] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:29:34 2022] GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:29:34.673047 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-15b03c62-492f-41cd-a7aa-372a5f092833 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:34.673612 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-15b03c62-492f-41cd-a7aa-372a5f092833 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:34.675712 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:29:34.682209 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-15b03c62-492f-41cd-a7aa-372a5f092833 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:34.682576 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-15b03c62-492f-41cd-a7aa-372a5f092833 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:34.683340 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-15b03c62-492f-41cd-a7aa-372a5f092833 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:34.683769 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-15b03c62-492f-41cd-a7aa-372a5f092833 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:34.824699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-15b03c62-492f-41cd-a7aa-372a5f092833 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e96d386c6964cb1bd8626aca1bfdd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf818da68ca643a1a1e5b7a05f33a0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:29:34.832792 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-15b03c62-492f-41cd-a7aa-372a5f092833 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b" status: 200 len: 1556 microversion: 2.1 time: 0.164000 Jul 25 15:29:34.833366 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3571/7369] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:29:34 2022] GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b => generated 1556 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:29:36.375547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-39e0fb53-dffa-478f-8b90-9096f10a1fcb tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e37cfc0e-1b78-4747-a6e9-eaf2bffb2cd0"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:29:36.378033 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-39e0fb53-dffa-478f-8b90-9096f10a1fcb tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:36.385213 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-39e0fb53-dffa-478f-8b90-9096f10a1fcb tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:36.385676 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-39e0fb53-dffa-478f-8b90-9096f10a1fcb tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:36.386456 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-39e0fb53-dffa-478f-8b90-9096f10a1fcb tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:36.386902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-39e0fb53-dffa-478f-8b90-9096f10a1fcb tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:36.626642 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:29:36.644411 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-39e0fb53-dffa-478f-8b90-9096f10a1fcb tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "POST /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272766 Jul 25 15:29:36.645043 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3799/7370] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Jul 25 15:29:36 2022] POST /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:29:47.419947 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1cc447df-92e1-4c97-bdd9-e257a1c3bbc7 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:47.420560 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1cc447df-92e1-4c97-bdd9-e257a1c3bbc7 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:47.423520 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:29:47.424347 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=70 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:29:47.434446 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1cc447df-92e1-4c97-bdd9-e257a1c3bbc7 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:47.434446 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1cc447df-92e1-4c97-bdd9-e257a1c3bbc7 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:47.434446 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1cc447df-92e1-4c97-bdd9-e257a1c3bbc7 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:47.434446 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1cc447df-92e1-4c97-bdd9-e257a1c3bbc7 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:47.534884 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-1cc447df-92e1-4c97-bdd9-e257a1c3bbc7 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lazy-loading 'services' on Instance uuid ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:29:47.610223 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1cc447df-92e1-4c97-bdd9-e257a1c3bbc7 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "DELETE /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b/os-volume_attachments/e37cfc0e-1b78-4747-a6e9-eaf2bffb2cd0" status: 202 len: 0 microversion: 2.1 time: 0.194220 Jul 25 15:29:47.610875 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3572/7371] 10.222.0.88 () {58 vars in 1416 bytes} [Mon Jul 25 15:29:47 2022] DELETE /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b/os-volume_attachments/e37cfc0e-1b78-4747-a6e9-eaf2bffb2cd0 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:29:47.618659 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:29:47.619473 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:29:47.625518 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f7bc489e-c087-49f4-9656-28c934bb293d tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:47.628098 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f7bc489e-c087-49f4-9656-28c934bb293d tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:47.637068 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f7bc489e-c087-49f4-9656-28c934bb293d tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:47.637622 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f7bc489e-c087-49f4-9656-28c934bb293d tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:47.638429 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f7bc489e-c087-49f4-9656-28c934bb293d tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:47.638961 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f7bc489e-c087-49f4-9656-28c934bb293d tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:47.676546 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f7bc489e-c087-49f4-9656-28c934bb293d tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059981 Jul 25 15:29:47.677161 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3800/7372] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 15:29:47 2022] GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:29:48.691044 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-292d5fab-3efb-433c-8f2a-89c79456ed0f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:48.693435 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-292d5fab-3efb-433c-8f2a-89c79456ed0f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:48.700575 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-292d5fab-3efb-433c-8f2a-89c79456ed0f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:48.701376 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-292d5fab-3efb-433c-8f2a-89c79456ed0f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:48.702711 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-292d5fab-3efb-433c-8f2a-89c79456ed0f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:48.702711 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-292d5fab-3efb-433c-8f2a-89c79456ed0f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:48.738712 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-292d5fab-3efb-433c-8f2a-89c79456ed0f tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053037 Jul 25 15:29:48.739307 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3573/7373] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 15:29:48 2022] GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:29:49.754568 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-68b173dd-3b7b-4c07-ad27-4215197c70e9 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:49.756819 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-68b173dd-3b7b-4c07-ad27-4215197c70e9 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:49.764480 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68b173dd-3b7b-4c07-ad27-4215197c70e9 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:49.764948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68b173dd-3b7b-4c07-ad27-4215197c70e9 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:49.765779 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68b173dd-3b7b-4c07-ad27-4215197c70e9 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:49.766233 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-68b173dd-3b7b-4c07-ad27-4215197c70e9 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:49.800952 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-68b173dd-3b7b-4c07-ad27-4215197c70e9 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052540 Jul 25 15:29:49.801535 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3801/7374] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 15:29:49 2022] GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:29:50.813845 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-54447604-8fae-4b80-880a-34909e50b29e tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:50.816112 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-54447604-8fae-4b80-880a-34909e50b29e tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:50.824794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-54447604-8fae-4b80-880a-34909e50b29e tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:50.825241 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-54447604-8fae-4b80-880a-34909e50b29e tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:50.826015 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-54447604-8fae-4b80-880a-34909e50b29e tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:50.826480 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-54447604-8fae-4b80-880a-34909e50b29e tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:50.861357 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-54447604-8fae-4b80-880a-34909e50b29e tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051518 Jul 25 15:29:50.866468 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3574/7375] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 15:29:50 2022] GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:29:51.874639 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-34b3fa46-7f9a-4982-b7fe-2e293a32eb49 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:51.876906 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-34b3fa46-7f9a-4982-b7fe-2e293a32eb49 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:51.884972 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-34b3fa46-7f9a-4982-b7fe-2e293a32eb49 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:51.885422 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-34b3fa46-7f9a-4982-b7fe-2e293a32eb49 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:51.886228 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-34b3fa46-7f9a-4982-b7fe-2e293a32eb49 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:51.886656 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-34b3fa46-7f9a-4982-b7fe-2e293a32eb49 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:51.917844 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-34b3fa46-7f9a-4982-b7fe-2e293a32eb49 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047291 Jul 25 15:29:51.918421 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3802/7376] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 15:29:51 2022] GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:29:52.933058 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6d7bb5ad-d024-4273-899d-e039d9ee3cb2 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:52.936227 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6d7bb5ad-d024-4273-899d-e039d9ee3cb2 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:52.946673 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6d7bb5ad-d024-4273-899d-e039d9ee3cb2 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:52.947166 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6d7bb5ad-d024-4273-899d-e039d9ee3cb2 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:52.948033 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6d7bb5ad-d024-4273-899d-e039d9ee3cb2 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:52.948565 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6d7bb5ad-d024-4273-899d-e039d9ee3cb2 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:52.980825 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6d7bb5ad-d024-4273-899d-e039d9ee3cb2 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053563 Jul 25 15:29:52.981323 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3575/7377] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 15:29:52 2022] GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 15:29:52.992778 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c6d11f24-854d-48a9-aa86-f1f5bc0f0168 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:52.993383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c6d11f24-854d-48a9-aa86-f1f5bc0f0168 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:53.001069 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c6d11f24-854d-48a9-aa86-f1f5bc0f0168 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:53.001530 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c6d11f24-854d-48a9-aa86-f1f5bc0f0168 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:53.002323 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c6d11f24-854d-48a9-aa86-f1f5bc0f0168 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:53.002770 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c6d11f24-854d-48a9-aa86-f1f5bc0f0168 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:53.096989 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-c6d11f24-854d-48a9-aa86-f1f5bc0f0168 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] HTTP exception thrown: Instance ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b is not attached to volume e37cfc0e-1b78-4747-a6e9-eaf2bffb2cd0 Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c6d11f24-854d-48a9-aa86-f1f5bc0f0168 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Request method failure captured: Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: request: DELETE /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b/os-volume_attachments/e37cfc0e-1b78-4747-a6e9-eaf2bffb2cd0 HTTP/1.1 Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3ram3OMrjFnDeYcjFPH7HwCi19-n1a_DngW61-zaCOR9PzfFk_XSjgZQWQ-pmyWbhARANlcMVJxfm9AXhrpwY0TEE5CdcvuV4UZSdsGZrg4-AWxCpXpJdiqmpct2w61r4hYUUNZG7dE48hiQRacuYOMgPpgHhQ5qrIvddhq9BMiYdME Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: bf818da68ca643a1a1e5b7a05f33a0dc Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1133684484 Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/bf818da68ca643a1a1e5b7a05f33a0dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/bf818da68ca643a1a1e5b7a05f33a0dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_bf818da68ca643a1a1e5b7a05f33a0dc", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/bf818da68ca643a1a1e5b7a05f33a0dc"}]}] Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-TestEncryptedCinderVolumes-1133684484 Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: bf818da68ca643a1a1e5b7a05f33a0dc Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1133684484 Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-TestEncryptedCinderVolumes-1133684484-project Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 8e96d386c6964cb1bd8626aca1bfdd8b Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-TestEncryptedCinderVolumes-1133684484-project Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b is not attached to volume e37cfc0e-1b78-4747-a6e9-eaf2bffb2cd0 Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'server_id': 'ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b', 'id': 'e37cfc0e-1b78-4747-a6e9-eaf2bffb2cd0'} Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e37cfc0e-1b78-4747-a6e9-eaf2bffb2cd0. Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b is not attached to volume e37cfc0e-1b78-4747-a6e9-eaf2bffb2cd0 Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:29:53.100106 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:29:53.104051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:29:53.104051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:29:53.104051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b is not attached to volume e37cfc0e-1b78-4747-a6e9-eaf2bffb2cd0 Jul 25 15:29:53.104051 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:29:53.104051 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c6d11f24-854d-48a9-aa86-f1f5bc0f0168 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Returning 404 to user: Instance ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b is not attached to volume e37cfc0e-1b78-4747-a6e9-eaf2bffb2cd0 {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:29:53.104051 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c6d11f24-854d-48a9-aa86-f1f5bc0f0168 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "DELETE /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b/os-volume_attachments/e37cfc0e-1b78-4747-a6e9-eaf2bffb2cd0" status: 404 len: 154 microversion: 2.1 time: 0.113617 Jul 25 15:29:53.104051 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3803/7378] 10.222.0.88 () {58 vars in 1416 bytes} [Mon Jul 25 15:29:52 2022] DELETE /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b/os-volume_attachments/e37cfc0e-1b78-4747-a6e9-eaf2bffb2cd0 => generated 154 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:29:56.526768 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8f3124a0-6973-4df0-9aea-be5a4a07749b tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:56.527892 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8f3124a0-6973-4df0-9aea-be5a4a07749b tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:56.534950 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f3124a0-6973-4df0-9aea-be5a4a07749b tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:56.535411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f3124a0-6973-4df0-9aea-be5a4a07749b tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:56.536216 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f3124a0-6973-4df0-9aea-be5a4a07749b tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:56.536656 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f3124a0-6973-4df0-9aea-be5a4a07749b tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:56.563881 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8f3124a0-6973-4df0-9aea-be5a4a07749b tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:29:56.655864 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8f3124a0-6973-4df0-9aea-be5a4a07749b tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "DELETE /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b" status: 204 len: 0 microversion: 2.1 time: 0.132576 Jul 25 15:29:56.656868 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3576/7379] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:29:56 2022] DELETE /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:29:56.665654 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c2968823-f1df-4b45-a239-0d3afabf368c tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:56.666372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c2968823-f1df-4b45-a239-0d3afabf368c tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:56.677266 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c2968823-f1df-4b45-a239-0d3afabf368c tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:56.678220 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c2968823-f1df-4b45-a239-0d3afabf368c tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:56.679647 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c2968823-f1df-4b45-a239-0d3afabf368c tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:56.680572 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c2968823-f1df-4b45-a239-0d3afabf368c tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:56.844610 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c2968823-f1df-4b45-a239-0d3afabf368c tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e96d386c6964cb1bd8626aca1bfdd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf818da68ca643a1a1e5b7a05f33a0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:29:56.853207 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c2968823-f1df-4b45-a239-0d3afabf368c tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b" status: 200 len: 1562 microversion: 2.1 time: 0.191822 Jul 25 15:29:56.853852 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3804/7380] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:29:56 2022] GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b => generated 1562 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:29:57.877016 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-142d7043-1191-414f-8f91-2188193da4e4 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:57.877803 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-142d7043-1191-414f-8f91-2188193da4e4 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:57.885651 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-142d7043-1191-414f-8f91-2188193da4e4 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:57.886085 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-142d7043-1191-414f-8f91-2188193da4e4 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:57.886897 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-142d7043-1191-414f-8f91-2188193da4e4 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:57.887338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-142d7043-1191-414f-8f91-2188193da4e4 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:58.031020 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-142d7043-1191-414f-8f91-2188193da4e4 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e96d386c6964cb1bd8626aca1bfdd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf818da68ca643a1a1e5b7a05f33a0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:29:58.040130 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-142d7043-1191-414f-8f91-2188193da4e4 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b" status: 200 len: 1562 microversion: 2.1 time: 0.168218 Jul 25 15:29:58.042645 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3577/7381] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:29:57 2022] GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b => generated 1562 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:29:58.867072 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-c93fe05e-d4a1-4167-8936-e9c2b317dc91 req-f31332f7-0977-467c-a0cc-084ea035e16e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b", "name": "network-vif-deleted", "tag": "1c023b45-1285-4afb-9cfd-65ec5d83a381"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:29:58.878933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c93fe05e-d4a1-4167-8936-e9c2b317dc91 req-f31332f7-0977-467c-a0cc-084ea035e16e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:58.879450 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-c93fe05e-d4a1-4167-8936-e9c2b317dc91 req-f31332f7-0977-467c-a0cc-084ea035e16e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:58.900566 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-c93fe05e-d4a1-4167-8936-e9c2b317dc91 req-f31332f7-0977-467c-a0cc-084ea035e16e service nova] Creating event network-vif-deleted:1c023b45-1285-4afb-9cfd-65ec5d83a381 for instance ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b on n-h1-846435-14 Jul 25 15:29:58.906011 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-c93fe05e-d4a1-4167-8936-e9c2b317dc91 req-f31332f7-0977-467c-a0cc-084ea035e16e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116467 Jul 25 15:29:58.906902 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3805/7382] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:29:59.062631 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c841b3f6-36d6-41bb-a7c7-3e44219b9e38 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:29:59.063218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c841b3f6-36d6-41bb-a7c7-3e44219b9e38 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:29:59.070860 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c841b3f6-36d6-41bb-a7c7-3e44219b9e38 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:59.071308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c841b3f6-36d6-41bb-a7c7-3e44219b9e38 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:59.072124 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c841b3f6-36d6-41bb-a7c7-3e44219b9e38 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:59.072526 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c841b3f6-36d6-41bb-a7c7-3e44219b9e38 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:59.109296 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c841b3f6-36d6-41bb-a7c7-3e44219b9e38 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:29:59.109749 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c841b3f6-36d6-41bb-a7c7-3e44219b9e38 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:29:59.110207 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-c841b3f6-36d6-41bb-a7c7-3e44219b9e38 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lazy-loading 'fault' on Instance uuid ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:29:59.159382 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c841b3f6-36d6-41bb-a7c7-3e44219b9e38 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e96d386c6964cb1bd8626aca1bfdd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf818da68ca643a1a1e5b7a05f33a0dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:29:59.168011 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c841b3f6-36d6-41bb-a7c7-3e44219b9e38 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b" status: 200 len: 1353 microversion: 2.1 time: 0.109328 Jul 25 15:29:59.168755 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3578/7383] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:29:59 2022] GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b => generated 1353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:30:00.192817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5d062a48-0459-45d5-b077-df0a09f143c8 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:30:00.193560 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5d062a48-0459-45d5-b077-df0a09f143c8 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] [instance: ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:30:00.201126 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d062a48-0459-45d5-b077-df0a09f143c8 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:00.201970 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d062a48-0459-45d5-b077-df0a09f143c8 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:00.204107 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d062a48-0459-45d5-b077-df0a09f143c8 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:00.204690 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d062a48-0459-45d5-b077-df0a09f143c8 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:00.225522 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-5d062a48-0459-45d5-b077-df0a09f143c8 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] HTTP exception thrown: Instance ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b could not be found. Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5d062a48-0459-45d5-b077-df0a09f143c8 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Request method failure captured: Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b HTTP/1.1 Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3ram3OMrjFnDeYcjFPH7HwCi19-n1a_DngW61-zaCOR9PzfFk_XSjgZQWQ-pmyWbhARANlcMVJxfm9AXhrpwY0TEE5CdcvuV4UZSdsGZrg4-AWxCpXpJdiqmpct2w61r4hYUUNZG7dE48hiQRacuYOMgPpgHhQ5qrIvddhq9BMiYdME Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: bf818da68ca643a1a1e5b7a05f33a0dc Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1133684484 Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/bf818da68ca643a1a1e5b7a05f33a0dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/bf818da68ca643a1a1e5b7a05f33a0dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_bf818da68ca643a1a1e5b7a05f33a0dc", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/bf818da68ca643a1a1e5b7a05f33a0dc"}]}] Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-TestEncryptedCinderVolumes-1133684484 Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: bf818da68ca643a1a1e5b7a05f33a0dc Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1133684484 Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-TestEncryptedCinderVolumes-1133684484-project Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 8e96d386c6964cb1bd8626aca1bfdd8b Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-TestEncryptedCinderVolumes-1133684484-project Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b could not be found. Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b'} Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b could not be found. Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b could not be found. Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:30:00.227325 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:30:00.232434 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:30:00.232434 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:30:00.232434 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:30:00.232434 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:30:00.232434 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:30:00.232434 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b could not be found. Jul 25 15:30:00.232434 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:30:00.232434 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5d062a48-0459-45d5-b077-df0a09f143c8 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Returning 404 to user: Instance ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:30:00.232434 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5d062a48-0459-45d5-b077-df0a09f143c8 tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b" status: 404 len: 111 microversion: 2.1 time: 0.041848 Jul 25 15:30:00.232434 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3806/7384] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:30:00 2022] GET /compute/v2.1/servers/ac8b4a07-9c2b-454e-8d95-3a1d4849ca5b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:30:00.241705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dbcbc365-bc59-451d-b2c5-311671f0988b tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] Calling method '.version_select at 0x7f468642e4c0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:30:00.269124 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dbcbc365-bc59-451d-b2c5-311671f0988b tempest-TestEncryptedCinderVolumes-1133684484 tempest-TestEncryptedCinderVolumes-1133684484-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1841251071" status: 202 len: 0 microversion: 2.1 time: 0.032961 Jul 25 15:30:00.270025 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3579/7385] 10.222.0.88 () {58 vars in 1278 bytes} [Mon Jul 25 15:30:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1841251071 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:30:28.459240 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6c7cc8ca-a74a-4b61-9b49-da7a77884d28 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Action: 'create', calling method: .version_select at 0x7f468466b040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-463907621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjozM1fZtMYeMqtbbY0HyN2ekSkl7kOp1W2IGLQymZP2X47Qo33vvcRWd49zzZfuXUAYFc9LIobubY2S9/uOPa9MYdI6GLQ+yq+EOdLLUb9FqXOQfChOYkQJy8yLzhohA=="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:30:28.464845 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=14 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:30:28.465518 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=34 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:30:28.478753 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-6c7cc8ca-a74a-4b61-9b49-da7a77884d28 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Getting quotas for project a4075ffb266f4b3eb54f948d22370f57. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:30:28.485177 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-6c7cc8ca-a74a-4b61-9b49-da7a77884d28 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Getting quotas for user 6cf843e3e35e4cb8bff95aca236051fc and project a4075ffb266f4b3eb54f948d22370f57. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:30:28.518503 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6c7cc8ca-a74a-4b61-9b49-da7a77884d28 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.063588 Jul 25 15:30:28.519230 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3807/7386] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 15:30:28 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:30:28.570037 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:30:28.570793 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:30:28.575266 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dffd7410-d197-4a13-ba33-afde7923831a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-583466698", "imageRef": "dfc9952f-b64e-400d-96c2-bc3a9105b2a4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-463907621", "networks": [{"uuid": "bb747b31-49e0-4337-a4e5-f6a6817a123d"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:30:28.635221 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-dffd7410-d197-4a13-ba33-afde7923831a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] validate_networks() for [('bb747b31-49e0-4337-a4e5-f6a6817a123d', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:30:29.142962 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-dffd7410-d197-4a13-ba33-afde7923831a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:30:29.143395 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-dffd7410-d197-4a13-ba33-afde7923831a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:30:29.143874 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-dffd7410-d197-4a13-ba33-afde7923831a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:30:29.144331 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-dffd7410-d197-4a13-ba33-afde7923831a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:30:29.144754 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-dffd7410-d197-4a13-ba33-afde7923831a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:30:29.154526 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dffd7410-d197-4a13-ba33-afde7923831a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:29.154973 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dffd7410-d197-4a13-ba33-afde7923831a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:29.155784 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dffd7410-d197-4a13-ba33-afde7923831a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:29.156254 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dffd7410-d197-4a13-ba33-afde7923831a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:29.173896 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-dffd7410-d197-4a13-ba33-afde7923831a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Getting quotas for project a4075ffb266f4b3eb54f948d22370f57. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:30:29.179607 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-dffd7410-d197-4a13-ba33-afde7923831a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Getting quotas for user 6cf843e3e35e4cb8bff95aca236051fc and project a4075ffb266f4b3eb54f948d22370f57. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:30:29.192290 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-dffd7410-d197-4a13-ba33-afde7923831a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:30:29.194528 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-dffd7410-d197-4a13-ba33-afde7923831a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dfc9952f-b64e-400d-96c2-bc3a9105b2a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:30:29.242884 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dffd7410-d197-4a13-ba33-afde7923831a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674758 Jul 25 15:30:29.243732 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3580/7387] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:30:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:30:29.254614 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8b63052d-2070-408c-be01-c187bc6524d0 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:30:29.255237 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8b63052d-2070-408c-be01-c187bc6524d0 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:30:29.316453 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8b63052d-2070-408c-be01-c187bc6524d0 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:30:29.323863 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8b63052d-2070-408c-be01-c187bc6524d0 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c" status: 200 len: 1257 microversion: 2.1 time: 0.073328 Jul 25 15:30:29.324465 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3808/7388] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:30:29 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c => generated 1257 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:30:30.346735 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-637285af-6c9a-4e55-80bc-637319a61020 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:30:30.347478 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-637285af-6c9a-4e55-80bc-637319a61020 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:30:30.355287 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-637285af-6c9a-4e55-80bc-637319a61020 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:30.355743 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-637285af-6c9a-4e55-80bc-637319a61020 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:30.356555 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-637285af-6c9a-4e55-80bc-637319a61020 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:30.357219 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-637285af-6c9a-4e55-80bc-637319a61020 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:30.479138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-637285af-6c9a-4e55-80bc-637319a61020 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:30:30.489469 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-637285af-6c9a-4e55-80bc-637319a61020 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c" status: 200 len: 1309 microversion: 2.1 time: 0.147442 Jul 25 15:30:30.499072 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3581/7389] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:30:30 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c => generated 1309 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:30:31.514455 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c88d7232-ab2d-4247-9c12-4f8d2728c9ec tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:30:31.515494 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c88d7232-ab2d-4247-9c12-4f8d2728c9ec tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:30:31.527553 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c88d7232-ab2d-4247-9c12-4f8d2728c9ec tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:31.528152 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c88d7232-ab2d-4247-9c12-4f8d2728c9ec tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:31.529628 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c88d7232-ab2d-4247-9c12-4f8d2728c9ec tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:31.530328 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c88d7232-ab2d-4247-9c12-4f8d2728c9ec tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:31.688906 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c88d7232-ab2d-4247-9c12-4f8d2728c9ec tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:30:31.698613 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c88d7232-ab2d-4247-9c12-4f8d2728c9ec tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c" status: 200 len: 1357 microversion: 2.1 time: 0.191007 Jul 25 15:30:31.699425 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3809/7390] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:30:31 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c => generated 1357 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:30:32.722129 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5896bf5b-1589-477e-93f3-d7fd2b3de7d6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:30:32.723773 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5896bf5b-1589-477e-93f3-d7fd2b3de7d6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:30:32.732654 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5896bf5b-1589-477e-93f3-d7fd2b3de7d6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:32.733402 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5896bf5b-1589-477e-93f3-d7fd2b3de7d6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:32.734364 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5896bf5b-1589-477e-93f3-d7fd2b3de7d6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:32.735426 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5896bf5b-1589-477e-93f3-d7fd2b3de7d6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:32.906549 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5896bf5b-1589-477e-93f3-d7fd2b3de7d6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:30:32.923736 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5896bf5b-1589-477e-93f3-d7fd2b3de7d6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c" status: 200 len: 1357 microversion: 2.1 time: 0.207586 Jul 25 15:30:32.924580 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3582/7391] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:30:32 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c => generated 1357 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:30:33.946896 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8b369b15-51eb-41dc-991f-9caf163ab171 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:30:33.947608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8b369b15-51eb-41dc-991f-9caf163ab171 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:30:33.956667 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8b369b15-51eb-41dc-991f-9caf163ab171 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:33.957432 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8b369b15-51eb-41dc-991f-9caf163ab171 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:33.958703 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8b369b15-51eb-41dc-991f-9caf163ab171 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:33.959537 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8b369b15-51eb-41dc-991f-9caf163ab171 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:34.110208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8b369b15-51eb-41dc-991f-9caf163ab171 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:30:34.119501 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8b369b15-51eb-41dc-991f-9caf163ab171 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c" status: 200 len: 1357 microversion: 2.1 time: 0.177663 Jul 25 15:30:34.121016 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3810/7392] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:30:33 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:30:35.141647 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ab16b483-fcbb-42bd-ab64-6f345d96a373 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:30:35.142253 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ab16b483-fcbb-42bd-ab64-6f345d96a373 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:30:35.150358 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab16b483-fcbb-42bd-ab64-6f345d96a373 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:35.150831 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab16b483-fcbb-42bd-ab64-6f345d96a373 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:35.151652 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab16b483-fcbb-42bd-ab64-6f345d96a373 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:35.152143 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ab16b483-fcbb-42bd-ab64-6f345d96a373 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:35.318348 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ab16b483-fcbb-42bd-ab64-6f345d96a373 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:30:35.326396 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ab16b483-fcbb-42bd-ab64-6f345d96a373 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c" status: 200 len: 1357 microversion: 2.1 time: 0.189037 Jul 25 15:30:35.326976 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3583/7393] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:30:35 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:30:36.348325 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8fd9c221-77c4-49ba-9913-2b4d75138794 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:30:36.348954 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8fd9c221-77c4-49ba-9913-2b4d75138794 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:30:36.357133 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8fd9c221-77c4-49ba-9913-2b4d75138794 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:36.357603 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8fd9c221-77c4-49ba-9913-2b4d75138794 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:36.358405 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8fd9c221-77c4-49ba-9913-2b4d75138794 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:36.358860 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8fd9c221-77c4-49ba-9913-2b4d75138794 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:36.508902 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8fd9c221-77c4-49ba-9913-2b4d75138794 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:30:36.517180 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8fd9c221-77c4-49ba-9913-2b4d75138794 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c" status: 200 len: 1357 microversion: 2.1 time: 0.173166 Jul 25 15:30:36.518023 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3811/7394] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:30:36 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:30:37.539306 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0b05eeb9-4a51-4aa6-a05e-35d0c893ac26 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:30:37.540085 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0b05eeb9-4a51-4aa6-a05e-35d0c893ac26 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:30:37.547578 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b05eeb9-4a51-4aa6-a05e-35d0c893ac26 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:37.548167 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b05eeb9-4a51-4aa6-a05e-35d0c893ac26 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:37.549011 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b05eeb9-4a51-4aa6-a05e-35d0c893ac26 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:37.549519 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b05eeb9-4a51-4aa6-a05e-35d0c893ac26 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:37.696428 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0b05eeb9-4a51-4aa6-a05e-35d0c893ac26 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:30:37.709499 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0b05eeb9-4a51-4aa6-a05e-35d0c893ac26 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c" status: 200 len: 1357 microversion: 2.1 time: 0.174350 Jul 25 15:30:37.723836 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3584/7395] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:30:37 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:30:38.731369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7d4eeac5-861f-4ec0-ab41-922c55a4ae72 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:30:38.731951 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7d4eeac5-861f-4ec0-ab41-922c55a4ae72 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:30:38.740358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d4eeac5-861f-4ec0-ab41-922c55a4ae72 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:38.740819 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d4eeac5-861f-4ec0-ab41-922c55a4ae72 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:38.741586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d4eeac5-861f-4ec0-ab41-922c55a4ae72 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:38.742040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d4eeac5-861f-4ec0-ab41-922c55a4ae72 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:38.885154 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7d4eeac5-861f-4ec0-ab41-922c55a4ae72 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:30:38.893690 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7d4eeac5-861f-4ec0-ab41-922c55a4ae72 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c" status: 200 len: 1357 microversion: 2.1 time: 0.166374 Jul 25 15:30:38.894548 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3812/7396] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:30:38 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:30:39.632889 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-57cd39f0-58d3-4ac0-b58f-afbdb946b8bd req-852f9882-e4df-4d19-9696-83ac1ff34e8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f07410b3-b57e-4c2e-91c9-e817384b115c", "tag": "49888669-429d-41b8-8c10-eb9442ec3e11"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:30:39.647697 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:30:39.648792 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:30:39.655601 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-57cd39f0-58d3-4ac0-b58f-afbdb946b8bd req-852f9882-e4df-4d19-9696-83ac1ff34e8c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:39.656091 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-57cd39f0-58d3-4ac0-b58f-afbdb946b8bd req-852f9882-e4df-4d19-9696-83ac1ff34e8c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:39.671518 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-57cd39f0-58d3-4ac0-b58f-afbdb946b8bd req-852f9882-e4df-4d19-9696-83ac1ff34e8c service nova] Creating event network-changed:49888669-429d-41b8-8c10-eb9442ec3e11 for instance f07410b3-b57e-4c2e-91c9-e817384b115c on n-h1-846435-14 Jul 25 15:30:39.677948 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-57cd39f0-58d3-4ac0-b58f-afbdb946b8bd req-852f9882-e4df-4d19-9696-83ac1ff34e8c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053348 Jul 25 15:30:39.678601 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3585/7397] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:30:39.916450 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e6360f15-c67a-4f67-9787-418447400711 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:30:39.917085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e6360f15-c67a-4f67-9787-418447400711 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:30:39.921674 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:30:39.928545 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6360f15-c67a-4f67-9787-418447400711 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:39.929008 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6360f15-c67a-4f67-9787-418447400711 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:39.929779 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6360f15-c67a-4f67-9787-418447400711 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:39.930249 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e6360f15-c67a-4f67-9787-418447400711 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:40.073306 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e6360f15-c67a-4f67-9787-418447400711 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:30:40.080969 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e6360f15-c67a-4f67-9787-418447400711 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c" status: 200 len: 1357 microversion: 2.1 time: 0.168458 Jul 25 15:30:40.081446 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3813/7398] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:30:39 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:30:41.103835 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7b0ba24e-e040-482f-961c-49d86d1883be tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:30:41.104685 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7b0ba24e-e040-482f-961c-49d86d1883be tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:30:41.112060 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b0ba24e-e040-482f-961c-49d86d1883be tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:41.112519 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b0ba24e-e040-482f-961c-49d86d1883be tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:41.113316 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b0ba24e-e040-482f-961c-49d86d1883be tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:41.115816 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b0ba24e-e040-482f-961c-49d86d1883be tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:41.320500 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7b0ba24e-e040-482f-961c-49d86d1883be tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:30:41.328656 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7b0ba24e-e040-482f-961c-49d86d1883be tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c" status: 200 len: 1357 microversion: 2.1 time: 0.230015 Jul 25 15:30:41.329238 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3586/7399] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:30:41 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c => generated 1357 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:30:42.351433 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3470f658-1129-4261-80ff-7e199fe3fe96 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:30:42.352099 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3470f658-1129-4261-80ff-7e199fe3fe96 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:30:42.361117 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3470f658-1129-4261-80ff-7e199fe3fe96 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:42.361615 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3470f658-1129-4261-80ff-7e199fe3fe96 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:42.362416 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3470f658-1129-4261-80ff-7e199fe3fe96 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:42.362904 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3470f658-1129-4261-80ff-7e199fe3fe96 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:42.509481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3470f658-1129-4261-80ff-7e199fe3fe96 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:30:42.520566 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3470f658-1129-4261-80ff-7e199fe3fe96 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c" status: 200 len: 1357 microversion: 2.1 time: 0.174305 Jul 25 15:30:42.521407 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3814/7400] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:30:42 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:30:43.543867 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-81ece87c-c541-4e1d-9edb-5cb6494e0eeb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:30:43.544479 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-81ece87c-c541-4e1d-9edb-5cb6494e0eeb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:30:43.552684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-81ece87c-c541-4e1d-9edb-5cb6494e0eeb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:43.553137 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-81ece87c-c541-4e1d-9edb-5cb6494e0eeb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:43.553917 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-81ece87c-c541-4e1d-9edb-5cb6494e0eeb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:43.554352 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-81ece87c-c541-4e1d-9edb-5cb6494e0eeb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:43.715035 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-81ece87c-c541-4e1d-9edb-5cb6494e0eeb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:30:43.723185 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-81ece87c-c541-4e1d-9edb-5cb6494e0eeb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c" status: 200 len: 1357 microversion: 2.1 time: 0.183140 Jul 25 15:30:43.723787 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3587/7401] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:30:43 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:30:44.745888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6eca59d0-ec1e-4ffd-bef2-ebde2f4497ae tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:30:44.746684 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6eca59d0-ec1e-4ffd-bef2-ebde2f4497ae tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:30:44.754212 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6eca59d0-ec1e-4ffd-bef2-ebde2f4497ae tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:44.754683 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6eca59d0-ec1e-4ffd-bef2-ebde2f4497ae tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:44.755477 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6eca59d0-ec1e-4ffd-bef2-ebde2f4497ae tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:44.755964 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6eca59d0-ec1e-4ffd-bef2-ebde2f4497ae tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:44.907627 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6eca59d0-ec1e-4ffd-bef2-ebde2f4497ae tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:30:44.915714 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6eca59d0-ec1e-4ffd-bef2-ebde2f4497ae tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c" status: 200 len: 1357 microversion: 2.1 time: 0.173936 Jul 25 15:30:44.916357 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3815/7402] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:30:44 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:30:45.775040 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-f4ff6547-3752-4f28-ba77-6f69d6b10486 req-664971bd-cdc5-47eb-a830-1297ad308840 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f07410b3-b57e-4c2e-91c9-e817384b115c", "name": "network-vif-plugged", "status": "completed", "tag": "49888669-429d-41b8-8c10-eb9442ec3e11"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:30:45.786277 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f4ff6547-3752-4f28-ba77-6f69d6b10486 req-664971bd-cdc5-47eb-a830-1297ad308840 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:45.786829 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f4ff6547-3752-4f28-ba77-6f69d6b10486 req-664971bd-cdc5-47eb-a830-1297ad308840 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:45.800491 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-f4ff6547-3752-4f28-ba77-6f69d6b10486 req-664971bd-cdc5-47eb-a830-1297ad308840 service nova] Creating event network-vif-plugged:49888669-429d-41b8-8c10-eb9442ec3e11 for instance f07410b3-b57e-4c2e-91c9-e817384b115c on n-h1-846435-14 Jul 25 15:30:45.805837 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-f4ff6547-3752-4f28-ba77-6f69d6b10486 req-664971bd-cdc5-47eb-a830-1297ad308840 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185723 Jul 25 15:30:45.806473 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3588/7403] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:30:45.938156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d8e93ef0-8716-4cd9-9067-670a80a78738 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:30:45.938904 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d8e93ef0-8716-4cd9-9067-670a80a78738 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:30:45.946979 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d8e93ef0-8716-4cd9-9067-670a80a78738 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:45.947446 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d8e93ef0-8716-4cd9-9067-670a80a78738 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:45.948271 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d8e93ef0-8716-4cd9-9067-670a80a78738 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:45.948721 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d8e93ef0-8716-4cd9-9067-670a80a78738 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:46.091544 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d8e93ef0-8716-4cd9-9067-670a80a78738 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:30:46.100353 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d8e93ef0-8716-4cd9-9067-670a80a78738 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c" status: 200 len: 1357 microversion: 2.1 time: 0.166572 Jul 25 15:30:46.100996 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3816/7404] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:30:45 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:30:47.130189 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a1e3ac75-ff9f-453b-846c-ed3595748326 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:30:47.131014 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a1e3ac75-ff9f-453b-846c-ed3595748326 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:30:47.138753 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a1e3ac75-ff9f-453b-846c-ed3595748326 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:47.138984 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a1e3ac75-ff9f-453b-846c-ed3595748326 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:47.139624 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a1e3ac75-ff9f-453b-846c-ed3595748326 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:47.140077 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a1e3ac75-ff9f-453b-846c-ed3595748326 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:47.281817 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a1e3ac75-ff9f-453b-846c-ed3595748326 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:30:47.289919 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a1e3ac75-ff9f-453b-846c-ed3595748326 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c" status: 200 len: 1547 microversion: 2.1 time: 0.171135 Jul 25 15:30:47.290546 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3589/7405] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:30:47 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c => generated 1547 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:30:47.314277 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4f674a00-c0e5-49db-af5c-8e80f7b3191b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:30:47.314935 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4f674a00-c0e5-49db-af5c-8e80f7b3191b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:30:47.322511 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4f674a00-c0e5-49db-af5c-8e80f7b3191b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:47.322968 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4f674a00-c0e5-49db-af5c-8e80f7b3191b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:47.325607 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4f674a00-c0e5-49db-af5c-8e80f7b3191b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:47.325607 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4f674a00-c0e5-49db-af5c-8e80f7b3191b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:47.459961 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4f674a00-c0e5-49db-af5c-8e80f7b3191b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:30:47.468220 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4f674a00-c0e5-49db-af5c-8e80f7b3191b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c" status: 200 len: 1547 microversion: 2.1 time: 0.158246 Jul 25 15:30:47.468812 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3817/7406] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:30:47 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:30:47.488725 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f8128bd5-75c5-4c37-99cf-10bd1bb3adab tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:30:47.493798 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f8128bd5-75c5-4c37-99cf-10bd1bb3adab tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:30:47.494571 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f8128bd5-75c5-4c37-99cf-10bd1bb3adab tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Searching by: {'deleted': False, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57'} {{(pid=119303) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 15:30:47.500391 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8128bd5-75c5-4c37-99cf-10bd1bb3adab tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:47.500839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8128bd5-75c5-4c37-99cf-10bd1bb3adab tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:47.501628 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8128bd5-75c5-4c37-99cf-10bd1bb3adab tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:47.502066 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f8128bd5-75c5-4c37-99cf-10bd1bb3adab tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:47.527230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.multi_cell_list [None req-f8128bd5-75c5-4c37-99cf-10bd1bb3adab tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119303) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 15:30:47.555236 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f8128bd5-75c5-4c37-99cf-10bd1bb3adab tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.070477 Jul 25 15:30:47.555860 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3590/7407] 10.222.0.88 () {58 vars in 1125 bytes} [Mon Jul 25 15:30:47 2022] GET /compute/v2.1/servers => generated 342 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:30:47.568073 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f98a96cc-36c3-45c8-9236-cabcdb56614a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:30:47.568769 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f98a96cc-36c3-45c8-9236-cabcdb56614a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:30:47.576159 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f98a96cc-36c3-45c8-9236-cabcdb56614a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:47.576631 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f98a96cc-36c3-45c8-9236-cabcdb56614a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:47.577423 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f98a96cc-36c3-45c8-9236-cabcdb56614a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:47.577875 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f98a96cc-36c3-45c8-9236-cabcdb56614a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:47.736599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f98a96cc-36c3-45c8-9236-cabcdb56614a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:30:47.745193 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f98a96cc-36c3-45c8-9236-cabcdb56614a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c" status: 200 len: 1547 microversion: 2.1 time: 0.181180 Jul 25 15:30:47.745788 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3818/7408] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:30:47 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c => generated 1547 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:30:49.357540 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fe437b68-894f-4473-b292-4b4b5ddb8bf4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf66532e-fc14-4632-98d6-ec5b3787800d"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:30:49.361347 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fe437b68-894f-4473-b292-4b4b5ddb8bf4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:30:49.370834 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fe437b68-894f-4473-b292-4b4b5ddb8bf4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:49.371294 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fe437b68-894f-4473-b292-4b4b5ddb8bf4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:49.372118 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fe437b68-894f-4473-b292-4b4b5ddb8bf4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:30:49.372559 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fe437b68-894f-4473-b292-4b4b5ddb8bf4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:30:49.672612 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fe437b68-894f-4473-b292-4b4b5ddb8bf4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "POST /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321919 Jul 25 15:30:49.673647 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3591/7409] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Jul 25 15:30:49 2022] POST /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:31:02.778992 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4622866e-9eba-4c7c-bd86-7d7d48f4c2cb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:31:02.779623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4622866e-9eba-4c7c-bd86-7d7d48f4c2cb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:31:02.781753 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:31:02.782431 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=60 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:31:02.791952 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4622866e-9eba-4c7c-bd86-7d7d48f4c2cb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:31:02.792789 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4622866e-9eba-4c7c-bd86-7d7d48f4c2cb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:31:02.794078 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4622866e-9eba-4c7c-bd86-7d7d48f4c2cb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:31:02.794825 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4622866e-9eba-4c7c-bd86-7d7d48f4c2cb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:31:02.939597 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4622866e-9eba-4c7c-bd86-7d7d48f4c2cb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:31:02.950318 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4622866e-9eba-4c7c-bd86-7d7d48f4c2cb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c" status: 200 len: 1593 microversion: 2.1 time: 0.175578 Jul 25 15:31:02.950866 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3819/7410] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:31:02 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c => generated 1593 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:31:05.051128 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-e2b1c2d5-6545-448e-a61d-5285a1042827 req-4a06f6c6-5023-4691-a55d-4dd79f15da2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f07410b3-b57e-4c2e-91c9-e817384b115c", "tag": "49888669-429d-41b8-8c10-eb9442ec3e11"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:31:05.061715 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:31:05.063075 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:31:05.064727 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:31:05.078892 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-e2b1c2d5-6545-448e-a61d-5285a1042827 req-4a06f6c6-5023-4691-a55d-4dd79f15da2b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:31:05.079104 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-e2b1c2d5-6545-448e-a61d-5285a1042827 req-4a06f6c6-5023-4691-a55d-4dd79f15da2b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:31:05.100545 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-e2b1c2d5-6545-448e-a61d-5285a1042827 req-4a06f6c6-5023-4691-a55d-4dd79f15da2b service nova] Creating event network-changed:49888669-429d-41b8-8c10-eb9442ec3e11 for instance f07410b3-b57e-4c2e-91c9-e817384b115c on n-h1-846435-14 Jul 25 15:31:05.109237 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-e2b1c2d5-6545-448e-a61d-5285a1042827 req-4a06f6c6-5023-4691-a55d-4dd79f15da2b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064619 Jul 25 15:31:05.110250 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3592/7411] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:31:06.253145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c36f9a30-ecde-4eac-ad09-5e21c35edaa1 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-771654317"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:31:06.253707 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c36f9a30-ecde-4eac-ad09-5e21c35edaa1 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:31:06.261269 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c36f9a30-ecde-4eac-ad09-5e21c35edaa1 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:31:06.261731 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c36f9a30-ecde-4eac-ad09-5e21c35edaa1 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:31:06.262513 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c36f9a30-ecde-4eac-ad09-5e21c35edaa1 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:31:06.262956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c36f9a30-ecde-4eac-ad09-5e21c35edaa1 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:31:06.403602 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.network.security_group_api [None req-c36f9a30-ecde-4eac-ad09-5e21c35edaa1 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Adding security group 8fd9f438-d951-421d-a694-5b7fbbfb4ad1 to port 49888669-429d-41b8-8c10-eb9442ec3e11 Jul 25 15:31:07.091565 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c36f9a30-ecde-4eac-ad09-5e21c35edaa1 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "POST /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c/action" status: 202 len: 0 microversion: 2.1 time: 0.841512 Jul 25 15:31:07.092905 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3820/7412] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:31:06 2022] POST /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c/action => generated 0 bytes in 845 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:31:07.127932 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f5f66468-f95c-4b16-8d28-22f569066543 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:31:07.140054 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f5f66468-f95c-4b16-8d28-22f569066543 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:31:07.148786 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5f66468-f95c-4b16-8d28-22f569066543 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:31:07.149697 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5f66468-f95c-4b16-8d28-22f569066543 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:31:07.150950 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5f66468-f95c-4b16-8d28-22f569066543 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:31:07.151415 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5f66468-f95c-4b16-8d28-22f569066543 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:31:07.205484 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-6b17d626-ec02-4c4b-b881-65a57efe61e5 req-f57034b4-edfb-4905-8387-bbe284c183aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f07410b3-b57e-4c2e-91c9-e817384b115c", "tag": "49888669-429d-41b8-8c10-eb9442ec3e11"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:31:07.216308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-6b17d626-ec02-4c4b-b881-65a57efe61e5 req-f57034b4-edfb-4905-8387-bbe284c183aa service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:31:07.216751 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-6b17d626-ec02-4c4b-b881-65a57efe61e5 req-f57034b4-edfb-4905-8387-bbe284c183aa service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:31:07.228709 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-6b17d626-ec02-4c4b-b881-65a57efe61e5 req-f57034b4-edfb-4905-8387-bbe284c183aa service nova] Creating event network-changed:49888669-429d-41b8-8c10-eb9442ec3e11 for instance f07410b3-b57e-4c2e-91c9-e817384b115c on n-h1-846435-14 Jul 25 15:31:07.234538 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-6b17d626-ec02-4c4b-b881-65a57efe61e5 req-f57034b4-edfb-4905-8387-bbe284c183aa service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136663 Jul 25 15:31:07.236151 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3593/7413] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:31:07.339505 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f5f66468-f95c-4b16-8d28-22f569066543 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:31:07.351558 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f5f66468-f95c-4b16-8d28-22f569066543 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c" status: 200 len: 1758 microversion: 2.1 time: 0.240112 Jul 25 15:31:07.352665 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3821/7414] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:31:07 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c => generated 1758 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:32:13.780859 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 15:32:13.781557 n-d-846435-14 devstack@n-api.service[119304]: Mon Jul 25 15:32:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 15:32:46.005320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:32:46.006980 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:32:46.019678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b804ced7-b303-440d-bf39-3d439d66c50e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:32:46.024357 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b804ced7-b303-440d-bf39-3d439d66c50e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:32:46.037780 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b804ced7-b303-440d-bf39-3d439d66c50e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:32:46.038576 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b804ced7-b303-440d-bf39-3d439d66c50e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:32:46.040027 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b804ced7-b303-440d-bf39-3d439d66c50e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:32:46.040804 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b804ced7-b303-440d-bf39-3d439d66c50e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:32:46.193000 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b804ced7-b303-440d-bf39-3d439d66c50e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "POST /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c/action" status: 202 len: 0 microversion: 2.1 time: 0.191790 Jul 25 15:32:46.194948 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3594/7415] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:32:45 2022] POST /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:32:46.205346 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:32:46.206868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=16 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:32:46.213982 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-252ab10b-1fbc-48b3-a035-c8f3bd74b476 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:32:46.214640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-252ab10b-1fbc-48b3-a035-c8f3bd74b476 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:32:46.225883 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-252ab10b-1fbc-48b3-a035-c8f3bd74b476 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:32:46.226780 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-252ab10b-1fbc-48b3-a035-c8f3bd74b476 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:32:46.228388 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-252ab10b-1fbc-48b3-a035-c8f3bd74b476 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:32:46.229080 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-252ab10b-1fbc-48b3-a035-c8f3bd74b476 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:32:46.490584 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-252ab10b-1fbc-48b3-a035-c8f3bd74b476 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:32:46.500894 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-252ab10b-1fbc-48b3-a035-c8f3bd74b476 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c" status: 200 len: 1760 microversion: 2.1 time: 0.298602 Jul 25 15:32:46.501926 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3822/7416] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:32:46 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c => generated 1760 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:32:47.532193 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-680a091d-a756-4ec1-bc1c-a76e9fc2cb8f tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:32:47.533483 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-680a091d-a756-4ec1-bc1c-a76e9fc2cb8f tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:32:47.545065 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-680a091d-a756-4ec1-bc1c-a76e9fc2cb8f tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:32:47.545782 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-680a091d-a756-4ec1-bc1c-a76e9fc2cb8f tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:32:47.547057 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-680a091d-a756-4ec1-bc1c-a76e9fc2cb8f tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:32:47.547765 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-680a091d-a756-4ec1-bc1c-a76e9fc2cb8f tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:32:47.830077 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-680a091d-a756-4ec1-bc1c-a76e9fc2cb8f tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:32:47.839877 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-680a091d-a756-4ec1-bc1c-a76e9fc2cb8f tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c" status: 200 len: 1765 microversion: 2.1 time: 0.317769 Jul 25 15:32:47.840693 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3595/7417] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:32:47 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c => generated 1765 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:32:48.870360 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7d161fb2-73fd-47db-ad3c-781c23a41fdf tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:32:48.871548 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7d161fb2-73fd-47db-ad3c-781c23a41fdf tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:32:48.885328 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d161fb2-73fd-47db-ad3c-781c23a41fdf tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:32:48.886177 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d161fb2-73fd-47db-ad3c-781c23a41fdf tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:32:48.887631 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d161fb2-73fd-47db-ad3c-781c23a41fdf tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:32:48.888505 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7d161fb2-73fd-47db-ad3c-781c23a41fdf tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:32:49.121613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7d161fb2-73fd-47db-ad3c-781c23a41fdf tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:32:49.131262 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7d161fb2-73fd-47db-ad3c-781c23a41fdf tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c" status: 200 len: 1765 microversion: 2.1 time: 0.268760 Jul 25 15:32:49.131879 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3823/7418] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:32:48 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c => generated 1765 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:32:50.157843 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-62e27493-e8c3-4fdb-ba94-93f409a48d7d tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:32:50.158909 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-62e27493-e8c3-4fdb-ba94-93f409a48d7d tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:32:50.171667 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-62e27493-e8c3-4fdb-ba94-93f409a48d7d tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:32:50.172551 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-62e27493-e8c3-4fdb-ba94-93f409a48d7d tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:32:50.173929 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-62e27493-e8c3-4fdb-ba94-93f409a48d7d tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:32:50.174729 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-62e27493-e8c3-4fdb-ba94-93f409a48d7d tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:32:50.456210 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-62e27493-e8c3-4fdb-ba94-93f409a48d7d tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:32:50.469932 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-62e27493-e8c3-4fdb-ba94-93f409a48d7d tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c" status: 200 len: 1765 microversion: 2.1 time: 0.319285 Jul 25 15:32:50.470957 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3596/7419] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:32:50 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c => generated 1765 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:32:51.495840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-11267c9e-d0ad-4d2f-871a-dd29f8c76101 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:32:51.496769 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-11267c9e-d0ad-4d2f-871a-dd29f8c76101 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:32:51.504844 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11267c9e-d0ad-4d2f-871a-dd29f8c76101 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:32:51.505430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11267c9e-d0ad-4d2f-871a-dd29f8c76101 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:32:51.506306 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11267c9e-d0ad-4d2f-871a-dd29f8c76101 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:32:51.507027 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11267c9e-d0ad-4d2f-871a-dd29f8c76101 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:32:51.704933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-11267c9e-d0ad-4d2f-871a-dd29f8c76101 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:32:51.714628 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-11267c9e-d0ad-4d2f-871a-dd29f8c76101 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c" status: 200 len: 1765 microversion: 2.1 time: 0.223741 Jul 25 15:32:51.715369 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3824/7420] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:32:51 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c => generated 1765 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:32:52.737693 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5ae84783-8df8-45d5-a92a-127045f9f826 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:32:52.738608 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5ae84783-8df8-45d5-a92a-127045f9f826 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:32:52.746769 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5ae84783-8df8-45d5-a92a-127045f9f826 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:32:52.747409 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5ae84783-8df8-45d5-a92a-127045f9f826 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:32:52.748612 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5ae84783-8df8-45d5-a92a-127045f9f826 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:32:52.749151 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5ae84783-8df8-45d5-a92a-127045f9f826 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:32:52.944230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5ae84783-8df8-45d5-a92a-127045f9f826 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:32:52.961295 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5ae84783-8df8-45d5-a92a-127045f9f826 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c" status: 200 len: 1758 microversion: 2.1 time: 0.228034 Jul 25 15:32:52.962419 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3597/7421] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:32:52 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c => generated 1758 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:34:05.568357 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:34:05.569448 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=18 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:34:05.576594 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b8a3d76c-652c-4720-8da7-7794d701985b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-771654317"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:34:05.577528 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b8a3d76c-652c-4720-8da7-7794d701985b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:05.587166 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8a3d76c-652c-4720-8da7-7794d701985b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:05.587645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8a3d76c-652c-4720-8da7-7794d701985b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:05.588589 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8a3d76c-652c-4720-8da7-7794d701985b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:05.589111 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b8a3d76c-652c-4720-8da7-7794d701985b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:05.773695 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.network.security_group_api [None req-b8a3d76c-652c-4720-8da7-7794d701985b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Removing security group 8fd9f438-d951-421d-a694-5b7fbbfb4ad1 from port 49888669-429d-41b8-8c10-eb9442ec3e11 Jul 25 15:34:06.273326 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b8a3d76c-652c-4720-8da7-7794d701985b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "POST /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c/action" status: 202 len: 0 microversion: 2.1 time: 0.706808 Jul 25 15:34:06.279255 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3825/7422] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:34:05 2022] POST /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c/action => generated 0 bytes in 714 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:34:06.288437 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-c62a898d-9070-41b8-a126-5732cbaa1a2d req-375ed901-c15a-4517-a31e-c9d68a61aa5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f07410b3-b57e-4c2e-91c9-e817384b115c", "tag": "49888669-429d-41b8-8c10-eb9442ec3e11"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:34:06.322213 n-d-846435-14 devstack@n-api.service[119303]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b24320cd-02fe-4cda-9e22-8ff297cb0d9a] AMQP server on 10.222.0.88:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 15:34:06.323930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=8 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:34:06.325780 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:34:06.338312 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c62a898d-9070-41b8-a126-5732cbaa1a2d req-375ed901-c15a-4517-a31e-c9d68a61aa5b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:06.344901 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c62a898d-9070-41b8-a126-5732cbaa1a2d req-375ed901-c15a-4517-a31e-c9d68a61aa5b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:06.388904 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-c62a898d-9070-41b8-a126-5732cbaa1a2d req-375ed901-c15a-4517-a31e-c9d68a61aa5b service nova] Creating event network-changed:49888669-429d-41b8-8c10-eb9442ec3e11 for instance f07410b3-b57e-4c2e-91c9-e817384b115c on n-h1-846435-14 Jul 25 15:34:06.410750 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-c62a898d-9070-41b8-a126-5732cbaa1a2d req-375ed901-c15a-4517-a31e-c9d68a61aa5b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133482 Jul 25 15:34:06.411885 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3598/7423] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:34:08.009737 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7a95a689-efe6-4d59-96c2-d23d2a49f638 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:08.010572 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7a95a689-efe6-4d59-96c2-d23d2a49f638 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:08.018364 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a95a689-efe6-4d59-96c2-d23d2a49f638 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:08.018830 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a95a689-efe6-4d59-96c2-d23d2a49f638 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:08.020156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a95a689-efe6-4d59-96c2-d23d2a49f638 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:08.020706 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7a95a689-efe6-4d59-96c2-d23d2a49f638 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:08.149877 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-7a95a689-efe6-4d59-96c2-d23d2a49f638 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lazy-loading 'services' on Instance uuid f07410b3-b57e-4c2e-91c9-e817384b115c {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:34:08.282804 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7a95a689-efe6-4d59-96c2-d23d2a49f638 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "DELETE /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c/os-volume_attachments/bf66532e-fc14-4632-98d6-ec5b3787800d" status: 202 len: 0 microversion: 2.1 time: 0.278190 Jul 25 15:34:08.283449 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3826/7424] 10.222.0.88 () {58 vars in 1416 bytes} [Mon Jul 25 15:34:08 2022] DELETE /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c/os-volume_attachments/bf66532e-fc14-4632-98d6-ec5b3787800d => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:34:08.302720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8ced1234-f399-43c9-8bc5-0b75518802aa tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:08.307133 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8ced1234-f399-43c9-8bc5-0b75518802aa tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:08.323424 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ced1234-f399-43c9-8bc5-0b75518802aa tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:08.324948 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ced1234-f399-43c9-8bc5-0b75518802aa tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:08.326687 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ced1234-f399-43c9-8bc5-0b75518802aa tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:08.327493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8ced1234-f399-43c9-8bc5-0b75518802aa tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:08.363479 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [-] [b24320cd-02fe-4cda-9e22-8ff297cb0d9a] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 51916. Jul 25 15:34:08.396466 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8ced1234-f399-43c9-8bc5-0b75518802aa tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104792 Jul 25 15:34:08.404318 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3599/7425] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 15:34:08 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:34:08.445169 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-529ca195-691b-4d60-bf52-3c4c86dca06e req-06bebf5a-d5d4-4f9f-a467-8d7273e89ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f07410b3-b57e-4c2e-91c9-e817384b115c", "tag": "49888669-429d-41b8-8c10-eb9442ec3e11"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:34:08.469810 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-529ca195-691b-4d60-bf52-3c4c86dca06e req-06bebf5a-d5d4-4f9f-a467-8d7273e89ea8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:08.470646 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-529ca195-691b-4d60-bf52-3c4c86dca06e req-06bebf5a-d5d4-4f9f-a467-8d7273e89ea8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:08.494477 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-529ca195-691b-4d60-bf52-3c4c86dca06e req-06bebf5a-d5d4-4f9f-a467-8d7273e89ea8 service nova] Creating event network-changed:49888669-429d-41b8-8c10-eb9442ec3e11 for instance f07410b3-b57e-4c2e-91c9-e817384b115c on n-h1-846435-14 Jul 25 15:34:08.503290 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-529ca195-691b-4d60-bf52-3c4c86dca06e req-06bebf5a-d5d4-4f9f-a467-8d7273e89ea8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074573 Jul 25 15:34:08.505218 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3827/7426] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:34:09.418405 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ddc23ae2-939d-4be3-a0b1-c23b47edccc8 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:09.424551 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ddc23ae2-939d-4be3-a0b1-c23b47edccc8 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:09.438806 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ddc23ae2-939d-4be3-a0b1-c23b47edccc8 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:09.440033 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ddc23ae2-939d-4be3-a0b1-c23b47edccc8 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:09.441845 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ddc23ae2-939d-4be3-a0b1-c23b47edccc8 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:09.443133 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ddc23ae2-939d-4be3-a0b1-c23b47edccc8 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:09.495434 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ddc23ae2-939d-4be3-a0b1-c23b47edccc8 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086199 Jul 25 15:34:09.496145 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3600/7427] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 15:34:09 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:34:10.512597 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-618c18c8-fa08-4c51-8509-0f275bd1c82b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:10.515730 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-618c18c8-fa08-4c51-8509-0f275bd1c82b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:10.525237 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-618c18c8-fa08-4c51-8509-0f275bd1c82b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:10.525831 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-618c18c8-fa08-4c51-8509-0f275bd1c82b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:10.527096 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-618c18c8-fa08-4c51-8509-0f275bd1c82b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:10.527860 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-618c18c8-fa08-4c51-8509-0f275bd1c82b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:10.570629 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-618c18c8-fa08-4c51-8509-0f275bd1c82b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065188 Jul 25 15:34:10.571614 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3828/7428] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 15:34:10 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:34:11.586493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2f9b11d5-e6ac-44e1-844c-f1c8a779e10f tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:11.589672 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2f9b11d5-e6ac-44e1-844c-f1c8a779e10f tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:11.599372 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f9b11d5-e6ac-44e1-844c-f1c8a779e10f tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:11.600089 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f9b11d5-e6ac-44e1-844c-f1c8a779e10f tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:11.601204 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f9b11d5-e6ac-44e1-844c-f1c8a779e10f tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:11.601819 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f9b11d5-e6ac-44e1-844c-f1c8a779e10f tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:11.641608 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2f9b11d5-e6ac-44e1-844c-f1c8a779e10f tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060489 Jul 25 15:34:11.642441 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3601/7429] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 15:34:11 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:34:12.658647 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cc0549e9-7089-4a61-9564-75f5d89b57d4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:12.662435 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cc0549e9-7089-4a61-9564-75f5d89b57d4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:12.673502 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cc0549e9-7089-4a61-9564-75f5d89b57d4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:12.673974 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cc0549e9-7089-4a61-9564-75f5d89b57d4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:12.674912 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cc0549e9-7089-4a61-9564-75f5d89b57d4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:12.675375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cc0549e9-7089-4a61-9564-75f5d89b57d4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:12.715628 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cc0549e9-7089-4a61-9564-75f5d89b57d4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064003 Jul 25 15:34:12.724305 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3829/7430] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 15:34:12 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:34:13.733982 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-acdd0953-7cc4-4074-9e82-0212d4b37c88 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:13.737033 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-acdd0953-7cc4-4074-9e82-0212d4b37c88 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:13.749769 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-acdd0953-7cc4-4074-9e82-0212d4b37c88 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:13.750471 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-acdd0953-7cc4-4074-9e82-0212d4b37c88 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:13.751849 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-acdd0953-7cc4-4074-9e82-0212d4b37c88 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:13.752566 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-acdd0953-7cc4-4074-9e82-0212d4b37c88 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:13.796651 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-acdd0953-7cc4-4074-9e82-0212d4b37c88 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067383 Jul 25 15:34:13.797830 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3602/7431] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 15:34:13 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:34:14.815809 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d37681df-2395-47a8-b0db-80e170c1d5c6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:14.818883 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d37681df-2395-47a8-b0db-80e170c1d5c6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:14.827476 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d37681df-2395-47a8-b0db-80e170c1d5c6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:14.828159 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d37681df-2395-47a8-b0db-80e170c1d5c6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:14.829074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d37681df-2395-47a8-b0db-80e170c1d5c6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:14.829678 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d37681df-2395-47a8-b0db-80e170c1d5c6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:14.867187 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d37681df-2395-47a8-b0db-80e170c1d5c6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056325 Jul 25 15:34:14.867897 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3830/7432] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 15:34:14 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 15:34:14.885685 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6afafe8f-3fb8-4fda-aca8-6aa745e22203 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:14.886405 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6afafe8f-3fb8-4fda-aca8-6aa745e22203 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:14.894467 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6afafe8f-3fb8-4fda-aca8-6aa745e22203 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:14.894950 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6afafe8f-3fb8-4fda-aca8-6aa745e22203 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:14.895753 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6afafe8f-3fb8-4fda-aca8-6aa745e22203 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:14.896235 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6afafe8f-3fb8-4fda-aca8-6aa745e22203 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:15.003683 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-6afafe8f-3fb8-4fda-aca8-6aa745e22203 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] HTTP exception thrown: Instance f07410b3-b57e-4c2e-91c9-e817384b115c is not attached to volume bf66532e-fc14-4632-98d6-ec5b3787800d Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6afafe8f-3fb8-4fda-aca8-6aa745e22203 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Request method failure captured: Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c/os-volume_attachments/bf66532e-fc14-4632-98d6-ec5b3787800d HTTP/1.1 Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rcFXhlUHrUZWzsT9nJIIC6eH6GKAge8Y9VCotIrPdsEytMZd1lNLymOMfYZCTP7LUUK5n8TpbjUa7_ar-23mLhf-aOASPe8PAc4l0P0bS8pmchpcIPUaG2ChzAJLW1KhJYdMA90L9fj2ejSi9o160JcQPDcAwp010TplyGSdklug-o Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: a4075ffb266f4b3eb54f948d22370f57 Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-TestMinimumBasicScenario-1745139868 Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a4075ffb266f4b3eb54f948d22370f57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a4075ffb266f4b3eb54f948d22370f57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a4075ffb266f4b3eb54f948d22370f57", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a4075ffb266f4b3eb54f948d22370f57"}]}] Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-TestMinimumBasicScenario-1745139868 Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: a4075ffb266f4b3eb54f948d22370f57 Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1745139868 Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-TestMinimumBasicScenario-1745139868-project Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 6cf843e3e35e4cb8bff95aca236051fc Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-TestMinimumBasicScenario-1745139868-project Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance f07410b3-b57e-4c2e-91c9-e817384b115c is not attached to volume bf66532e-fc14-4632-98d6-ec5b3787800d Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'server_id': 'f07410b3-b57e-4c2e-91c9-e817384b115c', 'id': 'bf66532e-fc14-4632-98d6-ec5b3787800d'} Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id bf66532e-fc14-4632-98d6-ec5b3787800d. Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f07410b3-b57e-4c2e-91c9-e817384b115c is not attached to volume bf66532e-fc14-4632-98d6-ec5b3787800d Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:34:15.005873 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:34:15.010251 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:34:15.010251 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:34:15.010251 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f07410b3-b57e-4c2e-91c9-e817384b115c is not attached to volume bf66532e-fc14-4632-98d6-ec5b3787800d Jul 25 15:34:15.010251 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:34:15.010251 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6afafe8f-3fb8-4fda-aca8-6aa745e22203 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Returning 404 to user: Instance f07410b3-b57e-4c2e-91c9-e817384b115c is not attached to volume bf66532e-fc14-4632-98d6-ec5b3787800d {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:34:15.010251 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6afafe8f-3fb8-4fda-aca8-6aa745e22203 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "DELETE /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c/os-volume_attachments/bf66532e-fc14-4632-98d6-ec5b3787800d" status: 404 len: 154 microversion: 2.1 time: 0.130402 Jul 25 15:34:15.010251 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3603/7433] 10.222.0.88 () {58 vars in 1416 bytes} [Mon Jul 25 15:34:14 2022] DELETE /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c/os-volume_attachments/bf66532e-fc14-4632-98d6-ec5b3787800d => generated 154 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:34:19.477329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a073744b-3dae-43ea-981d-0813e4bfe18a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:19.478213 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a073744b-3dae-43ea-981d-0813e4bfe18a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:19.493487 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a073744b-3dae-43ea-981d-0813e4bfe18a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:19.494344 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a073744b-3dae-43ea-981d-0813e4bfe18a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:19.495784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a073744b-3dae-43ea-981d-0813e4bfe18a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:19.496657 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a073744b-3dae-43ea-981d-0813e4bfe18a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:19.547202 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a073744b-3dae-43ea-981d-0813e4bfe18a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:34:19.691056 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a073744b-3dae-43ea-981d-0813e4bfe18a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "DELETE /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c" status: 204 len: 0 microversion: 2.1 time: 0.222978 Jul 25 15:34:19.692632 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3831/7434] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:34:19 2022] DELETE /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:34:19.710350 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3ccfa589-caf2-4198-8208-a0c5bc14e544 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:19.711682 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3ccfa589-caf2-4198-8208-a0c5bc14e544 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:19.728459 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3ccfa589-caf2-4198-8208-a0c5bc14e544 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:19.729454 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3ccfa589-caf2-4198-8208-a0c5bc14e544 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:19.731016 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3ccfa589-caf2-4198-8208-a0c5bc14e544 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:19.732033 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3ccfa589-caf2-4198-8208-a0c5bc14e544 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:20.194904 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3ccfa589-caf2-4198-8208-a0c5bc14e544 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:34:20.211237 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3ccfa589-caf2-4198-8208-a0c5bc14e544 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c" status: 200 len: 1553 microversion: 2.1 time: 0.508720 Jul 25 15:34:20.212421 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3604/7435] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:34:19 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c => generated 1553 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:34:21.241466 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3307b5cf-2935-4159-be1b-b782d74ef7e0 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:21.242233 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3307b5cf-2935-4159-be1b-b782d74ef7e0 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:21.251543 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3307b5cf-2935-4159-be1b-b782d74ef7e0 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:21.252366 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3307b5cf-2935-4159-be1b-b782d74ef7e0 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:21.253243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3307b5cf-2935-4159-be1b-b782d74ef7e0 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:21.253836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3307b5cf-2935-4159-be1b-b782d74ef7e0 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:21.673501 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3307b5cf-2935-4159-be1b-b782d74ef7e0 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:34:21.684545 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3307b5cf-2935-4159-be1b-b782d74ef7e0 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c" status: 200 len: 1553 microversion: 2.1 time: 0.448247 Jul 25 15:34:21.685171 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3832/7436] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:34:21 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c => generated 1553 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:34:22.289000 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-b794ee89-f242-4ca7-b430-3bc7f20d57d2 req-fe7b34d3-92a0-4579-84de-f75d8e8c307d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f07410b3-b57e-4c2e-91c9-e817384b115c", "name": "network-vif-deleted", "tag": "49888669-429d-41b8-8c10-eb9442ec3e11"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:34:22.311019 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b794ee89-f242-4ca7-b430-3bc7f20d57d2 req-fe7b34d3-92a0-4579-84de-f75d8e8c307d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:22.311940 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b794ee89-f242-4ca7-b430-3bc7f20d57d2 req-fe7b34d3-92a0-4579-84de-f75d8e8c307d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:22.336666 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-b794ee89-f242-4ca7-b430-3bc7f20d57d2 req-fe7b34d3-92a0-4579-84de-f75d8e8c307d service nova] Creating event network-vif-deleted:49888669-429d-41b8-8c10-eb9442ec3e11 for instance f07410b3-b57e-4c2e-91c9-e817384b115c on n-h1-846435-14 Jul 25 15:34:22.349399 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-b794ee89-f242-4ca7-b430-3bc7f20d57d2 req-fe7b34d3-92a0-4579-84de-f75d8e8c307d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068121 Jul 25 15:34:22.350567 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3605/7437] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:34:22.716167 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-af39609c-7702-4dff-a944-52bf1f6fbafb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:22.724965 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-af39609c-7702-4dff-a944-52bf1f6fbafb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:22.739175 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af39609c-7702-4dff-a944-52bf1f6fbafb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:22.739917 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af39609c-7702-4dff-a944-52bf1f6fbafb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:22.741351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af39609c-7702-4dff-a944-52bf1f6fbafb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:22.742056 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af39609c-7702-4dff-a944-52bf1f6fbafb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:22.810882 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af39609c-7702-4dff-a944-52bf1f6fbafb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:22.812478 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af39609c-7702-4dff-a944-52bf1f6fbafb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:22.813310 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-af39609c-7702-4dff-a944-52bf1f6fbafb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lazy-loading 'fault' on Instance uuid f07410b3-b57e-4c2e-91c9-e817384b115c {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:34:22.884285 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-af39609c-7702-4dff-a944-52bf1f6fbafb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:34:22.902851 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-af39609c-7702-4dff-a944-52bf1f6fbafb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c" status: 200 len: 1347 microversion: 2.1 time: 0.193818 Jul 25 15:34:22.903835 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3833/7438] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:34:22 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c => generated 1347 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:34:23.931847 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0a7ffa70-adf9-4f1c-9813-8f351ed3b511 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:23.933072 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0a7ffa70-adf9-4f1c-9813-8f351ed3b511 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: f07410b3-b57e-4c2e-91c9-e817384b115c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:23.944684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0a7ffa70-adf9-4f1c-9813-8f351ed3b511 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:23.945476 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0a7ffa70-adf9-4f1c-9813-8f351ed3b511 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:23.946841 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0a7ffa70-adf9-4f1c-9813-8f351ed3b511 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:23.947654 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0a7ffa70-adf9-4f1c-9813-8f351ed3b511 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:23.976046 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-0a7ffa70-adf9-4f1c-9813-8f351ed3b511 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] HTTP exception thrown: Instance f07410b3-b57e-4c2e-91c9-e817384b115c could not be found. Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0a7ffa70-adf9-4f1c-9813-8f351ed3b511 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Request method failure captured: Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c HTTP/1.1 Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rcFXhlUHrUZWzsT9nJIIC6eH6GKAge8Y9VCotIrPdsEytMZd1lNLymOMfYZCTP7LUUK5n8TpbjUa7_ar-23mLhf-aOASPe8PAc4l0P0bS8pmchpcIPUaG2ChzAJLW1KhJYdMA90L9fj2ejSi9o160JcQPDcAwp010TplyGSdklug-o Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: a4075ffb266f4b3eb54f948d22370f57 Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-TestMinimumBasicScenario-1745139868 Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a4075ffb266f4b3eb54f948d22370f57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a4075ffb266f4b3eb54f948d22370f57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a4075ffb266f4b3eb54f948d22370f57", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a4075ffb266f4b3eb54f948d22370f57"}]}] Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-TestMinimumBasicScenario-1745139868 Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: a4075ffb266f4b3eb54f948d22370f57 Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1745139868 Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-TestMinimumBasicScenario-1745139868-project Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 6cf843e3e35e4cb8bff95aca236051fc Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-TestMinimumBasicScenario-1745139868-project Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance f07410b3-b57e-4c2e-91c9-e817384b115c could not be found. Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'f07410b3-b57e-4c2e-91c9-e817384b115c'} Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f07410b3-b57e-4c2e-91c9-e817384b115c could not be found. Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f07410b3-b57e-4c2e-91c9-e817384b115c could not be found. Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:34:23.979145 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:34:23.988087 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:34:23.988087 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:34:23.988087 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:34:23.988087 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:34:23.988087 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:34:23.988087 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f07410b3-b57e-4c2e-91c9-e817384b115c could not be found. Jul 25 15:34:23.988087 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:34:23.988087 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0a7ffa70-adf9-4f1c-9813-8f351ed3b511 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Returning 404 to user: Instance f07410b3-b57e-4c2e-91c9-e817384b115c could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:34:23.988087 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0a7ffa70-adf9-4f1c-9813-8f351ed3b511 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c" status: 404 len: 111 microversion: 2.1 time: 0.057093 Jul 25 15:34:23.988087 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3606/7439] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:34:23 2022] GET /compute/v2.1/servers/f07410b3-b57e-4c2e-91c9-e817384b115c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 15:34:23.997348 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-76b8e123-e169-4782-8585-d441ef560826 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '.version_select at 0x7f4686193280>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:24.034081 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-76b8e123-e169-4782-8585-d441ef560826 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-463907621" status: 202 len: 0 microversion: 2.1 time: 0.043962 Jul 25 15:34:24.035108 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3834/7440] 10.222.0.88 () {58 vars in 1269 bytes} [Mon Jul 25 15:34:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-463907621 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:34:35.528696 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bd9187f7-981a-427c-8888-1fd89f086e01 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Action: 'create', calling method: .version_select at 0x7f46863a91f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1442473389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqkBMcCKGfHWNw+AcV+ltY8I21dl0tdN9sd+dPG2Y/HLEerNPnri18FNe+NLbmosqInF84JsNEavm25CcQE45GXB2EeJJTH0d0l0z1hr/6mkiIWoHldhEMrzL+OlKLQRA=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:34:35.535465 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=18 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:34:35.536163 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=42 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:34:35.550928 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-bd9187f7-981a-427c-8888-1fd89f086e01 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Getting quotas for project a4075ffb266f4b3eb54f948d22370f57. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:34:35.556763 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-bd9187f7-981a-427c-8888-1fd89f086e01 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Getting quotas for user 6cf843e3e35e4cb8bff95aca236051fc and project a4075ffb266f4b3eb54f948d22370f57. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:34:35.573532 n-d-846435-14 devstack@n-api.service[119303]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bd9187f7-981a-427c-8888-1fd89f086e01 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [2c2acd86-cda7-44eb-a5d9-ff251265bcd2] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 15:34:36.584658 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [None req-bd9187f7-981a-427c-8888-1fd89f086e01 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [2c2acd86-cda7-44eb-a5d9-ff251265bcd2] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 52050. Jul 25 15:34:36.615334 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bd9187f7-981a-427c-8888-1fd89f086e01 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.091373 Jul 25 15:34:36.616434 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3607/7441] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 15:34:35 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:34:36.688699 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:34:36.689669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:34:36.697441 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5700f7ac-9b11-4f18-8e7f-e504e8fa84e4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1898430138", "imageRef": "b907ec59-6d1c-4e82-b83c-8267e25bb993", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1442473389", "networks": [{"uuid": "bb747b31-49e0-4337-a4e5-f6a6817a123d"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:34:36.777458 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-5700f7ac-9b11-4f18-8e7f-e504e8fa84e4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] validate_networks() for [('bb747b31-49e0-4337-a4e5-f6a6817a123d', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:34:37.507903 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-5700f7ac-9b11-4f18-8e7f-e504e8fa84e4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:34:37.508728 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-5700f7ac-9b11-4f18-8e7f-e504e8fa84e4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:34:37.509657 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-5700f7ac-9b11-4f18-8e7f-e504e8fa84e4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:34:37.510422 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-5700f7ac-9b11-4f18-8e7f-e504e8fa84e4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:34:37.511173 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-5700f7ac-9b11-4f18-8e7f-e504e8fa84e4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:34:37.529093 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5700f7ac-9b11-4f18-8e7f-e504e8fa84e4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:37.530120 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5700f7ac-9b11-4f18-8e7f-e504e8fa84e4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:37.531972 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5700f7ac-9b11-4f18-8e7f-e504e8fa84e4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:37.533017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5700f7ac-9b11-4f18-8e7f-e504e8fa84e4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:37.572582 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-5700f7ac-9b11-4f18-8e7f-e504e8fa84e4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Getting quotas for project a4075ffb266f4b3eb54f948d22370f57. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:34:37.583859 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-5700f7ac-9b11-4f18-8e7f-e504e8fa84e4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Getting quotas for user 6cf843e3e35e4cb8bff95aca236051fc and project a4075ffb266f4b3eb54f948d22370f57. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:34:37.606896 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5700f7ac-9b11-4f18-8e7f-e504e8fa84e4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:34:37.611318 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5700f7ac-9b11-4f18-8e7f-e504e8fa84e4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b907ec59-6d1c-4e82-b83c-8267e25bb993',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:34:37.713346 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5700f7ac-9b11-4f18-8e7f-e504e8fa84e4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.026339 Jul 25 15:34:37.716150 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3835/7442] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:34:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:34:37.750272 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-25b5834d-88b2-486e-9968-9036f2c4ace6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:37.752348 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-25b5834d-88b2-486e-9968-9036f2c4ace6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:37.898635 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-25b5834d-88b2-486e-9968-9036f2c4ace6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:34:37.913840 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-25b5834d-88b2-486e-9968-9036f2c4ace6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1259 microversion: 2.1 time: 0.170919 Jul 25 15:34:37.915199 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3608/7443] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:34:37 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:34:38.953542 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-62bb3c1c-674c-4b85-ba5f-8e629dd48486 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:38.954201 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-62bb3c1c-674c-4b85-ba5f-8e629dd48486 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:38.968579 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-62bb3c1c-674c-4b85-ba5f-8e629dd48486 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:38.969392 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-62bb3c1c-674c-4b85-ba5f-8e629dd48486 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:38.970811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-62bb3c1c-674c-4b85-ba5f-8e629dd48486 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:38.971574 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-62bb3c1c-674c-4b85-ba5f-8e629dd48486 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:39.064709 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-62bb3c1c-674c-4b85-ba5f-8e629dd48486 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:34:39.079338 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-62bb3c1c-674c-4b85-ba5f-8e629dd48486 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1311 microversion: 2.1 time: 0.134001 Jul 25 15:34:39.080479 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3836/7444] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:34:38 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1311 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:34:40.121374 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-75ec652e-5a7a-47da-8a6a-221d068e41cb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:40.122874 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-75ec652e-5a7a-47da-8a6a-221d068e41cb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:40.146733 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-75ec652e-5a7a-47da-8a6a-221d068e41cb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:40.147569 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-75ec652e-5a7a-47da-8a6a-221d068e41cb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:40.149453 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-75ec652e-5a7a-47da-8a6a-221d068e41cb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:40.150439 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-75ec652e-5a7a-47da-8a6a-221d068e41cb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:40.719790 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-75ec652e-5a7a-47da-8a6a-221d068e41cb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:34:40.742502 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-75ec652e-5a7a-47da-8a6a-221d068e41cb tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1359 microversion: 2.1 time: 0.627819 Jul 25 15:34:40.744537 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3609/7445] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:34:40 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1359 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:34:41.784200 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0b060d2a-0a9a-4b55-b305-1632d33aa3b9 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:41.785027 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0b060d2a-0a9a-4b55-b305-1632d33aa3b9 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:41.797389 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b060d2a-0a9a-4b55-b305-1632d33aa3b9 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:41.801577 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b060d2a-0a9a-4b55-b305-1632d33aa3b9 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:41.804815 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b060d2a-0a9a-4b55-b305-1632d33aa3b9 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:41.805740 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b060d2a-0a9a-4b55-b305-1632d33aa3b9 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:42.273716 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-0437057c-3327-47b6-b7f9-80b8d5ac4cb4 req-c4c848da-c1d6-4a0c-8c72-dee15b6aa24a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70b94746-45d7-477d-b177-16d88344076a", "tag": "cb0dc228-2c2e-4a45-a917-2edc978dc2ae"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:34:42.313470 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-0437057c-3327-47b6-b7f9-80b8d5ac4cb4 req-c4c848da-c1d6-4a0c-8c72-dee15b6aa24a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:42.314792 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-0437057c-3327-47b6-b7f9-80b8d5ac4cb4 req-c4c848da-c1d6-4a0c-8c72-dee15b6aa24a service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:42.349307 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-0437057c-3327-47b6-b7f9-80b8d5ac4cb4 req-c4c848da-c1d6-4a0c-8c72-dee15b6aa24a service nova] Creating event network-changed:cb0dc228-2c2e-4a45-a917-2edc978dc2ae for instance 70b94746-45d7-477d-b177-16d88344076a on n-h2-846435-14 Jul 25 15:34:42.366992 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-0437057c-3327-47b6-b7f9-80b8d5ac4cb4 req-c4c848da-c1d6-4a0c-8c72-dee15b6aa24a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104162 Jul 25 15:34:42.370387 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3610/7446] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:34:42.431076 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0b060d2a-0a9a-4b55-b305-1632d33aa3b9 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:34:42.452377 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0b060d2a-0a9a-4b55-b305-1632d33aa3b9 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1359 microversion: 2.1 time: 0.677035 Jul 25 15:34:42.470439 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3837/7447] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:34:41 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1359 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:34:43.487356 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5ca2d3c7-7fc8-41e4-ac83-90ee47c58e2e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:43.489738 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5ca2d3c7-7fc8-41e4-ac83-90ee47c58e2e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:43.514678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5ca2d3c7-7fc8-41e4-ac83-90ee47c58e2e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:43.515860 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5ca2d3c7-7fc8-41e4-ac83-90ee47c58e2e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:43.517619 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5ca2d3c7-7fc8-41e4-ac83-90ee47c58e2e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:43.518651 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5ca2d3c7-7fc8-41e4-ac83-90ee47c58e2e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:43.827701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5ca2d3c7-7fc8-41e4-ac83-90ee47c58e2e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:34:43.845937 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5ca2d3c7-7fc8-41e4-ac83-90ee47c58e2e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1359 microversion: 2.1 time: 0.366996 Jul 25 15:34:43.847424 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3611/7448] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:34:43 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1359 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:34:44.880778 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4c5bb768-9e23-4889-8d45-d014f5fcf423 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:44.883475 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4c5bb768-9e23-4889-8d45-d014f5fcf423 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:44.900180 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4c5bb768-9e23-4889-8d45-d014f5fcf423 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:44.902545 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4c5bb768-9e23-4889-8d45-d014f5fcf423 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:44.903586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4c5bb768-9e23-4889-8d45-d014f5fcf423 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:44.904217 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4c5bb768-9e23-4889-8d45-d014f5fcf423 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:45.149271 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4c5bb768-9e23-4889-8d45-d014f5fcf423 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:34:45.160312 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4c5bb768-9e23-4889-8d45-d014f5fcf423 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1359 microversion: 2.1 time: 0.287847 Jul 25 15:34:45.162740 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3838/7449] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:34:44 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1359 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:34:46.200181 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-99a06e75-83c7-4863-a188-19af0e7a384f tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:46.205204 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-99a06e75-83c7-4863-a188-19af0e7a384f tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:46.260868 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99a06e75-83c7-4863-a188-19af0e7a384f tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:46.261456 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99a06e75-83c7-4863-a188-19af0e7a384f tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:46.265336 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99a06e75-83c7-4863-a188-19af0e7a384f tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:46.273790 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-99a06e75-83c7-4863-a188-19af0e7a384f tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:46.545167 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-99a06e75-83c7-4863-a188-19af0e7a384f tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:34:46.558317 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-99a06e75-83c7-4863-a188-19af0e7a384f tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1359 microversion: 2.1 time: 0.366982 Jul 25 15:34:46.560529 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3612/7450] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:34:46 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1359 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:34:47.591719 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9698e072-84d5-494d-8527-e328faa443d5 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:47.595596 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9698e072-84d5-494d-8527-e328faa443d5 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:47.601000 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:34:47.602320 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:34:47.614960 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9698e072-84d5-494d-8527-e328faa443d5 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:47.615888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9698e072-84d5-494d-8527-e328faa443d5 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:47.617507 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9698e072-84d5-494d-8527-e328faa443d5 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:47.618309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9698e072-84d5-494d-8527-e328faa443d5 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:47.824715 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9698e072-84d5-494d-8527-e328faa443d5 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:34:47.835174 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9698e072-84d5-494d-8527-e328faa443d5 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1359 microversion: 2.1 time: 0.249045 Jul 25 15:34:47.835784 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3839/7451] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:34:47 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1359 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:34:48.860482 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-16c0d4f6-19fb-43d5-8907-86744dc56526 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:48.861496 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-16c0d4f6-19fb-43d5-8907-86744dc56526 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:48.864714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:34:48.871301 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-16c0d4f6-19fb-43d5-8907-86744dc56526 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:48.871795 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-16c0d4f6-19fb-43d5-8907-86744dc56526 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:48.872712 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-16c0d4f6-19fb-43d5-8907-86744dc56526 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:48.873315 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-16c0d4f6-19fb-43d5-8907-86744dc56526 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:49.040134 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-16c0d4f6-19fb-43d5-8907-86744dc56526 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:34:49.048871 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-16c0d4f6-19fb-43d5-8907-86744dc56526 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1359 microversion: 2.1 time: 0.192972 Jul 25 15:34:49.049565 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3613/7452] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:34:48 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1359 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:34:50.073460 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d14d089b-1942-4ce9-8e9e-2dd34606aed4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:50.074254 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d14d089b-1942-4ce9-8e9e-2dd34606aed4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:50.083374 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d14d089b-1942-4ce9-8e9e-2dd34606aed4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:50.083849 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d14d089b-1942-4ce9-8e9e-2dd34606aed4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:50.084746 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d14d089b-1942-4ce9-8e9e-2dd34606aed4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:50.085202 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d14d089b-1942-4ce9-8e9e-2dd34606aed4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:50.289921 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d14d089b-1942-4ce9-8e9e-2dd34606aed4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:34:50.303086 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d14d089b-1942-4ce9-8e9e-2dd34606aed4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1359 microversion: 2.1 time: 0.234615 Jul 25 15:34:50.304244 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3840/7453] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:34:50 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1359 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:34:51.327373 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-12b53020-c664-40ae-a7d0-38415f44f61e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:51.328157 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-12b53020-c664-40ae-a7d0-38415f44f61e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:51.335473 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-12b53020-c664-40ae-a7d0-38415f44f61e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:51.335903 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-12b53020-c664-40ae-a7d0-38415f44f61e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:51.336714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-12b53020-c664-40ae-a7d0-38415f44f61e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:51.337145 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-12b53020-c664-40ae-a7d0-38415f44f61e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:51.570652 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-12b53020-c664-40ae-a7d0-38415f44f61e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:34:51.580054 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-12b53020-c664-40ae-a7d0-38415f44f61e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1359 microversion: 2.1 time: 0.256981 Jul 25 15:34:51.580547 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3614/7454] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:34:51 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1359 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:34:52.603829 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-52355820-1ad1-4191-8afb-d8b44e5fd5e4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:52.604636 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-52355820-1ad1-4191-8afb-d8b44e5fd5e4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:52.613581 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52355820-1ad1-4191-8afb-d8b44e5fd5e4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:52.613926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52355820-1ad1-4191-8afb-d8b44e5fd5e4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:52.614760 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52355820-1ad1-4191-8afb-d8b44e5fd5e4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:52.615213 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-52355820-1ad1-4191-8afb-d8b44e5fd5e4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:52.766441 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-52355820-1ad1-4191-8afb-d8b44e5fd5e4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:34:52.774666 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-52355820-1ad1-4191-8afb-d8b44e5fd5e4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1359 microversion: 2.1 time: 0.175294 Jul 25 15:34:52.775281 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3841/7455] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:34:52 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:34:53.799121 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ca4f029d-576e-4b2e-a022-8c37d9075318 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:53.799795 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ca4f029d-576e-4b2e-a022-8c37d9075318 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:53.809471 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ca4f029d-576e-4b2e-a022-8c37d9075318 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:53.809935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ca4f029d-576e-4b2e-a022-8c37d9075318 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:53.810854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ca4f029d-576e-4b2e-a022-8c37d9075318 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:53.811309 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ca4f029d-576e-4b2e-a022-8c37d9075318 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:53.986744 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ca4f029d-576e-4b2e-a022-8c37d9075318 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:34:53.998102 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ca4f029d-576e-4b2e-a022-8c37d9075318 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1359 microversion: 2.1 time: 0.204137 Jul 25 15:34:53.999089 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3615/7456] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:34:53 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1359 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:34:55.022984 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3e5306ff-266b-4b13-9810-7acb646a7903 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:55.024156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3e5306ff-266b-4b13-9810-7acb646a7903 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:55.037105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e5306ff-266b-4b13-9810-7acb646a7903 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:55.037766 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e5306ff-266b-4b13-9810-7acb646a7903 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:55.039017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e5306ff-266b-4b13-9810-7acb646a7903 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:55.039816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e5306ff-266b-4b13-9810-7acb646a7903 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:55.238391 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3e5306ff-266b-4b13-9810-7acb646a7903 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:34:55.247938 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3e5306ff-266b-4b13-9810-7acb646a7903 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1359 microversion: 2.1 time: 0.230557 Jul 25 15:34:55.248642 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3842/7457] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:34:55 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1359 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:34:56.276082 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e84163c0-aad5-4d21-ab0b-2af777d55059 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:56.277042 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e84163c0-aad5-4d21-ab0b-2af777d55059 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:56.288761 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e84163c0-aad5-4d21-ab0b-2af777d55059 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:56.289224 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e84163c0-aad5-4d21-ab0b-2af777d55059 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:56.290060 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e84163c0-aad5-4d21-ab0b-2af777d55059 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:56.290499 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e84163c0-aad5-4d21-ab0b-2af777d55059 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:56.458812 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e84163c0-aad5-4d21-ab0b-2af777d55059 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:34:56.473409 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e84163c0-aad5-4d21-ab0b-2af777d55059 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1359 microversion: 2.1 time: 0.204885 Jul 25 15:34:56.474373 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3616/7458] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:34:56 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1359 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:34:57.505205 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-26ddbbc8-d216-4b49-a9d0-12de9922699c tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:57.505975 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-26ddbbc8-d216-4b49-a9d0-12de9922699c tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:57.513692 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26ddbbc8-d216-4b49-a9d0-12de9922699c tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:57.514264 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26ddbbc8-d216-4b49-a9d0-12de9922699c tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:57.515192 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26ddbbc8-d216-4b49-a9d0-12de9922699c tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:57.515653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-26ddbbc8-d216-4b49-a9d0-12de9922699c tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:57.713459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-26ddbbc8-d216-4b49-a9d0-12de9922699c tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:34:57.726436 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-26ddbbc8-d216-4b49-a9d0-12de9922699c tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1359 microversion: 2.1 time: 0.225935 Jul 25 15:34:57.734026 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3843/7459] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:34:57 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1359 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:34:58.753332 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-404c559b-70b1-4b38-969f-8a24dd0b5090 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:58.754217 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-404c559b-70b1-4b38-969f-8a24dd0b5090 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:58.763822 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-404c559b-70b1-4b38-969f-8a24dd0b5090 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:58.764190 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-404c559b-70b1-4b38-969f-8a24dd0b5090 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:58.764903 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-404c559b-70b1-4b38-969f-8a24dd0b5090 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:58.765380 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-404c559b-70b1-4b38-969f-8a24dd0b5090 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:58.929763 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-404c559b-70b1-4b38-969f-8a24dd0b5090 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:34:58.943751 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-404c559b-70b1-4b38-969f-8a24dd0b5090 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1359 microversion: 2.1 time: 0.194907 Jul 25 15:34:58.944758 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3617/7460] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:34:58 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:34:59.154736 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-1ca09424-c0bb-4672-9479-28dbccf745b5 req-78c51e03-dafa-4d38-88b9-f80d9bd84787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70b94746-45d7-477d-b177-16d88344076a", "name": "network-vif-plugged", "status": "completed", "tag": "cb0dc228-2c2e-4a45-a917-2edc978dc2ae"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:34:59.171517 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-1ca09424-c0bb-4672-9479-28dbccf745b5 req-78c51e03-dafa-4d38-88b9-f80d9bd84787 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:59.172185 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-1ca09424-c0bb-4672-9479-28dbccf745b5 req-78c51e03-dafa-4d38-88b9-f80d9bd84787 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:59.188744 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-1ca09424-c0bb-4672-9479-28dbccf745b5 req-78c51e03-dafa-4d38-88b9-f80d9bd84787 service nova] Creating event network-vif-plugged:cb0dc228-2c2e-4a45-a917-2edc978dc2ae for instance 70b94746-45d7-477d-b177-16d88344076a on n-h2-846435-14 Jul 25 15:34:59.194482 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-1ca09424-c0bb-4672-9479-28dbccf745b5 req-78c51e03-dafa-4d38-88b9-f80d9bd84787 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044760 Jul 25 15:34:59.195125 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3844/7461] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:34:59.969100 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c512eadb-3f42-499a-963b-c8bed9c778fe tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:34:59.969915 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c512eadb-3f42-499a-963b-c8bed9c778fe tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:34:59.979593 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c512eadb-3f42-499a-963b-c8bed9c778fe tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:59.980289 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c512eadb-3f42-499a-963b-c8bed9c778fe tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:34:59.981218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c512eadb-3f42-499a-963b-c8bed9c778fe tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:34:59.981651 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c512eadb-3f42-499a-963b-c8bed9c778fe tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:35:00.181068 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c512eadb-3f42-499a-963b-c8bed9c778fe tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:35:00.190572 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c512eadb-3f42-499a-963b-c8bed9c778fe tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1359 microversion: 2.1 time: 0.226130 Jul 25 15:35:00.191181 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3618/7462] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:34:59 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:35:01.236583 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e69fca4c-86f0-430d-9aa9-903b746a651a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:35:01.237796 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e69fca4c-86f0-430d-9aa9-903b746a651a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:35:01.252260 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e69fca4c-86f0-430d-9aa9-903b746a651a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:35:01.253247 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e69fca4c-86f0-430d-9aa9-903b746a651a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:35:01.255298 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e69fca4c-86f0-430d-9aa9-903b746a651a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:35:01.256704 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e69fca4c-86f0-430d-9aa9-903b746a651a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:35:01.458129 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e69fca4c-86f0-430d-9aa9-903b746a651a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:35:01.469704 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e69fca4c-86f0-430d-9aa9-903b746a651a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1549 microversion: 2.1 time: 0.243204 Jul 25 15:35:01.470178 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3845/7463] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:35:01 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1549 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:35:01.500840 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-62e246bf-9fe0-46f3-b7ff-2b309f89699b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:35:01.501879 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-62e246bf-9fe0-46f3-b7ff-2b309f89699b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:35:01.515089 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-62e246bf-9fe0-46f3-b7ff-2b309f89699b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:35:01.515863 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-62e246bf-9fe0-46f3-b7ff-2b309f89699b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:35:01.517132 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-62e246bf-9fe0-46f3-b7ff-2b309f89699b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:35:01.517707 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-62e246bf-9fe0-46f3-b7ff-2b309f89699b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:35:01.724600 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-62e246bf-9fe0-46f3-b7ff-2b309f89699b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:35:01.733834 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-62e246bf-9fe0-46f3-b7ff-2b309f89699b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1549 microversion: 2.1 time: 0.240332 Jul 25 15:35:01.734779 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3619/7464] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:35:01 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1549 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:35:01.757818 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-655c4cde-927c-4183-b1a8-d077046ad256 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:35:01.764659 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-655c4cde-927c-4183-b1a8-d077046ad256 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:35:01.765861 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-655c4cde-927c-4183-b1a8-d077046ad256 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Searching by: {'deleted': False, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57'} {{(pid=119304) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 15:35:01.774222 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-655c4cde-927c-4183-b1a8-d077046ad256 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:35:01.774815 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-655c4cde-927c-4183-b1a8-d077046ad256 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:35:01.775876 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-655c4cde-927c-4183-b1a8-d077046ad256 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:35:01.776460 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-655c4cde-927c-4183-b1a8-d077046ad256 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:35:01.834431 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.multi_cell_list [None req-655c4cde-927c-4183-b1a8-d077046ad256 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119304) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 15:35:01.876376 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-655c4cde-927c-4183-b1a8-d077046ad256 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.124695 Jul 25 15:35:01.877028 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3846/7465] 10.222.0.88 () {58 vars in 1125 bytes} [Mon Jul 25 15:35:01 2022] GET /compute/v2.1/servers => generated 343 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:35:01.890711 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fdff3d07-e73c-47fe-8b19-64535a5352a9 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:35:01.891330 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fdff3d07-e73c-47fe-8b19-64535a5352a9 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:35:01.898928 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fdff3d07-e73c-47fe-8b19-64535a5352a9 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:35:01.899354 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fdff3d07-e73c-47fe-8b19-64535a5352a9 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:35:01.900247 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fdff3d07-e73c-47fe-8b19-64535a5352a9 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:35:01.900694 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fdff3d07-e73c-47fe-8b19-64535a5352a9 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:35:02.129151 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fdff3d07-e73c-47fe-8b19-64535a5352a9 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:35:02.145705 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fdff3d07-e73c-47fe-8b19-64535a5352a9 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1549 microversion: 2.1 time: 0.259992 Jul 25 15:35:02.146815 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3620/7466] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:35:01 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1549 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:35:05.112423 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-71786e67-a3b6-4ffb-871a-89f8f35c08f9 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8fade538-688b-4769-888f-39313ca8ad27"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:35:05.115022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-71786e67-a3b6-4ffb-871a-89f8f35c08f9 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:35:05.124077 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71786e67-a3b6-4ffb-871a-89f8f35c08f9 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:35:05.124800 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71786e67-a3b6-4ffb-871a-89f8f35c08f9 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:35:05.125892 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71786e67-a3b6-4ffb-871a-89f8f35c08f9 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:35:05.126581 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-71786e67-a3b6-4ffb-871a-89f8f35c08f9 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:35:05.509175 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-71786e67-a3b6-4ffb-871a-89f8f35c08f9 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "POST /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.401259 Jul 25 15:35:05.510394 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3847/7467] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Jul 25 15:35:05 2022] POST /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a/os-volume_attachments => generated 194 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:35:18.956520 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6db4f493-18e0-4a2d-8f2f-759bc99b7c33 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:35:18.957745 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6db4f493-18e0-4a2d-8f2f-759bc99b7c33 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:35:18.962893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:35:18.964361 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=68 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:35:18.977161 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6db4f493-18e0-4a2d-8f2f-759bc99b7c33 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:35:18.977873 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6db4f493-18e0-4a2d-8f2f-759bc99b7c33 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:35:18.979435 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6db4f493-18e0-4a2d-8f2f-759bc99b7c33 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:35:18.980351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6db4f493-18e0-4a2d-8f2f-759bc99b7c33 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:35:19.277058 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6db4f493-18e0-4a2d-8f2f-759bc99b7c33 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:35:19.291659 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6db4f493-18e0-4a2d-8f2f-759bc99b7c33 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1595 microversion: 2.1 time: 0.343220 Jul 25 15:35:19.292515 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3621/7468] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:35:18 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1595 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:35:22.461753 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:35:22.463885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:35:22.465079 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:35:22.472224 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-e547a8e3-135a-4d24-8785-d44a3a2794a9 req-782b0712-1292-4386-9ae8-7422436213f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70b94746-45d7-477d-b177-16d88344076a", "tag": "cb0dc228-2c2e-4a45-a917-2edc978dc2ae"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:35:22.493600 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-e547a8e3-135a-4d24-8785-d44a3a2794a9 req-782b0712-1292-4386-9ae8-7422436213f7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:35:22.494071 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-e547a8e3-135a-4d24-8785-d44a3a2794a9 req-782b0712-1292-4386-9ae8-7422436213f7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:35:22.519416 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-e547a8e3-135a-4d24-8785-d44a3a2794a9 req-782b0712-1292-4386-9ae8-7422436213f7 service nova] Creating event network-changed:cb0dc228-2c2e-4a45-a917-2edc978dc2ae for instance 70b94746-45d7-477d-b177-16d88344076a on n-h2-846435-14 Jul 25 15:35:22.527493 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-e547a8e3-135a-4d24-8785-d44a3a2794a9 req-782b0712-1292-4386-9ae8-7422436213f7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066658 Jul 25 15:35:22.528793 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3848/7469] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:35:24.233894 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a4f0a4e0-5edf-4d32-bace-d5fb19a334f2 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2100996698"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:35:24.238605 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a4f0a4e0-5edf-4d32-bace-d5fb19a334f2 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:35:24.253098 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a4f0a4e0-5edf-4d32-bace-d5fb19a334f2 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:35:24.253098 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a4f0a4e0-5edf-4d32-bace-d5fb19a334f2 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:35:24.254274 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a4f0a4e0-5edf-4d32-bace-d5fb19a334f2 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:35:24.255091 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a4f0a4e0-5edf-4d32-bace-d5fb19a334f2 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:35:24.456058 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.network.security_group_api [None req-a4f0a4e0-5edf-4d32-bace-d5fb19a334f2 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Adding security group 8a37d834-faa8-4683-9ce3-eeb9e2b367a9 to port cb0dc228-2c2e-4a45-a917-2edc978dc2ae Jul 25 15:35:24.967752 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a4f0a4e0-5edf-4d32-bace-d5fb19a334f2 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "POST /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a/action" status: 202 len: 0 microversion: 2.1 time: 0.741546 Jul 25 15:35:24.974970 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3622/7470] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:35:24 2022] POST /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a/action => generated 0 bytes in 750 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:35:24.981782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1331f799-d5ea-49d5-ae4f-07aa4684864b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:35:24.982833 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1331f799-d5ea-49d5-ae4f-07aa4684864b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:35:25.008777 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1331f799-d5ea-49d5-ae4f-07aa4684864b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:35:25.009866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1331f799-d5ea-49d5-ae4f-07aa4684864b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:35:25.011793 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1331f799-d5ea-49d5-ae4f-07aa4684864b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:35:25.013069 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1331f799-d5ea-49d5-ae4f-07aa4684864b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:35:25.160368 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-0f3d9dd7-fde9-4069-8d91-20b5843e44af req-19625422-7e12-44e3-9440-af461b67add7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70b94746-45d7-477d-b177-16d88344076a", "tag": "cb0dc228-2c2e-4a45-a917-2edc978dc2ae"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:35:25.180634 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-0f3d9dd7-fde9-4069-8d91-20b5843e44af req-19625422-7e12-44e3-9440-af461b67add7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:35:25.181870 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-0f3d9dd7-fde9-4069-8d91-20b5843e44af req-19625422-7e12-44e3-9440-af461b67add7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:35:25.206255 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-0f3d9dd7-fde9-4069-8d91-20b5843e44af req-19625422-7e12-44e3-9440-af461b67add7 service nova] Creating event network-changed:cb0dc228-2c2e-4a45-a917-2edc978dc2ae for instance 70b94746-45d7-477d-b177-16d88344076a on n-h2-846435-14 Jul 25 15:35:25.219933 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-0f3d9dd7-fde9-4069-8d91-20b5843e44af req-19625422-7e12-44e3-9440-af461b67add7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228524 Jul 25 15:35:25.221438 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3623/7471] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:35:25.482859 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1331f799-d5ea-49d5-ae4f-07aa4684864b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:35:25.495584 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1331f799-d5ea-49d5-ae4f-07aa4684864b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1761 microversion: 2.1 time: 0.520145 Jul 25 15:35:25.496269 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3849/7472] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:35:24 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1761 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:35:31.280126 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 15:35:31.281067 n-d-846435-14 devstack@n-api.service[119303]: Mon Jul 25 15:35:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 15:36:23.028133 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f4b93e6b-4233-47e0-bdb2-ff2481d47f3b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:36:23.030763 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f4b93e6b-4233-47e0-bdb2-ff2481d47f3b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:36:23.033887 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:36:23.035037 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=12 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:36:23.044694 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f4b93e6b-4233-47e0-bdb2-ff2481d47f3b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:36:23.046017 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f4b93e6b-4233-47e0-bdb2-ff2481d47f3b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:36:23.047728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f4b93e6b-4233-47e0-bdb2-ff2481d47f3b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:36:23.048559 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f4b93e6b-4233-47e0-bdb2-ff2481d47f3b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:36:23.175800 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f4b93e6b-4233-47e0-bdb2-ff2481d47f3b tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "POST /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a/action" status: 202 len: 0 microversion: 2.1 time: 0.151917 Jul 25 15:36:23.177187 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3624/7473] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:36:23 2022] POST /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 15:36:23.192090 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-10573463-e49a-4d10-8915-e7720d1c0d5c tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:36:23.193280 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-10573463-e49a-4d10-8915-e7720d1c0d5c tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:36:23.198342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=4 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:36:23.199694 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=8 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:36:23.210927 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-10573463-e49a-4d10-8915-e7720d1c0d5c tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:36:23.211604 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-10573463-e49a-4d10-8915-e7720d1c0d5c tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:36:23.213064 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-10573463-e49a-4d10-8915-e7720d1c0d5c tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:36:23.214150 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-10573463-e49a-4d10-8915-e7720d1c0d5c tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:36:23.586224 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-10573463-e49a-4d10-8915-e7720d1c0d5c tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:36:23.604617 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-10573463-e49a-4d10-8915-e7720d1c0d5c tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1753 microversion: 2.1 time: 0.419779 Jul 25 15:36:23.605444 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3850/7474] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:36:23 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1753 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:36:24.634084 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8fb06e26-85e1-4f7c-b168-9ea6eec9b658 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:36:24.635219 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8fb06e26-85e1-4f7c-b168-9ea6eec9b658 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:36:24.643916 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8fb06e26-85e1-4f7c-b168-9ea6eec9b658 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:36:24.644562 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8fb06e26-85e1-4f7c-b168-9ea6eec9b658 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:36:24.645667 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8fb06e26-85e1-4f7c-b168-9ea6eec9b658 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:36:24.646116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8fb06e26-85e1-4f7c-b168-9ea6eec9b658 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:36:24.884864 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8fb06e26-85e1-4f7c-b168-9ea6eec9b658 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:36:24.895898 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8fb06e26-85e1-4f7c-b168-9ea6eec9b658 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1758 microversion: 2.1 time: 0.267537 Jul 25 15:36:24.896547 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3625/7475] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:36:24 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1758 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:36:25.922092 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-35517d39-aedc-445c-963c-688b7ca6a32a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:36:25.922771 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-35517d39-aedc-445c-963c-688b7ca6a32a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:36:25.933419 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35517d39-aedc-445c-963c-688b7ca6a32a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:36:25.934231 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35517d39-aedc-445c-963c-688b7ca6a32a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:36:25.935494 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35517d39-aedc-445c-963c-688b7ca6a32a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:36:25.935949 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-35517d39-aedc-445c-963c-688b7ca6a32a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:36:26.177124 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-35517d39-aedc-445c-963c-688b7ca6a32a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:36:26.187627 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-35517d39-aedc-445c-963c-688b7ca6a32a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1758 microversion: 2.1 time: 0.269958 Jul 25 15:36:26.188499 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3851/7476] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:36:25 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1758 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:36:27.217490 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7909e6e4-8df7-43b6-8c6e-cd58f8de019d tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:36:27.218138 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7909e6e4-8df7-43b6-8c6e-cd58f8de019d tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:36:27.227860 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7909e6e4-8df7-43b6-8c6e-cd58f8de019d tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:36:27.228622 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7909e6e4-8df7-43b6-8c6e-cd58f8de019d tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:36:27.230487 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7909e6e4-8df7-43b6-8c6e-cd58f8de019d tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:36:27.231020 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7909e6e4-8df7-43b6-8c6e-cd58f8de019d tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:36:27.445311 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7909e6e4-8df7-43b6-8c6e-cd58f8de019d tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:36:27.458826 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7909e6e4-8df7-43b6-8c6e-cd58f8de019d tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1758 microversion: 2.1 time: 0.248942 Jul 25 15:36:27.459915 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3626/7477] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:36:27 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1758 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:36:28.490696 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2c3b302c-4df4-4aad-aaf1-673ae0faeaf6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:36:28.491837 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2c3b302c-4df4-4aad-aaf1-673ae0faeaf6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:36:28.504392 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2c3b302c-4df4-4aad-aaf1-673ae0faeaf6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:36:28.505148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2c3b302c-4df4-4aad-aaf1-673ae0faeaf6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:36:28.506505 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2c3b302c-4df4-4aad-aaf1-673ae0faeaf6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:36:28.507269 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2c3b302c-4df4-4aad-aaf1-673ae0faeaf6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:36:28.709716 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2c3b302c-4df4-4aad-aaf1-673ae0faeaf6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:36:28.720996 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2c3b302c-4df4-4aad-aaf1-673ae0faeaf6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1758 microversion: 2.1 time: 0.237801 Jul 25 15:36:28.721919 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3852/7478] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:36:28 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1758 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:36:29.749116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1530f770-fa06-4ece-95f3-fd38a47f8cc8 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:36:29.750187 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1530f770-fa06-4ece-95f3-fd38a47f8cc8 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:36:29.767032 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1530f770-fa06-4ece-95f3-fd38a47f8cc8 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:36:29.767841 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1530f770-fa06-4ece-95f3-fd38a47f8cc8 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:36:29.769221 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1530f770-fa06-4ece-95f3-fd38a47f8cc8 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:36:29.770613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1530f770-fa06-4ece-95f3-fd38a47f8cc8 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:36:29.998086 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1530f770-fa06-4ece-95f3-fd38a47f8cc8 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:36:30.007539 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1530f770-fa06-4ece-95f3-fd38a47f8cc8 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1758 microversion: 2.1 time: 0.265271 Jul 25 15:36:30.008548 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3627/7479] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:36:29 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1758 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:36:31.032302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3b5434d3-112c-4512-a20f-cfab23b99304 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:36:31.033142 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3b5434d3-112c-4512-a20f-cfab23b99304 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:36:31.041038 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b5434d3-112c-4512-a20f-cfab23b99304 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:36:31.041498 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b5434d3-112c-4512-a20f-cfab23b99304 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:36:31.042331 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b5434d3-112c-4512-a20f-cfab23b99304 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:36:31.043171 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3b5434d3-112c-4512-a20f-cfab23b99304 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:36:31.239101 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3b5434d3-112c-4512-a20f-cfab23b99304 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:36:31.250341 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3b5434d3-112c-4512-a20f-cfab23b99304 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1758 microversion: 2.1 time: 0.222523 Jul 25 15:36:31.251076 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3853/7480] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:36:31 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1758 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:36:32.279778 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4adc58c8-0fe0-476b-b4d5-312352490ce8 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:36:32.280970 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4adc58c8-0fe0-476b-b4d5-312352490ce8 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:36:32.293726 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4adc58c8-0fe0-476b-b4d5-312352490ce8 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:36:32.295092 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4adc58c8-0fe0-476b-b4d5-312352490ce8 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:36:32.296960 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4adc58c8-0fe0-476b-b4d5-312352490ce8 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:36:32.297800 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4adc58c8-0fe0-476b-b4d5-312352490ce8 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:36:32.520778 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4adc58c8-0fe0-476b-b4d5-312352490ce8 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:36:32.537813 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4adc58c8-0fe0-476b-b4d5-312352490ce8 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1758 microversion: 2.1 time: 0.265250 Jul 25 15:36:32.538792 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3628/7481] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:36:32 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1758 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:36:33.562184 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4b6f3699-14f9-4d80-a597-a8a7cdac38c4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:36:33.563148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4b6f3699-14f9-4d80-a597-a8a7cdac38c4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:36:33.571793 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4b6f3699-14f9-4d80-a597-a8a7cdac38c4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:36:33.572419 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4b6f3699-14f9-4d80-a597-a8a7cdac38c4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:36:33.573327 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4b6f3699-14f9-4d80-a597-a8a7cdac38c4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:36:33.574067 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4b6f3699-14f9-4d80-a597-a8a7cdac38c4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:36:33.761221 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4b6f3699-14f9-4d80-a597-a8a7cdac38c4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:36:33.771377 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4b6f3699-14f9-4d80-a597-a8a7cdac38c4 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1758 microversion: 2.1 time: 0.213625 Jul 25 15:36:33.772644 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3854/7482] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:36:33 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1758 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:36:34.795179 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-638ac3e8-a8f2-4ab6-92bf-838cb7ee84b8 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:36:34.795811 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-638ac3e8-a8f2-4ab6-92bf-838cb7ee84b8 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:36:34.805901 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-638ac3e8-a8f2-4ab6-92bf-838cb7ee84b8 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:36:34.806495 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-638ac3e8-a8f2-4ab6-92bf-838cb7ee84b8 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:36:34.807714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-638ac3e8-a8f2-4ab6-92bf-838cb7ee84b8 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:36:34.808401 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-638ac3e8-a8f2-4ab6-92bf-838cb7ee84b8 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:36:35.019364 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-638ac3e8-a8f2-4ab6-92bf-838cb7ee84b8 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:36:35.029208 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-638ac3e8-a8f2-4ab6-92bf-838cb7ee84b8 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1758 microversion: 2.1 time: 0.238295 Jul 25 15:36:35.029843 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3629/7483] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:36:34 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1758 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:36:36.056973 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-59973585-ef57-4076-aa5c-dde1d0ebc647 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:36:36.058003 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-59973585-ef57-4076-aa5c-dde1d0ebc647 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:36:36.070644 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59973585-ef57-4076-aa5c-dde1d0ebc647 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:36:36.071436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59973585-ef57-4076-aa5c-dde1d0ebc647 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:36:36.072929 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59973585-ef57-4076-aa5c-dde1d0ebc647 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:36:36.073780 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-59973585-ef57-4076-aa5c-dde1d0ebc647 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:36:36.283585 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-59973585-ef57-4076-aa5c-dde1d0ebc647 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:36:36.293741 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-59973585-ef57-4076-aa5c-dde1d0ebc647 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1761 microversion: 2.1 time: 0.244213 Jul 25 15:36:36.294382 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3855/7484] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:36:36 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1761 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:37:13.053811 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 15:37:13.054865 n-d-846435-14 devstack@n-api.service[119304]: Mon Jul 25 15:37:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 15:37:13.793574 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 15:37:13.793836 n-d-846435-14 devstack@n-api.service[119304]: Mon Jul 25 15:37:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 15:37:35.591063 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=12 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:37:35.592106 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:37:35.596656 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-39cc2f6b-aeba-4453-8c09-20d3889bcb1a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2100996698"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:37:35.597190 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-39cc2f6b-aeba-4453-8c09-20d3889bcb1a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:37:35.606123 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-39cc2f6b-aeba-4453-8c09-20d3889bcb1a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:35.606577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-39cc2f6b-aeba-4453-8c09-20d3889bcb1a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:35.607735 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-39cc2f6b-aeba-4453-8c09-20d3889bcb1a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:35.608190 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-39cc2f6b-aeba-4453-8c09-20d3889bcb1a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:36.057935 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.network.security_group_api [None req-39cc2f6b-aeba-4453-8c09-20d3889bcb1a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Removing security group 8a37d834-faa8-4683-9ce3-eeb9e2b367a9 from port cb0dc228-2c2e-4a45-a917-2edc978dc2ae Jul 25 15:37:36.576072 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-39cc2f6b-aeba-4453-8c09-20d3889bcb1a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "POST /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a/action" status: 202 len: 0 microversion: 2.1 time: 0.987104 Jul 25 15:37:36.577323 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3630/7485] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:37:35 2022] POST /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a/action => generated 0 bytes in 989 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:37:36.600490 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=12 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:37:36.602320 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=36 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:37:36.614806 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-efad07c9-0acb-4478-9904-1f8629973a92 req-b0dd1198-1bc2-4568-99fd-22ee377a41af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70b94746-45d7-477d-b177-16d88344076a", "tag": "cb0dc228-2c2e-4a45-a917-2edc978dc2ae"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:37:36.641430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-efad07c9-0acb-4478-9904-1f8629973a92 req-b0dd1198-1bc2-4568-99fd-22ee377a41af service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:36.642200 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-efad07c9-0acb-4478-9904-1f8629973a92 req-b0dd1198-1bc2-4568-99fd-22ee377a41af service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:36.669741 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-efad07c9-0acb-4478-9904-1f8629973a92 req-b0dd1198-1bc2-4568-99fd-22ee377a41af service nova] Creating event network-changed:cb0dc228-2c2e-4a45-a917-2edc978dc2ae for instance 70b94746-45d7-477d-b177-16d88344076a on n-h2-846435-14 Jul 25 15:37:36.680484 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-efad07c9-0acb-4478-9904-1f8629973a92 req-b0dd1198-1bc2-4568-99fd-22ee377a41af service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081582 Jul 25 15:37:36.684281 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3856/7486] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:37:38.625664 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-06abb4d0-3dc1-4b3b-af44-bdcd42318e9a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:37:38.626637 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-06abb4d0-3dc1-4b3b-af44-bdcd42318e9a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:37:38.636258 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-06abb4d0-3dc1-4b3b-af44-bdcd42318e9a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:38.637198 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-06abb4d0-3dc1-4b3b-af44-bdcd42318e9a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:38.638692 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-06abb4d0-3dc1-4b3b-af44-bdcd42318e9a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:38.639500 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-06abb4d0-3dc1-4b3b-af44-bdcd42318e9a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:38.719219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-f653e148-693d-427e-9a8f-8233cb03989c req-aa9443e8-1e10-4ba1-8d56-bdf279d59ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70b94746-45d7-477d-b177-16d88344076a", "tag": "cb0dc228-2c2e-4a45-a917-2edc978dc2ae"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:37:38.740846 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-f653e148-693d-427e-9a8f-8233cb03989c req-aa9443e8-1e10-4ba1-8d56-bdf279d59ed7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:38.742014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-f653e148-693d-427e-9a8f-8233cb03989c req-aa9443e8-1e10-4ba1-8d56-bdf279d59ed7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:38.763886 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-f653e148-693d-427e-9a8f-8233cb03989c req-aa9443e8-1e10-4ba1-8d56-bdf279d59ed7 service nova] Creating event network-changed:cb0dc228-2c2e-4a45-a917-2edc978dc2ae for instance 70b94746-45d7-477d-b177-16d88344076a on n-h2-846435-14 Jul 25 15:37:38.772536 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-f653e148-693d-427e-9a8f-8233cb03989c req-aa9443e8-1e10-4ba1-8d56-bdf279d59ed7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059858 Jul 25 15:37:38.773843 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3857/7487] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:37:38.812571 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-06abb4d0-3dc1-4b3b-af44-bdcd42318e9a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lazy-loading 'services' on Instance uuid 70b94746-45d7-477d-b177-16d88344076a {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:37:38.950138 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-06abb4d0-3dc1-4b3b-af44-bdcd42318e9a tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "DELETE /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a/os-volume_attachments/8fade538-688b-4769-888f-39313ca8ad27" status: 202 len: 0 microversion: 2.1 time: 0.329915 Jul 25 15:37:38.974252 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-53586b38-6ed5-49af-b783-b9d850b569a1 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:37:38.983084 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-53586b38-6ed5-49af-b783-b9d850b569a1 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:37:38.983674 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3631/7488] 10.222.0.88 () {58 vars in 1416 bytes} [Mon Jul 25 15:37:38 2022] DELETE /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a/os-volume_attachments/8fade538-688b-4769-888f-39313ca8ad27 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 15:37:39.003016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-53586b38-6ed5-49af-b783-b9d850b569a1 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:39.005467 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-53586b38-6ed5-49af-b783-b9d850b569a1 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:39.007414 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-53586b38-6ed5-49af-b783-b9d850b569a1 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:39.008481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-53586b38-6ed5-49af-b783-b9d850b569a1 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:39.069192 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-53586b38-6ed5-49af-b783-b9d850b569a1 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108717 Jul 25 15:37:39.070796 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3858/7489] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 15:37:38 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:37:40.099510 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-acc9923a-37db-419b-a68f-f5642fe6cc44 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:37:40.103731 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-acc9923a-37db-419b-a68f-f5642fe6cc44 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:37:40.122897 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-acc9923a-37db-419b-a68f-f5642fe6cc44 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:40.124393 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-acc9923a-37db-419b-a68f-f5642fe6cc44 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:40.126090 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-acc9923a-37db-419b-a68f-f5642fe6cc44 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:40.128277 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-acc9923a-37db-419b-a68f-f5642fe6cc44 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:40.201615 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-acc9923a-37db-419b-a68f-f5642fe6cc44 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117258 Jul 25 15:37:40.203511 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3632/7490] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 15:37:40 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:37:41.221104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3bc2d019-d831-41ac-b0e7-6d70850fcb22 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:37:41.224677 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3bc2d019-d831-41ac-b0e7-6d70850fcb22 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:37:41.234869 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3bc2d019-d831-41ac-b0e7-6d70850fcb22 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:41.235332 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3bc2d019-d831-41ac-b0e7-6d70850fcb22 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:41.236195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3bc2d019-d831-41ac-b0e7-6d70850fcb22 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:41.236647 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3bc2d019-d831-41ac-b0e7-6d70850fcb22 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:41.276322 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3bc2d019-d831-41ac-b0e7-6d70850fcb22 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061294 Jul 25 15:37:41.277409 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3859/7491] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 15:37:41 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:37:42.290971 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-79359963-3140-4472-921d-bcd04664a197 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:37:42.293580 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-79359963-3140-4472-921d-bcd04664a197 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:37:42.301555 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-79359963-3140-4472-921d-bcd04664a197 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:42.302001 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-79359963-3140-4472-921d-bcd04664a197 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:42.302787 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-79359963-3140-4472-921d-bcd04664a197 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:42.303226 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-79359963-3140-4472-921d-bcd04664a197 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:42.350851 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-79359963-3140-4472-921d-bcd04664a197 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063858 Jul 25 15:37:42.352340 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3633/7492] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 15:37:42 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:37:43.371222 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a504789f-b270-4308-bdce-e40ac36c97c6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:37:43.373748 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a504789f-b270-4308-bdce-e40ac36c97c6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:37:43.382655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a504789f-b270-4308-bdce-e40ac36c97c6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:43.383130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a504789f-b270-4308-bdce-e40ac36c97c6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:43.383954 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a504789f-b270-4308-bdce-e40ac36c97c6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:43.384563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a504789f-b270-4308-bdce-e40ac36c97c6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:43.435648 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a504789f-b270-4308-bdce-e40ac36c97c6 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069353 Jul 25 15:37:43.436811 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3860/7493] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 15:37:43 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:37:44.454991 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5710a647-c3eb-41c2-a4fc-b840b5674b69 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:37:44.458774 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5710a647-c3eb-41c2-a4fc-b840b5674b69 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:37:44.471389 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5710a647-c3eb-41c2-a4fc-b840b5674b69 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:44.472161 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5710a647-c3eb-41c2-a4fc-b840b5674b69 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:44.473552 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5710a647-c3eb-41c2-a4fc-b840b5674b69 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:44.474295 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5710a647-c3eb-41c2-a4fc-b840b5674b69 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:44.530105 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5710a647-c3eb-41c2-a4fc-b840b5674b69 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082168 Jul 25 15:37:44.530939 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3634/7494] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 15:37:44 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:37:45.551434 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c5aa9b4e-2b90-4798-82e4-3762ff6fe628 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:37:45.556663 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c5aa9b4e-2b90-4798-82e4-3762ff6fe628 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:37:45.570177 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c5aa9b4e-2b90-4798-82e4-3762ff6fe628 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:45.571040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c5aa9b4e-2b90-4798-82e4-3762ff6fe628 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:45.572679 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c5aa9b4e-2b90-4798-82e4-3762ff6fe628 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:45.573568 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c5aa9b4e-2b90-4798-82e4-3762ff6fe628 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:45.635441 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c5aa9b4e-2b90-4798-82e4-3762ff6fe628 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091649 Jul 25 15:37:45.636712 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3861/7495] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Jul 25 15:37:45 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 15:37:45.650558 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-928af2fe-fcf8-40cc-8381-bc0e2b9b842e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:37:45.651319 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-928af2fe-fcf8-40cc-8381-bc0e2b9b842e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:37:45.660250 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-928af2fe-fcf8-40cc-8381-bc0e2b9b842e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:45.660759 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-928af2fe-fcf8-40cc-8381-bc0e2b9b842e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:45.661699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-928af2fe-fcf8-40cc-8381-bc0e2b9b842e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:45.662184 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-928af2fe-fcf8-40cc-8381-bc0e2b9b842e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:45.769078 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-928af2fe-fcf8-40cc-8381-bc0e2b9b842e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] HTTP exception thrown: Instance 70b94746-45d7-477d-b177-16d88344076a is not attached to volume 8fade538-688b-4769-888f-39313ca8ad27 Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-928af2fe-fcf8-40cc-8381-bc0e2b9b842e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Request method failure captured: Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: request: DELETE /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a/os-volume_attachments/8fade538-688b-4769-888f-39313ca8ad27 HTTP/1.1 Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rcFXhlUHrUZWzsT9nJIIC6eH6GKAge8Y9VCotIrPdsEytMZd1lNLymOMfYZCTP7LUUK5n8TpbjUa7_ar-23mLhf-aOASPe8PAc4l0P0bS8pmchpcIPUaG2ChzAJLW1KhJYdMA90L9fj2ejSi9o160JcQPDcAwp010TplyGSdklug-o Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: a4075ffb266f4b3eb54f948d22370f57 Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-TestMinimumBasicScenario-1745139868 Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a4075ffb266f4b3eb54f948d22370f57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a4075ffb266f4b3eb54f948d22370f57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a4075ffb266f4b3eb54f948d22370f57", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a4075ffb266f4b3eb54f948d22370f57"}]}] Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-TestMinimumBasicScenario-1745139868 Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: a4075ffb266f4b3eb54f948d22370f57 Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1745139868 Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-TestMinimumBasicScenario-1745139868-project Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 6cf843e3e35e4cb8bff95aca236051fc Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-TestMinimumBasicScenario-1745139868-project Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 70b94746-45d7-477d-b177-16d88344076a is not attached to volume 8fade538-688b-4769-888f-39313ca8ad27 Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'server_id': '70b94746-45d7-477d-b177-16d88344076a', 'id': '8fade538-688b-4769-888f-39313ca8ad27'} Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8fade538-688b-4769-888f-39313ca8ad27. Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70b94746-45d7-477d-b177-16d88344076a is not attached to volume 8fade538-688b-4769-888f-39313ca8ad27 Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:37:45.772550 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:37:45.778473 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:37:45.778473 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:37:45.778473 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70b94746-45d7-477d-b177-16d88344076a is not attached to volume 8fade538-688b-4769-888f-39313ca8ad27 Jul 25 15:37:45.778473 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:37:45.778473 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-928af2fe-fcf8-40cc-8381-bc0e2b9b842e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Returning 404 to user: Instance 70b94746-45d7-477d-b177-16d88344076a is not attached to volume 8fade538-688b-4769-888f-39313ca8ad27 {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:37:45.778473 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-928af2fe-fcf8-40cc-8381-bc0e2b9b842e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "DELETE /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a/os-volume_attachments/8fade538-688b-4769-888f-39313ca8ad27" status: 404 len: 154 microversion: 2.1 time: 0.129148 Jul 25 15:37:45.778473 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3635/7496] 10.222.0.88 () {58 vars in 1416 bytes} [Mon Jul 25 15:37:45 2022] DELETE /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a/os-volume_attachments/8fade538-688b-4769-888f-39313ca8ad27 => generated 154 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:37:50.264019 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7aef0dfd-3172-4991-b48d-3bb272f77eb5 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:37:50.264988 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7aef0dfd-3172-4991-b48d-3bb272f77eb5 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:37:50.277964 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7aef0dfd-3172-4991-b48d-3bb272f77eb5 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:50.278972 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7aef0dfd-3172-4991-b48d-3bb272f77eb5 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:50.280252 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7aef0dfd-3172-4991-b48d-3bb272f77eb5 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:50.281107 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7aef0dfd-3172-4991-b48d-3bb272f77eb5 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:50.322906 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7aef0dfd-3172-4991-b48d-3bb272f77eb5 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:37:50.430774 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7aef0dfd-3172-4991-b48d-3bb272f77eb5 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "DELETE /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 204 len: 0 microversion: 2.1 time: 0.173663 Jul 25 15:37:50.433259 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3862/7497] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:37:50 2022] DELETE /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:37:50.445187 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d333dfce-a18d-4eda-8b8c-0230c84504ad tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:37:50.446326 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d333dfce-a18d-4eda-8b8c-0230c84504ad tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:37:50.459023 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d333dfce-a18d-4eda-8b8c-0230c84504ad tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:50.459627 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d333dfce-a18d-4eda-8b8c-0230c84504ad tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:50.460794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d333dfce-a18d-4eda-8b8c-0230c84504ad tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:50.461325 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d333dfce-a18d-4eda-8b8c-0230c84504ad tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:50.674691 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d333dfce-a18d-4eda-8b8c-0230c84504ad tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:37:50.684155 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d333dfce-a18d-4eda-8b8c-0230c84504ad tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1555 microversion: 2.1 time: 0.245896 Jul 25 15:37:50.684738 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3636/7498] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:37:50 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1555 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:37:51.709584 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0dd2d30e-b148-4161-8185-24165c9c3357 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:37:51.710654 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0dd2d30e-b148-4161-8185-24165c9c3357 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:37:51.720030 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0dd2d30e-b148-4161-8185-24165c9c3357 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:51.720495 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0dd2d30e-b148-4161-8185-24165c9c3357 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:51.721287 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0dd2d30e-b148-4161-8185-24165c9c3357 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:51.721793 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0dd2d30e-b148-4161-8185-24165c9c3357 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:51.909082 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0dd2d30e-b148-4161-8185-24165c9c3357 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:37:51.922116 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0dd2d30e-b148-4161-8185-24165c9c3357 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1555 microversion: 2.1 time: 0.218339 Jul 25 15:37:51.923211 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3863/7499] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:37:51 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1555 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:37:52.964276 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-500b0a0d-48e0-4eec-9970-7039ba7ccd8e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:37:52.966073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-500b0a0d-48e0-4eec-9970-7039ba7ccd8e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:37:52.977971 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-500b0a0d-48e0-4eec-9970-7039ba7ccd8e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:52.978796 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-500b0a0d-48e0-4eec-9970-7039ba7ccd8e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:52.980794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-500b0a0d-48e0-4eec-9970-7039ba7ccd8e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:52.981359 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-500b0a0d-48e0-4eec-9970-7039ba7ccd8e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:53.111520 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-500b0a0d-48e0-4eec-9970-7039ba7ccd8e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf843e3e35e4cb8bff95aca236051fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4075ffb266f4b3eb54f948d22370f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:37:53.127508 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-500b0a0d-48e0-4eec-9970-7039ba7ccd8e tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 200 len: 1513 microversion: 2.1 time: 0.170629 Jul 25 15:37:53.128411 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3637/7500] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:37:52 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:37:53.328707 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-158c1232-0c89-4fce-9d4a-8a848ee4e78c req-948c6bcf-7e77-4cc5-84a7-ac7982d1fc9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70b94746-45d7-477d-b177-16d88344076a", "name": "network-vif-deleted", "tag": "cb0dc228-2c2e-4a45-a917-2edc978dc2ae"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:37:53.350946 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-158c1232-0c89-4fce-9d4a-8a848ee4e78c req-948c6bcf-7e77-4cc5-84a7-ac7982d1fc9b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:53.351733 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-158c1232-0c89-4fce-9d4a-8a848ee4e78c req-948c6bcf-7e77-4cc5-84a7-ac7982d1fc9b service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:53.374106 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-158c1232-0c89-4fce-9d4a-8a848ee4e78c req-948c6bcf-7e77-4cc5-84a7-ac7982d1fc9b service nova] Creating event network-vif-deleted:cb0dc228-2c2e-4a45-a917-2edc978dc2ae for instance 70b94746-45d7-477d-b177-16d88344076a on n-h2-846435-14 Jul 25 15:37:53.383489 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-158c1232-0c89-4fce-9d4a-8a848ee4e78c req-948c6bcf-7e77-4cc5-84a7-ac7982d1fc9b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219513 Jul 25 15:37:53.384614 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3864/7501] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:37:54.155027 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a1de4abf-0a34-4127-8984-eebb4f5bf5e3 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:37:54.156169 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a1de4abf-0a34-4127-8984-eebb4f5bf5e3 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] [instance: 70b94746-45d7-477d-b177-16d88344076a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:37:54.169449 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a1de4abf-0a34-4127-8984-eebb4f5bf5e3 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:54.170260 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a1de4abf-0a34-4127-8984-eebb4f5bf5e3 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:54.171711 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a1de4abf-0a34-4127-8984-eebb4f5bf5e3 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:37:54.172551 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a1de4abf-0a34-4127-8984-eebb4f5bf5e3 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:37:54.198650 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-a1de4abf-0a34-4127-8984-eebb4f5bf5e3 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] HTTP exception thrown: Instance 70b94746-45d7-477d-b177-16d88344076a could not be found. Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a1de4abf-0a34-4127-8984-eebb4f5bf5e3 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Request method failure captured: Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a HTTP/1.1 Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rcFXhlUHrUZWzsT9nJIIC6eH6GKAge8Y9VCotIrPdsEytMZd1lNLymOMfYZCTP7LUUK5n8TpbjUa7_ar-23mLhf-aOASPe8PAc4l0P0bS8pmchpcIPUaG2ChzAJLW1KhJYdMA90L9fj2ejSi9o160JcQPDcAwp010TplyGSdklug-o Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: a4075ffb266f4b3eb54f948d22370f57 Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-TestMinimumBasicScenario-1745139868 Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a4075ffb266f4b3eb54f948d22370f57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a4075ffb266f4b3eb54f948d22370f57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a4075ffb266f4b3eb54f948d22370f57", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a4075ffb266f4b3eb54f948d22370f57"}]}] Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-TestMinimumBasicScenario-1745139868 Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: a4075ffb266f4b3eb54f948d22370f57 Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1745139868 Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-TestMinimumBasicScenario-1745139868-project Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 6cf843e3e35e4cb8bff95aca236051fc Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-TestMinimumBasicScenario-1745139868-project Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 70b94746-45d7-477d-b177-16d88344076a could not be found. Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '70b94746-45d7-477d-b177-16d88344076a'} Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70b94746-45d7-477d-b177-16d88344076a could not be found. Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70b94746-45d7-477d-b177-16d88344076a could not be found. Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:37:54.201126 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:37:54.208649 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:37:54.208649 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:37:54.208649 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:37:54.208649 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:37:54.208649 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:37:54.208649 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70b94746-45d7-477d-b177-16d88344076a could not be found. Jul 25 15:37:54.208649 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:37:54.208649 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a1de4abf-0a34-4127-8984-eebb4f5bf5e3 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Returning 404 to user: Instance 70b94746-45d7-477d-b177-16d88344076a could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:37:54.208649 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a1de4abf-0a34-4127-8984-eebb4f5bf5e3 tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a" status: 404 len: 111 microversion: 2.1 time: 0.056111 Jul 25 15:37:54.208649 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3638/7502] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:37:54 2022] GET /compute/v2.1/servers/70b94746-45d7-477d-b177-16d88344076a => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:37:54.222326 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-812c092b-995b-40ae-8bbc-e237609c2ccd tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] Calling method '.version_select at 0x7f468461e430>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:37:54.260615 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-812c092b-995b-40ae-8bbc-e237609c2ccd tempest-TestMinimumBasicScenario-1745139868 tempest-TestMinimumBasicScenario-1745139868-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1442473389" status: 202 len: 0 microversion: 2.1 time: 0.048148 Jul 25 15:37:54.261593 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3865/7503] 10.222.0.88 () {58 vars in 1272 bytes} [Mon Jul 25 15:37:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1442473389 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:38:07.257371 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=18 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:38:07.258579 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:38:07.478218 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-190f0897-40a9-4170-b5db-89bc47fffb36 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Action: 'create', calling method: .version_select at 0x7f46864ff700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1829395915", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAAlcYIQ6G66meYzHPn5dYxE5lqY8xsjZNtBEdADjxzuD9WrliNiFZU5AfW/B1ctHKTF1UxH5q5H+afDR109pfoOp0Gi3qGAnVb+Zd2mp7MZNGsbv0MnXpV9+EpujAaZpg=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:38:07.498075 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-190f0897-40a9-4170-b5db-89bc47fffb36 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Getting quotas for project a16a1323e1ae4f7d9b178c43cb15f169. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:38:07.505495 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-190f0897-40a9-4170-b5db-89bc47fffb36 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Getting quotas for user 5063de8e476b4378b1d7bdbfb8526b1c and project a16a1323e1ae4f7d9b178c43cb15f169. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:38:07.539215 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-190f0897-40a9-4170-b5db-89bc47fffb36 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.292344 Jul 25 15:38:07.539853 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3639/7504] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 15:38:07 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:38:17.831066 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:38:17.833149 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:38:17.843669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3e6ce204-4412-4e71-ac6c-71253a9c0412 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-238426848", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "721787f5-14e1-4427-acd1-cf843d345986"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1829395915", "security_groups": [{"name": "tempest-secgroup-smoke-281071823"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:38:18.015663 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-3e6ce204-4412-4e71-ac6c-71253a9c0412 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] validate_networks() for [('721787f5-14e1-4427-acd1-cf843d345986', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:38:18.667669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-3e6ce204-4412-4e71-ac6c-71253a9c0412 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:38:18.668408 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-3e6ce204-4412-4e71-ac6c-71253a9c0412 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:38:18.669062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-3e6ce204-4412-4e71-ac6c-71253a9c0412 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:38:18.669664 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-3e6ce204-4412-4e71-ac6c-71253a9c0412 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:38:18.670217 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-3e6ce204-4412-4e71-ac6c-71253a9c0412 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:38:18.683092 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e6ce204-4412-4e71-ac6c-71253a9c0412 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:18.683662 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e6ce204-4412-4e71-ac6c-71253a9c0412 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:18.684692 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e6ce204-4412-4e71-ac6c-71253a9c0412 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:18.685271 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3e6ce204-4412-4e71-ac6c-71253a9c0412 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:18.713098 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-3e6ce204-4412-4e71-ac6c-71253a9c0412 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Getting quotas for project a16a1323e1ae4f7d9b178c43cb15f169. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:38:18.725020 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-3e6ce204-4412-4e71-ac6c-71253a9c0412 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Getting quotas for user 5063de8e476b4378b1d7bdbfb8526b1c and project a16a1323e1ae4f7d9b178c43cb15f169. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:38:18.753149 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3e6ce204-4412-4e71-ac6c-71253a9c0412 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:38:18.758206 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3e6ce204-4412-4e71-ac6c-71253a9c0412 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: e5c8f01b-f29b-48fe-9862-71b7f19d300c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:38:18.841504 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3e6ce204-4412-4e71-ac6c-71253a9c0412 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.013357 Jul 25 15:38:18.842599 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3866/7505] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:38:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:38:18.858297 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:38:18.861416 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:38:18.870738 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d96d6bd8-f58d-49a7-b4c0-88ba7be54250 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:38:18.871753 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d96d6bd8-f58d-49a7-b4c0-88ba7be54250 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: e5c8f01b-f29b-48fe-9862-71b7f19d300c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:38:19.007787 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d96d6bd8-f58d-49a7-b4c0-88ba7be54250 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:38:19.018395 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d96d6bd8-f58d-49a7-b4c0-88ba7be54250 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c" status: 200 len: 1266 microversion: 2.1 time: 0.163653 Jul 25 15:38:19.019008 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3640/7506] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:38:18 2022] GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:38:20.066061 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ca6a1aa8-c746-4166-ab26-6e93bdfa3859 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:38:20.068216 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ca6a1aa8-c746-4166-ab26-6e93bdfa3859 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: e5c8f01b-f29b-48fe-9862-71b7f19d300c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:38:20.086070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ca6a1aa8-c746-4166-ab26-6e93bdfa3859 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:20.087034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ca6a1aa8-c746-4166-ab26-6e93bdfa3859 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:20.088929 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ca6a1aa8-c746-4166-ab26-6e93bdfa3859 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:20.089841 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ca6a1aa8-c746-4166-ab26-6e93bdfa3859 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:20.274021 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ca6a1aa8-c746-4166-ab26-6e93bdfa3859 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:38:20.305181 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ca6a1aa8-c746-4166-ab26-6e93bdfa3859 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c" status: 200 len: 1262 microversion: 2.1 time: 0.250088 Jul 25 15:38:20.306131 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3867/7507] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:38:20 2022] GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c => generated 1262 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:38:21.336769 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d78a1986-3686-4f25-b57a-b45f2c855839 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:38:21.340537 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d78a1986-3686-4f25-b57a-b45f2c855839 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: e5c8f01b-f29b-48fe-9862-71b7f19d300c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:38:21.353201 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d78a1986-3686-4f25-b57a-b45f2c855839 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:21.354517 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d78a1986-3686-4f25-b57a-b45f2c855839 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:21.356726 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d78a1986-3686-4f25-b57a-b45f2c855839 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:21.357825 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d78a1986-3686-4f25-b57a-b45f2c855839 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:21.503788 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d78a1986-3686-4f25-b57a-b45f2c855839 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:38:21.519621 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d78a1986-3686-4f25-b57a-b45f2c855839 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c" status: 200 len: 1324 microversion: 2.1 time: 0.192991 Jul 25 15:38:21.521286 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3641/7508] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:38:21 2022] GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c => generated 1324 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:38:22.555045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-625185a3-03c1-4ee0-bde4-988f8abbffe4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:38:22.556075 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-625185a3-03c1-4ee0-bde4-988f8abbffe4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: e5c8f01b-f29b-48fe-9862-71b7f19d300c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:38:22.564066 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-625185a3-03c1-4ee0-bde4-988f8abbffe4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:22.564553 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-625185a3-03c1-4ee0-bde4-988f8abbffe4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:22.565327 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-625185a3-03c1-4ee0-bde4-988f8abbffe4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:22.565791 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-625185a3-03c1-4ee0-bde4-988f8abbffe4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:22.795267 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-625185a3-03c1-4ee0-bde4-988f8abbffe4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:38:22.810013 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-625185a3-03c1-4ee0-bde4-988f8abbffe4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c" status: 200 len: 1391 microversion: 2.1 time: 0.258813 Jul 25 15:38:22.824096 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3868/7509] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:38:22 2022] GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c => generated 1391 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:38:23.279789 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-02b64dda-a554-4a2a-90c4-79687b45607f req-fd306d2d-f6e3-4b05-9dfe-66ed77068702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5c8f01b-f29b-48fe-9862-71b7f19d300c", "tag": "3eb472d1-4ba8-44cf-ae4d-eba2363e9fda"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:38:23.303791 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-02b64dda-a554-4a2a-90c4-79687b45607f req-fd306d2d-f6e3-4b05-9dfe-66ed77068702 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:23.304774 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-02b64dda-a554-4a2a-90c4-79687b45607f req-fd306d2d-f6e3-4b05-9dfe-66ed77068702 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:23.329959 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-02b64dda-a554-4a2a-90c4-79687b45607f req-fd306d2d-f6e3-4b05-9dfe-66ed77068702 service nova] Creating event network-changed:3eb472d1-4ba8-44cf-ae4d-eba2363e9fda for instance e5c8f01b-f29b-48fe-9862-71b7f19d300c on n-h1-846435-14 Jul 25 15:38:23.337466 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-02b64dda-a554-4a2a-90c4-79687b45607f req-fd306d2d-f6e3-4b05-9dfe-66ed77068702 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066773 Jul 25 15:38:23.338812 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3642/7510] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:38:23.848328 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fc937333-4655-4415-990c-a038f51362f3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:38:23.849747 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fc937333-4655-4415-990c-a038f51362f3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: e5c8f01b-f29b-48fe-9862-71b7f19d300c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:38:23.858932 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fc937333-4655-4415-990c-a038f51362f3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:23.859404 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fc937333-4655-4415-990c-a038f51362f3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:23.860326 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fc937333-4655-4415-990c-a038f51362f3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:23.860785 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fc937333-4655-4415-990c-a038f51362f3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:24.053144 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fc937333-4655-4415-990c-a038f51362f3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:38:24.066871 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fc937333-4655-4415-990c-a038f51362f3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c" status: 200 len: 1391 microversion: 2.1 time: 0.222233 Jul 25 15:38:24.067895 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3869/7511] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:38:23 2022] GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c => generated 1391 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:38:25.090576 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-adcf1c31-a2af-41c4-b4b7-05dcf3d46896 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:38:25.091868 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-adcf1c31-a2af-41c4-b4b7-05dcf3d46896 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: e5c8f01b-f29b-48fe-9862-71b7f19d300c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:38:25.099756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-adcf1c31-a2af-41c4-b4b7-05dcf3d46896 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:25.100308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-adcf1c31-a2af-41c4-b4b7-05dcf3d46896 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:25.101170 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-adcf1c31-a2af-41c4-b4b7-05dcf3d46896 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:25.101982 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-adcf1c31-a2af-41c4-b4b7-05dcf3d46896 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:25.281190 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-adcf1c31-a2af-41c4-b4b7-05dcf3d46896 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:38:25.292630 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-adcf1c31-a2af-41c4-b4b7-05dcf3d46896 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c" status: 200 len: 1391 microversion: 2.1 time: 0.206581 Jul 25 15:38:25.293766 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3643/7512] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:38:25 2022] GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c => generated 1391 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:38:26.322267 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6ddf0998-2a3b-4562-88a3-39b5072d55de tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:38:26.323653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6ddf0998-2a3b-4562-88a3-39b5072d55de tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: e5c8f01b-f29b-48fe-9862-71b7f19d300c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:38:26.334348 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6ddf0998-2a3b-4562-88a3-39b5072d55de tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:26.335120 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6ddf0998-2a3b-4562-88a3-39b5072d55de tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:26.336571 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6ddf0998-2a3b-4562-88a3-39b5072d55de tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:26.337528 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6ddf0998-2a3b-4562-88a3-39b5072d55de tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:26.542483 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6ddf0998-2a3b-4562-88a3-39b5072d55de tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:38:26.551905 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6ddf0998-2a3b-4562-88a3-39b5072d55de tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c" status: 200 len: 1391 microversion: 2.1 time: 0.235931 Jul 25 15:38:26.552704 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3870/7513] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:38:26 2022] GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c => generated 1391 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:38:27.575000 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0d0ccd1b-3262-4575-9750-41b6b9288f75 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:38:27.575631 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0d0ccd1b-3262-4575-9750-41b6b9288f75 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: e5c8f01b-f29b-48fe-9862-71b7f19d300c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:38:27.584387 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0d0ccd1b-3262-4575-9750-41b6b9288f75 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:27.584924 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0d0ccd1b-3262-4575-9750-41b6b9288f75 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:27.585928 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0d0ccd1b-3262-4575-9750-41b6b9288f75 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:27.586568 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0d0ccd1b-3262-4575-9750-41b6b9288f75 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:27.785884 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0d0ccd1b-3262-4575-9750-41b6b9288f75 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:38:27.797642 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0d0ccd1b-3262-4575-9750-41b6b9288f75 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c" status: 200 len: 1391 microversion: 2.1 time: 0.227147 Jul 25 15:38:27.798420 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3644/7514] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:38:27 2022] GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c => generated 1391 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:38:28.827675 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5af56412-19a3-4acd-8dff-1065c3c6d439 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:38:28.829006 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5af56412-19a3-4acd-8dff-1065c3c6d439 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: e5c8f01b-f29b-48fe-9862-71b7f19d300c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:38:28.835473 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:38:28.836904 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:38:28.845657 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5af56412-19a3-4acd-8dff-1065c3c6d439 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:28.846454 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5af56412-19a3-4acd-8dff-1065c3c6d439 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:28.847798 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5af56412-19a3-4acd-8dff-1065c3c6d439 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:28.848832 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5af56412-19a3-4acd-8dff-1065c3c6d439 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:29.115841 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5af56412-19a3-4acd-8dff-1065c3c6d439 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:38:29.131584 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5af56412-19a3-4acd-8dff-1065c3c6d439 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c" status: 200 len: 1391 microversion: 2.1 time: 0.310837 Jul 25 15:38:29.132679 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3871/7515] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:38:28 2022] GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c => generated 1391 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:38:30.130999 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:38:30.174398 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5b9159c6-f567-40b9-8afc-cf42e0505ede tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:38:30.176811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5b9159c6-f567-40b9-8afc-cf42e0505ede tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: e5c8f01b-f29b-48fe-9862-71b7f19d300c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:38:30.191750 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b9159c6-f567-40b9-8afc-cf42e0505ede tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:30.192889 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b9159c6-f567-40b9-8afc-cf42e0505ede tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:30.194698 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b9159c6-f567-40b9-8afc-cf42e0505ede tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:30.195836 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5b9159c6-f567-40b9-8afc-cf42e0505ede tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:30.231619 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-ec164385-f5b2-4c56-bf7a-030d9d5faa5f req-e55df5a7-42c5-48b7-8f43-4c8911f13f2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5c8f01b-f29b-48fe-9862-71b7f19d300c", "name": "network-vif-plugged", "status": "completed", "tag": "3eb472d1-4ba8-44cf-ae4d-eba2363e9fda"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:38:30.249662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ec164385-f5b2-4c56-bf7a-030d9d5faa5f req-e55df5a7-42c5-48b7-8f43-4c8911f13f2f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:30.250494 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ec164385-f5b2-4c56-bf7a-030d9d5faa5f req-e55df5a7-42c5-48b7-8f43-4c8911f13f2f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:30.272812 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-ec164385-f5b2-4c56-bf7a-030d9d5faa5f req-e55df5a7-42c5-48b7-8f43-4c8911f13f2f service nova] Creating event network-vif-plugged:3eb472d1-4ba8-44cf-ae4d-eba2363e9fda for instance e5c8f01b-f29b-48fe-9862-71b7f19d300c on n-h1-846435-14 Jul 25 15:38:30.282742 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-ec164385-f5b2-4c56-bf7a-030d9d5faa5f req-e55df5a7-42c5-48b7-8f43-4c8911f13f2f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159137 Jul 25 15:38:30.284786 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3645/7516] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:38:30.402432 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5b9159c6-f567-40b9-8afc-cf42e0505ede tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:38:30.412106 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5b9159c6-f567-40b9-8afc-cf42e0505ede tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c" status: 200 len: 1391 microversion: 2.1 time: 0.247512 Jul 25 15:38:30.412749 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3872/7517] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:38:30 2022] GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c => generated 1391 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:38:31.437235 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-64aa626a-51e6-4a04-9d76-17d5c2726867 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:38:31.438005 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-64aa626a-51e6-4a04-9d76-17d5c2726867 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: e5c8f01b-f29b-48fe-9862-71b7f19d300c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:38:31.445398 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-64aa626a-51e6-4a04-9d76-17d5c2726867 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:31.445870 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-64aa626a-51e6-4a04-9d76-17d5c2726867 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:31.447141 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-64aa626a-51e6-4a04-9d76-17d5c2726867 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:31.447340 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-64aa626a-51e6-4a04-9d76-17d5c2726867 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:31.632119 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-64aa626a-51e6-4a04-9d76-17d5c2726867 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:38:31.646276 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-64aa626a-51e6-4a04-9d76-17d5c2726867 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c" status: 200 len: 1391 microversion: 2.1 time: 0.214626 Jul 25 15:38:31.647321 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3646/7518] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:38:31 2022] GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c => generated 1391 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:38:32.672733 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-279c8b2c-a418-408d-b4ed-b4ac5b153f02 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:38:32.674959 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-279c8b2c-a418-408d-b4ed-b4ac5b153f02 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: e5c8f01b-f29b-48fe-9862-71b7f19d300c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:38:32.688921 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-279c8b2c-a418-408d-b4ed-b4ac5b153f02 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:32.689387 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-279c8b2c-a418-408d-b4ed-b4ac5b153f02 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:32.690182 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-279c8b2c-a418-408d-b4ed-b4ac5b153f02 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:32.690638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-279c8b2c-a418-408d-b4ed-b4ac5b153f02 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:32.901508 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-279c8b2c-a418-408d-b4ed-b4ac5b153f02 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:38:32.911059 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-279c8b2c-a418-408d-b4ed-b4ac5b153f02 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c" status: 200 len: 1564 microversion: 2.1 time: 0.245559 Jul 25 15:38:32.916089 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3873/7519] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:38:32 2022] GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c => generated 1564 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:38:32.937852 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3cc64af0-da35-44d2-90e6-2571cdcd0072 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:38:32.939046 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3cc64af0-da35-44d2-90e6-2571cdcd0072 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: e5c8f01b-f29b-48fe-9862-71b7f19d300c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:38:32.951590 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3cc64af0-da35-44d2-90e6-2571cdcd0072 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:32.952529 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3cc64af0-da35-44d2-90e6-2571cdcd0072 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:32.954014 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3cc64af0-da35-44d2-90e6-2571cdcd0072 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:32.954815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3cc64af0-da35-44d2-90e6-2571cdcd0072 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:33.189070 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3cc64af0-da35-44d2-90e6-2571cdcd0072 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:38:33.199508 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3cc64af0-da35-44d2-90e6-2571cdcd0072 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c" status: 200 len: 1564 microversion: 2.1 time: 0.268996 Jul 25 15:38:33.200550 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3647/7520] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:38:32 2022] GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c => generated 1564 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:38:35.562373 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e2a03f74-bc31-40ce-ab81-be4ea18b12ca tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:38:35.563759 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e2a03f74-bc31-40ce-ab81-be4ea18b12ca tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: e5c8f01b-f29b-48fe-9862-71b7f19d300c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:38:35.567109 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-ba95f766-2b06-4b67-8372-9ad763d720bf req-52ea88c8-9832-4a2b-bb69-235c804bc891 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5c8f01b-f29b-48fe-9862-71b7f19d300c", "tag": "3eb472d1-4ba8-44cf-ae4d-eba2363e9fda"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:38:35.576288 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2a03f74-bc31-40ce-ab81-be4ea18b12ca tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:35.577307 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2a03f74-bc31-40ce-ab81-be4ea18b12ca tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:35.578934 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2a03f74-bc31-40ce-ab81-be4ea18b12ca tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:35.579872 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e2a03f74-bc31-40ce-ab81-be4ea18b12ca tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:35.600760 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ba95f766-2b06-4b67-8372-9ad763d720bf req-52ea88c8-9832-4a2b-bb69-235c804bc891 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:35.601841 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ba95f766-2b06-4b67-8372-9ad763d720bf req-52ea88c8-9832-4a2b-bb69-235c804bc891 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:35.624050 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-ba95f766-2b06-4b67-8372-9ad763d720bf req-52ea88c8-9832-4a2b-bb69-235c804bc891 service nova] Creating event network-changed:3eb472d1-4ba8-44cf-ae4d-eba2363e9fda for instance e5c8f01b-f29b-48fe-9862-71b7f19d300c on n-h1-846435-14 Jul 25 15:38:35.631201 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-ba95f766-2b06-4b67-8372-9ad763d720bf req-52ea88c8-9832-4a2b-bb69-235c804bc891 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072387 Jul 25 15:38:35.633797 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3648/7521] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:38:35.821131 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e2a03f74-bc31-40ce-ab81-be4ea18b12ca tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:38:35.835735 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e2a03f74-bc31-40ce-ab81-be4ea18b12ca tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c" status: 200 len: 1564 microversion: 2.1 time: 0.280822 Jul 25 15:38:35.836949 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3874/7522] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:38:35 2022] GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c => generated 1564 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:38:51.292943 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 15:38:51.293842 n-d-846435-14 devstack@n-api.service[119303]: Mon Jul 25 15:38:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 15:38:58.317194 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=20 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:38:58.318394 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=36 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:38:58.323767 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-487ff17a-33e8-46df-bb37-7e0ecd7c9eb2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:38:58.326680 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-487ff17a-33e8-46df-bb37-7e0ecd7c9eb2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: e5c8f01b-f29b-48fe-9862-71b7f19d300c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:38:58.336234 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-487ff17a-33e8-46df-bb37-7e0ecd7c9eb2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:58.337076 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-487ff17a-33e8-46df-bb37-7e0ecd7c9eb2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:58.338569 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-487ff17a-33e8-46df-bb37-7e0ecd7c9eb2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:38:58.339178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-487ff17a-33e8-46df-bb37-7e0ecd7c9eb2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:38:58.408764 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-487ff17a-33e8-46df-bb37-7e0ecd7c9eb2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "POST /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c/action" status: 200 len: 24569 microversion: 2.1 time: 0.093511 Jul 25 15:38:58.409931 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3649/7523] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:38:58 2022] POST /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c/action => generated 24569 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 15:39:09.263705 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-72f7353c-09aa-4174-b62c-7e711ef28427 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:39:09.264590 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-72f7353c-09aa-4174-b62c-7e711ef28427 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: e5c8f01b-f29b-48fe-9862-71b7f19d300c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:39:09.268811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:39:09.270070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=50 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:39:09.281603 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72f7353c-09aa-4174-b62c-7e711ef28427 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:09.282409 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72f7353c-09aa-4174-b62c-7e711ef28427 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:09.283853 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72f7353c-09aa-4174-b62c-7e711ef28427 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:09.284784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-72f7353c-09aa-4174-b62c-7e711ef28427 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:09.414943 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-72f7353c-09aa-4174-b62c-7e711ef28427 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "POST /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c/action" status: 202 len: 0 microversion: 2.1 time: 0.158598 Jul 25 15:39:09.416066 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3875/7524] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:39:09 2022] POST /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:39:09.428122 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-120a68ae-8572-49e4-9805-53d7104c6b76 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:39:09.429397 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-120a68ae-8572-49e4-9805-53d7104c6b76 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: e5c8f01b-f29b-48fe-9862-71b7f19d300c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:39:09.444060 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:39:09.444060 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:39:09.448228 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-120a68ae-8572-49e4-9805-53d7104c6b76 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:09.449238 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-120a68ae-8572-49e4-9805-53d7104c6b76 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:09.450987 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-120a68ae-8572-49e4-9805-53d7104c6b76 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:09.451804 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-120a68ae-8572-49e4-9805-53d7104c6b76 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:09.662460 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-120a68ae-8572-49e4-9805-53d7104c6b76 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:39:09.677623 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-120a68ae-8572-49e4-9805-53d7104c6b76 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c" status: 200 len: 1688 microversion: 2.1 time: 0.255377 Jul 25 15:39:09.678990 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3650/7525] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:39:09 2022] GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c => generated 1688 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:39:10.719670 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-97935ecf-bf9e-4ee4-918a-e27686870c5d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:39:10.720755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-97935ecf-bf9e-4ee4-918a-e27686870c5d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: e5c8f01b-f29b-48fe-9862-71b7f19d300c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:39:10.729086 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-97935ecf-bf9e-4ee4-918a-e27686870c5d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:10.729754 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-97935ecf-bf9e-4ee4-918a-e27686870c5d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:10.731321 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-97935ecf-bf9e-4ee4-918a-e27686870c5d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:10.732020 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-97935ecf-bf9e-4ee4-918a-e27686870c5d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:10.930403 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-97935ecf-bf9e-4ee4-918a-e27686870c5d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:39:10.939258 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-97935ecf-bf9e-4ee4-918a-e27686870c5d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c" status: 200 len: 1668 microversion: 2.1 time: 0.228612 Jul 25 15:39:10.939873 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3876/7526] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:39:10 2022] GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c => generated 1668 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:39:12.067282 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-461dc174-ddff-4a47-b5f3-26632d75d949 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:39:12.069997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-461dc174-ddff-4a47-b5f3-26632d75d949 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: e5c8f01b-f29b-48fe-9862-71b7f19d300c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:39:12.082458 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-461dc174-ddff-4a47-b5f3-26632d75d949 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:12.082911 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-461dc174-ddff-4a47-b5f3-26632d75d949 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:12.083738 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-461dc174-ddff-4a47-b5f3-26632d75d949 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:12.084699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-461dc174-ddff-4a47-b5f3-26632d75d949 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:12.147373 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-461dc174-ddff-4a47-b5f3-26632d75d949 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "POST /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c/action" status: 200 len: 32644 microversion: 2.1 time: 0.083972 Jul 25 15:39:12.148284 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3651/7527] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:39:12 2022] POST /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c/action => generated 32644 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 15:39:12.163238 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cb7ba947-f900-4f84-b158-a63295251ce5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:39:12.164204 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cb7ba947-f900-4f84-b158-a63295251ce5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: e5c8f01b-f29b-48fe-9862-71b7f19d300c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:39:12.172895 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb7ba947-f900-4f84-b158-a63295251ce5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:12.173423 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb7ba947-f900-4f84-b158-a63295251ce5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:12.174377 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb7ba947-f900-4f84-b158-a63295251ce5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:12.174866 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb7ba947-f900-4f84-b158-a63295251ce5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:12.273880 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cb7ba947-f900-4f84-b158-a63295251ce5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "POST /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c/action" status: 202 len: 0 microversion: 2.1 time: 0.116209 Jul 25 15:39:12.274757 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3877/7528] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:39:12 2022] POST /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:39:12.286017 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3c880ba9-8138-434f-841c-8e19cbabb9df tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:39:12.287007 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3c880ba9-8138-434f-841c-8e19cbabb9df tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: e5c8f01b-f29b-48fe-9862-71b7f19d300c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:39:12.298073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c880ba9-8138-434f-841c-8e19cbabb9df tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:12.298896 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c880ba9-8138-434f-841c-8e19cbabb9df tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:12.301577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c880ba9-8138-434f-841c-8e19cbabb9df tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:12.301577 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3c880ba9-8138-434f-841c-8e19cbabb9df tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:12.518150 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3c880ba9-8138-434f-841c-8e19cbabb9df tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:39:12.527829 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3c880ba9-8138-434f-841c-8e19cbabb9df tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c" status: 200 len: 1675 microversion: 2.1 time: 0.247386 Jul 25 15:39:12.528490 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3652/7529] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:39:12 2022] GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c => generated 1675 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:39:13.554886 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d89fd22e-c8bf-4d05-8464-6f0cd2c9246e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:39:13.556014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d89fd22e-c8bf-4d05-8464-6f0cd2c9246e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: e5c8f01b-f29b-48fe-9862-71b7f19d300c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:39:13.564401 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d89fd22e-c8bf-4d05-8464-6f0cd2c9246e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:13.565046 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d89fd22e-c8bf-4d05-8464-6f0cd2c9246e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:13.565986 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d89fd22e-c8bf-4d05-8464-6f0cd2c9246e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:13.566539 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d89fd22e-c8bf-4d05-8464-6f0cd2c9246e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:13.744792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d89fd22e-c8bf-4d05-8464-6f0cd2c9246e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:39:13.755532 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d89fd22e-c8bf-4d05-8464-6f0cd2c9246e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c" status: 200 len: 1683 microversion: 2.1 time: 0.205559 Jul 25 15:39:13.756278 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3878/7530] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:39:13 2022] GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c => generated 1683 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:39:13.879036 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3ea3af96-7681-4032-8987-91fde6136dfb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:39:13.881611 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3ea3af96-7681-4032-8987-91fde6136dfb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: e5c8f01b-f29b-48fe-9862-71b7f19d300c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:39:13.891479 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3ea3af96-7681-4032-8987-91fde6136dfb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:13.892250 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3ea3af96-7681-4032-8987-91fde6136dfb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:13.893220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3ea3af96-7681-4032-8987-91fde6136dfb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:13.893786 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3ea3af96-7681-4032-8987-91fde6136dfb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:13.955720 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3ea3af96-7681-4032-8987-91fde6136dfb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "POST /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c/action" status: 200 len: 38464 microversion: 2.1 time: 0.080987 Jul 25 15:39:13.956829 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3653/7531] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:39:13 2022] POST /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c/action => generated 38464 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 15:39:15.659775 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0c0675ec-bd42-4c18-bff3-e00c5a105738 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:39:15.660457 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0c0675ec-bd42-4c18-bff3-e00c5a105738 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: e5c8f01b-f29b-48fe-9862-71b7f19d300c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:39:15.668326 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c0675ec-bd42-4c18-bff3-e00c5a105738 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:15.668816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c0675ec-bd42-4c18-bff3-e00c5a105738 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:15.669419 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-ae9ece5c-ffe7-4f07-9d7f-a7916d412a9f req-ac19ae2b-d607-4c25-8e39-829e48aa26e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5c8f01b-f29b-48fe-9862-71b7f19d300c", "tag": "3eb472d1-4ba8-44cf-ae4d-eba2363e9fda"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:39:15.669943 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c0675ec-bd42-4c18-bff3-e00c5a105738 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:15.670178 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0c0675ec-bd42-4c18-bff3-e00c5a105738 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:15.691313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ae9ece5c-ffe7-4f07-9d7f-a7916d412a9f req-ac19ae2b-d607-4c25-8e39-829e48aa26e1 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:15.692172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ae9ece5c-ffe7-4f07-9d7f-a7916d412a9f req-ac19ae2b-d607-4c25-8e39-829e48aa26e1 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:15.703854 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0c0675ec-bd42-4c18-bff3-e00c5a105738 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: e5c8f01b-f29b-48fe-9862-71b7f19d300c] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:39:15.724388 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-ae9ece5c-ffe7-4f07-9d7f-a7916d412a9f req-ac19ae2b-d607-4c25-8e39-829e48aa26e1 service nova] Creating event network-changed:3eb472d1-4ba8-44cf-ae4d-eba2363e9fda for instance e5c8f01b-f29b-48fe-9862-71b7f19d300c on n-h1-846435-14 Jul 25 15:39:15.730218 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-ae9ece5c-ffe7-4f07-9d7f-a7916d412a9f req-ac19ae2b-d607-4c25-8e39-829e48aa26e1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069298 Jul 25 15:39:15.731223 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3654/7532] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:39:15.840744 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0c0675ec-bd42-4c18-bff3-e00c5a105738 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "DELETE /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c" status: 204 len: 0 microversion: 2.1 time: 0.184651 Jul 25 15:39:15.842044 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3879/7533] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:39:15 2022] DELETE /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:39:15.857557 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b3eae84e-23d6-4c2b-b0ca-f6616c56a92a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:39:15.858382 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b3eae84e-23d6-4c2b-b0ca-f6616c56a92a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: e5c8f01b-f29b-48fe-9862-71b7f19d300c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:39:15.868480 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3eae84e-23d6-4c2b-b0ca-f6616c56a92a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:15.869080 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3eae84e-23d6-4c2b-b0ca-f6616c56a92a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:15.870054 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3eae84e-23d6-4c2b-b0ca-f6616c56a92a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:15.870617 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3eae84e-23d6-4c2b-b0ca-f6616c56a92a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:16.051731 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b3eae84e-23d6-4c2b-b0ca-f6616c56a92a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:39:16.061962 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b3eae84e-23d6-4c2b-b0ca-f6616c56a92a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c" status: 200 len: 1689 microversion: 2.1 time: 0.213505 Jul 25 15:39:16.062571 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3655/7534] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:39:15 2022] GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c => generated 1689 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:39:17.107554 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5ff93f3e-7b61-4035-bd4c-75fdf99974f4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:39:17.108978 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5ff93f3e-7b61-4035-bd4c-75fdf99974f4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: e5c8f01b-f29b-48fe-9862-71b7f19d300c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:39:17.122014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ff93f3e-7b61-4035-bd4c-75fdf99974f4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:17.122847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ff93f3e-7b61-4035-bd4c-75fdf99974f4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:17.124411 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ff93f3e-7b61-4035-bd4c-75fdf99974f4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:17.125250 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5ff93f3e-7b61-4035-bd4c-75fdf99974f4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:17.379640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5ff93f3e-7b61-4035-bd4c-75fdf99974f4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:39:17.391021 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5ff93f3e-7b61-4035-bd4c-75fdf99974f4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c" status: 200 len: 1689 microversion: 2.1 time: 0.291524 Jul 25 15:39:17.392330 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3880/7535] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:39:17 2022] GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c => generated 1689 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:39:18.318361 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-96413ae7-7071-44cf-a57a-299acc40f91b req-e9865bf2-704b-411e-bf17-f55600e04f60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5c8f01b-f29b-48fe-9862-71b7f19d300c", "name": "network-vif-deleted", "tag": "3eb472d1-4ba8-44cf-ae4d-eba2363e9fda"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:39:18.330918 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-96413ae7-7071-44cf-a57a-299acc40f91b req-e9865bf2-704b-411e-bf17-f55600e04f60 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:18.331485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-96413ae7-7071-44cf-a57a-299acc40f91b req-e9865bf2-704b-411e-bf17-f55600e04f60 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:18.346294 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-96413ae7-7071-44cf-a57a-299acc40f91b req-e9865bf2-704b-411e-bf17-f55600e04f60 service nova] Creating event network-vif-deleted:3eb472d1-4ba8-44cf-ae4d-eba2363e9fda for instance e5c8f01b-f29b-48fe-9862-71b7f19d300c on n-h1-846435-14 Jul 25 15:39:18.352679 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-96413ae7-7071-44cf-a57a-299acc40f91b req-e9865bf2-704b-411e-bf17-f55600e04f60 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038056 Jul 25 15:39:18.353340 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3656/7536] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:39:18.422713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-03d03cb1-060b-4bc8-9d74-fc6ab4c67b32 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:39:18.423956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-03d03cb1-060b-4bc8-9d74-fc6ab4c67b32 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: e5c8f01b-f29b-48fe-9862-71b7f19d300c] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:39:18.437422 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-03d03cb1-060b-4bc8-9d74-fc6ab4c67b32 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:18.438204 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-03d03cb1-060b-4bc8-9d74-fc6ab4c67b32 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:18.439062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-03d03cb1-060b-4bc8-9d74-fc6ab4c67b32 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:18.439494 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-03d03cb1-060b-4bc8-9d74-fc6ab4c67b32 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:18.494079 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-03d03cb1-060b-4bc8-9d74-fc6ab4c67b32 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:18.495341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-03d03cb1-060b-4bc8-9d74-fc6ab4c67b32 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:18.496143 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-03d03cb1-060b-4bc8-9d74-fc6ab4c67b32 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lazy-loading 'fault' on Instance uuid e5c8f01b-f29b-48fe-9862-71b7f19d300c {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:39:18.571189 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-03d03cb1-060b-4bc8-9d74-fc6ab4c67b32 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:39:18.584051 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-03d03cb1-060b-4bc8-9d74-fc6ab4c67b32 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c" status: 200 len: 1356 microversion: 2.1 time: 0.165468 Jul 25 15:39:18.584807 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3881/7537] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:39:18 2022] GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c => generated 1356 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:39:19.618750 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e3321039-677a-447e-b12a-5946dc389bdb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:39:19.619782 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e3321039-677a-447e-b12a-5946dc389bdb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: e5c8f01b-f29b-48fe-9862-71b7f19d300c] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:39:19.627589 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3321039-677a-447e-b12a-5946dc389bdb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:19.628119 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3321039-677a-447e-b12a-5946dc389bdb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:19.628948 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3321039-677a-447e-b12a-5946dc389bdb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:19.629392 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3321039-677a-447e-b12a-5946dc389bdb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:19.646155 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-e3321039-677a-447e-b12a-5946dc389bdb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] HTTP exception thrown: Instance e5c8f01b-f29b-48fe-9862-71b7f19d300c could not be found. Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e3321039-677a-447e-b12a-5946dc389bdb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Request method failure captured: Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c HTTP/1.1 Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rjesYZca3-zg5wdlKOEpTPhAkLj6IXHamAasfg58t3Ilpa049I9OXvWX-bAnAQJHJ7-EsS7XT_5PcwTYuQ1ZW4iBxHhHtUpRCFDZgNrRNC_KvS3yzJK8L0Xe-papm6ljnTIThiR4BhSlyxYZv1rC6Xr4z2ZatqPUTS5ZrTMaiSOTNI Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: a16a1323e1ae4f7d9b178c43cb15f169 Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-151732960 Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a16a1323e1ae4f7d9b178c43cb15f169"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a16a1323e1ae4f7d9b178c43cb15f169"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a16a1323e1ae4f7d9b178c43cb15f169", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a16a1323e1ae4f7d9b178c43cb15f169"}]}] Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-TestNetworkAdvancedServerOps-151732960 Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: a16a1323e1ae4f7d9b178c43cb15f169 Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-151732960 Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-TestNetworkAdvancedServerOps-151732960-project Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 5063de8e476b4378b1d7bdbfb8526b1c Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-TestNetworkAdvancedServerOps-151732960-project Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance e5c8f01b-f29b-48fe-9862-71b7f19d300c could not be found. Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': 'e5c8f01b-f29b-48fe-9862-71b7f19d300c'} Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5c8f01b-f29b-48fe-9862-71b7f19d300c could not be found. Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5c8f01b-f29b-48fe-9862-71b7f19d300c could not be found. Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:39:19.648426 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:39:19.656852 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:39:19.656852 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:39:19.656852 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:39:19.656852 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:39:19.656852 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:39:19.656852 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5c8f01b-f29b-48fe-9862-71b7f19d300c could not be found. Jul 25 15:39:19.656852 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:39:19.656852 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e3321039-677a-447e-b12a-5946dc389bdb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Returning 404 to user: Instance e5c8f01b-f29b-48fe-9862-71b7f19d300c could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:39:19.656852 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e3321039-677a-447e-b12a-5946dc389bdb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c" status: 404 len: 111 microversion: 2.1 time: 0.039241 Jul 25 15:39:19.656852 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3657/7538] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:39:19 2022] GET /compute/v2.1/servers/e5c8f01b-f29b-48fe-9862-71b7f19d300c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:39:25.184675 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-00b35bd1-1819-4cc6-8445-fc46808c3f28 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '.version_select at 0x7f46861a7e50>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:39:25.225590 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-00b35bd1-1819-4cc6-8445-fc46808c3f28 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1829395915" status: 202 len: 0 microversion: 2.1 time: 0.048616 Jul 25 15:39:25.226779 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3882/7539] 10.222.0.88 () {58 vars in 1284 bytes} [Mon Jul 25 15:39:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1829395915 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:39:25.280205 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b31667b0-4a55-4034-8378-ac7cf2691f5c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Action: 'create', calling method: .version_select at 0x7f4687e28280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-778528939", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtEFU2tH42PbnTl4nEE6AW0sR0g5QIWXdSHRvQsBnifODZcHw0nXxh0vUduUdaqNWx+nuAD0VoTYV183GhWUrQ3KaDDmWE0da5FyAbBD11dotPM/G+2SeOF418T9gotHw=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:39:25.313086 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-b31667b0-4a55-4034-8378-ac7cf2691f5c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Getting quotas for project a16a1323e1ae4f7d9b178c43cb15f169. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:39:25.323811 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-b31667b0-4a55-4034-8378-ac7cf2691f5c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Getting quotas for user 5063de8e476b4378b1d7bdbfb8526b1c and project a16a1323e1ae4f7d9b178c43cb15f169. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:39:25.366818 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b31667b0-4a55-4034-8378-ac7cf2691f5c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.094295 Jul 25 15:39:25.368076 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3658/7540] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 15:39:25 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:39:34.883029 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:39:34.891027 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0207bfc7-83f7-481e-8301-7a1748a0f455 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1667672685", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "6b22b5f7-c024-445d-ba6e-f21d622a6bcf"}], "key_name": "tempest-TestNetworkAdvancedServerOps-778528939", "security_groups": [{"name": "tempest-secgroup-smoke-732226316"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:39:35.330843 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-0207bfc7-83f7-481e-8301-7a1748a0f455 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] validate_networks() for [('6b22b5f7-c024-445d-ba6e-f21d622a6bcf', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:39:36.052006 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-0207bfc7-83f7-481e-8301-7a1748a0f455 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:39:36.053027 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-0207bfc7-83f7-481e-8301-7a1748a0f455 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:39:36.053254 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-0207bfc7-83f7-481e-8301-7a1748a0f455 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:39:36.053977 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-0207bfc7-83f7-481e-8301-7a1748a0f455 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:39:36.054591 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-0207bfc7-83f7-481e-8301-7a1748a0f455 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:39:36.079523 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0207bfc7-83f7-481e-8301-7a1748a0f455 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:36.080770 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0207bfc7-83f7-481e-8301-7a1748a0f455 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:36.082608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0207bfc7-83f7-481e-8301-7a1748a0f455 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:36.084173 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0207bfc7-83f7-481e-8301-7a1748a0f455 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:36.119058 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-0207bfc7-83f7-481e-8301-7a1748a0f455 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Getting quotas for project a16a1323e1ae4f7d9b178c43cb15f169. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:39:36.125998 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-0207bfc7-83f7-481e-8301-7a1748a0f455 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Getting quotas for user 5063de8e476b4378b1d7bdbfb8526b1c and project a16a1323e1ae4f7d9b178c43cb15f169. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:39:36.147805 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0207bfc7-83f7-481e-8301-7a1748a0f455 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:39:36.150457 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0207bfc7-83f7-481e-8301-7a1748a0f455 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:39:36.220503 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0207bfc7-83f7-481e-8301-7a1748a0f455 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.340924 Jul 25 15:39:36.221764 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3883/7541] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:39:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 1344 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:39:36.237756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=32 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:39:36.239077 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:39:36.240356 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:39:36.248256 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c5ba0790-4f4f-49fd-bbe2-595c358b1a27 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:39:36.249299 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c5ba0790-4f4f-49fd-bbe2-595c358b1a27 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:39:36.464450 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c5ba0790-4f4f-49fd-bbe2-595c358b1a27 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:39:36.473316 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c5ba0790-4f4f-49fd-bbe2-595c358b1a27 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1" status: 200 len: 1266 microversion: 2.1 time: 0.238867 Jul 25 15:39:36.473932 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3659/7542] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:39:36 2022] GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:39:37.531540 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-76c579a7-ca2c-42b1-b24e-5d707417788f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:39:37.533211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-76c579a7-ca2c-42b1-b24e-5d707417788f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:39:37.545312 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-76c579a7-ca2c-42b1-b24e-5d707417788f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:37.546351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-76c579a7-ca2c-42b1-b24e-5d707417788f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:37.547653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-76c579a7-ca2c-42b1-b24e-5d707417788f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:37.548898 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-76c579a7-ca2c-42b1-b24e-5d707417788f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:37.680023 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-76c579a7-ca2c-42b1-b24e-5d707417788f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:39:37.697332 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-76c579a7-ca2c-42b1-b24e-5d707417788f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1" status: 200 len: 1318 microversion: 2.1 time: 0.192339 Jul 25 15:39:37.699125 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3884/7543] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:39:37 2022] GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:39:38.731197 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-adbe2025-6e0d-4c03-8171-55fed7f06ef7 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:39:38.732477 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-adbe2025-6e0d-4c03-8171-55fed7f06ef7 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:39:38.749896 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-adbe2025-6e0d-4c03-8171-55fed7f06ef7 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:38.751411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-adbe2025-6e0d-4c03-8171-55fed7f06ef7 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:38.754226 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-adbe2025-6e0d-4c03-8171-55fed7f06ef7 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:38.755726 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-adbe2025-6e0d-4c03-8171-55fed7f06ef7 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:38.900301 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-adbe2025-6e0d-4c03-8171-55fed7f06ef7 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:39:38.920364 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-adbe2025-6e0d-4c03-8171-55fed7f06ef7 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1" status: 200 len: 1324 microversion: 2.1 time: 0.196588 Jul 25 15:39:38.927475 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3660/7544] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:39:38 2022] GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 => generated 1324 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:39:39.954344 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b74025a8-1f5c-4b31-be8c-8205e5d25e0b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:39:39.957217 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b74025a8-1f5c-4b31-be8c-8205e5d25e0b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:39:39.961208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:39:39.972192 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b74025a8-1f5c-4b31-be8c-8205e5d25e0b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:39.973102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b74025a8-1f5c-4b31-be8c-8205e5d25e0b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:39.974516 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b74025a8-1f5c-4b31-be8c-8205e5d25e0b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:39.976238 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b74025a8-1f5c-4b31-be8c-8205e5d25e0b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:40.281442 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b74025a8-1f5c-4b31-be8c-8205e5d25e0b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:39:40.291208 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b74025a8-1f5c-4b31-be8c-8205e5d25e0b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1" status: 200 len: 1391 microversion: 2.1 time: 0.346355 Jul 25 15:39:40.292267 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3885/7545] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:39:39 2022] GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 => generated 1391 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:39:40.418341 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-dd1cf2f4-5f74-4f7d-85cd-fd154f39debb req-4669e7d1-2408-44cb-9216-8bb480d60871 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46b6f71b-eb3d-4b9e-98a2-4974bebd30f1", "tag": "c842d35f-1004-40c1-accd-77fa67d025c8"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:39:40.456993 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-dd1cf2f4-5f74-4f7d-85cd-fd154f39debb req-4669e7d1-2408-44cb-9216-8bb480d60871 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:40.457809 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-dd1cf2f4-5f74-4f7d-85cd-fd154f39debb req-4669e7d1-2408-44cb-9216-8bb480d60871 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:40.488647 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-dd1cf2f4-5f74-4f7d-85cd-fd154f39debb req-4669e7d1-2408-44cb-9216-8bb480d60871 service nova] Creating event network-changed:c842d35f-1004-40c1-accd-77fa67d025c8 for instance 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 on n-h1-846435-14 Jul 25 15:39:40.499102 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-dd1cf2f4-5f74-4f7d-85cd-fd154f39debb req-4669e7d1-2408-44cb-9216-8bb480d60871 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096096 Jul 25 15:39:40.501133 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3661/7546] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:39:41.319209 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fb276e5e-d050-457b-9f9b-5435f64e07c6 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:39:41.320166 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fb276e5e-d050-457b-9f9b-5435f64e07c6 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:39:41.328565 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fb276e5e-d050-457b-9f9b-5435f64e07c6 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:41.329028 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fb276e5e-d050-457b-9f9b-5435f64e07c6 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:41.329856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fb276e5e-d050-457b-9f9b-5435f64e07c6 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:41.330351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fb276e5e-d050-457b-9f9b-5435f64e07c6 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:41.516109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fb276e5e-d050-457b-9f9b-5435f64e07c6 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:39:41.531164 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fb276e5e-d050-457b-9f9b-5435f64e07c6 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1" status: 200 len: 1391 microversion: 2.1 time: 0.215945 Jul 25 15:39:41.532317 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3886/7547] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:39:41 2022] GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 => generated 1391 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:39:42.555181 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6dbb8a4b-b2e4-4d52-ae55-6cf25126de33 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:39:42.556550 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6dbb8a4b-b2e4-4d52-ae55-6cf25126de33 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:39:42.566172 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6dbb8a4b-b2e4-4d52-ae55-6cf25126de33 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:42.566809 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6dbb8a4b-b2e4-4d52-ae55-6cf25126de33 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:42.567680 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6dbb8a4b-b2e4-4d52-ae55-6cf25126de33 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:42.568171 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6dbb8a4b-b2e4-4d52-ae55-6cf25126de33 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:42.755502 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6dbb8a4b-b2e4-4d52-ae55-6cf25126de33 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:39:42.765616 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6dbb8a4b-b2e4-4d52-ae55-6cf25126de33 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1" status: 200 len: 1391 microversion: 2.1 time: 0.215350 Jul 25 15:39:42.766231 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3662/7548] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:39:42 2022] GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 => generated 1391 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:39:43.788277 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8cd1b447-c1a5-48bb-964f-8113b69196b4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:39:43.789246 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8cd1b447-c1a5-48bb-964f-8113b69196b4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:39:43.798849 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8cd1b447-c1a5-48bb-964f-8113b69196b4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:43.799479 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8cd1b447-c1a5-48bb-964f-8113b69196b4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:43.800550 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8cd1b447-c1a5-48bb-964f-8113b69196b4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:43.801226 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8cd1b447-c1a5-48bb-964f-8113b69196b4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:43.975161 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8cd1b447-c1a5-48bb-964f-8113b69196b4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:39:43.984704 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8cd1b447-c1a5-48bb-964f-8113b69196b4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1" status: 200 len: 1391 microversion: 2.1 time: 0.201083 Jul 25 15:39:43.985288 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3887/7549] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:39:43 2022] GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 => generated 1391 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:39:45.020394 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1629bff9-8500-48ab-974d-ebe6b65a1418 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:39:45.021437 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1629bff9-8500-48ab-974d-ebe6b65a1418 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:39:45.031186 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1629bff9-8500-48ab-974d-ebe6b65a1418 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:45.031783 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1629bff9-8500-48ab-974d-ebe6b65a1418 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:45.033012 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1629bff9-8500-48ab-974d-ebe6b65a1418 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:45.033795 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1629bff9-8500-48ab-974d-ebe6b65a1418 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:45.266264 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1629bff9-8500-48ab-974d-ebe6b65a1418 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:39:45.279658 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1629bff9-8500-48ab-974d-ebe6b65a1418 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1" status: 200 len: 1391 microversion: 2.1 time: 0.264026 Jul 25 15:39:45.280780 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3663/7550] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:39:45 2022] GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 => generated 1391 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:39:46.308324 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8ea262d2-0e9b-48ab-b10f-b690de49ea80 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:39:46.309454 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8ea262d2-0e9b-48ab-b10f-b690de49ea80 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:39:46.314390 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:39:46.315674 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:39:46.327345 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8ea262d2-0e9b-48ab-b10f-b690de49ea80 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:46.329210 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8ea262d2-0e9b-48ab-b10f-b690de49ea80 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:46.330337 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8ea262d2-0e9b-48ab-b10f-b690de49ea80 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:46.331050 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8ea262d2-0e9b-48ab-b10f-b690de49ea80 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:46.572564 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8ea262d2-0e9b-48ab-b10f-b690de49ea80 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:39:46.582152 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8ea262d2-0e9b-48ab-b10f-b690de49ea80 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1" status: 200 len: 1391 microversion: 2.1 time: 0.281760 Jul 25 15:39:46.582797 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3888/7551] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:39:46 2022] GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 => generated 1391 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:39:46.594399 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-f0da07ce-438e-43b1-9a13-f581d5fff697 req-db628432-7fec-41d9-8170-bab4aa04aa45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46b6f71b-eb3d-4b9e-98a2-4974bebd30f1", "name": "network-vif-plugged", "status": "completed", "tag": "c842d35f-1004-40c1-accd-77fa67d025c8"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:39:46.605724 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:39:46.619553 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f0da07ce-438e-43b1-9a13-f581d5fff697 req-db628432-7fec-41d9-8170-bab4aa04aa45 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:46.620384 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f0da07ce-438e-43b1-9a13-f581d5fff697 req-db628432-7fec-41d9-8170-bab4aa04aa45 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:46.645441 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-f0da07ce-438e-43b1-9a13-f581d5fff697 req-db628432-7fec-41d9-8170-bab4aa04aa45 service nova] Creating event network-vif-plugged:c842d35f-1004-40c1-accd-77fa67d025c8 for instance 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 on n-h1-846435-14 Jul 25 15:39:46.654957 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-f0da07ce-438e-43b1-9a13-f581d5fff697 req-db628432-7fec-41d9-8170-bab4aa04aa45 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065161 Jul 25 15:39:46.656290 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3664/7552] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:39:47.618802 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-803e5db6-bff9-4dc9-8d00-20251958026c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:39:47.619440 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-803e5db6-bff9-4dc9-8d00-20251958026c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:39:47.627746 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-803e5db6-bff9-4dc9-8d00-20251958026c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:47.628242 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-803e5db6-bff9-4dc9-8d00-20251958026c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:47.629068 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-803e5db6-bff9-4dc9-8d00-20251958026c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:47.629528 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-803e5db6-bff9-4dc9-8d00-20251958026c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:47.809430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-803e5db6-bff9-4dc9-8d00-20251958026c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:39:47.818803 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-803e5db6-bff9-4dc9-8d00-20251958026c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1" status: 200 len: 1391 microversion: 2.1 time: 0.204387 Jul 25 15:39:47.819412 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3889/7553] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:39:47 2022] GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 => generated 1391 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:39:48.848724 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9baf10ab-5314-4e8d-8f37-b2dadf4e250d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:39:48.849985 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9baf10ab-5314-4e8d-8f37-b2dadf4e250d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:39:48.862140 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9baf10ab-5314-4e8d-8f37-b2dadf4e250d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:48.862940 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9baf10ab-5314-4e8d-8f37-b2dadf4e250d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:48.864541 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9baf10ab-5314-4e8d-8f37-b2dadf4e250d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:48.865421 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9baf10ab-5314-4e8d-8f37-b2dadf4e250d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:49.082767 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9baf10ab-5314-4e8d-8f37-b2dadf4e250d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:39:49.098395 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9baf10ab-5314-4e8d-8f37-b2dadf4e250d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1" status: 200 len: 1562 microversion: 2.1 time: 0.259025 Jul 25 15:39:49.099504 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3665/7554] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:39:48 2022] GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 => generated 1562 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:39:49.129713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2d4650a6-1cab-4815-92ed-a3401504fb43 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:39:49.130617 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2d4650a6-1cab-4815-92ed-a3401504fb43 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:39:49.139096 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d4650a6-1cab-4815-92ed-a3401504fb43 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:49.139568 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d4650a6-1cab-4815-92ed-a3401504fb43 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:49.140436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d4650a6-1cab-4815-92ed-a3401504fb43 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:49.140889 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2d4650a6-1cab-4815-92ed-a3401504fb43 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:49.350028 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2d4650a6-1cab-4815-92ed-a3401504fb43 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:39:49.362146 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2d4650a6-1cab-4815-92ed-a3401504fb43 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1" status: 200 len: 1562 microversion: 2.1 time: 0.236864 Jul 25 15:39:49.362777 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3890/7555] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:39:49 2022] GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 => generated 1562 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:39:52.190528 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-91385275-73e9-40c7-98e0-41975f9531a0 req-e20fcf02-165b-4236-87fc-30908e35c9d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46b6f71b-eb3d-4b9e-98a2-4974bebd30f1", "tag": "c842d35f-1004-40c1-accd-77fa67d025c8"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:39:52.193670 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9ba434e9-555b-4bd4-a447-92e636a95156 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:39:52.195271 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9ba434e9-555b-4bd4-a447-92e636a95156 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:39:52.206309 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9ba434e9-555b-4bd4-a447-92e636a95156 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:52.207303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9ba434e9-555b-4bd4-a447-92e636a95156 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:52.209610 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9ba434e9-555b-4bd4-a447-92e636a95156 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:52.210440 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-91385275-73e9-40c7-98e0-41975f9531a0 req-e20fcf02-165b-4236-87fc-30908e35c9d0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:39:52.210440 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-91385275-73e9-40c7-98e0-41975f9531a0 req-e20fcf02-165b-4236-87fc-30908e35c9d0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:52.211001 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9ba434e9-555b-4bd4-a447-92e636a95156 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:39:52.226158 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-91385275-73e9-40c7-98e0-41975f9531a0 req-e20fcf02-165b-4236-87fc-30908e35c9d0 service nova] Creating event network-changed:c842d35f-1004-40c1-accd-77fa67d025c8 for instance 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 on n-h1-846435-14 Jul 25 15:39:52.233814 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-91385275-73e9-40c7-98e0-41975f9531a0 req-e20fcf02-165b-4236-87fc-30908e35c9d0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047224 Jul 25 15:39:52.234875 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3891/7556] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:39:52.463248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9ba434e9-555b-4bd4-a447-92e636a95156 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:39:52.476487 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9ba434e9-555b-4bd4-a447-92e636a95156 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1" status: 200 len: 1562 microversion: 2.1 time: 0.294604 Jul 25 15:39:52.477983 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3666/7557] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:39:52 2022] GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 => generated 1562 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:40:14.873976 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=13 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:40:14.874947 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=46 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:40:14.879608 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e3809d7f-5f96-4210-bd5b-a75550ef76cc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:40:14.882356 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e3809d7f-5f96-4210-bd5b-a75550ef76cc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:40:14.890389 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3809d7f-5f96-4210-bd5b-a75550ef76cc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:40:14.890868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3809d7f-5f96-4210-bd5b-a75550ef76cc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:40:14.891689 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3809d7f-5f96-4210-bd5b-a75550ef76cc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:40:14.892146 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3809d7f-5f96-4210-bd5b-a75550ef76cc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:40:14.976418 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e3809d7f-5f96-4210-bd5b-a75550ef76cc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "POST /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1/action" status: 200 len: 24554 microversion: 2.1 time: 0.104024 Jul 25 15:40:14.977226 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3892/7558] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:40:14 2022] POST /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1/action => generated 24554 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 15:40:25.981943 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ca023775-8c55-48ef-a03d-89ba6677a569 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:40:25.986131 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ca023775-8c55-48ef-a03d-89ba6677a569 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:40:25.990944 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=18 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:40:25.992313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=34 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:40:26.003262 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ca023775-8c55-48ef-a03d-89ba6677a569 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:40:26.004101 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ca023775-8c55-48ef-a03d-89ba6677a569 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:40:26.005654 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ca023775-8c55-48ef-a03d-89ba6677a569 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:40:26.006237 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ca023775-8c55-48ef-a03d-89ba6677a569 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:40:26.144228 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ca023775-8c55-48ef-a03d-89ba6677a569 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "POST /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1/action" status: 202 len: 0 microversion: 2.1 time: 0.169672 Jul 25 15:40:26.145858 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3667/7559] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:40:25 2022] POST /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:40:26.160849 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b23b61cd-ee0f-4cb6-95f2-9b3985e7fb01 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:40:26.162209 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b23b61cd-ee0f-4cb6-95f2-9b3985e7fb01 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:40:26.167210 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:40:26.169761 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=4 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:40:26.178532 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b23b61cd-ee0f-4cb6-95f2-9b3985e7fb01 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:40:26.180285 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b23b61cd-ee0f-4cb6-95f2-9b3985e7fb01 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:40:26.181818 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b23b61cd-ee0f-4cb6-95f2-9b3985e7fb01 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:40:26.183078 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b23b61cd-ee0f-4cb6-95f2-9b3985e7fb01 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:40:26.602421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b23b61cd-ee0f-4cb6-95f2-9b3985e7fb01 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:40:26.613211 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b23b61cd-ee0f-4cb6-95f2-9b3985e7fb01 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1" status: 200 len: 1673 microversion: 2.1 time: 0.459717 Jul 25 15:40:26.613929 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3893/7560] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:40:26 2022] GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 => generated 1673 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:40:27.651455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9452d27d-801f-4ecf-aa7c-029aca613383 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:40:27.652413 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9452d27d-801f-4ecf-aa7c-029aca613383 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:40:27.660260 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9452d27d-801f-4ecf-aa7c-029aca613383 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:40:27.660807 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9452d27d-801f-4ecf-aa7c-029aca613383 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:40:27.661805 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9452d27d-801f-4ecf-aa7c-029aca613383 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:40:27.662341 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9452d27d-801f-4ecf-aa7c-029aca613383 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:40:27.857684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9452d27d-801f-4ecf-aa7c-029aca613383 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:40:27.871135 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9452d27d-801f-4ecf-aa7c-029aca613383 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1" status: 200 len: 1678 microversion: 2.1 time: 0.225707 Jul 25 15:40:27.872686 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3668/7561] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:40:27 2022] GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 => generated 1678 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:40:28.910203 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d433ef9f-1979-4ae9-8ccd-5c38de010c05 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:40:28.911168 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d433ef9f-1979-4ae9-8ccd-5c38de010c05 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:40:28.922342 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d433ef9f-1979-4ae9-8ccd-5c38de010c05 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:40:28.923108 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d433ef9f-1979-4ae9-8ccd-5c38de010c05 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:40:28.924535 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d433ef9f-1979-4ae9-8ccd-5c38de010c05 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:40:28.925322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d433ef9f-1979-4ae9-8ccd-5c38de010c05 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:40:29.121333 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d433ef9f-1979-4ae9-8ccd-5c38de010c05 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:40:29.131752 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d433ef9f-1979-4ae9-8ccd-5c38de010c05 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1" status: 200 len: 1678 microversion: 2.1 time: 0.227500 Jul 25 15:40:29.132310 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3894/7562] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:40:28 2022] GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 => generated 1678 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:40:30.155505 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-906bc4f5-596a-46b7-afce-3c6d9f3d9f75 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:40:30.156194 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-906bc4f5-596a-46b7-afce-3c6d9f3d9f75 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:40:30.164603 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-906bc4f5-596a-46b7-afce-3c6d9f3d9f75 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:40:30.165372 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-906bc4f5-596a-46b7-afce-3c6d9f3d9f75 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:40:30.166275 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-906bc4f5-596a-46b7-afce-3c6d9f3d9f75 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:40:30.166699 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-906bc4f5-596a-46b7-afce-3c6d9f3d9f75 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:40:30.366923 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-906bc4f5-596a-46b7-afce-3c6d9f3d9f75 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:40:30.376860 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-906bc4f5-596a-46b7-afce-3c6d9f3d9f75 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1" status: 200 len: 1678 microversion: 2.1 time: 0.226273 Jul 25 15:40:30.377665 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3669/7563] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:40:30 2022] GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 => generated 1678 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:40:31.402329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-98cac752-f0ba-4674-a289-96bf30a52e19 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:40:31.403262 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-98cac752-f0ba-4674-a289-96bf30a52e19 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:40:31.412263 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98cac752-f0ba-4674-a289-96bf30a52e19 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:40:31.412841 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98cac752-f0ba-4674-a289-96bf30a52e19 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:40:31.413784 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98cac752-f0ba-4674-a289-96bf30a52e19 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:40:31.414384 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-98cac752-f0ba-4674-a289-96bf30a52e19 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:40:31.595070 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-98cac752-f0ba-4674-a289-96bf30a52e19 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:40:31.605258 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-98cac752-f0ba-4674-a289-96bf30a52e19 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1" status: 200 len: 1678 microversion: 2.1 time: 0.207023 Jul 25 15:40:31.606084 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3895/7564] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:40:31 2022] GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 => generated 1678 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:40:32.636397 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f50dde11-2e2f-43aa-a8ee-279ce7972fd1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:40:32.637314 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f50dde11-2e2f-43aa-a8ee-279ce7972fd1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:40:32.646514 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f50dde11-2e2f-43aa-a8ee-279ce7972fd1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:40:32.647236 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f50dde11-2e2f-43aa-a8ee-279ce7972fd1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:40:32.648541 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f50dde11-2e2f-43aa-a8ee-279ce7972fd1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:40:32.649161 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f50dde11-2e2f-43aa-a8ee-279ce7972fd1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:40:32.844315 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f50dde11-2e2f-43aa-a8ee-279ce7972fd1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:40:32.858015 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f50dde11-2e2f-43aa-a8ee-279ce7972fd1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1" status: 200 len: 1678 microversion: 2.1 time: 0.226594 Jul 25 15:40:32.859057 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3670/7565] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:40:32 2022] GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 => generated 1678 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:40:33.895711 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d637a0eb-44f7-413c-8749-4c805f38e2b0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:40:33.896678 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d637a0eb-44f7-413c-8749-4c805f38e2b0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:40:33.911290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d637a0eb-44f7-413c-8749-4c805f38e2b0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:40:33.912149 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d637a0eb-44f7-413c-8749-4c805f38e2b0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:40:33.913767 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d637a0eb-44f7-413c-8749-4c805f38e2b0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:40:33.914605 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d637a0eb-44f7-413c-8749-4c805f38e2b0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:40:34.129253 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d637a0eb-44f7-413c-8749-4c805f38e2b0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:40:34.141290 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d637a0eb-44f7-413c-8749-4c805f38e2b0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1" status: 200 len: 1678 microversion: 2.1 time: 0.252213 Jul 25 15:40:34.142331 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3896/7566] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:40:33 2022] GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 => generated 1678 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:40:35.179357 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3cf01843-6904-4a19-baad-1fb785f2bab3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:40:35.180540 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3cf01843-6904-4a19-baad-1fb785f2bab3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:40:35.189417 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3cf01843-6904-4a19-baad-1fb785f2bab3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:40:35.190365 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3cf01843-6904-4a19-baad-1fb785f2bab3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:40:35.191800 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3cf01843-6904-4a19-baad-1fb785f2bab3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:40:35.192656 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3cf01843-6904-4a19-baad-1fb785f2bab3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:40:35.403830 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3cf01843-6904-4a19-baad-1fb785f2bab3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:40:35.413436 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3cf01843-6904-4a19-baad-1fb785f2bab3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1" status: 200 len: 1678 microversion: 2.1 time: 0.240883 Jul 25 15:40:35.414278 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3671/7567] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:40:35 2022] GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 => generated 1678 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:40:36.439929 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-11b74358-8307-44bb-a5e2-54d4c130410e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:40:36.441122 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-11b74358-8307-44bb-a5e2-54d4c130410e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:40:36.453913 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11b74358-8307-44bb-a5e2-54d4c130410e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:40:36.454593 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11b74358-8307-44bb-a5e2-54d4c130410e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:40:36.456661 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11b74358-8307-44bb-a5e2-54d4c130410e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:40:36.457325 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11b74358-8307-44bb-a5e2-54d4c130410e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:40:36.646931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-11b74358-8307-44bb-a5e2-54d4c130410e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:40:36.660550 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-11b74358-8307-44bb-a5e2-54d4c130410e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1" status: 200 len: 1678 microversion: 2.1 time: 0.226465 Jul 25 15:40:36.661521 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3897/7568] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:40:36 2022] GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 => generated 1678 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:40:37.687717 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1d215bee-2c31-4b93-983c-df2b83a3f788 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:40:37.688654 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1d215bee-2c31-4b93-983c-df2b83a3f788 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:40:37.697866 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d215bee-2c31-4b93-983c-df2b83a3f788 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:40:37.698466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d215bee-2c31-4b93-983c-df2b83a3f788 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:40:37.699346 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d215bee-2c31-4b93-983c-df2b83a3f788 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:40:37.699836 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1d215bee-2c31-4b93-983c-df2b83a3f788 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:40:37.917302 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1d215bee-2c31-4b93-983c-df2b83a3f788 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:40:37.929674 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1d215bee-2c31-4b93-983c-df2b83a3f788 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1" status: 200 len: 1678 microversion: 2.1 time: 0.249508 Jul 25 15:40:37.930758 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3672/7569] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:40:37 2022] GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 => generated 1678 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:40:38.969797 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4d903474-c5b3-4f46-b21c-f1e0ae6796f7 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:40:38.970852 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4d903474-c5b3-4f46-b21c-f1e0ae6796f7 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:40:38.985005 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4d903474-c5b3-4f46-b21c-f1e0ae6796f7 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:40:38.986796 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4d903474-c5b3-4f46-b21c-f1e0ae6796f7 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:40:38.987302 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4d903474-c5b3-4f46-b21c-f1e0ae6796f7 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:40:38.988139 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4d903474-c5b3-4f46-b21c-f1e0ae6796f7 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:40:39.185850 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4d903474-c5b3-4f46-b21c-f1e0ae6796f7 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:40:39.196308 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4d903474-c5b3-4f46-b21c-f1e0ae6796f7 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1" status: 200 len: 1681 microversion: 2.1 time: 0.233932 Jul 25 15:40:39.197348 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3898/7570] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:40:38 2022] GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 => generated 1681 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:41:03.461530 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7aec53bc-1da9-41f8-a06b-ad1bbb883769 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:41:03.464006 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7aec53bc-1da9-41f8-a06b-ad1bbb883769 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:41:03.466807 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=12 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:41:03.469272 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:41:03.474144 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7aec53bc-1da9-41f8-a06b-ad1bbb883769 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:03.475114 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7aec53bc-1da9-41f8-a06b-ad1bbb883769 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:03.476588 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7aec53bc-1da9-41f8-a06b-ad1bbb883769 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:03.477374 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7aec53bc-1da9-41f8-a06b-ad1bbb883769 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:03.549960 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7aec53bc-1da9-41f8-a06b-ad1bbb883769 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "POST /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1/action" status: 200 len: 69140 microversion: 2.1 time: 0.092461 Jul 25 15:41:03.551329 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3673/7571] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:41:03 2022] POST /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1/action => generated 69140 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 15:41:11.009097 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4559cc95-ca64-4bcb-bdc2-86c3ea4c715d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:41:11.010149 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4559cc95-ca64-4bcb-bdc2-86c3ea4c715d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:41:11.013811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=12 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:41:11.015488 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=36 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:41:11.035356 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4559cc95-ca64-4bcb-bdc2-86c3ea4c715d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:11.036870 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4559cc95-ca64-4bcb-bdc2-86c3ea4c715d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:11.038554 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4559cc95-ca64-4bcb-bdc2-86c3ea4c715d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:11.039643 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4559cc95-ca64-4bcb-bdc2-86c3ea4c715d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:11.088821 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-4d028a38-eaab-4c09-a3dd-af28878d8632 req-1b1157b8-9fdd-481d-984e-59253cc60bfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46b6f71b-eb3d-4b9e-98a2-4974bebd30f1", "tag": "c842d35f-1004-40c1-accd-77fa67d025c8"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:41:11.092496 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4559cc95-ca64-4bcb-bdc2-86c3ea4c715d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:41:11.105889 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-4d028a38-eaab-4c09-a3dd-af28878d8632 req-1b1157b8-9fdd-481d-984e-59253cc60bfc service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:11.106372 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-4d028a38-eaab-4c09-a3dd-af28878d8632 req-1b1157b8-9fdd-481d-984e-59253cc60bfc service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:11.122114 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-4d028a38-eaab-4c09-a3dd-af28878d8632 req-1b1157b8-9fdd-481d-984e-59253cc60bfc service nova] Creating event network-changed:c842d35f-1004-40c1-accd-77fa67d025c8 for instance 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 on n-h1-846435-14 Jul 25 15:41:11.128190 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-4d028a38-eaab-4c09-a3dd-af28878d8632 req-1b1157b8-9fdd-481d-984e-59253cc60bfc service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121665 Jul 25 15:41:11.129545 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3674/7572] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:41:11.245611 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4559cc95-ca64-4bcb-bdc2-86c3ea4c715d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "DELETE /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1" status: 204 len: 0 microversion: 2.1 time: 0.240237 Jul 25 15:41:11.246986 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3899/7573] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:41:11 2022] DELETE /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 15:41:11.260163 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6e4b17b3-11a6-4c11-b0a3-a42a0f5a8063 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:41:11.261794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6e4b17b3-11a6-4c11-b0a3-a42a0f5a8063 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:41:11.270574 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e4b17b3-11a6-4c11-b0a3-a42a0f5a8063 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:11.271814 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e4b17b3-11a6-4c11-b0a3-a42a0f5a8063 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:11.273655 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e4b17b3-11a6-4c11-b0a3-a42a0f5a8063 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:11.273969 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6e4b17b3-11a6-4c11-b0a3-a42a0f5a8063 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:11.467168 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6e4b17b3-11a6-4c11-b0a3-a42a0f5a8063 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:41:11.480629 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6e4b17b3-11a6-4c11-b0a3-a42a0f5a8063 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1" status: 200 len: 1687 microversion: 2.1 time: 0.227139 Jul 25 15:41:11.481368 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3675/7574] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:41:11 2022] GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 => generated 1687 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:41:12.516775 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-87741759-0364-4ee8-8bf4-bd8bb3ad6d5d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:41:12.517492 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-87741759-0364-4ee8-8bf4-bd8bb3ad6d5d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:41:12.527147 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-87741759-0364-4ee8-8bf4-bd8bb3ad6d5d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:12.527638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-87741759-0364-4ee8-8bf4-bd8bb3ad6d5d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:12.528592 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-87741759-0364-4ee8-8bf4-bd8bb3ad6d5d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:12.529215 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-87741759-0364-4ee8-8bf4-bd8bb3ad6d5d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:12.773074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-87741759-0364-4ee8-8bf4-bd8bb3ad6d5d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:41:12.781635 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-87741759-0364-4ee8-8bf4-bd8bb3ad6d5d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1" status: 200 len: 1687 microversion: 2.1 time: 0.270529 Jul 25 15:41:12.782251 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3900/7575] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:41:12 2022] GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 => generated 1687 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:41:13.437492 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-4ace09ca-0c68-42a3-8ed9-1187ce2b64aa req-5e4130f7-67b6-4873-bd81-148476555936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46b6f71b-eb3d-4b9e-98a2-4974bebd30f1", "name": "network-vif-deleted", "tag": "c842d35f-1004-40c1-accd-77fa67d025c8"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:41:13.452067 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-4ace09ca-0c68-42a3-8ed9-1187ce2b64aa req-5e4130f7-67b6-4873-bd81-148476555936 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:13.453055 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-4ace09ca-0c68-42a3-8ed9-1187ce2b64aa req-5e4130f7-67b6-4873-bd81-148476555936 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:13.466790 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-4ace09ca-0c68-42a3-8ed9-1187ce2b64aa req-5e4130f7-67b6-4873-bd81-148476555936 service nova] Creating event network-vif-deleted:c842d35f-1004-40c1-accd-77fa67d025c8 for instance 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 on n-h1-846435-14 Jul 25 15:41:13.473961 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-4ace09ca-0c68-42a3-8ed9-1187ce2b64aa req-5e4130f7-67b6-4873-bd81-148476555936 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040059 Jul 25 15:41:13.475246 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3676/7576] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:41:13.808177 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-4baf06af-34c3-4005-967e-350ead7f57ee tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:41:13.809099 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-4baf06af-34c3-4005-967e-350ead7f57ee tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:41:13.819148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4baf06af-34c3-4005-967e-350ead7f57ee tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:13.819785 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4baf06af-34c3-4005-967e-350ead7f57ee tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:13.821468 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4baf06af-34c3-4005-967e-350ead7f57ee tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:13.821950 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4baf06af-34c3-4005-967e-350ead7f57ee tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:13.893844 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4baf06af-34c3-4005-967e-350ead7f57ee tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:13.894660 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-4baf06af-34c3-4005-967e-350ead7f57ee tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:13.895461 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-4baf06af-34c3-4005-967e-350ead7f57ee tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lazy-loading 'fault' on Instance uuid 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:41:13.958293 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-4baf06af-34c3-4005-967e-350ead7f57ee tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:41:13.971097 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-4baf06af-34c3-4005-967e-350ead7f57ee tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1" status: 200 len: 1356 microversion: 2.1 time: 0.168079 Jul 25 15:41:13.972077 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3901/7577] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:41:13 2022] GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 => generated 1356 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:41:15.010737 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-31fce9a9-0759-43da-9531-baaf19a64558 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:41:15.011445 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-31fce9a9-0759-43da-9531-baaf19a64558 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:41:15.019894 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-31fce9a9-0759-43da-9531-baaf19a64558 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:15.020433 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-31fce9a9-0759-43da-9531-baaf19a64558 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:15.021244 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-31fce9a9-0759-43da-9531-baaf19a64558 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:15.021831 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-31fce9a9-0759-43da-9531-baaf19a64558 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:15.038325 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-31fce9a9-0759-43da-9531-baaf19a64558 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] HTTP exception thrown: Instance 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 could not be found. Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-31fce9a9-0759-43da-9531-baaf19a64558 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Request method failure captured: Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 HTTP/1.1 Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rjesYZca3-zg5wdlKOEpTPhAkLj6IXHamAasfg58t3Ilpa049I9OXvWX-bAnAQJHJ7-EsS7XT_5PcwTYuQ1ZW4iBxHhHtUpRCFDZgNrRNC_KvS3yzJK8L0Xe-papm6ljnTIThiR4BhSlyxYZv1rC6Xr4z2ZatqPUTS5ZrTMaiSOTNI Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: a16a1323e1ae4f7d9b178c43cb15f169 Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-151732960 Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a16a1323e1ae4f7d9b178c43cb15f169"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a16a1323e1ae4f7d9b178c43cb15f169"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a16a1323e1ae4f7d9b178c43cb15f169", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a16a1323e1ae4f7d9b178c43cb15f169"}]}] Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-TestNetworkAdvancedServerOps-151732960 Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: a16a1323e1ae4f7d9b178c43cb15f169 Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-151732960 Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-TestNetworkAdvancedServerOps-151732960-project Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 5063de8e476b4378b1d7bdbfb8526b1c Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-TestNetworkAdvancedServerOps-151732960-project Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 could not be found. Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '46b6f71b-eb3d-4b9e-98a2-4974bebd30f1'} Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 could not be found. Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 could not be found. Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:41:15.040197 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:41:15.049127 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:41:15.049127 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:41:15.049127 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:41:15.049127 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:41:15.049127 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:41:15.049127 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 could not be found. Jul 25 15:41:15.049127 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:41:15.049127 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-31fce9a9-0759-43da-9531-baaf19a64558 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Returning 404 to user: Instance 46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:41:15.049127 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-31fce9a9-0759-43da-9531-baaf19a64558 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1" status: 404 len: 111 microversion: 2.1 time: 0.038612 Jul 25 15:41:15.049127 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3677/7578] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:41:15 2022] GET /compute/v2.1/servers/46b6f71b-eb3d-4b9e-98a2-4974bebd30f1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:41:19.465591 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0f96a59e-adef-4264-905a-9432fa306dbd tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '.version_select at 0x7f46861a7310>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:41:19.507036 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0f96a59e-adef-4264-905a-9432fa306dbd tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-778528939" status: 202 len: 0 microversion: 2.1 time: 0.045250 Jul 25 15:41:19.508133 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3902/7579] 10.222.0.88 () {58 vars in 1281 bytes} [Mon Jul 25 15:41:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-778528939 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:41:19.535147 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a8c9474b-1092-40fa-879f-6001d04488e0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Action: 'create', calling method: .version_select at 0x7f4686496dc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-629754140", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAudTAmoHKxheJ2a1YTxJuVTcKqi8DQYvR4+SSyxObV34axMPze9OMt689X6EvDn0vIjU+hm18Vje7LJUVfQzDibmYV8ua6YMUgHCBY3mxiFcY0eATrEyfK4qQLB4HCPkg=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:41:19.556148 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-a8c9474b-1092-40fa-879f-6001d04488e0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Getting quotas for project a16a1323e1ae4f7d9b178c43cb15f169. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:41:19.562955 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-a8c9474b-1092-40fa-879f-6001d04488e0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Getting quotas for user 5063de8e476b4378b1d7bdbfb8526b1c and project a16a1323e1ae4f7d9b178c43cb15f169. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:41:19.595560 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a8c9474b-1092-40fa-879f-6001d04488e0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.064546 Jul 25 15:41:19.596318 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3678/7580] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 15:41:19 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:41:26.553692 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:41:26.559048 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-dee7c789-85c3-40f8-a54a-454b7c2f1b61 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-944509685", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "7eaa0b95-f2e5-4292-a010-1f268cb651b6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-629754140", "security_groups": [{"name": "tempest-secgroup-smoke-346062055"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:41:26.752524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-dee7c789-85c3-40f8-a54a-454b7c2f1b61 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] validate_networks() for [('7eaa0b95-f2e5-4292-a010-1f268cb651b6', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:41:27.496159 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-dee7c789-85c3-40f8-a54a-454b7c2f1b61 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:41:27.497450 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-dee7c789-85c3-40f8-a54a-454b7c2f1b61 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:41:27.498374 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-dee7c789-85c3-40f8-a54a-454b7c2f1b61 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:41:27.499156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-dee7c789-85c3-40f8-a54a-454b7c2f1b61 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:41:27.500023 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-dee7c789-85c3-40f8-a54a-454b7c2f1b61 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:41:27.517851 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dee7c789-85c3-40f8-a54a-454b7c2f1b61 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:27.518649 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dee7c789-85c3-40f8-a54a-454b7c2f1b61 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:27.520202 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dee7c789-85c3-40f8-a54a-454b7c2f1b61 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:27.521035 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-dee7c789-85c3-40f8-a54a-454b7c2f1b61 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:27.563879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-dee7c789-85c3-40f8-a54a-454b7c2f1b61 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Getting quotas for project a16a1323e1ae4f7d9b178c43cb15f169. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:41:27.575690 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-dee7c789-85c3-40f8-a54a-454b7c2f1b61 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Getting quotas for user 5063de8e476b4378b1d7bdbfb8526b1c and project a16a1323e1ae4f7d9b178c43cb15f169. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:41:27.595883 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dee7c789-85c3-40f8-a54a-454b7c2f1b61 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:41:27.599500 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-dee7c789-85c3-40f8-a54a-454b7c2f1b61 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:41:27.655922 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-dee7c789-85c3-40f8-a54a-454b7c2f1b61 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.104565 Jul 25 15:41:27.657316 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3903/7581] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:41:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 1108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:41:27.667910 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=16 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:41:27.674904 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3f53e655-5f51-4fa1-911f-b0fdc811e4a9 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:41:27.677009 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3f53e655-5f51-4fa1-911f-b0fdc811e4a9 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:41:27.793511 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3f53e655-5f51-4fa1-911f-b0fdc811e4a9 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:41:27.809210 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3f53e655-5f51-4fa1-911f-b0fdc811e4a9 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1265 microversion: 2.1 time: 0.142780 Jul 25 15:41:27.810478 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3679/7582] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:41:27 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:41:28.854201 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cb97b1e8-0e38-4f84-a629-6dfe233b53ab tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:41:28.854868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cb97b1e8-0e38-4f84-a629-6dfe233b53ab tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:41:28.864067 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb97b1e8-0e38-4f84-a629-6dfe233b53ab tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:28.865189 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb97b1e8-0e38-4f84-a629-6dfe233b53ab tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:28.866282 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb97b1e8-0e38-4f84-a629-6dfe233b53ab tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:28.867076 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cb97b1e8-0e38-4f84-a629-6dfe233b53ab tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:28.953623 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cb97b1e8-0e38-4f84-a629-6dfe233b53ab tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:41:28.964985 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cb97b1e8-0e38-4f84-a629-6dfe233b53ab tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1317 microversion: 2.1 time: 0.123135 Jul 25 15:41:28.980015 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3904/7583] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:41:28 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1317 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:41:30.001583 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-08540ce3-6fa4-4ddb-9f8d-62a1f9992b67 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:41:30.002292 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-08540ce3-6fa4-4ddb-9f8d-62a1f9992b67 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:41:30.014822 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08540ce3-6fa4-4ddb-9f8d-62a1f9992b67 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:30.015418 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08540ce3-6fa4-4ddb-9f8d-62a1f9992b67 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:30.016449 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08540ce3-6fa4-4ddb-9f8d-62a1f9992b67 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:30.017489 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-08540ce3-6fa4-4ddb-9f8d-62a1f9992b67 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:30.310050 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-08540ce3-6fa4-4ddb-9f8d-62a1f9992b67 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:41:30.322400 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-08540ce3-6fa4-4ddb-9f8d-62a1f9992b67 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1390 microversion: 2.1 time: 0.324965 Jul 25 15:41:30.324118 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3680/7584] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:41:29 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1390 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:41:31.344252 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-ab45dc72-79c6-4839-ab22-8deb4707f2ab req-1c022c27-2b56-48b0-928a-179c7567af34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b7074bd-fbd7-4191-a5f7-a54fe332a2f3", "tag": "a265007a-f554-4d84-8872-35b011990011"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:41:31.366625 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-17a18097-e52e-4012-adc8-d199cc4b31a8 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:41:31.368055 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ab45dc72-79c6-4839-ab22-8deb4707f2ab req-1c022c27-2b56-48b0-928a-179c7567af34 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:31.368585 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-ab45dc72-79c6-4839-ab22-8deb4707f2ab req-1c022c27-2b56-48b0-928a-179c7567af34 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:31.368772 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-17a18097-e52e-4012-adc8-d199cc4b31a8 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:41:31.387894 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-17a18097-e52e-4012-adc8-d199cc4b31a8 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:31.389354 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-17a18097-e52e-4012-adc8-d199cc4b31a8 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:31.391297 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-17a18097-e52e-4012-adc8-d199cc4b31a8 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:31.392245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-17a18097-e52e-4012-adc8-d199cc4b31a8 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:31.408566 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-ab45dc72-79c6-4839-ab22-8deb4707f2ab req-1c022c27-2b56-48b0-928a-179c7567af34 service nova] Creating event network-changed:a265007a-f554-4d84-8872-35b011990011 for instance 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 on n-h1-846435-14 Jul 25 15:41:31.444405 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-ab45dc72-79c6-4839-ab22-8deb4707f2ab req-1c022c27-2b56-48b0-928a-179c7567af34 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106260 Jul 25 15:41:31.448230 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3905/7585] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 25 15:41:31.842780 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-17a18097-e52e-4012-adc8-d199cc4b31a8 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:41:31.853584 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-17a18097-e52e-4012-adc8-d199cc4b31a8 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1390 microversion: 2.1 time: 0.496720 Jul 25 15:41:31.854126 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3681/7586] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:41:31 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1390 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:41:32.885490 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-28a6a982-e37e-4577-9582-45147e447ed0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:41:32.886931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-28a6a982-e37e-4577-9582-45147e447ed0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:41:32.898023 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28a6a982-e37e-4577-9582-45147e447ed0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:32.898742 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28a6a982-e37e-4577-9582-45147e447ed0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:32.899841 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28a6a982-e37e-4577-9582-45147e447ed0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:32.900678 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-28a6a982-e37e-4577-9582-45147e447ed0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:33.100169 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-28a6a982-e37e-4577-9582-45147e447ed0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:41:33.112869 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-28a6a982-e37e-4577-9582-45147e447ed0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1390 microversion: 2.1 time: 0.236511 Jul 25 15:41:33.114458 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3906/7587] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:41:32 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1390 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:41:34.142337 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5f78d2b2-743e-4e58-973f-330e3a0e6285 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:41:34.143077 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5f78d2b2-743e-4e58-973f-330e3a0e6285 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:41:34.146678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:41:34.156990 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f78d2b2-743e-4e58-973f-330e3a0e6285 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:34.157801 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f78d2b2-743e-4e58-973f-330e3a0e6285 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:34.159204 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f78d2b2-743e-4e58-973f-330e3a0e6285 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:34.160038 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f78d2b2-743e-4e58-973f-330e3a0e6285 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:34.340055 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5f78d2b2-743e-4e58-973f-330e3a0e6285 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:41:34.349080 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5f78d2b2-743e-4e58-973f-330e3a0e6285 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1390 microversion: 2.1 time: 0.211337 Jul 25 15:41:34.349862 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3682/7588] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:41:34 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1390 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:41:35.381334 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ea9b0ae6-d280-4fa2-8507-5247f1dd37fe tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:41:35.382223 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ea9b0ae6-d280-4fa2-8507-5247f1dd37fe tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:41:35.389860 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea9b0ae6-d280-4fa2-8507-5247f1dd37fe tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:35.390320 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea9b0ae6-d280-4fa2-8507-5247f1dd37fe tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:35.391137 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea9b0ae6-d280-4fa2-8507-5247f1dd37fe tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:35.391586 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ea9b0ae6-d280-4fa2-8507-5247f1dd37fe tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:35.573292 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ea9b0ae6-d280-4fa2-8507-5247f1dd37fe tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:41:35.581792 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ea9b0ae6-d280-4fa2-8507-5247f1dd37fe tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1390 microversion: 2.1 time: 0.208810 Jul 25 15:41:35.582458 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3907/7589] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:41:35 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1390 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:41:36.604257 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7b7a74bf-ac9a-4f51-8f9a-01d30b29b19b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:41:36.604900 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7b7a74bf-ac9a-4f51-8f9a-01d30b29b19b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:41:36.612704 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b7a74bf-ac9a-4f51-8f9a-01d30b29b19b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:36.613164 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b7a74bf-ac9a-4f51-8f9a-01d30b29b19b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:36.613983 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b7a74bf-ac9a-4f51-8f9a-01d30b29b19b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:36.614436 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7b7a74bf-ac9a-4f51-8f9a-01d30b29b19b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:36.758179 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7b7a74bf-ac9a-4f51-8f9a-01d30b29b19b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:41:36.766475 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7b7a74bf-ac9a-4f51-8f9a-01d30b29b19b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1390 microversion: 2.1 time: 0.166622 Jul 25 15:41:36.767081 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3683/7590] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:41:36 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:41:37.180300 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-fdca1c53-84cb-4902-8e2f-a27bae36e561 req-d44c31e9-9511-4566-9c77-bbd651df9c9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b7074bd-fbd7-4191-a5f7-a54fe332a2f3", "name": "network-vif-plugged", "status": "completed", "tag": "a265007a-f554-4d84-8872-35b011990011"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:41:37.196726 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-fdca1c53-84cb-4902-8e2f-a27bae36e561 req-d44c31e9-9511-4566-9c77-bbd651df9c9d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:37.197279 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-fdca1c53-84cb-4902-8e2f-a27bae36e561 req-d44c31e9-9511-4566-9c77-bbd651df9c9d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:37.210580 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-fdca1c53-84cb-4902-8e2f-a27bae36e561 req-d44c31e9-9511-4566-9c77-bbd651df9c9d service nova] Creating event network-vif-plugged:a265007a-f554-4d84-8872-35b011990011 for instance 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 on n-h1-846435-14 Jul 25 15:41:37.216380 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-fdca1c53-84cb-4902-8e2f-a27bae36e561 req-d44c31e9-9511-4566-9c77-bbd651df9c9d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043364 Jul 25 15:41:37.217227 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3908/7591] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:41:37.789049 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5a9661d3-e4d4-45df-8fc6-46d32ebea38e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:41:37.789958 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5a9661d3-e4d4-45df-8fc6-46d32ebea38e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:41:37.798509 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5a9661d3-e4d4-45df-8fc6-46d32ebea38e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:37.799058 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5a9661d3-e4d4-45df-8fc6-46d32ebea38e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:37.800054 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5a9661d3-e4d4-45df-8fc6-46d32ebea38e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:37.800537 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5a9661d3-e4d4-45df-8fc6-46d32ebea38e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:37.801179 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:41:37.978540 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5a9661d3-e4d4-45df-8fc6-46d32ebea38e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:41:37.987947 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5a9661d3-e4d4-45df-8fc6-46d32ebea38e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1390 microversion: 2.1 time: 0.203895 Jul 25 15:41:37.988604 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3684/7592] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:41:37 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1390 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:41:39.007662 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:41:39.008535 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:41:39.014334 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cd563070-2ad7-4d1b-9f9d-6fa15f1cb99a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:41:39.015062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cd563070-2ad7-4d1b-9f9d-6fa15f1cb99a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:41:39.023022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cd563070-2ad7-4d1b-9f9d-6fa15f1cb99a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:39.023485 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cd563070-2ad7-4d1b-9f9d-6fa15f1cb99a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:39.024330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cd563070-2ad7-4d1b-9f9d-6fa15f1cb99a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:39.024725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cd563070-2ad7-4d1b-9f9d-6fa15f1cb99a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:39.182035 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cd563070-2ad7-4d1b-9f9d-6fa15f1cb99a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:41:39.190865 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cd563070-2ad7-4d1b-9f9d-6fa15f1cb99a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1561 microversion: 2.1 time: 0.184146 Jul 25 15:41:39.191501 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3909/7593] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:41:39 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1561 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:41:39.212279 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8c3abe04-3e62-486a-acd1-ad6689168cde tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:41:39.212927 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8c3abe04-3e62-486a-acd1-ad6689168cde tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:41:39.220204 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8c3abe04-3e62-486a-acd1-ad6689168cde tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:39.220658 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8c3abe04-3e62-486a-acd1-ad6689168cde tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:39.221445 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8c3abe04-3e62-486a-acd1-ad6689168cde tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:39.221891 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8c3abe04-3e62-486a-acd1-ad6689168cde tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:39.374473 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8c3abe04-3e62-486a-acd1-ad6689168cde tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:41:39.382923 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8c3abe04-3e62-486a-acd1-ad6689168cde tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1561 microversion: 2.1 time: 0.174917 Jul 25 15:41:39.383533 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3685/7594] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:41:39 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1561 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:41:41.417941 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-dfe86f69-998a-4f29-a7f6-9e900b11043e req-d1dc5378-423c-41f2-9d0f-e35520d9629d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b7074bd-fbd7-4191-a5f7-a54fe332a2f3", "tag": "a265007a-f554-4d84-8872-35b011990011"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:41:41.424198 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1ee6c894-f5f0-49b5-8336-723a5ca9e4e5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:41:41.424869 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1ee6c894-f5f0-49b5-8336-723a5ca9e4e5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:41:41.438074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:41:41.449501 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-dfe86f69-998a-4f29-a7f6-9e900b11043e req-d1dc5378-423c-41f2-9d0f-e35520d9629d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:41.450331 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-dfe86f69-998a-4f29-a7f6-9e900b11043e req-d1dc5378-423c-41f2-9d0f-e35520d9629d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:41.450588 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1ee6c894-f5f0-49b5-8336-723a5ca9e4e5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:41.451071 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1ee6c894-f5f0-49b5-8336-723a5ca9e4e5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:41.452237 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1ee6c894-f5f0-49b5-8336-723a5ca9e4e5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:41:41.452956 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1ee6c894-f5f0-49b5-8336-723a5ca9e4e5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:41:41.467926 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-dfe86f69-998a-4f29-a7f6-9e900b11043e req-d1dc5378-423c-41f2-9d0f-e35520d9629d service nova] Creating event network-changed:a265007a-f554-4d84-8872-35b011990011 for instance 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 on n-h1-846435-14 Jul 25 15:41:41.475223 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-dfe86f69-998a-4f29-a7f6-9e900b11043e req-d1dc5378-423c-41f2-9d0f-e35520d9629d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060901 Jul 25 15:41:41.476654 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3686/7595] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:41:41.657153 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1ee6c894-f5f0-49b5-8336-723a5ca9e4e5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:41:41.666850 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1ee6c894-f5f0-49b5-8336-723a5ca9e4e5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1561 microversion: 2.1 time: 0.254570 Jul 25 15:41:41.667812 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3910/7596] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:41:41 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1561 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:42:08.984417 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3e9f4ca2-d5b9-441e-9c3d-010d271b59a9 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:42:08.986839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3e9f4ca2-d5b9-441e-9c3d-010d271b59a9 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:42:08.989244 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=9 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:42:08.989960 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=38 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:42:08.997889 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3e9f4ca2-d5b9-441e-9c3d-010d271b59a9 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:08.998356 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3e9f4ca2-d5b9-441e-9c3d-010d271b59a9 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:08.999152 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3e9f4ca2-d5b9-441e-9c3d-010d271b59a9 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:08.999593 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3e9f4ca2-d5b9-441e-9c3d-010d271b59a9 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:09.056182 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3e9f4ca2-d5b9-441e-9c3d-010d271b59a9 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "POST /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3/action" status: 200 len: 24571 microversion: 2.1 time: 0.076393 Jul 25 15:42:09.056860 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3687/7597] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:42:08 2022] POST /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3/action => generated 24571 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 15:42:11.305241 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 15:42:11.305996 n-d-846435-14 devstack@n-api.service[119303]: Mon Jul 25 15:42:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 15:42:19.996431 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-11b2c2f9-055b-4347-b179-58d9f2c4f696 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:42:19.998990 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-11b2c2f9-055b-4347-b179-58d9f2c4f696 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:42:20.001773 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:42:20.002475 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=36 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:42:20.009276 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11b2c2f9-055b-4347-b179-58d9f2c4f696 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:20.009855 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11b2c2f9-055b-4347-b179-58d9f2c4f696 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:20.010683 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11b2c2f9-055b-4347-b179-58d9f2c4f696 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:20.011157 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11b2c2f9-055b-4347-b179-58d9f2c4f696 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:20.056563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-11b2c2f9-055b-4347-b179-58d9f2c4f696 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:42:20.069285 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-11b2c2f9-055b-4347-b179-58d9f2c4f696 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Old instance type m1.heat2, new instance type m1.heat {{(pid=119304) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 15:42:20.076730 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-11b2c2f9-055b-4347-b179-58d9f2c4f696 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:42:20.077167 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-11b2c2f9-055b-4347-b179-58d9f2c4f696 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:42:20.077649 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-11b2c2f9-055b-4347-b179-58d9f2c4f696 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:42:20.078065 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-11b2c2f9-055b-4347-b179-58d9f2c4f696 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:42:20.078486 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-11b2c2f9-055b-4347-b179-58d9f2c4f696 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:42:20.150639 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-11b2c2f9-055b-4347-b179-58d9f2c4f696 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "POST /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3/action" status: 202 len: 0 microversion: 2.1 time: 0.158776 Jul 25 15:42:20.152268 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3911/7598] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:42:19 2022] POST /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:42:20.161850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2b430d0c-e4b4-4ef1-97a3-12fa1d3e5ebb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:42:20.162864 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2b430d0c-e4b4-4ef1-97a3-12fa1d3e5ebb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:42:20.167830 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:42:20.169091 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:42:20.178162 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2b430d0c-e4b4-4ef1-97a3-12fa1d3e5ebb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:20.179171 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2b430d0c-e4b4-4ef1-97a3-12fa1d3e5ebb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:20.180441 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2b430d0c-e4b4-4ef1-97a3-12fa1d3e5ebb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:20.181226 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2b430d0c-e4b4-4ef1-97a3-12fa1d3e5ebb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:20.345525 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2b430d0c-e4b4-4ef1-97a3-12fa1d3e5ebb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:42:20.354459 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2b430d0c-e4b4-4ef1-97a3-12fa1d3e5ebb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1689 microversion: 2.1 time: 0.197674 Jul 25 15:42:20.355138 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3688/7599] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:42:20 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1689 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:42:21.376712 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-92ebc554-72b5-44da-bcb1-55c0f9a69f9c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:42:21.377382 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-92ebc554-72b5-44da-bcb1-55c0f9a69f9c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:42:21.384847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-92ebc554-72b5-44da-bcb1-55c0f9a69f9c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:21.385275 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-92ebc554-72b5-44da-bcb1-55c0f9a69f9c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:21.386269 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-92ebc554-72b5-44da-bcb1-55c0f9a69f9c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:21.386720 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-92ebc554-72b5-44da-bcb1-55c0f9a69f9c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:21.552673 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-92ebc554-72b5-44da-bcb1-55c0f9a69f9c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:42:21.561987 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-92ebc554-72b5-44da-bcb1-55c0f9a69f9c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1689 microversion: 2.1 time: 0.189223 Jul 25 15:42:21.562623 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3912/7600] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:42:21 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1689 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:42:22.586959 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3a776b23-0888-4f87-8d0e-2f61932df020 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:42:22.587606 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3a776b23-0888-4f87-8d0e-2f61932df020 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:42:22.596077 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3a776b23-0888-4f87-8d0e-2f61932df020 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:22.596639 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3a776b23-0888-4f87-8d0e-2f61932df020 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:22.597953 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3a776b23-0888-4f87-8d0e-2f61932df020 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:22.598495 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3a776b23-0888-4f87-8d0e-2f61932df020 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:22.758232 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3a776b23-0888-4f87-8d0e-2f61932df020 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:42:22.766469 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3a776b23-0888-4f87-8d0e-2f61932df020 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1694 microversion: 2.1 time: 0.184558 Jul 25 15:42:22.767054 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3689/7601] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:42:22 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1694 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:42:23.792071 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e3c12d19-c112-4ab9-afd5-528781aaf75f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:42:23.792907 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e3c12d19-c112-4ab9-afd5-528781aaf75f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:42:23.805488 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3c12d19-c112-4ab9-afd5-528781aaf75f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:23.805957 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3c12d19-c112-4ab9-afd5-528781aaf75f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:23.806766 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3c12d19-c112-4ab9-afd5-528781aaf75f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:23.807219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e3c12d19-c112-4ab9-afd5-528781aaf75f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:23.961019 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e3c12d19-c112-4ab9-afd5-528781aaf75f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:42:23.969786 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e3c12d19-c112-4ab9-afd5-528781aaf75f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1694 microversion: 2.1 time: 0.181839 Jul 25 15:42:23.970417 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3913/7602] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:42:23 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1694 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:42:24.995508 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3a619655-73f9-45e5-a0ad-a57746298d93 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:42:24.996555 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3a619655-73f9-45e5-a0ad-a57746298d93 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:42:25.007731 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3a619655-73f9-45e5-a0ad-a57746298d93 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:25.008493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3a619655-73f9-45e5-a0ad-a57746298d93 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:25.009766 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3a619655-73f9-45e5-a0ad-a57746298d93 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:25.010248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3a619655-73f9-45e5-a0ad-a57746298d93 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:25.172720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3a619655-73f9-45e5-a0ad-a57746298d93 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:42:25.181899 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3a619655-73f9-45e5-a0ad-a57746298d93 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1694 microversion: 2.1 time: 0.192983 Jul 25 15:42:25.182748 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3690/7603] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:42:24 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1694 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:42:26.204338 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-380d2708-3fbe-47b6-afe0-2a6c4235e6e2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:42:26.204980 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-380d2708-3fbe-47b6-afe0-2a6c4235e6e2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:42:26.212582 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-380d2708-3fbe-47b6-afe0-2a6c4235e6e2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:26.213087 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-380d2708-3fbe-47b6-afe0-2a6c4235e6e2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:26.213975 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-380d2708-3fbe-47b6-afe0-2a6c4235e6e2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:26.214465 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-380d2708-3fbe-47b6-afe0-2a6c4235e6e2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:26.365119 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-380d2708-3fbe-47b6-afe0-2a6c4235e6e2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:42:26.374840 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-380d2708-3fbe-47b6-afe0-2a6c4235e6e2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1694 microversion: 2.1 time: 0.174736 Jul 25 15:42:26.375417 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3914/7604] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:42:26 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1694 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:42:27.397859 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-afe05c8a-0c53-4049-9265-de1afcb994b1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:42:27.398536 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-afe05c8a-0c53-4049-9265-de1afcb994b1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:42:27.406466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-afe05c8a-0c53-4049-9265-de1afcb994b1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:27.406925 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-afe05c8a-0c53-4049-9265-de1afcb994b1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:27.407700 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-afe05c8a-0c53-4049-9265-de1afcb994b1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:27.408187 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-afe05c8a-0c53-4049-9265-de1afcb994b1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:27.559317 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-afe05c8a-0c53-4049-9265-de1afcb994b1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:42:27.568502 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-afe05c8a-0c53-4049-9265-de1afcb994b1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1694 microversion: 2.1 time: 0.174838 Jul 25 15:42:27.569164 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3691/7605] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:42:27 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1694 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:42:28.591351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e89e2826-e3d0-4f39-b92e-30c7232d3db5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:42:28.592053 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e89e2826-e3d0-4f39-b92e-30c7232d3db5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:42:28.599967 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e89e2826-e3d0-4f39-b92e-30c7232d3db5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:28.600463 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e89e2826-e3d0-4f39-b92e-30c7232d3db5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:28.601274 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e89e2826-e3d0-4f39-b92e-30c7232d3db5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:28.602135 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e89e2826-e3d0-4f39-b92e-30c7232d3db5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:28.753995 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e89e2826-e3d0-4f39-b92e-30c7232d3db5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:42:28.762372 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e89e2826-e3d0-4f39-b92e-30c7232d3db5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1694 microversion: 2.1 time: 0.175963 Jul 25 15:42:28.762998 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3915/7606] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:42:28 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1694 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:42:29.783395 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3b50b1ee-53f2-4cfb-88ab-6e351f681a29 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:42:29.784228 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3b50b1ee-53f2-4cfb-88ab-6e351f681a29 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:42:29.792314 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b50b1ee-53f2-4cfb-88ab-6e351f681a29 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:29.792769 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b50b1ee-53f2-4cfb-88ab-6e351f681a29 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:29.793558 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b50b1ee-53f2-4cfb-88ab-6e351f681a29 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:29.794000 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3b50b1ee-53f2-4cfb-88ab-6e351f681a29 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:29.941634 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3b50b1ee-53f2-4cfb-88ab-6e351f681a29 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:42:29.952878 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3b50b1ee-53f2-4cfb-88ab-6e351f681a29 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1694 microversion: 2.1 time: 0.173033 Jul 25 15:42:29.953778 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3692/7607] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:42:29 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1694 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:42:30.978533 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6972d0a8-5702-4761-8d7e-9da0042c3aa3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:42:30.979260 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6972d0a8-5702-4761-8d7e-9da0042c3aa3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:42:30.986928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6972d0a8-5702-4761-8d7e-9da0042c3aa3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:30.987389 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6972d0a8-5702-4761-8d7e-9da0042c3aa3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:30.988224 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6972d0a8-5702-4761-8d7e-9da0042c3aa3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:30.988676 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6972d0a8-5702-4761-8d7e-9da0042c3aa3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:31.142695 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6972d0a8-5702-4761-8d7e-9da0042c3aa3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:42:31.151843 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6972d0a8-5702-4761-8d7e-9da0042c3aa3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1694 microversion: 2.1 time: 0.178130 Jul 25 15:42:31.152490 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3916/7608] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:42:30 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1694 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:42:32.175195 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-11a16720-89f4-44e5-b1ec-15da3a8bf6c4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:42:32.175851 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-11a16720-89f4-44e5-b1ec-15da3a8bf6c4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:42:32.183654 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-11a16720-89f4-44e5-b1ec-15da3a8bf6c4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:32.184924 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-11a16720-89f4-44e5-b1ec-15da3a8bf6c4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:32.185773 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-11a16720-89f4-44e5-b1ec-15da3a8bf6c4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:32.186225 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-11a16720-89f4-44e5-b1ec-15da3a8bf6c4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:32.373613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-11a16720-89f4-44e5-b1ec-15da3a8bf6c4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:42:32.382218 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-11a16720-89f4-44e5-b1ec-15da3a8bf6c4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1694 microversion: 2.1 time: 0.211106 Jul 25 15:42:32.382935 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3693/7609] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:42:32 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1694 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:42:33.403410 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fe3bb0ce-2efb-4c76-a4e6-d8b6eaea0e2b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:42:33.404078 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fe3bb0ce-2efb-4c76-a4e6-d8b6eaea0e2b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:42:33.412721 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fe3bb0ce-2efb-4c76-a4e6-d8b6eaea0e2b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:33.413082 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fe3bb0ce-2efb-4c76-a4e6-d8b6eaea0e2b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:33.413899 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fe3bb0ce-2efb-4c76-a4e6-d8b6eaea0e2b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:33.414348 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fe3bb0ce-2efb-4c76-a4e6-d8b6eaea0e2b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:33.563353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fe3bb0ce-2efb-4c76-a4e6-d8b6eaea0e2b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:42:33.571411 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fe3bb0ce-2efb-4c76-a4e6-d8b6eaea0e2b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1694 microversion: 2.1 time: 0.172108 Jul 25 15:42:33.572016 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3917/7610] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:42:33 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1694 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:42:34.594411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e5125b9e-4bcc-4ac0-beb1-639cf552c972 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:42:34.595025 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e5125b9e-4bcc-4ac0-beb1-639cf552c972 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:42:34.603035 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e5125b9e-4bcc-4ac0-beb1-639cf552c972 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:34.603484 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e5125b9e-4bcc-4ac0-beb1-639cf552c972 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:34.604315 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e5125b9e-4bcc-4ac0-beb1-639cf552c972 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:34.604750 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e5125b9e-4bcc-4ac0-beb1-639cf552c972 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:34.799889 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e5125b9e-4bcc-4ac0-beb1-639cf552c972 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:42:34.809985 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e5125b9e-4bcc-4ac0-beb1-639cf552c972 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1694 microversion: 2.1 time: 0.220294 Jul 25 15:42:34.810518 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3694/7611] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:42:34 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1694 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:42:35.514476 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-74ae0e21-c2ce-424e-bbe3-9c888e086444 req-dcac9be6-2666-45d5-ae54-691fbcc24bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b7074bd-fbd7-4191-a5f7-a54fe332a2f3", "name": "network-vif-unplugged", "status": "completed", "tag": "a265007a-f554-4d84-8872-35b011990011"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:42:35.526590 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-74ae0e21-c2ce-424e-bbe3-9c888e086444 req-dcac9be6-2666-45d5-ae54-691fbcc24bc3 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:35.527045 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-74ae0e21-c2ce-424e-bbe3-9c888e086444 req-dcac9be6-2666-45d5-ae54-691fbcc24bc3 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:35.539829 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-74ae0e21-c2ce-424e-bbe3-9c888e086444 req-dcac9be6-2666-45d5-ae54-691fbcc24bc3 service nova] Creating event network-vif-unplugged:a265007a-f554-4d84-8872-35b011990011 for instance 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 on n-h2-846435-14 Jul 25 15:42:35.549893 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [req-74ae0e21-c2ce-424e-bbe3-9c888e086444 req-dcac9be6-2666-45d5-ae54-691fbcc24bc3 service nova] Instance 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119304) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 15:42:35.563187 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-74ae0e21-c2ce-424e-bbe3-9c888e086444 req-dcac9be6-2666-45d5-ae54-691fbcc24bc3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053039 Jul 25 15:42:35.564737 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3918/7612] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:42:35.832883 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-29c0c9a0-f822-4e44-a1f4-367972f92017 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:42:35.833536 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-29c0c9a0-f822-4e44-a1f4-367972f92017 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:42:35.841836 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-29c0c9a0-f822-4e44-a1f4-367972f92017 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:35.842291 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-29c0c9a0-f822-4e44-a1f4-367972f92017 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:35.843075 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-29c0c9a0-f822-4e44-a1f4-367972f92017 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:35.843624 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-29c0c9a0-f822-4e44-a1f4-367972f92017 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:36.004149 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-29c0c9a0-f822-4e44-a1f4-367972f92017 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:42:36.014473 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-29c0c9a0-f822-4e44-a1f4-367972f92017 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1693 microversion: 2.1 time: 0.185653 Jul 25 15:42:36.028508 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3695/7613] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:42:35 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1693 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:42:37.040183 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2429d013-4266-47ed-a22e-9954961885df tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:42:37.040771 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2429d013-4266-47ed-a22e-9954961885df tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:42:37.048491 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2429d013-4266-47ed-a22e-9954961885df tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:37.048954 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2429d013-4266-47ed-a22e-9954961885df tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:37.049750 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2429d013-4266-47ed-a22e-9954961885df tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:37.050190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2429d013-4266-47ed-a22e-9954961885df tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:37.210058 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2429d013-4266-47ed-a22e-9954961885df tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:42:37.220308 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2429d013-4266-47ed-a22e-9954961885df tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1691 microversion: 2.1 time: 0.185929 Jul 25 15:42:37.221059 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3919/7614] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:42:37 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1691 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:42:37.579309 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-9eb6ba48-a1eb-430d-bf51-427ec43c6617 req-936a46aa-e768-4467-a9fe-d78d149b9880 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b7074bd-fbd7-4191-a5f7-a54fe332a2f3", "tag": "a265007a-f554-4d84-8872-35b011990011"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:42:37.590146 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-9eb6ba48-a1eb-430d-bf51-427ec43c6617 req-936a46aa-e768-4467-a9fe-d78d149b9880 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:37.590609 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-9eb6ba48-a1eb-430d-bf51-427ec43c6617 req-936a46aa-e768-4467-a9fe-d78d149b9880 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:37.603742 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-9eb6ba48-a1eb-430d-bf51-427ec43c6617 req-936a46aa-e768-4467-a9fe-d78d149b9880 service nova] Creating event network-changed:a265007a-f554-4d84-8872-35b011990011 for instance 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 on n-h2-846435-14 Jul 25 15:42:37.610171 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [req-9eb6ba48-a1eb-430d-bf51-427ec43c6617 req-936a46aa-e768-4467-a9fe-d78d149b9880 service nova] Instance 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846435-14', 'n-h1-846435-14'} {{(pid=119303) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 15:42:37.621928 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-9eb6ba48-a1eb-430d-bf51-427ec43c6617 req-936a46aa-e768-4467-a9fe-d78d149b9880 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046452 Jul 25 15:42:37.622570 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3696/7615] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:42:38.244092 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bbfceb58-159e-4739-b0ab-1b62124075cd tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:42:38.244896 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bbfceb58-159e-4739-b0ab-1b62124075cd tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:42:38.254264 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bbfceb58-159e-4739-b0ab-1b62124075cd tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:38.254722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bbfceb58-159e-4739-b0ab-1b62124075cd tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:38.255518 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bbfceb58-159e-4739-b0ab-1b62124075cd tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:38.255964 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bbfceb58-159e-4739-b0ab-1b62124075cd tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:38.416248 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bbfceb58-159e-4739-b0ab-1b62124075cd tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:42:38.425250 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bbfceb58-159e-4739-b0ab-1b62124075cd tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1691 microversion: 2.1 time: 0.185838 Jul 25 15:42:38.426073 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3920/7616] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:42:38 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1691 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:42:39.452529 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7d6c97a8-00cf-4fee-acbd-5d7b2427df00 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:42:39.453714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7d6c97a8-00cf-4fee-acbd-5d7b2427df00 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:42:39.465328 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7d6c97a8-00cf-4fee-acbd-5d7b2427df00 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:39.466297 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7d6c97a8-00cf-4fee-acbd-5d7b2427df00 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:39.467279 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7d6c97a8-00cf-4fee-acbd-5d7b2427df00 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:39.468006 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7d6c97a8-00cf-4fee-acbd-5d7b2427df00 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:39.632458 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7d6c97a8-00cf-4fee-acbd-5d7b2427df00 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:42:39.645772 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7d6c97a8-00cf-4fee-acbd-5d7b2427df00 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1691 microversion: 2.1 time: 0.197197 Jul 25 15:42:39.645772 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3697/7617] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:42:39 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1691 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:42:40.666166 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-65a0da56-660f-4da5-8b29-38d490c63c42 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:42:40.666786 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-65a0da56-660f-4da5-8b29-38d490c63c42 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:42:40.674381 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-65a0da56-660f-4da5-8b29-38d490c63c42 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:40.674841 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-65a0da56-660f-4da5-8b29-38d490c63c42 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:40.675647 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-65a0da56-660f-4da5-8b29-38d490c63c42 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:40.676143 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-65a0da56-660f-4da5-8b29-38d490c63c42 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:40.834174 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-65a0da56-660f-4da5-8b29-38d490c63c42 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:42:40.844112 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-65a0da56-660f-4da5-8b29-38d490c63c42 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1688 microversion: 2.1 time: 0.182202 Jul 25 15:42:40.844742 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3921/7618] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:42:40 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1688 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:42:40.866684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-eaa4661f-5b04-4c2e-91dd-56c2f84d1548 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:42:40.867276 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-eaa4661f-5b04-4c2e-91dd-56c2f84d1548 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:42:40.874768 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eaa4661f-5b04-4c2e-91dd-56c2f84d1548 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:40.875227 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eaa4661f-5b04-4c2e-91dd-56c2f84d1548 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:40.876048 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eaa4661f-5b04-4c2e-91dd-56c2f84d1548 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:40.876709 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-eaa4661f-5b04-4c2e-91dd-56c2f84d1548 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:40.954423 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-eaa4661f-5b04-4c2e-91dd-56c2f84d1548 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "POST /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3/action" status: 204 len: 0 microversion: 2.1 time: 0.091758 Jul 25 15:42:40.955258 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3698/7619] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:42:40 2022] POST /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3/action => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:42:40.964599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-eafcacec-341b-43a2-aaae-97945e06057f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:42:40.965278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-eafcacec-341b-43a2-aaae-97945e06057f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:42:40.972477 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eafcacec-341b-43a2-aaae-97945e06057f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:40.973292 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eafcacec-341b-43a2-aaae-97945e06057f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:40.974235 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eafcacec-341b-43a2-aaae-97945e06057f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:40.974778 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-eafcacec-341b-43a2-aaae-97945e06057f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:41.133042 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-eafcacec-341b-43a2-aaae-97945e06057f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:42:41.146177 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-eafcacec-341b-43a2-aaae-97945e06057f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1688 microversion: 2.1 time: 0.185553 Jul 25 15:42:41.146919 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3922/7620] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:42:40 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1688 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:42:41.170558 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2808e33a-f0e0-4d81-a245-3e1a81245467 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:42:41.172038 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2808e33a-f0e0-4d81-a245-3e1a81245467 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:42:41.178477 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2808e33a-f0e0-4d81-a245-3e1a81245467 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:41.178935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2808e33a-f0e0-4d81-a245-3e1a81245467 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:41.180010 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2808e33a-f0e0-4d81-a245-3e1a81245467 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:41.180648 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2808e33a-f0e0-4d81-a245-3e1a81245467 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:41.432090 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2808e33a-f0e0-4d81-a245-3e1a81245467 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:42:41.441628 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2808e33a-f0e0-4d81-a245-3e1a81245467 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1688 microversion: 2.1 time: 0.275524 Jul 25 15:42:41.452018 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3699/7621] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:42:41 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1688 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:42:42.468002 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0f38157f-00ad-4647-81a2-0a6a6e72dbf2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:42:42.468934 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0f38157f-00ad-4647-81a2-0a6a6e72dbf2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:42:42.476229 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0f38157f-00ad-4647-81a2-0a6a6e72dbf2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:42.477022 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0f38157f-00ad-4647-81a2-0a6a6e72dbf2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:42.478078 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0f38157f-00ad-4647-81a2-0a6a6e72dbf2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:42.478402 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0f38157f-00ad-4647-81a2-0a6a6e72dbf2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:43.006259 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0f38157f-00ad-4647-81a2-0a6a6e72dbf2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:42:43.015036 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0f38157f-00ad-4647-81a2-0a6a6e72dbf2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1680 microversion: 2.1 time: 0.550998 Jul 25 15:42:43.015867 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3923/7622] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:42:42 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1680 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:42:43.341511 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-c1f8b194-517e-4c9e-a1d7-5480f33c876f req-97727f54-2140-4909-89ec-4640a3964058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b7074bd-fbd7-4191-a5f7-a54fe332a2f3", "name": "network-vif-plugged", "status": "completed", "tag": "a265007a-f554-4d84-8872-35b011990011"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:42:43.353247 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c1f8b194-517e-4c9e-a1d7-5480f33c876f req-97727f54-2140-4909-89ec-4640a3964058 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:42:43.353687 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c1f8b194-517e-4c9e-a1d7-5480f33c876f req-97727f54-2140-4909-89ec-4640a3964058 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:42:43.366941 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-c1f8b194-517e-4c9e-a1d7-5480f33c876f req-97727f54-2140-4909-89ec-4640a3964058 service nova] Creating event network-vif-plugged:a265007a-f554-4d84-8872-35b011990011 for instance 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 on n-h2-846435-14 Jul 25 15:42:43.372441 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-c1f8b194-517e-4c9e-a1d7-5480f33c876f req-97727f54-2140-4909-89ec-4640a3964058 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034953 Jul 25 15:42:43.373277 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3700/7623] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:43:15.289047 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=30 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:43:15.289829 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:43:15.353497 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f5e28699-557a-4732-bc4f-6c341132f65d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:43:15.355692 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f5e28699-557a-4732-bc4f-6c341132f65d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:43:15.362745 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5e28699-557a-4732-bc4f-6c341132f65d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:43:15.363220 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5e28699-557a-4732-bc4f-6c341132f65d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:43:15.364057 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5e28699-557a-4732-bc4f-6c341132f65d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:43:15.364510 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f5e28699-557a-4732-bc4f-6c341132f65d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:43:15.422580 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f5e28699-557a-4732-bc4f-6c341132f65d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "POST /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3/action" status: 200 len: 24572 microversion: 2.1 time: 0.140121 Jul 25 15:43:15.423302 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3924/7624] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:43:15 2022] POST /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3/action => generated 24572 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 15:43:39.115430 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=26 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:43:39.117144 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:43:39.119918 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:43:39.120722 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=4 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:43:39.122924 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fac13b62-290a-4d04-8c7f-464386ab7830 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:43:39.123654 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fac13b62-290a-4d04-8c7f-464386ab7830 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:43:39.131517 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fac13b62-290a-4d04-8c7f-464386ab7830 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:43:39.132000 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fac13b62-290a-4d04-8c7f-464386ab7830 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:43:39.133037 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fac13b62-290a-4d04-8c7f-464386ab7830 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:43:39.133478 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fac13b62-290a-4d04-8c7f-464386ab7830 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:43:39.173877 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fac13b62-290a-4d04-8c7f-464386ab7830 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:43:39.188811 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-7f6f8354-eb42-4b2c-9d70-c1c6885a33f1 req-2dc76f20-00f6-4bc9-9b9e-c4f840359a87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b7074bd-fbd7-4191-a5f7-a54fe332a2f3", "tag": "a265007a-f554-4d84-8872-35b011990011"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:43:39.203168 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-7f6f8354-eb42-4b2c-9d70-c1c6885a33f1 req-2dc76f20-00f6-4bc9-9b9e-c4f840359a87 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:43:39.203637 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-7f6f8354-eb42-4b2c-9d70-c1c6885a33f1 req-2dc76f20-00f6-4bc9-9b9e-c4f840359a87 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:43:39.221907 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-7f6f8354-eb42-4b2c-9d70-c1c6885a33f1 req-2dc76f20-00f6-4bc9-9b9e-c4f840359a87 service nova] Creating event network-changed:a265007a-f554-4d84-8872-35b011990011 for instance 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 on n-h2-846435-14 Jul 25 15:43:39.228996 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-7f6f8354-eb42-4b2c-9d70-c1c6885a33f1 req-2dc76f20-00f6-4bc9-9b9e-c4f840359a87 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113540 Jul 25 15:43:39.228996 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3925/7625] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:43:39.310744 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fac13b62-290a-4d04-8c7f-464386ab7830 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "DELETE /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 204 len: 0 microversion: 2.1 time: 0.194719 Jul 25 15:43:39.312296 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3701/7626] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:43:39 2022] DELETE /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:43:39.324848 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-05d4c1bf-1eed-4887-817d-a0b1e8cd2191 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:43:39.326111 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-05d4c1bf-1eed-4887-817d-a0b1e8cd2191 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:43:39.336305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-05d4c1bf-1eed-4887-817d-a0b1e8cd2191 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:43:39.337033 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-05d4c1bf-1eed-4887-817d-a0b1e8cd2191 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:43:39.337906 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-05d4c1bf-1eed-4887-817d-a0b1e8cd2191 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:43:39.338525 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-05d4c1bf-1eed-4887-817d-a0b1e8cd2191 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:43:39.560894 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-05d4c1bf-1eed-4887-817d-a0b1e8cd2191 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:43:39.570727 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-05d4c1bf-1eed-4887-817d-a0b1e8cd2191 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1686 microversion: 2.1 time: 0.253021 Jul 25 15:43:39.571329 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3926/7627] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:43:39 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1686 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:43:40.596669 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-86eb9c45-37d9-423a-821b-c70e58db0bca tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:43:40.597398 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-86eb9c45-37d9-423a-821b-c70e58db0bca tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:43:40.605711 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-86eb9c45-37d9-423a-821b-c70e58db0bca tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:43:40.606171 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-86eb9c45-37d9-423a-821b-c70e58db0bca tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:43:40.606979 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-86eb9c45-37d9-423a-821b-c70e58db0bca tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:43:40.607415 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-86eb9c45-37d9-423a-821b-c70e58db0bca tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:43:40.783296 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-86eb9c45-37d9-423a-821b-c70e58db0bca tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:43:40.792607 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-86eb9c45-37d9-423a-821b-c70e58db0bca tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1686 microversion: 2.1 time: 0.200994 Jul 25 15:43:40.793233 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3702/7628] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:43:40 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1686 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:43:41.723105 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-9df02dc5-7747-48ff-80e7-669815c8dc38 req-2bf89ff8-24d6-4eb2-a420-81f8dbc90ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b7074bd-fbd7-4191-a5f7-a54fe332a2f3", "name": "network-vif-deleted", "tag": "a265007a-f554-4d84-8872-35b011990011"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:43:41.738987 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-9df02dc5-7747-48ff-80e7-669815c8dc38 req-2bf89ff8-24d6-4eb2-a420-81f8dbc90ca8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:43:41.739633 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-9df02dc5-7747-48ff-80e7-669815c8dc38 req-2bf89ff8-24d6-4eb2-a420-81f8dbc90ca8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:43:41.761833 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-9df02dc5-7747-48ff-80e7-669815c8dc38 req-2bf89ff8-24d6-4eb2-a420-81f8dbc90ca8 service nova] Creating event network-vif-deleted:a265007a-f554-4d84-8872-35b011990011 for instance 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 on n-h2-846435-14 Jul 25 15:43:41.769129 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-9df02dc5-7747-48ff-80e7-669815c8dc38 req-2bf89ff8-24d6-4eb2-a420-81f8dbc90ca8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050368 Jul 25 15:43:41.769785 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3927/7629] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:43:41.819661 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4070a665-a7fc-476c-9070-92d40999b5aa tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:43:41.820602 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4070a665-a7fc-476c-9070-92d40999b5aa tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:43:41.833396 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4070a665-a7fc-476c-9070-92d40999b5aa tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:43:41.833889 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4070a665-a7fc-476c-9070-92d40999b5aa tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:43:41.834935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4070a665-a7fc-476c-9070-92d40999b5aa tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:43:41.835390 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4070a665-a7fc-476c-9070-92d40999b5aa tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:43:41.890241 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4070a665-a7fc-476c-9070-92d40999b5aa tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:43:41.890667 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4070a665-a7fc-476c-9070-92d40999b5aa tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:43:41.891174 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-4070a665-a7fc-476c-9070-92d40999b5aa tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lazy-loading 'fault' on Instance uuid 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:43:41.948815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4070a665-a7fc-476c-9070-92d40999b5aa tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:43:41.963253 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4070a665-a7fc-476c-9070-92d40999b5aa tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 200 len: 1355 microversion: 2.1 time: 0.150470 Jul 25 15:43:41.964348 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3703/7630] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:43:41 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 1355 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:43:42.996719 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a0e046f4-5e73-4927-ab28-744b91adb83d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:43:42.997643 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a0e046f4-5e73-4927-ab28-744b91adb83d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:43:43.006230 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a0e046f4-5e73-4927-ab28-744b91adb83d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:43:43.006676 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a0e046f4-5e73-4927-ab28-744b91adb83d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:43:43.007488 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a0e046f4-5e73-4927-ab28-744b91adb83d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:43:43.007943 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a0e046f4-5e73-4927-ab28-744b91adb83d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:43:43.022889 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-a0e046f4-5e73-4927-ab28-744b91adb83d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] HTTP exception thrown: Instance 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 could not be found. Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a0e046f4-5e73-4927-ab28-744b91adb83d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Request method failure captured: Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 HTTP/1.1 Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3rjesYZca3-zg5wdlKOEpTPhAkLj6IXHamAasfg58t3Ilpa049I9OXvWX-bAnAQJHJ7-EsS7XT_5PcwTYuQ1ZW4iBxHhHtUpRCFDZgNrRNC_KvS3yzJK8L0Xe-papm6ljnTIThiR4BhSlyxYZv1rC6Xr4z2ZatqPUTS5ZrTMaiSOTNI Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: a16a1323e1ae4f7d9b178c43cb15f169 Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-151732960 Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a16a1323e1ae4f7d9b178c43cb15f169"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a16a1323e1ae4f7d9b178c43cb15f169"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a16a1323e1ae4f7d9b178c43cb15f169", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a16a1323e1ae4f7d9b178c43cb15f169"}]}] Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-TestNetworkAdvancedServerOps-151732960 Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: a16a1323e1ae4f7d9b178c43cb15f169 Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-151732960 Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-TestNetworkAdvancedServerOps-151732960-project Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 5063de8e476b4378b1d7bdbfb8526b1c Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-TestNetworkAdvancedServerOps-151732960-project Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 could not be found. Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': '2b7074bd-fbd7-4191-a5f7-a54fe332a2f3'} Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 could not be found. Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 could not be found. Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:43:43.024663 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:43:43.036486 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:43:43.036486 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:43:43.036486 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:43:43.036486 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:43:43.036486 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:43:43.036486 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 could not be found. Jul 25 15:43:43.036486 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:43:43.036486 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a0e046f4-5e73-4927-ab28-744b91adb83d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Returning 404 to user: Instance 2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:43:43.036486 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a0e046f4-5e73-4927-ab28-744b91adb83d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3" status: 404 len: 111 microversion: 2.1 time: 0.033920 Jul 25 15:43:43.036486 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3928/7631] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:43:42 2022] GET /compute/v2.1/servers/2b7074bd-fbd7-4191-a5f7-a54fe332a2f3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:43:46.965703 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b4d3582d-f253-4c9d-af18-7957263d320d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '.version_select at 0x7f46864ff790>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:43:46.971728 n-d-846435-14 devstack@n-api.service[119303]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b4d3582d-f253-4c9d-af18-7957263d320d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [2c2acd86-cda7-44eb-a5d9-ff251265bcd2] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 15:43:47.981429 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [None req-b4d3582d-f253-4c9d-af18-7957263d320d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [2c2acd86-cda7-44eb-a5d9-ff251265bcd2] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 53152. Jul 25 15:43:48.006202 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b4d3582d-f253-4c9d-af18-7957263d320d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-629754140" status: 202 len: 0 microversion: 2.1 time: 1.047579 Jul 25 15:43:48.006972 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3704/7632] 10.222.0.88 () {58 vars in 1281 bytes} [Mon Jul 25 15:43:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-629754140 => generated 0 bytes in 1049 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:43:48.045261 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7e1b145c-fc58-43b6-b007-9e4a9516b0b1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Action: 'create', calling method: .version_select at 0x7f46864d53a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-883185771", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBamu8uAToR/DpwuxsLz3v31dxFUoZCW/kFmYjQVpLBJyPZuc/llQD7ZVUAzh3DR8XlX6s4hv+14h1L9TL3Mme4tgzGl4o2WzUJY1HBloQvElrjMxZwm8oCnE7oi+PpYUA=="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:43:48.066661 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-7e1b145c-fc58-43b6-b007-9e4a9516b0b1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Getting quotas for project a16a1323e1ae4f7d9b178c43cb15f169. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:43:48.073407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-7e1b145c-fc58-43b6-b007-9e4a9516b0b1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Getting quotas for user 5063de8e476b4378b1d7bdbfb8526b1c and project a16a1323e1ae4f7d9b178c43cb15f169. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:43:48.110518 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7e1b145c-fc58-43b6-b007-9e4a9516b0b1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.068759 Jul 25 15:43:48.110843 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3929/7633] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 15:43:48 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:43:56.055454 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:43:56.061638 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f28047ec-4a19-4453-b49d-cef7945b5d3c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-105234811", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "51b91c76-b58f-4de5-8a51-be292513b30e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-883185771", "security_groups": [{"name": "tempest-secgroup-smoke-700656426"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:43:56.241296 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-f28047ec-4a19-4453-b49d-cef7945b5d3c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] validate_networks() for [('51b91c76-b58f-4de5-8a51-be292513b30e', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:43:56.907182 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-f28047ec-4a19-4453-b49d-cef7945b5d3c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:43:56.907623 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-f28047ec-4a19-4453-b49d-cef7945b5d3c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:43:56.908410 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-f28047ec-4a19-4453-b49d-cef7945b5d3c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:43:56.908918 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-f28047ec-4a19-4453-b49d-cef7945b5d3c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:43:56.909383 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-f28047ec-4a19-4453-b49d-cef7945b5d3c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:43:56.924335 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f28047ec-4a19-4453-b49d-cef7945b5d3c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:43:56.924831 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f28047ec-4a19-4453-b49d-cef7945b5d3c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:43:56.926035 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f28047ec-4a19-4453-b49d-cef7945b5d3c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:43:56.926779 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f28047ec-4a19-4453-b49d-cef7945b5d3c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:43:56.963254 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-f28047ec-4a19-4453-b49d-cef7945b5d3c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Getting quotas for project a16a1323e1ae4f7d9b178c43cb15f169. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:43:56.975995 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-f28047ec-4a19-4453-b49d-cef7945b5d3c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Getting quotas for user 5063de8e476b4378b1d7bdbfb8526b1c and project a16a1323e1ae4f7d9b178c43cb15f169. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:43:57.003752 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f28047ec-4a19-4453-b49d-cef7945b5d3c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:43:57.008203 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f28047ec-4a19-4453-b49d-cef7945b5d3c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:43:57.114881 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f28047ec-4a19-4453-b49d-cef7945b5d3c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.060784 Jul 25 15:43:57.117808 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3705/7634] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:43:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 1064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:43:57.133940 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8877f374-41f5-455a-b131-964c0c21f6bc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:43:57.138771 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8877f374-41f5-455a-b131-964c0c21f6bc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:43:57.146206 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=12 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:43:57.286284 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8877f374-41f5-455a-b131-964c0c21f6bc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:43:57.308018 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8877f374-41f5-455a-b131-964c0c21f6bc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 200 len: 1265 microversion: 2.1 time: 0.183159 Jul 25 15:43:57.326529 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3930/7635] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:43:57 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:43:58.357191 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-19c6e0d2-f801-48c8-a1f5-e4fddb1e6ce5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:43:58.358257 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-19c6e0d2-f801-48c8-a1f5-e4fddb1e6ce5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:43:58.509804 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-19c6e0d2-f801-48c8-a1f5-e4fddb1e6ce5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:43:58.523382 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-19c6e0d2-f801-48c8-a1f5-e4fddb1e6ce5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 200 len: 1265 microversion: 2.1 time: 0.176668 Jul 25 15:43:58.533050 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3706/7636] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:43:58 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:43:59.556191 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-aad64240-e98d-4049-a323-37faf589f311 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:43:59.558159 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-aad64240-e98d-4049-a323-37faf589f311 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:43:59.685195 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-aad64240-e98d-4049-a323-37faf589f311 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:43:59.697500 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-aad64240-e98d-4049-a323-37faf589f311 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 200 len: 1265 microversion: 2.1 time: 0.147061 Jul 25 15:43:59.708044 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3931/7637] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:43:59 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:44:00.735662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6360b47b-3404-45da-9e05-3d52f50701f5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:44:00.736649 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6360b47b-3404-45da-9e05-3d52f50701f5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:44:00.810389 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6360b47b-3404-45da-9e05-3d52f50701f5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:44:00.819095 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6360b47b-3404-45da-9e05-3d52f50701f5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 200 len: 1265 microversion: 2.1 time: 0.089448 Jul 25 15:44:00.819949 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3707/7638] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:44:00 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:44:01.843038 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-07d44815-7c71-4664-b3b6-8e5afd4fd2bc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:44:01.843868 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-07d44815-7c71-4664-b3b6-8e5afd4fd2bc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:44:01.855840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-07d44815-7c71-4664-b3b6-8e5afd4fd2bc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:01.856707 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-07d44815-7c71-4664-b3b6-8e5afd4fd2bc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:01.858114 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-07d44815-7c71-4664-b3b6-8e5afd4fd2bc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:01.858897 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-07d44815-7c71-4664-b3b6-8e5afd4fd2bc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:01.939309 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-07d44815-7c71-4664-b3b6-8e5afd4fd2bc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:44:01.953446 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-07d44815-7c71-4664-b3b6-8e5afd4fd2bc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 200 len: 1269 microversion: 2.1 time: 0.114406 Jul 25 15:44:01.954689 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3932/7639] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:44:01 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 1269 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:44:02.989004 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2f170f65-e324-43f6-9a4d-f4f048e2025b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:44:02.989986 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2f170f65-e324-43f6-9a4d-f4f048e2025b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:44:02.998102 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f170f65-e324-43f6-9a4d-f4f048e2025b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:02.998568 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f170f65-e324-43f6-9a4d-f4f048e2025b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:02.999443 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f170f65-e324-43f6-9a4d-f4f048e2025b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:02.999962 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2f170f65-e324-43f6-9a4d-f4f048e2025b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:03.122536 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2f170f65-e324-43f6-9a4d-f4f048e2025b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:44:03.134718 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2f170f65-e324-43f6-9a4d-f4f048e2025b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 200 len: 1323 microversion: 2.1 time: 0.151057 Jul 25 15:44:03.135754 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3708/7640] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:44:02 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 1323 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:44:04.163933 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-94a2d71b-316c-49ce-9b82-9aaee1b785bb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:44:04.164990 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-94a2d71b-316c-49ce-9b82-9aaee1b785bb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:44:04.173592 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94a2d71b-316c-49ce-9b82-9aaee1b785bb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:04.174184 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94a2d71b-316c-49ce-9b82-9aaee1b785bb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:04.175260 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94a2d71b-316c-49ce-9b82-9aaee1b785bb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:04.175781 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-94a2d71b-316c-49ce-9b82-9aaee1b785bb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:04.377837 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-94a2d71b-316c-49ce-9b82-9aaee1b785bb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:44:04.391178 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-94a2d71b-316c-49ce-9b82-9aaee1b785bb tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 200 len: 1390 microversion: 2.1 time: 0.231248 Jul 25 15:44:04.392046 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3933/7641] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:44:04 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 1390 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:44:04.850470 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-7f5974b0-cca7-4c42-8a31-06ff95218092 req-7770f16f-07ee-4358-a63c-ac1620c18614 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03086479-40a6-47ab-8ac6-62f9dc6ee71a", "tag": "6119725c-481c-4f52-9345-c7d7adf299a7"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:44:04.889982 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-7f5974b0-cca7-4c42-8a31-06ff95218092 req-7770f16f-07ee-4358-a63c-ac1620c18614 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:04.890720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-7f5974b0-cca7-4c42-8a31-06ff95218092 req-7770f16f-07ee-4358-a63c-ac1620c18614 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:04.914902 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-7f5974b0-cca7-4c42-8a31-06ff95218092 req-7770f16f-07ee-4358-a63c-ac1620c18614 service nova] Creating event network-changed:6119725c-481c-4f52-9345-c7d7adf299a7 for instance 03086479-40a6-47ab-8ac6-62f9dc6ee71a on n-h1-846435-14 Jul 25 15:44:04.928060 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-7f5974b0-cca7-4c42-8a31-06ff95218092 req-7770f16f-07ee-4358-a63c-ac1620c18614 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090271 Jul 25 15:44:04.930078 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3709/7642] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:44:05.426734 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b51930a7-0d7e-4473-b08d-cabde4243552 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:44:05.428395 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b51930a7-0d7e-4473-b08d-cabde4243552 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:44:05.439212 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b51930a7-0d7e-4473-b08d-cabde4243552 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:05.439685 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b51930a7-0d7e-4473-b08d-cabde4243552 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:05.440626 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b51930a7-0d7e-4473-b08d-cabde4243552 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:05.441334 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b51930a7-0d7e-4473-b08d-cabde4243552 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:05.646885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b51930a7-0d7e-4473-b08d-cabde4243552 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:44:05.655384 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b51930a7-0d7e-4473-b08d-cabde4243552 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 200 len: 1390 microversion: 2.1 time: 0.235616 Jul 25 15:44:05.656029 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3934/7643] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:44:05 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 1390 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:44:06.678686 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-46316342-cbf8-4f18-9ae0-91249b61927a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:44:06.680117 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-46316342-cbf8-4f18-9ae0-91249b61927a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:44:06.688767 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46316342-cbf8-4f18-9ae0-91249b61927a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:06.689215 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46316342-cbf8-4f18-9ae0-91249b61927a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:06.690065 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46316342-cbf8-4f18-9ae0-91249b61927a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:06.690499 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46316342-cbf8-4f18-9ae0-91249b61927a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:06.936953 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-46316342-cbf8-4f18-9ae0-91249b61927a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:44:06.944069 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:44:06.947623 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-46316342-cbf8-4f18-9ae0-91249b61927a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 200 len: 1390 microversion: 2.1 time: 0.273008 Jul 25 15:44:06.947865 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3710/7644] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:44:06 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 1390 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:44:07.975436 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f30d841a-0d92-4055-a540-3cf4ea7ebf8a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:44:07.976440 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f30d841a-0d92-4055-a540-3cf4ea7ebf8a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:44:07.989341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f30d841a-0d92-4055-a540-3cf4ea7ebf8a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:07.989833 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f30d841a-0d92-4055-a540-3cf4ea7ebf8a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:07.990797 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f30d841a-0d92-4055-a540-3cf4ea7ebf8a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:07.991252 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f30d841a-0d92-4055-a540-3cf4ea7ebf8a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:08.145035 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f30d841a-0d92-4055-a540-3cf4ea7ebf8a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:44:08.153408 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f30d841a-0d92-4055-a540-3cf4ea7ebf8a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 200 len: 1390 microversion: 2.1 time: 0.186353 Jul 25 15:44:08.153989 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3935/7645] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:44:07 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 1390 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:44:09.175966 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e09e77a1-f9c8-4595-8e22-77e069fd37b3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:44:09.176637 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e09e77a1-f9c8-4595-8e22-77e069fd37b3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:44:09.179112 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:44:09.185375 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e09e77a1-f9c8-4595-8e22-77e069fd37b3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:09.185836 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e09e77a1-f9c8-4595-8e22-77e069fd37b3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:09.186631 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e09e77a1-f9c8-4595-8e22-77e069fd37b3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:09.187051 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e09e77a1-f9c8-4595-8e22-77e069fd37b3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:09.339821 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e09e77a1-f9c8-4595-8e22-77e069fd37b3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:44:09.348521 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e09e77a1-f9c8-4595-8e22-77e069fd37b3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 200 len: 1390 microversion: 2.1 time: 0.177297 Jul 25 15:44:09.349210 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3711/7646] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:44:09 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 1390 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:44:10.371322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-abebc210-45c0-4e7b-bed7-f0fe736bd397 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:44:10.371997 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-abebc210-45c0-4e7b-bed7-f0fe736bd397 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:44:10.375108 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=8 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:44:10.375879 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:44:10.383668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-abebc210-45c0-4e7b-bed7-f0fe736bd397 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:10.384184 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-abebc210-45c0-4e7b-bed7-f0fe736bd397 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:10.384996 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-abebc210-45c0-4e7b-bed7-f0fe736bd397 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:10.385462 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-abebc210-45c0-4e7b-bed7-f0fe736bd397 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:10.538055 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-abebc210-45c0-4e7b-bed7-f0fe736bd397 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:44:10.549096 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-abebc210-45c0-4e7b-bed7-f0fe736bd397 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 200 len: 1390 microversion: 2.1 time: 0.182263 Jul 25 15:44:10.549698 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3936/7647] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:44:10 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 1390 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:44:11.570638 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a92f1776-e3e9-402d-b465-38b3894019dc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:44:11.571382 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a92f1776-e3e9-402d-b465-38b3894019dc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:44:11.574165 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=10 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:44:11.582839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a92f1776-e3e9-402d-b465-38b3894019dc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:11.583287 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a92f1776-e3e9-402d-b465-38b3894019dc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:11.584483 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a92f1776-e3e9-402d-b465-38b3894019dc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:11.584930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a92f1776-e3e9-402d-b465-38b3894019dc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:11.749287 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-0f8bf5c7-b63d-4f7b-88b3-77528b633663 req-f10c9d60-0dbf-49fe-936e-82e1438913a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03086479-40a6-47ab-8ac6-62f9dc6ee71a", "name": "network-vif-plugged", "status": "completed", "tag": "6119725c-481c-4f52-9345-c7d7adf299a7"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:44:11.759361 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-0f8bf5c7-b63d-4f7b-88b3-77528b633663 req-f10c9d60-0dbf-49fe-936e-82e1438913a8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:11.759829 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-0f8bf5c7-b63d-4f7b-88b3-77528b633663 req-f10c9d60-0dbf-49fe-936e-82e1438913a8 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:11.765085 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a92f1776-e3e9-402d-b465-38b3894019dc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:44:11.773746 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a92f1776-e3e9-402d-b465-38b3894019dc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 200 len: 1390 microversion: 2.1 time: 0.207197 Jul 25 15:44:11.774373 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3712/7648] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:44:11 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 1390 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:44:11.778077 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-0f8bf5c7-b63d-4f7b-88b3-77528b633663 req-f10c9d60-0dbf-49fe-936e-82e1438913a8 service nova] Creating event network-vif-plugged:6119725c-481c-4f52-9345-c7d7adf299a7 for instance 03086479-40a6-47ab-8ac6-62f9dc6ee71a on n-h1-846435-14 Jul 25 15:44:11.789499 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-0f8bf5c7-b63d-4f7b-88b3-77528b633663 req-f10c9d60-0dbf-49fe-936e-82e1438913a8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106162 Jul 25 15:44:11.790144 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3937/7649] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:44:12.795412 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-67e088c8-0dc9-4b4a-91ff-c47abd3bd33a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:44:12.796161 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-67e088c8-0dc9-4b4a-91ff-c47abd3bd33a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:44:12.804178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-67e088c8-0dc9-4b4a-91ff-c47abd3bd33a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:12.804646 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-67e088c8-0dc9-4b4a-91ff-c47abd3bd33a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:12.805455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-67e088c8-0dc9-4b4a-91ff-c47abd3bd33a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:12.805897 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-67e088c8-0dc9-4b4a-91ff-c47abd3bd33a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:12.972667 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-67e088c8-0dc9-4b4a-91ff-c47abd3bd33a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:44:12.981199 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-67e088c8-0dc9-4b4a-91ff-c47abd3bd33a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 200 len: 1390 microversion: 2.1 time: 0.189842 Jul 25 15:44:12.981802 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3713/7650] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:44:12 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 1390 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:44:14.005552 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ad53b9e8-3d96-4872-814b-03b9499ab9e3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:44:14.006325 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ad53b9e8-3d96-4872-814b-03b9499ab9e3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:44:14.013536 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad53b9e8-3d96-4872-814b-03b9499ab9e3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:14.014007 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad53b9e8-3d96-4872-814b-03b9499ab9e3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:14.014826 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad53b9e8-3d96-4872-814b-03b9499ab9e3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:14.015278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad53b9e8-3d96-4872-814b-03b9499ab9e3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:14.177139 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ad53b9e8-3d96-4872-814b-03b9499ab9e3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:44:14.184644 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ad53b9e8-3d96-4872-814b-03b9499ab9e3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 200 len: 1562 microversion: 2.1 time: 0.184547 Jul 25 15:44:14.185205 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3938/7651] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:44:13 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 1562 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:44:14.205683 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8180ee19-ee15-433e-b3c3-27bbf22576ea tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:44:14.206292 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8180ee19-ee15-433e-b3c3-27bbf22576ea tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:44:14.213893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8180ee19-ee15-433e-b3c3-27bbf22576ea tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:14.214350 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8180ee19-ee15-433e-b3c3-27bbf22576ea tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:14.215148 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8180ee19-ee15-433e-b3c3-27bbf22576ea tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:14.215889 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8180ee19-ee15-433e-b3c3-27bbf22576ea tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:14.376718 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8180ee19-ee15-433e-b3c3-27bbf22576ea tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:44:14.386356 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8180ee19-ee15-433e-b3c3-27bbf22576ea tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 200 len: 1562 microversion: 2.1 time: 0.184661 Jul 25 15:44:14.386959 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3714/7652] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:44:14 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 1562 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:44:16.736829 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bc41c68c-4f24-4fdc-93d8-82e68df58b04 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:44:16.737626 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bc41c68c-4f24-4fdc-93d8-82e68df58b04 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:44:16.746231 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-2d962808-b731-4287-a61b-c4a388c1d205 req-5c045778-e4ca-41d6-a717-32d3aefd8037 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03086479-40a6-47ab-8ac6-62f9dc6ee71a", "tag": "6119725c-481c-4f52-9345-c7d7adf299a7"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:44:16.749985 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bc41c68c-4f24-4fdc-93d8-82e68df58b04 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:16.750645 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bc41c68c-4f24-4fdc-93d8-82e68df58b04 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:16.751555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bc41c68c-4f24-4fdc-93d8-82e68df58b04 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:16.752051 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-bc41c68c-4f24-4fdc-93d8-82e68df58b04 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:16.759278 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-2d962808-b731-4287-a61b-c4a388c1d205 req-5c045778-e4ca-41d6-a717-32d3aefd8037 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:16.759745 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-2d962808-b731-4287-a61b-c4a388c1d205 req-5c045778-e4ca-41d6-a717-32d3aefd8037 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:16.773814 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-2d962808-b731-4287-a61b-c4a388c1d205 req-5c045778-e4ca-41d6-a717-32d3aefd8037 service nova] Creating event network-changed:6119725c-481c-4f52-9345-c7d7adf299a7 for instance 03086479-40a6-47ab-8ac6-62f9dc6ee71a on n-h1-846435-14 Jul 25 15:44:16.780013 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-2d962808-b731-4287-a61b-c4a388c1d205 req-5c045778-e4ca-41d6-a717-32d3aefd8037 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044349 Jul 25 15:44:16.780936 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3715/7653] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:44:16.950432 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bc41c68c-4f24-4fdc-93d8-82e68df58b04 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:44:16.962775 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bc41c68c-4f24-4fdc-93d8-82e68df58b04 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 200 len: 1562 microversion: 2.1 time: 0.230334 Jul 25 15:44:16.963417 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3939/7654] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:44:16 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 1562 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:44:40.334498 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=9 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:44:40.335341 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=42 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:44:40.339944 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7031e518-4ff5-4df6-a04e-794c04f22147 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:44:40.342365 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7031e518-4ff5-4df6-a04e-794c04f22147 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:44:40.350684 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7031e518-4ff5-4df6-a04e-794c04f22147 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:40.351149 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7031e518-4ff5-4df6-a04e-794c04f22147 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:40.351945 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7031e518-4ff5-4df6-a04e-794c04f22147 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:40.352450 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7031e518-4ff5-4df6-a04e-794c04f22147 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:40.408685 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7031e518-4ff5-4df6-a04e-794c04f22147 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "POST /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a/action" status: 200 len: 24563 microversion: 2.1 time: 0.075500 Jul 25 15:44:40.409485 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3716/7655] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:44:40 2022] POST /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a/action => generated 24563 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 15:44:51.452905 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-143b5353-5836-41c1-8496-8e81dd5f92aa tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:44:51.455757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=7 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:44:51.456535 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=44 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:44:51.463817 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-143b5353-5836-41c1-8496-8e81dd5f92aa tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:51.464320 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-143b5353-5836-41c1-8496-8e81dd5f92aa tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:51.492925 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-143b5353-5836-41c1-8496-8e81dd5f92aa tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Going to try to stop instance {{(pid=119304) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 15:44:51.550999 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-143b5353-5836-41c1-8496-8e81dd5f92aa tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "POST /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a/action" status: 202 len: 0 microversion: 2.1 time: 0.101948 Jul 25 15:44:51.551648 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3940/7656] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:44:51 2022] POST /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 15:44:51.561948 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-67ec95d2-97f1-4743-847c-6f022c68e95f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:44:51.563619 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-67ec95d2-97f1-4743-847c-6f022c68e95f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:44:51.568772 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:44:51.568772 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:44:51.575388 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-67ec95d2-97f1-4743-847c-6f022c68e95f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:51.576098 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-67ec95d2-97f1-4743-847c-6f022c68e95f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:51.576931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-67ec95d2-97f1-4743-847c-6f022c68e95f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:51.577381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-67ec95d2-97f1-4743-847c-6f022c68e95f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:51.907254 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-67ec95d2-97f1-4743-847c-6f022c68e95f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:44:51.917218 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-67ec95d2-97f1-4743-847c-6f022c68e95f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 200 len: 1690 microversion: 2.1 time: 0.359762 Jul 25 15:44:51.917976 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3717/7657] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:44:51 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 1690 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:44:52.942721 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f7d024db-b38f-4508-b8a4-af3cfd4057e4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:44:52.943446 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f7d024db-b38f-4508-b8a4-af3cfd4057e4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:44:52.951018 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f7d024db-b38f-4508-b8a4-af3cfd4057e4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:52.951484 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f7d024db-b38f-4508-b8a4-af3cfd4057e4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:52.952338 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f7d024db-b38f-4508-b8a4-af3cfd4057e4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:52.952782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f7d024db-b38f-4508-b8a4-af3cfd4057e4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:53.211588 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f7d024db-b38f-4508-b8a4-af3cfd4057e4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:44:53.221291 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f7d024db-b38f-4508-b8a4-af3cfd4057e4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 200 len: 1690 microversion: 2.1 time: 0.284902 Jul 25 15:44:53.221909 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3941/7658] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:44:52 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 1690 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:44:54.244531 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-206c1d2d-66dd-482b-b0a1-5f13bbf46755 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:44:54.245189 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-206c1d2d-66dd-482b-b0a1-5f13bbf46755 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:44:54.252770 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-206c1d2d-66dd-482b-b0a1-5f13bbf46755 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:54.253223 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-206c1d2d-66dd-482b-b0a1-5f13bbf46755 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:54.254212 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-206c1d2d-66dd-482b-b0a1-5f13bbf46755 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:54.254950 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-206c1d2d-66dd-482b-b0a1-5f13bbf46755 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:54.430997 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-206c1d2d-66dd-482b-b0a1-5f13bbf46755 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:44:54.440134 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-206c1d2d-66dd-482b-b0a1-5f13bbf46755 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 200 len: 1690 microversion: 2.1 time: 0.199604 Jul 25 15:44:54.440733 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3718/7659] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:44:54 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 1690 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:44:55.463514 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5d7b1501-993e-4f9f-a46e-d66b560ace8f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:44:55.464465 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5d7b1501-993e-4f9f-a46e-d66b560ace8f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:44:55.472734 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d7b1501-993e-4f9f-a46e-d66b560ace8f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:55.473202 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d7b1501-993e-4f9f-a46e-d66b560ace8f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:55.474344 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d7b1501-993e-4f9f-a46e-d66b560ace8f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:55.474799 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5d7b1501-993e-4f9f-a46e-d66b560ace8f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:55.664365 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5d7b1501-993e-4f9f-a46e-d66b560ace8f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:44:55.674092 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5d7b1501-993e-4f9f-a46e-d66b560ace8f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 200 len: 1690 microversion: 2.1 time: 0.215215 Jul 25 15:44:55.674705 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3942/7660] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:44:55 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 1690 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:44:56.710723 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-15e88b2f-ef9b-4cb6-81ec-9d4d8d3d09c5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:44:56.711492 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-15e88b2f-ef9b-4cb6-81ec-9d4d8d3d09c5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:44:56.718930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-15e88b2f-ef9b-4cb6-81ec-9d4d8d3d09c5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:56.719389 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-15e88b2f-ef9b-4cb6-81ec-9d4d8d3d09c5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:56.720248 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-15e88b2f-ef9b-4cb6-81ec-9d4d8d3d09c5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:56.720783 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-15e88b2f-ef9b-4cb6-81ec-9d4d8d3d09c5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:56.917093 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-15e88b2f-ef9b-4cb6-81ec-9d4d8d3d09c5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:44:56.926233 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-15e88b2f-ef9b-4cb6-81ec-9d4d8d3d09c5 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 200 len: 1690 microversion: 2.1 time: 0.220986 Jul 25 15:44:56.926983 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3719/7661] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:44:56 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 1690 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:44:57.950329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-11954745-be5e-401f-a2e6-c0bdf7d1e203 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:44:57.950969 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-11954745-be5e-401f-a2e6-c0bdf7d1e203 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:44:57.960470 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11954745-be5e-401f-a2e6-c0bdf7d1e203 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:57.960930 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11954745-be5e-401f-a2e6-c0bdf7d1e203 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:57.961770 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11954745-be5e-401f-a2e6-c0bdf7d1e203 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:57.962285 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-11954745-be5e-401f-a2e6-c0bdf7d1e203 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:58.124123 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-11954745-be5e-401f-a2e6-c0bdf7d1e203 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:44:58.133790 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-11954745-be5e-401f-a2e6-c0bdf7d1e203 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 200 len: 1690 microversion: 2.1 time: 0.187690 Jul 25 15:44:58.134504 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3943/7662] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:44:57 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 1690 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:44:59.156297 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-296623cf-616f-481b-9b16-825a0eb87d04 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:44:59.157195 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-296623cf-616f-481b-9b16-825a0eb87d04 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:44:59.165224 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-296623cf-616f-481b-9b16-825a0eb87d04 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:59.165673 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-296623cf-616f-481b-9b16-825a0eb87d04 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:59.166473 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-296623cf-616f-481b-9b16-825a0eb87d04 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:44:59.166910 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-296623cf-616f-481b-9b16-825a0eb87d04 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:44:59.327057 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-296623cf-616f-481b-9b16-825a0eb87d04 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:44:59.336616 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-296623cf-616f-481b-9b16-825a0eb87d04 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 200 len: 1690 microversion: 2.1 time: 0.184394 Jul 25 15:44:59.337462 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3720/7663] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:44:59 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 1690 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:45:00.373993 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e32f46c3-b06e-4ff5-9b3f-46e290dafcd1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:45:00.374584 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e32f46c3-b06e-4ff5-9b3f-46e290dafcd1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:45:00.383260 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e32f46c3-b06e-4ff5-9b3f-46e290dafcd1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:00.384116 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e32f46c3-b06e-4ff5-9b3f-46e290dafcd1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:00.384957 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e32f46c3-b06e-4ff5-9b3f-46e290dafcd1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:00.385538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e32f46c3-b06e-4ff5-9b3f-46e290dafcd1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:00.538173 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e32f46c3-b06e-4ff5-9b3f-46e290dafcd1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:45:00.546569 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e32f46c3-b06e-4ff5-9b3f-46e290dafcd1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 200 len: 1690 microversion: 2.1 time: 0.177034 Jul 25 15:45:00.547186 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3944/7664] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:45:00 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 1690 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:45:01.568965 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-00fdf768-f799-49f2-b5c9-c27fb7dbe422 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:45:01.569633 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-00fdf768-f799-49f2-b5c9-c27fb7dbe422 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:45:01.577549 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00fdf768-f799-49f2-b5c9-c27fb7dbe422 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:01.579175 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00fdf768-f799-49f2-b5c9-c27fb7dbe422 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:01.579175 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00fdf768-f799-49f2-b5c9-c27fb7dbe422 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:01.579421 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-00fdf768-f799-49f2-b5c9-c27fb7dbe422 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:01.742882 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-00fdf768-f799-49f2-b5c9-c27fb7dbe422 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:45:01.750998 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-00fdf768-f799-49f2-b5c9-c27fb7dbe422 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 200 len: 1690 microversion: 2.1 time: 0.186007 Jul 25 15:45:01.753039 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3721/7665] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:45:01 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 1690 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:45:02.778372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-25388714-49c3-486b-b604-2202e84333e4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:45:02.778948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-25388714-49c3-486b-b604-2202e84333e4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:45:02.787250 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25388714-49c3-486b-b604-2202e84333e4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:02.787716 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25388714-49c3-486b-b604-2202e84333e4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:02.788543 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25388714-49c3-486b-b604-2202e84333e4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:02.788993 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-25388714-49c3-486b-b604-2202e84333e4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:02.952063 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-25388714-49c3-486b-b604-2202e84333e4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:45:02.960340 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-25388714-49c3-486b-b604-2202e84333e4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 200 len: 1667 microversion: 2.1 time: 0.185913 Jul 25 15:45:02.960932 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3945/7666] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:45:02 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 1667 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:45:04.076503 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e2b043db-3c61-486a-b58d-47bfe5a92ef3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:45:04.079397 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e2b043db-3c61-486a-b58d-47bfe5a92ef3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:45:04.087027 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e2b043db-3c61-486a-b58d-47bfe5a92ef3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:04.087485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e2b043db-3c61-486a-b58d-47bfe5a92ef3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:04.088339 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e2b043db-3c61-486a-b58d-47bfe5a92ef3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:04.088782 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e2b043db-3c61-486a-b58d-47bfe5a92ef3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:04.151632 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e2b043db-3c61-486a-b58d-47bfe5a92ef3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "POST /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a/action" status: 200 len: 37724 microversion: 2.1 time: 0.078883 Jul 25 15:45:04.152300 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3722/7667] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:45:04 2022] POST /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a/action => generated 37724 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 15:45:04.165341 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7c1f6ef8-a1a0-4f33-9327-6f0086480bf2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:45:04.173071 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7c1f6ef8-a1a0-4f33-9327-6f0086480bf2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:04.173545 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7c1f6ef8-a1a0-4f33-9327-6f0086480bf2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:04.199226 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7c1f6ef8-a1a0-4f33-9327-6f0086480bf2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Going to try to start instance {{(pid=119304) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 15:45:04.247736 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7c1f6ef8-a1a0-4f33-9327-6f0086480bf2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "POST /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a/action" status: 202 len: 0 microversion: 2.1 time: 0.086470 Jul 25 15:45:04.248434 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3946/7668] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:45:04 2022] POST /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:45:04.259854 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-539c49d9-66c9-4347-98d6-23f97712193b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:45:04.261066 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-539c49d9-66c9-4347-98d6-23f97712193b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:45:04.271106 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-539c49d9-66c9-4347-98d6-23f97712193b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:04.271735 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-539c49d9-66c9-4347-98d6-23f97712193b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:04.272583 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-539c49d9-66c9-4347-98d6-23f97712193b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:04.273029 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-539c49d9-66c9-4347-98d6-23f97712193b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:04.526100 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-539c49d9-66c9-4347-98d6-23f97712193b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:45:04.541254 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-539c49d9-66c9-4347-98d6-23f97712193b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 200 len: 1676 microversion: 2.1 time: 0.286426 Jul 25 15:45:04.542449 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3723/7669] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:45:04 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 1676 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:45:05.583567 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-76663271-136c-4d09-8182-06fa6b0a0cd1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:45:05.584659 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-76663271-136c-4d09-8182-06fa6b0a0cd1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:45:05.592026 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-76663271-136c-4d09-8182-06fa6b0a0cd1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:05.592502 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-76663271-136c-4d09-8182-06fa6b0a0cd1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:05.593330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-76663271-136c-4d09-8182-06fa6b0a0cd1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:05.593786 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-76663271-136c-4d09-8182-06fa6b0a0cd1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:05.766535 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-76663271-136c-4d09-8182-06fa6b0a0cd1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:45:05.776261 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-76663271-136c-4d09-8182-06fa6b0a0cd1 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 200 len: 1680 microversion: 2.1 time: 0.199926 Jul 25 15:45:05.776895 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3947/7670] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:45:05 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 1680 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:45:29.986111 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e33a7195-7007-4ac8-b6f5-9c4ff640ffa0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:45:29.988354 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e33a7195-7007-4ac8-b6f5-9c4ff640ffa0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:45:29.991312 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=14 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:45:29.991995 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=40 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:45:29.998780 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e33a7195-7007-4ac8-b6f5-9c4ff640ffa0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:29.999231 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e33a7195-7007-4ac8-b6f5-9c4ff640ffa0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:30.000073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e33a7195-7007-4ac8-b6f5-9c4ff640ffa0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:30.000905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e33a7195-7007-4ac8-b6f5-9c4ff640ffa0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:30.057703 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e33a7195-7007-4ac8-b6f5-9c4ff640ffa0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "POST /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a/action" status: 200 len: 62285 microversion: 2.1 time: 0.075201 Jul 25 15:45:30.058461 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3724/7671] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:45:29 2022] POST /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a/action => generated 62285 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 15:45:33.809378 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 15:45:33.810178 n-d-846435-14 devstack@n-api.service[119304]: Mon Jul 25 15:45:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 15:45:37.305438 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-29074511-4eb6-4aa0-b647-29855cab5d56 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:45:37.306109 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-29074511-4eb6-4aa0-b647-29855cab5d56 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:45:37.308795 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=16 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:45:37.309478 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:45:37.312341 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-45aff6b9-91e5-4160-a0c6-8c77784a0f00 req-b05c452f-fa30-447a-a2dc-c7e5639d40d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03086479-40a6-47ab-8ac6-62f9dc6ee71a", "tag": "6119725c-481c-4f52-9345-c7d7adf299a7"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:45:37.316960 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-29074511-4eb6-4aa0-b647-29855cab5d56 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:37.317423 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-29074511-4eb6-4aa0-b647-29855cab5d56 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:37.318215 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-29074511-4eb6-4aa0-b647-29855cab5d56 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:37.318640 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-29074511-4eb6-4aa0-b647-29855cab5d56 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:37.336706 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-45aff6b9-91e5-4160-a0c6-8c77784a0f00 req-b05c452f-fa30-447a-a2dc-c7e5639d40d0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:37.337149 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-45aff6b9-91e5-4160-a0c6-8c77784a0f00 req-b05c452f-fa30-447a-a2dc-c7e5639d40d0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:37.351712 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-45aff6b9-91e5-4160-a0c6-8c77784a0f00 req-b05c452f-fa30-447a-a2dc-c7e5639d40d0 service nova] Creating event network-changed:6119725c-481c-4f52-9345-c7d7adf299a7 for instance 03086479-40a6-47ab-8ac6-62f9dc6ee71a on n-h1-846435-14 Jul 25 15:45:37.353014 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-29074511-4eb6-4aa0-b647-29855cab5d56 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:45:37.358637 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-45aff6b9-91e5-4160-a0c6-8c77784a0f00 req-b05c452f-fa30-447a-a2dc-c7e5639d40d0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054875 Jul 25 15:45:37.360344 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3725/7672] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:45:37.453674 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-29074511-4eb6-4aa0-b647-29855cab5d56 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "DELETE /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 204 len: 0 microversion: 2.1 time: 0.152369 Jul 25 15:45:37.456059 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3948/7673] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:45:37 2022] DELETE /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:45:37.465285 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-052ae855-e9c4-429e-82c6-b7e6e13eaf2f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:45:37.466302 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-052ae855-e9c4-429e-82c6-b7e6e13eaf2f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:45:37.476228 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-052ae855-e9c4-429e-82c6-b7e6e13eaf2f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:37.476994 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-052ae855-e9c4-429e-82c6-b7e6e13eaf2f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:37.477982 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-052ae855-e9c4-429e-82c6-b7e6e13eaf2f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:37.478572 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-052ae855-e9c4-429e-82c6-b7e6e13eaf2f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:37.664896 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-052ae855-e9c4-429e-82c6-b7e6e13eaf2f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:45:37.673357 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-052ae855-e9c4-429e-82c6-b7e6e13eaf2f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 200 len: 1686 microversion: 2.1 time: 0.213278 Jul 25 15:45:37.674428 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3726/7674] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:45:37 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 1686 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:45:38.698125 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-732269e7-f492-4300-b796-6c73d7b6cdd2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:45:38.699013 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-732269e7-f492-4300-b796-6c73d7b6cdd2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:45:38.708427 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-732269e7-f492-4300-b796-6c73d7b6cdd2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:38.709143 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-732269e7-f492-4300-b796-6c73d7b6cdd2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:38.710047 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-732269e7-f492-4300-b796-6c73d7b6cdd2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:38.710577 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-732269e7-f492-4300-b796-6c73d7b6cdd2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:38.878978 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-732269e7-f492-4300-b796-6c73d7b6cdd2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:45:38.889521 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-732269e7-f492-4300-b796-6c73d7b6cdd2 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 200 len: 1686 microversion: 2.1 time: 0.195424 Jul 25 15:45:38.890651 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3949/7675] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:45:38 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 1686 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:45:39.499429 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-d19721df-8aff-4955-9eb3-d00cd441d0c5 req-b4403a2a-dd73-4983-b0d8-e90eaf041ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03086479-40a6-47ab-8ac6-62f9dc6ee71a", "name": "network-vif-deleted", "tag": "6119725c-481c-4f52-9345-c7d7adf299a7"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:45:39.511584 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-d19721df-8aff-4955-9eb3-d00cd441d0c5 req-b4403a2a-dd73-4983-b0d8-e90eaf041ea0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:39.512044 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-d19721df-8aff-4955-9eb3-d00cd441d0c5 req-b4403a2a-dd73-4983-b0d8-e90eaf041ea0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:39.525759 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-d19721df-8aff-4955-9eb3-d00cd441d0c5 req-b4403a2a-dd73-4983-b0d8-e90eaf041ea0 service nova] Creating event network-vif-deleted:6119725c-481c-4f52-9345-c7d7adf299a7 for instance 03086479-40a6-47ab-8ac6-62f9dc6ee71a on n-h1-846435-14 Jul 25 15:45:39.535351 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-d19721df-8aff-4955-9eb3-d00cd441d0c5 req-b4403a2a-dd73-4983-b0d8-e90eaf041ea0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039640 Jul 25 15:45:39.536009 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3727/7676] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:45:39.914017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5fb1c5a2-03b5-4d3e-a0a4-502b1b12151c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:45:39.914934 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5fb1c5a2-03b5-4d3e-a0a4-502b1b12151c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:45:39.923463 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5fb1c5a2-03b5-4d3e-a0a4-502b1b12151c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:39.924102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5fb1c5a2-03b5-4d3e-a0a4-502b1b12151c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:39.925019 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5fb1c5a2-03b5-4d3e-a0a4-502b1b12151c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:39.926689 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5fb1c5a2-03b5-4d3e-a0a4-502b1b12151c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:39.964667 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5fb1c5a2-03b5-4d3e-a0a4-502b1b12151c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:39.965130 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5fb1c5a2-03b5-4d3e-a0a4-502b1b12151c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:39.965677 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-5fb1c5a2-03b5-4d3e-a0a4-502b1b12151c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lazy-loading 'fault' on Instance uuid 03086479-40a6-47ab-8ac6-62f9dc6ee71a {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:45:40.019055 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5fb1c5a2-03b5-4d3e-a0a4-502b1b12151c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:45:40.027114 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5fb1c5a2-03b5-4d3e-a0a4-502b1b12151c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 200 len: 1355 microversion: 2.1 time: 0.117455 Jul 25 15:45:40.027561 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3950/7677] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:45:39 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 1355 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:45:41.052360 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b4dcd484-620f-4c4c-b9b0-88f5cd06b65d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:45:41.053092 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b4dcd484-620f-4c4c-b9b0-88f5cd06b65d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: 03086479-40a6-47ab-8ac6-62f9dc6ee71a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:45:41.060509 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b4dcd484-620f-4c4c-b9b0-88f5cd06b65d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:41.060995 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b4dcd484-620f-4c4c-b9b0-88f5cd06b65d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:41.062037 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b4dcd484-620f-4c4c-b9b0-88f5cd06b65d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:41.062555 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b4dcd484-620f-4c4c-b9b0-88f5cd06b65d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:41.080752 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-b4dcd484-620f-4c4c-b9b0-88f5cd06b65d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] HTTP exception thrown: Instance 03086479-40a6-47ab-8ac6-62f9dc6ee71a could not be found. Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b4dcd484-620f-4c4c-b9b0-88f5cd06b65d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Request method failure captured: Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a HTTP/1.1 Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rjesYZca3-zg5wdlKOEpTPhAkLj6IXHamAasfg58t3Ilpa049I9OXvWX-bAnAQJHJ7-EsS7XT_5PcwTYuQ1ZW4iBxHhHtUpRCFDZgNrRNC_KvS3yzJK8L0Xe-papm6ljnTIThiR4BhSlyxYZv1rC6Xr4z2ZatqPUTS5ZrTMaiSOTNI Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: a16a1323e1ae4f7d9b178c43cb15f169 Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-151732960 Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a16a1323e1ae4f7d9b178c43cb15f169"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a16a1323e1ae4f7d9b178c43cb15f169"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a16a1323e1ae4f7d9b178c43cb15f169", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a16a1323e1ae4f7d9b178c43cb15f169"}]}] Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-TestNetworkAdvancedServerOps-151732960 Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: a16a1323e1ae4f7d9b178c43cb15f169 Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-151732960 Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-TestNetworkAdvancedServerOps-151732960-project Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: 5063de8e476b4378b1d7bdbfb8526b1c Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-TestNetworkAdvancedServerOps-151732960-project Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 03086479-40a6-47ab-8ac6-62f9dc6ee71a could not be found. Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '03086479-40a6-47ab-8ac6-62f9dc6ee71a'} Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03086479-40a6-47ab-8ac6-62f9dc6ee71a could not be found. Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03086479-40a6-47ab-8ac6-62f9dc6ee71a could not be found. Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:45:41.082448 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:45:41.089625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:45:41.089625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:45:41.089625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:45:41.089625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:45:41.089625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:45:41.089625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03086479-40a6-47ab-8ac6-62f9dc6ee71a could not be found. Jul 25 15:45:41.089625 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:45:41.089625 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b4dcd484-620f-4c4c-b9b0-88f5cd06b65d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Returning 404 to user: Instance 03086479-40a6-47ab-8ac6-62f9dc6ee71a could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:45:41.089625 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b4dcd484-620f-4c4c-b9b0-88f5cd06b65d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a" status: 404 len: 111 microversion: 2.1 time: 0.038120 Jul 25 15:45:41.089625 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3728/7678] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:45:41 2022] GET /compute/v2.1/servers/03086479-40a6-47ab-8ac6-62f9dc6ee71a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:45:44.908366 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fbcf063a-bc84-48fe-942e-dbc319750638 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '.version_select at 0x7f46862e1790>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:45:44.940477 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fbcf063a-bc84-48fe-942e-dbc319750638 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-883185771" status: 202 len: 0 microversion: 2.1 time: 0.037473 Jul 25 15:45:44.941994 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3951/7679] 10.222.0.88 () {58 vars in 1281 bytes} [Mon Jul 25 15:45:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-883185771 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:45:44.982798 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-56ed06a1-38a9-423d-a042-04c585a20eda tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Action: 'create', calling method: .version_select at 0x7f468642d670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-376815543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1ZwAYPJabSsu/92GbGJDqUam312qyvAdFpabjrb3tcg0pR+Tbj7yN9lnU8Mft337EX7LNXDbjp5ILNs0ntYz62I+s+oEKFfbBZyGMDd3aTeBQJNOj5Nf9j6bYzXGoA4g=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:45:45.004614 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-56ed06a1-38a9-423d-a042-04c585a20eda tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Getting quotas for project a16a1323e1ae4f7d9b178c43cb15f169. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:45:45.010853 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-56ed06a1-38a9-423d-a042-04c585a20eda tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Getting quotas for user 5063de8e476b4378b1d7bdbfb8526b1c and project a16a1323e1ae4f7d9b178c43cb15f169. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:45:45.040197 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-56ed06a1-38a9-423d-a042-04c585a20eda tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.062584 Jul 25 15:45:45.041044 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3729/7680] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 15:45:44 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:45:52.031862 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:45:52.042538 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ee4b7518-23fb-47c4-903c-a18671fb10f4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2138465832", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "networks": [{"uuid": "d3602ec5-0f83-475d-a894-f8cffed62849"}], "key_name": "tempest-TestNetworkAdvancedServerOps-376815543", "security_groups": [{"name": "tempest-secgroup-smoke-1390971880"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:45:52.192281 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-ee4b7518-23fb-47c4-903c-a18671fb10f4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] validate_networks() for [('d3602ec5-0f83-475d-a894-f8cffed62849', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:45:52.682213 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-ee4b7518-23fb-47c4-903c-a18671fb10f4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:45:52.684205 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-ee4b7518-23fb-47c4-903c-a18671fb10f4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:45:52.684205 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-ee4b7518-23fb-47c4-903c-a18671fb10f4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:45:52.684205 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-ee4b7518-23fb-47c4-903c-a18671fb10f4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:45:52.684205 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-ee4b7518-23fb-47c4-903c-a18671fb10f4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:45:52.694829 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee4b7518-23fb-47c4-903c-a18671fb10f4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:52.695295 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee4b7518-23fb-47c4-903c-a18671fb10f4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:52.696287 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee4b7518-23fb-47c4-903c-a18671fb10f4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:52.696748 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ee4b7518-23fb-47c4-903c-a18671fb10f4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:52.716361 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-ee4b7518-23fb-47c4-903c-a18671fb10f4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Getting quotas for project a16a1323e1ae4f7d9b178c43cb15f169. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:45:52.722080 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-ee4b7518-23fb-47c4-903c-a18671fb10f4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Getting quotas for user 5063de8e476b4378b1d7bdbfb8526b1c and project a16a1323e1ae4f7d9b178c43cb15f169. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:45:52.737412 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ee4b7518-23fb-47c4-903c-a18671fb10f4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:45:52.739891 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ee4b7518-23fb-47c4-903c-a18671fb10f4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: d987ecb1-d9e6-4703-8c92-66205078f92a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:45:52.790136 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ee4b7518-23fb-47c4-903c-a18671fb10f4 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.760336 Jul 25 15:45:52.791043 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3952/7681] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:45:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:45:52.799869 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=16 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:45:52.805086 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-07a2a494-6307-4fc5-8528-07e6791285bf tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:45:52.805721 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-07a2a494-6307-4fc5-8528-07e6791285bf tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: d987ecb1-d9e6-4703-8c92-66205078f92a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:45:52.868499 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-07a2a494-6307-4fc5-8528-07e6791285bf tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:45:52.877775 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-07a2a494-6307-4fc5-8528-07e6791285bf tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a" status: 200 len: 1266 microversion: 2.1 time: 0.079232 Jul 25 15:45:52.878320 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3730/7682] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:45:52 2022] GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:45:53.905820 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-409a647b-9ed7-426c-bf25-b809a82870af tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:45:53.907932 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-409a647b-9ed7-426c-bf25-b809a82870af tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: d987ecb1-d9e6-4703-8c92-66205078f92a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:45:53.922306 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-409a647b-9ed7-426c-bf25-b809a82870af tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:53.925812 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-409a647b-9ed7-426c-bf25-b809a82870af tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:53.927442 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-409a647b-9ed7-426c-bf25-b809a82870af tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:53.930881 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-409a647b-9ed7-426c-bf25-b809a82870af tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:54.012246 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-409a647b-9ed7-426c-bf25-b809a82870af tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:45:54.033798 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-409a647b-9ed7-426c-bf25-b809a82870af tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a" status: 200 len: 1318 microversion: 2.1 time: 0.138594 Jul 25 15:45:54.034420 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3953/7683] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:45:53 2022] GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a => generated 1318 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:45:55.056232 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d0d5aa60-c31b-4ff9-8d0a-bef629f92a8b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:45:55.057561 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d0d5aa60-c31b-4ff9-8d0a-bef629f92a8b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: d987ecb1-d9e6-4703-8c92-66205078f92a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:45:55.070338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d0d5aa60-c31b-4ff9-8d0a-bef629f92a8b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:55.070799 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d0d5aa60-c31b-4ff9-8d0a-bef629f92a8b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:55.071628 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d0d5aa60-c31b-4ff9-8d0a-bef629f92a8b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:55.073282 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d0d5aa60-c31b-4ff9-8d0a-bef629f92a8b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:55.370520 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d0d5aa60-c31b-4ff9-8d0a-bef629f92a8b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:45:55.395111 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d0d5aa60-c31b-4ff9-8d0a-bef629f92a8b tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a" status: 200 len: 1392 microversion: 2.1 time: 0.340410 Jul 25 15:45:55.411571 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3731/7684] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:45:55 2022] GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a => generated 1392 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:45:56.011754 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-e6f34b40-5e36-493b-b0bd-c7f4a14febc8 req-a169eafb-32ea-4228-a884-577766026703 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d987ecb1-d9e6-4703-8c92-66205078f92a", "tag": "0bc9fbb5-702c-48c7-b161-ac25f36aa766"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:45:56.037678 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-e6f34b40-5e36-493b-b0bd-c7f4a14febc8 req-a169eafb-32ea-4228-a884-577766026703 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:56.038672 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-e6f34b40-5e36-493b-b0bd-c7f4a14febc8 req-a169eafb-32ea-4228-a884-577766026703 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:56.055193 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-e6f34b40-5e36-493b-b0bd-c7f4a14febc8 req-a169eafb-32ea-4228-a884-577766026703 service nova] Creating event network-changed:0bc9fbb5-702c-48c7-b161-ac25f36aa766 for instance d987ecb1-d9e6-4703-8c92-66205078f92a on n-h2-846435-14 Jul 25 15:45:56.061300 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-e6f34b40-5e36-493b-b0bd-c7f4a14febc8 req-a169eafb-32ea-4228-a884-577766026703 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057329 Jul 25 15:45:56.064767 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3954/7685] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:45:56.418282 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b3c80328-c42f-40a7-a0ef-4cfd4699a6ac tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:45:56.418887 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b3c80328-c42f-40a7-a0ef-4cfd4699a6ac tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: d987ecb1-d9e6-4703-8c92-66205078f92a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:45:56.426621 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3c80328-c42f-40a7-a0ef-4cfd4699a6ac tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:56.427079 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3c80328-c42f-40a7-a0ef-4cfd4699a6ac tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:56.427874 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3c80328-c42f-40a7-a0ef-4cfd4699a6ac tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:56.428372 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b3c80328-c42f-40a7-a0ef-4cfd4699a6ac tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:56.582058 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b3c80328-c42f-40a7-a0ef-4cfd4699a6ac tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:45:56.595697 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b3c80328-c42f-40a7-a0ef-4cfd4699a6ac tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a" status: 200 len: 1392 microversion: 2.1 time: 0.181389 Jul 25 15:45:56.596345 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3732/7686] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:45:56 2022] GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a => generated 1392 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:45:57.620472 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e7a9af61-2f0f-4d4f-8bab-a61a330e99b6 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:45:57.621081 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e7a9af61-2f0f-4d4f-8bab-a61a330e99b6 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: d987ecb1-d9e6-4703-8c92-66205078f92a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:45:57.628707 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e7a9af61-2f0f-4d4f-8bab-a61a330e99b6 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:57.629205 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e7a9af61-2f0f-4d4f-8bab-a61a330e99b6 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:57.630023 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e7a9af61-2f0f-4d4f-8bab-a61a330e99b6 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:57.630472 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e7a9af61-2f0f-4d4f-8bab-a61a330e99b6 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:57.786146 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e7a9af61-2f0f-4d4f-8bab-a61a330e99b6 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:45:57.795084 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e7a9af61-2f0f-4d4f-8bab-a61a330e99b6 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a" status: 200 len: 1392 microversion: 2.1 time: 0.180656 Jul 25 15:45:57.795950 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3955/7687] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:45:57 2022] GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a => generated 1392 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:45:58.817585 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dcbbc866-538f-466c-8270-711a3514f148 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:45:58.818453 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-dcbbc866-538f-466c-8270-711a3514f148 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: d987ecb1-d9e6-4703-8c92-66205078f92a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:45:58.826072 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dcbbc866-538f-466c-8270-711a3514f148 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:58.826531 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dcbbc866-538f-466c-8270-711a3514f148 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:58.827342 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dcbbc866-538f-466c-8270-711a3514f148 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:45:58.827786 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dcbbc866-538f-466c-8270-711a3514f148 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:45:59.122109 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-dcbbc866-538f-466c-8270-711a3514f148 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:45:59.131493 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dcbbc866-538f-466c-8270-711a3514f148 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a" status: 200 len: 1392 microversion: 2.1 time: 0.317849 Jul 25 15:45:59.132098 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3733/7688] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:45:58 2022] GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a => generated 1392 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:46:00.156219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3c976b08-b25a-4eef-93ee-beaf6ae162bc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:46:00.157139 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3c976b08-b25a-4eef-93ee-beaf6ae162bc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: d987ecb1-d9e6-4703-8c92-66205078f92a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:46:00.165916 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c976b08-b25a-4eef-93ee-beaf6ae162bc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:46:00.166285 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c976b08-b25a-4eef-93ee-beaf6ae162bc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:46:00.167102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c976b08-b25a-4eef-93ee-beaf6ae162bc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:46:00.167553 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c976b08-b25a-4eef-93ee-beaf6ae162bc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:46:00.346653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3c976b08-b25a-4eef-93ee-beaf6ae162bc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:46:00.356623 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3c976b08-b25a-4eef-93ee-beaf6ae162bc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a" status: 200 len: 1392 microversion: 2.1 time: 0.206294 Jul 25 15:46:00.357487 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3956/7689] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:46:00 2022] GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a => generated 1392 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:46:01.380089 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8f9b35b3-d643-4bf8-9f2b-449cc31be13f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:46:01.380796 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8f9b35b3-d643-4bf8-9f2b-449cc31be13f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: d987ecb1-d9e6-4703-8c92-66205078f92a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:46:01.383444 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:46:01.389858 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f9b35b3-d643-4bf8-9f2b-449cc31be13f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:46:01.390329 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f9b35b3-d643-4bf8-9f2b-449cc31be13f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:46:01.391208 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f9b35b3-d643-4bf8-9f2b-449cc31be13f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:46:01.391695 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8f9b35b3-d643-4bf8-9f2b-449cc31be13f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:46:01.551363 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8f9b35b3-d643-4bf8-9f2b-449cc31be13f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:46:01.559739 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8f9b35b3-d643-4bf8-9f2b-449cc31be13f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a" status: 200 len: 1392 microversion: 2.1 time: 0.183981 Jul 25 15:46:01.560384 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3734/7690] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:46:01 2022] GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a => generated 1392 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:46:02.201918 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-053643b0-57aa-4adb-ad28-823abe527b82 req-d1180aad-f325-4709-8b14-9139169cd65c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d987ecb1-d9e6-4703-8c92-66205078f92a", "name": "network-vif-plugged", "status": "completed", "tag": "0bc9fbb5-702c-48c7-b161-ac25f36aa766"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:46:02.214502 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-053643b0-57aa-4adb-ad28-823abe527b82 req-d1180aad-f325-4709-8b14-9139169cd65c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:46:02.214971 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-053643b0-57aa-4adb-ad28-823abe527b82 req-d1180aad-f325-4709-8b14-9139169cd65c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:46:02.228253 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-053643b0-57aa-4adb-ad28-823abe527b82 req-d1180aad-f325-4709-8b14-9139169cd65c service nova] Creating event network-vif-plugged:0bc9fbb5-702c-48c7-b161-ac25f36aa766 for instance d987ecb1-d9e6-4703-8c92-66205078f92a on n-h2-846435-14 Jul 25 15:46:02.234341 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-053643b0-57aa-4adb-ad28-823abe527b82 req-d1180aad-f325-4709-8b14-9139169cd65c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036579 Jul 25 15:46:02.235137 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3957/7691] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:46:02.583910 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c3668f6f-31a4-485c-b9b7-c5bfdc00d69d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:46:02.584914 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c3668f6f-31a4-485c-b9b7-c5bfdc00d69d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: d987ecb1-d9e6-4703-8c92-66205078f92a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:46:02.596382 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c3668f6f-31a4-485c-b9b7-c5bfdc00d69d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:46:02.597054 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c3668f6f-31a4-485c-b9b7-c5bfdc00d69d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:46:02.598633 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c3668f6f-31a4-485c-b9b7-c5bfdc00d69d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:46:02.599320 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c3668f6f-31a4-485c-b9b7-c5bfdc00d69d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:46:02.777731 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c3668f6f-31a4-485c-b9b7-c5bfdc00d69d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:46:02.786565 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c3668f6f-31a4-485c-b9b7-c5bfdc00d69d tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a" status: 200 len: 1392 microversion: 2.1 time: 0.209542 Jul 25 15:46:02.787183 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3735/7692] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:46:02 2022] GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a => generated 1392 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:46:03.819294 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:46:03.820112 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:46:03.826333 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e8324866-d2fc-4caa-a587-331a3345d8fd tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:46:03.827069 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e8324866-d2fc-4caa-a587-331a3345d8fd tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: d987ecb1-d9e6-4703-8c92-66205078f92a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:46:03.834708 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e8324866-d2fc-4caa-a587-331a3345d8fd tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:46:03.835166 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e8324866-d2fc-4caa-a587-331a3345d8fd tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:46:03.835953 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e8324866-d2fc-4caa-a587-331a3345d8fd tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:46:03.836417 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e8324866-d2fc-4caa-a587-331a3345d8fd tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:46:03.983732 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e8324866-d2fc-4caa-a587-331a3345d8fd tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:46:03.992380 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e8324866-d2fc-4caa-a587-331a3345d8fd tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a" status: 200 len: 1564 microversion: 2.1 time: 0.174086 Jul 25 15:46:03.992983 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3958/7693] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:46:03 2022] GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a => generated 1564 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:46:04.014001 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-50074407-f747-4ea4-8d58-af46fcd9f3ed tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:46:04.014953 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-50074407-f747-4ea4-8d58-af46fcd9f3ed tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: d987ecb1-d9e6-4703-8c92-66205078f92a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:46:04.017159 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:46:04.024614 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-50074407-f747-4ea4-8d58-af46fcd9f3ed tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:46:04.025066 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-50074407-f747-4ea4-8d58-af46fcd9f3ed tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:46:04.025846 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-50074407-f747-4ea4-8d58-af46fcd9f3ed tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:46:04.026290 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-50074407-f747-4ea4-8d58-af46fcd9f3ed tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:46:04.173238 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-50074407-f747-4ea4-8d58-af46fcd9f3ed tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:46:04.182859 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-50074407-f747-4ea4-8d58-af46fcd9f3ed tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a" status: 200 len: 1564 microversion: 2.1 time: 0.172909 Jul 25 15:46:04.183472 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3736/7694] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:46:04 2022] GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a => generated 1564 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:46:06.313997 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-65550590-c4e4-40fd-9d84-8b841ac2e45c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:46:06.315025 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-28b15181-33ef-446f-9147-2053a2f56e8a req-3e590652-c941-4c1a-9865-2fff62f38599 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d987ecb1-d9e6-4703-8c92-66205078f92a", "tag": "0bc9fbb5-702c-48c7-b161-ac25f36aa766"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:46:06.316095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-65550590-c4e4-40fd-9d84-8b841ac2e45c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: d987ecb1-d9e6-4703-8c92-66205078f92a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:46:06.326433 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-65550590-c4e4-40fd-9d84-8b841ac2e45c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:46:06.327215 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-28b15181-33ef-446f-9147-2053a2f56e8a req-3e590652-c941-4c1a-9865-2fff62f38599 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:46:06.327588 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-65550590-c4e4-40fd-9d84-8b841ac2e45c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:46:06.327816 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-28b15181-33ef-446f-9147-2053a2f56e8a req-3e590652-c941-4c1a-9865-2fff62f38599 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:46:06.329053 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-65550590-c4e4-40fd-9d84-8b841ac2e45c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:46:06.329737 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-65550590-c4e4-40fd-9d84-8b841ac2e45c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:46:06.341033 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-28b15181-33ef-446f-9147-2053a2f56e8a req-3e590652-c941-4c1a-9865-2fff62f38599 service nova] Creating event network-changed:0bc9fbb5-702c-48c7-b161-ac25f36aa766 for instance d987ecb1-d9e6-4703-8c92-66205078f92a on n-h2-846435-14 Jul 25 15:46:06.346544 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-28b15181-33ef-446f-9147-2053a2f56e8a req-3e590652-c941-4c1a-9865-2fff62f38599 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035129 Jul 25 15:46:06.347586 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3737/7695] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:46:06.492536 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-65550590-c4e4-40fd-9d84-8b841ac2e45c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:46:06.502403 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-65550590-c4e4-40fd-9d84-8b841ac2e45c tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a" status: 200 len: 1564 microversion: 2.1 time: 0.192624 Jul 25 15:46:06.504013 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3959/7696] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:46:06 2022] GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a => generated 1564 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:46:41.831496 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=7 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:46:41.832525 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=38 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:46:41.837414 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3d5a515d-a4fb-48ec-912b-2024c9e5e254 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:46:41.839712 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3d5a515d-a4fb-48ec-912b-2024c9e5e254 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: d987ecb1-d9e6-4703-8c92-66205078f92a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:46:41.847945 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3d5a515d-a4fb-48ec-912b-2024c9e5e254 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:46:41.848449 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3d5a515d-a4fb-48ec-912b-2024c9e5e254 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:46:41.849232 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3d5a515d-a4fb-48ec-912b-2024c9e5e254 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:46:41.849655 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3d5a515d-a4fb-48ec-912b-2024c9e5e254 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:46:41.906351 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3d5a515d-a4fb-48ec-912b-2024c9e5e254 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "POST /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a/action" status: 200 len: 24541 microversion: 2.1 time: 0.076678 Jul 25 15:46:41.907053 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3738/7697] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:46:41 2022] POST /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a/action => generated 24541 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 15:47:11.317026 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 15:47:11.318034 n-d-846435-14 devstack@n-api.service[119303]: Mon Jul 25 15:47:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 15:47:20.995180 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:47:20.996057 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=36 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:47:21.000818 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0695df63-8981-47ce-9d6c-72af22a18859 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:47:21.001375 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0695df63-8981-47ce-9d6c-72af22a18859 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: d987ecb1-d9e6-4703-8c92-66205078f92a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:47:21.009024 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0695df63-8981-47ce-9d6c-72af22a18859 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:21.009557 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0695df63-8981-47ce-9d6c-72af22a18859 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:21.010362 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0695df63-8981-47ce-9d6c-72af22a18859 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:21.010825 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0695df63-8981-47ce-9d6c-72af22a18859 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:21.036939 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-0695df63-8981-47ce-9d6c-72af22a18859 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lazy-loading 'flavor' on Instance uuid d987ecb1-d9e6-4703-8c92-66205078f92a {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:47:21.112373 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0695df63-8981-47ce-9d6c-72af22a18859 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "POST /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a/action" status: 202 len: 0 microversion: 2.1 time: 0.118946 Jul 25 15:47:21.113014 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3960/7698] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:47:20 2022] POST /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:47:21.122911 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-630aafcc-3807-44ad-b19a-a7eb0a634363 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:47:21.123888 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-630aafcc-3807-44ad-b19a-a7eb0a634363 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: d987ecb1-d9e6-4703-8c92-66205078f92a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:47:21.126413 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:47:21.127192 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=4 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:47:21.138167 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-630aafcc-3807-44ad-b19a-a7eb0a634363 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:21.138619 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-630aafcc-3807-44ad-b19a-a7eb0a634363 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:21.139397 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-630aafcc-3807-44ad-b19a-a7eb0a634363 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:21.139813 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-630aafcc-3807-44ad-b19a-a7eb0a634363 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:21.278275 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-630aafcc-3807-44ad-b19a-a7eb0a634363 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:47:21.286134 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-630aafcc-3807-44ad-b19a-a7eb0a634363 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a" status: 200 len: 1691 microversion: 2.1 time: 0.167782 Jul 25 15:47:21.286713 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3739/7699] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:47:21 2022] GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:47:22.310991 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a5a31689-6319-42b2-8cf5-154d02973838 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:47:22.311704 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a5a31689-6319-42b2-8cf5-154d02973838 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: d987ecb1-d9e6-4703-8c92-66205078f92a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:47:22.318567 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5a31689-6319-42b2-8cf5-154d02973838 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:22.319034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5a31689-6319-42b2-8cf5-154d02973838 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:22.319829 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5a31689-6319-42b2-8cf5-154d02973838 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:22.320330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5a31689-6319-42b2-8cf5-154d02973838 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:22.469001 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a5a31689-6319-42b2-8cf5-154d02973838 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:47:22.478184 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a5a31689-6319-42b2-8cf5-154d02973838 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a" status: 200 len: 1691 microversion: 2.1 time: 0.172650 Jul 25 15:47:22.478755 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3961/7700] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:47:22 2022] GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a => generated 1691 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:47:23.499920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-03cd5515-29e7-4278-9822-9a8466ff56ac tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:47:23.500664 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-03cd5515-29e7-4278-9822-9a8466ff56ac tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: d987ecb1-d9e6-4703-8c92-66205078f92a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:47:23.510330 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03cd5515-29e7-4278-9822-9a8466ff56ac tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:23.510813 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03cd5515-29e7-4278-9822-9a8466ff56ac tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:23.511778 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03cd5515-29e7-4278-9822-9a8466ff56ac tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:23.512255 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-03cd5515-29e7-4278-9822-9a8466ff56ac tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:23.671081 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-03cd5515-29e7-4278-9822-9a8466ff56ac tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:47:23.679018 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-03cd5515-29e7-4278-9822-9a8466ff56ac tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a" status: 200 len: 1674 microversion: 2.1 time: 0.183743 Jul 25 15:47:23.679630 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3740/7701] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:47:23 2022] GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a => generated 1674 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:47:24.787682 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-51d7c212-09ab-491b-baa6-8f24a86c4db7 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:47:24.790926 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-51d7c212-09ab-491b-baa6-8f24a86c4db7 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: d987ecb1-d9e6-4703-8c92-66205078f92a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:47:24.798841 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51d7c212-09ab-491b-baa6-8f24a86c4db7 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:24.799303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51d7c212-09ab-491b-baa6-8f24a86c4db7 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:24.800110 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51d7c212-09ab-491b-baa6-8f24a86c4db7 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:24.800554 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51d7c212-09ab-491b-baa6-8f24a86c4db7 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:24.861672 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-51d7c212-09ab-491b-baa6-8f24a86c4db7 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "POST /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a/action" status: 200 len: 38494 microversion: 2.1 time: 0.079475 Jul 25 15:47:24.862389 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3962/7702] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:47:24 2022] POST /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a/action => generated 38494 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 15:47:24.877626 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-142d25e0-dc65-4984-b263-914647b45666 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:47:24.878378 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-142d25e0-dc65-4984-b263-914647b45666 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: d987ecb1-d9e6-4703-8c92-66205078f92a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:47:24.888746 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-142d25e0-dc65-4984-b263-914647b45666 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:24.889323 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-142d25e0-dc65-4984-b263-914647b45666 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:24.890398 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-142d25e0-dc65-4984-b263-914647b45666 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:24.890975 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-142d25e0-dc65-4984-b263-914647b45666 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:24.974613 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-142d25e0-dc65-4984-b263-914647b45666 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "POST /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a/action" status: 202 len: 0 microversion: 2.1 time: 0.101620 Jul 25 15:47:24.975290 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3741/7703] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:47:24 2022] POST /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:47:24.984721 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-da93bbda-6a3f-4d07-b4b0-75bffe5e9e19 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:47:24.985446 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-da93bbda-6a3f-4d07-b4b0-75bffe5e9e19 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: d987ecb1-d9e6-4703-8c92-66205078f92a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:47:24.993905 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-da93bbda-6a3f-4d07-b4b0-75bffe5e9e19 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:24.993905 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-da93bbda-6a3f-4d07-b4b0-75bffe5e9e19 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:24.994433 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-da93bbda-6a3f-4d07-b4b0-75bffe5e9e19 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:24.994831 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-da93bbda-6a3f-4d07-b4b0-75bffe5e9e19 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:25.148764 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-da93bbda-6a3f-4d07-b4b0-75bffe5e9e19 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:47:25.158569 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-da93bbda-6a3f-4d07-b4b0-75bffe5e9e19 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a" status: 200 len: 1680 microversion: 2.1 time: 0.178308 Jul 25 15:47:25.159180 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3963/7704] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:47:24 2022] GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:47:26.183948 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ce66d21b-e444-4cf3-8912-c1b9f47ff3dc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:47:26.184815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ce66d21b-e444-4cf3-8912-c1b9f47ff3dc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: d987ecb1-d9e6-4703-8c92-66205078f92a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:47:26.193387 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ce66d21b-e444-4cf3-8912-c1b9f47ff3dc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:26.193825 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ce66d21b-e444-4cf3-8912-c1b9f47ff3dc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:26.194643 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ce66d21b-e444-4cf3-8912-c1b9f47ff3dc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:26.195935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ce66d21b-e444-4cf3-8912-c1b9f47ff3dc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:26.363598 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ce66d21b-e444-4cf3-8912-c1b9f47ff3dc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:47:26.373383 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ce66d21b-e444-4cf3-8912-c1b9f47ff3dc tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a" status: 200 len: 1680 microversion: 2.1 time: 0.194028 Jul 25 15:47:26.374141 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3742/7705] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:47:26 2022] GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a => generated 1680 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:47:27.397295 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c576e3ad-ed57-472e-b2ca-1067bdac59c6 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:47:27.398071 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c576e3ad-ed57-472e-b2ca-1067bdac59c6 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: d987ecb1-d9e6-4703-8c92-66205078f92a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:47:27.406687 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c576e3ad-ed57-472e-b2ca-1067bdac59c6 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:27.407157 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c576e3ad-ed57-472e-b2ca-1067bdac59c6 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:27.408032 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c576e3ad-ed57-472e-b2ca-1067bdac59c6 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:27.408493 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c576e3ad-ed57-472e-b2ca-1067bdac59c6 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:27.568046 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c576e3ad-ed57-472e-b2ca-1067bdac59c6 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:47:27.577136 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c576e3ad-ed57-472e-b2ca-1067bdac59c6 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a" status: 200 len: 1683 microversion: 2.1 time: 0.184870 Jul 25 15:47:27.577739 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3964/7706] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:47:27 2022] GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a => generated 1683 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:47:27.680762 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-aad57457-9396-42d9-8167-9bef7d46195e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:47:27.683401 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-aad57457-9396-42d9-8167-9bef7d46195e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: d987ecb1-d9e6-4703-8c92-66205078f92a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:47:27.692363 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aad57457-9396-42d9-8167-9bef7d46195e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:27.692973 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aad57457-9396-42d9-8167-9bef7d46195e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:27.693951 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aad57457-9396-42d9-8167-9bef7d46195e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:27.694397 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-aad57457-9396-42d9-8167-9bef7d46195e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:27.745524 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-aad57457-9396-42d9-8167-9bef7d46195e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "POST /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a/action" status: 200 len: 38494 microversion: 2.1 time: 0.068844 Jul 25 15:47:27.746262 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3743/7707] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:47:27 2022] POST /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a/action => generated 38494 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 15:47:28.895876 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5537f2c7-61d6-4dbd-b51f-6f6f0f075c6e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:47:28.897274 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5537f2c7-61d6-4dbd-b51f-6f6f0f075c6e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: d987ecb1-d9e6-4703-8c92-66205078f92a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:47:28.905857 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5537f2c7-61d6-4dbd-b51f-6f6f0f075c6e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:28.906405 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5537f2c7-61d6-4dbd-b51f-6f6f0f075c6e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:28.907303 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5537f2c7-61d6-4dbd-b51f-6f6f0f075c6e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:28.907841 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5537f2c7-61d6-4dbd-b51f-6f6f0f075c6e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:28.941582 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5537f2c7-61d6-4dbd-b51f-6f6f0f075c6e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: d987ecb1-d9e6-4703-8c92-66205078f92a] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:47:28.960422 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-bbc16906-211e-48b5-bb06-74cc02b11538 req-6553277a-4f62-4da0-a00f-8d75173754d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d987ecb1-d9e6-4703-8c92-66205078f92a", "tag": "0bc9fbb5-702c-48c7-b161-ac25f36aa766"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:47:28.974484 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-bbc16906-211e-48b5-bb06-74cc02b11538 req-6553277a-4f62-4da0-a00f-8d75173754d4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:28.975082 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-bbc16906-211e-48b5-bb06-74cc02b11538 req-6553277a-4f62-4da0-a00f-8d75173754d4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:28.987103 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-bbc16906-211e-48b5-bb06-74cc02b11538 req-6553277a-4f62-4da0-a00f-8d75173754d4 service nova] Creating event network-changed:0bc9fbb5-702c-48c7-b161-ac25f36aa766 for instance d987ecb1-d9e6-4703-8c92-66205078f92a on n-h2-846435-14 Jul 25 15:47:28.994242 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-bbc16906-211e-48b5-bb06-74cc02b11538 req-6553277a-4f62-4da0-a00f-8d75173754d4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102953 Jul 25 15:47:28.995198 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3744/7708] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:47:29.050944 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5537f2c7-61d6-4dbd-b51f-6f6f0f075c6e tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "DELETE /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a" status: 204 len: 0 microversion: 2.1 time: 0.160078 Jul 25 15:47:29.051867 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3965/7709] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:47:28 2022] DELETE /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:47:29.061702 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c36af672-345a-4111-be84-95b26c4b0bb0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:47:29.062475 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c36af672-345a-4111-be84-95b26c4b0bb0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: d987ecb1-d9e6-4703-8c92-66205078f92a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:47:29.069485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c36af672-345a-4111-be84-95b26c4b0bb0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:29.069931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c36af672-345a-4111-be84-95b26c4b0bb0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:29.070728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c36af672-345a-4111-be84-95b26c4b0bb0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:29.071353 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c36af672-345a-4111-be84-95b26c4b0bb0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:29.225722 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c36af672-345a-4111-be84-95b26c4b0bb0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:47:29.234191 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c36af672-345a-4111-be84-95b26c4b0bb0 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a" status: 200 len: 1689 microversion: 2.1 time: 0.177232 Jul 25 15:47:29.236547 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3745/7710] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:47:29 2022] GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a => generated 1689 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:47:30.259548 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b4050c28-29f9-4ac6-a827-e716eda48f63 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:47:30.260259 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b4050c28-29f9-4ac6-a827-e716eda48f63 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: d987ecb1-d9e6-4703-8c92-66205078f92a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:47:30.268126 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b4050c28-29f9-4ac6-a827-e716eda48f63 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:30.268594 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b4050c28-29f9-4ac6-a827-e716eda48f63 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:30.269400 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b4050c28-29f9-4ac6-a827-e716eda48f63 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:30.269841 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b4050c28-29f9-4ac6-a827-e716eda48f63 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:30.422464 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b4050c28-29f9-4ac6-a827-e716eda48f63 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:47:30.433044 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b4050c28-29f9-4ac6-a827-e716eda48f63 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a" status: 200 len: 1689 microversion: 2.1 time: 0.178176 Jul 25 15:47:30.435144 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3966/7711] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:47:30 2022] GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a => generated 1689 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:47:31.458387 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7376eb6a-da0e-49ef-a326-8f241ce10ea3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:47:31.458980 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7376eb6a-da0e-49ef-a326-8f241ce10ea3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: d987ecb1-d9e6-4703-8c92-66205078f92a] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:47:31.466605 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7376eb6a-da0e-49ef-a326-8f241ce10ea3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:31.467056 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7376eb6a-da0e-49ef-a326-8f241ce10ea3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:31.467831 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7376eb6a-da0e-49ef-a326-8f241ce10ea3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:31.468331 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7376eb6a-da0e-49ef-a326-8f241ce10ea3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:31.671931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-e21040bd-ab68-4d17-be5a-001fac31903f req-728e15b2-b48b-462c-bd5e-00d3a8241da7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d987ecb1-d9e6-4703-8c92-66205078f92a", "name": "network-vif-deleted", "tag": "0bc9fbb5-702c-48c7-b161-ac25f36aa766"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:47:31.687329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-e21040bd-ab68-4d17-be5a-001fac31903f req-728e15b2-b48b-462c-bd5e-00d3a8241da7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:31.688613 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-e21040bd-ab68-4d17-be5a-001fac31903f req-728e15b2-b48b-462c-bd5e-00d3a8241da7 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:31.703136 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-e21040bd-ab68-4d17-be5a-001fac31903f req-728e15b2-b48b-462c-bd5e-00d3a8241da7 service nova] Creating event network-vif-deleted:0bc9fbb5-702c-48c7-b161-ac25f36aa766 for instance d987ecb1-d9e6-4703-8c92-66205078f92a on n-h2-846435-14 Jul 25 15:47:31.708562 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-e21040bd-ab68-4d17-be5a-001fac31903f req-728e15b2-b48b-462c-bd5e-00d3a8241da7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041062 Jul 25 15:47:31.709177 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3967/7712] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:47:31.709930 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7376eb6a-da0e-49ef-a326-8f241ce10ea3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5063de8e476b4378b1d7bdbfb8526b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16a1323e1ae4f7d9b178c43cb15f169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:47:31.718889 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7376eb6a-da0e-49ef-a326-8f241ce10ea3 tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a" status: 200 len: 1570 microversion: 2.1 time: 0.264625 Jul 25 15:47:31.720309 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3746/7713] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:47:31 2022] GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a => generated 1570 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:47:32.742222 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-339563bf-26d7-4977-a846-229699f4f30a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:47:32.742931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-339563bf-26d7-4977-a846-229699f4f30a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] [instance: d987ecb1-d9e6-4703-8c92-66205078f92a] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:47:32.752799 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-339563bf-26d7-4977-a846-229699f4f30a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:32.753259 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-339563bf-26d7-4977-a846-229699f4f30a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:32.754075 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-339563bf-26d7-4977-a846-229699f4f30a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:32.754523 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-339563bf-26d7-4977-a846-229699f4f30a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:32.771464 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-339563bf-26d7-4977-a846-229699f4f30a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] HTTP exception thrown: Instance d987ecb1-d9e6-4703-8c92-66205078f92a could not be found. Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-339563bf-26d7-4977-a846-229699f4f30a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Request method failure captured: Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a HTTP/1.1 Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3rjesYZca3-zg5wdlKOEpTPhAkLj6IXHamAasfg58t3Ilpa049I9OXvWX-bAnAQJHJ7-EsS7XT_5PcwTYuQ1ZW4iBxHhHtUpRCFDZgNrRNC_KvS3yzJK8L0Xe-papm6ljnTIThiR4BhSlyxYZv1rC6Xr4z2ZatqPUTS5ZrTMaiSOTNI Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: a16a1323e1ae4f7d9b178c43cb15f169 Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-151732960 Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a16a1323e1ae4f7d9b178c43cb15f169"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a16a1323e1ae4f7d9b178c43cb15f169"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a16a1323e1ae4f7d9b178c43cb15f169", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a16a1323e1ae4f7d9b178c43cb15f169"}]}] Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-TestNetworkAdvancedServerOps-151732960 Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: a16a1323e1ae4f7d9b178c43cb15f169 Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-151732960 Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-TestNetworkAdvancedServerOps-151732960-project Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: 5063de8e476b4378b1d7bdbfb8526b1c Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-TestNetworkAdvancedServerOps-151732960-project Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance d987ecb1-d9e6-4703-8c92-66205078f92a could not be found. Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'd987ecb1-d9e6-4703-8c92-66205078f92a'} Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d987ecb1-d9e6-4703-8c92-66205078f92a could not be found. Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d987ecb1-d9e6-4703-8c92-66205078f92a could not be found. Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:47:32.773208 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:47:32.779129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:47:32.779129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:47:32.779129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:47:32.779129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:47:32.779129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:47:32.779129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d987ecb1-d9e6-4703-8c92-66205078f92a could not be found. Jul 25 15:47:32.779129 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:47:32.779129 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-339563bf-26d7-4977-a846-229699f4f30a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Returning 404 to user: Instance d987ecb1-d9e6-4703-8c92-66205078f92a could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:47:32.779129 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-339563bf-26d7-4977-a846-229699f4f30a tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a" status: 404 len: 111 microversion: 2.1 time: 0.037278 Jul 25 15:47:32.779129 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3968/7714] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:47:32 2022] GET /compute/v2.1/servers/d987ecb1-d9e6-4703-8c92-66205078f92a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:47:36.138842 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-08bd5f6c-67b6-41a0-8095-d8ff25ce5e9f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] Calling method '.version_select at 0x7f46868cddc0>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:47:36.167085 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-08bd5f6c-67b6-41a0-8095-d8ff25ce5e9f tempest-TestNetworkAdvancedServerOps-151732960 tempest-TestNetworkAdvancedServerOps-151732960-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-376815543" status: 202 len: 0 microversion: 2.1 time: 0.027668 Jul 25 15:47:36.167085 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3747/7715] 10.222.0.88 () {58 vars in 1281 bytes} [Mon Jul 25 15:47:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-376815543 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 15:47:48.892304 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:47:48.893563 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:47:49.101874 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-13aaebc8-fdf2-4e9d-9805-4334ffe5a444 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Action: 'create', calling method: .version_select at 0x7f4698878280>, body: {"keypair": {"name": "tempest-TestShelveInstance-1943903229", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtEiBJn7oVT9GQzQYumW7NjMIZ+PXWwe+w6l9JOO+7hiVkU4YtCxa24xr1+pLRQQAHwuqFoXi5bmnNL/9jpINamNoFuFpzFkItdMWvVvSKhFl733cE3ePToAvORmZTm5g=="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:47:49.122161 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-13aaebc8-fdf2-4e9d-9805-4334ffe5a444 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Getting quotas for project 805b65aec52847419745f09be938db69. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:47:49.129011 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-13aaebc8-fdf2-4e9d-9805-4334ffe5a444 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Getting quotas for user ed6651178cc64addaec1f30bb0108295 and project 805b65aec52847419745f09be938db69. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:47:49.159620 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-13aaebc8-fdf2-4e9d-9805-4334ffe5a444 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.272997 Jul 25 15:47:49.160389 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3969/7716] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 15:47:48 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:47:50.447883 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:47:50.449546 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:47:50.453896 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bde307bf-b9f3-4abf-b2b2-2f962f210aeb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-659330373", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1943903229", "security_groups": [{"name": "tempest-secgroup-smoke-1288337965"}], "networks": [{"uuid": "cd4bcfbd-e893-47e9-b035-0273ba89e77e"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:47:50.598262 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-bde307bf-b9f3-4abf-b2b2-2f962f210aeb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] validate_networks() for [('cd4bcfbd-e893-47e9-b035-0273ba89e77e', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:47:51.021064 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-bde307bf-b9f3-4abf-b2b2-2f962f210aeb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:47:51.021566 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-bde307bf-b9f3-4abf-b2b2-2f962f210aeb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:47:51.022181 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-bde307bf-b9f3-4abf-b2b2-2f962f210aeb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:47:51.022660 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-bde307bf-b9f3-4abf-b2b2-2f962f210aeb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:47:51.023054 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-bde307bf-b9f3-4abf-b2b2-2f962f210aeb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:47:51.034390 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bde307bf-b9f3-4abf-b2b2-2f962f210aeb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:51.034833 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bde307bf-b9f3-4abf-b2b2-2f962f210aeb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:51.035714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bde307bf-b9f3-4abf-b2b2-2f962f210aeb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:51.036255 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bde307bf-b9f3-4abf-b2b2-2f962f210aeb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:51.058194 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-bde307bf-b9f3-4abf-b2b2-2f962f210aeb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Getting quotas for project 805b65aec52847419745f09be938db69. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:47:51.064567 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-bde307bf-b9f3-4abf-b2b2-2f962f210aeb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Getting quotas for user ed6651178cc64addaec1f30bb0108295 and project 805b65aec52847419745f09be938db69. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:47:51.079124 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bde307bf-b9f3-4abf-b2b2-2f962f210aeb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:47:51.081754 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bde307bf-b9f3-4abf-b2b2-2f962f210aeb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:47:51.139078 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bde307bf-b9f3-4abf-b2b2-2f962f210aeb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.692881 Jul 25 15:47:51.140083 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3748/7717] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:47:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:47:51.151241 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3edcc10d-8d14-4270-9736-1b4ee41fe96c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:47:51.152145 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3edcc10d-8d14-4270-9736-1b4ee41fe96c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:47:51.232238 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3edcc10d-8d14-4270-9736-1b4ee41fe96c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:47:51.241011 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3edcc10d-8d14-4270-9736-1b4ee41fe96c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1246 microversion: 2.1 time: 0.093716 Jul 25 15:47:51.244804 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3970/7718] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:47:51 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1246 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:47:52.265714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7e604b8e-e6c6-4be8-a48c-f8a303d460c9 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:47:52.268829 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7e604b8e-e6c6-4be8-a48c-f8a303d460c9 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:47:52.277282 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7e604b8e-e6c6-4be8-a48c-f8a303d460c9 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:52.278116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7e604b8e-e6c6-4be8-a48c-f8a303d460c9 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:52.279190 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7e604b8e-e6c6-4be8-a48c-f8a303d460c9 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:52.279875 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7e604b8e-e6c6-4be8-a48c-f8a303d460c9 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:52.370166 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7e604b8e-e6c6-4be8-a48c-f8a303d460c9 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:47:52.385530 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7e604b8e-e6c6-4be8-a48c-f8a303d460c9 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1298 microversion: 2.1 time: 0.126001 Jul 25 15:47:52.387180 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3749/7719] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:47:52 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1298 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:47:53.408515 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-75518ce7-2e94-4c34-aa63-eca5bf8b731c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:47:53.409182 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-75518ce7-2e94-4c34-aa63-eca5bf8b731c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:47:53.419296 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75518ce7-2e94-4c34-aa63-eca5bf8b731c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:53.420772 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75518ce7-2e94-4c34-aa63-eca5bf8b731c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:53.421631 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75518ce7-2e94-4c34-aa63-eca5bf8b731c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:53.422086 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-75518ce7-2e94-4c34-aa63-eca5bf8b731c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:53.717269 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-75518ce7-2e94-4c34-aa63-eca5bf8b731c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:47:53.733447 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-75518ce7-2e94-4c34-aa63-eca5bf8b731c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1372 microversion: 2.1 time: 0.329120 Jul 25 15:47:53.734738 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3971/7720] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:47:53 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1372 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:47:54.153322 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-bc853ab8-8ee5-4b01-8c0a-79e3dfc594a6 req-b340475a-b9f0-40ef-bb2e-b8312153ce88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bedefe32-ef9c-4920-b1bc-860499aeeeea", "tag": "0f5e3baf-51ad-4954-a50e-c4ab8d12f8a1"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:47:54.169192 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-bc853ab8-8ee5-4b01-8c0a-79e3dfc594a6 req-b340475a-b9f0-40ef-bb2e-b8312153ce88 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:54.169756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-bc853ab8-8ee5-4b01-8c0a-79e3dfc594a6 req-b340475a-b9f0-40ef-bb2e-b8312153ce88 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:54.183484 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-bc853ab8-8ee5-4b01-8c0a-79e3dfc594a6 req-b340475a-b9f0-40ef-bb2e-b8312153ce88 service nova] Creating event network-changed:0f5e3baf-51ad-4954-a50e-c4ab8d12f8a1 for instance bedefe32-ef9c-4920-b1bc-860499aeeeea on n-h1-846435-14 Jul 25 15:47:54.189609 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-bc853ab8-8ee5-4b01-8c0a-79e3dfc594a6 req-b340475a-b9f0-40ef-bb2e-b8312153ce88 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040365 Jul 25 15:47:54.190551 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3750/7721] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:47:54.758323 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-01248604-9cea-455a-ab3b-7522ea940e92 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:47:54.759163 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-01248604-9cea-455a-ab3b-7522ea940e92 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:47:54.766481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01248604-9cea-455a-ab3b-7522ea940e92 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:54.766878 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01248604-9cea-455a-ab3b-7522ea940e92 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:54.767665 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01248604-9cea-455a-ab3b-7522ea940e92 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:54.768154 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-01248604-9cea-455a-ab3b-7522ea940e92 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:54.914614 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-01248604-9cea-455a-ab3b-7522ea940e92 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:47:54.931036 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-01248604-9cea-455a-ab3b-7522ea940e92 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1372 microversion: 2.1 time: 0.176476 Jul 25 15:47:54.932693 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3972/7722] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:47:54 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1372 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:47:55.967633 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2d2f3c0c-0480-4387-a01f-77776cfb0413 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:47:55.968602 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2d2f3c0c-0480-4387-a01f-77776cfb0413 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:47:55.975395 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2d2f3c0c-0480-4387-a01f-77776cfb0413 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:55.975858 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2d2f3c0c-0480-4387-a01f-77776cfb0413 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:55.976693 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2d2f3c0c-0480-4387-a01f-77776cfb0413 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:55.977151 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2d2f3c0c-0480-4387-a01f-77776cfb0413 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:56.125304 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2d2f3c0c-0480-4387-a01f-77776cfb0413 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:47:56.137081 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2d2f3c0c-0480-4387-a01f-77776cfb0413 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1372 microversion: 2.1 time: 0.171087 Jul 25 15:47:56.137081 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3751/7723] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:47:55 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:47:57.154847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b451b4e4-997e-4ce0-b32a-51756bf57384 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:47:57.155474 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b451b4e4-997e-4ce0-b32a-51756bf57384 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:47:57.163426 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b451b4e4-997e-4ce0-b32a-51756bf57384 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:57.163927 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b451b4e4-997e-4ce0-b32a-51756bf57384 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:57.164901 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b451b4e4-997e-4ce0-b32a-51756bf57384 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:57.165350 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b451b4e4-997e-4ce0-b32a-51756bf57384 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:57.316262 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b451b4e4-997e-4ce0-b32a-51756bf57384 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:47:57.324428 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b451b4e4-997e-4ce0-b32a-51756bf57384 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1372 microversion: 2.1 time: 0.173907 Jul 25 15:47:57.325096 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3973/7724] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:47:57 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:47:58.348250 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-15b0d47a-da81-437b-8596-3b723fd437a8 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:47:58.348879 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-15b0d47a-da81-437b-8596-3b723fd437a8 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:47:58.356007 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-15b0d47a-da81-437b-8596-3b723fd437a8 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:58.356732 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-15b0d47a-da81-437b-8596-3b723fd437a8 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:58.357429 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-15b0d47a-da81-437b-8596-3b723fd437a8 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:58.357863 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-15b0d47a-da81-437b-8596-3b723fd437a8 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:58.501073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-15b0d47a-da81-437b-8596-3b723fd437a8 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:47:58.510130 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-15b0d47a-da81-437b-8596-3b723fd437a8 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1372 microversion: 2.1 time: 0.167248 Jul 25 15:47:58.510718 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3752/7725] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:47:58 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:47:59.531852 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9b2802de-d570-42ad-b524-0d8829e4899c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:47:59.532447 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9b2802de-d570-42ad-b524-0d8829e4899c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:47:59.540108 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9b2802de-d570-42ad-b524-0d8829e4899c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:59.540443 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9b2802de-d570-42ad-b524-0d8829e4899c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:59.541257 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9b2802de-d570-42ad-b524-0d8829e4899c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:47:59.541712 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9b2802de-d570-42ad-b524-0d8829e4899c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:47:59.686833 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9b2802de-d570-42ad-b524-0d8829e4899c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:47:59.694629 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9b2802de-d570-42ad-b524-0d8829e4899c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1372 microversion: 2.1 time: 0.167081 Jul 25 15:47:59.695204 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3974/7726] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:47:59 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:48:00.715574 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d8346372-7934-4251-8125-e4652be5ebe7 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:48:00.716213 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d8346372-7934-4251-8125-e4652be5ebe7 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:48:00.723847 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8346372-7934-4251-8125-e4652be5ebe7 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:48:00.724368 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8346372-7934-4251-8125-e4652be5ebe7 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:48:00.725170 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8346372-7934-4251-8125-e4652be5ebe7 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:48:00.725584 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d8346372-7934-4251-8125-e4652be5ebe7 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:48:00.761200 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-f927abd3-cf09-42ce-89d0-5d6e73b41c06 req-d3f852e1-d074-48dc-b0e5-baf1e13126f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bedefe32-ef9c-4920-b1bc-860499aeeeea", "name": "network-vif-plugged", "status": "completed", "tag": "0f5e3baf-51ad-4954-a50e-c4ab8d12f8a1"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:48:00.770814 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-f927abd3-cf09-42ce-89d0-5d6e73b41c06 req-d3f852e1-d074-48dc-b0e5-baf1e13126f3 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:48:00.771282 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-f927abd3-cf09-42ce-89d0-5d6e73b41c06 req-d3f852e1-d074-48dc-b0e5-baf1e13126f3 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:48:00.783681 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-f927abd3-cf09-42ce-89d0-5d6e73b41c06 req-d3f852e1-d074-48dc-b0e5-baf1e13126f3 service nova] Creating event network-vif-plugged:0f5e3baf-51ad-4954-a50e-c4ab8d12f8a1 for instance bedefe32-ef9c-4920-b1bc-860499aeeeea on n-h1-846435-14 Jul 25 15:48:00.789336 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-f927abd3-cf09-42ce-89d0-5d6e73b41c06 req-d3f852e1-d074-48dc-b0e5-baf1e13126f3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034209 Jul 25 15:48:00.790576 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3975/7727] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:48:00.931553 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d8346372-7934-4251-8125-e4652be5ebe7 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:48:00.944722 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d8346372-7934-4251-8125-e4652be5ebe7 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1372 microversion: 2.1 time: 0.233384 Jul 25 15:48:00.945654 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3753/7728] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:48:00 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1372 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:48:01.963593 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:48:01.968841 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-212be5fe-4d6a-45b7-aee4-3acc27c7f3ab tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:48:01.969553 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-212be5fe-4d6a-45b7-aee4-3acc27c7f3ab tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:48:01.976508 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-212be5fe-4d6a-45b7-aee4-3acc27c7f3ab tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:48:01.977049 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-212be5fe-4d6a-45b7-aee4-3acc27c7f3ab tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:48:01.977854 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-212be5fe-4d6a-45b7-aee4-3acc27c7f3ab tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:48:01.978297 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-212be5fe-4d6a-45b7-aee4-3acc27c7f3ab tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:48:02.126852 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-212be5fe-4d6a-45b7-aee4-3acc27c7f3ab tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:48:02.135395 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-212be5fe-4d6a-45b7-aee4-3acc27c7f3ab tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1372 microversion: 2.1 time: 0.172700 Jul 25 15:48:02.136528 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3976/7729] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:48:01 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:48:03.160109 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d9f2133b-b8bb-4dfa-b503-5ec86849721e tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:48:03.161147 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d9f2133b-b8bb-4dfa-b503-5ec86849721e tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:48:03.163634 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:48:03.164387 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:48:03.171853 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d9f2133b-b8bb-4dfa-b503-5ec86849721e tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:48:03.172351 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d9f2133b-b8bb-4dfa-b503-5ec86849721e tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:48:03.173187 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d9f2133b-b8bb-4dfa-b503-5ec86849721e tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:48:03.173630 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d9f2133b-b8bb-4dfa-b503-5ec86849721e tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:48:03.318769 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d9f2133b-b8bb-4dfa-b503-5ec86849721e tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:48:03.327012 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d9f2133b-b8bb-4dfa-b503-5ec86849721e tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1554 microversion: 2.1 time: 0.172612 Jul 25 15:48:03.328098 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3754/7730] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:48:03 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:48:03.349500 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-51e0c4ac-b8d2-495d-9857-1945f09dbe75 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:48:03.350126 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-51e0c4ac-b8d2-495d-9857-1945f09dbe75 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:48:03.357584 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51e0c4ac-b8d2-495d-9857-1945f09dbe75 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:48:03.358048 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51e0c4ac-b8d2-495d-9857-1945f09dbe75 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:48:03.358927 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51e0c4ac-b8d2-495d-9857-1945f09dbe75 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:48:03.359458 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-51e0c4ac-b8d2-495d-9857-1945f09dbe75 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:48:03.502801 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-51e0c4ac-b8d2-495d-9857-1945f09dbe75 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:48:03.511650 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-51e0c4ac-b8d2-495d-9857-1945f09dbe75 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1554 microversion: 2.1 time: 0.166453 Jul 25 15:48:03.512424 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3977/7731] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:48:03 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:48:05.726949 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-b5bf781a-c3d6-47c1-9619-0431fc6d6d64 req-fc45b25c-7b5a-4863-92e7-15b65dfd4365 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bedefe32-ef9c-4920-b1bc-860499aeeeea", "tag": "0f5e3baf-51ad-4954-a50e-c4ab8d12f8a1"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:48:05.738956 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b5bf781a-c3d6-47c1-9619-0431fc6d6d64 req-fc45b25c-7b5a-4863-92e7-15b65dfd4365 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:48:05.739401 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-b5bf781a-c3d6-47c1-9619-0431fc6d6d64 req-fc45b25c-7b5a-4863-92e7-15b65dfd4365 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:48:05.752488 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-b5bf781a-c3d6-47c1-9619-0431fc6d6d64 req-fc45b25c-7b5a-4863-92e7-15b65dfd4365 service nova] Creating event network-changed:0f5e3baf-51ad-4954-a50e-c4ab8d12f8a1 for instance bedefe32-ef9c-4920-b1bc-860499aeeeea on n-h1-846435-14 Jul 25 15:48:05.758135 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-b5bf781a-c3d6-47c1-9619-0431fc6d6d64 req-fc45b25c-7b5a-4863-92e7-15b65dfd4365 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035253 Jul 25 15:48:05.759173 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3755/7732] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:48:53.819299 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 15:48:53.819950 n-d-846435-14 devstack@n-api.service[119304]: Mon Jul 25 15:48:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 15:50:01.291489 n-d-846435-14 devstack@n-api.service[119304]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5a3fcd17-2893-497d-b07f-ee8fd2346add] AMQP server on 10.222.0.88:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 15:50:01.292966 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:50:01.293914 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=38 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:50:01.299047 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9c36c968-e505-41fc-a78e-acc10b5fb0df tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:50:01.299595 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9c36c968-e505-41fc-a78e-acc10b5fb0df tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:01.308123 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9c36c968-e505-41fc-a78e-acc10b5fb0df tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:01.308585 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9c36c968-e505-41fc-a78e-acc10b5fb0df tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:01.309386 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9c36c968-e505-41fc-a78e-acc10b5fb0df tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:01.309834 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9c36c968-e505-41fc-a78e-acc10b5fb0df tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:01.334367 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-9c36c968-e505-41fc-a78e-acc10b5fb0df tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lazy-loading 'flavor' on Instance uuid bedefe32-ef9c-4920-b1bc-860499aeeeea {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:50:01.750134 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9c36c968-e505-41fc-a78e-acc10b5fb0df tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "POST /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea/action" status: 202 len: 0 microversion: 2.1 time: 0.460745 Jul 25 15:50:01.750776 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3978/7733] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:50:01 2022] POST /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:50:01.757947 n-d-846435-14 devstack@n-api.service[119303]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c17eba8c-cddd-4f98-b66f-c71ea3b6f89c] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 15:50:01.758682 n-d-846435-14 devstack@n-api.service[119303]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b24320cd-02fe-4cda-9e22-8ff297cb0d9a] AMQP server on 10.222.0.88:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 25 15:50:01.759360 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:50:01.760341 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=36 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:50:01.765972 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-3706ec04-61a7-44da-baa8-8ae59d5e7a59 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:01.766653 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-3706ec04-61a7-44da-baa8-8ae59d5e7a59 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:01.775378 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3706ec04-61a7-44da-baa8-8ae59d5e7a59 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:01.775820 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3706ec04-61a7-44da-baa8-8ae59d5e7a59 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:01.776685 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3706ec04-61a7-44da-baa8-8ae59d5e7a59 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:01.777131 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-3706ec04-61a7-44da-baa8-8ae59d5e7a59 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:01.998898 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-3706ec04-61a7-44da-baa8-8ae59d5e7a59 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:02.009392 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-3706ec04-61a7-44da-baa8-8ae59d5e7a59 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1679 microversion: 2.1 time: 0.253573 Jul 25 15:50:02.010179 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3756/7734] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:01 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1679 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:50:03.033825 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3a56ef32-f92d-4409-94e1-1842621aa3ec tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:03.034674 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3a56ef32-f92d-4409-94e1-1842621aa3ec tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:03.044292 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a56ef32-f92d-4409-94e1-1842621aa3ec tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:03.044755 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a56ef32-f92d-4409-94e1-1842621aa3ec tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:03.045544 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a56ef32-f92d-4409-94e1-1842621aa3ec tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:03.045988 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3a56ef32-f92d-4409-94e1-1842621aa3ec tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:03.049780 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [-] [5a3fcd17-2893-497d-b07f-ee8fd2346add] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 53776. Jul 25 15:50:03.197325 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3a56ef32-f92d-4409-94e1-1842621aa3ec tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:03.207921 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3a56ef32-f92d-4409-94e1-1842621aa3ec tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1679 microversion: 2.1 time: 0.180190 Jul 25 15:50:03.208634 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3979/7735] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:03 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:50:04.233620 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-650c573c-e8a1-45e6-b416-59cba1d49f8b tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:04.234359 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-650c573c-e8a1-45e6-b416-59cba1d49f8b tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:04.246956 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-650c573c-e8a1-45e6-b416-59cba1d49f8b tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:04.247437 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-650c573c-e8a1-45e6-b416-59cba1d49f8b tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:04.248273 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-650c573c-e8a1-45e6-b416-59cba1d49f8b tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:04.248711 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-650c573c-e8a1-45e6-b416-59cba1d49f8b tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:04.253517 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [-] [c17eba8c-cddd-4f98-b66f-c71ea3b6f89c] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 53780. Jul 25 15:50:04.255852 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [-] [b24320cd-02fe-4cda-9e22-8ff297cb0d9a] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 53782. Jul 25 15:50:04.398662 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-650c573c-e8a1-45e6-b416-59cba1d49f8b tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:04.406868 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-650c573c-e8a1-45e6-b416-59cba1d49f8b tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1679 microversion: 2.1 time: 0.177274 Jul 25 15:50:04.407495 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3757/7736] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:04 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:50:05.433186 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a378b3d3-4ec6-4cc9-83f0-9390353f2f66 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:05.433887 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a378b3d3-4ec6-4cc9-83f0-9390353f2f66 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:05.441730 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a378b3d3-4ec6-4cc9-83f0-9390353f2f66 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:05.442270 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a378b3d3-4ec6-4cc9-83f0-9390353f2f66 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:05.443061 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a378b3d3-4ec6-4cc9-83f0-9390353f2f66 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:05.443519 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a378b3d3-4ec6-4cc9-83f0-9390353f2f66 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:05.593177 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a378b3d3-4ec6-4cc9-83f0-9390353f2f66 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:05.601257 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a378b3d3-4ec6-4cc9-83f0-9390353f2f66 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1679 microversion: 2.1 time: 0.172215 Jul 25 15:50:05.601869 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3980/7737] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:05 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:50:06.625154 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7228d34a-fe21-4ca8-bf24-41c7dc0eb1e7 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:06.625767 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7228d34a-fe21-4ca8-bf24-41c7dc0eb1e7 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:06.633329 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7228d34a-fe21-4ca8-bf24-41c7dc0eb1e7 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:06.633778 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7228d34a-fe21-4ca8-bf24-41c7dc0eb1e7 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:06.634554 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7228d34a-fe21-4ca8-bf24-41c7dc0eb1e7 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:06.634988 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7228d34a-fe21-4ca8-bf24-41c7dc0eb1e7 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:06.788110 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7228d34a-fe21-4ca8-bf24-41c7dc0eb1e7 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:06.796760 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7228d34a-fe21-4ca8-bf24-41c7dc0eb1e7 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1679 microversion: 2.1 time: 0.176734 Jul 25 15:50:06.797359 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3758/7738] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:06 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:50:07.819054 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0b79da2f-a12f-426c-bc5b-925856cac015 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:07.819665 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0b79da2f-a12f-426c-bc5b-925856cac015 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:07.827374 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b79da2f-a12f-426c-bc5b-925856cac015 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:07.827838 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b79da2f-a12f-426c-bc5b-925856cac015 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:07.828655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b79da2f-a12f-426c-bc5b-925856cac015 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:07.829102 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b79da2f-a12f-426c-bc5b-925856cac015 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:07.987399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0b79da2f-a12f-426c-bc5b-925856cac015 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:07.995711 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0b79da2f-a12f-426c-bc5b-925856cac015 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1679 microversion: 2.1 time: 0.180611 Jul 25 15:50:07.996306 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3981/7739] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:07 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:50:09.022001 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-212c066d-2013-472b-9d6f-8a0484702818 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:09.022729 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-212c066d-2013-472b-9d6f-8a0484702818 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:09.032471 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-212c066d-2013-472b-9d6f-8a0484702818 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:09.032931 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-212c066d-2013-472b-9d6f-8a0484702818 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:09.034033 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-212c066d-2013-472b-9d6f-8a0484702818 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:09.034482 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-212c066d-2013-472b-9d6f-8a0484702818 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:09.202254 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-212c066d-2013-472b-9d6f-8a0484702818 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:09.209804 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-212c066d-2013-472b-9d6f-8a0484702818 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1679 microversion: 2.1 time: 0.194399 Jul 25 15:50:09.210409 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3759/7740] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:09 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1679 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:50:10.232417 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6f959883-47ec-4a18-81ec-661301e73fac tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:10.233110 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6f959883-47ec-4a18-81ec-661301e73fac tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:10.240421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f959883-47ec-4a18-81ec-661301e73fac tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:10.240905 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f959883-47ec-4a18-81ec-661301e73fac tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:10.241733 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f959883-47ec-4a18-81ec-661301e73fac tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:10.242180 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6f959883-47ec-4a18-81ec-661301e73fac tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:10.383200 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6f959883-47ec-4a18-81ec-661301e73fac tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:10.391432 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6f959883-47ec-4a18-81ec-661301e73fac tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1679 microversion: 2.1 time: 0.163326 Jul 25 15:50:10.392099 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3982/7741] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:10 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:50:11.416475 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f7b2cd9d-4f68-44bb-ab8e-a7472f2d1733 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:11.417052 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f7b2cd9d-4f68-44bb-ab8e-a7472f2d1733 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:11.424598 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f7b2cd9d-4f68-44bb-ab8e-a7472f2d1733 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:11.425046 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f7b2cd9d-4f68-44bb-ab8e-a7472f2d1733 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:11.425815 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f7b2cd9d-4f68-44bb-ab8e-a7472f2d1733 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:11.426236 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f7b2cd9d-4f68-44bb-ab8e-a7472f2d1733 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:11.580081 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f7b2cd9d-4f68-44bb-ab8e-a7472f2d1733 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:11.588115 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f7b2cd9d-4f68-44bb-ab8e-a7472f2d1733 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1679 microversion: 2.1 time: 0.175895 Jul 25 15:50:11.588715 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3760/7742] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:11 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:50:12.610865 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b0f1e7b4-0459-4c95-9c19-35c943e3cb3d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:12.611515 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b0f1e7b4-0459-4c95-9c19-35c943e3cb3d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:12.619114 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0f1e7b4-0459-4c95-9c19-35c943e3cb3d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:12.619581 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0f1e7b4-0459-4c95-9c19-35c943e3cb3d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:12.620395 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0f1e7b4-0459-4c95-9c19-35c943e3cb3d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:12.620823 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b0f1e7b4-0459-4c95-9c19-35c943e3cb3d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:12.772192 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b0f1e7b4-0459-4c95-9c19-35c943e3cb3d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:12.781006 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b0f1e7b4-0459-4c95-9c19-35c943e3cb3d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1700 microversion: 2.1 time: 0.174320 Jul 25 15:50:12.781613 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3983/7743] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:12 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1700 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:50:13.802629 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4f3ddc34-7ed8-4fca-99bc-31457f3bb566 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:13.803261 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4f3ddc34-7ed8-4fca-99bc-31457f3bb566 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:13.810617 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4f3ddc34-7ed8-4fca-99bc-31457f3bb566 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:13.811072 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4f3ddc34-7ed8-4fca-99bc-31457f3bb566 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:13.811849 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4f3ddc34-7ed8-4fca-99bc-31457f3bb566 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:13.812315 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4f3ddc34-7ed8-4fca-99bc-31457f3bb566 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:13.951293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4f3ddc34-7ed8-4fca-99bc-31457f3bb566 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:13.959175 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4f3ddc34-7ed8-4fca-99bc-31457f3bb566 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1700 microversion: 2.1 time: 0.160511 Jul 25 15:50:13.959766 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3761/7744] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:13 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1700 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:50:14.980906 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b11165f2-e914-4a0a-bddb-7db5525874e2 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:14.981767 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b11165f2-e914-4a0a-bddb-7db5525874e2 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:14.989590 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b11165f2-e914-4a0a-bddb-7db5525874e2 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:14.990158 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b11165f2-e914-4a0a-bddb-7db5525874e2 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:14.991015 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b11165f2-e914-4a0a-bddb-7db5525874e2 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:14.991553 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b11165f2-e914-4a0a-bddb-7db5525874e2 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:15.180754 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b11165f2-e914-4a0a-bddb-7db5525874e2 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:15.189883 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b11165f2-e914-4a0a-bddb-7db5525874e2 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1695 microversion: 2.1 time: 0.213158 Jul 25 15:50:15.202233 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3984/7745] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:14 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1695 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:50:15.608644 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-dbfa32ba-0de9-4545-ba05-1978c35f6905 req-1ccdc6d7-4d86-46cc-976d-2b6db7d619ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bedefe32-ef9c-4920-b1bc-860499aeeeea", "name": "network-vif-plugged", "status": "completed", "tag": "0f5e3baf-51ad-4954-a50e-c4ab8d12f8a1"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:50:15.620471 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-dbfa32ba-0de9-4545-ba05-1978c35f6905 req-1ccdc6d7-4d86-46cc-976d-2b6db7d619ac service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:15.620913 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-dbfa32ba-0de9-4545-ba05-1978c35f6905 req-1ccdc6d7-4d86-46cc-976d-2b6db7d619ac service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:15.634379 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-dbfa32ba-0de9-4545-ba05-1978c35f6905 req-1ccdc6d7-4d86-46cc-976d-2b6db7d619ac service nova] Creating event network-vif-plugged:0f5e3baf-51ad-4954-a50e-c4ab8d12f8a1 for instance bedefe32-ef9c-4920-b1bc-860499aeeeea on n-h1-846435-14 Jul 25 15:50:15.638597 n-d-846435-14 devstack@n-api.service[119303]: ERROR oslo.messaging._drivers.impl_rabbit [req-dbfa32ba-0de9-4545-ba05-1978c35f6905 req-1ccdc6d7-4d86-46cc-976d-2b6db7d619ac service nova] [9075d6e8-9e8f-4371-80b4-41c0660bd18a] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 15:50:16.215785 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3782e866-3a58-4cf2-ab05-5f76c24c9c26 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:16.216603 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3782e866-3a58-4cf2-ab05-5f76c24c9c26 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:16.224845 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3782e866-3a58-4cf2-ab05-5f76c24c9c26 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:16.225631 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3782e866-3a58-4cf2-ab05-5f76c24c9c26 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:16.226837 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3782e866-3a58-4cf2-ab05-5f76c24c9c26 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:16.227463 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3782e866-3a58-4cf2-ab05-5f76c24c9c26 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:16.404046 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3782e866-3a58-4cf2-ab05-5f76c24c9c26 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:16.418714 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3782e866-3a58-4cf2-ab05-5f76c24c9c26 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1695 microversion: 2.1 time: 0.209773 Jul 25 15:50:16.419947 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3985/7746] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:16 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1695 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:50:16.649059 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [req-dbfa32ba-0de9-4545-ba05-1978c35f6905 req-1ccdc6d7-4d86-46cc-976d-2b6db7d619ac service nova] [9075d6e8-9e8f-4371-80b4-41c0660bd18a] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 53836. Jul 25 15:50:16.653383 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-dbfa32ba-0de9-4545-ba05-1978c35f6905 req-1ccdc6d7-4d86-46cc-976d-2b6db7d619ac service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.139197 Jul 25 15:50:16.654356 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3762/7747] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:50:17.446559 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cd820562-efc3-4e42-b233-20d8c28f2bb6 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:17.447410 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cd820562-efc3-4e42-b233-20d8c28f2bb6 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:17.456221 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cd820562-efc3-4e42-b233-20d8c28f2bb6 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:17.456679 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cd820562-efc3-4e42-b233-20d8c28f2bb6 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:17.457481 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cd820562-efc3-4e42-b233-20d8c28f2bb6 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:17.457932 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cd820562-efc3-4e42-b233-20d8c28f2bb6 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:17.647647 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cd820562-efc3-4e42-b233-20d8c28f2bb6 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:17.656579 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cd820562-efc3-4e42-b233-20d8c28f2bb6 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1695 microversion: 2.1 time: 0.218148 Jul 25 15:50:17.657674 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3986/7748] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:17 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1695 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:50:18.684296 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-017be35a-81f1-42ee-b96e-14d2789a0ada tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:18.685295 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-017be35a-81f1-42ee-b96e-14d2789a0ada tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:18.699328 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-017be35a-81f1-42ee-b96e-14d2789a0ada tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:18.699860 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-017be35a-81f1-42ee-b96e-14d2789a0ada tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:18.701216 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-017be35a-81f1-42ee-b96e-14d2789a0ada tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:18.702445 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-017be35a-81f1-42ee-b96e-14d2789a0ada tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:18.885882 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-017be35a-81f1-42ee-b96e-14d2789a0ada tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:18.907736 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-017be35a-81f1-42ee-b96e-14d2789a0ada tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1695 microversion: 2.1 time: 0.230456 Jul 25 15:50:18.921178 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3763/7749] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:18 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1695 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:50:19.934026 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2c023457-425b-410a-8667-417785981a1c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:19.934777 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2c023457-425b-410a-8667-417785981a1c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:19.942946 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2c023457-425b-410a-8667-417785981a1c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:19.943417 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2c023457-425b-410a-8667-417785981a1c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:19.944290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2c023457-425b-410a-8667-417785981a1c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:19.944786 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2c023457-425b-410a-8667-417785981a1c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:20.111431 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2c023457-425b-410a-8667-417785981a1c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:20.119871 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2c023457-425b-410a-8667-417785981a1c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1695 microversion: 2.1 time: 0.190595 Jul 25 15:50:20.120748 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3987/7750] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:19 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1695 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:50:21.142727 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0033f98a-7a25-4ea1-8963-ede6368df999 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:21.144073 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0033f98a-7a25-4ea1-8963-ede6368df999 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:21.152538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0033f98a-7a25-4ea1-8963-ede6368df999 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:21.153009 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0033f98a-7a25-4ea1-8963-ede6368df999 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:21.153810 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0033f98a-7a25-4ea1-8963-ede6368df999 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:21.154257 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0033f98a-7a25-4ea1-8963-ede6368df999 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:21.341598 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0033f98a-7a25-4ea1-8963-ede6368df999 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:21.351554 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0033f98a-7a25-4ea1-8963-ede6368df999 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1695 microversion: 2.1 time: 0.213022 Jul 25 15:50:21.352099 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3764/7751] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:21 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1695 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:50:22.375991 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-85b10a4a-bf84-4d94-9013-d0211da63128 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:22.376699 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-85b10a4a-bf84-4d94-9013-d0211da63128 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:22.385442 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-85b10a4a-bf84-4d94-9013-d0211da63128 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:22.385938 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-85b10a4a-bf84-4d94-9013-d0211da63128 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:22.386751 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-85b10a4a-bf84-4d94-9013-d0211da63128 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:22.387190 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-85b10a4a-bf84-4d94-9013-d0211da63128 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:22.573075 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-85b10a4a-bf84-4d94-9013-d0211da63128 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:22.582611 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-85b10a4a-bf84-4d94-9013-d0211da63128 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1695 microversion: 2.1 time: 0.211267 Jul 25 15:50:22.596362 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3988/7752] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:22 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1695 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:50:23.605776 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5f5b78fb-30c1-4a90-982f-aa3d74bdf338 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:23.606495 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5f5b78fb-30c1-4a90-982f-aa3d74bdf338 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:23.614050 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f5b78fb-30c1-4a90-982f-aa3d74bdf338 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:23.614509 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f5b78fb-30c1-4a90-982f-aa3d74bdf338 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:23.615459 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f5b78fb-30c1-4a90-982f-aa3d74bdf338 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:23.615900 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5f5b78fb-30c1-4a90-982f-aa3d74bdf338 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:23.770721 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5f5b78fb-30c1-4a90-982f-aa3d74bdf338 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:23.780153 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5f5b78fb-30c1-4a90-982f-aa3d74bdf338 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1695 microversion: 2.1 time: 0.178197 Jul 25 15:50:23.780733 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3765/7753] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:23 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1695 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:50:24.804011 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f4d5b0cf-897b-4ccb-9382-b6f14323b933 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:24.804911 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f4d5b0cf-897b-4ccb-9382-b6f14323b933 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:24.812747 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f4d5b0cf-897b-4ccb-9382-b6f14323b933 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:24.813270 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f4d5b0cf-897b-4ccb-9382-b6f14323b933 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:24.814120 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f4d5b0cf-897b-4ccb-9382-b6f14323b933 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:24.814572 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f4d5b0cf-897b-4ccb-9382-b6f14323b933 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:24.998240 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f4d5b0cf-897b-4ccb-9382-b6f14323b933 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:25.006280 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f4d5b0cf-897b-4ccb-9382-b6f14323b933 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1677 microversion: 2.1 time: 0.206923 Jul 25 15:50:25.006880 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3989/7754] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:24 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1677 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:50:26.028856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a03b421c-c48c-4cb5-9149-87ca66a2512a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:26.029532 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a03b421c-c48c-4cb5-9149-87ca66a2512a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:26.037004 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a03b421c-c48c-4cb5-9149-87ca66a2512a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:26.037466 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a03b421c-c48c-4cb5-9149-87ca66a2512a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:26.038254 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a03b421c-c48c-4cb5-9149-87ca66a2512a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:26.038710 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a03b421c-c48c-4cb5-9149-87ca66a2512a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:26.193705 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a03b421c-c48c-4cb5-9149-87ca66a2512a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:26.201749 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a03b421c-c48c-4cb5-9149-87ca66a2512a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1677 microversion: 2.1 time: 0.177348 Jul 25 15:50:26.202337 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3766/7755] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:26 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:50:27.223991 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-edb8a5fd-e1c9-401e-baf6-74b3b51c82fc tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:27.225017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-edb8a5fd-e1c9-401e-baf6-74b3b51c82fc tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:27.233616 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-edb8a5fd-e1c9-401e-baf6-74b3b51c82fc tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:27.234078 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-edb8a5fd-e1c9-401e-baf6-74b3b51c82fc tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:27.235211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-edb8a5fd-e1c9-401e-baf6-74b3b51c82fc tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:27.235655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-edb8a5fd-e1c9-401e-baf6-74b3b51c82fc tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:27.377918 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-edb8a5fd-e1c9-401e-baf6-74b3b51c82fc tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:27.385913 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-edb8a5fd-e1c9-401e-baf6-74b3b51c82fc tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1620 microversion: 2.1 time: 0.166208 Jul 25 15:50:27.386619 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3990/7756] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:27 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1620 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:50:27.408701 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d223c75a-b74a-4627-a595-aa6f9d971b50 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:50:27.409378 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d223c75a-b74a-4627-a595-aa6f9d971b50 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:27.417385 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d223c75a-b74a-4627-a595-aa6f9d971b50 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:27.417898 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d223c75a-b74a-4627-a595-aa6f9d971b50 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:27.418833 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d223c75a-b74a-4627-a595-aa6f9d971b50 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:27.419391 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d223c75a-b74a-4627-a595-aa6f9d971b50 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:27.539237 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-573abcfc-be6b-4e07-a66b-03b4dcde4dcd req-579e268e-8f3a-45be-8561-fbdba60a2ebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bedefe32-ef9c-4920-b1bc-860499aeeeea", "name": "network-vif-unplugged", "status": "completed", "tag": "0f5e3baf-51ad-4954-a50e-c4ab8d12f8a1"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:50:27.549673 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-573abcfc-be6b-4e07-a66b-03b4dcde4dcd req-579e268e-8f3a-45be-8561-fbdba60a2ebe service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:27.550211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-573abcfc-be6b-4e07-a66b-03b4dcde4dcd req-579e268e-8f3a-45be-8561-fbdba60a2ebe service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:27.564307 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.compute.server_external_events [req-573abcfc-be6b-4e07-a66b-03b4dcde4dcd req-579e268e-8f3a-45be-8561-fbdba60a2ebe service nova] Unable to find a host for instance bedefe32-ef9c-4920-b1bc-860499aeeeea. Dropping event network-vif-unplugged {{(pid=119304) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 25 15:50:27.565549 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-573abcfc-be6b-4e07-a66b-03b4dcde4dcd req-579e268e-8f3a-45be-8561-fbdba60a2ebe service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030646 Jul 25 15:50:27.566404 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3991/7757] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 25 15:50:27.607927 n-d-846435-14 devstack@n-api.service[119303]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d223c75a-b74a-4627-a595-aa6f9d971b50 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [65f5083c-1ce0-4f62-b916-2c16af617d4d] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 15:50:28.617062 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [None req-d223c75a-b74a-4627-a595-aa6f9d971b50 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [65f5083c-1ce0-4f62-b916-2c16af617d4d] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 53886. Jul 25 15:50:28.620894 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d223c75a-b74a-4627-a595-aa6f9d971b50 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "POST /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea/action" status: 202 len: 0 microversion: 2.1 time: 1.216639 Jul 25 15:50:28.621557 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3767/7758] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:50:27 2022] POST /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea/action => generated 0 bytes in 1218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:50:28.630090 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d11b4041-3439-4b56-acc0-633cce516826 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:28.630725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d11b4041-3439-4b56-acc0-633cce516826 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:28.638839 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d11b4041-3439-4b56-acc0-633cce516826 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:28.639318 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d11b4041-3439-4b56-acc0-633cce516826 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:28.640216 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d11b4041-3439-4b56-acc0-633cce516826 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:28.640664 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d11b4041-3439-4b56-acc0-633cce516826 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:28.829387 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d11b4041-3439-4b56-acc0-633cce516826 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:28.840667 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d11b4041-3439-4b56-acc0-633cce516826 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1628 microversion: 2.1 time: 0.213744 Jul 25 15:50:28.841885 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3992/7759] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:28 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1628 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:50:29.867671 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-c083a7a9-b4de-4674-af50-cab52705d657 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:29.868323 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-c083a7a9-b4de-4674-af50-cab52705d657 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:29.876252 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c083a7a9-b4de-4674-af50-cab52705d657 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:29.876717 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c083a7a9-b4de-4674-af50-cab52705d657 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:29.877532 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c083a7a9-b4de-4674-af50-cab52705d657 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:29.877975 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-c083a7a9-b4de-4674-af50-cab52705d657 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:30.098467 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-c083a7a9-b4de-4674-af50-cab52705d657 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:30.112999 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-c083a7a9-b4de-4674-af50-cab52705d657 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1686 microversion: 2.1 time: 0.250362 Jul 25 15:50:30.114130 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3768/7760] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:29 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1686 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:50:31.157114 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-caa85a63-9c4b-49ec-bea6-87726a1f5a71 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:31.159651 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-caa85a63-9c4b-49ec-bea6-87726a1f5a71 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:31.174088 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-caa85a63-9c4b-49ec-bea6-87726a1f5a71 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:31.175203 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-caa85a63-9c4b-49ec-bea6-87726a1f5a71 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:31.176887 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-caa85a63-9c4b-49ec-bea6-87726a1f5a71 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:31.177989 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-caa85a63-9c4b-49ec-bea6-87726a1f5a71 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:31.220258 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:50:31.227038 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 15:50:31.227969 n-d-846435-14 devstack@n-api.service[119303]: Mon Jul 25 15:50:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 15:50:31.471227 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-caa85a63-9c4b-49ec-bea6-87726a1f5a71 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:31.481952 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-caa85a63-9c4b-49ec-bea6-87726a1f5a71 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1686 microversion: 2.1 time: 0.334724 Jul 25 15:50:31.481952 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3993/7761] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:31 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1686 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:50:32.504222 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-251cb3bc-9b65-4dd5-bf69-cf5061d28f8a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:32.505632 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-251cb3bc-9b65-4dd5-bf69-cf5061d28f8a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:32.513625 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=29 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:50:32.515798 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-251cb3bc-9b65-4dd5-bf69-cf5061d28f8a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:32.516682 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-251cb3bc-9b65-4dd5-bf69-cf5061d28f8a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:32.518167 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-251cb3bc-9b65-4dd5-bf69-cf5061d28f8a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:32.518727 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-251cb3bc-9b65-4dd5-bf69-cf5061d28f8a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:32.523807 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:50:32.696613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-251cb3bc-9b65-4dd5-bf69-cf5061d28f8a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:32.707248 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-251cb3bc-9b65-4dd5-bf69-cf5061d28f8a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1686 microversion: 2.1 time: 0.207980 Jul 25 15:50:32.708853 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3769/7762] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:32 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1686 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:50:33.076845 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 15:50:33.077652 n-d-846435-14 devstack@n-api.service[119304]: Mon Jul 25 15:50:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 15:50:33.734267 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-938b7f18-7fb8-40b8-89b9-1ac7d249ab54 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:33.735289 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-938b7f18-7fb8-40b8-89b9-1ac7d249ab54 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:33.743398 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=33 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:50:33.746948 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-938b7f18-7fb8-40b8-89b9-1ac7d249ab54 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:33.747767 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-938b7f18-7fb8-40b8-89b9-1ac7d249ab54 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:33.750081 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-938b7f18-7fb8-40b8-89b9-1ac7d249ab54 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:33.750765 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-938b7f18-7fb8-40b8-89b9-1ac7d249ab54 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:34.007330 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-938b7f18-7fb8-40b8-89b9-1ac7d249ab54 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:34.016232 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-938b7f18-7fb8-40b8-89b9-1ac7d249ab54 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1686 microversion: 2.1 time: 0.288515 Jul 25 15:50:34.016853 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3994/7763] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:33 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1686 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:50:35.040329 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-168f3fc6-1b75-45d4-8234-d19bc7b7db93 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:35.041178 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-168f3fc6-1b75-45d4-8234-d19bc7b7db93 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:35.066485 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-168f3fc6-1b75-45d4-8234-d19bc7b7db93 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:35.067252 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-168f3fc6-1b75-45d4-8234-d19bc7b7db93 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:35.068781 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-168f3fc6-1b75-45d4-8234-d19bc7b7db93 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:35.069563 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-168f3fc6-1b75-45d4-8234-d19bc7b7db93 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:35.289380 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-168f3fc6-1b75-45d4-8234-d19bc7b7db93 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:35.305590 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-168f3fc6-1b75-45d4-8234-d19bc7b7db93 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1686 microversion: 2.1 time: 0.270250 Jul 25 15:50:35.314916 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3770/7764] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:35 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1686 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:50:36.346370 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2e24160d-21f4-4cfb-b951-5c0c905b4708 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:36.347550 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2e24160d-21f4-4cfb-b951-5c0c905b4708 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:36.357321 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2e24160d-21f4-4cfb-b951-5c0c905b4708 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:36.357783 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2e24160d-21f4-4cfb-b951-5c0c905b4708 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:36.358599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2e24160d-21f4-4cfb-b951-5c0c905b4708 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:36.359050 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2e24160d-21f4-4cfb-b951-5c0c905b4708 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:36.628234 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-2e24160d-21f4-4cfb-b951-5c0c905b4708 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:36.642003 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2e24160d-21f4-4cfb-b951-5c0c905b4708 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1686 microversion: 2.1 time: 0.303938 Jul 25 15:50:36.642812 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3995/7765] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:36 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1686 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:50:37.673958 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-81148ded-e9ff-4623-8d5b-dd62ba99cfbd tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:37.675028 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-81148ded-e9ff-4623-8d5b-dd62ba99cfbd tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:37.691390 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-81148ded-e9ff-4623-8d5b-dd62ba99cfbd tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:37.692877 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-81148ded-e9ff-4623-8d5b-dd62ba99cfbd tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:37.694881 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-81148ded-e9ff-4623-8d5b-dd62ba99cfbd tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:37.696286 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-81148ded-e9ff-4623-8d5b-dd62ba99cfbd tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:37.968180 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-81148ded-e9ff-4623-8d5b-dd62ba99cfbd tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:37.978616 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-81148ded-e9ff-4623-8d5b-dd62ba99cfbd tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1686 microversion: 2.1 time: 0.312304 Jul 25 15:50:37.989463 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3771/7766] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:37 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1686 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:50:38.999764 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a5e0bf7e-fb48-4f97-8a34-2d10e08f24ee tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:39.000669 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a5e0bf7e-fb48-4f97-8a34-2d10e08f24ee tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:39.008999 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5e0bf7e-fb48-4f97-8a34-2d10e08f24ee tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:39.009520 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5e0bf7e-fb48-4f97-8a34-2d10e08f24ee tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:39.010307 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5e0bf7e-fb48-4f97-8a34-2d10e08f24ee tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:39.010761 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5e0bf7e-fb48-4f97-8a34-2d10e08f24ee tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:39.205044 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a5e0bf7e-fb48-4f97-8a34-2d10e08f24ee tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:39.220562 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a5e0bf7e-fb48-4f97-8a34-2d10e08f24ee tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1686 microversion: 2.1 time: 0.224441 Jul 25 15:50:39.221667 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3996/7767] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:38 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1686 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:50:40.244640 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-91278b32-6327-4fcf-9e98-0b28afaaf277 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:40.245584 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-91278b32-6327-4fcf-9e98-0b28afaaf277 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:40.254076 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-91278b32-6327-4fcf-9e98-0b28afaaf277 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:40.254536 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-91278b32-6327-4fcf-9e98-0b28afaaf277 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:40.255348 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-91278b32-6327-4fcf-9e98-0b28afaaf277 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:40.255787 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-91278b32-6327-4fcf-9e98-0b28afaaf277 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:40.433736 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-91278b32-6327-4fcf-9e98-0b28afaaf277 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:40.446195 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-91278b32-6327-4fcf-9e98-0b28afaaf277 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1686 microversion: 2.1 time: 0.205570 Jul 25 15:50:40.447536 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3772/7768] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:40 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1686 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:50:41.471301 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0965f03b-655b-4d01-a5f1-c1fd8ac8cf57 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:41.472237 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0965f03b-655b-4d01-a5f1-c1fd8ac8cf57 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:41.480315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0965f03b-655b-4d01-a5f1-c1fd8ac8cf57 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:41.480968 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0965f03b-655b-4d01-a5f1-c1fd8ac8cf57 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:41.481816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0965f03b-655b-4d01-a5f1-c1fd8ac8cf57 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:41.482476 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0965f03b-655b-4d01-a5f1-c1fd8ac8cf57 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:41.649942 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0965f03b-655b-4d01-a5f1-c1fd8ac8cf57 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:41.658617 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0965f03b-655b-4d01-a5f1-c1fd8ac8cf57 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1686 microversion: 2.1 time: 0.191725 Jul 25 15:50:41.659623 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3997/7769] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:41 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1686 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:50:42.690676 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-6fa95532-5e6a-4d81-b4d0-f66428769a8f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:42.691316 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-6fa95532-5e6a-4d81-b4d0-f66428769a8f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:42.698831 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6fa95532-5e6a-4d81-b4d0-f66428769a8f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:42.699309 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6fa95532-5e6a-4d81-b4d0-f66428769a8f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:42.700124 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6fa95532-5e6a-4d81-b4d0-f66428769a8f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:42.700570 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-6fa95532-5e6a-4d81-b4d0-f66428769a8f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:42.846202 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-6fa95532-5e6a-4d81-b4d0-f66428769a8f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:42.854786 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-6fa95532-5e6a-4d81-b4d0-f66428769a8f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1686 microversion: 2.1 time: 0.168122 Jul 25 15:50:42.855375 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3773/7770] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:42 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1686 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:50:43.633418 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-469b1de7-68e9-4218-a22e-230153c12c82 req-0f5638cb-e5e5-4da0-a518-3e088e65d9e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bedefe32-ef9c-4920-b1bc-860499aeeeea", "name": "network-vif-plugged", "status": "completed", "tag": "0f5e3baf-51ad-4954-a50e-c4ab8d12f8a1"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:50:43.650530 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-469b1de7-68e9-4218-a22e-230153c12c82 req-0f5638cb-e5e5-4da0-a518-3e088e65d9e1 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:43.652534 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-469b1de7-68e9-4218-a22e-230153c12c82 req-0f5638cb-e5e5-4da0-a518-3e088e65d9e1 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:43.665435 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-469b1de7-68e9-4218-a22e-230153c12c82 req-0f5638cb-e5e5-4da0-a518-3e088e65d9e1 service nova] Creating event network-vif-plugged:0f5e3baf-51ad-4954-a50e-c4ab8d12f8a1 for instance bedefe32-ef9c-4920-b1bc-860499aeeeea on n-h1-846435-14 Jul 25 15:50:43.671297 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-469b1de7-68e9-4218-a22e-230153c12c82 req-0f5638cb-e5e5-4da0-a518-3e088e65d9e1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042236 Jul 25 15:50:43.671846 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3998/7771] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:50:43.877752 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-afb2ab8e-bda5-4016-849a-8e91b6be5f79 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:43.878747 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-afb2ab8e-bda5-4016-849a-8e91b6be5f79 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:43.892216 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-afb2ab8e-bda5-4016-849a-8e91b6be5f79 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:43.893259 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-afb2ab8e-bda5-4016-849a-8e91b6be5f79 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:43.895202 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-afb2ab8e-bda5-4016-849a-8e91b6be5f79 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:43.896066 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-afb2ab8e-bda5-4016-849a-8e91b6be5f79 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:44.082694 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-afb2ab8e-bda5-4016-849a-8e91b6be5f79 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:44.091505 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-afb2ab8e-bda5-4016-849a-8e91b6be5f79 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1686 microversion: 2.1 time: 0.218471 Jul 25 15:50:44.092452 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3774/7772] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:43 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1686 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:50:45.117171 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7eda8b1f-1197-401f-97fd-2c722048395c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:45.117731 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7eda8b1f-1197-401f-97fd-2c722048395c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:45.127085 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7eda8b1f-1197-401f-97fd-2c722048395c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:45.127365 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7eda8b1f-1197-401f-97fd-2c722048395c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:45.128316 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7eda8b1f-1197-401f-97fd-2c722048395c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:45.129009 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7eda8b1f-1197-401f-97fd-2c722048395c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:45.303704 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7eda8b1f-1197-401f-97fd-2c722048395c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:45.315445 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7eda8b1f-1197-401f-97fd-2c722048395c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1686 microversion: 2.1 time: 0.204610 Jul 25 15:50:45.317148 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 3999/7773] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:45 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1686 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:50:46.339657 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-46933ae0-e977-4454-867c-83e479aa11bc tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:50:46.340381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-46933ae0-e977-4454-867c-83e479aa11bc tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:50:46.348676 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46933ae0-e977-4454-867c-83e479aa11bc tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:46.349141 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46933ae0-e977-4454-867c-83e479aa11bc tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:46.349962 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46933ae0-e977-4454-867c-83e479aa11bc tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:50:46.350404 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-46933ae0-e977-4454-867c-83e479aa11bc tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:50:46.503003 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-46933ae0-e977-4454-867c-83e479aa11bc tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:50:46.511811 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-46933ae0-e977-4454-867c-83e479aa11bc tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1673 microversion: 2.1 time: 0.176503 Jul 25 15:50:46.512472 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3775/7774] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:50:46 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1673 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:52:00.437998 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=13 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:52:00.438998 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=41 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:52:00.441899 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-380e818b-411a-458f-9526-810c2b1deeba tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:52:00.442389 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-380e818b-411a-458f-9526-810c2b1deeba tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:52:00.444932 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=11 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:52:00.446320 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=36 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:52:00.454148 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-380e818b-411a-458f-9526-810c2b1deeba tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:00.454579 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-380e818b-411a-458f-9526-810c2b1deeba tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:00.455425 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-380e818b-411a-458f-9526-810c2b1deeba tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:00.455833 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-380e818b-411a-458f-9526-810c2b1deeba tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:00.482814 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-380e818b-411a-458f-9526-810c2b1deeba tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:52:00.509753 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-adfdf027-9df7-4215-acff-223a912ad21c req-5566e934-b656-420e-b5f3-ef5ca60cb0b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bedefe32-ef9c-4920-b1bc-860499aeeeea", "tag": "0f5e3baf-51ad-4954-a50e-c4ab8d12f8a1"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:52:00.520062 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-adfdf027-9df7-4215-acff-223a912ad21c req-5566e934-b656-420e-b5f3-ef5ca60cb0b0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:00.520850 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-adfdf027-9df7-4215-acff-223a912ad21c req-5566e934-b656-420e-b5f3-ef5ca60cb0b0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:00.533523 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-adfdf027-9df7-4215-acff-223a912ad21c req-5566e934-b656-420e-b5f3-ef5ca60cb0b0 service nova] Creating event network-changed:0f5e3baf-51ad-4954-a50e-c4ab8d12f8a1 for instance bedefe32-ef9c-4920-b1bc-860499aeeeea on n-h1-846435-14 Jul 25 15:52:00.539850 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-adfdf027-9df7-4215-acff-223a912ad21c req-5566e934-b656-420e-b5f3-ef5ca60cb0b0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104233 Jul 25 15:52:00.541134 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3776/7775] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:52:00.583348 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-380e818b-411a-458f-9526-810c2b1deeba tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "DELETE /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 204 len: 0 microversion: 2.1 time: 0.149790 Jul 25 15:52:00.585570 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4000/7776] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:52:00 2022] DELETE /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 15:52:00.596605 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-dbeca7ec-1c9d-4f08-8e61-5d4ca49cd941 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:52:00.597527 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-dbeca7ec-1c9d-4f08-8e61-5d4ca49cd941 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:52:00.605220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dbeca7ec-1c9d-4f08-8e61-5d4ca49cd941 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:00.605822 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dbeca7ec-1c9d-4f08-8e61-5d4ca49cd941 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:00.606922 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dbeca7ec-1c9d-4f08-8e61-5d4ca49cd941 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:00.607462 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-dbeca7ec-1c9d-4f08-8e61-5d4ca49cd941 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:00.757286 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-dbeca7ec-1c9d-4f08-8e61-5d4ca49cd941 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:52:00.765646 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-dbeca7ec-1c9d-4f08-8e61-5d4ca49cd941 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1679 microversion: 2.1 time: 0.176344 Jul 25 15:52:00.766246 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3777/7777] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:52:00 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:52:01.789354 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-83e562c8-da51-49f9-8b23-ca59a80873a6 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:52:01.790091 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-83e562c8-da51-49f9-8b23-ca59a80873a6 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:52:01.797735 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83e562c8-da51-49f9-8b23-ca59a80873a6 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:01.798199 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83e562c8-da51-49f9-8b23-ca59a80873a6 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:01.799004 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83e562c8-da51-49f9-8b23-ca59a80873a6 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:01.799444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-83e562c8-da51-49f9-8b23-ca59a80873a6 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:02.018780 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-83e562c8-da51-49f9-8b23-ca59a80873a6 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:52:02.028504 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-83e562c8-da51-49f9-8b23-ca59a80873a6 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 200 len: 1679 microversion: 2.1 time: 0.243443 Jul 25 15:52:02.029203 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4001/7778] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:52:01 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 1679 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:52:02.489183 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-43fc681d-8942-425b-b061-0ca3eb56beb9 req-5c11ca8e-2115-42ad-8658-e0e59e44b8cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bedefe32-ef9c-4920-b1bc-860499aeeeea", "name": "network-vif-deleted", "tag": "0f5e3baf-51ad-4954-a50e-c4ab8d12f8a1"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:52:02.502736 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-43fc681d-8942-425b-b061-0ca3eb56beb9 req-5c11ca8e-2115-42ad-8658-e0e59e44b8cc service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:02.503508 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-43fc681d-8942-425b-b061-0ca3eb56beb9 req-5c11ca8e-2115-42ad-8658-e0e59e44b8cc service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:02.518789 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-43fc681d-8942-425b-b061-0ca3eb56beb9 req-5c11ca8e-2115-42ad-8658-e0e59e44b8cc service nova] Creating event network-vif-deleted:0f5e3baf-51ad-4954-a50e-c4ab8d12f8a1 for instance bedefe32-ef9c-4920-b1bc-860499aeeeea on n-h1-846435-14 Jul 25 15:52:02.523950 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-43fc681d-8942-425b-b061-0ca3eb56beb9 req-5c11ca8e-2115-42ad-8658-e0e59e44b8cc service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040822 Jul 25 15:52:02.524595 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3778/7779] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:52:03.052329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2636a2c9-a325-49da-adef-9b600e1d2f39 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:52:03.052928 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-2636a2c9-a325-49da-adef-9b600e1d2f39 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: bedefe32-ef9c-4920-b1bc-860499aeeeea] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:52:03.060016 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2636a2c9-a325-49da-adef-9b600e1d2f39 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:03.060519 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2636a2c9-a325-49da-adef-9b600e1d2f39 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:03.061315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2636a2c9-a325-49da-adef-9b600e1d2f39 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:03.061773 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-2636a2c9-a325-49da-adef-9b600e1d2f39 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:03.076323 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-2636a2c9-a325-49da-adef-9b600e1d2f39 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] HTTP exception thrown: Instance bedefe32-ef9c-4920-b1bc-860499aeeeea could not be found. Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2636a2c9-a325-49da-adef-9b600e1d2f39 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Request method failure captured: Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea HTTP/1.1 Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3rsf6-B4Ph-On6ITGuTpM7grz86Riy9_cvMgBlTSk4-SE-bvXp4ii_0EHzHUTvrn52Y3HGHd2WnjBwPE_wqZ-1TECFEAlxn-k-ITpwIZf-nfCnh_i9-K3vr4Dw1CTT8WzeZjvzW0_ows0ap_uZ57E9qEaxh0adtZs1XMK9DxH6iduws Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 805b65aec52847419745f09be938db69 Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-TestShelveInstance-160824503 Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/805b65aec52847419745f09be938db69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/805b65aec52847419745f09be938db69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_805b65aec52847419745f09be938db69", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/805b65aec52847419745f09be938db69"}]}] Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-TestShelveInstance-160824503 Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 805b65aec52847419745f09be938db69 Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-TestShelveInstance-160824503 Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-TestShelveInstance-160824503-project Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: ed6651178cc64addaec1f30bb0108295 Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-TestShelveInstance-160824503-project Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance bedefe32-ef9c-4920-b1bc-860499aeeeea could not be found. Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'bedefe32-ef9c-4920-b1bc-860499aeeeea'} Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bedefe32-ef9c-4920-b1bc-860499aeeeea could not be found. Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bedefe32-ef9c-4920-b1bc-860499aeeeea could not be found. Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:52:03.078058 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:52:03.085211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:52:03.085211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:52:03.085211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:52:03.085211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:52:03.085211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:52:03.085211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bedefe32-ef9c-4920-b1bc-860499aeeeea could not be found. Jul 25 15:52:03.085211 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 15:52:03.085211 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-2636a2c9-a325-49da-adef-9b600e1d2f39 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Returning 404 to user: Instance bedefe32-ef9c-4920-b1bc-860499aeeeea could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:52:03.085211 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-2636a2c9-a325-49da-adef-9b600e1d2f39 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea" status: 404 len: 111 microversion: 2.1 time: 0.031424 Jul 25 15:52:03.085211 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4002/7780] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:52:03 2022] GET /compute/v2.1/servers/bedefe32-ef9c-4920-b1bc-860499aeeeea => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:52:03.278527 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e56ecc4e-0db9-4aa7-9cc4-995951c5b43f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '.version_select at 0x7f46868af820>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:52:03.307023 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e56ecc4e-0db9-4aa7-9cc4-995951c5b43f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1943903229" status: 202 len: 0 microversion: 2.1 time: 0.033245 Jul 25 15:52:03.308079 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3779/7781] 10.222.0.88 () {58 vars in 1254 bytes} [Mon Jul 25 15:52:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1943903229 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:52:03.329935 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ea4ed02b-ede2-495f-8f9d-b5451a4736d4 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Action: 'create', calling method: .version_select at 0x7f46874e1ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-745757774", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEgofV3ybcl8CpI7zZIACjYEC2Kt0YiqDRnE9d1wRk/VlA6tXOhr9EEQAkyrQOvMLLBFNtbQ+dEWlOqoE3myvtRDy7NVqyJNpjcPLZCsNJeEWG0Hhju690IWcqAvC3n7g=="}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:52:03.347091 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-ea4ed02b-ede2-495f-8f9d-b5451a4736d4 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Getting quotas for project 805b65aec52847419745f09be938db69. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:52:03.352674 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-ea4ed02b-ede2-495f-8f9d-b5451a4736d4 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Getting quotas for user ed6651178cc64addaec1f30bb0108295 and project 805b65aec52847419745f09be938db69. Resources: {'key_pairs'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:52:03.386238 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ea4ed02b-ede2-495f-8f9d-b5451a4736d4 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.060072 Jul 25 15:52:03.387183 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4003/7782] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 15:52:03 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:52:13.829757 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 15:52:13.830508 n-d-846435-14 devstack@n-api.service[119304]: Mon Jul 25 15:52:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 15:52:22.004520 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=10 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:52:22.005277 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:52:22.009523 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4bcc79bd-8279-4c6a-8acc-6bb0108c3a18 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1616074737", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-745757774", "security_groups": [{"name": "tempest-secgroup-smoke-346740744"}], "networks": [{"uuid": "cd4bcfbd-e893-47e9-b035-0273ba89e77e"}], "block_device_mapping_v2": [{"uuid": "7360c879-72f2-4de5-b1cc-dd345b6e510e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:52:22.132028 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-4bcc79bd-8279-4c6a-8acc-6bb0108c3a18 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] validate_networks() for [('cd4bcfbd-e893-47e9-b035-0273ba89e77e', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:52:22.545828 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-4bcc79bd-8279-4c6a-8acc-6bb0108c3a18 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:52:22.546250 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-4bcc79bd-8279-4c6a-8acc-6bb0108c3a18 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:52:22.546773 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-4bcc79bd-8279-4c6a-8acc-6bb0108c3a18 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:52:22.547183 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-4bcc79bd-8279-4c6a-8acc-6bb0108c3a18 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:52:22.547594 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-4bcc79bd-8279-4c6a-8acc-6bb0108c3a18 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:52:22.561656 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4bcc79bd-8279-4c6a-8acc-6bb0108c3a18 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:22.562257 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4bcc79bd-8279-4c6a-8acc-6bb0108c3a18 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:22.563387 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4bcc79bd-8279-4c6a-8acc-6bb0108c3a18 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:22.564033 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4bcc79bd-8279-4c6a-8acc-6bb0108c3a18 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:22.585822 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-4bcc79bd-8279-4c6a-8acc-6bb0108c3a18 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Getting quotas for project 805b65aec52847419745f09be938db69. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:52:22.591667 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-4bcc79bd-8279-4c6a-8acc-6bb0108c3a18 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Getting quotas for user ed6651178cc64addaec1f30bb0108295 and project 805b65aec52847419745f09be938db69. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:52:22.657617 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4bcc79bd-8279-4c6a-8acc-6bb0108c3a18 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:52:22.659839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4bcc79bd-8279-4c6a-8acc-6bb0108c3a18 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7360c879-72f2-4de5-b1cc-dd345b6e510e',volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:52:22.809232 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4bcc79bd-8279-4c6a-8acc-6bb0108c3a18 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.806555 Jul 25 15:52:22.809823 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3780/7783] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:52:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:52:22.822271 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e129e77f-3315-4cc7-a861-f72957623d8e tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:52:22.823112 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e129e77f-3315-4cc7-a861-f72957623d8e tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:52:22.826601 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:52:22.827278 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=4 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:52:22.828166 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:52:22.888279 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e129e77f-3315-4cc7-a861-f72957623d8e tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:52:22.897748 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e129e77f-3315-4cc7-a861-f72957623d8e tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1088 microversion: 2.1 time: 0.079425 Jul 25 15:52:22.898347 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4004/7784] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:52:22 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1088 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:52:23.920305 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0200866a-fa35-4b9a-b4ac-c731a4f6b258 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:52:23.921031 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0200866a-fa35-4b9a-b4ac-c731a4f6b258 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:52:23.928512 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0200866a-fa35-4b9a-b4ac-c731a4f6b258 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:23.928970 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0200866a-fa35-4b9a-b4ac-c731a4f6b258 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:23.930072 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0200866a-fa35-4b9a-b4ac-c731a4f6b258 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:23.930837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0200866a-fa35-4b9a-b4ac-c731a4f6b258 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:24.283845 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0200866a-fa35-4b9a-b4ac-c731a4f6b258 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:52:24.294169 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0200866a-fa35-4b9a-b4ac-c731a4f6b258 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1204 microversion: 2.1 time: 0.378521 Jul 25 15:52:24.295333 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3781/7785] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:52:23 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1204 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:52:25.319094 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ecdb43be-a83e-4ba7-8e6c-89b1719a79b8 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:52:25.320827 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ecdb43be-a83e-4ba7-8e6c-89b1719a79b8 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:52:25.330326 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ecdb43be-a83e-4ba7-8e6c-89b1719a79b8 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:25.331191 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ecdb43be-a83e-4ba7-8e6c-89b1719a79b8 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:25.332363 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ecdb43be-a83e-4ba7-8e6c-89b1719a79b8 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:25.333038 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ecdb43be-a83e-4ba7-8e6c-89b1719a79b8 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:25.497935 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ecdb43be-a83e-4ba7-8e6c-89b1719a79b8 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:52:25.509334 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ecdb43be-a83e-4ba7-8e6c-89b1719a79b8 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1271 microversion: 2.1 time: 0.195745 Jul 25 15:52:25.512930 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4005/7786] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:52:25 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1271 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:52:25.884784 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-c2bf3d19-a3fd-48b5-8972-47d020d898c5 req-642f3030-b6c7-4c70-84bb-16101203da3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "066f1426-8ee1-4b6c-b0c2-1d4d94e38423", "tag": "43fc53a7-d36d-44b4-abf2-0edf3a004784"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:52:25.930251 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c2bf3d19-a3fd-48b5-8972-47d020d898c5 req-642f3030-b6c7-4c70-84bb-16101203da3f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:25.930712 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-c2bf3d19-a3fd-48b5-8972-47d020d898c5 req-642f3030-b6c7-4c70-84bb-16101203da3f service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:25.951422 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-c2bf3d19-a3fd-48b5-8972-47d020d898c5 req-642f3030-b6c7-4c70-84bb-16101203da3f service nova] Creating event network-changed:43fc53a7-d36d-44b4-abf2-0edf3a004784 for instance 066f1426-8ee1-4b6c-b0c2-1d4d94e38423 on n-h2-846435-14 Jul 25 15:52:25.958188 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-c2bf3d19-a3fd-48b5-8972-47d020d898c5 req-642f3030-b6c7-4c70-84bb-16101203da3f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081921 Jul 25 15:52:25.959395 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3782/7787] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:52:26.531511 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-3c6577ea-8df9-4f67-9bee-9461d9bee50f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:52:26.533505 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-3c6577ea-8df9-4f67-9bee-9461d9bee50f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:52:26.542243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c6577ea-8df9-4f67-9bee-9461d9bee50f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:26.543725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c6577ea-8df9-4f67-9bee-9461d9bee50f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:26.544642 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c6577ea-8df9-4f67-9bee-9461d9bee50f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:26.545140 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-3c6577ea-8df9-4f67-9bee-9461d9bee50f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:26.700794 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-3c6577ea-8df9-4f67-9bee-9461d9bee50f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:52:26.709155 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-3c6577ea-8df9-4f67-9bee-9461d9bee50f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1271 microversion: 2.1 time: 0.181815 Jul 25 15:52:26.710185 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4006/7788] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:52:26 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1271 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:52:27.732993 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-e3916519-43ba-4e66-b46a-5347082a385e tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:52:27.733834 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-e3916519-43ba-4e66-b46a-5347082a385e tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:52:27.742959 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3916519-43ba-4e66-b46a-5347082a385e tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:27.743411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3916519-43ba-4e66-b46a-5347082a385e tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:27.744281 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3916519-43ba-4e66-b46a-5347082a385e tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:27.745058 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-e3916519-43ba-4e66-b46a-5347082a385e tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:27.895656 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-e3916519-43ba-4e66-b46a-5347082a385e tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:52:27.903968 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-e3916519-43ba-4e66-b46a-5347082a385e tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1271 microversion: 2.1 time: 0.175643 Jul 25 15:52:27.904582 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3783/7789] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:52:27 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1271 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:52:28.924756 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a5cad0f2-09c2-428e-8a88-605be743d39a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:52:28.925397 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a5cad0f2-09c2-428e-8a88-605be743d39a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:52:28.936957 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5cad0f2-09c2-428e-8a88-605be743d39a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:28.937431 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5cad0f2-09c2-428e-8a88-605be743d39a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:28.938259 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5cad0f2-09c2-428e-8a88-605be743d39a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:28.938723 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a5cad0f2-09c2-428e-8a88-605be743d39a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:29.108993 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a5cad0f2-09c2-428e-8a88-605be743d39a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:52:29.118258 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a5cad0f2-09c2-428e-8a88-605be743d39a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1271 microversion: 2.1 time: 0.197626 Jul 25 15:52:29.119799 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4007/7790] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:52:28 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1271 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:52:30.143204 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8b8ded92-615e-44ea-ac77-5ffab4da645d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:52:30.143874 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8b8ded92-615e-44ea-ac77-5ffab4da645d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:52:30.151313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b8ded92-615e-44ea-ac77-5ffab4da645d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:30.151769 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b8ded92-615e-44ea-ac77-5ffab4da645d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:30.152583 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b8ded92-615e-44ea-ac77-5ffab4da645d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:30.153024 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b8ded92-615e-44ea-ac77-5ffab4da645d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:30.297717 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8b8ded92-615e-44ea-ac77-5ffab4da645d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:52:30.309113 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8b8ded92-615e-44ea-ac77-5ffab4da645d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1259 microversion: 2.1 time: 0.169555 Jul 25 15:52:30.309946 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3784/7791] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:52:30 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:52:31.332286 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-37fad8b1-ce90-46f3-a7a5-5385d39a93a2 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:52:31.332884 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-37fad8b1-ce90-46f3-a7a5-5385d39a93a2 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:52:31.340826 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37fad8b1-ce90-46f3-a7a5-5385d39a93a2 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:31.341524 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37fad8b1-ce90-46f3-a7a5-5385d39a93a2 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:31.342638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37fad8b1-ce90-46f3-a7a5-5385d39a93a2 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:31.343088 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-37fad8b1-ce90-46f3-a7a5-5385d39a93a2 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:31.493903 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-37fad8b1-ce90-46f3-a7a5-5385d39a93a2 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:52:31.505146 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-37fad8b1-ce90-46f3-a7a5-5385d39a93a2 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1259 microversion: 2.1 time: 0.177380 Jul 25 15:52:31.505912 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4008/7792] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:52:31 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:52:32.531332 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b982d693-c3ba-4373-9009-0902d44f4fdb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:52:32.532389 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b982d693-c3ba-4373-9009-0902d44f4fdb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:52:32.540215 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b982d693-c3ba-4373-9009-0902d44f4fdb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:32.540666 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b982d693-c3ba-4373-9009-0902d44f4fdb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:32.541434 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b982d693-c3ba-4373-9009-0902d44f4fdb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:32.541893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b982d693-c3ba-4373-9009-0902d44f4fdb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:32.574083 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:52:32.598884 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=6 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:52:32.690186 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b982d693-c3ba-4373-9009-0902d44f4fdb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:52:32.698183 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b982d693-c3ba-4373-9009-0902d44f4fdb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1259 microversion: 2.1 time: 0.171377 Jul 25 15:52:32.698703 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3785/7793] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:52:32 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:52:33.722147 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-7eddcc39-7418-44f0-90e9-f2835bfbf8eb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:52:33.722997 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-7eddcc39-7418-44f0-90e9-f2835bfbf8eb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:52:33.726361 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:52:33.733881 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7eddcc39-7418-44f0-90e9-f2835bfbf8eb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:33.734482 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7eddcc39-7418-44f0-90e9-f2835bfbf8eb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:33.735497 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7eddcc39-7418-44f0-90e9-f2835bfbf8eb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:33.736115 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-7eddcc39-7418-44f0-90e9-f2835bfbf8eb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:33.883865 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-7eddcc39-7418-44f0-90e9-f2835bfbf8eb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:52:33.894694 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-7eddcc39-7418-44f0-90e9-f2835bfbf8eb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1259 microversion: 2.1 time: 0.177789 Jul 25 15:52:33.895426 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4009/7794] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:52:33 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:52:34.919724 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-4f5ed4b2-0469-46e6-9b46-03062839884d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:52:34.920470 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-4f5ed4b2-0469-46e6-9b46-03062839884d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:52:34.927479 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4f5ed4b2-0469-46e6-9b46-03062839884d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:34.927935 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4f5ed4b2-0469-46e6-9b46-03062839884d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:34.928744 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4f5ed4b2-0469-46e6-9b46-03062839884d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:34.929181 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-4f5ed4b2-0469-46e6-9b46-03062839884d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:35.089323 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-4f5ed4b2-0469-46e6-9b46-03062839884d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:52:35.097694 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-4f5ed4b2-0469-46e6-9b46-03062839884d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1259 microversion: 2.1 time: 0.182144 Jul 25 15:52:35.098322 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3786/7795] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:52:34 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1259 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:52:36.119699 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-8b8d776b-4ff4-4c69-b526-966fe566d794 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:52:36.120389 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-8b8d776b-4ff4-4c69-b526-966fe566d794 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:52:36.127713 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8b8d776b-4ff4-4c69-b526-966fe566d794 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:36.128231 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8b8d776b-4ff4-4c69-b526-966fe566d794 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:36.129017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8b8d776b-4ff4-4c69-b526-966fe566d794 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:36.129548 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-8b8d776b-4ff4-4c69-b526-966fe566d794 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:36.268395 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-8b8d776b-4ff4-4c69-b526-966fe566d794 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:52:36.276223 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-8b8d776b-4ff4-4c69-b526-966fe566d794 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1259 microversion: 2.1 time: 0.160964 Jul 25 15:52:36.276811 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4010/7796] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:52:36 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:52:37.297362 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0641ab8d-b798-4a8a-8d04-c7cd01035846 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:52:37.298039 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0641ab8d-b798-4a8a-8d04-c7cd01035846 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:52:37.305658 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0641ab8d-b798-4a8a-8d04-c7cd01035846 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:37.306112 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0641ab8d-b798-4a8a-8d04-c7cd01035846 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:37.306886 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0641ab8d-b798-4a8a-8d04-c7cd01035846 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:37.307321 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0641ab8d-b798-4a8a-8d04-c7cd01035846 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:37.455955 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0641ab8d-b798-4a8a-8d04-c7cd01035846 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:52:37.464359 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0641ab8d-b798-4a8a-8d04-c7cd01035846 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1259 microversion: 2.1 time: 0.170890 Jul 25 15:52:37.465315 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3787/7797] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:52:37 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:52:38.489472 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ef46ff9d-dd5c-4403-a989-021d8f1758d9 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:52:38.490074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ef46ff9d-dd5c-4403-a989-021d8f1758d9 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:52:38.498413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ef46ff9d-dd5c-4403-a989-021d8f1758d9 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:38.498877 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ef46ff9d-dd5c-4403-a989-021d8f1758d9 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:38.499654 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ef46ff9d-dd5c-4403-a989-021d8f1758d9 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:38.500138 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ef46ff9d-dd5c-4403-a989-021d8f1758d9 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:38.639762 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ef46ff9d-dd5c-4403-a989-021d8f1758d9 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:52:38.649700 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ef46ff9d-dd5c-4403-a989-021d8f1758d9 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1259 microversion: 2.1 time: 0.166542 Jul 25 15:52:38.650331 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4011/7798] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:52:38 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:52:39.670829 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f716032c-59b4-415b-9b90-af906b13ac6a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:52:39.671488 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f716032c-59b4-415b-9b90-af906b13ac6a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:52:39.678918 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f716032c-59b4-415b-9b90-af906b13ac6a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:39.679373 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f716032c-59b4-415b-9b90-af906b13ac6a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:39.680193 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f716032c-59b4-415b-9b90-af906b13ac6a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:39.680629 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f716032c-59b4-415b-9b90-af906b13ac6a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:39.824641 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f716032c-59b4-415b-9b90-af906b13ac6a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:52:39.832480 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f716032c-59b4-415b-9b90-af906b13ac6a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1259 microversion: 2.1 time: 0.165642 Jul 25 15:52:39.833139 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3788/7799] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:52:39 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:52:40.206062 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-b5b172c1-30d0-462d-9846-16a244589fbb req-f9a25632-224d-438a-9a83-3fe3b0e86eed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "066f1426-8ee1-4b6c-b0c2-1d4d94e38423", "name": "network-vif-plugged", "status": "completed", "tag": "43fc53a7-d36d-44b4-abf2-0edf3a004784"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:52:40.219738 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-b5b172c1-30d0-462d-9846-16a244589fbb req-f9a25632-224d-438a-9a83-3fe3b0e86eed service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:40.220243 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-b5b172c1-30d0-462d-9846-16a244589fbb req-f9a25632-224d-438a-9a83-3fe3b0e86eed service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:40.234496 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-b5b172c1-30d0-462d-9846-16a244589fbb req-f9a25632-224d-438a-9a83-3fe3b0e86eed service nova] Creating event network-vif-plugged:43fc53a7-d36d-44b4-abf2-0edf3a004784 for instance 066f1426-8ee1-4b6c-b0c2-1d4d94e38423 on n-h2-846435-14 Jul 25 15:52:40.240002 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-b5b172c1-30d0-462d-9846-16a244589fbb req-f9a25632-224d-438a-9a83-3fe3b0e86eed service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037567 Jul 25 15:52:40.240575 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4012/7800] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:52:40.854529 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b176a331-07dd-47ce-b770-b30fd3a56688 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:52:40.855124 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b176a331-07dd-47ce-b770-b30fd3a56688 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:52:40.862457 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b176a331-07dd-47ce-b770-b30fd3a56688 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:40.863030 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b176a331-07dd-47ce-b770-b30fd3a56688 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:40.864294 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b176a331-07dd-47ce-b770-b30fd3a56688 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:40.864838 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b176a331-07dd-47ce-b770-b30fd3a56688 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:41.010411 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-b176a331-07dd-47ce-b770-b30fd3a56688 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:52:41.022040 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b176a331-07dd-47ce-b770-b30fd3a56688 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1259 microversion: 2.1 time: 0.171534 Jul 25 15:52:41.022696 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3789/7801] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:52:40 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:52:42.051745 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-9624055f-7888-42bd-8829-6dcd47aa5f33 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:52:42.052706 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-9624055f-7888-42bd-8829-6dcd47aa5f33 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:52:42.059693 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9624055f-7888-42bd-8829-6dcd47aa5f33 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:42.060192 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9624055f-7888-42bd-8829-6dcd47aa5f33 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:42.060995 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9624055f-7888-42bd-8829-6dcd47aa5f33 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:42.061447 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-9624055f-7888-42bd-8829-6dcd47aa5f33 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:42.210824 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-9624055f-7888-42bd-8829-6dcd47aa5f33 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:52:42.219469 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-9624055f-7888-42bd-8829-6dcd47aa5f33 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1441 microversion: 2.1 time: 0.175462 Jul 25 15:52:42.220008 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4013/7802] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:52:42 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1441 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:52:42.240203 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-44f683ea-408b-4e94-becb-f21509517a04 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:52:42.240814 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-44f683ea-408b-4e94-becb-f21509517a04 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:52:42.248231 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-44f683ea-408b-4e94-becb-f21509517a04 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:42.248796 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-44f683ea-408b-4e94-becb-f21509517a04 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:42.249460 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-44f683ea-408b-4e94-becb-f21509517a04 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:42.249920 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-44f683ea-408b-4e94-becb-f21509517a04 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:42.390455 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-44f683ea-408b-4e94-becb-f21509517a04 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:52:42.399001 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-44f683ea-408b-4e94-becb-f21509517a04 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1441 microversion: 2.1 time: 0.162887 Jul 25 15:52:42.399655 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3790/7803] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:52:42 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1441 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:52:44.219423 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-1b2ac8c8-35bf-4b21-90c8-5e5ceed287ef req-8d19cf1c-1672-42fb-8289-9450f8c2d168 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "066f1426-8ee1-4b6c-b0c2-1d4d94e38423", "tag": "43fc53a7-d36d-44b4-abf2-0edf3a004784"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:52:44.230275 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-1b2ac8c8-35bf-4b21-90c8-5e5ceed287ef req-8d19cf1c-1672-42fb-8289-9450f8c2d168 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:52:44.230728 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-1b2ac8c8-35bf-4b21-90c8-5e5ceed287ef req-8d19cf1c-1672-42fb-8289-9450f8c2d168 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:52:44.244409 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-1b2ac8c8-35bf-4b21-90c8-5e5ceed287ef req-8d19cf1c-1672-42fb-8289-9450f8c2d168 service nova] Creating event network-changed:43fc53a7-d36d-44b4-abf2-0edf3a004784 for instance 066f1426-8ee1-4b6c-b0c2-1d4d94e38423 on n-h2-846435-14 Jul 25 15:52:44.250128 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-1b2ac8c8-35bf-4b21-90c8-5e5ceed287ef req-8d19cf1c-1672-42fb-8289-9450f8c2d168 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035101 Jul 25 15:52:44.251117 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4014/7804] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:54:41.756989 n-d-846435-14 devstack@n-api.service[119303]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c17eba8c-cddd-4f98-b66f-c71ea3b6f89c] AMQP server on 10.222.0.88:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 15:54:41.757942 n-d-846435-14 devstack@n-api.service[119303]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b24320cd-02fe-4cda-9e22-8ff297cb0d9a] AMQP server on 10.222.0.88:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 15:54:41.758876 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:54:41.759679 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=58 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:54:41.814306 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d88d0786-7ab2-46a2-8f77-58bdf6652597 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:54:41.814905 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d88d0786-7ab2-46a2-8f77-58bdf6652597 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:54:41.821641 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d88d0786-7ab2-46a2-8f77-58bdf6652597 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:41.822147 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d88d0786-7ab2-46a2-8f77-58bdf6652597 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:41.822965 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d88d0786-7ab2-46a2-8f77-58bdf6652597 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:41.823405 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d88d0786-7ab2-46a2-8f77-58bdf6652597 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:41.852658 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-d88d0786-7ab2-46a2-8f77-58bdf6652597 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lazy-loading 'flavor' on Instance uuid 066f1426-8ee1-4b6c-b0c2-1d4d94e38423 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:54:41.944180 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d88d0786-7ab2-46a2-8f77-58bdf6652597 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "POST /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423/action" status: 202 len: 0 microversion: 2.1 time: 0.188908 Jul 25 15:54:41.944768 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3791/7805] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:54:41 2022] POST /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:54:41.952847 n-d-846435-14 devstack@n-api.service[119304]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2677c88d-98e4-43fd-a6d8-07da2f5a5121] AMQP server on 10.222.0.88:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 15:54:41.953761 n-d-846435-14 devstack@n-api.service[119304]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5a3fcd17-2893-497d-b07f-ee8fd2346add] AMQP server on 10.222.0.88:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 15:54:41.954451 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=24 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:54:41.955457 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=52 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:54:41.961056 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e4da23b6-6b10-4c6d-82de-f702834ab8cf tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:54:41.961994 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e4da23b6-6b10-4c6d-82de-f702834ab8cf tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:54:41.971555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e4da23b6-6b10-4c6d-82de-f702834ab8cf tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:41.972040 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e4da23b6-6b10-4c6d-82de-f702834ab8cf tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:41.972818 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e4da23b6-6b10-4c6d-82de-f702834ab8cf tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:41.973259 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e4da23b6-6b10-4c6d-82de-f702834ab8cf tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:42.119511 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e4da23b6-6b10-4c6d-82de-f702834ab8cf tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:54:42.129567 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e4da23b6-6b10-4c6d-82de-f702834ab8cf tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1565 microversion: 2.1 time: 0.178701 Jul 25 15:54:42.130156 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4015/7806] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:54:41 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1565 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:54:43.152065 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-bc267af0-c9a9-4c06-9175-879ea82b706f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:54:43.152840 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-bc267af0-c9a9-4c06-9175-879ea82b706f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:54:43.163067 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bc267af0-c9a9-4c06-9175-879ea82b706f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:43.163516 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bc267af0-c9a9-4c06-9175-879ea82b706f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:43.164297 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bc267af0-c9a9-4c06-9175-879ea82b706f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:43.164737 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-bc267af0-c9a9-4c06-9175-879ea82b706f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:43.169515 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [-] [c17eba8c-cddd-4f98-b66f-c71ea3b6f89c] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 54314. Jul 25 15:54:43.173060 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [-] [b24320cd-02fe-4cda-9e22-8ff297cb0d9a] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 54316. Jul 25 15:54:43.319648 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-bc267af0-c9a9-4c06-9175-879ea82b706f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:54:43.330683 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-bc267af0-c9a9-4c06-9175-879ea82b706f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1565 microversion: 2.1 time: 0.182852 Jul 25 15:54:43.332614 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3792/7807] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:54:43 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1565 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:54:44.353113 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-84be7026-a2aa-4a04-b227-9013c7386061 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:54:44.353733 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-84be7026-a2aa-4a04-b227-9013c7386061 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:54:44.364832 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-84be7026-a2aa-4a04-b227-9013c7386061 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:44.365292 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-84be7026-a2aa-4a04-b227-9013c7386061 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:44.366083 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-84be7026-a2aa-4a04-b227-9013c7386061 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:44.366532 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-84be7026-a2aa-4a04-b227-9013c7386061 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:44.370571 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [-] [2677c88d-98e4-43fd-a6d8-07da2f5a5121] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 54320. Jul 25 15:54:44.373439 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [-] [5a3fcd17-2893-497d-b07f-ee8fd2346add] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 54322. Jul 25 15:54:44.511010 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-84be7026-a2aa-4a04-b227-9013c7386061 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:54:44.519878 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-84be7026-a2aa-4a04-b227-9013c7386061 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1565 microversion: 2.1 time: 0.170624 Jul 25 15:54:44.520644 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4016/7808] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:54:44 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:54:45.545293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7e69feaa-b95f-4ee6-99f8-21046c93bc6f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:54:45.545900 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-7e69feaa-b95f-4ee6-99f8-21046c93bc6f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:54:45.553618 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7e69feaa-b95f-4ee6-99f8-21046c93bc6f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:45.554069 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7e69feaa-b95f-4ee6-99f8-21046c93bc6f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:45.554857 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7e69feaa-b95f-4ee6-99f8-21046c93bc6f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:45.555293 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-7e69feaa-b95f-4ee6-99f8-21046c93bc6f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:45.697015 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-7e69feaa-b95f-4ee6-99f8-21046c93bc6f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:54:45.705152 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7e69feaa-b95f-4ee6-99f8-21046c93bc6f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1565 microversion: 2.1 time: 0.163713 Jul 25 15:54:45.705770 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3793/7809] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:54:45 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:54:46.730426 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-6c54f251-d6ed-42b7-9d57-2a50f47f7154 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:54:46.731071 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-6c54f251-d6ed-42b7-9d57-2a50f47f7154 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:54:46.741286 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6c54f251-d6ed-42b7-9d57-2a50f47f7154 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:46.741861 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6c54f251-d6ed-42b7-9d57-2a50f47f7154 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:46.742959 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6c54f251-d6ed-42b7-9d57-2a50f47f7154 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:46.743597 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-6c54f251-d6ed-42b7-9d57-2a50f47f7154 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:46.892379 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-6c54f251-d6ed-42b7-9d57-2a50f47f7154 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:54:46.903116 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-6c54f251-d6ed-42b7-9d57-2a50f47f7154 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1565 microversion: 2.1 time: 0.179285 Jul 25 15:54:46.904112 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4017/7810] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:54:46 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1565 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:54:47.926999 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d16fa8fc-6199-47e1-8d44-00fd0d2c4570 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:54:47.927616 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d16fa8fc-6199-47e1-8d44-00fd0d2c4570 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:54:47.934981 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d16fa8fc-6199-47e1-8d44-00fd0d2c4570 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:47.935436 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d16fa8fc-6199-47e1-8d44-00fd0d2c4570 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:47.936263 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d16fa8fc-6199-47e1-8d44-00fd0d2c4570 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:47.936750 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d16fa8fc-6199-47e1-8d44-00fd0d2c4570 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:48.091418 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d16fa8fc-6199-47e1-8d44-00fd0d2c4570 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:54:48.100199 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d16fa8fc-6199-47e1-8d44-00fd0d2c4570 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1565 microversion: 2.1 time: 0.177385 Jul 25 15:54:48.100792 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3794/7811] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:54:47 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1565 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:54:49.122358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0ce215f8-2dd3-4caa-ae88-817882a6f060 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:54:49.122996 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0ce215f8-2dd3-4caa-ae88-817882a6f060 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:54:49.130506 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0ce215f8-2dd3-4caa-ae88-817882a6f060 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:49.130981 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0ce215f8-2dd3-4caa-ae88-817882a6f060 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:49.131832 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0ce215f8-2dd3-4caa-ae88-817882a6f060 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:49.132315 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0ce215f8-2dd3-4caa-ae88-817882a6f060 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:49.275895 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0ce215f8-2dd3-4caa-ae88-817882a6f060 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:54:49.283595 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0ce215f8-2dd3-4caa-ae88-817882a6f060 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1565 microversion: 2.1 time: 0.165365 Jul 25 15:54:49.284244 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4018/7812] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:54:49 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:54:50.308559 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-115fd155-8793-4c5a-84fb-20f4ff4d6229 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:54:50.309221 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-115fd155-8793-4c5a-84fb-20f4ff4d6229 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:54:50.318811 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-115fd155-8793-4c5a-84fb-20f4ff4d6229 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:50.319261 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-115fd155-8793-4c5a-84fb-20f4ff4d6229 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:50.320082 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-115fd155-8793-4c5a-84fb-20f4ff4d6229 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:50.320504 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-115fd155-8793-4c5a-84fb-20f4ff4d6229 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:50.482587 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-115fd155-8793-4c5a-84fb-20f4ff4d6229 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:54:50.491386 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-115fd155-8793-4c5a-84fb-20f4ff4d6229 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1565 microversion: 2.1 time: 0.188062 Jul 25 15:54:50.492021 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3795/7813] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:54:50 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1565 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:54:51.513048 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-d744e4da-6036-4548-974c-adbd6f02e53d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:54:51.513641 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-d744e4da-6036-4548-974c-adbd6f02e53d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:54:51.521537 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d744e4da-6036-4548-974c-adbd6f02e53d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:51.522008 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d744e4da-6036-4548-974c-adbd6f02e53d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:51.522790 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d744e4da-6036-4548-974c-adbd6f02e53d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:51.523237 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-d744e4da-6036-4548-974c-adbd6f02e53d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:51.674484 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-d744e4da-6036-4548-974c-adbd6f02e53d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:54:51.682541 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-d744e4da-6036-4548-974c-adbd6f02e53d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1565 microversion: 2.1 time: 0.173512 Jul 25 15:54:51.683132 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4019/7814] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:54:51 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:54:52.704372 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ee2f65db-b1ff-4748-84fd-f93b2fc18c31 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:54:52.704979 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ee2f65db-b1ff-4748-84fd-f93b2fc18c31 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:54:52.714323 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee2f65db-b1ff-4748-84fd-f93b2fc18c31 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:52.714940 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee2f65db-b1ff-4748-84fd-f93b2fc18c31 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:52.716047 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee2f65db-b1ff-4748-84fd-f93b2fc18c31 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:52.716591 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee2f65db-b1ff-4748-84fd-f93b2fc18c31 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:52.865458 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ee2f65db-b1ff-4748-84fd-f93b2fc18c31 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:54:52.873692 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ee2f65db-b1ff-4748-84fd-f93b2fc18c31 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1565 microversion: 2.1 time: 0.173420 Jul 25 15:54:52.874396 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3796/7815] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:54:52 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:54:53.896300 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ba7153a6-0529-43bd-90f0-0a86720ea45d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:54:53.896999 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ba7153a6-0529-43bd-90f0-0a86720ea45d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:54:53.905317 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ba7153a6-0529-43bd-90f0-0a86720ea45d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:53.905796 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ba7153a6-0529-43bd-90f0-0a86720ea45d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:53.906599 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ba7153a6-0529-43bd-90f0-0a86720ea45d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:53.907051 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ba7153a6-0529-43bd-90f0-0a86720ea45d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:54.059412 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ba7153a6-0529-43bd-90f0-0a86720ea45d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:54:54.071839 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ba7153a6-0529-43bd-90f0-0a86720ea45d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1565 microversion: 2.1 time: 0.180240 Jul 25 15:54:54.072857 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4020/7816] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:54:53 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1565 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:54:55.097538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0bdca727-8bac-4dad-930a-bac7dddaae38 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:54:55.098161 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0bdca727-8bac-4dad-930a-bac7dddaae38 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:54:55.106695 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0bdca727-8bac-4dad-930a-bac7dddaae38 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:55.107437 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0bdca727-8bac-4dad-930a-bac7dddaae38 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:55.108352 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0bdca727-8bac-4dad-930a-bac7dddaae38 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:55.108819 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0bdca727-8bac-4dad-930a-bac7dddaae38 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:55.270115 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0bdca727-8bac-4dad-930a-bac7dddaae38 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:54:55.284871 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0bdca727-8bac-4dad-930a-bac7dddaae38 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1565 microversion: 2.1 time: 0.191276 Jul 25 15:54:55.288135 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3797/7817] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:54:55 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1565 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:54:56.307724 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-971a6aca-4fda-47ac-978d-94369fd84bbe tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:54:56.308558 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-971a6aca-4fda-47ac-978d-94369fd84bbe tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:54:56.316703 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-971a6aca-4fda-47ac-978d-94369fd84bbe tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:56.317156 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-971a6aca-4fda-47ac-978d-94369fd84bbe tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:56.317969 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-971a6aca-4fda-47ac-978d-94369fd84bbe tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:56.318413 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-971a6aca-4fda-47ac-978d-94369fd84bbe tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:56.466805 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-971a6aca-4fda-47ac-978d-94369fd84bbe tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:54:56.480905 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-971a6aca-4fda-47ac-978d-94369fd84bbe tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1566 microversion: 2.1 time: 0.176997 Jul 25 15:54:56.482006 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4021/7818] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:54:56 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1566 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:54:56.507196 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-099de73b-2a1e-43a9-8884-f62927571f4d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:54:56.507777 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-099de73b-2a1e-43a9-8884-f62927571f4d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:54:56.515720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-099de73b-2a1e-43a9-8884-f62927571f4d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:56.516211 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-099de73b-2a1e-43a9-8884-f62927571f4d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:56.516992 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-099de73b-2a1e-43a9-8884-f62927571f4d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:56.517720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-099de73b-2a1e-43a9-8884-f62927571f4d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:56.629979 n-d-846435-14 devstack@n-api.service[119303]: ERROR oslo.messaging._drivers.impl_rabbit [None req-099de73b-2a1e-43a9-8884-f62927571f4d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [65f5083c-1ce0-4f62-b916-2c16af617d4d] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 15:54:56.679528 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-38de4038-79b4-4096-a9bd-11faa359523e req-02956c1c-262d-4fd5-bba3-c18994fb1b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "066f1426-8ee1-4b6c-b0c2-1d4d94e38423", "name": "network-vif-unplugged", "status": "completed", "tag": "43fc53a7-d36d-44b4-abf2-0edf3a004784"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:54:56.697923 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-38de4038-79b4-4096-a9bd-11faa359523e req-02956c1c-262d-4fd5-bba3-c18994fb1b42 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:56.698372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-38de4038-79b4-4096-a9bd-11faa359523e req-02956c1c-262d-4fd5-bba3-c18994fb1b42 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:56.710779 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.compute.server_external_events [req-38de4038-79b4-4096-a9bd-11faa359523e req-02956c1c-262d-4fd5-bba3-c18994fb1b42 service nova] Unable to find a host for instance 066f1426-8ee1-4b6c-b0c2-1d4d94e38423. Dropping event network-vif-unplugged {{(pid=119304) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 25 15:54:56.711656 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-38de4038-79b4-4096-a9bd-11faa359523e req-02956c1c-262d-4fd5-bba3-c18994fb1b42 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036224 Jul 25 15:54:56.712621 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4022/7819] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 25 15:54:57.638327 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [None req-099de73b-2a1e-43a9-8884-f62927571f4d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [65f5083c-1ce0-4f62-b916-2c16af617d4d] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 54352. Jul 25 15:54:57.644617 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-099de73b-2a1e-43a9-8884-f62927571f4d tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "POST /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423/action" status: 202 len: 0 microversion: 2.1 time: 1.141515 Jul 25 15:54:57.645711 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3798/7820] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 15:54:56 2022] POST /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423/action => generated 0 bytes in 1144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 15:54:57.655160 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-31381702-7dce-4933-9871-125776d0df5c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:54:57.655947 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-31381702-7dce-4933-9871-125776d0df5c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:54:57.665322 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-31381702-7dce-4933-9871-125776d0df5c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:57.665908 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-31381702-7dce-4933-9871-125776d0df5c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:57.666806 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-31381702-7dce-4933-9871-125776d0df5c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:57.667262 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-31381702-7dce-4933-9871-125776d0df5c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:57.909239 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-31381702-7dce-4933-9871-125776d0df5c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:54:57.920483 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-31381702-7dce-4933-9871-125776d0df5c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1514 microversion: 2.1 time: 0.269719 Jul 25 15:54:57.921452 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4023/7821] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:54:57 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1514 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:54:58.944939 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-cd6edcb8-1b3f-41aa-b0e0-edc7cac34b42 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:54:58.945647 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-cd6edcb8-1b3f-41aa-b0e0-edc7cac34b42 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:54:58.953489 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cd6edcb8-1b3f-41aa-b0e0-edc7cac34b42 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:58.953943 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cd6edcb8-1b3f-41aa-b0e0-edc7cac34b42 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:58.954727 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cd6edcb8-1b3f-41aa-b0e0-edc7cac34b42 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:54:58.955161 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-cd6edcb8-1b3f-41aa-b0e0-edc7cac34b42 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:54:59.130166 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-cd6edcb8-1b3f-41aa-b0e0-edc7cac34b42 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:54:59.140667 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-cd6edcb8-1b3f-41aa-b0e0-edc7cac34b42 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1516 microversion: 2.1 time: 0.200727 Jul 25 15:54:59.141254 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3799/7822] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:54:58 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1516 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:55:00.175882 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fdd54e2a-f486-4b2f-9e2e-6f7cfb5a532b tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:55:00.176560 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fdd54e2a-f486-4b2f-9e2e-6f7cfb5a532b tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:55:00.184516 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fdd54e2a-f486-4b2f-9e2e-6f7cfb5a532b tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:55:00.184989 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fdd54e2a-f486-4b2f-9e2e-6f7cfb5a532b tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:55:00.185813 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fdd54e2a-f486-4b2f-9e2e-6f7cfb5a532b tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:55:00.186250 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-fdd54e2a-f486-4b2f-9e2e-6f7cfb5a532b tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:55:00.365886 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fdd54e2a-f486-4b2f-9e2e-6f7cfb5a532b tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:55:00.374822 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fdd54e2a-f486-4b2f-9e2e-6f7cfb5a532b tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1516 microversion: 2.1 time: 0.204528 Jul 25 15:55:00.375432 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4024/7823] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:55:00 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1516 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:55:01.396730 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-d0e8d45d-a623-44a3-8bf4-f46d56524e91 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:55:01.397321 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-d0e8d45d-a623-44a3-8bf4-f46d56524e91 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:55:01.404678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d0e8d45d-a623-44a3-8bf4-f46d56524e91 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:55:01.405130 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d0e8d45d-a623-44a3-8bf4-f46d56524e91 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:55:01.405949 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d0e8d45d-a623-44a3-8bf4-f46d56524e91 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:55:01.406388 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-d0e8d45d-a623-44a3-8bf4-f46d56524e91 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:55:01.596381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-d0e8d45d-a623-44a3-8bf4-f46d56524e91 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:55:01.604903 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-d0e8d45d-a623-44a3-8bf4-f46d56524e91 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1516 microversion: 2.1 time: 0.212154 Jul 25 15:55:01.605600 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3800/7824] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:55:01 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1516 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:55:02.627220 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1f0c24f5-7264-44aa-ad8b-956b5512c6bd tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:55:02.627918 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1f0c24f5-7264-44aa-ad8b-956b5512c6bd tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:55:02.635642 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1f0c24f5-7264-44aa-ad8b-956b5512c6bd tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:55:02.636138 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1f0c24f5-7264-44aa-ad8b-956b5512c6bd tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:55:02.636932 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1f0c24f5-7264-44aa-ad8b-956b5512c6bd tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:55:02.637380 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1f0c24f5-7264-44aa-ad8b-956b5512c6bd tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:55:02.970709 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1f0c24f5-7264-44aa-ad8b-956b5512c6bd tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:55:02.986519 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1f0c24f5-7264-44aa-ad8b-956b5512c6bd tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1516 microversion: 2.1 time: 0.362889 Jul 25 15:55:02.987699 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4025/7825] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:55:02 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1516 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:55:04.013433 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-acfb5ec5-1ad5-4041-a6bb-1ce55c21ddd4 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:55:04.014009 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-acfb5ec5-1ad5-4041-a6bb-1ce55c21ddd4 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:55:04.021893 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-acfb5ec5-1ad5-4041-a6bb-1ce55c21ddd4 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:55:04.022469 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-acfb5ec5-1ad5-4041-a6bb-1ce55c21ddd4 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:55:04.023270 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-acfb5ec5-1ad5-4041-a6bb-1ce55c21ddd4 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:55:04.023714 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-acfb5ec5-1ad5-4041-a6bb-1ce55c21ddd4 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:55:04.645068 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-acfb5ec5-1ad5-4041-a6bb-1ce55c21ddd4 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:55:04.660694 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-acfb5ec5-1ad5-4041-a6bb-1ce55c21ddd4 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1572 microversion: 2.1 time: 0.651194 Jul 25 15:55:04.661855 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3801/7826] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:55:04 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1572 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:55:05.593340 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-957b422c-6cdb-409a-98c8-0be3ff817056 req-2912a7f5-e75d-4038-9ed3-584282c25053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "066f1426-8ee1-4b6c-b0c2-1d4d94e38423", "tag": "43fc53a7-d36d-44b4-abf2-0edf3a004784"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:55:05.604960 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-957b422c-6cdb-409a-98c8-0be3ff817056 req-2912a7f5-e75d-4038-9ed3-584282c25053 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:55:05.605719 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-957b422c-6cdb-409a-98c8-0be3ff817056 req-2912a7f5-e75d-4038-9ed3-584282c25053 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:55:05.619657 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-957b422c-6cdb-409a-98c8-0be3ff817056 req-2912a7f5-e75d-4038-9ed3-584282c25053 service nova] Creating event network-changed:43fc53a7-d36d-44b4-abf2-0edf3a004784 for instance 066f1426-8ee1-4b6c-b0c2-1d4d94e38423 on n-h1-846435-14 Jul 25 15:55:05.623679 n-d-846435-14 devstack@n-api.service[119304]: ERROR oslo.messaging._drivers.impl_rabbit [req-957b422c-6cdb-409a-98c8-0be3ff817056 req-2912a7f5-e75d-4038-9ed3-584282c25053 service nova] [e15a3c26-4f9c-4eb3-b456-6157da08d36e] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 15:55:05.684752 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9e7da4aa-a322-45e4-b7e9-076cbe0a73fb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:55:05.685298 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9e7da4aa-a322-45e4-b7e9-076cbe0a73fb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:55:05.694961 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9e7da4aa-a322-45e4-b7e9-076cbe0a73fb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:55:05.695761 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9e7da4aa-a322-45e4-b7e9-076cbe0a73fb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:55:05.697298 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9e7da4aa-a322-45e4-b7e9-076cbe0a73fb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:55:05.698102 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9e7da4aa-a322-45e4-b7e9-076cbe0a73fb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:55:06.102955 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9e7da4aa-a322-45e4-b7e9-076cbe0a73fb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:55:06.113169 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9e7da4aa-a322-45e4-b7e9-076cbe0a73fb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1572 microversion: 2.1 time: 0.433115 Jul 25 15:55:06.114187 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3802/7827] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:55:05 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1572 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:55:06.633806 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [req-957b422c-6cdb-409a-98c8-0be3ff817056 req-2912a7f5-e75d-4038-9ed3-584282c25053 service nova] [e15a3c26-4f9c-4eb3-b456-6157da08d36e] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 54384. Jul 25 15:55:06.639037 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-957b422c-6cdb-409a-98c8-0be3ff817056 req-2912a7f5-e75d-4038-9ed3-584282c25053 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.145980 Jul 25 15:55:06.639749 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4026/7828] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:55:07.139487 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2a57b8d2-2e86-4fe6-81fb-15752a9d534a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:55:07.140676 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2a57b8d2-2e86-4fe6-81fb-15752a9d534a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:55:07.153159 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a57b8d2-2e86-4fe6-81fb-15752a9d534a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:55:07.153952 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a57b8d2-2e86-4fe6-81fb-15752a9d534a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:55:07.155130 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a57b8d2-2e86-4fe6-81fb-15752a9d534a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:55:07.155877 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2a57b8d2-2e86-4fe6-81fb-15752a9d534a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:55:07.412313 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-2a57b8d2-2e86-4fe6-81fb-15752a9d534a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:55:07.428288 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2a57b8d2-2e86-4fe6-81fb-15752a9d534a tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1572 microversion: 2.1 time: 0.295291 Jul 25 15:55:07.429731 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3803/7829] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:55:07 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1572 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:55:08.462598 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-56953d01-178e-4d7c-a7b9-0d05ca5554b5 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:55:08.463306 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-56953d01-178e-4d7c-a7b9-0d05ca5554b5 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:55:08.470290 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-56953d01-178e-4d7c-a7b9-0d05ca5554b5 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:55:08.470969 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-56953d01-178e-4d7c-a7b9-0d05ca5554b5 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:55:08.471768 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-56953d01-178e-4d7c-a7b9-0d05ca5554b5 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:55:08.472421 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-56953d01-178e-4d7c-a7b9-0d05ca5554b5 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:55:09.039074 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-56953d01-178e-4d7c-a7b9-0d05ca5554b5 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:55:09.054147 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-56953d01-178e-4d7c-a7b9-0d05ca5554b5 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1572 microversion: 2.1 time: 0.596827 Jul 25 15:55:09.055275 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4027/7830] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:55:08 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1572 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:55:10.094514 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-146439c3-a087-460f-a042-2bca89cc0cfa tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:55:10.095720 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-146439c3-a087-460f-a042-2bca89cc0cfa tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:55:10.109002 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-146439c3-a087-460f-a042-2bca89cc0cfa tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:55:10.109697 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-146439c3-a087-460f-a042-2bca89cc0cfa tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:55:10.111018 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-146439c3-a087-460f-a042-2bca89cc0cfa tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:55:10.111962 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-146439c3-a087-460f-a042-2bca89cc0cfa tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:55:10.149250 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:55:10.318612 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-146439c3-a087-460f-a042-2bca89cc0cfa tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:55:10.328197 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-146439c3-a087-460f-a042-2bca89cc0cfa tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1572 microversion: 2.1 time: 0.241328 Jul 25 15:55:10.328830 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3804/7831] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:55:10 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1572 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:55:11.353032 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-36175876-be0b-4496-aea4-934505a6c574 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:55:11.353679 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-36175876-be0b-4496-aea4-934505a6c574 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:55:11.362328 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-36175876-be0b-4496-aea4-934505a6c574 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:55:11.362816 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-36175876-be0b-4496-aea4-934505a6c574 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:55:11.363639 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-36175876-be0b-4496-aea4-934505a6c574 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:55:11.364149 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-36175876-be0b-4496-aea4-934505a6c574 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:55:11.542359 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-36175876-be0b-4496-aea4-934505a6c574 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:55:11.550961 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-36175876-be0b-4496-aea4-934505a6c574 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1572 microversion: 2.1 time: 0.202563 Jul 25 15:55:11.551580 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4028/7832] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:55:11 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1572 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:55:12.581128 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ee319e9d-bd87-4fbd-ab77-c691cf0efad3 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:55:12.581987 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ee319e9d-bd87-4fbd-ab77-c691cf0efad3 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:55:12.585148 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=31 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:55:12.593239 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee319e9d-bd87-4fbd-ab77-c691cf0efad3 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:55:12.593726 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee319e9d-bd87-4fbd-ab77-c691cf0efad3 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:55:12.594521 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee319e9d-bd87-4fbd-ab77-c691cf0efad3 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:55:12.594992 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ee319e9d-bd87-4fbd-ab77-c691cf0efad3 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:55:12.767835 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ee319e9d-bd87-4fbd-ab77-c691cf0efad3 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:55:12.777233 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ee319e9d-bd87-4fbd-ab77-c691cf0efad3 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1572 microversion: 2.1 time: 0.200907 Jul 25 15:55:12.777953 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3805/7833] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:55:12 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1572 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:55:13.800628 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-1e7dd687-c9a7-4e60-8120-8b81286abebf tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:55:13.801362 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-1e7dd687-c9a7-4e60-8120-8b81286abebf tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:55:13.804449 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=29 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:55:13.811079 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1e7dd687-c9a7-4e60-8120-8b81286abebf tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:55:13.811547 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1e7dd687-c9a7-4e60-8120-8b81286abebf tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:55:13.812401 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1e7dd687-c9a7-4e60-8120-8b81286abebf tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:55:13.812856 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-1e7dd687-c9a7-4e60-8120-8b81286abebf tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:55:13.816252 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=77 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:55:13.992520 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-1e7dd687-c9a7-4e60-8120-8b81286abebf tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:55:14.001603 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-1e7dd687-c9a7-4e60-8120-8b81286abebf tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1572 microversion: 2.1 time: 0.204922 Jul 25 15:55:14.002135 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4029/7834] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:55:13 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1572 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:55:15.024842 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-39a88835-90a3-4fce-812b-52e4e958fd7c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:55:15.026407 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-39a88835-90a3-4fce-812b-52e4e958fd7c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:55:15.034260 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-39a88835-90a3-4fce-812b-52e4e958fd7c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:55:15.035085 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-39a88835-90a3-4fce-812b-52e4e958fd7c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:55:15.036168 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-39a88835-90a3-4fce-812b-52e4e958fd7c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:55:15.036702 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-39a88835-90a3-4fce-812b-52e4e958fd7c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:55:15.260581 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-39a88835-90a3-4fce-812b-52e4e958fd7c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:55:15.275425 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-39a88835-90a3-4fce-812b-52e4e958fd7c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1572 microversion: 2.1 time: 0.255335 Jul 25 15:55:15.276458 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3806/7835] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:55:15 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1572 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:55:16.299721 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-86b874f6-335b-4906-8395-301899b241b1 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:55:16.300381 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-86b874f6-335b-4906-8395-301899b241b1 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:55:16.307251 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-86b874f6-335b-4906-8395-301899b241b1 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:55:16.307738 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-86b874f6-335b-4906-8395-301899b241b1 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:55:16.308575 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-86b874f6-335b-4906-8395-301899b241b1 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:55:16.309093 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-86b874f6-335b-4906-8395-301899b241b1 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:55:16.455189 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-86b874f6-335b-4906-8395-301899b241b1 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:55:16.463917 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-86b874f6-335b-4906-8395-301899b241b1 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1572 microversion: 2.1 time: 0.168483 Jul 25 15:55:16.464603 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4030/7836] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:55:16 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1572 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:55:17.063356 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-f5a3ad7d-79ae-4aec-bc56-7521a5346ebd req-ae4b0863-b24c-4338-91fa-eaa35e205c5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "066f1426-8ee1-4b6c-b0c2-1d4d94e38423", "name": "network-vif-plugged", "status": "completed", "tag": "43fc53a7-d36d-44b4-abf2-0edf3a004784"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:55:17.075355 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f5a3ad7d-79ae-4aec-bc56-7521a5346ebd req-ae4b0863-b24c-4338-91fa-eaa35e205c5e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:55:17.075802 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f5a3ad7d-79ae-4aec-bc56-7521a5346ebd req-ae4b0863-b24c-4338-91fa-eaa35e205c5e service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:55:17.089998 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-f5a3ad7d-79ae-4aec-bc56-7521a5346ebd req-ae4b0863-b24c-4338-91fa-eaa35e205c5e service nova] Creating event network-vif-plugged:43fc53a7-d36d-44b4-abf2-0edf3a004784 for instance 066f1426-8ee1-4b6c-b0c2-1d4d94e38423 on n-h1-846435-14 Jul 25 15:55:17.095812 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-f5a3ad7d-79ae-4aec-bc56-7521a5346ebd req-ae4b0863-b24c-4338-91fa-eaa35e205c5e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109409 Jul 25 15:55:17.097029 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3807/7837] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:55:17.486846 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-349891e1-221d-4d65-9682-82f43c656a0c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:55:17.487758 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-349891e1-221d-4d65-9682-82f43c656a0c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:55:17.498491 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-349891e1-221d-4d65-9682-82f43c656a0c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:55:17.499136 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-349891e1-221d-4d65-9682-82f43c656a0c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:55:17.500414 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-349891e1-221d-4d65-9682-82f43c656a0c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:55:17.501736 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-349891e1-221d-4d65-9682-82f43c656a0c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:55:17.648890 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-349891e1-221d-4d65-9682-82f43c656a0c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:55:17.657938 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-349891e1-221d-4d65-9682-82f43c656a0c tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1572 microversion: 2.1 time: 0.175632 Jul 25 15:55:17.658549 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4031/7838] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:55:17 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1572 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:55:18.689912 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0060358a-45df-4803-aa89-ef5afd06449e tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:55:18.691194 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0060358a-45df-4803-aa89-ef5afd06449e tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:55:18.705874 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0060358a-45df-4803-aa89-ef5afd06449e tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:55:18.706512 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0060358a-45df-4803-aa89-ef5afd06449e tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:55:18.708119 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0060358a-45df-4803-aa89-ef5afd06449e tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:55:18.708660 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0060358a-45df-4803-aa89-ef5afd06449e tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:55:18.875173 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0060358a-45df-4803-aa89-ef5afd06449e tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:55:18.885450 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0060358a-45df-4803-aa89-ef5afd06449e tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1559 microversion: 2.1 time: 0.200690 Jul 25 15:55:18.886245 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3808/7839] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:55:18 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1559 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:55:33.838681 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 15:55:33.839331 n-d-846435-14 devstack@n-api.service[119304]: Mon Jul 25 15:55:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 15:56:38.383262 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=7 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:56:38.384317 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=22 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:56:38.390903 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f03f27cb-3f4f-4c1e-982a-3a4947e6c532 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:56:38.391844 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f03f27cb-3f4f-4c1e-982a-3a4947e6c532 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:56:38.394998 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=5 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:56:38.395863 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=17 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:56:38.400721 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-201554fc-215d-4d76-a93d-d0181a28fef9 req-06408207-feb5-45c2-9f32-7274aba53c5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "066f1426-8ee1-4b6c-b0c2-1d4d94e38423", "tag": "43fc53a7-d36d-44b4-abf2-0edf3a004784"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:56:38.414476 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-201554fc-215d-4d76-a93d-d0181a28fef9 req-06408207-feb5-45c2-9f32-7274aba53c5d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:56:38.414976 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-201554fc-215d-4d76-a93d-d0181a28fef9 req-06408207-feb5-45c2-9f32-7274aba53c5d service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:56:38.416490 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f03f27cb-3f4f-4c1e-982a-3a4947e6c532 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:56:38.416946 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f03f27cb-3f4f-4c1e-982a-3a4947e6c532 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:56:38.418911 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f03f27cb-3f4f-4c1e-982a-3a4947e6c532 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:56:38.419687 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f03f27cb-3f4f-4c1e-982a-3a4947e6c532 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:56:38.443470 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-201554fc-215d-4d76-a93d-d0181a28fef9 req-06408207-feb5-45c2-9f32-7274aba53c5d service nova] Creating event network-changed:43fc53a7-d36d-44b4-abf2-0edf3a004784 for instance 066f1426-8ee1-4b6c-b0c2-1d4d94e38423 on n-h1-846435-14 Jul 25 15:56:38.452028 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-201554fc-215d-4d76-a93d-d0181a28fef9 req-06408207-feb5-45c2-9f32-7274aba53c5d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071195 Jul 25 15:56:38.452743 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3809/7840] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:56:38.468314 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f03f27cb-3f4f-4c1e-982a-3a4947e6c532 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 15:56:38.623699 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f03f27cb-3f4f-4c1e-982a-3a4947e6c532 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "DELETE /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 204 len: 0 microversion: 2.1 time: 0.244982 Jul 25 15:56:38.624825 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4032/7841] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 15:56:38 2022] DELETE /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 15:56:38.636609 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-80bab390-3503-4387-8943-fda1c757f9cd tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:56:38.638605 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-80bab390-3503-4387-8943-fda1c757f9cd tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:56:38.648303 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-80bab390-3503-4387-8943-fda1c757f9cd tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:56:38.648771 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-80bab390-3503-4387-8943-fda1c757f9cd tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:56:38.649844 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-80bab390-3503-4387-8943-fda1c757f9cd tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:56:38.650291 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-80bab390-3503-4387-8943-fda1c757f9cd tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:56:38.839702 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-80bab390-3503-4387-8943-fda1c757f9cd tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:56:38.849492 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-80bab390-3503-4387-8943-fda1c757f9cd tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1565 microversion: 2.1 time: 0.217060 Jul 25 15:56:38.849492 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3810/7842] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:56:38 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1565 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 15:56:39.871578 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b3db6113-0e5b-4732-acbc-7204b90108e9 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:56:39.873043 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b3db6113-0e5b-4732-acbc-7204b90108e9 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:56:39.881265 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b3db6113-0e5b-4732-acbc-7204b90108e9 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:56:39.881905 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b3db6113-0e5b-4732-acbc-7204b90108e9 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:56:39.882771 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b3db6113-0e5b-4732-acbc-7204b90108e9 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:56:39.883217 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b3db6113-0e5b-4732-acbc-7204b90108e9 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:56:40.066562 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b3db6113-0e5b-4732-acbc-7204b90108e9 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:56:40.086414 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b3db6113-0e5b-4732-acbc-7204b90108e9 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1565 microversion: 2.1 time: 0.219048 Jul 25 15:56:40.087319 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4033/7843] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:56:39 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1565 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:56:40.698277 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-ed392742-cea0-423c-8f7f-8ab7f19e85d5 req-ec8682f8-8872-411d-a5ea-6ef2f3926c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "066f1426-8ee1-4b6c-b0c2-1d4d94e38423", "name": "network-vif-deleted", "tag": "43fc53a7-d36d-44b4-abf2-0edf3a004784"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:56:40.713428 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ed392742-cea0-423c-8f7f-8ab7f19e85d5 req-ec8682f8-8872-411d-a5ea-6ef2f3926c51 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:56:40.713870 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-ed392742-cea0-423c-8f7f-8ab7f19e85d5 req-ec8682f8-8872-411d-a5ea-6ef2f3926c51 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:56:40.727716 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-ed392742-cea0-423c-8f7f-8ab7f19e85d5 req-ec8682f8-8872-411d-a5ea-6ef2f3926c51 service nova] Creating event network-vif-deleted:43fc53a7-d36d-44b4-abf2-0edf3a004784 for instance 066f1426-8ee1-4b6c-b0c2-1d4d94e38423 on n-h1-846435-14 Jul 25 15:56:40.734219 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-ed392742-cea0-423c-8f7f-8ab7f19e85d5 req-ec8682f8-8872-411d-a5ea-6ef2f3926c51 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039267 Jul 25 15:56:40.734865 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3811/7844] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:56:41.112034 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5e2b26d1-7cad-4a99-affe-024d00525560 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:56:41.113913 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5e2b26d1-7cad-4a99-affe-024d00525560 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:56:41.122119 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5e2b26d1-7cad-4a99-affe-024d00525560 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:56:41.123205 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5e2b26d1-7cad-4a99-affe-024d00525560 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:56:41.124177 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5e2b26d1-7cad-4a99-affe-024d00525560 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:56:41.124888 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-5e2b26d1-7cad-4a99-affe-024d00525560 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:56:41.204358 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5e2b26d1-7cad-4a99-affe-024d00525560 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:56:41.218245 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5e2b26d1-7cad-4a99-affe-024d00525560 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1219 microversion: 2.1 time: 0.108201 Jul 25 15:56:41.218245 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4034/7845] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:56:41 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:56:42.237469 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-1ce5f9e1-9262-49e9-aac0-07b05dbca084 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:56:42.238654 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-1ce5f9e1-9262-49e9-aac0-07b05dbca084 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:56:42.248633 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ce5f9e1-9262-49e9-aac0-07b05dbca084 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:56:42.249055 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ce5f9e1-9262-49e9-aac0-07b05dbca084 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:56:42.249882 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ce5f9e1-9262-49e9-aac0-07b05dbca084 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:56:42.250355 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-1ce5f9e1-9262-49e9-aac0-07b05dbca084 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:56:42.346572 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-1ce5f9e1-9262-49e9-aac0-07b05dbca084 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:56:42.355712 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-1ce5f9e1-9262-49e9-aac0-07b05dbca084 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1219 microversion: 2.1 time: 0.123857 Jul 25 15:56:42.356348 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3812/7846] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:56:42 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1219 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:56:43.379636 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cab5ee84-b893-47e9-ae1e-d8afa20319de tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:56:43.380557 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cab5ee84-b893-47e9-ae1e-d8afa20319de tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:56:43.393048 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cab5ee84-b893-47e9-ae1e-d8afa20319de tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:56:43.393847 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cab5ee84-b893-47e9-ae1e-d8afa20319de tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:56:43.395430 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cab5ee84-b893-47e9-ae1e-d8afa20319de tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:56:43.396242 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cab5ee84-b893-47e9-ae1e-d8afa20319de tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:56:43.481328 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-cab5ee84-b893-47e9-ae1e-d8afa20319de tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:56:43.490064 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cab5ee84-b893-47e9-ae1e-d8afa20319de tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1219 microversion: 2.1 time: 0.116016 Jul 25 15:56:43.490741 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4035/7847] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:56:43 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1219 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:56:44.516547 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fa9e6b62-76be-4fc9-999d-4384a7870bd6 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:56:44.517533 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fa9e6b62-76be-4fc9-999d-4384a7870bd6 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:56:44.527727 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa9e6b62-76be-4fc9-999d-4384a7870bd6 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:56:44.528503 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa9e6b62-76be-4fc9-999d-4384a7870bd6 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:56:44.529822 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa9e6b62-76be-4fc9-999d-4384a7870bd6 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:56:44.530608 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-fa9e6b62-76be-4fc9-999d-4384a7870bd6 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:56:44.610834 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fa9e6b62-76be-4fc9-999d-4384a7870bd6 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:56:44.620483 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fa9e6b62-76be-4fc9-999d-4384a7870bd6 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1219 microversion: 2.1 time: 0.110966 Jul 25 15:56:44.621085 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3813/7848] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:56:44 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1219 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:56:45.643864 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-503a4e9d-b5d9-4026-b6ba-bae946d62e1f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:56:45.644807 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-503a4e9d-b5d9-4026-b6ba-bae946d62e1f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:56:45.652732 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-503a4e9d-b5d9-4026-b6ba-bae946d62e1f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:56:45.653597 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-503a4e9d-b5d9-4026-b6ba-bae946d62e1f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:56:45.654655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-503a4e9d-b5d9-4026-b6ba-bae946d62e1f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:56:45.655197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-503a4e9d-b5d9-4026-b6ba-bae946d62e1f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:56:45.695299 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-503a4e9d-b5d9-4026-b6ba-bae946d62e1f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:56:45.696153 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-503a4e9d-b5d9-4026-b6ba-bae946d62e1f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:56:45.697017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.objects.instance [None req-503a4e9d-b5d9-4026-b6ba-bae946d62e1f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lazy-loading 'fault' on Instance uuid 066f1426-8ee1-4b6c-b0c2-1d4d94e38423 {{(pid=119304) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 15:56:45.746792 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-503a4e9d-b5d9-4026-b6ba-bae946d62e1f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6651178cc64addaec1f30bb0108295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805b65aec52847419745f09be938db69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:56:45.754956 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-503a4e9d-b5d9-4026-b6ba-bae946d62e1f tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 200 len: 1178 microversion: 2.1 time: 0.115725 Jul 25 15:56:45.755564 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4036/7849] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:56:45 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 1178 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:56:46.776790 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9a2a1749-d06a-443f-8256-e784b20f65eb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:56:46.777634 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9a2a1749-d06a-443f-8256-e784b20f65eb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [instance: 066f1426-8ee1-4b6c-b0c2-1d4d94e38423] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:56:46.785929 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9a2a1749-d06a-443f-8256-e784b20f65eb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:56:46.793085 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9a2a1749-d06a-443f-8256-e784b20f65eb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:56:46.793085 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9a2a1749-d06a-443f-8256-e784b20f65eb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:56:46.793085 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9a2a1749-d06a-443f-8256-e784b20f65eb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:56:46.803579 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-9a2a1749-d06a-443f-8256-e784b20f65eb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] HTTP exception thrown: Instance 066f1426-8ee1-4b6c-b0c2-1d4d94e38423 could not be found. Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9a2a1749-d06a-443f-8256-e784b20f65eb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Request method failure captured: Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 HTTP/1.1 Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3rsf6-B4Ph-On6ITGuTpM7grz86Riy9_cvMgBlTSk4-SE-bvXp4ii_0EHzHUTvrn52Y3HGHd2WnjBwPE_wqZ-1TECFEAlxn-k-ITpwIZf-nfCnh_i9-K3vr4Dw1CTT8WzeZjvzW0_ows0ap_uZ57E9qEaxh0adtZs1XMK9DxH6iduws Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 805b65aec52847419745f09be938db69 Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-TestShelveInstance-160824503 Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/805b65aec52847419745f09be938db69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/805b65aec52847419745f09be938db69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_805b65aec52847419745f09be938db69", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/805b65aec52847419745f09be938db69"}]}] Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-TestShelveInstance-160824503 Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 805b65aec52847419745f09be938db69 Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-TestShelveInstance-160824503 Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-TestShelveInstance-160824503-project Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: ed6651178cc64addaec1f30bb0108295 Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-TestShelveInstance-160824503-project Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 066f1426-8ee1-4b6c-b0c2-1d4d94e38423 could not be found. Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '066f1426-8ee1-4b6c-b0c2-1d4d94e38423'} Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 066f1426-8ee1-4b6c-b0c2-1d4d94e38423 could not be found. Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 066f1426-8ee1-4b6c-b0c2-1d4d94e38423 could not be found. Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 15:56:46.805430 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:56:46.810675 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 15:56:46.810675 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 15:56:46.810675 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 15:56:46.810675 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 15:56:46.810675 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 15:56:46.810675 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 066f1426-8ee1-4b6c-b0c2-1d4d94e38423 could not be found. Jul 25 15:56:46.810675 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 15:56:46.810675 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9a2a1749-d06a-443f-8256-e784b20f65eb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Returning 404 to user: Instance 066f1426-8ee1-4b6c-b0c2-1d4d94e38423 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 15:56:46.810675 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9a2a1749-d06a-443f-8256-e784b20f65eb tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423" status: 404 len: 111 microversion: 2.1 time: 0.035336 Jul 25 15:56:46.810675 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3814/7850] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:56:46 2022] GET /compute/v2.1/servers/066f1426-8ee1-4b6c-b0c2-1d4d94e38423 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 15:56:47.028975 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-87cdc43a-cd13-4e52-903b-d0c8af4c34d3 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] Calling method '.version_select at 0x7f46989b2a60>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:56:47.035253 n-d-846435-14 devstack@n-api.service[119304]: ERROR oslo.messaging._drivers.impl_rabbit [None req-87cdc43a-cd13-4e52-903b-d0c8af4c34d3 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [56f6bbb3-d79b-419b-8d71-b05e55801b63] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 15:56:48.048674 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [None req-87cdc43a-cd13-4e52-903b-d0c8af4c34d3 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] [56f6bbb3-d79b-419b-8d71-b05e55801b63] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 54468. Jul 25 15:56:48.079660 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-87cdc43a-cd13-4e52-903b-d0c8af4c34d3 tempest-TestShelveInstance-160824503 tempest-TestShelveInstance-160824503-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-745757774" status: 202 len: 0 microversion: 2.1 time: 1.054362 Jul 25 15:56:48.080833 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4037/7851] 10.222.0.88 () {58 vars in 1251 bytes} [Mon Jul 25 15:56:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-745757774 => generated 0 bytes in 1057 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 15:57:08.340432 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=12 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:57:08.341265 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=24 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:57:08.590377 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-7bfa6a05-30a9-42af-9edc-2193adcffe77 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Action: 'create', calling method: .version_select at 0x7f46989e5af0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1257169491", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAkEaQUsMKgIBW+CQUAOQ00tHdbeyGRLlGmKcJV0tWj3ryad6UR7BJ0TO7qx7V47sB6FWpZPXpbfPwlta1aJaiYY4A1G5A3n2K6jK8nm6Zu7uM2H8q3nmyOcdPzm1Lh5w=="}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:57:08.609639 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-7bfa6a05-30a9-42af-9edc-2193adcffe77 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Getting quotas for project 4b5a27c71cdb4556a4b3ac246a55d448. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:57:08.617756 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-7bfa6a05-30a9-42af-9edc-2193adcffe77 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Getting quotas for user da3b5892413b401e9c0c97f68e56195e and project 4b5a27c71cdb4556a4b3ac246a55d448. Resources: {'key_pairs'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:57:08.636998 n-d-846435-14 devstack@n-api.service[119303]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7bfa6a05-30a9-42af-9edc-2193adcffe77 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [2c2acd86-cda7-44eb-a5d9-ff251265bcd2] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 15:57:09.650563 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [None req-7bfa6a05-30a9-42af-9edc-2193adcffe77 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [2c2acd86-cda7-44eb-a5d9-ff251265bcd2] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 54572. Jul 25 15:57:09.676108 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-7bfa6a05-30a9-42af-9edc-2193adcffe77 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 1.341773 Jul 25 15:57:09.677230 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3815/7852] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Jul 25 15:57:08 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 15:57:11.015182 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:57:11.016103 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:57:11.020626 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-cfb5fa6d-22df-4787-b59a-3d368f2200b2 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1562883065", "imageRef": "a7b14aba-1848-4a00-a3e7-b66eb3e97925", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1257169491", "security_groups": [{"name": "tempest-secgroup-smoke-1997614357"}], "networks": [{"uuid": "079651ba-1617-4434-96ee-61d452f88e5e"}]}} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:57:11.159668 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.network.neutron [None req-cfb5fa6d-22df-4787-b59a-3d368f2200b2 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] validate_networks() for [('079651ba-1617-4434-96ee-61d452f88e5e', None, None, None, None, None)] {{(pid=119304) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 15:57:11.722407 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-cfb5fa6d-22df-4787-b59a-3d368f2200b2 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Flavor limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 15:57:11.723079 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-cfb5fa6d-22df-4787-b59a-3d368f2200b2 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Image limits 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 15:57:11.723848 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-cfb5fa6d-22df-4787-b59a-3d368f2200b2 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Flavor pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 15:57:11.724550 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-cfb5fa6d-22df-4787-b59a-3d368f2200b2 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Image pref 0:0:0 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 15:57:11.725206 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.virt.hardware [None req-cfb5fa6d-22df-4787-b59a-3d368f2200b2 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119304) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 15:57:11.740002 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cfb5fa6d-22df-4787-b59a-3d368f2200b2 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:57:11.740469 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cfb5fa6d-22df-4787-b59a-3d368f2200b2 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:57:11.741276 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cfb5fa6d-22df-4787-b59a-3d368f2200b2 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:57:11.741725 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-cfb5fa6d-22df-4787-b59a-3d368f2200b2 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:57:11.760339 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-cfb5fa6d-22df-4787-b59a-3d368f2200b2 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Getting quotas for project 4b5a27c71cdb4556a4b3ac246a55d448. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 15:57:11.766219 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.quota [None req-cfb5fa6d-22df-4787-b59a-3d368f2200b2 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Getting quotas for user da3b5892413b401e9c0c97f68e56195e and project 4b5a27c71cdb4556a4b3ac246a55d448. Resources: {'cores', 'instances', 'ram'} {{(pid=119304) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 15:57:11.782939 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cfb5fa6d-22df-4787-b59a-3d368f2200b2 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Going to run 1 instances... {{(pid=119304) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 15:57:11.786456 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-cfb5fa6d-22df-4787-b59a-3d368f2200b2 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: 43cd620c-c269-4535-a4fe-a7db2c99dbf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7b14aba-1848-4a00-a3e7-b66eb3e97925',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119304) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 15:57:11.847850 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-cfb5fa6d-22df-4787-b59a-3d368f2200b2 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.834495 Jul 25 15:57:11.849347 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4038/7853] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 15:57:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 15:57:11.861403 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-92de8914-eefe-447a-97ce-e092046f563b tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:57:11.862039 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-92de8914-eefe-447a-97ce-e092046f563b tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: 43cd620c-c269-4535-a4fe-a7db2c99dbf6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:57:11.935403 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-92de8914-eefe-447a-97ce-e092046f563b tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:57:11.946928 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-92de8914-eefe-447a-97ce-e092046f563b tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6" status: 200 len: 1249 microversion: 2.1 time: 0.090520 Jul 25 15:57:11.955658 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3816/7854] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:57:11 2022] GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6 => generated 1249 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:57:12.979361 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-bbecf864-e516-4483-9549-92abcc44b49f tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:57:12.980205 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-bbecf864-e516-4483-9549-92abcc44b49f tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: 43cd620c-c269-4535-a4fe-a7db2c99dbf6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:57:13.049736 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-bbecf864-e516-4483-9549-92abcc44b49f tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:57:13.057838 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-bbecf864-e516-4483-9549-92abcc44b49f tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6" status: 200 len: 1249 microversion: 2.1 time: 0.083586 Jul 25 15:57:13.058934 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4039/7855] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:57:12 2022] GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6 => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:57:14.084837 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-fbed3148-964f-40b4-9543-050b56e90bf6 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:57:14.086670 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-fbed3148-964f-40b4-9543-050b56e90bf6 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: 43cd620c-c269-4535-a4fe-a7db2c99dbf6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:57:14.150430 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-fbed3148-964f-40b4-9543-050b56e90bf6 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:57:14.160470 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-fbed3148-964f-40b4-9543-050b56e90bf6 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6" status: 200 len: 1249 microversion: 2.1 time: 0.081998 Jul 25 15:57:14.161321 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3817/7856] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:57:14 2022] GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6 => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:57:15.187674 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-5d5a85a4-2210-4fd6-815e-55f4cec51265 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:57:15.188785 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-5d5a85a4-2210-4fd6-815e-55f4cec51265 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: 43cd620c-c269-4535-a4fe-a7db2c99dbf6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:57:15.247399 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-5d5a85a4-2210-4fd6-815e-55f4cec51265 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:57:15.255266 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-5d5a85a4-2210-4fd6-815e-55f4cec51265 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6" status: 200 len: 1249 microversion: 2.1 time: 0.075701 Jul 25 15:57:15.256041 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4040/7857] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:57:15 2022] GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6 => generated 1249 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:57:16.277076 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-046e4086-67fa-43aa-9ec7-7b1581846df9 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:57:16.277647 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-046e4086-67fa-43aa-9ec7-7b1581846df9 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: 43cd620c-c269-4535-a4fe-a7db2c99dbf6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:57:16.286525 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-046e4086-67fa-43aa-9ec7-7b1581846df9 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:57:16.287215 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-046e4086-67fa-43aa-9ec7-7b1581846df9 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:57:16.288427 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-046e4086-67fa-43aa-9ec7-7b1581846df9 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:57:16.289169 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-046e4086-67fa-43aa-9ec7-7b1581846df9 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:57:16.358481 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-046e4086-67fa-43aa-9ec7-7b1581846df9 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:57:16.367354 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-046e4086-67fa-43aa-9ec7-7b1581846df9 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6" status: 200 len: 1253 microversion: 2.1 time: 0.094157 Jul 25 15:57:16.367947 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3818/7858] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:57:16 2022] GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6 => generated 1253 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:57:17.392200 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-0b021a38-a985-4ffd-a017-b6810f6d8af1 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:57:17.393003 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-0b021a38-a985-4ffd-a017-b6810f6d8af1 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: 43cd620c-c269-4535-a4fe-a7db2c99dbf6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:57:17.405194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b021a38-a985-4ffd-a017-b6810f6d8af1 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:57:17.405194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b021a38-a985-4ffd-a017-b6810f6d8af1 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:57:17.405194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b021a38-a985-4ffd-a017-b6810f6d8af1 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:57:17.405194 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-0b021a38-a985-4ffd-a017-b6810f6d8af1 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:57:17.505910 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-0b021a38-a985-4ffd-a017-b6810f6d8af1 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:57:17.520318 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-0b021a38-a985-4ffd-a017-b6810f6d8af1 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6" status: 200 len: 1307 microversion: 2.1 time: 0.134743 Jul 25 15:57:17.520941 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4041/7859] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:57:17 2022] GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6 => generated 1307 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:57:18.559704 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-437f5860-bea7-47e3-a013-9a348d86c41d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:57:18.560346 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-437f5860-bea7-47e3-a013-9a348d86c41d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: 43cd620c-c269-4535-a4fe-a7db2c99dbf6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:57:18.574304 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-437f5860-bea7-47e3-a013-9a348d86c41d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:57:18.575256 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-437f5860-bea7-47e3-a013-9a348d86c41d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:57:18.576571 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-437f5860-bea7-47e3-a013-9a348d86c41d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:57:18.577202 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-437f5860-bea7-47e3-a013-9a348d86c41d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:57:18.809445 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-f5eeb782-4a13-4ae6-9971-0e7cbdd095fd req-5748d60f-f8cc-4f4e-9c73-ae08df5ff6f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43cd620c-c269-4535-a4fe-a7db2c99dbf6", "tag": "36236c97-d3fe-45d3-906c-9e16c8a98f19"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:57:18.835804 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-f5eeb782-4a13-4ae6-9971-0e7cbdd095fd req-5748d60f-f8cc-4f4e-9c73-ae08df5ff6f0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:57:18.839786 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-f5eeb782-4a13-4ae6-9971-0e7cbdd095fd req-5748d60f-f8cc-4f4e-9c73-ae08df5ff6f0 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:57:18.856662 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-f5eeb782-4a13-4ae6-9971-0e7cbdd095fd req-5748d60f-f8cc-4f4e-9c73-ae08df5ff6f0 service nova] Creating event network-changed:36236c97-d3fe-45d3-906c-9e16c8a98f19 for instance 43cd620c-c269-4535-a4fe-a7db2c99dbf6 on n-h2-846435-14 Jul 25 15:57:18.856868 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-437f5860-bea7-47e3-a013-9a348d86c41d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:57:18.864270 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-f5eeb782-4a13-4ae6-9971-0e7cbdd095fd req-5748d60f-f8cc-4f4e-9c73-ae08df5ff6f0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061528 Jul 25 15:57:18.865943 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4042/7860] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:57:18.874807 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-437f5860-bea7-47e3-a013-9a348d86c41d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6" status: 200 len: 1375 microversion: 2.1 time: 0.319476 Jul 25 15:57:18.875419 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3819/7861] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:57:18 2022] GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6 => generated 1375 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:57:19.899414 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-a919fd23-9a45-4b36-a96f-2f37f311240a tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:57:19.900024 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-a919fd23-9a45-4b36-a96f-2f37f311240a tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: 43cd620c-c269-4535-a4fe-a7db2c99dbf6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:57:19.907095 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a919fd23-9a45-4b36-a96f-2f37f311240a tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:57:19.907532 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a919fd23-9a45-4b36-a96f-2f37f311240a tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:57:19.908485 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a919fd23-9a45-4b36-a96f-2f37f311240a tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:57:19.908936 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-a919fd23-9a45-4b36-a96f-2f37f311240a tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:57:20.051273 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-a919fd23-9a45-4b36-a96f-2f37f311240a tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:57:20.059658 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-a919fd23-9a45-4b36-a96f-2f37f311240a tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6" status: 200 len: 1375 microversion: 2.1 time: 0.166011 Jul 25 15:57:20.060308 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4043/7862] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:57:19 2022] GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6 => generated 1375 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:57:21.080975 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a4f7f1ad-ad1f-4b0d-8a40-4b4ab0ccdb49 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:57:21.081615 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a4f7f1ad-ad1f-4b0d-8a40-4b4ab0ccdb49 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: 43cd620c-c269-4535-a4fe-a7db2c99dbf6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:57:21.090099 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a4f7f1ad-ad1f-4b0d-8a40-4b4ab0ccdb49 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:57:21.090545 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a4f7f1ad-ad1f-4b0d-8a40-4b4ab0ccdb49 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:57:21.091328 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a4f7f1ad-ad1f-4b0d-8a40-4b4ab0ccdb49 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:57:21.091761 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a4f7f1ad-ad1f-4b0d-8a40-4b4ab0ccdb49 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:57:21.244807 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a4f7f1ad-ad1f-4b0d-8a40-4b4ab0ccdb49 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:57:21.255829 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a4f7f1ad-ad1f-4b0d-8a40-4b4ab0ccdb49 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6" status: 200 len: 1375 microversion: 2.1 time: 0.178811 Jul 25 15:57:21.256453 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3820/7863] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:57:21 2022] GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6 => generated 1375 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:57:22.277448 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-970830f2-641b-496c-85fd-9512d50ba49d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:57:22.278353 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-970830f2-641b-496c-85fd-9512d50ba49d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: 43cd620c-c269-4535-a4fe-a7db2c99dbf6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:57:22.281383 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:57:22.288149 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-970830f2-641b-496c-85fd-9512d50ba49d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:57:22.288629 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-970830f2-641b-496c-85fd-9512d50ba49d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:57:22.289402 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-970830f2-641b-496c-85fd-9512d50ba49d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:57:22.289841 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-970830f2-641b-496c-85fd-9512d50ba49d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:57:22.432113 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-970830f2-641b-496c-85fd-9512d50ba49d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:57:22.440597 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-970830f2-641b-496c-85fd-9512d50ba49d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6" status: 200 len: 1375 microversion: 2.1 time: 0.167550 Jul 25 15:57:22.441078 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4044/7864] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:57:22 2022] GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6 => generated 1375 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:57:23.467660 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-307afdfd-afb0-4add-bf7a-3123b2b9a799 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:57:23.468742 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-307afdfd-afb0-4add-bf7a-3123b2b9a799 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: 43cd620c-c269-4535-a4fe-a7db2c99dbf6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:57:23.476162 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-307afdfd-afb0-4add-bf7a-3123b2b9a799 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:57:23.476618 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-307afdfd-afb0-4add-bf7a-3123b2b9a799 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:57:23.477423 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-307afdfd-afb0-4add-bf7a-3123b2b9a799 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:57:23.477873 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-307afdfd-afb0-4add-bf7a-3123b2b9a799 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:57:23.624126 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-307afdfd-afb0-4add-bf7a-3123b2b9a799 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:57:23.632356 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-307afdfd-afb0-4add-bf7a-3123b2b9a799 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6" status: 200 len: 1375 microversion: 2.1 time: 0.170471 Jul 25 15:57:23.632950 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3821/7865] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:57:23 2022] GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6 => generated 1375 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:57:24.653932 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-33fd1d8b-7d3c-4bc1-9161-8d78b9df8720 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:57:24.654556 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-33fd1d8b-7d3c-4bc1-9161-8d78b9df8720 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: 43cd620c-c269-4535-a4fe-a7db2c99dbf6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:57:24.662372 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-33fd1d8b-7d3c-4bc1-9161-8d78b9df8720 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:57:24.662839 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-33fd1d8b-7d3c-4bc1-9161-8d78b9df8720 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:57:24.663638 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-33fd1d8b-7d3c-4bc1-9161-8d78b9df8720 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:57:24.664110 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-33fd1d8b-7d3c-4bc1-9161-8d78b9df8720 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:57:24.803732 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-33fd1d8b-7d3c-4bc1-9161-8d78b9df8720 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:57:24.811673 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-33fd1d8b-7d3c-4bc1-9161-8d78b9df8720 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6" status: 200 len: 1375 microversion: 2.1 time: 0.161772 Jul 25 15:57:24.815256 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4045/7866] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:57:24 2022] GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6 => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:57:25.464538 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=8 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:57:25.470385 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-f79367e8-fce2-462c-9d55-2484fa3c181d req-0e63f2a1-754c-4570-a850-ee2128b9c618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43cd620c-c269-4535-a4fe-a7db2c99dbf6", "name": "network-vif-plugged", "status": "completed", "tag": "36236c97-d3fe-45d3-906c-9e16c8a98f19"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:57:25.481283 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f79367e8-fce2-462c-9d55-2484fa3c181d req-0e63f2a1-754c-4570-a850-ee2128b9c618 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:57:25.481728 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-f79367e8-fce2-462c-9d55-2484fa3c181d req-0e63f2a1-754c-4570-a850-ee2128b9c618 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:57:25.500569 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-f79367e8-fce2-462c-9d55-2484fa3c181d req-0e63f2a1-754c-4570-a850-ee2128b9c618 service nova] Creating event network-vif-plugged:36236c97-d3fe-45d3-906c-9e16c8a98f19 for instance 43cd620c-c269-4535-a4fe-a7db2c99dbf6 on n-h2-846435-14 Jul 25 15:57:25.507014 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-f79367e8-fce2-462c-9d55-2484fa3c181d req-0e63f2a1-754c-4570-a850-ee2128b9c618 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042963 Jul 25 15:57:25.508617 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3822/7867] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 15:57:25.835387 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-990320f9-35a6-4e19-bb67-aeae06564ae0 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:57:25.836038 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-990320f9-35a6-4e19-bb67-aeae06564ae0 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: 43cd620c-c269-4535-a4fe-a7db2c99dbf6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:57:25.838051 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=10 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 15:57:25.844459 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-990320f9-35a6-4e19-bb67-aeae06564ae0 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:57:25.844918 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-990320f9-35a6-4e19-bb67-aeae06564ae0 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:57:25.845708 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-990320f9-35a6-4e19-bb67-aeae06564ae0 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:57:25.846155 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-990320f9-35a6-4e19-bb67-aeae06564ae0 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:57:25.998786 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-990320f9-35a6-4e19-bb67-aeae06564ae0 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:57:26.006919 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-990320f9-35a6-4e19-bb67-aeae06564ae0 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6" status: 200 len: 1375 microversion: 2.1 time: 0.175863 Jul 25 15:57:26.007521 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4046/7868] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:57:25 2022] GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6 => generated 1375 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:57:27.029911 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-334bfb25-cec6-4c38-b1e8-4778591f2922 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:57:27.030612 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-334bfb25-cec6-4c38-b1e8-4778591f2922 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: 43cd620c-c269-4535-a4fe-a7db2c99dbf6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:57:27.037767 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-334bfb25-cec6-4c38-b1e8-4778591f2922 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:57:27.038225 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-334bfb25-cec6-4c38-b1e8-4778591f2922 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:57:27.039011 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-334bfb25-cec6-4c38-b1e8-4778591f2922 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:57:27.039453 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-334bfb25-cec6-4c38-b1e8-4778591f2922 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:57:27.184932 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-334bfb25-cec6-4c38-b1e8-4778591f2922 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:57:27.197487 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-334bfb25-cec6-4c38-b1e8-4778591f2922 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6" status: 200 len: 1375 microversion: 2.1 time: 0.172763 Jul 25 15:57:27.198383 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3823/7869] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:57:27 2022] GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6 => generated 1375 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:57:28.220444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ad326b35-3cc0-4ff5-9aaf-d066b199291d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:57:28.221056 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ad326b35-3cc0-4ff5-9aaf-d066b199291d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: 43cd620c-c269-4535-a4fe-a7db2c99dbf6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:57:28.228818 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad326b35-3cc0-4ff5-9aaf-d066b199291d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:57:28.229274 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad326b35-3cc0-4ff5-9aaf-d066b199291d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:57:28.230104 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad326b35-3cc0-4ff5-9aaf-d066b199291d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:57:28.230555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ad326b35-3cc0-4ff5-9aaf-d066b199291d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:57:28.386900 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ad326b35-3cc0-4ff5-9aaf-d066b199291d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:57:28.395244 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ad326b35-3cc0-4ff5-9aaf-d066b199291d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6" status: 200 len: 1559 microversion: 2.1 time: 0.179118 Jul 25 15:57:28.395848 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4047/7870] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:57:28 2022] GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:57:28.415615 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-8b226191-008d-4ab6-ba05-be30565172dc tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 15:57:28.416262 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-8b226191-008d-4ab6-ba05-be30565172dc tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: 43cd620c-c269-4535-a4fe-a7db2c99dbf6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 15:57:28.423661 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b226191-008d-4ab6-ba05-be30565172dc tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:57:28.424543 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b226191-008d-4ab6-ba05-be30565172dc tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:57:28.425433 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b226191-008d-4ab6-ba05-be30565172dc tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:57:28.426042 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-8b226191-008d-4ab6-ba05-be30565172dc tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:57:28.587081 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-8b226191-008d-4ab6-ba05-be30565172dc tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 15:57:28.597831 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-8b226191-008d-4ab6-ba05-be30565172dc tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6" status: 200 len: 1559 microversion: 2.1 time: 0.186055 Jul 25 15:57:28.598463 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3824/7871] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 15:57:28 2022] GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6 => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 15:57:30.545197 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-b8afbcad-960b-4b1f-80a3-72de53041ab0 req-ed1b416a-080e-489b-b297-6605ed9f1ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43cd620c-c269-4535-a4fe-a7db2c99dbf6", "tag": "36236c97-d3fe-45d3-906c-9e16c8a98f19"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 15:57:30.558171 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-b8afbcad-960b-4b1f-80a3-72de53041ab0 req-ed1b416a-080e-489b-b297-6605ed9f1ea6 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 15:57:30.558633 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-b8afbcad-960b-4b1f-80a3-72de53041ab0 req-ed1b416a-080e-489b-b297-6605ed9f1ea6 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 15:57:30.577742 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-b8afbcad-960b-4b1f-80a3-72de53041ab0 req-ed1b416a-080e-489b-b297-6605ed9f1ea6 service nova] Creating event network-changed:36236c97-d3fe-45d3-906c-9e16c8a98f19 for instance 43cd620c-c269-4535-a4fe-a7db2c99dbf6 on n-h2-846435-14 Jul 25 15:57:30.586645 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-b8afbcad-960b-4b1f-80a3-72de53041ab0 req-ed1b416a-080e-489b-b297-6605ed9f1ea6 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045174 Jul 25 15:57:30.587686 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4048/7872] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 15:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:00:06.774534 n-d-846435-14 devstack@n-api.service[119303]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b24320cd-02fe-4cda-9e22-8ff297cb0d9a] AMQP server on 10.222.0.88:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 16:00:06.775314 n-d-846435-14 devstack@n-api.service[119303]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c17eba8c-cddd-4f98-b66f-c71ea3b6f89c] AMQP server on 10.222.0.88:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 16:00:06.775902 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:00:06.776824 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=38 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:00:06.781039 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-2de0e1db-cb41-4047-92b6-58ae5a3d0e28 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1383209468"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:00:06.783374 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-2de0e1db-cb41-4047-92b6-58ae5a3d0e28 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: 43cd620c-c269-4535-a4fe-a7db2c99dbf6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:00:06.791856 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2de0e1db-cb41-4047-92b6-58ae5a3d0e28 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:06.792656 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2de0e1db-cb41-4047-92b6-58ae5a3d0e28 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:06.793317 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2de0e1db-cb41-4047-92b6-58ae5a3d0e28 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:06.793552 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-2de0e1db-cb41-4047-92b6-58ae5a3d0e28 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:07.171239 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-2de0e1db-cb41-4047-92b6-58ae5a3d0e28 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "POST /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6/action" status: 202 len: 0 microversion: 2.1 time: 0.398731 Jul 25 16:00:07.171953 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3825/7873] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 16:00:06 2022] POST /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6/action => generated 0 bytes in 400 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 16:00:14.253930 n-d-846435-14 devstack@n-api.service[119304]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2677c88d-98e4-43fd-a6d8-07da2f5a5121] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 16:00:14.255151 n-d-846435-14 devstack@n-api.service[119304]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5a3fcd17-2893-497d-b07f-ee8fd2346add] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 16:00:14.255967 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:00:14.257362 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=42 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:00:14.263698 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-9b527e45-760f-4fa7-815f-a395f852ac0c req-4ec82423-c7e7-4672-90aa-440d7af51121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43cd620c-c269-4535-a4fe-a7db2c99dbf6", "name": "network-vif-plugged", "status": "completed", "tag": "36236c97-d3fe-45d3-906c-9e16c8a98f19"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:00:14.284652 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-9b527e45-760f-4fa7-815f-a395f852ac0c req-4ec82423-c7e7-4672-90aa-440d7af51121 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:14.285274 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-9b527e45-760f-4fa7-815f-a395f852ac0c req-4ec82423-c7e7-4672-90aa-440d7af51121 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:14.298756 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-9b527e45-760f-4fa7-815f-a395f852ac0c req-4ec82423-c7e7-4672-90aa-440d7af51121 service nova] Creating event network-vif-plugged:36236c97-d3fe-45d3-906c-9e16c8a98f19 for instance 43cd620c-c269-4535-a4fe-a7db2c99dbf6 on n-h2-846435-14 Jul 25 16:00:14.302583 n-d-846435-14 devstack@n-api.service[119304]: ERROR oslo.messaging._drivers.impl_rabbit [req-9b527e45-760f-4fa7-815f-a395f852ac0c req-4ec82423-c7e7-4672-90aa-440d7af51121 service nova] [e15a3c26-4f9c-4eb3-b456-6157da08d36e] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 16:00:15.265904 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [-] [5a3fcd17-2893-497d-b07f-ee8fd2346add] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 54774. Jul 25 16:00:15.267884 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [-] [2677c88d-98e4-43fd-a6d8-07da2f5a5121] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 54772. Jul 25 16:00:15.310946 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [req-9b527e45-760f-4fa7-815f-a395f852ac0c req-4ec82423-c7e7-4672-90aa-440d7af51121 service nova] [e15a3c26-4f9c-4eb3-b456-6157da08d36e] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 54776. Jul 25 16:00:15.315097 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-9b527e45-760f-4fa7-815f-a395f852ac0c req-4ec82423-c7e7-4672-90aa-440d7af51121 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.064435 Jul 25 16:00:15.315796 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4049/7874] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 16:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:00:31.075608 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-889d64c6-ae5f-47d7-b46a-02f7ddb5f271 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-2015465735", "imageRef": "903196e3-f6e1-446e-b9b5-74cbbeb15e9d", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1257169491", "security_groups": [{"name": "tempest-secgroup-smoke-1997614357"}], "networks": [{"uuid": "079651ba-1617-4434-96ee-61d452f88e5e"}]}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:00:31.087709 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:00:31.088468 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:00:31.111698 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [-] [b24320cd-02fe-4cda-9e22-8ff297cb0d9a] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 54904. Jul 25 16:00:31.114801 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [-] [c17eba8c-cddd-4f98-b66f-c71ea3b6f89c] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 54906. Jul 25 16:00:31.203693 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.network.neutron [None req-889d64c6-ae5f-47d7-b46a-02f7ddb5f271 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] validate_networks() for [('079651ba-1617-4434-96ee-61d452f88e5e', None, None, None, None, None)] {{(pid=119303) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:00:31.338073 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:00:31.338286 n-d-846435-14 devstack@n-api.service[119303]: Mon Jul 25 16:00:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.88) !!! Jul 25 16:00:31.687963 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-889d64c6-ae5f-47d7-b46a-02f7ddb5f271 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Flavor limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:00:31.688574 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-889d64c6-ae5f-47d7-b46a-02f7ddb5f271 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Image limits 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:00:31.689544 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-889d64c6-ae5f-47d7-b46a-02f7ddb5f271 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Flavor pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:00:31.690116 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-889d64c6-ae5f-47d7-b46a-02f7ddb5f271 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Image pref 0:0:0 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:00:31.690702 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.virt.hardware [None req-889d64c6-ae5f-47d7-b46a-02f7ddb5f271 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:00:31.702574 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-889d64c6-ae5f-47d7-b46a-02f7ddb5f271 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:31.703033 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-889d64c6-ae5f-47d7-b46a-02f7ddb5f271 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:31.703839 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-889d64c6-ae5f-47d7-b46a-02f7ddb5f271 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:31.704312 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-889d64c6-ae5f-47d7-b46a-02f7ddb5f271 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:31.723355 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-889d64c6-ae5f-47d7-b46a-02f7ddb5f271 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Getting quotas for project 4b5a27c71cdb4556a4b3ac246a55d448. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:00:31.728929 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.quota [None req-889d64c6-ae5f-47d7-b46a-02f7ddb5f271 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Getting quotas for user da3b5892413b401e9c0c97f68e56195e and project 4b5a27c71cdb4556a4b3ac246a55d448. Resources: {'cores', 'instances', 'ram'} {{(pid=119303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:00:31.742898 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-889d64c6-ae5f-47d7-b46a-02f7ddb5f271 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Going to run 1 instances... {{(pid=119303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:00:31.745622 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-889d64c6-ae5f-47d7-b46a-02f7ddb5f271 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: a7d0a9b1-0715-429b-9105-497a544fae53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='903196e3-f6e1-446e-b9b5-74cbbeb15e9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:00:31.795686 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-889d64c6-ae5f-47d7-b46a-02f7ddb5f271 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.724412 Jul 25 16:00:31.796714 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3826/7875] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Jul 25 16:00:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 16:00:31.805987 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:00:31.806883 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:00:31.811181 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-fd29e6de-2626-4d49-90cf-38612fdc95f8 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:00:31.811895 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-fd29e6de-2626-4d49-90cf-38612fdc95f8 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: a7d0a9b1-0715-429b-9105-497a544fae53] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:00:31.931618 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-fd29e6de-2626-4d49-90cf-38612fdc95f8 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:00:31.944292 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-fd29e6de-2626-4d49-90cf-38612fdc95f8 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53" status: 200 len: 1249 microversion: 2.1 time: 0.139209 Jul 25 16:00:31.944928 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4050/7876] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 16:00:31 2022] GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53 => generated 1249 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:00:32.978477 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-91ab3846-a4ff-4609-bcd7-35324f0f6e15 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:00:32.979103 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-91ab3846-a4ff-4609-bcd7-35324f0f6e15 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: a7d0a9b1-0715-429b-9105-497a544fae53] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:00:33.045486 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-91ab3846-a4ff-4609-bcd7-35324f0f6e15 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:00:33.053244 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-91ab3846-a4ff-4609-bcd7-35324f0f6e15 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53" status: 200 len: 1249 microversion: 2.1 time: 0.080062 Jul 25 16:00:33.053808 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3827/7877] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 16:00:32 2022] GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53 => generated 1249 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:00:34.077693 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-87a7b7e2-ba19-460d-97fb-f3dbadad4877 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:00:34.078907 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-87a7b7e2-ba19-460d-97fb-f3dbadad4877 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: a7d0a9b1-0715-429b-9105-497a544fae53] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:00:34.158825 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-87a7b7e2-ba19-460d-97fb-f3dbadad4877 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:00:34.168309 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-87a7b7e2-ba19-460d-97fb-f3dbadad4877 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53" status: 200 len: 1249 microversion: 2.1 time: 0.096284 Jul 25 16:00:34.168829 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4051/7878] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 16:00:34 2022] GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53 => generated 1249 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:00:34.386054 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-4a6cf4db-23dc-43d5-a6c3-9328002ac4a2 req-0579b063-a899-4a06-9c3c-3487978bc4f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43cd620c-c269-4535-a4fe-a7db2c99dbf6", "name": "network-vif-unplugged", "status": "completed", "tag": "36236c97-d3fe-45d3-906c-9e16c8a98f19"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:00:34.402070 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-4a6cf4db-23dc-43d5-a6c3-9328002ac4a2 req-0579b063-a899-4a06-9c3c-3487978bc4f9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:34.402624 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-4a6cf4db-23dc-43d5-a6c3-9328002ac4a2 req-0579b063-a899-4a06-9c3c-3487978bc4f9 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:34.415460 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-4a6cf4db-23dc-43d5-a6c3-9328002ac4a2 req-0579b063-a899-4a06-9c3c-3487978bc4f9 service nova] Creating event network-vif-unplugged:36236c97-d3fe-45d3-906c-9e16c8a98f19 for instance 43cd620c-c269-4535-a4fe-a7db2c99dbf6 on n-h2-846435-14 Jul 25 16:00:34.421353 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-4a6cf4db-23dc-43d5-a6c3-9328002ac4a2 req-0579b063-a899-4a06-9c3c-3487978bc4f9 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100414 Jul 25 16:00:34.422732 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3828/7879] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 16:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:00:35.190787 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-57f84717-49f3-445e-9659-2f7211a4c1ca tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:00:35.191655 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-57f84717-49f3-445e-9659-2f7211a4c1ca tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: a7d0a9b1-0715-429b-9105-497a544fae53] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:00:35.258622 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-57f84717-49f3-445e-9659-2f7211a4c1ca tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:00:35.267191 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-57f84717-49f3-445e-9659-2f7211a4c1ca tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53" status: 200 len: 1249 microversion: 2.1 time: 0.081368 Jul 25 16:00:35.267940 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4052/7880] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 16:00:35 2022] GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53 => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:00:36.300338 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9294cf9c-93cc-4a08-af8a-cba5918d0f20 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:00:36.301041 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9294cf9c-93cc-4a08-af8a-cba5918d0f20 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: a7d0a9b1-0715-429b-9105-497a544fae53] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:00:36.309134 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9294cf9c-93cc-4a08-af8a-cba5918d0f20 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:36.309588 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9294cf9c-93cc-4a08-af8a-cba5918d0f20 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:36.310381 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9294cf9c-93cc-4a08-af8a-cba5918d0f20 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:36.310820 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9294cf9c-93cc-4a08-af8a-cba5918d0f20 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:36.389041 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9294cf9c-93cc-4a08-af8a-cba5918d0f20 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:00:36.406769 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9294cf9c-93cc-4a08-af8a-cba5918d0f20 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53" status: 200 len: 1253 microversion: 2.1 time: 0.112582 Jul 25 16:00:36.407477 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3829/7881] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 16:00:36 2022] GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53 => generated 1253 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:00:37.447757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c910e6da-4f83-4d33-80be-7dc23eacf25f tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:00:37.450536 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-c910e6da-4f83-4d33-80be-7dc23eacf25f tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: a7d0a9b1-0715-429b-9105-497a544fae53] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:00:37.468333 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c910e6da-4f83-4d33-80be-7dc23eacf25f tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:37.469845 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c910e6da-4f83-4d33-80be-7dc23eacf25f tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:37.471845 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c910e6da-4f83-4d33-80be-7dc23eacf25f tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:37.473202 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-c910e6da-4f83-4d33-80be-7dc23eacf25f tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:37.632347 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-c910e6da-4f83-4d33-80be-7dc23eacf25f tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:00:37.649534 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c910e6da-4f83-4d33-80be-7dc23eacf25f tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53" status: 200 len: 1307 microversion: 2.1 time: 0.222881 Jul 25 16:00:37.652937 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4053/7882] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 16:00:37 2022] GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53 => generated 1307 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:00:38.696863 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-feb4f3aa-d08a-4c66-ba6a-648e99cab6af tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:00:38.697444 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-feb4f3aa-d08a-4c66-ba6a-648e99cab6af tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: a7d0a9b1-0715-429b-9105-497a544fae53] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:00:38.705251 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-feb4f3aa-d08a-4c66-ba6a-648e99cab6af tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:38.706075 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-feb4f3aa-d08a-4c66-ba6a-648e99cab6af tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:38.706873 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-feb4f3aa-d08a-4c66-ba6a-648e99cab6af tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:38.707308 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-feb4f3aa-d08a-4c66-ba6a-648e99cab6af tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:38.867492 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-feb4f3aa-d08a-4c66-ba6a-648e99cab6af tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:00:38.877121 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-feb4f3aa-d08a-4c66-ba6a-648e99cab6af tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53" status: 200 len: 1375 microversion: 2.1 time: 0.184120 Jul 25 16:00:38.878315 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3830/7883] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 16:00:38 2022] GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53 => generated 1375 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:00:39.903225 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-b384d87c-5878-49b2-a97f-1adbb91618ec tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:00:39.905247 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-b384d87c-5878-49b2-a97f-1adbb91618ec tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: a7d0a9b1-0715-429b-9105-497a544fae53] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:00:39.916885 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b384d87c-5878-49b2-a97f-1adbb91618ec tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:39.917736 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b384d87c-5878-49b2-a97f-1adbb91618ec tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:39.928595 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b384d87c-5878-49b2-a97f-1adbb91618ec tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:39.929782 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-b384d87c-5878-49b2-a97f-1adbb91618ec tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:40.521202 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-b384d87c-5878-49b2-a97f-1adbb91618ec tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:00:40.537233 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-b384d87c-5878-49b2-a97f-1adbb91618ec tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53" status: 200 len: 1375 microversion: 2.1 time: 0.641035 Jul 25 16:00:40.538349 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4054/7884] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 16:00:39 2022] GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53 => generated 1375 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:00:41.563667 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-47a8253b-9a43-4e12-acdb-d8071b57fa6d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:00:41.565573 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-47a8253b-9a43-4e12-acdb-d8071b57fa6d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: a7d0a9b1-0715-429b-9105-497a544fae53] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:00:41.581829 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-47a8253b-9a43-4e12-acdb-d8071b57fa6d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:41.582575 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-47a8253b-9a43-4e12-acdb-d8071b57fa6d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:41.584045 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-47a8253b-9a43-4e12-acdb-d8071b57fa6d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:41.584948 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-47a8253b-9a43-4e12-acdb-d8071b57fa6d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:41.713937 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:00:41.783109 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-47a8253b-9a43-4e12-acdb-d8071b57fa6d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:00:41.797571 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-47a8253b-9a43-4e12-acdb-d8071b57fa6d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53" status: 200 len: 1375 microversion: 2.1 time: 0.237794 Jul 25 16:00:41.802575 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3831/7885] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 16:00:41 2022] GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53 => generated 1375 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:00:42.828409 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ce2adf60-534b-481a-af76-5da27ea8ac40 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:00:42.829240 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ce2adf60-534b-481a-af76-5da27ea8ac40 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: a7d0a9b1-0715-429b-9105-497a544fae53] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:00:42.850992 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce2adf60-534b-481a-af76-5da27ea8ac40 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:42.851846 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce2adf60-534b-481a-af76-5da27ea8ac40 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:42.853351 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce2adf60-534b-481a-af76-5da27ea8ac40 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:42.854179 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ce2adf60-534b-481a-af76-5da27ea8ac40 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:43.018207 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-ce2adf60-534b-481a-af76-5da27ea8ac40 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:00:43.026501 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ce2adf60-534b-481a-af76-5da27ea8ac40 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53" status: 200 len: 1375 microversion: 2.1 time: 0.203075 Jul 25 16:00:43.027391 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4055/7886] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 16:00:42 2022] GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53 => generated 1375 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:00:44.050598 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-81a5d4ed-c800-4a34-9235-855f8c914597 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:00:44.051249 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-81a5d4ed-c800-4a34-9235-855f8c914597 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: a7d0a9b1-0715-429b-9105-497a544fae53] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:00:44.054255 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell0:SELECT=8 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:00:44.060451 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-81a5d4ed-c800-4a34-9235-855f8c914597 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:44.060976 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-81a5d4ed-c800-4a34-9235-855f8c914597 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:44.061769 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-81a5d4ed-c800-4a34-9235-855f8c914597 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:44.062226 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-81a5d4ed-c800-4a34-9235-855f8c914597 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:44.271307 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-81a5d4ed-c800-4a34-9235-855f8c914597 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:00:44.283621 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-81a5d4ed-c800-4a34-9235-855f8c914597 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53" status: 200 len: 1375 microversion: 2.1 time: 0.237410 Jul 25 16:00:44.287418 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3832/7887] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 16:00:44 2022] GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53 => generated 1375 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:00:45.303564 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-104d85a4-e44b-4a51-ac35-2adb08067ec0 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:00:45.304435 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-104d85a4-e44b-4a51-ac35-2adb08067ec0 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: a7d0a9b1-0715-429b-9105-497a544fae53] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:00:45.306754 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell0:SELECT=6 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:00:45.313502 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-104d85a4-e44b-4a51-ac35-2adb08067ec0 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:45.313955 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-104d85a4-e44b-4a51-ac35-2adb08067ec0 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:45.314771 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-104d85a4-e44b-4a51-ac35-2adb08067ec0 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:45.315418 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-104d85a4-e44b-4a51-ac35-2adb08067ec0 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:45.502305 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-104d85a4-e44b-4a51-ac35-2adb08067ec0 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:00:45.513534 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-104d85a4-e44b-4a51-ac35-2adb08067ec0 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53" status: 200 len: 1375 microversion: 2.1 time: 0.213933 Jul 25 16:00:45.514112 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4056/7888] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 16:00:45 2022] GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53 => generated 1375 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:00:46.538181 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-f082d98f-902a-423f-953e-368aed9c4872 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:00:46.540404 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-f082d98f-902a-423f-953e-368aed9c4872 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: a7d0a9b1-0715-429b-9105-497a544fae53] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:00:46.551368 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f082d98f-902a-423f-953e-368aed9c4872 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:46.552011 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f082d98f-902a-423f-953e-368aed9c4872 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:46.553120 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f082d98f-902a-423f-953e-368aed9c4872 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:46.553797 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-f082d98f-902a-423f-953e-368aed9c4872 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:46.743220 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-f082d98f-902a-423f-953e-368aed9c4872 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:00:46.751451 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-f082d98f-902a-423f-953e-368aed9c4872 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53" status: 200 len: 1375 microversion: 2.1 time: 0.218788 Jul 25 16:00:46.752418 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3833/7889] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 16:00:46 2022] GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53 => generated 1375 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:00:46.950112 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-3e4da7a5-fffd-4a8e-a24a-1bdeece0abe6 req-201494b4-881c-407a-bc1e-0381f11e04d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7d0a9b1-0715-429b-9105-497a544fae53", "tag": "76ba2941-9a5d-46b0-b7b5-5193e10136e2"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:00:46.961972 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-3e4da7a5-fffd-4a8e-a24a-1bdeece0abe6 req-201494b4-881c-407a-bc1e-0381f11e04d3 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:46.962818 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-3e4da7a5-fffd-4a8e-a24a-1bdeece0abe6 req-201494b4-881c-407a-bc1e-0381f11e04d3 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:46.977723 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-3e4da7a5-fffd-4a8e-a24a-1bdeece0abe6 req-201494b4-881c-407a-bc1e-0381f11e04d3 service nova] Creating event network-changed:76ba2941-9a5d-46b0-b7b5-5193e10136e2 for instance a7d0a9b1-0715-429b-9105-497a544fae53 on n-h1-846435-14 Jul 25 16:00:46.984338 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-3e4da7a5-fffd-4a8e-a24a-1bdeece0abe6 req-201494b4-881c-407a-bc1e-0381f11e04d3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123719 Jul 25 16:00:46.985261 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4057/7890] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 16:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:00:47.774953 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-56751503-97bb-4964-8773-c785b63754b2 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:00:47.775683 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-56751503-97bb-4964-8773-c785b63754b2 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: a7d0a9b1-0715-429b-9105-497a544fae53] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:00:47.785258 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56751503-97bb-4964-8773-c785b63754b2 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:47.785604 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56751503-97bb-4964-8773-c785b63754b2 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:47.786407 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56751503-97bb-4964-8773-c785b63754b2 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:47.786873 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56751503-97bb-4964-8773-c785b63754b2 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:47.949354 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-56751503-97bb-4964-8773-c785b63754b2 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:00:47.957911 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-56751503-97bb-4964-8773-c785b63754b2 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53" status: 200 len: 1375 microversion: 2.1 time: 0.188393 Jul 25 16:00:47.958497 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3834/7891] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 16:00:47 2022] GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53 => generated 1375 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:00:48.980319 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-004cd4d7-1bca-4b7d-a9ee-1f8b0fcdf8b2 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:00:48.981277 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-004cd4d7-1bca-4b7d-a9ee-1f8b0fcdf8b2 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: a7d0a9b1-0715-429b-9105-497a544fae53] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:00:48.990181 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-004cd4d7-1bca-4b7d-a9ee-1f8b0fcdf8b2 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:48.990679 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-004cd4d7-1bca-4b7d-a9ee-1f8b0fcdf8b2 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:48.991502 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-004cd4d7-1bca-4b7d-a9ee-1f8b0fcdf8b2 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:48.991951 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-004cd4d7-1bca-4b7d-a9ee-1f8b0fcdf8b2 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:49.156993 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-004cd4d7-1bca-4b7d-a9ee-1f8b0fcdf8b2 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:00:49.165898 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-004cd4d7-1bca-4b7d-a9ee-1f8b0fcdf8b2 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53" status: 200 len: 1375 microversion: 2.1 time: 0.190041 Jul 25 16:00:49.180038 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4058/7892] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 16:00:48 2022] GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53 => generated 1375 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:00:50.188807 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-9d918cbc-b2f5-4748-b16b-15a789d218d1 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:00:50.189460 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-9d918cbc-b2f5-4748-b16b-15a789d218d1 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: a7d0a9b1-0715-429b-9105-497a544fae53] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:00:50.196923 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d918cbc-b2f5-4748-b16b-15a789d218d1 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:50.197405 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d918cbc-b2f5-4748-b16b-15a789d218d1 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:50.198193 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d918cbc-b2f5-4748-b16b-15a789d218d1 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:50.198631 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-9d918cbc-b2f5-4748-b16b-15a789d218d1 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:50.347479 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-9d918cbc-b2f5-4748-b16b-15a789d218d1 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:00:50.356441 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-9d918cbc-b2f5-4748-b16b-15a789d218d1 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53" status: 200 len: 1375 microversion: 2.1 time: 0.171316 Jul 25 16:00:50.356899 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3835/7893] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 16:00:50 2022] GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53 => generated 1375 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:00:50.797549 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-3411bea0-74e3-407c-9b21-916a1b79cf86 req-125ff880-0fc0-4de6-9e69-ed9d20079723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7d0a9b1-0715-429b-9105-497a544fae53", "name": "network-vif-plugged", "status": "completed", "tag": "76ba2941-9a5d-46b0-b7b5-5193e10136e2"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:00:50.808702 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-3411bea0-74e3-407c-9b21-916a1b79cf86 req-125ff880-0fc0-4de6-9e69-ed9d20079723 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:50.808940 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-3411bea0-74e3-407c-9b21-916a1b79cf86 req-125ff880-0fc0-4de6-9e69-ed9d20079723 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:50.822169 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-3411bea0-74e3-407c-9b21-916a1b79cf86 req-125ff880-0fc0-4de6-9e69-ed9d20079723 service nova] Creating event network-vif-plugged:76ba2941-9a5d-46b0-b7b5-5193e10136e2 for instance a7d0a9b1-0715-429b-9105-497a544fae53 on n-h1-846435-14 Jul 25 16:00:50.827771 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-3411bea0-74e3-407c-9b21-916a1b79cf86 req-125ff880-0fc0-4de6-9e69-ed9d20079723 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036174 Jul 25 16:00:50.828814 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4059/7894] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 16:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:00:51.380268 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-0b04a068-d0ba-4ed2-b108-c994e14ff1c0 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:00:51.380910 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-0b04a068-d0ba-4ed2-b108-c994e14ff1c0 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: a7d0a9b1-0715-429b-9105-497a544fae53] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:00:51.389240 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b04a068-d0ba-4ed2-b108-c994e14ff1c0 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:51.389681 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b04a068-d0ba-4ed2-b108-c994e14ff1c0 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:51.390477 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b04a068-d0ba-4ed2-b108-c994e14ff1c0 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:51.390929 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-0b04a068-d0ba-4ed2-b108-c994e14ff1c0 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:51.531607 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-0b04a068-d0ba-4ed2-b108-c994e14ff1c0 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:00:51.541987 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-0b04a068-d0ba-4ed2-b108-c994e14ff1c0 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53" status: 200 len: 1375 microversion: 2.1 time: 0.167022 Jul 25 16:00:51.542583 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3836/7895] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 16:00:51 2022] GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53 => generated 1375 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:00:52.564653 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-f92c643e-1f38-46bf-820e-0631c471f0a4 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:00:52.565321 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-f92c643e-1f38-46bf-820e-0631c471f0a4 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: a7d0a9b1-0715-429b-9105-497a544fae53] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:00:52.572369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f92c643e-1f38-46bf-820e-0631c471f0a4 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:52.572832 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f92c643e-1f38-46bf-820e-0631c471f0a4 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:52.573611 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f92c643e-1f38-46bf-820e-0631c471f0a4 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:52.574056 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-f92c643e-1f38-46bf-820e-0631c471f0a4 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:52.731327 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-f92c643e-1f38-46bf-820e-0631c471f0a4 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:00:52.741064 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-f92c643e-1f38-46bf-820e-0631c471f0a4 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53" status: 200 len: 1560 microversion: 2.1 time: 0.181569 Jul 25 16:00:52.741631 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4060/7896] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 16:00:52 2022] GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53 => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:00:52.763690 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-a9a6609b-156e-456a-97a8-b9b2caff5449 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:00:52.764689 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-a9a6609b-156e-456a-97a8-b9b2caff5449 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: a7d0a9b1-0715-429b-9105-497a544fae53] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:00:52.774544 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a9a6609b-156e-456a-97a8-b9b2caff5449 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:52.775000 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a9a6609b-156e-456a-97a8-b9b2caff5449 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:52.775793 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a9a6609b-156e-456a-97a8-b9b2caff5449 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:52.776271 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-a9a6609b-156e-456a-97a8-b9b2caff5449 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:52.930364 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-a9a6609b-156e-456a-97a8-b9b2caff5449 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:00:52.939187 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-a9a6609b-156e-456a-97a8-b9b2caff5449 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53" status: 200 len: 1560 microversion: 2.1 time: 0.181204 Jul 25 16:00:52.939907 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3837/7897] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 16:00:52 2022] GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53 => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:00:55.372744 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-a67b3234-4a0e-4ca3-8b30-a59c54872765 req-a9821960-a58c-428b-a08e-a8500356e686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7d0a9b1-0715-429b-9105-497a544fae53", "tag": "76ba2941-9a5d-46b0-b7b5-5193e10136e2"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:00:55.382986 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a67b3234-4a0e-4ca3-8b30-a59c54872765 req-a9821960-a58c-428b-a08e-a8500356e686 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:00:55.383474 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a67b3234-4a0e-4ca3-8b30-a59c54872765 req-a9821960-a58c-428b-a08e-a8500356e686 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:00:55.397039 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-a67b3234-4a0e-4ca3-8b30-a59c54872765 req-a9821960-a58c-428b-a08e-a8500356e686 service nova] Creating event network-changed:76ba2941-9a5d-46b0-b7b5-5193e10136e2 for instance a7d0a9b1-0715-429b-9105-497a544fae53 on n-h1-846435-14 Jul 25 16:00:55.403708 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-a67b3234-4a0e-4ca3-8b30-a59c54872765 req-a9821960-a58c-428b-a08e-a8500356e686 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102057 Jul 25 16:00:55.404669 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4061/7898] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 16:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:02:11.257483 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:02:11.258205 n-d-846435-14 devstack@n-api.service[119303]: Mon Jul 25 16:02:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:02:13.099547 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:02:13.100265 n-d-846435-14 devstack@n-api.service[119304]: Mon Jul 25 16:02:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:02:13.851998 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:02:13.852421 n-d-846435-14 devstack@n-api.service[119304]: Mon Jul 25 16:02:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:02:16.230575 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:02:16.231613 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=58 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:02:16.291135 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-56b3a1f9-5a42-4995-8e15-c41d650dc110 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1079262158"}} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:02:16.293947 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-56b3a1f9-5a42-4995-8e15-c41d650dc110 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: a7d0a9b1-0715-429b-9105-497a544fae53] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:02:16.300544 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56b3a1f9-5a42-4995-8e15-c41d650dc110 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:16.301002 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56b3a1f9-5a42-4995-8e15-c41d650dc110 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:16.301794 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56b3a1f9-5a42-4995-8e15-c41d650dc110 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:16.302230 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-56b3a1f9-5a42-4995-8e15-c41d650dc110 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:16.530035 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-56b3a1f9-5a42-4995-8e15-c41d650dc110 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "POST /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53/action" status: 202 len: 0 microversion: 2.1 time: 0.301147 Jul 25 16:02:16.531050 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3838/7899] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Jul 25 16:02:16 2022] POST /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 16:02:21.366138 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=30 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:02:21.367954 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=42 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:02:21.375748 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-e8834c5a-1ba2-4948-b05a-942173899a4d req-c83e9bce-a3da-4694-a9e7-42803bb17248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7d0a9b1-0715-429b-9105-497a544fae53", "name": "network-vif-plugged", "status": "completed", "tag": "76ba2941-9a5d-46b0-b7b5-5193e10136e2"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:02:21.398437 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-e8834c5a-1ba2-4948-b05a-942173899a4d req-c83e9bce-a3da-4694-a9e7-42803bb17248 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:21.399561 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-e8834c5a-1ba2-4948-b05a-942173899a4d req-c83e9bce-a3da-4694-a9e7-42803bb17248 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:21.425163 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-e8834c5a-1ba2-4948-b05a-942173899a4d req-c83e9bce-a3da-4694-a9e7-42803bb17248 service nova] Creating event network-vif-plugged:76ba2941-9a5d-46b0-b7b5-5193e10136e2 for instance a7d0a9b1-0715-429b-9105-497a544fae53 on n-h1-846435-14 Jul 25 16:02:21.444517 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-e8834c5a-1ba2-4948-b05a-942173899a4d req-c83e9bce-a3da-4694-a9e7-42803bb17248 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081082 Jul 25 16:02:21.449836 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4062/7900] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 16:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:02:31.448001 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_api:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:02:31.450019 n-d-846435-14 devstack@n-api.service[119304]: DEBUG dbcounter [-] [119304] Writing DB stats nova_cell1:SELECT=2 {{(pid=119304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:02:31.450585 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-fc6e2bda-822b-4408-9183-67bdbd01847e req-b7e4eb3a-c715-415c-9f01-8a652430781c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7d0a9b1-0715-429b-9105-497a544fae53", "tag": "76ba2941-9a5d-46b0-b7b5-5193e10136e2"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:02:31.455432 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-ed06597f-6381-468b-998a-02209e4f738a tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:31.456037 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ed06597f-6381-468b-998a-02209e4f738a tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: a7d0a9b1-0715-429b-9105-497a544fae53] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:02:31.459433 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_api:SELECT=2 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:02:31.460239 n-d-846435-14 devstack@n-api.service[119303]: DEBUG dbcounter [-] [119303] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:02:31.465402 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed06597f-6381-468b-998a-02209e4f738a tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:31.465913 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed06597f-6381-468b-998a-02209e4f738a tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:31.466935 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed06597f-6381-468b-998a-02209e4f738a tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:31.467444 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-ed06597f-6381-468b-998a-02209e4f738a tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:31.470335 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-fc6e2bda-822b-4408-9183-67bdbd01847e req-b7e4eb3a-c715-415c-9f01-8a652430781c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:31.470990 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-fc6e2bda-822b-4408-9183-67bdbd01847e req-b7e4eb3a-c715-415c-9f01-8a652430781c service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:31.484782 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-fc6e2bda-822b-4408-9183-67bdbd01847e req-b7e4eb3a-c715-415c-9f01-8a652430781c service nova] Creating event network-changed:76ba2941-9a5d-46b0-b7b5-5193e10136e2 for instance a7d0a9b1-0715-429b-9105-497a544fae53 on n-h1-846435-14 Jul 25 16:02:31.490130 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-fc6e2bda-822b-4408-9183-67bdbd01847e req-b7e4eb3a-c715-415c-9f01-8a652430781c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044136 Jul 25 16:02:31.490734 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3839/7901] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 16:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:02:31.498090 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-ed06597f-6381-468b-998a-02209e4f738a tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: a7d0a9b1-0715-429b-9105-497a544fae53] Going to try to terminate instance {{(pid=119304) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:02:31.597949 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-ed06597f-6381-468b-998a-02209e4f738a tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53" status: 204 len: 0 microversion: 2.1 time: 0.151384 Jul 25 16:02:31.600076 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4063/7902] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 16:02:31 2022] DELETE /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 16:02:31.609278 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-70f1fb93-b4ef-4105-a381-116cbed110ba tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:31.610245 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-70f1fb93-b4ef-4105-a381-116cbed110ba tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: a7d0a9b1-0715-429b-9105-497a544fae53] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:02:31.619641 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70f1fb93-b4ef-4105-a381-116cbed110ba tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:31.620297 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70f1fb93-b4ef-4105-a381-116cbed110ba tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:31.621167 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70f1fb93-b4ef-4105-a381-116cbed110ba tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:31.624493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-70f1fb93-b4ef-4105-a381-116cbed110ba tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:31.773691 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-70f1fb93-b4ef-4105-a381-116cbed110ba tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:02:31.782193 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-70f1fb93-b4ef-4105-a381-116cbed110ba tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53" status: 200 len: 1684 microversion: 2.1 time: 0.178067 Jul 25 16:02:31.782780 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3840/7903] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 16:02:31 2022] GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53 => generated 1684 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:02:32.806892 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-e8efd2d0-b7f3-4b39-ba13-ee4c909f2e8d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:32.808494 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-e8efd2d0-b7f3-4b39-ba13-ee4c909f2e8d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: a7d0a9b1-0715-429b-9105-497a544fae53] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:02:32.818017 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e8efd2d0-b7f3-4b39-ba13-ee4c909f2e8d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:32.818487 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e8efd2d0-b7f3-4b39-ba13-ee4c909f2e8d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:32.819293 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e8efd2d0-b7f3-4b39-ba13-ee4c909f2e8d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:32.819744 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-e8efd2d0-b7f3-4b39-ba13-ee4c909f2e8d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:32.970334 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-e8efd2d0-b7f3-4b39-ba13-ee4c909f2e8d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:02:32.978911 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-e8efd2d0-b7f3-4b39-ba13-ee4c909f2e8d tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53" status: 200 len: 1684 microversion: 2.1 time: 0.177652 Jul 25 16:02:32.979546 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4064/7904] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 16:02:32 2022] GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53 => generated 1684 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:02:33.225742 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [req-0dddd288-44f7-4460-b279-b3d605797dae req-5430c308-24d3-4e3a-a6a3-d82a7397ce86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7d0a9b1-0715-429b-9105-497a544fae53", "name": "network-vif-unplugged", "status": "completed", "tag": "76ba2941-9a5d-46b0-b7b5-5193e10136e2"}]} {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:02:33.237638 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-0dddd288-44f7-4460-b279-b3d605797dae req-5430c308-24d3-4e3a-a6a3-d82a7397ce86 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:33.238197 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [req-0dddd288-44f7-4460-b279-b3d605797dae req-5430c308-24d3-4e3a-a6a3-d82a7397ce86 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:33.250446 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.compute.server_external_events [req-0dddd288-44f7-4460-b279-b3d605797dae req-5430c308-24d3-4e3a-a6a3-d82a7397ce86 service nova] Creating event network-vif-unplugged:76ba2941-9a5d-46b0-b7b5-5193e10136e2 for instance a7d0a9b1-0715-429b-9105-497a544fae53 on n-h1-846435-14 Jul 25 16:02:33.255736 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [req-0dddd288-44f7-4460-b279-b3d605797dae req-5430c308-24d3-4e3a-a6a3-d82a7397ce86 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033798 Jul 25 16:02:33.256367 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3841/7905] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 16:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:02:33.902522 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-a48f3e30-bdd5-4ee0-afb7-f5bc44effb08 req-c426477a-cbd2-40e1-a655-e9ab33a7ced2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7d0a9b1-0715-429b-9105-497a544fae53", "name": "network-vif-deleted", "tag": "76ba2941-9a5d-46b0-b7b5-5193e10136e2"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:02:33.917555 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a48f3e30-bdd5-4ee0-afb7-f5bc44effb08 req-c426477a-cbd2-40e1-a655-e9ab33a7ced2 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:33.918196 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-a48f3e30-bdd5-4ee0-afb7-f5bc44effb08 req-c426477a-cbd2-40e1-a655-e9ab33a7ced2 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:33.934704 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-a48f3e30-bdd5-4ee0-afb7-f5bc44effb08 req-c426477a-cbd2-40e1-a655-e9ab33a7ced2 service nova] Creating event network-vif-deleted:76ba2941-9a5d-46b0-b7b5-5193e10136e2 for instance a7d0a9b1-0715-429b-9105-497a544fae53 on n-h1-846435-14 Jul 25 16:02:33.941222 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-a48f3e30-bdd5-4ee0-afb7-f5bc44effb08 req-c426477a-cbd2-40e1-a655-e9ab33a7ced2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042501 Jul 25 16:02:33.942234 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4065/7906] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 16:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:02:34.001425 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-5bc00f54-33d6-4a8f-b969-7df8dd2c2b6c tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:34.002282 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-5bc00f54-33d6-4a8f-b969-7df8dd2c2b6c tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: a7d0a9b1-0715-429b-9105-497a544fae53] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:02:34.008946 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5bc00f54-33d6-4a8f-b969-7df8dd2c2b6c tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:34.009413 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5bc00f54-33d6-4a8f-b969-7df8dd2c2b6c tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:34.010200 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5bc00f54-33d6-4a8f-b969-7df8dd2c2b6c tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:34.010646 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5bc00f54-33d6-4a8f-b969-7df8dd2c2b6c tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:34.047013 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5bc00f54-33d6-4a8f-b969-7df8dd2c2b6c tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:34.047475 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-5bc00f54-33d6-4a8f-b969-7df8dd2c2b6c tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:34.047937 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.objects.instance [None req-5bc00f54-33d6-4a8f-b969-7df8dd2c2b6c tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lazy-loading 'fault' on Instance uuid a7d0a9b1-0715-429b-9105-497a544fae53 {{(pid=119303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:02:34.091512 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-5bc00f54-33d6-4a8f-b969-7df8dd2c2b6c tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:02:34.099948 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-5bc00f54-33d6-4a8f-b969-7df8dd2c2b6c tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53" status: 200 len: 1339 microversion: 2.1 time: 0.102872 Jul 25 16:02:34.100504 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3842/7907] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 16:02:33 2022] GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53 => generated 1339 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:02:35.122551 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-91a6366a-d3e6-4d31-80a8-ee9978ba8add tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:35.123320 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-91a6366a-d3e6-4d31-80a8-ee9978ba8add tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: a7d0a9b1-0715-429b-9105-497a544fae53] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:02:35.131471 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-91a6366a-d3e6-4d31-80a8-ee9978ba8add tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:35.131931 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-91a6366a-d3e6-4d31-80a8-ee9978ba8add tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:35.132785 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-91a6366a-d3e6-4d31-80a8-ee9978ba8add tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:35.133246 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-91a6366a-d3e6-4d31-80a8-ee9978ba8add tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:35.148997 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.wsgi [None req-91a6366a-d3e6-4d31-80a8-ee9978ba8add tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] HTTP exception thrown: Instance a7d0a9b1-0715-429b-9105-497a544fae53 could not be found. Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-91a6366a-d3e6-4d31-80a8-ee9978ba8add tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Request method failure captured: Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: request: GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53 HTTP/1.1 Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: Accept: application/json Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: Accept-Encoding: identity Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: Connection: close Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: Content-Length: 0 Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: Content-Type: application/json Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: Host: 10.222.0.88 Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: Openstack-System-Scope: None Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: User-Agent: python-urllib3/1.26.10 Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: X-Auth-Token: gAAAAABi3r1O7GXlBaTpB5nBzNiRsEyW-u9hAMbsfy57qR6puB0qqPRDwMmWeuSpdI6XAEC16k462i2rCwlzllqqeKOU8hQSa9SnqW28ASCrv7y4oGUiBp9SDNfYxOTB9J_94wrqm1f2dPUJFI8cvw-qAwkvICuXScBuI-HfHFym5qKUwaApr88 Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Id: None Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: X-Domain-Name: None Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: X-Identity-Status: Confirmed Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: X-Is-Admin-Project: True Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Id: default Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Domain-Name: Default Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Id: 4b5a27c71cdb4556a4b3ac246a55d448 Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: X-Project-Name: tempest-TestSnapshotPattern-358668068 Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: X-Role: reader,member Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: X-Roles: reader,member Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/4b5a27c71cdb4556a4b3ac246a55d448"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/4b5a27c71cdb4556a4b3ac246a55d448"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_4b5a27c71cdb4556a4b3ac246a55d448", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/4b5a27c71cdb4556a4b3ac246a55d448"}]}] Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant: tempest-TestSnapshotPattern-358668068 Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Id: 4b5a27c71cdb4556a4b3ac246a55d448 Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: X-Tenant-Name: tempest-TestSnapshotPattern-358668068 Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: X-User: tempest-TestSnapshotPattern-358668068-project Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Id: default Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: X-User-Domain-Name: Default Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: X-User-Id: da3b5892413b401e9c0c97f68e56195e Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: X-User-Name: tempest-TestSnapshotPattern-358668068-project Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: method: > Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: exception: Instance a7d0a9b1-0715-429b-9105-497a544fae53 could not be found. Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: action_args: {'id': 'a7d0a9b1-0715-429b-9105-497a544fae53'} Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7d0a9b1-0715-429b-9105-497a544fae53 could not be found. Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7d0a9b1-0715-429b-9105-497a544fae53 could not be found. Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:02:35.150758 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 16:02:35.155887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:35.155887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:02:35.155887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:02:35.155887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:02:35.155887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:02:35.155887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7d0a9b1-0715-429b-9105-497a544fae53 could not be found. Jul 25 16:02:35.155887 n-d-846435-14 devstack@n-api.service[119304]: ERROR nova.api.openstack.wsgi Jul 25 16:02:35.155887 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-91a6366a-d3e6-4d31-80a8-ee9978ba8add tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Returning 404 to user: Instance a7d0a9b1-0715-429b-9105-497a544fae53 could not be found. {{(pid=119304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:02:35.155887 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-91a6366a-d3e6-4d31-80a8-ee9978ba8add tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53" status: 404 len: 111 microversion: 2.1 time: 0.034083 Jul 25 16:02:35.155887 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4066/7908] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 16:02:35 2022] GET /compute/v2.1/servers/a7d0a9b1-0715-429b-9105-497a544fae53 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:02:36.615672 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-b367a845-04bd-4ac8-ae5c-f00c3bc68982 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:36.616268 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b367a845-04bd-4ac8-ae5c-f00c3bc68982 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: 43cd620c-c269-4535-a4fe-a7db2c99dbf6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:02:36.618237 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-559eb61c-b4b6-4ca7-b428-375514d6f6d2 req-c1452425-2706-44f1-a390-f78d70ddf2a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43cd620c-c269-4535-a4fe-a7db2c99dbf6", "tag": "36236c97-d3fe-45d3-906c-9e16c8a98f19"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:02:36.623678 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b367a845-04bd-4ac8-ae5c-f00c3bc68982 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:36.624177 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b367a845-04bd-4ac8-ae5c-f00c3bc68982 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:36.624960 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b367a845-04bd-4ac8-ae5c-f00c3bc68982 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:36.625618 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-b367a845-04bd-4ac8-ae5c-f00c3bc68982 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:36.629903 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-559eb61c-b4b6-4ca7-b428-375514d6f6d2 req-c1452425-2706-44f1-a390-f78d70ddf2a2 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:36.630362 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-559eb61c-b4b6-4ca7-b428-375514d6f6d2 req-c1452425-2706-44f1-a390-f78d70ddf2a2 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:36.643887 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-559eb61c-b4b6-4ca7-b428-375514d6f6d2 req-c1452425-2706-44f1-a390-f78d70ddf2a2 service nova] Creating event network-changed:36236c97-d3fe-45d3-906c-9e16c8a98f19 for instance 43cd620c-c269-4535-a4fe-a7db2c99dbf6 on n-h2-846435-14 Jul 25 16:02:36.650237 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-559eb61c-b4b6-4ca7-b428-375514d6f6d2 req-c1452425-2706-44f1-a390-f78d70ddf2a2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035634 Jul 25 16:02:36.651148 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4067/7909] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 16:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:02:36.655267 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-b367a845-04bd-4ac8-ae5c-f00c3bc68982 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: 43cd620c-c269-4535-a4fe-a7db2c99dbf6] Going to try to terminate instance {{(pid=119303) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:02:36.749242 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-b367a845-04bd-4ac8-ae5c-f00c3bc68982 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "DELETE /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6" status: 204 len: 0 microversion: 2.1 time: 0.137223 Jul 25 16:02:36.750067 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3843/7910] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Jul 25 16:02:36 2022] DELETE /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:02:36.759564 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-af7c6d2b-651b-4f6f-b8f6-d0b7b299b872 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:36.760329 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.compute.api [None req-af7c6d2b-651b-4f6f-b8f6-d0b7b299b872 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: 43cd620c-c269-4535-a4fe-a7db2c99dbf6] Fetching instance by UUID {{(pid=119304) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:02:36.767369 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af7c6d2b-651b-4f6f-b8f6-d0b7b299b872 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:36.767822 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af7c6d2b-651b-4f6f-b8f6-d0b7b299b872 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:36.768840 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af7c6d2b-651b-4f6f-b8f6-d0b7b299b872 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:36.769339 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [None req-af7c6d2b-651b-4f6f-b8f6-d0b7b299b872 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:36.921799 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.policy [None req-af7c6d2b-651b-4f6f-b8f6-d0b7b299b872 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119304) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:02:36.929966 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-af7c6d2b-651b-4f6f-b8f6-d0b7b299b872 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6" status: 200 len: 1684 microversion: 2.1 time: 0.174876 Jul 25 16:02:36.930710 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4068/7911] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 16:02:36 2022] GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6 => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:02:37.958109 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-ec7b2a14-9bda-4721-8f10-114ef49893cb tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:37.959491 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-ec7b2a14-9bda-4721-8f10-114ef49893cb tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: 43cd620c-c269-4535-a4fe-a7db2c99dbf6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:02:37.967399 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec7b2a14-9bda-4721-8f10-114ef49893cb tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:37.968264 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec7b2a14-9bda-4721-8f10-114ef49893cb tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:37.969061 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec7b2a14-9bda-4721-8f10-114ef49893cb tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:37.969493 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-ec7b2a14-9bda-4721-8f10-114ef49893cb tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:38.040239 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.policy [None req-ec7b2a14-9bda-4721-8f10-114ef49893cb tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da3b5892413b401e9c0c97f68e56195e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5a27c71cdb4556a4b3ac246a55d448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119303) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:02:38.048459 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-ec7b2a14-9bda-4721-8f10-114ef49893cb tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6" status: 200 len: 1497 microversion: 2.1 time: 0.100055 Jul 25 16:02:38.049051 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3844/7912] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 16:02:37 2022] GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6 => generated 1497 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:02:38.087495 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [req-97735322-1a9b-4588-ada8-484e3938cce9 req-4feb238d-3745-4083-847e-1ca89e250fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43cd620c-c269-4535-a4fe-a7db2c99dbf6", "name": "network-vif-deleted", "tag": "36236c97-d3fe-45d3-906c-9e16c8a98f19"}]} {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:02:38.097757 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-97735322-1a9b-4588-ada8-484e3938cce9 req-4feb238d-3745-4083-847e-1ca89e250fd4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:38.098210 n-d-846435-14 devstack@n-api.service[119304]: DEBUG oslo_concurrency.lockutils [req-97735322-1a9b-4588-ada8-484e3938cce9 req-4feb238d-3745-4083-847e-1ca89e250fd4 service nova] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:38.110437 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.compute.server_external_events [req-97735322-1a9b-4588-ada8-484e3938cce9 req-4feb238d-3745-4083-847e-1ca89e250fd4 service nova] Creating event network-vif-deleted:36236c97-d3fe-45d3-906c-9e16c8a98f19 for instance 43cd620c-c269-4535-a4fe-a7db2c99dbf6 on n-h2-846435-14 Jul 25 16:02:38.115594 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [req-97735322-1a9b-4588-ada8-484e3938cce9 req-4feb238d-3745-4083-847e-1ca89e250fd4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031841 Jul 25 16:02:38.116267 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4069/7913] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Jul 25 16:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:02:39.071916 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-30bd6600-b85d-488b-9750-fa62b5db6c35 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '>' {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:39.072559 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.compute.api [None req-30bd6600-b85d-488b-9750-fa62b5db6c35 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] [instance: 43cd620c-c269-4535-a4fe-a7db2c99dbf6] Fetching instance by UUID {{(pid=119303) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:02:39.083592 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-30bd6600-b85d-488b-9750-fa62b5db6c35 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:39.084261 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-30bd6600-b85d-488b-9750-fa62b5db6c35 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:39.085345 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-30bd6600-b85d-488b-9750-fa62b5db6c35 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:02:39.085835 n-d-846435-14 devstack@n-api.service[119303]: DEBUG oslo_concurrency.lockutils [None req-30bd6600-b85d-488b-9750-fa62b5db6c35 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Lock "cadb07ed-5464-41eb-afb8-bf9dd92401b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:02:39.102111 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.wsgi [None req-30bd6600-b85d-488b-9750-fa62b5db6c35 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] HTTP exception thrown: Instance 43cd620c-c269-4535-a4fe-a7db2c99dbf6 could not be found. Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-30bd6600-b85d-488b-9750-fa62b5db6c35 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Request method failure captured: Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: request: GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6 HTTP/1.1 Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: Accept: application/json Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: Accept-Encoding: identity Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: Connection: close Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: Content-Length: 0 Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: Content-Type: application/json Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: Host: 10.222.0.88 Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: Openstack-System-Scope: None Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: User-Agent: python-urllib3/1.26.10 Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: X-Auth-Token: gAAAAABi3r1O7GXlBaTpB5nBzNiRsEyW-u9hAMbsfy57qR6puB0qqPRDwMmWeuSpdI6XAEC16k462i2rCwlzllqqeKOU8hQSa9SnqW28ASCrv7y4oGUiBp9SDNfYxOTB9J_94wrqm1f2dPUJFI8cvw-qAwkvICuXScBuI-HfHFym5qKUwaApr88 Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Id: None Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: X-Domain-Name: None Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: X-Identity-Status: Confirmed Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: X-Is-Admin-Project: True Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Id: default Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Domain-Name: Default Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Id: 4b5a27c71cdb4556a4b3ac246a55d448 Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: X-Project-Name: tempest-TestSnapshotPattern-358668068 Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: X-Role: reader,member Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: X-Roles: reader,member Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/4b5a27c71cdb4556a4b3ac246a55d448"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/4b5a27c71cdb4556a4b3ac246a55d448"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_4b5a27c71cdb4556a4b3ac246a55d448", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/4b5a27c71cdb4556a4b3ac246a55d448"}]}] Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant: tempest-TestSnapshotPattern-358668068 Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Id: 4b5a27c71cdb4556a4b3ac246a55d448 Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: X-Tenant-Name: tempest-TestSnapshotPattern-358668068 Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: X-User: tempest-TestSnapshotPattern-358668068-project Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Id: default Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: X-User-Domain-Name: Default Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: X-User-Id: da3b5892413b401e9c0c97f68e56195e Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: X-User-Name: tempest-TestSnapshotPattern-358668068-project Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: method: > Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: exception: Instance 43cd620c-c269-4535-a4fe-a7db2c99dbf6 could not be found. Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: action_args: {'id': '43cd620c-c269-4535-a4fe-a7db2c99dbf6'} Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: {{(pid=119303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43cd620c-c269-4535-a4fe-a7db2c99dbf6 could not be found. Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43cd620c-c269-4535-a4fe-a7db2c99dbf6 could not be found. Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:02:39.103793 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 16:02:39.110458 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:02:39.110458 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:02:39.110458 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:02:39.110458 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:02:39.110458 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:02:39.110458 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43cd620c-c269-4535-a4fe-a7db2c99dbf6 could not be found. Jul 25 16:02:39.110458 n-d-846435-14 devstack@n-api.service[119303]: ERROR nova.api.openstack.wsgi Jul 25 16:02:39.110458 n-d-846435-14 devstack@n-api.service[119303]: DEBUG nova.api.openstack.wsgi [None req-30bd6600-b85d-488b-9750-fa62b5db6c35 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Returning 404 to user: Instance 43cd620c-c269-4535-a4fe-a7db2c99dbf6 could not be found. {{(pid=119303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:02:39.110458 n-d-846435-14 devstack@n-api.service[119303]: INFO nova.api.openstack.requestlog [None req-30bd6600-b85d-488b-9750-fa62b5db6c35 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6" status: 404 len: 111 microversion: 2.1 time: 0.039058 Jul 25 16:02:39.110458 n-d-846435-14 devstack@n-api.service[119303]: [pid: 119303|app: 0|req: 3845/7914] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Jul 25 16:02:39 2022] GET /compute/v2.1/servers/43cd620c-c269-4535-a4fe-a7db2c99dbf6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:02:39.304051 n-d-846435-14 devstack@n-api.service[119304]: DEBUG nova.api.openstack.wsgi [None req-c0026571-3627-438d-b8e2-bb2c30accd40 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] Calling method '.version_select at 0x7f46878f1f70>' {{(pid=119304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:02:39.330133 n-d-846435-14 devstack@n-api.service[119304]: INFO nova.api.openstack.requestlog [None req-c0026571-3627-438d-b8e2-bb2c30accd40 tempest-TestSnapshotPattern-358668068 tempest-TestSnapshotPattern-358668068-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1257169491" status: 202 len: 0 microversion: 2.1 time: 0.031374 Jul 25 16:02:39.330866 n-d-846435-14 devstack@n-api.service[119304]: [pid: 119304|app: 0|req: 4070/7915] 10.222.0.88 () {58 vars in 1257 bytes} [Mon Jul 25 16:02:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1257169491 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:03:51.347005 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:03:51.348251 n-d-846435-14 devstack@n-api.service[119303]: Mon Jul 25 16:03:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:05:31.269185 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:05:31.270037 n-d-846435-14 devstack@n-api.service[119303]: Mon Jul 25 16:05:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:05:33.109720 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:05:33.110322 n-d-846435-14 devstack@n-api.service[119304]: Mon Jul 25 16:05:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:05:33.861707 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:05:33.861967 n-d-846435-14 devstack@n-api.service[119304]: Mon Jul 25 16:05:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:05:50.392670 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:05:50.393391 n-d-846435-14 devstack@n-api.service[119304]: Mon Jul 25 16:05:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:07:11.357788 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:07:11.358457 n-d-846435-14 devstack@n-api.service[119303]: Mon Jul 25 16:07:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:07:47.817561 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:07:47.818528 n-d-846435-14 devstack@n-api.service[119303]: Mon Jul 25 16:07:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:08:51.280193 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:08:51.280935 n-d-846435-14 devstack@n-api.service[119303]: Mon Jul 25 16:08:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:08:53.120583 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:08:53.121225 n-d-846435-14 devstack@n-api.service[119304]: Mon Jul 25 16:08:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:08:53.871625 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:08:53.871933 n-d-846435-14 devstack@n-api.service[119304]: Mon Jul 25 16:08:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:09:10.403113 n-d-846435-14 devstack@n-api.service[119304]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:09:10.403960 n-d-846435-14 devstack@n-api.service[119304]: Mon Jul 25 16:09:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:10:31.368623 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:10:31.369304 n-d-846435-14 devstack@n-api.service[119303]: Mon Jul 25 16:10:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:11:07.828333 n-d-846435-14 devstack@n-api.service[119303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:11:07.829325 n-d-846435-14 devstack@n-api.service[119303]: Mon Jul 25 16:11:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!